2024-12-17T23:52:54.5940869Z Current runner version: '2.321.0' 2024-12-17T23:52:54.5949026Z Runner name: 'i-0dcf3a01d7b6a24eb' 2024-12-17T23:52:54.5950021Z Runner group name: 'Default' 2024-12-17T23:52:54.5951031Z Machine name: 'ip-10-0-12-55' 2024-12-17T23:52:54.5956373Z ##[group]GITHUB_TOKEN Permissions 2024-12-17T23:52:54.5959011Z Actions: read 2024-12-17T23:52:54.5959699Z Attestations: read 2024-12-17T23:52:54.5960420Z Checks: read 2024-12-17T23:52:54.5961062Z Contents: read 2024-12-17T23:52:54.5961695Z Deployments: read 2024-12-17T23:52:54.5962380Z Discussions: read 2024-12-17T23:52:54.5963018Z Issues: read 2024-12-17T23:52:54.5963619Z Metadata: read 2024-12-17T23:52:54.5964260Z Packages: read 2024-12-17T23:52:54.5964886Z Pages: read 2024-12-17T23:52:54.5965492Z PullRequests: read 2024-12-17T23:52:54.5966209Z RepositoryProjects: read 2024-12-17T23:52:54.5966905Z SecurityEvents: read 2024-12-17T23:52:54.5967496Z Statuses: read 2024-12-17T23:52:54.5968163Z ##[endgroup] 2024-12-17T23:52:54.5971640Z Secret source: Actions 2024-12-17T23:52:54.5972740Z Prepare workflow directory 2024-12-17T23:52:54.8912324Z Prepare all required actions 2024-12-17T23:52:54.8953490Z Getting action download info 2024-12-17T23:52:55.0987894Z Download action repository 'pytorch/test-infra@release/2.6' (SHA:eb0adf5a84668865394af69e26428b32c8105c1c) 2024-12-17T23:52:56.6607370Z Download action repository 'pytorch/pytorch@release/2.6' (SHA:0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-17T23:53:09.3155387Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-12-17T23:53:09.4979609Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-12-17T23:53:09.7476565Z Getting action download info 2024-12-17T23:53:09.8579838Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-12-17T23:53:10.1769297Z Getting action download info 2024-12-17T23:53:10.2855781Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2024-12-17T23:53:10.4620608Z Getting action download info 2024-12-17T23:53:10.5813310Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-12-17T23:53:10.7224615Z Getting action download info 2024-12-17T23:53:10.8383869Z Download action repository 'pytorch/test-infra@main' (SHA:a07505a74641a4ff5123d635defac481ef28ef1e) 2024-12-17T23:53:12.2955182Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/release/2.6 (0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-17T23:53:12.2957439Z ##[group] Inputs 2024-12-17T23:53:12.2957794Z build-environment: linux-focal-py3.9-clang9-xla 2024-12-17T23:53:12.2958350Z test-matrix: {"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "linux.12xlarge"}]} 2024-12-17T23:53:12.2959051Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:53:12.2959548Z sync-tag: 2024-12-17T23:53:12.2960300Z timeout-minutes: 240 2024-12-17T23:53:12.2960570Z use-gha: 2024-12-17T23:53:12.2960800Z dashboard-tag: 2024-12-17T23:53:12.2961056Z s3-bucket: gha-artifacts 2024-12-17T23:53:12.2961322Z aws-role-to-assume: 2024-12-17T23:53:12.2962001Z disable-monitor: false 2024-12-17T23:53:12.2962294Z ##[endgroup] 2024-12-17T23:53:12.2962693Z Complete job name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-17T23:53:12.3538249Z A job started hook has been configured by the self-hosted runner administrator 2024-12-17T23:53:12.3634556Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-12-17T23:53:12.3642743Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:53:12.3643371Z ##[endgroup] 2024-12-17T23:53:14.3601742Z Runner Type: linux.12xlarge 2024-12-17T23:53:14.3602183Z Instance Type: c5.12xlarge 2024-12-17T23:53:14.3602561Z AMI Name: unknown 2024-12-17T23:53:14.3626422Z AMI ID: ami-0fff1b9a61dec8a5f 2024-12-17T23:53:19.6584510Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@release/2.6 2024-12-17T23:53:19.6585034Z with: 2024-12-17T23:53:19.6585765Z github-secret: *** 2024-12-17T23:53:19.6586531Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-12-17T23:53:19.6587343Z activate-with-label: false 2024-12-17T23:53:19.6587648Z label: with-ssh 2024-12-17T23:53:19.6587903Z remove-existing-keys: true 2024-12-17T23:53:19.6588207Z fail-silently: true 2024-12-17T23:53:19.6588608Z env: 2024-12-17T23:53:19.6588831Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:53:19.6589106Z ##[endgroup] 2024-12-17T23:53:19.7649884Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-12-17T23:53:19.7650841Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys 2024-12-17T23:53:19.7780108Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@release/2.6 2024-12-17T23:53:19.7780617Z with: 2024-12-17T23:53:19.7780841Z no-sudo: true 2024-12-17T23:53:19.7781099Z submodules: recursive 2024-12-17T23:53:19.7781385Z fetch-depth: 0 2024-12-17T23:53:19.7781638Z env: 2024-12-17T23:53:19.7781859Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:53:19.7782148Z ##[endgroup] 2024-12-17T23:53:19.7868605Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-17T23:53:19.7869644Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-17T23:53:19.7878020Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:53:19.7878501Z env: 2024-12-17T23:53:19.7878805Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:53:19.7879220Z ##[endgroup] 2024-12-17T23:53:19.7971560Z ##[group]Run retry () { 2024-12-17T23:53:19.7971876Z retry () { 2024-12-17T23:53:19.7972271Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-12-17T23:53:19.7972718Z } 2024-12-17T23:53:19.7972977Z echo "${GITHUB_WORKSPACE}" 2024-12-17T23:53:19.7973326Z if [ -z "${NO_SUDO}" ]; then 2024-12-17T23:53:19.7973767Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-12-17T23:53:19.7974150Z else 2024-12-17T23:53:19.7974434Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-12-17T23:53:19.7974773Z fi 2024-12-17T23:53:19.7975035Z mkdir "${GITHUB_WORKSPACE}" 2024-12-17T23:53:19.7980463Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:53:19.7980877Z env: 2024-12-17T23:53:19.7981119Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:53:19.7981392Z NO_SUDO: true 2024-12-17T23:53:19.7981645Z ##[endgroup] 2024-12-17T23:53:19.8003494Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-17T23:53:21.9923466Z ##[group]Run malfet/checkout@silent-checkout 2024-12-17T23:53:21.9923819Z with: 2024-12-17T23:53:21.9924068Z ref: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-17T23:53:21.9924394Z fetch-depth: 0 2024-12-17T23:53:21.9924635Z submodules: recursive 2024-12-17T23:53:21.9924877Z quiet-checkout: true 2024-12-17T23:53:21.9925138Z repository: pytorch/pytorch 2024-12-17T23:53:21.9925518Z token: *** 2024-12-17T23:53:21.9925742Z ssh-strict: true 2024-12-17T23:53:21.9925992Z persist-credentials: true 2024-12-17T23:53:21.9926260Z clean: true 2024-12-17T23:53:21.9926492Z sparse-checkout-cone-mode: true 2024-12-17T23:53:21.9926787Z lfs: false 2024-12-17T23:53:21.9927015Z set-safe-directory: true 2024-12-17T23:53:21.9927275Z env: 2024-12-17T23:53:21.9927477Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:53:21.9927734Z ##[endgroup] 2024-12-17T23:53:22.0760727Z Syncing repository: pytorch/pytorch 2024-12-17T23:53:22.0762022Z ##[group]Getting Git version info 2024-12-17T23:53:22.0762561Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-17T23:53:22.0763523Z [command]/usr/bin/git version 2024-12-17T23:53:22.0763813Z git version 2.40.1 2024-12-17T23:53:22.0781268Z ##[endgroup] 2024-12-17T23:53:22.0796198Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/895535a5-b908-44f2-be7e-df058baf9d90' before making global git config changes 2024-12-17T23:53:22.0797192Z Adding repository directory to the temporary git global config as a safe directory 2024-12-17T23:53:22.0799323Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-17T23:53:22.0825898Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-17T23:53:22.0828834Z ##[group]Initializing the repository 2024-12-17T23:53:22.0831266Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-17T23:53:22.0854169Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-12-17T23:53:22.0854810Z hint: is subject to change. To configure the initial branch name to use in all 2024-12-17T23:53:22.0855389Z hint: of your new repositories, which will suppress this warning, call: 2024-12-17T23:53:22.0855827Z hint: 2024-12-17T23:53:22.0856131Z hint: git config --global init.defaultBranch 2024-12-17T23:53:22.0856589Z hint: 2024-12-17T23:53:22.0856945Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-12-17T23:53:22.0857528Z hint: 'development'. The just-created branch can be renamed via this command: 2024-12-17T23:53:22.0857990Z hint: 2024-12-17T23:53:22.0858228Z hint: git branch -m 2024-12-17T23:53:22.0858776Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-12-17T23:53:22.0863732Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-12-17T23:53:22.0887186Z ##[endgroup] 2024-12-17T23:53:22.0887671Z ##[group]Disabling automatic garbage collection 2024-12-17T23:53:22.0888112Z [command]/usr/bin/git config --local gc.auto 0 2024-12-17T23:53:22.0911843Z ##[endgroup] 2024-12-17T23:53:22.0912288Z ##[group]Setting up auth 2024-12-17T23:53:22.0915110Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-17T23:53:22.0937077Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-17T23:53:22.1201352Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-17T23:53:22.1222309Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-17T23:53:22.1481008Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-17T23:53:22.1518977Z ##[endgroup] 2024-12-17T23:53:22.1519459Z ##[group]Fetching the repository 2024-12-17T23:53:22.1523059Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-12-17T23:53:25.1479003Z remote: Enumerating objects: 1056385 2024-12-17T23:53:25.1480285Z remote: Enumerating objects: 1057255, done. 2024-12-17T23:53:25.1481643Z remote: Counting objects: 0% (1/870) 2024-12-17T23:53:25.1482508Z remote: Counting objects: 1% (9/870) 2024-12-17T23:53:25.1482929Z remote: Counting objects: 2% (18/870) 2024-12-17T23:53:25.1483561Z remote: Counting objects: 3% (27/870) 2024-12-17T23:53:25.1484223Z remote: Counting objects: 4% (35/870) 2024-12-17T23:53:25.1484956Z remote: Counting objects: 5% (44/870) 2024-12-17T23:53:25.1485471Z remote: Counting objects: 6% (53/870) 2024-12-17T23:53:25.1486200Z remote: Counting objects: 7% (61/870) 2024-12-17T23:53:25.1487357Z remote: Counting objects: 8% (70/870) 2024-12-17T23:53:25.1488038Z remote: Counting objects: 9% (79/870) 2024-12-17T23:53:25.1488567Z remote: Counting objects: 10% (87/870) 2024-12-17T23:53:25.1489266Z remote: Counting objects: 11% (96/870) 2024-12-17T23:53:25.1489904Z remote: Counting objects: 12% (105/870) 2024-12-17T23:53:25.1490670Z remote: Counting objects: 13% (114/870) 2024-12-17T23:53:25.1491082Z remote: Counting objects: 14% (122/870) 2024-12-17T23:53:25.1491487Z remote: Counting objects: 15% (131/870) 2024-12-17T23:53:25.1491871Z remote: Counting objects: 16% (140/870) 2024-12-17T23:53:25.1492280Z remote: Counting objects: 17% (148/870) 2024-12-17T23:53:25.1492688Z remote: Counting objects: 18% (157/870) 2024-12-17T23:53:25.1493095Z remote: Counting objects: 19% (166/870) 2024-12-17T23:53:25.1493694Z remote: Counting objects: 20% (174/870) 2024-12-17T23:53:25.1494096Z remote: Counting objects: 21% (183/870) 2024-12-17T23:53:25.1494504Z remote: Counting objects: 22% (192/870) 2024-12-17T23:53:25.1494913Z remote: Counting objects: 23% (201/870) 2024-12-17T23:53:25.1495320Z remote: Counting objects: 24% (209/870) 2024-12-17T23:53:25.1495730Z remote: Counting objects: 25% (218/870) 2024-12-17T23:53:25.1496131Z remote: Counting objects: 26% (227/870) 2024-12-17T23:53:25.1496759Z remote: Counting objects: 27% (235/870) 2024-12-17T23:53:25.1497223Z remote: Counting objects: 28% (244/870) 2024-12-17T23:53:25.1497626Z remote: Counting objects: 29% (253/870) 2024-12-17T23:53:25.1498030Z remote: Counting objects: 30% (261/870) 2024-12-17T23:53:25.1498437Z remote: Counting objects: 31% (270/870) 2024-12-17T23:53:25.1498823Z remote: Counting objects: 32% (279/870) 2024-12-17T23:53:25.1499232Z remote: Counting objects: 33% (288/870) 2024-12-17T23:53:25.1499641Z remote: Counting objects: 34% (296/870) 2024-12-17T23:53:25.1500041Z remote: Counting objects: 35% (305/870) 2024-12-17T23:53:25.1500441Z remote: Counting objects: 36% (314/870) 2024-12-17T23:53:25.1500826Z remote: Counting objects: 37% (322/870) 2024-12-17T23:53:25.1501228Z remote: Counting objects: 38% (331/870) 2024-12-17T23:53:25.1501628Z remote: Counting objects: 39% (340/870) 2024-12-17T23:53:25.1502027Z remote: Counting objects: 40% (348/870) 2024-12-17T23:53:25.1502428Z remote: Counting objects: 41% (357/870) 2024-12-17T23:53:25.1502827Z remote: Counting objects: 42% (366/870) 2024-12-17T23:53:25.1503209Z remote: Counting objects: 43% (375/870) 2024-12-17T23:53:25.1503611Z remote: Counting objects: 44% (383/870) 2024-12-17T23:53:25.1504010Z remote: Counting objects: 45% (392/870) 2024-12-17T23:53:25.1504412Z remote: Counting objects: 46% (401/870) 2024-12-17T23:53:25.1504809Z remote: Counting objects: 47% (409/870) 2024-12-17T23:53:25.1505198Z remote: Counting objects: 48% (418/870) 2024-12-17T23:53:25.1505599Z remote: Counting objects: 49% (427/870) 2024-12-17T23:53:25.1506002Z remote: Counting objects: 50% (435/870) 2024-12-17T23:53:25.1506404Z remote: Counting objects: 51% (444/870) 2024-12-17T23:53:25.1506804Z remote: Counting objects: 52% (453/870) 2024-12-17T23:53:25.1507187Z remote: Counting objects: 53% (462/870) 2024-12-17T23:53:25.1507591Z remote: Counting objects: 54% (470/870) 2024-12-17T23:53:25.1508000Z remote: Counting objects: 55% (479/870) 2024-12-17T23:53:25.1508406Z remote: Counting objects: 56% (488/870) 2024-12-17T23:53:25.1508805Z remote: Counting objects: 57% (496/870) 2024-12-17T23:53:25.1509185Z remote: Counting objects: 58% (505/870) 2024-12-17T23:53:25.1509588Z remote: Counting objects: 59% (514/870) 2024-12-17T23:53:25.1509989Z remote: Counting objects: 60% (522/870) 2024-12-17T23:53:25.1510509Z remote: Counting objects: 61% (531/870) 2024-12-17T23:53:25.1510913Z remote: Counting objects: 62% (540/870) 2024-12-17T23:53:25.1511358Z remote: Counting objects: 63% (549/870) 2024-12-17T23:53:25.1511775Z remote: Counting objects: 64% (557/870) 2024-12-17T23:53:25.1512160Z remote: Counting objects: 65% (566/870) 2024-12-17T23:53:25.1512564Z remote: Counting objects: 66% (575/870) 2024-12-17T23:53:25.1512976Z remote: Counting objects: 67% (583/870) 2024-12-17T23:53:25.1513375Z remote: Counting objects: 68% (592/870) 2024-12-17T23:53:25.1513779Z remote: Counting objects: 69% (601/870) 2024-12-17T23:53:25.1514162Z remote: Counting objects: 70% (609/870) 2024-12-17T23:53:25.1514569Z remote: Counting objects: 71% (618/870) 2024-12-17T23:53:25.1514975Z remote: Counting objects: 72% (627/870) 2024-12-17T23:53:25.1515458Z remote: Counting objects: 73% (636/870) 2024-12-17T23:53:25.1515869Z remote: Counting objects: 74% (644/870) 2024-12-17T23:53:25.1516269Z remote: Counting objects: 75% (653/870) 2024-12-17T23:53:25.1516649Z remote: Counting objects: 76% (662/870) 2024-12-17T23:53:25.1517050Z remote: Counting objects: 77% (670/870) 2024-12-17T23:53:25.1517448Z remote: Counting objects: 78% (679/870) 2024-12-17T23:53:25.1517848Z remote: Counting objects: 79% (688/870) 2024-12-17T23:53:25.1518261Z remote: Counting objects: 80% (696/870) 2024-12-17T23:53:25.1518663Z remote: Counting objects: 81% (705/870) 2024-12-17T23:53:25.1519069Z remote: Counting objects: 82% (714/870) 2024-12-17T23:53:25.1519477Z remote: Counting objects: 83% (723/870) 2024-12-17T23:53:25.1519887Z remote: Counting objects: 84% (731/870) 2024-12-17T23:53:25.1520273Z remote: Counting objects: 85% (740/870) 2024-12-17T23:53:25.1520683Z remote: Counting objects: 86% (749/870) 2024-12-17T23:53:25.1521092Z remote: Counting objects: 87% (757/870) 2024-12-17T23:53:25.1521500Z remote: Counting objects: 88% (766/870) 2024-12-17T23:53:25.1521908Z remote: Counting objects: 89% (775/870) 2024-12-17T23:53:25.1522300Z remote: Counting objects: 90% (783/870) 2024-12-17T23:53:25.1522711Z remote: Counting objects: 91% (792/870) 2024-12-17T23:53:25.1523120Z remote: Counting objects: 92% (801/870) 2024-12-17T23:53:25.1523530Z remote: Counting objects: 93% (810/870) 2024-12-17T23:53:25.1523938Z remote: Counting objects: 94% (818/870) 2024-12-17T23:53:25.1524326Z remote: Counting objects: 95% (827/870) 2024-12-17T23:53:25.1524742Z remote: Counting objects: 96% (836/870) 2024-12-17T23:53:25.1525150Z remote: Counting objects: 97% (844/870) 2024-12-17T23:53:25.1525561Z remote: Counting objects: 98% (853/870) 2024-12-17T23:53:25.1525974Z remote: Counting objects: 99% (862/870) 2024-12-17T23:53:25.1526384Z remote: Counting objects: 100% (870/870) 2024-12-17T23:53:25.1526803Z remote: Counting objects: 100% (870/870), done. 2024-12-17T23:53:25.1591586Z remote: Compressing objects: 0% (1/348) 2024-12-17T23:53:25.1661064Z remote: Compressing objects: 1% (4/348) 2024-12-17T23:53:25.1807429Z remote: Compressing objects: 2% (7/348) 2024-12-17T23:53:25.1851104Z remote: Compressing objects: 3% (11/348) 2024-12-17T23:53:25.1957371Z remote: Compressing objects: 4% (14/348) 2024-12-17T23:53:25.2009237Z remote: Compressing objects: 5% (18/348) 2024-12-17T23:53:25.2195118Z remote: Compressing objects: 6% (21/348) 2024-12-17T23:53:25.2611320Z remote: Compressing objects: 7% (25/348) 2024-12-17T23:53:25.3108177Z remote: Compressing objects: 8% (28/348) 2024-12-17T23:53:25.3866342Z remote: Compressing objects: 9% (32/348) 2024-12-17T23:53:25.4430907Z remote: Compressing objects: 10% (35/348) 2024-12-17T23:53:25.4740939Z remote: Compressing objects: 11% (39/348) 2024-12-17T23:53:25.4907834Z remote: Compressing objects: 12% (42/348) 2024-12-17T23:53:25.5005775Z remote: Compressing objects: 13% (46/348) 2024-12-17T23:53:25.5079735Z remote: Compressing objects: 14% (49/348) 2024-12-17T23:53:25.5080434Z remote: Compressing objects: 15% (53/348) 2024-12-17T23:53:25.5082261Z remote: Compressing objects: 16% (56/348) 2024-12-17T23:53:25.5082993Z remote: Compressing objects: 17% (60/348) 2024-12-17T23:53:25.5085141Z remote: Compressing objects: 18% (63/348) 2024-12-17T23:53:25.5087086Z remote: Compressing objects: 19% (67/348) 2024-12-17T23:53:25.5088923Z remote: Compressing objects: 20% (70/348) 2024-12-17T23:53:25.5090892Z remote: Compressing objects: 21% (74/348) 2024-12-17T23:53:25.5095254Z remote: Compressing objects: 22% (77/348) 2024-12-17T23:53:25.5101717Z remote: Compressing objects: 23% (81/348) 2024-12-17T23:53:25.5106048Z remote: Compressing objects: 24% (84/348) 2024-12-17T23:53:25.5112194Z remote: Compressing objects: 25% (87/348) 2024-12-17T23:53:25.5112973Z remote: Compressing objects: 26% (91/348) 2024-12-17T23:53:25.5114275Z remote: Compressing objects: 27% (94/348) 2024-12-17T23:53:25.5119116Z remote: Compressing objects: 28% (98/348) 2024-12-17T23:53:25.5127985Z remote: Compressing objects: 29% (101/348) 2024-12-17T23:53:25.5136728Z remote: Compressing objects: 30% (105/348) 2024-12-17T23:53:25.5139239Z remote: Compressing objects: 31% (108/348) 2024-12-17T23:53:25.5141654Z remote: Compressing objects: 32% (112/348) 2024-12-17T23:53:25.5144064Z remote: Compressing objects: 33% (115/348) 2024-12-17T23:53:25.5153090Z remote: Compressing objects: 34% (119/348) 2024-12-17T23:53:25.5155352Z remote: Compressing objects: 35% (122/348) 2024-12-17T23:53:25.5160867Z remote: Compressing objects: 36% (126/348) 2024-12-17T23:53:25.5167451Z remote: Compressing objects: 37% (129/348) 2024-12-17T23:53:25.5173054Z remote: Compressing objects: 38% (133/348) 2024-12-17T23:53:25.5175905Z remote: Compressing objects: 39% (136/348) 2024-12-17T23:53:25.5178730Z remote: Compressing objects: 40% (140/348) 2024-12-17T23:53:25.5182848Z remote: Compressing objects: 41% (143/348) 2024-12-17T23:53:25.5188091Z remote: Compressing objects: 42% (147/348) 2024-12-17T23:53:25.5192068Z remote: Compressing objects: 43% (150/348) 2024-12-17T23:53:25.5193274Z remote: Compressing objects: 44% (154/348) 2024-12-17T23:53:25.5199829Z remote: Compressing objects: 45% (157/348) 2024-12-17T23:53:25.5204022Z remote: Compressing objects: 46% (161/348) 2024-12-17T23:53:25.5208086Z remote: Compressing objects: 47% (164/348) 2024-12-17T23:53:25.5210971Z remote: Compressing objects: 48% (168/348) 2024-12-17T23:53:25.5213266Z remote: Compressing objects: 49% (171/348) 2024-12-17T23:53:25.5215517Z remote: Compressing objects: 50% (174/348) 2024-12-17T23:53:25.5217648Z remote: Compressing objects: 51% (178/348) 2024-12-17T23:53:25.5220486Z remote: Compressing objects: 52% (181/348) 2024-12-17T23:53:25.5222804Z remote: Compressing objects: 53% (185/348) 2024-12-17T23:53:25.5225231Z remote: Compressing objects: 54% (188/348) 2024-12-17T23:53:25.5227700Z remote: Compressing objects: 55% (192/348) 2024-12-17T23:53:25.5230774Z remote: Compressing objects: 56% (195/348) 2024-12-17T23:53:25.5233048Z remote: Compressing objects: 57% (199/348) 2024-12-17T23:53:25.5236661Z remote: Compressing objects: 58% (202/348) 2024-12-17T23:53:25.5239484Z remote: Compressing objects: 59% (206/348) 2024-12-17T23:53:25.5243617Z remote: Compressing objects: 60% (209/348) 2024-12-17T23:53:25.5244980Z remote: Compressing objects: 61% (213/348) 2024-12-17T23:53:25.5247313Z remote: Compressing objects: 62% (216/348) 2024-12-17T23:53:25.5251016Z remote: Compressing objects: 63% (220/348) 2024-12-17T23:53:25.5256886Z remote: Compressing objects: 64% (223/348) 2024-12-17T23:53:25.5261149Z remote: Compressing objects: 65% (227/348) 2024-12-17T23:53:25.5263751Z remote: Compressing objects: 66% (230/348) 2024-12-17T23:53:25.5266217Z remote: Compressing objects: 67% (234/348) 2024-12-17T23:53:25.5267878Z remote: Compressing objects: 68% (237/348) 2024-12-17T23:53:25.5271281Z remote: Compressing objects: 69% (241/348) 2024-12-17T23:53:25.5274907Z remote: Compressing objects: 70% (244/348) 2024-12-17T23:53:25.5277285Z remote: Compressing objects: 71% (248/348) 2024-12-17T23:53:25.5279771Z remote: Compressing objects: 72% (251/348) 2024-12-17T23:53:25.5282552Z remote: Compressing objects: 73% (255/348) 2024-12-17T23:53:25.5287929Z remote: Compressing objects: 74% (258/348) 2024-12-17T23:53:25.5289104Z remote: Compressing objects: 75% (261/348) 2024-12-17T23:53:25.5290322Z remote: Compressing objects: 76% (265/348) 2024-12-17T23:53:25.5291592Z remote: Compressing objects: 77% (268/348) 2024-12-17T23:53:25.5292739Z remote: Compressing objects: 78% (272/348) 2024-12-17T23:53:25.5294032Z remote: Compressing objects: 79% (275/348) 2024-12-17T23:53:25.5295353Z remote: Compressing objects: 80% (279/348) 2024-12-17T23:53:25.5297746Z remote: Compressing objects: 81% (282/348) 2024-12-17T23:53:25.5299677Z remote: Compressing objects: 82% (286/348) 2024-12-17T23:53:25.5302913Z remote: Compressing objects: 83% (289/348) 2024-12-17T23:53:25.5304739Z remote: Compressing objects: 84% (293/348) 2024-12-17T23:53:25.5307382Z remote: Compressing objects: 85% (296/348) 2024-12-17T23:53:25.5309476Z remote: Compressing objects: 86% (300/348) 2024-12-17T23:53:25.5311320Z remote: Compressing objects: 87% (303/348) 2024-12-17T23:53:25.5312912Z remote: Compressing objects: 88% (307/348) 2024-12-17T23:53:25.5345469Z remote: Compressing objects: 89% (310/348) 2024-12-17T23:53:25.5345920Z remote: Compressing objects: 90% (314/348) 2024-12-17T23:53:25.5346344Z remote: Compressing objects: 91% (317/348) 2024-12-17T23:53:25.5346765Z remote: Compressing objects: 92% (321/348) 2024-12-17T23:53:25.5347184Z remote: Compressing objects: 93% (324/348) 2024-12-17T23:53:25.5347571Z remote: Compressing objects: 94% (328/348) 2024-12-17T23:53:25.5347987Z remote: Compressing objects: 95% (331/348) 2024-12-17T23:53:25.5348402Z remote: Compressing objects: 96% (335/348) 2024-12-17T23:53:25.5348815Z remote: Compressing objects: 97% (338/348) 2024-12-17T23:53:25.5349248Z remote: Compressing objects: 98% (342/348) 2024-12-17T23:53:25.5349646Z remote: Compressing objects: 99% (345/348) 2024-12-17T23:53:25.5350069Z remote: Compressing objects: 100% (348/348) 2024-12-17T23:53:25.5350518Z remote: Compressing objects: 100% (348/348), done. 2024-12-17T23:53:46.4953061Z remote: Total 1057255 (delta 693), reused 546 (delta 522), pack-reused 1056385 (from 3) 2024-12-17T23:54:08.6676195Z [command]/usr/bin/git rev-parse --verify --quiet 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7^{object} 2024-12-17T23:54:08.6696712Z 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-17T23:54:08.6699694Z ##[endgroup] 2024-12-17T23:54:08.6700163Z ##[group]Determining the checkout info 2024-12-17T23:54:08.6700672Z ##[endgroup] 2024-12-17T23:54:08.6701103Z ##[group]Checking out the ref 2024-12-17T23:54:08.6703527Z [command]/usr/bin/git checkout --quiet --force 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-17T23:54:10.0279655Z ##[endgroup] 2024-12-17T23:54:10.0280187Z ##[group]Setting up auth for fetching submodules 2024-12-17T23:54:10.0282487Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-17T23:54:10.0333872Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-12-17T23:54:10.0355716Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-12-17T23:54:10.0378153Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-12-17T23:54:10.0402161Z ##[endgroup] 2024-12-17T23:54:10.0402670Z ##[group]Fetching submodules 2024-12-17T23:54:10.0403057Z [command]/usr/bin/git submodule sync --recursive 2024-12-17T23:54:10.0692481Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-12-17T23:54:10.0966663Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-12-17T23:54:10.0967993Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-12-17T23:54:10.0969074Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-12-17T23:54:10.0970392Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-12-17T23:54:10.0972750Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2024-12-17T23:54:10.0975554Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-12-17T23:54:10.0978046Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-12-17T23:54:10.0980742Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-12-17T23:54:10.0984927Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2024-12-17T23:54:10.0987732Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-12-17T23:54:10.0990592Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-12-17T23:54:10.0993741Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-12-17T23:54:10.0996743Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-12-17T23:54:10.0999950Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-12-17T23:54:10.1003272Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-12-17T23:54:10.1006695Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-12-17T23:54:10.1011541Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-12-17T23:54:10.1015407Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-12-17T23:54:10.1019135Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-12-17T23:54:10.1023065Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-12-17T23:54:10.1026826Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-12-17T23:54:10.1030842Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-12-17T23:54:10.1034830Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-12-17T23:54:10.1039033Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-12-17T23:54:10.1043208Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-12-17T23:54:10.1048016Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-12-17T23:54:10.1052279Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-12-17T23:54:10.1057122Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-12-17T23:54:10.1061693Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-12-17T23:54:10.1066248Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-12-17T23:54:10.1071011Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-12-17T23:54:10.1075983Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-12-17T23:54:10.1080845Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-12-17T23:54:10.1087399Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-12-17T23:54:10.1092555Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-12-17T23:54:10.1098054Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-12-17T23:54:10.1126581Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-12-17T23:54:10.4126200Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-12-17T23:54:10.6151912Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-12-17T23:54:10.8085474Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-12-17T23:54:11.0635845Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'... 2024-12-17T23:54:11.3722323Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-12-17T23:54:13.0565856Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-12-17T23:54:21.3640972Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-12-17T23:54:21.7358949Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'... 2024-12-17T23:54:23.6302189Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-12-17T23:54:24.0677324Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-12-17T23:54:24.6578452Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-12-17T23:54:25.7227928Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-12-17T23:54:27.6048503Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-12-17T23:54:32.4949549Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-12-17T23:54:33.8151781Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-12-17T23:54:34.7821124Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-12-17T23:54:35.7383702Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-12-17T23:54:36.1456719Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-12-17T23:54:36.4923165Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-12-17T23:54:37.3257943Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-12-17T23:54:37.7192738Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-12-17T23:54:37.9753578Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-12-17T23:54:39.4598159Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-12-17T23:54:40.2654897Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-12-17T23:54:40.6461415Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-12-17T23:54:46.7149412Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-12-17T23:54:48.3935611Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-12-17T23:54:51.5482399Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-12-17T23:54:51.7682751Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-12-17T23:54:59.1858132Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-12-17T23:54:59.3863824Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-12-17T23:54:59.5994609Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-12-17T23:55:00.5094065Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-12-17T23:55:00.8235360Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-12-17T23:55:01.4594981Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-12-17T23:55:01.8558166Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-12-17T23:55:01.8672179Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-12-17T23:55:01.8759725Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-12-17T23:55:01.8986493Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-12-17T23:55:01.9298226Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2024-12-17T23:55:01.9633986Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-12-17T23:55:02.6305602Z Submodule path 'third_party/XNNPACK': checked out '4ea82e595b36106653175dcb04b2aa532660d0d8' 2024-12-17T23:55:02.6529412Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-12-17T23:55:02.8667545Z Submodule path 'third_party/composable_kernel': checked out '50ee4267e27b875d149e642f4cebd47be1dc3b57' 2024-12-17T23:55:02.9125964Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-12-17T23:55:03.0036742Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2024-12-17T23:55:03.0346165Z Submodule path 'third_party/cudnn_frontend': checked out '936021bfed8c91dc416af1588b2c4eca631a9e45' 2024-12-17T23:55:03.5065733Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-12-17T23:55:03.7458726Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-12-17T23:55:03.8340254Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-12-17T23:55:03.8355689Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-12-17T23:55:03.8357876Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-12-17T23:55:03.8360157Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-12-17T23:55:03.8362563Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-12-17T23:55:03.8365526Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-12-17T23:55:03.8394819Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-12-17T23:55:04.5917957Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-12-17T23:55:05.2289156Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-12-17T23:55:07.1065396Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-12-17T23:55:07.9759170Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-12-17T23:55:08.3867575Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-12-17T23:55:08.4789223Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-12-17T23:55:08.8545856Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-12-17T23:55:08.9139968Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-12-17T23:55:08.9260084Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-12-17T23:55:09.0496535Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-12-17T23:55:09.0870480Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-12-17T23:55:09.1248961Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-12-17T23:55:09.1494811Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-12-17T23:55:09.1908640Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59' 2024-12-17T23:55:09.2032305Z Submodule path 'third_party/ideep': checked out 'c7ccd5bdbe5434ba156f4e856dcef0601637334b' 2024-12-17T23:55:09.2046483Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-12-17T23:55:09.2073038Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-12-17T23:55:21.4218968Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af' 2024-12-17T23:55:21.4393353Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-12-17T23:55:21.5205934Z Submodule path 'third_party/kineto': checked out '338140f58a28d599da3434ced4fd2d75dd1a213d' 2024-12-17T23:55:21.5221223Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-17T23:55:21.5222963Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-12-17T23:55:21.5225554Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-12-17T23:55:21.5254985Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-12-17T23:55:22.2980164Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-12-17T23:55:23.2565796Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-12-17T23:55:24.1768302Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-12-17T23:55:24.1782454Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-17T23:55:24.1784762Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-17T23:55:24.1786942Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-17T23:55:24.1789392Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-17T23:55:24.1791884Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-17T23:55:24.1794623Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-17T23:55:24.1797302Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-17T23:55:24.1800177Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-17T23:55:24.1828029Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-12-17T23:55:25.0774927Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-12-17T23:55:25.4372457Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-12-17T23:55:26.3981342Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-12-17T23:55:26.6753380Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-12-17T23:55:27.1109745Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-12-17T23:55:27.9508420Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-12-17T23:55:34.9553636Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-12-17T23:55:35.5419944Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-12-17T23:55:35.5599773Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-12-17T23:55:35.5946759Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-12-17T23:55:35.6078723Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-12-17T23:55:35.6094806Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-17T23:55:35.6119256Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-12-17T23:55:36.0824043Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-12-17T23:55:36.1006182Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-12-17T23:55:36.1394159Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-12-17T23:55:36.2369259Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-12-17T23:55:36.2528016Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-12-17T23:55:36.2906616Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-12-17T23:55:36.3476474Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-12-17T23:55:36.3834970Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-12-17T23:55:36.4117427Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-12-17T23:55:36.5196882Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-12-17T23:55:36.8544714Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2024-12-17T23:55:36.8577582Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-12-17T23:55:36.8604400Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-12-17T23:55:37.8786385Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-12-17T23:55:37.9418163Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-12-17T23:55:37.9436209Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-17T23:55:37.9438931Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-17T23:55:37.9440193Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-17T23:55:37.9441412Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-17T23:55:37.9443584Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-17T23:55:37.9446382Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-17T23:55:37.9448987Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-17T23:55:37.9452042Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-17T23:55:37.9479858Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-12-17T23:55:38.3533881Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-12-17T23:55:39.1988942Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-12-17T23:55:39.5300211Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-12-17T23:55:45.4998055Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-12-17T23:55:45.8672201Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-12-17T23:55:46.0822680Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-12-17T23:55:46.3770821Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-12-17T23:55:52.0232975Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-12-17T23:55:52.0626250Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-12-17T23:55:52.0779726Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-12-17T23:55:52.1818648Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-12-17T23:55:52.1946650Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-12-17T23:55:52.2087481Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-12-17T23:55:52.2236971Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-12-17T23:55:52.2250294Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-17T23:55:52.2252474Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-17T23:55:52.2278836Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-12-17T23:55:53.7082485Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-12-17T23:55:54.8241653Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-12-17T23:55:54.8671854Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-12-17T23:55:55.2858741Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-12-17T23:55:55.2971307Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-12-17T23:55:55.5565920Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-12-17T23:55:55.5585987Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-12-17T23:55:55.5587812Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-12-17T23:55:55.5616992Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-12-17T23:55:55.9978803Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-12-17T23:55:56.8719039Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-12-17T23:55:56.9378498Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-12-17T23:55:56.9467029Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-12-17T23:55:56.9580687Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-12-17T23:55:56.9904120Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2024-12-17T23:55:57.0173844Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-12-17T23:55:57.0563862Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-12-17T23:55:57.0804455Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-12-17T23:55:57.0818704Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-12-17T23:55:57.0820370Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-12-17T23:55:57.0822653Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-12-17T23:55:57.0825088Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-12-17T23:55:57.0849549Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-12-17T23:55:57.9679018Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-12-17T23:55:58.1985831Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-12-17T23:56:00.2873105Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-12-17T23:56:01.2621211Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-12-17T23:56:01.2763955Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-12-17T23:56:01.3319808Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-12-17T23:56:01.3589032Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-12-17T23:56:01.3607755Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-17T23:56:01.3631602Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-12-17T23:56:01.6013883Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-12-17T23:56:01.6056948Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-12-17T23:56:01.6370513Z Entering 'android/libs/fbjni' 2024-12-17T23:56:01.6412899Z Entering 'third_party/FP16' 2024-12-17T23:56:01.6459753Z Entering 'third_party/FXdiv' 2024-12-17T23:56:01.6500598Z Entering 'third_party/NNPACK' 2024-12-17T23:56:01.6542029Z Entering 'third_party/NVTX' 2024-12-17T23:56:01.6582984Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-17T23:56:01.6624643Z Entering 'third_party/XNNPACK' 2024-12-17T23:56:01.6683378Z Entering 'third_party/benchmark' 2024-12-17T23:56:01.6724047Z Entering 'third_party/composable_kernel' 2024-12-17T23:56:01.6770376Z Entering 'third_party/cpp-httplib' 2024-12-17T23:56:01.6810100Z Entering 'third_party/cpuinfo' 2024-12-17T23:56:01.6850292Z Entering 'third_party/cudnn_frontend' 2024-12-17T23:56:01.6891759Z Entering 'third_party/cutlass' 2024-12-17T23:56:01.6938830Z Entering 'third_party/eigen' 2024-12-17T23:56:01.6979920Z Entering 'third_party/fbgemm' 2024-12-17T23:56:01.7019664Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-17T23:56:01.7058361Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-17T23:56:01.7097058Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-17T23:56:01.7140432Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-17T23:56:01.7179287Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-17T23:56:01.7221610Z Entering 'third_party/flatbuffers' 2024-12-17T23:56:01.7263406Z Entering 'third_party/fmt' 2024-12-17T23:56:01.7301232Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-17T23:56:01.7340781Z Entering 'third_party/gloo' 2024-12-17T23:56:01.7379784Z Entering 'third_party/googletest' 2024-12-17T23:56:01.7418308Z Entering 'third_party/ideep' 2024-12-17T23:56:01.7457908Z Entering 'third_party/ideep/mkl-dnn' 2024-12-17T23:56:01.7501804Z Entering 'third_party/ittapi' 2024-12-17T23:56:01.7541378Z Entering 'third_party/kineto' 2024-12-17T23:56:01.7580814Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-17T23:56:01.7618291Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-17T23:56:01.7657594Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-17T23:56:01.7696411Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-17T23:56:01.7734601Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-17T23:56:01.7772700Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-17T23:56:01.7817089Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-17T23:56:01.7854028Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-17T23:56:01.7900029Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-17T23:56:01.7938896Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-17T23:56:01.7981762Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-17T23:56:01.8019050Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-17T23:56:01.8058985Z Entering 'third_party/mimalloc' 2024-12-17T23:56:01.8098013Z Entering 'third_party/nccl/nccl' 2024-12-17T23:56:01.8137156Z Entering 'third_party/nlohmann' 2024-12-17T23:56:01.8177913Z Entering 'third_party/onnx' 2024-12-17T23:56:01.8232326Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-17T23:56:01.8273539Z Entering 'third_party/opentelemetry-cpp' 2024-12-17T23:56:01.8315280Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-17T23:56:01.8351378Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-17T23:56:01.8391960Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-17T23:56:01.8429834Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-17T23:56:01.8467024Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-17T23:56:01.8513445Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-17T23:56:01.8549636Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-17T23:56:01.8586731Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-17T23:56:01.8636559Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-17T23:56:01.8677897Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-17T23:56:01.8734894Z Entering 'third_party/pocketfft' 2024-12-17T23:56:01.8774932Z Entering 'third_party/protobuf' 2024-12-17T23:56:01.8816029Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-17T23:56:01.8858903Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-17T23:56:01.8898603Z Entering 'third_party/psimd' 2024-12-17T23:56:01.8937859Z Entering 'third_party/pthreadpool' 2024-12-17T23:56:01.8978302Z Entering 'third_party/pybind11' 2024-12-17T23:56:01.9018042Z Entering 'third_party/python-peachpy' 2024-12-17T23:56:01.9058322Z Entering 'third_party/sleef' 2024-12-17T23:56:01.9097752Z Entering 'third_party/tensorpipe' 2024-12-17T23:56:01.9137606Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-17T23:56:01.9174825Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-17T23:56:01.9212588Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-17T23:56:01.9249597Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-17T23:56:01.9289962Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-17T23:56:01.9347977Z ##[endgroup] 2024-12-17T23:56:01.9349519Z ##[group]Persisting credentials for submodules 2024-12-17T23:56:01.9353688Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-12-17T23:56:01.9628059Z Entering 'android/libs/fbjni' 2024-12-17T23:56:01.9680212Z Entering 'third_party/FP16' 2024-12-17T23:56:01.9731578Z Entering 'third_party/FXdiv' 2024-12-17T23:56:01.9781203Z Entering 'third_party/NNPACK' 2024-12-17T23:56:01.9832914Z Entering 'third_party/NVTX' 2024-12-17T23:56:01.9883941Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-17T23:56:01.9937744Z Entering 'third_party/XNNPACK' 2024-12-17T23:56:02.0003235Z Entering 'third_party/benchmark' 2024-12-17T23:56:02.0052911Z Entering 'third_party/composable_kernel' 2024-12-17T23:56:02.0111456Z Entering 'third_party/cpp-httplib' 2024-12-17T23:56:02.0162346Z Entering 'third_party/cpuinfo' 2024-12-17T23:56:02.0213407Z Entering 'third_party/cudnn_frontend' 2024-12-17T23:56:02.0262382Z Entering 'third_party/cutlass' 2024-12-17T23:56:02.0322140Z Entering 'third_party/eigen' 2024-12-17T23:56:02.0377702Z Entering 'third_party/fbgemm' 2024-12-17T23:56:02.0436366Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-17T23:56:02.0487019Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-17T23:56:02.0537906Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-17T23:56:02.0595013Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-17T23:56:02.0645865Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-17T23:56:02.0698709Z Entering 'third_party/flatbuffers' 2024-12-17T23:56:02.0752237Z Entering 'third_party/fmt' 2024-12-17T23:56:02.0803872Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-17T23:56:02.0853194Z Entering 'third_party/gloo' 2024-12-17T23:56:02.0902954Z Entering 'third_party/googletest' 2024-12-17T23:56:02.0952965Z Entering 'third_party/ideep' 2024-12-17T23:56:02.1004381Z Entering 'third_party/ideep/mkl-dnn' 2024-12-17T23:56:02.1068261Z Entering 'third_party/ittapi' 2024-12-17T23:56:02.1117447Z Entering 'third_party/kineto' 2024-12-17T23:56:02.1168138Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-17T23:56:02.1218440Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-17T23:56:02.1274909Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-17T23:56:02.1325829Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-17T23:56:02.1376698Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-17T23:56:02.1424206Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-17T23:56:02.1478900Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-17T23:56:02.1529025Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-17T23:56:02.1577897Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-17T23:56:02.1627703Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-17T23:56:02.1683511Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-17T23:56:02.1738942Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-17T23:56:02.1795013Z Entering 'third_party/mimalloc' 2024-12-17T23:56:02.1846473Z Entering 'third_party/nccl/nccl' 2024-12-17T23:56:02.1897975Z Entering 'third_party/nlohmann' 2024-12-17T23:56:02.1962254Z Entering 'third_party/onnx' 2024-12-17T23:56:02.2024354Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-17T23:56:02.2078106Z Entering 'third_party/opentelemetry-cpp' 2024-12-17T23:56:02.2130301Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-17T23:56:02.2178517Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-17T23:56:02.2227379Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-17T23:56:02.2277953Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-17T23:56:02.2328004Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-17T23:56:02.2378199Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-17T23:56:02.2426251Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-17T23:56:02.2475558Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-17T23:56:02.2531395Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-17T23:56:02.2592443Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-17T23:56:02.2660522Z Entering 'third_party/pocketfft' 2024-12-17T23:56:02.2712878Z Entering 'third_party/protobuf' 2024-12-17T23:56:02.2766399Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-17T23:56:02.2818195Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-17T23:56:02.2877189Z Entering 'third_party/psimd' 2024-12-17T23:56:02.2931846Z Entering 'third_party/pthreadpool' 2024-12-17T23:56:02.2981921Z Entering 'third_party/pybind11' 2024-12-17T23:56:02.3033551Z Entering 'third_party/python-peachpy' 2024-12-17T23:56:02.3085193Z Entering 'third_party/sleef' 2024-12-17T23:56:02.3135395Z Entering 'third_party/tensorpipe' 2024-12-17T23:56:02.3183770Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-17T23:56:02.3234686Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-17T23:56:02.3282836Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-17T23:56:02.3338052Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-17T23:56:02.3386215Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-17T23:56:02.3453503Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-12-17T23:56:02.3729790Z Entering 'android/libs/fbjni' 2024-12-17T23:56:02.3775597Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-12-17T23:56:02.3791925Z Entering 'third_party/FP16' 2024-12-17T23:56:02.3838745Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-12-17T23:56:02.3852951Z Entering 'third_party/FXdiv' 2024-12-17T23:56:02.3899889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-12-17T23:56:02.3916598Z Entering 'third_party/NNPACK' 2024-12-17T23:56:02.3963462Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-12-17T23:56:02.3978207Z Entering 'third_party/NVTX' 2024-12-17T23:56:02.4024312Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2024-12-17T23:56:02.4041644Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-17T23:56:02.4087832Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-12-17T23:56:02.4101964Z Entering 'third_party/XNNPACK' 2024-12-17T23:56:02.4148505Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-12-17T23:56:02.4178325Z Entering 'third_party/benchmark' 2024-12-17T23:56:02.4226888Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-12-17T23:56:02.4243389Z Entering 'third_party/composable_kernel' 2024-12-17T23:56:02.4289393Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2024-12-17T23:56:02.4313831Z Entering 'third_party/cpp-httplib' 2024-12-17T23:56:02.4360821Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-12-17T23:56:02.4377347Z Entering 'third_party/cpuinfo' 2024-12-17T23:56:02.4422289Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-12-17T23:56:02.4440135Z Entering 'third_party/cudnn_frontend' 2024-12-17T23:56:02.4488014Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-12-17T23:56:02.4502999Z Entering 'third_party/cutlass' 2024-12-17T23:56:02.4547999Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-12-17T23:56:02.4572289Z Entering 'third_party/eigen' 2024-12-17T23:56:02.4618051Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-12-17T23:56:02.4637117Z Entering 'third_party/fbgemm' 2024-12-17T23:56:02.4685089Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-12-17T23:56:02.4699676Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-17T23:56:02.4744632Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-12-17T23:56:02.4761319Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-17T23:56:02.4807618Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-12-17T23:56:02.4822020Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-17T23:56:02.4867966Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-12-17T23:56:02.4891907Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-17T23:56:02.4938353Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-12-17T23:56:02.4951322Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-17T23:56:02.4999116Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-12-17T23:56:02.5017171Z Entering 'third_party/flatbuffers' 2024-12-17T23:56:02.5061993Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-12-17T23:56:02.5082073Z Entering 'third_party/fmt' 2024-12-17T23:56:02.5128154Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-12-17T23:56:02.5142280Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-17T23:56:02.5190846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-12-17T23:56:02.5207656Z Entering 'third_party/gloo' 2024-12-17T23:56:02.5252973Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-12-17T23:56:02.5271850Z Entering 'third_party/googletest' 2024-12-17T23:56:02.5317540Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-12-17T23:56:02.5335293Z Entering 'third_party/ideep' 2024-12-17T23:56:02.5382723Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-12-17T23:56:02.5399200Z Entering 'third_party/ideep/mkl-dnn' 2024-12-17T23:56:02.5445975Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-12-17T23:56:02.5469967Z Entering 'third_party/ittapi' 2024-12-17T23:56:02.5516944Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-12-17T23:56:02.5533968Z Entering 'third_party/kineto' 2024-12-17T23:56:02.5578956Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-12-17T23:56:02.5597026Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-17T23:56:02.5645336Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-12-17T23:56:02.5658906Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-17T23:56:02.5707488Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-12-17T23:56:02.5724938Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-17T23:56:02.5772880Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-12-17T23:56:02.5785898Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-17T23:56:02.5834104Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-12-17T23:56:02.5848406Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-17T23:56:02.5900291Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-12-17T23:56:02.5916287Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-17T23:56:02.5963906Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-12-17T23:56:02.5979716Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-17T23:56:02.6026406Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-12-17T23:56:02.6043618Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-17T23:56:02.6089838Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-12-17T23:56:02.6104314Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-17T23:56:02.6151629Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-12-17T23:56:02.6169894Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-17T23:56:02.6216546Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-12-17T23:56:02.6235448Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-17T23:56:02.6287597Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-12-17T23:56:02.6301263Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-17T23:56:02.6348527Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-12-17T23:56:02.6367382Z Entering 'third_party/mimalloc' 2024-12-17T23:56:02.6414650Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-12-17T23:56:02.6431621Z Entering 'third_party/nccl/nccl' 2024-12-17T23:56:02.6478573Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-12-17T23:56:02.6495565Z Entering 'third_party/nlohmann' 2024-12-17T23:56:02.6538769Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-12-17T23:56:02.6555091Z Entering 'third_party/onnx' 2024-12-17T23:56:02.6605133Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-12-17T23:56:02.6635595Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-17T23:56:02.6683806Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-12-17T23:56:02.6699796Z Entering 'third_party/opentelemetry-cpp' 2024-12-17T23:56:02.6746840Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-12-17T23:56:02.6765252Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-17T23:56:02.6816864Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-12-17T23:56:02.6832405Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-17T23:56:02.6878197Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-12-17T23:56:02.6894393Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-17T23:56:02.6938455Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-12-17T23:56:02.6952374Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-17T23:56:02.7002147Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-12-17T23:56:02.7018091Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-17T23:56:02.7070812Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-12-17T23:56:02.7086128Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-17T23:56:02.7131647Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-12-17T23:56:02.7145374Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-17T23:56:02.7193234Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-12-17T23:56:02.7208922Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-17T23:56:02.7254250Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-12-17T23:56:02.7273104Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-17T23:56:02.7321164Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-12-17T23:56:02.7338491Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-17T23:56:02.7382933Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-12-17T23:56:02.7418316Z Entering 'third_party/pocketfft' 2024-12-17T23:56:02.7464095Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-12-17T23:56:02.7480697Z Entering 'third_party/protobuf' 2024-12-17T23:56:02.7527413Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-12-17T23:56:02.7544083Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-17T23:56:02.7591559Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-12-17T23:56:02.7607832Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-17T23:56:02.7656131Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-12-17T23:56:02.7674409Z Entering 'third_party/psimd' 2024-12-17T23:56:02.7721877Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-12-17T23:56:02.7737069Z Entering 'third_party/pthreadpool' 2024-12-17T23:56:02.7787082Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-12-17T23:56:02.7803389Z Entering 'third_party/pybind11' 2024-12-17T23:56:02.7846685Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-12-17T23:56:02.7861300Z Entering 'third_party/python-peachpy' 2024-12-17T23:56:02.7907845Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-12-17T23:56:02.7925280Z Entering 'third_party/sleef' 2024-12-17T23:56:02.7973645Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-12-17T23:56:02.7990863Z Entering 'third_party/tensorpipe' 2024-12-17T23:56:02.8037886Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-12-17T23:56:02.8051535Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-17T23:56:02.8098515Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-12-17T23:56:02.8113374Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-17T23:56:02.8161200Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-12-17T23:56:02.8176754Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-17T23:56:02.8220867Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-12-17T23:56:02.8237890Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-17T23:56:02.8284620Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-12-17T23:56:02.8298349Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-17T23:56:02.8345097Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-12-17T23:56:02.8979504Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-12-17T23:56:02.9257812Z Entering 'android/libs/fbjni' 2024-12-17T23:56:02.9298041Z Entering 'third_party/FP16' 2024-12-17T23:56:02.9337464Z Entering 'third_party/FXdiv' 2024-12-17T23:56:02.9377255Z Entering 'third_party/NNPACK' 2024-12-17T23:56:02.9417191Z Entering 'third_party/NVTX' 2024-12-17T23:56:02.9455390Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-17T23:56:02.9496586Z Entering 'third_party/XNNPACK' 2024-12-17T23:56:02.9548202Z Entering 'third_party/benchmark' 2024-12-17T23:56:02.9589327Z Entering 'third_party/composable_kernel' 2024-12-17T23:56:02.9635422Z Entering 'third_party/cpp-httplib' 2024-12-17T23:56:02.9675612Z Entering 'third_party/cpuinfo' 2024-12-17T23:56:02.9714665Z Entering 'third_party/cudnn_frontend' 2024-12-17T23:56:02.9752794Z Entering 'third_party/cutlass' 2024-12-17T23:56:02.9799887Z Entering 'third_party/eigen' 2024-12-17T23:56:02.9840047Z Entering 'third_party/fbgemm' 2024-12-17T23:56:02.9879492Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-17T23:56:02.9916959Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-17T23:56:02.9953657Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-17T23:56:02.9999780Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-17T23:56:03.0037260Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-17T23:56:03.0079624Z Entering 'third_party/flatbuffers' 2024-12-17T23:56:03.0122147Z Entering 'third_party/fmt' 2024-12-17T23:56:03.0162146Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-17T23:56:03.0202567Z Entering 'third_party/gloo' 2024-12-17T23:56:03.0242038Z Entering 'third_party/googletest' 2024-12-17T23:56:03.0282314Z Entering 'third_party/ideep' 2024-12-17T23:56:03.0320859Z Entering 'third_party/ideep/mkl-dnn' 2024-12-17T23:56:03.0372390Z Entering 'third_party/ittapi' 2024-12-17T23:56:03.0412780Z Entering 'third_party/kineto' 2024-12-17T23:56:03.0452051Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-17T23:56:03.0492057Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-17T23:56:03.0533095Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-17T23:56:03.0571018Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-17T23:56:03.0613217Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-17T23:56:03.0654566Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-17T23:56:03.0698884Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-17T23:56:03.0738447Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-17T23:56:03.0778596Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-17T23:56:03.0821356Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-17T23:56:03.0860838Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-17T23:56:03.0902120Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-17T23:56:03.0941292Z Entering 'third_party/mimalloc' 2024-12-17T23:56:03.0980536Z Entering 'third_party/nccl/nccl' 2024-12-17T23:56:03.1019522Z Entering 'third_party/nlohmann' 2024-12-17T23:56:03.1060192Z Entering 'third_party/onnx' 2024-12-17T23:56:03.1115996Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-17T23:56:03.1154896Z Entering 'third_party/opentelemetry-cpp' 2024-12-17T23:56:03.1195824Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-17T23:56:03.1233899Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-17T23:56:03.1271785Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-17T23:56:03.1309572Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-17T23:56:03.1349082Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-17T23:56:03.1386094Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-17T23:56:03.1427959Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-17T23:56:03.1464924Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-17T23:56:03.1504082Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-17T23:56:03.1543079Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-17T23:56:03.1608553Z Entering 'third_party/pocketfft' 2024-12-17T23:56:03.1650693Z Entering 'third_party/protobuf' 2024-12-17T23:56:03.1694501Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-17T23:56:03.1732341Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-17T23:56:03.1773316Z Entering 'third_party/psimd' 2024-12-17T23:56:03.1827695Z Entering 'third_party/pthreadpool' 2024-12-17T23:56:03.1853795Z Entering 'third_party/pybind11' 2024-12-17T23:56:03.1893740Z Entering 'third_party/python-peachpy' 2024-12-17T23:56:03.1933453Z Entering 'third_party/sleef' 2024-12-17T23:56:03.1972616Z Entering 'third_party/tensorpipe' 2024-12-17T23:56:03.2011688Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-17T23:56:03.2048450Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-17T23:56:03.2087786Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-17T23:56:03.2131192Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-17T23:56:03.2168541Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-17T23:56:03.2224097Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-12-17T23:56:03.2506711Z Entering 'android/libs/fbjni' 2024-12-17T23:56:03.2548190Z Entering 'third_party/FP16' 2024-12-17T23:56:03.2587585Z Entering 'third_party/FXdiv' 2024-12-17T23:56:03.2626473Z Entering 'third_party/NNPACK' 2024-12-17T23:56:03.2664302Z Entering 'third_party/NVTX' 2024-12-17T23:56:03.2702887Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-17T23:56:03.2741328Z Entering 'third_party/XNNPACK' 2024-12-17T23:56:03.2797067Z Entering 'third_party/benchmark' 2024-12-17T23:56:03.2836954Z Entering 'third_party/composable_kernel' 2024-12-17T23:56:03.2881844Z Entering 'third_party/cpp-httplib' 2024-12-17T23:56:03.2921130Z Entering 'third_party/cpuinfo' 2024-12-17T23:56:03.2960207Z Entering 'third_party/cudnn_frontend' 2024-12-17T23:56:03.3000037Z Entering 'third_party/cutlass' 2024-12-17T23:56:03.3045948Z Entering 'third_party/eigen' 2024-12-17T23:56:03.3091030Z Entering 'third_party/fbgemm' 2024-12-17T23:56:03.3132332Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-17T23:56:03.3170758Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-17T23:56:03.3209623Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-17T23:56:03.3254185Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-17T23:56:03.3293718Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-17T23:56:03.3337772Z Entering 'third_party/flatbuffers' 2024-12-17T23:56:03.3378885Z Entering 'third_party/fmt' 2024-12-17T23:56:03.3417980Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-17T23:56:03.3459726Z Entering 'third_party/gloo' 2024-12-17T23:56:03.3498710Z Entering 'third_party/googletest' 2024-12-17T23:56:03.3537713Z Entering 'third_party/ideep' 2024-12-17T23:56:03.3580081Z Entering 'third_party/ideep/mkl-dnn' 2024-12-17T23:56:03.3624209Z Entering 'third_party/ittapi' 2024-12-17T23:56:03.3662993Z Entering 'third_party/kineto' 2024-12-17T23:56:03.3701504Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-17T23:56:03.3739079Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-17T23:56:03.3779561Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-17T23:56:03.3817951Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-17T23:56:03.3856192Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-17T23:56:03.3898371Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-17T23:56:03.3938412Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-17T23:56:03.3978561Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-17T23:56:03.4018219Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-17T23:56:03.4057968Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-17T23:56:03.4098254Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-17T23:56:03.4137395Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-17T23:56:03.4181375Z Entering 'third_party/mimalloc' 2024-12-17T23:56:03.4219558Z Entering 'third_party/nccl/nccl' 2024-12-17T23:56:03.4261251Z Entering 'third_party/nlohmann' 2024-12-17T23:56:03.4303932Z Entering 'third_party/onnx' 2024-12-17T23:56:03.4364614Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-17T23:56:03.4405941Z Entering 'third_party/opentelemetry-cpp' 2024-12-17T23:56:03.4446353Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-17T23:56:03.4486586Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-17T23:56:03.4526632Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-17T23:56:03.4564705Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-17T23:56:03.4603643Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-17T23:56:03.4640274Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-17T23:56:03.4677664Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-17T23:56:03.4714202Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-17T23:56:03.4753194Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-17T23:56:03.4802558Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-17T23:56:03.4858580Z Entering 'third_party/pocketfft' 2024-12-17T23:56:03.4897681Z Entering 'third_party/protobuf' 2024-12-17T23:56:03.4938256Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-17T23:56:03.4977560Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-17T23:56:03.5021214Z Entering 'third_party/psimd' 2024-12-17T23:56:03.5059635Z Entering 'third_party/pthreadpool' 2024-12-17T23:56:03.5097890Z Entering 'third_party/pybind11' 2024-12-17T23:56:03.5137174Z Entering 'third_party/python-peachpy' 2024-12-17T23:56:03.5177789Z Entering 'third_party/sleef' 2024-12-17T23:56:03.5215655Z Entering 'third_party/tensorpipe' 2024-12-17T23:56:03.5252679Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-17T23:56:03.5292351Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-17T23:56:03.5330994Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-17T23:56:03.5378096Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-17T23:56:03.5418068Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-17T23:56:03.5467802Z ##[endgroup] 2024-12-17T23:56:03.5496514Z [command]/usr/bin/git log -1 --format='%H' 2024-12-17T23:56:03.5516863Z '0cdf8b1d09254cfda66191d1bd01e3041c3c76f7' 2024-12-17T23:56:03.5672219Z Prepare all required actions 2024-12-17T23:56:03.5672754Z Getting action download info 2024-12-17T23:56:03.7217629Z ##[group]Run ./.github/actions/setup-linux 2024-12-17T23:56:03.7218172Z env: 2024-12-17T23:56:03.7218417Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:03.7218715Z ##[endgroup] 2024-12-17T23:56:03.7267964Z ##[group]Run set -euo pipefail 2024-12-17T23:56:03.7268364Z set -euo pipefail 2024-12-17T23:56:03.7268782Z function get_ec2_metadata() { 2024-12-17T23:56:03.7269167Z  # Pulled from instance metadata endpoint for EC2 2024-12-17T23:56:03.7269792Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-12-17T23:56:03.7270346Z  category=$1 2024-12-17T23:56:03.7270709Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-12-17T23:56:03.7271151Z  runner_name_str=i-0dcf3a01d7b6a24eb 2024-12-17T23:56:03.7271553Z  if [[ -f /.inarc ]]; then 2024-12-17T23:56:03.7271908Z  echo "ARC Runner, no info on ec2 metadata" 2024-12-17T23:56:03.7272282Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-12-17T23:56:03.7272764Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-12-17T23:56:03.7273198Z  else 2024-12-17T23:56:03.7274029Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-12-17T23:56:03.7274913Z  fi 2024-12-17T23:56:03.7275145Z } 2024-12-17T23:56:03.7275402Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-12-17T23:56:03.7275830Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-12-17T23:56:03.7276307Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-12-17T23:56:03.7276723Z echo "system info $(uname -a)" 2024-12-17T23:56:03.7283162Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:03.7283554Z env: 2024-12-17T23:56:03.7283778Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:03.7284060Z ##[endgroup] 2024-12-17T23:56:03.7435327Z ami-id: ami-0fff1b9a61dec8a5f 2024-12-17T23:56:03.7545735Z instance-id: i-0dcf3a01d7b6a24eb 2024-12-17T23:56:03.7643795Z instance-type: c5.12xlarge 2024-12-17T23:56:03.7656495Z system info Linux ip-10-0-12-55.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-12-17T23:56:03.7683668Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-17T23:56:03.7684623Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-17T23:56:03.7690442Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:03.7690854Z env: 2024-12-17T23:56:03.7691093Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:03.7691372Z ##[endgroup] 2024-12-17T23:56:03.7749741Z ##[group]Run if systemctl is-active --quiet docker; then 2024-12-17T23:56:03.7750238Z if systemctl is-active --quiet docker; then 2024-12-17T23:56:03.7750653Z  echo "Docker daemon is running..."; 2024-12-17T23:56:03.7750995Z else 2024-12-17T23:56:03.7751385Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-12-17T23:56:03.7751837Z fi 2024-12-17T23:56:03.7757256Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:03.7757638Z env: 2024-12-17T23:56:03.7757867Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:03.7758124Z ##[endgroup] 2024-12-17T23:56:03.7829897Z Docker daemon is running... 2024-12-17T23:56:03.7872633Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-17T23:56:03.7872948Z with: 2024-12-17T23:56:03.7873168Z shell: bash 2024-12-17T23:56:03.7873545Z timeout_minutes: 5 2024-12-17T23:56:03.7873803Z max_attempts: 3 2024-12-17T23:56:03.7874039Z retry_wait_seconds: 30 2024-12-17T23:56:03.7876211Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-12-17T23:56:03.7878539Z polling_interval_seconds: 1 2024-12-17T23:56:03.7878837Z warning_on_retry: true 2024-12-17T23:56:03.7879096Z continue_on_error: false 2024-12-17T23:56:03.7879363Z env: 2024-12-17T23:56:03.7879595Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:03.7879871Z AWS_RETRY_MODE: standard 2024-12-17T23:56:03.7880144Z AWS_MAX_ATTEMPTS: 5 2024-12-17T23:56:03.7880398Z AWS_DEFAULT_REGION: us-east-1 2024-12-17T23:56:03.7880685Z ##[endgroup] 2024-12-17T23:56:04.9761984Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-17T23:56:04.9762637Z Configure a credential helper to remove this warning. See 2024-12-17T23:56:04.9763240Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-17T23:56:04.9763642Z 2024-12-17T23:56:04.9763757Z Login Succeeded 2024-12-17T23:56:05.9535353Z Command completed after 1 attempt(s). 2024-12-17T23:56:05.9604392Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-17T23:56:05.9604943Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-17T23:56:05.9605418Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-17T23:56:05.9611445Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:05.9611817Z env: 2024-12-17T23:56:05.9612050Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:05.9612329Z ##[endgroup] 2024-12-17T23:56:05.9705589Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-17T23:56:05.9706224Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-17T23:56:05.9706693Z # shellcheck disable=SC2046 2024-12-17T23:56:05.9707070Z docker stop $(docker ps -q) || true 2024-12-17T23:56:05.9707458Z # Prune all of the docker images 2024-12-17T23:56:05.9707830Z docker system prune -af 2024-12-17T23:56:05.9713832Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:05.9714207Z env: 2024-12-17T23:56:05.9714450Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:05.9714733Z ##[endgroup] 2024-12-17T23:56:05.9996438Z "docker stop" requires at least 1 argument. 2024-12-17T23:56:05.9996919Z See 'docker stop --help'. 2024-12-17T23:56:05.9997130Z 2024-12-17T23:56:05.9997328Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-12-17T23:56:05.9997612Z 2024-12-17T23:56:05.9997745Z Stop one or more running containers 2024-12-17T23:56:06.0139796Z Total reclaimed space: 0B 2024-12-17T23:56:06.0175711Z ##[group]Run set +e 2024-12-17T23:56:06.0176028Z set +e 2024-12-17T23:56:06.0176371Z set -x 2024-12-17T23:56:06.0176610Z  2024-12-17T23:56:06.0177046Z PT_DOMAIN=download.pytorch.org 2024-12-17T23:56:06.0177697Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-12-17T23:56:06.0178503Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-12-17T23:56:06.0179070Z # one is returned at random 2024-12-17T23:56:06.0179482Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-12-17T23:56:06.0179896Z  2024-12-17T23:56:06.0180326Z if [ -z "${RESOLVED_IP}" ]; then 2024-12-17T23:56:06.0180795Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-12-17T23:56:06.0181362Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-12-17T23:56:06.0181911Z  2024-12-17T23:56:06.0182166Z  if [ -z "${RESOLVED_IP}" ]; then 2024-12-17T23:56:06.0182592Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-12-17T23:56:06.0183087Z  exit 1 2024-12-17T23:56:06.0183336Z  fi 2024-12-17T23:56:06.0183566Z fi 2024-12-17T23:56:06.0183774Z  2024-12-17T23:56:06.0184040Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-12-17T23:56:06.0184410Z  # Clean up any old records first 2024-12-17T23:56:06.0184776Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-12-17T23:56:06.0185110Z fi 2024-12-17T23:56:06.0185319Z  2024-12-17T23:56:06.0223955Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-12-17T23:56:06.0224388Z cat /etc/hosts 2024-12-17T23:56:06.0230040Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:06.0230433Z env: 2024-12-17T23:56:06.0230676Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:06.0230954Z ##[endgroup] 2024-12-17T23:56:06.0254041Z + PT_DOMAIN=download.pytorch.org 2024-12-17T23:56:06.0259404Z ++ dig -4 +short download.pytorch.org 2024-12-17T23:56:06.0260434Z ++ tail -n1 2024-12-17T23:56:06.0688453Z + RESOLVED_IP=3.167.99.70 2024-12-17T23:56:06.0689203Z + '[' -z 3.167.99.70 ']' 2024-12-17T23:56:06.0689585Z + grep -r download.pytorch.org /etc/hosts 2024-12-17T23:56:06.0699491Z 3.167.99.70 download.pytorch.org 2024-12-17T23:56:06.0700810Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-12-17T23:56:06.2921109Z + echo '3.167.99.70 download.pytorch.org' 2024-12-17T23:56:06.2921524Z + sudo tee -a /etc/hosts 2024-12-17T23:56:06.3303962Z 3.167.99.70 download.pytorch.org 2024-12-17T23:56:06.3317785Z + cat /etc/hosts 2024-12-17T23:56:06.3326329Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-12-17T23:56:06.3331518Z ::1 localhost6 localhost6.localdomain6 2024-12-17T23:56:06.3331918Z 3.167.99.70 download.pytorch.org 2024-12-17T23:56:06.3485982Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@release/2.6 2024-12-17T23:56:06.3486497Z with: 2024-12-17T23:56:06.3487051Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:06.3487571Z docker-build-dir: .ci/docker 2024-12-17T23:56:06.3487842Z working-directory: . 2024-12-17T23:56:06.3488187Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:06.3488578Z force-push: false 2024-12-17T23:56:06.3488806Z env: 2024-12-17T23:56:06.3489021Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:06.3489266Z ##[endgroup] 2024-12-17T23:56:06.3516397Z ##[group]Run set -ex 2024-12-17T23:56:06.3516695Z set -ex 2024-12-17T23:56:06.3516925Z  2024-12-17T23:56:06.3517314Z # If the docker build directory or the build script doesn't exist, the action will 2024-12-17T23:56:06.3518008Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-12-17T23:56:06.3518569Z # job could then download the pre-built image as usual 2024-12-17T23:56:06.3519054Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-12-17T23:56:06.3519515Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3519950Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3520348Z  2024-12-17T23:56:06.3520692Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-12-17T23:56:06.3521106Z  exit 0 2024-12-17T23:56:06.3521333Z else 2024-12-17T23:56:06.3521596Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3521918Z fi 2024-12-17T23:56:06.3522128Z  2024-12-17T23:56:06.3522456Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-12-17T23:56:06.3523027Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-12-17T23:56:06.3523670Z  # use it as it is, but first let's extract the tag 2024-12-17T23:56:06.3524136Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-12-17T23:56:06.3524627Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3525105Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3525507Z else 2024-12-17T23:56:06.3525801Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-12-17T23:56:06.3526248Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3526868Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3527411Z fi 2024-12-17T23:56:06.3534564Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:06.3534956Z env: 2024-12-17T23:56:06.3535179Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:06.3535444Z REPO_NAME: pytorch 2024-12-17T23:56:06.3535883Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:06.3536491Z DOCKER_BUILD_DIR: .ci/docker 2024-12-17T23:56:06.3537019Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:06.3537424Z ##[endgroup] 2024-12-17T23:56:06.3559944Z + [[ ! -d .ci/docker ]] 2024-12-17T23:56:06.3560250Z + [[ ! -f .ci/docker/build.sh ]] 2024-12-17T23:56:06.3560575Z + echo skip=false 2024-12-17T23:56:06.3561256Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-12-17T23:56:06.3566981Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:06.3567676Z ++ awk -F '[:,]' '{print $2}' 2024-12-17T23:56:06.3585644Z + DOCKER_TAG=v1.3-lite 2024-12-17T23:56:06.3586111Z + echo docker-tag=v1.3-lite 2024-12-17T23:56:06.3586632Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:06.3614288Z ##[group]Run set +e 2024-12-17T23:56:06.3614605Z set +e 2024-12-17T23:56:06.3614838Z set -x 2024-12-17T23:56:06.3615067Z  2024-12-17T23:56:06.3615270Z login() { 2024-12-17T23:56:06.3615734Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-17T23:56:06.3616355Z } 2024-12-17T23:56:06.3616573Z  2024-12-17T23:56:06.3616960Z retry () { 2024-12-17T23:56:06.3617240Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-17T23:56:06.3617630Z } 2024-12-17T23:56:06.3617856Z  2024-12-17T23:56:06.3618106Z retry login "${DOCKER_REGISTRY}" 2024-12-17T23:56:06.3618433Z  2024-12-17T23:56:06.3618656Z START_TIME=$(date +%s) 2024-12-17T23:56:06.3618984Z # Wait up to 90 minutes 2024-12-17T23:56:06.3619366Z while [[ $(( $(date +%s) - 5400 )) -lt $START_TIME ]]; do 2024-12-17T23:56:06.3619886Z  # Check if image already exists, if it does then skip building it 2024-12-17T23:56:06.3620405Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-12-17T23:56:06.3620798Z  exit 0 2024-12-17T23:56:06.3621039Z  fi 2024-12-17T23:56:06.3621273Z  2024-12-17T23:56:06.3621678Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2024-12-17T23:56:06.3622370Z  # use this to differentiate between the Docker build and regular build jobs. For the 2024-12-17T23:56:06.3623143Z  # latter, it will wait for the Docker images to become available before continuing 2024-12-17T23:56:06.3623646Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2024-12-17T23:56:06.3624043Z  # It's a Docker build job, let's build the image 2024-12-17T23:56:06.3624532Z  break 2024-12-17T23:56:06.3624774Z  else 2024-12-17T23:56:06.3625117Z  # It's a regular build job, wait for the image to become available 2024-12-17T23:56:06.3625529Z  sleep 300 2024-12-17T23:56:06.3625765Z  fi 2024-12-17T23:56:06.3625989Z done 2024-12-17T23:56:06.3626214Z  2024-12-17T23:56:06.3626567Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-12-17T23:56:06.3627132Z # be empty. The default action would be to continue rebuild the image 2024-12-17T23:56:06.3627636Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-12-17T23:56:06.3628071Z  # if we're on the base branch then use the parent commit 2024-12-17T23:56:06.3628473Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-12-17T23:56:06.3628794Z else 2024-12-17T23:56:06.3629130Z  # otherwise we're on a PR, so use the most recent base commit 2024-12-17T23:56:06.3629602Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-12-17T23:56:06.3629962Z fi 2024-12-17T23:56:06.3630166Z  2024-12-17T23:56:06.3630403Z if [[ -z "${MERGE_BASE}" ]]; then 2024-12-17T23:56:06.3630761Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3631096Z  2024-12-17T23:56:06.3631555Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-12-17T23:56:06.3632080Z  exit 0 2024-12-17T23:56:06.3632305Z fi 2024-12-17T23:56:06.3632520Z  2024-12-17T23:56:06.3632825Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-12-17T23:56:06.3633486Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-12-17T23:56:06.3634040Z  exit 1 2024-12-17T23:56:06.3634348Z fi 2024-12-17T23:56:06.3634562Z  2024-12-17T23:56:06.3634919Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-12-17T23:56:06.3635554Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-12-17T23:56:06.3636132Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-12-17T23:56:06.3636781Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-12-17T23:56:06.3637526Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-12-17T23:56:06.3637980Z fi 2024-12-17T23:56:06.3638205Z  2024-12-17T23:56:06.3638470Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-17T23:56:06.3643497Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:06.3643854Z env: 2024-12-17T23:56:06.3644132Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:06.3644722Z DOCKER_BUILD_DIR: .ci/docker 2024-12-17T23:56:06.3645119Z BASE_REVISION: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-17T23:56:06.3645809Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:06.3646335Z DOCKER_TAG: v1.3-lite 2024-12-17T23:56:06.3646701Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:06.3647115Z DOCKER_PUSH: 2024-12-17T23:56:06.3647345Z ##[endgroup] 2024-12-17T23:56:06.3670899Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:06.3671385Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:06.3672816Z + aws ecr get-login-password --region us-east-1 2024-12-17T23:56:06.3673741Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:06.8735408Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-17T23:56:06.8737947Z Configure a credential helper to remove this warning. See 2024-12-17T23:56:06.8739664Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-17T23:56:06.8740843Z 2024-12-17T23:56:06.8741146Z Login Succeeded 2024-12-17T23:56:06.8757945Z ++ date +%s 2024-12-17T23:56:06.8766556Z + START_TIME=1734479766 2024-12-17T23:56:06.8769444Z ++ date +%s 2024-12-17T23:56:06.8777816Z + [[ 1734474366 -lt 1734479766 ]] 2024-12-17T23:56:06.8778429Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:07.1032751Z { 2024-12-17T23:56:07.1033173Z "schemaVersion": 2, 2024-12-17T23:56:07.1033749Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-12-17T23:56:07.1034289Z "config": { 2024-12-17T23:56:07.1034661Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-12-17T23:56:07.1035086Z "size": 20306, 2024-12-17T23:56:07.1035569Z "digest": "sha256:cf27a324d40a0113eed6566aaff9ac3dc962999a9bd00a53137bed1837a9bbf1" 2024-12-17T23:56:07.1036102Z }, 2024-12-17T23:56:07.1036338Z "layers": [ 2024-12-17T23:56:07.1036583Z { 2024-12-17T23:56:07.1036924Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1037381Z "size": 55105512, 2024-12-17T23:56:07.1037845Z "digest": "sha256:1f3d25ffcb7db1dd7d1952f15b1c5de335e308cff0e99ecc0e435fe509e9869b" 2024-12-17T23:56:07.1038366Z }, 2024-12-17T23:56:07.1038587Z { 2024-12-17T23:56:07.1038922Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1039373Z "size": 15558387, 2024-12-17T23:56:07.1039818Z "digest": "sha256:925257a7168ed219a5d7c2a69af3245ca4cd9e376424f7f006535d9714437bd4" 2024-12-17T23:56:07.1040319Z }, 2024-12-17T23:56:07.1040539Z { 2024-12-17T23:56:07.1040877Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1041324Z "size": 54753972, 2024-12-17T23:56:07.1042045Z "digest": "sha256:dcb34ce34679cf6bc8738a0166300fb0af605abff20bb9c1c8008dbc48722061" 2024-12-17T23:56:07.1042596Z }, 2024-12-17T23:56:07.1042821Z { 2024-12-17T23:56:07.1043159Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1043608Z "size": 197073362, 2024-12-17T23:56:07.1044059Z "digest": "sha256:f3364194d1839c998f7fa1f479212c49598df894b8a851ba42e54ebf7f4344a6" 2024-12-17T23:56:07.1044812Z }, 2024-12-17T23:56:07.1045118Z { 2024-12-17T23:56:07.1045456Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1045908Z "size": 6051779, 2024-12-17T23:56:07.1046348Z "digest": "sha256:4cc8b9d3272439a6687a79ff25b4fda064d038a465cf268c758468f8b623b298" 2024-12-17T23:56:07.1046852Z }, 2024-12-17T23:56:07.1047071Z { 2024-12-17T23:56:07.1047566Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1048029Z "size": 21645846, 2024-12-17T23:56:07.1048468Z "digest": "sha256:ff25840f6834ec5eac29429b2a415cb6d3a4be2fc15624f6dfa2813af457bf42" 2024-12-17T23:56:07.1048991Z }, 2024-12-17T23:56:07.1049211Z { 2024-12-17T23:56:07.1049564Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1050019Z "size": 251, 2024-12-17T23:56:07.1050447Z "digest": "sha256:420daba023a78d518742d8a42e47c19a39fa8af4c1c5bbd1909071a61329c6b2" 2024-12-17T23:56:07.1050957Z }, 2024-12-17T23:56:07.1051182Z { 2024-12-17T23:56:07.1051540Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1051984Z "size": 121249307, 2024-12-17T23:56:07.1052422Z "digest": "sha256:33756ea9a39f645079c3768abafd4adbb158648c215d30552cfdf3e35a9da2e4" 2024-12-17T23:56:07.1052927Z }, 2024-12-17T23:56:07.1053144Z { 2024-12-17T23:56:07.1053495Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1054054Z "size": 9318, 2024-12-17T23:56:07.1054585Z "digest": "sha256:9219fbddff3f81293ce17ae456bcaae6a77e72aca892ec230c065904d29554c3" 2024-12-17T23:56:07.1055198Z }, 2024-12-17T23:56:07.1055415Z { 2024-12-17T23:56:07.1055752Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1056175Z "size": 6429540282, 2024-12-17T23:56:07.1056861Z "digest": "sha256:921f6b7523a84d29228b74bf9411ca6eb1e7e5b4c56b32f2afbd7131f80eaddb" 2024-12-17T23:56:07.1057371Z }, 2024-12-17T23:56:07.1057681Z { 2024-12-17T23:56:07.1058040Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1058498Z "size": 638047, 2024-12-17T23:56:07.1058924Z "digest": "sha256:29c67d834513cead54127f9d4ed8f9090f1541e1b56f4537c567e369b4b555fc" 2024-12-17T23:56:07.1059424Z }, 2024-12-17T23:56:07.1059644Z { 2024-12-17T23:56:07.1060000Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1060449Z "size": 572016, 2024-12-17T23:56:07.1060881Z "digest": "sha256:1131f28efee02566f2dc85aa57acbb6d916a23882edbd2e62bcdaa3b87144ec9" 2024-12-17T23:56:07.1061393Z }, 2024-12-17T23:56:07.1061619Z { 2024-12-17T23:56:07.1061978Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1062438Z "size": 95736204, 2024-12-17T23:56:07.1063009Z "digest": "sha256:3124f1fe68e417ad5d9b0d59c37f91958e93fa1ddffeefd8829f730d7c6b2669" 2024-12-17T23:56:07.1063471Z }, 2024-12-17T23:56:07.1063681Z { 2024-12-17T23:56:07.1064017Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1064440Z "size": 345, 2024-12-17T23:56:07.1064852Z "digest": "sha256:1ce05e19f36801c47a007b47b66c531e9033e7df64bb9193d57226eab5ffe616" 2024-12-17T23:56:07.1065303Z }, 2024-12-17T23:56:07.1065518Z { 2024-12-17T23:56:07.1065857Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1066282Z "size": 49631307, 2024-12-17T23:56:07.1066708Z "digest": "sha256:f75fd6a89da95ca35b9647d69cc846f399c2218951e8e56788ccd7456ca9e378" 2024-12-17T23:56:07.1067165Z }, 2024-12-17T23:56:07.1067379Z { 2024-12-17T23:56:07.1067829Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1068255Z "size": 10501642, 2024-12-17T23:56:07.1068680Z "digest": "sha256:e0f5db15a8e1dd5d653ee5137194ed8292c483a70947a20de4d7215f03a389cb" 2024-12-17T23:56:07.1069137Z }, 2024-12-17T23:56:07.1069351Z { 2024-12-17T23:56:07.1069686Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1070114Z "size": 30796174, 2024-12-17T23:56:07.1070545Z "digest": "sha256:8ff471ae1d8ae80de9bd1369709c821613c523afd29a59bfde3d71c7b7d179ae" 2024-12-17T23:56:07.1071012Z }, 2024-12-17T23:56:07.1071223Z { 2024-12-17T23:56:07.1071557Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1071976Z "size": 285235828, 2024-12-17T23:56:07.1072401Z "digest": "sha256:0d4638ab59c4f42e68cbea873d9425b226715081568fbea93d3d9cc9ba2b071f" 2024-12-17T23:56:07.1072850Z }, 2024-12-17T23:56:07.1073056Z { 2024-12-17T23:56:07.1073387Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1073805Z "size": 42603294, 2024-12-17T23:56:07.1074224Z "digest": "sha256:cebe223cdb632191217029314591a96b1d5fa1abfd7d32dc9809eeb67c28f3c4" 2024-12-17T23:56:07.1074673Z }, 2024-12-17T23:56:07.1074877Z { 2024-12-17T23:56:07.1075114Z + exit 0 2024-12-17T23:56:07.1075453Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1075872Z "size": 1101048, 2024-12-17T23:56:07.1076296Z "digest": "sha256:b80bf4ff993894a7778d05121b5eacaebc4efca588826e8c5804abafd3c171c4" 2024-12-17T23:56:07.1076751Z }, 2024-12-17T23:56:07.1076954Z { 2024-12-17T23:56:07.1077285Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1077704Z "size": 2106316, 2024-12-17T23:56:07.1078114Z "digest": "sha256:5049db0838edb8183d0f13230c9bc18d0c1d9c4b0173afa5d26832146adfe14d" 2024-12-17T23:56:07.1078564Z }, 2024-12-17T23:56:07.1078767Z { 2024-12-17T23:56:07.1079100Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1079591Z "size": 2497221, 2024-12-17T23:56:07.1080007Z "digest": "sha256:fe344efe8b8f197425843dbb864751c1aebe86a20628751f536f1290457bcb69" 2024-12-17T23:56:07.1080461Z }, 2024-12-17T23:56:07.1080673Z { 2024-12-17T23:56:07.1081011Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1081434Z "size": 2106, 2024-12-17T23:56:07.1081846Z "digest": "sha256:2d5b4d57bd2a05833c0cc47c1943a938560fba7338d3d7238756297ff1bd110f" 2024-12-17T23:56:07.1082295Z }, 2024-12-17T23:56:07.1082498Z { 2024-12-17T23:56:07.1082827Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1083242Z "size": 513, 2024-12-17T23:56:07.1083650Z "digest": "sha256:44fa2dc2d0d916eff258de782465631db3f2f1ab2922003ccc6a43360c1536b9" 2024-12-17T23:56:07.1084103Z }, 2024-12-17T23:56:07.1084311Z { 2024-12-17T23:56:07.1084639Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1085061Z "size": 239, 2024-12-17T23:56:07.1085468Z "digest": "sha256:34b9107bfe8bd5925bf1e85099902b68f9b44494aac4e1f44c0be56588b510c6" 2024-12-17T23:56:07.1085921Z }, 2024-12-17T23:56:07.1086128Z { 2024-12-17T23:56:07.1086457Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1086874Z "size": 32, 2024-12-17T23:56:07.1087281Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-17T23:56:07.1087736Z }, 2024-12-17T23:56:07.1087940Z { 2024-12-17T23:56:07.1088275Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1088693Z "size": 992, 2024-12-17T23:56:07.1089097Z "digest": "sha256:8c799786826d4df7aa98a75c824f97ddcdc43df3ff792291a8832d2497eefbcf" 2024-12-17T23:56:07.1089543Z }, 2024-12-17T23:56:07.1089746Z { 2024-12-17T23:56:07.1090070Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1090485Z "size": 1002, 2024-12-17T23:56:07.1090975Z "digest": "sha256:ef1a553ee8be26f89d66704453f98ee88256a8d567ff39bcd14148a72519fdbc" 2024-12-17T23:56:07.1091432Z }, 2024-12-17T23:56:07.1091635Z { 2024-12-17T23:56:07.1091969Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1092387Z "size": 1424467539, 2024-12-17T23:56:07.1092807Z "digest": "sha256:0da246d99584125c6673368a59a61fa5750a062c891061509f7f110acad7b042" 2024-12-17T23:56:07.1093251Z }, 2024-12-17T23:56:07.1093461Z { 2024-12-17T23:56:07.1093786Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1094201Z "size": 226, 2024-12-17T23:56:07.1094607Z "digest": "sha256:30f2a6a20f98f6a7a723072ac22244cf7d6a3b71da340c59cb690f685f0de000" 2024-12-17T23:56:07.1095060Z }, 2024-12-17T23:56:07.1095263Z { 2024-12-17T23:56:07.1095595Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1096014Z "size": 263, 2024-12-17T23:56:07.1096556Z "digest": "sha256:059c7d29514b10dd1c0d8bcc4dd559d12650f453588f2063ce843b3f64ba1f15" 2024-12-17T23:56:07.1097232Z }, 2024-12-17T23:56:07.1097539Z { 2024-12-17T23:56:07.1097902Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-17T23:56:07.1098356Z "size": 93, 2024-12-17T23:56:07.1098791Z "digest": "sha256:154002409cdb84b368db103707ce46c883a19faba870997fc189a842d43ef1b7" 2024-12-17T23:56:07.1099278Z } 2024-12-17T23:56:07.1099505Z ] 2024-12-17T23:56:07.1099731Z } 2024-12-17T23:56:07.1133049Z ##[group]Run set -eux 2024-12-17T23:56:07.1133364Z set -eux 2024-12-17T23:56:07.1134271Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin 2024-12-17T23:56:07.1142119Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:07.1142515Z env: 2024-12-17T23:56:07.1142759Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:07.1143176Z ##[endgroup] 2024-12-17T23:56:07.1172167Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2024-12-17T23:56:07.1173217Z + jq --raw-output .SecretString 2024-12-17T23:56:07.1174262Z + jq -r .docker_hub_readonly_token 2024-12-17T23:56:07.1175592Z + docker login --username pytorchbot --password-stdin 2024-12-17T23:56:07.6903839Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-17T23:56:07.6905712Z Configure a credential helper to remove this warning. See 2024-12-17T23:56:07.6907433Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-17T23:56:07.6908645Z 2024-12-17T23:56:07.6910127Z Login Succeeded 2024-12-17T23:56:07.7017940Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-12-17T23:56:07.7018333Z tag=${ECR_DOCKER_IMAGE##*/} 2024-12-17T23:56:07.7018743Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-12-17T23:56:07.7024406Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:07.7024819Z env: 2024-12-17T23:56:07.7025052Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:07.7025542Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:07.7026071Z ##[endgroup] 2024-12-17T23:56:07.7050881Z docker pull ghcr.io/pytorch/ci-image:xla_base-v1.3-lite 2024-12-17T23:56:07.7097601Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@release/2.6 2024-12-17T23:56:07.7098085Z with: 2024-12-17T23:56:07.7098497Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:07.7099112Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:07.7099521Z env: 2024-12-17T23:56:07.7099747Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:07.7100025Z ##[endgroup] 2024-12-17T23:56:07.7123137Z ##[group]Run set -x 2024-12-17T23:56:07.7123425Z set -x 2024-12-17T23:56:07.7123673Z set +e 2024-12-17T23:56:07.7123912Z  2024-12-17T23:56:07.7124140Z login() { 2024-12-17T23:56:07.7124647Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-17T23:56:07.7125186Z } 2024-12-17T23:56:07.7125409Z  2024-12-17T23:56:07.7125618Z retry () { 2024-12-17T23:56:07.7125951Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-17T23:56:07.7126280Z } 2024-12-17T23:56:07.7126503Z  2024-12-17T23:56:07.7126739Z retry login "${DOCKER_REGISTRY}" 2024-12-17T23:56:07.7127073Z  2024-12-17T23:56:07.7127298Z set -e 2024-12-17T23:56:07.7127661Z # ignore output since only exit code is used for conditional 2024-12-17T23:56:07.7128180Z # only pull docker image if it's not available locally 2024-12-17T23:56:07.7128756Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-12-17T23:56:07.7129273Z  retry docker pull "${DOCKER_IMAGE}" 2024-12-17T23:56:07.7129623Z fi 2024-12-17T23:56:07.7134494Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:56:07.7134896Z env: 2024-12-17T23:56:07.7135127Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:56:07.7135592Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:07.7136294Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:07.7136721Z ##[endgroup] 2024-12-17T23:56:07.7157364Z + set +e 2024-12-17T23:56:07.7157731Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:07.7158176Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:07.7161062Z + aws ecr get-login-password --region us-east-1 2024-12-17T23:56:07.7162378Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-17T23:56:08.2442862Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-17T23:56:08.2444000Z Configure a credential helper to remove this warning. See 2024-12-17T23:56:08.2444760Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-17T23:56:08.2445163Z 2024-12-17T23:56:08.2445278Z Login Succeeded 2024-12-17T23:56:08.2455121Z + set -e 2024-12-17T23:56:08.2455631Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:08.2582765Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:08.2583520Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:56:08.5423974Z v1.3-lite: Pulling from pytorch/xla_base 2024-12-17T23:56:08.5428508Z 1f3d25ffcb7d: Pulling fs layer 2024-12-17T23:56:08.5428889Z 925257a7168e: Pulling fs layer 2024-12-17T23:56:08.5429325Z dcb34ce34679: Pulling fs layer 2024-12-17T23:56:08.5429630Z f3364194d183: Pulling fs layer 2024-12-17T23:56:08.5429941Z 4cc8b9d32724: Pulling fs layer 2024-12-17T23:56:08.5430281Z ff25840f6834: Pulling fs layer 2024-12-17T23:56:08.5430594Z 420daba023a7: Pulling fs layer 2024-12-17T23:56:08.5430890Z 33756ea9a39f: Pulling fs layer 2024-12-17T23:56:08.5431207Z 9219fbddff3f: Pulling fs layer 2024-12-17T23:56:08.5431523Z 921f6b7523a8: Pulling fs layer 2024-12-17T23:56:08.5432056Z 29c67d834513: Pulling fs layer 2024-12-17T23:56:08.5432406Z 1131f28efee0: Pulling fs layer 2024-12-17T23:56:08.5432714Z 3124f1fe68e4: Pulling fs layer 2024-12-17T23:56:08.5433002Z 1ce05e19f368: Pulling fs layer 2024-12-17T23:56:08.5433309Z f75fd6a89da9: Pulling fs layer 2024-12-17T23:56:08.5433619Z e0f5db15a8e1: Pulling fs layer 2024-12-17T23:56:08.5433927Z 8ff471ae1d8a: Pulling fs layer 2024-12-17T23:56:08.5434224Z f3364194d183: Waiting 2024-12-17T23:56:08.5434484Z 0d4638ab59c4: Pulling fs layer 2024-12-17T23:56:08.5434779Z 4cc8b9d32724: Waiting 2024-12-17T23:56:08.5435058Z cebe223cdb63: Pulling fs layer 2024-12-17T23:56:08.5435363Z ff25840f6834: Waiting 2024-12-17T23:56:08.5435650Z b80bf4ff9938: Pulling fs layer 2024-12-17T23:56:08.5435934Z 33756ea9a39f: Waiting 2024-12-17T23:56:08.5436207Z 420daba023a7: Waiting 2024-12-17T23:56:08.5436470Z 29c67d834513: Waiting 2024-12-17T23:56:08.5436739Z 9219fbddff3f: Waiting 2024-12-17T23:56:08.5436999Z 5049db0838ed: Pulling fs layer 2024-12-17T23:56:08.5437299Z 1131f28efee0: Waiting 2024-12-17T23:56:08.5437568Z 3124f1fe68e4: Waiting 2024-12-17T23:56:08.5437849Z fe344efe8b8f: Pulling fs layer 2024-12-17T23:56:08.5438148Z 921f6b7523a8: Waiting 2024-12-17T23:56:08.5438412Z 2d5b4d57bd2a: Pulling fs layer 2024-12-17T23:56:08.5438715Z e0f5db15a8e1: Waiting 2024-12-17T23:56:08.5438986Z 1ce05e19f368: Waiting 2024-12-17T23:56:08.5439264Z 44fa2dc2d0d9: Pulling fs layer 2024-12-17T23:56:08.5439569Z b80bf4ff9938: Waiting 2024-12-17T23:56:08.5439820Z cebe223cdb63: Waiting 2024-12-17T23:56:08.5440088Z 8ff471ae1d8a: Waiting 2024-12-17T23:56:08.5440356Z 5049db0838ed: Waiting 2024-12-17T23:56:08.5440633Z 34b9107bfe8b: Pulling fs layer 2024-12-17T23:56:08.5440960Z f75fd6a89da9: Waiting 2024-12-17T23:56:08.5441258Z fe344efe8b8f: Waiting 2024-12-17T23:56:08.5441537Z 4f4fb700ef54: Pulling fs layer 2024-12-17T23:56:08.5441843Z 8c799786826d: Pulling fs layer 2024-12-17T23:56:08.5442142Z 44fa2dc2d0d9: Waiting 2024-12-17T23:56:08.5442578Z ef1a553ee8be: Pulling fs layer 2024-12-17T23:56:08.5443005Z 34b9107bfe8b: Waiting 2024-12-17T23:56:08.5443469Z 4f4fb700ef54: Waiting 2024-12-17T23:56:08.5443911Z 2d5b4d57bd2a: Waiting 2024-12-17T23:56:08.5444504Z 8c799786826d: Waiting 2024-12-17T23:56:08.5444875Z 0da246d99584: Pulling fs layer 2024-12-17T23:56:08.5445185Z ef1a553ee8be: Waiting 2024-12-17T23:56:08.5445470Z 30f2a6a20f98: Pulling fs layer 2024-12-17T23:56:08.5445782Z 059c7d29514b: Pulling fs layer 2024-12-17T23:56:08.5446080Z 0da246d99584: Waiting 2024-12-17T23:56:08.5446325Z 30f2a6a20f98: Waiting 2024-12-17T23:56:08.5446595Z 154002409cdb: Pulling fs layer 2024-12-17T23:56:08.5446888Z 059c7d29514b: Waiting 2024-12-17T23:56:08.5447146Z 154002409cdb: Waiting 2024-12-17T23:56:08.7632536Z 925257a7168e: Verifying Checksum 2024-12-17T23:56:08.7633012Z 925257a7168e: Download complete 2024-12-17T23:56:09.1435568Z 1f3d25ffcb7d: Verifying Checksum 2024-12-17T23:56:09.1435939Z 1f3d25ffcb7d: Download complete 2024-12-17T23:56:09.1614037Z dcb34ce34679: Verifying Checksum 2024-12-17T23:56:09.1614401Z dcb34ce34679: Download complete 2024-12-17T23:56:09.2586317Z 4cc8b9d32724: Verifying Checksum 2024-12-17T23:56:09.2586793Z 4cc8b9d32724: Download complete 2024-12-17T23:56:09.3373993Z 420daba023a7: Download complete 2024-12-17T23:56:09.4359597Z ff25840f6834: Verifying Checksum 2024-12-17T23:56:09.4360018Z ff25840f6834: Download complete 2024-12-17T23:56:09.5154337Z 9219fbddff3f: Download complete 2024-12-17T23:56:10.3782667Z 1f3d25ffcb7d: Pull complete 2024-12-17T23:56:10.6179767Z 33756ea9a39f: Verifying Checksum 2024-12-17T23:56:10.6180176Z 33756ea9a39f: Download complete 2024-12-17T23:56:10.6398093Z 925257a7168e: Pull complete 2024-12-17T23:56:10.6996907Z 29c67d834513: Download complete 2024-12-17T23:56:10.7855897Z 1131f28efee0: Download complete 2024-12-17T23:56:10.8015285Z f3364194d183: Verifying Checksum 2024-12-17T23:56:10.8015721Z f3364194d183: Download complete 2024-12-17T23:56:10.8687245Z 1ce05e19f368: Verifying Checksum 2024-12-17T23:56:10.8688034Z 1ce05e19f368: Download complete 2024-12-17T23:56:11.4339956Z f75fd6a89da9: Verifying Checksum 2024-12-17T23:56:11.4340653Z f75fd6a89da9: Download complete 2024-12-17T23:56:11.6075805Z e0f5db15a8e1: Download complete 2024-12-17T23:56:11.8111594Z 3124f1fe68e4: Verifying Checksum 2024-12-17T23:56:11.8112013Z 3124f1fe68e4: Download complete 2024-12-17T23:56:11.9737538Z dcb34ce34679: Pull complete 2024-12-17T23:56:11.9861441Z 8ff471ae1d8a: Download complete 2024-12-17T23:56:12.4799507Z cebe223cdb63: Verifying Checksum 2024-12-17T23:56:12.4799926Z cebe223cdb63: Download complete 2024-12-17T23:56:12.5713411Z b80bf4ff9938: Verifying Checksum 2024-12-17T23:56:12.5713835Z b80bf4ff9938: Download complete 2024-12-17T23:56:12.6821672Z 5049db0838ed: Verifying Checksum 2024-12-17T23:56:12.6822140Z 5049db0838ed: Download complete 2024-12-17T23:56:12.7734219Z fe344efe8b8f: Verifying Checksum 2024-12-17T23:56:12.7734655Z fe344efe8b8f: Download complete 2024-12-17T23:56:12.8505310Z 2d5b4d57bd2a: Verifying Checksum 2024-12-17T23:56:12.8505740Z 2d5b4d57bd2a: Download complete 2024-12-17T23:56:12.9536311Z 44fa2dc2d0d9: Download complete 2024-12-17T23:56:13.0440474Z 34b9107bfe8b: Verifying Checksum 2024-12-17T23:56:13.0441032Z 34b9107bfe8b: Download complete 2024-12-17T23:56:13.0530332Z 4f4fb700ef54: Verifying Checksum 2024-12-17T23:56:13.0530800Z 4f4fb700ef54: Download complete 2024-12-17T23:56:13.1481954Z 8c799786826d: Verifying Checksum 2024-12-17T23:56:13.1482332Z 8c799786826d: Download complete 2024-12-17T23:56:13.2279345Z ef1a553ee8be: Download complete 2024-12-17T23:56:14.7218873Z 0d4638ab59c4: Verifying Checksum 2024-12-17T23:56:14.7219307Z 0d4638ab59c4: Download complete 2024-12-17T23:56:14.8122988Z 30f2a6a20f98: Verifying Checksum 2024-12-17T23:56:14.8123460Z 30f2a6a20f98: Download complete 2024-12-17T23:56:14.8985048Z 059c7d29514b: Verifying Checksum 2024-12-17T23:56:14.8985478Z 059c7d29514b: Download complete 2024-12-17T23:56:14.9769822Z 154002409cdb: Verifying Checksum 2024-12-17T23:56:14.9770402Z 154002409cdb: Download complete 2024-12-17T23:56:15.5325021Z f3364194d183: Pull complete 2024-12-17T23:56:15.6958332Z 4cc8b9d32724: Pull complete 2024-12-17T23:56:16.2152693Z ff25840f6834: Pull complete 2024-12-17T23:56:16.2282575Z 420daba023a7: Pull complete 2024-12-17T23:56:23.9617413Z 33756ea9a39f: Pull complete 2024-12-17T23:56:24.1978645Z 9219fbddff3f: Pull complete 2024-12-17T23:56:27.5165996Z 0da246d99584: Verifying Checksum 2024-12-17T23:56:27.5166441Z 0da246d99584: Download complete 2024-12-17T23:57:13.8553334Z 921f6b7523a8: Verifying Checksum 2024-12-17T23:57:13.8553734Z 921f6b7523a8: Download complete 2024-12-17T23:58:09.6618442Z 921f6b7523a8: Pull complete 2024-12-17T23:58:10.1601957Z 29c67d834513: Pull complete 2024-12-17T23:58:10.4636011Z 1131f28efee0: Pull complete 2024-12-17T23:58:12.9781122Z 3124f1fe68e4: Pull complete 2024-12-17T23:58:13.4253503Z 1ce05e19f368: Pull complete 2024-12-17T23:58:14.6216819Z f75fd6a89da9: Pull complete 2024-12-17T23:58:15.7766042Z e0f5db15a8e1: Pull complete 2024-12-17T23:58:17.1142943Z 8ff471ae1d8a: Pull complete 2024-12-17T23:58:28.8213881Z 0d4638ab59c4: Pull complete 2024-12-17T23:58:31.4036480Z cebe223cdb63: Pull complete 2024-12-17T23:58:31.8895358Z b80bf4ff9938: Pull complete 2024-12-17T23:58:32.3523463Z 5049db0838ed: Pull complete 2024-12-17T23:58:32.9012168Z fe344efe8b8f: Pull complete 2024-12-17T23:58:33.3696706Z 2d5b4d57bd2a: Pull complete 2024-12-17T23:58:33.8321591Z 44fa2dc2d0d9: Pull complete 2024-12-17T23:58:34.3318519Z 34b9107bfe8b: Pull complete 2024-12-17T23:58:34.7805392Z 4f4fb700ef54: Pull complete 2024-12-17T23:58:35.2380216Z 8c799786826d: Pull complete 2024-12-17T23:58:35.6950009Z ef1a553ee8be: Pull complete 2024-12-17T23:58:55.7819813Z 0da246d99584: Pull complete 2024-12-17T23:58:56.2718744Z 30f2a6a20f98: Pull complete 2024-12-17T23:58:56.7519289Z 059c7d29514b: Pull complete 2024-12-17T23:58:57.1929408Z 154002409cdb: Pull complete 2024-12-17T23:58:57.4309542Z Digest: sha256:9d335f45f6e71fbb6ae402124a4084895d94a26118fc11ddd5d654d4fdd009e9 2024-12-17T23:58:57.5166874Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:58:57.5668573Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:58:57.5724084Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-17T23:58:57.5725121Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-17T23:58:57.5732687Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:58:57.5733106Z env: 2024-12-17T23:58:57.5733363Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:58:57.5733679Z ##[endgroup] 2024-12-17T23:58:57.6001136Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-17T23:58:57.6001712Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-17T23:58:57.6002219Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-12-17T23:58:57.6002879Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-12-17T23:58:57.6008424Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:58:57.6008826Z env: 2024-12-17T23:58:57.6009070Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:58:57.6009357Z ##[endgroup] 2024-12-17T23:58:57.8396667Z Defaulting to user installation because normal site-packages is not writeable 2024-12-17T23:58:57.8560011Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-12-17T23:58:57.8564467Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-12-17T23:58:57.9822520Z Prepare all required actions 2024-12-17T23:58:57.9823539Z Getting action download info 2024-12-17T23:58:58.1666913Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-12-17T23:58:59.1124420Z Download action repository 'actions/download-artifact@v4' (SHA:fa0a91b85d4f404e444e00e005971372dc801d16) 2024-12-17T23:59:01.0464724Z ##[group]Run ./.github/actions/download-build-artifacts 2024-12-17T23:59:01.0465122Z with: 2024-12-17T23:59:01.0465382Z name: linux-focal-py3.9-clang9-xla 2024-12-17T23:59:01.0465721Z s3-bucket: gha-artifacts 2024-12-17T23:59:01.0466010Z env: 2024-12-17T23:59:01.0466233Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:01.0466515Z ##[endgroup] 2024-12-17T23:59:01.0553043Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-17T23:59:01.0553409Z with: 2024-12-17T23:59:01.0553665Z name: linux-focal-py3.9-clang9-xla 2024-12-17T23:59:01.0554001Z s3-bucket: gha-artifacts 2024-12-17T23:59:01.0554333Z region: us-east-1 2024-12-17T23:59:01.0554744Z env: 2024-12-17T23:59:01.0554975Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:01.0555258Z ##[endgroup] 2024-12-17T23:59:01.7918378Z (node:637811) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-17T23:59:01.7918939Z 2024-12-17T23:59:01.7919153Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-17T23:59:01.7919722Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-17T23:59:01.7920312Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-17T23:59:01.9004116Z Found 1 objects with prefix pytorch/pytorch/12383255652/linux-focal-py3.9-clang9-xla/ 2024-12-17T23:59:01.9004889Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-17T23:59:06.3101833Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-17T23:59:06.3107799Z Artifact download has finished successfully 2024-12-17T23:59:06.3381852Z ##[group]Run unzip -o artifacts.zip 2024-12-17T23:59:06.3382243Z unzip -o artifacts.zip 2024-12-17T23:59:06.3388172Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:06.3388569Z env: 2024-12-17T23:59:06.3388817Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:06.3389211Z ##[endgroup] 2024-12-17T23:59:06.3431715Z Archive: artifacts.zip 2024-12-17T23:59:06.3432147Z creating: dist/ 2024-12-17T23:59:07.2163842Z inflating: dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl 2024-12-17T23:59:07.2280870Z inflating: dist/.ninja_log 2024-12-17T23:59:07.2281657Z creating: build/custom_test_artifacts/ 2024-12-17T23:59:07.2282196Z creating: build/custom_test_artifacts/custom-op-build/ 2024-12-17T23:59:07.2282744Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-12-17T23:59:07.2283382Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-12-17T23:59:07.2284169Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-17T23:59:07.2284871Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/ 2024-12-17T23:59:07.2285554Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CMakeSystem.cmake 2024-12-17T23:59:07.2286301Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdC/ 2024-12-17T23:59:07.2287031Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdC/tmp/ 2024-12-17T23:59:07.2287861Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdC/CMakeCCompilerId.c 2024-12-17T23:59:07.2288715Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdC/a.out 2024-12-17T23:59:07.2289507Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CMakeCCompiler.cmake 2024-12-17T23:59:07.2290544Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdCXX/ 2024-12-17T23:59:07.2291304Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdCXX/tmp/ 2024-12-17T23:59:07.2292177Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-17T23:59:07.2293067Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CompilerIdCXX/a.out 2024-12-17T23:59:07.2293883Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CMakeCXXCompiler.cmake 2024-12-17T23:59:07.2294870Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CMakeDetermineCompilerABI_C.bin 2024-12-17T23:59:07.2296439Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.1/CMakeDetermineCompilerABI_CXX.bin 2024-12-17T23:59:07.2297374Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-12-17T23:59:07.2298093Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-12-17T23:59:07.2299002Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-12-17T23:59:07.2299792Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-12-17T23:59:07.2300673Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-12-17T23:59:07.2301513Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-12-17T23:59:07.2302302Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-12-17T23:59:07.2303122Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-12-17T23:59:07.2303949Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-12-17T23:59:07.2304778Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-12-17T23:59:07.2305602Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-12-17T23:59:07.2306396Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-12-17T23:59:07.2319226Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-12-17T23:59:07.2414610Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-12-17T23:59:07.2415419Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-12-17T23:59:07.2416397Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-12-17T23:59:07.2417344Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-12-17T23:59:07.2418243Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-12-17T23:59:07.2419082Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-12-17T23:59:07.2419950Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-12-17T23:59:07.2420822Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-12-17T23:59:07.2421685Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-12-17T23:59:07.2422548Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-12-17T23:59:07.2423384Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-12-17T23:59:07.2435970Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-12-17T23:59:07.2483963Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-12-17T23:59:07.2484937Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-17T23:59:07.2485770Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-12-17T23:59:07.2486519Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-12-17T23:59:07.2487204Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-12-17T23:59:07.2487880Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-12-17T23:59:07.2488522Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-12-17T23:59:07.2489104Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-12-17T23:59:07.2489698Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-12-17T23:59:07.2577877Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-12-17T23:59:07.2615639Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-12-17T23:59:07.2616474Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-12-17T23:59:07.2616975Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-12-17T23:59:07.2617575Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-12-17T23:59:07.2618312Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-17T23:59:07.2619002Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/ 2024-12-17T23:59:07.2619692Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CMakeSystem.cmake 2024-12-17T23:59:07.2620430Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdC/ 2024-12-17T23:59:07.2621161Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdC/tmp/ 2024-12-17T23:59:07.2621980Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdC/CMakeCCompilerId.c 2024-12-17T23:59:07.2622824Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdC/a.out 2024-12-17T23:59:07.2623609Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CMakeCCompiler.cmake 2024-12-17T23:59:07.2624366Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdCXX/ 2024-12-17T23:59:07.2625102Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdCXX/tmp/ 2024-12-17T23:59:07.2625970Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-17T23:59:07.2626854Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CompilerIdCXX/a.out 2024-12-17T23:59:07.2627650Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CMakeCXXCompiler.cmake 2024-12-17T23:59:07.2628906Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CMakeDetermineCompilerABI_C.bin 2024-12-17T23:59:07.2630595Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.1/CMakeDetermineCompilerABI_CXX.bin 2024-12-17T23:59:07.2631400Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-12-17T23:59:07.2632088Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-12-17T23:59:07.2632795Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-12-17T23:59:07.2633606Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-12-17T23:59:07.2634519Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-12-17T23:59:07.2635537Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-12-17T23:59:07.2636360Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-12-17T23:59:07.2637193Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-12-17T23:59:07.2638042Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-12-17T23:59:07.2638886Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-12-17T23:59:07.2639727Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-12-17T23:59:07.2640544Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-12-17T23:59:07.2653572Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-12-17T23:59:07.2686704Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-12-17T23:59:07.2687817Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-17T23:59:07.2688639Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-12-17T23:59:07.2689372Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-12-17T23:59:07.2690053Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-12-17T23:59:07.2690707Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-12-17T23:59:07.2691355Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-12-17T23:59:07.2691930Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-12-17T23:59:07.2692520Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-12-17T23:59:07.2718872Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-12-17T23:59:07.2719476Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-12-17T23:59:07.2720040Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-12-17T23:59:07.2720688Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-12-17T23:59:07.2721471Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-17T23:59:07.2722221Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/ 2024-12-17T23:59:07.2722954Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CMakeSystem.cmake 2024-12-17T23:59:07.2723748Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdC/ 2024-12-17T23:59:07.2724527Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdC/tmp/ 2024-12-17T23:59:07.2725422Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdC/CMakeCCompilerId.c 2024-12-17T23:59:07.2726313Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdC/a.out 2024-12-17T23:59:07.2727160Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CMakeCCompiler.cmake 2024-12-17T23:59:07.2727983Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdCXX/ 2024-12-17T23:59:07.2728779Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdCXX/tmp/ 2024-12-17T23:59:07.2729700Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-17T23:59:07.2730642Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CompilerIdCXX/a.out 2024-12-17T23:59:07.2731508Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CMakeCXXCompiler.cmake 2024-12-17T23:59:07.2732609Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CMakeDetermineCompilerABI_C.bin 2024-12-17T23:59:07.2733903Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.1/CMakeDetermineCompilerABI_CXX.bin 2024-12-17T23:59:07.2734772Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-12-17T23:59:07.2735520Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-12-17T23:59:07.2736394Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-12-17T23:59:07.2737278Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-12-17T23:59:07.2738263Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-12-17T23:59:07.2739215Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-12-17T23:59:07.2740151Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-12-17T23:59:07.2741061Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-12-17T23:59:07.2741987Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-12-17T23:59:07.2742906Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-12-17T23:59:07.2743822Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-12-17T23:59:07.2744869Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-12-17T23:59:07.2745839Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-12-17T23:59:07.2823486Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-12-17T23:59:07.2824426Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-12-17T23:59:07.2825348Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-12-17T23:59:07.2826380Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-12-17T23:59:07.2827369Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-12-17T23:59:07.2828303Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-12-17T23:59:07.2829263Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-12-17T23:59:07.2830248Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-12-17T23:59:07.2831212Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-12-17T23:59:07.2832186Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-12-17T23:59:07.2833137Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-12-17T23:59:07.2846332Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-12-17T23:59:07.2871307Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-12-17T23:59:07.2872359Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-17T23:59:07.2873429Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-12-17T23:59:07.2874247Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-12-17T23:59:07.2874970Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-12-17T23:59:07.2875695Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-12-17T23:59:07.2876391Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-12-17T23:59:07.2877017Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-12-17T23:59:07.2877659Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-12-17T23:59:07.2946966Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-12-17T23:59:07.2967420Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-12-17T23:59:07.2967975Z creating: build/lib/ 2024-12-17T23:59:07.3038090Z inflating: build/lib/libprotobuf-lite.a 2024-12-17T23:59:07.3407864Z inflating: build/lib/libprotobuf.a 2024-12-17T23:59:07.3415157Z inflating: build/lib/libpthreadpool.a 2024-12-17T23:59:07.3422431Z inflating: build/lib/libcpuinfo.a 2024-12-17T23:59:07.3834418Z inflating: build/lib/libprotoc.a 2024-12-17T23:59:07.3839220Z inflating: build/lib/libcpuinfo_internals.a 2024-12-17T23:59:07.3839925Z inflating: build/lib/libclog.a 2024-12-17T23:59:07.3857567Z inflating: build/lib/libpytorch_qnnpack.a 2024-12-17T23:59:07.3859839Z inflating: build/lib/libnnpack_reference_layers.a 2024-12-17T23:59:07.3878617Z inflating: build/lib/libnnpack.a 2024-12-17T23:59:07.4032091Z inflating: build/lib/libmicrokernels-prod.a 2024-12-17T23:59:07.4660742Z inflating: build/lib/libmicrokernels-all.a 2024-12-17T23:59:07.4718741Z inflating: build/lib/libgtest.a 2024-12-17T23:59:07.4728297Z inflating: build/lib/libgmock.a 2024-12-17T23:59:07.4729051Z inflating: build/lib/libgmock_main.a 2024-12-17T23:59:07.4729460Z inflating: build/lib/libgtest_main.a 2024-12-17T23:59:07.4835453Z inflating: build/lib/libXNNPACK.a 2024-12-17T23:59:07.4896062Z inflating: build/lib/libbenchmark.a 2024-12-17T23:59:07.4896660Z inflating: build/lib/libbenchmark_main.a 2024-12-17T23:59:07.4902254Z inflating: build/lib/libittnotify.a 2024-12-17T23:59:07.4964886Z inflating: build/lib/libasmjit.a 2024-12-17T23:59:07.4987290Z inflating: build/lib/libtensorpipe_uv.a 2024-12-17T23:59:07.5442323Z inflating: build/lib/libtensorpipe.a 2024-12-17T23:59:07.5523962Z inflating: build/lib/libgloo.a 2024-12-17T23:59:07.5565189Z inflating: build/lib/libonnx_proto.a 2024-12-17T23:59:07.6228372Z inflating: build/lib/libonnx.a 2024-12-17T23:59:07.7181189Z inflating: build/lib/libfbgemm.a 2024-12-17T23:59:07.7200860Z inflating: build/lib/libfmt.a 2024-12-17T23:59:07.7453895Z inflating: build/lib/libkineto.a 2024-12-17T23:59:07.7537128Z inflating: build/lib/libc10.so 2024-12-17T23:59:08.9643114Z inflating: build/lib/libdnnl.a 2024-12-17T23:59:08.9643743Z inflating: build/lib/libtorch_global_deps.so 2024-12-17T23:59:10.9059845Z inflating: build/lib/libtorch_cpu.so 2024-12-17T23:59:10.9060376Z inflating: build/lib/libtorch.so 2024-12-17T23:59:10.9064562Z inflating: build/lib/libunbox_lib.a 2024-12-17T23:59:10.9136084Z inflating: build/lib/libtorchbind_test.so 2024-12-17T23:59:10.9155507Z inflating: build/lib/libjitbackend_test.so 2024-12-17T23:59:10.9179197Z inflating: build/lib/libbackend_with_compiler.so 2024-12-17T23:59:10.9205655Z inflating: build/lib/libaoti_custom_ops.so 2024-12-17T23:59:10.9208197Z inflating: build/lib/libshm.so 2024-12-17T23:59:11.1122757Z inflating: build/lib/libtorch_python.so 2024-12-17T23:59:11.1158463Z inflating: build/lib/libnnapi_backend.so 2024-12-17T23:59:11.1158889Z creating: build/bin/ 2024-12-17T23:59:11.1159440Z creating: build/bin/CMakeFiles/ 2024-12-17T23:59:11.1159819Z inflating: build/bin/cmake_install.cmake 2024-12-17T23:59:11.1160186Z inflating: build/bin/CTestTestfile.cmake 2024-12-17T23:59:11.1513457Z inflating: build/bin/protoc-3.13.0.0 2024-12-17T23:59:11.1865887Z inflating: build/bin/protoc 2024-12-17T23:59:11.1915151Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-12-17T23:59:11.1963778Z inflating: build/bin/c10_DeviceGuard_test 2024-12-17T23:59:11.2012212Z inflating: build/bin/c10_Device_test 2024-12-17T23:59:11.2058543Z inflating: build/bin/c10_StreamGuard_test 2024-12-17T23:59:11.2112818Z inflating: build/bin/c10_DispatchKeySet_test 2024-12-17T23:59:11.2163659Z inflating: build/bin/c10_Scalar_test 2024-12-17T23:59:11.2210953Z inflating: build/bin/c10_SymInt_test 2024-12-17T23:59:11.2260632Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-12-17T23:59:11.2314324Z inflating: build/bin/c10_InlineStreamGuard_test 2024-12-17T23:59:11.2367353Z inflating: build/bin/c10_SizesAndStrides_test 2024-12-17T23:59:11.2431102Z inflating: build/bin/c10_cow_test 2024-12-17T23:59:11.2479575Z inflating: build/bin/c10_ArrayRef_test 2024-12-17T23:59:11.2530018Z inflating: build/bin/c10_Bitset_test 2024-12-17T23:59:11.2576595Z inflating: build/bin/c10_ConstexprCrc_test 2024-12-17T23:59:11.2623116Z inflating: build/bin/c10_DeadlockDetection_test 2024-12-17T23:59:11.2673045Z inflating: build/bin/c10_Half_test 2024-12-17T23:59:11.2723232Z inflating: build/bin/c10_NetworkFlow_test 2024-12-17T23:59:11.2776685Z inflating: build/bin/c10_LeftRight_test 2024-12-17T23:59:11.2822724Z inflating: build/bin/c10_Synchronized_test 2024-12-17T23:59:11.2874242Z inflating: build/bin/c10_Metaprogramming_test 2024-12-17T23:59:11.2925220Z inflating: build/bin/c10_ThreadLocal_test 2024-12-17T23:59:11.2974068Z inflating: build/bin/c10_TypeList_test 2024-12-17T23:59:11.3020330Z inflating: build/bin/c10_TypeIndex_test 2024-12-17T23:59:11.3067561Z inflating: build/bin/c10_TypeTraits_test 2024-12-17T23:59:11.3118061Z inflating: build/bin/c10_accumulate_test 2024-12-17T23:59:11.3169016Z inflating: build/bin/c10_bfloat16_test 2024-12-17T23:59:11.3217759Z inflating: build/bin/c10_bit_cast_test 2024-12-17T23:59:11.3263732Z inflating: build/bin/c10_error_test 2024-12-17T23:59:11.3317142Z inflating: build/bin/c10_complex_test 2024-12-17T23:59:11.3371170Z inflating: build/bin/c10_complex_math_test 2024-12-17T23:59:11.3417992Z inflating: build/bin/c10_flags_test 2024-12-17T23:59:11.3470020Z inflating: build/bin/c10_exception_test 2024-12-17T23:59:11.3516889Z inflating: build/bin/c10_generic_math_test 2024-12-17T23:59:11.3566229Z inflating: build/bin/c10_irange_test 2024-12-17T23:59:11.3697821Z inflating: build/bin/c10_intrusive_ptr_test 2024-12-17T23:59:11.3747471Z inflating: build/bin/c10_lazy_test 2024-12-17T23:59:11.3800542Z inflating: build/bin/c10_logging_test 2024-12-17T23:59:11.3872422Z inflating: build/bin/c10_optional_test 2024-12-17T23:59:11.3930792Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-12-17T23:59:11.3981946Z inflating: build/bin/c10_registry_test 2024-12-17T23:59:11.4115538Z inflating: build/bin/c10_small_vector_test 2024-12-17T23:59:11.4164812Z inflating: build/bin/c10_ssize_test 2024-12-17T23:59:11.4213739Z inflating: build/bin/c10_string_util_test 2024-12-17T23:59:11.4260122Z inflating: build/bin/c10_tempfile_test 2024-12-17T23:59:11.4316058Z inflating: build/bin/c10_string_view_test 2024-12-17T23:59:11.4354595Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-12-17T23:59:11.4404752Z inflating: build/bin/c10_typeid_test 2024-12-17T23:59:11.4780564Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-12-17T23:59:11.5164119Z inflating: build/bin/vec_test_all_types_AVX512 2024-12-17T23:59:11.5559956Z inflating: build/bin/vec_test_all_types_AVX2 2024-12-17T23:59:11.5609408Z inflating: build/bin/static_runtime_bench 2024-12-17T23:59:11.5891400Z inflating: build/bin/static_runtime_test 2024-12-17T23:59:11.5959011Z inflating: build/bin/Dict_test 2024-12-17T23:59:11.6006968Z inflating: build/bin/Dimname_test 2024-12-17T23:59:11.6070203Z inflating: build/bin/MaybeOwned_test 2024-12-17T23:59:11.6122929Z inflating: build/bin/NamedTensor_test 2024-12-17T23:59:11.6178025Z inflating: build/bin/apply_utils_test 2024-12-17T23:59:11.6233086Z inflating: build/bin/atest 2024-12-17T23:59:11.6293769Z inflating: build/bin/basic 2024-12-17T23:59:11.6344677Z inflating: build/bin/broadcast_test 2024-12-17T23:59:11.6394895Z inflating: build/bin/cpu_allocator_test 2024-12-17T23:59:11.6450036Z inflating: build/bin/cpu_generator_test 2024-12-17T23:59:11.6498333Z inflating: build/bin/cpu_profiling_allocator_test 2024-12-17T23:59:11.6586179Z inflating: build/bin/cpu_rng_test 2024-12-17T23:59:11.6635134Z inflating: build/bin/dispatch_key_set_test 2024-12-17T23:59:11.6683739Z inflating: build/bin/dlconvertor_test 2024-12-17T23:59:11.6737788Z inflating: build/bin/extension_backend_test 2024-12-17T23:59:11.6787848Z inflating: build/bin/half_test 2024-12-17T23:59:11.6880646Z inflating: build/bin/ivalue_test 2024-12-17T23:59:11.6928436Z inflating: build/bin/lazy_tensor_test 2024-12-17T23:59:11.6978232Z inflating: build/bin/math_kernel_test 2024-12-17T23:59:11.7027478Z inflating: build/bin/memory_format_test 2024-12-17T23:59:11.7079558Z inflating: build/bin/memory_overlapping_test 2024-12-17T23:59:11.7129968Z inflating: build/bin/mobile_memory_cleanup 2024-12-17T23:59:11.7182222Z inflating: build/bin/native_test 2024-12-17T23:59:11.7232319Z inflating: build/bin/operator_name_test 2024-12-17T23:59:11.7280473Z inflating: build/bin/operators_test 2024-12-17T23:59:11.7330375Z inflating: build/bin/packedtensoraccessor_test 2024-12-17T23:59:11.7397780Z inflating: build/bin/pow_test 2024-12-17T23:59:11.7450860Z inflating: build/bin/quantized_test 2024-12-17T23:59:11.7498234Z inflating: build/bin/reduce_ops_test 2024-12-17T23:59:11.7546670Z inflating: build/bin/reportMemoryUsage_test 2024-12-17T23:59:11.7602306Z inflating: build/bin/scalar_tensor_test 2024-12-17T23:59:11.7656945Z inflating: build/bin/scalar_test 2024-12-17T23:59:11.7704634Z inflating: build/bin/StorageUtils_test 2024-12-17T23:59:11.7754619Z inflating: build/bin/stride_properties_test 2024-12-17T23:59:11.7832021Z inflating: build/bin/tensor_iterator_test 2024-12-17T23:59:11.7883467Z inflating: build/bin/test_parallel 2024-12-17T23:59:11.7884532Z inflating: build/bin/thread_init_test 2024-12-17T23:59:11.7935195Z inflating: build/bin/type_ptr_test 2024-12-17T23:59:11.7993693Z inflating: build/bin/type_test 2024-12-17T23:59:11.8043104Z inflating: build/bin/undefined_tensor_test 2024-12-17T23:59:11.8043558Z inflating: build/bin/verify_api_visibility 2024-12-17T23:59:11.8114124Z inflating: build/bin/legacy_vmap_test 2024-12-17T23:59:11.8162821Z inflating: build/bin/weakref_test 2024-12-17T23:59:11.8212584Z inflating: build/bin/wrapdim_test 2024-12-17T23:59:11.8261452Z inflating: build/bin/xla_tensor_test 2024-12-17T23:59:11.8319230Z inflating: build/bin/IListRef_test 2024-12-17T23:59:11.8414512Z inflating: build/bin/List_test 2024-12-17T23:59:11.8476117Z inflating: build/bin/KernelFunction_test 2024-12-17T23:59:11.8598535Z inflating: build/bin/kernel_function_legacy_test 2024-12-17T23:59:11.8689656Z inflating: build/bin/kernel_function_test 2024-12-17T23:59:11.8816048Z inflating: build/bin/kernel_lambda_legacy_test 2024-12-17T23:59:11.8914339Z inflating: build/bin/kernel_lambda_test 2024-12-17T23:59:11.8972803Z inflating: build/bin/kernel_stackbased_test 2024-12-17T23:59:11.9064386Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-12-17T23:59:11.9117459Z inflating: build/bin/backend_fallback_test 2024-12-17T23:59:11.9166157Z inflating: build/bin/CppSignature_test 2024-12-17T23:59:11.9212401Z inflating: build/bin/op_allowlist_test 2024-12-17T23:59:11.9517382Z inflating: build/bin/op_registration_test 2024-12-17T23:59:11.9577995Z inflating: build/bin/inline_container_test 2024-12-17T23:59:11.9626945Z inflating: build/bin/test_edge_op_registration 2024-12-17T23:59:11.9642066Z inflating: build/bin/tutorial_tensorexpr 2024-12-17T23:59:12.0512986Z inflating: build/bin/test_tensorexpr 2024-12-17T23:59:12.0562341Z inflating: build/bin/BackoffTest 2024-12-17T23:59:12.1114119Z inflating: build/bin/test_jit 2024-12-17T23:59:12.1164314Z inflating: build/bin/FileStoreTest 2024-12-17T23:59:12.1214956Z inflating: build/bin/TCPStoreTest 2024-12-17T23:59:12.1265042Z inflating: build/bin/HashStoreTest 2024-12-17T23:59:12.1330364Z inflating: build/bin/ProcessGroupGlooTest 2024-12-17T23:59:12.1335947Z inflating: build/bin/ProcessGroupMPITest 2024-12-17T23:59:12.1338840Z inflating: build/bin/example_allreduce 2024-12-17T23:59:12.1393372Z inflating: build/bin/test_dist_autograd 2024-12-17T23:59:12.1456057Z inflating: build/bin/test_cpp_rpc 2024-12-17T23:59:12.2698528Z inflating: build/bin/test_api 2024-12-17T23:59:12.2700314Z inflating: build/bin/parallel_benchmark 2024-12-17T23:59:12.3013552Z inflating: build/bin/test_lazy 2024-12-17T23:59:12.3015987Z inflating: build/bin/torch_shm_manager 2024-12-17T23:59:12.3016629Z creating: .additional_ci_files/ 2024-12-17T23:59:12.3103336Z inflating: .additional_ci_files/test-times.json 2024-12-17T23:59:12.3448277Z inflating: .additional_ci_files/test-class-times.json 2024-12-17T23:59:12.3473746Z ##[group]Run rm artifacts.zip 2024-12-17T23:59:12.3474082Z rm artifacts.zip 2024-12-17T23:59:12.3479649Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:12.3480040Z env: 2024-12-17T23:59:12.3480281Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:12.3480569Z ##[endgroup] 2024-12-17T23:59:12.3878319Z ##[group]Run df -H 2024-12-17T23:59:12.3878582Z df -H 2024-12-17T23:59:12.3883733Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:12.3884139Z env: 2024-12-17T23:59:12.3884377Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:12.3884659Z ##[endgroup] 2024-12-17T23:59:12.3923328Z Filesystem Size Used Avail Use% Mounted on 2024-12-17T23:59:12.3924547Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-12-17T23:59:12.3925591Z tmpfs 50G 0 50G 0% /dev/shm 2024-12-17T23:59:12.3926968Z tmpfs 20G 652k 20G 1% /run 2024-12-17T23:59:12.3927944Z /dev/nvme0n1p1 215G 41G 175G 19% / 2024-12-17T23:59:12.3929000Z tmpfs 50G 41k 50G 1% /tmp 2024-12-17T23:59:12.3929364Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-12-17T23:59:12.3960901Z Prepare all required actions 2024-12-17T23:59:12.3961342Z Getting action download info 2024-12-17T23:59:12.6231457Z ##[group]Run ./.github/actions/download-td-artifacts 2024-12-17T23:59:12.6231836Z with: 2024-12-17T23:59:12.6232052Z env: 2024-12-17T23:59:12.6232284Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:12.6232545Z ##[endgroup] 2024-12-17T23:59:12.6540414Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-17T23:59:12.6540799Z with: 2024-12-17T23:59:12.6541050Z name: td_results 2024-12-17T23:59:12.6541329Z s3-bucket: gha-artifacts 2024-12-17T23:59:12.6541620Z region: us-east-1 2024-12-17T23:59:12.6541888Z env: 2024-12-17T23:59:12.6542135Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:12.6542435Z ##[endgroup] 2024-12-17T23:59:13.1044583Z (node:637831) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-17T23:59:13.1045114Z 2024-12-17T23:59:13.1045412Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-17T23:59:13.1045966Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-17T23:59:13.1046550Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-17T23:59:13.2134361Z Found 1 objects with prefix pytorch/pytorch/12383255652/td_results/ 2024-12-17T23:59:13.2135046Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-12-17T23:59:13.2672374Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-12-17T23:59:13.2676036Z Artifact download has finished successfully 2024-12-17T23:59:13.3077940Z ##[group]Run mkdir -p .additional_ci_files 2024-12-17T23:59:13.3078304Z mkdir -p .additional_ci_files 2024-12-17T23:59:13.3078731Z mv td_results.json .additional_ci_files/td_results.json || true 2024-12-17T23:59:13.3084610Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:13.3085015Z env: 2024-12-17T23:59:13.3085270Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:13.3085555Z ##[endgroup] 2024-12-17T23:59:13.3282368Z ##[group]Run .github/scripts/parse_ref.py 2024-12-17T23:59:13.3282756Z .github/scripts/parse_ref.py 2024-12-17T23:59:13.3288098Z shell: /usr/bin/bash -e {0} 2024-12-17T23:59:13.3288385Z env: 2024-12-17T23:59:13.3288613Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:13.3288886Z ##[endgroup] 2024-12-17T23:59:13.3545269Z Prepare all required actions 2024-12-17T23:59:13.3724554Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-12-17T23:59:13.3725020Z with: 2024-12-17T23:59:13.3725573Z github-token: *** 2024-12-17T23:59:13.3725820Z env: 2024-12-17T23:59:13.3726049Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:13.3726319Z ##[endgroup] 2024-12-17T23:59:13.3830735Z ##[group]Run set -eux 2024-12-17T23:59:13.3831003Z set -eux 2024-12-17T23:59:13.3831425Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-17T23:59:13.3836668Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:13.3837044Z env: 2024-12-17T23:59:13.3837262Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:13.3837733Z GITHUB_TOKEN: *** 2024-12-17T23:59:13.3837976Z ##[endgroup] 2024-12-17T23:59:13.3858885Z + python3 .github/scripts/get_workflow_job_id.py 12383255652 i-0dcf3a01d7b6a24eb 2024-12-17T23:59:15.3861674Z setting job-id=34566322490 2024-12-17T23:59:15.3862287Z setting job-name=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-17T23:59:15.4141168Z Prepare all required actions 2024-12-17T23:59:15.4141955Z Getting action download info 2024-12-17T23:59:15.5621776Z ##[group]Run ./.github/actions/filter-test-configs 2024-12-17T23:59:15.5622145Z with: 2024-12-17T23:59:15.5622612Z github-token: *** 2024-12-17T23:59:15.5623084Z test-matrix: {"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "linux.12xlarge"}]} 2024-12-17T23:59:15.5623755Z job-name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-17T23:59:15.5624223Z env: 2024-12-17T23:59:15.5624466Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:15.5624743Z ##[endgroup] 2024-12-17T23:59:15.5925200Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-17T23:59:15.5925498Z with: 2024-12-17T23:59:15.5925718Z shell: bash 2024-12-17T23:59:15.5925930Z timeout_minutes: 10 2024-12-17T23:59:15.5926169Z max_attempts: 5 2024-12-17T23:59:15.5926402Z retry_wait_seconds: 30 2024-12-17T23:59:15.5927209Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-17T23:59:15.5927996Z polling_interval_seconds: 1 2024-12-17T23:59:15.5928268Z warning_on_retry: true 2024-12-17T23:59:15.5928515Z continue_on_error: false 2024-12-17T23:59:15.5928758Z env: 2024-12-17T23:59:15.5928957Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:15.5929449Z GITHUB_TOKEN: *** 2024-12-17T23:59:15.5929670Z ##[endgroup] 2024-12-17T23:59:15.6872528Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-17T23:59:15.9182005Z Defaulting to user installation because normal site-packages is not writeable 2024-12-17T23:59:15.9338076Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2024-12-17T23:59:15.9340511Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2024-12-17T23:59:15.9452273Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-12-17T23:59:15.9453673Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.12.14) 2024-12-17T23:59:15.9464211Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2024-12-17T23:59:15.9474274Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-12-17T23:59:16.6693878Z Command completed after 1 attempt(s). 2024-12-17T23:59:16.6921482Z ##[group]Run set -x 2024-12-17T23:59:16.6921771Z set -x 2024-12-17T23:59:16.6922168Z  2024-12-17T23:59:16.6922544Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-17T23:59:16.6923032Z # in runner workspace 2024-12-17T23:59:16.6923447Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-12-17T23:59:16.6930545Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:16.6930937Z env: 2024-12-17T23:59:16.6931176Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:16.6931441Z ##[endgroup] 2024-12-17T23:59:16.6958775Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-12-17T23:59:16.7393432Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-17T23:59:16.7393843Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-17T23:59:16.7394193Z echo "Job name: ${JOB_NAME}" 2024-12-17T23:59:16.7394480Z  2024-12-17T23:59:16.7394869Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-17T23:59:16.7395548Z # in runner workspace 2024-12-17T23:59:16.7396001Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-12-17T23:59:16.7396687Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-12-17T23:59:16.7397033Z  --job-name "${JOB_NAME}" \ 2024-12-17T23:59:16.7397585Z  --test-matrix "{"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "linux.12xlarge"}]}" \ 2024-12-17T23:59:16.7398156Z  --selected-test-configs "" \ 2024-12-17T23:59:16.7398523Z  --pr-number "${PR_NUMBER}" \ 2024-12-17T23:59:16.7398860Z  --tag "${TAG}" \ 2024-12-17T23:59:16.7399174Z  --event-name "${EVENT_NAME}" \ 2024-12-17T23:59:16.7399508Z  --schedule "${SCHEDULE}" \ 2024-12-17T23:59:16.7399843Z  --branch "${HEAD_BRANCH}" 2024-12-17T23:59:16.7405231Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:16.7405629Z env: 2024-12-17T23:59:16.7405859Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:16.7406339Z GITHUB_TOKEN: *** 2024-12-17T23:59:16.7406697Z JOB_NAME: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-17T23:59:16.7407142Z PR_NUMBER: 2024-12-17T23:59:16.7407375Z TAG: 2024-12-17T23:59:16.7407594Z EVENT_NAME: push 2024-12-17T23:59:16.7407837Z SCHEDULE: 2024-12-17T23:59:16.7408050Z HEAD_BRANCH: 2024-12-17T23:59:16.7408287Z ##[endgroup] 2024-12-17T23:59:16.7431187Z Workflow: pull 2024-12-17T23:59:16.7431633Z Job name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-17T23:59:17.0183340Z ##[group]Run echo "Filtered matrix:" 2024-12-17T23:59:17.0183690Z echo "Filtered matrix:" 2024-12-17T23:59:17.0184149Z echo "{"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "linux.12xlarge"}]}" 2024-12-17T23:59:17.0184624Z  2024-12-17T23:59:17.0184833Z echo 2024-12-17T23:59:17.0185108Z echo "Is the current job unstable? False" 2024-12-17T23:59:17.0185455Z  2024-12-17T23:59:17.0185651Z echo 2024-12-17T23:59:17.0185910Z echo "Is keep-going label set? False" 2024-12-17T23:59:17.0186230Z  2024-12-17T23:59:17.0186451Z echo 2024-12-17T23:59:17.0186687Z echo "Renabled issues? " 2024-12-17T23:59:17.0192122Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:17.0192527Z env: 2024-12-17T23:59:17.0192757Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:17.0193035Z ##[endgroup] 2024-12-17T23:59:17.0216806Z Filtered matrix: 2024-12-17T23:59:17.0217235Z {include: [{config: xla, shard: 1, num_shards: 1, runner: linux.12xlarge}]} 2024-12-17T23:59:17.0217662Z 2024-12-17T23:59:17.0217797Z Is the current job unstable? False 2024-12-17T23:59:17.0218008Z 2024-12-17T23:59:17.0218124Z Is keep-going label set? False 2024-12-17T23:59:17.0218338Z 2024-12-17T23:59:17.0218438Z Renabled issues? 2024-12-17T23:59:17.0293380Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-17T23:59:17.0294017Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-17T23:59:17.0299756Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-17T23:59:17.0300160Z env: 2024-12-17T23:59:17.0300391Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:17.0300677Z JOB_TIMEOUT: 240 2024-12-17T23:59:17.0300926Z ##[endgroup] 2024-12-17T23:59:17.0466808Z ##[group]Run set -x 2024-12-17T23:59:17.0467143Z set -x 2024-12-17T23:59:17.0467390Z  2024-12-17T23:59:17.0467664Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-12-17T23:59:17.0468083Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-12-17T23:59:17.0468494Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-12-17T23:59:17.0468978Z  TEST_COMMAND=.ci/onnx/test.sh 2024-12-17T23:59:17.0469284Z else 2024-12-17T23:59:17.0469537Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-12-17T23:59:17.0469856Z fi 2024-12-17T23:59:17.0470053Z  2024-12-17T23:59:17.0470388Z # detached container should get cleaned up by teardown_ec2_linux 2024-12-17T23:59:17.0470911Z # TODO: Stop building test binaries as part of the build phase 2024-12-17T23:59:17.0471366Z # Used for GPU_FLAG since that doesn't play nice 2024-12-17T23:59:17.0471772Z # shellcheck disable=SC2086,SC2090 2024-12-17T23:59:17.0472109Z container_name=$(docker run \ 2024-12-17T23:59:17.0472416Z  ${GPU_FLAG:-} \ 2024-12-17T23:59:17.0472714Z  ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \ 2024-12-17T23:59:17.0473056Z  -e BUILD_ENVIRONMENT \ 2024-12-17T23:59:17.0473338Z  -e PR_NUMBER \ 2024-12-17T23:59:17.0473609Z  -e GITHUB_ACTIONS \ 2024-12-17T23:59:17.0473900Z  -e GITHUB_REPOSITORY \ 2024-12-17T23:59:17.0474204Z  -e GITHUB_WORKFLOW \ 2024-12-17T23:59:17.0474704Z  -e GITHUB_JOB \ 2024-12-17T23:59:17.0474986Z  -e GITHUB_RUN_ID \ 2024-12-17T23:59:17.0475279Z  -e GITHUB_RUN_NUMBER \ 2024-12-17T23:59:17.0475591Z  -e GITHUB_RUN_ATTEMPT \ 2024-12-17T23:59:17.0475898Z  -e JOB_ID \ 2024-12-17T23:59:17.0476164Z  -e JOB_NAME \ 2024-12-17T23:59:17.0476421Z  -e BASE_SHA \ 2024-12-17T23:59:17.0476690Z  -e BRANCH \ 2024-12-17T23:59:17.0476957Z  -e SHA1 \ 2024-12-17T23:59:17.0477223Z  -e AWS_DEFAULT_REGION \ 2024-12-17T23:59:17.0477533Z  -e IN_WHEEL_TEST \ 2024-12-17T23:59:17.0477809Z  -e SHARD_NUMBER \ 2024-12-17T23:59:17.0478095Z  -e TEST_CONFIG \ 2024-12-17T23:59:17.0478385Z  -e NUM_TEST_SHARDS \ 2024-12-17T23:59:17.0478688Z  -e REENABLED_ISSUES \ 2024-12-17T23:59:17.0479007Z  -e CONTINUE_THROUGH_ERROR \ 2024-12-17T23:59:17.0479331Z  -e VERBOSE_TEST_LOGS \ 2024-12-17T23:59:17.0479627Z  -e TEST_SHOWLOCALS \ 2024-12-17T23:59:17.0479933Z  -e NO_TEST_TIMEOUT \ 2024-12-17T23:59:17.0480224Z  -e NO_TD \ 2024-12-17T23:59:17.0480490Z  -e TD_DISTRIBUTED \ 2024-12-17T23:59:17.0480785Z  -e PR_LABELS \ 2024-12-17T23:59:17.0481078Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-12-17T23:59:17.0481423Z  -e SCCACHE_BUCKET \ 2024-12-17T23:59:17.0481724Z  -e SCCACHE_REGION \ 2024-12-17T23:59:17.0482029Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-12-17T23:59:17.0482346Z  -e XLA_CUDA \ 2024-12-17T23:59:17.0482635Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-12-17T23:59:17.0483007Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-12-17T23:59:17.0483389Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-12-17T23:59:17.0483768Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-12-17T23:59:17.0484121Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-12-17T23:59:17.0484454Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-12-17T23:59:17.0484945Z  -e DASHBOARD_TAG \ 2024-12-17T23:59:17.0485244Z  -e IS_A100_RUNNER \ 2024-12-17T23:59:17.0485646Z  -e ARTIFACTS_FILE_SUFFIX \ 2024-12-17T23:59:17.0486005Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-12-17T23:59:17.0486393Z  --security-opt seccomp=unconfined \ 2024-12-17T23:59:17.0486801Z  --cap-add=SYS_PTRACE \ 2024-12-17T23:59:17.0487093Z  --ipc=host \ 2024-12-17T23:59:17.0487360Z  --shm-size="${SHM_SIZE}" \ 2024-12-17T23:59:17.0487652Z  --tty \ 2024-12-17T23:59:17.0487891Z  --detach \ 2024-12-17T23:59:17.0488141Z  --name="${container_name}" \ 2024-12-17T23:59:17.0488451Z  --user jenkins \ 2024-12-17T23:59:17.0488794Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-12-17T23:59:17.0489190Z  -w /var/lib/jenkins/workspace \ 2024-12-17T23:59:17.0489508Z  "${DOCKER_IMAGE}" 2024-12-17T23:59:17.0489784Z ) 2024-12-17T23:59:17.0490076Z # Propagate download.pytorch.org IP to container 2024-12-17T23:59:17.0490716Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-12-17T23:59:17.0491413Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-12-17T23:59:17.0492305Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-12-17T23:59:17.0497755Z shell: /usr/bin/bash -e {0} 2024-12-17T23:59:17.0498052Z env: 2024-12-17T23:59:17.0498289Z GIT_DEFAULT_BRANCH: main 2024-12-17T23:59:17.0498638Z BUILD_ENVIRONMENT: linux-focal-py3.9-clang9-xla 2024-12-17T23:59:17.0498999Z PR_NUMBER: 2024-12-17T23:59:17.0499268Z GITHUB_REPOSITORY: pytorch/pytorch 2024-12-17T23:59:17.0499601Z GITHUB_WORKFLOW: pull 2024-12-17T23:59:17.0499879Z GITHUB_JOB: test 2024-12-17T23:59:17.0500137Z GITHUB_RUN_ID: 12383255652 2024-12-17T23:59:17.0500429Z GITHUB_RUN_NUMBER: 276594 2024-12-17T23:59:17.0500722Z GITHUB_RUN_ATTEMPT: 1 2024-12-17T23:59:17.0500994Z JOB_ID: 34566322490 2024-12-17T23:59:17.0501395Z JOB_NAME: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-17T23:59:17.0501860Z BRANCH: release/2.6 2024-12-17T23:59:17.0502153Z SHA1: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-17T23:59:17.0502563Z BASE_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-17T23:59:17.0502930Z TEST_CONFIG: xla 2024-12-17T23:59:17.0503180Z SHARD_NUMBER: 1 2024-12-17T23:59:17.0503425Z NUM_TEST_SHARDS: 1 2024-12-17T23:59:17.0503672Z REENABLED_ISSUES: 2024-12-17T23:59:17.0503941Z CONTINUE_THROUGH_ERROR: False 2024-12-17T23:59:17.0504254Z VERBOSE_TEST_LOGS: False 2024-12-17T23:59:17.0504570Z TEST_SHOWLOCALS: False 2024-12-17T23:59:17.0504845Z NO_TEST_TIMEOUT: False 2024-12-17T23:59:17.0505101Z NO_TD: False 2024-12-17T23:59:17.0505345Z TD_DISTRIBUTED: False 2024-12-17T23:59:17.0505685Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-12-17T23:59:17.0506073Z SCCACHE_REGION: us-east-1 2024-12-17T23:59:17.0506369Z SCCACHE_S3_KEY_PREFIX: pull 2024-12-17T23:59:17.0506646Z SHM_SIZE: 1g 2024-12-17T23:59:17.0507078Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-17T23:59:17.0507588Z XLA_CUDA: 0 2024-12-17T23:59:17.0507970Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-12-17T23:59:17.0508446Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-12-17T23:59:17.0508773Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-12-17T23:59:17.0509195Z DASHBOARD_TAG: 2024-12-17T23:59:17.0509613Z HUGGING_FACE_HUB_TOKEN: *** 2024-12-17T23:59:17.0510039Z SCRIBE_GRAPHQL_ACCESS_TOKEN: *** 2024-12-17T23:59:17.0510343Z IS_A100_RUNNER: 0 2024-12-17T23:59:17.0510691Z ARTIFACTS_FILE_SUFFIX: test-xla-1-1-linux.12xlarge_34566322490 2024-12-17T23:59:17.0511090Z ##[endgroup] 2024-12-17T23:59:17.0532761Z + [[ xla == \m\u\l\t\i\g\p\u ]] 2024-12-17T23:59:17.0533311Z + [[ linux-focal-py3.9-clang9-xla == *onnx* ]] 2024-12-17T23:59:17.0533696Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-12-17T23:59:17.0540596Z +++ nproc --ignore=2 2024-12-17T23:59:17.0553382Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=46 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --env-file=/tmp/github_env_12383255652 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-18T00:00:12.4284265Z + container_name=a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T00:00:12.4290126Z + grep download.pytorch.org /etc/hosts 2024-12-18T00:00:12.4293322Z + docker exec -i a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c sudo bash -c '/bin/cat >> /etc/hosts' 2024-12-18T00:00:12.5578278Z + echo DOCKER_CONTAINER_ID=a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T00:00:12.5580527Z ++ echo dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl 2024-12-18T00:00:12.5582676Z + docker exec -t a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c sh -c 'python3 -m pip install dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-12-18T00:00:12.9627491Z Processing ./dist/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl (from torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:00:13.4253607Z Collecting filelock (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:00:13.4613647Z Downloading filelock-3.16.1-py3-none-any.whl.metadata (2.9 kB) 2024-12-18T00:00:13.4678616Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (4.11.0) 2024-12-18T00:00:13.4679945Z Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.4.2) 2024-12-18T00:00:13.4877791Z Collecting jinja2 (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:00:13.4916148Z Downloading jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB) 2024-12-18T00:00:13.5356855Z Collecting fsspec (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:00:13.5386025Z Downloading fsspec-2024.10.0-py3-none-any.whl.metadata (11 kB) 2024-12-18T00:00:13.5933672Z Collecting sympy==1.13.1 (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:00:13.5962840Z Downloading sympy-1.13.1-py3-none-any.whl.metadata (12 kB) 2024-12-18T00:00:13.6025646Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy==1.13.1->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.3.0) 2024-12-18T00:00:13.6137915Z Collecting opt-einsum>=3.3 (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:00:13.6174451Z Downloading opt_einsum-3.4.0-py3-none-any.whl.metadata (6.3 kB) 2024-12-18T00:00:13.6813513Z Collecting MarkupSafe>=2.0 (from jinja2->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:00:13.6844029Z Downloading MarkupSafe-3.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) 2024-12-18T00:00:13.6996225Z Downloading sympy-1.13.1-py3-none-any.whl (6.2 MB) 2024-12-18T00:00:13.7482335Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/6.2 MB ? eta -:--:-- 2024-12-18T00:00:13.7483164Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 158.4 MB/s eta 0:00:00 2024-12-18T00:00:13.7507461Z [?25hDownloading opt_einsum-3.4.0-py3-none-any.whl (71 kB) 2024-12-18T00:00:13.7581338Z Downloading filelock-3.16.1-py3-none-any.whl (16 kB) 2024-12-18T00:00:13.7659017Z Downloading fsspec-2024.10.0-py3-none-any.whl (179 kB) 2024-12-18T00:00:13.7741523Z Downloading jinja2-3.1.4-py3-none-any.whl (133 kB) 2024-12-18T00:00:13.7829919Z Downloading MarkupSafe-3.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20 kB) 2024-12-18T00:00:14.0648589Z Installing collected packages: sympy, opt-einsum, MarkupSafe, fsspec, filelock, jinja2, torch 2024-12-18T00:00:14.0649193Z Attempting uninstall: sympy 2024-12-18T00:00:14.0656636Z Found existing installation: sympy 1.13.3 2024-12-18T00:00:14.1900713Z Uninstalling sympy-1.13.3: 2024-12-18T00:00:14.7460634Z Successfully uninstalled sympy-1.13.3 2024-12-18T00:00:26.1141473Z Successfully installed MarkupSafe-3.0.2 filelock-3.16.1 fsspec-2024.10.0 jinja2-3.1.4 opt-einsum-3.4.0 sympy-1.13.1 torch-2.6.0a0+git0cdf8b1 2024-12-18T00:00:26.2019589Z + export TERM=vt100 2024-12-18T00:00:26.2019944Z + TERM=vt100 2024-12-18T00:00:26.2020234Z ++ dirname .ci/pytorch/test.sh 2024-12-18T00:00:26.2028298Z + source .ci/pytorch/common.sh 2024-12-18T00:00:26.2031903Z +++ dirname .ci/pytorch/common.sh 2024-12-18T00:00:26.2040310Z ++ source .ci/pytorch/common_utils.sh 2024-12-18T00:00:26.2041517Z +++ declare -f -t trap_add 2024-12-18T00:00:26.2045639Z ++ set -ex 2024-12-18T00:00:26.2045922Z ++ [[ linux-focal-py3.9-clang9-xla == *rocm* ]] 2024-12-18T00:00:26.2046294Z ++ BUILD_TEST_LIBTORCH=0 2024-12-18T00:00:26.2046595Z + [[ linux-focal-py3.9-clang9-xla != *rocm* ]] 2024-12-18T00:00:26.2046985Z + [[ -d /var/lib/jenkins/workspace ]] 2024-12-18T00:00:26.2049827Z ++ stat -c %u /var/lib/jenkins/workspace 2024-12-18T00:00:26.2065388Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-12-18T00:00:26.2065757Z + trap_add cleanup_workspace EXIT 2024-12-18T00:00:26.2066093Z + trap_add_cmd=cleanup_workspace 2024-12-18T00:00:26.2066397Z + shift 2024-12-18T00:00:26.2066654Z + for trap_add_name in "$@" 2024-12-18T00:00:26.2072809Z +++ trap -p EXIT 2024-12-18T00:00:26.2075217Z ++ eval 'extract_trap_cmd ' 2024-12-18T00:00:26.2075522Z +++ extract_trap_cmd 2024-12-18T00:00:26.2075790Z +++ printf '%s\n' '' 2024-12-18T00:00:26.2076251Z ++ printf '%s\n' cleanup_workspace 2024-12-18T00:00:26.2077731Z + trap -- ' 2024-12-18T00:00:26.2077982Z cleanup_workspace' EXIT 2024-12-18T00:00:26.2078320Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-12-18T00:00:26.6538449Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-12-18T00:00:26.6553634Z + echo 'Environment variables:' 2024-12-18T00:00:26.6553994Z Environment variables: 2024-12-18T00:00:26.6554252Z + env 2024-12-18T00:00:26.6562477Z NVIDIA_VISIBLE_DEVICES=all 2024-12-18T00:00:26.6562955Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:00:26.6563630Z PYTHON_SHA256=bfb249609990220491a1b92850a07135ed0831e41738cf681d63cf01b2a8fbd1 2024-12-18T00:00:26.6564150Z TF_CUDA_COMPUTE_CAPABILITIES=5.2,7.5 2024-12-18T00:00:26.6564494Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:00:26.6564818Z TAGS=bazel,configure_env,install_deps 2024-12-18T00:00:26.6565188Z BUILD_ENVIRONMENT=linux-focal-py3.9-clang9-xla 2024-12-18T00:00:26.6565556Z HOSTNAME=a9d01d962683 2024-12-18T00:00:26.6565829Z PYTHON_VERSION=3.10.16 2024-12-18T00:00:26.6566442Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6567106Z GITHUB_ACTION=__self 2024-12-18T00:00:26.6567377Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:00:26.6567894Z GITHUB_RUN_NUMBER=276594 2024-12-18T00:00:26.6568171Z TEST_CONFIG=xla 2024-12-18T00:00:26.6568440Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:00:26.6568789Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:00:26.6569107Z IS_A100_RUNNER=0 2024-12-18T00:00:26.6569621Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:00:26.6569939Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:00:26.6570351Z GITHUB_REF_TYPE=branch 2024-12-18T00:00:26.6570633Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:00:26.6570955Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6571310Z XLA_CUDA=0 2024-12-18T00:00:26.6571659Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:00:26.6572047Z *** 2024-12-18T00:00:26.6572281Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:00:26.6572579Z GITHUB_ACTIONS=true 2024-12-18T00:00:26.6572858Z NVIDIA_DRIVER_CAPABILITIES=compute,utility 2024-12-18T00:00:26.6573243Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6573646Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6574223Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6 2024-12-18T00:00:26.6574744Z CXX=clang++ 2024-12-18T00:00:26.6574969Z VERBOSE_TEST_LOGS=False 2024-12-18T00:00:26.6575233Z USE_CUDA=0 2024-12-18T00:00:26.6575477Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:00:26.6575781Z SHARD_NUMBER=1 2024-12-18T00:00:26.6576038Z GITHUB_REF_PROTECTED=true 2024-12-18T00:00:26.6576389Z HOME=/home/jenkins 2024-12-18T00:00:26.6576680Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:00:26.6577039Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:00:26.6577362Z LANG=C.UTF-8 2024-12-18T00:00:26.6577606Z CARGO_HOME=/opt/cargo 2024-12-18T00:00:26.6577866Z SCCACHE_S3_KEY_PREFIX=pull 2024-12-18T00:00:26.6578175Z OPENSSL_INCLUDE_DIR=/usr/include/openssl 2024-12-18T00:00:26.6578507Z NUM_TEST_SHARDS=1 2024-12-18T00:00:26.6579110Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6579830Z GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D 2024-12-18T00:00:26.6580307Z JOB_NAME=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-18T00:00:26.6581084Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6581922Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:00:26.6582447Z GITHUB_EVENT_NAME=push 2024-12-18T00:00:26.6582721Z DASHBOARD_TAG= 2024-12-18T00:00:26.6582957Z GITHUB_RUN_ID=12383255652 2024-12-18T00:00:26.6583621Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6584328Z GITHUB_ACTOR=malfet 2024-12-18T00:00:26.6584580Z PR_NUMBER= 2024-12-18T00:00:26.6584816Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:00:26.6585130Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:00:26.6585497Z TERM=vt100 2024-12-18T00:00:26.6585732Z BRANCH=release/2.6 2024-12-18T00:00:26.6585994Z RUSTUP_HOME=/opt/rustup 2024-12-18T00:00:26.6586273Z SCCACHE_REGION=us-east-1 2024-12-18T00:00:26.6586544Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:00:26.6587086Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:00:26.6587693Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:00:26.6588024Z REENABLED_ISSUES= 2024-12-18T00:00:26.6588267Z SHLVL=1 2024-12-18T00:00:26.6588500Z MAX_JOBS=46 2024-12-18T00:00:26.6588722Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:00:26.6589084Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6589501Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:00:26.6589928Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:00:26.6590385Z GITHUB_JOB=test 2024-12-18T00:00:26.6590867Z LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64: 2024-12-18T00:00:26.6591527Z NO_TEST_TIMEOUT=False 2024-12-18T00:00:26.6591798Z TD_DISTRIBUTED=False 2024-12-18T00:00:26.6592108Z TF_CUDA_PATHS=/usr/local/cuda,/usr/include,/usr 2024-12-18T00:00:26.6592489Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:00:26.6592799Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:00:26.6593092Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:00:26.6593904Z PATH=/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:00:26.6594683Z GITHUB_BASE_REF= 2024-12-18T00:00:26.6594932Z CC=clang 2024-12-18T00:00:26.6595250Z ARTIFACTS_FILE_SUFFIX=test-xla-1-1-linux.12xlarge_34566322490 2024-12-18T00:00:26.6595665Z CI=true 2024-12-18T00:00:26.6595919Z OPENSSL_LIB_DIR=/usr/lib/x86_64-linux-gnu 2024-12-18T00:00:26.6596275Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:00:26.6596580Z JOB_ID=34566322490 2024-12-18T00:00:26.6596820Z GITHUB_HEAD_REF= 2024-12-18T00:00:26.6597091Z GITHUB_ACTION_REF= 2024-12-18T00:00:26.6597393Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:00:26.6597775Z TEST_SHOWLOCALS=False 2024-12-18T00:00:26.6598046Z GITHUB_WORKFLOW=pull 2024-12-18T00:00:26.6598672Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6599347Z NO_TD=False 2024-12-18T00:00:26.6599584Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:00:26.6599891Z TPUVM_MODE= 2024-12-18T00:00:26.6600124Z _=/usr/bin/env 2024-12-18T00:00:26.6600464Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-12-18T00:00:26.6732978Z + TORCH_INSTALL_DIR=/opt/conda/lib/python3.10/site-packages/torch 2024-12-18T00:00:26.6733995Z + TORCH_BIN_DIR=/opt/conda/lib/python3.10/site-packages/torch/bin 2024-12-18T00:00:26.6734560Z + TORCH_LIB_DIR=/opt/conda/lib/python3.10/site-packages/torch/lib 2024-12-18T00:00:26.6735104Z + TORCH_TEST_DIR=/opt/conda/lib/python3.10/site-packages/torch/test 2024-12-18T00:00:26.6735540Z + BUILD_DIR=build 2024-12-18T00:00:26.6735812Z + BUILD_RENAMED_DIR=build_renamed 2024-12-18T00:00:26.6736249Z + BUILD_BIN_DIR=build/bin 2024-12-18T00:00:26.6736535Z + SHARD_NUMBER=1 2024-12-18T00:00:26.6736791Z + NUM_TEST_SHARDS=1 2024-12-18T00:00:26.6737036Z + export VALGRIND=ON 2024-12-18T00:00:26.6737300Z + VALGRIND=ON 2024-12-18T00:00:26.6737588Z + [[ linux-focal-py3.9-clang9-xla == *clang9* ]] 2024-12-18T00:00:26.6737966Z + export VALGRIND=OFF 2024-12-18T00:00:26.6738231Z + VALGRIND=OFF 2024-12-18T00:00:26.6738448Z + [[ 0 == \1 ]] 2024-12-18T00:00:26.6738681Z + [[ False == \1 ]] 2024-12-18T00:00:26.6738966Z + [[ linux-focal-py3.9-clang9-xla != *bazel* ]] 2024-12-18T00:00:26.6739341Z ++ realpath build/custom_test_artifacts 2024-12-18T00:00:26.6741532Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-12-18T00:00:26.6742056Z + [[ -n '' ]] 2024-12-18T00:00:26.6742297Z + echo 'Environment variables' 2024-12-18T00:00:26.6742599Z Environment variables 2024-12-18T00:00:26.6742852Z + env 2024-12-18T00:00:26.6749930Z NVIDIA_VISIBLE_DEVICES=all 2024-12-18T00:00:26.6750357Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:00:26.6751011Z PYTHON_SHA256=bfb249609990220491a1b92850a07135ed0831e41738cf681d63cf01b2a8fbd1 2024-12-18T00:00:26.6751503Z TF_CUDA_COMPUTE_CAPABILITIES=5.2,7.5 2024-12-18T00:00:26.6751839Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:00:26.6752160Z TAGS=bazel,configure_env,install_deps 2024-12-18T00:00:26.6752535Z BUILD_ENVIRONMENT=linux-focal-py3.9-clang9-xla 2024-12-18T00:00:26.6752901Z HOSTNAME=a9d01d962683 2024-12-18T00:00:26.6753155Z PYTHON_VERSION=3.10.16 2024-12-18T00:00:26.6753768Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6754423Z GITHUB_ACTION=__self 2024-12-18T00:00:26.6754702Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:00:26.6755023Z GITHUB_RUN_NUMBER=276594 2024-12-18T00:00:26.6755287Z TEST_CONFIG=xla 2024-12-18T00:00:26.6756458Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:00:26.6756806Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:00:26.6757138Z IS_A100_RUNNER=0 2024-12-18T00:00:26.6757596Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:00:26.6757917Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:00:26.6758207Z GITHUB_REF_TYPE=branch 2024-12-18T00:00:26.6758487Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:00:26.6758919Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6759284Z XLA_CUDA=0 2024-12-18T00:00:26.6759643Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:00:26.6760132Z *** 2024-12-18T00:00:26.6760358Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:00:26.6760658Z GITHUB_ACTIONS=true 2024-12-18T00:00:26.6760973Z NVIDIA_DRIVER_CAPABILITIES=compute,utility 2024-12-18T00:00:26.6761355Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6761740Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6762307Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6 2024-12-18T00:00:26.6762830Z CXX=clang++ 2024-12-18T00:00:26.6763064Z VERBOSE_TEST_LOGS=False 2024-12-18T00:00:26.6763327Z USE_CUDA=0 2024-12-18T00:00:26.6763557Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:00:26.6763862Z SHARD_NUMBER=1 2024-12-18T00:00:26.6764113Z GITHUB_REF_PROTECTED=true 2024-12-18T00:00:26.6764388Z HOME=/home/jenkins 2024-12-18T00:00:26.6764674Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:00:26.6765013Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:00:26.6765325Z LANG=C.UTF-8 2024-12-18T00:00:26.6765568Z CARGO_HOME=/opt/cargo 2024-12-18T00:00:26.6765839Z SCCACHE_S3_KEY_PREFIX=pull 2024-12-18T00:00:26.6766150Z OPENSSL_INCLUDE_DIR=/usr/include/openssl 2024-12-18T00:00:26.6766470Z NUM_TEST_SHARDS=1 2024-12-18T00:00:26.6767074Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6767793Z GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D 2024-12-18T00:00:26.6768283Z JOB_NAME=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-18T00:00:26.6769061Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6769900Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:00:26.6770411Z GITHUB_EVENT_NAME=push 2024-12-18T00:00:26.6770683Z DASHBOARD_TAG= 2024-12-18T00:00:26.6770928Z GITHUB_RUN_ID=12383255652 2024-12-18T00:00:26.6771588Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6772290Z GITHUB_ACTOR=malfet 2024-12-18T00:00:26.6772524Z PR_NUMBER= 2024-12-18T00:00:26.6772754Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:00:26.6773018Z VALGRIND=OFF 2024-12-18T00:00:26.6773316Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:00:26.6773686Z TERM=vt100 2024-12-18T00:00:26.6773906Z BRANCH=release/2.6 2024-12-18T00:00:26.6774167Z RUSTUP_HOME=/opt/rustup 2024-12-18T00:00:26.6774449Z SCCACHE_REGION=us-east-1 2024-12-18T00:00:26.6774734Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:00:26.6775272Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:00:26.6775881Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:00:26.6776296Z REENABLED_ISSUES= 2024-12-18T00:00:26.6776548Z SHLVL=1 2024-12-18T00:00:26.6776793Z MAX_JOBS=46 2024-12-18T00:00:26.6777032Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:00:26.6777385Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:00:26.6777805Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:00:26.6778234Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:00:26.6778690Z GITHUB_JOB=test 2024-12-18T00:00:26.6779177Z LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64: 2024-12-18T00:00:26.6779724Z NO_TEST_TIMEOUT=False 2024-12-18T00:00:26.6780001Z TD_DISTRIBUTED=False 2024-12-18T00:00:26.6780398Z TF_CUDA_PATHS=/usr/local/cuda,/usr/include,/usr 2024-12-18T00:00:26.6780779Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:00:26.6781102Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:00:26.6781374Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:00:26.6782172Z PATH=/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:00:26.6782950Z GITHUB_BASE_REF= 2024-12-18T00:00:26.6783191Z CC=clang 2024-12-18T00:00:26.6783518Z ARTIFACTS_FILE_SUFFIX=test-xla-1-1-linux.12xlarge_34566322490 2024-12-18T00:00:26.6783911Z CI=true 2024-12-18T00:00:26.6784158Z OPENSSL_LIB_DIR=/usr/lib/x86_64-linux-gnu 2024-12-18T00:00:26.6784503Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:00:26.6784796Z JOB_ID=34566322490 2024-12-18T00:00:26.6785044Z GITHUB_HEAD_REF= 2024-12-18T00:00:26.6785276Z GITHUB_ACTION_REF= 2024-12-18T00:00:26.6785582Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:00:26.6785962Z TEST_SHOWLOCALS=False 2024-12-18T00:00:26.6786231Z GITHUB_WORKFLOW=pull 2024-12-18T00:00:26.6786847Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_6cea778c-12b7-4a04-9aa2-17ad49a015f2 2024-12-18T00:00:26.6787497Z NO_TD=False 2024-12-18T00:00:26.6787744Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:00:26.6788036Z TPUVM_MODE= 2024-12-18T00:00:26.6788260Z _=/usr/bin/env 2024-12-18T00:00:26.6788509Z + echo 'Testing pytorch' 2024-12-18T00:00:26.6788770Z Testing pytorch 2024-12-18T00:00:26.6789018Z + export LANG=C.UTF-8 2024-12-18T00:00:26.6789275Z + LANG=C.UTF-8 2024-12-18T00:00:26.6789511Z + PR_NUMBER= 2024-12-18T00:00:26.6789748Z + [[ xla == \d\e\f\a\u\l\t ]] 2024-12-18T00:00:26.6790032Z + [[ xla == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-12-18T00:00:26.6790339Z + [[ xla == \s\l\o\w ]] 2024-12-18T00:00:26.6790674Z + [[ linux-focal-py3.9-clang9-xla == *slow-gradcheck* ]] 2024-12-18T00:00:26.6791091Z + [[ linux-focal-py3.9-clang9-xla == *cuda* ]] 2024-12-18T00:00:26.6791472Z + [[ linux-focal-py3.9-clang9-xla == *rocm* ]] 2024-12-18T00:00:26.6791837Z + [[ linux-focal-py3.9-clang9-xla == *xpu* ]] 2024-12-18T00:00:26.6792181Z + [[ xla == *crossref* ]] 2024-12-18T00:00:26.6792489Z + [[ linux-focal-py3.9-clang9-xla == *rocm* ]] 2024-12-18T00:00:26.6792862Z + [[ linux-focal-py3.9-clang9-xla == *xpu* ]] 2024-12-18T00:00:26.6793256Z + [[ linux-focal-py3.9-clang9-xla != *-bazel-* ]] 2024-12-18T00:00:26.6793620Z + pip_install --user ninja==1.10.2 2024-12-18T00:00:26.6794030Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:00:26.6794542Z + python3 -m pip install --progress-bar off --user ninja==1.10.2 2024-12-18T00:00:27.1601993Z Collecting ninja==1.10.2 2024-12-18T00:00:27.1954833Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-12-18T00:00:27.2046433Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-12-18T00:00:27.4252098Z Installing collected packages: ninja 2024-12-18T00:00:27.4376529Z Successfully installed ninja-1.10.2 2024-12-18T00:00:27.5138761Z + export PATH=/home/jenkins/.local/bin:/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:00:27.5140314Z + PATH=/home/jenkins/.local/bin:/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:00:27.5141265Z + [[ linux-focal-py3.9-clang9-xla == *aarch64* ]] 2024-12-18T00:00:27.5141635Z + install_tlparse 2024-12-18T00:00:27.5141917Z + pip_install --user tlparse==0.3.25 2024-12-18T00:00:27.5142336Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:00:27.5142858Z + python3 -m pip install --progress-bar off --user tlparse==0.3.25 2024-12-18T00:00:27.9491328Z Collecting tlparse==0.3.25 2024-12-18T00:00:27.9854732Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-12-18T00:00:27.9978200Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-12-18T00:00:28.2560672Z Installing collected packages: tlparse 2024-12-18T00:00:28.3381716Z Successfully installed tlparse-0.3.25 2024-12-18T00:00:28.4185875Z ++ python -m site --user-base 2024-12-18T00:00:28.4363668Z + PATH=/home/jenkins/.local/bin:/home/jenkins/.local/bin:/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:00:28.4364767Z + [[ linux-focal-py3.9-clang9-xla == *asan* ]] 2024-12-18T00:00:28.4365165Z + [[ linux-focal-py3.9-clang9-xla == *-debug* ]] 2024-12-18T00:00:28.4365580Z + [[ linux-focal-py3.9-clang9-xla != *-bazel-* ]] 2024-12-18T00:00:28.4366146Z + echo 'We are not in debug mode: linux-focal-py3.9-clang9-xla. Expect the assertion to pass' 2024-12-18T00:00:28.4366838Z We are not in debug mode: linux-focal-py3.9-clang9-xla. Expect the assertion to pass 2024-12-18T00:00:28.4367343Z + cd test 2024-12-18T00:00:28.4367712Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-12-18T00:00:29.7859392Z + [[ xla == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-12-18T00:00:29.7859803Z + [[ xla == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-12-18T00:00:29.7861513Z + DYNAMO_BENCHMARK_FLAGS=() 2024-12-18T00:00:29.7862280Z + [[ xla == *pr_time_benchmarks* ]] 2024-12-18T00:00:29.7862661Z + [[ xla == *dynamo_eager* ]] 2024-12-18T00:00:29.7862966Z + [[ xla == *aot_eager* ]] 2024-12-18T00:00:29.7863269Z + [[ xla == *aot_inductor* ]] 2024-12-18T00:00:29.7863553Z + [[ xla == *inductor* ]] 2024-12-18T00:00:29.7863834Z + [[ xla == *dynamic* ]] 2024-12-18T00:00:29.7864106Z + [[ xla == *cpu* ]] 2024-12-18T00:00:29.7864405Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-12-18T00:00:29.7885144Z + [[ linux-focal-py3.9-clang9-xla == *libtorch* ]] 2024-12-18T00:00:29.7885616Z + [[ linux-focal-py3.9-clang9-xla == *-bazel-* ]] 2024-12-18T00:00:29.7885985Z + cd test 2024-12-18T00:00:29.7886518Z + python -c 'import torch; print(torch.__config__.show())' 2024-12-18T00:00:30.9248145Z PyTorch built with: 2024-12-18T00:00:30.9248476Z - GCC 4.2 2024-12-18T00:00:30.9248729Z - C++ Version: 201703 2024-12-18T00:00:30.9249002Z - clang 11.0.1 2024-12-18T00:00:30.9249389Z - Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-12-18T00:00:30.9249873Z - OpenMP 201811 2024-12-18T00:00:30.9250159Z - LAPACK is enabled (usually provided by MKL) 2024-12-18T00:00:30.9250515Z - NNPACK is enabled 2024-12-18T00:00:30.9250795Z - CPU capability usage: AVX512 2024-12-18T00:00:30.9256769Z - Build settings: BLAS_INFO=open, BUILD_TYPE=Release, COMMIT_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7, CXX_COMPILER=/tmp/cache/bin/clang++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=braced-scalar-init -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wvla-extension -Wsuggest-override -Wnewline-eof -Winconsistent-missing-override -Winconsistent-missing-destructor-override -Wno-pass-failed -Wno-error=old-style-cast -Wconstant-conversion -Wno-missing-braces -Qunused-arguments -fcolor-diagnostics -faligned-new -fno-math-errno -fno-trapping-math -Werror=format, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=open, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.6.0, USE_CUDA=0, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EIGEN_FOR_BLAS=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=OFF, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-12-18T00:00:30.9263126Z 2024-12-18T00:00:31.1308093Z + cd test 2024-12-18T00:00:31.1308529Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-12-18T00:00:32.2748231Z ATen/Parallel: 2024-12-18T00:00:32.2748585Z at::get_num_threads() : 24 2024-12-18T00:00:32.2748914Z at::get_num_interop_threads() : 24 2024-12-18T00:00:32.2749233Z OpenMP 201811 2024-12-18T00:00:32.2749782Z omp_get_max_threads() : 24 2024-12-18T00:00:32.2750074Z MKL not found 2024-12-18T00:00:32.2750447Z Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-12-18T00:00:32.2750929Z std::thread::hardware_concurrency() : 48 2024-12-18T00:00:32.2751277Z Environment variables: 2024-12-18T00:00:32.2751549Z OMP_NUM_THREADS : [not set] 2024-12-18T00:00:32.2751849Z MKL_NUM_THREADS : [not set] 2024-12-18T00:00:32.2752150Z ATen parallel backend: OpenMP 2024-12-18T00:00:32.2752345Z 2024-12-18T00:00:32.4920734Z + [[ xla == *numpy_2* ]] 2024-12-18T00:00:32.4921173Z + [[ linux-focal-py3.9-clang9-xla == *aarch64* ]] 2024-12-18T00:00:32.4921636Z + [[ xla == *backward* ]] 2024-12-18T00:00:32.4921922Z + [[ xla == *xla* ]] 2024-12-18T00:00:32.4922192Z + install_torchvision 2024-12-18T00:00:32.4922470Z + local orig_preload 2024-12-18T00:00:32.4922727Z + local commit 2024-12-18T00:00:32.4922990Z ++ get_pinned_commit vision 2024-12-18T00:00:32.4923305Z ++ cat .github/ci_commit_pins/vision.txt 2024-12-18T00:00:32.4930503Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:00:32.4930859Z + orig_preload= 2024-12-18T00:00:32.4931096Z + '[' -n '' ']' 2024-12-18T00:00:32.4931695Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:00:32.4932431Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:00:32.4933298Z + python3 -m pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:00:32.8618984Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:00:32.8620084Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-zxwov2sa 2024-12-18T00:00:32.8642848Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-zxwov2sa 2024-12-18T00:00:34.3180179Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2024-12-18T00:00:34.3202452Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:00:34.4256327Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:00:34.7503343Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2024-12-18T00:00:36.7349245Z Preparing metadata (setup.py) ... [?25l- \ done 2024-12-18T00:00:36.7383375Z [?25hRequirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.0.2) 2024-12-18T00:00:36.7385746Z Requirement already satisfied: torch in /opt/conda/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.6.0a0+git0cdf8b1) 2024-12-18T00:00:36.7389977Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (11.0.0) 2024-12-18T00:00:36.7468184Z Requirement already satisfied: filelock in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.16.1) 2024-12-18T00:00:36.7471142Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.11.0) 2024-12-18T00:00:36.7474109Z Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.4.2) 2024-12-18T00:00:36.7477179Z Requirement already satisfied: jinja2 in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.4) 2024-12-18T00:00:36.7480211Z Requirement already satisfied: fsspec in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.10.0) 2024-12-18T00:00:36.7485426Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.1) 2024-12-18T00:00:36.7500549Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy==1.13.1->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2024-12-18T00:00:36.7970663Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (3.0.2) 2024-12-18T00:00:36.8046021Z Building wheels for collected packages: torchvision 2024-12-18T00:01:03.0151064Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - done 2024-12-18T00:01:03.0186182Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=1122677 sha256=226da751c784794fa1b4ee534baf705059f0527e9e366f7b9cf90ad50687897f 2024-12-18T00:01:03.0187986Z Stored in directory: /home/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2024-12-18T00:01:03.0221777Z Successfully built torchvision 2024-12-18T00:01:03.1686529Z Installing collected packages: torchvision 2024-12-18T00:01:03.5400798Z Successfully installed torchvision-0.19.0a0+d23a6e1 2024-12-18T00:01:03.6448344Z + '[' -n '' ']' 2024-12-18T00:01:03.6448638Z + build_xla 2024-12-18T00:01:03.6448879Z + pushd .. 2024-12-18T00:01:03.6449148Z /var/lib/jenkins /var/lib/jenkins/workspace 2024-12-18T00:01:03.6449984Z + python -c 'import os, torch, shutil; shutil.copytree(os.path.join(os.path.dirname(torch.__file__), '\''include'\''), '\''workspace/torch/include'\'', dirs_exist_ok=True)' 2024-12-18T00:01:05.7297152Z + popd 2024-12-18T00:01:05.7297469Z /var/lib/jenkins/workspace 2024-12-18T00:01:05.7297806Z ++ dirname .ci/pytorch/test.sh 2024-12-18T00:01:05.7306296Z + source .ci/pytorch/common-build.sh 2024-12-18T00:01:05.7307723Z ++ [[ linux-focal-py3.9-clang9-xla != *win-* ]] 2024-12-18T00:01:05.7315270Z ++++ dirname .ci/pytorch/common-build.sh 2024-12-18T00:01:05.7324987Z +++ cd .ci/pytorch 2024-12-18T00:01:05.7325306Z +++ pwd -P 2024-12-18T00:01:05.7327888Z ++ script_dir=/var/lib/jenkins/workspace/.ci/pytorch 2024-12-18T00:01:05.7328304Z ++ [[ linux-focal-py3.9-clang9-xla == *-pch* ]] 2024-12-18T00:01:05.7328653Z ++ which sccache 2024-12-18T00:01:05.7340989Z ++ sccache --stop-server 2024-12-18T00:01:05.7377918Z ++ true 2024-12-18T00:01:05.7378216Z ++ rm -f /home/jenkins/sccache_error.log 2024-12-18T00:01:05.7392858Z ++ trap_add sccache_epilogue EXIT 2024-12-18T00:01:05.7393217Z ++ trap_add_cmd=sccache_epilogue 2024-12-18T00:01:05.7393621Z ++ shift 2024-12-18T00:01:05.7393861Z ++ for trap_add_name in "$@" 2024-12-18T00:01:05.7396182Z ++++ trap -p EXIT 2024-12-18T00:01:05.7398930Z +++ eval 'extract_trap_cmd trap -- '\'' 2024-12-18T00:01:05.7399341Z cleanup_workspace'\'' EXIT' 2024-12-18T00:01:05.7399651Z ++++ extract_trap_cmd trap -- ' 2024-12-18T00:01:05.7399962Z cleanup_workspace' EXIT 2024-12-18T00:01:05.7400238Z ++++ printf '%s\n' ' 2024-12-18T00:01:05.7400501Z cleanup_workspace' 2024-12-18T00:01:05.7400770Z +++ printf '%s\n' sccache_epilogue 2024-12-18T00:01:05.7402071Z ++ trap -- ' 2024-12-18T00:01:05.7402312Z cleanup_workspace 2024-12-18T00:01:05.7402578Z sccache_epilogue' EXIT 2024-12-18T00:01:05.7402841Z ++ [[ -n 1 ]] 2024-12-18T00:01:05.7403232Z ++ echo 'Skipping sccache server initialization, setting environment variables' 2024-12-18T00:01:05.7403854Z Skipping sccache server initialization, setting environment variables 2024-12-18T00:01:05.7404324Z ++ export SCCACHE_IDLE_TIMEOUT=0 2024-12-18T00:01:05.7404638Z ++ SCCACHE_IDLE_TIMEOUT=0 2024-12-18T00:01:05.7404999Z ++ export SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2024-12-18T00:01:05.7407011Z ++ SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2024-12-18T00:01:05.7407440Z ++ export RUST_LOG=sccache::server=error 2024-12-18T00:01:05.7407788Z ++ RUST_LOG=sccache::server=error 2024-12-18T00:01:05.7408104Z ++ sccache --zero-stats 2024-12-18T00:01:05.7604183Z Compile requests 0 2024-12-18T00:01:05.7604915Z Compile requests executed 0 2024-12-18T00:01:05.7605253Z Cache hits 0 2024-12-18T00:01:05.7605580Z Cache misses 0 2024-12-18T00:01:05.7605903Z Cache timeouts 0 2024-12-18T00:01:05.7606228Z Cache read errors 0 2024-12-18T00:01:05.7606555Z Forced recaches 0 2024-12-18T00:01:05.7606869Z Cache write errors 0 2024-12-18T00:01:05.7607203Z Compilation failures 0 2024-12-18T00:01:05.7607530Z Cache errors 0 2024-12-18T00:01:05.7607878Z Non-cacheable compilations 0 2024-12-18T00:01:05.7608220Z Non-cacheable calls 0 2024-12-18T00:01:05.7608542Z Non-compilation calls 0 2024-12-18T00:01:05.7608884Z Unsupported compiler calls 0 2024-12-18T00:01:05.7609231Z Average cache write 0.000 s 2024-12-18T00:01:05.7609577Z Average cache read miss 0.000 s 2024-12-18T00:01:05.7609934Z Average cache read hit 0.000 s 2024-12-18T00:01:05.7610275Z Failed distributed compilations 0 2024-12-18T00:01:05.7611079Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2024-12-18T00:01:05.7611848Z ++ which ccache 2024-12-18T00:01:05.7614054Z ++ ccache --zero-stats 2024-12-18T00:01:05.7915202Z Statistics zeroed 2024-12-18T00:01:05.7915593Z ++ ccache --show-stats 2024-12-18T00:01:05.7965477Z cache directory /home/jenkins/.cache/ccache 2024-12-18T00:01:05.7966138Z primary config /home/jenkins/.config/ccache/ccache.conf 2024-12-18T00:01:05.7966640Z secondary config (readonly) /etc/ccache.conf 2024-12-18T00:01:05.7967074Z stats updated Wed Dec 18 00:01:05 2024 2024-12-18T00:01:05.7967538Z stats zeroed Wed Dec 18 00:01:05 2024 2024-12-18T00:01:05.7967932Z cache hit (direct) 0 2024-12-18T00:01:05.7968289Z cache hit (preprocessed) 0 2024-12-18T00:01:05.7968630Z cache miss 0 2024-12-18T00:01:05.7968951Z cache hit rate 0.00 % 2024-12-18T00:01:05.7969299Z cleanups performed 0 2024-12-18T00:01:05.7969638Z files in cache 0 2024-12-18T00:01:05.7969977Z cache size 0.0 kB 2024-12-18T00:01:05.7970324Z max cache size 5.0 GB 2024-12-18T00:01:05.7970656Z ++ trap_add ccache_epilogue EXIT 2024-12-18T00:01:05.7970978Z ++ trap_add_cmd=ccache_epilogue 2024-12-18T00:01:05.7971276Z ++ shift 2024-12-18T00:01:05.7971516Z ++ for trap_add_name in "$@" 2024-12-18T00:01:05.7975197Z ++++ trap -p EXIT 2024-12-18T00:01:05.7975520Z +++ eval 'extract_trap_cmd trap -- '\'' 2024-12-18T00:01:05.7976317Z cleanup_workspace 2024-12-18T00:01:05.7976640Z sccache_epilogue'\'' EXIT' 2024-12-18T00:01:05.7976956Z ++++ extract_trap_cmd trap -- ' 2024-12-18T00:01:05.7977264Z cleanup_workspace 2024-12-18T00:01:05.7977580Z sccache_epilogue' EXIT 2024-12-18T00:01:05.7977854Z ++++ printf '%s\n' ' 2024-12-18T00:01:05.7978117Z cleanup_workspace 2024-12-18T00:01:05.7978371Z sccache_epilogue' 2024-12-18T00:01:05.7978620Z +++ printf '%s\n' ccache_epilogue 2024-12-18T00:01:05.7978938Z ++ trap -- ' 2024-12-18T00:01:05.7979176Z cleanup_workspace 2024-12-18T00:01:05.7979425Z sccache_epilogue 2024-12-18T00:01:05.7979678Z ccache_epilogue' EXIT 2024-12-18T00:01:05.7979929Z + XLA_DIR=xla 2024-12-18T00:01:05.7980158Z + USE_CACHE=1 2024-12-18T00:01:05.7980391Z + clone_pytorch_xla 2024-12-18T00:01:05.7981186Z + [[ ! -d ./xla ]] 2024-12-18T00:01:05.7981572Z + git clone --recursive -b r2.6 https://github.com/pytorch/xla.git 2024-12-18T00:01:05.7992527Z Cloning into 'xla'... 2024-12-18T00:01:06.2767105Z remote: Enumerating objects: 140447, done. 2024-12-18T00:01:06.2767606Z remote: Counting objects: 0% (1/1196) 2024-12-18T00:01:06.2768087Z remote: Counting objects: 1% (12/1196) 2024-12-18T00:01:06.2768795Z remote: Counting objects: 2% (24/1196) 2024-12-18T00:01:06.2769262Z remote: Counting objects: 3% (36/1196) 2024-12-18T00:01:06.2769694Z remote: Counting objects: 4% (48/1196) 2024-12-18T00:01:06.2770136Z remote: Counting objects: 5% (60/1196) 2024-12-18T00:01:06.2770565Z remote: Counting objects: 6% (72/1196) 2024-12-18T00:01:06.2770985Z remote: Counting objects: 7% (84/1196) 2024-12-18T00:01:06.2771387Z remote: Counting objects: 8% (96/1196) 2024-12-18T00:01:06.2771820Z remote: Counting objects: 9% (108/1196) 2024-12-18T00:01:06.2772269Z remote: Counting objects: 10% (120/1196) 2024-12-18T00:01:06.2772706Z remote: Counting objects: 11% (132/1196) 2024-12-18T00:01:06.2773133Z remote: Counting objects: 12% (144/1196) 2024-12-18T00:01:06.2773545Z remote: Counting objects: 13% (156/1196) 2024-12-18T00:01:06.2773973Z remote: Counting objects: 14% (168/1196) 2024-12-18T00:01:06.2774401Z remote: Counting objects: 15% (180/1196) 2024-12-18T00:01:06.2774837Z remote: Counting objects: 16% (192/1196) 2024-12-18T00:01:06.2775267Z remote: Counting objects: 17% (204/1196) 2024-12-18T00:01:06.2775682Z remote: Counting objects: 18% (216/1196) 2024-12-18T00:01:06.2776254Z remote: Counting objects: 19% (228/1196) 2024-12-18T00:01:06.2776704Z remote: Counting objects: 20% (240/1196) 2024-12-18T00:01:06.2777136Z remote: Counting objects: 21% (252/1196) 2024-12-18T00:01:06.2777569Z remote: Counting objects: 22% (264/1196) 2024-12-18T00:01:06.2778006Z remote: Counting objects: 23% (276/1196) 2024-12-18T00:01:06.2778423Z remote: Counting objects: 24% (288/1196) 2024-12-18T00:01:06.2778855Z remote: Counting objects: 25% (299/1196) 2024-12-18T00:01:06.2779282Z remote: Counting objects: 26% (311/1196) 2024-12-18T00:01:06.2779715Z remote: Counting objects: 27% (323/1196) 2024-12-18T00:01:06.2780145Z remote: Counting objects: 28% (335/1196) 2024-12-18T00:01:06.2780560Z remote: Counting objects: 29% (347/1196) 2024-12-18T00:01:06.2780989Z remote: Counting objects: 30% (359/1196) 2024-12-18T00:01:06.2781418Z remote: Counting objects: 31% (371/1196) 2024-12-18T00:01:06.2781845Z remote: Counting objects: 32% (383/1196) 2024-12-18T00:01:06.2782273Z remote: Counting objects: 33% (395/1196) 2024-12-18T00:01:06.2782681Z remote: Counting objects: 34% (407/1196) 2024-12-18T00:01:06.2783106Z remote: Counting objects: 35% (419/1196) 2024-12-18T00:01:06.2783531Z remote: Counting objects: 36% (431/1196) 2024-12-18T00:01:06.2783958Z remote: Counting objects: 37% (443/1196) 2024-12-18T00:01:06.2784389Z remote: Counting objects: 38% (455/1196) 2024-12-18T00:01:06.2784799Z remote: Counting objects: 39% (467/1196) 2024-12-18T00:01:06.2785223Z remote: Counting objects: 40% (479/1196) 2024-12-18T00:01:06.2785646Z remote: Counting objects: 41% (491/1196) 2024-12-18T00:01:06.2786073Z remote: Counting objects: 42% (503/1196) 2024-12-18T00:01:06.2786504Z remote: Counting objects: 43% (515/1196) 2024-12-18T00:01:06.2786913Z remote: Counting objects: 44% (527/1196) 2024-12-18T00:01:06.2787340Z remote: Counting objects: 45% (539/1196) 2024-12-18T00:01:06.2787768Z remote: Counting objects: 46% (551/1196) 2024-12-18T00:01:06.2788195Z remote: Counting objects: 47% (563/1196) 2024-12-18T00:01:06.2788623Z remote: Counting objects: 48% (575/1196) 2024-12-18T00:01:06.2789037Z remote: Counting objects: 49% (587/1196) 2024-12-18T00:01:06.2789471Z remote: Counting objects: 50% (598/1196) 2024-12-18T00:01:06.2789906Z remote: Counting objects: 51% (610/1196) 2024-12-18T00:01:06.2790491Z remote: Counting objects: 52% (622/1196) 2024-12-18T00:01:06.2790922Z remote: Counting objects: 53% (634/1196) 2024-12-18T00:01:06.2791333Z remote: Counting objects: 54% (646/1196) 2024-12-18T00:01:06.2791763Z remote: Counting objects: 55% (658/1196) 2024-12-18T00:01:06.2792195Z remote: Counting objects: 56% (670/1196) 2024-12-18T00:01:06.2792744Z remote: Counting objects: 57% (682/1196) 2024-12-18T00:01:06.2793181Z remote: Counting objects: 58% (694/1196) 2024-12-18T00:01:06.2793618Z remote: Counting objects: 59% (706/1196) 2024-12-18T00:01:06.2794037Z remote: Counting objects: 60% (718/1196) 2024-12-18T00:01:06.2794473Z remote: Counting objects: 61% (730/1196) 2024-12-18T00:01:06.2794906Z remote: Counting objects: 62% (742/1196) 2024-12-18T00:01:06.2795339Z remote: Counting objects: 63% (754/1196) 2024-12-18T00:01:06.2795770Z remote: Counting objects: 64% (766/1196) 2024-12-18T00:01:06.2796182Z remote: Counting objects: 65% (778/1196) 2024-12-18T00:01:06.2796620Z remote: Counting objects: 66% (790/1196) 2024-12-18T00:01:06.2797049Z remote: Counting objects: 67% (802/1196) 2024-12-18T00:01:06.2797482Z remote: Counting objects: 68% (814/1196) 2024-12-18T00:01:06.2797906Z remote: Counting objects: 69% (826/1196) 2024-12-18T00:01:06.2798318Z remote: Counting objects: 70% (838/1196) 2024-12-18T00:01:06.2798748Z remote: Counting objects: 71% (850/1196) 2024-12-18T00:01:06.2799180Z remote: Counting objects: 72% (862/1196) 2024-12-18T00:01:06.2799616Z remote: Counting objects: 73% (874/1196) 2024-12-18T00:01:06.2800045Z remote: Counting objects: 74% (886/1196) 2024-12-18T00:01:06.2800458Z remote: Counting objects: 75% (897/1196) 2024-12-18T00:01:06.2800895Z remote: Counting objects: 76% (909/1196) 2024-12-18T00:01:06.2801322Z remote: Counting objects: 77% (921/1196) 2024-12-18T00:01:06.2801753Z remote: Counting objects: 78% (933/1196) 2024-12-18T00:01:06.2802183Z remote: Counting objects: 79% (945/1196) 2024-12-18T00:01:06.2802597Z remote: Counting objects: 80% (957/1196) 2024-12-18T00:01:06.2803020Z remote: Counting objects: 81% (969/1196) 2024-12-18T00:01:06.2803443Z remote: Counting objects: 82% (981/1196) 2024-12-18T00:01:06.2803869Z remote: Counting objects: 83% (993/1196) 2024-12-18T00:01:06.2804299Z remote: Counting objects: 84% (1005/1196) 2024-12-18T00:01:06.2804745Z remote: Counting objects: 85% (1017/1196) 2024-12-18T00:01:06.2805162Z remote: Counting objects: 86% (1029/1196) 2024-12-18T00:01:06.2805596Z remote: Counting objects: 87% (1041/1196) 2024-12-18T00:01:06.2806027Z remote: Counting objects: 88% (1053/1196) 2024-12-18T00:01:06.2806460Z remote: Counting objects: 89% (1065/1196) 2024-12-18T00:01:06.2806893Z remote: Counting objects: 90% (1077/1196) 2024-12-18T00:01:06.2807311Z remote: Counting objects: 91% (1089/1196) 2024-12-18T00:01:06.2807746Z remote: Counting objects: 92% (1101/1196) 2024-12-18T00:01:06.2808186Z remote: Counting objects: 93% (1113/1196) 2024-12-18T00:01:06.2808619Z remote: Counting objects: 94% (1125/1196) 2024-12-18T00:01:06.2809055Z remote: Counting objects: 95% (1137/1196) 2024-12-18T00:01:06.2809477Z remote: Counting objects: 96% (1149/1196) 2024-12-18T00:01:06.2809918Z remote: Counting objects: 97% (1161/1196) 2024-12-18T00:01:06.2810353Z remote: Counting objects: 98% (1173/1196) 2024-12-18T00:01:06.2810786Z remote: Counting objects: 99% (1185/1196) 2024-12-18T00:01:06.2811219Z remote: Counting objects: 100% (1196/1196) 2024-12-18T00:01:06.2811671Z remote: Counting objects: 100% (1196/1196), done. 2024-12-18T00:01:06.2812142Z remote: Compressing objects: 0% (1/535) 2024-12-18T00:01:06.2812591Z remote: Compressing objects: 1% (6/535) 2024-12-18T00:01:06.2841528Z remote: Compressing objects: 2% (11/535) 2024-12-18T00:01:06.3018830Z remote: Compressing objects: 3% (17/535) 2024-12-18T00:01:06.3072921Z remote: Compressing objects: 4% (22/535) 2024-12-18T00:01:06.3180944Z remote: Compressing objects: 5% (27/535) 2024-12-18T00:01:06.3241543Z remote: Compressing objects: 6% (33/535) 2024-12-18T00:01:06.3305484Z remote: Compressing objects: 7% (38/535) 2024-12-18T00:01:06.3447765Z remote: Compressing objects: 8% (43/535) 2024-12-18T00:01:06.3578008Z remote: Compressing objects: 9% (49/535) 2024-12-18T00:01:06.3677026Z remote: Compressing objects: 10% (54/535) 2024-12-18T00:01:06.3821217Z remote: Compressing objects: 11% (59/535) 2024-12-18T00:01:06.3901856Z remote: Compressing objects: 12% (65/535) 2024-12-18T00:01:06.3902474Z remote: Compressing objects: 13% (70/535) 2024-12-18T00:01:06.4067300Z remote: Compressing objects: 14% (75/535) 2024-12-18T00:01:06.4191042Z remote: Compressing objects: 15% (81/535) 2024-12-18T00:01:06.4365915Z remote: Compressing objects: 16% (86/535) 2024-12-18T00:01:06.4530105Z remote: Compressing objects: 17% (91/535) 2024-12-18T00:01:06.4573101Z remote: Compressing objects: 18% (97/535) 2024-12-18T00:01:06.4659405Z remote: Compressing objects: 19% (102/535) 2024-12-18T00:01:06.4699521Z remote: Compressing objects: 20% (107/535) 2024-12-18T00:01:06.4734695Z remote: Compressing objects: 21% (113/535) 2024-12-18T00:01:06.4761359Z remote: Compressing objects: 22% (118/535) 2024-12-18T00:01:06.4793491Z remote: Compressing objects: 23% (124/535) 2024-12-18T00:01:06.4824083Z remote: Compressing objects: 24% (129/535) 2024-12-18T00:01:06.4859545Z remote: Compressing objects: 25% (134/535) 2024-12-18T00:01:06.4894899Z remote: Compressing objects: 26% (140/535) 2024-12-18T00:01:06.4912215Z remote: Compressing objects: 27% (145/535) 2024-12-18T00:01:06.4920442Z remote: Compressing objects: 28% (150/535) 2024-12-18T00:01:06.4935527Z remote: Compressing objects: 29% (156/535) 2024-12-18T00:01:06.4950504Z remote: Compressing objects: 30% (161/535) 2024-12-18T00:01:06.4951961Z remote: Compressing objects: 31% (166/535) 2024-12-18T00:01:06.4968927Z remote: Compressing objects: 32% (172/535) 2024-12-18T00:01:06.4976035Z remote: Compressing objects: 33% (177/535) 2024-12-18T00:01:06.4977915Z remote: Compressing objects: 34% (182/535) 2024-12-18T00:01:06.4978374Z remote: Compressing objects: 35% (188/535) 2024-12-18T00:01:06.4978841Z remote: Compressing objects: 36% (193/535) 2024-12-18T00:01:06.4979318Z remote: Compressing objects: 37% (198/535) 2024-12-18T00:01:06.4979752Z remote: Compressing objects: 38% (204/535) 2024-12-18T00:01:06.4980232Z remote: Compressing objects: 39% (209/535) 2024-12-18T00:01:06.4980665Z remote: Compressing objects: 40% (214/535) 2024-12-18T00:01:06.4981118Z remote: Compressing objects: 41% (220/535) 2024-12-18T00:01:06.4981568Z remote: Compressing objects: 42% (225/535) 2024-12-18T00:01:06.4988034Z remote: Compressing objects: 43% (231/535) 2024-12-18T00:01:06.4988490Z remote: Compressing objects: 44% (236/535) 2024-12-18T00:01:06.4988928Z remote: Compressing objects: 45% (241/535) 2024-12-18T00:01:06.4989396Z remote: Compressing objects: 46% (247/535) 2024-12-18T00:01:06.4989860Z remote: Compressing objects: 47% (252/535) 2024-12-18T00:01:06.4990317Z remote: Compressing objects: 48% (257/535) 2024-12-18T00:01:06.4990795Z remote: Compressing objects: 49% (263/535) 2024-12-18T00:01:06.4991261Z remote: Compressing objects: 50% (268/535) 2024-12-18T00:01:06.4998427Z remote: Compressing objects: 51% (273/535) 2024-12-18T00:01:06.4998920Z remote: Compressing objects: 52% (279/535) 2024-12-18T00:01:06.4999376Z remote: Compressing objects: 53% (284/535) 2024-12-18T00:01:06.4999831Z remote: Compressing objects: 54% (289/535) 2024-12-18T00:01:06.5004273Z remote: Compressing objects: 55% (295/535) 2024-12-18T00:01:06.5005433Z remote: Compressing objects: 56% (300/535) 2024-12-18T00:01:06.5005878Z remote: Compressing objects: 57% (305/535) 2024-12-18T00:01:06.5006335Z remote: Compressing objects: 58% (311/535) 2024-12-18T00:01:06.5006991Z remote: Compressing objects: 59% (316/535) 2024-12-18T00:01:06.5007455Z remote: Compressing objects: 60% (321/535) 2024-12-18T00:01:06.5007915Z remote: Compressing objects: 61% (327/535) 2024-12-18T00:01:06.5008343Z remote: Compressing objects: 62% (332/535) 2024-12-18T00:01:06.5008795Z remote: Compressing objects: 63% (338/535) 2024-12-18T00:01:06.5009639Z remote: Compressing objects: 64% (343/535) 2024-12-18T00:01:06.5010927Z remote: Compressing objects: 65% (348/535) 2024-12-18T00:01:06.5012952Z remote: Compressing objects: 66% (354/535) 2024-12-18T00:01:06.5014335Z remote: Compressing objects: 67% (359/535) 2024-12-18T00:01:06.5016526Z remote: Compressing objects: 68% (364/535) 2024-12-18T00:01:06.5019502Z remote: Compressing objects: 69% (370/535) 2024-12-18T00:01:06.5021074Z remote: Compressing objects: 70% (375/535) 2024-12-18T00:01:06.5022294Z remote: Compressing objects: 71% (380/535) 2024-12-18T00:01:06.5024238Z remote: Compressing objects: 72% (386/535) 2024-12-18T00:01:06.5025489Z remote: Compressing objects: 73% (391/535) 2024-12-18T00:01:06.5026809Z remote: Compressing objects: 74% (396/535) 2024-12-18T00:01:06.5028130Z remote: Compressing objects: 75% (402/535) 2024-12-18T00:01:06.5028594Z remote: Compressing objects: 76% (407/535) 2024-12-18T00:01:06.5029256Z remote: Compressing objects: 77% (412/535) 2024-12-18T00:01:06.5029713Z remote: Compressing objects: 78% (418/535) 2024-12-18T00:01:06.5030727Z remote: Compressing objects: 79% (423/535) 2024-12-18T00:01:06.5031181Z remote: Compressing objects: 80% (428/535) 2024-12-18T00:01:06.5032010Z remote: Compressing objects: 81% (434/535) 2024-12-18T00:01:06.5033364Z remote: Compressing objects: 82% (439/535) 2024-12-18T00:01:06.5033813Z remote: Compressing objects: 83% (445/535) 2024-12-18T00:01:06.5034277Z remote: Compressing objects: 84% (450/535) 2024-12-18T00:01:06.5034740Z remote: Compressing objects: 85% (455/535) 2024-12-18T00:01:06.5035257Z remote: Compressing objects: 86% (461/535) 2024-12-18T00:01:06.5035868Z remote: Compressing objects: 87% (466/535) 2024-12-18T00:01:06.5036309Z remote: Compressing objects: 88% (471/535) 2024-12-18T00:01:06.5036763Z remote: Compressing objects: 89% (477/535) 2024-12-18T00:01:06.5037221Z remote: Compressing objects: 90% (482/535) 2024-12-18T00:01:06.5037681Z remote: Compressing objects: 91% (487/535) 2024-12-18T00:01:06.5038428Z remote: Compressing objects: 92% (493/535) 2024-12-18T00:01:06.5041732Z remote: Compressing objects: 93% (498/535) 2024-12-18T00:01:06.5044859Z remote: Compressing objects: 94% (503/535) 2024-12-18T00:01:06.5047008Z remote: Compressing objects: 95% (509/535) 2024-12-18T00:01:06.5048176Z remote: Compressing objects: 96% (514/535) 2024-12-18T00:01:06.5049336Z remote: Compressing objects: 97% (519/535) 2024-12-18T00:01:06.5050471Z remote: Compressing objects: 98% (525/535) 2024-12-18T00:01:06.5051911Z remote: Compressing objects: 99% (530/535) 2024-12-18T00:01:06.5052353Z remote: Compressing objects: 100% (535/535) 2024-12-18T00:01:06.5052837Z remote: Compressing objects: 100% (535/535), done. 2024-12-18T00:01:06.5205095Z Receiving objects: 0% (1/140447) 2024-12-18T00:01:06.5332294Z Receiving objects: 1% (1405/140447) 2024-12-18T00:01:06.5447666Z Receiving objects: 2% (2809/140447) 2024-12-18T00:01:06.5554779Z Receiving objects: 3% (4214/140447) 2024-12-18T00:01:06.5703761Z Receiving objects: 4% (5618/140447) 2024-12-18T00:01:06.5841300Z Receiving objects: 5% (7023/140447) 2024-12-18T00:01:06.5955535Z Receiving objects: 6% (8427/140447) 2024-12-18T00:01:06.6067182Z Receiving objects: 7% (9832/140447) 2024-12-18T00:01:06.6168349Z Receiving objects: 8% (11236/140447) 2024-12-18T00:01:06.6282656Z Receiving objects: 9% (12641/140447) 2024-12-18T00:01:06.6410603Z Receiving objects: 10% (14045/140447) 2024-12-18T00:01:06.6538750Z Receiving objects: 11% (15450/140447) 2024-12-18T00:01:06.6655000Z Receiving objects: 12% (16854/140447) 2024-12-18T00:01:06.7236950Z Receiving objects: 13% (18259/140447) 2024-12-18T00:01:06.7549610Z Receiving objects: 14% (19663/140447) 2024-12-18T00:01:06.8161861Z Receiving objects: 15% (21068/140447) 2024-12-18T00:01:06.8536619Z Receiving objects: 16% (22472/140447) 2024-12-18T00:01:06.8776720Z Receiving objects: 17% (23876/140447) 2024-12-18T00:01:06.8933808Z Receiving objects: 18% (25281/140447) 2024-12-18T00:01:06.9113017Z Receiving objects: 19% (26685/140447) 2024-12-18T00:01:06.9287367Z Receiving objects: 20% (28090/140447) 2024-12-18T00:01:06.9514771Z Receiving objects: 21% (29494/140447) 2024-12-18T00:01:07.0098693Z Receiving objects: 22% (30899/140447) 2024-12-18T00:01:07.0261310Z Receiving objects: 23% (32303/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.0429783Z Receiving objects: 24% (33708/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.0538840Z Receiving objects: 25% (35112/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.0586691Z Receiving objects: 26% (36517/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.0681296Z Receiving objects: 27% (37921/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.0821474Z Receiving objects: 28% (39326/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.0938203Z Receiving objects: 29% (40730/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1035803Z Receiving objects: 30% (42135/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1162165Z Receiving objects: 31% (43539/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1298517Z Receiving objects: 32% (44944/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1465192Z Receiving objects: 33% (46348/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1608440Z Receiving objects: 34% (47752/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1739923Z Receiving objects: 35% (49157/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1861763Z Receiving objects: 36% (50561/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.1953775Z Receiving objects: 37% (51966/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2067593Z Receiving objects: 38% (53370/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2162706Z Receiving objects: 39% (54775/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2287449Z Receiving objects: 40% (56179/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2426818Z Receiving objects: 41% (57584/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2566819Z Receiving objects: 42% (58988/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2665128Z Receiving objects: 43% (60393/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2697839Z Receiving objects: 44% (61797/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2754054Z Receiving objects: 45% (63202/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2801863Z Receiving objects: 46% (64606/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2808614Z Receiving objects: 47% (66011/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2864441Z Receiving objects: 48% (67415/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2904394Z Receiving objects: 49% (68820/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2928004Z Receiving objects: 50% (70224/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2949088Z Receiving objects: 51% (71628/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.2987773Z Receiving objects: 52% (73033/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3009270Z Receiving objects: 53% (74437/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3039365Z Receiving objects: 54% (75842/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3065748Z Receiving objects: 55% (77246/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3098665Z Receiving objects: 56% (78651/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3152685Z Receiving objects: 57% (80055/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3209266Z Receiving objects: 58% (81460/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3498995Z Receiving objects: 59% (82864/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3602966Z Receiving objects: 60% (84269/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3667797Z Receiving objects: 61% (85673/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3697756Z Receiving objects: 62% (87078/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3727358Z Receiving objects: 63% (88482/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3778004Z Receiving objects: 64% (89887/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3808324Z Receiving objects: 65% (91291/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3848545Z Receiving objects: 66% (92696/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3907341Z Receiving objects: 67% (94100/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.3973209Z Receiving objects: 68% (95504/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.4051607Z Receiving objects: 69% (96909/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.4133134Z Receiving objects: 70% (98313/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.4305456Z Receiving objects: 71% (99718/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.4476103Z Receiving objects: 72% (101122/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.4582464Z Receiving objects: 73% (102527/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.4733403Z Receiving objects: 74% (103931/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.4896263Z Receiving objects: 75% (105336/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.5033348Z Receiving objects: 76% (106740/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.5057511Z Receiving objects: 77% (108145/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.5142788Z Receiving objects: 77% (108378/140447), 23.74 MiB | 47.47 MiB/s 2024-12-18T00:01:07.5212478Z Receiving objects: 78% (109549/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.5290653Z Receiving objects: 79% (110954/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.5343864Z Receiving objects: 80% (112358/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.5464863Z Receiving objects: 81% (113763/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7125999Z Receiving objects: 82% (115167/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7168289Z Receiving objects: 83% (116572/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7208898Z Receiving objects: 84% (117976/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7235190Z Receiving objects: 85% (119380/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7253886Z Receiving objects: 86% (120785/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7291645Z Receiving objects: 87% (122189/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7328114Z Receiving objects: 88% (123594/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7370374Z Receiving objects: 89% (124998/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7421582Z Receiving objects: 90% (126403/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7479710Z Receiving objects: 91% (127807/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7571093Z Receiving objects: 92% (129212/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7623022Z Receiving objects: 93% (130616/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7654898Z Receiving objects: 94% (132021/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.7847110Z Receiving objects: 95% (133425/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.8080201Z Receiving objects: 96% (134830/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.8197201Z Receiving objects: 97% (136234/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.8386578Z Receiving objects: 98% (137639/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.8603178Z Receiving objects: 99% (139043/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.8604139Z remote: Total 140447 (delta 971), reused 722 (delta 649), pack-reused 139251 (from 3) 2024-12-18T00:01:07.8618088Z Receiving objects: 100% (140447/140447), 49.44 MiB | 49.43 MiB/s 2024-12-18T00:01:07.8618860Z Receiving objects: 100% (140447/140447), 64.82 MiB | 47.82 MiB/s, done. 2024-12-18T00:01:07.8824295Z Resolving deltas: 0% (0/104301) 2024-12-18T00:01:07.8877139Z Resolving deltas: 1% (1044/104301) 2024-12-18T00:01:07.8904192Z Resolving deltas: 2% (2087/104301) 2024-12-18T00:01:07.8925978Z Resolving deltas: 3% (3130/104301) 2024-12-18T00:01:07.8987248Z Resolving deltas: 4% (4173/104301) 2024-12-18T00:01:07.9013338Z Resolving deltas: 5% (5216/104301) 2024-12-18T00:01:07.9050257Z Resolving deltas: 6% (6259/104301) 2024-12-18T00:01:07.9115631Z Resolving deltas: 7% (7302/104301) 2024-12-18T00:01:07.9162687Z Resolving deltas: 8% (8345/104301) 2024-12-18T00:01:07.9235470Z Resolving deltas: 9% (9388/104301) 2024-12-18T00:01:07.9339291Z Resolving deltas: 10% (10431/104301) 2024-12-18T00:01:07.9352451Z Resolving deltas: 11% (11474/104301) 2024-12-18T00:01:07.9377921Z Resolving deltas: 12% (12517/104301) 2024-12-18T00:01:07.9408526Z Resolving deltas: 13% (13560/104301) 2024-12-18T00:01:07.9505561Z Resolving deltas: 14% (14603/104301) 2024-12-18T00:01:07.9573714Z Resolving deltas: 15% (15646/104301) 2024-12-18T00:01:07.9618177Z Resolving deltas: 16% (16689/104301) 2024-12-18T00:01:07.9744733Z Resolving deltas: 17% (17732/104301) 2024-12-18T00:01:07.9924813Z Resolving deltas: 18% (18775/104301) 2024-12-18T00:01:08.0064486Z Resolving deltas: 19% (19818/104301) 2024-12-18T00:01:08.0211718Z Resolving deltas: 20% (20861/104301) 2024-12-18T00:01:08.0375712Z Resolving deltas: 21% (21904/104301) 2024-12-18T00:01:08.0554575Z Resolving deltas: 22% (22947/104301) 2024-12-18T00:01:08.0708440Z Resolving deltas: 23% (23990/104301) 2024-12-18T00:01:08.0843720Z Resolving deltas: 24% (25033/104301) 2024-12-18T00:01:08.0988542Z Resolving deltas: 25% (26076/104301) 2024-12-18T00:01:08.1155507Z Resolving deltas: 26% (27119/104301) 2024-12-18T00:01:08.1323026Z Resolving deltas: 27% (28162/104301) 2024-12-18T00:01:08.1488765Z Resolving deltas: 28% (29205/104301) 2024-12-18T00:01:08.1575845Z Resolving deltas: 29% (30248/104301) 2024-12-18T00:01:08.1622754Z Resolving deltas: 30% (31291/104301) 2024-12-18T00:01:08.1667744Z Resolving deltas: 31% (32335/104301) 2024-12-18T00:01:08.1740196Z Resolving deltas: 32% (33377/104301) 2024-12-18T00:01:08.1781508Z Resolving deltas: 33% (34420/104301) 2024-12-18T00:01:08.1841164Z Resolving deltas: 34% (35463/104301) 2024-12-18T00:01:08.1897784Z Resolving deltas: 35% (36506/104301) 2024-12-18T00:01:08.1942824Z Resolving deltas: 36% (37549/104301) 2024-12-18T00:01:08.1969098Z Resolving deltas: 37% (38592/104301) 2024-12-18T00:01:08.2006231Z Resolving deltas: 38% (39635/104301) 2024-12-18T00:01:08.2042117Z Resolving deltas: 39% (40678/104301) 2024-12-18T00:01:08.2283217Z Resolving deltas: 40% (41721/104301) 2024-12-18T00:01:08.2361546Z Resolving deltas: 41% (42764/104301) 2024-12-18T00:01:08.2426329Z Resolving deltas: 42% (43807/104301) 2024-12-18T00:01:08.2460055Z Resolving deltas: 43% (44850/104301) 2024-12-18T00:01:08.2503100Z Resolving deltas: 44% (45893/104301) 2024-12-18T00:01:08.2732095Z Resolving deltas: 45% (46936/104301) 2024-12-18T00:01:08.2833349Z Resolving deltas: 46% (47979/104301) 2024-12-18T00:01:08.2852787Z Resolving deltas: 47% (49023/104301) 2024-12-18T00:01:08.2900678Z Resolving deltas: 48% (50065/104301) 2024-12-18T00:01:08.2955722Z Resolving deltas: 49% (51108/104301) 2024-12-18T00:01:08.3000672Z Resolving deltas: 50% (52151/104301) 2024-12-18T00:01:08.3049821Z Resolving deltas: 51% (53194/104301) 2024-12-18T00:01:08.3083085Z Resolving deltas: 52% (54237/104301) 2024-12-18T00:01:08.3158696Z Resolving deltas: 53% (55280/104301) 2024-12-18T00:01:08.3214369Z Resolving deltas: 54% (56323/104301) 2024-12-18T00:01:08.3247449Z Resolving deltas: 55% (57366/104301) 2024-12-18T00:01:08.3281315Z Resolving deltas: 56% (58410/104301) 2024-12-18T00:01:08.3329837Z Resolving deltas: 57% (59452/104301) 2024-12-18T00:01:08.3372849Z Resolving deltas: 58% (60495/104301) 2024-12-18T00:01:08.3414338Z Resolving deltas: 59% (61538/104301) 2024-12-18T00:01:08.3452967Z Resolving deltas: 60% (62581/104301) 2024-12-18T00:01:08.3554499Z Resolving deltas: 61% (63624/104301) 2024-12-18T00:01:08.3618147Z Resolving deltas: 62% (64667/104301) 2024-12-18T00:01:08.3649300Z Resolving deltas: 63% (65710/104301) 2024-12-18T00:01:08.3690304Z Resolving deltas: 64% (66753/104301) 2024-12-18T00:01:08.3714897Z Resolving deltas: 65% (67796/104301) 2024-12-18T00:01:08.3795325Z Resolving deltas: 66% (68839/104301) 2024-12-18T00:01:08.3837805Z Resolving deltas: 67% (69882/104301) 2024-12-18T00:01:08.3889379Z Resolving deltas: 68% (70925/104301) 2024-12-18T00:01:08.3927346Z Resolving deltas: 69% (71968/104301) 2024-12-18T00:01:08.3974371Z Resolving deltas: 70% (73011/104301) 2024-12-18T00:01:08.3997548Z Resolving deltas: 71% (74054/104301) 2024-12-18T00:01:08.4024141Z Resolving deltas: 72% (75097/104301) 2024-12-18T00:01:08.4135242Z Resolving deltas: 73% (76142/104301) 2024-12-18T00:01:08.4272186Z Resolving deltas: 74% (77183/104301) 2024-12-18T00:01:08.4303134Z Resolving deltas: 75% (78226/104301) 2024-12-18T00:01:08.4336584Z Resolving deltas: 76% (79269/104301) 2024-12-18T00:01:08.4355620Z Resolving deltas: 77% (80312/104301) 2024-12-18T00:01:08.4396764Z Resolving deltas: 78% (81355/104301) 2024-12-18T00:01:08.4435031Z Resolving deltas: 79% (82398/104301) 2024-12-18T00:01:08.4461069Z Resolving deltas: 80% (83441/104301) 2024-12-18T00:01:08.4496050Z Resolving deltas: 81% (84484/104301) 2024-12-18T00:01:08.4527632Z Resolving deltas: 82% (85528/104301) 2024-12-18T00:01:08.4581887Z Resolving deltas: 83% (86570/104301) 2024-12-18T00:01:08.4618291Z Resolving deltas: 84% (87613/104301) 2024-12-18T00:01:08.4645980Z Resolving deltas: 85% (88656/104301) 2024-12-18T00:01:08.4676199Z Resolving deltas: 86% (89699/104301) 2024-12-18T00:01:08.4726715Z Resolving deltas: 87% (90742/104301) 2024-12-18T00:01:08.4777595Z Resolving deltas: 88% (91785/104301) 2024-12-18T00:01:08.4805185Z Resolving deltas: 89% (92828/104301) 2024-12-18T00:01:08.4836118Z Resolving deltas: 90% (93871/104301) 2024-12-18T00:01:08.4892757Z Resolving deltas: 91% (94914/104301) 2024-12-18T00:01:08.4933315Z Resolving deltas: 92% (95957/104301) 2024-12-18T00:01:08.4959835Z Resolving deltas: 93% (97000/104301) 2024-12-18T00:01:08.4988474Z Resolving deltas: 94% (98043/104301) 2024-12-18T00:01:08.5019889Z Resolving deltas: 95% (99086/104301) 2024-12-18T00:01:08.5145000Z Resolving deltas: 96% (100129/104301) 2024-12-18T00:01:08.5236314Z Resolving deltas: 97% (101172/104301) 2024-12-18T00:01:08.5303490Z Resolving deltas: 98% (102215/104301) 2024-12-18T00:01:08.5384055Z Resolving deltas: 99% (103258/104301) 2024-12-18T00:01:08.5385176Z Resolving deltas: 100% (104301/104301) 2024-12-18T00:01:08.5385515Z Resolving deltas: 100% (104301/104301), done. 2024-12-18T00:01:08.9696015Z + pushd xla 2024-12-18T00:01:08.9696585Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2024-12-18T00:01:08.9697093Z ++ cat ../.github/ci_commit_pins/xla.txt 2024-12-18T00:01:08.9704744Z + git checkout r2.6 2024-12-18T00:01:09.0258719Z Already on 'r2.6' 2024-12-18T00:01:09.0259108Z Your branch is up to date with 'origin/r2.6'. 2024-12-18T00:01:09.0261494Z + git submodule sync 2024-12-18T00:01:09.0491768Z + git submodule update --init --recursive 2024-12-18T00:01:09.0734412Z + popd 2024-12-18T00:01:09.0734703Z /var/lib/jenkins/workspace 2024-12-18T00:01:09.0735111Z + source xla/.circleci/common.sh 2024-12-18T00:01:09.0735415Z ++ set -ex 2024-12-18T00:01:09.0735709Z ++ CONTINUE_ON_ERROR=false 2024-12-18T00:01:09.0735973Z ++ [[ false == \1 ]] 2024-12-18T00:01:09.0739496Z ++++ which conda 2024-12-18T00:01:09.0748141Z +++ dirname /opt/conda/bin/conda 2024-12-18T00:01:09.0756753Z ++ export CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2024-12-18T00:01:09.0757205Z ++ CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2024-12-18T00:01:09.0761229Z +++ python3-config --prefix 2024-12-18T00:01:09.0882128Z ++ export LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2024-12-18T00:01:09.0883452Z ++ LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2024-12-18T00:01:09.0884378Z ++ echo /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2024-12-18T00:01:09.0885345Z /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2024-12-18T00:01:09.0885986Z + rm xla/torch_patches/.torch_pin 2024-12-18T00:01:09.0892680Z rm: cannot remove 'xla/torch_patches/.torch_pin': No such file or directory 2024-12-18T00:01:09.0893241Z + true 2024-12-18T00:01:09.0893467Z + apply_patches 2024-12-18T00:01:09.0893733Z + ./xla/scripts/apply_patches.sh 2024-12-18T00:01:09.0917140Z +++ dirname ./xla/scripts/apply_patches.sh 2024-12-18T00:01:09.0921739Z ++ cd ./xla/scripts 2024-12-18T00:01:09.0922008Z ++ pwd -P 2024-12-18T00:01:09.0923720Z + CDIR=/var/lib/jenkins/workspace/xla/scripts 2024-12-18T00:01:09.0924134Z + XDIR=/var/lib/jenkins/workspace/xla/scripts/.. 2024-12-18T00:01:09.0924559Z + PTDIR=/var/lib/jenkins/workspace/xla/scripts/../.. 2024-12-18T00:01:09.0925083Z + OPENXLADIR=/var/lib/jenkins/workspace/xla/scripts/../third_party/xla 2024-12-18T00:01:09.0925644Z + TORCH_PIN=/var/lib/jenkins/workspace/xla/scripts/../.torch_pin 2024-12-18T00:01:09.0926176Z + '[' -f /var/lib/jenkins/workspace/xla/scripts/../.torch_pin ']' 2024-12-18T00:01:09.0927496Z ++ cat /var/lib/jenkins/workspace/xla/scripts/../.torch_pin 2024-12-18T00:01:09.0934989Z + CID=release/2.6 2024-12-18T00:01:09.0935307Z + [[ release/2.6 = \#* ]] 2024-12-18T00:01:09.0935639Z + [[ release/2.6 != '' ]] 2024-12-18T00:01:09.0935980Z + echo 'Checking out branch $CID' 2024-12-18T00:01:09.0936742Z Checking out branch $CID 2024-12-18T00:01:09.0937159Z + pushd /var/lib/jenkins/workspace/xla/scripts/../.. 2024-12-18T00:01:09.0937625Z /var/lib/jenkins/workspace /var/lib/jenkins/workspace 2024-12-18T00:01:09.0938024Z + git fetch origin release/2.6 2024-12-18T00:01:09.5651417Z From https://github.com/pytorch/pytorch 2024-12-18T00:01:09.5652053Z * branch release/2.6 -> FETCH_HEAD 2024-12-18T00:01:09.6224810Z + git checkout release/2.6 2024-12-18T00:01:12.0071201Z Branch 'release/2.6' set up to track remote branch 'release/2.6' from 'origin'. 2024-12-18T00:01:12.0071786Z Switched to a new branch 'release/2.6' 2024-12-18T00:01:12.0085568Z + git submodule update --init --recursive 2024-12-18T00:01:13.1377473Z + popd 2024-12-18T00:01:13.1377783Z /var/lib/jenkins/workspace 2024-12-18T00:01:13.1378731Z + python /var/lib/jenkins/workspace/xla/scripts/cond_patch.py /var/lib/jenkins/workspace/xla/scripts/../torch_patches /var/lib/jenkins/workspace/xla/scripts/../.. 2024-12-18T00:01:13.1842825Z + [[ -n '' ]] 2024-12-18T00:01:13.1848472Z ++ python -c 'from distutils.sysconfig import get_python_lib; print(get_python_lib())' 2024-12-18T00:01:13.2997501Z + SITE_PACKAGES=/opt/conda/lib/python3.10/site-packages 2024-12-18T00:01:13.2997992Z + retry install_deps_pytorch_xla xla 1 2024-12-18T00:01:13.2998370Z + install_deps_pytorch_xla xla 1 2024-12-18T00:01:13.2998677Z + XLA_DIR=xla 2024-12-18T00:01:13.2998913Z + USE_CACHE=1 2024-12-18T00:01:13.2999160Z + pip install sympy 2024-12-18T00:01:13.6679928Z Requirement already satisfied: sympy in /opt/conda/lib/python3.10/site-packages (1.13.1) 2024-12-18T00:01:13.6697086Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy) (1.3.0) 2024-12-18T00:01:13.9535582Z + pip install ninja 2024-12-18T00:01:14.3197787Z Requirement already satisfied: ninja in /home/jenkins/.local/lib/python3.10/site-packages (1.10.2) 2024-12-18T00:01:14.6010221Z + pip install hypothesis 2024-12-18T00:01:14.9695857Z Requirement already satisfied: hypothesis in /opt/conda/lib/python3.10/site-packages (6.115.6) 2024-12-18T00:01:14.9797017Z Requirement already satisfied: attrs>=22.2.0 in /opt/conda/lib/python3.10/site-packages (from hypothesis) (24.2.0) 2024-12-18T00:01:14.9798063Z Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in /opt/conda/lib/python3.10/site-packages (from hypothesis) (2.4.0) 2024-12-18T00:01:14.9802671Z Requirement already satisfied: exceptiongroup>=1.0.0 in /opt/conda/lib/python3.10/site-packages (from hypothesis) (1.2.0) 2024-12-18T00:01:15.2565900Z + pip install cloud-tpu-client 2024-12-18T00:01:15.6245737Z Requirement already satisfied: cloud-tpu-client in /opt/conda/lib/python3.10/site-packages (0.10) 2024-12-18T00:01:15.6251327Z Requirement already satisfied: google-api-python-client==1.8.0 in /opt/conda/lib/python3.10/site-packages (from cloud-tpu-client) (1.8.0) 2024-12-18T00:01:15.6254287Z Requirement already satisfied: oauth2client in /opt/conda/lib/python3.10/site-packages (from cloud-tpu-client) (4.1.3) 2024-12-18T00:01:15.6274376Z Requirement already satisfied: httplib2<1dev,>=0.9.2 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (0.22.0) 2024-12-18T00:01:15.6275703Z Requirement already satisfied: google-auth>=1.4.1 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (2.37.0) 2024-12-18T00:01:15.6278956Z Requirement already satisfied: google-auth-httplib2>=0.0.3 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (0.2.0) 2024-12-18T00:01:15.6282984Z Requirement already satisfied: google-api-core<2dev,>=1.13.0 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (1.34.1) 2024-12-18T00:01:15.6286702Z Requirement already satisfied: six<2dev,>=1.6.1 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (1.17.0) 2024-12-18T00:01:15.6291137Z Requirement already satisfied: uritemplate<4dev,>=3.0.0 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (3.0.1) 2024-12-18T00:01:15.6306201Z Requirement already satisfied: pyasn1>=0.1.7 in /opt/conda/lib/python3.10/site-packages (from oauth2client->cloud-tpu-client) (0.6.1) 2024-12-18T00:01:15.6309913Z Requirement already satisfied: pyasn1-modules>=0.0.5 in /opt/conda/lib/python3.10/site-packages (from oauth2client->cloud-tpu-client) (0.4.1) 2024-12-18T00:01:15.6313574Z Requirement already satisfied: rsa>=3.1.4 in /opt/conda/lib/python3.10/site-packages (from oauth2client->cloud-tpu-client) (4.9) 2024-12-18T00:01:15.6343088Z Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.56.2 in /opt/conda/lib/python3.10/site-packages (from google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (1.66.0) 2024-12-18T00:01:15.6347997Z Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<4.0.0dev,>=3.19.5 in /opt/conda/lib/python3.10/site-packages (from google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (3.20.3) 2024-12-18T00:01:15.6352791Z Requirement already satisfied: requests<3.0.0dev,>=2.18.0 in /opt/conda/lib/python3.10/site-packages (from google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (2.32.3) 2024-12-18T00:01:15.6384868Z Requirement already satisfied: cachetools<6.0,>=2.0.0 in /opt/conda/lib/python3.10/site-packages (from google-auth>=1.4.1->google-api-python-client==1.8.0->cloud-tpu-client) (5.5.0) 2024-12-18T00:01:15.6417910Z Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in /opt/conda/lib/python3.10/site-packages (from httplib2<1dev,>=0.9.2->google-api-python-client==1.8.0->cloud-tpu-client) (3.2.0) 2024-12-18T00:01:15.6503743Z Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (3.3.2) 2024-12-18T00:01:15.6506872Z Requirement already satisfied: idna<4,>=2.5 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (3.7) 2024-12-18T00:01:15.6511539Z Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (1.26.20) 2024-12-18T00:01:15.6515424Z Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (2024.12.14) 2024-12-18T00:01:15.9275915Z + pip install absl-py 2024-12-18T00:01:16.2966748Z Requirement already satisfied: absl-py in /opt/conda/lib/python3.10/site-packages (2.1.0) 2024-12-18T00:01:16.5802233Z + pip install pandas 2024-12-18T00:01:16.9462517Z Requirement already satisfied: pandas in /opt/conda/lib/python3.10/site-packages (2.2.3) 2024-12-18T00:01:16.9746831Z Requirement already satisfied: numpy>=1.22.4 in /opt/conda/lib/python3.10/site-packages (from pandas) (2.0.2) 2024-12-18T00:01:16.9750269Z Requirement already satisfied: python-dateutil>=2.8.2 in /opt/conda/lib/python3.10/site-packages (from pandas) (2.9.0.post0) 2024-12-18T00:01:16.9753938Z Requirement already satisfied: pytz>=2020.1 in /opt/conda/lib/python3.10/site-packages (from pandas) (2024.2) 2024-12-18T00:01:16.9757601Z Requirement already satisfied: tzdata>=2022.7 in /opt/conda/lib/python3.10/site-packages (from pandas) (2024.2) 2024-12-18T00:01:16.9781160Z Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas) (1.17.0) 2024-12-18T00:01:17.2299153Z + pip install tabulate 2024-12-18T00:01:17.5984411Z Requirement already satisfied: tabulate in /opt/conda/lib/python3.10/site-packages (0.9.0) 2024-12-18T00:01:17.8772148Z + pip install --upgrade 'numpy>=1.18.5' 2024-12-18T00:01:18.2451574Z Requirement already satisfied: numpy>=1.18.5 in /opt/conda/lib/python3.10/site-packages (2.0.2) 2024-12-18T00:01:18.5127222Z Collecting numpy>=1.18.5 2024-12-18T00:01:18.5500049Z Downloading numpy-2.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB) 2024-12-18T00:01:18.5715785Z Downloading numpy-2.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.4 MB) 2024-12-18T00:01:18.6809150Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/16.4 MB ? eta -:--:-- 2024-12-18T00:01:18.6809979Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.4/16.4 MB 166.2 MB/s eta 0:00:00 2024-12-18T00:01:18.9242556Z [?25hInstalling collected packages: numpy 2024-12-18T00:01:18.9242957Z Attempting uninstall: numpy 2024-12-18T00:01:18.9255161Z Found existing installation: numpy 2.0.2 2024-12-18T00:01:18.9762340Z Uninstalling numpy-2.0.2: 2024-12-18T00:01:19.2026127Z Successfully uninstalled numpy-2.0.2 2024-12-18T00:01:20.8246692Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2024-12-18T00:01:20.8247988Z numba 0.60.0 requires numpy<2.1,>=1.22, but you have numpy 2.2.0 which is incompatible. 2024-12-18T00:01:20.8248594Z Successfully installed numpy-2.2.0 2024-12-18T00:01:20.9249240Z + pip install --upgrade numba 2024-12-18T00:01:21.2919630Z Requirement already satisfied: numba in /opt/conda/lib/python3.10/site-packages (0.60.0) 2024-12-18T00:01:21.4335950Z Requirement already satisfied: llvmlite<0.44,>=0.43.0dev0 in /opt/conda/lib/python3.10/site-packages (from numba) (0.43.0) 2024-12-18T00:01:21.6016822Z Collecting numpy<2.1,>=1.22 (from numba) 2024-12-18T00:01:21.6025502Z Using cached numpy-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB) 2024-12-18T00:01:21.6080153Z Using cached numpy-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB) 2024-12-18T00:01:21.8616691Z Installing collected packages: numpy 2024-12-18T00:01:21.8617204Z Attempting uninstall: numpy 2024-12-18T00:01:21.8634249Z Found existing installation: numpy 2.2.0 2024-12-18T00:01:21.9086635Z Uninstalling numpy-2.2.0: 2024-12-18T00:01:21.9170390Z Successfully uninstalled numpy-2.2.0 2024-12-18T00:01:23.5233458Z Successfully installed numpy-2.0.2 2024-12-18T00:01:23.6303462Z + pip install 'cmake>=3.13' --upgrade 2024-12-18T00:01:24.1896310Z Collecting cmake>=3.13 2024-12-18T00:01:24.2262971Z Downloading cmake-3.31.2-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB) 2024-12-18T00:01:24.2354786Z Downloading cmake-3.31.2-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (27.8 MB) 2024-12-18T00:01:24.4041553Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/27.8 MB ? eta -:--:-- 2024-12-18T00:01:24.4042418Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27.8/27.8 MB 188.4 MB/s eta 0:00:00 2024-12-18T00:01:24.7020481Z [?25hInstalling collected packages: cmake 2024-12-18T00:01:25.5684242Z Successfully installed cmake-3.31.2 2024-12-18T00:01:25.6636229Z + sudo apt-get -qq update 2024-12-18T00:01:26.4863526Z + sudo apt-get -qq install npm nodejs 2024-12-18T00:01:28.7337912Z debconf: delaying package configuration, since apt-utils is not installed 2024-12-18T00:01:28.7916404Z Selecting previously unselected package gtk-update-icon-cache. 2024-12-18T00:01:28.8018863Z (Reading database ... 2024-12-18T00:01:28.8019250Z (Reading database ... 5% 2024-12-18T00:01:28.8019537Z (Reading database ... 10% 2024-12-18T00:01:28.8019828Z (Reading database ... 15% 2024-12-18T00:01:28.8020114Z (Reading database ... 20% 2024-12-18T00:01:28.8020403Z (Reading database ... 25% 2024-12-18T00:01:28.8020690Z (Reading database ... 30% 2024-12-18T00:01:28.8020963Z (Reading database ... 35% 2024-12-18T00:01:28.8021250Z (Reading database ... 40% 2024-12-18T00:01:28.8021533Z (Reading database ... 45% 2024-12-18T00:01:28.8021813Z (Reading database ... 50% 2024-12-18T00:01:28.8040543Z (Reading database ... 55% 2024-12-18T00:01:28.8046718Z (Reading database ... 60% 2024-12-18T00:01:28.8063443Z (Reading database ... 65% 2024-12-18T00:01:28.8084975Z (Reading database ... 70% 2024-12-18T00:01:28.8091919Z (Reading database ... 75% 2024-12-18T00:01:28.8105040Z (Reading database ... 80% 2024-12-18T00:01:28.8128790Z (Reading database ... 85% 2024-12-18T00:01:28.8141199Z (Reading database ... 90% 2024-12-18T00:01:28.8168956Z (Reading database ... 95% 2024-12-18T00:01:28.8169376Z (Reading database ... 100% 2024-12-18T00:01:28.8169804Z (Reading database ... 46272 files and directories currently installed.) 2024-12-18T00:01:28.8172132Z Preparing to unpack .../000-gtk-update-icon-cache_3.24.24-4+deb11u4_amd64.deb ... 2024-12-18T00:01:28.8203118Z Unpacking gtk-update-icon-cache (3.24.24-4+deb11u4) ... 2024-12-18T00:01:28.8638982Z Selecting previously unselected package adwaita-icon-theme. 2024-12-18T00:01:28.8670873Z Preparing to unpack .../001-adwaita-icon-theme_3.38.0-1_all.deb ... 2024-12-18T00:01:28.8701526Z Unpacking adwaita-icon-theme (3.38.0-1) ... 2024-12-18T00:01:29.8406557Z Selecting previously unselected package dbus-user-session. 2024-12-18T00:01:29.8457722Z Preparing to unpack .../002-dbus-user-session_1.12.28-0+deb11u1_amd64.deb ... 2024-12-18T00:01:29.8488558Z Unpacking dbus-user-session (1.12.28-0+deb11u1) ... 2024-12-18T00:01:29.8814507Z Selecting previously unselected package libdconf1:amd64. 2024-12-18T00:01:29.8850776Z Preparing to unpack .../003-libdconf1_0.38.0-2_amd64.deb ... 2024-12-18T00:01:29.8900547Z Unpacking libdconf1:amd64 (0.38.0-2) ... 2024-12-18T00:01:29.9146510Z Selecting previously unselected package dconf-service. 2024-12-18T00:01:29.9181053Z Preparing to unpack .../004-dconf-service_0.38.0-2_amd64.deb ... 2024-12-18T00:01:29.9213497Z Unpacking dconf-service (0.38.0-2) ... 2024-12-18T00:01:29.9467733Z Selecting previously unselected package dconf-gsettings-backend:amd64. 2024-12-18T00:01:29.9500548Z Preparing to unpack .../005-dconf-gsettings-backend_0.38.0-2_amd64.deb ... 2024-12-18T00:01:29.9532416Z Unpacking dconf-gsettings-backend:amd64 (0.38.0-2) ... 2024-12-18T00:01:29.9808766Z Selecting previously unselected package libproxy1v5:amd64. 2024-12-18T00:01:29.9843559Z Preparing to unpack .../006-libproxy1v5_0.4.17-1_amd64.deb ... 2024-12-18T00:01:29.9873730Z Unpacking libproxy1v5:amd64 (0.4.17-1) ... 2024-12-18T00:01:30.0130934Z Selecting previously unselected package glib-networking-common. 2024-12-18T00:01:30.0165050Z Preparing to unpack .../007-glib-networking-common_2.66.0-2_all.deb ... 2024-12-18T00:01:30.0190876Z Unpacking glib-networking-common (2.66.0-2) ... 2024-12-18T00:01:30.0599512Z Selecting previously unselected package glib-networking-services. 2024-12-18T00:01:30.0635525Z Preparing to unpack .../008-glib-networking-services_2.66.0-2_amd64.deb ... 2024-12-18T00:01:30.0658040Z Unpacking glib-networking-services (2.66.0-2) ... 2024-12-18T00:01:30.0885172Z Selecting previously unselected package gsettings-desktop-schemas. 2024-12-18T00:01:30.0919116Z Preparing to unpack .../009-gsettings-desktop-schemas_3.38.0-2_all.deb ... 2024-12-18T00:01:30.0942796Z Unpacking gsettings-desktop-schemas (3.38.0-2) ... 2024-12-18T00:01:30.1690230Z Selecting previously unselected package glib-networking:amd64. 2024-12-18T00:01:30.1728427Z Preparing to unpack .../010-glib-networking_2.66.0-2_amd64.deb ... 2024-12-18T00:01:30.1751221Z Unpacking glib-networking:amd64 (2.66.0-2) ... 2024-12-18T00:01:30.2034772Z Selecting previously unselected package gyp. 2024-12-18T00:01:30.2069582Z Preparing to unpack .../011-gyp_0.1+20200513gitcaa6002-2_all.deb ... 2024-12-18T00:01:30.2098461Z Unpacking gyp (0.1+20200513gitcaa6002-2) ... 2024-12-18T00:01:30.2488262Z Selecting previously unselected package libauthen-sasl-perl. 2024-12-18T00:01:30.2526199Z Preparing to unpack .../012-libauthen-sasl-perl_2.1600-1.1_all.deb ... 2024-12-18T00:01:30.2549517Z Unpacking libauthen-sasl-perl (2.1600-1.1) ... 2024-12-18T00:01:30.2828753Z Selecting previously unselected package libc-ares2:amd64. 2024-12-18T00:01:30.2862403Z Preparing to unpack .../013-libc-ares2_1.17.1-1+deb11u3_amd64.deb ... 2024-12-18T00:01:30.2894894Z Unpacking libc-ares2:amd64 (1.17.1-1+deb11u3) ... 2024-12-18T00:01:30.3169369Z Selecting previously unselected package libclone-perl. 2024-12-18T00:01:30.3207158Z Preparing to unpack .../014-libclone-perl_0.45-1+b1_amd64.deb ... 2024-12-18T00:01:30.3230185Z Unpacking libclone-perl (0.45-1+b1) ... 2024-12-18T00:01:30.3489553Z Selecting previously unselected package libcolord2:amd64. 2024-12-18T00:01:30.3524636Z Preparing to unpack .../015-libcolord2_1.4.5-3_amd64.deb ... 2024-12-18T00:01:30.3548515Z Unpacking libcolord2:amd64 (1.4.5-3) ... 2024-12-18T00:01:30.3874123Z Selecting previously unselected package libdata-dump-perl. 2024-12-18T00:01:30.3903112Z Preparing to unpack .../016-libdata-dump-perl_1.23-1.1_all.deb ... 2024-12-18T00:01:30.3932224Z Unpacking libdata-dump-perl (1.23-1.1) ... 2024-12-18T00:01:30.4168788Z Selecting previously unselected package libencode-locale-perl. 2024-12-18T00:01:30.4202667Z Preparing to unpack .../017-libencode-locale-perl_1.05-1.1_all.deb ... 2024-12-18T00:01:30.4226876Z Unpacking libencode-locale-perl (1.05-1.1) ... 2024-12-18T00:01:30.4500201Z Selecting previously unselected package libepoxy0:amd64. 2024-12-18T00:01:30.4536355Z Preparing to unpack .../018-libepoxy0_1.5.5-1_amd64.deb ... 2024-12-18T00:01:30.4560740Z Unpacking libepoxy0:amd64 (1.5.5-1) ... 2024-12-18T00:01:30.4919321Z Selecting previously unselected package libipc-system-simple-perl. 2024-12-18T00:01:30.4949544Z Preparing to unpack .../019-libipc-system-simple-perl_1.30-1_all.deb ... 2024-12-18T00:01:30.4978967Z Unpacking libipc-system-simple-perl (1.30-1) ... 2024-12-18T00:01:30.5214003Z Selecting previously unselected package libfile-basedir-perl. 2024-12-18T00:01:30.5246887Z Preparing to unpack .../020-libfile-basedir-perl_0.08-1_all.deb ... 2024-12-18T00:01:30.5273780Z Unpacking libfile-basedir-perl (0.08-1) ... 2024-12-18T00:01:30.5487763Z Selecting previously unselected package liburi-perl. 2024-12-18T00:01:30.5524771Z Preparing to unpack .../021-liburi-perl_5.08-1_all.deb ... 2024-12-18T00:01:30.5547734Z Unpacking liburi-perl (5.08-1) ... 2024-12-18T00:01:30.5839629Z Selecting previously unselected package libfile-desktopentry-perl. 2024-12-18T00:01:30.5876292Z Preparing to unpack .../022-libfile-desktopentry-perl_0.22-2_all.deb ... 2024-12-18T00:01:30.5902709Z Unpacking libfile-desktopentry-perl (0.22-2) ... 2024-12-18T00:01:30.6131725Z Selecting previously unselected package libtimedate-perl. 2024-12-18T00:01:30.6168981Z Preparing to unpack .../023-libtimedate-perl_2.3300-2_all.deb ... 2024-12-18T00:01:30.6196009Z Unpacking libtimedate-perl (2.3300-2) ... 2024-12-18T00:01:30.6460330Z Selecting previously unselected package libhttp-date-perl. 2024-12-18T00:01:30.6496551Z Preparing to unpack .../024-libhttp-date-perl_6.05-1_all.deb ... 2024-12-18T00:01:30.6521422Z Unpacking libhttp-date-perl (6.05-1) ... 2024-12-18T00:01:30.6733591Z Selecting previously unselected package libfile-listing-perl. 2024-12-18T00:01:30.6768018Z Preparing to unpack .../025-libfile-listing-perl_6.14-1_all.deb ... 2024-12-18T00:01:30.6786789Z Unpacking libfile-listing-perl (6.14-1) ... 2024-12-18T00:01:30.7012232Z Selecting previously unselected package libfile-mimeinfo-perl. 2024-12-18T00:01:30.7045798Z Preparing to unpack .../026-libfile-mimeinfo-perl_0.30-1_all.deb ... 2024-12-18T00:01:30.7076890Z Unpacking libfile-mimeinfo-perl (0.30-1) ... 2024-12-18T00:01:30.7330094Z Selecting previously unselected package libfont-afm-perl. 2024-12-18T00:01:30.7365066Z Preparing to unpack .../027-libfont-afm-perl_1.20-3_all.deb ... 2024-12-18T00:01:30.7396652Z Unpacking libfont-afm-perl (1.20-3) ... 2024-12-18T00:01:30.7642816Z Selecting previously unselected package libjson-glib-1.0-common. 2024-12-18T00:01:30.7677282Z Preparing to unpack .../028-libjson-glib-1.0-common_1.6.2-1_all.deb ... 2024-12-18T00:01:30.7698735Z Unpacking libjson-glib-1.0-common (1.6.2-1) ... 2024-12-18T00:01:30.8044383Z Selecting previously unselected package libjson-glib-1.0-0:amd64. 2024-12-18T00:01:30.8076608Z Preparing to unpack .../029-libjson-glib-1.0-0_1.6.2-1_amd64.deb ... 2024-12-18T00:01:30.8104473Z Unpacking libjson-glib-1.0-0:amd64 (1.6.2-1) ... 2024-12-18T00:01:30.8419498Z Selecting previously unselected package libsoup2.4-1:amd64. 2024-12-18T00:01:30.8456121Z Preparing to unpack .../030-libsoup2.4-1_2.72.0-2+deb11u1_amd64.deb ... 2024-12-18T00:01:30.8491359Z Unpacking libsoup2.4-1:amd64 (2.72.0-2+deb11u1) ... 2024-12-18T00:01:30.8934347Z Selecting previously unselected package libsoup-gnome2.4-1:amd64. 2024-12-18T00:01:30.8967176Z Preparing to unpack .../031-libsoup-gnome2.4-1_2.72.0-2+deb11u1_amd64.deb ... 2024-12-18T00:01:30.8999122Z Unpacking libsoup-gnome2.4-1:amd64 (2.72.0-2+deb11u1) ... 2024-12-18T00:01:30.9275305Z Selecting previously unselected package librest-0.7-0:amd64. 2024-12-18T00:01:30.9303943Z Preparing to unpack .../032-librest-0.7-0_0.8.1-1.1_amd64.deb ... 2024-12-18T00:01:30.9337177Z Unpacking librest-0.7-0:amd64 (0.8.1-1.1) ... 2024-12-18T00:01:30.9614517Z Selecting previously unselected package libwayland-cursor0:amd64. 2024-12-18T00:01:30.9645914Z Preparing to unpack .../033-libwayland-cursor0_1.18.0-2~exp1.1_amd64.deb ... 2024-12-18T00:01:30.9678457Z Unpacking libwayland-cursor0:amd64 (1.18.0-2~exp1.1) ... 2024-12-18T00:01:30.9936354Z Selecting previously unselected package libwayland-egl1:amd64. 2024-12-18T00:01:30.9968488Z Preparing to unpack .../034-libwayland-egl1_1.18.0-2~exp1.1_amd64.deb ... 2024-12-18T00:01:31.0006494Z Unpacking libwayland-egl1:amd64 (1.18.0-2~exp1.1) ... 2024-12-18T00:01:31.0248916Z Selecting previously unselected package libxcursor1:amd64. 2024-12-18T00:01:31.0285940Z Preparing to unpack .../035-libxcursor1_1%3a1.2.0-2_amd64.deb ... 2024-12-18T00:01:31.0316437Z Unpacking libxcursor1:amd64 (1:1.2.0-2) ... 2024-12-18T00:01:31.0578946Z Selecting previously unselected package libgtk-3-common. 2024-12-18T00:01:31.0614517Z Preparing to unpack .../036-libgtk-3-common_3.24.24-4+deb11u4_all.deb ... 2024-12-18T00:01:31.0642239Z Unpacking libgtk-3-common (3.24.24-4+deb11u4) ... 2024-12-18T00:01:31.3774503Z Selecting previously unselected package libgtk-3-0:amd64. 2024-12-18T00:01:31.3814176Z Preparing to unpack .../037-libgtk-3-0_3.24.24-4+deb11u4_amd64.deb ... 2024-12-18T00:01:31.3841655Z Unpacking libgtk-3-0:amd64 (3.24.24-4+deb11u4) ... 2024-12-18T00:01:31.5900248Z Selecting previously unselected package libgtk-3-bin. 2024-12-18T00:01:31.5939774Z Preparing to unpack .../038-libgtk-3-bin_3.24.24-4+deb11u4_amd64.deb ... 2024-12-18T00:01:31.5972249Z Unpacking libgtk-3-bin (3.24.24-4+deb11u4) ... 2024-12-18T00:01:31.6286029Z Selecting previously unselected package libhtml-tagset-perl. 2024-12-18T00:01:31.6326638Z Preparing to unpack .../039-libhtml-tagset-perl_3.20-4_all.deb ... 2024-12-18T00:01:31.6349327Z Unpacking libhtml-tagset-perl (3.20-4) ... 2024-12-18T00:01:31.6579093Z Selecting previously unselected package libhtml-parser-perl. 2024-12-18T00:01:31.6617795Z Preparing to unpack .../040-libhtml-parser-perl_3.75-1+b1_amd64.deb ... 2024-12-18T00:01:31.6646032Z Unpacking libhtml-parser-perl (3.75-1+b1) ... 2024-12-18T00:01:31.6947517Z Selecting previously unselected package libio-html-perl. 2024-12-18T00:01:31.6982064Z Preparing to unpack .../041-libio-html-perl_1.004-2_all.deb ... 2024-12-18T00:01:31.7015416Z Unpacking libio-html-perl (1.004-2) ... 2024-12-18T00:01:31.7250388Z Selecting previously unselected package liblwp-mediatypes-perl. 2024-12-18T00:01:31.7286739Z Preparing to unpack .../042-liblwp-mediatypes-perl_6.04-1_all.deb ... 2024-12-18T00:01:31.7317078Z Unpacking liblwp-mediatypes-perl (6.04-1) ... 2024-12-18T00:01:31.7550411Z Selecting previously unselected package libhttp-message-perl. 2024-12-18T00:01:31.7582824Z Preparing to unpack .../043-libhttp-message-perl_6.28-1_all.deb ... 2024-12-18T00:01:31.7619784Z Unpacking libhttp-message-perl (6.28-1) ... 2024-12-18T00:01:31.7898645Z Selecting previously unselected package libhtml-form-perl. 2024-12-18T00:01:31.7933988Z Preparing to unpack .../044-libhtml-form-perl_6.07-1_all.deb ... 2024-12-18T00:01:31.7962298Z Unpacking libhtml-form-perl (6.07-1) ... 2024-12-18T00:01:31.8205103Z Selecting previously unselected package libhtml-tree-perl. 2024-12-18T00:01:31.8239080Z Preparing to unpack .../045-libhtml-tree-perl_5.07-2_all.deb ... 2024-12-18T00:01:31.8264137Z Unpacking libhtml-tree-perl (5.07-2) ... 2024-12-18T00:01:31.8631954Z Selecting previously unselected package libhtml-format-perl. 2024-12-18T00:01:31.8662276Z Preparing to unpack .../046-libhtml-format-perl_2.12-1.1_all.deb ... 2024-12-18T00:01:31.8699260Z Unpacking libhtml-format-perl (2.12-1.1) ... 2024-12-18T00:01:31.8948273Z Selecting previously unselected package libhttp-cookies-perl. 2024-12-18T00:01:31.8981188Z Preparing to unpack .../047-libhttp-cookies-perl_6.10-1_all.deb ... 2024-12-18T00:01:31.9015341Z Unpacking libhttp-cookies-perl (6.10-1) ... 2024-12-18T00:01:31.9248185Z Selecting previously unselected package libhttp-daemon-perl. 2024-12-18T00:01:31.9284356Z Preparing to unpack .../048-libhttp-daemon-perl_6.12-1+deb11u1_all.deb ... 2024-12-18T00:01:31.9305910Z Unpacking libhttp-daemon-perl (6.12-1+deb11u1) ... 2024-12-18T00:01:31.9562719Z Selecting previously unselected package libhttp-negotiate-perl. 2024-12-18T00:01:31.9596359Z Preparing to unpack .../049-libhttp-negotiate-perl_6.01-1_all.deb ... 2024-12-18T00:01:31.9620838Z Unpacking libhttp-negotiate-perl (6.01-1) ... 2024-12-18T00:01:31.9859511Z Selecting previously unselected package perl-openssl-defaults:amd64. 2024-12-18T00:01:31.9896394Z Preparing to unpack .../050-perl-openssl-defaults_5_amd64.deb ... 2024-12-18T00:01:31.9927395Z Unpacking perl-openssl-defaults:amd64 (5) ... 2024-12-18T00:01:32.0168844Z Selecting previously unselected package libnet-ssleay-perl. 2024-12-18T00:01:32.0203884Z Preparing to unpack .../051-libnet-ssleay-perl_1.88-3+b1_amd64.deb ... 2024-12-18T00:01:32.0225316Z Unpacking libnet-ssleay-perl (1.88-3+b1) ... 2024-12-18T00:01:32.0684729Z Selecting previously unselected package libio-socket-ssl-perl. 2024-12-18T00:01:32.0718656Z Preparing to unpack .../052-libio-socket-ssl-perl_2.069-1_all.deb ... 2024-12-18T00:01:32.0743434Z Unpacking libio-socket-ssl-perl (2.069-1) ... 2024-12-18T00:01:32.1111134Z Selecting previously unselected package libjs-highlight.js. 2024-12-18T00:01:32.1142833Z Preparing to unpack .../053-libjs-highlight.js_9.18.5+dfsg1-1_all.deb ... 2024-12-18T00:01:32.1175438Z Unpacking libjs-highlight.js (9.18.5+dfsg1-1) ... 2024-12-18T00:01:32.1708508Z Selecting previously unselected package libjs-inherits. 2024-12-18T00:01:32.1741941Z Preparing to unpack .../054-libjs-inherits_2.0.4-1_all.deb ... 2024-12-18T00:01:32.1778183Z Unpacking libjs-inherits (2.0.4-1) ... 2024-12-18T00:01:32.2005575Z Selecting previously unselected package libjs-is-typedarray. 2024-12-18T00:01:32.2040759Z Preparing to unpack .../055-libjs-is-typedarray_1.0.0-3_all.deb ... 2024-12-18T00:01:32.2060701Z Unpacking libjs-is-typedarray (1.0.0-3) ... 2024-12-18T00:01:32.2599586Z Selecting previously unselected package libjs-psl. 2024-12-18T00:01:32.2634714Z Preparing to unpack .../056-libjs-psl_1.8.0+ds-4_all.deb ... 2024-12-18T00:01:32.2748505Z Unpacking libjs-psl (1.8.0+ds-4) ... 2024-12-18T00:01:32.3091560Z Selecting previously unselected package libjs-typedarray-to-buffer. 2024-12-18T00:01:32.3128248Z Preparing to unpack .../057-libjs-typedarray-to-buffer_4.0.0-1_all.deb ... 2024-12-18T00:01:32.3150790Z Unpacking libjs-typedarray-to-buffer (4.0.0-1) ... 2024-12-18T00:01:32.3419139Z Selecting previously unselected package liblua5.3-0:amd64. 2024-12-18T00:01:32.3456564Z Preparing to unpack .../058-liblua5.3-0_5.3.3-1.1+deb11u1_amd64.deb ... 2024-12-18T00:01:32.3492697Z Unpacking liblua5.3-0:amd64 (5.3.3-1.1+deb11u1) ... 2024-12-18T00:01:32.3827964Z Selecting previously unselected package libnet-http-perl. 2024-12-18T00:01:32.3862357Z Preparing to unpack .../059-libnet-http-perl_6.20-1_all.deb ... 2024-12-18T00:01:32.3897067Z Unpacking libnet-http-perl (6.20-1) ... 2024-12-18T00:01:32.4139340Z Selecting previously unselected package libtry-tiny-perl. 2024-12-18T00:01:32.4176992Z Preparing to unpack .../060-libtry-tiny-perl_0.30-1_all.deb ... 2024-12-18T00:01:32.4205987Z Unpacking libtry-tiny-perl (0.30-1) ... 2024-12-18T00:01:32.4460957Z Selecting previously unselected package libwww-robotrules-perl. 2024-12-18T00:01:32.4498126Z Preparing to unpack .../061-libwww-robotrules-perl_6.02-1_all.deb ... 2024-12-18T00:01:32.4529180Z Unpacking libwww-robotrules-perl (6.02-1) ... 2024-12-18T00:01:32.4779194Z Selecting previously unselected package libwww-perl. 2024-12-18T00:01:32.4814257Z Preparing to unpack .../062-libwww-perl_6.52-1_all.deb ... 2024-12-18T00:01:32.4846878Z Unpacking libwww-perl (6.52-1) ... 2024-12-18T00:01:32.5212078Z Selecting previously unselected package liblwp-protocol-https-perl. 2024-12-18T00:01:32.5246036Z Preparing to unpack .../063-liblwp-protocol-https-perl_6.10-1_all.deb ... 2024-12-18T00:01:32.5276200Z Unpacking liblwp-protocol-https-perl (6.10-1) ... 2024-12-18T00:01:32.5522532Z Selecting previously unselected package libnet-smtp-ssl-perl. 2024-12-18T00:01:32.5553546Z Preparing to unpack .../064-libnet-smtp-ssl-perl_1.04-1_all.deb ... 2024-12-18T00:01:32.5583354Z Unpacking libnet-smtp-ssl-perl (1.04-1) ... 2024-12-18T00:01:32.5832498Z Selecting previously unselected package libmailtools-perl. 2024-12-18T00:01:32.5861871Z Preparing to unpack .../065-libmailtools-perl_2.21-1_all.deb ... 2024-12-18T00:01:32.5898230Z Unpacking libmailtools-perl (2.21-1) ... 2024-12-18T00:01:32.6183369Z Selecting previously unselected package libxml-parser-perl:amd64. 2024-12-18T00:01:32.6218423Z Preparing to unpack .../066-libxml-parser-perl_2.46-2_amd64.deb ... 2024-12-18T00:01:32.6247267Z Unpacking libxml-parser-perl:amd64 (2.46-2) ... 2024-12-18T00:01:32.6627619Z Selecting previously unselected package libxml-twig-perl. 2024-12-18T00:01:32.6661920Z Preparing to unpack .../067-libxml-twig-perl_1%3a3.52-1_all.deb ... 2024-12-18T00:01:32.6692056Z Unpacking libxml-twig-perl (1:3.52-1) ... 2024-12-18T00:01:32.7046274Z Selecting previously unselected package libnet-dbus-perl. 2024-12-18T00:01:32.7080270Z Preparing to unpack .../068-libnet-dbus-perl_1.2.0-1+b1_amd64.deb ... 2024-12-18T00:01:32.7111440Z Unpacking libnet-dbus-perl (1.2.0-1+b1) ... 2024-12-18T00:01:32.7533623Z Selecting previously unselected package libuv1:amd64. 2024-12-18T00:01:32.7568849Z Preparing to unpack .../069-libuv1_1.40.0-2+deb11u1_amd64.deb ... 2024-12-18T00:01:32.7596013Z Unpacking libuv1:amd64 (1.40.0-2+deb11u1) ... 2024-12-18T00:01:32.7906566Z Selecting previously unselected package libuv1-dev:amd64. 2024-12-18T00:01:32.7939566Z Preparing to unpack .../070-libuv1-dev_1.40.0-2+deb11u1_amd64.deb ... 2024-12-18T00:01:32.7973610Z Unpacking libuv1-dev:amd64 (1.40.0-2+deb11u1) ... 2024-12-18T00:01:32.8372371Z Selecting previously unselected package libnode72:amd64. 2024-12-18T00:01:32.8407980Z Preparing to unpack .../071-libnode72_12.22.12~dfsg-1~deb11u5_amd64.deb ... 2024-12-18T00:01:32.8438257Z Unpacking libnode72:amd64 (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:33.4275555Z Selecting previously unselected package libnode-dev. 2024-12-18T00:01:33.4316271Z Preparing to unpack .../072-libnode-dev_12.22.12~dfsg-1~deb11u5_amd64.deb ... 2024-12-18T00:01:33.4341548Z Unpacking libnode-dev (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:33.4899460Z Selecting previously unselected package libtext-iconv-perl. 2024-12-18T00:01:33.4939462Z Preparing to unpack .../073-libtext-iconv-perl_1.7-7+b1_amd64.deb ... 2024-12-18T00:01:33.4996011Z Unpacking libtext-iconv-perl (1.7-7+b1) ... 2024-12-18T00:01:33.5245669Z Selecting previously unselected package libtie-ixhash-perl. 2024-12-18T00:01:33.5283329Z Preparing to unpack .../074-libtie-ixhash-perl_1.23-2.1_all.deb ... 2024-12-18T00:01:33.5306883Z Unpacking libtie-ixhash-perl (1.23-2.1) ... 2024-12-18T00:01:33.5576728Z Selecting previously unselected package libvte-2.91-common. 2024-12-18T00:01:33.5610842Z Preparing to unpack .../075-libvte-2.91-common_0.62.3-1_amd64.deb ... 2024-12-18T00:01:33.5640937Z Unpacking libvte-2.91-common (0.62.3-1) ... 2024-12-18T00:01:33.6083605Z Selecting previously unselected package libvte-2.91-0:amd64. 2024-12-18T00:01:33.6119607Z Preparing to unpack .../076-libvte-2.91-0_0.62.3-1_amd64.deb ... 2024-12-18T00:01:33.6151068Z Unpacking libvte-2.91-0:amd64 (0.62.3-1) ... 2024-12-18T00:01:33.6565674Z Selecting previously unselected package libx11-protocol-perl. 2024-12-18T00:01:33.6599762Z Preparing to unpack .../077-libx11-protocol-perl_0.56-7.1_all.deb ... 2024-12-18T00:01:33.6631139Z Unpacking libx11-protocol-perl (0.56-7.1) ... 2024-12-18T00:01:33.6975563Z Selecting previously unselected package libxml-xpathengine-perl. 2024-12-18T00:01:33.7010125Z Preparing to unpack .../078-libxml-xpathengine-perl_0.14-1_all.deb ... 2024-12-18T00:01:33.7038859Z Unpacking libxml-xpathengine-perl (0.14-1) ... 2024-12-18T00:01:33.7321523Z Selecting previously unselected package nodejs. 2024-12-18T00:01:33.7356894Z Preparing to unpack .../079-nodejs_12.22.12~dfsg-1~deb11u5_amd64.deb ... 2024-12-18T00:01:33.7389893Z Unpacking nodejs (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:33.7741196Z Selecting previously unselected package node-abbrev. 2024-12-18T00:01:33.7778466Z Preparing to unpack .../080-node-abbrev_1.1.1-2_all.deb ... 2024-12-18T00:01:33.7806598Z Unpacking node-abbrev (1.1.1-2) ... 2024-12-18T00:01:33.8051875Z Selecting previously unselected package node-ms. 2024-12-18T00:01:33.8088557Z Preparing to unpack .../081-node-ms_2.1.3+~cs0.7.31-1_all.deb ... 2024-12-18T00:01:33.8117734Z Unpacking node-ms (2.1.3+~cs0.7.31-1) ... 2024-12-18T00:01:33.8498895Z Selecting previously unselected package node-debug. 2024-12-18T00:01:33.8535323Z Preparing to unpack .../082-node-debug_4.3.1+~cs4.1.5-1_all.deb ... 2024-12-18T00:01:33.8568184Z Unpacking node-debug (4.3.1+~cs4.1.5-1) ... 2024-12-18T00:01:33.8812751Z Selecting previously unselected package node-yallist. 2024-12-18T00:01:33.8846071Z Preparing to unpack .../083-node-yallist_4.0.0-1_all.deb ... 2024-12-18T00:01:33.8874524Z Unpacking node-yallist (4.0.0-1) ... 2024-12-18T00:01:33.9099555Z Selecting previously unselected package node-lru-cache. 2024-12-18T00:01:33.9136604Z Preparing to unpack .../084-node-lru-cache_5.1.1-5_all.deb ... 2024-12-18T00:01:33.9166966Z Unpacking node-lru-cache (5.1.1-5) ... 2024-12-18T00:01:33.9401979Z Selecting previously unselected package node-semver. 2024-12-18T00:01:33.9437268Z Preparing to unpack .../085-node-semver_7.3.4-1_all.deb ... 2024-12-18T00:01:33.9459838Z Unpacking node-semver (7.3.4-1) ... 2024-12-18T00:01:33.9782092Z Selecting previously unselected package node-agent-base. 2024-12-18T00:01:33.9818294Z Preparing to unpack .../086-node-agent-base_6.0.2-2_all.deb ... 2024-12-18T00:01:33.9847459Z Unpacking node-agent-base (6.0.2-2) ... 2024-12-18T00:01:34.0092876Z Selecting previously unselected package node-fast-deep-equal. 2024-12-18T00:01:34.0127273Z Preparing to unpack .../087-node-fast-deep-equal_3.1.3-1_all.deb ... 2024-12-18T00:01:34.0151048Z Unpacking node-fast-deep-equal (3.1.3-1) ... 2024-12-18T00:01:34.0388173Z Selecting previously unselected package node-json-schema-traverse. 2024-12-18T00:01:34.0421432Z Preparing to unpack .../088-node-json-schema-traverse_1.0.0-2_all.deb ... 2024-12-18T00:01:34.0452341Z Unpacking node-json-schema-traverse (1.0.0-2) ... 2024-12-18T00:01:34.0694530Z Selecting previously unselected package node-jsonify. 2024-12-18T00:01:34.0728617Z Preparing to unpack .../089-node-jsonify_0.0.0-1.1_all.deb ... 2024-12-18T00:01:34.0751264Z Unpacking node-jsonify (0.0.0-1.1) ... 2024-12-18T00:01:34.0978989Z Selecting previously unselected package node-json-stable-stringify. 2024-12-18T00:01:34.1015235Z Preparing to unpack .../090-node-json-stable-stringify_1.0.1+~cs5.1.32-1_all.deb ... 2024-12-18T00:01:34.1044790Z Unpacking node-json-stable-stringify (1.0.1+~cs5.1.32-1) ... 2024-12-18T00:01:34.1393805Z Selecting previously unselected package node-punycode. 2024-12-18T00:01:34.1428750Z Preparing to unpack .../091-node-punycode_2.1.1-3_all.deb ... 2024-12-18T00:01:34.1459848Z Unpacking node-punycode (2.1.1-3) ... 2024-12-18T00:01:34.1698396Z Selecting previously unselected package node-uri-js. 2024-12-18T00:01:34.1733813Z Preparing to unpack .../092-node-uri-js_4.4.0+dfsg-5_all.deb ... 2024-12-18T00:01:34.1782334Z Unpacking node-uri-js (4.4.0+dfsg-5) ... 2024-12-18T00:01:34.2084792Z Selecting previously unselected package node-ajv. 2024-12-18T00:01:34.2119030Z Preparing to unpack .../093-node-ajv_6.12.6-2_all.deb ... 2024-12-18T00:01:34.2146962Z Unpacking node-ajv (6.12.6-2) ... 2024-12-18T00:01:34.2483963Z Selecting previously unselected package node-ansi. 2024-12-18T00:01:34.2518562Z Preparing to unpack .../094-node-ansi_0.3.1-1_all.deb ... 2024-12-18T00:01:34.2546924Z Unpacking node-ansi (0.3.1-1) ... 2024-12-18T00:01:34.2809060Z Selecting previously unselected package node-ansi-regex. 2024-12-18T00:01:34.2845446Z Preparing to unpack .../095-node-ansi-regex_5.0.1-1~deb11u1_all.deb ... 2024-12-18T00:01:34.2880367Z Unpacking node-ansi-regex (5.0.1-1~deb11u1) ... 2024-12-18T00:01:34.3132019Z Selecting previously unselected package node-color-name. 2024-12-18T00:01:34.3166458Z Preparing to unpack .../096-node-color-name_1.1.4+~1.1.1-1_all.deb ... 2024-12-18T00:01:34.3198014Z Unpacking node-color-name (1.1.4+~1.1.1-1) ... 2024-12-18T00:01:34.3441544Z Selecting previously unselected package node-color-convert. 2024-12-18T00:01:34.3477347Z Preparing to unpack .../097-node-color-convert_1.9.3-1_all.deb ... 2024-12-18T00:01:34.3505878Z Unpacking node-color-convert (1.9.3-1) ... 2024-12-18T00:01:34.3739040Z Selecting previously unselected package node-ansi-styles. 2024-12-18T00:01:34.3775651Z Preparing to unpack .../098-node-ansi-styles_4.2.1-1_all.deb ... 2024-12-18T00:01:34.3802293Z Unpacking node-ansi-styles (4.2.1-1) ... 2024-12-18T00:01:34.4045832Z Selecting previously unselected package node-ansistyles. 2024-12-18T00:01:34.4080438Z Preparing to unpack .../099-node-ansistyles_0.1.3-2_all.deb ... 2024-12-18T00:01:34.4108204Z Unpacking node-ansistyles (0.1.3-2) ... 2024-12-18T00:01:34.4365812Z Selecting previously unselected package node-aproba. 2024-12-18T00:01:34.4399774Z Preparing to unpack .../100-node-aproba_2.0.0-1_all.deb ... 2024-12-18T00:01:34.4436699Z Unpacking node-aproba (2.0.0-1) ... 2024-12-18T00:01:34.4676002Z Selecting previously unselected package node-archy. 2024-12-18T00:01:34.4707065Z Preparing to unpack .../101-node-archy_1.0.0-3_all.deb ... 2024-12-18T00:01:34.4738535Z Unpacking node-archy (1.0.0-3) ... 2024-12-18T00:01:34.4981376Z Selecting previously unselected package node-delegates. 2024-12-18T00:01:34.5018561Z Preparing to unpack .../102-node-delegates_1.0.0-2_all.deb ... 2024-12-18T00:01:34.5046983Z Unpacking node-delegates (1.0.0-2) ... 2024-12-18T00:01:34.5291246Z Selecting previously unselected package node-inherits. 2024-12-18T00:01:34.5327297Z Preparing to unpack .../103-node-inherits_2.0.4-1_all.deb ... 2024-12-18T00:01:34.5372044Z Unpacking node-inherits (2.0.4-1) ... 2024-12-18T00:01:34.5604485Z Selecting previously unselected package node-core-util-is. 2024-12-18T00:01:34.5639134Z Preparing to unpack .../104-node-core-util-is_1.0.2-2_all.deb ... 2024-12-18T00:01:34.5664616Z Unpacking node-core-util-is (1.0.2-2) ... 2024-12-18T00:01:34.5921707Z Selecting previously unselected package node-safe-buffer. 2024-12-18T00:01:34.5954674Z Preparing to unpack .../105-node-safe-buffer_5.2.1+~cs2.1.2-1_all.deb ... 2024-12-18T00:01:34.5986639Z Unpacking node-safe-buffer (5.2.1+~cs2.1.2-1) ... 2024-12-18T00:01:34.6226365Z Selecting previously unselected package node-string-decoder. 2024-12-18T00:01:34.6260925Z Preparing to unpack .../106-node-string-decoder_1.3.0-2_all.deb ... 2024-12-18T00:01:34.6294314Z Unpacking node-string-decoder (1.3.0-2) ... 2024-12-18T00:01:34.6531516Z Selecting previously unselected package node-process-nextick-args. 2024-12-18T00:01:34.6567237Z Preparing to unpack .../107-node-process-nextick-args_2.0.0-1_all.deb ... 2024-12-18T00:01:34.6602532Z Unpacking node-process-nextick-args (2.0.0-1) ... 2024-12-18T00:01:34.6850310Z Selecting previously unselected package node-util-deprecate. 2024-12-18T00:01:34.6886952Z Preparing to unpack .../108-node-util-deprecate_1.0.2-1_all.deb ... 2024-12-18T00:01:34.6914912Z Unpacking node-util-deprecate (1.0.2-1) ... 2024-12-18T00:01:34.7176165Z Selecting previously unselected package node-isarray. 2024-12-18T00:01:34.7212069Z Preparing to unpack .../109-node-isarray_2.0.5-1_all.deb ... 2024-12-18T00:01:34.7238898Z Unpacking node-isarray (2.0.5-1) ... 2024-12-18T00:01:34.7484919Z Selecting previously unselected package node-readable-stream. 2024-12-18T00:01:34.7519947Z Preparing to unpack .../110-node-readable-stream_3.6.0-2_all.deb ... 2024-12-18T00:01:34.7547756Z Unpacking node-readable-stream (3.6.0-2) ... 2024-12-18T00:01:34.7815410Z Selecting previously unselected package node-are-we-there-yet. 2024-12-18T00:01:34.7846749Z Preparing to unpack .../111-node-are-we-there-yet_1.1.5-1_all.deb ... 2024-12-18T00:01:34.7882955Z Unpacking node-are-we-there-yet (1.1.5-1) ... 2024-12-18T00:01:34.8138892Z Selecting previously unselected package node-asap. 2024-12-18T00:01:34.8176045Z Preparing to unpack .../112-node-asap_2.0.6-2_all.deb ... 2024-12-18T00:01:34.8205600Z Unpacking node-asap (2.0.6-2) ... 2024-12-18T00:01:34.8450426Z Selecting previously unselected package node-asn1. 2024-12-18T00:01:34.8486505Z Preparing to unpack .../113-node-asn1_0.2.3-2_all.deb ... 2024-12-18T00:01:34.8517647Z Unpacking node-asn1 (0.2.3-2) ... 2024-12-18T00:01:34.8778737Z Selecting previously unselected package node-assert-plus. 2024-12-18T00:01:34.8815040Z Preparing to unpack .../114-node-assert-plus_1.0.0-2_all.deb ... 2024-12-18T00:01:34.8842263Z Unpacking node-assert-plus (1.0.0-2) ... 2024-12-18T00:01:34.9092411Z Selecting previously unselected package node-asynckit. 2024-12-18T00:01:34.9127851Z Preparing to unpack .../115-node-asynckit_0.4.0-3_all.deb ... 2024-12-18T00:01:34.9155822Z Unpacking node-asynckit (0.4.0-3) ... 2024-12-18T00:01:34.9434050Z Selecting previously unselected package node-aws-sign2. 2024-12-18T00:01:34.9465548Z Preparing to unpack .../116-node-aws-sign2_0.7.1-2_all.deb ... 2024-12-18T00:01:34.9501940Z Unpacking node-aws-sign2 (0.7.1-2) ... 2024-12-18T00:01:34.9753017Z Selecting previously unselected package node-aws4. 2024-12-18T00:01:34.9784780Z Preparing to unpack .../117-node-aws4_1.11.0-1_all.deb ... 2024-12-18T00:01:34.9818598Z Unpacking node-aws4 (1.11.0-1) ... 2024-12-18T00:01:35.0075513Z Selecting previously unselected package node-balanced-match. 2024-12-18T00:01:35.0106044Z Preparing to unpack .../118-node-balanced-match_1.0.0-1_all.deb ... 2024-12-18T00:01:35.0138829Z Unpacking node-balanced-match (1.0.0-1) ... 2024-12-18T00:01:35.0386430Z Selecting previously unselected package node-tweetnacl. 2024-12-18T00:01:35.0420192Z Preparing to unpack .../119-node-tweetnacl_1.0.3+dfsg-1_all.deb ... 2024-12-18T00:01:35.0448643Z Unpacking node-tweetnacl (1.0.3+dfsg-1) ... 2024-12-18T00:01:35.0715591Z Selecting previously unselected package node-bcrypt-pbkdf. 2024-12-18T00:01:35.0746736Z Preparing to unpack .../120-node-bcrypt-pbkdf_1.0.2-1_all.deb ... 2024-12-18T00:01:35.0778028Z Unpacking node-bcrypt-pbkdf (1.0.2-1) ... 2024-12-18T00:01:35.1006017Z Selecting previously unselected package node-brace-expansion. 2024-12-18T00:01:35.1041065Z Preparing to unpack .../121-node-brace-expansion_2.0.0-1_all.deb ... 2024-12-18T00:01:35.1076041Z Unpacking node-brace-expansion (2.0.0-1) ... 2024-12-18T00:01:35.1375366Z Selecting previously unselected package node-builtins. 2024-12-18T00:01:35.1409676Z Preparing to unpack .../122-node-builtins_1.0.3-2_all.deb ... 2024-12-18T00:01:35.1453612Z Unpacking node-builtins (1.0.3-2) ... 2024-12-18T00:01:35.1731841Z Selecting previously unselected package node-chownr. 2024-12-18T00:01:35.1766886Z Preparing to unpack .../123-node-chownr_1.1.3-5_all.deb ... 2024-12-18T00:01:35.1801822Z Unpacking node-chownr (1.1.3-5) ... 2024-12-18T00:01:35.2067296Z Selecting previously unselected package node-fs.realpath. 2024-12-18T00:01:35.2100710Z Preparing to unpack .../124-node-fs.realpath_1.0.0-1.1_all.deb ... 2024-12-18T00:01:35.2139113Z Unpacking node-fs.realpath (1.0.0-1.1) ... 2024-12-18T00:01:35.2395257Z Selecting previously unselected package node-wrappy. 2024-12-18T00:01:35.2425216Z Preparing to unpack .../125-node-wrappy_1.0.2-1.1_all.deb ... 2024-12-18T00:01:35.2457496Z Unpacking node-wrappy (1.0.2-1.1) ... 2024-12-18T00:01:35.2698777Z Selecting previously unselected package node-once. 2024-12-18T00:01:35.2735919Z Preparing to unpack .../126-node-once_1.4.0-3_all.deb ... 2024-12-18T00:01:35.2769025Z Unpacking node-once (1.4.0-3) ... 2024-12-18T00:01:35.3012339Z Selecting previously unselected package node-inflight. 2024-12-18T00:01:35.3046724Z Preparing to unpack .../127-node-inflight_1.0.6-1.1_all.deb ... 2024-12-18T00:01:35.3075137Z Unpacking node-inflight (1.0.6-1.1) ... 2024-12-18T00:01:35.3327399Z Selecting previously unselected package node-minimatch. 2024-12-18T00:01:35.3354207Z Preparing to unpack .../128-node-minimatch_3.0.4+~3.0.3-1+deb11u2_all.deb ... 2024-12-18T00:01:35.3395875Z Unpacking node-minimatch (3.0.4+~3.0.3-1+deb11u2) ... 2024-12-18T00:01:35.3651740Z Selecting previously unselected package node-path-is-absolute. 2024-12-18T00:01:35.3688315Z Preparing to unpack .../129-node-path-is-absolute_2.0.0-1_all.deb ... 2024-12-18T00:01:35.3717934Z Unpacking node-path-is-absolute (2.0.0-1) ... 2024-12-18T00:01:35.3949840Z Selecting previously unselected package node-glob. 2024-12-18T00:01:35.3983895Z Preparing to unpack .../130-node-glob_7.1.6+~7.1.3-1_all.deb ... 2024-12-18T00:01:35.4018299Z Unpacking node-glob (7.1.6+~7.1.3-1) ... 2024-12-18T00:01:35.4333495Z Selecting previously unselected package node-graceful-fs. 2024-12-18T00:01:35.4368022Z Preparing to unpack .../131-node-graceful-fs_4.2.4+repack-1_all.deb ... 2024-12-18T00:01:35.4394724Z Unpacking node-graceful-fs (4.2.4+repack-1) ... 2024-12-18T00:01:35.4643384Z Selecting previously unselected package node-mkdirp. 2024-12-18T00:01:35.4679454Z Preparing to unpack .../132-node-mkdirp_1.0.4+~1.0.1-1_all.deb ... 2024-12-18T00:01:35.4704454Z Unpacking node-mkdirp (1.0.4+~1.0.1-1) ... 2024-12-18T00:01:35.4966182Z Selecting previously unselected package node-run-queue. 2024-12-18T00:01:35.5001797Z Preparing to unpack .../133-node-run-queue_2.0.0-1_all.deb ... 2024-12-18T00:01:35.5030391Z Unpacking node-run-queue (2.0.0-1) ... 2024-12-18T00:01:35.5294460Z Selecting previously unselected package node-rimraf. 2024-12-18T00:01:35.5328900Z Preparing to unpack .../134-node-rimraf_3.0.2-1_all.deb ... 2024-12-18T00:01:35.5355433Z Unpacking node-rimraf (3.0.2-1) ... 2024-12-18T00:01:35.5604742Z Selecting previously unselected package node-imurmurhash. 2024-12-18T00:01:35.5640421Z Preparing to unpack .../135-node-imurmurhash_0.1.4-1.1_all.deb ... 2024-12-18T00:01:35.5666491Z Unpacking node-imurmurhash (0.1.4-1.1) ... 2024-12-18T00:01:35.5930973Z Selecting previously unselected package node-iferr. 2024-12-18T00:01:35.5967489Z Preparing to unpack .../136-node-iferr_1.0.2-1_all.deb ... 2024-12-18T00:01:35.5996317Z Unpacking node-iferr (1.0.2-1) ... 2024-12-18T00:01:35.6242113Z Selecting previously unselected package node-fs-write-stream-atomic. 2024-12-18T00:01:35.6278795Z Preparing to unpack .../137-node-fs-write-stream-atomic_1.0.10-4_all.deb ... 2024-12-18T00:01:35.6304808Z Unpacking node-fs-write-stream-atomic (1.0.10-4) ... 2024-12-18T00:01:35.6538893Z Selecting previously unselected package node-copy-concurrently. 2024-12-18T00:01:35.6577096Z Preparing to unpack .../138-node-copy-concurrently_1.0.5-7_all.deb ... 2024-12-18T00:01:35.6602194Z Unpacking node-copy-concurrently (1.0.5-7) ... 2024-12-18T00:01:35.6873377Z Selecting previously unselected package node-move-concurrently. 2024-12-18T00:01:35.6904655Z Preparing to unpack .../139-node-move-concurrently_1.0.1-2_all.deb ... 2024-12-18T00:01:35.6937313Z Unpacking node-move-concurrently (1.0.1-2) ... 2024-12-18T00:01:35.7174643Z Selecting previously unselected package node-escape-string-regexp. 2024-12-18T00:01:35.7209743Z Preparing to unpack .../140-node-escape-string-regexp_4.0.0-1_all.deb ... 2024-12-18T00:01:35.7239420Z Unpacking node-escape-string-regexp (4.0.0-1) ... 2024-12-18T00:01:35.7490121Z Selecting previously unselected package node-indent-string. 2024-12-18T00:01:35.7526543Z Preparing to unpack .../141-node-indent-string_4.0.0-1_all.deb ... 2024-12-18T00:01:35.7551015Z Unpacking node-indent-string (4.0.0-1) ... 2024-12-18T00:01:35.7782719Z Selecting previously unselected package node-p-map. 2024-12-18T00:01:35.7820029Z Preparing to unpack .../142-node-p-map_4.0.0-1_all.deb ... 2024-12-18T00:01:35.7847740Z Unpacking node-p-map (4.0.0-1) ... 2024-12-18T00:01:35.8084686Z Selecting previously unselected package node-promise-inflight. 2024-12-18T00:01:35.8119845Z Preparing to unpack .../143-node-promise-inflight_1.0.1-1.1_all.deb ... 2024-12-18T00:01:35.8146868Z Unpacking node-promise-inflight (1.0.1-1.1) ... 2024-12-18T00:01:35.8387435Z Selecting previously unselected package node-ssri. 2024-12-18T00:01:35.8418843Z Preparing to unpack .../144-node-ssri_8.0.1-2_all.deb ... 2024-12-18T00:01:35.8448181Z Unpacking node-ssri (8.0.1-2) ... 2024-12-18T00:01:35.8693408Z Selecting previously unselected package node-unique-filename. 2024-12-18T00:01:35.8727863Z Preparing to unpack .../145-node-unique-filename_1.1.1+ds-1_all.deb ... 2024-12-18T00:01:35.8752537Z Unpacking node-unique-filename (1.1.1+ds-1) ... 2024-12-18T00:01:35.8988162Z Selecting previously unselected package node-cacache. 2024-12-18T00:01:35.9022114Z Preparing to unpack .../146-node-cacache_15.0.5+~cs13.9.21-1_all.deb ... 2024-12-18T00:01:35.9055688Z Unpacking node-cacache (15.0.5+~cs13.9.21-1) ... 2024-12-18T00:01:35.9341313Z Selecting previously unselected package node-caseless. 2024-12-18T00:01:35.9378706Z Preparing to unpack .../147-node-caseless_0.12.1-1_all.deb ... 2024-12-18T00:01:35.9406757Z Unpacking node-caseless (0.12.1-1) ... 2024-12-18T00:01:35.9648924Z Selecting previously unselected package node-has-flag. 2024-12-18T00:01:35.9686853Z Preparing to unpack .../148-node-has-flag_4.0.0-1_all.deb ... 2024-12-18T00:01:35.9707750Z Unpacking node-has-flag (4.0.0-1) ... 2024-12-18T00:01:35.9940634Z Selecting previously unselected package node-supports-color. 2024-12-18T00:01:35.9978342Z Preparing to unpack .../149-node-supports-color_8.1.0+~7.2.0-1_all.deb ... 2024-12-18T00:01:36.0006282Z Unpacking node-supports-color (8.1.0+~7.2.0-1) ... 2024-12-18T00:01:36.0248368Z Selecting previously unselected package node-chalk. 2024-12-18T00:01:36.0284571Z Preparing to unpack .../150-node-chalk_4.1.0-1_all.deb ... 2024-12-18T00:01:36.0314852Z Unpacking node-chalk (4.1.0-1) ... 2024-12-18T00:01:36.0553142Z Selecting previously unselected package node-clone. 2024-12-18T00:01:36.0584965Z Preparing to unpack .../151-node-clone_2.1.2-2_all.deb ... 2024-12-18T00:01:36.0618643Z Unpacking node-clone (2.1.2-2) ... 2024-12-18T00:01:36.0850277Z Selecting previously unselected package node-colors. 2024-12-18T00:01:36.0886856Z Preparing to unpack .../152-node-colors_1.4.0-1_all.deb ... 2024-12-18T00:01:36.0915766Z Unpacking node-colors (1.4.0-1) ... 2024-12-18T00:01:36.1176093Z Selecting previously unselected package node-strip-ansi. 2024-12-18T00:01:36.1209881Z Preparing to unpack .../153-node-strip-ansi_6.0.0-2_all.deb ... 2024-12-18T00:01:36.1234780Z Unpacking node-strip-ansi (6.0.0-2) ... 2024-12-18T00:01:36.1459886Z Selecting previously unselected package node-defaults. 2024-12-18T00:01:36.1497483Z Preparing to unpack .../154-node-defaults_1.0.3-2_all.deb ... 2024-12-18T00:01:36.1525014Z Unpacking node-defaults (1.0.3-2) ... 2024-12-18T00:01:36.1753361Z Selecting previously unselected package node-wcwidth.js. 2024-12-18T00:01:36.1785163Z Preparing to unpack .../155-node-wcwidth.js_1.0.0-1.1_all.deb ... 2024-12-18T00:01:36.1814445Z Unpacking node-wcwidth.js (1.0.0-1.1) ... 2024-12-18T00:01:36.2051520Z Selecting previously unselected package node-columnify. 2024-12-18T00:01:36.2086392Z Preparing to unpack .../156-node-columnify_1.5.4-3_all.deb ... 2024-12-18T00:01:36.2115885Z Unpacking node-columnify (1.5.4-3) ... 2024-12-18T00:01:36.2351217Z Selecting previously unselected package node-delayed-stream. 2024-12-18T00:01:36.2383586Z Preparing to unpack .../157-node-delayed-stream_1.0.0-4_all.deb ... 2024-12-18T00:01:36.2414678Z Unpacking node-delayed-stream (1.0.0-4) ... 2024-12-18T00:01:36.2651362Z Selecting previously unselected package node-combined-stream. 2024-12-18T00:01:36.2688731Z Preparing to unpack .../158-node-combined-stream_1.0.8-1_all.deb ... 2024-12-18T00:01:36.2716759Z Unpacking node-combined-stream (1.0.8-1) ... 2024-12-18T00:01:36.2973589Z Selecting previously unselected package node-concat-map. 2024-12-18T00:01:36.3007285Z Preparing to unpack .../159-node-concat-map_0.0.1-2_all.deb ... 2024-12-18T00:01:36.3034481Z Unpacking node-concat-map (0.0.1-2) ... 2024-12-18T00:01:36.3276675Z Selecting previously unselected package node-console-control-strings. 2024-12-18T00:01:36.3306764Z Preparing to unpack .../160-node-console-control-strings_1.1.0-2_all.deb ... 2024-12-18T00:01:36.3338012Z Unpacking node-console-control-strings (1.1.0-2) ... 2024-12-18T00:01:36.3574761Z Selecting previously unselected package node-dashdash. 2024-12-18T00:01:36.3608970Z Preparing to unpack .../161-node-dashdash_2.0.0-1_all.deb ... 2024-12-18T00:01:36.3637741Z Unpacking node-dashdash (2.0.0-1) ... 2024-12-18T00:01:36.3886690Z Selecting previously unselected package node-depd. 2024-12-18T00:01:36.3921579Z Preparing to unpack .../162-node-depd_2.0.0-1_all.deb ... 2024-12-18T00:01:36.3945252Z Unpacking node-depd (2.0.0-1) ... 2024-12-18T00:01:36.4184513Z Selecting previously unselected package node-jsbn. 2024-12-18T00:01:36.4219351Z Preparing to unpack .../163-node-jsbn_1.1.0-1.1_all.deb ... 2024-12-18T00:01:36.4267785Z Unpacking node-jsbn (1.1.0-1.1) ... 2024-12-18T00:01:36.4526025Z Selecting previously unselected package node-ecc-jsbn. 2024-12-18T00:01:36.4555426Z Preparing to unpack .../164-node-ecc-jsbn_0.2.0-2_all.deb ... 2024-12-18T00:01:36.4586016Z Unpacking node-ecc-jsbn (0.2.0-2) ... 2024-12-18T00:01:36.4818939Z Selecting previously unselected package node-iconv-lite. 2024-12-18T00:01:36.4853300Z Preparing to unpack .../165-node-iconv-lite_0.5.1-3_all.deb ... 2024-12-18T00:01:36.4896975Z Unpacking node-iconv-lite (0.5.1-3) ... 2024-12-18T00:01:36.5375415Z Selecting previously unselected package node-encoding. 2024-12-18T00:01:36.5411131Z Preparing to unpack .../166-node-encoding_0.1.13-1_all.deb ... 2024-12-18T00:01:36.5437823Z Unpacking node-encoding (0.1.13-1) ... 2024-12-18T00:01:36.5676627Z Selecting previously unselected package node-err-code. 2024-12-18T00:01:36.5708002Z Preparing to unpack .../167-node-err-code_2.0.3+dfsg-1_all.deb ... 2024-12-18T00:01:36.5737379Z Unpacking node-err-code (2.0.3+dfsg-1) ... 2024-12-18T00:01:36.5973945Z Selecting previously unselected package node-extend. 2024-12-18T00:01:36.6008334Z Preparing to unpack .../168-node-extend_3.0.2-1_all.deb ... 2024-12-18T00:01:36.6036269Z Unpacking node-extend (3.0.2-1) ... 2024-12-18T00:01:36.6262667Z Selecting previously unselected package node-extsprintf. 2024-12-18T00:01:36.6298980Z Preparing to unpack .../169-node-extsprintf_1.4.0-1_all.deb ... 2024-12-18T00:01:36.6327695Z Unpacking node-extsprintf (1.4.0-1) ... 2024-12-18T00:01:36.6573951Z Selecting previously unselected package node-forever-agent. 2024-12-18T00:01:36.6608061Z Preparing to unpack .../170-node-forever-agent_0.6.1-2_all.deb ... 2024-12-18T00:01:36.6629867Z Unpacking node-forever-agent (0.6.1-2) ... 2024-12-18T00:01:36.6902487Z Selecting previously unselected package node-mime. 2024-12-18T00:01:36.6938626Z Preparing to unpack .../171-node-mime_2.5.0+dfsg+~cs3.90.0-1_all.deb ... 2024-12-18T00:01:36.7013124Z Unpacking node-mime (2.5.0+dfsg+~cs3.90.0-1) ... 2024-12-18T00:01:36.7259464Z Selecting previously unselected package node-mime-types. 2024-12-18T00:01:36.7297553Z Preparing to unpack .../172-node-mime-types_2.1.28-1_all.deb ... 2024-12-18T00:01:36.7325360Z Unpacking node-mime-types (2.1.28-1) ... 2024-12-18T00:01:36.7566655Z Selecting previously unselected package node-form-data. 2024-12-18T00:01:36.7601656Z Preparing to unpack .../173-node-form-data_3.0.0-2_all.deb ... 2024-12-18T00:01:36.7622273Z Unpacking node-form-data (3.0.0-2) ... 2024-12-18T00:01:36.7861928Z Selecting previously unselected package node-function-bind. 2024-12-18T00:01:36.7898120Z Preparing to unpack .../174-node-function-bind_1.1.1+repack-1_all.deb ... 2024-12-18T00:01:36.7927413Z Unpacking node-function-bind (1.1.1+repack-1) ... 2024-12-18T00:01:36.8149918Z Selecting previously unselected package node-string-width. 2024-12-18T00:01:36.8183036Z Preparing to unpack .../175-node-string-width_4.2.0-1_all.deb ... 2024-12-18T00:01:36.8215877Z Unpacking node-string-width (4.2.0-1) ... 2024-12-18T00:01:36.8446907Z Selecting previously unselected package node-object-assign. 2024-12-18T00:01:36.8482657Z Preparing to unpack .../176-node-object-assign_4.1.1-3_all.deb ... 2024-12-18T00:01:36.8504684Z Unpacking node-object-assign (4.1.1-3) ... 2024-12-18T00:01:36.8728122Z Selecting previously unselected package node-has-unicode. 2024-12-18T00:01:36.8763456Z Preparing to unpack .../177-node-has-unicode_2.0.1-2_all.deb ... 2024-12-18T00:01:36.8787456Z Unpacking node-has-unicode (2.0.1-2) ... 2024-12-18T00:01:36.9020061Z Selecting previously unselected package node-wide-align. 2024-12-18T00:01:36.9054294Z Preparing to unpack .../178-node-wide-align_1.1.3-1_all.deb ... 2024-12-18T00:01:36.9084898Z Unpacking node-wide-align (1.1.3-1) ... 2024-12-18T00:01:36.9322976Z Selecting previously unselected package node-signal-exit. 2024-12-18T00:01:36.9358292Z Preparing to unpack .../179-node-signal-exit_3.0.3-1_all.deb ... 2024-12-18T00:01:36.9384952Z Unpacking node-signal-exit (3.0.3-1) ... 2024-12-18T00:01:36.9709951Z Selecting previously unselected package node-gauge. 2024-12-18T00:01:36.9743020Z Preparing to unpack .../180-node-gauge_2.7.4-1.1_all.deb ... 2024-12-18T00:01:36.9775209Z Unpacking node-gauge (2.7.4-1.1) ... 2024-12-18T00:01:37.0028487Z Selecting previously unselected package node-getpass. 2024-12-18T00:01:37.0063672Z Preparing to unpack .../181-node-getpass_0.1.7-1.1_all.deb ... 2024-12-18T00:01:37.0095117Z Unpacking node-getpass (0.1.7-1.1) ... 2024-12-18T00:01:37.0320741Z Selecting previously unselected package node-nopt. 2024-12-18T00:01:37.0351894Z Preparing to unpack .../182-node-nopt_5.0.0-1_all.deb ... 2024-12-18T00:01:37.0384221Z Unpacking node-nopt (5.0.0-1) ... 2024-12-18T00:01:37.0619931Z Selecting previously unselected package node-set-blocking. 2024-12-18T00:01:37.0655352Z Preparing to unpack .../183-node-set-blocking_2.0.0-1.1_all.deb ... 2024-12-18T00:01:37.0693064Z Unpacking node-set-blocking (2.0.0-1.1) ... 2024-12-18T00:01:37.0926608Z Selecting previously unselected package node-npmlog. 2024-12-18T00:01:37.0959602Z Preparing to unpack .../184-node-npmlog_4.1.2-2_all.deb ... 2024-12-18T00:01:37.0985959Z Unpacking node-npmlog (4.1.2-2) ... 2024-12-18T00:01:37.1228485Z Selecting previously unselected package node-osenv. 2024-12-18T00:01:37.1263171Z Preparing to unpack .../185-node-osenv_0.1.5-1_all.deb ... 2024-12-18T00:01:37.1292565Z Unpacking node-osenv (0.1.5-1) ... 2024-12-18T00:01:37.1525957Z Selecting previously unselected package node-tar. 2024-12-18T00:01:37.1557298Z Preparing to unpack .../186-node-tar_6.0.5+ds1+~cs11.3.9-1+deb11u2_all.deb ... 2024-12-18T00:01:37.1586875Z Unpacking node-tar (6.0.5+ds1+~cs11.3.9-1+deb11u2) ... 2024-12-18T00:01:37.1861708Z Selecting previously unselected package node-isexe. 2024-12-18T00:01:37.1898460Z Preparing to unpack .../187-node-isexe_2.0.0-5_all.deb ... 2024-12-18T00:01:37.1925008Z Unpacking node-isexe (2.0.0-5) ... 2024-12-18T00:01:37.2139702Z Selecting previously unselected package node-which. 2024-12-18T00:01:37.2178051Z Preparing to unpack .../188-node-which_2.0.2+~cs1.3.2-1_all.deb ... 2024-12-18T00:01:37.2204910Z Unpacking node-which (2.0.2+~cs1.3.2-1) ... 2024-12-18T00:01:37.2444554Z Selecting previously unselected package node-gyp. 2024-12-18T00:01:37.2479222Z Preparing to unpack .../189-node-gyp_7.1.2-4_all.deb ... 2024-12-18T00:01:37.2500572Z Unpacking node-gyp (7.1.2-4) ... 2024-12-18T00:01:37.2765885Z Selecting previously unselected package node-har-schema. 2024-12-18T00:01:37.2799599Z Preparing to unpack .../190-node-har-schema_2.0.0-4_all.deb ... 2024-12-18T00:01:37.2820444Z Unpacking node-har-schema (2.0.0-4) ... 2024-12-18T00:01:37.3068796Z Selecting previously unselected package node-har-validator. 2024-12-18T00:01:37.3103126Z Preparing to unpack .../191-node-har-validator_5.1.5-1_all.deb ... 2024-12-18T00:01:37.3134852Z Unpacking node-har-validator (5.1.5-1) ... 2024-12-18T00:01:37.3375206Z Selecting previously unselected package node-hosted-git-info. 2024-12-18T00:01:37.3408840Z Preparing to unpack .../192-node-hosted-git-info_3.0.8-1_all.deb ... 2024-12-18T00:01:37.3436182Z Unpacking node-hosted-git-info (3.0.8-1) ... 2024-12-18T00:01:37.3684844Z Selecting previously unselected package node-json-schema. 2024-12-18T00:01:37.3718906Z Preparing to unpack .../193-node-json-schema_0.3.0+~7.0.6-1+deb11u1_all.deb ... 2024-12-18T00:01:37.3746660Z Unpacking node-json-schema (0.3.0+~7.0.6-1+deb11u1) ... 2024-12-18T00:01:37.4003755Z Selecting previously unselected package node-verror. 2024-12-18T00:01:37.4037919Z Preparing to unpack .../194-node-verror_1.10.0-1.1_all.deb ... 2024-12-18T00:01:37.4061169Z Unpacking node-verror (1.10.0-1.1) ... 2024-12-18T00:01:37.4286187Z Selecting previously unselected package node-jsprim. 2024-12-18T00:01:37.4321194Z Preparing to unpack .../195-node-jsprim_2.0.0-1_all.deb ... 2024-12-18T00:01:37.4347144Z Unpacking node-jsprim (2.0.0-1) ... 2024-12-18T00:01:37.4580311Z Selecting previously unselected package node-sshpk. 2024-12-18T00:01:37.4617969Z Preparing to unpack .../196-node-sshpk_1.16.1+dfsg-2_all.deb ... 2024-12-18T00:01:37.4644563Z Unpacking node-sshpk (1.16.1+dfsg-2) ... 2024-12-18T00:01:37.4936869Z Selecting previously unselected package node-http-signature. 2024-12-18T00:01:37.4972204Z Preparing to unpack .../197-node-http-signature_1.3.5-1_all.deb ... 2024-12-18T00:01:37.5008817Z Unpacking node-http-signature (1.3.5-1) ... 2024-12-18T00:01:37.5300981Z Selecting previously unselected package node-https-proxy-agent. 2024-12-18T00:01:37.5338790Z Preparing to unpack .../198-node-https-proxy-agent_5.0.0-3_all.deb ... 2024-12-18T00:01:37.5378695Z Unpacking node-https-proxy-agent (5.0.0-3) ... 2024-12-18T00:01:37.5742053Z Selecting previously unselected package node-ini. 2024-12-18T00:01:37.5778933Z Preparing to unpack .../199-node-ini_2.0.0-1_all.deb ... 2024-12-18T00:01:37.5851044Z Unpacking node-ini (2.0.0-1) ... 2024-12-18T00:01:37.6859392Z Selecting previously unselected package node-ip. 2024-12-18T00:01:37.6899329Z Preparing to unpack .../200-node-ip_1.1.5-5_all.deb ... 2024-12-18T00:01:37.7018372Z Unpacking node-ip (1.1.5-5) ... 2024-12-18T00:01:37.7406542Z Selecting previously unselected package node-ip-regex. 2024-12-18T00:01:37.7446473Z Preparing to unpack .../201-node-ip-regex_4.3.0-1_all.deb ... 2024-12-18T00:01:37.7473686Z Unpacking node-ip-regex (4.3.0-1) ... 2024-12-18T00:01:37.7707950Z Selecting previously unselected package node-is-typedarray. 2024-12-18T00:01:37.7745115Z Preparing to unpack .../202-node-is-typedarray_1.0.0-3_all.deb ... 2024-12-18T00:01:37.7774558Z Unpacking node-is-typedarray (1.0.0-3) ... 2024-12-18T00:01:37.8014040Z Selecting previously unselected package node-isstream. 2024-12-18T00:01:37.8047834Z Preparing to unpack .../203-node-isstream_0.1.2+dfsg-1.1_all.deb ... 2024-12-18T00:01:37.8077286Z Unpacking node-isstream (0.1.2+dfsg-1.1) ... 2024-12-18T00:01:37.8298886Z Selecting previously unselected package node-json-parse-better-errors. 2024-12-18T00:01:37.8337180Z Preparing to unpack .../204-node-json-parse-better-errors_1.0.2+~2.3.1-1_all.deb ... 2024-12-18T00:01:37.8368169Z Unpacking node-json-parse-better-errors (1.0.2+~2.3.1-1) ... 2024-12-18T00:01:37.8614761Z Selecting previously unselected package node-json-stringify-safe. 2024-12-18T00:01:37.8646496Z Preparing to unpack .../205-node-json-stringify-safe_5.0.1+repack-3_all.deb ... 2024-12-18T00:01:37.8679509Z Unpacking node-json-stringify-safe (5.0.1+repack-3) ... 2024-12-18T00:01:37.8933115Z Selecting previously unselected package node-jsonparse. 2024-12-18T00:01:37.8969107Z Preparing to unpack .../206-node-jsonparse_1.3.1-7_all.deb ... 2024-12-18T00:01:37.8994679Z Unpacking node-jsonparse (1.3.1-7) ... 2024-12-18T00:01:37.9217972Z Selecting previously unselected package node-through. 2024-12-18T00:01:37.9249597Z Preparing to unpack .../207-node-through_2.3.8+~cs0.0.30-1_all.deb ... 2024-12-18T00:01:37.9281992Z Unpacking node-through (2.3.8+~cs0.0.30-1) ... 2024-12-18T00:01:37.9522755Z Selecting previously unselected package node-jsonstream. 2024-12-18T00:01:37.9555752Z Preparing to unpack .../208-node-jsonstream_1.3.5-1_all.deb ... 2024-12-18T00:01:37.9585264Z Unpacking node-jsonstream (1.3.5-1) ... 2024-12-18T00:01:37.9819076Z Selecting previously unselected package node-leven. 2024-12-18T00:01:37.9854190Z Preparing to unpack .../209-node-leven_3.1.0+~cs1.1.1-1_all.deb ... 2024-12-18T00:01:37.9885030Z Unpacking node-leven (3.1.0+~cs1.1.1-1) ... 2024-12-18T00:01:38.0122152Z Selecting previously unselected package node-lockfile. 2024-12-18T00:01:38.0154292Z Preparing to unpack .../210-node-lockfile_1.0.4-3_all.deb ... 2024-12-18T00:01:38.0183740Z Unpacking node-lockfile (1.0.4-3) ... 2024-12-18T00:01:38.0419563Z Selecting previously unselected package node-mute-stream. 2024-12-18T00:01:38.0453872Z Preparing to unpack .../211-node-mute-stream_0.0.8-2_all.deb ... 2024-12-18T00:01:38.0483650Z Unpacking node-mute-stream (0.0.8-2) ... 2024-12-18T00:01:38.0709958Z Selecting previously unselected package node-resolve. 2024-12-18T00:01:38.0743187Z Preparing to unpack .../212-node-resolve_1.19.0+~cs5.20.8-2_all.deb ... 2024-12-18T00:01:38.0775473Z Unpacking node-resolve (1.19.0+~cs5.20.8-2) ... 2024-12-18T00:01:38.1030938Z Selecting previously unselected package node-spdx-license-ids. 2024-12-18T00:01:38.1064955Z Preparing to unpack .../213-node-spdx-license-ids_3.0.7-1_all.deb ... 2024-12-18T00:01:38.1094830Z Unpacking node-spdx-license-ids (3.0.7-1) ... 2024-12-18T00:01:38.1325748Z Selecting previously unselected package node-spdx-exceptions. 2024-12-18T00:01:38.1362567Z Preparing to unpack .../214-node-spdx-exceptions_2.3.0-1_all.deb ... 2024-12-18T00:01:38.1384190Z Unpacking node-spdx-exceptions (2.3.0-1) ... 2024-12-18T00:01:38.1619190Z Selecting previously unselected package node-spdx-expression-parse. 2024-12-18T00:01:38.1654025Z Preparing to unpack .../215-node-spdx-expression-parse_3.0.1-1_all.deb ... 2024-12-18T00:01:38.1689272Z Unpacking node-spdx-expression-parse (3.0.1-1) ... 2024-12-18T00:01:38.1925262Z Selecting previously unselected package node-spdx-correct. 2024-12-18T00:01:38.1957447Z Preparing to unpack .../216-node-spdx-correct_3.1.1-1_all.deb ... 2024-12-18T00:01:38.1987433Z Unpacking node-spdx-correct (3.1.1-1) ... 2024-12-18T00:01:38.2220297Z Selecting previously unselected package node-validate-npm-package-license. 2024-12-18T00:01:38.2254978Z Preparing to unpack .../217-node-validate-npm-package-license_3.0.4-1_all.deb ... 2024-12-18T00:01:38.2287233Z Unpacking node-validate-npm-package-license (3.0.4-1) ... 2024-12-18T00:01:38.2524568Z Selecting previously unselected package node-normalize-package-data. 2024-12-18T00:01:38.2554844Z Preparing to unpack .../218-node-normalize-package-data_3.0.0+~2.4.0-1_all.deb ... 2024-12-18T00:01:38.2583487Z Unpacking node-normalize-package-data (3.0.0+~2.4.0-1) ... 2024-12-18T00:01:38.2835485Z Selecting previously unselected package node-npm-bundled. 2024-12-18T00:01:38.2865938Z Preparing to unpack .../219-node-npm-bundled_1.1.1-1_all.deb ... 2024-12-18T00:01:38.2898042Z Unpacking node-npm-bundled (1.1.1-1) ... 2024-12-18T00:01:38.3133784Z Selecting previously unselected package node-validate-npm-package-name. 2024-12-18T00:01:38.3169513Z Preparing to unpack .../220-node-validate-npm-package-name_3.0.0-1.1_all.deb ... 2024-12-18T00:01:38.3198503Z Unpacking node-validate-npm-package-name (3.0.0-1.1) ... 2024-12-18T00:01:38.3428108Z Selecting previously unselected package node-npm-package-arg. 2024-12-18T00:01:38.3463257Z Preparing to unpack .../221-node-npm-package-arg_8.1.0-1_all.deb ... 2024-12-18T00:01:38.3491586Z Unpacking node-npm-package-arg (8.1.0-1) ... 2024-12-18T00:01:38.3733385Z Selecting previously unselected package node-number-is-nan. 2024-12-18T00:01:38.3769129Z Preparing to unpack .../222-node-number-is-nan_2.0.0-1_all.deb ... 2024-12-18T00:01:38.3795386Z Unpacking node-number-is-nan (2.0.0-1) ... 2024-12-18T00:01:38.4034924Z Selecting previously unselected package node-oauth-sign. 2024-12-18T00:01:38.4064860Z Preparing to unpack .../223-node-oauth-sign_0.9.0-2_all.deb ... 2024-12-18T00:01:38.4098078Z Unpacking node-oauth-sign (0.9.0-2) ... 2024-12-18T00:01:38.4348879Z Selecting previously unselected package xdg-utils. 2024-12-18T00:01:38.4383051Z Preparing to unpack .../224-xdg-utils_1.1.3-4.1_all.deb ... 2024-12-18T00:01:38.4416755Z Unpacking xdg-utils (1.1.3-4.1) ... 2024-12-18T00:01:38.4685905Z Selecting previously unselected package node-opener. 2024-12-18T00:01:38.4721720Z Preparing to unpack .../225-node-opener_1.5.2-1_all.deb ... 2024-12-18T00:01:38.4746793Z Unpacking node-opener (1.5.2-1) ... 2024-12-18T00:01:38.4983008Z Selecting previously unselected package node-performance-now. 2024-12-18T00:01:38.5018859Z Preparing to unpack .../226-node-performance-now_2.1.0+debian-1.1_all.deb ... 2024-12-18T00:01:38.5047501Z Unpacking node-performance-now (2.1.0+debian-1.1) ... 2024-12-18T00:01:38.5286106Z Selecting previously unselected package node-retry. 2024-12-18T00:01:38.5321508Z Preparing to unpack .../227-node-retry_0.12.0-1_all.deb ... 2024-12-18T00:01:38.5348092Z Unpacking node-retry (0.12.0-1) ... 2024-12-18T00:01:38.5594766Z Selecting previously unselected package node-promise-retry. 2024-12-18T00:01:38.5625226Z Preparing to unpack .../228-node-promise-retry_2.0.1-1_all.deb ... 2024-12-18T00:01:38.5649750Z Unpacking node-promise-retry (2.0.1-1) ... 2024-12-18T00:01:38.5891641Z Selecting previously unselected package node-read. 2024-12-18T00:01:38.5926939Z Preparing to unpack .../229-node-read_1.0.7-2_all.deb ... 2024-12-18T00:01:38.5952850Z Unpacking node-read (1.0.7-2) ... 2024-12-18T00:01:38.6203346Z Selecting previously unselected package node-promzard. 2024-12-18T00:01:38.6239189Z Preparing to unpack .../230-node-promzard_0.3.0-1.1_all.deb ... 2024-12-18T00:01:38.6262980Z Unpacking node-promzard (0.3.0-1.1) ... 2024-12-18T00:01:38.6501232Z Selecting previously unselected package node-psl. 2024-12-18T00:01:38.6538336Z Preparing to unpack .../231-node-psl_1.8.0+ds-4_all.deb ... 2024-12-18T00:01:38.6567043Z Unpacking node-psl (1.8.0+ds-4) ... 2024-12-18T00:01:38.6819620Z Selecting previously unselected package node-puka. 2024-12-18T00:01:38.6853798Z Preparing to unpack .../232-node-puka_1.0.1+dfsg-2_all.deb ... 2024-12-18T00:01:38.6884727Z Unpacking node-puka (1.0.1+dfsg-2) ... 2024-12-18T00:01:38.7150123Z Selecting previously unselected package node-qs. 2024-12-18T00:01:38.7183916Z Preparing to unpack .../233-node-qs_6.9.4+ds-1+deb11u1_all.deb ... 2024-12-18T00:01:38.7218258Z Unpacking node-qs (6.9.4+ds-1+deb11u1) ... 2024-12-18T00:01:38.7485358Z Selecting previously unselected package node-slash. 2024-12-18T00:01:38.7519837Z Preparing to unpack .../234-node-slash_3.0.0-1_all.deb ... 2024-12-18T00:01:38.7546453Z Unpacking node-slash (3.0.0-1) ... 2024-12-18T00:01:38.7781402Z Selecting previously unselected package node-read-package-json. 2024-12-18T00:01:38.7818133Z Preparing to unpack .../235-node-read-package-json_3.0.0-1_all.deb ... 2024-12-18T00:01:38.7845797Z Unpacking node-read-package-json (3.0.0-1) ... 2024-12-18T00:01:38.8087093Z Selecting previously unselected package node-universalify. 2024-12-18T00:01:38.8122009Z Preparing to unpack .../236-node-universalify_2.0.0-2_all.deb ... 2024-12-18T00:01:38.8147000Z Unpacking node-universalify (2.0.0-2) ... 2024-12-18T00:01:38.8388552Z Selecting previously unselected package node-tough-cookie. 2024-12-18T00:01:38.8423327Z Preparing to unpack .../237-node-tough-cookie_4.0.0-2+deb11u1_all.deb ... 2024-12-18T00:01:38.8451049Z Unpacking node-tough-cookie (4.0.0-2+deb11u1) ... 2024-12-18T00:01:38.8702732Z Selecting previously unselected package node-tunnel-agent. 2024-12-18T00:01:38.8738809Z Preparing to unpack .../238-node-tunnel-agent_0.6.1-2_all.deb ... 2024-12-18T00:01:38.8767258Z Unpacking node-tunnel-agent (0.6.1-2) ... 2024-12-18T00:01:38.8995114Z Selecting previously unselected package node-uuid. 2024-12-18T00:01:38.9025319Z Preparing to unpack .../239-node-uuid_8.3.2+~8.3.0-4_all.deb ... 2024-12-18T00:01:38.9058277Z Unpacking node-uuid (8.3.2+~8.3.0-4) ... 2024-12-18T00:01:38.9352561Z Selecting previously unselected package node-request. 2024-12-18T00:01:38.9385240Z Preparing to unpack .../240-node-request_2.88.1-5_all.deb ... 2024-12-18T00:01:38.9417688Z Unpacking node-request (2.88.1-5) ... 2024-12-18T00:01:38.9687653Z Selecting previously unselected package node-resolve-from. 2024-12-18T00:01:38.9722912Z Preparing to unpack .../241-node-resolve-from_5.0.0+~3.1.0+~3.3.0+~2.0.0-1_all.deb ... 2024-12-18T00:01:38.9746565Z Unpacking node-resolve-from (5.0.0+~3.1.0+~3.3.0+~2.0.0-1) ... 2024-12-18T00:01:39.0006125Z Selecting previously unselected package node-text-table. 2024-12-18T00:01:39.0041088Z Preparing to unpack .../242-node-text-table_0.2.0-2_all.deb ... 2024-12-18T00:01:39.0071754Z Unpacking node-text-table (0.2.0-2) ... 2024-12-18T00:01:39.0306914Z Selecting previously unselected package node-typedarray-to-buffer. 2024-12-18T00:01:39.0342036Z Preparing to unpack .../243-node-typedarray-to-buffer_4.0.0-1_all.deb ... 2024-12-18T00:01:39.0375418Z Unpacking node-typedarray-to-buffer (4.0.0-1) ... 2024-12-18T00:01:39.0615461Z Selecting previously unselected package node-write-file-atomic. 2024-12-18T00:01:39.0647212Z Preparing to unpack .../244-node-write-file-atomic_3.0.3+~3.0.1-1_all.deb ... 2024-12-18T00:01:39.0679086Z Unpacking node-write-file-atomic (3.0.3+~3.0.1-1) ... 2024-12-18T00:01:39.0915657Z Selecting previously unselected package nodejs-doc. 2024-12-18T00:01:39.0947361Z Preparing to unpack .../245-nodejs-doc_12.22.12~dfsg-1~deb11u5_all.deb ... 2024-12-18T00:01:39.0977621Z Unpacking nodejs-doc (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:39.2737404Z Selecting previously unselected package npm. 2024-12-18T00:01:39.2777707Z Preparing to unpack .../246-npm_7.5.2+ds-2_all.deb ... 2024-12-18T00:01:39.2915161Z Unpacking npm (7.5.2+ds-2) ... 2024-12-18T00:01:39.3980430Z Selecting previously unselected package termit. 2024-12-18T00:01:39.4022278Z Preparing to unpack .../247-termit_3.1-1_amd64.deb ... 2024-12-18T00:01:39.4050203Z Unpacking termit (3.1-1) ... 2024-12-18T00:01:39.4384132Z Selecting previously unselected package x11-xserver-utils. 2024-12-18T00:01:39.4422604Z Preparing to unpack .../248-x11-xserver-utils_7.7+8_amd64.deb ... 2024-12-18T00:01:39.4457046Z Unpacking x11-xserver-utils (7.7+8) ... 2024-12-18T00:01:39.5021715Z Setting up node-qs (6.9.4+ds-1+deb11u1) ... 2024-12-18T00:01:39.5118530Z Setting up libtext-iconv-perl (1.7-7+b1) ... 2024-12-18T00:01:39.5198320Z Setting up gtk-update-icon-cache (3.24.24-4+deb11u4) ... 2024-12-18T00:01:39.5275226Z Setting up node-extsprintf (1.4.0-1) ... 2024-12-18T00:01:39.5355864Z Setting up libproxy1v5:amd64 (0.4.17-1) ... 2024-12-18T00:01:39.5440704Z Setting up libtie-ixhash-perl (1.23-2.1) ... 2024-12-18T00:01:39.5519994Z Setting up libjs-inherits (2.0.4-1) ... 2024-12-18T00:01:39.5594292Z Setting up libfont-afm-perl (1.20-3) ... 2024-12-18T00:01:39.5667391Z Setting up libvte-2.91-common (0.62.3-1) ... 2024-12-18T00:01:39.5804935Z Setting up libclone-perl (0.45-1+b1) ... 2024-12-18T00:01:39.5871929Z Setting up libhtml-tagset-perl (3.20-4) ... 2024-12-18T00:01:39.5954950Z Setting up libauthen-sasl-perl (2.1600-1.1) ... 2024-12-18T00:01:39.6027445Z Setting up libxcursor1:amd64 (1:1.2.0-2) ... 2024-12-18T00:01:39.6106541Z Setting up liblwp-mediatypes-perl (6.04-1) ... 2024-12-18T00:01:39.6188063Z Setting up node-through (2.3.8+~cs0.0.30-1) ... 2024-12-18T00:01:39.6266969Z Setting up libtry-tiny-perl (0.30-1) ... 2024-12-18T00:01:39.6346721Z Setting up perl-openssl-defaults:amd64 (5) ... 2024-12-18T00:01:39.6434089Z Setting up node-color-name (1.1.4+~1.1.1-1) ... 2024-12-18T00:01:39.6528268Z Setting up libencode-locale-perl (1.05-1.1) ... 2024-12-18T00:01:39.6611274Z Setting up libc-ares2:amd64 (1.17.1-1+deb11u3) ... 2024-12-18T00:01:39.6694320Z Setting up node-uuid (8.3.2+~8.3.0-4) ... 2024-12-18T00:01:39.6770595Z Setting up x11-xserver-utils (7.7+8) ... 2024-12-18T00:01:39.6901222Z Setting up node-indent-string (4.0.0-1) ... 2024-12-18T00:01:39.6985073Z Setting up libcolord2:amd64 (1.4.5-3) ... 2024-12-18T00:01:39.7060471Z Setting up node-chownr (1.1.3-5) ... 2024-12-18T00:01:39.7138596Z Setting up libdconf1:amd64 (0.38.0-2) ... 2024-12-18T00:01:39.7219176Z Setting up libjs-psl (1.8.0+ds-4) ... 2024-12-18T00:01:39.7299031Z Setting up node-json-schema-traverse (1.0.0-2) ... 2024-12-18T00:01:39.7376624Z Setting up dbus-user-session (1.12.28-0+deb11u1) ... 2024-12-18T00:01:39.7478895Z Setting up node-universalify (2.0.0-2) ... 2024-12-18T00:01:39.7548503Z Setting up node-ini (2.0.0-1) ... 2024-12-18T00:01:39.7628764Z Setting up libuv1:amd64 (1.40.0-2+deb11u1) ... 2024-12-18T00:01:39.7709368Z Setting up node-json-parse-better-errors (1.0.2+~2.3.1-1) ... 2024-12-18T00:01:39.7787220Z Setting up node-fast-deep-equal (3.1.3-1) ... 2024-12-18T00:01:39.7865634Z Setting up node-err-code (2.0.3+dfsg-1) ... 2024-12-18T00:01:39.7940168Z Setting up adwaita-icon-theme (3.38.0-1) ... 2024-12-18T00:01:39.8519621Z update-alternatives: using /usr/share/icons/Adwaita/cursor.theme to provide /usr/share/icons/default/index.theme (x-cursor-theme) in auto mode 2024-12-18T00:01:39.8571135Z Setting up libdata-dump-perl (1.23-1.1) ... 2024-12-18T00:01:39.8662872Z Setting up node-resolve-from (5.0.0+~3.1.0+~3.3.0+~2.0.0-1) ... 2024-12-18T00:01:39.8750574Z Setting up libepoxy0:amd64 (1.5.5-1) ... 2024-12-18T00:01:39.8839291Z Setting up libipc-system-simple-perl (1.30-1) ... 2024-12-18T00:01:39.8920466Z Setting up libxml-xpathengine-perl (0.14-1) ... 2024-12-18T00:01:39.8991172Z Setting up libio-html-perl (1.004-2) ... 2024-12-18T00:01:39.9066661Z Setting up libtimedate-perl (2.3300-2) ... 2024-12-18T00:01:39.9146017Z Setting up libjs-typedarray-to-buffer (4.0.0-1) ... 2024-12-18T00:01:39.9226420Z Setting up libjs-highlight.js (9.18.5+dfsg1-1) ... 2024-12-18T00:01:39.9304038Z Setting up libwayland-cursor0:amd64 (1.18.0-2~exp1.1) ... 2024-12-18T00:01:39.9386630Z Setting up liblua5.3-0:amd64 (5.3.3-1.1+deb11u1) ... 2024-12-18T00:01:39.9465482Z Setting up libjson-glib-1.0-common (1.6.2-1) ... 2024-12-18T00:01:39.9542170Z Setting up node-json-schema (0.3.0+~7.0.6-1+deb11u1) ... 2024-12-18T00:01:39.9619630Z Setting up libwayland-egl1:amd64 (1.18.0-2~exp1.1) ... 2024-12-18T00:01:39.9699053Z Setting up glib-networking-common (2.66.0-2) ... 2024-12-18T00:01:39.9778586Z Setting up xdg-utils (1.1.3-4.1) ... 2024-12-18T00:01:39.9869890Z update-alternatives: using /usr/bin/xdg-open to provide /usr/bin/open (open) in auto mode 2024-12-18T00:01:39.9934056Z Setting up liburi-perl (5.08-1) ... 2024-12-18T00:01:40.0019284Z Setting up libx11-protocol-perl (0.56-7.1) ... 2024-12-18T00:01:40.0102143Z Setting up libjs-is-typedarray (1.0.0-3) ... 2024-12-18T00:01:40.0187535Z Setting up gyp (0.1+20200513gitcaa6002-2) ... 2024-12-18T00:01:40.2250776Z Setting up libnet-ssleay-perl (1.88-3+b1) ... 2024-12-18T00:01:40.2334347Z Setting up libuv1-dev:amd64 (1.40.0-2+deb11u1) ... 2024-12-18T00:01:40.2415263Z Setting up glib-networking-services (2.66.0-2) ... 2024-12-18T00:01:40.2493146Z Setting up libhttp-date-perl (6.05-1) ... 2024-12-18T00:01:40.2572323Z Setting up libfile-basedir-perl (0.08-1) ... 2024-12-18T00:01:40.2649025Z Setting up libfile-listing-perl (6.14-1) ... 2024-12-18T00:01:40.2737995Z Setting up libnet-http-perl (6.20-1) ... 2024-12-18T00:01:40.2835258Z Setting up dconf-service (0.38.0-2) ... 2024-12-18T00:01:40.2953925Z Setting up libnode72:amd64 (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:40.3091450Z Setting up libjson-glib-1.0-0:amd64 (1.6.2-1) ... 2024-12-18T00:01:40.3222459Z Setting up libfile-desktopentry-perl (0.22-2) ... 2024-12-18T00:01:40.3362705Z Setting up nodejs-doc (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:40.3496889Z Setting up node-is-typedarray (1.0.0-3) ... 2024-12-18T00:01:40.3635284Z Setting up libwww-robotrules-perl (6.02-1) ... 2024-12-18T00:01:40.3778137Z Setting up libhtml-parser-perl (3.75-1+b1) ... 2024-12-18T00:01:40.3922924Z Setting up libio-socket-ssl-perl (2.069-1) ... 2024-12-18T00:01:40.4068801Z Setting up libhttp-message-perl (6.28-1) ... 2024-12-18T00:01:40.4211024Z Setting up libhtml-form-perl (6.07-1) ... 2024-12-18T00:01:40.4349452Z Setting up libfile-mimeinfo-perl (0.30-1) ... 2024-12-18T00:01:40.4492632Z Setting up libhttp-negotiate-perl (6.01-1) ... 2024-12-18T00:01:40.4628659Z Setting up dconf-gsettings-backend:amd64 (0.38.0-2) ... 2024-12-18T00:01:40.4771419Z Setting up libnode-dev (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:40.4921042Z Setting up libhttp-cookies-perl (6.10-1) ... 2024-12-18T00:01:40.5073726Z Setting up libhtml-tree-perl (5.07-2) ... 2024-12-18T00:01:40.5219917Z Setting up libhtml-format-perl (2.12-1.1) ... 2024-12-18T00:01:40.5373037Z Setting up nodejs (12.22.12~dfsg-1~deb11u5) ... 2024-12-18T00:01:40.5532444Z update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 2024-12-18T00:01:40.5624563Z Setting up node-aws4 (1.11.0-1) ... 2024-12-18T00:01:40.5923163Z Setting up node-function-bind (1.1.1+repack-1) ... 2024-12-18T00:01:40.6049726Z Setting up node-clone (2.1.2-2) ... 2024-12-18T00:01:40.6179056Z Setting up node-iferr (1.0.2-1) ... 2024-12-18T00:01:40.6313084Z Setting up node-has-flag (4.0.0-1) ... 2024-12-18T00:01:40.6449747Z Setting up node-asap (2.0.6-2) ... 2024-12-18T00:01:40.6599626Z Setting up node-mime (2.5.0+dfsg+~cs3.90.0-1) ... 2024-12-18T00:01:40.6794558Z Setting up node-inherits (2.0.4-1) ... 2024-12-18T00:01:40.6939319Z Setting up node-path-is-absolute (2.0.0-1) ... 2024-12-18T00:01:40.7064584Z Setting up node-iconv-lite (0.5.1-3) ... 2024-12-18T00:01:40.7214392Z Setting up node-safe-buffer (5.2.1+~cs2.1.2-1) ... 2024-12-18T00:01:40.7353070Z Setting up node-promise-inflight (1.0.1-1.1) ... 2024-12-18T00:01:40.7496083Z Setting up node-json-stringify-safe (5.0.1+repack-3) ... 2024-12-18T00:01:40.7633346Z Setting up libnet-smtp-ssl-perl (1.04-1) ... 2024-12-18T00:01:40.7778580Z Setting up node-har-schema (2.0.0-4) ... 2024-12-18T00:01:40.7923910Z Setting up node-mime-types (2.1.28-1) ... 2024-12-18T00:01:40.8061454Z Setting up node-performance-now (2.1.0+debian-1.1) ... 2024-12-18T00:01:40.8213711Z Setting up libmailtools-perl (2.21-1) ... 2024-12-18T00:01:40.8347442Z Setting up node-balanced-match (1.0.0-1) ... 2024-12-18T00:01:40.8481109Z Setting up node-ansi (0.3.1-1) ... 2024-12-18T00:01:40.8625739Z Setting up node-brace-expansion (2.0.0-1) ... 2024-12-18T00:01:40.8756909Z Setting up node-spdx-exceptions (2.3.0-1) ... 2024-12-18T00:01:40.8900223Z Setting up node-set-blocking (2.0.0-1.1) ... 2024-12-18T00:01:40.9033516Z Setting up node-tunnel-agent (0.6.1-2) ... 2024-12-18T00:01:40.9169889Z Setting up node-npm-bundled (1.1.1-1) ... 2024-12-18T00:01:40.9323038Z Setting up node-signal-exit (3.0.3-1) ... 2024-12-18T00:01:40.9398277Z Setting up node-wrappy (1.0.2-1.1) ... 2024-12-18T00:01:40.9477081Z Setting up node-typedarray-to-buffer (4.0.0-1) ... 2024-12-18T00:01:40.9558148Z Setting up node-text-table (0.2.0-2) ... 2024-12-18T00:01:40.9648838Z Setting up node-asynckit (0.4.0-3) ... 2024-12-18T00:01:40.9740599Z Setting up node-ip (1.1.5-5) ... 2024-12-18T00:01:40.9844752Z Setting up node-punycode (2.1.1-3) ... 2024-12-18T00:01:40.9955185Z Setting up node-defaults (1.0.3-2) ... 2024-12-18T00:01:41.0079791Z Setting up node-mute-stream (0.0.8-2) ... 2024-12-18T00:01:41.0213152Z Setting up node-number-is-nan (2.0.0-1) ... 2024-12-18T00:01:41.0341463Z Setting up libhttp-daemon-perl (6.12-1+deb11u1) ... 2024-12-18T00:01:41.0480227Z Setting up node-graceful-fs (4.2.4+repack-1) ... 2024-12-18T00:01:41.0619861Z Setting up node-jsonify (0.0.0-1.1) ... 2024-12-18T00:01:41.0768842Z Setting up node-json-stable-stringify (1.0.1+~cs5.1.32-1) ... 2024-12-18T00:01:41.0905329Z Setting up node-aproba (2.0.0-1) ... 2024-12-18T00:01:41.1044062Z Setting up node-ip-regex (4.3.0-1) ... 2024-12-18T00:01:41.1195434Z Setting up node-spdx-license-ids (3.0.7-1) ... 2024-12-18T00:01:41.1324997Z Setting up node-string-decoder (1.3.0-2) ... 2024-12-18T00:01:41.1453723Z Setting up node-mkdirp (1.0.4+~1.0.1-1) ... 2024-12-18T00:01:41.1601338Z Setting up node-run-queue (2.0.0-1) ... 2024-12-18T00:01:41.1764255Z Setting up node-core-util-is (1.0.2-2) ... 2024-12-18T00:01:41.1899648Z Setting up node-uri-js (4.4.0+dfsg-5) ... 2024-12-18T00:01:41.2047890Z Setting up node-minimatch (3.0.4+~3.0.3-1+deb11u2) ... 2024-12-18T00:01:41.2173908Z Setting up node-opener (1.5.2-1) ... 2024-12-18T00:01:41.2299941Z Setting up node-archy (1.0.0-3) ... 2024-12-18T00:01:41.2448568Z Setting up node-caseless (0.12.1-1) ... 2024-12-18T00:01:41.2588800Z Setting up node-imurmurhash (0.1.4-1.1) ... 2024-12-18T00:01:41.2730696Z Setting up node-encoding (0.1.13-1) ... 2024-12-18T00:01:41.2860302Z Setting up node-read (1.0.7-2) ... 2024-12-18T00:01:41.3012727Z Setting up node-asn1 (0.2.3-2) ... 2024-12-18T00:01:41.3147438Z Setting up node-color-convert (1.9.3-1) ... 2024-12-18T00:01:41.3295886Z Setting up libgtk-3-common (3.24.24-4+deb11u4) ... 2024-12-18T00:01:41.3478069Z Setting up node-isarray (2.0.5-1) ... 2024-12-18T00:01:41.3619668Z Setting up node-osenv (0.1.5-1) ... 2024-12-18T00:01:41.3778966Z Setting up node-ms (2.1.3+~cs0.7.31-1) ... 2024-12-18T00:01:41.3919515Z Setting up node-process-nextick-args (2.0.0-1) ... 2024-12-18T00:01:41.4058541Z Setting up node-has-unicode (2.0.1-2) ... 2024-12-18T00:01:41.4204158Z Setting up node-fs-write-stream-atomic (1.0.10-4) ... 2024-12-18T00:01:41.4348698Z Setting up node-forever-agent (0.6.1-2) ... 2024-12-18T00:01:41.4488148Z Setting up node-delayed-stream (1.0.0-4) ... 2024-12-18T00:01:41.4631910Z Setting up node-isstream (0.1.2+dfsg-1.1) ... 2024-12-18T00:01:41.4771654Z Setting up node-builtins (1.0.3-2) ... 2024-12-18T00:01:41.4917776Z Setting up gsettings-desktop-schemas (3.38.0-2) ... 2024-12-18T00:01:41.5052988Z Setting up node-colors (1.4.0-1) ... 2024-12-18T00:01:41.5199811Z Setting up node-fs.realpath (1.0.0-1.1) ... 2024-12-18T00:01:41.5340062Z Setting up node-oauth-sign (0.9.0-2) ... 2024-12-18T00:01:41.5491171Z Setting up node-jsbn (1.1.0-1.1) ... 2024-12-18T00:01:41.5619733Z Setting up node-object-assign (4.1.1-3) ... 2024-12-18T00:01:41.5768474Z Setting up node-leven (3.1.0+~cs1.1.1-1) ... 2024-12-18T00:01:41.5917364Z Setting up node-abbrev (1.1.1-2) ... 2024-12-18T00:01:41.6060635Z Setting up node-puka (1.0.1+dfsg-2) ... 2024-12-18T00:01:41.6215223Z Setting up node-supports-color (8.1.0+~7.2.0-1) ... 2024-12-18T00:01:41.6364310Z Setting up node-yallist (4.0.0-1) ... 2024-12-18T00:01:41.6516260Z Setting up node-ansi-regex (5.0.1-1~deb11u1) ... 2024-12-18T00:01:41.6650121Z Setting up node-once (1.4.0-3) ... 2024-12-18T00:01:41.6801318Z Setting up node-write-file-atomic (3.0.3+~3.0.1-1) ... 2024-12-18T00:01:41.6952394Z Setting up node-psl (1.8.0+ds-4) ... 2024-12-18T00:01:41.7100747Z Setting up node-slash (3.0.0-1) ... 2024-12-18T00:01:41.7258295Z Setting up node-util-deprecate (1.0.2-1) ... 2024-12-18T00:01:41.7559731Z Setting up node-retry (0.12.0-1) ... 2024-12-18T00:01:41.7681813Z Setting up node-concat-map (0.0.1-2) ... 2024-12-18T00:01:41.7819287Z Setting up node-assert-plus (1.0.0-2) ... 2024-12-18T00:01:41.7950870Z Setting up node-ansistyles (0.1.3-2) ... 2024-12-18T00:01:41.8093094Z Setting up node-delegates (1.0.0-2) ... 2024-12-18T00:01:41.8238469Z Setting up node-depd (2.0.0-1) ... 2024-12-18T00:01:41.8376906Z Setting up node-isexe (2.0.0-5) ... 2024-12-18T00:01:41.8520937Z Setting up node-resolve (1.19.0+~cs5.20.8-2) ... 2024-12-18T00:01:41.8657102Z Setting up node-jsonparse (1.3.1-7) ... 2024-12-18T00:01:41.8795405Z Setting up node-ajv (6.12.6-2) ... 2024-12-18T00:01:41.8929401Z Setting up node-tweetnacl (1.0.3+dfsg-1) ... 2024-12-18T00:01:41.9079460Z Setting up node-escape-string-regexp (4.0.0-1) ... 2024-12-18T00:01:41.9226557Z Setting up node-aws-sign2 (0.7.1-2) ... 2024-12-18T00:01:41.9369259Z Setting up node-console-control-strings (1.1.0-2) ... 2024-12-18T00:01:41.9507440Z Setting up node-debug (4.3.1+~cs4.1.5-1) ... 2024-12-18T00:01:41.9648413Z Setting up node-extend (3.0.2-1) ... 2024-12-18T00:01:41.9799959Z Setting up node-jsonstream (1.3.5-1) ... 2024-12-18T00:01:41.9938197Z Setting up node-dashdash (2.0.0-1) ... 2024-12-18T00:01:42.0080629Z Setting up node-p-map (4.0.0-1) ... 2024-12-18T00:01:42.0223293Z Setting up node-validate-npm-package-name (3.0.0-1.1) ... 2024-12-18T00:01:42.0370909Z Setting up node-promzard (0.3.0-1.1) ... 2024-12-18T00:01:42.0518529Z Setting up node-wcwidth.js (1.0.0-1.1) ... 2024-12-18T00:01:42.0649215Z Setting up node-ecc-jsbn (0.2.0-2) ... 2024-12-18T00:01:42.0791366Z Setting up node-combined-stream (1.0.8-1) ... 2024-12-18T00:01:42.0939036Z Setting up node-unique-filename (1.1.1+ds-1) ... 2024-12-18T00:01:42.1062329Z Setting up node-ansi-styles (4.2.1-1) ... 2024-12-18T00:01:42.1219748Z Setting up node-form-data (3.0.0-2) ... 2024-12-18T00:01:42.1358385Z Setting up node-strip-ansi (6.0.0-2) ... 2024-12-18T00:01:42.1518399Z Setting up node-lockfile (1.0.4-3) ... 2024-12-18T00:01:42.1642662Z Setting up node-chalk (4.1.0-1) ... 2024-12-18T00:01:42.1779122Z Setting up node-spdx-expression-parse (3.0.1-1) ... 2024-12-18T00:01:42.1921806Z Setting up node-which (2.0.2+~cs1.3.2-1) ... 2024-12-18T00:01:42.2050848Z Setting up node-tar (6.0.5+ds1+~cs11.3.9-1+deb11u2) ... 2024-12-18T00:01:42.2193464Z Setting up node-inflight (1.0.6-1.1) ... 2024-12-18T00:01:42.2339464Z Setting up node-tough-cookie (4.0.0-2+deb11u1) ... 2024-12-18T00:01:42.2480910Z Setting up node-verror (1.10.0-1.1) ... 2024-12-18T00:01:42.2630040Z Setting up node-getpass (0.1.7-1.1) ... 2024-12-18T00:01:42.2768280Z Setting up node-nopt (5.0.0-1) ... 2024-12-18T00:01:42.2908216Z Setting up node-string-width (4.2.0-1) ... 2024-12-18T00:01:42.3044819Z Setting up node-har-validator (5.1.5-1) ... 2024-12-18T00:01:42.3193277Z Setting up node-readable-stream (3.6.0-2) ... 2024-12-18T00:01:42.3323661Z Setting up node-ssri (8.0.1-2) ... 2024-12-18T00:01:42.3466337Z Setting up node-lru-cache (5.1.1-5) ... 2024-12-18T00:01:42.3602940Z Setting up node-bcrypt-pbkdf (1.0.2-1) ... 2024-12-18T00:01:42.3748404Z Setting up node-promise-retry (2.0.1-1) ... 2024-12-18T00:01:42.3886934Z Setting up node-columnify (1.5.4-3) ... 2024-12-18T00:01:42.4019320Z Setting up node-jsprim (2.0.0-1) ... 2024-12-18T00:01:42.4166975Z Setting up node-are-we-there-yet (1.1.5-1) ... 2024-12-18T00:01:42.4299894Z Setting up node-spdx-correct (3.1.1-1) ... 2024-12-18T00:01:42.4427464Z Setting up node-glob (7.1.6+~7.1.3-1) ... 2024-12-18T00:01:42.4578823Z Setting up node-hosted-git-info (3.0.8-1) ... 2024-12-18T00:01:42.4708716Z Setting up node-wide-align (1.1.3-1) ... 2024-12-18T00:01:42.4850787Z Setting up node-rimraf (3.0.2-1) ... 2024-12-18T00:01:42.5001519Z Setting up node-sshpk (1.16.1+dfsg-2) ... 2024-12-18T00:01:42.5141536Z Setting up node-semver (7.3.4-1) ... 2024-12-18T00:01:42.5290839Z Setting up node-validate-npm-package-license (3.0.4-1) ... 2024-12-18T00:01:42.5438777Z Setting up node-copy-concurrently (1.0.5-7) ... 2024-12-18T00:01:42.5569835Z Setting up node-move-concurrently (1.0.1-2) ... 2024-12-18T00:01:42.5699519Z Setting up node-agent-base (6.0.2-2) ... 2024-12-18T00:01:42.5845398Z Setting up node-http-signature (1.3.5-1) ... 2024-12-18T00:01:42.6360473Z Setting up node-gauge (2.7.4-1.1) ... 2024-12-18T00:01:42.6498995Z Setting up node-normalize-package-data (3.0.0+~2.4.0-1) ... 2024-12-18T00:01:42.6579487Z Setting up node-npm-package-arg (8.1.0-1) ... 2024-12-18T00:01:42.6656885Z Setting up node-request (2.88.1-5) ... 2024-12-18T00:01:42.6732273Z Setting up node-npmlog (4.1.2-2) ... 2024-12-18T00:01:42.6808595Z Setting up node-https-proxy-agent (5.0.0-3) ... 2024-12-18T00:01:42.6886187Z Setting up node-cacache (15.0.5+~cs13.9.21-1) ... 2024-12-18T00:01:42.6963539Z Setting up node-read-package-json (3.0.0-1) ... 2024-12-18T00:01:42.7060249Z Setting up node-gyp (7.1.2-4) ... 2024-12-18T00:01:42.7183734Z Setting up npm (7.5.2+ds-2) ... 2024-12-18T00:01:42.7469741Z Setting up libwww-perl (6.52-1) ... 2024-12-18T00:01:42.7705399Z Setting up liblwp-protocol-https-perl (6.10-1) ... 2024-12-18T00:01:42.8038540Z Setting up libxml-parser-perl:amd64 (2.46-2) ... 2024-12-18T00:01:42.8391438Z Setting up libxml-twig-perl (1:3.52-1) ... 2024-12-18T00:01:42.8494684Z Setting up libnet-dbus-perl (1.2.0-1+b1) ... 2024-12-18T00:01:42.8679173Z Processing triggers for libglib2.0-0:amd64 (2.66.8-1+deb11u5) ... 2024-12-18T00:01:42.8932314Z Processing triggers for libc-bin (2.31-13+deb11u11) ... 2024-12-18T00:01:42.9015700Z ldconfig: /usr/local/lib/libur_loader.so.0 is not a symbolic link 2024-12-18T00:01:42.9016105Z 2024-12-18T00:01:42.9016477Z ldconfig: /usr/local/lib/libur_adapter_opencl.so.0 is not a symbolic link 2024-12-18T00:01:42.9016862Z 2024-12-18T00:01:42.9017121Z ldconfig: /usr/local/lib/libur_adapter_level_zero.so.0 is not a symbolic link 2024-12-18T00:01:42.9017498Z 2024-12-18T00:01:42.9017698Z ldconfig: /usr/local/lib/libumf.so.0 is not a symbolic link 2024-12-18T00:01:42.9017994Z 2024-12-18T00:01:42.9018579Z ldconfig: /usr/local/lib/libtcm_debug.so.1 is not a symbolic link 2024-12-18T00:01:42.9018915Z 2024-12-18T00:01:42.9019113Z ldconfig: /usr/local/lib/libtcm.so.1 is not a symbolic link 2024-12-18T00:01:42.9019409Z 2024-12-18T00:01:42.9019648Z ldconfig: /usr/local/lib/libtbbmalloc_proxy.so.2 is not a symbolic link 2024-12-18T00:01:42.9020014Z 2024-12-18T00:01:42.9020226Z ldconfig: /usr/local/lib/libtbbmalloc.so.2 is not a symbolic link 2024-12-18T00:01:42.9020562Z 2024-12-18T00:01:42.9020784Z ldconfig: /usr/local/lib/libtbbbind_2_5.so.3 is not a symbolic link 2024-12-18T00:01:42.9021124Z 2024-12-18T00:01:42.9021344Z ldconfig: /usr/local/lib/libtbbbind_2_0.so.3 is not a symbolic link 2024-12-18T00:01:42.9021687Z 2024-12-18T00:01:42.9021890Z ldconfig: /usr/local/lib/libtbbbind.so.3 is not a symbolic link 2024-12-18T00:01:42.9022203Z 2024-12-18T00:01:42.9022408Z ldconfig: /usr/local/lib/libtbb.so.12 is not a symbolic link 2024-12-18T00:01:42.9022705Z 2024-12-18T00:01:42.9022915Z ldconfig: /usr/local/lib/libhwloc.so.15 is not a symbolic link 2024-12-18T00:01:42.9023220Z 2024-12-18T00:01:42.9339029Z Setting up glib-networking:amd64 (2.66.0-2) ... 2024-12-18T00:01:42.9447188Z Setting up libsoup2.4-1:amd64 (2.72.0-2+deb11u1) ... 2024-12-18T00:01:42.9580602Z Setting up libsoup-gnome2.4-1:amd64 (2.72.0-2+deb11u1) ... 2024-12-18T00:01:42.9675612Z Setting up librest-0.7-0:amd64 (0.8.1-1.1) ... 2024-12-18T00:01:42.9766180Z Setting up libgtk-3-0:amd64 (3.24.24-4+deb11u4) ... 2024-12-18T00:01:43.0002668Z Setting up libgtk-3-bin (3.24.24-4+deb11u4) ... 2024-12-18T00:01:43.0223836Z Setting up libvte-2.91-0:amd64 (0.62.3-1) ... 2024-12-18T00:01:43.0314958Z Setting up termit (3.1-1) ... 2024-12-18T00:01:43.0480436Z update-alternatives: using /usr/bin/termit to provide /usr/bin/x-terminal-emulator (x-terminal-emulator) in auto mode 2024-12-18T00:01:43.0532124Z Processing triggers for libc-bin (2.31-13+deb11u11) ... 2024-12-18T00:01:43.0581937Z ldconfig: /usr/local/lib/libur_loader.so.0 is not a symbolic link 2024-12-18T00:01:43.0582318Z 2024-12-18T00:01:43.0582566Z ldconfig: /usr/local/lib/libur_adapter_opencl.so.0 is not a symbolic link 2024-12-18T00:01:43.0582958Z 2024-12-18T00:01:43.0583214Z ldconfig: /usr/local/lib/libur_adapter_level_zero.so.0 is not a symbolic link 2024-12-18T00:01:43.0583586Z 2024-12-18T00:01:43.0583785Z ldconfig: /usr/local/lib/libumf.so.0 is not a symbolic link 2024-12-18T00:01:43.0584081Z 2024-12-18T00:01:43.0584302Z ldconfig: /usr/local/lib/libtcm_debug.so.1 is not a symbolic link 2024-12-18T00:01:43.0584627Z 2024-12-18T00:01:43.0584822Z ldconfig: /usr/local/lib/libtcm.so.1 is not a symbolic link 2024-12-18T00:01:43.0585117Z 2024-12-18T00:01:43.0585355Z ldconfig: /usr/local/lib/libtbbmalloc_proxy.so.2 is not a symbolic link 2024-12-18T00:01:43.0585723Z 2024-12-18T00:01:43.0585932Z ldconfig: /usr/local/lib/libtbbmalloc.so.2 is not a symbolic link 2024-12-18T00:01:43.0586269Z 2024-12-18T00:01:43.0586484Z ldconfig: /usr/local/lib/libtbbbind_2_5.so.3 is not a symbolic link 2024-12-18T00:01:43.0586830Z 2024-12-18T00:01:43.0587044Z ldconfig: /usr/local/lib/libtbbbind_2_0.so.3 is not a symbolic link 2024-12-18T00:01:43.0587391Z 2024-12-18T00:01:43.0587594Z ldconfig: /usr/local/lib/libtbbbind.so.3 is not a symbolic link 2024-12-18T00:01:43.0587905Z 2024-12-18T00:01:43.0588105Z ldconfig: /usr/local/lib/libtbb.so.12 is not a symbolic link 2024-12-18T00:01:43.0588404Z 2024-12-18T00:01:43.0588620Z ldconfig: /usr/local/lib/libhwloc.so.15 is not a symbolic link 2024-12-18T00:01:43.0588925Z 2024-12-18T00:01:43.1026418Z + sudo apt-get install -y lcov 2024-12-18T00:01:43.1161881Z 2024-12-18T00:01:43.1573272Z Reading package lists... 0% 2024-12-18T00:01:43.1573520Z 2024-12-18T00:01:43.1773732Z Reading package lists... 0% 2024-12-18T00:01:43.1774060Z 2024-12-18T00:01:43.4780109Z Reading package lists... 0% 2024-12-18T00:01:43.4780397Z 2024-12-18T00:01:43.4780542Z Reading package lists... 82% 2024-12-18T00:01:43.4780747Z 2024-12-18T00:01:43.4907955Z Reading package lists... 82% 2024-12-18T00:01:43.4908194Z 2024-12-18T00:01:43.4908313Z Reading package lists... 86% 2024-12-18T00:01:43.4908568Z 2024-12-18T00:01:43.4915001Z Reading package lists... 86% 2024-12-18T00:01:43.4915209Z 2024-12-18T00:01:43.4915323Z Reading package lists... 86% 2024-12-18T00:01:43.4915522Z 2024-12-18T00:01:43.4946276Z Reading package lists... 86% 2024-12-18T00:01:43.4946538Z 2024-12-18T00:01:43.4946656Z Reading package lists... 86% 2024-12-18T00:01:43.4946849Z 2024-12-18T00:01:43.5365845Z Reading package lists... 86% 2024-12-18T00:01:43.5366135Z 2024-12-18T00:01:43.5366329Z Reading package lists... 98% 2024-12-18T00:01:43.5366553Z 2024-12-18T00:01:43.5425489Z Reading package lists... 98% 2024-12-18T00:01:43.5425726Z 2024-12-18T00:01:43.5425855Z Reading package lists... Done 2024-12-18T00:01:43.5426055Z 2024-12-18T00:01:43.5549120Z 2024-12-18T00:01:43.5549642Z Building dependency tree... 0% 2024-12-18T00:01:43.5549933Z 2024-12-18T00:01:43.5701783Z Building dependency tree... 0% 2024-12-18T00:01:43.5702063Z 2024-12-18T00:01:43.5702180Z Building dependency tree... 50% 2024-12-18T00:01:43.5702381Z 2024-12-18T00:01:43.6409597Z Building dependency tree... 50% 2024-12-18T00:01:43.6409849Z 2024-12-18T00:01:43.6409986Z Building dependency tree... Done 2024-12-18T00:01:43.6410192Z 2024-12-18T00:01:43.6410197Z 2024-12-18T00:01:43.6410311Z Reading state information... 0% 2024-12-18T00:01:43.6410527Z 2024-12-18T00:01:43.6413396Z Reading state information... 0% 2024-12-18T00:01:43.6413613Z 2024-12-18T00:01:43.6413982Z Reading state information... Done 2024-12-18T00:01:43.6414207Z 2024-12-18T00:01:43.6538250Z lcov is already the newest version (1.14-2). 2024-12-18T00:01:43.7510493Z 0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded. 2024-12-18T00:01:43.7561538Z + sudo npm install -g @bazel/bazelisk 2024-12-18T00:01:44.1002304Z [?25l[..................] | idealTree: timing arborist:ctor Completed in 0ms 2024-12-18T00:01:44.1485662Z [..................] | idealTree:lib: sill idealTree buildDeps 2024-12-18T00:01:44.1988517Z [..................] | idealTree:lib: sill idealTree buildDeps 2024-12-18T00:01:44.2441336Z [..................] | idealTree:lib: sill idealTree buildDeps 2024-12-18T00:01:44.2441719Z 2024-12-18T00:01:44.2460419Z [?25hnpm ERR! code EEXIST 2024-12-18T00:01:44.2461033Z npm ERR! path /usr/local/bin/bazel 2024-12-18T00:01:44.2486784Z npm ERR! EEXIST: file already exists 2024-12-18T00:01:44.2487459Z npm ERR! File exists: /usr/local/bin/bazel 2024-12-18T00:01:44.2488163Z npm ERR! Remove the existing file and try again, or run npm 2024-12-18T00:01:44.2488873Z npm ERR! with --force to overwrite files recklessly. 2024-12-18T00:01:44.3401597Z  2024-12-18T00:01:44.3402219Z npm ERR! A complete log of this run can be found in: 2024-12-18T00:01:44.3402999Z npm ERR! /root/.npm/_logs/2024-12-18T00_01_44_248Z-debug.log 2024-12-18T00:01:44.3447136Z + [[ -e /usr/bin/bazel ]] 2024-12-18T00:01:44.3449999Z ++ command -v bazelisk 2024-12-18T00:01:44.3454013Z + sudo ln -s '' /usr/bin/bazel 2024-12-18T00:01:44.3517783Z ln: failed to create symbolic link '/usr/bin/bazel' -> '': No such file or directory 2024-12-18T00:01:44.3519888Z + CUBLAS_PATTERN='/usr/include/cublas*' 2024-12-18T00:01:44.3521789Z + ls '/usr/include/cublas*' 2024-12-18T00:01:44.3541034Z + CMAKE_PREFIX_PATH=/opt/conda/lib/python3.10/site-packages/torch:/opt/conda/bin/../ 2024-12-18T00:01:44.3541595Z + XLA_SANDBOX_BUILD=1 2024-12-18T00:01:44.3541879Z + build_torch_xla xla 2024-12-18T00:01:44.3542134Z + XLA_DIR=xla 2024-12-18T00:01:44.3542380Z + pushd xla 2024-12-18T00:01:44.3542719Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2024-12-18T00:01:44.3543149Z + python setup.py install 2024-12-18T00:01:44.5986634Z Building torch_xla version: 2.6.0+gitcfe54bf 2024-12-18T00:01:44.5987115Z XLA Commit ID: cfe54bf30c1d98e295505896d6eb4be24b84dd9e 2024-12-18T00:01:44.5987586Z PyTorch Commit ID: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:01:44.6256302Z running install 2024-12-18T00:01:44.6257150Z /opt/conda/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-12-18T00:01:44.6257915Z !! 2024-12-18T00:01:44.6258031Z 2024-12-18T00:01:44.6258170Z ******************************************************************************** 2024-12-18T00:01:44.6258555Z Please avoid running ``setup.py`` directly. 2024-12-18T00:01:44.6258969Z Instead, use pypa/build, pypa/installer or other 2024-12-18T00:01:44.6259350Z standards-based tools. 2024-12-18T00:01:44.6259540Z 2024-12-18T00:01:44.6259856Z See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-12-18T00:01:44.6260679Z ******************************************************************************** 2024-12-18T00:01:44.6260926Z 2024-12-18T00:01:44.6261027Z !! 2024-12-18T00:01:44.6261246Z self.initialize_options() 2024-12-18T00:01:44.6557964Z /opt/conda/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated. 2024-12-18T00:01:44.6558959Z !! 2024-12-18T00:01:44.6559103Z 2024-12-18T00:01:44.6559274Z ******************************************************************************** 2024-12-18T00:01:44.6559715Z Please avoid running ``setup.py`` and ``easy_install``. 2024-12-18T00:01:44.6560172Z Instead, use pypa/build, pypa/installer or other 2024-12-18T00:01:44.6560562Z standards-based tools. 2024-12-18T00:01:44.6560751Z 2024-12-18T00:01:44.6560976Z See https://github.com/pypa/setuptools/issues/917 for details. 2024-12-18T00:01:44.6561412Z ******************************************************************************** 2024-12-18T00:01:44.6561679Z 2024-12-18T00:01:44.6561769Z !! 2024-12-18T00:01:44.6562003Z self.initialize_options() 2024-12-18T00:01:44.7014308Z running bdist_egg 2024-12-18T00:01:44.7142587Z running egg_info 2024-12-18T00:01:44.7142896Z creating torch_xla.egg-info 2024-12-18T00:01:44.7184729Z writing torch_xla.egg-info/PKG-INFO 2024-12-18T00:01:44.7194989Z writing dependency_links to torch_xla.egg-info/dependency_links.txt 2024-12-18T00:01:44.7196776Z writing entry points to torch_xla.egg-info/entry_points.txt 2024-12-18T00:01:44.7203806Z writing requirements to torch_xla.egg-info/requires.txt 2024-12-18T00:01:44.7205056Z writing top-level names to torch_xla.egg-info/top_level.txt 2024-12-18T00:01:44.7206023Z writing manifest file 'torch_xla.egg-info/SOURCES.txt' 2024-12-18T00:01:44.7337684Z reading manifest file 'torch_xla.egg-info/SOURCES.txt' 2024-12-18T00:01:44.7338124Z adding license file 'LICENSE' 2024-12-18T00:01:44.7348800Z writing manifest file 'torch_xla.egg-info/SOURCES.txt' 2024-12-18T00:01:44.7349298Z installing library code to build/bdist.linux-x86_64/egg 2024-12-18T00:01:44.7349987Z running install_lib 2024-12-18T00:01:44.7350293Z running build_py 2024-12-18T00:01:44.7351838Z creating build 2024-12-18T00:01:44.7352367Z creating build/lib.linux-x86_64-cpython-310 2024-12-18T00:01:44.7352848Z creating build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7353554Z copying torch_xla/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7354970Z copying torch_xla/_patched_functions.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7355970Z copying torch_xla/runtime.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7357231Z copying torch_xla/stablehlo.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7358441Z copying torch_xla/tf_saved_model_integration.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7359504Z copying torch_xla/torch_xla.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7360571Z copying torch_xla/version.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2024-12-18T00:01:44.7362439Z creating build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2024-12-18T00:01:44.7363196Z copying torch_xla/_dynamo/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2024-12-18T00:01:44.7364404Z copying torch_xla/_dynamo/config.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2024-12-18T00:01:44.7365513Z copying torch_xla/_dynamo/dynamo_bridge.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2024-12-18T00:01:44.7368258Z creating build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7369388Z copying torch_xla/_internal/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7370494Z copying torch_xla/_internal/c10d_registration.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7371570Z copying torch_xla/_internal/custom_kernel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7372671Z copying torch_xla/_internal/decomp_registration.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7373626Z copying torch_xla/_internal/gpu.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7374746Z copying torch_xla/_internal/neuron.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7375757Z copying torch_xla/_internal/neuron_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7376864Z copying torch_xla/_internal/pjrt.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7378057Z copying torch_xla/_internal/rendezvous.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7385867Z copying torch_xla/_internal/tpu.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7386704Z copying torch_xla/_internal/utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7387453Z copying torch_xla/_internal/xpu.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2024-12-18T00:01:44.7388068Z creating build/lib.linux-x86_64-cpython-310/torch_xla/amp 2024-12-18T00:01:44.7388640Z copying torch_xla/amp/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp 2024-12-18T00:01:44.7389341Z copying torch_xla/amp/autocast_mode.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp 2024-12-18T00:01:44.7390057Z copying torch_xla/amp/grad_scaler.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp 2024-12-18T00:01:44.7390658Z creating build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7391220Z copying torch_xla/core/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7391932Z copying torch_xla/core/dynamo_bridge.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7392667Z copying torch_xla/core/functions.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7393381Z copying torch_xla/core/xla_builder.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7394100Z copying torch_xla/core/xla_env_vars.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7394805Z copying torch_xla/core/xla_model.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7396058Z copying torch_xla/core/xla_op_registry.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2024-12-18T00:01:44.7398200Z creating build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7398898Z copying torch_xla/debug/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7399989Z copying torch_xla/debug/frame_parser_util.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7401055Z copying torch_xla/debug/graph_saver.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7402103Z copying torch_xla/debug/metrics.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7403219Z copying torch_xla/debug/metrics_compare_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7404297Z copying torch_xla/debug/metrics_saver.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7405945Z copying torch_xla/debug/model_comparator.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7406907Z copying torch_xla/debug/profiler.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2024-12-18T00:01:44.7409238Z creating build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2024-12-18T00:01:44.7409956Z copying torch_xla/distributed/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2024-12-18T00:01:44.7411036Z copying torch_xla/distributed/data_parallel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2024-12-18T00:01:44.7412172Z copying torch_xla/distributed/parallel_loader.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2024-12-18T00:01:44.7413242Z copying torch_xla/distributed/xla_backend.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2024-12-18T00:01:44.7414412Z copying torch_xla/distributed/xla_multiprocessing.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2024-12-18T00:01:44.7416104Z copying torch_xla/distributed/zero_redundancy_optimizer.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2024-12-18T00:01:44.7419480Z creating build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7420258Z copying torch_xla/experimental/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7421478Z copying torch_xla/experimental/callback.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7422583Z copying torch_xla/experimental/custom_kernel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7424097Z copying torch_xla/experimental/deprecation.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7425209Z copying torch_xla/experimental/dynamo_mark_sharding.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7426267Z copying torch_xla/experimental/dynamo_set_buffer_donor.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7427188Z copying torch_xla/experimental/eager.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7428235Z copying torch_xla/experimental/fori_loop.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7429405Z copying torch_xla/experimental/mark_pattern_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7430643Z copying torch_xla/experimental/pjrt_backend.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7431685Z copying torch_xla/experimental/plugins.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7432730Z copying torch_xla/experimental/pytreeify.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7433786Z copying torch_xla/experimental/quantized.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7434827Z copying torch_xla/experimental/scan.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7436115Z copying torch_xla/experimental/scan_layers.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7437317Z copying torch_xla/experimental/spmd_fully_sharded_data_parallel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7438347Z copying torch_xla/experimental/stablehlo_custom_call.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7439306Z copying torch_xla/experimental/triton.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7440459Z copying torch_xla/experimental/unbounded_dynamism_export.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7441590Z copying torch_xla/experimental/xla_dynamic_reshape_ops.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7442581Z copying torch_xla/experimental/xla_marker.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7443633Z copying torch_xla/experimental/xla_mlir_debuginfo.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7444832Z copying torch_xla/experimental/xla_quantized_matmul.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2024-12-18T00:01:44.7447667Z creating build/lib.linux-x86_64-cpython-310/torch_xla/test 2024-12-18T00:01:44.7448393Z copying torch_xla/test/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/test 2024-12-18T00:01:44.7449412Z copying torch_xla/test/test_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/test 2024-12-18T00:01:44.7451713Z creating build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7452418Z copying torch_xla/utils/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7453489Z copying torch_xla/utils/checkpoint.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7454757Z copying torch_xla/utils/checkpoint_tagger.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7455695Z copying torch_xla/utils/closures.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7456778Z copying torch_xla/utils/dlpack.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7457988Z copying torch_xla/utils/keyd_queue.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7459081Z copying torch_xla/utils/serialization.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7460156Z copying torch_xla/utils/stablehlo_test_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7461120Z copying torch_xla/utils/utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2024-12-18T00:01:44.7463463Z creating build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2024-12-18T00:01:44.7464207Z copying torch_xla/amp/syncfree/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2024-12-18T00:01:44.7465444Z copying torch_xla/amp/syncfree/_functional.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2024-12-18T00:01:44.7466491Z copying torch_xla/amp/syncfree/adam.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2024-12-18T00:01:44.7467591Z copying torch_xla/amp/syncfree/adamw.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2024-12-18T00:01:44.7468630Z copying torch_xla/amp/syncfree/sgd.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2024-12-18T00:01:44.7470829Z creating build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7471583Z copying torch_xla/distributed/fsdp/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7472813Z copying torch_xla/distributed/fsdp/_init_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7474012Z copying torch_xla/distributed/fsdp/consolidate_sharded_ckpts.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7475053Z copying torch_xla/distributed/fsdp/state_dict_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7476100Z copying torch_xla/distributed/fsdp/utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7477223Z copying torch_xla/distributed/fsdp/wrap.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7478434Z copying torch_xla/distributed/fsdp/xla_flatten_params_wrapper.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7479675Z copying torch_xla/distributed/fsdp/xla_fully_sharded_data_parallel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2024-12-18T00:01:44.7482574Z creating build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2024-12-18T00:01:44.7483539Z copying torch_xla/distributed/spmd/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2024-12-18T00:01:44.7484707Z copying torch_xla/distributed/spmd/api.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2024-12-18T00:01:44.7485906Z copying torch_xla/distributed/spmd/debugging.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2024-12-18T00:01:44.7487022Z copying torch_xla/distributed/spmd/xla_sharded_tensor.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2024-12-18T00:01:44.7488080Z copying torch_xla/distributed/spmd/xla_sharding.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2024-12-18T00:01:44.7490314Z creating build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:01:44.7491427Z copying torch_xla/experimental/distributed_checkpoint/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:01:44.7492753Z copying torch_xla/experimental/distributed_checkpoint/_helpers.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:01:44.7494037Z copying torch_xla/experimental/distributed_checkpoint/manager.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:01:44.7495317Z copying torch_xla/experimental/distributed_checkpoint/planners.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:01:44.7496671Z copying torch_xla/experimental/distributed_checkpoint/util.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:01:44.7497915Z creating build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels 2024-12-18T00:01:44.7498866Z copying torch_xla/experimental/pallas_kernels/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels 2024-12-18T00:01:44.7500102Z copying torch_xla/experimental/pallas_kernels/multi_queries_paged_attention_kernel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels 2024-12-18T00:01:44.7522372Z running build_ext 2024-12-18T00:01:45.8319321Z bazel build //:_XLAC.so --symlink_prefix=build/temp.linux-x86_64-cpython-310/bazel- --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=1 --remote_default_exec_properties=cache-silo-key=dev 2024-12-18T00:01:45.8341091Z 2024/12/18 00:01:45 Downloading https://releases.bazel.build/6.5.0/release/bazel-6.5.0-linux-x86_64... 2024-12-18T00:01:46.0072577Z Extracting Bazel installation... 2024-12-18T00:01:47.7633128Z Starting local Bazel server and connecting to it... 2024-12-18T00:01:49.1401926Z INFO: Options provided by the client: 2024-12-18T00:01:49.1402486Z Inherited 'common' options: --isatty=1 --terminal_columns=0 2024-12-18T00:01:49.1403232Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2024-12-18T00:01:49.1403845Z Inherited 'common' options: --experimental_repo_remote_exec 2024-12-18T00:01:49.1404590Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2024-12-18T00:01:49.1408485Z 'build' options: --announce_rc --nocheck_visibility --enable_platform_specific_config --experimental_cc_shared_library --define=no_aws_support=true --define=no_hdfs_support=true --define=no_hdfs_support=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true -c opt --config=short_logs --action_env=CC=gcc --action_env=CXX=g++ --spawn_strategy=standalone --incompatible_strict_action_env --noremote_upload_local_results --java_runtime_version=remotejdk_11 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --define framework_shared_object=false --define tsl_protobuf_header_only=false --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --define=with_xla_support=true --noincompatible_remove_legacy_whole_archive --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility 2024-12-18T00:01:49.1412708Z INFO: Found applicable config definition build:short_logs in file /var/lib/jenkins/workspace/xla/.bazelrc: --output_filter=DONT_MATCH_ANYTHING 2024-12-18T00:01:49.1416728Z INFO: Found applicable config definition build:linux in file /var/lib/jenkins/workspace/xla/.bazelrc: --config=posix --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --define=build_with_onednn_v2=true --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable 2024-12-18T00:01:49.1420665Z INFO: Found applicable config definition build:posix in file /var/lib/jenkins/workspace/xla/.bazelrc: --copt=-Wno-sign-compare --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 2024-12-18T00:01:49.1422456Z INFO: Found applicable config definition build:dynamic_kernels in file /var/lib/jenkins/workspace/xla/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS 2024-12-18T00:01:49.1723943Z Loading: 2024-12-18T00:01:49.3788909Z 2024-12-18T00:01:49.3789646Z Loading: 2024-12-18T00:01:49.5798082Z 2024-12-18T00:01:49.5798784Z Loading: 2024-12-18T00:01:49.5799228Z Fetching repository @pybind11_bazel; starting 2024-12-18T00:01:49.7475420Z 2024-12-18T00:01:49.7476065Z  2024-12-18T00:01:49.7477338Z DEBUG: Rule 'pybind11_bazel' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "6426567481ee345eb48661e7db86adc053881cb4dd39fbf527c8986316b682b9" 2024-12-18T00:01:49.7478372Z Loading: 2024-12-18T00:01:49.7478681Z Fetching repository @pybind11_bazel; starting 2024-12-18T00:01:49.7480011Z 2024-12-18T00:01:49.7480179Z  2024-12-18T00:01:49.7480580Z DEBUG: Repository pybind11_bazel instantiated at: 2024-12-18T00:01:49.7481086Z /var/lib/jenkins/workspace/xla/WORKSPACE:6:13: in 2024-12-18T00:01:49.7481535Z Repository rule http_archive defined at: 2024-12-18T00:01:49.7482367Z /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in 2024-12-18T00:01:49.7483212Z Loading: 2024-12-18T00:01:49.7483514Z Fetching repository @pybind11_bazel; starting 2024-12-18T00:01:49.9806430Z 2024-12-18T00:01:49.9807130Z  2024-12-18T00:01:49.9807522Z Loading: 2024-12-18T00:01:49.9807860Z Fetching repository @xla; starting 2024-12-18T00:01:49.9808364Z Fetching https://github.com/...2f4d6cb523e035c237f30aeac4e00ae34821.tar.gz 2024-12-18T00:01:50.1825658Z 2024-12-18T00:01:50.1826235Z  2024-12-18T00:01:50.1826534Z  2024-12-18T00:01:50.1826797Z Loading: 2024-12-18T00:01:50.1827158Z Fetching repository @xla; starting 2024-12-18T00:01:50.1827652Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 1.9 MiB (2,031,640B) 2024-12-18T00:01:50.3835384Z 2024-12-18T00:01:50.3836030Z  2024-12-18T00:01:50.3836333Z  2024-12-18T00:01:50.3836593Z Loading: 2024-12-18T00:01:50.3836921Z Fetching repository @xla; starting 2024-12-18T00:01:50.3837419Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 3.1 MiB (3,276,824B) 2024-12-18T00:01:50.7752866Z 2024-12-18T00:01:50.7753383Z  2024-12-18T00:01:50.7753673Z  2024-12-18T00:01:50.7753958Z Loading: 2024-12-18T00:01:50.7754333Z Fetching repository @xla; starting 2024-12-18T00:01:50.7754823Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 5.7 MiB (6,012,951B) 2024-12-18T00:01:50.9847870Z 2024-12-18T00:01:50.9848734Z  2024-12-18T00:01:50.9849055Z  2024-12-18T00:01:50.9849347Z Loading: 2024-12-18T00:01:50.9849691Z Fetching repository @xla; starting 2024-12-18T00:01:50.9850216Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 7.1 MiB (7,421,976B) 2024-12-18T00:01:51.1857932Z 2024-12-18T00:01:51.1858464Z  2024-12-18T00:01:51.1858760Z  2024-12-18T00:01:51.1859045Z Loading: 2024-12-18T00:01:51.1859377Z Fetching repository @xla; starting 2024-12-18T00:01:51.1859874Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 8.4 MiB (8,781,848B) 2024-12-18T00:01:51.3861564Z 2024-12-18T00:01:51.3862185Z  2024-12-18T00:01:51.3862482Z  2024-12-18T00:01:51.3862771Z Loading: 2024-12-18T00:01:51.3863570Z Fetching repository @xla; starting 2024-12-18T00:01:51.3864075Z Fetching https://github.com/...ac4e00ae34821.tar.gz; 9.6 MiB (10,092,570B) 2024-12-18T00:01:51.5873791Z 2024-12-18T00:01:51.5874467Z  2024-12-18T00:01:51.5874783Z  2024-12-18T00:01:51.5875067Z Loading: 2024-12-18T00:01:51.5875418Z Fetching repository @xla; starting 2024-12-18T00:01:51.5876208Z Fetching https://github.com/...c4e00ae34821.tar.gz; 10.6 MiB (11,157,530B) 2024-12-18T00:01:51.7910985Z 2024-12-18T00:01:51.7911626Z  2024-12-18T00:01:51.7911950Z  2024-12-18T00:01:51.7912243Z Loading: 2024-12-18T00:01:51.7912572Z Fetching repository @xla; starting 2024-12-18T00:01:51.7913079Z Fetching https://github.com/...c4e00ae34821.tar.gz; 11.9 MiB (12,451,864B) 2024-12-18T00:01:51.9925092Z 2024-12-18T00:01:51.9925518Z  2024-12-18T00:01:51.9925817Z  2024-12-18T00:01:51.9926108Z Loading: 2024-12-18T00:01:51.9926457Z Fetching repository @xla; starting 2024-12-18T00:01:51.9926976Z Fetching https://github.com/...c4e00ae34821.tar.gz; 13.1 MiB (13,746,202B) 2024-12-18T00:01:52.2301105Z 2024-12-18T00:01:52.2301703Z  2024-12-18T00:01:52.2302029Z  2024-12-18T00:01:52.2302317Z Loading: 2024-12-18T00:01:52.2302662Z Fetching repository @xla; starting 2024-12-18T00:01:52.2303184Z Fetching ...al/xla; Extracting 30f22f4d6cb523e035c237f30aeac4e00ae34821.ta\ 2024-12-18T00:01:52.2303667Z r.gz 2024-12-18T00:01:52.9874098Z 2024-12-18T00:01:52.9874880Z  2024-12-18T00:01:52.9875324Z  2024-12-18T00:01:52.9875710Z  2024-12-18T00:01:52.9876148Z Loading: 2024-12-18T00:01:52.9876683Z Fetching repository @xla; starting 2024-12-18T00:01:53.0345138Z 2024-12-18T00:01:53.0345851Z  2024-12-18T00:01:53.0346994Z DEBUG: Rule 'xla' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "546dc97a5bee684b3baf1c14c00ef6c73f18c717ebb97c000a35f683bf53c244" 2024-12-18T00:01:53.0347980Z Loading: 2024-12-18T00:01:53.0348294Z Fetching repository @xla; Patching repository 2024-12-18T00:01:53.0348566Z 2024-12-18T00:01:53.0348693Z  2024-12-18T00:01:53.0349037Z DEBUG: Repository xla instantiated at: 2024-12-18T00:01:53.0349512Z /var/lib/jenkins/workspace/xla/WORKSPACE:55:13: in 2024-12-18T00:01:53.0349980Z Repository rule http_archive defined at: 2024-12-18T00:01:53.0350879Z /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in 2024-12-18T00:01:53.0351716Z Loading: 2024-12-18T00:01:53.0352019Z Fetching repository @xla; Patching repository 2024-12-18T00:01:53.2640124Z 2024-12-18T00:01:53.2640867Z  2024-12-18T00:01:53.2641178Z Loading: 2024-12-18T00:01:53.2641565Z Fetching repository @python_version_repo; starting 2024-12-18T00:01:53.3028389Z 2024-12-18T00:01:53.3029114Z  2024-12-18T00:01:53.3030311Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:154:14: 2024-12-18T00:01:53.3031443Z HERMETIC_PYTHON_VERSION variable was not set correctly, using default version. 2024-12-18T00:01:53.3032025Z Python 3.10 will be used. 2024-12-18T00:01:53.3032478Z To select Python version, either set HERMETIC_PYTHON_VERSION env variable in 2024-12-18T00:01:53.3032994Z your shell: 2024-12-18T00:01:53.3033249Z export HERMETIC_PYTHON_VERSION=3.12 2024-12-18T00:01:53.3033907Z OR pass it as an argument to bazel command directly or inside your .bazelrc 2024-12-18T00:01:53.3034571Z file: 2024-12-18T00:01:53.3034932Z --repo_env=HERMETIC_PYTHON_VERSION=3.12 2024-12-18T00:01:53.3035563Z Loading: 2024-12-18T00:01:53.3036062Z Fetching repository @python_version_repo; starting 2024-12-18T00:01:53.3073589Z 2024-12-18T00:01:53.3074128Z  2024-12-18T00:01:53.3075795Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:87:10: 2024-12-18T00:01:53.3076946Z ============================= 2024-12-18T00:01:53.3077389Z Hermetic Python configuration: 2024-12-18T00:01:53.3077838Z Version: "3.10" 2024-12-18T00:01:53.3078211Z Kind: "" 2024-12-18T00:01:53.3078864Z Interpreter: "default" (provided by rules_python) 2024-12-18T00:01:53.3079674Z Requirements_lock label: "@python_version_repo//:requirements_lock_3_10.txt" 2024-12-18T00:01:53.3080159Z ===================================== 2024-12-18T00:01:53.3080551Z Loading: 2024-12-18T00:01:53.3080870Z Fetching repository @python_version_repo; starting 2024-12-18T00:01:53.5480446Z 2024-12-18T00:01:53.5481080Z  2024-12-18T00:01:53.5481414Z Loading: 2024-12-18T00:01:53.5481765Z Fetching repository @pypi; Restarting. 2024-12-18T00:01:53.5482274Z Fetching repository @python_x86_64-unknown-linux-gnu; starting 2024-12-18T00:01:53.5482917Z Fetching https://github.com/...86_64-unknown-linux-gnu-install_only.tar.gz 2024-12-18T00:01:53.7881136Z 2024-12-18T00:01:53.7881790Z  2024-12-18T00:01:53.7882084Z  2024-12-18T00:01:53.7882323Z  2024-12-18T00:01:53.7882591Z Loading: 2024-12-18T00:01:53.7882911Z Fetching repository @pypi; Restarting. 2024-12-18T00:01:53.7883394Z Fetching repository @python_x86_64-unknown-linux-gnu; starting 2024-12-18T00:01:53.9885260Z 2024-12-18T00:01:53.9885909Z  2024-12-18T00:01:53.9886212Z  2024-12-18T00:01:53.9886481Z Loading: 2024-12-18T00:01:53.9886807Z Fetching repository @pypi; Restarting. 2024-12-18T00:01:53.9887263Z Fetching repository @python_x86_64-unknown-linux-gnu; starting 2024-12-18T00:01:53.9887833Z Fetching ...ux-gnu; Extracting cpython-3.10.15+20241016-x86_64-unknown-lin\ 2024-12-18T00:01:53.9888308Z ux-gnu-install_only.tar.gz 2024-12-18T00:01:54.5543172Z 2024-12-18T00:01:54.5543858Z  2024-12-18T00:01:54.5544312Z  2024-12-18T00:01:54.5544625Z  2024-12-18T00:01:54.5544863Z  2024-12-18T00:01:54.5545129Z Loading: 2024-12-18T00:01:54.5545458Z Fetching repository @pypi; starting 2024-12-18T00:01:54.7289387Z 2024-12-18T00:01:54.7290095Z  2024-12-18T00:01:54.7291527Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2024-12-18T00:01:54.7292923Z Warning: skipping import of repository 'llvm-raw' because it already exists. 2024-12-18T00:01:54.7293469Z Loading: 2024-12-18T00:01:54.9896291Z 2024-12-18T00:01:54.9896994Z Loading: 2024-12-18T00:01:54.9897386Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:54.9897900Z Fetching https://storage.googleapis.com/...c4fde581cec0295abed8c977.tar.gz 2024-12-18T00:01:55.2536441Z 2024-12-18T00:01:55.2537107Z  2024-12-18T00:01:55.2537450Z  2024-12-18T00:01:55.2537789Z Loading: 2024-12-18T00:01:55.2538123Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:55.2538660Z Fetching https://storage.googleapis.com/...d8c977.tar.gz; 40.4 MiB (18.9%) 2024-12-18T00:01:55.5903125Z 2024-12-18T00:01:55.5903763Z  2024-12-18T00:01:55.5904063Z  2024-12-18T00:01:55.5904338Z Loading: 2024-12-18T00:01:55.5904707Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:55.5905223Z Fetching https://storage.googleapis.com/...d8c977.tar.gz; 63.3 MiB (29.7%) 2024-12-18T00:01:55.7908759Z 2024-12-18T00:01:55.7909386Z  2024-12-18T00:01:55.7909684Z  2024-12-18T00:01:55.7909943Z Loading: 2024-12-18T00:01:55.7910284Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:55.7910806Z Fetching https://storage.googleapis.com/...d8c977.tar.gz; 86.6 MiB (40.6%) 2024-12-18T00:01:55.9917389Z 2024-12-18T00:01:55.9918053Z  2024-12-18T00:01:55.9918446Z  2024-12-18T00:01:55.9918984Z Loading: 2024-12-18T00:01:55.9919332Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:55.9919860Z Fetching https://storage.googleapis.com/...8c977.tar.gz; 109.9 MiB (51.5%) 2024-12-18T00:01:56.2525559Z 2024-12-18T00:01:56.2526196Z  2024-12-18T00:01:56.2526494Z  2024-12-18T00:01:56.2526757Z Loading: 2024-12-18T00:01:56.2527355Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:56.2527914Z Fetching https://storage.googleapis.com/...8c977.tar.gz; 156.8 MiB (73.5%) 2024-12-18T00:01:56.5925504Z 2024-12-18T00:01:56.5926126Z  2024-12-18T00:01:56.5926459Z  2024-12-18T00:01:56.5926739Z Loading: 2024-12-18T00:01:56.5927066Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:56.5927585Z Fetching https://storage.googleapis.com/...8c977.tar.gz; 180.2 MiB (84.5%) 2024-12-18T00:01:56.8922904Z 2024-12-18T00:01:56.8923549Z  2024-12-18T00:01:56.8923839Z  2024-12-18T00:01:56.8924142Z Loading: 2024-12-18T00:01:56.8924491Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:56.8924989Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:01:56.8925442Z r.gz 2024-12-18T00:01:57.9938233Z 2024-12-18T00:01:57.9938909Z  2024-12-18T00:01:57.9939204Z  2024-12-18T00:01:57.9939441Z  2024-12-18T00:01:57.9939756Z Loading: 2024-12-18T00:01:57.9940109Z Fetching repository @llvm-raw; starting 2024-12-18T00:01:57.9940608Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:01:57.9941059Z r.gz 2024-12-18T00:01:58.9987117Z 2024-12-18T00:01:58.9987759Z  2024-12-18T00:01:58.9988059Z  2024-12-18T00:01:58.9988307Z  2024-12-18T00:01:58.9988576Z Loading: 2024-12-18T00:01:58.9988921Z Fetching repository @llvm-raw; starting 4s 2024-12-18T00:01:58.9989414Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:01:58.9989907Z r.gz 2024-12-18T00:01:59.9997569Z 2024-12-18T00:01:59.9998227Z  2024-12-18T00:01:59.9998530Z  2024-12-18T00:01:59.9998778Z  2024-12-18T00:01:59.9999049Z Loading: 2024-12-18T00:01:59.9999378Z Fetching repository @llvm-raw; starting 5s 2024-12-18T00:01:59.9999916Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:00.0000383Z r.gz 2024-12-18T00:02:01.0007790Z 2024-12-18T00:02:01.0008431Z  2024-12-18T00:02:01.0008765Z  2024-12-18T00:02:01.0009022Z  2024-12-18T00:02:01.0009309Z Loading: 2024-12-18T00:02:01.0009657Z Fetching repository @llvm-raw; starting 6s 2024-12-18T00:02:01.0010181Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:01.0010659Z r.gz 4s 2024-12-18T00:02:02.0016848Z 2024-12-18T00:02:02.0017564Z  2024-12-18T00:02:02.0017873Z  2024-12-18T00:02:02.0018151Z  2024-12-18T00:02:02.0018412Z Loading: 2024-12-18T00:02:02.0018758Z Fetching repository @llvm-raw; starting 7s 2024-12-18T00:02:02.0019262Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:02.0019722Z r.gz 5s 2024-12-18T00:02:03.0022428Z 2024-12-18T00:02:03.0023064Z  2024-12-18T00:02:03.0023361Z  2024-12-18T00:02:03.0023641Z  2024-12-18T00:02:03.0023896Z Loading: 2024-12-18T00:02:03.0024251Z Fetching repository @llvm-raw; starting 8s 2024-12-18T00:02:03.0024768Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:04.0028508Z r.gz 6s 2024-12-18T00:02:04.0028721Z 2024-12-18T00:02:04.0029026Z  2024-12-18T00:02:04.0029287Z  2024-12-18T00:02:04.0029541Z  2024-12-18T00:02:04.0029808Z Loading: 2024-12-18T00:02:04.0030152Z Fetching repository @llvm-raw; starting 9s 2024-12-18T00:02:04.0030661Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:04.0031410Z r.gz 7s 2024-12-18T00:02:05.2042723Z 2024-12-18T00:02:05.2043329Z  2024-12-18T00:02:05.2043651Z  2024-12-18T00:02:05.2043922Z  2024-12-18T00:02:05.2044368Z Loading: 2024-12-18T00:02:05.2044724Z Fetching repository @llvm-raw; starting 10s 2024-12-18T00:02:05.2045490Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:05.2045970Z r.gz 8s 2024-12-18T00:02:06.2052828Z 2024-12-18T00:02:06.2053470Z  2024-12-18T00:02:06.2053818Z  2024-12-18T00:02:06.2054062Z  2024-12-18T00:02:06.2054340Z Loading: 2024-12-18T00:02:06.2054702Z Fetching repository @llvm-raw; starting 11s 2024-12-18T00:02:06.2055213Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:06.2055673Z r.gz 9s 2024-12-18T00:02:07.2058753Z 2024-12-18T00:02:07.2059448Z  2024-12-18T00:02:07.2059779Z  2024-12-18T00:02:07.2060025Z  2024-12-18T00:02:07.2060294Z Loading: 2024-12-18T00:02:07.2060644Z Fetching repository @llvm-raw; starting 12s 2024-12-18T00:02:07.2061143Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:07.2061611Z r.gz 10s 2024-12-18T00:02:08.2069913Z 2024-12-18T00:02:08.2070589Z  2024-12-18T00:02:08.2070918Z  2024-12-18T00:02:08.2071167Z  2024-12-18T00:02:08.2071440Z Loading: 2024-12-18T00:02:08.2071789Z Fetching repository @llvm-raw; starting 13s 2024-12-18T00:02:08.2072304Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:08.2072774Z r.gz 11s 2024-12-18T00:02:09.2080835Z 2024-12-18T00:02:09.2081467Z  2024-12-18T00:02:09.2081775Z  2024-12-18T00:02:09.2082019Z  2024-12-18T00:02:09.2082275Z Loading: 2024-12-18T00:02:09.2082621Z Fetching repository @llvm-raw; starting 14s 2024-12-18T00:02:09.2083165Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:09.2083635Z r.gz 12s 2024-12-18T00:02:10.2092477Z 2024-12-18T00:02:10.2093126Z  2024-12-18T00:02:10.2093461Z  2024-12-18T00:02:10.2093717Z  2024-12-18T00:02:10.2093997Z Loading: 2024-12-18T00:02:10.2094405Z Fetching repository @llvm-raw; starting 15s 2024-12-18T00:02:10.2094929Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2024-12-18T00:02:10.2095388Z r.gz 13s 2024-12-18T00:02:10.3499207Z 2024-12-18T00:02:10.3499848Z  2024-12-18T00:02:10.3500179Z  2024-12-18T00:02:10.3500428Z  2024-12-18T00:02:10.3501244Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2024-12-18T00:02:10.3502264Z Warning: skipping import of repository 'pybind11_bazel' because it already exists. 2024-12-18T00:02:10.3502833Z Loading: 2024-12-18T00:02:10.3502999Z 2024-12-18T00:02:10.3503628Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2024-12-18T00:02:10.3504600Z Warning: skipping import of repository 'pybind11' because it already exists. 2024-12-18T00:02:10.3505129Z Loading: 2024-12-18T00:02:10.3505289Z 2024-12-18T00:02:10.3505934Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2024-12-18T00:02:10.3506921Z Warning: skipping import of repository 'jsoncpp_git' because it already exists. 2024-12-18T00:02:10.3507446Z Loading: 2024-12-18T00:02:10.5646963Z 2024-12-18T00:02:10.5647686Z Loading: 2024-12-18T00:02:10.5648116Z Fetching repository @com_github_grpc_grpc; starting 2024-12-18T00:02:10.5648713Z Fetching ...c_grpc; Extracting b54a5b338637f92bfcf4b0bc05e0f57a5fd8fadd.ta\ 2024-12-18T00:02:10.5649519Z r.gz 2024-12-18T00:02:11.4902872Z 2024-12-18T00:02:11.4903552Z  2024-12-18T00:02:11.4903842Z  2024-12-18T00:02:11.4904081Z  2024-12-18T00:02:11.4904387Z Loading: 2024-12-18T00:02:11.4904736Z Fetching repository @bazel_toolchains; starting 2024-12-18T00:02:11.8101504Z 2024-12-18T00:02:11.8102197Z  2024-12-18T00:02:11.8102792Z Loading: 2024-12-18T00:02:11.8103192Z Fetching repository @com_google_protobuf; starting 2024-12-18T00:02:11.8103733Z Fetching ...232118ec5/external/com_google_protobuf; Extracting v3.21.9.zip 2024-12-18T00:02:12.0146361Z 2024-12-18T00:02:12.0147764Z  2024-12-18T00:02:12.0148191Z  2024-12-18T00:02:12.0148582Z Loading: 2024-12-18T00:02:12.0732626Z 2024-12-18T00:02:12.0733309Z Loading: 2024-12-18T00:02:12.0770630Z 2024-12-18T00:02:12.0771072Z Loading: 0 packages loaded 2024-12-18T00:02:12.2200172Z 2024-12-18T00:02:12.2201022Z Analyzing: target //:_XLAC.so (1 packages loaded, 0 targets configured) 2024-12-18T00:02:12.4378192Z 2024-12-18T00:02:12.4379105Z Analyzing: target //:_XLAC.so (33 packages loaded, 9 targets configured) 2024-12-18T00:02:12.4379727Z Fetching repository @local_config_python; Restarting. 2024-12-18T00:02:12.4380249Z Fetching repository @go_sdk; Finding Go SHA-256 sums 2024-12-18T00:02:12.6858623Z 2024-12-18T00:02:12.6859420Z  2024-12-18T00:02:12.6859720Z  2024-12-18T00:02:12.6860406Z Analyzing: target //:_XLAC.so (33 packages loaded, 9 targets configured) 2024-12-18T00:02:12.6861329Z currently loading: @local_config_python// 2024-12-18T00:02:12.9140390Z Fetching repository @go_sdk; Finding Go SHA-256 sums 2024-12-18T00:02:12.9140888Z 2024-12-18T00:02:12.9141269Z  2024-12-18T00:02:12.9141651Z  2024-12-18T00:02:12.9142446Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:12.9143574Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2024-12-18T00:02:12.9144751Z Fetching https://dl.google.com/go/go1.18.4.linux-amd64.tar.gz 2024-12-18T00:02:13.2153977Z 2024-12-18T00:02:13.2154614Z  2024-12-18T00:02:13.2154899Z  2024-12-18T00:02:13.2155444Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:13.2156075Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2024-12-18T00:02:13.2156677Z Fetching https://dl.google.com/...8.4.linux-amd64.tar.gz; 25.7 MiB (19.0%) 2024-12-18T00:02:13.5123599Z 2024-12-18T00:02:13.5124265Z  2024-12-18T00:02:13.5124574Z  2024-12-18T00:02:13.5125077Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:13.5125704Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2024-12-18T00:02:13.5126304Z Fetching https://dl.google.com/...8.4.linux-amd64.tar.gz; 80.6 MiB (59.6%) 2024-12-18T00:02:13.8163877Z 2024-12-18T00:02:13.8164583Z  2024-12-18T00:02:13.8164940Z  2024-12-18T00:02:13.8165461Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:13.8166111Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2024-12-18T00:02:13.8166766Z Fetching https://dl.google.com/....4.linux-amd64.tar.gz; 108.0 MiB (79.8%) 2024-12-18T00:02:14.2168872Z 2024-12-18T00:02:14.2169361Z  2024-12-18T00:02:14.2169648Z  2024-12-18T00:02:14.2170147Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:14.2170762Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2024-12-18T00:02:15.2178130Z 2024-12-18T00:02:15.2178771Z  2024-12-18T00:02:15.2179340Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:15.2180236Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2024-12-18T00:02:16.2187261Z 2024-12-18T00:02:16.2187898Z  2024-12-18T00:02:16.2188471Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:16.2189104Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2024-12-18T00:02:16.4678057Z 2024-12-18T00:02:16.4679185Z  2024-12-18T00:02:16.4680155Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2024-12-18T00:02:16.4681070Z currently loading: @go_sdk// 2024-12-18T00:02:16.7405647Z 2024-12-18T00:02:16.7406373Z  2024-12-18T00:02:16.7406960Z Analyzing: target //:_XLAC.so (41 packages loaded, 266 targets configured) 2024-12-18T00:02:16.7407474Z currently loading: @torch// 2024-12-18T00:02:17.0198297Z 2024-12-18T00:02:17.0198964Z  2024-12-18T00:02:17.0199559Z Analyzing: target //:_XLAC.so (44 packages loaded, 266 targets configured) 2024-12-18T00:02:17.0200156Z Fetching repository @local_config_cc; starting 2024-12-18T00:02:17.2852287Z 2024-12-18T00:02:17.2853005Z  2024-12-18T00:02:17.2853600Z Analyzing: target //:_XLAC.so (44 packages loaded, 266 targets configured) 2024-12-18T00:02:17.2854124Z currently loading: @local_config_cc// 2024-12-18T00:02:17.2854522Z Fetching repository @protobuf; starting 2024-12-18T00:02:17.2855013Z Fetching https://github.com/.../download/v27.0/protobuf-27.0.tar.gz 2024-12-18T00:02:17.6204482Z 2024-12-18T00:02:17.6205197Z  2024-12-18T00:02:17.6205547Z  2024-12-18T00:02:17.6205800Z  2024-12-18T00:02:17.6206343Z Analyzing: target //:_XLAC.so (44 packages loaded, 266 targets configured) 2024-12-18T00:02:17.6206884Z currently loading: @local_config_cc// 2024-12-18T00:02:17.6207265Z Fetching repository @protobuf; starting 2024-12-18T00:02:17.6207781Z Fetching ...05232118ec5/external/protobuf; Extracting protobuf-27.0.tar.gz 2024-12-18T00:02:17.8878739Z 2024-12-18T00:02:17.8879407Z  2024-12-18T00:02:17.8879703Z  2024-12-18T00:02:17.8879949Z  2024-12-18T00:02:17.8880460Z Analyzing: target //:_XLAC.so (53 packages loaded, 8930 targets configured) 2024-12-18T00:02:17.8881091Z currently loading: @com_google_absl//absl/container ... (4 packages) 2024-12-18T00:02:18.0932523Z 2024-12-18T00:02:18.0933797Z  2024-12-18T00:02:18.0934667Z Analyzing: target //:_XLAC.so (155 packages loaded, 10439 targets configured) 2024-12-18T00:02:18.0935570Z currently loading: @com_google_protobuf// ... (6 packages) 2024-12-18T00:02:18.0936169Z Fetching repository @pybind11; starting 2024-12-18T00:02:18.0936867Z Fetching repository @eigen_archive; starting 2024-12-18T00:02:18.0937451Z Fetching repository @llvm-project; starting 2024-12-18T00:02:18.0937986Z Fetching repository @farmhash_archive; starting 2024-12-18T00:02:18.0938597Z Fetching repository @double_conversion; starting 2024-12-18T00:02:18.0939134Z Fetching repository @stablehlo; starting 2024-12-18T00:02:18.0939793Z Fetching https://storage.googleapis.com/.../archive/v3.2.0.tar.gz 2024-12-18T00:02:18.0940481Z Fetching repository @nsync; starting ... (18 fetches) 2024-12-18T00:02:18.2235558Z 2024-12-18T00:02:18.2236653Z  2024-12-18T00:02:18.2237069Z  2024-12-18T00:02:18.2237357Z  2024-12-18T00:02:18.2237709Z  2024-12-18T00:02:18.2237957Z  2024-12-18T00:02:18.2238280Z  2024-12-18T00:02:18.2238627Z  2024-12-18T00:02:18.2238915Z  2024-12-18T00:02:18.2239230Z  2024-12-18T00:02:18.2240761Z DEBUG: Rule 'pybind11' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "cd2fc28640a6b3d712cfd17c176a52185a97c99707f42ac38fa87385de177ec1" 2024-12-18T00:02:18.2242676Z Analyzing: target //:_XLAC.so (172 packages loaded, 12489 targets configured) 2024-12-18T00:02:18.2243896Z currently loading: @xla//xla/mlir_hlo ... (3 packages) 2024-12-18T00:02:18.2244778Z Fetching repository @pybind11; starting 2024-12-18T00:02:18.2245421Z Fetching repository @eigen_archive; starting 2024-12-18T00:02:18.2245951Z Fetching repository @llvm-project; starting 2024-12-18T00:02:18.2246489Z Fetching repository @double_conversion; starting 2024-12-18T00:02:18.2247341Z Fetching repository @stablehlo; starting 2024-12-18T00:02:18.2248112Z Fetching ...rchive; Extracting eigen-33d0937c6bdf5ec999939fb17f2a553183d14\ 2024-12-18T00:02:18.2248850Z a74.tar.gz 2024-12-18T00:02:18.2249232Z Fetching repository @curl; starting 2024-12-18T00:02:18.2249921Z Fetching repository @boringssl; starting ... (14 fetches) 2024-12-18T00:02:18.2250473Z 2024-12-18T00:02:18.2250757Z  2024-12-18T00:02:18.2251088Z  2024-12-18T00:02:18.2251403Z  2024-12-18T00:02:18.2251737Z  2024-12-18T00:02:18.2252068Z  2024-12-18T00:02:18.2252369Z  2024-12-18T00:02:18.2252630Z  2024-12-18T00:02:18.2252865Z  2024-12-18T00:02:18.2253089Z  2024-12-18T00:02:18.2253326Z  2024-12-18T00:02:18.2253706Z DEBUG: Repository pybind11 instantiated at: 2024-12-18T00:02:18.2254213Z /var/lib/jenkins/workspace/xla/WORKSPACE:12:13: in 2024-12-18T00:02:18.2254676Z Repository rule http_archive defined at: 2024-12-18T00:02:18.2255516Z /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in 2024-12-18T00:02:18.2256732Z Analyzing: target //:_XLAC.so (172 packages loaded, 12490 targets configured) 2024-12-18T00:02:18.2257383Z currently loading: @xla//xla/mlir_hlo ... (3 packages) 2024-12-18T00:02:18.2257839Z Fetching repository @pybind11; starting 2024-12-18T00:02:18.2258234Z Fetching repository @eigen_archive; starting 2024-12-18T00:02:18.2258642Z Fetching repository @llvm-project; starting 2024-12-18T00:02:18.2259051Z Fetching repository @double_conversion; starting 2024-12-18T00:02:18.2259452Z Fetching repository @stablehlo; starting 2024-12-18T00:02:18.2259949Z Fetching ...rchive; Extracting eigen-33d0937c6bdf5ec999939fb17f2a553183d14\ 2024-12-18T00:02:18.2260467Z a74.tar.gz 2024-12-18T00:02:18.2260717Z Fetching repository @curl; starting 2024-12-18T00:02:18.2261155Z Fetching repository @boringssl; starting ... (14 fetches) 2024-12-18T00:02:18.4278139Z 2024-12-18T00:02:18.4278835Z  2024-12-18T00:02:18.4279134Z  2024-12-18T00:02:18.4279374Z  2024-12-18T00:02:18.4279640Z  2024-12-18T00:02:18.4279889Z  2024-12-18T00:02:18.4280127Z  2024-12-18T00:02:18.4280363Z  2024-12-18T00:02:18.4280600Z  2024-12-18T00:02:18.4280867Z  2024-12-18T00:02:18.4281090Z  2024-12-18T00:02:18.4281604Z Analyzing: target //:_XLAC.so (182 packages loaded, 13915 targets configured) 2024-12-18T00:02:18.4282182Z currently loading: @xla//xla/mlir_hlo ... (4 packages) 2024-12-18T00:02:18.4282640Z Fetching repository @llvm-project; starting 2024-12-18T00:02:18.4283028Z Fetching repository @stablehlo; starting 2024-12-18T00:02:18.4283373Z Fetching repository @curl; starting 2024-12-18T00:02:18.4283726Z Fetching repository @boringssl; starting 2024-12-18T00:02:18.4284250Z Fetching https://storage.googleapis.com/...a4bcdc.tar.gz; 10.6 MiB (25.6%) 2024-12-18T00:02:18.4284882Z Fetching https://storage.googleapis.com/...625447fb6d.zip; 8.0 MiB (42.2%) 2024-12-18T00:02:18.4285501Z Fetching ...74777805232118ec5/external/curl; Extracting curl-8.11.0.tar.gz 2024-12-18T00:02:18.4286051Z Fetching repository @pypi_torch; starting ... (9 fetches) 2024-12-18T00:02:18.6892615Z 2024-12-18T00:02:18.6893306Z  2024-12-18T00:02:18.6893581Z  2024-12-18T00:02:18.6893840Z  2024-12-18T00:02:18.6894082Z  2024-12-18T00:02:18.6894325Z  2024-12-18T00:02:18.6894568Z  2024-12-18T00:02:18.6895064Z  2024-12-18T00:02:18.6895301Z  2024-12-18T00:02:18.6895534Z  2024-12-18T00:02:18.6896064Z Analyzing: target //:_XLAC.so (187 packages loaded, 14243 targets configured) 2024-12-18T00:02:18.6896786Z currently loading: @llvm-project//mlir ... (2 packages) 2024-12-18T00:02:18.6897223Z Fetching repository @stablehlo; starting 2024-12-18T00:02:18.6897721Z Fetching repository @boringssl; starting 2024-12-18T00:02:18.6898221Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:18.6898688Z ch) 2024-12-18T00:02:18.6899071Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2024-12-18T00:02:18.6899538Z yaml==6.0.1) 2024-12-18T00:02:18.6899929Z Fetching ...blehlo; Extracting d1db6dfe13488b4735a6f08c324145625447fb6d.zi\ 2024-12-18T00:02:18.6900394Z p 2024-12-18T00:02:18.6900769Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2024-12-18T00:02:18.6901237Z r.gz 2024-12-18T00:02:18.8912539Z 2024-12-18T00:02:18.8913219Z  2024-12-18T00:02:18.8913562Z  2024-12-18T00:02:18.8913827Z  2024-12-18T00:02:18.8914085Z  2024-12-18T00:02:18.8914340Z  2024-12-18T00:02:18.8914598Z  2024-12-18T00:02:18.8914853Z  2024-12-18T00:02:18.8915100Z  2024-12-18T00:02:18.8915341Z  2024-12-18T00:02:18.8915578Z  2024-12-18T00:02:18.8915834Z  2024-12-18T00:02:18.8916369Z Analyzing: target //:_XLAC.so (205 packages loaded, 20477 targets configured) 2024-12-18T00:02:18.8916909Z Fetching repository @stablehlo; starting 2024-12-18T00:02:18.8917292Z Fetching repository @boringssl; starting 2024-12-18T00:02:18.8917792Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:18.8918247Z ch) 2024-12-18T00:02:18.8918634Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2024-12-18T00:02:18.8919115Z yaml==6.0.1) 2024-12-18T00:02:18.8919520Z Fetching ...blehlo; Extracting d1db6dfe13488b4735a6f08c324145625447fb6d.zi\ 2024-12-18T00:02:18.8919982Z p 2024-12-18T00:02:18.8920341Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2024-12-18T00:02:18.8920799Z r.gz 2024-12-18T00:02:18.8921045Z Fetching repository @onednn; starting 2024-12-18T00:02:18.8921442Z Fetching repository @ducc; starting ... (10 fetches) 2024-12-18T00:02:19.1649273Z 2024-12-18T00:02:19.1656900Z  2024-12-18T00:02:19.1657603Z  2024-12-18T00:02:19.1657991Z  2024-12-18T00:02:19.1658384Z  2024-12-18T00:02:19.1658763Z  2024-12-18T00:02:19.1659130Z  2024-12-18T00:02:19.1659483Z  2024-12-18T00:02:19.1659854Z  2024-12-18T00:02:19.1660206Z  2024-12-18T00:02:19.1660573Z  2024-12-18T00:02:19.1660944Z  2024-12-18T00:02:19.1661309Z  2024-12-18T00:02:19.1662206Z Analyzing: target //:_XLAC.so (206 packages loaded, 21882 targets configured) 2024-12-18T00:02:19.1663166Z currently loading: @stablehlo// 2024-12-18T00:02:19.1663783Z Fetching repository @boringssl; starting 2024-12-18T00:02:19.1664638Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:19.1665471Z ch) 2024-12-18T00:02:19.1666079Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2024-12-18T00:02:19.1666859Z yaml==6.0.1) 2024-12-18T00:02:19.1667516Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2024-12-18T00:02:19.1668335Z r.gz 2024-12-18T00:02:19.1668740Z Fetching repository @onednn; starting 2024-12-18T00:02:19.1669589Z Fetching ...b58aa74777805232118ec5/external/onednn; Extracting v3.5.tar.gz 2024-12-18T00:02:19.3742965Z 2024-12-18T00:02:19.3743660Z  2024-12-18T00:02:19.3743942Z  2024-12-18T00:02:19.3744390Z  2024-12-18T00:02:19.3744674Z  2024-12-18T00:02:19.3744911Z  2024-12-18T00:02:19.3745144Z  2024-12-18T00:02:19.3745412Z  2024-12-18T00:02:19.3746088Z  2024-12-18T00:02:19.3746394Z  2024-12-18T00:02:19.3746724Z  2024-12-18T00:02:19.3747243Z Analyzing: target //:_XLAC.so (207 packages loaded, 22789 targets configured) 2024-12-18T00:02:19.3747784Z Fetching repository @boringssl; starting 2024-12-18T00:02:19.3748277Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:19.3748870Z ch) 2024-12-18T00:02:19.3749252Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2024-12-18T00:02:19.3749725Z yaml==6.0.1) 2024-12-18T00:02:19.3750101Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2024-12-18T00:02:19.3750562Z r.gz 2024-12-18T00:02:19.3750807Z Fetching repository @onednn; starting 2024-12-18T00:02:19.3751292Z Fetching ...b58aa74777805232118ec5/external/onednn; Extracting v3.5.tar.gz 2024-12-18T00:02:19.3751819Z Fetching repository @com_nlohmann_json; starting 2024-12-18T00:02:19.3752329Z Fetching ...32118ec5/external/com_nlohmann_json; Extracting v3.11.2.tar.gz 2024-12-18T00:02:19.6234295Z 2024-12-18T00:02:19.6235146Z  2024-12-18T00:02:19.6235607Z  2024-12-18T00:02:19.6236009Z  2024-12-18T00:02:19.6236396Z  2024-12-18T00:02:19.6236793Z  2024-12-18T00:02:19.6237188Z  2024-12-18T00:02:19.6237594Z  2024-12-18T00:02:19.6237977Z  2024-12-18T00:02:19.6238395Z  2024-12-18T00:02:19.6238785Z  2024-12-18T00:02:19.6239182Z  2024-12-18T00:02:19.6240078Z Analyzing: target //:_XLAC.so (208 packages loaded, 22796 targets configured) 2024-12-18T00:02:19.6241011Z Fetching repository @boringssl; starting 2024-12-18T00:02:19.6241910Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:19.6242756Z ch) 2024-12-18T00:02:19.6243428Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2024-12-18T00:02:19.6244511Z yaml==6.0.1) 2024-12-18T00:02:19.6245245Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2024-12-18T00:02:19.6246091Z r.gz 2024-12-18T00:02:19.6246494Z Fetching repository @onednn; starting 2024-12-18T00:02:19.6247382Z Fetching ...b58aa74777805232118ec5/external/onednn; Extracting v3.5.tar.gz 2024-12-18T00:02:19.9853270Z 2024-12-18T00:02:19.9853973Z  2024-12-18T00:02:19.9854363Z  2024-12-18T00:02:19.9854645Z  2024-12-18T00:02:19.9854953Z  2024-12-18T00:02:19.9855196Z  2024-12-18T00:02:19.9855434Z  2024-12-18T00:02:19.9855734Z  2024-12-18T00:02:19.9855982Z  2024-12-18T00:02:19.9856204Z  2024-12-18T00:02:19.9856877Z Analyzing: target //:_XLAC.so (209 packages loaded, 23929 targets configured) 2024-12-18T00:02:19.9857479Z currently loading: @boringssl// 2024-12-18T00:02:19.9858023Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:19.9858496Z ch) 2024-12-18T00:02:19.9858955Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2024-12-18T00:02:19.9859457Z yaml==6.0.1) 2024-12-18T00:02:20.2240565Z 2024-12-18T00:02:20.2241269Z  2024-12-18T00:02:20.2241574Z  2024-12-18T00:02:20.2241801Z  2024-12-18T00:02:20.2242038Z  2024-12-18T00:02:20.2242274Z  2024-12-18T00:02:20.2242818Z Analyzing: target //:_XLAC.so (210 packages loaded, 24945 targets configured) 2024-12-18T00:02:20.2243472Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:20.2243921Z ch) 2024-12-18T00:02:20.2244537Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2024-12-18T00:02:20.2245017Z yaml==6.0.1) 2024-12-18T00:02:20.5989331Z 2024-12-18T00:02:20.5990049Z  2024-12-18T00:02:20.5990323Z  2024-12-18T00:02:20.5990566Z  2024-12-18T00:02:20.5990829Z  2024-12-18T00:02:20.5991470Z Analyzing: target //:_XLAC.so (210 packages loaded, 24945 targets configured) 2024-12-18T00:02:20.5992843Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:20.5993339Z ch) 2024-12-18T00:02:20.5993740Z Fetching ...pyyaml; Running whl_library.ExtractWheel(pypi_pyyaml, /home/je\ 2024-12-18T00:02:20.5994642Z nkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/py\ 2024-12-18T00:02:20.5995945Z pi_pyyaml/PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.\ 2024-12-18T00:02:20.5996741Z whl) 2024-12-18T00:02:20.8245833Z 2024-12-18T00:02:20.8246483Z  2024-12-18T00:02:20.8246757Z  2024-12-18T00:02:20.8246996Z  2024-12-18T00:02:20.8247229Z  2024-12-18T00:02:20.8247460Z  2024-12-18T00:02:20.8247677Z  2024-12-18T00:02:20.8248190Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:20.8248844Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2024-12-18T00:02:20.8249340Z ch) 2024-12-18T00:02:21.2251942Z 2024-12-18T00:02:21.2252711Z  2024-12-18T00:02:21.2253089Z  2024-12-18T00:02:21.2253768Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:21.2254432Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2024-12-18T00:02:21.2255084Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:21.2255665Z i_torch/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl) 2024-12-18T00:02:22.4259391Z 2024-12-18T00:02:22.4259944Z  2024-12-18T00:02:22.4260360Z  2024-12-18T00:02:22.4260715Z  2024-12-18T00:02:22.4261315Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:22.4262052Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2024-12-18T00:02:22.4262685Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:22.4263314Z i_torch/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl) 4s 2024-12-18T00:02:23.4263739Z 2024-12-18T00:02:23.4264544Z  2024-12-18T00:02:23.4264924Z  2024-12-18T00:02:23.4265168Z  2024-12-18T00:02:23.4265680Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:23.4266358Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2024-12-18T00:02:23.4266988Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:23.4267578Z i_torch/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl) 5s 2024-12-18T00:02:24.4270217Z 2024-12-18T00:02:24.4271067Z  2024-12-18T00:02:24.4271365Z  2024-12-18T00:02:24.4271604Z  2024-12-18T00:02:24.4272124Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:24.4272778Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2024-12-18T00:02:24.4279452Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:24.4280143Z i_torch/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl) 6s 2024-12-18T00:02:25.6280328Z 2024-12-18T00:02:25.6280993Z  2024-12-18T00:02:25.6281333Z  2024-12-18T00:02:25.6281597Z  2024-12-18T00:02:25.6282157Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:25.6282834Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2024-12-18T00:02:25.6283539Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:25.6284142Z i_torch/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl) 7s 2024-12-18T00:02:26.6288912Z 2024-12-18T00:02:26.6289522Z  2024-12-18T00:02:26.6289827Z  2024-12-18T00:02:26.6290072Z  2024-12-18T00:02:26.6290577Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:26.6291538Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2024-12-18T00:02:26.6292174Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:26.6292771Z i_torch/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl) 8s 2024-12-18T00:02:27.6298786Z 2024-12-18T00:02:27.6299997Z  2024-12-18T00:02:27.6300386Z  2024-12-18T00:02:27.6300613Z  2024-12-18T00:02:27.6301145Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:27.6301802Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2024-12-18T00:02:27.6302435Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:27.6303026Z i_torch/torch-2.6.0a0+git0cdf8b1-cp310-cp310-linux_x86_64.whl) 9s 2024-12-18T00:02:28.4639835Z 2024-12-18T00:02:28.4640506Z  2024-12-18T00:02:28.4640810Z  2024-12-18T00:02:28.4641036Z  2024-12-18T00:02:28.4641561Z Analyzing: target //:_XLAC.so (211 packages loaded, 24945 targets configured) 2024-12-18T00:02:28.4642090Z currently loading: @pypi_torch// 2024-12-18T00:02:28.8305766Z 2024-12-18T00:02:28.8306411Z  2024-12-18T00:02:28.8307066Z Analyzing: target //:_XLAC.so (213 packages loaded, 27266 targets configured) 2024-12-18T00:02:28.8307747Z Fetching ...nsions; Running whl_library.ResolveRequirement(pypi_typing_ext\ 2024-12-18T00:02:28.8308258Z ensions, typing-extensions==4.11.0) 2024-12-18T00:02:28.8308747Z Fetching ..._sympy; Running whl_library.ResolveRequirement(pypi_sympy, sym\ 2024-12-18T00:02:28.8309215Z py==1.12) 2024-12-18T00:02:28.8309605Z Fetching ...jinja2; Running whl_library.ResolveRequirement(pypi_jinja2, ji\ 2024-12-18T00:02:28.8310074Z nja2==3.1.4) 2024-12-18T00:02:28.8310456Z Fetching ...fsspec; Running whl_library.ResolveRequirement(pypi_fsspec, fs\ 2024-12-18T00:02:28.8310939Z spec==2024.5.0) 2024-12-18T00:02:28.8311339Z Fetching ...tworkx; Running whl_library.ResolveRequirement(pypi_networkx, \ 2024-12-18T00:02:28.8311810Z networkx==3.3) 2024-12-18T00:02:28.8312207Z Fetching ...lelock; Running whl_library.ResolveRequirement(pypi_filelock, \ 2024-12-18T00:02:28.8312678Z filelock==3.14.0) 2024-12-18T00:02:29.3541645Z 2024-12-18T00:02:29.3542334Z  2024-12-18T00:02:29.3542641Z  2024-12-18T00:02:29.3542868Z  2024-12-18T00:02:29.3543108Z  2024-12-18T00:02:29.3543343Z  2024-12-18T00:02:29.3543579Z  2024-12-18T00:02:29.3543800Z  2024-12-18T00:02:29.3544033Z  2024-12-18T00:02:29.3544463Z  2024-12-18T00:02:29.3544702Z  2024-12-18T00:02:29.3544935Z  2024-12-18T00:02:29.3545181Z  2024-12-18T00:02:29.3545698Z Analyzing: target //:_XLAC.so (213 packages loaded, 27266 targets configured) 2024-12-18T00:02:29.3546348Z Fetching ...nsions; Running whl_library.ResolveRequirement(pypi_typing_ext\ 2024-12-18T00:02:29.3546860Z ensions, typing-extensions==4.11.0) 2024-12-18T00:02:29.3547331Z Fetching ..._sympy; Running whl_library.ResolveRequirement(pypi_sympy, sym\ 2024-12-18T00:02:29.3547795Z py==1.12) 2024-12-18T00:02:29.3548172Z Fetching ...jinja2; Running whl_library.ExtractWheel(pypi_jinja2, /home/je\ 2024-12-18T00:02:29.3548806Z nkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/py\ 2024-12-18T00:02:29.3549299Z pi_jinja2/jinja2-3.1.4-py3-none-any.whl) 2024-12-18T00:02:29.3549784Z Fetching ...fsspec; Running whl_library.ResolveRequirement(pypi_fsspec, fs\ 2024-12-18T00:02:29.3550257Z spec==2024.5.0) 2024-12-18T00:02:29.3550653Z Fetching ...tworkx; Running whl_library.ResolveRequirement(pypi_networkx, \ 2024-12-18T00:02:29.3551129Z networkx==3.3) 2024-12-18T00:02:29.3551515Z Fetching ...lelock; Running whl_library.ResolveRequirement(pypi_filelock, \ 2024-12-18T00:02:29.3551988Z filelock==3.14.0) 2024-12-18T00:02:29.6313918Z 2024-12-18T00:02:29.6314387Z  2024-12-18T00:02:29.6314667Z  2024-12-18T00:02:29.6314910Z  2024-12-18T00:02:29.6315135Z  2024-12-18T00:02:29.6315375Z  2024-12-18T00:02:29.6315605Z  2024-12-18T00:02:29.6315837Z  2024-12-18T00:02:29.6316057Z  2024-12-18T00:02:29.6316291Z  2024-12-18T00:02:29.6316521Z  2024-12-18T00:02:29.6317039Z  2024-12-18T00:02:29.6317297Z  2024-12-18T00:02:29.6317515Z  2024-12-18T00:02:29.6318020Z Analyzing: target //:_XLAC.so (216 packages loaded, 27266 targets configured) 2024-12-18T00:02:29.6318675Z Fetching ..._sympy; Running whl_library.ExtractWheel(pypi_sympy, /home/jen\ 2024-12-18T00:02:29.6319309Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:29.6319815Z i_sympy/sympy-1.12-py3-none-any.whl) 2024-12-18T00:02:29.6320281Z Fetching ...fsspec; Running whl_library.ExtractWheel(pypi_fsspec, /home/je\ 2024-12-18T00:02:29.6320918Z nkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/py\ 2024-12-18T00:02:29.6321433Z pi_fsspec/fsspec-2024.5.0-py3-none-any.whl) 2024-12-18T00:02:29.6321924Z Fetching ...tworkx; Running whl_library.ExtractWheel(pypi_networkx, /home/\ 2024-12-18T00:02:29.6322544Z jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/\ 2024-12-18T00:02:29.6323067Z pypi_networkx/networkx-3.3-py3-none-any.whl) 2024-12-18T00:02:30.0319048Z 2024-12-18T00:02:30.0319684Z  2024-12-18T00:02:30.0319984Z  2024-12-18T00:02:30.0320225Z  2024-12-18T00:02:30.0320458Z  2024-12-18T00:02:30.0320702Z  2024-12-18T00:02:30.0320923Z  2024-12-18T00:02:30.0321152Z  2024-12-18T00:02:30.0321387Z  2024-12-18T00:02:30.0321617Z  2024-12-18T00:02:30.0322144Z Analyzing: target //:_XLAC.so (218 packages loaded, 27266 targets configured) 2024-12-18T00:02:30.0322790Z Fetching ..._sympy; Running whl_library.ExtractWheel(pypi_sympy, /home/jen\ 2024-12-18T00:02:30.0323446Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2024-12-18T00:02:30.0323948Z i_sympy/sympy-1.12-py3-none-any.whl) 2024-12-18T00:02:30.2320879Z 2024-12-18T00:02:30.2321652Z  2024-12-18T00:02:30.2322108Z  2024-12-18T00:02:30.2322507Z  2024-12-18T00:02:30.2323422Z Analyzing: target //:_XLAC.so (219 packages loaded, 27266 targets configured) 2024-12-18T00:02:30.6325719Z 2024-12-18T00:02:30.6326527Z Analyzing: target //:_XLAC.so (219 packages loaded, 38980 targets configured) 2024-12-18T00:02:30.6327225Z Fetching ...upsafe; Running whl_library.ResolveRequirement(pypi_markupsafe\ 2024-12-18T00:02:30.6327734Z , markupsafe==2.1.5) 2024-12-18T00:02:30.6328155Z Fetching ...mpmath; Running whl_library.ResolveRequirement(pypi_mpmath, mp\ 2024-12-18T00:02:30.6328633Z math==1.3.0) 2024-12-18T00:02:31.3583174Z 2024-12-18T00:02:31.3583845Z  2024-12-18T00:02:31.3584170Z  2024-12-18T00:02:31.3584408Z  2024-12-18T00:02:31.3584643Z  2024-12-18T00:02:31.3585158Z Analyzing: target //:_XLAC.so (219 packages loaded, 38980 targets configured) 2024-12-18T00:02:31.3585830Z Fetching ...upsafe; Running whl_library.ResolveRequirement(pypi_markupsafe\ 2024-12-18T00:02:31.3586310Z , markupsafe==2.1.5) 2024-12-18T00:02:31.3586737Z Fetching ...mpmath; Running whl_library.ExtractWheel(pypi_mpmath, /home/je\ 2024-12-18T00:02:31.3587373Z nkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/py\ 2024-12-18T00:02:31.3587872Z pi_mpmath/mpmath-1.3.0-py3-none-any.whl) 2024-12-18T00:02:31.5700488Z 2024-12-18T00:02:31.5701230Z  2024-12-18T00:02:31.5701519Z  2024-12-18T00:02:31.5701759Z  2024-12-18T00:02:31.5702055Z  2024-12-18T00:02:31.5702357Z  2024-12-18T00:02:31.5703017Z Analyzing: target //:_XLAC.so (220 packages loaded, 40560 targets configured) 2024-12-18T00:02:31.5704082Z Fetching ...upsafe; Running whl_library.ExtractWheel(pypi_markupsafe, /hom\ 2024-12-18T00:02:31.5704727Z e/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/externa\ 2024-12-18T00:02:31.5705380Z l/pypi_markupsafe/MarkupSafe-2.1.5-cp310-cp310-manylinux_2_17_x86_64.manylinux\ 2024-12-18T00:02:31.5705875Z 2014_x86_64.whl) 2024-12-18T00:02:31.8336741Z 2024-12-18T00:02:31.8337399Z  2024-12-18T00:02:31.8337908Z  2024-12-18T00:02:31.8338141Z  2024-12-18T00:02:31.8338375Z  2024-12-18T00:02:31.8338897Z Analyzing: target //:_XLAC.so (221 packages loaded, 40617 targets configured) 2024-12-18T00:02:32.0473026Z 2024-12-18T00:02:32.0474001Z INFO: Analyzed target //:_XLAC.so (221 packages loaded, 40618 targets configured). 2024-12-18T00:02:32.0474606Z  checking cached actions 2024-12-18T00:02:32.0502302Z 2024-12-18T00:02:32.0502522Z INFO: Found 1 target... 2024-12-18T00:02:32.0502908Z  checking cached actions 2024-12-18T00:02:32.2298775Z 2024-12-18T00:02:32.2299719Z [0 / 41] 10 actions, 0 running 2024-12-18T00:02:32.2300439Z @llvm-project//llvm:targets_def_gen; 0s local 2024-12-18T00:02:32.2301204Z [Prepa] BazelWorkspaceStatusAction stable-status.txt 2024-12-18T00:02:32.2301965Z [Prepa] Writing file _XLAC.so-2.params 2024-12-18T00:02:32.2302574Z [Prepa] @torch//:libtorch 2024-12-18T00:02:32.2303133Z [Prepa] @torch//:libc10 2024-12-18T00:02:32.3939856Z 2024-12-18T00:02:32.3940629Z  2024-12-18T00:02:32.3941085Z  2024-12-18T00:02:32.3941480Z  2024-12-18T00:02:32.3941880Z  2024-12-18T00:02:32.3942276Z  2024-12-18T00:02:32.3942821Z [331 / 15,179] 40 actions, 36 running 2024-12-18T00:02:32.3943711Z Executing genrule @local_config_python//:python_include; 0s local 2024-12-18T00:02:32.3944991Z Compiling src/google/protobuf/stubs/bytestream.cc [for tool]; 0s local 2024-12-18T00:02:32.3946133Z Compiling src/google/protobuf/repeated_ptr_field.cc [for tool]; 0s local 2024-12-18T00:02:32.3947272Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2024-12-18T00:02:32.3948406Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 0s local 2024-12-18T00:02:32.3949613Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 0s local 2024-12-18T00:02:32.3950594Z Compiling src/google/protobuf/any_lite.cc; 0s local 2024-12-18T00:02:32.3951366Z Compiling absl/base/log_severity.cc; 0s local ... 2024-12-18T00:02:32.6616978Z 2024-12-18T00:02:32.6618012Z  2024-12-18T00:02:32.6618511Z  2024-12-18T00:02:32.6618906Z  2024-12-18T00:02:32.6619308Z  2024-12-18T00:02:32.6619700Z  2024-12-18T00:02:32.6620105Z  2024-12-18T00:02:32.6620490Z  2024-12-18T00:02:32.6620883Z  2024-12-18T00:02:32.6621491Z [506 / 15,187] 44 actions, 39 running 2024-12-18T00:02:32.6622370Z Executing genrule @local_config_python//:python_include; 0s local 2024-12-18T00:02:32.6623492Z Compiling src/google/protobuf/stubs/bytestream.cc [for tool]; 0s local 2024-12-18T00:02:32.6624583Z Compiling src/google/protobuf/repeated_ptr_field.cc [for tool]; 0s local 2024-12-18T00:02:32.6625620Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2024-12-18T00:02:32.6626746Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 0s local 2024-12-18T00:02:32.6627960Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 0s local 2024-12-18T00:02:32.6628905Z Compiling src/google/protobuf/any_lite.cc; 0s local 2024-12-18T00:02:32.6629691Z Compiling absl/base/log_severity.cc; 0s local ... 2024-12-18T00:02:32.8607767Z 2024-12-18T00:02:32.8609503Z  2024-12-18T00:02:32.8609937Z  2024-12-18T00:02:32.8610299Z  2024-12-18T00:02:32.8610642Z  2024-12-18T00:02:32.8611005Z  2024-12-18T00:02:32.8611378Z  2024-12-18T00:02:32.8611764Z  2024-12-18T00:02:32.8612116Z  2024-12-18T00:02:32.8613057Z [693 / 15,187] 43 actions, 41 running 2024-12-18T00:02:32.8613971Z Compiling src/google/protobuf/stubs/bytestream.cc [for tool]; 0s local 2024-12-18T00:02:32.8615118Z Compiling src/google/protobuf/repeated_ptr_field.cc [for tool]; 0s local 2024-12-18T00:02:32.8616179Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2024-12-18T00:02:32.8617666Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 0s local 2024-12-18T00:02:32.8618846Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 0s local 2024-12-18T00:02:32.8619721Z Compiling src/google/protobuf/any_lite.cc; 0s local 2024-12-18T00:02:32.8620568Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 0s local 2024-12-18T00:02:32.8621596Z Compiling mlir/lib/ExecutionEngine/CRunnerUtils.cpp; 0s local ... 2024-12-18T00:02:33.0431397Z 2024-12-18T00:02:33.0432246Z  2024-12-18T00:02:33.0432710Z  2024-12-18T00:02:33.0433098Z  2024-12-18T00:02:33.0433526Z  2024-12-18T00:02:33.0433908Z  2024-12-18T00:02:33.0434292Z  2024-12-18T00:02:33.0434668Z  2024-12-18T00:02:33.0435036Z  2024-12-18T00:02:33.0435626Z [1,011 / 15,187] 43 actions, 40 running 2024-12-18T00:02:33.0436505Z Compiling src/google/protobuf/stubs/bytestream.cc [for tool]; 0s local 2024-12-18T00:02:33.0437630Z Compiling src/google/protobuf/repeated_ptr_field.cc [for tool]; 0s local 2024-12-18T00:02:33.0438695Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2024-12-18T00:02:33.0439750Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 0s local 2024-12-18T00:02:33.0440839Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 0s local 2024-12-18T00:02:33.0441734Z Compiling src/google/protobuf/any_lite.cc; 0s local 2024-12-18T00:02:33.0443065Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 0s local 2024-12-18T00:02:33.0444703Z Compiling mlir/lib/ExecutionEngine/CRunnerUtils.cpp; 0s local ... 2024-12-18T00:02:33.2041080Z 2024-12-18T00:02:33.2042046Z  2024-12-18T00:02:33.2042791Z  2024-12-18T00:02:33.2043284Z  2024-12-18T00:02:33.2043767Z  2024-12-18T00:02:33.2044379Z  2024-12-18T00:02:33.2044864Z  2024-12-18T00:02:33.2045263Z  2024-12-18T00:02:33.2045662Z  2024-12-18T00:02:33.2046263Z [1,311 / 15,187] 43 actions, 41 running 2024-12-18T00:02:33.2047190Z Compiling src/google/protobuf/repeated_ptr_field.cc [for tool]; 0s local 2024-12-18T00:02:33.2048238Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 0s local 2024-12-18T00:02:33.2049232Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 0s local 2024-12-18T00:02:33.2050069Z Compiling src/google/protobuf/any_lite.cc; 0s local 2024-12-18T00:02:33.2050837Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 0s local 2024-12-18T00:02:33.2051690Z Compiling mlir/lib/ExecutionEngine/CRunnerUtils.cpp; 0s local 2024-12-18T00:02:33.2052623Z Compiling src/google/protobuf/any_lite.cc [for tool]; 0s local 2024-12-18T00:02:33.2053599Z Compiling src/google/protobuf/arenastring.cc [for tool]; 0s local ... 2024-12-18T00:02:33.4048223Z 2024-12-18T00:02:33.4049545Z  2024-12-18T00:02:33.4050006Z  2024-12-18T00:02:33.4050396Z  2024-12-18T00:02:33.4050804Z  2024-12-18T00:02:33.4051219Z  2024-12-18T00:02:33.4051625Z  2024-12-18T00:02:33.4051996Z  2024-12-18T00:02:33.4052384Z  2024-12-18T00:02:33.4052959Z [1,716 / 15,187] 43 actions, 41 running 2024-12-18T00:02:33.4053815Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:33.4054927Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 1s local 2024-12-18T00:02:33.4055920Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 1s local 2024-12-18T00:02:33.4056972Z Compiling mlir/lib/ExecutionEngine/CRunnerUtils.cpp; 1s local 2024-12-18T00:02:33.4058221Z Compiling src/google/protobuf/any_lite.cc [for tool]; 1s local 2024-12-18T00:02:33.4059152Z Compiling src/google/protobuf/arenastring.cc [for tool]; 1s local 2024-12-18T00:02:33.4060090Z Compiling src/google/protobuf/arena.cc [for tool]; 1s local 2024-12-18T00:02:33.4060903Z @llvm-project//llvm:llvm-min-tblgen; 1s local ... 2024-12-18T00:02:33.6057155Z 2024-12-18T00:02:33.6058252Z  2024-12-18T00:02:33.6058729Z  2024-12-18T00:02:33.6059119Z  2024-12-18T00:02:33.6059507Z  2024-12-18T00:02:33.6059892Z  2024-12-18T00:02:33.6060223Z  2024-12-18T00:02:33.6060618Z  2024-12-18T00:02:33.6061019Z  2024-12-18T00:02:33.6061590Z [1,970 / 15,187] 44 actions, 41 running 2024-12-18T00:02:33.6062575Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:33.6063753Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 1s local 2024-12-18T00:02:33.6064854Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 1s local 2024-12-18T00:02:33.6065732Z @llvm-project//llvm:llvm-min-tblgen; 1s local 2024-12-18T00:02:33.6066582Z Compiling llvm/utils/TableGen/VTEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:33.6067625Z Compiling src/google/protobuf/wire_format_lite.cc [for tool]; 1s local 2024-12-18T00:02:33.6068639Z Compiling src/google/protobuf/extension_set.cc [for tool]; 1s local 2024-12-18T00:02:33.6069517Z @llvm-project//llvm:llvm-min-tblgen; 1s local ... 2024-12-18T00:02:33.8452494Z 2024-12-18T00:02:33.8453349Z  2024-12-18T00:02:33.8453779Z  2024-12-18T00:02:33.8454107Z  2024-12-18T00:02:33.8454472Z  2024-12-18T00:02:33.8454830Z  2024-12-18T00:02:33.8455183Z  2024-12-18T00:02:33.8455525Z  2024-12-18T00:02:33.8455898Z  2024-12-18T00:02:33.8456598Z [2,179 / 15,187] 43 actions, 41 running 2024-12-18T00:02:33.8457564Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:33.8458708Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 1s local 2024-12-18T00:02:33.8459760Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 1s local 2024-12-18T00:02:33.8460515Z @llvm-project//llvm:llvm-min-tblgen; 1s local 2024-12-18T00:02:33.8461373Z Compiling llvm/utils/TableGen/VTEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:33.8462479Z Compiling src/google/protobuf/wire_format_lite.cc [for tool]; 1s local 2024-12-18T00:02:33.8463604Z Compiling src/google/protobuf/extension_set.cc [for tool]; 1s local 2024-12-18T00:02:33.8464350Z @llvm-project//llvm:llvm-min-tblgen; 1s local ... 2024-12-18T00:02:34.0361610Z 2024-12-18T00:02:34.0362394Z  2024-12-18T00:02:34.0362922Z  2024-12-18T00:02:34.0363193Z  2024-12-18T00:02:34.0363532Z  2024-12-18T00:02:34.0363792Z  2024-12-18T00:02:34.0364096Z  2024-12-18T00:02:34.0364434Z  2024-12-18T00:02:34.0364771Z  2024-12-18T00:02:34.0365211Z [2,627 / 15,187] 45 actions, 41 running 2024-12-18T00:02:34.0365862Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:34.0366632Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 1s local 2024-12-18T00:02:34.0367310Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 1s local 2024-12-18T00:02:34.0367901Z @llvm-project//llvm:llvm-min-tblgen; 1s local 2024-12-18T00:02:34.0368474Z Compiling llvm/utils/TableGen/VTEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:34.0369144Z Compiling src/google/protobuf/wire_format_lite.cc [for tool]; 1s local 2024-12-18T00:02:34.0369840Z Compiling src/google/protobuf/extension_set.cc [for tool]; 1s local 2024-12-18T00:02:34.0370437Z @llvm-project//llvm:llvm-min-tblgen; 1s local ... 2024-12-18T00:02:34.2306872Z 2024-12-18T00:02:34.2307874Z  2024-12-18T00:02:34.2308336Z  2024-12-18T00:02:34.2308729Z  2024-12-18T00:02:34.2309449Z  2024-12-18T00:02:34.2309845Z  2024-12-18T00:02:34.2310241Z  2024-12-18T00:02:34.2310622Z  2024-12-18T00:02:34.2311020Z  2024-12-18T00:02:34.2311604Z [3,097 / 15,187] 46 actions, 43 running 2024-12-18T00:02:34.2312594Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:34.2314027Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 1s local 2024-12-18T00:02:34.2315118Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 1s local 2024-12-18T00:02:34.2316147Z @llvm-project//llvm:llvm-min-tblgen; 1s local 2024-12-18T00:02:34.2317027Z Compiling llvm/utils/TableGen/VTEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:34.2318340Z Compiling src/google/protobuf/extension_set.cc [for tool]; 1s local 2024-12-18T00:02:34.2319479Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 1s local 2024-12-18T00:02:34.2320565Z @llvm-project//llvm:llvm-min-tblgen; 1s local ... 2024-12-18T00:02:34.4474790Z 2024-12-18T00:02:34.4475683Z  2024-12-18T00:02:34.4476148Z  2024-12-18T00:02:34.4476531Z  2024-12-18T00:02:34.4476894Z  2024-12-18T00:02:34.4477260Z  2024-12-18T00:02:34.4477604Z  2024-12-18T00:02:34.4477991Z  2024-12-18T00:02:34.4478379Z  2024-12-18T00:02:34.4478972Z [3,652 / 15,187] 43 actions, 41 running 2024-12-18T00:02:34.4479976Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.4481134Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 2s local 2024-12-18T00:02:34.4482229Z Compiling llvm/utils/TableGen/TableGen.cpp [for tool]; 2s local 2024-12-18T00:02:34.4483141Z @llvm-project//llvm:llvm-min-tblgen; 2s local 2024-12-18T00:02:34.4484145Z Compiling llvm/utils/TableGen/VTEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.4485081Z Compiling src/google/protobuf/extension_set.cc [for tool]; 2s local 2024-12-18T00:02:34.4486181Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.4487132Z @llvm-project//llvm:llvm-min-tblgen; 2s local ... 2024-12-18T00:02:34.6316560Z 2024-12-18T00:02:34.6317616Z  2024-12-18T00:02:34.6318096Z  2024-12-18T00:02:34.6318498Z  2024-12-18T00:02:34.6318909Z  2024-12-18T00:02:34.6319300Z  2024-12-18T00:02:34.6319732Z  2024-12-18T00:02:34.6320176Z  2024-12-18T00:02:34.6320577Z  2024-12-18T00:02:34.6321179Z [4,204 / 15,187] 45 actions, 42 running 2024-12-18T00:02:34.6322174Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.6323419Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 2s local 2024-12-18T00:02:34.6324405Z @llvm-project//llvm:llvm-min-tblgen; 2s local 2024-12-18T00:02:34.6325307Z Compiling llvm/utils/TableGen/VTEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.6326392Z Compiling src/google/protobuf/extension_set.cc [for tool]; 2s local 2024-12-18T00:02:34.6327557Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.6328732Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.6329860Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 2s local ... 2024-12-18T00:02:34.8344602Z 2024-12-18T00:02:34.8345431Z  2024-12-18T00:02:34.8345972Z  2024-12-18T00:02:34.8346384Z  2024-12-18T00:02:34.8346798Z  2024-12-18T00:02:34.8347183Z  2024-12-18T00:02:34.8347580Z  2024-12-18T00:02:34.8347970Z  2024-12-18T00:02:34.8348349Z  2024-12-18T00:02:34.8348922Z [4,733 / 15,187] 47 actions, 43 running 2024-12-18T00:02:34.8349940Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.8351126Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 2s local 2024-12-18T00:02:34.8352111Z @llvm-project//llvm:llvm-min-tblgen; 2s local 2024-12-18T00:02:34.8353390Z Compiling src/google/protobuf/extension_set.cc [for tool]; 2s local 2024-12-18T00:02:34.8354542Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.8355700Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:34.8356789Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 2s local 2024-12-18T00:02:34.8357995Z Compiling xla/service/cpu/runtime_fork_join.cc; 2s local ... 2024-12-18T00:02:35.0349542Z 2024-12-18T00:02:35.0350370Z  2024-12-18T00:02:35.0350845Z  2024-12-18T00:02:35.0351238Z  2024-12-18T00:02:35.0351640Z  2024-12-18T00:02:35.0352068Z  2024-12-18T00:02:35.0352472Z  2024-12-18T00:02:35.0352874Z  2024-12-18T00:02:35.0353260Z  2024-12-18T00:02:35.0353860Z [5,255 / 15,187] 46 actions, 42 running 2024-12-18T00:02:35.0354842Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:35.0356059Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 2s local 2024-12-18T00:02:35.0357003Z @llvm-project//llvm:llvm-min-tblgen; 2s local 2024-12-18T00:02:35.0357879Z Compiling src/google/protobuf/extension_set.cc [for tool]; 2s local 2024-12-18T00:02:35.0358968Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:35.0360173Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:35.0361202Z Compiling xla/service/cpu/runtime_fork_join.cc; 2s local 2024-12-18T00:02:35.0362095Z Compiling xla/service/cpu/runtime_conv3d.cc; 2s local ... 2024-12-18T00:02:35.2349617Z 2024-12-18T00:02:35.2350512Z  2024-12-18T00:02:35.2350959Z  2024-12-18T00:02:35.2351339Z  2024-12-18T00:02:35.2351747Z  2024-12-18T00:02:35.2352106Z  2024-12-18T00:02:35.2352501Z  2024-12-18T00:02:35.2352861Z  2024-12-18T00:02:35.2353194Z  2024-12-18T00:02:35.2353787Z [5,419 / 15,187] 45 actions, 41 running 2024-12-18T00:02:35.2354653Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:35.2355698Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 2s local 2024-12-18T00:02:35.2356743Z Compiling src/google/protobuf/extension_set.cc [for tool]; 2s local 2024-12-18T00:02:35.2357712Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:35.2358895Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 2s local 2024-12-18T00:02:35.2359944Z Compiling xla/service/cpu/runtime_fork_join.cc; 2s local 2024-12-18T00:02:35.2360854Z Compiling xla/service/cpu/runtime_conv3d.cc; 2s local 2024-12-18T00:02:35.2361803Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 2s local ... 2024-12-18T00:02:35.4361184Z 2024-12-18T00:02:35.4362080Z  2024-12-18T00:02:35.4362533Z  2024-12-18T00:02:35.4362950Z  2024-12-18T00:02:35.4363373Z  2024-12-18T00:02:35.4363939Z  2024-12-18T00:02:35.4364330Z  2024-12-18T00:02:35.4364710Z  2024-12-18T00:02:35.4365097Z  2024-12-18T00:02:35.4365669Z [5,959 / 15,187] 44 actions, 42 running 2024-12-18T00:02:35.4366580Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.4367711Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:02:35.4368746Z Compiling src/google/protobuf/extension_set.cc [for tool]; 3s local 2024-12-18T00:02:35.4369881Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.4371036Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.4372041Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2024-12-18T00:02:35.4372880Z Compiling xla/service/cpu/runtime_conv3d.cc; 3s local 2024-12-18T00:02:35.4373889Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local ... 2024-12-18T00:02:35.6430571Z 2024-12-18T00:02:35.6431426Z  2024-12-18T00:02:35.6431973Z  2024-12-18T00:02:35.6432353Z  2024-12-18T00:02:35.6432841Z  2024-12-18T00:02:35.6433245Z  2024-12-18T00:02:35.6433635Z  2024-12-18T00:02:35.6434034Z  2024-12-18T00:02:35.6434382Z  2024-12-18T00:02:35.6435292Z [6,533 / 15,187] 44 actions, 41 running 2024-12-18T00:02:35.6436257Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.6437439Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:02:35.6438562Z Compiling src/google/protobuf/extension_set.cc [for tool]; 3s local 2024-12-18T00:02:35.6439716Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.6440873Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.6441893Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2024-12-18T00:02:35.6442766Z Compiling xla/service/cpu/runtime_conv3d.cc; 3s local 2024-12-18T00:02:35.6443641Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local ... 2024-12-18T00:02:35.8377330Z 2024-12-18T00:02:35.8378229Z  2024-12-18T00:02:35.8378694Z  2024-12-18T00:02:35.8379105Z  2024-12-18T00:02:35.8379485Z  2024-12-18T00:02:35.8379861Z  2024-12-18T00:02:35.8380290Z  2024-12-18T00:02:35.8380654Z  2024-12-18T00:02:35.8381096Z  2024-12-18T00:02:35.8381732Z [7,125 / 15,187] 47 actions, 44 running 2024-12-18T00:02:35.8382744Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.8383846Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:02:35.8384891Z Compiling src/google/protobuf/extension_set.cc [for tool]; 3s local 2024-12-18T00:02:35.8385967Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.8387115Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:35.8388075Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2024-12-18T00:02:35.8388820Z Compiling xla/service/cpu/runtime_conv3d.cc; 3s local 2024-12-18T00:02:35.8389758Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local ... 2024-12-18T00:02:36.0388235Z 2024-12-18T00:02:36.0389162Z  2024-12-18T00:02:36.0389673Z  2024-12-18T00:02:36.0390095Z  2024-12-18T00:02:36.0390515Z  2024-12-18T00:02:36.0390959Z  2024-12-18T00:02:36.0391368Z  2024-12-18T00:02:36.0391766Z  2024-12-18T00:02:36.0392159Z  2024-12-18T00:02:36.0392751Z [7,702 / 15,187] 46 actions, 45 running 2024-12-18T00:02:36.0393731Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:02:36.0394932Z Compiling src/google/protobuf/extension_set.cc [for tool]; 3s local 2024-12-18T00:02:36.0396103Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:36.0397231Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:36.0398307Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2024-12-18T00:02:36.0399119Z Compiling xla/service/cpu/runtime_conv3d.cc; 3s local 2024-12-18T00:02:36.0400002Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local 2024-12-18T00:02:36.0400840Z @com_google_protobuf//:protobuf_lite; 3s local ... 2024-12-18T00:02:36.2396895Z 2024-12-18T00:02:36.2397774Z  2024-12-18T00:02:36.2398241Z  2024-12-18T00:02:36.2398662Z  2024-12-18T00:02:36.2399049Z  2024-12-18T00:02:36.2399422Z  2024-12-18T00:02:36.2399791Z  2024-12-18T00:02:36.2400174Z  2024-12-18T00:02:36.2400550Z  2024-12-18T00:02:36.2401126Z [8,125 / 15,187] 48 actions, 45 running 2024-12-18T00:02:36.2402058Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:02:36.2403434Z Compiling src/google/protobuf/extension_set.cc [for tool]; 3s local 2024-12-18T00:02:36.2404526Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:36.2405666Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 3s local 2024-12-18T00:02:36.2406678Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2024-12-18T00:02:36.2407823Z Compiling xla/service/cpu/runtime_conv3d.cc; 3s local 2024-12-18T00:02:36.2408688Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local 2024-12-18T00:02:36.2409511Z @com_google_protobuf//:protobuf_lite; 3s local ... 2024-12-18T00:02:36.4411441Z 2024-12-18T00:02:36.4412361Z  2024-12-18T00:02:36.4412948Z  2024-12-18T00:02:36.4413438Z  2024-12-18T00:02:36.4413786Z  2024-12-18T00:02:36.4414220Z  2024-12-18T00:02:36.4414706Z  2024-12-18T00:02:36.4415097Z  2024-12-18T00:02:36.4415494Z  2024-12-18T00:02:36.4416199Z [8,477 / 15,187] 48 actions, 45 running 2024-12-18T00:02:36.4417265Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:02:36.4418493Z Compiling src/google/protobuf/extension_set.cc [for tool]; 4s local 2024-12-18T00:02:36.4419642Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:36.4420784Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:36.4421746Z Compiling xla/service/cpu/runtime_conv3d.cc; 4s local 2024-12-18T00:02:36.4422491Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2024-12-18T00:02:36.4423241Z @com_google_protobuf//:protobuf_lite; 3s local 2024-12-18T00:02:36.4423999Z Compiling xla/service/cpu/runtime_conv2d.cc; 3s local ... 2024-12-18T00:02:36.6418732Z 2024-12-18T00:02:36.6419729Z  2024-12-18T00:02:36.6420206Z  2024-12-18T00:02:36.6420590Z  2024-12-18T00:02:36.6421003Z  2024-12-18T00:02:36.6421436Z  2024-12-18T00:02:36.6421805Z  2024-12-18T00:02:36.6422212Z  2024-12-18T00:02:36.6422599Z  2024-12-18T00:02:36.6423197Z [8,936 / 15,187] 47 actions, 45 running 2024-12-18T00:02:36.6424037Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:02:36.6425102Z Compiling src/google/protobuf/extension_set.cc [for tool]; 4s local 2024-12-18T00:02:36.6426228Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:36.6427354Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:36.6428347Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2024-12-18T00:02:36.6429122Z @com_google_protobuf//:protobuf_lite; 3s local 2024-12-18T00:02:36.6429854Z Compiling xla/service/cpu/runtime_conv2d.cc; 3s local 2024-12-18T00:02:36.6430708Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local ... 2024-12-18T00:02:36.9341344Z 2024-12-18T00:02:36.9342201Z  2024-12-18T00:02:36.9342647Z  2024-12-18T00:02:36.9343054Z  2024-12-18T00:02:36.9343457Z  2024-12-18T00:02:36.9343859Z  2024-12-18T00:02:36.9344455Z  2024-12-18T00:02:36.9344850Z  2024-12-18T00:02:36.9345242Z  2024-12-18T00:02:36.9345823Z [9,093 / 15,187] 48 actions, 47 running 2024-12-18T00:02:36.9346808Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:02:36.9347939Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:36.9349085Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:36.9350108Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2024-12-18T00:02:36.9350912Z @com_google_protobuf//:protobuf_lite; 4s local 2024-12-18T00:02:36.9351665Z Compiling xla/service/cpu/runtime_conv2d.cc; 3s local 2024-12-18T00:02:36.9352624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local 2024-12-18T00:02:36.9353908Z @llvm-project//llvm:llvm-min-tblgen; 3s local ... 2024-12-18T00:02:37.2043651Z 2024-12-18T00:02:37.2044729Z  2024-12-18T00:02:37.2045230Z  2024-12-18T00:02:37.2045645Z  2024-12-18T00:02:37.2046030Z  2024-12-18T00:02:37.2046412Z  2024-12-18T00:02:37.2046792Z  2024-12-18T00:02:37.2047144Z  2024-12-18T00:02:37.2047851Z  2024-12-18T00:02:37.2048461Z [9,099 / 15,187] 48 actions, 47 running 2024-12-18T00:02:37.2049360Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:02:37.2050344Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:37.2051463Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:02:37.2052384Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2024-12-18T00:02:37.2053343Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local 2024-12-18T00:02:37.2054296Z @llvm-project//llvm:llvm-min-tblgen; 3s local 2024-12-18T00:02:37.2055165Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 3s local 2024-12-18T00:02:37.2056182Z Compiling xla/service/cpu/runtime_conv2d_acl.cc; 2s local ... 2024-12-18T00:02:37.4381452Z 2024-12-18T00:02:37.4382355Z  2024-12-18T00:02:37.4382814Z  2024-12-18T00:02:37.4383250Z  2024-12-18T00:02:37.4383647Z  2024-12-18T00:02:37.4384022Z  2024-12-18T00:02:37.4384374Z  2024-12-18T00:02:37.4384721Z  2024-12-18T00:02:37.4385093Z  2024-12-18T00:02:37.4385632Z [9,110 / 15,187] 48 actions, 46 running 2024-12-18T00:02:37.4386479Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:02:37.4388031Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:02:37.4389049Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2024-12-18T00:02:37.4390240Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2024-12-18T00:02:37.4391446Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2024-12-18T00:02:37.4392481Z Compiling xla/service/cpu/runtime_fft.cc; 2s local 2024-12-18T00:02:37.4393302Z Compiling google/fft.cc; 1s local 2024-12-18T00:02:37.4394283Z Compiling src/google/protobuf/wrappers.pb.cc [for tool]; 1s local ... 2024-12-18T00:02:37.6412502Z 2024-12-18T00:02:37.6413409Z  2024-12-18T00:02:37.6413887Z  2024-12-18T00:02:37.6414308Z  2024-12-18T00:02:37.6414707Z  2024-12-18T00:02:37.6415113Z  2024-12-18T00:02:37.6415514Z  2024-12-18T00:02:37.6415933Z  2024-12-18T00:02:37.6416526Z  2024-12-18T00:02:37.6417097Z [9,112 / 15,187] 48 actions running 2024-12-18T00:02:37.6418189Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:02:37.6419364Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:02:37.6420853Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2024-12-18T00:02:37.6421852Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2024-12-18T00:02:37.6423122Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2024-12-18T00:02:37.6424222Z Compiling xla/service/cpu/runtime_fft.cc; 2s local 2024-12-18T00:02:37.6425078Z Compiling google/fft.cc; 2s local 2024-12-18T00:02:37.6426049Z Compiling src/google/protobuf/wrappers.pb.cc [for tool]; 2s local ... 2024-12-18T00:02:37.8419070Z 2024-12-18T00:02:37.8419954Z  2024-12-18T00:02:37.8420438Z  2024-12-18T00:02:37.8420838Z  2024-12-18T00:02:37.8421215Z  2024-12-18T00:02:37.8421591Z  2024-12-18T00:02:37.8422311Z  2024-12-18T00:02:37.8422831Z  2024-12-18T00:02:37.8423331Z  2024-12-18T00:02:37.8424001Z [9,115 / 15,187] 48 actions running 2024-12-18T00:02:37.8425078Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:02:37.8426901Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:02:37.8428112Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2024-12-18T00:02:37.8429267Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2024-12-18T00:02:37.8430769Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2024-12-18T00:02:37.8431936Z Compiling xla/service/cpu/runtime_fft.cc; 3s local 2024-12-18T00:02:37.8432761Z Compiling google/fft.cc; 2s local 2024-12-18T00:02:37.8433668Z Compiling src/google/protobuf/wrappers.pb.cc [for tool]; 2s local ... 2024-12-18T00:02:38.0427734Z 2024-12-18T00:02:38.0429775Z  2024-12-18T00:02:38.0430279Z  2024-12-18T00:02:38.0430713Z  2024-12-18T00:02:38.0431148Z  2024-12-18T00:02:38.0431544Z  2024-12-18T00:02:38.0431958Z  2024-12-18T00:02:38.0432364Z  2024-12-18T00:02:38.0432818Z  2024-12-18T00:02:38.0433435Z [9,118 / 15,187] 48 actions, 47 running 2024-12-18T00:02:38.0434378Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:02:38.0435594Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:02:38.0436696Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2024-12-18T00:02:38.0437739Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2024-12-18T00:02:38.0438763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2024-12-18T00:02:38.0439602Z Compiling xla/service/cpu/runtime_fft.cc; 3s local 2024-12-18T00:02:38.0440297Z Compiling google/fft.cc; 2s local 2024-12-18T00:02:38.0441189Z Compiling mlir/lib/Support/StorageUniquer.cpp [for tool]; 2s local ... 2024-12-18T00:02:38.2587564Z 2024-12-18T00:02:38.2588423Z  2024-12-18T00:02:38.2588882Z  2024-12-18T00:02:38.2589257Z  2024-12-18T00:02:38.2589715Z  2024-12-18T00:02:38.2590089Z  2024-12-18T00:02:38.2590454Z  2024-12-18T00:02:38.2590842Z  2024-12-18T00:02:38.2591236Z  2024-12-18T00:02:38.2591795Z [9,124 / 15,187] 47 actions, 46 running 2024-12-18T00:02:38.2592684Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:02:38.2593689Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2024-12-18T00:02:38.2594644Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2024-12-18T00:02:38.2595689Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2024-12-18T00:02:38.2596543Z Compiling google/fft.cc; 2s local 2024-12-18T00:02:38.2597332Z Compiling mlir/lib/Support/StorageUniquer.cpp [for tool]; 2s local 2024-12-18T00:02:38.2598268Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 2s local 2024-12-18T00:02:38.2599189Z Compiling src/google/protobuf/repeated_field.cc; 2s local ... 2024-12-18T00:02:38.4654169Z 2024-12-18T00:02:38.4655506Z  2024-12-18T00:02:38.4656016Z  2024-12-18T00:02:38.4656542Z  2024-12-18T00:02:38.4656934Z  2024-12-18T00:02:38.4657329Z  2024-12-18T00:02:38.4657761Z  2024-12-18T00:02:38.4658210Z  2024-12-18T00:02:38.4658668Z  2024-12-18T00:02:38.4659263Z [9,130 / 15,187] 48 actions, 47 running 2024-12-18T00:02:38.4660236Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:02:38.4661270Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2024-12-18T00:02:38.4662176Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:02:38.4663283Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2024-12-18T00:02:38.4664155Z Compiling google/fft.cc; 2s local 2024-12-18T00:02:38.4665005Z Compiling mlir/lib/Support/StorageUniquer.cpp [for tool]; 2s local 2024-12-18T00:02:38.4666033Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 2s local 2024-12-18T00:02:38.4667360Z Compiling src/google/protobuf/repeated_field.cc; 2s local ... 2024-12-18T00:02:38.7740039Z 2024-12-18T00:02:38.7740999Z  2024-12-18T00:02:38.7741401Z  2024-12-18T00:02:38.7741726Z  2024-12-18T00:02:38.7742026Z  2024-12-18T00:02:38.7742342Z  2024-12-18T00:02:38.7742682Z  2024-12-18T00:02:38.7743018Z  2024-12-18T00:02:38.7743682Z  2024-12-18T00:02:38.7744340Z [9,132 / 15,187] 48 actions, 47 running 2024-12-18T00:02:38.7745131Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:02:38.7746011Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2024-12-18T00:02:38.7746858Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:02:38.7747742Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2024-12-18T00:02:38.7748431Z Compiling google/fft.cc; 3s local 2024-12-18T00:02:38.7749082Z Compiling mlir/lib/Support/StorageUniquer.cpp [for tool]; 3s local 2024-12-18T00:02:38.7749977Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:02:38.7750786Z Compiling src/google/protobuf/repeated_field.cc; 2s local ... 2024-12-18T00:02:39.0562042Z 2024-12-18T00:02:39.0562901Z  2024-12-18T00:02:39.0563364Z  2024-12-18T00:02:39.0563783Z  2024-12-18T00:02:39.0564209Z  2024-12-18T00:02:39.0564608Z  2024-12-18T00:02:39.0564982Z  2024-12-18T00:02:39.0565370Z  2024-12-18T00:02:39.0565761Z  2024-12-18T00:02:39.0566247Z [9,136 / 15,187] 48 actions running 2024-12-18T00:02:39.0567126Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:02:39.0568104Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2024-12-18T00:02:39.0569071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:02:39.0570149Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2024-12-18T00:02:39.0571013Z Compiling google/fft.cc; 3s local 2024-12-18T00:02:39.0571734Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:02:39.0572609Z Compiling src/google/protobuf/repeated_field.cc; 3s local 2024-12-18T00:02:39.0573501Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local ... 2024-12-18T00:02:39.2588853Z 2024-12-18T00:02:39.2589710Z  2024-12-18T00:02:39.2590134Z  2024-12-18T00:02:39.2590497Z  2024-12-18T00:02:39.2590851Z  2024-12-18T00:02:39.2591215Z  2024-12-18T00:02:39.2591542Z  2024-12-18T00:02:39.2591856Z  2024-12-18T00:02:39.2592195Z  2024-12-18T00:02:39.2592694Z [9,145 / 15,187] 48 actions, 47 running 2024-12-18T00:02:39.2593502Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:02:39.2594365Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2024-12-18T00:02:39.2595175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:02:39.2596098Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2024-12-18T00:02:39.2596823Z Compiling google/fft.cc; 3s local 2024-12-18T00:02:39.2597432Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:02:39.2598183Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:02:39.2599016Z Compiling src/google/protobuf/extension_set.cc; 3s local ... 2024-12-18T00:02:39.4571782Z 2024-12-18T00:02:39.4572650Z  2024-12-18T00:02:39.4573107Z  2024-12-18T00:02:39.4573488Z  2024-12-18T00:02:39.4573848Z  2024-12-18T00:02:39.4574249Z  2024-12-18T00:02:39.4574648Z  2024-12-18T00:02:39.4575028Z  2024-12-18T00:02:39.4575370Z  2024-12-18T00:02:39.4575894Z [9,148 / 15,187] 48 actions running 2024-12-18T00:02:39.4576957Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:02:39.4578245Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2024-12-18T00:02:39.4579196Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:02:39.4580243Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:02:39.4581131Z Compiling google/fft.cc; 3s local 2024-12-18T00:02:39.4582150Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:02:39.4583053Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:02:39.4583991Z Compiling src/google/protobuf/extension_set.cc; 3s local ... 2024-12-18T00:02:39.6579462Z 2024-12-18T00:02:39.6580407Z  2024-12-18T00:02:39.6580879Z  2024-12-18T00:02:39.6581286Z  2024-12-18T00:02:39.6581641Z  2024-12-18T00:02:39.6582036Z  2024-12-18T00:02:39.6582445Z  2024-12-18T00:02:39.6582822Z  2024-12-18T00:02:39.6583218Z  2024-12-18T00:02:39.6583765Z [9,150 / 15,187] 48 actions running 2024-12-18T00:02:39.6584725Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:02:39.6585712Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2024-12-18T00:02:39.6586676Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:02:39.6587835Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:02:39.6588671Z Compiling google/fft.cc; 4s local 2024-12-18T00:02:39.6589359Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:02:39.6590242Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:02:39.6591153Z Compiling src/google/protobuf/extension_set.cc; 3s local ... 2024-12-18T00:02:39.8587153Z 2024-12-18T00:02:39.8588092Z  2024-12-18T00:02:39.8588574Z  2024-12-18T00:02:39.8588980Z  2024-12-18T00:02:39.8589400Z  2024-12-18T00:02:39.8589824Z  2024-12-18T00:02:39.8590263Z  2024-12-18T00:02:39.8590660Z  2024-12-18T00:02:39.8591042Z  2024-12-18T00:02:39.8591597Z [9,154 / 15,187] 48 actions running 2024-12-18T00:02:39.8592523Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:02:39.8593513Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2024-12-18T00:02:39.8594466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:02:39.8595622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:02:39.8596552Z Compiling google/fft.cc; 4s local 2024-12-18T00:02:39.8597295Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:02:39.8598152Z Compiling src/google/protobuf/extension_set.cc; 3s local 2024-12-18T00:02:39.8599044Z Compiling src/google/protobuf/wire_format.cc; 3s local ... 2024-12-18T00:02:40.1028267Z 2024-12-18T00:02:40.1029180Z  2024-12-18T00:02:40.1029644Z  2024-12-18T00:02:40.1030106Z  2024-12-18T00:02:40.1030507Z  2024-12-18T00:02:40.1030889Z  2024-12-18T00:02:40.1031267Z  2024-12-18T00:02:40.1031687Z  2024-12-18T00:02:40.1032041Z  2024-12-18T00:02:40.1032618Z [9,158 / 15,187] 48 actions, 47 running 2024-12-18T00:02:40.1033515Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:02:40.1034502Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2024-12-18T00:02:40.1047475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:02:40.1048581Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:02:40.1049464Z Compiling google/fft.cc; 4s local 2024-12-18T00:02:40.1050158Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:02:40.1050996Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:02:40.1051962Z Compiling src/google/protobuf/util/message_differencer.cc; 3s local ... 2024-12-18T00:02:40.3365578Z 2024-12-18T00:02:40.3366432Z  2024-12-18T00:02:40.3366896Z  2024-12-18T00:02:40.3367341Z  2024-12-18T00:02:40.3367698Z  2024-12-18T00:02:40.3368093Z  2024-12-18T00:02:40.3368485Z  2024-12-18T00:02:40.3368903Z  2024-12-18T00:02:40.3369298Z  2024-12-18T00:02:40.3370675Z [9,161 / 15,187] 48 actions, 47 running 2024-12-18T00:02:40.3371598Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:02:40.3372552Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2024-12-18T00:02:40.3373545Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:02:40.3374609Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:02:40.3375446Z Compiling google/fft.cc; 4s local 2024-12-18T00:02:40.3376130Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:02:40.3377109Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:02:40.3378144Z Compiling src/google/protobuf/util/message_differencer.cc; 3s local ... 2024-12-18T00:02:40.5648684Z 2024-12-18T00:02:40.5649583Z  2024-12-18T00:02:40.5650048Z  2024-12-18T00:02:40.5650436Z  2024-12-18T00:02:40.5650865Z  2024-12-18T00:02:40.5651260Z  2024-12-18T00:02:40.5651628Z  2024-12-18T00:02:40.5652018Z  2024-12-18T00:02:40.5652387Z  2024-12-18T00:02:40.5652955Z [9,167 / 15,187] 48 actions, 47 running 2024-12-18T00:02:40.5654008Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:02:40.5654888Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2024-12-18T00:02:40.5655831Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:02:40.5656962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2024-12-18T00:02:40.5657828Z Compiling google/fft.cc; 4s local 2024-12-18T00:02:40.5658548Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:02:40.5659346Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:02:40.5660242Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local ... 2024-12-18T00:02:40.8483126Z 2024-12-18T00:02:40.8483958Z  2024-12-18T00:02:40.8484411Z  2024-12-18T00:02:40.8484834Z  2024-12-18T00:02:40.8485189Z  2024-12-18T00:02:40.8485598Z  2024-12-18T00:02:40.8485972Z  2024-12-18T00:02:40.8486347Z  2024-12-18T00:02:40.8486728Z  2024-12-18T00:02:40.8487308Z [9,171 / 15,187] 48 actions, 47 running 2024-12-18T00:02:40.8488214Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:02:40.8489246Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2024-12-18T00:02:40.8490181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:02:40.8491255Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2024-12-18T00:02:40.8492116Z Compiling google/fft.cc; 5s local 2024-12-18T00:02:40.8492835Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:02:40.8493706Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:02:40.8494687Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local ... 2024-12-18T00:02:41.0599090Z 2024-12-18T00:02:41.0599973Z  2024-12-18T00:02:41.0600427Z  2024-12-18T00:02:41.0600802Z  2024-12-18T00:02:41.0601180Z  2024-12-18T00:02:41.0601557Z  2024-12-18T00:02:41.0601926Z  2024-12-18T00:02:41.0602297Z  2024-12-18T00:02:41.0602645Z  2024-12-18T00:02:41.0603179Z [9,174 / 15,187] 48 actions running 2024-12-18T00:02:41.0604061Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:02:41.0605015Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2024-12-18T00:02:41.0606361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:02:41.0607387Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2024-12-18T00:02:41.0608254Z Compiling google/fft.cc; 5s local 2024-12-18T00:02:41.0608981Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 5s local 2024-12-18T00:02:41.0610190Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local 2024-12-18T00:02:41.0611178Z Compiling torch_xla/csrc/runtime/env_hash.cc; 4s local ... 2024-12-18T00:02:41.2605634Z 2024-12-18T00:02:41.2606465Z  2024-12-18T00:02:41.2606908Z  2024-12-18T00:02:41.2607310Z  2024-12-18T00:02:41.2607703Z  2024-12-18T00:02:41.2608081Z  2024-12-18T00:02:41.2608456Z  2024-12-18T00:02:41.2608823Z  2024-12-18T00:02:41.2609186Z  2024-12-18T00:02:41.2609787Z [9,179 / 15,187] 48 actions running 2024-12-18T00:02:41.2610696Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:02:41.2611795Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2024-12-18T00:02:41.2612723Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:02:41.2613870Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2024-12-18T00:02:41.2614714Z Compiling google/fft.cc; 5s local 2024-12-18T00:02:41.2615581Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local 2024-12-18T00:02:41.2616699Z Compiling torch_xla/csrc/runtime/env_hash.cc; 4s local 2024-12-18T00:02:41.2617642Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local ... 2024-12-18T00:02:41.4642575Z 2024-12-18T00:02:41.4643468Z  2024-12-18T00:02:41.4643932Z  2024-12-18T00:02:41.4644591Z  2024-12-18T00:02:41.4644986Z  2024-12-18T00:02:41.4645377Z  2024-12-18T00:02:41.4646096Z  2024-12-18T00:02:41.4646623Z  2024-12-18T00:02:41.4647175Z  2024-12-18T00:02:41.4647894Z [9,181 / 15,187] 48 actions, 47 running 2024-12-18T00:02:41.4648950Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:02:41.4650098Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2024-12-18T00:02:41.4651201Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:02:41.4652439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:02:41.4653429Z Compiling google/fft.cc; 5s local 2024-12-18T00:02:41.4654403Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local 2024-12-18T00:02:41.4655457Z Compiling torch_xla/csrc/runtime/env_hash.cc; 4s local 2024-12-18T00:02:41.4656578Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local ... 2024-12-18T00:02:41.6768895Z 2024-12-18T00:02:41.6769760Z  2024-12-18T00:02:41.6770234Z  2024-12-18T00:02:41.6770736Z  2024-12-18T00:02:41.6771134Z  2024-12-18T00:02:41.6771576Z  2024-12-18T00:02:41.6771960Z  2024-12-18T00:02:41.6772354Z  2024-12-18T00:02:41.6772775Z  2024-12-18T00:02:41.6773370Z [9,188 / 15,187] 48 actions, 47 running 2024-12-18T00:02:41.6774269Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:02:41.6775305Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2024-12-18T00:02:41.6776847Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:02:41.6777981Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:02:41.6779105Z Compiling google/fft.cc; 6s local 2024-12-18T00:02:41.6780085Z Compiling src/google/protobuf/util/message_differencer.cc; 5s local 2024-12-18T00:02:41.6781289Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2024-12-18T00:02:41.6782541Z Compiling src/google/protobuf/wire_format.cc [for tool]; 3s local ... 2024-12-18T00:02:41.8794730Z 2024-12-18T00:02:41.8795601Z  2024-12-18T00:02:41.8796050Z  2024-12-18T00:02:41.8796440Z  2024-12-18T00:02:41.8797135Z  2024-12-18T00:02:41.8797487Z  2024-12-18T00:02:41.8797785Z  2024-12-18T00:02:41.8798124Z  2024-12-18T00:02:41.8798453Z  2024-12-18T00:02:41.8799011Z [9,195 / 15,187] 48 actions, 47 running 2024-12-18T00:02:41.8800229Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:02:41.8801419Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2024-12-18T00:02:41.8802388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:02:41.8803463Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:02:41.8804366Z Compiling google/fft.cc; 6s local 2024-12-18T00:02:41.8805105Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2024-12-18T00:02:41.8806001Z Compiling src/google/protobuf/wire_format.cc [for tool]; 3s local 2024-12-18T00:02:41.8807036Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 3s local ... 2024-12-18T00:02:42.1289059Z 2024-12-18T00:02:42.1289753Z  2024-12-18T00:02:42.1290211Z  2024-12-18T00:02:42.1290640Z  2024-12-18T00:02:42.1291046Z  2024-12-18T00:02:42.1291464Z  2024-12-18T00:02:42.1291893Z  2024-12-18T00:02:42.1292293Z  2024-12-18T00:02:42.1292675Z  2024-12-18T00:02:42.1293277Z [9,198 / 15,187] 48 actions, 47 running 2024-12-18T00:02:42.1294172Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:02:42.1295194Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2024-12-18T00:02:42.1296150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:02:42.1297460Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:02:42.1298382Z Compiling google/fft.cc; 6s local 2024-12-18T00:02:42.1299176Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2024-12-18T00:02:42.1300188Z Compiling src/google/protobuf/wire_format.cc [for tool]; 4s local 2024-12-18T00:02:42.1301223Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 3s local ... 2024-12-18T00:02:42.3487233Z 2024-12-18T00:02:42.3488163Z  2024-12-18T00:02:42.3488608Z  2024-12-18T00:02:42.3488989Z  2024-12-18T00:02:42.3489416Z  2024-12-18T00:02:42.3489804Z  2024-12-18T00:02:42.3490184Z  2024-12-18T00:02:42.3490538Z  2024-12-18T00:02:42.3490913Z  2024-12-18T00:02:42.3491478Z [9,203 / 15,187] 48 actions, 47 running 2024-12-18T00:02:42.3492388Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:02:42.3493390Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2024-12-18T00:02:42.3494316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:02:42.3495389Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:02:42.3496268Z Compiling google/fft.cc; 6s local 2024-12-18T00:02:42.3497133Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:02:42.3498029Z Compiling src/google/protobuf/wire_format.cc [for tool]; 4s local 2024-12-18T00:02:42.3498997Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 3s local ... 2024-12-18T00:02:42.5709517Z 2024-12-18T00:02:42.5710357Z  2024-12-18T00:02:42.5710842Z  2024-12-18T00:02:42.5711206Z  2024-12-18T00:02:42.5711548Z  2024-12-18T00:02:42.5711915Z  2024-12-18T00:02:42.5712266Z  2024-12-18T00:02:42.5712626Z  2024-12-18T00:02:42.5712980Z  2024-12-18T00:02:42.5713561Z [9,209 / 15,187] 48 actions, 47 running 2024-12-18T00:02:42.5714446Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:02:42.5715475Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2024-12-18T00:02:42.5716900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:02:42.5717960Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:02:42.5718808Z Compiling google/fft.cc; 6s local 2024-12-18T00:02:42.5719570Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:02:42.5720733Z Compiling src/google/protobuf/wire_format.cc [for tool]; 4s local 2024-12-18T00:02:42.5721718Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local ... 2024-12-18T00:02:42.7975836Z 2024-12-18T00:02:42.7976851Z  2024-12-18T00:02:42.7977307Z  2024-12-18T00:02:42.7977689Z  2024-12-18T00:02:42.7978048Z  2024-12-18T00:02:42.7978415Z  2024-12-18T00:02:42.7978774Z  2024-12-18T00:02:42.7979149Z  2024-12-18T00:02:42.7979520Z  2024-12-18T00:02:42.7980102Z [9,213 / 15,187] 48 actions, 47 running 2024-12-18T00:02:42.7980988Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:02:42.7982062Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2024-12-18T00:02:42.7983066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:02:42.7984062Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:02:42.7984937Z Compiling google/fft.cc; 7s local 2024-12-18T00:02:42.7985667Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:02:42.7986626Z Compiling src/google/protobuf/wire_format.cc [for tool]; 4s local 2024-12-18T00:02:42.7987587Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local ... 2024-12-18T00:02:43.0342467Z 2024-12-18T00:02:43.0343338Z  2024-12-18T00:02:43.0343796Z  2024-12-18T00:02:43.0344384Z  2024-12-18T00:02:43.0344777Z  2024-12-18T00:02:43.0345169Z  2024-12-18T00:02:43.0345554Z  2024-12-18T00:02:43.0345933Z  2024-12-18T00:02:43.0346325Z  2024-12-18T00:02:43.0346957Z [9,218 / 15,187] 48 actions, 47 running 2024-12-18T00:02:43.0347884Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:02:43.0348888Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2024-12-18T00:02:43.0349894Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:02:43.0351010Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:02:43.0351841Z Compiling google/fft.cc; 7s local 2024-12-18T00:02:43.0352478Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:02:43.0353291Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local 2024-12-18T00:02:43.0354176Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local ... 2024-12-18T00:02:43.2627403Z 2024-12-18T00:02:43.2628285Z  2024-12-18T00:02:43.2628768Z  2024-12-18T00:02:43.2629186Z  2024-12-18T00:02:43.2629570Z  2024-12-18T00:02:43.2630008Z  2024-12-18T00:02:43.2630414Z  2024-12-18T00:02:43.2630814Z  2024-12-18T00:02:43.2631207Z  2024-12-18T00:02:43.2631775Z [9,221 / 15,187] 48 actions running 2024-12-18T00:02:43.2632706Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:02:43.2633744Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2024-12-18T00:02:43.2634749Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:02:43.2635810Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:02:43.2636673Z Compiling google/fft.cc; 7s local 2024-12-18T00:02:43.2637438Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:02:43.2638364Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local 2024-12-18T00:02:43.2639312Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local ... 2024-12-18T00:02:43.4629584Z 2024-12-18T00:02:43.4630442Z  2024-12-18T00:02:43.4631208Z  2024-12-18T00:02:43.4631689Z  2024-12-18T00:02:43.4632013Z  2024-12-18T00:02:43.4632339Z  2024-12-18T00:02:43.4632659Z  2024-12-18T00:02:43.4632962Z  2024-12-18T00:02:43.4633284Z  2024-12-18T00:02:43.4633739Z [9,225 / 15,187] 48 actions running 2024-12-18T00:02:43.4634676Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:02:43.4635538Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2024-12-18T00:02:43.4636336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:02:43.4637208Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:02:43.4637931Z Compiling google/fft.cc; 7s local 2024-12-18T00:02:43.4638553Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:02:43.4639268Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2024-12-18T00:02:43.4640050Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local ... 2024-12-18T00:02:43.6780568Z 2024-12-18T00:02:43.6781410Z  2024-12-18T00:02:43.6781909Z  2024-12-18T00:02:43.6782305Z  2024-12-18T00:02:43.6782674Z  2024-12-18T00:02:43.6783065Z  2024-12-18T00:02:43.6783439Z  2024-12-18T00:02:43.6783811Z  2024-12-18T00:02:43.6784198Z  2024-12-18T00:02:43.6784812Z [9,229 / 15,187] 48 actions, 47 running 2024-12-18T00:02:43.6785723Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:02:43.6786748Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2024-12-18T00:02:43.6787711Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:02:43.6788795Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:02:43.6789694Z Compiling google/fft.cc; 8s local 2024-12-18T00:02:43.6790432Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:02:43.6791344Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2024-12-18T00:02:43.6792274Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local ... 2024-12-18T00:02:43.9460557Z 2024-12-18T00:02:43.9461455Z  2024-12-18T00:02:43.9461943Z  2024-12-18T00:02:43.9462324Z  2024-12-18T00:02:43.9462678Z  2024-12-18T00:02:43.9463082Z  2024-12-18T00:02:43.9463466Z  2024-12-18T00:02:43.9463816Z  2024-12-18T00:02:43.9464196Z  2024-12-18T00:02:43.9464772Z [9,236 / 15,187] 48 actions, 47 running 2024-12-18T00:02:43.9465675Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:02:43.9466680Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2024-12-18T00:02:43.9467629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:02:43.9468721Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:02:43.9469604Z Compiling google/fft.cc; 8s local 2024-12-18T00:02:43.9470348Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:02:43.9471244Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2024-12-18T00:02:43.9472166Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local ... 2024-12-18T00:02:44.2033043Z 2024-12-18T00:02:44.2033915Z  2024-12-18T00:02:44.2034468Z  2024-12-18T00:02:44.2034866Z  2024-12-18T00:02:44.2035250Z  2024-12-18T00:02:44.2035631Z  2024-12-18T00:02:44.2036037Z  2024-12-18T00:02:44.2036438Z  2024-12-18T00:02:44.2036782Z  2024-12-18T00:02:44.2037332Z [9,239 / 15,187] 48 actions, 47 running 2024-12-18T00:02:44.2038266Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:02:44.2039309Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2024-12-18T00:02:44.2040215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:02:44.2041681Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:02:44.2042507Z Compiling google/fft.cc; 8s local 2024-12-18T00:02:44.2043227Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:02:44.2044108Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2024-12-18T00:02:44.2045531Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local ... 2024-12-18T00:02:44.4136844Z 2024-12-18T00:02:44.4137777Z  2024-12-18T00:02:44.4138231Z  2024-12-18T00:02:44.4138616Z  2024-12-18T00:02:44.4139028Z  2024-12-18T00:02:44.4139507Z  2024-12-18T00:02:44.4139890Z  2024-12-18T00:02:44.4140249Z  2024-12-18T00:02:44.4140715Z  2024-12-18T00:02:44.4141296Z [9,245 / 15,187] 48 actions, 47 running 2024-12-18T00:02:44.4142233Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:02:44.4143317Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2024-12-18T00:02:44.4144628Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:02:44.4145774Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:02:44.4146638Z Compiling google/fft.cc; 8s local 2024-12-18T00:02:44.4147349Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:02:44.4148314Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2024-12-18T00:02:44.4149260Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local ... 2024-12-18T00:02:44.6353060Z 2024-12-18T00:02:44.6353903Z  2024-12-18T00:02:44.6354378Z  2024-12-18T00:02:44.6354751Z  2024-12-18T00:02:44.6355135Z  2024-12-18T00:02:44.6355541Z  2024-12-18T00:02:44.6355949Z  2024-12-18T00:02:44.6356347Z  2024-12-18T00:02:44.6356736Z  2024-12-18T00:02:44.6357326Z [9,252 / 15,187] 48 actions, 47 running 2024-12-18T00:02:44.6358342Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:02:44.6359343Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2024-12-18T00:02:44.6360457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:02:44.6361524Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:02:44.6362412Z Compiling google/fft.cc; 9s local 2024-12-18T00:02:44.6363144Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:02:44.6364046Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2024-12-18T00:02:44.6364989Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local ... 2024-12-18T00:02:44.8526709Z 2024-12-18T00:02:44.8527581Z  2024-12-18T00:02:44.8528040Z  2024-12-18T00:02:44.8528419Z  2024-12-18T00:02:44.8528814Z  2024-12-18T00:02:44.8529201Z  2024-12-18T00:02:44.8529597Z  2024-12-18T00:02:44.8530005Z  2024-12-18T00:02:44.8530397Z  2024-12-18T00:02:44.8531003Z [9,257 / 15,187] 48 actions, 47 running 2024-12-18T00:02:44.8531937Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:02:44.8532967Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2024-12-18T00:02:44.8534016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:02:44.8535118Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:02:44.8535975Z Compiling google/fft.cc; 9s local 2024-12-18T00:02:44.8536846Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:02:44.8537767Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2024-12-18T00:02:44.8538742Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local ... 2024-12-18T00:02:45.0642562Z 2024-12-18T00:02:45.0643534Z  2024-12-18T00:02:45.0644051Z  2024-12-18T00:02:45.0647051Z  2024-12-18T00:02:45.0647469Z  2024-12-18T00:02:45.0647912Z  2024-12-18T00:02:45.0648268Z  2024-12-18T00:02:45.0648652Z  2024-12-18T00:02:45.0649041Z  2024-12-18T00:02:45.0649586Z [9,259 / 15,187] 48 actions running 2024-12-18T00:02:45.0650464Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:02:45.0651766Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2024-12-18T00:02:45.0652768Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:02:45.0653882Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:02:45.0654764Z Compiling google/fft.cc; 9s local 2024-12-18T00:02:45.0655520Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:02:45.0656583Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2024-12-18T00:02:45.0657537Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local ... 2024-12-18T00:02:45.2652287Z 2024-12-18T00:02:45.2653204Z  2024-12-18T00:02:45.2653663Z  2024-12-18T00:02:45.2654058Z  2024-12-18T00:02:45.2654432Z  2024-12-18T00:02:45.2654813Z  2024-12-18T00:02:45.2655170Z  2024-12-18T00:02:45.2655559Z  2024-12-18T00:02:45.2655948Z  2024-12-18T00:02:45.2656683Z [9,261 / 15,187] 48 actions running 2024-12-18T00:02:45.2657552Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:02:45.2658486Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2024-12-18T00:02:45.2659450Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:02:45.2660723Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:02:45.2661623Z Compiling google/fft.cc; 9s local 2024-12-18T00:02:45.2662354Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:02:45.2663284Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2024-12-18T00:02:45.2664230Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local ... 2024-12-18T00:02:45.4659463Z 2024-12-18T00:02:45.4660296Z  2024-12-18T00:02:45.4660765Z  2024-12-18T00:02:45.4661162Z  2024-12-18T00:02:45.4661557Z  2024-12-18T00:02:45.4661932Z  2024-12-18T00:02:45.4662325Z  2024-12-18T00:02:45.4662741Z  2024-12-18T00:02:45.4663132Z  2024-12-18T00:02:45.4663680Z [9,266 / 15,187] 48 actions running 2024-12-18T00:02:45.4664590Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:02:45.4665641Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2024-12-18T00:02:45.4666626Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:02:45.4667745Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:02:45.4668627Z Compiling google/fft.cc; 9s local 2024-12-18T00:02:45.4669390Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2024-12-18T00:02:45.4670269Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2024-12-18T00:02:45.4671218Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local ... 2024-12-18T00:02:45.6746503Z 2024-12-18T00:02:45.6747437Z  2024-12-18T00:02:45.6747909Z  2024-12-18T00:02:45.6748382Z  2024-12-18T00:02:45.6748791Z  2024-12-18T00:02:45.6749179Z  2024-12-18T00:02:45.6749528Z  2024-12-18T00:02:45.6749888Z  2024-12-18T00:02:45.6750252Z  2024-12-18T00:02:45.6750830Z [9,270 / 15,187] 48 actions, 47 running 2024-12-18T00:02:45.6751696Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:02:45.6752715Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2024-12-18T00:02:45.6753681Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:02:45.6755184Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:02:45.6756030Z Compiling google/fft.cc; 10s local 2024-12-18T00:02:45.6756751Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2024-12-18T00:02:45.6757616Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2024-12-18T00:02:45.6758789Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local ... 2024-12-18T00:02:45.9157624Z 2024-12-18T00:02:45.9158486Z  2024-12-18T00:02:45.9158938Z  2024-12-18T00:02:45.9159324Z  2024-12-18T00:02:45.9159711Z  2024-12-18T00:02:45.9160072Z  2024-12-18T00:02:45.9160418Z  2024-12-18T00:02:45.9160762Z  2024-12-18T00:02:45.9161123Z  2024-12-18T00:02:45.9161653Z [9,274 / 15,187] 47 actions, 46 running 2024-12-18T00:02:45.9162482Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:02:45.9163475Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2024-12-18T00:02:45.9164478Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:02:45.9165552Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:02:45.9166392Z Compiling google/fft.cc; 10s local 2024-12-18T00:02:45.9167033Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2024-12-18T00:02:45.9167929Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2024-12-18T00:02:45.9168807Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local ... 2024-12-18T00:02:46.2464507Z 2024-12-18T00:02:46.2465394Z  2024-12-18T00:02:46.2465874Z  2024-12-18T00:02:46.2466273Z  2024-12-18T00:02:46.2466661Z  2024-12-18T00:02:46.2467058Z  2024-12-18T00:02:46.2467437Z  2024-12-18T00:02:46.2467820Z  2024-12-18T00:02:46.2468211Z  2024-12-18T00:02:46.2468782Z [9,277 / 15,187] 48 actions, 47 running 2024-12-18T00:02:46.2469716Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:02:46.2470714Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2024-12-18T00:02:46.2471664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:02:46.2472743Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:02:46.2473618Z Compiling google/fft.cc; 10s local 2024-12-18T00:02:46.2474307Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2024-12-18T00:02:46.2475204Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:02:46.2476071Z Compiling src/common/memory_zero_pad.cpp; 6s local ... 2024-12-18T00:02:46.4668516Z 2024-12-18T00:02:46.4669389Z  2024-12-18T00:02:46.4669843Z  2024-12-18T00:02:46.4670233Z  2024-12-18T00:02:46.4670610Z  2024-12-18T00:02:46.4670960Z  2024-12-18T00:02:46.4671363Z  2024-12-18T00:02:46.4671761Z  2024-12-18T00:02:46.4672195Z  2024-12-18T00:02:46.4672700Z [9,283 / 15,187] 48 actions running 2024-12-18T00:02:46.4673571Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:02:46.4674579Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:02:46.4675547Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:02:46.4676661Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:02:46.4677512Z Compiling google/fft.cc; 10s local 2024-12-18T00:02:46.4678225Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:02:46.4679089Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:02:46.4679950Z Compiling src/common/memory_zero_pad.cpp; 6s local ... 2024-12-18T00:02:46.6881307Z 2024-12-18T00:02:46.6882148Z  2024-12-18T00:02:46.6882633Z  2024-12-18T00:02:46.6883045Z  2024-12-18T00:02:46.6883460Z  2024-12-18T00:02:46.6884200Z  2024-12-18T00:02:46.6884601Z  2024-12-18T00:02:46.6885021Z  2024-12-18T00:02:46.6885436Z  2024-12-18T00:02:46.6886028Z [9,286 / 15,187] 48 actions, 47 running 2024-12-18T00:02:46.6886992Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:02:46.6888270Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:02:46.6889325Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:02:46.6890481Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:02:46.6891387Z Compiling google/fft.cc; 11s local 2024-12-18T00:02:46.6892115Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:02:46.6893076Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:02:46.6893992Z Compiling src/common/memory_zero_pad.cpp; 6s local ... 2024-12-18T00:02:46.9558747Z 2024-12-18T00:02:46.9559613Z  2024-12-18T00:02:46.9560125Z  2024-12-18T00:02:46.9560528Z  2024-12-18T00:02:46.9560947Z  2024-12-18T00:02:46.9561347Z  2024-12-18T00:02:46.9561750Z  2024-12-18T00:02:46.9562155Z  2024-12-18T00:02:46.9562538Z  2024-12-18T00:02:46.9563148Z [9,289 / 15,187] 48 actions, 47 running 2024-12-18T00:02:46.9564123Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:02:46.9565184Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:02:46.9566189Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:02:46.9567203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:02:46.9568106Z Compiling google/fft.cc; 11s local 2024-12-18T00:02:46.9568845Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:02:46.9569798Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 8s local 2024-12-18T00:02:46.9570746Z Compiling src/common/memory_zero_pad.cpp; 6s local ... 2024-12-18T00:02:47.2644968Z 2024-12-18T00:02:47.2645974Z  2024-12-18T00:02:47.2646477Z  2024-12-18T00:02:47.2646891Z  2024-12-18T00:02:47.2647303Z  2024-12-18T00:02:47.2647886Z  2024-12-18T00:02:47.2648241Z  2024-12-18T00:02:47.2648586Z  2024-12-18T00:02:47.2648981Z  2024-12-18T00:02:47.2649625Z [9,295 / 15,187] 48 actions, 47 running 2024-12-18T00:02:47.2650533Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:02:47.2651618Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:02:47.2652638Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:02:47.2653759Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:02:47.2654643Z Compiling google/fft.cc; 11s local 2024-12-18T00:02:47.2655398Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:02:47.2656259Z Compiling src/common/memory_zero_pad.cpp; 7s local 2024-12-18T00:02:47.2657253Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local ... 2024-12-18T00:02:47.4674158Z 2024-12-18T00:02:47.4675396Z  2024-12-18T00:02:47.4675895Z  2024-12-18T00:02:47.4676330Z  2024-12-18T00:02:47.4676757Z  2024-12-18T00:02:47.4677138Z  2024-12-18T00:02:47.4677441Z  2024-12-18T00:02:47.4677762Z  2024-12-18T00:02:47.4678081Z  2024-12-18T00:02:47.4678537Z [9,298 / 15,187] 48 actions running 2024-12-18T00:02:47.4679269Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:02:47.4680085Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:02:47.4680886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:02:47.4681789Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:02:47.4682872Z Compiling google/fft.cc; 11s local 2024-12-18T00:02:47.4683504Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:02:47.4684223Z Compiling src/common/memory_zero_pad.cpp; 7s local 2024-12-18T00:02:47.4684999Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local ... 2024-12-18T00:02:47.8659332Z 2024-12-18T00:02:47.8660512Z  2024-12-18T00:02:47.8661365Z  2024-12-18T00:02:47.8661798Z  2024-12-18T00:02:47.8662154Z  2024-12-18T00:02:47.8662514Z  2024-12-18T00:02:47.8662882Z  2024-12-18T00:02:47.8663279Z  2024-12-18T00:02:47.8663672Z  2024-12-18T00:02:47.8664264Z [9,302 / 15,187] 48 actions, 47 running 2024-12-18T00:02:47.8665167Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:02:47.8666167Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:02:47.8667158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:02:47.8668308Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:02:47.8669182Z Compiling google/fft.cc; 12s local 2024-12-18T00:02:47.8669919Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:02:47.8670767Z Compiling src/common/memory_zero_pad.cpp; 7s local 2024-12-18T00:02:48.0684827Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2024-12-18T00:02:48.0685502Z 2024-12-18T00:02:48.0685959Z  2024-12-18T00:02:48.0686400Z  2024-12-18T00:02:48.0686790Z  2024-12-18T00:02:48.0687146Z  2024-12-18T00:02:48.0687510Z  2024-12-18T00:02:48.0687886Z  2024-12-18T00:02:48.0688243Z  2024-12-18T00:02:48.0688613Z  2024-12-18T00:02:48.0689117Z [9,302 / 15,187] 48 actions running 2024-12-18T00:02:48.0689975Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:02:48.0690978Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:02:48.0691995Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:02:48.0693163Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:02:48.0693943Z Compiling google/fft.cc; 12s local 2024-12-18T00:02:48.0694826Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:02:48.0695692Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:02:48.0696687Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2024-12-18T00:02:48.2690092Z 2024-12-18T00:02:48.2691090Z  2024-12-18T00:02:48.2691596Z  2024-12-18T00:02:48.2692017Z  2024-12-18T00:02:48.2692433Z  2024-12-18T00:02:48.2692787Z  2024-12-18T00:02:48.2693161Z  2024-12-18T00:02:48.2693537Z  2024-12-18T00:02:48.2693913Z  2024-12-18T00:02:48.2694456Z [9,305 / 15,187] 48 actions running 2024-12-18T00:02:48.2695438Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:02:48.2696614Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:02:48.2697613Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:02:48.2698693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:02:48.2699568Z Compiling google/fft.cc; 12s local 2024-12-18T00:02:48.2700312Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:02:48.2701119Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:02:48.2701964Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2024-12-18T00:02:48.4697277Z 2024-12-18T00:02:48.4698244Z  2024-12-18T00:02:48.4698765Z  2024-12-18T00:02:48.4699193Z  2024-12-18T00:02:48.4699608Z  2024-12-18T00:02:48.4699985Z  2024-12-18T00:02:48.4700327Z  2024-12-18T00:02:48.4700687Z  2024-12-18T00:02:48.4701457Z  2024-12-18T00:02:48.4701998Z [9,308 / 15,187] 48 actions running 2024-12-18T00:02:48.4702926Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:02:48.4703966Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2024-12-18T00:02:48.4704957Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:02:48.4706325Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:02:48.4707236Z Compiling google/fft.cc; 12s local 2024-12-18T00:02:48.4707949Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:02:48.4708777Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:02:48.4709610Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2024-12-18T00:02:48.7096688Z 2024-12-18T00:02:48.7097619Z  2024-12-18T00:02:48.7098133Z  2024-12-18T00:02:48.7098581Z  2024-12-18T00:02:48.7099058Z  2024-12-18T00:02:48.7099487Z  2024-12-18T00:02:48.7099825Z  2024-12-18T00:02:48.7100195Z  2024-12-18T00:02:48.7100587Z  2024-12-18T00:02:48.7101122Z [9,313 / 15,187] 48 actions, 47 running 2024-12-18T00:02:48.7102023Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:02:48.7102969Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2024-12-18T00:02:48.7103741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:02:48.7104788Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:02:48.7105575Z Compiling google/fft.cc; 13s local 2024-12-18T00:02:48.7106143Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:02:48.7106806Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:02:48.7107599Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local ... 2024-12-18T00:02:48.9833223Z 2024-12-18T00:02:48.9834484Z  2024-12-18T00:02:48.9834978Z  2024-12-18T00:02:48.9835409Z  2024-12-18T00:02:48.9835813Z  2024-12-18T00:02:48.9836162Z  2024-12-18T00:02:48.9836519Z  2024-12-18T00:02:48.9836880Z  2024-12-18T00:02:48.9837251Z  2024-12-18T00:02:48.9837792Z [9,318 / 15,187] 48 actions, 47 running 2024-12-18T00:02:48.9838756Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:02:48.9839776Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2024-12-18T00:02:48.9840753Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:02:48.9841774Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:02:48.9842521Z Compiling google/fft.cc; 13s local 2024-12-18T00:02:48.9843202Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:02:48.9843902Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:02:48.9845002Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local ... 2024-12-18T00:02:49.2485849Z 2024-12-18T00:02:49.2486745Z  2024-12-18T00:02:49.2487254Z  2024-12-18T00:02:49.2487674Z  2024-12-18T00:02:49.2488089Z  2024-12-18T00:02:49.2488491Z  2024-12-18T00:02:49.2488860Z  2024-12-18T00:02:49.2489223Z  2024-12-18T00:02:49.2489580Z  2024-12-18T00:02:49.2490137Z [9,319 / 15,187] 48 actions, 47 running 2024-12-18T00:02:49.2491013Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:02:49.2492042Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2024-12-18T00:02:49.2492936Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:02:49.2493996Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:02:49.2494775Z Compiling google/fft.cc; 13s local 2024-12-18T00:02:49.2495489Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:02:49.2497019Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:02:49.2497769Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local ... 2024-12-18T00:02:49.4708351Z 2024-12-18T00:02:49.4709240Z  2024-12-18T00:02:49.4709760Z  2024-12-18T00:02:49.4710165Z  2024-12-18T00:02:49.4710586Z  2024-12-18T00:02:49.4711348Z  2024-12-18T00:02:49.4711770Z  2024-12-18T00:02:49.4712137Z  2024-12-18T00:02:49.4712483Z  2024-12-18T00:02:49.4713020Z [9,319 / 15,187] 48 actions running 2024-12-18T00:02:49.4713925Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:02:49.4714930Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:02:49.4715900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:02:49.4716956Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:02:49.4717828Z Compiling google/fft.cc; 13s local 2024-12-18T00:02:49.4718540Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2024-12-18T00:02:49.4719358Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:02:49.4720187Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local ... 2024-12-18T00:02:49.6991883Z 2024-12-18T00:02:49.6992796Z  2024-12-18T00:02:49.6993368Z  2024-12-18T00:02:49.6993807Z  2024-12-18T00:02:49.6994216Z  2024-12-18T00:02:49.6994623Z  2024-12-18T00:02:49.6995010Z  2024-12-18T00:02:49.6995378Z  2024-12-18T00:02:49.6995745Z  2024-12-18T00:02:49.6996312Z [9,321 / 15,187] 48 actions, 47 running 2024-12-18T00:02:49.6997218Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:02:49.6998210Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:02:49.6999230Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:02:49.7000394Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:02:49.7001228Z Compiling google/fft.cc; 14s local 2024-12-18T00:02:49.7001950Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2024-12-18T00:02:49.7002785Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:02:49.7003622Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local ... 2024-12-18T00:02:49.9479555Z 2024-12-18T00:02:49.9480415Z  2024-12-18T00:02:49.9480943Z  2024-12-18T00:02:49.9481366Z  2024-12-18T00:02:49.9481766Z  2024-12-18T00:02:49.9482181Z  2024-12-18T00:02:49.9482566Z  2024-12-18T00:02:49.9482970Z  2024-12-18T00:02:49.9483360Z  2024-12-18T00:02:49.9483929Z [9,324 / 15,187] 48 actions, 47 running 2024-12-18T00:02:49.9484894Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:02:49.9485973Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:02:49.9486897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:02:49.9488007Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:02:49.9488900Z Compiling google/fft.cc; 14s local 2024-12-18T00:02:49.9489639Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2024-12-18T00:02:49.9490381Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:02:49.9491134Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local ... 2024-12-18T00:02:50.2055243Z 2024-12-18T00:02:50.2056158Z  2024-12-18T00:02:50.2056863Z  2024-12-18T00:02:50.2057292Z  2024-12-18T00:02:50.2057707Z  2024-12-18T00:02:50.2058103Z  2024-12-18T00:02:50.2058485Z  2024-12-18T00:02:50.2058880Z  2024-12-18T00:02:50.2059283Z  2024-12-18T00:02:50.2059837Z [9,328 / 15,187] 48 actions, 47 running 2024-12-18T00:02:50.2061104Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:02:50.2062184Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:02:50.2063199Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:02:50.2064303Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:02:50.2065440Z Compiling google/fft.cc; 14s local 2024-12-18T00:02:50.2066190Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2024-12-18T00:02:50.2067014Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:02:50.2067872Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local ... 2024-12-18T00:02:50.4043446Z 2024-12-18T00:02:50.4044896Z  2024-12-18T00:02:50.4046545Z  2024-12-18T00:02:50.4047035Z  2024-12-18T00:02:50.4047465Z  2024-12-18T00:02:50.4047902Z  2024-12-18T00:02:50.4048283Z  2024-12-18T00:02:50.4048641Z  2024-12-18T00:02:50.4049071Z  2024-12-18T00:02:50.4049650Z [9,332 / 15,187] 48 actions, 47 running 2024-12-18T00:02:50.4050604Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:02:50.4051574Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2024-12-18T00:02:50.4052582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:02:50.4053884Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:02:50.4054733Z Compiling google/fft.cc; 14s local 2024-12-18T00:02:50.4055461Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:02:50.4056473Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:02:50.4057315Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local ... 2024-12-18T00:02:50.6720169Z 2024-12-18T00:02:50.6721133Z  2024-12-18T00:02:50.6721650Z  2024-12-18T00:02:50.6722026Z  2024-12-18T00:02:50.6722435Z  2024-12-18T00:02:50.6722789Z  2024-12-18T00:02:50.6723166Z  2024-12-18T00:02:50.6723544Z  2024-12-18T00:02:50.6723926Z  2024-12-18T00:02:50.6724459Z [9,335 / 15,187] 48 actions running 2024-12-18T00:02:50.6725343Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:02:50.6726366Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2024-12-18T00:02:50.6727372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:02:50.6728516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:02:50.6729391Z Compiling google/fft.cc; 15s local 2024-12-18T00:02:50.6730159Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:02:50.6731048Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:02:50.6731927Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local ... 2024-12-18T00:02:50.8727607Z 2024-12-18T00:02:50.8728541Z  2024-12-18T00:02:50.8729024Z  2024-12-18T00:02:50.8729457Z  2024-12-18T00:02:50.8741055Z  2024-12-18T00:02:50.8741519Z  2024-12-18T00:02:50.8741944Z  2024-12-18T00:02:50.8742370Z  2024-12-18T00:02:50.8742794Z  2024-12-18T00:02:50.8743348Z [9,340 / 15,187] 48 actions running 2024-12-18T00:02:50.8744521Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:02:50.8745690Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2024-12-18T00:02:50.8746811Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:02:50.8747912Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:02:50.8748729Z Compiling google/fft.cc; 15s local 2024-12-18T00:02:50.8749412Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:02:50.8750202Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:02:50.8751406Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local ... 2024-12-18T00:02:51.1560845Z 2024-12-18T00:02:51.1561715Z  2024-12-18T00:02:51.1562204Z  2024-12-18T00:02:51.1562632Z  2024-12-18T00:02:51.1563028Z  2024-12-18T00:02:51.1563399Z  2024-12-18T00:02:51.1563773Z  2024-12-18T00:02:51.1564146Z  2024-12-18T00:02:51.1564518Z  2024-12-18T00:02:51.1565379Z [9,344 / 15,187] 48 actions, 47 running 2024-12-18T00:02:51.1566286Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:02:51.1567256Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2024-12-18T00:02:51.1568186Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:02:51.1569189Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:02:51.1570033Z Compiling google/fft.cc; 15s local 2024-12-18T00:02:51.1570719Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:02:51.1571531Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:02:51.1572315Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local ... 2024-12-18T00:02:51.3828898Z 2024-12-18T00:02:51.3829821Z  2024-12-18T00:02:51.3830294Z  2024-12-18T00:02:51.3830702Z  2024-12-18T00:02:51.3831229Z  2024-12-18T00:02:51.3831666Z  2024-12-18T00:02:51.3832065Z  2024-12-18T00:02:51.3832484Z  2024-12-18T00:02:51.3832862Z  2024-12-18T00:02:51.3833474Z [9,347 / 15,187] 48 actions, 47 running 2024-12-18T00:02:51.3834443Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:02:51.3835458Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2024-12-18T00:02:51.3836417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:02:51.3837453Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:02:51.3838391Z Compiling google/fft.cc; 15s local 2024-12-18T00:02:51.3839089Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:02:51.3839886Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:02:51.3840724Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local ... 2024-12-18T00:02:51.6236274Z 2024-12-18T00:02:51.6237070Z  2024-12-18T00:02:51.6237549Z  2024-12-18T00:02:51.6237950Z  2024-12-18T00:02:51.6238343Z  2024-12-18T00:02:51.6238743Z  2024-12-18T00:02:51.6239136Z  2024-12-18T00:02:51.6239512Z  2024-12-18T00:02:51.6239910Z  2024-12-18T00:02:51.6240495Z [9,352 / 15,187] 48 actions, 47 running 2024-12-18T00:02:51.6241453Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:02:51.6242538Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2024-12-18T00:02:51.6243590Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:02:51.6244956Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:02:51.6245862Z Compiling google/fft.cc; 16s local 2024-12-18T00:02:51.6246647Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:02:51.6247464Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:02:51.6248265Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local ... 2024-12-18T00:02:51.8295665Z 2024-12-18T00:02:51.8296761Z  2024-12-18T00:02:51.8297242Z  2024-12-18T00:02:51.8297668Z  2024-12-18T00:02:51.8298091Z  2024-12-18T00:02:51.8298488Z  2024-12-18T00:02:51.8298857Z  2024-12-18T00:02:51.8299250Z  2024-12-18T00:02:51.8299612Z  2024-12-18T00:02:51.8300206Z [9,358 / 15,187] 48 actions, 47 running 2024-12-18T00:02:51.8301160Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:02:51.8302644Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2024-12-18T00:02:51.8303665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:02:51.8304737Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:02:51.8305626Z Compiling google/fft.cc; 16s local 2024-12-18T00:02:51.8306629Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:02:51.8307513Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:02:51.8308403Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local ... 2024-12-18T00:02:52.0739103Z 2024-12-18T00:02:52.0740159Z  2024-12-18T00:02:52.0740766Z  2024-12-18T00:02:52.0741166Z  2024-12-18T00:02:52.0741565Z  2024-12-18T00:02:52.0741966Z  2024-12-18T00:02:52.0742331Z  2024-12-18T00:02:52.0742706Z  2024-12-18T00:02:52.0743088Z  2024-12-18T00:02:52.0743629Z [9,361 / 15,187] 48 actions running 2024-12-18T00:02:52.0744762Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:02:52.0745831Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2024-12-18T00:02:52.0746743Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:02:52.0747797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:02:52.0748685Z Compiling google/fft.cc; 16s local 2024-12-18T00:02:52.0749407Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:02:52.0750228Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:02:52.0751129Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local ... 2024-12-18T00:02:52.2746265Z 2024-12-18T00:02:52.2747194Z  2024-12-18T00:02:52.2747715Z  2024-12-18T00:02:52.2748150Z  2024-12-18T00:02:52.2748553Z  2024-12-18T00:02:52.2748978Z  2024-12-18T00:02:52.2749384Z  2024-12-18T00:02:52.2749840Z  2024-12-18T00:02:52.2750259Z  2024-12-18T00:02:52.2750831Z [9,362 / 15,187] 48 actions running 2024-12-18T00:02:52.2751827Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:02:52.2752939Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2024-12-18T00:02:52.2754029Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:02:52.2755252Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:02:52.2756203Z Compiling google/fft.cc; 16s local 2024-12-18T00:02:52.2757004Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:02:52.2757905Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:02:52.2758838Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local ... 2024-12-18T00:02:52.5154725Z 2024-12-18T00:02:52.5155686Z  2024-12-18T00:02:52.5156155Z  2024-12-18T00:02:52.5156560Z  2024-12-18T00:02:52.5156983Z  2024-12-18T00:02:52.5157375Z  2024-12-18T00:02:52.5157764Z  2024-12-18T00:02:52.5158169Z  2024-12-18T00:02:52.5158542Z  2024-12-18T00:02:52.5159141Z [9,369 / 15,187] 48 actions, 47 running 2024-12-18T00:02:52.5160110Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:02:52.5161207Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:02:52.5162181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:02:52.5163290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:02:52.5164210Z Compiling google/fft.cc; 16s local 2024-12-18T00:02:52.5164959Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2024-12-18T00:02:52.5165773Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:02:52.5166628Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local ... 2024-12-18T00:02:52.8117404Z 2024-12-18T00:02:52.8118246Z  2024-12-18T00:02:52.8118681Z  2024-12-18T00:02:52.8119064Z  2024-12-18T00:02:52.8119462Z  2024-12-18T00:02:52.8119845Z  2024-12-18T00:02:52.8120222Z  2024-12-18T00:02:52.8120625Z  2024-12-18T00:02:52.8120998Z  2024-12-18T00:02:52.8121588Z [9,373 / 15,187] 48 actions, 47 running 2024-12-18T00:02:52.8122864Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:02:52.8123898Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:02:52.8124944Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:02:52.8125876Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:02:52.8126678Z Compiling google/fft.cc; 17s local 2024-12-18T00:02:52.8127414Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2024-12-18T00:02:52.8128153Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:02:52.8129007Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local ... 2024-12-18T00:02:53.0133582Z 2024-12-18T00:02:53.0134455Z  2024-12-18T00:02:53.0134958Z  2024-12-18T00:02:53.0135359Z  2024-12-18T00:02:53.0135763Z  2024-12-18T00:02:53.0136163Z  2024-12-18T00:02:53.0136752Z  2024-12-18T00:02:53.0137143Z  2024-12-18T00:02:53.0137578Z  2024-12-18T00:02:53.0138159Z [9,376 / 15,187] 48 actions, 47 running 2024-12-18T00:02:53.0139036Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:02:53.0140092Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:02:53.0141068Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:02:53.0142048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:02:53.0142784Z Compiling google/fft.cc; 17s local 2024-12-18T00:02:53.0143524Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2024-12-18T00:02:53.0144562Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:02:53.0145405Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local ... 2024-12-18T00:02:53.2755619Z 2024-12-18T00:02:53.2756491Z  2024-12-18T00:02:53.2756970Z  2024-12-18T00:02:53.2757381Z  2024-12-18T00:02:53.2757863Z  2024-12-18T00:02:53.2758541Z  2024-12-18T00:02:53.2759088Z  2024-12-18T00:02:53.2759505Z  2024-12-18T00:02:53.2759901Z  2024-12-18T00:02:53.2760487Z [9,379 / 15,187] 48 actions running 2024-12-18T00:02:53.2761479Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:02:53.2762599Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:02:53.2763677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:02:53.2764883Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:02:53.2765819Z Compiling google/fft.cc; 17s local 2024-12-18T00:02:53.2766611Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2024-12-18T00:02:53.2767488Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:02:53.2768388Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local ... 2024-12-18T00:02:53.5023539Z 2024-12-18T00:02:53.5024531Z  2024-12-18T00:02:53.5025023Z  2024-12-18T00:02:53.5025418Z  2024-12-18T00:02:53.5025827Z  2024-12-18T00:02:53.5026217Z  2024-12-18T00:02:53.5026607Z  2024-12-18T00:02:53.5026989Z  2024-12-18T00:02:53.5027360Z  2024-12-18T00:02:53.5027925Z [9,384 / 15,187] 48 actions, 47 running 2024-12-18T00:02:53.5028838Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:02:53.5030022Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:02:53.5031025Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:02:53.5032585Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:02:53.5033457Z Compiling google/fft.cc; 17s local 2024-12-18T00:02:53.5034200Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2024-12-18T00:02:53.5035063Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:02:53.5036208Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local ... 2024-12-18T00:02:53.7495863Z 2024-12-18T00:02:53.7496837Z  2024-12-18T00:02:53.7497332Z  2024-12-18T00:02:53.7497739Z  2024-12-18T00:02:53.7498133Z  2024-12-18T00:02:53.7498540Z  2024-12-18T00:02:53.7498942Z  2024-12-18T00:02:53.7499352Z  2024-12-18T00:02:53.7499843Z  2024-12-18T00:02:53.7500474Z [9,389 / 15,187] 48 actions, 47 running 2024-12-18T00:02:53.7501377Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:02:53.7502476Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:02:53.7503487Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:02:53.7504525Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:02:53.7505360Z Compiling google/fft.cc; 18s local 2024-12-18T00:02:53.7506097Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2024-12-18T00:02:53.7506939Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:02:53.7507773Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local ... 2024-12-18T00:02:54.0506380Z 2024-12-18T00:02:54.0507413Z  2024-12-18T00:02:54.0507965Z  2024-12-18T00:02:54.0508392Z  2024-12-18T00:02:54.0508851Z  2024-12-18T00:02:54.0509249Z  2024-12-18T00:02:54.0509628Z  2024-12-18T00:02:54.0509989Z  2024-12-18T00:02:54.0510364Z  2024-12-18T00:02:54.0510904Z [9,393 / 15,187] 48 actions, 47 running 2024-12-18T00:02:54.0511963Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:02:54.0512917Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:02:54.0513855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:02:54.0514899Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:02:54.0515653Z Compiling google/fft.cc; 18s local 2024-12-18T00:02:54.0516308Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2024-12-18T00:02:54.0517081Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:02:54.0517760Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local ... 2024-12-18T00:02:54.2621195Z 2024-12-18T00:02:54.2622128Z  2024-12-18T00:02:54.2622593Z  2024-12-18T00:02:54.2622993Z  2024-12-18T00:02:54.2623350Z  2024-12-18T00:02:54.2623748Z  2024-12-18T00:02:54.2624138Z  2024-12-18T00:02:54.2624573Z  2024-12-18T00:02:54.2624960Z  2024-12-18T00:02:54.2625558Z [9,396 / 15,187] 48 actions, 47 running 2024-12-18T00:02:54.2626506Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:02:54.2627545Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:02:54.2628538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:02:54.2629636Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:02:54.2630487Z Compiling google/fft.cc; 18s local 2024-12-18T00:02:54.2631264Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2024-12-18T00:02:54.2632151Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:02:54.2632989Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local ... 2024-12-18T00:02:54.4767208Z 2024-12-18T00:02:54.4768193Z  2024-12-18T00:02:54.4768670Z  2024-12-18T00:02:54.4769482Z  2024-12-18T00:02:54.4769910Z  2024-12-18T00:02:54.4770344Z  2024-12-18T00:02:54.4770718Z  2024-12-18T00:02:54.4771093Z  2024-12-18T00:02:54.4771490Z  2024-12-18T00:02:54.4772028Z [9,400 / 15,187] 48 actions running 2024-12-18T00:02:54.4772954Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:02:54.4774263Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2024-12-18T00:02:54.4775273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:02:54.4776552Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:02:54.4777437Z Compiling google/fft.cc; 18s local 2024-12-18T00:02:54.4778164Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2024-12-18T00:02:54.4778974Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:02:54.4779817Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local ... 2024-12-18T00:02:54.8739585Z 2024-12-18T00:02:54.8740506Z  2024-12-18T00:02:54.8740990Z  2024-12-18T00:02:54.8741358Z  2024-12-18T00:02:54.8741759Z  2024-12-18T00:02:54.8742139Z  2024-12-18T00:02:54.8742528Z  2024-12-18T00:02:54.8742899Z  2024-12-18T00:02:54.8743245Z  2024-12-18T00:02:54.8743810Z [9,403 / 15,187] 48 actions, 47 running 2024-12-18T00:02:54.8744955Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:02:54.8745904Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2024-12-18T00:02:54.8746879Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:02:54.8747921Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:02:54.8748772Z Compiling google/fft.cc; 19s local 2024-12-18T00:02:54.8749464Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2024-12-18T00:02:54.8750237Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:02:54.8751062Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local ... 2024-12-18T00:02:55.0774143Z 2024-12-18T00:02:55.0775179Z  2024-12-18T00:02:55.0775654Z  2024-12-18T00:02:55.0776000Z  2024-12-18T00:02:55.0776527Z  2024-12-18T00:02:55.0776896Z  2024-12-18T00:02:55.0777240Z  2024-12-18T00:02:55.0777641Z  2024-12-18T00:02:55.0778020Z  2024-12-18T00:02:55.0778550Z [9,408 / 15,187] 47 actions running 2024-12-18T00:02:55.0779439Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:02:55.0780435Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2024-12-18T00:02:55.0781396Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:02:55.0782488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:02:55.0783372Z Compiling google/fft.cc; 19s local 2024-12-18T00:02:55.0784150Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2024-12-18T00:02:55.0784993Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:02:55.0785861Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local ... 2024-12-18T00:02:55.4318884Z 2024-12-18T00:02:55.4319753Z  2024-12-18T00:02:55.4320246Z  2024-12-18T00:02:55.4320628Z  2024-12-18T00:02:55.4321049Z  2024-12-18T00:02:55.4321557Z  2024-12-18T00:02:55.4321924Z  2024-12-18T00:02:55.4322320Z  2024-12-18T00:02:55.4322722Z  2024-12-18T00:02:55.4323295Z [9,410 / 15,187] 48 actions, 47 running 2024-12-18T00:02:55.4324417Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:02:55.4325501Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:02:55.4326557Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:02:55.4327665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:02:55.4328955Z Compiling google/fft.cc; 19s local 2024-12-18T00:02:55.4329671Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:02:55.4330447Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:02:55.4331348Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local ... 2024-12-18T00:02:55.6782189Z 2024-12-18T00:02:55.6783016Z  2024-12-18T00:02:55.6783484Z  2024-12-18T00:02:55.6783872Z  2024-12-18T00:02:55.6784270Z  2024-12-18T00:02:55.6784661Z  2024-12-18T00:02:55.6785070Z  2024-12-18T00:02:55.6785407Z  2024-12-18T00:02:55.6785764Z  2024-12-18T00:02:55.6786317Z [9,411 / 15,187] 48 actions running 2024-12-18T00:02:55.6787298Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:02:55.6788354Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:02:55.6789412Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:02:55.6790586Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:02:55.6791508Z Compiling google/fft.cc; 20s local 2024-12-18T00:02:55.6792294Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:02:55.6793187Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:02:55.6794055Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local ... 2024-12-18T00:02:55.8788063Z 2024-12-18T00:02:55.8788985Z  2024-12-18T00:02:55.8789484Z  2024-12-18T00:02:55.8789869Z  2024-12-18T00:02:55.8790273Z  2024-12-18T00:02:55.8790669Z  2024-12-18T00:02:55.8791055Z  2024-12-18T00:02:55.8791458Z  2024-12-18T00:02:55.8791856Z  2024-12-18T00:02:55.8792441Z [9,414 / 15,187] 48 actions, 47 running 2024-12-18T00:02:55.8793344Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:02:55.8794331Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:02:55.8795290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:02:55.8796341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:02:55.8797248Z Compiling google/fft.cc; 20s local 2024-12-18T00:02:55.8797992Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:02:55.8798797Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:02:55.8799712Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local ... 2024-12-18T00:02:56.0917670Z 2024-12-18T00:02:56.0918584Z  2024-12-18T00:02:56.0919076Z  2024-12-18T00:02:56.0919489Z  2024-12-18T00:02:56.0919910Z  2024-12-18T00:02:56.0920293Z  2024-12-18T00:02:56.0920699Z  2024-12-18T00:02:56.0921116Z  2024-12-18T00:02:56.0921530Z  2024-12-18T00:02:56.0922140Z [9,419 / 15,187] 48 actions, 47 running 2024-12-18T00:02:56.0923107Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:02:56.0924171Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:02:56.0925222Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:02:56.0926445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:02:56.0927364Z Compiling google/fft.cc; 20s local 2024-12-18T00:02:56.0928090Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:02:56.0928911Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:02:56.0929765Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local ... 2024-12-18T00:02:56.4012177Z 2024-12-18T00:02:56.4013407Z  2024-12-18T00:02:56.4013842Z  2024-12-18T00:02:56.4014208Z  2024-12-18T00:02:56.4014592Z  2024-12-18T00:02:56.4014965Z  2024-12-18T00:02:56.4015725Z  2024-12-18T00:02:56.4016071Z  2024-12-18T00:02:56.4016565Z  2024-12-18T00:02:56.4017139Z [9,422 / 15,187] 48 actions, 47 running 2024-12-18T00:02:56.4018040Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:02:56.4019102Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:02:56.4020403Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:02:56.4021591Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:02:56.4022518Z Compiling google/fft.cc; 20s local 2024-12-18T00:02:56.4023301Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:02:56.4024233Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:02:56.4025150Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local ... 2024-12-18T00:02:56.6261249Z 2024-12-18T00:02:56.6262122Z  2024-12-18T00:02:56.6262597Z  2024-12-18T00:02:56.6263012Z  2024-12-18T00:02:56.6263383Z  2024-12-18T00:02:56.6263775Z  2024-12-18T00:02:56.6264153Z  2024-12-18T00:02:56.6264556Z  2024-12-18T00:02:56.6264930Z  2024-12-18T00:02:56.6265500Z [9,424 / 15,187] 48 actions, 47 running 2024-12-18T00:02:56.6266425Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:02:56.6267547Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:02:56.6268625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:02:56.6269834Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:02:56.6270712Z Compiling google/fft.cc; 21s local 2024-12-18T00:02:56.6271645Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:02:56.6272505Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:02:56.6273385Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local ... 2024-12-18T00:02:56.8592700Z 2024-12-18T00:02:56.8594901Z  2024-12-18T00:02:56.8595362Z  2024-12-18T00:02:56.8595776Z  2024-12-18T00:02:56.8596178Z  2024-12-18T00:02:56.8596581Z  2024-12-18T00:02:56.8596968Z  2024-12-18T00:02:56.8597364Z  2024-12-18T00:02:56.8597755Z  2024-12-18T00:02:56.8598372Z [9,428 / 15,187] 48 actions, 47 running 2024-12-18T00:02:56.8599358Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:02:56.8600424Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:02:56.8601470Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:02:56.8602629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:02:56.8603535Z Compiling google/fft.cc; 21s local 2024-12-18T00:02:56.8604291Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:02:56.8605177Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:02:56.8606079Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local ... 2024-12-18T00:02:57.0798882Z 2024-12-18T00:02:57.0799798Z  2024-12-18T00:02:57.0800323Z  2024-12-18T00:02:57.0800743Z  2024-12-18T00:02:57.0801166Z  2024-12-18T00:02:57.0801580Z  2024-12-18T00:02:57.0801954Z  2024-12-18T00:02:57.0802375Z  2024-12-18T00:02:57.0802748Z  2024-12-18T00:02:57.0803301Z [9,430 / 15,187] 48 actions running 2024-12-18T00:02:57.0804221Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:02:57.0805297Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:02:57.0806334Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:02:57.0807450Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:02:57.0808385Z Compiling google/fft.cc; 21s local 2024-12-18T00:02:57.0809485Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:02:57.0810329Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:02:57.0811193Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local ... 2024-12-18T00:02:57.2805860Z 2024-12-18T00:02:57.2806780Z  2024-12-18T00:02:57.2807274Z  2024-12-18T00:02:57.2808056Z  2024-12-18T00:02:57.2808473Z  2024-12-18T00:02:57.2808817Z  2024-12-18T00:02:57.2809119Z  2024-12-18T00:02:57.2809434Z  2024-12-18T00:02:57.2809891Z  2024-12-18T00:02:57.2810341Z [9,434 / 15,187] 48 actions running 2024-12-18T00:02:57.2811089Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:02:57.2811899Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:02:57.2812684Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:02:57.2813575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:02:57.2814266Z Compiling google/fft.cc; 21s local 2024-12-18T00:02:57.2814862Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:02:57.2815536Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:02:57.2816211Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local ... 2024-12-18T00:02:57.6776296Z 2024-12-18T00:02:57.6777258Z  2024-12-18T00:02:57.6777774Z  2024-12-18T00:02:57.6778199Z  2024-12-18T00:02:57.6778599Z  2024-12-18T00:02:57.6779018Z  2024-12-18T00:02:57.6779377Z  2024-12-18T00:02:57.6779725Z  2024-12-18T00:02:57.6780067Z  2024-12-18T00:02:57.6780636Z [9,440 / 15,187] 48 actions, 47 running 2024-12-18T00:02:57.6781551Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:02:57.6782559Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:02:57.6783699Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:02:57.6784807Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:02:57.6785726Z Compiling google/fft.cc; 22s local 2024-12-18T00:02:57.6786461Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:02:57.6787337Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:02:57.6788162Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local ... 2024-12-18T00:02:57.8815396Z 2024-12-18T00:02:57.8816426Z  2024-12-18T00:02:57.8816965Z  2024-12-18T00:02:57.8817374Z  2024-12-18T00:02:57.8817796Z  2024-12-18T00:02:57.8818191Z  2024-12-18T00:02:57.8818555Z  2024-12-18T00:02:57.8818912Z  2024-12-18T00:02:57.8819294Z  2024-12-18T00:02:57.8819851Z [9,443 / 15,187] 48 actions running 2024-12-18T00:02:57.8820806Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:02:57.8821925Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:02:57.8822937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:02:57.8824094Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:02:57.8824943Z Compiling google/fft.cc; 22s local 2024-12-18T00:02:57.8825698Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:02:57.8826452Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:02:57.8827324Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local ... 2024-12-18T00:02:58.0821345Z 2024-12-18T00:02:58.0822177Z  2024-12-18T00:02:58.0822685Z  2024-12-18T00:02:58.0823099Z  2024-12-18T00:02:58.0823519Z  2024-12-18T00:02:58.0823933Z  2024-12-18T00:02:58.0824300Z  2024-12-18T00:02:58.0824667Z  2024-12-18T00:02:58.0825036Z  2024-12-18T00:02:58.0825916Z [9,444 / 15,187] 48 actions running 2024-12-18T00:02:58.0826868Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:02:58.0827882Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:02:58.0828878Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:02:58.0830231Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:02:58.0831108Z Compiling google/fft.cc; 22s local 2024-12-18T00:02:58.0831824Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:02:58.0832629Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:02:58.0833489Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local ... 2024-12-18T00:02:58.2827333Z 2024-12-18T00:02:58.2828302Z  2024-12-18T00:02:58.2828808Z  2024-12-18T00:02:58.2829248Z  2024-12-18T00:02:58.2829634Z  2024-12-18T00:02:58.2830023Z  2024-12-18T00:02:58.2830440Z  2024-12-18T00:02:58.2830845Z  2024-12-18T00:02:58.2831241Z  2024-12-18T00:02:58.2831747Z [9,445 / 15,187] 48 actions running 2024-12-18T00:02:58.2832659Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:02:58.2833743Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:02:58.2834778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:02:58.2835896Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:02:58.2836796Z Compiling google/fft.cc; 22s local 2024-12-18T00:02:58.2837522Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:02:58.2838357Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:02:58.2839233Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local ... 2024-12-18T00:02:58.4834201Z 2024-12-18T00:02:58.4835108Z  2024-12-18T00:02:58.4835607Z  2024-12-18T00:02:58.4836161Z  2024-12-18T00:02:58.4836576Z  2024-12-18T00:02:58.4836971Z  2024-12-18T00:02:58.4837361Z  2024-12-18T00:02:58.4837772Z  2024-12-18T00:02:58.4838188Z  2024-12-18T00:02:58.4838745Z [9,447 / 15,187] 48 actions running 2024-12-18T00:02:58.4839691Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:02:58.4840794Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:02:58.4841854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:02:58.4842978Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:02:58.4843839Z Compiling google/fft.cc; 22s local 2024-12-18T00:02:58.4851001Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:02:58.4851811Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:02:58.4852782Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local ... 2024-12-18T00:02:58.7883868Z 2024-12-18T00:02:58.7884822Z  2024-12-18T00:02:58.7885294Z  2024-12-18T00:02:58.7885689Z  2024-12-18T00:02:58.7886087Z  2024-12-18T00:02:58.7886436Z  2024-12-18T00:02:58.7886794Z  2024-12-18T00:02:58.7887145Z  2024-12-18T00:02:58.7887528Z  2024-12-18T00:02:58.7888153Z [9,450 / 15,187] 48 actions, 47 running 2024-12-18T00:02:58.7889135Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:02:58.7890219Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:02:58.7891253Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:02:58.7892394Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:02:58.7893282Z Compiling google/fft.cc; 23s local 2024-12-18T00:02:58.7894064Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:02:58.7895312Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:02:58.7896222Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local ... 2024-12-18T00:02:58.9921507Z 2024-12-18T00:02:58.9922479Z  2024-12-18T00:02:58.9922916Z  2024-12-18T00:02:58.9923267Z  2024-12-18T00:02:58.9923638Z  2024-12-18T00:02:58.9923995Z  2024-12-18T00:02:58.9924379Z  2024-12-18T00:02:58.9925364Z  2024-12-18T00:02:58.9925756Z  2024-12-18T00:02:58.9926341Z [9,455 / 15,187] 48 actions, 47 running 2024-12-18T00:02:58.9927237Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:02:58.9928150Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:02:58.9929070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:02:58.9930074Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:02:58.9930873Z Compiling google/fft.cc; 23s local 2024-12-18T00:02:58.9931581Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:02:58.9932347Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:02:58.9933133Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local ... 2024-12-18T00:02:59.2846236Z 2024-12-18T00:02:59.2847122Z  2024-12-18T00:02:59.2847571Z  2024-12-18T00:02:59.2847979Z  2024-12-18T00:02:59.2848358Z  2024-12-18T00:02:59.2848741Z  2024-12-18T00:02:59.2849132Z  2024-12-18T00:02:59.2849509Z  2024-12-18T00:02:59.2849936Z  2024-12-18T00:02:59.2850603Z [9,461 / 15,187] 48 actions running 2024-12-18T00:02:59.2851549Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:02:59.2852618Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:02:59.2853593Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:02:59.2854729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:02:59.2855647Z Compiling google/fft.cc; 23s local 2024-12-18T00:02:59.2856598Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:02:59.2857503Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:02:59.2858374Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local ... 2024-12-18T00:02:59.4893286Z 2024-12-18T00:02:59.4894283Z  2024-12-18T00:02:59.4894747Z  2024-12-18T00:02:59.4895127Z  2024-12-18T00:02:59.4895514Z  2024-12-18T00:02:59.4895897Z  2024-12-18T00:02:59.4896243Z  2024-12-18T00:02:59.4896739Z  2024-12-18T00:02:59.4897108Z  2024-12-18T00:02:59.4897626Z [9,465 / 15,187] 48 actions running 2024-12-18T00:02:59.4898550Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:02:59.4899598Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:02:59.4900768Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:02:59.4901944Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:02:59.4902870Z Compiling google/fft.cc; 23s local 2024-12-18T00:02:59.4903652Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:02:59.4904534Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:02:59.4905425Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local ... 2024-12-18T00:02:59.6862240Z 2024-12-18T00:02:59.6863170Z  2024-12-18T00:02:59.6863622Z  2024-12-18T00:02:59.6863972Z  2024-12-18T00:02:59.6864322Z  2024-12-18T00:02:59.6864670Z  2024-12-18T00:02:59.6864984Z  2024-12-18T00:02:59.6865331Z  2024-12-18T00:02:59.6865677Z  2024-12-18T00:02:59.6866225Z [9,466 / 15,187] 48 actions running 2024-12-18T00:02:59.6867075Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:02:59.6868360Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:02:59.6869194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:02:59.6870116Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:02:59.6870884Z Compiling google/fft.cc; 24s local 2024-12-18T00:02:59.6871741Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:02:59.6872536Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:02:59.6873393Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local ... 2024-12-18T00:02:59.8878776Z 2024-12-18T00:02:59.8879608Z  2024-12-18T00:02:59.8880103Z  2024-12-18T00:02:59.8880671Z  2024-12-18T00:02:59.8881082Z  2024-12-18T00:02:59.8881489Z  2024-12-18T00:02:59.8881880Z  2024-12-18T00:02:59.8882272Z  2024-12-18T00:02:59.8882678Z  2024-12-18T00:02:59.8883308Z [9,471 / 15,187] 48 actions running 2024-12-18T00:02:59.8884293Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:02:59.8885387Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:02:59.8886460Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:02:59.8887647Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:02:59.8888498Z Compiling google/fft.cc; 24s local 2024-12-18T00:02:59.8889284Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:02:59.8890162Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:02:59.8891015Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local ... 2024-12-18T00:03:00.1567251Z 2024-12-18T00:03:00.1568096Z  2024-12-18T00:03:00.1568561Z  2024-12-18T00:03:00.1568965Z  2024-12-18T00:03:00.1569370Z  2024-12-18T00:03:00.1569806Z  2024-12-18T00:03:00.1570221Z  2024-12-18T00:03:00.1570610Z  2024-12-18T00:03:00.1571010Z  2024-12-18T00:03:00.1571595Z [9,473 / 15,187] 48 actions, 47 running 2024-12-18T00:03:00.1572523Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:03:00.1573576Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:03:00.1574656Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:03:00.1575827Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:03:00.1576900Z Compiling google/fft.cc; 24s local 2024-12-18T00:03:00.1577657Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:03:00.1578504Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:03:00.1579367Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local ... 2024-12-18T00:03:00.3884648Z 2024-12-18T00:03:00.3885522Z  2024-12-18T00:03:00.3886025Z  2024-12-18T00:03:00.3886383Z  2024-12-18T00:03:00.3886746Z  2024-12-18T00:03:00.3887104Z  2024-12-18T00:03:00.3887495Z  2024-12-18T00:03:00.3887878Z  2024-12-18T00:03:00.3888259Z  2024-12-18T00:03:00.3888837Z [9,477 / 15,187] 48 actions, 47 running 2024-12-18T00:03:00.3889767Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:03:00.3890843Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2024-12-18T00:03:00.3891831Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:03:00.3892899Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:03:00.3893726Z Compiling google/fft.cc; 24s local 2024-12-18T00:03:00.3894460Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:03:00.3895250Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:03:00.3896091Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local ... 2024-12-18T00:03:00.6931196Z 2024-12-18T00:03:00.6932011Z  2024-12-18T00:03:00.6932490Z  2024-12-18T00:03:00.6932922Z  2024-12-18T00:03:00.6933342Z  2024-12-18T00:03:00.6933766Z  2024-12-18T00:03:00.6934179Z  2024-12-18T00:03:00.6934610Z  2024-12-18T00:03:00.6935033Z  2024-12-18T00:03:00.6935945Z [9,485 / 15,187] 48 actions running 2024-12-18T00:03:00.6937035Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:03:00.6938236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:03:00.6939428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:03:00.6940368Z Compiling google/fft.cc; 25s local 2024-12-18T00:03:00.6941288Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:03:00.6942175Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:03:00.6943087Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:03:00.6943998Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local ... 2024-12-18T00:03:00.8937417Z 2024-12-18T00:03:00.8938268Z  2024-12-18T00:03:00.8938748Z  2024-12-18T00:03:00.8939155Z  2024-12-18T00:03:00.8939562Z  2024-12-18T00:03:00.8939929Z  2024-12-18T00:03:00.8940365Z  2024-12-18T00:03:00.8940768Z  2024-12-18T00:03:00.8941169Z  2024-12-18T00:03:00.8941732Z [9,488 / 15,187] 48 actions running 2024-12-18T00:03:00.8942659Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:03:00.8943966Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:03:00.8945451Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:03:00.8946392Z Compiling google/fft.cc; 25s local 2024-12-18T00:03:00.8947159Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:03:00.8948030Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:03:00.8948873Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:03:00.8949788Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local ... 2024-12-18T00:03:01.1273852Z 2024-12-18T00:03:01.1274638Z  2024-12-18T00:03:01.1275112Z  2024-12-18T00:03:01.1275572Z  2024-12-18T00:03:01.1275985Z  2024-12-18T00:03:01.1276390Z  2024-12-18T00:03:01.1276779Z  2024-12-18T00:03:01.1277184Z  2024-12-18T00:03:01.1277583Z  2024-12-18T00:03:01.1278203Z [9,489 / 15,187] 48 actions, 47 running 2024-12-18T00:03:01.1279160Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:03:01.1280316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:03:01.1281605Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:03:01.1282569Z Compiling google/fft.cc; 25s local 2024-12-18T00:03:01.1283304Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:03:01.1284159Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:03:01.1284984Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:03:01.1285915Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local ... 2024-12-18T00:03:01.4965491Z 2024-12-18T00:03:01.4966325Z  2024-12-18T00:03:01.4966879Z  2024-12-18T00:03:01.4967317Z  2024-12-18T00:03:01.4967695Z  2024-12-18T00:03:01.4968062Z  2024-12-18T00:03:01.4968443Z  2024-12-18T00:03:01.4968839Z  2024-12-18T00:03:01.4969221Z  2024-12-18T00:03:01.4969819Z [9,490 / 15,187] 48 actions running 2024-12-18T00:03:01.4970829Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:03:01.4971912Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:03:01.4973462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:03:01.4974346Z Compiling google/fft.cc; 25s local 2024-12-18T00:03:01.4975111Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2024-12-18T00:03:01.4975940Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:03:01.4977207Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:03:01.4978088Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local ... 2024-12-18T00:03:01.7032657Z 2024-12-18T00:03:01.7033533Z  2024-12-18T00:03:01.7034019Z  2024-12-18T00:03:01.7034426Z  2024-12-18T00:03:01.7034800Z  2024-12-18T00:03:01.7035204Z  2024-12-18T00:03:01.7035577Z  2024-12-18T00:03:01.7035977Z  2024-12-18T00:03:01.7036375Z  2024-12-18T00:03:01.7036978Z [9,493 / 15,187] 48 actions, 47 running 2024-12-18T00:03:01.7037901Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:03:01.7039055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:03:01.7040124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:03:01.7040889Z Compiling google/fft.cc; 26s local 2024-12-18T00:03:01.7041612Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2024-12-18T00:03:01.7042404Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:03:01.7043372Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:03:01.7044475Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local ... 2024-12-18T00:03:01.9716639Z 2024-12-18T00:03:01.9717463Z  2024-12-18T00:03:01.9717940Z  2024-12-18T00:03:01.9718340Z  2024-12-18T00:03:01.9718715Z  2024-12-18T00:03:01.9719070Z  2024-12-18T00:03:01.9719583Z  2024-12-18T00:03:01.9720026Z  2024-12-18T00:03:01.9720398Z  2024-12-18T00:03:01.9720995Z [9,495 / 15,187] 48 actions, 47 running 2024-12-18T00:03:01.9721941Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:03:01.9723075Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:03:01.9724165Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:03:01.9735511Z Compiling google/fft.cc; 26s local 2024-12-18T00:03:01.9736656Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2024-12-18T00:03:01.9737472Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:03:01.9738260Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:03:01.9739099Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local ... 2024-12-18T00:03:02.1793492Z 2024-12-18T00:03:02.1794323Z  2024-12-18T00:03:02.1794834Z  2024-12-18T00:03:02.1795242Z  2024-12-18T00:03:02.1795749Z  2024-12-18T00:03:02.1796175Z  2024-12-18T00:03:02.1796626Z  2024-12-18T00:03:02.1797041Z  2024-12-18T00:03:02.1797454Z  2024-12-18T00:03:02.1798141Z [9,497 / 15,187] 48 actions, 47 running 2024-12-18T00:03:02.1799114Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:03:02.1800373Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:03:02.1801622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:03:02.1802551Z Compiling google/fft.cc; 26s local 2024-12-18T00:03:02.1803333Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2024-12-18T00:03:02.1804301Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:03:02.1805223Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:03:02.1806165Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local ... 2024-12-18T00:03:02.3922762Z 2024-12-18T00:03:02.3923662Z  2024-12-18T00:03:02.3924522Z  2024-12-18T00:03:02.3924921Z  2024-12-18T00:03:02.3925330Z  2024-12-18T00:03:02.3925745Z  2024-12-18T00:03:02.3926154Z  2024-12-18T00:03:02.3926542Z  2024-12-18T00:03:02.3926949Z  2024-12-18T00:03:02.3927547Z [9,500 / 15,187] 48 actions, 47 running 2024-12-18T00:03:02.3928724Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:03:02.3929913Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:03:02.3931018Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:03:02.3931918Z Compiling google/fft.cc; 26s local 2024-12-18T00:03:02.3932665Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:03:02.3933599Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:03:02.3934469Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:03:02.3935357Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local ... 2024-12-18T00:03:02.6244574Z 2024-12-18T00:03:02.6245415Z  2024-12-18T00:03:02.6245887Z  2024-12-18T00:03:02.6246291Z  2024-12-18T00:03:02.6246685Z  2024-12-18T00:03:02.6247066Z  2024-12-18T00:03:02.6247421Z  2024-12-18T00:03:02.6247798Z  2024-12-18T00:03:02.6248187Z  2024-12-18T00:03:02.6248823Z [9,504 / 15,187] 48 actions, 47 running 2024-12-18T00:03:02.6249758Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:03:02.6250866Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:03:02.6251994Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:03:02.6252871Z Compiling google/fft.cc; 27s local 2024-12-18T00:03:02.6253636Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:03:02.6254510Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:03:02.6255364Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:03:02.6256205Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local ... 2024-12-18T00:03:02.8315052Z 2024-12-18T00:03:02.8315896Z  2024-12-18T00:03:02.8316370Z  2024-12-18T00:03:02.8316783Z  2024-12-18T00:03:02.8317164Z  2024-12-18T00:03:02.8317530Z  2024-12-18T00:03:02.8317950Z  2024-12-18T00:03:02.8318347Z  2024-12-18T00:03:02.8318755Z  2024-12-18T00:03:02.8319367Z [9,507 / 15,187] 48 actions, 47 running 2024-12-18T00:03:02.8320243Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:03:02.8321387Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:03:02.8322511Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:03:02.8323375Z Compiling google/fft.cc; 27s local 2024-12-18T00:03:02.8324126Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:03:02.8325069Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:03:02.8325936Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:03:02.8326762Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local ... 2024-12-18T00:03:03.0961043Z 2024-12-18T00:03:03.0961912Z  2024-12-18T00:03:03.0962417Z  2024-12-18T00:03:03.0962885Z  2024-12-18T00:03:03.0963308Z  2024-12-18T00:03:03.0963716Z  2024-12-18T00:03:03.0964124Z  2024-12-18T00:03:03.0964537Z  2024-12-18T00:03:03.0964949Z  2024-12-18T00:03:03.0965508Z [9,509 / 15,187] 48 actions running 2024-12-18T00:03:03.0966447Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:03:03.0967618Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:03:03.0968740Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:03:03.0970011Z Compiling google/fft.cc; 27s local 2024-12-18T00:03:03.0970743Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:03:03.0971646Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:03:03.0972515Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:03:03.0973610Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local ... 2024-12-18T00:03:03.4205085Z 2024-12-18T00:03:03.4205911Z  2024-12-18T00:03:03.4206412Z  2024-12-18T00:03:03.4206819Z  2024-12-18T00:03:03.4207238Z  2024-12-18T00:03:03.4207642Z  2024-12-18T00:03:03.4208034Z  2024-12-18T00:03:03.4208450Z  2024-12-18T00:03:03.4208861Z  2024-12-18T00:03:03.4209419Z [9,510 / 15,187] 48 actions, 47 running 2024-12-18T00:03:03.4210339Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:03:03.4211576Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:03:03.4212766Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:03:03.4213622Z Compiling google/fft.cc; 27s local 2024-12-18T00:03:03.4214377Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2024-12-18T00:03:03.4215239Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:03:03.4216121Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:03:03.4217166Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local ... 2024-12-18T00:03:03.6304540Z 2024-12-18T00:03:03.6305361Z  2024-12-18T00:03:03.6305821Z  2024-12-18T00:03:03.6306216Z  2024-12-18T00:03:03.6306604Z  2024-12-18T00:03:03.6306974Z  2024-12-18T00:03:03.6307332Z  2024-12-18T00:03:03.6307712Z  2024-12-18T00:03:03.6308074Z  2024-12-18T00:03:03.6308645Z [9,516 / 15,187] 47 actions, 46 running 2024-12-18T00:03:03.6309563Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:03:03.6310699Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:03:03.6311766Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:03:03.6312624Z Compiling google/fft.cc; 28s local 2024-12-18T00:03:03.6313360Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:03:03.6314202Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:03:03.6315001Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:03:03.6315765Z Compiling src/cpu/nhwc_pooling.cpp; 7s local ... 2024-12-18T00:03:03.8848352Z 2024-12-18T00:03:03.8849216Z  2024-12-18T00:03:03.8849689Z  2024-12-18T00:03:03.8850075Z  2024-12-18T00:03:03.8850469Z  2024-12-18T00:03:03.8850849Z  2024-12-18T00:03:03.8851239Z  2024-12-18T00:03:03.8851636Z  2024-12-18T00:03:03.8852036Z  2024-12-18T00:03:03.8852668Z [9,517 / 15,187] 48 actions, 47 running 2024-12-18T00:03:03.8853600Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:03:03.8854707Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:03:03.8855820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:03:03.8856946Z Compiling google/fft.cc; 28s local 2024-12-18T00:03:03.8857640Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2024-12-18T00:03:03.8858475Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:03:03.8859278Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:03:03.8860171Z Compiling src/cpu/nspc_batch_normalization.cpp; 6s local ... 2024-12-18T00:03:04.1050657Z 2024-12-18T00:03:04.1051505Z  2024-12-18T00:03:04.1051938Z  2024-12-18T00:03:04.1052308Z  2024-12-18T00:03:04.1052679Z  2024-12-18T00:03:04.1053064Z  2024-12-18T00:03:04.1053800Z  2024-12-18T00:03:04.1054154Z  2024-12-18T00:03:04.1054511Z  2024-12-18T00:03:04.1054999Z [9,521 / 15,187] 48 actions running 2024-12-18T00:03:04.1055842Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:03:04.1056993Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:03:04.1058290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:03:04.1059102Z Compiling google/fft.cc; 28s local 2024-12-18T00:03:04.1059749Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2024-12-18T00:03:04.1060557Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:03:04.1061304Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:03:04.1062109Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local ... 2024-12-18T00:03:04.6060069Z 2024-12-18T00:03:04.6060935Z  2024-12-18T00:03:04.6061456Z  2024-12-18T00:03:04.6061842Z  2024-12-18T00:03:04.6062331Z  2024-12-18T00:03:04.6062709Z  2024-12-18T00:03:04.6063086Z  2024-12-18T00:03:04.6063465Z  2024-12-18T00:03:04.6063812Z  2024-12-18T00:03:04.6064389Z [9,522 / 15,187] 48 actions, 47 running 2024-12-18T00:03:04.6065228Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:03:04.6066351Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:03:04.6067395Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:03:04.6068202Z Compiling google/fft.cc; 28s local 2024-12-18T00:03:04.6068905Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2024-12-18T00:03:04.6069716Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:03:04.6070489Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:03:04.6071303Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local ... 2024-12-18T00:03:04.8212922Z 2024-12-18T00:03:04.8213761Z  2024-12-18T00:03:04.8214214Z  2024-12-18T00:03:04.8214590Z  2024-12-18T00:03:04.8214978Z  2024-12-18T00:03:04.8215436Z  2024-12-18T00:03:04.8215870Z  2024-12-18T00:03:04.8216341Z  2024-12-18T00:03:04.8216923Z  2024-12-18T00:03:04.8217518Z [9,523 / 15,187] 48 actions, 47 running 2024-12-18T00:03:04.8218363Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:03:04.8219411Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:03:04.8220463Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:03:04.8221296Z Compiling google/fft.cc; 29s local 2024-12-18T00:03:04.8222007Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2024-12-18T00:03:04.8222833Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:03:04.8223666Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:03:04.8224546Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local ... 2024-12-18T00:03:05.1021735Z 2024-12-18T00:03:05.1022597Z  2024-12-18T00:03:05.1023044Z  2024-12-18T00:03:05.1023420Z  2024-12-18T00:03:05.1023765Z  2024-12-18T00:03:05.1024119Z  2024-12-18T00:03:05.1024484Z  2024-12-18T00:03:05.1024889Z  2024-12-18T00:03:05.1025248Z  2024-12-18T00:03:05.1025765Z [9,524 / 15,187] 48 actions running 2024-12-18T00:03:05.1026637Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:03:05.1027741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:03:05.1028791Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:03:05.1029616Z Compiling google/fft.cc; 29s local 2024-12-18T00:03:05.1030274Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2024-12-18T00:03:05.1031482Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:03:05.1032228Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:03:05.1033063Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local ... 2024-12-18T00:03:05.4955369Z 2024-12-18T00:03:05.4956218Z  2024-12-18T00:03:05.4956709Z  2024-12-18T00:03:05.4957111Z  2024-12-18T00:03:05.4957860Z  2024-12-18T00:03:05.4958233Z  2024-12-18T00:03:05.4958598Z  2024-12-18T00:03:05.4958969Z  2024-12-18T00:03:05.4959347Z  2024-12-18T00:03:05.4959922Z [9,526 / 15,187] 48 actions, 47 running 2024-12-18T00:03:05.4960840Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:03:05.4961973Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:03:05.4963101Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:03:05.4964134Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2024-12-18T00:03:05.4964989Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:03:05.4965816Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:03:05.4966664Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2024-12-18T00:03:05.4967507Z Compiling src/cpu/ref_deconvolution.cpp; 6s local ... 2024-12-18T00:03:05.6991324Z 2024-12-18T00:03:05.6992172Z  2024-12-18T00:03:05.6992637Z  2024-12-18T00:03:05.6993021Z  2024-12-18T00:03:05.6993385Z  2024-12-18T00:03:05.6993761Z  2024-12-18T00:03:05.6994129Z  2024-12-18T00:03:05.6994523Z  2024-12-18T00:03:05.6994895Z  2024-12-18T00:03:05.6995427Z [9,527 / 15,187] 48 actions running 2024-12-18T00:03:05.6996127Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:03:05.6997001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:03:05.6998105Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:03:05.6998926Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:03:05.6999575Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:03:05.7000278Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:03:05.7001097Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2024-12-18T00:03:05.7001886Z Compiling src/cpu/ref_deconvolution.cpp; 6s local ... 2024-12-18T00:03:05.9614819Z 2024-12-18T00:03:05.9615679Z  2024-12-18T00:03:05.9616186Z  2024-12-18T00:03:05.9616730Z  2024-12-18T00:03:05.9617166Z  2024-12-18T00:03:05.9617581Z  2024-12-18T00:03:05.9617998Z  2024-12-18T00:03:05.9618415Z  2024-12-18T00:03:05.9618832Z  2024-12-18T00:03:05.9619450Z [9,531 / 15,187] 48 actions, 47 running 2024-12-18T00:03:05.9620455Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:03:05.9621739Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:03:05.9622823Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:03:05.9624022Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:03:05.9624941Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:03:05.9625791Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:03:05.9626607Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2024-12-18T00:03:05.9627329Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2024-12-18T00:03:06.3031595Z 2024-12-18T00:03:06.3032439Z  2024-12-18T00:03:06.3032924Z  2024-12-18T00:03:06.3033365Z  2024-12-18T00:03:06.3033799Z  2024-12-18T00:03:06.3034235Z  2024-12-18T00:03:06.3034650Z  2024-12-18T00:03:06.3035086Z  2024-12-18T00:03:06.3035523Z  2024-12-18T00:03:06.3036587Z [9,531 / 15,187] 48 actions running 2024-12-18T00:03:06.3037640Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:03:06.3038907Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:03:06.3040167Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:03:06.3041487Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:03:06.3042434Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:03:06.3043355Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:03:06.3044448Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2024-12-18T00:03:06.3045193Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2024-12-18T00:03:06.8318163Z 2024-12-18T00:03:06.8318951Z  2024-12-18T00:03:06.8319350Z  2024-12-18T00:03:06.8319693Z  2024-12-18T00:03:06.8320015Z  2024-12-18T00:03:06.8320344Z  2024-12-18T00:03:06.8320726Z  2024-12-18T00:03:06.8321060Z  2024-12-18T00:03:06.8321370Z  2024-12-18T00:03:06.8321884Z [9,532 / 15,187] 48 actions, 47 running 2024-12-18T00:03:06.8322718Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:03:06.8323675Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:03:06.8324577Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:03:06.8325392Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:03:06.8326086Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:03:06.8326792Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:03:06.8327399Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2024-12-18T00:03:06.8327947Z Compiling src/cpu/ref_lrn.cpp; 7s local ... 2024-12-18T00:03:07.1006247Z 2024-12-18T00:03:07.1007131Z  2024-12-18T00:03:07.1007679Z  2024-12-18T00:03:07.1008187Z  2024-12-18T00:03:07.1008665Z  2024-12-18T00:03:07.1009136Z  2024-12-18T00:03:07.1009603Z  2024-12-18T00:03:07.1010053Z  2024-12-18T00:03:07.1010525Z  2024-12-18T00:03:07.1011149Z [9,534 / 15,187] 48 actions running 2024-12-18T00:03:07.1012160Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:03:07.1013316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:03:07.1014393Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:03:07.1015358Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:03:07.1016202Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:03:07.1017190Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:03:07.1017912Z Compiling src/cpu/ref_lrn.cpp; 7s local 2024-12-18T00:03:07.1018580Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2024-12-18T00:03:07.5013389Z 2024-12-18T00:03:07.5014232Z  2024-12-18T00:03:07.5014688Z  2024-12-18T00:03:07.5015033Z  2024-12-18T00:03:07.5015411Z  2024-12-18T00:03:07.5015800Z  2024-12-18T00:03:07.5016171Z  2024-12-18T00:03:07.5016706Z  2024-12-18T00:03:07.5017078Z  2024-12-18T00:03:07.5017604Z [9,536 / 15,187] 48 actions running 2024-12-18T00:03:07.5018534Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:03:07.5019650Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:03:07.5020765Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:03:07.5021718Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:03:07.5022532Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:03:07.5023329Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:03:07.5024466Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:03:07.5025339Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local ... 2024-12-18T00:03:07.7188732Z 2024-12-18T00:03:07.7189587Z  2024-12-18T00:03:07.7190069Z  2024-12-18T00:03:07.7190464Z  2024-12-18T00:03:07.7190851Z  2024-12-18T00:03:07.7191354Z  2024-12-18T00:03:07.7191734Z  2024-12-18T00:03:07.7192720Z  2024-12-18T00:03:07.7193197Z  2024-12-18T00:03:07.7193792Z [9,537 / 15,187] 48 actions, 47 running 2024-12-18T00:03:07.7194705Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:03:07.7195831Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:03:07.7196946Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:03:07.7197929Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:03:07.7198791Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:03:07.7199648Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:03:07.7200417Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:03:07.7201370Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local ... 2024-12-18T00:03:07.9911226Z 2024-12-18T00:03:07.9912047Z  2024-12-18T00:03:07.9912534Z  2024-12-18T00:03:07.9912974Z  2024-12-18T00:03:07.9913378Z  2024-12-18T00:03:07.9913761Z  2024-12-18T00:03:07.9914117Z  2024-12-18T00:03:07.9914511Z  2024-12-18T00:03:07.9914920Z  2024-12-18T00:03:07.9915494Z [9,542 / 15,187] 48 actions, 47 running 2024-12-18T00:03:07.9916414Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:03:07.9917547Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:03:07.9918609Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:03:07.9919521Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:03:07.9920317Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:03:07.9921373Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2024-12-18T00:03:07.9922263Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 7s local 2024-12-18T00:03:07.9923201Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local ... 2024-12-18T00:03:08.2434530Z 2024-12-18T00:03:08.2435392Z  2024-12-18T00:03:08.2435851Z  2024-12-18T00:03:08.2436247Z  2024-12-18T00:03:08.2436626Z  2024-12-18T00:03:08.2437013Z  2024-12-18T00:03:08.2437398Z  2024-12-18T00:03:08.2437780Z  2024-12-18T00:03:08.2438167Z  2024-12-18T00:03:08.2438768Z [9,543 / 15,187] 48 actions, 47 running 2024-12-18T00:03:08.2439685Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:03:08.2440812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:03:08.2441848Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:03:08.2442819Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:03:08.2443603Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:03:08.2444837Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2024-12-18T00:03:08.2445842Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 7s local 2024-12-18T00:03:08.2446737Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local ... 2024-12-18T00:03:08.5024225Z 2024-12-18T00:03:08.5025060Z  2024-12-18T00:03:08.5025516Z  2024-12-18T00:03:08.5025926Z  2024-12-18T00:03:08.5026338Z  2024-12-18T00:03:08.5026733Z  2024-12-18T00:03:08.5027141Z  2024-12-18T00:03:08.5027520Z  2024-12-18T00:03:08.5027907Z  2024-12-18T00:03:08.5028438Z [9,544 / 15,187] 48 actions running 2024-12-18T00:03:08.5029699Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:03:08.5030864Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:03:08.5031906Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:03:08.5032786Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:03:08.5033874Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:03:08.5034874Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 8s local 2024-12-18T00:03:08.5035874Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 7s local 2024-12-18T00:03:08.5036844Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local ... 2024-12-18T00:03:08.7029195Z 2024-12-18T00:03:08.7030023Z  2024-12-18T00:03:08.7030499Z  2024-12-18T00:03:08.7030894Z  2024-12-18T00:03:08.7031276Z  2024-12-18T00:03:08.7031639Z  2024-12-18T00:03:08.7032048Z  2024-12-18T00:03:08.7032437Z  2024-12-18T00:03:08.7032819Z  2024-12-18T00:03:08.7033354Z [9,546 / 15,187] 48 actions running 2024-12-18T00:03:08.7034234Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:03:08.7035314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:03:08.7036303Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:03:08.7037147Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:03:08.7037993Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:03:08.7038907Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2024-12-18T00:03:08.7039867Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2024-12-18T00:03:08.7040963Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local ... 2024-12-18T00:03:08.9432177Z 2024-12-18T00:03:08.9433009Z  2024-12-18T00:03:08.9433490Z  2024-12-18T00:03:08.9433839Z  2024-12-18T00:03:08.9434163Z  2024-12-18T00:03:08.9434504Z  2024-12-18T00:03:08.9434866Z  2024-12-18T00:03:08.9435205Z  2024-12-18T00:03:08.9435508Z  2024-12-18T00:03:08.9435962Z [9,550 / 15,187] 48 actions, 47 running 2024-12-18T00:03:08.9436682Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:03:08.9437575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:03:08.9438327Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:03:08.9439054Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:03:08.9439738Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:03:08.9440468Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:03:08.9441262Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:03:08.9442045Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local ... 2024-12-18T00:03:09.1893171Z 2024-12-18T00:03:09.1894039Z  2024-12-18T00:03:09.1894518Z  2024-12-18T00:03:09.1894949Z  2024-12-18T00:03:09.1895372Z  2024-12-18T00:03:09.1895799Z  2024-12-18T00:03:09.1896206Z  2024-12-18T00:03:09.1896806Z  2024-12-18T00:03:09.1897238Z  2024-12-18T00:03:09.1897877Z [9,554 / 15,187] 48 actions, 47 running 2024-12-18T00:03:09.1898863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:03:09.1900091Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:03:09.1901156Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:03:09.1902058Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:03:09.1902991Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:03:09.1903981Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:03:09.1905346Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:03:09.1906419Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local ... 2024-12-18T00:03:09.4392720Z 2024-12-18T00:03:09.4393544Z  2024-12-18T00:03:09.4394028Z  2024-12-18T00:03:09.4394450Z  2024-12-18T00:03:09.4394870Z  2024-12-18T00:03:09.4395560Z  2024-12-18T00:03:09.4395987Z  2024-12-18T00:03:09.4396391Z  2024-12-18T00:03:09.4396794Z  2024-12-18T00:03:09.4397397Z [9,557 / 15,187] 48 actions, 47 running 2024-12-18T00:03:09.4398340Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:03:09.4399462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:03:09.4400435Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:03:09.4401285Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:03:09.4402201Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:03:09.4403157Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:03:09.4404174Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:03:09.4405208Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local ... 2024-12-18T00:03:09.6417623Z 2024-12-18T00:03:09.6418555Z  2024-12-18T00:03:09.6419031Z  2024-12-18T00:03:09.6419441Z  2024-12-18T00:03:09.6419839Z  2024-12-18T00:03:09.6420250Z  2024-12-18T00:03:09.6420778Z  2024-12-18T00:03:09.6421176Z  2024-12-18T00:03:09.6421574Z  2024-12-18T00:03:09.6422126Z [9,559 / 15,187] 48 actions, 47 running 2024-12-18T00:03:09.6423038Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:03:09.6424182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:03:09.6425205Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:03:09.6426038Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:03:09.6426935Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:03:09.6427831Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:03:09.6428832Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:03:09.6429908Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local ... 2024-12-18T00:03:09.8399575Z 2024-12-18T00:03:09.8400559Z  2024-12-18T00:03:09.8401006Z  2024-12-18T00:03:09.8401413Z  2024-12-18T00:03:09.8401811Z  2024-12-18T00:03:09.8402209Z  2024-12-18T00:03:09.8402623Z  2024-12-18T00:03:09.8403032Z  2024-12-18T00:03:09.8403442Z  2024-12-18T00:03:09.8404069Z [9,561 / 15,187] 48 actions, 47 running 2024-12-18T00:03:09.8405010Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:03:09.8406217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:03:09.8407224Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:03:09.8408036Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:03:09.8408937Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:03:09.8409943Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:03:09.8410948Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2024-12-18T00:03:09.8411879Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local ... 2024-12-18T00:03:10.1018297Z 2024-12-18T00:03:10.1019117Z  2024-12-18T00:03:10.1019587Z  2024-12-18T00:03:10.1019987Z  2024-12-18T00:03:10.1020386Z  2024-12-18T00:03:10.1020790Z  2024-12-18T00:03:10.1021190Z  2024-12-18T00:03:10.1021599Z  2024-12-18T00:03:10.1022000Z  2024-12-18T00:03:10.1022896Z [9,565 / 15,187] 48 actions, 47 running 2024-12-18T00:03:10.1023839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:03:10.1025026Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:03:10.1026033Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:03:10.1027071Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:03:10.1027861Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:03:10.1028797Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:03:10.1029768Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2024-12-18T00:03:10.1030805Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2024-12-18T00:03:10.3041869Z 2024-12-18T00:03:10.3042682Z  2024-12-18T00:03:10.3043137Z  2024-12-18T00:03:10.3043528Z  2024-12-18T00:03:10.3043984Z  2024-12-18T00:03:10.3044586Z  2024-12-18T00:03:10.3044955Z  2024-12-18T00:03:10.3045351Z  2024-12-18T00:03:10.3045741Z  2024-12-18T00:03:10.3046271Z [9,569 / 15,187] 47 actions running 2024-12-18T00:03:10.3047192Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:03:10.3048366Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:03:10.3049361Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:03:10.3050241Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:03:10.3051055Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:03:10.3051996Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:03:10.3053032Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2024-12-18T00:03:10.3053980Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2024-12-18T00:03:10.5047728Z 2024-12-18T00:03:10.5048529Z  2024-12-18T00:03:10.5049035Z  2024-12-18T00:03:10.5049476Z  2024-12-18T00:03:10.5050000Z  2024-12-18T00:03:10.5050396Z  2024-12-18T00:03:10.5050798Z  2024-12-18T00:03:10.5051178Z  2024-12-18T00:03:10.5051541Z  2024-12-18T00:03:10.5052069Z [9,571 / 15,187] 48 actions running 2024-12-18T00:03:10.5053039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:03:10.5054010Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:03:10.5054936Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:03:10.5055765Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:03:10.5056754Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:03:10.5057657Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:03:10.5058612Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2024-12-18T00:03:10.5059635Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2024-12-18T00:03:10.8987391Z 2024-12-18T00:03:10.8988408Z  2024-12-18T00:03:10.8988882Z  2024-12-18T00:03:10.8989296Z  2024-12-18T00:03:10.8989701Z  2024-12-18T00:03:10.8990098Z  2024-12-18T00:03:10.8990494Z  2024-12-18T00:03:10.8990887Z  2024-12-18T00:03:10.8991292Z  2024-12-18T00:03:10.8991831Z [9,576 / 15,187] 48 actions, 47 running 2024-12-18T00:03:10.8992757Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:03:10.8993965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:03:10.8994906Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:03:10.8995773Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:03:10.8996612Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2024-12-18T00:03:10.8997859Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:03:10.8998840Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:03:10.8999857Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2024-12-18T00:03:11.1051123Z 2024-12-18T00:03:11.1052115Z  2024-12-18T00:03:11.1052642Z  2024-12-18T00:03:11.1053361Z  2024-12-18T00:03:11.1053758Z  2024-12-18T00:03:11.1054163Z  2024-12-18T00:03:11.1054557Z  2024-12-18T00:03:11.1054955Z  2024-12-18T00:03:11.1055367Z  2024-12-18T00:03:11.1055900Z [9,578 / 15,187] 48 actions running 2024-12-18T00:03:11.1056936Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:03:11.1058041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:03:11.1059014Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:03:11.1060044Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:03:11.1060927Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2024-12-18T00:03:11.1061899Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:03:11.1062942Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:03:11.1064032Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2024-12-18T00:03:11.3057322Z 2024-12-18T00:03:11.3058338Z  2024-12-18T00:03:11.3058852Z  2024-12-18T00:03:11.3059250Z  2024-12-18T00:03:11.3059645Z  2024-12-18T00:03:11.3060001Z  2024-12-18T00:03:11.3060357Z  2024-12-18T00:03:11.3060747Z  2024-12-18T00:03:11.3061138Z  2024-12-18T00:03:11.3061656Z [9,582 / 15,187] 48 actions running 2024-12-18T00:03:11.3062567Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:03:11.3063690Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:03:11.3064690Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:03:11.3065688Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2024-12-18T00:03:11.3066596Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2024-12-18T00:03:11.3067566Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:03:11.3068627Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:03:11.3069666Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2024-12-18T00:03:11.6324369Z 2024-12-18T00:03:11.6325407Z  2024-12-18T00:03:11.6325880Z  2024-12-18T00:03:11.6326312Z  2024-12-18T00:03:11.6326713Z  2024-12-18T00:03:11.6327131Z  2024-12-18T00:03:11.6327528Z  2024-12-18T00:03:11.6327894Z  2024-12-18T00:03:11.6328284Z  2024-12-18T00:03:11.6328859Z [9,584 / 15,187] 48 actions, 47 running 2024-12-18T00:03:11.6329814Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:03:11.6330989Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:03:11.6331970Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:03:11.6332857Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:03:11.6333842Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:03:11.6335027Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:03:11.6336068Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2024-12-18T00:03:11.6337254Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local ... 2024-12-18T00:03:11.9063896Z 2024-12-18T00:03:11.9065105Z  2024-12-18T00:03:11.9065826Z  2024-12-18T00:03:11.9066993Z  2024-12-18T00:03:11.9067471Z  2024-12-18T00:03:11.9067851Z  2024-12-18T00:03:11.9068631Z  2024-12-18T00:03:11.9069011Z  2024-12-18T00:03:11.9069415Z  2024-12-18T00:03:11.9069995Z [9,586 / 15,187] 48 actions running 2024-12-18T00:03:11.9070859Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:03:11.9071995Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:03:11.9073262Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:03:11.9074120Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:03:11.9075083Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:03:11.9076097Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:03:11.9077031Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:03:11.9078050Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local ... 2024-12-18T00:03:12.1969892Z 2024-12-18T00:03:12.1971151Z  2024-12-18T00:03:12.1971982Z  2024-12-18T00:03:12.1972586Z  2024-12-18T00:03:12.1973186Z  2024-12-18T00:03:12.1973752Z  2024-12-18T00:03:12.1976965Z  2024-12-18T00:03:12.1977789Z  2024-12-18T00:03:12.1978398Z  2024-12-18T00:03:12.1979162Z [9,589 / 15,187] 48 actions, 47 running 2024-12-18T00:03:12.1980307Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:03:12.1981606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:03:12.1982787Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:03:12.1983833Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:03:12.1985041Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:03:12.1986200Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:03:12.1987384Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:03:12.1988645Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2024-12-18T00:03:12.4257059Z 2024-12-18T00:03:12.4257879Z  2024-12-18T00:03:12.4258364Z  2024-12-18T00:03:12.4258769Z  2024-12-18T00:03:12.4259165Z  2024-12-18T00:03:12.4259551Z  2024-12-18T00:03:12.4259944Z  2024-12-18T00:03:12.4260331Z  2024-12-18T00:03:12.4260723Z  2024-12-18T00:03:12.4261376Z [9,592 / 15,187] 48 actions, 47 running 2024-12-18T00:03:12.4262281Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:03:12.4263414Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:03:12.4264378Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:03:12.4265233Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:03:12.4266187Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:03:12.4267162Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:03:12.4268177Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:03:12.4269182Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2024-12-18T00:03:12.6633677Z 2024-12-18T00:03:12.6634548Z  2024-12-18T00:03:12.6634990Z  2024-12-18T00:03:12.6635365Z  2024-12-18T00:03:12.6635789Z  2024-12-18T00:03:12.6636192Z  2024-12-18T00:03:12.6636564Z  2024-12-18T00:03:12.6636970Z  2024-12-18T00:03:12.6637361Z  2024-12-18T00:03:12.6637952Z [9,594 / 15,187] 48 actions, 47 running 2024-12-18T00:03:12.6638856Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:03:12.6639982Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:03:12.6640929Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:03:12.6641930Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:03:12.6643222Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:03:12.6644445Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:03:12.6645461Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:03:12.6646498Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2024-12-18T00:03:12.8663894Z 2024-12-18T00:03:12.8664794Z  2024-12-18T00:03:12.8665276Z  2024-12-18T00:03:12.8665670Z  2024-12-18T00:03:12.8666068Z  2024-12-18T00:03:12.8666490Z  2024-12-18T00:03:12.8666871Z  2024-12-18T00:03:12.8667281Z  2024-12-18T00:03:12.8667675Z  2024-12-18T00:03:12.8668279Z [9,597 / 15,187] 48 actions, 47 running 2024-12-18T00:03:12.8669183Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:03:12.8670290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:03:12.8671411Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:03:12.8672265Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:03:12.8673211Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:03:12.8674163Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:03:12.8675143Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:03:12.8676107Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2024-12-18T00:03:13.1080066Z 2024-12-18T00:03:13.1081035Z  2024-12-18T00:03:13.1081460Z  2024-12-18T00:03:13.1081834Z  2024-12-18T00:03:13.1082184Z  2024-12-18T00:03:13.1082526Z  2024-12-18T00:03:13.1082868Z  2024-12-18T00:03:13.1083225Z  2024-12-18T00:03:13.1083556Z  2024-12-18T00:03:13.1084049Z [9,599 / 15,187] 48 actions running 2024-12-18T00:03:13.1084874Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:03:13.1085846Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:03:13.1086695Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:03:13.1087446Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:03:13.1088294Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:03:13.1089212Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:03:13.1090107Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:03:13.1091021Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 10s local ... 2024-12-18T00:03:13.5086138Z 2024-12-18T00:03:13.5087010Z  2024-12-18T00:03:13.5087492Z  2024-12-18T00:03:13.5087895Z  2024-12-18T00:03:13.5088295Z  2024-12-18T00:03:13.5088682Z  2024-12-18T00:03:13.5089068Z  2024-12-18T00:03:13.5089504Z  2024-12-18T00:03:13.5089910Z  2024-12-18T00:03:13.5090642Z [9,600 / 15,187] 48 actions running 2024-12-18T00:03:13.5091581Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:03:13.5092722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:03:13.5093718Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:03:13.5094582Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:03:13.5095547Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:03:13.5096666Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:03:13.5097662Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:03:13.5098649Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local ... 2024-12-18T00:03:13.8458810Z 2024-12-18T00:03:13.8459616Z  2024-12-18T00:03:13.8460097Z  2024-12-18T00:03:13.8460867Z  2024-12-18T00:03:13.8461259Z  2024-12-18T00:03:13.8461639Z  2024-12-18T00:03:13.8462031Z  2024-12-18T00:03:13.8462418Z  2024-12-18T00:03:13.8462794Z  2024-12-18T00:03:13.8463358Z [9,603 / 15,187] 48 actions, 47 running 2024-12-18T00:03:13.8464221Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:03:13.8465617Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:03:13.8466630Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:03:13.8467432Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2024-12-18T00:03:13.8468303Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:03:13.8469265Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:03:13.8470190Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:03:13.8471104Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local ... 2024-12-18T00:03:14.1094345Z 2024-12-18T00:03:14.1095175Z  2024-12-18T00:03:14.1095669Z  2024-12-18T00:03:14.1096057Z  2024-12-18T00:03:14.1096570Z  2024-12-18T00:03:14.1096969Z  2024-12-18T00:03:14.1097363Z  2024-12-18T00:03:14.1097735Z  2024-12-18T00:03:14.1098133Z  2024-12-18T00:03:14.1098744Z [9,605 / 15,187] 48 actions running 2024-12-18T00:03:14.1099689Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:03:14.1100822Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:03:14.1101770Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:03:14.1102618Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2024-12-18T00:03:14.1103570Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:03:14.1104530Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:03:14.1105545Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:03:14.1106536Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local ... 2024-12-18T00:03:14.3099136Z 2024-12-18T00:03:14.3100004Z  2024-12-18T00:03:14.3100504Z  2024-12-18T00:03:14.3100902Z  2024-12-18T00:03:14.3101298Z  2024-12-18T00:03:14.3101732Z  2024-12-18T00:03:14.3102141Z  2024-12-18T00:03:14.3102532Z  2024-12-18T00:03:14.3102915Z  2024-12-18T00:03:14.3103495Z [9,607 / 15,187] 48 actions running 2024-12-18T00:03:14.3104342Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:03:14.3105439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:03:14.3106387Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:03:14.3107230Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2024-12-18T00:03:14.3108168Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:03:14.3109177Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:03:14.3110154Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:03:14.3111074Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local ... 2024-12-18T00:03:14.7286479Z 2024-12-18T00:03:14.7287380Z  2024-12-18T00:03:14.7287849Z  2024-12-18T00:03:14.7288234Z  2024-12-18T00:03:14.7288614Z  2024-12-18T00:03:14.7288987Z  2024-12-18T00:03:14.7289293Z  2024-12-18T00:03:14.7289630Z  2024-12-18T00:03:14.7290001Z  2024-12-18T00:03:14.7290555Z [9,608 / 15,187] 48 actions, 47 running 2024-12-18T00:03:14.7291398Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:03:14.7292465Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:03:14.7293784Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:03:14.7294595Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:03:14.7295661Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:03:14.7296789Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:03:14.7298026Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:03:14.7298970Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local ... 2024-12-18T00:03:15.1108590Z 2024-12-18T00:03:15.1109478Z  2024-12-18T00:03:15.1110023Z  2024-12-18T00:03:15.1110432Z  2024-12-18T00:03:15.1110838Z  2024-12-18T00:03:15.1111257Z  2024-12-18T00:03:15.1111682Z  2024-12-18T00:03:15.1112104Z  2024-12-18T00:03:15.1112506Z  2024-12-18T00:03:15.1113083Z [9,609 / 15,187] 48 actions running 2024-12-18T00:03:15.1114019Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:03:15.1115212Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:03:15.1116175Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:03:15.1117045Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:03:15.1117965Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:03:15.1118994Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:03:15.1119972Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:03:15.1120933Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local ... 2024-12-18T00:03:15.3384584Z 2024-12-18T00:03:15.3385434Z  2024-12-18T00:03:15.3386067Z  2024-12-18T00:03:15.3386471Z  2024-12-18T00:03:15.3386847Z  2024-12-18T00:03:15.3387248Z  2024-12-18T00:03:15.3387645Z  2024-12-18T00:03:15.3388036Z  2024-12-18T00:03:15.3388447Z  2024-12-18T00:03:15.3389074Z [9,611 / 15,187] 48 actions, 47 running 2024-12-18T00:03:15.3390031Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:03:15.3391152Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:03:15.3392127Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:03:15.3392956Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:03:15.3393900Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:03:15.3394883Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:03:15.3395837Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:03:15.3396804Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local ... 2024-12-18T00:03:15.6435404Z 2024-12-18T00:03:15.6436293Z  2024-12-18T00:03:15.6436778Z  2024-12-18T00:03:15.6437168Z  2024-12-18T00:03:15.6437598Z  2024-12-18T00:03:15.6437952Z  2024-12-18T00:03:15.6438346Z  2024-12-18T00:03:15.6438740Z  2024-12-18T00:03:15.6439125Z  2024-12-18T00:03:15.6439648Z [9,613 / 15,187] 48 actions, 47 running 2024-12-18T00:03:15.6440542Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:03:15.6441667Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:03:15.6442624Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:03:15.6443561Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:03:15.6444735Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:03:15.6445707Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:03:15.6446635Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:03:15.6447599Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local ... 2024-12-18T00:03:15.8578355Z 2024-12-18T00:03:15.8579230Z  2024-12-18T00:03:15.8579707Z  2024-12-18T00:03:15.8580106Z  2024-12-18T00:03:15.8580487Z  2024-12-18T00:03:15.8580874Z  2024-12-18T00:03:15.8581263Z  2024-12-18T00:03:15.8581655Z  2024-12-18T00:03:15.8582021Z  2024-12-18T00:03:15.8582617Z [9,615 / 15,187] 48 actions, 47 running 2024-12-18T00:03:15.8583861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:03:15.8585034Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:03:15.8585992Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:03:15.8586842Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:03:15.8587761Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2024-12-18T00:03:15.8588787Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 15s local 2024-12-18T00:03:15.8589700Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2024-12-18T00:03:15.8590482Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local ... 2024-12-18T00:03:16.0929675Z 2024-12-18T00:03:16.0930544Z  2024-12-18T00:03:16.0931030Z  2024-12-18T00:03:16.0931398Z  2024-12-18T00:03:16.0931783Z  2024-12-18T00:03:16.0932158Z  2024-12-18T00:03:16.0932552Z  2024-12-18T00:03:16.0932963Z  2024-12-18T00:03:16.0933339Z  2024-12-18T00:03:16.0933913Z [9,616 / 15,187] 48 actions, 47 running 2024-12-18T00:03:16.0934798Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:03:16.0935875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:03:16.0937017Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:03:16.0937837Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:03:16.0938784Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2024-12-18T00:03:16.0939768Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2024-12-18T00:03:16.0940549Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2024-12-18T00:03:16.0941279Z Compiling src/cpu/simple_resampling.cpp; 8s local ... 2024-12-18T00:03:16.3136198Z 2024-12-18T00:03:16.3137188Z  2024-12-18T00:03:16.3137658Z  2024-12-18T00:03:16.3138065Z  2024-12-18T00:03:16.3138515Z  2024-12-18T00:03:16.3138921Z  2024-12-18T00:03:16.3139307Z  2024-12-18T00:03:16.3139708Z  2024-12-18T00:03:16.3140101Z  2024-12-18T00:03:16.3140681Z [9,620 / 15,187] 48 actions running 2024-12-18T00:03:16.3141604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:03:16.3142739Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:03:16.3143718Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:03:16.3144757Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:03:16.3145656Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2024-12-18T00:03:16.3146424Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2024-12-18T00:03:16.3147171Z Compiling src/cpu/simple_resampling.cpp; 8s local 2024-12-18T00:03:16.3148016Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local ... 2024-12-18T00:03:16.5141634Z 2024-12-18T00:03:16.5142515Z  2024-12-18T00:03:16.5143027Z  2024-12-18T00:03:16.5143447Z  2024-12-18T00:03:16.5143873Z  2024-12-18T00:03:16.5144541Z  2024-12-18T00:03:16.5144969Z  2024-12-18T00:03:16.5145383Z  2024-12-18T00:03:16.5145804Z  2024-12-18T00:03:16.5146377Z [9,621 / 15,187] 48 actions running 2024-12-18T00:03:16.5147362Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:03:16.5148587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:03:16.5149962Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:03:16.5150898Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:03:16.5151864Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2024-12-18T00:03:16.5152701Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2024-12-18T00:03:16.5153489Z Compiling src/cpu/simple_resampling.cpp; 8s local 2024-12-18T00:03:16.5154558Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local ... 2024-12-18T00:03:16.7148613Z 2024-12-18T00:03:16.7149485Z  2024-12-18T00:03:16.7149961Z  2024-12-18T00:03:16.7150365Z  2024-12-18T00:03:16.7150738Z  2024-12-18T00:03:16.7151142Z  2024-12-18T00:03:16.7151518Z  2024-12-18T00:03:16.7151999Z  2024-12-18T00:03:16.7152357Z  2024-12-18T00:03:16.7152905Z [9,624 / 15,187] 48 actions, 47 running 2024-12-18T00:03:16.7153822Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:03:16.7155187Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:03:16.7156106Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:03:16.7156903Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:03:16.7157772Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2024-12-18T00:03:16.7158605Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2024-12-18T00:03:16.7159359Z Compiling src/cpu/simple_resampling.cpp; 8s local 2024-12-18T00:03:16.7160219Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local ... 2024-12-18T00:03:17.0055054Z 2024-12-18T00:03:17.0055871Z  2024-12-18T00:03:17.0056339Z  2024-12-18T00:03:17.0056865Z  2024-12-18T00:03:17.0057266Z  2024-12-18T00:03:17.0057634Z  2024-12-18T00:03:17.0058032Z  2024-12-18T00:03:17.0058421Z  2024-12-18T00:03:17.0058812Z  2024-12-18T00:03:17.0059390Z [9,628 / 15,187] 48 actions, 47 running 2024-12-18T00:03:17.0060377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:03:17.0061516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:03:17.0062640Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:03:17.0063505Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:03:17.0064399Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2024-12-18T00:03:17.0065134Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:03:17.0065814Z Compiling src/cpu/simple_resampling.cpp; 9s local 2024-12-18T00:03:17.0066619Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local ... 2024-12-18T00:03:17.3149640Z 2024-12-18T00:03:17.3150521Z  2024-12-18T00:03:17.3151144Z  2024-12-18T00:03:17.3151547Z  2024-12-18T00:03:17.3151938Z  2024-12-18T00:03:17.3152333Z  2024-12-18T00:03:17.3152713Z  2024-12-18T00:03:17.3153157Z  2024-12-18T00:03:17.3153553Z  2024-12-18T00:03:17.3154121Z [9,630 / 15,187] 48 actions running 2024-12-18T00:03:17.3155056Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:03:17.3156225Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:03:17.3157207Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:03:17.3158193Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:03:17.3159085Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2024-12-18T00:03:17.3159878Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:03:17.3160614Z Compiling src/cpu/simple_resampling.cpp; 9s local 2024-12-18T00:03:17.3161489Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local ... 2024-12-18T00:03:17.7158441Z 2024-12-18T00:03:17.7159340Z  2024-12-18T00:03:17.7159835Z  2024-12-18T00:03:17.7160210Z  2024-12-18T00:03:17.7161001Z  2024-12-18T00:03:17.7161369Z  2024-12-18T00:03:17.7161750Z  2024-12-18T00:03:17.7162108Z  2024-12-18T00:03:17.7162496Z  2024-12-18T00:03:17.7163053Z [9,633 / 15,187] 48 actions running 2024-12-18T00:03:17.7163943Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:03:17.7165297Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:03:17.7166268Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:03:17.7167079Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:03:17.7168110Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2024-12-18T00:03:17.7168925Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:03:17.7169682Z Compiling src/cpu/simple_resampling.cpp; 9s local 2024-12-18T00:03:17.7170538Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2024-12-18T00:03:17.9308057Z 2024-12-18T00:03:17.9308960Z  2024-12-18T00:03:17.9309449Z  2024-12-18T00:03:17.9309860Z  2024-12-18T00:03:17.9310272Z  2024-12-18T00:03:17.9310680Z  2024-12-18T00:03:17.9311079Z  2024-12-18T00:03:17.9311489Z  2024-12-18T00:03:17.9311891Z  2024-12-18T00:03:17.9312454Z [9,634 / 15,187] 48 actions, 47 running 2024-12-18T00:03:17.9313404Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:03:17.9314508Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:03:17.9315606Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:03:17.9316422Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:03:17.9317318Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2024-12-18T00:03:17.9318108Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:03:17.9318834Z Compiling src/cpu/simple_resampling.cpp; 9s local 2024-12-18T00:03:17.9319658Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2024-12-18T00:03:18.2832667Z 2024-12-18T00:03:18.2833536Z  2024-12-18T00:03:18.2834020Z  2024-12-18T00:03:18.2834409Z  2024-12-18T00:03:18.2834800Z  2024-12-18T00:03:18.2835197Z  2024-12-18T00:03:18.2835577Z  2024-12-18T00:03:18.2835961Z  2024-12-18T00:03:18.2836356Z  2024-12-18T00:03:18.2836962Z [9,635 / 15,187] 48 actions, 47 running 2024-12-18T00:03:18.2837871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:03:18.2838980Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:03:18.2839956Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:03:18.2840797Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:03:18.2841694Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2024-12-18T00:03:18.2842505Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:03:18.2843268Z Compiling src/cpu/simple_resampling.cpp; 10s local 2024-12-18T00:03:18.2844088Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2024-12-18T00:03:18.5046395Z 2024-12-18T00:03:18.5047206Z  2024-12-18T00:03:18.5047676Z  2024-12-18T00:03:18.5048092Z  2024-12-18T00:03:18.5048502Z  2024-12-18T00:03:18.5048940Z  2024-12-18T00:03:18.5049333Z  2024-12-18T00:03:18.5049729Z  2024-12-18T00:03:18.5050132Z  2024-12-18T00:03:18.5050731Z [9,636 / 15,187] 48 actions, 47 running 2024-12-18T00:03:18.5051677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:03:18.5052840Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:03:18.5053843Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:03:18.5054736Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:03:18.5056009Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2024-12-18T00:03:18.5056941Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:03:18.5057692Z Compiling src/cpu/simple_resampling.cpp; 10s local 2024-12-18T00:03:18.5058582Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2024-12-18T00:03:18.7168161Z 2024-12-18T00:03:18.7169026Z  2024-12-18T00:03:18.7169811Z  2024-12-18T00:03:18.7170227Z  2024-12-18T00:03:18.7170601Z  2024-12-18T00:03:18.7170964Z  2024-12-18T00:03:18.7171333Z  2024-12-18T00:03:18.7171704Z  2024-12-18T00:03:18.7172071Z  2024-12-18T00:03:18.7172626Z [9,641 / 15,187] 48 actions running 2024-12-18T00:03:18.7173509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:03:18.7174668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:03:18.7175655Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:03:18.7176699Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:03:18.7177612Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2024-12-18T00:03:18.7178407Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:03:18.7179266Z Compiling src/cpu/simple_resampling.cpp; 10s local 2024-12-18T00:03:18.7180079Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2024-12-18T00:03:18.9500771Z 2024-12-18T00:03:18.9501638Z  2024-12-18T00:03:18.9502093Z  2024-12-18T00:03:18.9502461Z  2024-12-18T00:03:18.9502843Z  2024-12-18T00:03:18.9503195Z  2024-12-18T00:03:18.9503540Z  2024-12-18T00:03:18.9503905Z  2024-12-18T00:03:18.9504268Z  2024-12-18T00:03:18.9504832Z [9,642 / 15,187] 48 actions, 47 running 2024-12-18T00:03:18.9505707Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:03:18.9506839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:03:18.9507852Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:03:18.9508697Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:03:18.9509586Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2024-12-18T00:03:18.9510277Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:03:18.9511077Z Compiling src/cpu/simple_resampling.cpp; 10s local 2024-12-18T00:03:18.9511928Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2024-12-18T00:03:19.1931685Z 2024-12-18T00:03:19.1932568Z  2024-12-18T00:03:19.1933043Z  2024-12-18T00:03:19.1933460Z  2024-12-18T00:03:19.1933869Z  2024-12-18T00:03:19.1934275Z  2024-12-18T00:03:19.1934696Z  2024-12-18T00:03:19.1935080Z  2024-12-18T00:03:19.1935480Z  2024-12-18T00:03:19.1936073Z [9,644 / 15,187] 48 actions, 47 running 2024-12-18T00:03:19.1937138Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:03:19.1938326Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:03:19.1939323Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:03:19.1940127Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:03:19.1941012Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2024-12-18T00:03:19.1941794Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:03:19.1942525Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:03:19.1943359Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2024-12-18T00:03:19.5175732Z 2024-12-18T00:03:19.5176731Z  2024-12-18T00:03:19.5177224Z  2024-12-18T00:03:19.5177626Z  2024-12-18T00:03:19.5178040Z  2024-12-18T00:03:19.5178423Z  2024-12-18T00:03:19.5178827Z  2024-12-18T00:03:19.5179221Z  2024-12-18T00:03:19.5180037Z  2024-12-18T00:03:19.5180605Z [9,645 / 15,187] 48 actions running 2024-12-18T00:03:19.5181554Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:03:19.5182740Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:03:19.5183750Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:03:19.5184816Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:03:19.5185760Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:03:19.5186592Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:03:19.5187341Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:03:19.5188252Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2024-12-18T00:03:19.7347911Z 2024-12-18T00:03:19.7348757Z  2024-12-18T00:03:19.7349214Z  2024-12-18T00:03:19.7349626Z  2024-12-18T00:03:19.7350025Z  2024-12-18T00:03:19.7350473Z  2024-12-18T00:03:19.7350865Z  2024-12-18T00:03:19.7351300Z  2024-12-18T00:03:19.7351709Z  2024-12-18T00:03:19.7352299Z [9,646 / 15,187] 48 actions, 47 running 2024-12-18T00:03:19.7353271Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:03:19.7354446Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:03:19.7355490Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:03:19.7356387Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:03:19.7357330Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:03:19.7358159Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:03:19.7358933Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:03:19.7359831Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:03:19.9651903Z 2024-12-18T00:03:19.9652777Z  2024-12-18T00:03:19.9653307Z  2024-12-18T00:03:19.9653734Z  2024-12-18T00:03:19.9654155Z  2024-12-18T00:03:19.9654557Z  2024-12-18T00:03:19.9654976Z  2024-12-18T00:03:19.9655384Z  2024-12-18T00:03:19.9655810Z  2024-12-18T00:03:19.9656542Z [9,648 / 15,187] 48 actions, 47 running 2024-12-18T00:03:19.9657556Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:03:19.9658754Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:03:19.9659805Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:03:19.9660711Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:03:19.9661629Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:03:19.9662428Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:03:19.9663185Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:03:19.9664070Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:03:20.2162127Z 2024-12-18T00:03:20.2163010Z  2024-12-18T00:03:20.2163476Z  2024-12-18T00:03:20.2163878Z  2024-12-18T00:03:20.2164265Z  2024-12-18T00:03:20.2164663Z  2024-12-18T00:03:20.2165048Z  2024-12-18T00:03:20.2165446Z  2024-12-18T00:03:20.2165843Z  2024-12-18T00:03:20.2166465Z [9,650 / 15,187] 48 actions, 47 running 2024-12-18T00:03:20.2167400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:03:20.2168509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:03:20.2169499Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:03:20.2170383Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:03:20.2171295Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:03:20.2172103Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:03:20.2173198Z Compiling src/cpu/simple_resampling.cpp; 12s local 2024-12-18T00:03:20.2174068Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:03:20.4181636Z 2024-12-18T00:03:20.4182462Z  2024-12-18T00:03:20.4183087Z  2024-12-18T00:03:20.4183505Z  2024-12-18T00:03:20.4183923Z  2024-12-18T00:03:20.4184322Z  2024-12-18T00:03:20.4184748Z  2024-12-18T00:03:20.4185462Z  2024-12-18T00:03:20.4185899Z  2024-12-18T00:03:20.4186534Z [9,652 / 15,187] 48 actions, 47 running 2024-12-18T00:03:20.4187471Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:03:20.4188712Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:03:20.4189738Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:03:20.4190663Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:03:20.4191638Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:03:20.4192496Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:03:20.4193284Z Compiling src/cpu/simple_resampling.cpp; 12s local 2024-12-18T00:03:20.4194226Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:03:20.6302889Z 2024-12-18T00:03:20.6303713Z  2024-12-18T00:03:20.6304091Z  2024-12-18T00:03:20.6304447Z  2024-12-18T00:03:20.6304761Z  2024-12-18T00:03:20.6305080Z  2024-12-18T00:03:20.6305435Z  2024-12-18T00:03:20.6305829Z  2024-12-18T00:03:20.6306148Z  2024-12-18T00:03:20.6306613Z [9,654 / 15,187] 48 actions, 47 running 2024-12-18T00:03:20.6307351Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:03:20.6308197Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:03:20.6308991Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:03:20.6309717Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:03:20.6310604Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2024-12-18T00:03:20.6311434Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:03:20.6312198Z Compiling src/cpu/simple_resampling.cpp; 12s local 2024-12-18T00:03:20.6313125Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:03:20.9186890Z 2024-12-18T00:03:20.9187809Z  2024-12-18T00:03:20.9188325Z  2024-12-18T00:03:20.9188726Z  2024-12-18T00:03:20.9189105Z  2024-12-18T00:03:20.9189474Z  2024-12-18T00:03:20.9189841Z  2024-12-18T00:03:20.9190225Z  2024-12-18T00:03:20.9190608Z  2024-12-18T00:03:20.9191286Z [9,658 / 15,187] 48 actions running 2024-12-18T00:03:20.9192208Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:03:20.9193362Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:03:20.9194403Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:03:20.9195265Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:03:20.9196167Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2024-12-18T00:03:20.9196978Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:03:20.9197736Z Compiling src/cpu/simple_resampling.cpp; 12s local 2024-12-18T00:03:20.9198618Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2024-12-18T00:03:21.3194263Z 2024-12-18T00:03:21.3195112Z  2024-12-18T00:03:21.3195602Z  2024-12-18T00:03:21.3195987Z  2024-12-18T00:03:21.3196378Z  2024-12-18T00:03:21.3196755Z  2024-12-18T00:03:21.3197135Z  2024-12-18T00:03:21.3197498Z  2024-12-18T00:03:21.3197842Z  2024-12-18T00:03:21.3198402Z [9,659 / 15,187] 48 actions running 2024-12-18T00:03:21.3199329Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:03:21.3201028Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:03:21.3201989Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:03:21.3202827Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:03:21.3203705Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2024-12-18T00:03:21.3204717Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:03:21.3205444Z Compiling src/cpu/simple_resampling.cpp; 13s local 2024-12-18T00:03:21.3206294Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2024-12-18T00:03:21.5199689Z 2024-12-18T00:03:21.5200588Z  2024-12-18T00:03:21.5201072Z  2024-12-18T00:03:21.5201468Z  2024-12-18T00:03:21.5201871Z  2024-12-18T00:03:21.5202238Z  2024-12-18T00:03:21.5202636Z  2024-12-18T00:03:21.5203019Z  2024-12-18T00:03:21.5203416Z  2024-12-18T00:03:21.5203937Z [9,662 / 15,187] 48 actions running 2024-12-18T00:03:21.5204879Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:03:21.5205995Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:03:21.5206932Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:03:21.5207818Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:03:21.5208685Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:03:21.5209432Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:03:21.5210157Z Compiling src/cpu/simple_resampling.cpp; 13s local 2024-12-18T00:03:21.5211030Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2024-12-18T00:03:21.8288353Z 2024-12-18T00:03:21.8289172Z  2024-12-18T00:03:21.8289665Z  2024-12-18T00:03:21.8290101Z  2024-12-18T00:03:21.8290511Z  2024-12-18T00:03:21.8290909Z  2024-12-18T00:03:21.8291376Z  2024-12-18T00:03:21.8291903Z  2024-12-18T00:03:21.8292298Z  2024-12-18T00:03:21.8292889Z [9,664 / 15,187] 48 actions, 47 running 2024-12-18T00:03:21.8293837Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:03:21.8295003Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:03:21.8296038Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:03:21.8297049Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:03:21.8297968Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:03:21.8298767Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:03:21.8299530Z Compiling src/cpu/simple_resampling.cpp; 13s local 2024-12-18T00:03:21.8300439Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2024-12-18T00:03:22.1182606Z 2024-12-18T00:03:22.1183444Z  2024-12-18T00:03:22.1183923Z  2024-12-18T00:03:22.1184378Z  2024-12-18T00:03:22.1184730Z  2024-12-18T00:03:22.1185138Z  2024-12-18T00:03:22.1185523Z  2024-12-18T00:03:22.1185925Z  2024-12-18T00:03:22.1186304Z  2024-12-18T00:03:22.1186902Z [9,666 / 15,187] 48 actions, 47 running 2024-12-18T00:03:22.1187820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:03:22.1188981Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:03:22.1189973Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:03:22.1190820Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:03:22.1191731Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:03:22.1192549Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:03:22.1193307Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:03:22.1194180Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2024-12-18T00:03:22.3199948Z 2024-12-18T00:03:22.3200834Z  2024-12-18T00:03:22.3201328Z  2024-12-18T00:03:22.3201718Z  2024-12-18T00:03:22.3202074Z  2024-12-18T00:03:22.3202467Z  2024-12-18T00:03:22.3202835Z  2024-12-18T00:03:22.3203188Z  2024-12-18T00:03:22.3203560Z  2024-12-18T00:03:22.3204112Z [9,667 / 15,187] 48 actions, 47 running 2024-12-18T00:03:22.3205822Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:03:22.3206976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:03:22.3207971Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:03:22.3208813Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:03:22.3209833Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:03:22.3210580Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:03:22.3211314Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:03:22.3212265Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2024-12-18T00:03:22.5207316Z 2024-12-18T00:03:22.5208188Z  2024-12-18T00:03:22.5208679Z  2024-12-18T00:03:22.5209065Z  2024-12-18T00:03:22.5209588Z  2024-12-18T00:03:22.5210026Z  2024-12-18T00:03:22.5210434Z  2024-12-18T00:03:22.5210822Z  2024-12-18T00:03:22.5211222Z  2024-12-18T00:03:22.5211776Z [9,669 / 15,187] 48 actions running 2024-12-18T00:03:22.5212693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:03:22.5213923Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:03:22.5214987Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:03:22.5215906Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:03:22.5217055Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:03:22.5217936Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:03:22.5218736Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:03:22.5219648Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2024-12-18T00:03:22.8569029Z 2024-12-18T00:03:22.8569883Z  2024-12-18T00:03:22.8570337Z  2024-12-18T00:03:22.8570725Z  2024-12-18T00:03:22.8571087Z  2024-12-18T00:03:22.8571515Z  2024-12-18T00:03:22.8571903Z  2024-12-18T00:03:22.8572300Z  2024-12-18T00:03:22.8572658Z  2024-12-18T00:03:22.8573228Z [9,671 / 15,187] 48 actions, 47 running 2024-12-18T00:03:22.8574131Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:03:22.8575228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:03:22.8576187Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:03:22.8577202Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:03:22.8578088Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:03:22.8578849Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:03:22.8579577Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:03:22.8580432Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2024-12-18T00:03:23.1214340Z 2024-12-18T00:03:23.1215209Z  2024-12-18T00:03:23.1215708Z  2024-12-18T00:03:23.1216092Z  2024-12-18T00:03:23.1216709Z  2024-12-18T00:03:23.1217102Z  2024-12-18T00:03:23.1217462Z  2024-12-18T00:03:23.1217825Z  2024-12-18T00:03:23.1218175Z  2024-12-18T00:03:23.1218712Z [9,673 / 15,187] 48 actions running 2024-12-18T00:03:23.1219584Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:03:23.1220680Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:03:23.1221604Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:03:23.1222808Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:03:23.1223674Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:03:23.1224394Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:03:23.1225056Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:03:23.1226091Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2024-12-18T00:03:23.3219545Z 2024-12-18T00:03:23.3220455Z  2024-12-18T00:03:23.3220910Z  2024-12-18T00:03:23.3221295Z  2024-12-18T00:03:23.3221665Z  2024-12-18T00:03:23.3222052Z  2024-12-18T00:03:23.3222440Z  2024-12-18T00:03:23.3222806Z  2024-12-18T00:03:23.3223162Z  2024-12-18T00:03:23.3223686Z [9,674 / 15,187] 48 actions running 2024-12-18T00:03:23.3224526Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:03:23.3225544Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:03:23.3226395Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:03:23.3227169Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:03:23.3227908Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:03:23.3228744Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:03:23.3229425Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:03:23.3230222Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2024-12-18T00:03:23.7363231Z 2024-12-18T00:03:23.7364087Z  2024-12-18T00:03:23.7364571Z  2024-12-18T00:03:23.7364964Z  2024-12-18T00:03:23.7365361Z  2024-12-18T00:03:23.7365764Z  2024-12-18T00:03:23.7366149Z  2024-12-18T00:03:23.7366536Z  2024-12-18T00:03:23.7366922Z  2024-12-18T00:03:23.7367503Z [9,675 / 15,187] 48 actions, 47 running 2024-12-18T00:03:23.7368512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:03:23.7369694Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:03:23.7370693Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:03:23.7371697Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:03:23.7372626Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2024-12-18T00:03:23.7373443Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:03:23.7374193Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:03:23.7375108Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2024-12-18T00:03:23.9994114Z 2024-12-18T00:03:23.9994935Z  2024-12-18T00:03:23.9995419Z  2024-12-18T00:03:23.9995840Z  2024-12-18T00:03:23.9996254Z  2024-12-18T00:03:23.9996618Z  2024-12-18T00:03:23.9996984Z  2024-12-18T00:03:23.9997384Z  2024-12-18T00:03:23.9997813Z  2024-12-18T00:03:23.9998403Z [9,678 / 15,187] 48 actions, 47 running 2024-12-18T00:03:23.9999388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:03:24.0000601Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:03:24.0001795Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:03:24.0002689Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:03:24.0003576Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2024-12-18T00:03:24.0004400Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:03:24.0005187Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:03:24.0006103Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2024-12-18T00:03:24.2580750Z 2024-12-18T00:03:24.2581576Z  2024-12-18T00:03:24.2582072Z  2024-12-18T00:03:24.2582500Z  2024-12-18T00:03:24.2583259Z  2024-12-18T00:03:24.2583666Z  2024-12-18T00:03:24.2584089Z  2024-12-18T00:03:24.2584505Z  2024-12-18T00:03:24.2584916Z  2024-12-18T00:03:24.2585512Z [9,679 / 15,187] 48 actions, 47 running 2024-12-18T00:03:24.2586472Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:03:24.2587953Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:03:24.2588989Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:03:24.2589894Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:03:24.2590776Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2024-12-18T00:03:24.2591569Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:03:24.2592341Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:03:24.2593238Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2024-12-18T00:03:24.5231417Z 2024-12-18T00:03:24.5232338Z  2024-12-18T00:03:24.5232825Z  2024-12-18T00:03:24.5233213Z  2024-12-18T00:03:24.5233607Z  2024-12-18T00:03:24.5234017Z  2024-12-18T00:03:24.5234409Z  2024-12-18T00:03:24.5234813Z  2024-12-18T00:03:24.5235199Z  2024-12-18T00:03:24.5235757Z [9,679 / 15,187] 48 actions running 2024-12-18T00:03:24.5236746Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:03:24.5237954Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:03:24.5238937Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:03:24.5239799Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:03:24.5240735Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:03:24.5241571Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:03:24.5242356Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:03:24.5243303Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2024-12-18T00:03:24.7236446Z 2024-12-18T00:03:24.7237289Z  2024-12-18T00:03:24.7237766Z  2024-12-18T00:03:24.7238168Z  2024-12-18T00:03:24.7238536Z  2024-12-18T00:03:24.7238930Z  2024-12-18T00:03:24.7239330Z  2024-12-18T00:03:24.7239720Z  2024-12-18T00:03:24.7240110Z  2024-12-18T00:03:24.7240687Z [9,680 / 15,187] 48 actions running 2024-12-18T00:03:24.7241643Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:03:24.7242778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:03:24.7243752Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:03:24.7244863Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:03:24.7245771Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:03:24.7246572Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:03:24.7247358Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:03:24.7248256Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2024-12-18T00:03:24.9443441Z 2024-12-18T00:03:24.9444586Z  2024-12-18T00:03:24.9445119Z  2024-12-18T00:03:24.9445506Z  2024-12-18T00:03:24.9445886Z  2024-12-18T00:03:24.9446262Z  2024-12-18T00:03:24.9446698Z  2024-12-18T00:03:24.9447033Z  2024-12-18T00:03:24.9447400Z  2024-12-18T00:03:24.9448005Z [9,682 / 15,187] 48 actions, 47 running 2024-12-18T00:03:24.9448894Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:03:24.9450052Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:03:24.9451009Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:03:24.9451854Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:03:24.9453080Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:03:24.9453884Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:03:24.9454623Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:03:24.9455550Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2024-12-18T00:03:25.2626798Z 2024-12-18T00:03:25.2627633Z  2024-12-18T00:03:25.2628458Z  2024-12-18T00:03:25.2628906Z  2024-12-18T00:03:25.2629326Z  2024-12-18T00:03:25.2629733Z  2024-12-18T00:03:25.2630151Z  2024-12-18T00:03:25.2630562Z  2024-12-18T00:03:25.2630969Z  2024-12-18T00:03:25.2631562Z [9,685 / 15,187] 48 actions, 47 running 2024-12-18T00:03:25.2632528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:03:25.2633707Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:03:25.2634872Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:03:25.2635793Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:03:25.2636742Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:03:25.2637567Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:03:25.2638347Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:03:25.2639275Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2024-12-18T00:03:25.4875099Z 2024-12-18T00:03:25.4876006Z  2024-12-18T00:03:25.4876505Z  2024-12-18T00:03:25.4876920Z  2024-12-18T00:03:25.4877353Z  2024-12-18T00:03:25.4877764Z  2024-12-18T00:03:25.4878187Z  2024-12-18T00:03:25.4878606Z  2024-12-18T00:03:25.4879004Z  2024-12-18T00:03:25.4879627Z [9,687 / 15,187] 48 actions, 47 running 2024-12-18T00:03:25.4880600Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:03:25.4881814Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:03:25.4882924Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:03:25.4883824Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:03:25.4884800Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2024-12-18T00:03:25.4885672Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:03:25.4886494Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:03:25.4887430Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2024-12-18T00:03:25.7242287Z 2024-12-18T00:03:25.7243205Z  2024-12-18T00:03:25.7243647Z  2024-12-18T00:03:25.7244005Z  2024-12-18T00:03:25.7244538Z  2024-12-18T00:03:25.7244897Z  2024-12-18T00:03:25.7245242Z  2024-12-18T00:03:25.7245581Z  2024-12-18T00:03:25.7245916Z  2024-12-18T00:03:25.7246395Z [9,689 / 15,187] 48 actions running 2024-12-18T00:03:25.7247203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:03:25.7248223Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:03:25.7249064Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:03:25.7249799Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2024-12-18T00:03:25.7250444Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:03:25.7251110Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:03:25.7251859Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:03:25.7252700Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local ... 2024-12-18T00:03:26.1120889Z 2024-12-18T00:03:26.1122114Z  2024-12-18T00:03:26.1122568Z  2024-12-18T00:03:26.1122977Z  2024-12-18T00:03:26.1123347Z  2024-12-18T00:03:26.1123761Z  2024-12-18T00:03:26.1124166Z  2024-12-18T00:03:26.1124547Z  2024-12-18T00:03:26.1124950Z  2024-12-18T00:03:26.1125922Z [9,690 / 15,187] 48 actions, 47 running 2024-12-18T00:03:26.1126939Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:03:26.1128264Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:03:26.1129453Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:03:26.1130685Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2024-12-18T00:03:26.1131644Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:03:26.1132536Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:03:26.1133539Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:03:26.1134666Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local ... 2024-12-18T00:03:26.3250262Z 2024-12-18T00:03:26.3251229Z  2024-12-18T00:03:26.3251705Z  2024-12-18T00:03:26.3252074Z  2024-12-18T00:03:26.3252380Z  2024-12-18T00:03:26.3252742Z  2024-12-18T00:03:26.3253122Z  2024-12-18T00:03:26.3253498Z  2024-12-18T00:03:26.3253861Z  2024-12-18T00:03:26.3254425Z [9,691 / 15,187] 48 actions running 2024-12-18T00:03:26.3264874Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:03:26.3265854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:03:26.3266790Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:03:26.3267648Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2024-12-18T00:03:26.3268386Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:03:26.3269081Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:03:26.3269873Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:03:26.3270740Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local ... 2024-12-18T00:03:26.5253804Z 2024-12-18T00:03:26.5255166Z  2024-12-18T00:03:26.5255728Z  2024-12-18T00:03:26.5256149Z  2024-12-18T00:03:26.5256719Z  2024-12-18T00:03:26.5257140Z  2024-12-18T00:03:26.5257566Z  2024-12-18T00:03:26.5257977Z  2024-12-18T00:03:26.5258395Z  2024-12-18T00:03:26.5258980Z [9,694 / 15,187] 48 actions running 2024-12-18T00:03:26.5259975Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:03:26.5261083Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:03:26.5262068Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:03:26.5262984Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:03:26.5263862Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:03:26.5264679Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:03:26.5265565Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:03:26.5266488Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local ... 2024-12-18T00:03:26.7745812Z 2024-12-18T00:03:26.7746716Z  2024-12-18T00:03:26.7747210Z  2024-12-18T00:03:26.7747625Z  2024-12-18T00:03:26.7748007Z  2024-12-18T00:03:26.7748403Z  2024-12-18T00:03:26.7748802Z  2024-12-18T00:03:26.7749210Z  2024-12-18T00:03:26.7749589Z  2024-12-18T00:03:26.7750205Z [9,695 / 15,187] 48 actions, 47 running 2024-12-18T00:03:26.7751142Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:03:26.7752343Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:03:26.7753340Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:03:26.7754260Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:03:26.7755240Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:03:26.7756048Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:03:26.7757300Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:03:26.7758282Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local ... 2024-12-18T00:03:27.0155353Z 2024-12-18T00:03:27.0156315Z  2024-12-18T00:03:27.0156787Z  2024-12-18T00:03:27.0157166Z  2024-12-18T00:03:27.0157565Z  2024-12-18T00:03:27.0157987Z  2024-12-18T00:03:27.0158385Z  2024-12-18T00:03:27.0159092Z  2024-12-18T00:03:27.0159506Z  2024-12-18T00:03:27.0160106Z [9,697 / 15,187] 48 actions, 47 running 2024-12-18T00:03:27.0161048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:03:27.0162183Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:03:27.0163216Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:03:27.0164100Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:03:27.0164928Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:03:27.0165707Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:03:27.0166592Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:03:27.0167538Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local ... 2024-12-18T00:03:27.3262843Z 2024-12-18T00:03:27.3263722Z  2024-12-18T00:03:27.3264183Z  2024-12-18T00:03:27.3264577Z  2024-12-18T00:03:27.3264919Z  2024-12-18T00:03:27.3265248Z  2024-12-18T00:03:27.3265569Z  2024-12-18T00:03:27.3265906Z  2024-12-18T00:03:27.3266255Z  2024-12-18T00:03:27.3266780Z [9,699 / 15,187] 48 actions running 2024-12-18T00:03:27.3267775Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:03:27.3268786Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:03:27.3269677Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:03:27.3270532Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:03:27.3271304Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:03:27.3272033Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:03:27.3272838Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:03:27.3273776Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local ... 2024-12-18T00:03:27.5377862Z 2024-12-18T00:03:27.5378717Z  2024-12-18T00:03:27.5379125Z  2024-12-18T00:03:27.5379468Z  2024-12-18T00:03:27.5379790Z  2024-12-18T00:03:27.5380121Z  2024-12-18T00:03:27.5380454Z  2024-12-18T00:03:27.5380782Z  2024-12-18T00:03:27.5381114Z  2024-12-18T00:03:27.5381600Z [9,701 / 15,187] 48 actions, 47 running 2024-12-18T00:03:27.5382379Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:03:27.5383298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:03:27.5384105Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:03:27.5384799Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:03:27.5385409Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:03:27.5385993Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:03:27.5386695Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:03:27.5387440Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local ... 2024-12-18T00:03:27.8830945Z 2024-12-18T00:03:27.8831889Z  2024-12-18T00:03:27.8833451Z  2024-12-18T00:03:27.8834356Z  2024-12-18T00:03:27.8835104Z  2024-12-18T00:03:27.8835497Z  2024-12-18T00:03:27.8835887Z  2024-12-18T00:03:27.8836287Z  2024-12-18T00:03:27.8836656Z  2024-12-18T00:03:27.8837241Z [9,702 / 15,187] 48 actions, 47 running 2024-12-18T00:03:27.8838218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:03:27.8839773Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:03:27.8840830Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:03:27.8841691Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:03:27.8842545Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:03:27.8843664Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:03:27.8844812Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:03:27.8845820Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local ... 2024-12-18T00:03:28.1270955Z 2024-12-18T00:03:28.1271849Z  2024-12-18T00:03:28.1273326Z  2024-12-18T00:03:28.1275122Z  2024-12-18T00:03:28.1275545Z  2024-12-18T00:03:28.1275955Z  2024-12-18T00:03:28.1276390Z  2024-12-18T00:03:28.1276773Z  2024-12-18T00:03:28.1277183Z  2024-12-18T00:03:28.1277770Z [9,705 / 15,187] 48 actions running 2024-12-18T00:03:28.1278686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:03:28.1279861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:03:28.1280838Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:03:28.1281781Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:03:28.1282498Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:03:28.1283166Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:03:28.1283881Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:03:28.1284669Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local ... 2024-12-18T00:03:28.3276069Z 2024-12-18T00:03:28.3276972Z  2024-12-18T00:03:28.3278697Z  2024-12-18T00:03:28.3279104Z  2024-12-18T00:03:28.3279459Z  2024-12-18T00:03:28.3279817Z  2024-12-18T00:03:28.3280222Z  2024-12-18T00:03:28.3280592Z  2024-12-18T00:03:28.3281045Z  2024-12-18T00:03:28.3281578Z [9,706 / 15,187] 48 actions running 2024-12-18T00:03:28.3282467Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:03:28.3283543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:03:28.3284536Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:03:28.3285445Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:03:28.3286284Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:03:28.3286964Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:03:28.3287715Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:03:28.3288633Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local ... 2024-12-18T00:03:28.7281849Z 2024-12-18T00:03:28.7283100Z  2024-12-18T00:03:28.7283606Z  2024-12-18T00:03:28.7284046Z  2024-12-18T00:03:28.7284404Z  2024-12-18T00:03:28.7284777Z  2024-12-18T00:03:28.7285156Z  2024-12-18T00:03:28.7285543Z  2024-12-18T00:03:28.7285912Z  2024-12-18T00:03:28.7286486Z [9,710 / 15,187] 48 actions running 2024-12-18T00:03:28.7287400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:03:28.7288589Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:03:28.7289599Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:03:28.7290468Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:03:28.7291257Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:03:28.7291991Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:03:28.7292862Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:03:28.7293876Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local ... 2024-12-18T00:03:29.1260553Z 2024-12-18T00:03:29.1261419Z  2024-12-18T00:03:29.1261849Z  2024-12-18T00:03:29.1262223Z  2024-12-18T00:03:29.1262564Z  2024-12-18T00:03:29.1262957Z  2024-12-18T00:03:29.1263322Z  2024-12-18T00:03:29.1263682Z  2024-12-18T00:03:29.1264058Z  2024-12-18T00:03:29.1264973Z [9,711 / 15,187] 48 actions, 47 running 2024-12-18T00:03:29.1265780Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:03:29.1266852Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:03:29.1267876Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:03:29.1268659Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:03:29.1269389Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:03:29.1270057Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:03:29.1270827Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:03:29.1271752Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local ... 2024-12-18T00:03:29.3288710Z 2024-12-18T00:03:29.3289552Z  2024-12-18T00:03:29.3290002Z  2024-12-18T00:03:29.3290386Z  2024-12-18T00:03:29.3290784Z  2024-12-18T00:03:29.3291182Z  2024-12-18T00:03:29.3291577Z  2024-12-18T00:03:29.3292031Z  2024-12-18T00:03:29.3292456Z  2024-12-18T00:03:29.3293016Z [9,712 / 15,187] 48 actions running 2024-12-18T00:03:29.3293933Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:03:29.3295108Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:03:29.3296158Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:03:29.3297227Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:03:29.3298096Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:03:29.3298904Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:03:29.3299765Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:03:29.3300742Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local ... 2024-12-18T00:03:29.5293301Z 2024-12-18T00:03:29.5294159Z  2024-12-18T00:03:29.5294741Z  2024-12-18T00:03:29.5295149Z  2024-12-18T00:03:29.5295577Z  2024-12-18T00:03:29.5295936Z  2024-12-18T00:03:29.5296325Z  2024-12-18T00:03:29.5296819Z  2024-12-18T00:03:29.5297217Z  2024-12-18T00:03:29.5297764Z [9,715 / 15,187] 48 actions running 2024-12-18T00:03:29.5298603Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:03:29.5299783Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:03:29.5300825Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:03:29.5301740Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:03:29.5302581Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:03:29.5303324Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:03:29.5304133Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:03:29.5305076Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local ... 2024-12-18T00:03:29.9300308Z 2024-12-18T00:03:29.9301225Z  2024-12-18T00:03:29.9301719Z  2024-12-18T00:03:29.9302126Z  2024-12-18T00:03:29.9302545Z  2024-12-18T00:03:29.9302920Z  2024-12-18T00:03:29.9303322Z  2024-12-18T00:03:29.9303727Z  2024-12-18T00:03:29.9304142Z  2024-12-18T00:03:29.9304682Z [9,717 / 15,187] 48 actions running 2024-12-18T00:03:29.9305653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:03:29.9306762Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:03:29.9308161Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:03:29.9309082Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:03:29.9309909Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:03:29.9310671Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:03:29.9311549Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:03:29.9312782Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local ... 2024-12-18T00:03:30.1305274Z 2024-12-18T00:03:30.1306168Z  2024-12-18T00:03:30.1306613Z  2024-12-18T00:03:30.1307004Z  2024-12-18T00:03:30.1307401Z  2024-12-18T00:03:30.1307820Z  2024-12-18T00:03:30.1308189Z  2024-12-18T00:03:30.1308570Z  2024-12-18T00:03:30.1308942Z  2024-12-18T00:03:30.1309476Z [9,719 / 15,187] 48 actions running 2024-12-18T00:03:30.1310387Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:03:30.1311559Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:03:30.1312518Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:03:30.1313399Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:03:30.1314192Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:03:30.1314931Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:03:30.1315770Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:03:30.1316709Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local ... 2024-12-18T00:03:30.5311641Z 2024-12-18T00:03:30.5312548Z  2024-12-18T00:03:30.5313006Z  2024-12-18T00:03:30.5313404Z  2024-12-18T00:03:30.5313811Z  2024-12-18T00:03:30.5314181Z  2024-12-18T00:03:30.5314546Z  2024-12-18T00:03:30.5314930Z  2024-12-18T00:03:30.5315314Z  2024-12-18T00:03:30.5315875Z [9,721 / 15,187] 48 actions running 2024-12-18T00:03:30.5316760Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:03:30.5317871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:03:30.5318843Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:03:30.5319720Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:03:30.5320560Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:03:30.5321358Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:03:30.5322225Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:03:30.5323245Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local ... 2024-12-18T00:03:30.7320973Z 2024-12-18T00:03:30.7321860Z  2024-12-18T00:03:30.7322324Z  2024-12-18T00:03:30.7322720Z  2024-12-18T00:03:30.7323114Z  2024-12-18T00:03:30.7323522Z  2024-12-18T00:03:30.7323902Z  2024-12-18T00:03:30.7324350Z  2024-12-18T00:03:30.7324741Z  2024-12-18T00:03:30.7325278Z [9,723 / 15,187] 48 actions running 2024-12-18T00:03:30.7326177Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:03:30.7327092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:03:30.7327996Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:03:30.7328796Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:03:30.7329609Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:03:30.7330280Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:03:30.7331068Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:03:30.7332212Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local ... 2024-12-18T00:03:30.9375941Z 2024-12-18T00:03:30.9376938Z  2024-12-18T00:03:30.9377433Z  2024-12-18T00:03:30.9378319Z  2024-12-18T00:03:30.9378752Z  2024-12-18T00:03:30.9379149Z  2024-12-18T00:03:30.9379554Z  2024-12-18T00:03:30.9379964Z  2024-12-18T00:03:30.9380355Z  2024-12-18T00:03:30.9380923Z [9,724 / 15,187] 48 actions, 47 running 2024-12-18T00:03:30.9381788Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:03:30.9383090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:03:30.9384038Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:03:30.9384826Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:03:30.9385603Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:03:30.9386357Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:03:30.9387180Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:03:30.9388244Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local ... 2024-12-18T00:03:31.2692270Z 2024-12-18T00:03:31.2693047Z  2024-12-18T00:03:31.2693565Z  2024-12-18T00:03:31.2693853Z  2024-12-18T00:03:31.2694153Z  2024-12-18T00:03:31.2694416Z  2024-12-18T00:03:31.2694768Z  2024-12-18T00:03:31.2695018Z  2024-12-18T00:03:31.2695353Z  2024-12-18T00:03:31.2695882Z [9,727 / 15,187] 48 actions, 47 running 2024-12-18T00:03:31.2696652Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:03:31.2697393Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:03:31.2698029Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:03:31.2698600Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:03:31.2699128Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:03:31.2699576Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:03:31.2700134Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:03:31.2700811Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local ... 2024-12-18T00:03:31.5325436Z 2024-12-18T00:03:31.5326309Z  2024-12-18T00:03:31.5326737Z  2024-12-18T00:03:31.5327151Z  2024-12-18T00:03:31.5327538Z  2024-12-18T00:03:31.5327941Z  2024-12-18T00:03:31.5328376Z  2024-12-18T00:03:31.5328819Z  2024-12-18T00:03:31.5329207Z  2024-12-18T00:03:31.5329774Z [9,727 / 15,187] 48 actions running 2024-12-18T00:03:31.5330733Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:03:31.5331932Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:03:31.5332902Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:03:31.5333760Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:03:31.5334555Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:03:31.5335312Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:03:31.5336169Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:03:31.5337436Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local ... 2024-12-18T00:03:31.7741597Z 2024-12-18T00:03:31.7742485Z  2024-12-18T00:03:31.7742950Z  2024-12-18T00:03:31.7743366Z  2024-12-18T00:03:31.7743821Z  2024-12-18T00:03:31.7744414Z  2024-12-18T00:03:31.7744838Z  2024-12-18T00:03:31.7745204Z  2024-12-18T00:03:31.7745600Z  2024-12-18T00:03:31.7746152Z [9,730 / 15,187] 48 actions, 47 running 2024-12-18T00:03:31.7747089Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:03:31.7748242Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:03:31.7749245Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:03:31.7750123Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:03:31.7751286Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:03:31.7752044Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:03:31.7752943Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:03:31.7753989Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local ... 2024-12-18T00:03:32.1019045Z 2024-12-18T00:03:32.1019957Z  2024-12-18T00:03:32.1020461Z  2024-12-18T00:03:32.1020861Z  2024-12-18T00:03:32.1021294Z  2024-12-18T00:03:32.1021706Z  2024-12-18T00:03:32.1022107Z  2024-12-18T00:03:32.1024800Z  2024-12-18T00:03:32.1027650Z  2024-12-18T00:03:32.1030878Z [9,733 / 15,187] 48 actions, 47 running 2024-12-18T00:03:32.1034189Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:03:32.1037597Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:03:32.1038963Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:03:32.1040384Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:03:32.1041206Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:03:32.1042017Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:03:32.1042944Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:03:32.1043981Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local ... 2024-12-18T00:03:32.3334536Z 2024-12-18T00:03:32.3335445Z  2024-12-18T00:03:32.3338219Z  2024-12-18T00:03:32.3338632Z  2024-12-18T00:03:32.3339003Z  2024-12-18T00:03:32.3339366Z  2024-12-18T00:03:32.3339714Z  2024-12-18T00:03:32.3340064Z  2024-12-18T00:03:32.3340427Z  2024-12-18T00:03:32.3340926Z [9,734 / 15,187] 48 actions running 2024-12-18T00:03:32.3341746Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:03:32.3342853Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:03:32.3343771Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:03:32.3344795Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:03:32.3345547Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:03:32.3346209Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:03:32.3346989Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:03:32.3347919Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local ... 2024-12-18T00:03:32.8715487Z 2024-12-18T00:03:32.8716337Z  2024-12-18T00:03:32.8716798Z  2024-12-18T00:03:32.8717184Z  2024-12-18T00:03:32.8717592Z  2024-12-18T00:03:32.8717985Z  2024-12-18T00:03:32.8718377Z  2024-12-18T00:03:32.8718748Z  2024-12-18T00:03:32.8719122Z  2024-12-18T00:03:32.8719719Z [9,735 / 15,187] 48 actions, 47 running 2024-12-18T00:03:32.8720582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:03:32.8721725Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:03:32.8722701Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:03:32.8723535Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:03:32.8724456Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:03:32.8725211Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:03:32.8726071Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:03:32.8727114Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local ... 2024-12-18T00:03:33.1342569Z 2024-12-18T00:03:33.1343434Z  2024-12-18T00:03:33.1344026Z  2024-12-18T00:03:33.1344750Z  2024-12-18T00:03:33.1345130Z  2024-12-18T00:03:33.1345858Z  2024-12-18T00:03:33.1346236Z  2024-12-18T00:03:33.1346613Z  2024-12-18T00:03:33.1347003Z  2024-12-18T00:03:33.1347557Z [9,736 / 15,187] 48 actions running 2024-12-18T00:03:33.1348475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:03:33.1349583Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:03:33.1350875Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:03:33.1351758Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:03:33.1352575Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:03:33.1353361Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:03:33.1354237Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:03:33.1355289Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:03:33.4245977Z 2024-12-18T00:03:33.4246874Z  2024-12-18T00:03:33.4247413Z  2024-12-18T00:03:33.4247772Z  2024-12-18T00:03:33.4248184Z  2024-12-18T00:03:33.4248553Z  2024-12-18T00:03:33.4248948Z  2024-12-18T00:03:33.4249352Z  2024-12-18T00:03:33.4249740Z  2024-12-18T00:03:33.4250351Z [9,738 / 15,187] 48 actions, 47 running 2024-12-18T00:03:33.4251322Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:03:33.4252430Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:03:33.4253435Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:03:33.4254238Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:03:33.4255010Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:03:33.4255760Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:03:33.4256810Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:03:33.4257867Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:03:33.7348836Z 2024-12-18T00:03:33.7349732Z  2024-12-18T00:03:33.7350267Z  2024-12-18T00:03:33.7350688Z  2024-12-18T00:03:33.7351108Z  2024-12-18T00:03:33.7351534Z  2024-12-18T00:03:33.7351911Z  2024-12-18T00:03:33.7352289Z  2024-12-18T00:03:33.7352732Z  2024-12-18T00:03:33.7353365Z [9,739 / 15,187] 48 actions running 2024-12-18T00:03:33.7354280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:03:33.7355484Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:03:33.7356609Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:03:33.7357465Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:03:33.7358262Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:03:33.7359575Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:03:33.7360473Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:03:33.7361745Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:03:33.9354172Z 2024-12-18T00:03:33.9355114Z  2024-12-18T00:03:33.9355634Z  2024-12-18T00:03:33.9356127Z  2024-12-18T00:03:33.9356545Z  2024-12-18T00:03:33.9356989Z  2024-12-18T00:03:33.9357539Z  2024-12-18T00:03:33.9358001Z  2024-12-18T00:03:33.9358386Z  2024-12-18T00:03:33.9358983Z [9,741 / 15,187] 48 actions running 2024-12-18T00:03:33.9359885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:03:33.9360867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:03:33.9361829Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:03:33.9362742Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:03:33.9363994Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:03:33.9364686Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:03:33.9365497Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:03:33.9366493Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:03:34.1860040Z 2024-12-18T00:03:34.1862067Z  2024-12-18T00:03:34.1862840Z  2024-12-18T00:03:34.1863205Z  2024-12-18T00:03:34.1863573Z  2024-12-18T00:03:34.1863930Z  2024-12-18T00:03:34.1864299Z  2024-12-18T00:03:34.1864667Z  2024-12-18T00:03:34.1865066Z  2024-12-18T00:03:34.1865645Z [9,742 / 15,187] 48 actions, 47 running 2024-12-18T00:03:34.1866587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:03:34.1867763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:03:34.1868654Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:03:34.1869433Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:03:34.1870152Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:03:34.1870992Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:03:34.1871756Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:03:34.1872783Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local ... 2024-12-18T00:03:34.5092517Z 2024-12-18T00:03:34.5093530Z  2024-12-18T00:03:34.5094011Z  2024-12-18T00:03:34.5094392Z  2024-12-18T00:03:34.5094777Z  2024-12-18T00:03:34.5095143Z  2024-12-18T00:03:34.5095517Z  2024-12-18T00:03:34.5095893Z  2024-12-18T00:03:34.5096284Z  2024-12-18T00:03:34.5097035Z [9,744 / 15,187] 48 actions, 47 running 2024-12-18T00:03:34.5097928Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:03:34.5099021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:03:34.5099974Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:03:34.5100721Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:03:34.5101451Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:03:34.5102270Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:03:34.5103278Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2024-12-18T00:03:34.5104170Z @onednn//:mkl_dnn; 18s local ... 2024-12-18T00:03:34.7087685Z 2024-12-18T00:03:34.7088549Z  2024-12-18T00:03:34.7088993Z  2024-12-18T00:03:34.7089325Z  2024-12-18T00:03:34.7089671Z  2024-12-18T00:03:34.7090017Z  2024-12-18T00:03:34.7090369Z  2024-12-18T00:03:34.7090714Z  2024-12-18T00:03:34.7091034Z  2024-12-18T00:03:34.7091541Z [9,749 / 15,187] 48 actions, 47 running 2024-12-18T00:03:34.7092319Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:03:34.7093339Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:03:34.7094190Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:03:34.7094810Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:03:34.7095435Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:03:34.7096179Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:03:34.7097227Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2024-12-18T00:03:34.7097950Z @onednn//:mkl_dnn; 18s local ... 2024-12-18T00:03:34.9362829Z 2024-12-18T00:03:34.9363854Z  2024-12-18T00:03:34.9364304Z  2024-12-18T00:03:34.9364764Z  2024-12-18T00:03:34.9365104Z  2024-12-18T00:03:34.9365577Z  2024-12-18T00:03:34.9366066Z  2024-12-18T00:03:34.9366474Z  2024-12-18T00:03:34.9366822Z  2024-12-18T00:03:34.9367665Z [9,750 / 15,187] 48 actions running 2024-12-18T00:03:34.9368592Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:03:34.9369713Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:03:34.9370660Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:03:34.9371611Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:03:34.9372357Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:03:34.9373176Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:03:34.9374311Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2024-12-18T00:03:34.9375235Z @onednn//:mkl_dnn; 18s local ... 2024-12-18T00:03:35.3369653Z 2024-12-18T00:03:35.3370546Z  2024-12-18T00:03:35.3371051Z  2024-12-18T00:03:35.3371494Z  2024-12-18T00:03:35.3371909Z  2024-12-18T00:03:35.3372343Z  2024-12-18T00:03:35.3372800Z  2024-12-18T00:03:35.3373224Z  2024-12-18T00:03:35.3373655Z  2024-12-18T00:03:35.3374219Z [9,751 / 15,187] 48 actions running 2024-12-18T00:03:35.3375179Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:03:35.3376341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:03:35.3377535Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:03:35.3378324Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:03:35.3379091Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:03:35.3379983Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:03:35.3381017Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:03:35.3381925Z @onednn//:mkl_dnn; 19s local ... 2024-12-18T00:03:35.5374342Z 2024-12-18T00:03:35.5375368Z  2024-12-18T00:03:35.5375851Z  2024-12-18T00:03:35.5376242Z  2024-12-18T00:03:35.5376805Z  2024-12-18T00:03:35.5377226Z  2024-12-18T00:03:35.5377657Z  2024-12-18T00:03:35.5378055Z  2024-12-18T00:03:35.5378470Z  2024-12-18T00:03:35.5379054Z [9,752 / 15,187] 48 actions running 2024-12-18T00:03:35.5380001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:03:35.5381238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:03:35.5382230Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:03:35.5383013Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:03:35.5383784Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:03:35.5384642Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:03:35.5385673Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:03:35.5386546Z @onednn//:mkl_dnn; 19s local ... 2024-12-18T00:03:35.8133654Z 2024-12-18T00:03:35.8134540Z  2024-12-18T00:03:35.8135041Z  2024-12-18T00:03:35.8135481Z  2024-12-18T00:03:35.8135959Z  2024-12-18T00:03:35.8136367Z  2024-12-18T00:03:35.8136978Z  2024-12-18T00:03:35.8137364Z  2024-12-18T00:03:35.8137788Z  2024-12-18T00:03:35.8138412Z [9,755 / 15,187] 48 actions, 47 running 2024-12-18T00:03:35.8139363Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:03:35.8140556Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:03:35.8141544Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:03:35.8142323Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:03:35.8143110Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:03:35.8143976Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:03:35.8145342Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:03:35.8146716Z @onednn//:mkl_dnn; 19s local ... 2024-12-18T00:03:36.0307307Z 2024-12-18T00:03:36.0308180Z  2024-12-18T00:03:36.0308660Z  2024-12-18T00:03:36.0309069Z  2024-12-18T00:03:36.0309437Z  2024-12-18T00:03:36.0309805Z  2024-12-18T00:03:36.0310240Z  2024-12-18T00:03:36.0310621Z  2024-12-18T00:03:36.0311005Z  2024-12-18T00:03:36.0311944Z [9,757 / 15,187] 48 actions, 47 running 2024-12-18T00:03:36.0312742Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:03:36.0313747Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:03:36.0314747Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:03:36.0315386Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:03:36.0316023Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:03:36.0316752Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:03:36.0317796Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:03:36.0318637Z @onednn//:mkl_dnn; 19s local ... 2024-12-18T00:03:36.3114989Z 2024-12-18T00:03:36.3116119Z  2024-12-18T00:03:36.3116530Z  2024-12-18T00:03:36.3116873Z  2024-12-18T00:03:36.3117201Z  2024-12-18T00:03:36.3117557Z  2024-12-18T00:03:36.3117896Z  2024-12-18T00:03:36.3118272Z  2024-12-18T00:03:36.3118605Z  2024-12-18T00:03:36.3119121Z [9,759 / 15,187] 48 actions, 47 running 2024-12-18T00:03:36.3119954Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:03:36.3121013Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:03:36.3121925Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:03:36.3122657Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:03:36.3123358Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:03:36.3124168Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:03:36.3125052Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:03:36.3125853Z @onednn//:mkl_dnn; 20s local ... 2024-12-18T00:03:36.5385393Z 2024-12-18T00:03:36.5386390Z  2024-12-18T00:03:36.5386936Z  2024-12-18T00:03:36.5387340Z  2024-12-18T00:03:36.5387819Z  2024-12-18T00:03:36.5388246Z  2024-12-18T00:03:36.5388677Z  2024-12-18T00:03:36.5389097Z  2024-12-18T00:03:36.5389517Z  2024-12-18T00:03:36.5390136Z [9,760 / 15,187] 48 actions running 2024-12-18T00:03:36.5391156Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:03:36.5392379Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:03:36.5393446Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:03:36.5394144Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:03:36.5394897Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:03:36.5395729Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:03:36.5396635Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:03:36.5397431Z @onednn//:mkl_dnn; 20s local ... 2024-12-18T00:03:36.8795074Z 2024-12-18T00:03:36.8795988Z  2024-12-18T00:03:36.8796491Z  2024-12-18T00:03:36.8796969Z  2024-12-18T00:03:36.8797363Z  2024-12-18T00:03:36.8797776Z  2024-12-18T00:03:36.8798174Z  2024-12-18T00:03:36.8798564Z  2024-12-18T00:03:36.8798946Z  2024-12-18T00:03:36.8799536Z [9,762 / 15,187] 48 actions, 47 running 2024-12-18T00:03:36.8800512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:03:36.8801679Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:03:36.8803040Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:03:36.8803775Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:03:36.8804476Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:03:36.8805293Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:03:36.8806412Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:03:36.8807706Z @onednn//:mkl_dnn; 20s local ... 2024-12-18T00:03:37.1392652Z 2024-12-18T00:03:37.1393561Z  2024-12-18T00:03:37.1394012Z  2024-12-18T00:03:37.1394377Z  2024-12-18T00:03:37.1394751Z  2024-12-18T00:03:37.1395091Z  2024-12-18T00:03:37.1395402Z  2024-12-18T00:03:37.1395743Z  2024-12-18T00:03:37.1396072Z  2024-12-18T00:03:37.1396545Z [9,764 / 15,187] 48 actions running 2024-12-18T00:03:37.1397333Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:03:37.1398304Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:03:37.1399132Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:03:37.1399752Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:03:37.1400372Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:03:37.1401117Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:03:37.1402008Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:03:37.1402768Z @onednn//:mkl_dnn; 20s local ... 2024-12-18T00:03:37.5398165Z 2024-12-18T00:03:37.5399062Z  2024-12-18T00:03:37.5399637Z  2024-12-18T00:03:37.5399977Z  2024-12-18T00:03:37.5400300Z  2024-12-18T00:03:37.5400611Z  2024-12-18T00:03:37.5400934Z  2024-12-18T00:03:37.5401254Z  2024-12-18T00:03:37.5401572Z  2024-12-18T00:03:37.5401990Z [9,766 / 15,187] 48 actions running 2024-12-18T00:03:37.5402730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:03:37.5403570Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:03:37.5404288Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:03:37.5404858Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:03:37.5405447Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:03:37.5406062Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:03:37.5406797Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:03:37.5407457Z @onednn//:mkl_dnn; 21s local ... 2024-12-18T00:03:37.8210477Z 2024-12-18T00:03:37.8211346Z  2024-12-18T00:03:37.8211847Z  2024-12-18T00:03:37.8212238Z  2024-12-18T00:03:37.8212621Z  2024-12-18T00:03:37.8212985Z  2024-12-18T00:03:37.8213359Z  2024-12-18T00:03:37.8213881Z  2024-12-18T00:03:37.8214276Z  2024-12-18T00:03:37.8214902Z [9,767 / 15,187] 48 actions, 47 running 2024-12-18T00:03:37.8215785Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:03:37.8217058Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:03:37.8218085Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:03:37.8218860Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:03:37.8219573Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:03:37.8220447Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:03:37.8221452Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:03:37.8222386Z @onednn//:mkl_dnn; 21s local ... 2024-12-18T00:03:38.1405193Z 2024-12-18T00:03:38.1406195Z  2024-12-18T00:03:38.1406666Z  2024-12-18T00:03:38.1407090Z  2024-12-18T00:03:38.1407486Z  2024-12-18T00:03:38.1407863Z  2024-12-18T00:03:38.1408596Z  2024-12-18T00:03:38.1408991Z  2024-12-18T00:03:38.1409392Z  2024-12-18T00:03:38.1409932Z [9,767 / 15,187] 48 actions running 2024-12-18T00:03:38.1410839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:03:38.1411983Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:03:38.1413158Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:03:38.1413944Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:03:38.1414689Z Compiling src/cpu/simple_resampling.cpp; 30s local 2024-12-18T00:03:38.1415545Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:03:38.1416735Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:03:38.1417638Z @onednn//:mkl_dnn; 21s local ... 2024-12-18T00:03:38.3825811Z 2024-12-18T00:03:38.3826774Z  2024-12-18T00:03:38.3827269Z  2024-12-18T00:03:38.3827727Z  2024-12-18T00:03:38.3828122Z  2024-12-18T00:03:38.3828531Z  2024-12-18T00:03:38.3828938Z  2024-12-18T00:03:38.3829341Z  2024-12-18T00:03:38.3829735Z  2024-12-18T00:03:38.3830346Z [9,770 / 15,187] 48 actions, 47 running 2024-12-18T00:03:38.3831323Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:03:38.3832548Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:03:38.3833582Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:03:38.3834406Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:03:38.3835234Z Compiling src/cpu/simple_resampling.cpp; 30s local 2024-12-18T00:03:38.3836151Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:03:38.3837253Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:03:38.3838201Z @onednn//:mkl_dnn; 22s local ... 2024-12-18T00:03:38.5814627Z 2024-12-18T00:03:38.5815658Z  2024-12-18T00:03:38.5816308Z  2024-12-18T00:03:38.5816856Z  2024-12-18T00:03:38.5817255Z  2024-12-18T00:03:38.5817635Z  2024-12-18T00:03:38.5817996Z  2024-12-18T00:03:38.5818354Z  2024-12-18T00:03:38.5818766Z  2024-12-18T00:03:38.5819349Z [9,772 / 15,187] 48 actions, 47 running 2024-12-18T00:03:38.5820327Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:03:38.5821449Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:03:38.5822419Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:03:38.5823203Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:03:38.5823996Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:03:38.5824983Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:03:38.5826157Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:03:38.5827288Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local ... 2024-12-18T00:03:38.9413895Z 2024-12-18T00:03:38.9414738Z  2024-12-18T00:03:38.9415173Z  2024-12-18T00:03:38.9415555Z  2024-12-18T00:03:38.9415926Z  2024-12-18T00:03:38.9416318Z  2024-12-18T00:03:38.9416870Z  2024-12-18T00:03:38.9417295Z  2024-12-18T00:03:38.9417705Z  2024-12-18T00:03:38.9418246Z [9,772 / 15,187] 48 actions running 2024-12-18T00:03:38.9419129Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:03:38.9420236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:03:38.9421231Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:03:38.9422110Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:03:38.9422836Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:03:38.9434825Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:03:38.9436134Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:03:38.9437241Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local ... 2024-12-18T00:03:39.1584346Z 2024-12-18T00:03:39.1585230Z  2024-12-18T00:03:39.1585709Z  2024-12-18T00:03:39.1586455Z  2024-12-18T00:03:39.1586877Z  2024-12-18T00:03:39.1587286Z  2024-12-18T00:03:39.1587688Z  2024-12-18T00:03:39.1588060Z  2024-12-18T00:03:39.1588447Z  2024-12-18T00:03:39.1589039Z [9,776 / 15,187] 48 actions, 47 running 2024-12-18T00:03:39.1589957Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:03:39.1591071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:03:39.1592067Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:03:39.1592841Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:03:39.1593634Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:03:39.1594636Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:03:39.1595743Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:03:39.1596761Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local ... 2024-12-18T00:03:39.3786051Z 2024-12-18T00:03:39.3786882Z  2024-12-18T00:03:39.3787364Z  2024-12-18T00:03:39.3787802Z  2024-12-18T00:03:39.3788166Z  2024-12-18T00:03:39.3788553Z  2024-12-18T00:03:39.3788930Z  2024-12-18T00:03:39.3789320Z  2024-12-18T00:03:39.3789692Z  2024-12-18T00:03:39.3790276Z [9,778 / 15,187] 48 actions, 47 running 2024-12-18T00:03:39.3791134Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:03:39.3792303Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:03:39.3793306Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:03:39.3794065Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:03:39.3794874Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:03:39.3795913Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:03:39.3797022Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:03:39.3798099Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local ... 2024-12-18T00:03:39.7422361Z 2024-12-18T00:03:39.7423716Z  2024-12-18T00:03:39.7424201Z  2024-12-18T00:03:39.7424623Z  2024-12-18T00:03:39.7425036Z  2024-12-18T00:03:39.7425455Z  2024-12-18T00:03:39.7425847Z  2024-12-18T00:03:39.7426228Z  2024-12-18T00:03:39.7426645Z  2024-12-18T00:03:39.7427201Z [9,781 / 15,187] 48 actions running 2024-12-18T00:03:39.7428220Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:03:39.7429373Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:03:39.7430358Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:03:39.7431124Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:03:39.7431959Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:03:39.7432997Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:03:39.7434113Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:03:39.7435005Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:03:39.9789359Z 2024-12-18T00:03:39.9790257Z  2024-12-18T00:03:39.9790756Z  2024-12-18T00:03:39.9791132Z  2024-12-18T00:03:39.9791577Z  2024-12-18T00:03:39.9791951Z  2024-12-18T00:03:39.9792318Z  2024-12-18T00:03:39.9793117Z  2024-12-18T00:03:39.9793488Z  2024-12-18T00:03:39.9794067Z [9,782 / 15,187] 48 actions, 47 running 2024-12-18T00:03:39.9794968Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:03:39.9796106Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:03:39.9797373Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:03:39.9798141Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:03:39.9798978Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:03:39.9799903Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:03:39.9800989Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:03:39.9801845Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:03:40.1839838Z 2024-12-18T00:03:40.1840730Z  2024-12-18T00:03:40.1841354Z  2024-12-18T00:03:40.1841832Z  2024-12-18T00:03:40.1842347Z  2024-12-18T00:03:40.1842755Z  2024-12-18T00:03:40.1843131Z  2024-12-18T00:03:40.1843501Z  2024-12-18T00:03:40.1843859Z  2024-12-18T00:03:40.1844651Z [9,785 / 15,187] 48 actions, 47 running 2024-12-18T00:03:40.1845781Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:03:40.1847100Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:03:40.1848172Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:03:40.1849029Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:03:40.1849901Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:03:40.1851043Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:03:40.1852289Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:03:40.1853409Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2024-12-18T00:03:40.4021416Z 2024-12-18T00:03:40.4022281Z  2024-12-18T00:03:40.4022774Z  2024-12-18T00:03:40.4023134Z  2024-12-18T00:03:40.4023525Z  2024-12-18T00:03:40.4023936Z  2024-12-18T00:03:40.4024329Z  2024-12-18T00:03:40.4024724Z  2024-12-18T00:03:40.4025099Z  2024-12-18T00:03:40.4025718Z [9,787 / 15,187] 48 actions, 47 running 2024-12-18T00:03:40.4026601Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:03:40.4027749Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:03:40.4028720Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:03:40.4029482Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:03:40.4030302Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:03:40.4031317Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:03:40.4032582Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:03:40.4033557Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2024-12-18T00:03:40.7433590Z 2024-12-18T00:03:40.7434436Z  2024-12-18T00:03:40.7434905Z  2024-12-18T00:03:40.7435311Z  2024-12-18T00:03:40.7435654Z  2024-12-18T00:03:40.7436073Z  2024-12-18T00:03:40.7436528Z  2024-12-18T00:03:40.7436946Z  2024-12-18T00:03:40.7437366Z  2024-12-18T00:03:40.7437938Z [9,788 / 15,187] 48 actions running 2024-12-18T00:03:40.7438902Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:03:40.7440094Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:03:40.7441085Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:03:40.7441882Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:03:40.7442720Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:03:40.7444145Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:03:40.7445592Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:03:40.7446732Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2024-12-18T00:03:40.9439377Z 2024-12-18T00:03:40.9440350Z  2024-12-18T00:03:40.9441249Z  2024-12-18T00:03:40.9441664Z  2024-12-18T00:03:40.9442214Z  2024-12-18T00:03:40.9442617Z  2024-12-18T00:03:40.9442998Z  2024-12-18T00:03:40.9443402Z  2024-12-18T00:03:40.9443771Z  2024-12-18T00:03:40.9444569Z [9,789 / 15,187] 48 actions running 2024-12-18T00:03:40.9445495Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:03:40.9446629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:03:40.9447654Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:03:40.9448427Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:03:40.9449226Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:03:40.9450244Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:03:40.9451359Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:03:40.9452407Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2024-12-18T00:03:41.1793951Z 2024-12-18T00:03:41.1795036Z  2024-12-18T00:03:41.1795483Z  2024-12-18T00:03:41.1795862Z  2024-12-18T00:03:41.1796216Z  2024-12-18T00:03:41.1796589Z  2024-12-18T00:03:41.1797001Z  2024-12-18T00:03:41.1797376Z  2024-12-18T00:03:41.1797757Z  2024-12-18T00:03:41.1798312Z [9,790 / 15,187] 48 actions, 47 running 2024-12-18T00:03:41.1799196Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:03:41.1800336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:03:41.1801268Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:03:41.1801982Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:03:41.1802743Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:03:41.1803709Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:03:41.1804763Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:03:41.1805918Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2024-12-18T00:03:41.5445171Z 2024-12-18T00:03:41.5446056Z  2024-12-18T00:03:41.5446514Z  2024-12-18T00:03:41.5446887Z  2024-12-18T00:03:41.5447252Z  2024-12-18T00:03:41.5447627Z  2024-12-18T00:03:41.5448032Z  2024-12-18T00:03:41.5448476Z  2024-12-18T00:03:41.5448875Z  2024-12-18T00:03:41.5449448Z [9,791 / 15,187] 48 actions running 2024-12-18T00:03:41.5450466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:03:41.5451682Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:03:41.5452718Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:03:41.5453506Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:03:41.5454334Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:03:41.5455392Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:03:41.5456420Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:03:41.5457621Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2024-12-18T00:03:41.8124955Z 2024-12-18T00:03:41.8125827Z  2024-12-18T00:03:41.8126317Z  2024-12-18T00:03:41.8126742Z  2024-12-18T00:03:41.8127145Z  2024-12-18T00:03:41.8127561Z  2024-12-18T00:03:41.8128436Z  2024-12-18T00:03:41.8128848Z  2024-12-18T00:03:41.8129266Z  2024-12-18T00:03:41.8129877Z [9,793 / 15,187] 48 actions, 47 running 2024-12-18T00:03:41.8130875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:03:41.8132122Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:03:41.8133349Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:03:41.8134186Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:03:41.8135055Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:03:41.8136141Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:03:41.8137505Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:03:41.8138611Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2024-12-18T00:03:42.1116064Z 2024-12-18T00:03:42.1116947Z  2024-12-18T00:03:42.1117541Z  2024-12-18T00:03:42.1117928Z  2024-12-18T00:03:42.1118317Z  2024-12-18T00:03:42.1118672Z  2024-12-18T00:03:42.1119041Z  2024-12-18T00:03:42.1119413Z  2024-12-18T00:03:42.1119762Z  2024-12-18T00:03:42.1120326Z [9,795 / 15,187] 48 actions, 47 running 2024-12-18T00:03:42.1121284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:03:42.1122458Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:03:42.1123496Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:03:42.1124247Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:03:42.1125071Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:03:42.1126125Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:03:42.1127223Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:03:42.1128184Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2024-12-18T00:03:42.3453933Z 2024-12-18T00:03:42.3454888Z  2024-12-18T00:03:42.3455363Z  2024-12-18T00:03:42.3455719Z  2024-12-18T00:03:42.3456120Z  2024-12-18T00:03:42.3456588Z  2024-12-18T00:03:42.3456959Z  2024-12-18T00:03:42.3457316Z  2024-12-18T00:03:42.3457663Z  2024-12-18T00:03:42.3458229Z [9,797 / 15,187] 48 actions running 2024-12-18T00:03:42.3459087Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:03:42.3460056Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:03:42.3460920Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:03:42.3461570Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:03:42.3462307Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:03:42.3463227Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:03:42.3464224Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:03:42.3465160Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2024-12-18T00:03:42.6113481Z 2024-12-18T00:03:42.6114342Z  2024-12-18T00:03:42.6114827Z  2024-12-18T00:03:42.6115249Z  2024-12-18T00:03:42.6115670Z  2024-12-18T00:03:42.6116139Z  2024-12-18T00:03:42.6116549Z  2024-12-18T00:03:42.6116976Z  2024-12-18T00:03:42.6117405Z  2024-12-18T00:03:42.6118033Z [9,800 / 15,187] 48 actions, 47 running 2024-12-18T00:03:42.6119000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:03:42.6120121Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:03:42.6121059Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:03:42.6121803Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:03:42.6122819Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:03:42.6123734Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:03:42.6124760Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:03:42.6125743Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2024-12-18T00:03:42.9459118Z 2024-12-18T00:03:42.9460355Z  2024-12-18T00:03:42.9460853Z  2024-12-18T00:03:42.9461264Z  2024-12-18T00:03:42.9461616Z  2024-12-18T00:03:42.9461978Z  2024-12-18T00:03:42.9462352Z  2024-12-18T00:03:42.9462703Z  2024-12-18T00:03:42.9463080Z  2024-12-18T00:03:42.9463626Z [9,802 / 15,187] 48 actions running 2024-12-18T00:03:42.9464564Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:03:42.9465676Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:03:42.9466654Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:03:42.9467411Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:03:42.9468185Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:03:42.9469229Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:03:42.9470254Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2024-12-18T00:03:42.9471086Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local ... 2024-12-18T00:03:43.1465093Z 2024-12-18T00:03:43.1465948Z  2024-12-18T00:03:43.1466405Z  2024-12-18T00:03:43.1466815Z  2024-12-18T00:03:43.1467233Z  2024-12-18T00:03:43.1467644Z  2024-12-18T00:03:43.1468061Z  2024-12-18T00:03:43.1468469Z  2024-12-18T00:03:43.1468883Z  2024-12-18T00:03:43.1469436Z [9,804 / 15,187] 48 actions running 2024-12-18T00:03:43.1470421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:03:43.1471665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:03:43.1472697Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:03:43.1473489Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:03:43.1474226Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:03:43.1475297Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:03:43.1476336Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2024-12-18T00:03:43.1477149Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local ... 2024-12-18T00:03:43.5471135Z 2024-12-18T00:03:43.5471994Z  2024-12-18T00:03:43.5472474Z  2024-12-18T00:03:43.5472875Z  2024-12-18T00:03:43.5473308Z  2024-12-18T00:03:43.5473739Z  2024-12-18T00:03:43.5474152Z  2024-12-18T00:03:43.5474544Z  2024-12-18T00:03:43.5474943Z  2024-12-18T00:03:43.5475479Z [9,805 / 15,187] 48 actions running 2024-12-18T00:03:43.5476464Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:03:43.5477641Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:03:43.5478669Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:03:43.5479456Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:03:43.5480336Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:03:43.5481407Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:03:43.5482423Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:03:43.5483305Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local ... 2024-12-18T00:03:43.9395627Z 2024-12-18T00:03:43.9396560Z  2024-12-18T00:03:43.9397085Z  2024-12-18T00:03:43.9397491Z  2024-12-18T00:03:43.9397924Z  2024-12-18T00:03:43.9398339Z  2024-12-18T00:03:43.9399086Z  2024-12-18T00:03:43.9399454Z  2024-12-18T00:03:43.9399800Z  2024-12-18T00:03:43.9400375Z [9,807 / 15,187] 48 actions, 47 running 2024-12-18T00:03:43.9401300Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:03:43.9402472Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:03:43.9403676Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:03:43.9404473Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:03:43.9405300Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:03:43.9406361Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:03:43.9407421Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:03:43.9408314Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local ... 2024-12-18T00:03:44.1478040Z 2024-12-18T00:03:44.1478913Z  2024-12-18T00:03:44.1479411Z  2024-12-18T00:03:44.1479876Z  2024-12-18T00:03:44.1480286Z  2024-12-18T00:03:44.1480741Z  2024-12-18T00:03:44.1481120Z  2024-12-18T00:03:44.1481494Z  2024-12-18T00:03:44.1481828Z  2024-12-18T00:03:44.1482359Z [9,811 / 15,187] 48 actions running 2024-12-18T00:03:44.1483274Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:03:44.1484457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:03:44.1485463Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:03:44.1486273Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:03:44.1487057Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:03:44.1488087Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:03:44.1489129Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:03:44.1489989Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local ... 2024-12-18T00:03:44.3840151Z 2024-12-18T00:03:44.3841023Z  2024-12-18T00:03:44.3841534Z  2024-12-18T00:03:44.3841909Z  2024-12-18T00:03:44.3842327Z  2024-12-18T00:03:44.3842735Z  2024-12-18T00:03:44.3843151Z  2024-12-18T00:03:44.3843537Z  2024-12-18T00:03:44.3843936Z  2024-12-18T00:03:44.3844861Z [9,812 / 15,187] 48 actions, 47 running 2024-12-18T00:03:44.3845831Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:03:44.3847046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:03:44.3848076Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:03:44.3848800Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:03:44.3849517Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:03:44.3850429Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:03:44.3851352Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:03:44.3852224Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local ... 2024-12-18T00:03:44.5998545Z 2024-12-18T00:03:44.5999444Z  2024-12-18T00:03:44.5999928Z  2024-12-18T00:03:44.6000369Z  2024-12-18T00:03:44.6000786Z  2024-12-18T00:03:44.6001183Z  2024-12-18T00:03:44.6001575Z  2024-12-18T00:03:44.6002046Z  2024-12-18T00:03:44.6002450Z  2024-12-18T00:03:44.6003049Z [9,813 / 15,187] 48 actions, 47 running 2024-12-18T00:03:44.6004034Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:03:44.6005200Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:03:44.6006217Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:03:44.6007002Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:03:44.6007842Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:03:44.6009263Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:03:44.6010310Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local 2024-12-18T00:03:44.6011218Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local ... 2024-12-18T00:03:44.9236558Z 2024-12-18T00:03:44.9237431Z  2024-12-18T00:03:44.9237934Z  2024-12-18T00:03:44.9238680Z  2024-12-18T00:03:44.9239080Z  2024-12-18T00:03:44.9239481Z  2024-12-18T00:03:44.9239882Z  2024-12-18T00:03:44.9240285Z  2024-12-18T00:03:44.9240680Z  2024-12-18T00:03:44.9241255Z [9,815 / 15,187] 48 actions, 47 running 2024-12-18T00:03:44.9242179Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:03:44.9243362Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:03:44.9244595Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:03:44.9245427Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:03:44.9246215Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:03:44.9247250Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:03:44.9248278Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:03:44.9249289Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2024-12-18T00:03:45.1487317Z 2024-12-18T00:03:45.1488167Z  2024-12-18T00:03:45.1488636Z  2024-12-18T00:03:45.1489146Z  2024-12-18T00:03:45.1489503Z  2024-12-18T00:03:45.1489860Z  2024-12-18T00:03:45.1490192Z  2024-12-18T00:03:45.1490538Z  2024-12-18T00:03:45.1490882Z  2024-12-18T00:03:45.1491405Z [9,816 / 15,187] 48 actions running 2024-12-18T00:03:45.1492228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:03:45.1493262Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:03:45.1494191Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:03:45.1494872Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:03:45.1495638Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:03:45.1496653Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:03:45.1497464Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:03:45.1498202Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2024-12-18T00:03:45.3491945Z 2024-12-18T00:03:45.3493269Z  2024-12-18T00:03:45.3493784Z  2024-12-18T00:03:45.3494195Z  2024-12-18T00:03:45.3494595Z  2024-12-18T00:03:45.3495012Z  2024-12-18T00:03:45.3495407Z  2024-12-18T00:03:45.3495808Z  2024-12-18T00:03:45.3496197Z  2024-12-18T00:03:45.3496908Z [9,817 / 15,187] 48 actions running 2024-12-18T00:03:45.3497878Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:03:45.3499044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:03:45.3500061Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:03:45.3500852Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:03:45.3501717Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:03:45.3502803Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:03:45.3503842Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:03:45.3504813Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2024-12-18T00:03:45.5826970Z 2024-12-18T00:03:45.5828151Z  2024-12-18T00:03:45.5828624Z  2024-12-18T00:03:45.5829040Z  2024-12-18T00:03:45.5829445Z  2024-12-18T00:03:45.5829832Z  2024-12-18T00:03:45.5830212Z  2024-12-18T00:03:45.5830594Z  2024-12-18T00:03:45.5831388Z  2024-12-18T00:03:45.5831978Z [9,820 / 15,187] 48 actions, 47 running 2024-12-18T00:03:45.5832942Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:03:45.5834034Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:03:45.5835004Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:03:45.5836023Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:03:45.5836843Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:03:45.5837902Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:03:45.5838926Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:03:45.5839890Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2024-12-18T00:03:45.9498038Z 2024-12-18T00:03:45.9499239Z  2024-12-18T00:03:45.9499724Z  2024-12-18T00:03:45.9500119Z  2024-12-18T00:03:45.9500581Z  2024-12-18T00:03:45.9500956Z  2024-12-18T00:03:45.9501353Z  2024-12-18T00:03:45.9501748Z  2024-12-18T00:03:45.9502139Z  2024-12-18T00:03:45.9502672Z [9,821 / 15,187] 48 actions running 2024-12-18T00:03:45.9503580Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:03:45.9504703Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:03:45.9505680Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:03:45.9506427Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:03:45.9507370Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:03:45.9508450Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:03:45.9509422Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:03:45.9511660Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2024-12-18T00:03:46.1504450Z 2024-12-18T00:03:46.1505344Z  2024-12-18T00:03:46.1505746Z  2024-12-18T00:03:46.1506105Z  2024-12-18T00:03:46.1506463Z  2024-12-18T00:03:46.1506810Z  2024-12-18T00:03:46.1507145Z  2024-12-18T00:03:46.1507496Z  2024-12-18T00:03:46.1507850Z  2024-12-18T00:03:46.1508359Z [9,822 / 15,187] 48 actions running 2024-12-18T00:03:46.1509256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:03:46.1510307Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:03:46.1511246Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:03:46.1511939Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:03:46.1512731Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:03:46.1513765Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:03:46.1514748Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:03:46.1515687Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2024-12-18T00:03:46.4160314Z 2024-12-18T00:03:46.4161168Z  2024-12-18T00:03:46.4161643Z  2024-12-18T00:03:46.4162047Z  2024-12-18T00:03:46.4162442Z  2024-12-18T00:03:46.4162817Z  2024-12-18T00:03:46.4163209Z  2024-12-18T00:03:46.4163612Z  2024-12-18T00:03:46.4164040Z  2024-12-18T00:03:46.4164653Z [9,823 / 15,187] 48 actions, 47 running 2024-12-18T00:03:46.4165607Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:03:46.4166768Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:03:46.4167816Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:03:46.4168623Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:03:46.4169483Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:03:46.4170894Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:03:46.4171866Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:03:46.4172774Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2024-12-18T00:03:46.7436920Z 2024-12-18T00:03:46.7437787Z  2024-12-18T00:03:46.7438275Z  2024-12-18T00:03:46.7438696Z  2024-12-18T00:03:46.7439433Z  2024-12-18T00:03:46.7440223Z  2024-12-18T00:03:46.7440925Z  2024-12-18T00:03:46.7441462Z  2024-12-18T00:03:46.7442002Z  2024-12-18T00:03:46.7442728Z [9,825 / 15,187] 48 actions, 47 running 2024-12-18T00:03:46.7443809Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:03:46.7445345Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:03:46.7446510Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:03:46.7447420Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:03:46.7448426Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:03:46.7449603Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:03:46.7450759Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:03:46.7451821Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2024-12-18T00:03:46.9510748Z 2024-12-18T00:03:46.9511607Z  2024-12-18T00:03:46.9512096Z  2024-12-18T00:03:46.9512506Z  2024-12-18T00:03:46.9512918Z  2024-12-18T00:03:46.9513318Z  2024-12-18T00:03:46.9513701Z  2024-12-18T00:03:46.9514102Z  2024-12-18T00:03:46.9514527Z  2024-12-18T00:03:46.9515111Z [9,826 / 15,187] 48 actions running 2024-12-18T00:03:46.9516066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:03:46.9517270Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:03:46.9518298Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:03:46.9519076Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:03:46.9519928Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:03:46.9520996Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:03:46.9521987Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:03:46.9522911Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local ... 2024-12-18T00:03:47.5825892Z 2024-12-18T00:03:47.5830805Z  2024-12-18T00:03:47.5831347Z  2024-12-18T00:03:47.5831777Z  2024-12-18T00:03:47.5832217Z  2024-12-18T00:03:47.5832658Z  2024-12-18T00:03:47.5833052Z  2024-12-18T00:03:47.5833441Z  2024-12-18T00:03:47.5833848Z  2024-12-18T00:03:47.5834460Z [9,827 / 15,187] 48 actions, 47 running 2024-12-18T00:03:47.5835404Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:03:47.5836588Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:03:47.5837648Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:03:47.5838475Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:03:47.5839334Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:03:47.5840467Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:03:47.5841510Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:03:47.5842503Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local ... 2024-12-18T00:03:47.8329621Z 2024-12-18T00:03:47.8330534Z  2024-12-18T00:03:47.8331030Z  2024-12-18T00:03:47.8332539Z  2024-12-18T00:03:47.8333414Z  2024-12-18T00:03:47.8334156Z  2024-12-18T00:03:47.8334608Z  2024-12-18T00:03:47.8335019Z  2024-12-18T00:03:47.8335729Z  2024-12-18T00:03:47.8336310Z [9,830 / 15,187] 48 actions, 47 running 2024-12-18T00:03:47.8337354Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:03:47.8338447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:03:47.8339415Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:03:47.8340441Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:03:47.8341288Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:03:47.8342329Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:03:47.8343330Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:03:47.8344579Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local ... 2024-12-18T00:03:48.0378369Z 2024-12-18T00:03:48.0380275Z  2024-12-18T00:03:48.0381346Z  2024-12-18T00:03:48.0382057Z  2024-12-18T00:03:48.0382814Z  2024-12-18T00:03:48.0383240Z  2024-12-18T00:03:48.0383635Z  2024-12-18T00:03:48.0384026Z  2024-12-18T00:03:48.0384424Z  2024-12-18T00:03:48.0385014Z [9,833 / 15,187] 47 actions, 46 running 2024-12-18T00:03:48.0385962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:03:48.0387313Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:03:48.0388380Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:03:48.0389225Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:03:48.0390058Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:03:48.0391103Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:03:48.0392134Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:03:48.0393116Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local ... 2024-12-18T00:03:48.3523153Z 2024-12-18T00:03:48.3524055Z  2024-12-18T00:03:48.3524499Z  2024-12-18T00:03:48.3524902Z  2024-12-18T00:03:48.3525441Z  2024-12-18T00:03:48.3525838Z  2024-12-18T00:03:48.3526247Z  2024-12-18T00:03:48.3526671Z  2024-12-18T00:03:48.3527065Z  2024-12-18T00:03:48.3527623Z [9,834 / 15,187] 48 actions running 2024-12-18T00:03:48.3528666Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:03:48.3529910Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:03:48.3531331Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:03:48.3532126Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:03:48.3533094Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:03:48.3534261Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:03:48.3535433Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:03:48.3536622Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local ... 2024-12-18T00:03:48.7506497Z 2024-12-18T00:03:48.7507463Z  2024-12-18T00:03:48.7508449Z  2024-12-18T00:03:48.7509189Z  2024-12-18T00:03:48.7509938Z  2024-12-18T00:03:48.7510361Z  2024-12-18T00:03:48.7510782Z  2024-12-18T00:03:48.7511194Z  2024-12-18T00:03:48.7511639Z  2024-12-18T00:03:48.7512255Z [9,837 / 15,187] 48 actions, 47 running 2024-12-18T00:03:48.7513182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:03:48.7514333Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:03:48.7515362Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:03:48.7516156Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:03:48.7517011Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:03:48.7518394Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:03:48.7519405Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:03:48.7520355Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local ... 2024-12-18T00:03:48.9530187Z 2024-12-18T00:03:48.9531430Z  2024-12-18T00:03:48.9531964Z  2024-12-18T00:03:48.9532403Z  2024-12-18T00:03:48.9533180Z  2024-12-18T00:03:48.9533637Z  2024-12-18T00:03:48.9534089Z  2024-12-18T00:03:48.9534528Z  2024-12-18T00:03:48.9534954Z  2024-12-18T00:03:48.9535559Z [9,838 / 15,187] 48 actions running 2024-12-18T00:03:48.9536750Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:03:48.9538043Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:03:48.9539298Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:03:48.9540256Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:03:48.9541118Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:03:48.9542224Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:03:48.9543285Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:03:48.9544503Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2024-12-18T00:03:49.1535981Z 2024-12-18T00:03:49.1537075Z  2024-12-18T00:03:49.1537553Z  2024-12-18T00:03:49.1537935Z  2024-12-18T00:03:49.1538313Z  2024-12-18T00:03:49.1538647Z  2024-12-18T00:03:49.1539025Z  2024-12-18T00:03:49.1539426Z  2024-12-18T00:03:49.1539842Z  2024-12-18T00:03:49.1540455Z [9,840 / 15,187] 48 actions running 2024-12-18T00:03:49.1541655Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:03:49.1542868Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:03:49.1543925Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:03:49.1545042Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:03:49.1545865Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:03:49.1546938Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:03:49.1547963Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:03:49.1548824Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2024-12-18T00:03:49.5386660Z 2024-12-18T00:03:49.5387484Z  2024-12-18T00:03:49.5387969Z  2024-12-18T00:03:49.5388374Z  2024-12-18T00:03:49.5388767Z  2024-12-18T00:03:49.5389152Z  2024-12-18T00:03:49.5389539Z  2024-12-18T00:03:49.5389941Z  2024-12-18T00:03:49.5390332Z  2024-12-18T00:03:49.5390936Z [9,844 / 15,187] 48 actions, 47 running 2024-12-18T00:03:49.5391917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:03:49.5393174Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:03:49.5394249Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:03:49.5395059Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:03:49.5395919Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:03:49.5397026Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:03:49.5398061Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:03:49.5398994Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2024-12-18T00:03:49.7543066Z 2024-12-18T00:03:49.7544002Z  2024-12-18T00:03:49.7545350Z  2024-12-18T00:03:49.7546228Z  2024-12-18T00:03:49.7546997Z  2024-12-18T00:03:49.7547451Z  2024-12-18T00:03:49.7547865Z  2024-12-18T00:03:49.7548241Z  2024-12-18T00:03:49.7548657Z  2024-12-18T00:03:49.7549603Z [9,846 / 15,187] 48 actions running 2024-12-18T00:03:49.7550579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:03:49.7551755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:03:49.7552944Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:03:49.7553984Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:03:49.7554829Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:03:49.7555891Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:03:49.7556926Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:03:49.7557816Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2024-12-18T00:03:50.0397725Z 2024-12-18T00:03:50.0398912Z  2024-12-18T00:03:50.0399402Z  2024-12-18T00:03:50.0399817Z  2024-12-18T00:03:50.0400217Z  2024-12-18T00:03:50.0400641Z  2024-12-18T00:03:50.0401023Z  2024-12-18T00:03:50.0401420Z  2024-12-18T00:03:50.0401819Z  2024-12-18T00:03:50.0402385Z [9,849 / 15,187] 48 actions, 47 running 2024-12-18T00:03:50.0403304Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:03:50.0404447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:03:50.0405499Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:03:50.0406444Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:03:50.0407302Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:03:50.0408417Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:03:50.0409476Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:03:50.0410461Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local ... 2024-12-18T00:03:50.2937060Z 2024-12-18T00:03:50.2938288Z  2024-12-18T00:03:50.2938776Z  2024-12-18T00:03:50.2939188Z  2024-12-18T00:03:50.2939589Z  2024-12-18T00:03:50.2940000Z  2024-12-18T00:03:50.2940409Z  2024-12-18T00:03:50.2940826Z  2024-12-18T00:03:50.2941250Z  2024-12-18T00:03:50.2941863Z [9,850 / 15,187] 48 actions, 47 running 2024-12-18T00:03:50.2942885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:03:50.2944074Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:03:50.2945369Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:03:50.2946082Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:03:50.2946900Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:03:50.2947956Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:03:50.2948997Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:03:50.2949974Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local ... 2024-12-18T00:03:50.5550821Z 2024-12-18T00:03:50.5551916Z  2024-12-18T00:03:50.5552392Z  2024-12-18T00:03:50.5552798Z  2024-12-18T00:03:50.5553179Z  2024-12-18T00:03:50.5553579Z  2024-12-18T00:03:50.5553935Z  2024-12-18T00:03:50.5554286Z  2024-12-18T00:03:50.5554676Z  2024-12-18T00:03:50.5555254Z [9,850 / 15,187] 48 actions running 2024-12-18T00:03:50.5556131Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:03:50.5557144Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:03:50.5558044Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:03:50.5558783Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:03:50.5559568Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:03:50.5560550Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:03:50.5561918Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:03:50.5562820Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local ... 2024-12-18T00:03:50.7554646Z 2024-12-18T00:03:50.7555963Z  2024-12-18T00:03:50.7556568Z  2024-12-18T00:03:50.7556941Z  2024-12-18T00:03:50.7557312Z  2024-12-18T00:03:50.7558005Z  2024-12-18T00:03:50.7558413Z  2024-12-18T00:03:50.7558790Z  2024-12-18T00:03:50.7559172Z  2024-12-18T00:03:50.7559776Z [9,852 / 15,187] 48 actions running 2024-12-18T00:03:50.7560738Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:03:50.7561877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:03:50.7562902Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:03:50.7563576Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:03:50.7564355Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:03:50.7565340Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:03:50.7566326Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:03:50.7567224Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local ... 2024-12-18T00:03:51.1492164Z 2024-12-18T00:03:51.1493131Z  2024-12-18T00:03:51.1493669Z  2024-12-18T00:03:51.1494118Z  2024-12-18T00:03:51.1494536Z  2024-12-18T00:03:51.1494969Z  2024-12-18T00:03:51.1495366Z  2024-12-18T00:03:51.1495801Z  2024-12-18T00:03:51.1496162Z  2024-12-18T00:03:51.1496900Z [9,853 / 15,187] 48 actions, 47 running 2024-12-18T00:03:51.1497858Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:03:51.1498966Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:03:51.1500001Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:03:51.1501524Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:03:51.1502442Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:03:51.1503460Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:03:51.1505981Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:03:51.1509469Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local ... 2024-12-18T00:03:51.3561220Z 2024-12-18T00:03:51.3563123Z  2024-12-18T00:03:51.3564565Z  2024-12-18T00:03:51.3565927Z  2024-12-18T00:03:51.3567254Z  2024-12-18T00:03:51.3568609Z  2024-12-18T00:03:51.3570075Z  2024-12-18T00:03:51.3571573Z  2024-12-18T00:03:51.3573028Z  2024-12-18T00:03:51.3574654Z [9,855 / 15,187] 48 actions running 2024-12-18T00:03:51.3576813Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:03:51.3579044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:03:51.3581041Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:03:51.3582719Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:03:51.3584506Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:03:51.3592623Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:03:51.3593504Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:03:51.3594328Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local ... 2024-12-18T00:03:51.5894940Z 2024-12-18T00:03:51.5895819Z  2024-12-18T00:03:51.5896294Z  2024-12-18T00:03:51.5896878Z  2024-12-18T00:03:51.5897263Z  2024-12-18T00:03:51.5897625Z  2024-12-18T00:03:51.5915340Z  2024-12-18T00:03:51.5915747Z  2024-12-18T00:03:51.5916119Z  2024-12-18T00:03:51.5916688Z [9,857 / 15,187] 48 actions, 47 running 2024-12-18T00:03:51.5918052Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:03:51.5919194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:03:51.5920214Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:03:51.5920989Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:03:51.5921970Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:03:51.5923010Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:03:51.5923970Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:03:51.5924855Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local ... 2024-12-18T00:03:51.9572375Z 2024-12-18T00:03:51.9573269Z  2024-12-18T00:03:51.9573744Z  2024-12-18T00:03:51.9574418Z  2024-12-18T00:03:51.9574852Z  2024-12-18T00:03:51.9575254Z  2024-12-18T00:03:51.9575622Z  2024-12-18T00:03:51.9575955Z  2024-12-18T00:03:51.9576836Z  2024-12-18T00:03:51.9577430Z [9,859 / 15,187] 48 actions running 2024-12-18T00:03:51.9578735Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:03:51.9579739Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:03:51.9581064Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:03:51.9581880Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:03:51.9582712Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:03:51.9584324Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:03:51.9585659Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:03:51.9586647Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local ... 2024-12-18T00:03:52.1576282Z 2024-12-18T00:03:52.1577301Z  2024-12-18T00:03:52.1577828Z  2024-12-18T00:03:52.1578244Z  2024-12-18T00:03:52.1578628Z  2024-12-18T00:03:52.1579030Z  2024-12-18T00:03:52.1579437Z  2024-12-18T00:03:52.1579822Z  2024-12-18T00:03:52.1580203Z  2024-12-18T00:03:52.1580779Z [9,860 / 15,187] 48 actions running 2024-12-18T00:03:52.1581755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:03:52.1582914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:03:52.1583889Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:03:52.1584642Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:03:52.1585413Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:03:52.1586433Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:03:52.1587386Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:03:52.1588312Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local ... 2024-12-18T00:03:52.5374746Z 2024-12-18T00:03:52.5375607Z  2024-12-18T00:03:52.5376070Z  2024-12-18T00:03:52.5376628Z  2024-12-18T00:03:52.5377026Z  2024-12-18T00:03:52.5377438Z  2024-12-18T00:03:52.5377822Z  2024-12-18T00:03:52.5378222Z  2024-12-18T00:03:52.5378638Z  2024-12-18T00:03:52.5379293Z [9,862 / 15,187] 48 actions, 47 running 2024-12-18T00:03:52.5380233Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:03:52.5381377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:03:52.5382383Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:03:52.5383199Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:03:52.5384003Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:03:52.5385020Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:03:52.5386436Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:03:52.5387364Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local ... 2024-12-18T00:03:52.7578693Z 2024-12-18T00:03:52.7579607Z  2024-12-18T00:03:52.7580094Z  2024-12-18T00:03:52.7580529Z  2024-12-18T00:03:52.7580951Z  2024-12-18T00:03:52.7581709Z  2024-12-18T00:03:52.7582138Z  2024-12-18T00:03:52.7582561Z  2024-12-18T00:03:52.7582964Z  2024-12-18T00:03:52.7583688Z [9,864 / 15,187] 48 actions running 2024-12-18T00:03:52.7584668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:03:52.7585829Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:03:52.7586857Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:03:52.7587660Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:03:52.7588523Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:03:52.7589582Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:03:52.7590600Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:03:52.7591699Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local ... 2024-12-18T00:03:52.9583442Z 2024-12-18T00:03:52.9584914Z  2024-12-18T00:03:52.9585718Z  2024-12-18T00:03:52.9586940Z  2024-12-18T00:03:52.9587381Z  2024-12-18T00:03:52.9587816Z  2024-12-18T00:03:52.9588224Z  2024-12-18T00:03:52.9588668Z  2024-12-18T00:03:52.9589126Z  2024-12-18T00:03:52.9589730Z [9,865 / 15,187] 48 actions running 2024-12-18T00:03:52.9590705Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:03:52.9591939Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:03:52.9592971Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:03:52.9593789Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:03:52.9594586Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:03:52.9595670Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:03:52.9596615Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:03:52.9597597Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local ... 2024-12-18T00:03:53.3077604Z 2024-12-18T00:03:53.3078801Z  2024-12-18T00:03:53.3079305Z  2024-12-18T00:03:53.3079728Z  2024-12-18T00:03:53.3080125Z  2024-12-18T00:03:53.3080538Z  2024-12-18T00:03:53.3080980Z  2024-12-18T00:03:53.3081393Z  2024-12-18T00:03:53.3081809Z  2024-12-18T00:03:53.3082415Z [9,867 / 15,187] 48 actions, 47 running 2024-12-18T00:03:53.3083396Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:03:53.3084664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:03:53.3085618Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:03:53.3086384Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:03:53.3087232Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:03:53.3088191Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:03:53.3089140Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:03:53.3090090Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local ... 2024-12-18T00:03:53.5263435Z 2024-12-18T00:03:53.5264537Z  2024-12-18T00:03:53.5265301Z  2024-12-18T00:03:53.5265959Z  2024-12-18T00:03:53.5266914Z  2024-12-18T00:03:53.5267419Z  2024-12-18T00:03:53.5267800Z  2024-12-18T00:03:53.5268204Z  2024-12-18T00:03:53.5268628Z  2024-12-18T00:03:53.5269228Z [9,871 / 15,187] 48 actions, 47 running 2024-12-18T00:03:53.5270624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:03:53.5271866Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:03:53.5272937Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:03:53.5273752Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:03:53.5274812Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:03:53.5275965Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:03:53.5277054Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:03:53.5278042Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local ... 2024-12-18T00:03:53.7590055Z 2024-12-18T00:03:53.7591261Z  2024-12-18T00:03:53.7591725Z  2024-12-18T00:03:53.7592099Z  2024-12-18T00:03:53.7592504Z  2024-12-18T00:03:53.7592898Z  2024-12-18T00:03:53.7593312Z  2024-12-18T00:03:53.7593673Z  2024-12-18T00:03:53.7594047Z  2024-12-18T00:03:53.7594577Z [9,872 / 15,187] 48 actions running 2024-12-18T00:03:53.7595449Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:03:53.7596614Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:03:53.7597632Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:03:53.7598412Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:03:53.7599242Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:03:53.7600282Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:03:53.7601302Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:03:53.7602220Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local ... 2024-12-18T00:03:54.0271629Z 2024-12-18T00:03:54.0272893Z  2024-12-18T00:03:54.0273402Z  2024-12-18T00:03:54.0273814Z  2024-12-18T00:03:54.0274214Z  2024-12-18T00:03:54.0274623Z  2024-12-18T00:03:54.0275008Z  2024-12-18T00:03:54.0275406Z  2024-12-18T00:03:54.0275812Z  2024-12-18T00:03:54.0276440Z [9,874 / 15,187] 48 actions, 47 running 2024-12-18T00:03:54.0277433Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:03:54.0278665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:03:54.0279732Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:03:54.0280546Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:03:54.0281421Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:03:54.0282481Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:03:54.0283489Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:03:54.0284440Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local ... 2024-12-18T00:03:54.3342599Z 2024-12-18T00:03:54.3343483Z  2024-12-18T00:03:54.3344012Z  2024-12-18T00:03:54.3344667Z  2024-12-18T00:03:54.3345123Z  2024-12-18T00:03:54.3345523Z  2024-12-18T00:03:54.3345942Z  2024-12-18T00:03:54.3346325Z  2024-12-18T00:03:54.3346712Z  2024-12-18T00:03:54.3347831Z [9,875 / 15,187] 48 actions, 47 running 2024-12-18T00:03:54.3348926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:03:54.3350086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:03:54.3351137Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:03:54.3351900Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:03:54.3352677Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:03:54.3353685Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:03:54.3355051Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:03:54.3356008Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local ... 2024-12-18T00:03:54.6478898Z 2024-12-18T00:03:54.6479870Z  2024-12-18T00:03:54.6480367Z  2024-12-18T00:03:54.6480759Z  2024-12-18T00:03:54.6481151Z  2024-12-18T00:03:54.6481551Z  2024-12-18T00:03:54.6482469Z  2024-12-18T00:03:54.6482885Z  2024-12-18T00:03:54.6483292Z  2024-12-18T00:03:54.6483866Z [9,875 / 15,187] 48 actions running 2024-12-18T00:03:54.6484802Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:03:54.6485952Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:03:54.6487091Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:03:54.6487827Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:03:54.6488609Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:03:54.6489579Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:03:54.6490573Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:03:54.6491478Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local ... 2024-12-18T00:03:54.8483889Z 2024-12-18T00:03:54.8484775Z  2024-12-18T00:03:54.8485327Z  2024-12-18T00:03:54.8485711Z  2024-12-18T00:03:54.8486084Z  2024-12-18T00:03:54.8486477Z  2024-12-18T00:03:54.8486861Z  2024-12-18T00:03:54.8487236Z  2024-12-18T00:03:54.8487545Z  2024-12-18T00:03:54.8488082Z [9,878 / 15,187] 48 actions running 2024-12-18T00:03:54.8489045Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:03:54.8490098Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:03:54.8491073Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2024-12-18T00:03:54.8491744Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:03:54.8492465Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:03:54.8493539Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:03:54.8494459Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:03:54.8495358Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local ... 2024-12-18T00:03:55.2489100Z 2024-12-18T00:03:55.2489968Z  2024-12-18T00:03:55.2490428Z  2024-12-18T00:03:55.2490810Z  2024-12-18T00:03:55.2491199Z  2024-12-18T00:03:55.2491594Z  2024-12-18T00:03:55.2492003Z  2024-12-18T00:03:55.2492393Z  2024-12-18T00:03:55.2492786Z  2024-12-18T00:03:55.2493309Z [9,886 / 15,187] 48 actions running 2024-12-18T00:03:55.2494410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:03:55.2495496Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:03:55.2496638Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2024-12-18T00:03:55.2497445Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:03:55.2498234Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:03:55.2499275Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:03:55.2500272Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:03:55.2501253Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local ... 2024-12-18T00:03:55.4494154Z 2024-12-18T00:03:55.4495086Z  2024-12-18T00:03:55.4495585Z  2024-12-18T00:03:55.4495985Z  2024-12-18T00:03:55.4496387Z  2024-12-18T00:03:55.4496911Z  2024-12-18T00:03:55.4497314Z  2024-12-18T00:03:55.4497722Z  2024-12-18T00:03:55.4498136Z  2024-12-18T00:03:55.4498690Z [9,888 / 15,187] 48 actions running 2024-12-18T00:03:55.4499985Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:03:55.4501134Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:03:55.4502076Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:03:55.4502895Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:03:55.4503939Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:03:55.4504844Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:03:55.4505737Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:03:55.4506766Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local ... 2024-12-18T00:03:55.7810382Z 2024-12-18T00:03:55.7811321Z  2024-12-18T00:03:55.7811963Z  2024-12-18T00:03:55.7812373Z  2024-12-18T00:03:55.7812932Z  2024-12-18T00:03:55.7813467Z  2024-12-18T00:03:55.7813981Z  2024-12-18T00:03:55.7814676Z  2024-12-18T00:03:55.7815210Z  2024-12-18T00:03:55.7815920Z [9,891 / 15,187] 48 actions, 47 running 2024-12-18T00:03:55.7817113Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:03:55.7818377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:03:55.7819432Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:03:55.7820389Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:03:55.7821567Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:03:55.7822687Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:03:55.7823706Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:03:55.7824833Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local ... 2024-12-18T00:03:56.0500088Z 2024-12-18T00:03:56.0501039Z  2024-12-18T00:03:56.0501543Z  2024-12-18T00:03:56.0501986Z  2024-12-18T00:03:56.0502376Z  2024-12-18T00:03:56.0502797Z  2024-12-18T00:03:56.0503203Z  2024-12-18T00:03:56.0503593Z  2024-12-18T00:03:56.0504011Z  2024-12-18T00:03:56.0504521Z [9,892 / 15,187] 48 actions running 2024-12-18T00:03:56.0505530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:03:56.0506745Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:03:56.0507713Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:03:56.0508549Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:03:56.0509554Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:03:56.0510569Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:03:56.0511502Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:03:56.0512566Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local ... 2024-12-18T00:03:56.2505125Z 2024-12-18T00:03:56.2505992Z  2024-12-18T00:03:56.2506495Z  2024-12-18T00:03:56.2506905Z  2024-12-18T00:03:56.2507297Z  2024-12-18T00:03:56.2507668Z  2024-12-18T00:03:56.2508078Z  2024-12-18T00:03:56.2508457Z  2024-12-18T00:03:56.2508817Z  2024-12-18T00:03:56.2509403Z [9,895 / 15,187] 48 actions running 2024-12-18T00:03:56.2510306Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:03:56.2511365Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:03:56.2512297Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:03:56.2513036Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:03:56.2513989Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:03:56.2514931Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:03:56.2516191Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:03:56.2517167Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local ... 2024-12-18T00:03:56.5093173Z 2024-12-18T00:03:56.5094023Z  2024-12-18T00:03:56.5094623Z  2024-12-18T00:03:56.5095002Z  2024-12-18T00:03:56.5095382Z  2024-12-18T00:03:56.5095781Z  2024-12-18T00:03:56.5096632Z  2024-12-18T00:03:56.5097054Z  2024-12-18T00:03:56.5097435Z  2024-12-18T00:03:56.5098012Z [9,896 / 15,187] 48 actions, 47 running 2024-12-18T00:03:56.5098881Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:03:56.5099963Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:03:56.5100844Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:03:56.5101604Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:03:56.5102492Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:03:56.5103403Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:03:56.5104246Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:03:56.5105181Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local ... 2024-12-18T00:03:56.8514228Z 2024-12-18T00:03:56.8515093Z  2024-12-18T00:03:56.8515631Z  2024-12-18T00:03:56.8516039Z  2024-12-18T00:03:56.8516425Z  2024-12-18T00:03:56.8516842Z  2024-12-18T00:03:56.8517250Z  2024-12-18T00:03:56.8517648Z  2024-12-18T00:03:56.8518048Z  2024-12-18T00:03:56.8518623Z [9,898 / 15,187] 48 actions running 2024-12-18T00:03:56.8519558Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:03:56.8520617Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:03:56.8521497Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:03:56.8522267Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:03:56.8523253Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:03:56.8524185Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:03:56.8524987Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:03:56.8525995Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local ... 2024-12-18T00:03:57.0641435Z 2024-12-18T00:03:57.0642326Z  2024-12-18T00:03:57.0642815Z  2024-12-18T00:03:57.0643200Z  2024-12-18T00:03:57.0643596Z  2024-12-18T00:03:57.0643996Z  2024-12-18T00:03:57.0644612Z  2024-12-18T00:03:57.0645003Z  2024-12-18T00:03:57.0645415Z  2024-12-18T00:03:57.0646068Z [9,902 / 15,187] 48 actions, 47 running 2024-12-18T00:03:57.0647037Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:03:57.0648287Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:03:57.0649252Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:03:57.0650085Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:03:57.0651128Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:03:57.0652098Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:03:57.0652998Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:03:57.0654052Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local ... 2024-12-18T00:03:57.4519593Z 2024-12-18T00:03:57.4520456Z  2024-12-18T00:03:57.4520937Z  2024-12-18T00:03:57.4521373Z  2024-12-18T00:03:57.4521745Z  2024-12-18T00:03:57.4522180Z  2024-12-18T00:03:57.4522606Z  2024-12-18T00:03:57.4522999Z  2024-12-18T00:03:57.4523359Z  2024-12-18T00:03:57.4523872Z [9,903 / 15,187] 48 actions running 2024-12-18T00:03:57.4525400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:03:57.4526538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:03:57.4527457Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:03:57.4528282Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:03:57.4529596Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:03:57.4530623Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:03:57.4531513Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:03:57.4532526Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local ... 2024-12-18T00:03:57.8604146Z 2024-12-18T00:03:57.8605030Z  2024-12-18T00:03:57.8605469Z  2024-12-18T00:03:57.8605859Z  2024-12-18T00:03:57.8606237Z  2024-12-18T00:03:57.8606634Z  2024-12-18T00:03:57.8607034Z  2024-12-18T00:03:57.8607454Z  2024-12-18T00:03:57.8607858Z  2024-12-18T00:03:57.8608462Z [9,904 / 15,187] 48 actions, 47 running 2024-12-18T00:03:57.8609371Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:03:57.8610490Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:03:57.8611464Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:03:57.8612287Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:03:57.8613287Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:03:57.8614226Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:03:57.8614994Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:03:57.8616135Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local ... 2024-12-18T00:03:58.1569298Z 2024-12-18T00:03:58.1570097Z  2024-12-18T00:03:58.1570601Z  2024-12-18T00:03:58.1570985Z  2024-12-18T00:03:58.1571400Z  2024-12-18T00:03:58.1571818Z  2024-12-18T00:03:58.1572220Z  2024-12-18T00:03:58.1572619Z  2024-12-18T00:03:58.1573007Z  2024-12-18T00:03:58.1573572Z [9,905 / 15,187] 48 actions, 47 running 2024-12-18T00:03:58.1574539Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:03:58.1575692Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:03:58.1576781Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:03:58.1577567Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:03:58.1578600Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:03:58.1579597Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:03:58.1580514Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:03:58.1581531Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local ... 2024-12-18T00:03:58.4527934Z 2024-12-18T00:03:58.4528781Z  2024-12-18T00:03:58.4529250Z  2024-12-18T00:03:58.4529663Z  2024-12-18T00:03:58.4530085Z  2024-12-18T00:03:58.4530496Z  2024-12-18T00:03:58.4530897Z  2024-12-18T00:03:58.4531287Z  2024-12-18T00:03:58.4531675Z  2024-12-18T00:03:58.4532300Z [9,907 / 15,187] 48 actions running 2024-12-18T00:03:58.4533195Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:03:58.4534305Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:03:58.4535144Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:03:58.4535926Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:03:58.4537083Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:03:58.4538079Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:03:58.4539358Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:03:58.4540287Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local ... 2024-12-18T00:03:58.6532101Z 2024-12-18T00:03:58.6533019Z  2024-12-18T00:03:58.6533511Z  2024-12-18T00:03:58.6533895Z  2024-12-18T00:03:58.6534287Z  2024-12-18T00:03:58.6535025Z  2024-12-18T00:03:58.6535455Z  2024-12-18T00:03:58.6535848Z  2024-12-18T00:03:58.6536363Z  2024-12-18T00:03:58.6537054Z [9,909 / 15,187] 48 actions running 2024-12-18T00:03:58.6537955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:03:58.6539048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:03:58.6539774Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:03:58.6540530Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:03:58.6541565Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:03:58.6542501Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:03:58.6543317Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:03:58.6548373Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local ... 2024-12-18T00:03:58.9389182Z 2024-12-18T00:03:58.9390137Z  2024-12-18T00:03:58.9390738Z  2024-12-18T00:03:58.9391105Z  2024-12-18T00:03:58.9391474Z  2024-12-18T00:03:58.9391848Z  2024-12-18T00:03:58.9392238Z  2024-12-18T00:03:58.9392618Z  2024-12-18T00:03:58.9393004Z  2024-12-18T00:03:58.9393573Z [9,911 / 15,187] 48 actions, 47 running 2024-12-18T00:03:58.9394501Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:03:58.9395606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:03:58.9396490Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:03:58.9397280Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:03:58.9398291Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:03:58.9399247Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:03:58.9400099Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:03:58.9401027Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local ... 2024-12-18T00:03:59.1802114Z 2024-12-18T00:03:59.1802973Z  2024-12-18T00:03:59.1803600Z  2024-12-18T00:03:59.1803990Z  2024-12-18T00:03:59.1804374Z  2024-12-18T00:03:59.1804777Z  2024-12-18T00:03:59.1805172Z  2024-12-18T00:03:59.1805540Z  2024-12-18T00:03:59.1805903Z  2024-12-18T00:03:59.1806467Z [9,914 / 15,187] 48 actions, 47 running 2024-12-18T00:03:59.1807401Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:03:59.1808577Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:03:59.1809499Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:03:59.1810302Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:03:59.1811091Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:03:59.1811970Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:03:59.1812847Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:03:59.1813788Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local ... 2024-12-18T00:03:59.4543602Z 2024-12-18T00:03:59.4544693Z  2024-12-18T00:03:59.4545173Z  2024-12-18T00:03:59.4545583Z  2024-12-18T00:03:59.4546000Z  2024-12-18T00:03:59.4546409Z  2024-12-18T00:03:59.4546798Z  2024-12-18T00:03:59.4547187Z  2024-12-18T00:03:59.4547584Z  2024-12-18T00:03:59.4548586Z [9,914 / 15,187] 48 actions running 2024-12-18T00:03:59.4549672Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:03:59.4550782Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:03:59.4551667Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:03:59.4552634Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:03:59.4553633Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:03:59.4554614Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:03:59.4555489Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:03:59.4556455Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local ... 2024-12-18T00:03:59.6548934Z 2024-12-18T00:03:59.6549826Z  2024-12-18T00:03:59.6550302Z  2024-12-18T00:03:59.6550658Z  2024-12-18T00:03:59.6551013Z  2024-12-18T00:03:59.6551474Z  2024-12-18T00:03:59.6551874Z  2024-12-18T00:03:59.6552278Z  2024-12-18T00:03:59.6552689Z  2024-12-18T00:03:59.6553268Z [9,916 / 15,187] 48 actions running 2024-12-18T00:03:59.6554201Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:03:59.6555361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:03:59.6556335Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:03:59.6557155Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:03:59.6558187Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:03:59.6559189Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:03:59.6560069Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:03:59.6561076Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local ... 2024-12-18T00:03:59.8875786Z 2024-12-18T00:03:59.8876664Z  2024-12-18T00:03:59.8877078Z  2024-12-18T00:03:59.8877442Z  2024-12-18T00:03:59.8877800Z  2024-12-18T00:03:59.8878150Z  2024-12-18T00:03:59.8878510Z  2024-12-18T00:03:59.8878840Z  2024-12-18T00:03:59.8879197Z  2024-12-18T00:03:59.8879745Z [9,918 / 15,187] 48 actions, 47 running 2024-12-18T00:03:59.8880592Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:03:59.8881592Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:03:59.8882386Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:03:59.8883102Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:03:59.8883992Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:03:59.8884862Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:03:59.8885629Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:03:59.8886517Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local ... 2024-12-18T00:04:00.1787991Z 2024-12-18T00:04:00.1788777Z  2024-12-18T00:04:00.1789155Z  2024-12-18T00:04:00.1789448Z  2024-12-18T00:04:00.1789751Z  2024-12-18T00:04:00.1790100Z  2024-12-18T00:04:00.1790466Z  2024-12-18T00:04:00.1790833Z  2024-12-18T00:04:00.1791236Z  2024-12-18T00:04:00.1791801Z [9,921 / 15,187] 48 actions, 47 running 2024-12-18T00:04:00.1792663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:04:00.1793713Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:04:00.1794550Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:04:00.1795290Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:04:00.1796217Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:04:00.1797536Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:04:00.1798252Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:04:00.1799087Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local ... 2024-12-18T00:04:00.3829925Z 2024-12-18T00:04:00.3830814Z  2024-12-18T00:04:00.3831223Z  2024-12-18T00:04:00.3831585Z  2024-12-18T00:04:00.3832315Z  2024-12-18T00:04:00.3832650Z  2024-12-18T00:04:00.3832942Z  2024-12-18T00:04:00.3833217Z  2024-12-18T00:04:00.3833506Z  2024-12-18T00:04:00.3834020Z [9,923 / 15,187] 48 actions, 47 running 2024-12-18T00:04:00.3834714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:04:00.3835716Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:04:00.3836517Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:04:00.3837259Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:04:00.3838239Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:04:00.3839164Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:04:00.3839971Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:04:00.3840922Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local ... 2024-12-18T00:04:00.6557765Z 2024-12-18T00:04:00.6558622Z  2024-12-18T00:04:00.6559109Z  2024-12-18T00:04:00.6559496Z  2024-12-18T00:04:00.6559906Z  2024-12-18T00:04:00.6560273Z  2024-12-18T00:04:00.6560661Z  2024-12-18T00:04:00.6561056Z  2024-12-18T00:04:00.6561410Z  2024-12-18T00:04:00.6561991Z [9,926 / 15,187] 48 actions, 47 running 2024-12-18T00:04:00.6562853Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:04:00.6563932Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:04:00.6564849Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:04:00.6565597Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:04:00.6566587Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:04:00.6567506Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:04:00.6568370Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:04:00.6569307Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local ... 2024-12-18T00:04:00.8563180Z 2024-12-18T00:04:00.8564039Z  2024-12-18T00:04:00.8564450Z  2024-12-18T00:04:00.8564812Z  2024-12-18T00:04:00.8565224Z  2024-12-18T00:04:00.8565591Z  2024-12-18T00:04:00.8566095Z  2024-12-18T00:04:00.8566454Z  2024-12-18T00:04:00.8566841Z  2024-12-18T00:04:00.8567360Z [9,926 / 15,187] 48 actions running 2024-12-18T00:04:00.8568231Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:04:00.8569341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:04:00.8570177Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:04:00.8570931Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:04:00.8571941Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:04:00.8572879Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:04:00.8573739Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:04:00.8574707Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local ... 2024-12-18T00:04:01.2563036Z 2024-12-18T00:04:01.2563878Z  2024-12-18T00:04:01.2564367Z  2024-12-18T00:04:01.2564771Z  2024-12-18T00:04:01.2565188Z  2024-12-18T00:04:01.2565576Z  2024-12-18T00:04:01.2565968Z  2024-12-18T00:04:01.2566352Z  2024-12-18T00:04:01.2567145Z  2024-12-18T00:04:01.2567655Z [9,927 / 15,187] 48 actions running 2024-12-18T00:04:01.2568488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:04:01.2569524Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:04:01.2570413Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:04:01.2571399Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:04:01.2572376Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:04:01.2573331Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:04:01.2574178Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:04:01.2575104Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 32s local ... 2024-12-18T00:04:01.4568545Z 2024-12-18T00:04:01.4569426Z  2024-12-18T00:04:01.4569898Z  2024-12-18T00:04:01.4570285Z  2024-12-18T00:04:01.4570693Z  2024-12-18T00:04:01.4571063Z  2024-12-18T00:04:01.4571425Z  2024-12-18T00:04:01.4571765Z  2024-12-18T00:04:01.4572091Z  2024-12-18T00:04:01.4572628Z [9,928 / 15,187] 48 actions running 2024-12-18T00:04:01.4573466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:04:01.4574560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:04:01.4575368Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:04:01.4576091Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:04:01.4577213Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:04:01.4578146Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:04:01.4579011Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:04:01.4579965Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 32s local ... 2024-12-18T00:04:01.6825212Z 2024-12-18T00:04:01.6826037Z  2024-12-18T00:04:01.6826467Z  2024-12-18T00:04:01.6826806Z  2024-12-18T00:04:01.6827169Z  2024-12-18T00:04:01.6827559Z  2024-12-18T00:04:01.6827944Z  2024-12-18T00:04:01.6828336Z  2024-12-18T00:04:01.6828694Z  2024-12-18T00:04:01.6829257Z [9,930 / 15,187] 48 actions, 47 running 2024-12-18T00:04:01.6830136Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:04:01.6831187Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:04:01.6832026Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:04:01.6832786Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:04:01.6833730Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:04:01.6834633Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:04:01.6835438Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:04:01.6836420Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 32s local ... 2024-12-18T00:04:02.0575060Z 2024-12-18T00:04:02.0575917Z  2024-12-18T00:04:02.0576402Z  2024-12-18T00:04:02.0576955Z  2024-12-18T00:04:02.0577340Z  2024-12-18T00:04:02.0577745Z  2024-12-18T00:04:02.0578140Z  2024-12-18T00:04:02.0578571Z  2024-12-18T00:04:02.0578917Z  2024-12-18T00:04:02.0579474Z [9,932 / 15,187] 48 actions running 2024-12-18T00:04:02.0580291Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:04:02.0581358Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:04:02.0582256Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:04:02.0583053Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:04:02.0584041Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:04:02.0585403Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:04:02.0586268Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:04:02.0587238Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 32s local ... 2024-12-18T00:04:02.2885990Z 2024-12-18T00:04:02.2886863Z  2024-12-18T00:04:02.2887263Z  2024-12-18T00:04:02.2887981Z  2024-12-18T00:04:02.2888322Z  2024-12-18T00:04:02.2888643Z  2024-12-18T00:04:02.2888965Z  2024-12-18T00:04:02.2889281Z  2024-12-18T00:04:02.2889582Z  2024-12-18T00:04:02.2890066Z [9,936 / 15,187] 48 actions, 47 running 2024-12-18T00:04:02.2890806Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:04:02.2891791Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:04:02.2892682Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:04:02.2893355Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:04:02.2894388Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:04:02.2895278Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:04:02.2896061Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:04:02.2897098Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local ... 2024-12-18T00:04:02.6399253Z 2024-12-18T00:04:02.6400108Z  2024-12-18T00:04:02.6400550Z  2024-12-18T00:04:02.6400931Z  2024-12-18T00:04:02.6401298Z  2024-12-18T00:04:02.6401684Z  2024-12-18T00:04:02.6402203Z  2024-12-18T00:04:02.6402570Z  2024-12-18T00:04:02.6402929Z  2024-12-18T00:04:02.6403465Z [9,940 / 15,187] 48 actions, 47 running 2024-12-18T00:04:02.6404295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:04:02.6405316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:04:02.6406156Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:04:02.6406904Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:04:02.6407812Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:04:02.6408727Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:04:02.6409539Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:04:02.6410361Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local ... 2024-12-18T00:04:02.8582846Z 2024-12-18T00:04:02.8583749Z  2024-12-18T00:04:02.8584235Z  2024-12-18T00:04:02.8584612Z  2024-12-18T00:04:02.8585003Z  2024-12-18T00:04:02.8585375Z  2024-12-18T00:04:02.8585766Z  2024-12-18T00:04:02.8586123Z  2024-12-18T00:04:02.8586485Z  2024-12-18T00:04:02.8587033Z [9,942 / 15,187] 48 actions running 2024-12-18T00:04:02.8587924Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:04:02.8589060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:04:02.8589912Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:04:02.8590699Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:04:02.8591698Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:04:02.8592619Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:04:02.8593450Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:04:02.8594337Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local ... 2024-12-18T00:04:03.0588211Z 2024-12-18T00:04:03.0589099Z  2024-12-18T00:04:03.0589546Z  2024-12-18T00:04:03.0589937Z  2024-12-18T00:04:03.0590312Z  2024-12-18T00:04:03.0590678Z  2024-12-18T00:04:03.0591027Z  2024-12-18T00:04:03.0591404Z  2024-12-18T00:04:03.0592209Z  2024-12-18T00:04:03.0592724Z [9,943 / 15,187] 48 actions running 2024-12-18T00:04:03.0593597Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:04:03.0594628Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:04:03.0595511Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:04:03.0596571Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:04:03.0597534Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:04:03.0598445Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:04:03.0599279Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:04:03.0600134Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local ... 2024-12-18T00:04:03.2685397Z 2024-12-18T00:04:03.2686328Z  2024-12-18T00:04:03.2686812Z  2024-12-18T00:04:03.2687186Z  2024-12-18T00:04:03.2687646Z  2024-12-18T00:04:03.2688027Z  2024-12-18T00:04:03.2688400Z  2024-12-18T00:04:03.2688768Z  2024-12-18T00:04:03.2689167Z  2024-12-18T00:04:03.2689746Z [9,944 / 15,187] 48 actions, 47 running 2024-12-18T00:04:03.2690620Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:04:03.2691713Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:04:03.2692621Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:04:03.2693423Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:04:03.2694379Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:04:03.2695311Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:04:03.2696127Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:04:03.2697176Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local ... 2024-12-18T00:04:03.6155525Z 2024-12-18T00:04:03.6156371Z  2024-12-18T00:04:03.6156825Z  2024-12-18T00:04:03.6157205Z  2024-12-18T00:04:03.6157589Z  2024-12-18T00:04:03.6157948Z  2024-12-18T00:04:03.6158351Z  2024-12-18T00:04:03.6158715Z  2024-12-18T00:04:03.6159098Z  2024-12-18T00:04:03.6159657Z [9,946 / 15,187] 48 actions, 47 running 2024-12-18T00:04:03.6160534Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:04:03.6161542Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:04:03.6162399Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:04:03.6163145Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:04:03.6164141Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:04:03.6165066Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:04:03.6165932Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:04:03.6166862Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 24s local ... 2024-12-18T00:04:03.8594851Z 2024-12-18T00:04:03.8595714Z  2024-12-18T00:04:03.8596149Z  2024-12-18T00:04:03.8596520Z  2024-12-18T00:04:03.8596907Z  2024-12-18T00:04:03.8597271Z  2024-12-18T00:04:03.8597606Z  2024-12-18T00:04:03.8597976Z  2024-12-18T00:04:03.8598404Z  2024-12-18T00:04:03.8598930Z [9,947 / 15,187] 48 actions running 2024-12-18T00:04:03.8608937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:04:03.8610067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:04:03.8610862Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:04:03.8611565Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:04:03.8612463Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:04:03.8613723Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:04:03.8614515Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:04:03.8615341Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local ... 2024-12-18T00:04:04.2600780Z 2024-12-18T00:04:04.2601624Z  2024-12-18T00:04:04.2602003Z  2024-12-18T00:04:04.2602331Z  2024-12-18T00:04:04.2603006Z  2024-12-18T00:04:04.2603343Z  2024-12-18T00:04:04.2603652Z  2024-12-18T00:04:04.2603969Z  2024-12-18T00:04:04.2604289Z  2024-12-18T00:04:04.2604743Z [9,948 / 15,187] 48 actions running 2024-12-18T00:04:04.2605479Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:04:04.2606339Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:04:04.2607053Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:04:04.2607669Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:04:04.2608481Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:04:04.2609223Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:04:04.2609900Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:04:04.2610636Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2024-12-18T00:04:04.4605580Z 2024-12-18T00:04:04.4606426Z  2024-12-18T00:04:04.4606893Z  2024-12-18T00:04:04.4607288Z  2024-12-18T00:04:04.4607665Z  2024-12-18T00:04:04.4608008Z  2024-12-18T00:04:04.4608370Z  2024-12-18T00:04:04.4608739Z  2024-12-18T00:04:04.4609102Z  2024-12-18T00:04:04.4609664Z [9,950 / 15,187] 48 actions running 2024-12-18T00:04:04.4610538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:04:04.4611648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:04:04.4612571Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:04:04.4613352Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:04:04.4614333Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:04:04.4615250Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:04:04.4616244Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:04:04.4617425Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2024-12-18T00:04:04.7529009Z 2024-12-18T00:04:04.7529862Z  2024-12-18T00:04:04.7530299Z  2024-12-18T00:04:04.7530649Z  2024-12-18T00:04:04.7530978Z  2024-12-18T00:04:04.7531306Z  2024-12-18T00:04:04.7531620Z  2024-12-18T00:04:04.7531941Z  2024-12-18T00:04:04.7532254Z  2024-12-18T00:04:04.7532734Z [9,952 / 15,187] 48 actions, 47 running 2024-12-18T00:04:04.7533546Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:04:04.7534581Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:04:04.7535344Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:04:04.7535979Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:04:04.7536971Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:04:04.7537748Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:04:04.7538637Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:04:04.7539544Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2024-12-18T00:04:05.0611925Z 2024-12-18T00:04:05.0612839Z  2024-12-18T00:04:05.0613332Z  2024-12-18T00:04:05.0613709Z  2024-12-18T00:04:05.0614081Z  2024-12-18T00:04:05.0614458Z  2024-12-18T00:04:05.0614842Z  2024-12-18T00:04:05.0615207Z  2024-12-18T00:04:05.0615952Z  2024-12-18T00:04:05.0616646Z [9,953 / 15,187] 48 actions running 2024-12-18T00:04:05.0617600Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:04:05.0618755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:04:05.0619683Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:04:05.0620752Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:04:05.0621836Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:04:05.0622847Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:04:05.0623912Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:04:05.0624865Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2024-12-18T00:04:05.2617053Z 2024-12-18T00:04:05.2617891Z  2024-12-18T00:04:05.2618383Z  2024-12-18T00:04:05.2618809Z  2024-12-18T00:04:05.2619244Z  2024-12-18T00:04:05.2619652Z  2024-12-18T00:04:05.2620019Z  2024-12-18T00:04:05.2620387Z  2024-12-18T00:04:05.2620776Z  2024-12-18T00:04:05.2621336Z [9,955 / 15,187] 48 actions running 2024-12-18T00:04:05.2622298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:04:05.2623462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:04:05.2624395Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:04:05.2625177Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:04:05.2626366Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:04:05.2627346Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:04:05.2628212Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:04:05.2629204Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local ... 2024-12-18T00:04:05.8092622Z 2024-12-18T00:04:05.8093489Z  2024-12-18T00:04:05.8093981Z  2024-12-18T00:04:05.8094385Z  2024-12-18T00:04:05.8094822Z  2024-12-18T00:04:05.8095234Z  2024-12-18T00:04:05.8095610Z  2024-12-18T00:04:05.8096006Z  2024-12-18T00:04:05.8096380Z  2024-12-18T00:04:05.8097103Z [9,956 / 15,187] 48 actions, 47 running 2024-12-18T00:04:05.8098055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:04:05.8099214Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:04:05.8100175Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:04:05.8100952Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:04:05.8101949Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:04:05.8102912Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:04:05.8103813Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:04:05.8104804Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local ... 2024-12-18T00:04:06.0156467Z 2024-12-18T00:04:06.0157336Z  2024-12-18T00:04:06.0157789Z  2024-12-18T00:04:06.0158178Z  2024-12-18T00:04:06.0158550Z  2024-12-18T00:04:06.0158943Z  2024-12-18T00:04:06.0159326Z  2024-12-18T00:04:06.0159707Z  2024-12-18T00:04:06.0160132Z  2024-12-18T00:04:06.0160716Z [9,959 / 15,187] 48 actions, 47 running 2024-12-18T00:04:06.0161640Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:04:06.0162778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:04:06.0163701Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:04:06.0164492Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:04:06.0165475Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:04:06.0166899Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:04:06.0167800Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:04:06.0168697Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local ... 2024-12-18T00:04:06.2626634Z 2024-12-18T00:04:06.2627499Z  2024-12-18T00:04:06.2627961Z  2024-12-18T00:04:06.2628337Z  2024-12-18T00:04:06.2629062Z  2024-12-18T00:04:06.2629460Z  2024-12-18T00:04:06.2629834Z  2024-12-18T00:04:06.2630209Z  2024-12-18T00:04:06.2630580Z  2024-12-18T00:04:06.2631117Z [9,961 / 15,187] 48 actions running 2024-12-18T00:04:06.2631970Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:04:06.2633005Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:04:06.2633872Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:04:06.2634650Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:04:06.2635454Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:04:06.2636255Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:04:06.2637110Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:04:06.2637991Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 11s local ... 2024-12-18T00:04:06.6547305Z 2024-12-18T00:04:06.6548181Z  2024-12-18T00:04:06.6548623Z  2024-12-18T00:04:06.6548973Z  2024-12-18T00:04:06.6549332Z  2024-12-18T00:04:06.6549701Z  2024-12-18T00:04:06.6550050Z  2024-12-18T00:04:06.6550437Z  2024-12-18T00:04:06.6550783Z  2024-12-18T00:04:06.6551337Z [9,963 / 15,187] 48 actions, 47 running 2024-12-18T00:04:06.6552192Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:04:06.6553227Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:04:06.6554119Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:04:06.6554841Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:04:06.6555619Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:04:06.6556437Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:04:06.6557285Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:04:06.6558100Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 11s local ... 2024-12-18T00:04:06.8632315Z 2024-12-18T00:04:06.8633192Z  2024-12-18T00:04:06.8633662Z  2024-12-18T00:04:06.8634042Z  2024-12-18T00:04:06.8634441Z  2024-12-18T00:04:06.8634794Z  2024-12-18T00:04:06.8635165Z  2024-12-18T00:04:06.8635533Z  2024-12-18T00:04:06.8635913Z  2024-12-18T00:04:06.8636463Z [9,963 / 15,187] 48 actions running 2024-12-18T00:04:06.8637330Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:04:06.8638572Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:04:06.8639457Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:04:06.8640226Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:04:06.8641007Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:04:06.8641825Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:04:06.8642706Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:04:06.8643617Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local ... 2024-12-18T00:04:07.0637659Z 2024-12-18T00:04:07.0638490Z  2024-12-18T00:04:07.0638974Z  2024-12-18T00:04:07.0639373Z  2024-12-18T00:04:07.0639784Z  2024-12-18T00:04:07.0640182Z  2024-12-18T00:04:07.0640582Z  2024-12-18T00:04:07.0640979Z  2024-12-18T00:04:07.0641353Z  2024-12-18T00:04:07.0642327Z [9,964 / 15,187] 48 actions running 2024-12-18T00:04:07.0643261Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:04:07.0644645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:04:07.0645594Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:04:07.0646584Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:04:07.0647516Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:04:07.0648484Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:04:07.0649426Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local 2024-12-18T00:04:07.0650282Z @llvm-project//llvm:llvm-tblgen; 12s local ... 2024-12-18T00:04:07.2924190Z 2024-12-18T00:04:07.2925049Z  2024-12-18T00:04:07.2925485Z  2024-12-18T00:04:07.2925863Z  2024-12-18T00:04:07.2926242Z  2024-12-18T00:04:07.2926670Z  2024-12-18T00:04:07.2927135Z  2024-12-18T00:04:07.2927559Z  2024-12-18T00:04:07.2927920Z  2024-12-18T00:04:07.2928524Z [9,967 / 15,187] 48 actions, 47 running 2024-12-18T00:04:07.2929436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:04:07.2930497Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:04:07.2931324Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:04:07.2932000Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:04:07.2933074Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:04:07.2933982Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:04:07.2934829Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local 2024-12-18T00:04:07.2935678Z @llvm-project//llvm:llvm-tblgen; 12s local ... 2024-12-18T00:04:07.6543278Z 2024-12-18T00:04:07.6544107Z  2024-12-18T00:04:07.6544787Z  2024-12-18T00:04:07.6545187Z  2024-12-18T00:04:07.6545525Z  2024-12-18T00:04:07.6545845Z  2024-12-18T00:04:07.6546181Z  2024-12-18T00:04:07.6546514Z  2024-12-18T00:04:07.6546857Z  2024-12-18T00:04:07.6547360Z [9,971 / 15,187] 48 actions, 47 running 2024-12-18T00:04:07.6548077Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:04:07.6549127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:04:07.6549822Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:04:07.6550433Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:04:07.6551112Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:04:07.6551878Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:04:07.6552607Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local 2024-12-18T00:04:07.6553439Z @llvm-project//llvm:llvm-tblgen; 12s local ... 2024-12-18T00:04:07.8645500Z 2024-12-18T00:04:07.8646325Z  2024-12-18T00:04:07.8646805Z  2024-12-18T00:04:07.8647170Z  2024-12-18T00:04:07.8647533Z  2024-12-18T00:04:07.8647902Z  2024-12-18T00:04:07.8648307Z  2024-12-18T00:04:07.8648696Z  2024-12-18T00:04:07.8649078Z  2024-12-18T00:04:07.8649617Z [9,973 / 15,187] 48 actions running 2024-12-18T00:04:07.8650577Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:04:07.8651710Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:04:07.8652606Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:04:07.8653364Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:04:07.8654201Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:04:07.8655107Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:04:07.8655984Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local 2024-12-18T00:04:07.8657247Z @llvm-project//llvm:llvm-tblgen; 12s local ... 2024-12-18T00:04:08.0720188Z 2024-12-18T00:04:08.0721086Z  2024-12-18T00:04:08.0721565Z  2024-12-18T00:04:08.0721929Z  2024-12-18T00:04:08.0722373Z  2024-12-18T00:04:08.0722799Z  2024-12-18T00:04:08.0723202Z  2024-12-18T00:04:08.0723598Z  2024-12-18T00:04:08.0724340Z  2024-12-18T00:04:08.0724973Z [9,975 / 15,187] 48 actions, 47 running 2024-12-18T00:04:08.0725997Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:04:08.0727168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:04:08.0728091Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:04:08.0728855Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:04:08.0729788Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:04:08.0730760Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:04:08.0731643Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local 2024-12-18T00:04:08.0732532Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2024-12-18T00:04:08.3004602Z 2024-12-18T00:04:08.3005477Z  2024-12-18T00:04:08.3005969Z  2024-12-18T00:04:08.3006373Z  2024-12-18T00:04:08.3006789Z  2024-12-18T00:04:08.3007177Z  2024-12-18T00:04:08.3007546Z  2024-12-18T00:04:08.3007939Z  2024-12-18T00:04:08.3008337Z  2024-12-18T00:04:08.3008932Z [9,978 / 15,187] 48 actions, 47 running 2024-12-18T00:04:08.3009859Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:04:08.3011005Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:04:08.3011942Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:04:08.3012698Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:04:08.3013604Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:04:08.3014666Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:04:08.3015558Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local 2024-12-18T00:04:08.3016367Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2024-12-18T00:04:08.5695472Z 2024-12-18T00:04:08.5696380Z  2024-12-18T00:04:08.5697052Z  2024-12-18T00:04:08.5697454Z  2024-12-18T00:04:08.5697821Z  2024-12-18T00:04:08.5698210Z  2024-12-18T00:04:08.5698608Z  2024-12-18T00:04:08.5698997Z  2024-12-18T00:04:08.5699396Z  2024-12-18T00:04:08.5699976Z [9,983 / 15,187] 48 actions, 47 running 2024-12-18T00:04:08.5700916Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:04:08.5702051Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:04:08.5702995Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:04:08.5703753Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:04:08.5704607Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:04:08.5705544Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:04:08.5706412Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local 2024-12-18T00:04:08.5707207Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2024-12-18T00:04:08.8654447Z 2024-12-18T00:04:08.8655307Z  2024-12-18T00:04:08.8655772Z  2024-12-18T00:04:08.8656172Z  2024-12-18T00:04:08.8656701Z  2024-12-18T00:04:08.8657083Z  2024-12-18T00:04:08.8657476Z  2024-12-18T00:04:08.8657874Z  2024-12-18T00:04:08.8658252Z  2024-12-18T00:04:08.8658783Z [9,984 / 15,187] 48 actions running 2024-12-18T00:04:08.8659706Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:04:08.8661209Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:04:08.8662121Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:04:08.8662860Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:04:08.8663737Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:04:08.8664860Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:04:08.8665881Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local 2024-12-18T00:04:08.8666865Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local ... 2024-12-18T00:04:09.2255010Z 2024-12-18T00:04:09.2255960Z  2024-12-18T00:04:09.2256554Z  2024-12-18T00:04:09.2256974Z  2024-12-18T00:04:09.2257376Z  2024-12-18T00:04:09.2257802Z  2024-12-18T00:04:09.2258195Z  2024-12-18T00:04:09.2258560Z  2024-12-18T00:04:09.2258963Z  2024-12-18T00:04:09.2259547Z [9,989 / 15,187] 48 actions, 47 running 2024-12-18T00:04:09.2260494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:04:09.2261693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:04:09.2262640Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:04:09.2263392Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:04:09.2264323Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:04:09.2265233Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:04:09.2266134Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local 2024-12-18T00:04:09.2267140Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local ... 2024-12-18T00:04:09.4658850Z 2024-12-18T00:04:09.4659839Z  2024-12-18T00:04:09.4660331Z  2024-12-18T00:04:09.4660714Z  2024-12-18T00:04:09.4661104Z  2024-12-18T00:04:09.4661528Z  2024-12-18T00:04:09.4661940Z  2024-12-18T00:04:09.4662320Z  2024-12-18T00:04:09.4662711Z  2024-12-18T00:04:09.4663260Z [9,990 / 15,187] 48 actions running 2024-12-18T00:04:09.4664151Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:04:09.4665313Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:04:09.4666294Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:04:09.4667042Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:04:09.4667818Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:04:09.4668706Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:04:09.4669527Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local 2024-12-18T00:04:09.4670508Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local ... 2024-12-18T00:04:09.6663599Z 2024-12-18T00:04:09.6664581Z  2024-12-18T00:04:09.6665059Z  2024-12-18T00:04:09.6665499Z  2024-12-18T00:04:09.6665897Z  2024-12-18T00:04:09.6666294Z  2024-12-18T00:04:09.6666677Z  2024-12-18T00:04:09.6667064Z  2024-12-18T00:04:09.6667469Z  2024-12-18T00:04:09.6668006Z [9,991 / 15,187] 48 actions running 2024-12-18T00:04:09.6668939Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:04:09.6670092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:04:09.6671029Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:04:09.6671873Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:04:09.6672613Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:04:09.6673513Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:04:09.6674397Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2024-12-18T00:04:09.6675403Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local ... 2024-12-18T00:04:09.9403861Z 2024-12-18T00:04:09.9405087Z  2024-12-18T00:04:09.9405582Z  2024-12-18T00:04:09.9405989Z  2024-12-18T00:04:09.9406389Z  2024-12-18T00:04:09.9406774Z  2024-12-18T00:04:09.9407177Z  2024-12-18T00:04:09.9407569Z  2024-12-18T00:04:09.9407958Z  2024-12-18T00:04:09.9408960Z [9,994 / 15,187] 48 actions, 47 running 2024-12-18T00:04:09.9409970Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:04:09.9411123Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:04:09.9412024Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:04:09.9412735Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:04:09.9413596Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:04:09.9414506Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:04:09.9415380Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2024-12-18T00:04:09.9416361Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local ... 2024-12-18T00:04:10.2669090Z 2024-12-18T00:04:10.2670067Z  2024-12-18T00:04:10.2670548Z  2024-12-18T00:04:10.2670953Z  2024-12-18T00:04:10.2671370Z  2024-12-18T00:04:10.2671748Z  2024-12-18T00:04:10.2672160Z  2024-12-18T00:04:10.2672531Z  2024-12-18T00:04:10.2672929Z  2024-12-18T00:04:10.2673470Z [9,996 / 15,187] 48 actions running 2024-12-18T00:04:10.2674302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:04:10.2675411Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:04:10.2676276Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:04:10.2676996Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:04:10.2677838Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:04:10.2678808Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:04:10.2679547Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2024-12-18T00:04:10.2680565Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 14s local ... 2024-12-18T00:04:10.4673940Z 2024-12-18T00:04:10.4674853Z  2024-12-18T00:04:10.4675383Z  2024-12-18T00:04:10.4675781Z  2024-12-18T00:04:10.4676167Z  2024-12-18T00:04:10.4676547Z  2024-12-18T00:04:10.4676899Z  2024-12-18T00:04:10.4677310Z  2024-12-18T00:04:10.4677681Z  2024-12-18T00:04:10.4678193Z [9,999 / 15,187] 48 actions running 2024-12-18T00:04:10.4679076Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:04:10.4680147Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:04:10.4681016Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:04:10.4681755Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:04:10.4682632Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:04:10.4683612Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:04:10.4684499Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2024-12-18T00:04:10.4685576Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 14s local ... 2024-12-18T00:04:10.7474831Z 2024-12-18T00:04:10.7475775Z  2024-12-18T00:04:10.7476219Z  2024-12-18T00:04:10.7476561Z  2024-12-18T00:04:10.7476920Z  2024-12-18T00:04:10.7477267Z  2024-12-18T00:04:10.7477619Z  2024-12-18T00:04:10.7477951Z  2024-12-18T00:04:10.7478306Z  2024-12-18T00:04:10.7478841Z [10,003 / 15,187] 48 actions, 47 running 2024-12-18T00:04:10.7479632Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:04:10.7480581Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:04:10.7481704Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:04:10.7482358Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:04:10.7483118Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:04:10.7484030Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:04:10.7484942Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2024-12-18T00:04:10.7485824Z Compiling src/graph/backend/dnnl/patterns/conv_post_ops.cpp; 12s local ... 2024-12-18T00:04:10.9611185Z 2024-12-18T00:04:10.9612125Z  2024-12-18T00:04:10.9612604Z  2024-12-18T00:04:10.9613010Z  2024-12-18T00:04:10.9613392Z  2024-12-18T00:04:10.9613770Z  2024-12-18T00:04:10.9614159Z  2024-12-18T00:04:10.9614552Z  2024-12-18T00:04:10.9614933Z  2024-12-18T00:04:10.9615509Z [10,004 / 15,187] 48 actions, 47 running 2024-12-18T00:04:10.9616688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:04:10.9617831Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:04:10.9618740Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:04:10.9619453Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:04:10.9620350Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:04:10.9621312Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:04:10.9622199Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2024-12-18T00:04:10.9623247Z Compiling src/graph/backend/dnnl/patterns/conv_post_ops.cpp; 12s local ... 2024-12-18T00:04:11.1928759Z 2024-12-18T00:04:11.1929597Z  2024-12-18T00:04:11.1930078Z  2024-12-18T00:04:11.1930504Z  2024-12-18T00:04:11.1930934Z  2024-12-18T00:04:11.1931352Z  2024-12-18T00:04:11.1931673Z  2024-12-18T00:04:11.1932122Z  2024-12-18T00:04:11.1932543Z  2024-12-18T00:04:11.1933176Z [10,006 / 15,187] 48 actions, 47 running 2024-12-18T00:04:11.1934150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:04:11.1935345Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:04:11.1936332Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:04:11.1937287Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:04:11.1938216Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:04:11.1939220Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:04:11.1940183Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2024-12-18T00:04:11.1941324Z Compiling src/graph/backend/dnnl/patterns/conv_post_ops.cpp; 12s local ... 2024-12-18T00:04:11.4686710Z 2024-12-18T00:04:11.4687604Z  2024-12-18T00:04:11.4688154Z  2024-12-18T00:04:11.4688600Z  2024-12-18T00:04:11.4689041Z  2024-12-18T00:04:11.4689455Z  2024-12-18T00:04:11.4689823Z  2024-12-18T00:04:11.4690268Z  2024-12-18T00:04:11.4690660Z  2024-12-18T00:04:11.4691277Z [10,010 / 15,187] 48 actions running 2024-12-18T00:04:11.4692222Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:04:11.4693429Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:04:11.4694390Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:04:11.4695176Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:04:11.4696088Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:04:11.4697181Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:04:11.4698107Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2024-12-18T00:04:11.4698936Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:04:11.7153591Z 2024-12-18T00:04:11.7154419Z  2024-12-18T00:04:11.7154895Z  2024-12-18T00:04:11.7155322Z  2024-12-18T00:04:11.7155725Z  2024-12-18T00:04:11.7156113Z  2024-12-18T00:04:11.7156506Z  2024-12-18T00:04:11.7156889Z  2024-12-18T00:04:11.7157289Z  2024-12-18T00:04:11.7157917Z [10,013 / 15,187] 48 actions, 47 running 2024-12-18T00:04:11.7159691Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:04:11.7160823Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:04:11.7161775Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:04:11.7162534Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:04:11.7163474Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:04:11.7164424Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:04:11.7165481Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:04:11.7166703Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 11s local ... 2024-12-18T00:04:11.9289006Z 2024-12-18T00:04:11.9289861Z  2024-12-18T00:04:11.9290313Z  2024-12-18T00:04:11.9290684Z  2024-12-18T00:04:11.9291072Z  2024-12-18T00:04:11.9291414Z  2024-12-18T00:04:11.9291786Z  2024-12-18T00:04:11.9292190Z  2024-12-18T00:04:11.9292555Z  2024-12-18T00:04:11.9293142Z [10,018 / 15,187] 48 actions, 47 running 2024-12-18T00:04:11.9293989Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:04:11.9295051Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:04:11.9295901Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:04:11.9296712Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:04:11.9297534Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:04:11.9298432Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:04:11.9299441Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:04:11.9300454Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 11s local ... 2024-12-18T00:04:12.2694913Z 2024-12-18T00:04:12.2695802Z  2024-12-18T00:04:12.2696277Z  2024-12-18T00:04:12.2696872Z  2024-12-18T00:04:12.2697231Z  2024-12-18T00:04:12.2697599Z  2024-12-18T00:04:12.2697993Z  2024-12-18T00:04:12.2698384Z  2024-12-18T00:04:12.2698756Z  2024-12-18T00:04:12.2699317Z [10,019 / 15,187] 48 actions running 2024-12-18T00:04:12.2700335Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:04:12.2701533Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:04:12.2702526Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:04:12.2703325Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:04:12.2704273Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:04:12.2705332Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:04:12.2706460Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:04:12.2707602Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 11s local ... 2024-12-18T00:04:12.4831278Z 2024-12-18T00:04:12.4832148Z  2024-12-18T00:04:12.4832595Z  2024-12-18T00:04:12.4833017Z  2024-12-18T00:04:12.4833437Z  2024-12-18T00:04:12.4833861Z  2024-12-18T00:04:12.4834286Z  2024-12-18T00:04:12.4834693Z  2024-12-18T00:04:12.4835112Z  2024-12-18T00:04:12.4835738Z [10,020 / 15,187] 48 actions, 47 running 2024-12-18T00:04:12.4836729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:04:12.4837972Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:04:12.4839320Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:04:12.4840124Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:04:12.4841078Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:04:12.4842129Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:04:12.4843453Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:04:12.4844991Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local ... 2024-12-18T00:04:12.6968408Z 2024-12-18T00:04:12.6969272Z  2024-12-18T00:04:12.6969741Z  2024-12-18T00:04:12.6970140Z  2024-12-18T00:04:12.6970530Z  2024-12-18T00:04:12.6970942Z  2024-12-18T00:04:12.6971333Z  2024-12-18T00:04:12.6971718Z  2024-12-18T00:04:12.6972113Z  2024-12-18T00:04:12.6972721Z [10,024 / 15,187] 48 actions, 47 running 2024-12-18T00:04:12.6973721Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:04:12.6974868Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:04:12.6975914Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:04:12.6976741Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:04:12.6977567Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:04:12.6978481Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2024-12-18T00:04:12.6979521Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 13s local 2024-12-18T00:04:12.6980594Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local ... 2024-12-18T00:04:13.0271087Z 2024-12-18T00:04:13.0271898Z  2024-12-18T00:04:13.0272289Z  2024-12-18T00:04:13.0272628Z  2024-12-18T00:04:13.0272959Z  2024-12-18T00:04:13.0273290Z  2024-12-18T00:04:13.0273678Z  2024-12-18T00:04:13.0273991Z  2024-12-18T00:04:13.0274321Z  2024-12-18T00:04:13.0274820Z [10,027 / 15,187] 48 actions, 47 running 2024-12-18T00:04:13.0275552Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:04:13.0276439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:04:13.0277176Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:04:13.0277787Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:04:13.0278512Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:04:13.0279304Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2024-12-18T00:04:13.0280085Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2024-12-18T00:04:13.0280734Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:04:13.2701138Z 2024-12-18T00:04:13.2701948Z  2024-12-18T00:04:13.2702345Z  2024-12-18T00:04:13.2702735Z  2024-12-18T00:04:13.2703072Z  2024-12-18T00:04:13.2703410Z  2024-12-18T00:04:13.2703751Z  2024-12-18T00:04:13.2704087Z  2024-12-18T00:04:13.2704423Z  2024-12-18T00:04:13.2704913Z [10,028 / 15,187] 48 actions running 2024-12-18T00:04:13.2705688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:04:13.2706683Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:04:13.2707487Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:04:13.2708120Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:04:13.2708920Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:04:13.2709805Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2024-12-18T00:04:13.2710707Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2024-12-18T00:04:13.2711413Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:04:13.4838520Z 2024-12-18T00:04:13.4839374Z  2024-12-18T00:04:13.4839822Z  2024-12-18T00:04:13.4840241Z  2024-12-18T00:04:13.4840668Z  2024-12-18T00:04:13.4841064Z  2024-12-18T00:04:13.4841438Z  2024-12-18T00:04:13.4841856Z  2024-12-18T00:04:13.4842251Z  2024-12-18T00:04:13.4842846Z [10,029 / 15,187] 48 actions, 47 running 2024-12-18T00:04:13.4844432Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:04:13.4845599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:04:13.4846597Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:04:13.4847380Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:04:13.4848308Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:04:13.4849326Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2024-12-18T00:04:13.4850310Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:04:13.4851146Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:04:13.8612769Z 2024-12-18T00:04:13.8613633Z  2024-12-18T00:04:13.8614117Z  2024-12-18T00:04:13.8614509Z  2024-12-18T00:04:13.8614894Z  2024-12-18T00:04:13.8615316Z  2024-12-18T00:04:13.8615725Z  2024-12-18T00:04:13.8616068Z  2024-12-18T00:04:13.8616606Z  2024-12-18T00:04:13.8617255Z [10,030 / 15,187] 48 actions, 47 running 2024-12-18T00:04:13.8618170Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:04:13.8619320Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:04:13.8620237Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:04:13.8620984Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:04:13.8621773Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:04:13.8622650Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:04:13.8623553Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:04:13.8624282Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:04:14.0685670Z 2024-12-18T00:04:14.0686561Z  2024-12-18T00:04:14.0687028Z  2024-12-18T00:04:14.0687446Z  2024-12-18T00:04:14.0687828Z  2024-12-18T00:04:14.0688212Z  2024-12-18T00:04:14.0688633Z  2024-12-18T00:04:14.0689041Z  2024-12-18T00:04:14.0689452Z  2024-12-18T00:04:14.0690071Z [10,032 / 15,187] 48 actions, 47 running 2024-12-18T00:04:14.0691055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:04:14.0692220Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:04:14.0693187Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:04:14.0693958Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:04:14.0694911Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:04:14.0695906Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:04:14.0697070Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:04:14.0697865Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:04:14.2713272Z 2024-12-18T00:04:14.2714174Z  2024-12-18T00:04:14.2714653Z  2024-12-18T00:04:14.2715125Z  2024-12-18T00:04:14.2715554Z  2024-12-18T00:04:14.2715985Z  2024-12-18T00:04:14.2716407Z  2024-12-18T00:04:14.2716813Z  2024-12-18T00:04:14.2717239Z  2024-12-18T00:04:14.2717845Z [10,033 / 15,187] 48 actions running 2024-12-18T00:04:14.2718854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:04:14.2720124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:04:14.2721119Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:04:14.2722291Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:04:14.2723251Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:04:14.2724309Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:04:14.2725339Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:04:14.2726325Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:04:14.4717844Z 2024-12-18T00:04:14.4718636Z  2024-12-18T00:04:14.4719123Z  2024-12-18T00:04:14.4719543Z  2024-12-18T00:04:14.4719958Z  2024-12-18T00:04:14.4720360Z  2024-12-18T00:04:14.4720778Z  2024-12-18T00:04:14.4721198Z  2024-12-18T00:04:14.4721616Z  2024-12-18T00:04:14.4722210Z [10,036 / 15,187] 48 actions running 2024-12-18T00:04:14.4723206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:04:14.4724474Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:04:14.4725516Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:04:14.4726322Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:04:14.4727287Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:04:14.4728333Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:04:14.4729368Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:04:14.4730206Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:04:14.7110495Z 2024-12-18T00:04:14.7111368Z  2024-12-18T00:04:14.7111853Z  2024-12-18T00:04:14.7112241Z  2024-12-18T00:04:14.7112690Z  2024-12-18T00:04:14.7113126Z  2024-12-18T00:04:14.7113537Z  2024-12-18T00:04:14.7113953Z  2024-12-18T00:04:14.7114357Z  2024-12-18T00:04:14.7114999Z [10,037 / 15,187] 48 actions, 47 running 2024-12-18T00:04:14.7116006Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:04:14.7117288Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:04:14.7118272Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:04:14.7119078Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:04:14.7119957Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:04:14.7121015Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:04:14.7122009Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:04:14.7122835Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:04:14.9316746Z 2024-12-18T00:04:14.9317565Z  2024-12-18T00:04:14.9318060Z  2024-12-18T00:04:14.9318495Z  2024-12-18T00:04:14.9318924Z  2024-12-18T00:04:14.9319331Z  2024-12-18T00:04:14.9319762Z  2024-12-18T00:04:14.9320188Z  2024-12-18T00:04:14.9320610Z  2024-12-18T00:04:14.9321246Z [10,039 / 15,187] 48 actions, 47 running 2024-12-18T00:04:14.9322289Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:04:14.9323551Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:04:14.9324562Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:04:14.9325365Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:04:14.9326348Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:04:14.9327387Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:04:14.9328413Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:04:14.9329251Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:04:15.1567852Z 2024-12-18T00:04:15.1568749Z  2024-12-18T00:04:15.1569251Z  2024-12-18T00:04:15.1569678Z  2024-12-18T00:04:15.1570102Z  2024-12-18T00:04:15.1570519Z  2024-12-18T00:04:15.1570929Z  2024-12-18T00:04:15.1571730Z  2024-12-18T00:04:15.1572148Z  2024-12-18T00:04:15.1572754Z [10,041 / 15,187] 48 actions, 47 running 2024-12-18T00:04:15.1573738Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:04:15.1574953Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:04:15.1576138Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:04:15.1577077Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:04:15.1578033Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:04:15.1579058Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:04:15.1580058Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:04:15.1580917Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:04:15.4450131Z 2024-12-18T00:04:15.4451028Z  2024-12-18T00:04:15.4451525Z  2024-12-18T00:04:15.4451939Z  2024-12-18T00:04:15.4452374Z  2024-12-18T00:04:15.4452777Z  2024-12-18T00:04:15.4453196Z  2024-12-18T00:04:15.4453608Z  2024-12-18T00:04:15.4454013Z  2024-12-18T00:04:15.4454609Z [10,044 / 15,187] 48 actions, 47 running 2024-12-18T00:04:15.4455575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:04:15.4456993Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:04:15.4457949Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:04:15.4458702Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:04:15.4459625Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:04:15.4460595Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:04:15.4461515Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:04:15.4462320Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:04:15.6728877Z 2024-12-18T00:04:15.6729723Z  2024-12-18T00:04:15.6730187Z  2024-12-18T00:04:15.6730583Z  2024-12-18T00:04:15.6730976Z  2024-12-18T00:04:15.6731347Z  2024-12-18T00:04:15.6731731Z  2024-12-18T00:04:15.6732123Z  2024-12-18T00:04:15.6732525Z  2024-12-18T00:04:15.6733094Z [10,044 / 15,187] 48 actions running 2024-12-18T00:04:15.6734103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:04:15.6735324Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:04:15.6736246Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:04:15.6737184Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:04:15.6738054Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:04:15.6739065Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2024-12-18T00:04:15.6740009Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:04:15.6740819Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:04:15.8749125Z 2024-12-18T00:04:15.8749966Z  2024-12-18T00:04:15.8760107Z  2024-12-18T00:04:15.8760509Z  2024-12-18T00:04:15.8760839Z  2024-12-18T00:04:15.8761185Z  2024-12-18T00:04:15.8761543Z  2024-12-18T00:04:15.8761895Z  2024-12-18T00:04:15.8762234Z  2024-12-18T00:04:15.8762815Z [10,046 / 15,187] 48 actions, 47 running 2024-12-18T00:04:15.8763663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:04:15.8764682Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:04:15.8765493Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:04:15.8766137Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:04:15.8766929Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:04:15.8767772Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2024-12-18T00:04:15.8768972Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:04:15.8769688Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:04:16.2256937Z 2024-12-18T00:04:16.2257800Z  2024-12-18T00:04:16.2258297Z  2024-12-18T00:04:16.2258681Z  2024-12-18T00:04:16.2259012Z  2024-12-18T00:04:16.2259374Z  2024-12-18T00:04:16.2260120Z  2024-12-18T00:04:16.2260494Z  2024-12-18T00:04:16.2260845Z  2024-12-18T00:04:16.2261379Z [10,048 / 15,187] 48 actions, 47 running 2024-12-18T00:04:16.2262235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:04:16.2263210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:04:16.2264017Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:04:16.2264661Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:04:16.2265423Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:04:16.2266282Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2024-12-18T00:04:16.2267096Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:04:16.2267779Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:04:16.4735278Z 2024-12-18T00:04:16.4736127Z  2024-12-18T00:04:16.4736657Z  2024-12-18T00:04:16.4737036Z  2024-12-18T00:04:16.4737365Z  2024-12-18T00:04:16.4737691Z  2024-12-18T00:04:16.4738016Z  2024-12-18T00:04:16.4738312Z  2024-12-18T00:04:16.4738629Z  2024-12-18T00:04:16.4739100Z [10,050 / 15,187] 48 actions running 2024-12-18T00:04:16.4739816Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:04:16.4740715Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:04:16.4741404Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:04:16.4742003Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:04:16.4742680Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:04:16.4743415Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2024-12-18T00:04:16.4751691Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:04:16.4752599Z @onednn//:mkl_dnn; 16s local ... 2024-12-18T00:04:16.6971495Z 2024-12-18T00:04:16.6972310Z  2024-12-18T00:04:16.6972710Z  2024-12-18T00:04:16.6973039Z  2024-12-18T00:04:16.6973376Z  2024-12-18T00:04:16.6973704Z  2024-12-18T00:04:16.6974034Z  2024-12-18T00:04:16.6974358Z  2024-12-18T00:04:16.6974700Z  2024-12-18T00:04:16.6975198Z [10,051 / 15,187] 48 actions, 47 running 2024-12-18T00:04:16.6975958Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:04:16.6977002Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:04:16.6977754Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:04:16.6978352Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:04:16.6979035Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:04:16.6979796Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:04:16.6980561Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:04:16.6981176Z @onednn//:mkl_dnn; 16s local ... 2024-12-18T00:04:17.0742906Z 2024-12-18T00:04:17.0743771Z  2024-12-18T00:04:17.0744751Z  2024-12-18T00:04:17.0745106Z  2024-12-18T00:04:17.0745439Z  2024-12-18T00:04:17.0745735Z  2024-12-18T00:04:17.0746048Z  2024-12-18T00:04:17.0746359Z  2024-12-18T00:04:17.0746679Z  2024-12-18T00:04:17.0747164Z [10,051 / 15,187] 48 actions running 2024-12-18T00:04:17.0747903Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:04:17.0749275Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:04:17.0749997Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:04:17.0750590Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:04:17.0751313Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:04:17.0752303Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:04:17.0753079Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:04:17.0753872Z @onednn//:mkl_dnn; 16s local ... 2024-12-18T00:04:17.2745865Z 2024-12-18T00:04:17.2746744Z  2024-12-18T00:04:17.2747205Z  2024-12-18T00:04:17.2747592Z  2024-12-18T00:04:17.2747980Z  2024-12-18T00:04:17.2748359Z  2024-12-18T00:04:17.2748726Z  2024-12-18T00:04:17.2749109Z  2024-12-18T00:04:17.2749501Z  2024-12-18T00:04:17.2750036Z [10,052 / 15,187] 48 actions running 2024-12-18T00:04:17.2751016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:04:17.2752177Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:04:17.2753057Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:04:17.2753837Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:04:17.2754781Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:04:17.2755705Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:04:17.2756657Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:04:17.2757431Z @onednn//:mkl_dnn; 16s local ... 2024-12-18T00:04:17.5163133Z 2024-12-18T00:04:17.5163959Z  2024-12-18T00:04:17.5164345Z  2024-12-18T00:04:17.5164676Z  2024-12-18T00:04:17.5164994Z  2024-12-18T00:04:17.5165327Z  2024-12-18T00:04:17.5165649Z  2024-12-18T00:04:17.5166018Z  2024-12-18T00:04:17.5166333Z  2024-12-18T00:04:17.5166845Z [10,056 / 15,187] 48 actions, 47 running 2024-12-18T00:04:17.5167624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:04:17.5168579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:04:17.5169353Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:04:17.5170135Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:04:17.5170858Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:04:17.5171619Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:04:17.5172378Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:04:17.5173038Z @onednn//:mkl_dnn; 17s local ... 2024-12-18T00:04:17.7381242Z 2024-12-18T00:04:17.7382157Z  2024-12-18T00:04:17.7382559Z  2024-12-18T00:04:17.7382895Z  2024-12-18T00:04:17.7383275Z  2024-12-18T00:04:17.7383604Z  2024-12-18T00:04:17.7383934Z  2024-12-18T00:04:17.7384254Z  2024-12-18T00:04:17.7384596Z  2024-12-18T00:04:17.7385121Z [10,060 / 15,187] 48 actions, 47 running 2024-12-18T00:04:17.7385898Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:04:17.7386857Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:04:17.7387632Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:04:17.7388269Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:04:17.7389043Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:04:17.7389888Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2024-12-18T00:04:17.7390652Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:04:17.7391252Z @onednn//:mkl_dnn; 17s local ... 2024-12-18T00:04:18.0053839Z 2024-12-18T00:04:18.0055080Z  2024-12-18T00:04:18.0055525Z  2024-12-18T00:04:18.0055888Z  2024-12-18T00:04:18.0056257Z  2024-12-18T00:04:18.0056800Z  2024-12-18T00:04:18.0057167Z  2024-12-18T00:04:18.0057517Z  2024-12-18T00:04:18.0057867Z  2024-12-18T00:04:18.0058407Z [10,062 / 15,187] 47 actions, 46 running 2024-12-18T00:04:18.0059518Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:04:18.0060501Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:04:18.0061314Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:04:18.0061985Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:04:18.0062782Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:04:18.0063610Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2024-12-18T00:04:18.0064421Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:04:18.0065123Z @onednn//:mkl_dnn; 17s local ... 2024-12-18T00:04:18.2056358Z 2024-12-18T00:04:18.2057354Z  2024-12-18T00:04:18.2057751Z  2024-12-18T00:04:18.2059636Z  2024-12-18T00:04:18.2062445Z  2024-12-18T00:04:18.2065137Z  2024-12-18T00:04:18.2065755Z  2024-12-18T00:04:18.2066317Z  2024-12-18T00:04:18.2066891Z  2024-12-18T00:04:18.2067693Z [10,066 / 15,187] 48 actions, 47 running 2024-12-18T00:04:18.2068937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:04:18.2070234Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:04:18.2071201Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:04:18.2072084Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:04:18.2073058Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:04:18.2074055Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:04:18.2075236Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:04:18.2076251Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:18.4615872Z 2024-12-18T00:04:18.4617185Z  2024-12-18T00:04:18.4617781Z  2024-12-18T00:04:18.4618433Z  2024-12-18T00:04:18.4619044Z  2024-12-18T00:04:18.4619476Z  2024-12-18T00:04:18.4619985Z  2024-12-18T00:04:18.4690721Z  2024-12-18T00:04:18.4691122Z  2024-12-18T00:04:18.4691628Z [10,069 / 15,187] 48 actions, 47 running 2024-12-18T00:04:18.4692373Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:04:18.4693319Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:04:18.4694121Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:04:18.4694736Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:04:18.4695518Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:04:18.4696262Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:04:18.4697276Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:04:18.4698012Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:18.6755699Z 2024-12-18T00:04:18.6756645Z  2024-12-18T00:04:18.6757177Z  2024-12-18T00:04:18.6757624Z  2024-12-18T00:04:18.6757951Z  2024-12-18T00:04:18.6758389Z  2024-12-18T00:04:18.6758694Z  2024-12-18T00:04:18.6759129Z  2024-12-18T00:04:18.6759462Z  2024-12-18T00:04:18.6760042Z [10,072 / 15,187] 48 actions running 2024-12-18T00:04:18.6760912Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:04:18.6761897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:04:18.6762989Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:04:18.6764120Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:04:18.6764972Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:04:18.6766332Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:04:18.6767175Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:04:18.6768142Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:19.0222915Z 2024-12-18T00:04:19.0223808Z  2024-12-18T00:04:19.0224252Z  2024-12-18T00:04:19.0224629Z  2024-12-18T00:04:19.0224994Z  2024-12-18T00:04:19.0225350Z  2024-12-18T00:04:19.0225720Z  2024-12-18T00:04:19.0226085Z  2024-12-18T00:04:19.0226459Z  2024-12-18T00:04:19.0227037Z [10,074 / 15,187] 48 actions, 47 running 2024-12-18T00:04:19.0227886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:04:19.0228982Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:04:19.0229948Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:04:19.0230665Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:04:19.0231542Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:04:19.0232455Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:04:19.0233548Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:04:19.0234492Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:19.2761687Z 2024-12-18T00:04:19.2762529Z  2024-12-18T00:04:19.2762924Z  2024-12-18T00:04:19.2763253Z  2024-12-18T00:04:19.2763584Z  2024-12-18T00:04:19.2763921Z  2024-12-18T00:04:19.2764227Z  2024-12-18T00:04:19.2764563Z  2024-12-18T00:04:19.2764895Z  2024-12-18T00:04:19.2765382Z [10,074 / 15,187] 48 actions running 2024-12-18T00:04:19.2766173Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:04:19.2767111Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:04:19.2767884Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:04:19.2768503Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:04:19.2769247Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:04:19.2770195Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:04:19.2771085Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:04:19.2771916Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:19.4789152Z 2024-12-18T00:04:19.4789923Z  2024-12-18T00:04:19.4790370Z  2024-12-18T00:04:19.4790697Z  2024-12-18T00:04:19.4791018Z  2024-12-18T00:04:19.4791331Z  2024-12-18T00:04:19.4791651Z  2024-12-18T00:04:19.4791986Z  2024-12-18T00:04:19.4792349Z  2024-12-18T00:04:19.4792846Z [10,075 / 15,187] 48 actions, 47 running 2024-12-18T00:04:19.4793617Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:04:19.4794566Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:04:19.4795304Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:04:19.4795931Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:04:19.4796638Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:04:19.4797433Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:04:19.4798305Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:04:19.4799082Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:19.7621694Z 2024-12-18T00:04:19.7622603Z  2024-12-18T00:04:19.7623036Z  2024-12-18T00:04:19.7623387Z  2024-12-18T00:04:19.7624089Z  2024-12-18T00:04:19.7624406Z  2024-12-18T00:04:19.7624733Z  2024-12-18T00:04:19.7625066Z  2024-12-18T00:04:19.7625386Z  2024-12-18T00:04:19.7625873Z [10,080 / 15,187] 48 actions, 47 running 2024-12-18T00:04:19.7626670Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:04:19.7628117Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:04:19.7628976Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:04:19.7629657Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:04:19.7630439Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:04:19.7631303Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:04:19.7632327Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:04:19.7633076Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:19.9958408Z 2024-12-18T00:04:19.9959187Z  2024-12-18T00:04:19.9959604Z  2024-12-18T00:04:19.9959958Z  2024-12-18T00:04:19.9960308Z  2024-12-18T00:04:19.9960665Z  2024-12-18T00:04:19.9961010Z  2024-12-18T00:04:19.9961370Z  2024-12-18T00:04:19.9961725Z  2024-12-18T00:04:19.9962274Z [10,084 / 15,187] 48 actions, 47 running 2024-12-18T00:04:19.9963163Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:04:19.9964186Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:04:19.9965044Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:04:19.9965659Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:04:19.9966426Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2024-12-18T00:04:19.9967274Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:04:19.9968224Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:04:19.9969063Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:20.2772895Z 2024-12-18T00:04:20.2773723Z  2024-12-18T00:04:20.2774126Z  2024-12-18T00:04:20.2774469Z  2024-12-18T00:04:20.2774779Z  2024-12-18T00:04:20.2775108Z  2024-12-18T00:04:20.2775435Z  2024-12-18T00:04:20.2775766Z  2024-12-18T00:04:20.2776144Z  2024-12-18T00:04:20.2776762Z [10,088 / 15,187] 48 actions running 2024-12-18T00:04:20.2777562Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:04:20.2778497Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:04:20.2779247Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:04:20.2779862Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:04:20.2780568Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:04:20.2781483Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:04:20.2782403Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:20.2782935Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:20.4779196Z 2024-12-18T00:04:20.4780055Z  2024-12-18T00:04:20.4780482Z  2024-12-18T00:04:20.4780819Z  2024-12-18T00:04:20.4781180Z  2024-12-18T00:04:20.4781576Z  2024-12-18T00:04:20.4781927Z  2024-12-18T00:04:20.4782271Z  2024-12-18T00:04:20.4782617Z  2024-12-18T00:04:20.4783137Z [10,089 / 15,187] 48 actions running 2024-12-18T00:04:20.4784016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:04:20.4785063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:04:20.4785934Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:04:20.4786619Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:04:20.4787749Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:04:20.4788753Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:04:20.4789688Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:20.4790263Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:20.6784781Z 2024-12-18T00:04:20.6785594Z  2024-12-18T00:04:20.6786315Z  2024-12-18T00:04:20.6786657Z  2024-12-18T00:04:20.6786977Z  2024-12-18T00:04:20.6787294Z  2024-12-18T00:04:20.6787607Z  2024-12-18T00:04:20.6787933Z  2024-12-18T00:04:20.6788253Z  2024-12-18T00:04:20.6788730Z [10,091 / 15,187] 48 actions running 2024-12-18T00:04:20.6789469Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:04:20.6790388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:04:20.6791147Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:04:20.6791785Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:04:20.6792474Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:04:20.6793318Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:04:20.6794064Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:20.6794554Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:21.0790898Z 2024-12-18T00:04:21.0791780Z  2024-12-18T00:04:21.0792168Z  2024-12-18T00:04:21.0792473Z  2024-12-18T00:04:21.0792786Z  2024-12-18T00:04:21.0793103Z  2024-12-18T00:04:21.0793423Z  2024-12-18T00:04:21.0793723Z  2024-12-18T00:04:21.0794067Z  2024-12-18T00:04:21.0794536Z [10,092 / 15,187] 48 actions running 2024-12-18T00:04:21.0795284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:04:21.0796193Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:04:21.0796963Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:04:21.0797529Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:04:21.0798228Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:04:21.0799097Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:04:21.0799849Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:21.0800336Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:21.5139396Z 2024-12-18T00:04:21.5140295Z  2024-12-18T00:04:21.5140764Z  2024-12-18T00:04:21.5141156Z  2024-12-18T00:04:21.5141533Z  2024-12-18T00:04:21.5141929Z  2024-12-18T00:04:21.5142335Z  2024-12-18T00:04:21.5142737Z  2024-12-18T00:04:21.5143140Z  2024-12-18T00:04:21.5143736Z [10,093 / 15,187] 48 actions, 47 running 2024-12-18T00:04:21.5144959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:04:21.5146234Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:04:21.5147206Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:04:21.5147993Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:04:21.5148895Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:04:21.5150053Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:04:21.5151000Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:21.5151635Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:21.7643540Z 2024-12-18T00:04:21.7644769Z  2024-12-18T00:04:21.7645168Z  2024-12-18T00:04:21.7645531Z  2024-12-18T00:04:21.7645893Z  2024-12-18T00:04:21.7646252Z  2024-12-18T00:04:21.7646587Z  2024-12-18T00:04:21.7646943Z  2024-12-18T00:04:21.7647284Z  2024-12-18T00:04:21.7647805Z [10,094 / 15,187] 48 actions, 47 running 2024-12-18T00:04:21.7649001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:04:21.7650027Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:04:21.7650902Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:04:21.7651570Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:04:21.7652522Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:04:21.7653526Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:04:21.7654328Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:21.7654855Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:04:22.0800553Z 2024-12-18T00:04:22.0801424Z  2024-12-18T00:04:22.0801885Z  2024-12-18T00:04:22.0802265Z  2024-12-18T00:04:22.0802634Z  2024-12-18T00:04:22.0802982Z  2024-12-18T00:04:22.0803349Z  2024-12-18T00:04:22.0803716Z  2024-12-18T00:04:22.0804123Z  2024-12-18T00:04:22.0804661Z [10,095 / 15,187] 48 actions running 2024-12-18T00:04:22.0805494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:04:22.0806520Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:04:22.0807371Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:04:22.0808054Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:04:22.0808834Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:04:22.0809758Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:04:22.0810592Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:22.0811119Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:04:22.2806288Z 2024-12-18T00:04:22.2807156Z  2024-12-18T00:04:22.2807607Z  2024-12-18T00:04:22.2807948Z  2024-12-18T00:04:22.2808275Z  2024-12-18T00:04:22.2808655Z  2024-12-18T00:04:22.2809013Z  2024-12-18T00:04:22.2809419Z  2024-12-18T00:04:22.2809742Z  2024-12-18T00:04:22.2810225Z [10,098 / 15,187] 48 actions running 2024-12-18T00:04:22.2810969Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:04:22.2811922Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:04:22.2812681Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:04:22.2813273Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:04:22.2813954Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:04:22.2814827Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:04:22.2815628Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:22.2816257Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:22.6988426Z 2024-12-18T00:04:22.6989270Z  2024-12-18T00:04:22.6989704Z  2024-12-18T00:04:22.6990042Z  2024-12-18T00:04:22.6990373Z  2024-12-18T00:04:22.6990702Z  2024-12-18T00:04:22.6991011Z  2024-12-18T00:04:22.6991333Z  2024-12-18T00:04:22.6991659Z  2024-12-18T00:04:22.6992157Z [10,099 / 15,187] 48 actions, 47 running 2024-12-18T00:04:22.6992962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:04:22.6993891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:04:22.6994643Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:04:22.6995236Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:04:22.6995946Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:04:22.6996852Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:04:22.6997622Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:22.6998118Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:04:22.9318509Z 2024-12-18T00:04:22.9319362Z  2024-12-18T00:04:22.9319785Z  2024-12-18T00:04:22.9320169Z  2024-12-18T00:04:22.9320554Z  2024-12-18T00:04:22.9320917Z  2024-12-18T00:04:22.9321313Z  2024-12-18T00:04:22.9321707Z  2024-12-18T00:04:22.9322091Z  2024-12-18T00:04:22.9322981Z [10,101 / 15,187] 48 actions, 47 running 2024-12-18T00:04:22.9323842Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:04:22.9324948Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:04:22.9325871Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:04:22.9326628Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:04:22.9327495Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:04:22.9328544Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:04:22.9329440Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:22.9330043Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:04:23.1334261Z 2024-12-18T00:04:23.1335026Z  2024-12-18T00:04:23.1335433Z  2024-12-18T00:04:23.1335776Z  2024-12-18T00:04:23.1336118Z  2024-12-18T00:04:23.1336565Z  2024-12-18T00:04:23.1336888Z  2024-12-18T00:04:23.1337225Z  2024-12-18T00:04:23.1337600Z  2024-12-18T00:04:23.1338128Z [10,103 / 15,187] 48 actions, 47 running 2024-12-18T00:04:23.1338908Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:04:23.1339827Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:04:23.1340578Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:04:23.1341194Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:04:23.1341927Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:04:23.1342594Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:23.1343075Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:23.1343599Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:23.3409956Z 2024-12-18T00:04:23.3410794Z  2024-12-18T00:04:23.3411211Z  2024-12-18T00:04:23.3411572Z  2024-12-18T00:04:23.3411915Z  2024-12-18T00:04:23.3412262Z  2024-12-18T00:04:23.3412646Z  2024-12-18T00:04:23.3413004Z  2024-12-18T00:04:23.3413471Z  2024-12-18T00:04:23.3413954Z [10,105 / 15,187] 48 actions, 47 running 2024-12-18T00:04:23.3414719Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:04:23.3415653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:04:23.3416665Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:04:23.3417458Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:04:23.3418177Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:04:23.3418859Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:23.3419341Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:23.3419832Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:23.6327487Z 2024-12-18T00:04:23.6328283Z  2024-12-18T00:04:23.6328709Z  2024-12-18T00:04:23.6329065Z  2024-12-18T00:04:23.6329432Z  2024-12-18T00:04:23.6329784Z  2024-12-18T00:04:23.6330142Z  2024-12-18T00:04:23.6330499Z  2024-12-18T00:04:23.6330853Z  2024-12-18T00:04:23.6331382Z [10,110 / 15,187] 48 actions, 47 running 2024-12-18T00:04:23.6332221Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:04:23.6333248Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:04:23.6334061Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:04:23.6334693Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:04:23.6335697Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:04:23.6336353Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:04:23.6336992Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:23.6337504Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:23.8818278Z 2024-12-18T00:04:23.8819105Z  2024-12-18T00:04:23.8819904Z  2024-12-18T00:04:23.8820320Z  2024-12-18T00:04:23.8820750Z  2024-12-18T00:04:23.8821177Z  2024-12-18T00:04:23.8821601Z  2024-12-18T00:04:23.8822006Z  2024-12-18T00:04:23.8822425Z  2024-12-18T00:04:23.8823000Z [10,111 / 15,187] 48 actions running 2024-12-18T00:04:23.8823987Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:04:23.8825215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:04:23.8826201Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:04:23.8826964Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:04:23.8827889Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:04:23.8828740Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:23.8829372Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:23.8830229Z Compiling mlir/tools/mlir-tblgen/RewriterGen.cpp [for tool]; 7s local ... 2024-12-18T00:04:24.2824828Z 2024-12-18T00:04:24.2825715Z  2024-12-18T00:04:24.2826195Z  2024-12-18T00:04:24.2826590Z  2024-12-18T00:04:24.2826978Z  2024-12-18T00:04:24.2827378Z  2024-12-18T00:04:24.2827779Z  2024-12-18T00:04:24.2828183Z  2024-12-18T00:04:24.2828717Z  2024-12-18T00:04:24.2829284Z [10,113 / 15,187] 48 actions running 2024-12-18T00:04:24.2830229Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:04:24.2831408Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:04:24.2832569Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:04:24.2833483Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:04:24.2834381Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:04:24.2835253Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:24.2835889Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:24.2836777Z Compiling mlir/tools/mlir-tblgen/RewriterGen.cpp [for tool]; 8s local ... 2024-12-18T00:04:24.5427413Z 2024-12-18T00:04:24.5428280Z  2024-12-18T00:04:24.5428787Z  2024-12-18T00:04:24.5429166Z  2024-12-18T00:04:24.5429567Z  2024-12-18T00:04:24.5429984Z  2024-12-18T00:04:24.5430372Z  2024-12-18T00:04:24.5430757Z  2024-12-18T00:04:24.5431120Z  2024-12-18T00:04:24.5431719Z [10,115 / 15,187] 48 actions, 47 running 2024-12-18T00:04:24.5432692Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:04:24.5433873Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:04:24.5434772Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:04:24.5435452Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:04:24.5436320Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:04:24.5437149Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:04:24.5437993Z Compiling mlir/tools/mlir-tblgen/RewriterGen.cpp [for tool]; 8s local 2024-12-18T00:04:24.5438882Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:24.8832585Z 2024-12-18T00:04:24.8833472Z  2024-12-18T00:04:24.8833957Z  2024-12-18T00:04:24.8834349Z  2024-12-18T00:04:24.8834727Z  2024-12-18T00:04:24.8835090Z  2024-12-18T00:04:24.8835489Z  2024-12-18T00:04:24.8835886Z  2024-12-18T00:04:24.8836280Z  2024-12-18T00:04:24.8836869Z [10,115 / 15,187] 48 actions running 2024-12-18T00:04:24.8838221Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:04:24.8839390Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:04:24.8840332Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:04:24.8841089Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:04:24.8842143Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:04:24.8842946Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:04:24.8843727Z Compiling mlir/tools/mlir-tblgen/RewriterGen.cpp [for tool]; 8s local 2024-12-18T00:04:24.8844885Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:25.0837201Z 2024-12-18T00:04:25.0838085Z  2024-12-18T00:04:25.0838584Z  2024-12-18T00:04:25.0838991Z  2024-12-18T00:04:25.0839431Z  2024-12-18T00:04:25.0839857Z  2024-12-18T00:04:25.0840282Z  2024-12-18T00:04:25.0840696Z  2024-12-18T00:04:25.0841176Z  2024-12-18T00:04:25.0841772Z [10,116 / 15,187] 48 actions running 2024-12-18T00:04:25.0842735Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:04:25.0843926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:04:25.0845297Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:04:25.0846112Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:04:25.0846984Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:04:25.0847793Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:04:25.0848420Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:04:25.0849040Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:25.3405786Z 2024-12-18T00:04:25.3406620Z  2024-12-18T00:04:25.3407107Z  2024-12-18T00:04:25.3407496Z  2024-12-18T00:04:25.3407901Z  2024-12-18T00:04:25.3408286Z  2024-12-18T00:04:25.3408725Z  2024-12-18T00:04:25.3409122Z  2024-12-18T00:04:25.3409518Z  2024-12-18T00:04:25.3410133Z [10,119 / 15,187] 48 actions, 47 running 2024-12-18T00:04:25.3411094Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:04:25.3412272Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:04:25.3413243Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:04:25.3413995Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:04:25.3414901Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 25s local 2024-12-18T00:04:25.3415693Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:04:25.3416317Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:04:25.3417095Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:25.5662913Z 2024-12-18T00:04:25.5663832Z  2024-12-18T00:04:25.5664298Z  2024-12-18T00:04:25.5664746Z  2024-12-18T00:04:25.5665141Z  2024-12-18T00:04:25.5665561Z  2024-12-18T00:04:25.5665932Z  2024-12-18T00:04:25.5666304Z  2024-12-18T00:04:25.5666684Z  2024-12-18T00:04:25.5667277Z [10,122 / 15,187] 48 actions, 47 running 2024-12-18T00:04:25.5668105Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:04:25.5669171Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:04:25.5670036Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:04:25.5670767Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:04:25.5671527Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:25.5672191Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:04:25.5672836Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:04:25.5673572Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:25.7910188Z 2024-12-18T00:04:25.7911060Z  2024-12-18T00:04:25.7911494Z  2024-12-18T00:04:25.7911867Z  2024-12-18T00:04:25.7912670Z  2024-12-18T00:04:25.7913045Z  2024-12-18T00:04:25.7913427Z  2024-12-18T00:04:25.7913801Z  2024-12-18T00:04:25.7914174Z  2024-12-18T00:04:25.7914746Z [10,126 / 15,187] 48 actions, 47 running 2024-12-18T00:04:25.7915624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:04:25.7917013Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:04:25.7917877Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:04:25.7918564Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:04:25.7919180Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:25.7919722Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:25.7920279Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:04:25.7920830Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:26.0846014Z 2024-12-18T00:04:26.0846883Z  2024-12-18T00:04:26.0847371Z  2024-12-18T00:04:26.0847815Z  2024-12-18T00:04:26.0848216Z  2024-12-18T00:04:26.0848606Z  2024-12-18T00:04:26.0848989Z  2024-12-18T00:04:26.0849379Z  2024-12-18T00:04:26.0849763Z  2024-12-18T00:04:26.0850322Z [10,128 / 15,187] 48 actions running 2024-12-18T00:04:26.0851239Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:04:26.0852410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:04:26.0853401Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:04:26.0854093Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:04:26.0854788Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:26.0855359Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:26.0855970Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:04:26.0856713Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:26.3449858Z 2024-12-18T00:04:26.3450726Z  2024-12-18T00:04:26.3451263Z  2024-12-18T00:04:26.3451681Z  2024-12-18T00:04:26.3452091Z  2024-12-18T00:04:26.3452491Z  2024-12-18T00:04:26.3452906Z  2024-12-18T00:04:26.3453316Z  2024-12-18T00:04:26.3453836Z  2024-12-18T00:04:26.3454449Z [10,131 / 15,187] 48 actions, 47 running 2024-12-18T00:04:26.3455445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:04:26.3456805Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:04:26.3457765Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:04:26.3458541Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:04:26.3459274Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:26.3459877Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:26.3460489Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:26.3461121Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:26.6853017Z 2024-12-18T00:04:26.6853884Z  2024-12-18T00:04:26.6854283Z  2024-12-18T00:04:26.6854632Z  2024-12-18T00:04:26.6854983Z  2024-12-18T00:04:26.6855332Z  2024-12-18T00:04:26.6855674Z  2024-12-18T00:04:26.6855997Z  2024-12-18T00:04:26.6856333Z  2024-12-18T00:04:26.6857121Z [10,131 / 15,187] 48 actions running 2024-12-18T00:04:26.6857945Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:04:26.6858907Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:04:26.6859670Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:04:26.6860309Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:04:26.6860909Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:26.6861413Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:26.6861916Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:26.6862399Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:26.8857775Z 2024-12-18T00:04:26.8858615Z  2024-12-18T00:04:26.8859115Z  2024-12-18T00:04:26.8859556Z  2024-12-18T00:04:26.8859994Z  2024-12-18T00:04:26.8860402Z  2024-12-18T00:04:26.8860817Z  2024-12-18T00:04:26.8861244Z  2024-12-18T00:04:26.8861675Z  2024-12-18T00:04:26.8862307Z [10,133 / 15,187] 48 actions, 47 running 2024-12-18T00:04:26.8863666Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:04:26.8864938Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:04:26.8865911Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:04:26.8866694Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:04:26.8867446Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:26.8868072Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:26.8868710Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:26.8869367Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:27.2447386Z 2024-12-18T00:04:27.2448293Z  2024-12-18T00:04:27.2448788Z  2024-12-18T00:04:27.2449202Z  2024-12-18T00:04:27.2449568Z  2024-12-18T00:04:27.2449942Z  2024-12-18T00:04:27.2450325Z  2024-12-18T00:04:27.2450724Z  2024-12-18T00:04:27.2451123Z  2024-12-18T00:04:27.2451762Z [10,134 / 15,187] 48 actions, 47 running 2024-12-18T00:04:27.2452707Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:04:27.2453872Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:04:27.2454802Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:04:27.2455597Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:04:27.2456355Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:27.2457132Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:27.2457732Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:27.2458366Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:27.4864841Z 2024-12-18T00:04:27.4865715Z  2024-12-18T00:04:27.4866195Z  2024-12-18T00:04:27.4866615Z  2024-12-18T00:04:27.4867014Z  2024-12-18T00:04:27.4867428Z  2024-12-18T00:04:27.4867842Z  2024-12-18T00:04:27.4868247Z  2024-12-18T00:04:27.4868668Z  2024-12-18T00:04:27.4869291Z [10,135 / 15,187] 48 actions running 2024-12-18T00:04:27.4870264Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:04:27.4871474Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:04:27.4872475Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:04:27.4873266Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:04:27.4874010Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:27.4874659Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:27.4875306Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:27.4875958Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:27.8852039Z 2024-12-18T00:04:27.8852829Z  2024-12-18T00:04:27.8853216Z  2024-12-18T00:04:27.8853541Z  2024-12-18T00:04:27.8853852Z  2024-12-18T00:04:27.8854181Z  2024-12-18T00:04:27.8854511Z  2024-12-18T00:04:27.8854845Z  2024-12-18T00:04:27.8855196Z  2024-12-18T00:04:27.8855688Z [10,138 / 15,187] 48 actions, 47 running 2024-12-18T00:04:27.8856587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:04:27.8857516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:04:27.8858256Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:04:27.8858868Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:04:27.8859435Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:27.8859919Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:27.8860784Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:27.8861277Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:28.0871357Z 2024-12-18T00:04:28.0872213Z  2024-12-18T00:04:28.0872697Z  2024-12-18T00:04:28.0873100Z  2024-12-18T00:04:28.0873515Z  2024-12-18T00:04:28.0873926Z  2024-12-18T00:04:28.0874324Z  2024-12-18T00:04:28.0875084Z  2024-12-18T00:04:28.0875486Z  2024-12-18T00:04:28.0876080Z [10,139 / 15,187] 48 actions running 2024-12-18T00:04:28.0877207Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:04:28.0888501Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:04:28.0889559Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:04:28.0890365Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:04:28.0891131Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:28.0891808Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:28.0892459Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:28.0893105Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:28.5101327Z 2024-12-18T00:04:28.5102199Z  2024-12-18T00:04:28.5102668Z  2024-12-18T00:04:28.5103026Z  2024-12-18T00:04:28.5103385Z  2024-12-18T00:04:28.5103747Z  2024-12-18T00:04:28.5104137Z  2024-12-18T00:04:28.5104546Z  2024-12-18T00:04:28.5104886Z  2024-12-18T00:04:28.5105487Z [10,140 / 15,187] 48 actions, 47 running 2024-12-18T00:04:28.5106420Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:04:28.5107637Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:04:28.5108608Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:04:28.5109311Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:04:28.5109988Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:28.5110614Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:28.5111228Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:28.5111847Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:28.8356727Z 2024-12-18T00:04:28.8357574Z  2024-12-18T00:04:28.8358034Z  2024-12-18T00:04:28.8358414Z  2024-12-18T00:04:28.8358818Z  2024-12-18T00:04:28.8359198Z  2024-12-18T00:04:28.8359546Z  2024-12-18T00:04:28.8359911Z  2024-12-18T00:04:28.8360268Z  2024-12-18T00:04:28.8360802Z [10,143 / 15,187] 48 actions, 47 running 2024-12-18T00:04:28.8361658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:04:28.8362695Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:04:28.8363550Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:04:28.8364235Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:04:28.8364885Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:28.8365428Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:28.8365948Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:28.8366493Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:29.0880696Z 2024-12-18T00:04:29.0881534Z  2024-12-18T00:04:29.0881934Z  2024-12-18T00:04:29.0882259Z  2024-12-18T00:04:29.0882655Z  2024-12-18T00:04:29.0882998Z  2024-12-18T00:04:29.0883349Z  2024-12-18T00:04:29.0883696Z  2024-12-18T00:04:29.0884018Z  2024-12-18T00:04:29.0884518Z [10,145 / 15,187] 48 actions running 2024-12-18T00:04:29.0885318Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:04:29.0886271Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:04:29.0887051Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:04:29.0887659Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:04:29.0888767Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.0889293Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.0889784Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:29.0890312Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:29.2884631Z 2024-12-18T00:04:29.2885479Z  2024-12-18T00:04:29.2885862Z  2024-12-18T00:04:29.2886584Z  2024-12-18T00:04:29.2886922Z  2024-12-18T00:04:29.2887250Z  2024-12-18T00:04:29.2887558Z  2024-12-18T00:04:29.2887864Z  2024-12-18T00:04:29.2888195Z  2024-12-18T00:04:29.2888693Z [10,149 / 15,187] 48 actions, 47 running 2024-12-18T00:04:29.2889466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:04:29.2890428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:04:29.2891213Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:04:29.2891868Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:04:29.2892441Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.2892947Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.2893424Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.2893943Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:04:29.5373180Z 2024-12-18T00:04:29.5374007Z  2024-12-18T00:04:29.5374489Z  2024-12-18T00:04:29.5374884Z  2024-12-18T00:04:29.5375238Z  2024-12-18T00:04:29.5375649Z  2024-12-18T00:04:29.5376027Z  2024-12-18T00:04:29.5376432Z  2024-12-18T00:04:29.5376988Z  2024-12-18T00:04:29.5377581Z [10,153 / 15,187] 48 actions, 47 running 2024-12-18T00:04:29.5378551Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:04:29.5379693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:04:29.5380630Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:04:29.5381412Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:04:29.5382075Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:29.5382656Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.5383153Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.5383761Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:29.7867951Z 2024-12-18T00:04:29.7868840Z  2024-12-18T00:04:29.7869336Z  2024-12-18T00:04:29.7869752Z  2024-12-18T00:04:29.7870125Z  2024-12-18T00:04:29.7870527Z  2024-12-18T00:04:29.7870924Z  2024-12-18T00:04:29.7871307Z  2024-12-18T00:04:29.7871707Z  2024-12-18T00:04:29.7872286Z [10,156 / 15,187] 48 actions, 47 running 2024-12-18T00:04:29.7873194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:04:29.7874385Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:04:29.7875336Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:04:29.7876043Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:04:29.7876724Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:29.7877318Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:29.7877893Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:04:29.7878475Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:04:29.9939935Z 2024-12-18T00:04:29.9940854Z  2024-12-18T00:04:29.9941295Z  2024-12-18T00:04:29.9941678Z  2024-12-18T00:04:29.9942072Z  2024-12-18T00:04:29.9942429Z  2024-12-18T00:04:29.9942806Z  2024-12-18T00:04:29.9943175Z  2024-12-18T00:04:29.9943563Z  2024-12-18T00:04:29.9944396Z [10,159 / 15,187] 48 actions, 47 running 2024-12-18T00:04:29.9945305Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:04:29.9946526Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:04:29.9947821Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:04:29.9948541Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:04:29.9949235Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:29.9949817Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:29.9950377Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:29.9951237Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:04:30.2761385Z 2024-12-18T00:04:30.2762262Z  2024-12-18T00:04:30.2762729Z  2024-12-18T00:04:30.2763106Z  2024-12-18T00:04:30.2763492Z  2024-12-18T00:04:30.2763882Z  2024-12-18T00:04:30.2764262Z  2024-12-18T00:04:30.2764639Z  2024-12-18T00:04:30.2764998Z  2024-12-18T00:04:30.2765565Z [10,164 / 15,187] 48 actions, 47 running 2024-12-18T00:04:30.2766458Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:04:30.2767587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:04:30.2768484Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:04:30.2769169Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:04:30.2769690Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:30.2770175Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:30.2770758Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:04:30.2771485Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:30.4896859Z 2024-12-18T00:04:30.4897742Z  2024-12-18T00:04:30.4898193Z  2024-12-18T00:04:30.4898541Z  2024-12-18T00:04:30.4898919Z  2024-12-18T00:04:30.4899285Z  2024-12-18T00:04:30.4899655Z  2024-12-18T00:04:30.4900075Z  2024-12-18T00:04:30.4900458Z  2024-12-18T00:04:30.4901032Z [10,168 / 15,187] 48 actions running 2024-12-18T00:04:30.4901971Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:04:30.4903043Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:04:30.4903916Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:04:30.4904641Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:04:30.4905336Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:30.4905880Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:04:30.4906460Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:30.4907008Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:30.7282634Z 2024-12-18T00:04:30.7283512Z  2024-12-18T00:04:30.7283950Z  2024-12-18T00:04:30.7284351Z  2024-12-18T00:04:30.7284752Z  2024-12-18T00:04:30.7285149Z  2024-12-18T00:04:30.7285533Z  2024-12-18T00:04:30.7285907Z  2024-12-18T00:04:30.7286296Z  2024-12-18T00:04:30.7287007Z [10,175 / 15,187] 48 actions, 47 running 2024-12-18T00:04:30.7287852Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:04:30.7288910Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:04:30.7289767Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:04:30.7290439Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:04:30.7291115Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:30.7291673Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:30.7292212Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:30.7292755Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:30.9370733Z 2024-12-18T00:04:30.9371658Z  2024-12-18T00:04:30.9372103Z  2024-12-18T00:04:30.9372461Z  2024-12-18T00:04:30.9372825Z  2024-12-18T00:04:30.9373191Z  2024-12-18T00:04:30.9373536Z  2024-12-18T00:04:30.9373873Z  2024-12-18T00:04:30.9374381Z  2024-12-18T00:04:30.9374974Z [10,181 / 15,187] 48 actions, 47 running 2024-12-18T00:04:30.9376277Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:04:30.9377361Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:04:30.9378120Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:04:30.9378827Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:30.9379366Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:30.9380175Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:30.9380750Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:04:30.9381348Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:04:31.2397143Z 2024-12-18T00:04:31.2397985Z  2024-12-18T00:04:31.2398481Z  2024-12-18T00:04:31.2398877Z  2024-12-18T00:04:31.2399281Z  2024-12-18T00:04:31.2399694Z  2024-12-18T00:04:31.2400092Z  2024-12-18T00:04:31.2400501Z  2024-12-18T00:04:31.2400884Z  2024-12-18T00:04:31.2401496Z [10,186 / 15,187] 48 actions, 47 running 2024-12-18T00:04:31.2402509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:04:31.2403481Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:04:31.2404190Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:04:31.2404836Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:31.2405415Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:31.2406045Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:31.2406611Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:31.2407240Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:31.4423836Z 2024-12-18T00:04:31.4424732Z  2024-12-18T00:04:31.4425206Z  2024-12-18T00:04:31.4425625Z  2024-12-18T00:04:31.4426051Z  2024-12-18T00:04:31.4426445Z  2024-12-18T00:04:31.4426826Z  2024-12-18T00:04:31.4427253Z  2024-12-18T00:04:31.4427650Z  2024-12-18T00:04:31.4428260Z [10,187 / 15,187] 48 actions, 47 running 2024-12-18T00:04:31.4429273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:04:31.4430235Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:04:31.4430955Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:04:31.4431671Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:04:31.4432261Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:31.4433026Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:31.4433563Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:31.4434156Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:04:31.6675519Z 2024-12-18T00:04:31.6676385Z  2024-12-18T00:04:31.6676873Z  2024-12-18T00:04:31.6677310Z  2024-12-18T00:04:31.6677730Z  2024-12-18T00:04:31.6678128Z  2024-12-18T00:04:31.6678536Z  2024-12-18T00:04:31.6678954Z  2024-12-18T00:04:31.6679373Z  2024-12-18T00:04:31.6680005Z [10,199 / 15,187] 48 actions, 47 running 2024-12-18T00:04:31.6681040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:04:31.6682034Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:04:31.6682840Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:04:31.6683563Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:04:31.6684168Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:31.6684792Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:31.6685614Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 6s local 2024-12-18T00:04:31.6686569Z @llvm-project//llvm:ExecutionEngine; 5s local ... 2024-12-18T00:04:31.8872104Z 2024-12-18T00:04:31.8872954Z  2024-12-18T00:04:31.8873427Z  2024-12-18T00:04:31.8873961Z  2024-12-18T00:04:31.8874359Z  2024-12-18T00:04:31.8874748Z  2024-12-18T00:04:31.8875162Z  2024-12-18T00:04:31.8875573Z  2024-12-18T00:04:31.8875985Z  2024-12-18T00:04:31.8876567Z [10,203 / 15,187] 48 actions, 47 running 2024-12-18T00:04:31.8877930Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:04:31.8878920Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:04:31.8879705Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:04:31.8880440Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:04:31.8881271Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:31.8882064Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 6s local 2024-12-18T00:04:31.8883237Z Compiling llvm/lib/ExecutionEngine/RuntimeDyld/RuntimeDyld.cpp; 6s local 2024-12-18T00:04:31.8884257Z @llvm-project//llvm:ExecutionEngine; 5s local ... 2024-12-18T00:04:32.0908543Z 2024-12-18T00:04:32.0909368Z  2024-12-18T00:04:32.0909854Z  2024-12-18T00:04:32.0910281Z  2024-12-18T00:04:32.0910689Z  2024-12-18T00:04:32.0911104Z  2024-12-18T00:04:32.0911509Z  2024-12-18T00:04:32.0911925Z  2024-12-18T00:04:32.0912372Z  2024-12-18T00:04:32.0912976Z [10,209 / 15,187] 48 actions running 2024-12-18T00:04:32.0913919Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:04:32.0914884Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:04:32.0915608Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:04:32.0916334Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:04:32.0917163Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 6s local 2024-12-18T00:04:32.0918315Z Compiling llvm/lib/ExecutionEngine/RuntimeDyld/RuntimeDyld.cpp; 6s local 2024-12-18T00:04:32.0919335Z @llvm-project//llvm:ExecutionEngine; 5s local 2024-12-18T00:04:32.0920085Z @llvm-project//mlir:mlir-tblgen; 4s local ... 2024-12-18T00:04:32.4467491Z 2024-12-18T00:04:32.4468328Z  2024-12-18T00:04:32.4468791Z  2024-12-18T00:04:32.4469216Z  2024-12-18T00:04:32.4469637Z  2024-12-18T00:04:32.4470046Z  2024-12-18T00:04:32.4470492Z  2024-12-18T00:04:32.4470885Z  2024-12-18T00:04:32.4471290Z  2024-12-18T00:04:32.4471904Z [10,213 / 15,187] 48 actions, 47 running 2024-12-18T00:04:32.4472879Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:04:32.4473848Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:04:32.4474624Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:04:32.4475354Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:04:32.4476183Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 7s local 2024-12-18T00:04:32.4477331Z Compiling llvm/lib/ExecutionEngine/RuntimeDyld/RuntimeDyld.cpp; 6s local 2024-12-18T00:04:32.4478334Z @llvm-project//llvm:ExecutionEngine; 6s local 2024-12-18T00:04:32.4479053Z @llvm-project//mlir:mlir-tblgen; 4s local ... 2024-12-18T00:04:32.6915454Z 2024-12-18T00:04:32.6916309Z  2024-12-18T00:04:32.6916804Z  2024-12-18T00:04:32.6917270Z  2024-12-18T00:04:32.6917654Z  2024-12-18T00:04:32.6918057Z  2024-12-18T00:04:32.6918431Z  2024-12-18T00:04:32.6918795Z  2024-12-18T00:04:32.6919142Z  2024-12-18T00:04:32.6919701Z [10,219 / 15,187] 48 actions running 2024-12-18T00:04:32.6920609Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:04:32.6921516Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:04:32.6922244Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:04:32.6923140Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 7s local 2024-12-18T00:04:32.6924234Z Compiling llvm/lib/ExecutionEngine/RuntimeDyld/RuntimeDyld.cpp; 7s local 2024-12-18T00:04:32.6925199Z @llvm-project//llvm:ExecutionEngine; 6s local 2024-12-18T00:04:32.6926136Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 5s local 2024-12-18T00:04:32.6927259Z @llvm-project//mlir:mlir-tblgen; 3s local ... 2024-12-18T00:04:32.9755082Z 2024-12-18T00:04:32.9755960Z  2024-12-18T00:04:32.9756453Z  2024-12-18T00:04:32.9756830Z  2024-12-18T00:04:32.9757213Z  2024-12-18T00:04:32.9757576Z  2024-12-18T00:04:32.9757975Z  2024-12-18T00:04:32.9758320Z  2024-12-18T00:04:32.9758705Z  2024-12-18T00:04:32.9759284Z [10,221 / 15,187] 48 actions, 47 running 2024-12-18T00:04:32.9760531Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:04:32.9761492Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:04:32.9762201Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:04:32.9763108Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 7s local 2024-12-18T00:04:32.9763943Z @llvm-project//llvm:ExecutionEngine; 6s local 2024-12-18T00:04:32.9764822Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 5s local 2024-12-18T00:04:32.9765740Z @llvm-project//mlir:mlir-tblgen; 3s local 2024-12-18T00:04:32.9766614Z Compiling llvm/lib/MC/MCDisassembler/Disassembler.cpp; 2s local ... 2024-12-18T00:04:33.2921518Z 2024-12-18T00:04:33.2922325Z  2024-12-18T00:04:33.2922799Z  2024-12-18T00:04:33.2923220Z  2024-12-18T00:04:33.2923622Z  2024-12-18T00:04:33.2924041Z  2024-12-18T00:04:33.2924431Z  2024-12-18T00:04:33.2924793Z  2024-12-18T00:04:33.2925219Z  2024-12-18T00:04:33.2925825Z [10,221 / 15,187] 48 actions running 2024-12-18T00:04:33.2926797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:04:33.2927742Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:04:33.2928481Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:04:33.2929378Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 8s local 2024-12-18T00:04:33.2930272Z @llvm-project//llvm:ExecutionEngine; 6s local 2024-12-18T00:04:33.2931224Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 5s local 2024-12-18T00:04:33.2932179Z @llvm-project//mlir:mlir-tblgen; 3s local 2024-12-18T00:04:33.2933046Z Compiling llvm/lib/MC/MCDisassembler/Disassembler.cpp; 2s local ... 2024-12-18T00:04:33.6219377Z 2024-12-18T00:04:33.6220232Z  2024-12-18T00:04:33.6220733Z  2024-12-18T00:04:33.6221101Z  2024-12-18T00:04:33.6221490Z  2024-12-18T00:04:33.6221935Z  2024-12-18T00:04:33.6222337Z  2024-12-18T00:04:33.6222724Z  2024-12-18T00:04:33.6223096Z  2024-12-18T00:04:33.6223710Z [10,222 / 15,187] 48 actions, 47 running 2024-12-18T00:04:33.6224684Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:04:33.6225614Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:04:33.6226390Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:04:33.6227436Z Compiling llvm/lib/ExecutionEngine/ExecutionEngine.cpp; 8s local 2024-12-18T00:04:33.6228357Z @llvm-project//llvm:ExecutionEngine; 7s local 2024-12-18T00:04:33.6229315Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 5s local 2024-12-18T00:04:33.6230220Z @llvm-project//mlir:mlir-tblgen; 4s local 2024-12-18T00:04:33.6231066Z Compiling llvm/lib/MC/MCDisassembler/Disassembler.cpp; 3s local ... 2024-12-18T00:04:33.8215996Z 2024-12-18T00:04:33.8217022Z  2024-12-18T00:04:33.8217537Z  2024-12-18T00:04:33.8217916Z  2024-12-18T00:04:33.8218279Z  2024-12-18T00:04:33.8218663Z  2024-12-18T00:04:33.8219056Z  2024-12-18T00:04:33.8219439Z  2024-12-18T00:04:33.8219805Z  2024-12-18T00:04:33.8220346Z [10,224 / 15,187] 48 actions, 47 running 2024-12-18T00:04:33.8221261Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:04:33.8222174Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:04:33.8222894Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:04:33.8223983Z @llvm-project//llvm:ExecutionEngine; 7s local 2024-12-18T00:04:33.8224879Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 6s local 2024-12-18T00:04:33.8225690Z @llvm-project//mlir:mlir-tblgen; 4s local 2024-12-18T00:04:33.8226336Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 2s local 2024-12-18T00:04:33.8227413Z Compiling llvm/lib/Passes/PassBuilder.cpp; 2s local ... 2024-12-18T00:04:34.0929794Z 2024-12-18T00:04:34.0930696Z  2024-12-18T00:04:34.0931166Z  2024-12-18T00:04:34.0931548Z  2024-12-18T00:04:34.0931938Z  2024-12-18T00:04:34.0932321Z  2024-12-18T00:04:34.0932713Z  2024-12-18T00:04:34.0933087Z  2024-12-18T00:04:34.0933475Z  2024-12-18T00:04:34.0933988Z [10,224 / 15,187] 48 actions running 2024-12-18T00:04:34.0934910Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:04:34.0935836Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:04:34.0936784Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:04:34.0937454Z @llvm-project//llvm:ExecutionEngine; 7s local 2024-12-18T00:04:34.0938320Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 6s local 2024-12-18T00:04:34.0939199Z @llvm-project//mlir:mlir-tblgen; 4s local 2024-12-18T00:04:34.0939876Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 3s local 2024-12-18T00:04:34.0940596Z Compiling llvm/lib/Passes/PassBuilder.cpp; 3s local ... 2024-12-18T00:04:34.4935305Z 2024-12-18T00:04:34.4936116Z  2024-12-18T00:04:34.4936685Z  2024-12-18T00:04:34.4937024Z  2024-12-18T00:04:34.4937384Z  2024-12-18T00:04:34.4937744Z  2024-12-18T00:04:34.4938103Z  2024-12-18T00:04:34.4938453Z  2024-12-18T00:04:34.4938784Z  2024-12-18T00:04:34.4939286Z [10,225 / 15,187] 48 actions running 2024-12-18T00:04:34.4940087Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:04:34.4940936Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:04:34.4941561Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:04:34.4942197Z @llvm-project//llvm:ExecutionEngine; 8s local 2024-12-18T00:04:34.4943033Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 6s local 2024-12-18T00:04:34.4943897Z @llvm-project//mlir:mlir-tblgen; 5s local 2024-12-18T00:04:34.4944889Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 3s local 2024-12-18T00:04:34.4945684Z Compiling llvm/lib/Passes/PassBuilder.cpp; 3s local ... 2024-12-18T00:04:35.2858683Z 2024-12-18T00:04:35.2859521Z  2024-12-18T00:04:35.2859902Z  2024-12-18T00:04:35.2860215Z  2024-12-18T00:04:35.2860531Z  2024-12-18T00:04:35.2860828Z  2024-12-18T00:04:35.2861142Z  2024-12-18T00:04:35.2861454Z  2024-12-18T00:04:35.2861773Z  2024-12-18T00:04:35.2862251Z [10,226 / 15,187] 48 actions, 47 running 2024-12-18T00:04:35.2862982Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:04:35.2863971Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:04:35.2864541Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:04:35.2865136Z @llvm-project//llvm:ExecutionEngine; 8s local 2024-12-18T00:04:35.2865861Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 7s local 2024-12-18T00:04:35.2866545Z @llvm-project//mlir:mlir-tblgen; 5s local 2024-12-18T00:04:35.2867160Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 4s local 2024-12-18T00:04:35.2867862Z Compiling llvm/lib/Passes/PassBuilder.cpp; 4s local ... 2024-12-18T00:04:35.4945568Z 2024-12-18T00:04:35.4946435Z  2024-12-18T00:04:35.4946902Z  2024-12-18T00:04:35.4947293Z  2024-12-18T00:04:35.4947666Z  2024-12-18T00:04:35.4948070Z  2024-12-18T00:04:35.4948451Z  2024-12-18T00:04:35.4948841Z  2024-12-18T00:04:35.4949631Z  2024-12-18T00:04:35.4950173Z [10,228 / 15,187] 48 actions running 2024-12-18T00:04:35.4951084Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:04:35.4952010Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:04:35.4952740Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:04:35.4953673Z @llvm-project//llvm:ExecutionEngine; 9s local 2024-12-18T00:04:35.4954585Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 7s local 2024-12-18T00:04:35.4955486Z @llvm-project//mlir:mlir-tblgen; 6s local 2024-12-18T00:04:35.4956241Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 4s local 2024-12-18T00:04:35.4957118Z Compiling llvm/lib/Passes/PassBuilder.cpp; 4s local ... 2024-12-18T00:04:35.7525093Z 2024-12-18T00:04:35.7525934Z  2024-12-18T00:04:35.7526417Z  2024-12-18T00:04:35.7526763Z  2024-12-18T00:04:35.7527069Z  2024-12-18T00:04:35.7527456Z  2024-12-18T00:04:35.7527764Z  2024-12-18T00:04:35.7528074Z  2024-12-18T00:04:35.7528401Z  2024-12-18T00:04:35.7528878Z [10,231 / 15,187] 48 actions, 47 running 2024-12-18T00:04:35.7529622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:04:35.7530605Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:04:35.7531338Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:04:35.7532023Z @llvm-project//llvm:ExecutionEngine; 9s local 2024-12-18T00:04:35.7532896Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 8s local 2024-12-18T00:04:35.7533935Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 4s local 2024-12-18T00:04:35.7534730Z Compiling llvm/lib/Passes/PassBuilder.cpp; 4s local 2024-12-18T00:04:35.7535634Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 4s local ... 2024-12-18T00:04:35.9548651Z 2024-12-18T00:04:35.9549522Z  2024-12-18T00:04:35.9550146Z  2024-12-18T00:04:35.9550616Z  2024-12-18T00:04:35.9551081Z  2024-12-18T00:04:35.9551545Z  2024-12-18T00:04:35.9552040Z  2024-12-18T00:04:35.9552507Z  2024-12-18T00:04:35.9552994Z  2024-12-18T00:04:35.9553672Z [10,235 / 15,187] 48 actions, 47 running 2024-12-18T00:04:35.9554677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:04:35.9555542Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:04:35.9556212Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:04:35.9556866Z @llvm-project//llvm:ExecutionEngine; 9s local 2024-12-18T00:04:35.9557656Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 5s local 2024-12-18T00:04:35.9558487Z Compiling llvm/lib/Passes/PassBuilder.cpp; 5s local 2024-12-18T00:04:35.9559332Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 4s local 2024-12-18T00:04:35.9560325Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 4s local ... 2024-12-18T00:04:36.2953738Z 2024-12-18T00:04:36.2954637Z  2024-12-18T00:04:36.2955126Z  2024-12-18T00:04:36.2955522Z  2024-12-18T00:04:36.2955898Z  2024-12-18T00:04:36.2956286Z  2024-12-18T00:04:36.2956684Z  2024-12-18T00:04:36.2957064Z  2024-12-18T00:04:36.2957457Z  2024-12-18T00:04:36.2958035Z [10,236 / 15,187] 48 actions running 2024-12-18T00:04:36.2958935Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:04:36.2959871Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:04:36.2960593Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:04:36.2961355Z @llvm-project//llvm:ExecutionEngine; 9s local 2024-12-18T00:04:36.2962138Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 5s local 2024-12-18T00:04:36.2962986Z Compiling llvm/lib/Passes/PassBuilder.cpp; 5s local 2024-12-18T00:04:36.2963790Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 5s local 2024-12-18T00:04:36.2965230Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 5s local ... 2024-12-18T00:04:36.4957860Z 2024-12-18T00:04:36.4958790Z  2024-12-18T00:04:36.4959356Z  2024-12-18T00:04:36.4959814Z  2024-12-18T00:04:36.4960282Z  2024-12-18T00:04:36.4960767Z  2024-12-18T00:04:36.4961217Z  2024-12-18T00:04:36.4961599Z  2024-12-18T00:04:36.4962418Z  2024-12-18T00:04:36.4963026Z [10,237 / 15,187] 48 actions running 2024-12-18T00:04:36.4963941Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:04:36.4964854Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:04:36.4965560Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:04:36.4966388Z @llvm-project//llvm:ExecutionEngine; 10s local 2024-12-18T00:04:36.4967285Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 5s local 2024-12-18T00:04:36.4968177Z Compiling llvm/lib/Passes/PassBuilder.cpp; 5s local 2024-12-18T00:04:36.4969208Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 5s local 2024-12-18T00:04:36.4970331Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 5s local ... 2024-12-18T00:04:36.7608712Z 2024-12-18T00:04:36.7609466Z  2024-12-18T00:04:36.7609878Z  2024-12-18T00:04:36.7610240Z  2024-12-18T00:04:36.7610581Z  2024-12-18T00:04:36.7610957Z  2024-12-18T00:04:36.7611307Z  2024-12-18T00:04:36.7611659Z  2024-12-18T00:04:36.7611977Z  2024-12-18T00:04:36.7612516Z [10,239 / 15,187] 48 actions, 47 running 2024-12-18T00:04:36.7613505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:04:36.7614321Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:04:36.7614968Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:04:36.7615638Z @llvm-project//llvm:ExecutionEngine; 10s local 2024-12-18T00:04:36.7616383Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 5s local 2024-12-18T00:04:36.7617376Z Compiling llvm/lib/Passes/PassBuilder.cpp; 5s local 2024-12-18T00:04:36.7618160Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 5s local 2024-12-18T00:04:36.7619052Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 5s local ... 2024-12-18T00:04:37.0963222Z 2024-12-18T00:04:37.0964069Z  2024-12-18T00:04:37.0964564Z  2024-12-18T00:04:37.0964935Z  2024-12-18T00:04:37.0965342Z  2024-12-18T00:04:37.0965693Z  2024-12-18T00:04:37.0969048Z  2024-12-18T00:04:37.0969498Z  2024-12-18T00:04:37.0969889Z  2024-12-18T00:04:37.0970436Z [10,240 / 15,187] 48 actions running 2024-12-18T00:04:37.0971290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:04:37.0972112Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:04:37.0972789Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:04:37.0973500Z @llvm-project//llvm:ExecutionEngine; 10s local 2024-12-18T00:04:37.0974248Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 6s local 2024-12-18T00:04:37.0974994Z Compiling llvm/lib/Passes/PassBuilder.cpp; 6s local 2024-12-18T00:04:37.0975801Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 6s local 2024-12-18T00:04:37.0976909Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 6s local ... 2024-12-18T00:04:37.2967940Z 2024-12-18T00:04:37.2968732Z  2024-12-18T00:04:37.2969185Z  2024-12-18T00:04:37.2969577Z  2024-12-18T00:04:37.2969955Z  2024-12-18T00:04:37.2970344Z  2024-12-18T00:04:37.2970702Z  2024-12-18T00:04:37.2971038Z  2024-12-18T00:04:37.2971409Z  2024-12-18T00:04:37.2972118Z [10,243 / 15,187] 48 actions running 2024-12-18T00:04:37.2972997Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:04:37.2973913Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:04:37.2975073Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:04:37.2975798Z @llvm-project//llvm:ExecutionEngine; 10s local 2024-12-18T00:04:37.2976786Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 6s local 2024-12-18T00:04:37.2977622Z Compiling llvm/lib/Passes/PassBuilder.cpp; 6s local 2024-12-18T00:04:37.2978734Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 6s local 2024-12-18T00:04:37.2979869Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 6s local ... 2024-12-18T00:04:37.5366604Z 2024-12-18T00:04:37.5367514Z  2024-12-18T00:04:37.5368088Z  2024-12-18T00:04:37.5368586Z  2024-12-18T00:04:37.5369084Z  2024-12-18T00:04:37.5369549Z  2024-12-18T00:04:37.5369893Z  2024-12-18T00:04:37.5370245Z  2024-12-18T00:04:37.5370623Z  2024-12-18T00:04:37.5371241Z [10,244 / 15,187] 48 actions, 47 running 2024-12-18T00:04:37.5372269Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:04:37.5373235Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:04:37.5373880Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:04:37.5374547Z @llvm-project//llvm:ExecutionEngine; 11s local 2024-12-18T00:04:37.5375216Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 6s local 2024-12-18T00:04:37.5375831Z Compiling llvm/lib/Passes/PassBuilder.cpp; 6s local 2024-12-18T00:04:37.5376798Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 6s local 2024-12-18T00:04:37.5377650Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 6s local ... 2024-12-18T00:04:37.8212140Z 2024-12-18T00:04:37.8213015Z  2024-12-18T00:04:37.8213473Z  2024-12-18T00:04:37.8213944Z  2024-12-18T00:04:37.8214432Z  2024-12-18T00:04:37.8214802Z  2024-12-18T00:04:37.8215164Z  2024-12-18T00:04:37.8215538Z  2024-12-18T00:04:37.8215915Z  2024-12-18T00:04:37.8216685Z [10,248 / 15,187] 48 actions, 47 running 2024-12-18T00:04:37.8217687Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:04:37.8218623Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:04:37.8219317Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:04:37.8220019Z @llvm-project//llvm:ExecutionEngine; 11s local 2024-12-18T00:04:37.8220882Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 6s local 2024-12-18T00:04:37.8221642Z Compiling llvm/lib/Passes/PassBuilder.cpp; 6s local 2024-12-18T00:04:37.8222484Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 6s local 2024-12-18T00:04:37.8223407Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 6s local ... 2024-12-18T00:04:38.0976854Z 2024-12-18T00:04:38.0977733Z  2024-12-18T00:04:38.0978170Z  2024-12-18T00:04:38.0978558Z  2024-12-18T00:04:38.0978959Z  2024-12-18T00:04:38.0979364Z  2024-12-18T00:04:38.0979758Z  2024-12-18T00:04:38.0980174Z  2024-12-18T00:04:38.0980560Z  2024-12-18T00:04:38.0981130Z [10,249 / 15,187] 48 actions running 2024-12-18T00:04:38.0982054Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:04:38.0982922Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:04:38.0983605Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:04:38.0984381Z @llvm-project//llvm:ExecutionEngine; 11s local 2024-12-18T00:04:38.0985152Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 7s local 2024-12-18T00:04:38.0985985Z Compiling llvm/lib/Passes/PassBuilder.cpp; 7s local 2024-12-18T00:04:38.0986852Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 7s local 2024-12-18T00:04:38.0987780Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 7s local ... 2024-12-18T00:04:38.3620852Z 2024-12-18T00:04:38.3621680Z  2024-12-18T00:04:38.3622071Z  2024-12-18T00:04:38.3622435Z  2024-12-18T00:04:38.3622793Z  2024-12-18T00:04:38.3623563Z  2024-12-18T00:04:38.3623924Z  2024-12-18T00:04:38.3624269Z  2024-12-18T00:04:38.3624642Z  2024-12-18T00:04:38.3625218Z [10,251 / 15,187] 48 actions, 47 running 2024-12-18T00:04:38.3626095Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:04:38.3626978Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:04:38.3627928Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:04:38.3628676Z @llvm-project//llvm:ExecutionEngine; 12s local 2024-12-18T00:04:38.3629443Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 7s local 2024-12-18T00:04:38.3630264Z Compiling llvm/lib/Passes/PassBuilder.cpp; 7s local 2024-12-18T00:04:38.3631063Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 7s local 2024-12-18T00:04:38.3631773Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 7s local ... 2024-12-18T00:04:38.6981858Z 2024-12-18T00:04:38.6982666Z  2024-12-18T00:04:38.6983181Z  2024-12-18T00:04:38.6983595Z  2024-12-18T00:04:38.6983960Z  2024-12-18T00:04:38.6984351Z  2024-12-18T00:04:38.6984742Z  2024-12-18T00:04:38.6985122Z  2024-12-18T00:04:38.6985520Z  2024-12-18T00:04:38.6986051Z [10,254 / 15,187] 48 actions running 2024-12-18T00:04:38.6986923Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:04:38.6987971Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:04:38.6988827Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:04:38.6989558Z @llvm-project//llvm:ExecutionEngine; 12s local 2024-12-18T00:04:38.6990294Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 7s local 2024-12-18T00:04:38.6991123Z Compiling llvm/lib/Passes/PassBuilder.cpp; 7s local 2024-12-18T00:04:38.6991952Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 7s local 2024-12-18T00:04:38.6992903Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 7s local ... 2024-12-18T00:04:39.1537577Z 2024-12-18T00:04:39.1538514Z  2024-12-18T00:04:39.1538909Z  2024-12-18T00:04:39.1539248Z  2024-12-18T00:04:39.1539598Z  2024-12-18T00:04:39.1539940Z  2024-12-18T00:04:39.1540284Z  2024-12-18T00:04:39.1540665Z  2024-12-18T00:04:39.1541057Z  2024-12-18T00:04:39.1541685Z [10,255 / 15,187] 48 actions, 47 running 2024-12-18T00:04:39.1542560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:04:39.1543627Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:04:39.1544777Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:04:39.1545525Z @llvm-project//llvm:ExecutionEngine; 12s local 2024-12-18T00:04:39.1546277Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 8s local 2024-12-18T00:04:39.1547109Z Compiling llvm/lib/Passes/PassBuilder.cpp; 8s local 2024-12-18T00:04:39.1547918Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 8s local 2024-12-18T00:04:39.1548914Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 8s local ... 2024-12-18T00:04:39.4992326Z 2024-12-18T00:04:39.4993225Z  2024-12-18T00:04:39.4993652Z  2024-12-18T00:04:39.4993992Z  2024-12-18T00:04:39.4994364Z  2024-12-18T00:04:39.4994724Z  2024-12-18T00:04:39.4995099Z  2024-12-18T00:04:39.4995421Z  2024-12-18T00:04:39.4995751Z  2024-12-18T00:04:39.4996161Z [10,260 / 15,187] 48 actions running 2024-12-18T00:04:39.4996851Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:04:39.4997579Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:04:39.4998202Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:04:39.4999105Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 8s local 2024-12-18T00:04:39.5000155Z Compiling llvm/lib/Passes/PassBuilder.cpp; 8s local 2024-12-18T00:04:39.5001171Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 8s local 2024-12-18T00:04:39.5002533Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 8s local 2024-12-18T00:04:39.5003488Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local ... 2024-12-18T00:04:39.6995478Z 2024-12-18T00:04:39.6996343Z  2024-12-18T00:04:39.6997078Z  2024-12-18T00:04:39.6997602Z  2024-12-18T00:04:39.6998583Z  2024-12-18T00:04:39.6999154Z  2024-12-18T00:04:39.6999650Z  2024-12-18T00:04:39.7000164Z  2024-12-18T00:04:39.7000520Z  2024-12-18T00:04:39.7001041Z [10,263 / 15,187] 48 actions running 2024-12-18T00:04:39.7001901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:04:39.7002859Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:04:39.7003758Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:04:39.7004796Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 8s local 2024-12-18T00:04:39.7005677Z Compiling llvm/lib/Passes/PassBuilder.cpp; 8s local 2024-12-18T00:04:39.7006657Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 8s local 2024-12-18T00:04:39.7007532Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 8s local 2024-12-18T00:04:39.7008707Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local ... 2024-12-18T00:04:39.9995206Z 2024-12-18T00:04:39.9996113Z  2024-12-18T00:04:39.9996740Z  2024-12-18T00:04:39.9997117Z  2024-12-18T00:04:39.9997518Z  2024-12-18T00:04:39.9997891Z  2024-12-18T00:04:39.9998257Z  2024-12-18T00:04:39.9998638Z  2024-12-18T00:04:39.9999013Z  2024-12-18T00:04:39.9999588Z [10,268 / 15,187] 48 actions, 47 running 2024-12-18T00:04:40.0000499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:04:40.0001436Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:04:40.0002177Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:04:40.0003081Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 9s local 2024-12-18T00:04:40.0003916Z Compiling llvm/lib/Passes/PassBuilder.cpp; 9s local 2024-12-18T00:04:40.0004756Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local 2024-12-18T00:04:40.0005629Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 8s local 2024-12-18T00:04:40.0006657Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local ... 2024-12-18T00:04:40.2007180Z 2024-12-18T00:04:40.2008072Z  2024-12-18T00:04:40.2008535Z  2024-12-18T00:04:40.2008962Z  2024-12-18T00:04:40.2009355Z  2024-12-18T00:04:40.2009731Z  2024-12-18T00:04:40.2010127Z  2024-12-18T00:04:40.2010512Z  2024-12-18T00:04:40.2010885Z  2024-12-18T00:04:40.2011486Z [10,274 / 15,187] 48 actions, 47 running 2024-12-18T00:04:40.2012422Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:04:40.2013388Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:04:40.2014118Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:04:40.2015006Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 9s local 2024-12-18T00:04:40.2015821Z Compiling llvm/lib/Passes/PassBuilder.cpp; 9s local 2024-12-18T00:04:40.2016891Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local 2024-12-18T00:04:40.2017905Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 9s local 2024-12-18T00:04:40.2018974Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local ... 2024-12-18T00:04:40.5003154Z 2024-12-18T00:04:40.5004002Z  2024-12-18T00:04:40.5004399Z  2024-12-18T00:04:40.5004692Z  2024-12-18T00:04:40.5004993Z  2024-12-18T00:04:40.5005294Z  2024-12-18T00:04:40.5005587Z  2024-12-18T00:04:40.5005925Z  2024-12-18T00:04:40.5006290Z  2024-12-18T00:04:40.5006843Z [10,276 / 15,187] 48 actions running 2024-12-18T00:04:40.5008334Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:04:40.5009278Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:04:40.5010008Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:04:40.5010824Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 9s local 2024-12-18T00:04:40.5011881Z Compiling llvm/lib/Passes/PassBuilder.cpp; 9s local 2024-12-18T00:04:40.5012782Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local 2024-12-18T00:04:40.5013617Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 9s local 2024-12-18T00:04:40.5014532Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 9s local ... 2024-12-18T00:04:40.7007864Z 2024-12-18T00:04:40.7008736Z  2024-12-18T00:04:40.7009216Z  2024-12-18T00:04:40.7009606Z  2024-12-18T00:04:40.7009983Z  2024-12-18T00:04:40.7010373Z  2024-12-18T00:04:40.7010755Z  2024-12-18T00:04:40.7011140Z  2024-12-18T00:04:40.7011578Z  2024-12-18T00:04:40.7012137Z [10,280 / 15,187] 48 actions running 2024-12-18T00:04:40.7013048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:04:40.7014000Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:04:40.7014743Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:04:40.7015620Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 9s local 2024-12-18T00:04:40.7016651Z Compiling llvm/lib/Passes/PassBuilder.cpp; 9s local 2024-12-18T00:04:40.7017525Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local 2024-12-18T00:04:40.7018526Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 9s local 2024-12-18T00:04:40.7019488Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 9s local ... 2024-12-18T00:04:40.9603815Z 2024-12-18T00:04:40.9604650Z  2024-12-18T00:04:40.9605139Z  2024-12-18T00:04:40.9615882Z  2024-12-18T00:04:40.9616363Z  2024-12-18T00:04:40.9616945Z  2024-12-18T00:04:40.9617343Z  2024-12-18T00:04:40.9617783Z  2024-12-18T00:04:40.9618189Z  2024-12-18T00:04:40.9618821Z [10,283 / 15,187] 48 actions, 47 running 2024-12-18T00:04:40.9619833Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:04:40.9620742Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:04:40.9621400Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:04:40.9622213Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 10s local 2024-12-18T00:04:40.9623057Z Compiling llvm/lib/Passes/PassBuilder.cpp; 10s local 2024-12-18T00:04:40.9623827Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local 2024-12-18T00:04:40.9624718Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 9s local 2024-12-18T00:04:40.9625679Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 9s local ... 2024-12-18T00:04:41.3015405Z 2024-12-18T00:04:41.3016227Z  2024-12-18T00:04:41.3016866Z  2024-12-18T00:04:41.3017256Z  2024-12-18T00:04:41.3017615Z  2024-12-18T00:04:41.3017967Z  2024-12-18T00:04:41.3018336Z  2024-12-18T00:04:41.3018719Z  2024-12-18T00:04:41.3019094Z  2024-12-18T00:04:41.3019612Z [10,285 / 15,187] 48 actions running 2024-12-18T00:04:41.3020457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:04:41.3021281Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:04:41.3021943Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:04:41.3022676Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 10s local 2024-12-18T00:04:41.3023436Z Compiling llvm/lib/Passes/PassBuilder.cpp; 10s local 2024-12-18T00:04:41.3024190Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 10s local 2024-12-18T00:04:41.3025033Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 10s local 2024-12-18T00:04:41.3026387Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local ... 2024-12-18T00:04:41.6527139Z 2024-12-18T00:04:41.6527974Z  2024-12-18T00:04:41.6528369Z  2024-12-18T00:04:41.6528725Z  2024-12-18T00:04:41.6529075Z  2024-12-18T00:04:41.6529420Z  2024-12-18T00:04:41.6529757Z  2024-12-18T00:04:41.6530114Z  2024-12-18T00:04:41.6530451Z  2024-12-18T00:04:41.6531341Z [10,286 / 15,187] 48 actions, 47 running 2024-12-18T00:04:41.6532154Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:04:41.6532957Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:04:41.6533575Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:04:41.6534344Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 10s local 2024-12-18T00:04:41.6535154Z Compiling llvm/lib/Passes/PassBuilder.cpp; 10s local 2024-12-18T00:04:41.6535921Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 10s local 2024-12-18T00:04:41.6536936Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 10s local 2024-12-18T00:04:41.6537917Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local ... 2024-12-18T00:04:41.9019780Z 2024-12-18T00:04:41.9020579Z  2024-12-18T00:04:41.9020995Z  2024-12-18T00:04:41.9021352Z  2024-12-18T00:04:41.9021664Z  2024-12-18T00:04:41.9021969Z  2024-12-18T00:04:41.9022370Z  2024-12-18T00:04:41.9022722Z  2024-12-18T00:04:41.9023064Z  2024-12-18T00:04:41.9023602Z [10,286 / 15,187] 48 actions running 2024-12-18T00:04:41.9024335Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:04:41.9025156Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:04:41.9025804Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:04:41.9026546Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 11s local 2024-12-18T00:04:41.9027317Z Compiling llvm/lib/Passes/PassBuilder.cpp; 10s local 2024-12-18T00:04:41.9028129Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 10s local 2024-12-18T00:04:41.9028931Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 10s local 2024-12-18T00:04:41.9029780Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local ... 2024-12-18T00:04:42.1023509Z 2024-12-18T00:04:42.1024320Z  2024-12-18T00:04:42.1024754Z  2024-12-18T00:04:42.1025096Z  2024-12-18T00:04:42.1025431Z  2024-12-18T00:04:42.1025758Z  2024-12-18T00:04:42.1026071Z  2024-12-18T00:04:42.1026401Z  2024-12-18T00:04:42.1026734Z  2024-12-18T00:04:42.1027236Z [10,288 / 15,187] 48 actions, 47 running 2024-12-18T00:04:42.1028001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:04:42.1028737Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:04:42.1029346Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:04:42.1030074Z Compiling llvm/lib/Passes/CodeGenPassBuilder.cpp; 11s local 2024-12-18T00:04:42.1030790Z Compiling llvm/lib/Passes/PassBuilder.cpp; 11s local 2024-12-18T00:04:42.1031511Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 11s local 2024-12-18T00:04:42.1032286Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 11s local 2024-12-18T00:04:42.1033164Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local ... 2024-12-18T00:04:42.3176827Z 2024-12-18T00:04:42.3177675Z  2024-12-18T00:04:42.3178109Z  2024-12-18T00:04:42.3178472Z  2024-12-18T00:04:42.3178823Z  2024-12-18T00:04:42.3179203Z  2024-12-18T00:04:42.3179535Z  2024-12-18T00:04:42.3179883Z  2024-12-18T00:04:42.3180230Z  2024-12-18T00:04:42.3180767Z [10,291 / 15,187] 48 actions, 47 running 2024-12-18T00:04:42.3181591Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:04:42.3182595Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:04:42.3183530Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:04:42.3184150Z Compiling llvm/lib/Passes/PassBuilder.cpp; 11s local 2024-12-18T00:04:42.3184834Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 11s local 2024-12-18T00:04:42.3185596Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 11s local 2024-12-18T00:04:42.3186541Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:04:42.3187467Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 10s local ... 2024-12-18T00:04:42.5243420Z 2024-12-18T00:04:42.5244490Z  2024-12-18T00:04:42.5244927Z  2024-12-18T00:04:42.5245279Z  2024-12-18T00:04:42.5245602Z  2024-12-18T00:04:42.5245937Z  2024-12-18T00:04:42.5246267Z  2024-12-18T00:04:42.5246600Z  2024-12-18T00:04:42.5246908Z  2024-12-18T00:04:42.5247467Z [10,301 / 15,187] 48 actions, 47 running 2024-12-18T00:04:42.5248439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:04:42.5249369Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:04:42.5250106Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:04:42.5250924Z Compiling llvm/lib/Passes/PassBuilder.cpp; 11s local 2024-12-18T00:04:42.5251861Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 11s local 2024-12-18T00:04:42.5252864Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:04:42.5253954Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 10s local 2024-12-18T00:04:42.5255033Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 10s local ... 2024-12-18T00:04:42.7332842Z 2024-12-18T00:04:42.7333717Z  2024-12-18T00:04:42.7334177Z  2024-12-18T00:04:42.7334582Z  2024-12-18T00:04:42.7334972Z  2024-12-18T00:04:42.7335335Z  2024-12-18T00:04:42.7335726Z  2024-12-18T00:04:42.7336127Z  2024-12-18T00:04:42.7336746Z  2024-12-18T00:04:42.7337340Z [10,309 / 15,187] 48 actions, 47 running 2024-12-18T00:04:42.7338314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:04:42.7339304Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:04:42.7340050Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:04:42.7340927Z Compiling llvm/lib/Passes/PassBuilder.cpp; 11s local 2024-12-18T00:04:42.7341690Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 11s local 2024-12-18T00:04:42.7342780Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:04:42.7343663Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 11s local 2024-12-18T00:04:42.7344914Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 11s local ... 2024-12-18T00:04:43.0105951Z 2024-12-18T00:04:43.0106775Z  2024-12-18T00:04:43.0107313Z  2024-12-18T00:04:43.0107765Z  2024-12-18T00:04:43.0108215Z  2024-12-18T00:04:43.0108594Z  2024-12-18T00:04:43.0108978Z  2024-12-18T00:04:43.0109370Z  2024-12-18T00:04:43.0109741Z  2024-12-18T00:04:43.0110314Z [10,310 / 15,187] 48 actions, 47 running 2024-12-18T00:04:43.0111097Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:04:43.0111873Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:04:43.0112670Z Compiling llvm/lib/Passes/PassBuilder.cpp; 12s local 2024-12-18T00:04:43.0113562Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 11s local 2024-12-18T00:04:43.0114567Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:04:43.0115650Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 11s local 2024-12-18T00:04:43.0116684Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 11s local 2024-12-18T00:04:43.0117895Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 10s local ... 2024-12-18T00:04:43.2140560Z 2024-12-18T00:04:43.2141439Z  2024-12-18T00:04:43.2141892Z  2024-12-18T00:04:43.2142259Z  2024-12-18T00:04:43.2142677Z  2024-12-18T00:04:43.2143062Z  2024-12-18T00:04:43.2143460Z  2024-12-18T00:04:43.2143850Z  2024-12-18T00:04:43.2144519Z  2024-12-18T00:04:43.2145102Z [10,312 / 15,187] 48 actions, 47 running 2024-12-18T00:04:43.2146165Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:04:43.2146928Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:04:43.2147656Z Compiling llvm/lib/Passes/PassBuilder.cpp; 12s local 2024-12-18T00:04:43.2148522Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local 2024-12-18T00:04:43.2149533Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:04:43.2150575Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 11s local 2024-12-18T00:04:43.2151624Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 11s local 2024-12-18T00:04:43.2152513Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 11s local ... 2024-12-18T00:04:43.4836496Z 2024-12-18T00:04:43.4837325Z  2024-12-18T00:04:43.4837821Z  2024-12-18T00:04:43.4838219Z  2024-12-18T00:04:43.4838656Z  2024-12-18T00:04:43.4839081Z  2024-12-18T00:04:43.4839481Z  2024-12-18T00:04:43.4839902Z  2024-12-18T00:04:43.4840336Z  2024-12-18T00:04:43.4840944Z [10,316 / 15,187] 48 actions, 47 running 2024-12-18T00:04:43.4841678Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:04:43.4842440Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:04:43.4843272Z Compiling llvm/lib/Passes/PassBuilder.cpp; 12s local 2024-12-18T00:04:43.4844505Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local 2024-12-18T00:04:43.4845592Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local 2024-12-18T00:04:43.4846699Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 11s local 2024-12-18T00:04:43.4847799Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 11s local 2024-12-18T00:04:43.4848995Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 11s local ... 2024-12-18T00:04:43.6891697Z 2024-12-18T00:04:43.6892519Z  2024-12-18T00:04:43.6893026Z  2024-12-18T00:04:43.6893432Z  2024-12-18T00:04:43.6893897Z  2024-12-18T00:04:43.6894298Z  2024-12-18T00:04:43.6894692Z  2024-12-18T00:04:43.6895202Z  2024-12-18T00:04:43.6895597Z  2024-12-18T00:04:43.6896155Z [10,318 / 15,187] 48 actions, 47 running 2024-12-18T00:04:43.6897052Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:04:43.6897770Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:04:43.6898538Z Compiling llvm/lib/Passes/PassBuilder.cpp; 12s local 2024-12-18T00:04:43.6899412Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local 2024-12-18T00:04:43.6900405Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local 2024-12-18T00:04:43.6901403Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2024-12-18T00:04:43.6902418Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 12s local 2024-12-18T00:04:43.6903535Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 11s local ... 2024-12-18T00:04:43.9037095Z 2024-12-18T00:04:43.9038011Z  2024-12-18T00:04:43.9038480Z  2024-12-18T00:04:43.9038862Z  2024-12-18T00:04:43.9039229Z  2024-12-18T00:04:43.9039601Z  2024-12-18T00:04:43.9039978Z  2024-12-18T00:04:43.9040349Z  2024-12-18T00:04:43.9040728Z  2024-12-18T00:04:43.9041294Z [10,319 / 15,187] 48 actions running 2024-12-18T00:04:43.9041986Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:04:43.9042687Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:04:43.9043451Z Compiling llvm/lib/Passes/PassBuilder.cpp; 12s local 2024-12-18T00:04:43.9045053Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local 2024-12-18T00:04:43.9046078Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local 2024-12-18T00:04:43.9047099Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2024-12-18T00:04:43.9048191Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 12s local 2024-12-18T00:04:43.9049669Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 11s local ... 2024-12-18T00:04:44.1350183Z 2024-12-18T00:04:44.1351034Z  2024-12-18T00:04:44.1351502Z  2024-12-18T00:04:44.1351910Z  2024-12-18T00:04:44.1352326Z  2024-12-18T00:04:44.1352728Z  2024-12-18T00:04:44.1353132Z  2024-12-18T00:04:44.1353660Z  2024-12-18T00:04:44.1354062Z  2024-12-18T00:04:44.1354681Z [10,320 / 15,187] 48 actions, 47 running 2024-12-18T00:04:44.1355409Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:04:44.1356230Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:04:44.1357034Z Compiling llvm/lib/Passes/PassBuilder.cpp; 13s local 2024-12-18T00:04:44.1357971Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local 2024-12-18T00:04:44.1359040Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local 2024-12-18T00:04:44.1360118Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2024-12-18T00:04:44.1361082Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 12s local 2024-12-18T00:04:44.1362142Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 12s local ... 2024-12-18T00:04:44.3451572Z 2024-12-18T00:04:44.3452473Z  2024-12-18T00:04:44.3453038Z  2024-12-18T00:04:44.3453437Z  2024-12-18T00:04:44.3453801Z  2024-12-18T00:04:44.3454169Z  2024-12-18T00:04:44.3454527Z  2024-12-18T00:04:44.3454891Z  2024-12-18T00:04:44.3455265Z  2024-12-18T00:04:44.3455854Z [10,329 / 15,187] 48 actions, 47 running 2024-12-18T00:04:44.3456774Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:04:44.3457479Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:04:44.3458247Z Compiling llvm/lib/Passes/PassBuilder.cpp; 13s local 2024-12-18T00:04:44.3459094Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local 2024-12-18T00:04:44.3460081Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2024-12-18T00:04:44.3461008Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2024-12-18T00:04:44.3462144Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 12s local 2024-12-18T00:04:44.3463294Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 12s local ... 2024-12-18T00:04:44.7044843Z 2024-12-18T00:04:44.7045718Z  2024-12-18T00:04:44.7046197Z  2024-12-18T00:04:44.7046587Z  2024-12-18T00:04:44.7046984Z  2024-12-18T00:04:44.7047368Z  2024-12-18T00:04:44.7047780Z  2024-12-18T00:04:44.7048120Z  2024-12-18T00:04:44.7048492Z  2024-12-18T00:04:44.7049038Z [10,334 / 15,187] 48 actions running 2024-12-18T00:04:44.7049750Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:04:44.7050456Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:04:44.7051281Z Compiling llvm/lib/Passes/PassBuilder.cpp; 13s local 2024-12-18T00:04:44.7052157Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local 2024-12-18T00:04:44.7053205Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2024-12-18T00:04:44.7054240Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 13s local 2024-12-18T00:04:44.7055242Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 13s local 2024-12-18T00:04:44.7056230Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 12s local ... 2024-12-18T00:04:45.1049527Z 2024-12-18T00:04:45.1050365Z  2024-12-18T00:04:45.1050833Z  2024-12-18T00:04:45.1051656Z  2024-12-18T00:04:45.1052069Z  2024-12-18T00:04:45.1052472Z  2024-12-18T00:04:45.1052839Z  2024-12-18T00:04:45.1053210Z  2024-12-18T00:04:45.1053593Z  2024-12-18T00:04:45.1054267Z [10,337 / 15,187] 47 actions running 2024-12-18T00:04:45.1055125Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:04:45.1056364Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:04:45.1057294Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local 2024-12-18T00:04:45.1058310Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:04:45.1059329Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2024-12-18T00:04:45.1060329Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 13s local 2024-12-18T00:04:45.1061253Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 13s local 2024-12-18T00:04:45.1062283Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local ... 2024-12-18T00:04:45.3438573Z 2024-12-18T00:04:45.3439428Z  2024-12-18T00:04:45.3439827Z  2024-12-18T00:04:45.3440181Z  2024-12-18T00:04:45.3440532Z  2024-12-18T00:04:45.3440863Z  2024-12-18T00:04:45.3441211Z  2024-12-18T00:04:45.3441547Z  2024-12-18T00:04:45.3441888Z  2024-12-18T00:04:45.3442450Z [10,338 / 15,187] 48 actions, 47 running 2024-12-18T00:04:45.3443052Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:04:45.3443679Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:04:45.3444624Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local 2024-12-18T00:04:45.3445395Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:04:45.3446254Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2024-12-18T00:04:45.3447088Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 13s local 2024-12-18T00:04:45.3447880Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 13s local 2024-12-18T00:04:45.3448744Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local ... 2024-12-18T00:04:45.7057173Z 2024-12-18T00:04:45.7058044Z  2024-12-18T00:04:45.7058512Z  2024-12-18T00:04:45.7058885Z  2024-12-18T00:04:45.7059250Z  2024-12-18T00:04:45.7059640Z  2024-12-18T00:04:45.7059980Z  2024-12-18T00:04:45.7060383Z  2024-12-18T00:04:45.7060760Z  2024-12-18T00:04:45.7061291Z [10,340 / 15,187] 48 actions running 2024-12-18T00:04:45.7061945Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:04:45.7062652Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:04:45.7063418Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local 2024-12-18T00:04:45.7064292Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:04:45.7065293Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2024-12-18T00:04:45.7066362Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 14s local 2024-12-18T00:04:45.7067346Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local 2024-12-18T00:04:45.7068352Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local ... 2024-12-18T00:04:45.9466143Z 2024-12-18T00:04:45.9466979Z  2024-12-18T00:04:45.9467419Z  2024-12-18T00:04:45.9467757Z  2024-12-18T00:04:45.9468160Z  2024-12-18T00:04:45.9468535Z  2024-12-18T00:04:45.9468918Z  2024-12-18T00:04:45.9469275Z  2024-12-18T00:04:45.9469631Z  2024-12-18T00:04:45.9470203Z [10,346 / 15,187] 48 actions, 47 running 2024-12-18T00:04:45.9470833Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:04:45.9471554Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:04:45.9472302Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local 2024-12-18T00:04:45.9473170Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:04:45.9474615Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2024-12-18T00:04:45.9475580Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 14s local 2024-12-18T00:04:45.9476546Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local 2024-12-18T00:04:45.9477615Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local ... 2024-12-18T00:04:46.2981285Z 2024-12-18T00:04:46.2982160Z  2024-12-18T00:04:46.2982643Z  2024-12-18T00:04:46.2983058Z  2024-12-18T00:04:46.2983417Z  2024-12-18T00:04:46.2983786Z  2024-12-18T00:04:46.2984171Z  2024-12-18T00:04:46.2984582Z  2024-12-18T00:04:46.2984971Z  2024-12-18T00:04:46.2985564Z [10,350 / 15,187] 48 actions, 47 running 2024-12-18T00:04:46.2986285Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:04:46.2986963Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:04:46.2987717Z Compiling llvm/lib/Passes/PassBuilder.cpp; 15s local 2024-12-18T00:04:46.2988587Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local 2024-12-18T00:04:46.2989591Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:04:46.2990643Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 14s local 2024-12-18T00:04:46.2991718Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local 2024-12-18T00:04:46.2992884Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local ... 2024-12-18T00:04:46.5064018Z 2024-12-18T00:04:46.5064883Z  2024-12-18T00:04:46.5065348Z  2024-12-18T00:04:46.5065749Z  2024-12-18T00:04:46.5066290Z  2024-12-18T00:04:46.5066692Z  2024-12-18T00:04:46.5067091Z  2024-12-18T00:04:46.5067483Z  2024-12-18T00:04:46.5067857Z  2024-12-18T00:04:46.5068413Z [10,350 / 15,187] 48 actions running 2024-12-18T00:04:46.5069082Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:04:46.5069816Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:04:46.5070587Z Compiling llvm/lib/Passes/PassBuilder.cpp; 15s local 2024-12-18T00:04:46.5071441Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local 2024-12-18T00:04:46.5072444Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:04:46.5073486Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 14s local 2024-12-18T00:04:46.5074520Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local 2024-12-18T00:04:46.5075616Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local ... 2024-12-18T00:04:46.9064546Z 2024-12-18T00:04:46.9065407Z  2024-12-18T00:04:46.9065884Z  2024-12-18T00:04:46.9066261Z  2024-12-18T00:04:46.9066633Z  2024-12-18T00:04:46.9067011Z  2024-12-18T00:04:46.9067368Z  2024-12-18T00:04:46.9067754Z  2024-12-18T00:04:46.9068112Z  2024-12-18T00:04:46.9068750Z [10,351 / 15,187] 48 actions, 47 running 2024-12-18T00:04:46.9069436Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:04:46.9070170Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:04:46.9070928Z Compiling llvm/lib/Passes/PassBuilder.cpp; 15s local 2024-12-18T00:04:46.9071760Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local 2024-12-18T00:04:46.9072745Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:04:46.9073650Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 15s local 2024-12-18T00:04:46.9074603Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local 2024-12-18T00:04:46.9075540Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local ... 2024-12-18T00:04:47.1515154Z 2024-12-18T00:04:47.1516012Z  2024-12-18T00:04:47.1516434Z  2024-12-18T00:04:47.1516793Z  2024-12-18T00:04:47.1517142Z  2024-12-18T00:04:47.1517490Z  2024-12-18T00:04:47.1518247Z  2024-12-18T00:04:47.1518582Z  2024-12-18T00:04:47.1519028Z  2024-12-18T00:04:47.1519563Z [10,355 / 15,187] 48 actions, 47 running 2024-12-18T00:04:47.1520200Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:04:47.1520836Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:04:47.1521745Z Compiling llvm/lib/Passes/PassBuilder.cpp; 16s local 2024-12-18T00:04:47.1522553Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local 2024-12-18T00:04:47.1523466Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:04:47.1524348Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 15s local 2024-12-18T00:04:47.1525335Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local 2024-12-18T00:04:47.1526225Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local ... 2024-12-18T00:04:47.4495682Z 2024-12-18T00:04:47.4496645Z  2024-12-18T00:04:47.4497173Z  2024-12-18T00:04:47.4497565Z  2024-12-18T00:04:47.4497941Z  2024-12-18T00:04:47.4498328Z  2024-12-18T00:04:47.4498705Z  2024-12-18T00:04:47.4499093Z  2024-12-18T00:04:47.4499461Z  2024-12-18T00:04:47.4500003Z [10,356 / 15,187] 48 actions, 47 running 2024-12-18T00:04:47.4500679Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:04:47.4501413Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:04:47.4502158Z Compiling llvm/lib/Passes/PassBuilder.cpp; 16s local 2024-12-18T00:04:47.4502996Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local 2024-12-18T00:04:47.4503938Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2024-12-18T00:04:47.4504969Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 15s local 2024-12-18T00:04:47.4505961Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local 2024-12-18T00:04:47.4506982Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local ... 2024-12-18T00:04:47.7072117Z 2024-12-18T00:04:47.7072974Z  2024-12-18T00:04:47.7073447Z  2024-12-18T00:04:47.7073839Z  2024-12-18T00:04:47.7074233Z  2024-12-18T00:04:47.7074620Z  2024-12-18T00:04:47.7075010Z  2024-12-18T00:04:47.7075393Z  2024-12-18T00:04:47.7075783Z  2024-12-18T00:04:47.7076372Z [10,361 / 15,187] 48 actions running 2024-12-18T00:04:47.7077088Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:04:47.7077801Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:04:47.7078594Z Compiling llvm/lib/Passes/PassBuilder.cpp; 16s local 2024-12-18T00:04:47.7079542Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local 2024-12-18T00:04:47.7080688Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2024-12-18T00:04:47.7081637Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local 2024-12-18T00:04:47.7082647Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2024-12-18T00:04:47.7083646Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local ... 2024-12-18T00:04:47.9077018Z 2024-12-18T00:04:47.9077821Z  2024-12-18T00:04:47.9078288Z  2024-12-18T00:04:47.9078653Z  2024-12-18T00:04:47.9079021Z  2024-12-18T00:04:47.9079401Z  2024-12-18T00:04:47.9079786Z  2024-12-18T00:04:47.9080207Z  2024-12-18T00:04:47.9080553Z  2024-12-18T00:04:47.9081088Z [10,364 / 15,187] 47 actions running 2024-12-18T00:04:47.9081763Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:04:47.9082495Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:04:47.9083287Z Compiling llvm/lib/Passes/PassBuilder.cpp; 16s local 2024-12-18T00:04:47.9084118Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local 2024-12-18T00:04:47.9085249Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2024-12-18T00:04:47.9086746Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local 2024-12-18T00:04:47.9087773Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2024-12-18T00:04:47.9088801Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local ... 2024-12-18T00:04:48.1479203Z 2024-12-18T00:04:48.1480052Z  2024-12-18T00:04:48.1480539Z  2024-12-18T00:04:48.1481324Z  2024-12-18T00:04:48.1481734Z  2024-12-18T00:04:48.1482164Z  2024-12-18T00:04:48.1482545Z  2024-12-18T00:04:48.1482918Z  2024-12-18T00:04:48.1483350Z  2024-12-18T00:04:48.1483918Z [10,367 / 15,187] 48 actions, 47 running 2024-12-18T00:04:48.1484609Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:04:48.1485334Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:04:48.1486093Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2024-12-18T00:04:48.1486945Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:04:48.1487943Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2024-12-18T00:04:48.1488950Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local 2024-12-18T00:04:48.1489940Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2024-12-18T00:04:48.1490958Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local ... 2024-12-18T00:04:48.4097831Z 2024-12-18T00:04:48.4098708Z  2024-12-18T00:04:48.4099156Z  2024-12-18T00:04:48.4099520Z  2024-12-18T00:04:48.4099899Z  2024-12-18T00:04:48.4100302Z  2024-12-18T00:04:48.4100685Z  2024-12-18T00:04:48.4101076Z  2024-12-18T00:04:48.4101457Z  2024-12-18T00:04:48.4102030Z [10,369 / 15,187] 48 actions, 47 running 2024-12-18T00:04:48.4102688Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:04:48.4103408Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:04:48.4104227Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2024-12-18T00:04:48.4105086Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:04:48.4106102Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:04:48.4107131Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local 2024-12-18T00:04:48.4108176Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2024-12-18T00:04:48.4109279Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local ... 2024-12-18T00:04:48.7043723Z 2024-12-18T00:04:48.7044809Z  2024-12-18T00:04:48.7045272Z  2024-12-18T00:04:48.7045666Z  2024-12-18T00:04:48.7046038Z  2024-12-18T00:04:48.7046427Z  2024-12-18T00:04:48.7046794Z  2024-12-18T00:04:48.7047154Z  2024-12-18T00:04:48.7047536Z  2024-12-18T00:04:48.7048091Z [10,371 / 15,187] 48 actions, 47 running 2024-12-18T00:04:48.7048769Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:04:48.7049569Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:04:48.7050393Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2024-12-18T00:04:48.7051299Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:04:48.7052271Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:04:48.7053356Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2024-12-18T00:04:48.7054391Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2024-12-18T00:04:48.7055437Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local ... 2024-12-18T00:04:48.9084348Z 2024-12-18T00:04:48.9085236Z  2024-12-18T00:04:48.9085773Z  2024-12-18T00:04:48.9086164Z  2024-12-18T00:04:48.9086571Z  2024-12-18T00:04:48.9086964Z  2024-12-18T00:04:48.9087332Z  2024-12-18T00:04:48.9087728Z  2024-12-18T00:04:48.9088124Z  2024-12-18T00:04:48.9089123Z [10,371 / 15,187] 48 actions running 2024-12-18T00:04:48.9089857Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:04:48.9090588Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:04:48.9091469Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2024-12-18T00:04:48.9092282Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:04:48.9093551Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:04:48.9094526Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2024-12-18T00:04:48.9095516Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2024-12-18T00:04:48.9096746Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local ... 2024-12-18T00:04:49.1362970Z 2024-12-18T00:04:49.1363842Z  2024-12-18T00:04:49.1364334Z  2024-12-18T00:04:49.1364745Z  2024-12-18T00:04:49.1365145Z  2024-12-18T00:04:49.1365618Z  2024-12-18T00:04:49.1366013Z  2024-12-18T00:04:49.1366412Z  2024-12-18T00:04:49.1366789Z  2024-12-18T00:04:49.1367371Z [10,372 / 15,187] 48 actions, 47 running 2024-12-18T00:04:49.1368019Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:04:49.1368763Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:04:49.1369583Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2024-12-18T00:04:49.1370423Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2024-12-18T00:04:49.1371353Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:04:49.1372354Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2024-12-18T00:04:49.1373380Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2024-12-18T00:04:49.1374447Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local ... 2024-12-18T00:04:49.3541764Z 2024-12-18T00:04:49.3542596Z  2024-12-18T00:04:49.3543077Z  2024-12-18T00:04:49.3543428Z  2024-12-18T00:04:49.3543781Z  2024-12-18T00:04:49.3544118Z  2024-12-18T00:04:49.3544682Z  2024-12-18T00:04:49.3545040Z  2024-12-18T00:04:49.3545371Z  2024-12-18T00:04:49.3545897Z [10,376 / 15,187] 48 actions, 47 running 2024-12-18T00:04:49.3546523Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:04:49.3547176Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:04:49.3547843Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2024-12-18T00:04:49.3548605Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2024-12-18T00:04:49.3549489Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:04:49.3550369Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2024-12-18T00:04:49.3551277Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2024-12-18T00:04:49.3552205Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local ... 2024-12-18T00:04:49.7091920Z 2024-12-18T00:04:49.7092759Z  2024-12-18T00:04:49.7093185Z  2024-12-18T00:04:49.7093535Z  2024-12-18T00:04:49.7093862Z  2024-12-18T00:04:49.7094201Z  2024-12-18T00:04:49.7094539Z  2024-12-18T00:04:49.7094889Z  2024-12-18T00:04:49.7095245Z  2024-12-18T00:04:49.7095785Z [10,379 / 15,187] 48 actions running 2024-12-18T00:04:49.7096385Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:04:49.7097195Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:04:49.7097877Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2024-12-18T00:04:49.7098683Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2024-12-18T00:04:49.7099539Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:04:49.7100478Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local 2024-12-18T00:04:49.7101740Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2024-12-18T00:04:49.7102595Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local ... 2024-12-18T00:04:49.9096070Z 2024-12-18T00:04:49.9097016Z  2024-12-18T00:04:49.9097420Z  2024-12-18T00:04:49.9097745Z  2024-12-18T00:04:49.9098081Z  2024-12-18T00:04:49.9098419Z  2024-12-18T00:04:49.9099159Z  2024-12-18T00:04:49.9099505Z  2024-12-18T00:04:49.9099814Z  2024-12-18T00:04:49.9100289Z [10,382 / 15,187] 48 actions running 2024-12-18T00:04:49.9100876Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:04:49.9101495Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:04:49.9102197Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2024-12-18T00:04:49.9102937Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2024-12-18T00:04:49.9103790Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:04:49.9104685Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local 2024-12-18T00:04:49.9105568Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2024-12-18T00:04:49.9106467Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local ... 2024-12-18T00:04:50.1562740Z 2024-12-18T00:04:50.1563575Z  2024-12-18T00:04:50.1564055Z  2024-12-18T00:04:50.1564464Z  2024-12-18T00:04:50.1564822Z  2024-12-18T00:04:50.1565204Z  2024-12-18T00:04:50.1565572Z  2024-12-18T00:04:50.1565964Z  2024-12-18T00:04:50.1566415Z  2024-12-18T00:04:50.1567018Z [10,384 / 15,187] 48 actions, 47 running 2024-12-18T00:04:50.1567683Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:04:50.1568411Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:04:50.1569147Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local 2024-12-18T00:04:50.1569981Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2024-12-18T00:04:50.1571094Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:04:50.1572146Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local 2024-12-18T00:04:50.1573186Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2024-12-18T00:04:50.1574313Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2024-12-18T00:04:50.5102904Z 2024-12-18T00:04:50.5103817Z  2024-12-18T00:04:50.5104283Z  2024-12-18T00:04:50.5104644Z  2024-12-18T00:04:50.5105029Z  2024-12-18T00:04:50.5105423Z  2024-12-18T00:04:50.5105783Z  2024-12-18T00:04:50.5106158Z  2024-12-18T00:04:50.5106554Z  2024-12-18T00:04:50.5107119Z [10,384 / 15,187] 48 actions running 2024-12-18T00:04:50.5107947Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:04:50.5108688Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:04:50.5109560Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local 2024-12-18T00:04:50.5110488Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2024-12-18T00:04:50.5111552Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2024-12-18T00:04:50.5112610Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local 2024-12-18T00:04:50.5113723Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2024-12-18T00:04:50.5114782Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2024-12-18T00:04:50.7107207Z 2024-12-18T00:04:50.7108017Z  2024-12-18T00:04:50.7108472Z  2024-12-18T00:04:50.7108829Z  2024-12-18T00:04:50.7109224Z  2024-12-18T00:04:50.7109630Z  2024-12-18T00:04:50.7110017Z  2024-12-18T00:04:50.7110401Z  2024-12-18T00:04:50.7110792Z  2024-12-18T00:04:50.7111375Z [10,385 / 15,187] 48 actions running 2024-12-18T00:04:50.7112067Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:04:50.7113327Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:04:50.7114186Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local 2024-12-18T00:04:50.7115085Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2024-12-18T00:04:50.7116158Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2024-12-18T00:04:50.7117473Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local 2024-12-18T00:04:50.7118693Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2024-12-18T00:04:50.7119803Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2024-12-18T00:04:51.1112263Z 2024-12-18T00:04:51.1113152Z  2024-12-18T00:04:51.1113597Z  2024-12-18T00:04:51.1113954Z  2024-12-18T00:04:51.1114343Z  2024-12-18T00:04:51.1114751Z  2024-12-18T00:04:51.1115149Z  2024-12-18T00:04:51.1115536Z  2024-12-18T00:04:51.1115952Z  2024-12-18T00:04:51.1116562Z [10,386 / 15,187] 48 actions running 2024-12-18T00:04:51.1117302Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:04:51.1118076Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:04:51.1118845Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2024-12-18T00:04:51.1119721Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:04:51.1120756Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2024-12-18T00:04:51.1121750Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local 2024-12-18T00:04:51.1122791Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2024-12-18T00:04:51.1123904Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:04:51.3116633Z 2024-12-18T00:04:51.3117476Z  2024-12-18T00:04:51.3117929Z  2024-12-18T00:04:51.3118300Z  2024-12-18T00:04:51.3118657Z  2024-12-18T00:04:51.3119050Z  2024-12-18T00:04:51.3119406Z  2024-12-18T00:04:51.3119775Z  2024-12-18T00:04:51.3120121Z  2024-12-18T00:04:51.3120675Z [10,387 / 15,187] 48 actions running 2024-12-18T00:04:51.3121356Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:04:51.3122086Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:04:51.3122908Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2024-12-18T00:04:51.3123706Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:04:51.3124619Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:04:51.3125627Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local 2024-12-18T00:04:51.3126612Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2024-12-18T00:04:51.3127595Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:04:51.5161093Z 2024-12-18T00:04:51.5161920Z  2024-12-18T00:04:51.5162394Z  2024-12-18T00:04:51.5162781Z  2024-12-18T00:04:51.5163154Z  2024-12-18T00:04:51.5163524Z  2024-12-18T00:04:51.5163907Z  2024-12-18T00:04:51.5164250Z  2024-12-18T00:04:51.5164566Z  2024-12-18T00:04:51.5165121Z [10,388 / 15,187] 48 actions, 47 running 2024-12-18T00:04:51.5165831Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:04:51.5166719Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:04:51.5167509Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2024-12-18T00:04:51.5168428Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:04:51.5169533Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:04:51.5170519Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local 2024-12-18T00:04:51.5171565Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2024-12-18T00:04:51.5172615Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:04:51.7326971Z 2024-12-18T00:04:51.7327817Z  2024-12-18T00:04:51.7328421Z  2024-12-18T00:04:51.7328825Z  2024-12-18T00:04:51.7329222Z  2024-12-18T00:04:51.7329636Z  2024-12-18T00:04:51.7330054Z  2024-12-18T00:04:51.7330457Z  2024-12-18T00:04:51.7330835Z  2024-12-18T00:04:51.7331803Z [10,390 / 15,187] 48 actions, 47 running 2024-12-18T00:04:51.7332582Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:04:51.7333296Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:04:51.7334040Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2024-12-18T00:04:51.7334942Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:04:51.7335953Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:04:51.7337182Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:04:51.7338236Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 20s local 2024-12-18T00:04:51.7339356Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:04:51.9567324Z 2024-12-18T00:04:51.9568226Z  2024-12-18T00:04:51.9568692Z  2024-12-18T00:04:51.9569079Z  2024-12-18T00:04:51.9569456Z  2024-12-18T00:04:51.9569842Z  2024-12-18T00:04:51.9570271Z  2024-12-18T00:04:51.9570620Z  2024-12-18T00:04:51.9571008Z  2024-12-18T00:04:51.9571561Z [10,393 / 15,187] 48 actions, 47 running 2024-12-18T00:04:51.9572305Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:04:51.9573041Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:04:51.9573775Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2024-12-18T00:04:51.9574658Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:04:51.9575651Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:04:51.9576794Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:04:51.9577797Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 20s local 2024-12-18T00:04:51.9578865Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:04:52.1678985Z 2024-12-18T00:04:52.1679842Z  2024-12-18T00:04:52.1680299Z  2024-12-18T00:04:52.1680704Z  2024-12-18T00:04:52.1681078Z  2024-12-18T00:04:52.1681462Z  2024-12-18T00:04:52.1681845Z  2024-12-18T00:04:52.1682206Z  2024-12-18T00:04:52.1682571Z  2024-12-18T00:04:52.1683180Z [10,396 / 15,187] 48 actions, 47 running 2024-12-18T00:04:52.1683932Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:04:52.1684673Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:04:52.1685446Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2024-12-18T00:04:52.1686327Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2024-12-18T00:04:52.1687350Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:04:52.1688350Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:04:52.1689290Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:04:52.1690295Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 11s local ... 2024-12-18T00:04:52.4554473Z 2024-12-18T00:04:52.4555384Z  2024-12-18T00:04:52.4555883Z  2024-12-18T00:04:52.4556278Z  2024-12-18T00:04:52.4556692Z  2024-12-18T00:04:52.4557061Z  2024-12-18T00:04:52.4557459Z  2024-12-18T00:04:52.4557865Z  2024-12-18T00:04:52.4558274Z  2024-12-18T00:04:52.4558884Z [10,399 / 15,187] 48 actions, 47 running 2024-12-18T00:04:52.4559605Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:04:52.4560494Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:04:52.4561804Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2024-12-18T00:04:52.4562719Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2024-12-18T00:04:52.4563772Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 21s local 2024-12-18T00:04:52.4564817Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:04:52.4566019Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:04:52.4567019Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local ... 2024-12-18T00:04:52.7127381Z 2024-12-18T00:04:52.7128237Z  2024-12-18T00:04:52.7128680Z  2024-12-18T00:04:52.7129070Z  2024-12-18T00:04:52.7129464Z  2024-12-18T00:04:52.7129840Z  2024-12-18T00:04:52.7130211Z  2024-12-18T00:04:52.7130613Z  2024-12-18T00:04:52.7130960Z  2024-12-18T00:04:52.7131516Z [10,400 / 15,187] 48 actions running 2024-12-18T00:04:52.7142350Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:04:52.7143117Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:04:52.7143866Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2024-12-18T00:04:52.7144965Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2024-12-18T00:04:52.7145946Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 21s local 2024-12-18T00:04:52.7146974Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 21s local 2024-12-18T00:04:52.7147966Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:04:52.7148993Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local ... 2024-12-18T00:04:53.1132565Z 2024-12-18T00:04:53.1133401Z  2024-12-18T00:04:53.1133897Z  2024-12-18T00:04:53.1134309Z  2024-12-18T00:04:53.1134698Z  2024-12-18T00:04:53.1135084Z  2024-12-18T00:04:53.1135474Z  2024-12-18T00:04:53.1135881Z  2024-12-18T00:04:53.1136274Z  2024-12-18T00:04:53.1137011Z [10,403 / 15,187] 48 actions running 2024-12-18T00:04:53.1137714Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:04:53.1138448Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:04:53.1139225Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2024-12-18T00:04:53.1140104Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:04:53.1141124Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:04:53.1142037Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local 2024-12-18T00:04:53.1143046Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local 2024-12-18T00:04:53.1144542Z Compiling llvm/lib/CodeGen/ComplexDeinterleavingPass.cpp; 12s local ... 2024-12-18T00:04:53.3138691Z 2024-12-18T00:04:53.3139561Z  2024-12-18T00:04:53.3140055Z  2024-12-18T00:04:53.3140471Z  2024-12-18T00:04:53.3140880Z  2024-12-18T00:04:53.3141278Z  2024-12-18T00:04:53.3141731Z  2024-12-18T00:04:53.3142135Z  2024-12-18T00:04:53.3142542Z  2024-12-18T00:04:53.3143104Z [10,406 / 15,187] 48 actions running 2024-12-18T00:04:53.3143838Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:04:53.3144859Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:04:53.3145636Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2024-12-18T00:04:53.3146696Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:04:53.3147673Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:04:53.3148648Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:04:53.3149548Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local 2024-12-18T00:04:53.3150590Z Compiling llvm/lib/CodeGen/ComplexDeinterleavingPass.cpp; 12s local ... 2024-12-18T00:04:53.6442181Z 2024-12-18T00:04:53.6443040Z  2024-12-18T00:04:53.6443486Z  2024-12-18T00:04:53.6444497Z  2024-12-18T00:04:53.6444896Z  2024-12-18T00:04:53.6445288Z  2024-12-18T00:04:53.6445657Z  2024-12-18T00:04:53.6446044Z  2024-12-18T00:04:53.6446438Z  2024-12-18T00:04:53.6447027Z [10,410 / 15,187] 48 actions, 47 running 2024-12-18T00:04:53.6447724Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:04:53.6448777Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2024-12-18T00:04:53.6449597Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2024-12-18T00:04:53.6450500Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:04:53.6451492Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:04:53.6452376Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:04:53.6453346Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local 2024-12-18T00:04:53.6454229Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:04:53.9143354Z 2024-12-18T00:04:53.9144359Z  2024-12-18T00:04:53.9144861Z  2024-12-18T00:04:53.9145276Z  2024-12-18T00:04:53.9145666Z  2024-12-18T00:04:53.9146073Z  2024-12-18T00:04:53.9146474Z  2024-12-18T00:04:53.9146877Z  2024-12-18T00:04:53.9147274Z  2024-12-18T00:04:53.9147862Z [10,411 / 15,187] 48 actions running 2024-12-18T00:04:53.9148640Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:04:53.9149398Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2024-12-18T00:04:53.9150231Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2024-12-18T00:04:53.9151122Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:04:53.9152142Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:04:53.9153124Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:04:53.9154135Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local 2024-12-18T00:04:53.9155092Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:04:54.1145259Z 2024-12-18T00:04:54.1146246Z  2024-12-18T00:04:54.1146876Z  2024-12-18T00:04:54.1147289Z  2024-12-18T00:04:54.1147661Z  2024-12-18T00:04:54.1148010Z  2024-12-18T00:04:54.1148356Z  2024-12-18T00:04:54.1148696Z  2024-12-18T00:04:54.1149048Z  2024-12-18T00:04:54.1149603Z [10,413 / 15,187] 48 actions running 2024-12-18T00:04:54.1150255Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:04:54.1150918Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2024-12-18T00:04:54.1151648Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2024-12-18T00:04:54.1152493Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2024-12-18T00:04:54.1153393Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:04:54.1154235Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:04:54.1155088Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local 2024-12-18T00:04:54.1155860Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:04:54.4985405Z 2024-12-18T00:04:54.4986237Z  2024-12-18T00:04:54.4986679Z  2024-12-18T00:04:54.4987057Z  2024-12-18T00:04:54.4987442Z  2024-12-18T00:04:54.4987890Z  2024-12-18T00:04:54.4988295Z  2024-12-18T00:04:54.4988662Z  2024-12-18T00:04:54.4989033Z  2024-12-18T00:04:54.4989575Z [10,419 / 15,187] 48 actions, 47 running 2024-12-18T00:04:54.4990244Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:04:54.4990988Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2024-12-18T00:04:54.4991819Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2024-12-18T00:04:54.4992977Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:04:54.4994121Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:04:54.4995450Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:04:54.4996231Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:04:54.4997034Z Compiling llvm/lib/CodeGen/GlobalISel/CallLowering.cpp; 8s local ... 2024-12-18T00:04:54.7153314Z 2024-12-18T00:04:54.7154249Z  2024-12-18T00:04:54.7154721Z  2024-12-18T00:04:54.7155536Z  2024-12-18T00:04:54.7155942Z  2024-12-18T00:04:54.7156341Z  2024-12-18T00:04:54.7156744Z  2024-12-18T00:04:54.7157142Z  2024-12-18T00:04:54.7157517Z  2024-12-18T00:04:54.7158093Z [10,420 / 15,187] 48 actions running 2024-12-18T00:04:54.7158829Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:04:54.7159630Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2024-12-18T00:04:54.7160568Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2024-12-18T00:04:54.7161610Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:04:54.7162615Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:04:54.7163795Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:04:54.7164771Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:04:54.7165718Z Compiling llvm/lib/CodeGen/GlobalISel/CallLowering.cpp; 8s local ... 2024-12-18T00:04:54.9153973Z 2024-12-18T00:04:54.9154855Z  2024-12-18T00:04:54.9155295Z  2024-12-18T00:04:54.9155639Z  2024-12-18T00:04:54.9156002Z  2024-12-18T00:04:54.9156352Z  2024-12-18T00:04:54.9156706Z  2024-12-18T00:04:54.9157033Z  2024-12-18T00:04:54.9157357Z  2024-12-18T00:04:54.9157853Z [10,424 / 15,187] 48 actions running 2024-12-18T00:04:54.9158500Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:04:54.9159112Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2024-12-18T00:04:54.9160168Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2024-12-18T00:04:54.9161050Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:04:54.9162027Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:04:54.9162970Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:04:54.9163884Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:04:54.9164745Z Compiling llvm/lib/CodeGen/GlobalISel/CallLowering.cpp; 9s local ... 2024-12-18T00:04:55.3159882Z 2024-12-18T00:04:55.3160811Z  2024-12-18T00:04:55.3161328Z  2024-12-18T00:04:55.3161755Z  2024-12-18T00:04:55.3162160Z  2024-12-18T00:04:55.3162549Z  2024-12-18T00:04:55.3162925Z  2024-12-18T00:04:55.3163318Z  2024-12-18T00:04:55.3163721Z  2024-12-18T00:04:55.3164301Z [10,425 / 15,187] 48 actions running 2024-12-18T00:04:55.3165000Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:04:55.3165812Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2024-12-18T00:04:55.3166716Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:04:55.3167725Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2024-12-18T00:04:55.3168675Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:04:55.3169699Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:04:55.3170572Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:04:55.3171465Z Compiling llvm/lib/CodeGen/GlobalISel/CallLowering.cpp; 9s local ... 2024-12-18T00:04:55.5277786Z 2024-12-18T00:04:55.5278687Z  2024-12-18T00:04:55.5279157Z  2024-12-18T00:04:55.5279571Z  2024-12-18T00:04:55.5279958Z  2024-12-18T00:04:55.5280360Z  2024-12-18T00:04:55.5280765Z  2024-12-18T00:04:55.5281159Z  2024-12-18T00:04:55.5281546Z  2024-12-18T00:04:55.5282130Z [10,426 / 15,187] 48 actions, 47 running 2024-12-18T00:04:55.5283264Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:04:55.5284030Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2024-12-18T00:04:55.5284951Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:04:55.5285941Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2024-12-18T00:04:55.5287149Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:04:55.5288152Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:04:55.5289047Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:04:55.5289910Z Compiling llvm/lib/CodeGen/GlobalISel/CallLowering.cpp; 9s local ... 2024-12-18T00:04:55.8556256Z 2024-12-18T00:04:55.8557204Z  2024-12-18T00:04:55.8557685Z  2024-12-18T00:04:55.8558124Z  2024-12-18T00:04:55.8558501Z  2024-12-18T00:04:55.8558929Z  2024-12-18T00:04:55.8559314Z  2024-12-18T00:04:55.8559702Z  2024-12-18T00:04:55.8560147Z  2024-12-18T00:04:55.8560754Z [10,427 / 15,187] 48 actions, 47 running 2024-12-18T00:04:55.8561522Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:04:55.8562317Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2024-12-18T00:04:55.8563265Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:04:55.8564347Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2024-12-18T00:04:55.8565294Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:04:55.8566189Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:04:55.8567091Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:04:55.8567975Z Compiling llvm/lib/CodeGen/GlobalISel/CallLowering.cpp; 10s local ... 2024-12-18T00:04:56.1167092Z 2024-12-18T00:04:56.1167943Z  2024-12-18T00:04:56.1168394Z  2024-12-18T00:04:56.1168726Z  2024-12-18T00:04:56.1169151Z  2024-12-18T00:04:56.1169512Z  2024-12-18T00:04:56.1169877Z  2024-12-18T00:04:56.1170324Z  2024-12-18T00:04:56.1170767Z  2024-12-18T00:04:56.1171329Z [10,429 / 15,187] 48 actions running 2024-12-18T00:04:56.1172013Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:04:56.1172720Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2024-12-18T00:04:56.1173628Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:04:56.1174619Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 24s local 2024-12-18T00:04:56.1175495Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:04:56.1176619Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:04:56.1177509Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:04:56.1178369Z Compiling llvm/lib/CodeGen/GlobalISel/CallLowering.cpp; 10s local ... 2024-12-18T00:04:56.3172136Z 2024-12-18T00:04:56.3173078Z  2024-12-18T00:04:56.3173700Z  2024-12-18T00:04:56.3174109Z  2024-12-18T00:04:56.3174459Z  2024-12-18T00:04:56.3174838Z  2024-12-18T00:04:56.3175193Z  2024-12-18T00:04:56.3175587Z  2024-12-18T00:04:56.3175983Z  2024-12-18T00:04:56.3176693Z [10,430 / 15,187] 48 actions running 2024-12-18T00:04:56.3177415Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:04:56.3178227Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2024-12-18T00:04:56.3179132Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:04:56.3180175Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 24s local 2024-12-18T00:04:56.3181145Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:04:56.3182164Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:04:56.3183056Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:04:56.3184135Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 10s local ... 2024-12-18T00:04:56.5822561Z 2024-12-18T00:04:56.5823491Z  2024-12-18T00:04:56.5823974Z  2024-12-18T00:04:56.5824360Z  2024-12-18T00:04:56.5824730Z  2024-12-18T00:04:56.5825125Z  2024-12-18T00:04:56.5825510Z  2024-12-18T00:04:56.5825870Z  2024-12-18T00:04:56.5826247Z  2024-12-18T00:04:56.5827204Z [10,433 / 15,187] 48 actions, 47 running 2024-12-18T00:04:56.5827905Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:04:56.5828610Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2024-12-18T00:04:56.5829449Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:04:56.5830259Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:04:56.5831223Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2024-12-18T00:04:56.5832088Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:04:56.5832894Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 10s local 2024-12-18T00:04:56.5833987Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 10s local ... 2024-12-18T00:04:56.9178801Z 2024-12-18T00:04:56.9179781Z  2024-12-18T00:04:56.9180257Z  2024-12-18T00:04:56.9180613Z  2024-12-18T00:04:56.9180974Z  2024-12-18T00:04:56.9181349Z  2024-12-18T00:04:56.9181719Z  2024-12-18T00:04:56.9182147Z  2024-12-18T00:04:56.9182490Z  2024-12-18T00:04:56.9183050Z [10,435 / 15,187] 48 actions running 2024-12-18T00:04:56.9183757Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:04:56.9184477Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2024-12-18T00:04:56.9185391Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:04:56.9186318Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:04:56.9187239Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2024-12-18T00:04:56.9188166Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:04:56.9189033Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 11s local 2024-12-18T00:04:56.9190149Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 10s local ... 2024-12-18T00:04:57.1183500Z 2024-12-18T00:04:57.1184436Z  2024-12-18T00:04:57.1184919Z  2024-12-18T00:04:57.1185343Z  2024-12-18T00:04:57.1185722Z  2024-12-18T00:04:57.1186108Z  2024-12-18T00:04:57.1186494Z  2024-12-18T00:04:57.1186882Z  2024-12-18T00:04:57.1187253Z  2024-12-18T00:04:57.1187950Z [10,437 / 15,187] 48 actions running 2024-12-18T00:04:57.1188646Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:04:57.1189374Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2024-12-18T00:04:57.1190259Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:04:57.1191157Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:04:57.1191949Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:04:57.1192821Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 11s local 2024-12-18T00:04:57.1193888Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2024-12-18T00:04:57.1194798Z @llvm-project//mlir:mlir-tblgen; 10s local ... 2024-12-18T00:04:57.4790720Z 2024-12-18T00:04:57.4791626Z  2024-12-18T00:04:57.4792132Z  2024-12-18T00:04:57.4792549Z  2024-12-18T00:04:57.4792946Z  2024-12-18T00:04:57.4793334Z  2024-12-18T00:04:57.4793707Z  2024-12-18T00:04:57.4794109Z  2024-12-18T00:04:57.4794515Z  2024-12-18T00:04:57.4795122Z [10,441 / 15,187] 48 actions, 47 running 2024-12-18T00:04:57.4795837Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:04:57.4796630Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2024-12-18T00:04:57.4797677Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:04:57.4798910Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:04:57.4799681Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:04:57.4800468Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 11s local 2024-12-18T00:04:57.4801522Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2024-12-18T00:04:57.4802670Z @llvm-project//mlir:mlir-tblgen; 10s local ... 2024-12-18T00:04:57.7190662Z 2024-12-18T00:04:57.7191651Z  2024-12-18T00:04:57.7192121Z  2024-12-18T00:04:57.7192492Z  2024-12-18T00:04:57.7192857Z  2024-12-18T00:04:57.7193212Z  2024-12-18T00:04:57.7193592Z  2024-12-18T00:04:57.7193942Z  2024-12-18T00:04:57.7194307Z  2024-12-18T00:04:57.7194831Z [10,443 / 15,187] 48 actions running 2024-12-18T00:04:57.7195508Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:04:57.7196243Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2024-12-18T00:04:57.7197176Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:04:57.7198060Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:04:57.7198785Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:04:57.7199635Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 11s local 2024-12-18T00:04:57.7200712Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2024-12-18T00:04:57.7201549Z @llvm-project//mlir:mlir-tblgen; 10s local ... 2024-12-18T00:04:57.9195132Z 2024-12-18T00:04:57.9196081Z  2024-12-18T00:04:57.9196531Z  2024-12-18T00:04:57.9196899Z  2024-12-18T00:04:57.9197270Z  2024-12-18T00:04:57.9197642Z  2024-12-18T00:04:57.9198006Z  2024-12-18T00:04:57.9198378Z  2024-12-18T00:04:57.9198789Z  2024-12-18T00:04:57.9199295Z [10,444 / 15,187] 48 actions running 2024-12-18T00:04:57.9199980Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:04:57.9200762Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2024-12-18T00:04:57.9201661Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:04:57.9202550Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:04:57.9203302Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:04:57.9204190Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 12s local 2024-12-18T00:04:57.9205240Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2024-12-18T00:04:57.9206106Z @llvm-project//mlir:mlir-tblgen; 10s local ... 2024-12-18T00:04:58.1319193Z 2024-12-18T00:04:58.1320154Z  2024-12-18T00:04:58.1320630Z  2024-12-18T00:04:58.1320990Z  2024-12-18T00:04:58.1321313Z  2024-12-18T00:04:58.1321665Z  2024-12-18T00:04:58.1322016Z  2024-12-18T00:04:58.1322371Z  2024-12-18T00:04:58.1322846Z  2024-12-18T00:04:58.1323427Z [10,446 / 15,187] 48 actions, 47 running 2024-12-18T00:04:58.1324069Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:04:58.1324735Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2024-12-18T00:04:58.1325523Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:04:58.1326314Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:04:58.1327179Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 12s local 2024-12-18T00:04:58.1328220Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 12s local 2024-12-18T00:04:58.1329004Z @llvm-project//mlir:mlir-tblgen; 11s local 2024-12-18T00:04:58.1329795Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 10s local ... 2024-12-18T00:04:58.5202433Z 2024-12-18T00:04:58.5203473Z  2024-12-18T00:04:58.5203899Z  2024-12-18T00:04:58.5204257Z  2024-12-18T00:04:58.5204642Z  2024-12-18T00:04:58.5205046Z  2024-12-18T00:04:58.5205779Z  2024-12-18T00:04:58.5206173Z  2024-12-18T00:04:58.5206564Z  2024-12-18T00:04:58.5207149Z [10,447 / 15,187] 48 actions running 2024-12-18T00:04:58.5207850Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:04:58.5208591Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2024-12-18T00:04:58.5209700Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:04:58.5210614Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T00:04:58.5211633Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 12s local 2024-12-18T00:04:58.5212871Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 12s local 2024-12-18T00:04:58.5213748Z @llvm-project//mlir:mlir-tblgen; 11s local 2024-12-18T00:04:58.5214621Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 10s local ... 2024-12-18T00:04:58.7377401Z 2024-12-18T00:04:58.7378326Z  2024-12-18T00:04:58.7379025Z  2024-12-18T00:04:58.7379601Z  2024-12-18T00:04:58.7380132Z  2024-12-18T00:04:58.7380664Z  2024-12-18T00:04:58.7381195Z  2024-12-18T00:04:58.7381648Z  2024-12-18T00:04:58.7382105Z  2024-12-18T00:04:58.7382843Z [10,451 / 15,187] 48 actions, 47 running 2024-12-18T00:04:58.7383693Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:04:58.7384644Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2024-12-18T00:04:58.7385662Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:04:58.7386741Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T00:04:58.7388046Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 12s local 2024-12-18T00:04:58.7389166Z @llvm-project//mlir:mlir-tblgen; 11s local 2024-12-18T00:04:58.7390143Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 10s local 2024-12-18T00:04:58.7391300Z Compiling llvm/lib/CodeGen/GlobalISel/Legalizer.cpp; 9s local ... 2024-12-18T00:04:58.9420913Z 2024-12-18T00:04:58.9421818Z  2024-12-18T00:04:58.9422303Z  2024-12-18T00:04:58.9422720Z  2024-12-18T00:04:58.9423111Z  2024-12-18T00:04:58.9423531Z  2024-12-18T00:04:58.9423945Z  2024-12-18T00:04:58.9424361Z  2024-12-18T00:04:58.9424757Z  2024-12-18T00:04:58.9425360Z [10,455 / 15,187] 48 actions, 47 running 2024-12-18T00:04:58.9426151Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2024-12-18T00:04:58.9427032Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:04:58.9428091Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T00:04:58.9429039Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 13s local 2024-12-18T00:04:58.9429912Z @llvm-project//mlir:mlir-tblgen; 11s local 2024-12-18T00:04:58.9430756Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 11s local 2024-12-18T00:04:58.9431748Z Compiling llvm/lib/CodeGen/GlobalISel/Legalizer.cpp; 9s local 2024-12-18T00:04:58.9432791Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 9s local ... 2024-12-18T00:04:59.1850169Z 2024-12-18T00:04:59.1851136Z  2024-12-18T00:04:59.1851565Z  2024-12-18T00:04:59.1851929Z  2024-12-18T00:04:59.1852280Z  2024-12-18T00:04:59.1852659Z  2024-12-18T00:04:59.1853028Z  2024-12-18T00:04:59.1853421Z  2024-12-18T00:04:59.1853778Z  2024-12-18T00:04:59.1854297Z [10,458 / 15,187] 48 actions, 47 running 2024-12-18T00:04:59.1855015Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:04:59.1855833Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:04:59.1856833Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T00:04:59.1857709Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 13s local 2024-12-18T00:04:59.1858530Z @llvm-project//mlir:mlir-tblgen; 12s local 2024-12-18T00:04:59.1859658Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 11s local 2024-12-18T00:04:59.1860628Z Compiling llvm/lib/CodeGen/GlobalISel/Legalizer.cpp; 10s local 2024-12-18T00:04:59.1861698Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 9s local ... 2024-12-18T00:04:59.3838758Z 2024-12-18T00:04:59.3839679Z  2024-12-18T00:04:59.3840161Z  2024-12-18T00:04:59.3840548Z  2024-12-18T00:04:59.3841264Z  2024-12-18T00:04:59.3841739Z  2024-12-18T00:04:59.3842181Z  2024-12-18T00:04:59.3842629Z  2024-12-18T00:04:59.3842979Z  2024-12-18T00:04:59.3843630Z [10,460 / 15,187] 48 actions, 47 running 2024-12-18T00:04:59.3844656Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:04:59.3845594Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:04:59.3846508Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:04:59.3847435Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 13s local 2024-12-18T00:04:59.3848428Z @llvm-project//mlir:mlir-tblgen; 12s local 2024-12-18T00:04:59.3849236Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 11s local 2024-12-18T00:04:59.3850279Z Compiling llvm/lib/CodeGen/GlobalISel/Legalizer.cpp; 10s local 2024-12-18T00:04:59.3851410Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 10s local ... 2024-12-18T00:04:59.7212799Z 2024-12-18T00:04:59.7213634Z  2024-12-18T00:04:59.7214121Z  2024-12-18T00:04:59.7214526Z  2024-12-18T00:04:59.7214910Z  2024-12-18T00:04:59.7215287Z  2024-12-18T00:04:59.7215772Z  2024-12-18T00:04:59.7216139Z  2024-12-18T00:04:59.7216679Z  2024-12-18T00:04:59.7217196Z [10,460 / 15,187] 48 actions running 2024-12-18T00:04:59.7217927Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:04:59.7218750Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:04:59.7219659Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:04:59.7220580Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 13s local 2024-12-18T00:04:59.7221422Z @llvm-project//mlir:mlir-tblgen; 12s local 2024-12-18T00:04:59.7222203Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 11s local 2024-12-18T00:04:59.7223231Z Compiling llvm/lib/CodeGen/GlobalISel/Legalizer.cpp; 10s local 2024-12-18T00:04:59.7224257Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 10s local ... 2024-12-18T00:04:59.9567469Z 2024-12-18T00:04:59.9568305Z  2024-12-18T00:04:59.9568760Z  2024-12-18T00:04:59.9569159Z  2024-12-18T00:04:59.9569529Z  2024-12-18T00:04:59.9569894Z  2024-12-18T00:04:59.9570281Z  2024-12-18T00:04:59.9570652Z  2024-12-18T00:04:59.9570965Z  2024-12-18T00:04:59.9571493Z [10,462 / 15,187] 48 actions, 47 running 2024-12-18T00:04:59.9572228Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:04:59.9573125Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:04:59.9574000Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:04:59.9574887Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:04:59.9575748Z @llvm-project//mlir:mlir-tblgen; 12s local 2024-12-18T00:04:59.9576744Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 12s local 2024-12-18T00:04:59.9577774Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 10s local 2024-12-18T00:04:59.9578781Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 9s local ... 2024-12-18T00:05:00.1817429Z 2024-12-18T00:05:00.1818296Z  2024-12-18T00:05:00.1818758Z  2024-12-18T00:05:00.1819164Z  2024-12-18T00:05:00.1819550Z  2024-12-18T00:05:00.1819927Z  2024-12-18T00:05:00.1820323Z  2024-12-18T00:05:00.1820711Z  2024-12-18T00:05:00.1821096Z  2024-12-18T00:05:00.1822168Z [10,464 / 15,187] 48 actions, 47 running 2024-12-18T00:05:00.1822934Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:05:00.1823827Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2024-12-18T00:05:00.1824744Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:05:00.1825933Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:05:00.1826812Z @llvm-project//mlir:mlir-tblgen; 13s local 2024-12-18T00:05:00.1827651Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 12s local 2024-12-18T00:05:00.1828712Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 10s local 2024-12-18T00:05:00.1829731Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 9s local ... 2024-12-18T00:05:00.4953484Z 2024-12-18T00:05:00.4954230Z  2024-12-18T00:05:00.4954631Z  2024-12-18T00:05:00.4954963Z  2024-12-18T00:05:00.4955303Z  2024-12-18T00:05:00.4955642Z  2024-12-18T00:05:00.4956036Z  2024-12-18T00:05:00.4956373Z  2024-12-18T00:05:00.4956693Z  2024-12-18T00:05:00.4957227Z [10,467 / 15,187] 48 actions, 47 running 2024-12-18T00:05:00.4957877Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:05:00.4958646Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2024-12-18T00:05:00.4959447Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T00:05:00.4960271Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:05:00.4961037Z @llvm-project//mlir:mlir-tblgen; 13s local 2024-12-18T00:05:00.4961754Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 12s local 2024-12-18T00:05:00.4962662Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 11s local 2024-12-18T00:05:00.4963555Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 9s local ... 2024-12-18T00:05:00.7222357Z 2024-12-18T00:05:00.7223207Z  2024-12-18T00:05:00.7223721Z  2024-12-18T00:05:00.7224106Z  2024-12-18T00:05:00.7224473Z  2024-12-18T00:05:00.7224858Z  2024-12-18T00:05:00.7225233Z  2024-12-18T00:05:00.7225638Z  2024-12-18T00:05:00.7226054Z  2024-12-18T00:05:00.7226613Z [10,469 / 15,187] 48 actions running 2024-12-18T00:05:00.7227354Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:05:00.7228210Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T00:05:00.7229252Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:05:00.7230133Z @llvm-project//mlir:mlir-tblgen; 13s local 2024-12-18T00:05:00.7230946Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 12s local 2024-12-18T00:05:00.7231938Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 11s local 2024-12-18T00:05:00.7232838Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 10s local 2024-12-18T00:05:00.7233686Z Compiling llvm/lib/CodeGen/IfConversion.cpp; 8s local ... 2024-12-18T00:05:00.9554289Z 2024-12-18T00:05:00.9555191Z  2024-12-18T00:05:00.9555728Z  2024-12-18T00:05:00.9556141Z  2024-12-18T00:05:00.9556509Z  2024-12-18T00:05:00.9556875Z  2024-12-18T00:05:00.9557250Z  2024-12-18T00:05:00.9557616Z  2024-12-18T00:05:00.9557979Z  2024-12-18T00:05:00.9558591Z [10,470 / 15,187] 48 actions, 47 running 2024-12-18T00:05:00.9559342Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:05:00.9560148Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T00:05:00.9561121Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local 2024-12-18T00:05:00.9562020Z @llvm-project//mlir:mlir-tblgen; 13s local 2024-12-18T00:05:00.9562823Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 13s local 2024-12-18T00:05:00.9563809Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 11s local 2024-12-18T00:05:00.9565393Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 10s local 2024-12-18T00:05:00.9566252Z Compiling llvm/lib/CodeGen/IfConversion.cpp; 9s local ... 2024-12-18T00:05:01.1860529Z 2024-12-18T00:05:01.1861366Z  2024-12-18T00:05:01.1861837Z  2024-12-18T00:05:01.1862264Z  2024-12-18T00:05:01.1862655Z  2024-12-18T00:05:01.1863011Z  2024-12-18T00:05:01.1863405Z  2024-12-18T00:05:01.1864187Z  2024-12-18T00:05:01.1864605Z  2024-12-18T00:05:01.1865192Z [10,474 / 15,187] 48 actions, 47 running 2024-12-18T00:05:01.1865938Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:05:01.1866801Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T00:05:01.1867808Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local 2024-12-18T00:05:01.1868713Z @llvm-project//mlir:mlir-tblgen; 14s local 2024-12-18T00:05:01.1869575Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 13s local 2024-12-18T00:05:01.1870651Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 11s local 2024-12-18T00:05:01.1871618Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 10s local 2024-12-18T00:05:01.1872511Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 8s local ... 2024-12-18T00:05:01.4142921Z 2024-12-18T00:05:01.4143752Z  2024-12-18T00:05:01.4144378Z  2024-12-18T00:05:01.4144779Z  2024-12-18T00:05:01.4145130Z  2024-12-18T00:05:01.4145492Z  2024-12-18T00:05:01.4145840Z  2024-12-18T00:05:01.4146193Z  2024-12-18T00:05:01.4146527Z  2024-12-18T00:05:01.4147072Z [10,476 / 15,187] 48 actions, 47 running 2024-12-18T00:05:01.4147777Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:05:01.4148704Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T00:05:01.4149685Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local 2024-12-18T00:05:01.4150531Z @llvm-project//mlir:mlir-tblgen; 14s local 2024-12-18T00:05:01.4151359Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 13s local 2024-12-18T00:05:01.4152375Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 12s local 2024-12-18T00:05:01.4153338Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 10s local 2024-12-18T00:05:01.4154197Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 8s local ... 2024-12-18T00:05:01.6808609Z 2024-12-18T00:05:01.6809484Z  2024-12-18T00:05:01.6810091Z  2024-12-18T00:05:01.6810481Z  2024-12-18T00:05:01.6810853Z  2024-12-18T00:05:01.6811249Z  2024-12-18T00:05:01.6811627Z  2024-12-18T00:05:01.6812019Z  2024-12-18T00:05:01.6812401Z  2024-12-18T00:05:01.6812967Z [10,478 / 15,187] 48 actions, 47 running 2024-12-18T00:05:01.6813728Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:05:01.6814513Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T00:05:01.6815504Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local 2024-12-18T00:05:01.6816391Z @llvm-project//mlir:mlir-tblgen; 14s local 2024-12-18T00:05:01.6817344Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 13s local 2024-12-18T00:05:01.6818428Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 12s local 2024-12-18T00:05:01.6819429Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 11s local 2024-12-18T00:05:01.6820342Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 9s local ... 2024-12-18T00:05:01.9234632Z 2024-12-18T00:05:01.9235521Z  2024-12-18T00:05:01.9235994Z  2024-12-18T00:05:01.9236323Z  2024-12-18T00:05:01.9236697Z  2024-12-18T00:05:01.9237060Z  2024-12-18T00:05:01.9237429Z  2024-12-18T00:05:01.9237786Z  2024-12-18T00:05:01.9238145Z  2024-12-18T00:05:01.9238645Z [10,479 / 15,187] 48 actions running 2024-12-18T00:05:01.9239360Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:05:01.9240692Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T00:05:01.9241663Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:05:01.9242469Z @llvm-project//mlir:mlir-tblgen; 14s local 2024-12-18T00:05:01.9243271Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local 2024-12-18T00:05:01.9244769Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 12s local 2024-12-18T00:05:01.9245685Z Compiling llvm/lib/CodeGen/GlobalISel/Utils.cpp; 11s local 2024-12-18T00:05:01.9246551Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 9s local ... 2024-12-18T00:05:02.1419643Z 2024-12-18T00:05:02.1420515Z  2024-12-18T00:05:02.1421001Z  2024-12-18T00:05:02.1421414Z  2024-12-18T00:05:02.1421798Z  2024-12-18T00:05:02.1422179Z  2024-12-18T00:05:02.1422569Z  2024-12-18T00:05:02.1422966Z  2024-12-18T00:05:02.1423373Z  2024-12-18T00:05:02.1423952Z [10,483 / 15,187] 48 actions, 47 running 2024-12-18T00:05:02.1424773Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:05:02.1425607Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T00:05:02.1426623Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:05:02.1427531Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:05:02.1428409Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local 2024-12-18T00:05:02.1429470Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 12s local 2024-12-18T00:05:02.1430421Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 9s local 2024-12-18T00:05:02.1431393Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 9s local ... 2024-12-18T00:05:02.5196079Z 2024-12-18T00:05:02.5196940Z  2024-12-18T00:05:02.5197349Z  2024-12-18T00:05:02.5197725Z  2024-12-18T00:05:02.5198079Z  2024-12-18T00:05:02.5198465Z  2024-12-18T00:05:02.5198886Z  2024-12-18T00:05:02.5199256Z  2024-12-18T00:05:02.5199636Z  2024-12-18T00:05:02.5200194Z [10,484 / 15,187] 48 actions, 47 running 2024-12-18T00:05:02.5200941Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:05:02.5201769Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T00:05:02.5202774Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:05:02.5203788Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:05:02.5204688Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local 2024-12-18T00:05:02.5205839Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 13s local 2024-12-18T00:05:02.5206865Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 10s local 2024-12-18T00:05:02.5207910Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 9s local ... 2024-12-18T00:05:02.7242371Z 2024-12-18T00:05:02.7243282Z  2024-12-18T00:05:02.7243821Z  2024-12-18T00:05:02.7244372Z  2024-12-18T00:05:02.7244761Z  2024-12-18T00:05:02.7245149Z  2024-12-18T00:05:02.7245520Z  2024-12-18T00:05:02.7245898Z  2024-12-18T00:05:02.7246297Z  2024-12-18T00:05:02.7246875Z [10,484 / 15,187] 48 actions running 2024-12-18T00:05:02.7247773Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:05:02.7248656Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T00:05:02.7249633Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:05:02.7250533Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:05:02.7251364Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local 2024-12-18T00:05:02.7252300Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 13s local 2024-12-18T00:05:02.7253280Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 10s local 2024-12-18T00:05:02.7254262Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 9s local ... 2024-12-18T00:05:02.9422344Z 2024-12-18T00:05:02.9423266Z  2024-12-18T00:05:02.9423740Z  2024-12-18T00:05:02.9424145Z  2024-12-18T00:05:02.9424555Z  2024-12-18T00:05:02.9424954Z  2024-12-18T00:05:02.9425342Z  2024-12-18T00:05:02.9425736Z  2024-12-18T00:05:02.9426144Z  2024-12-18T00:05:02.9427129Z [10,485 / 15,187] 48 actions, 47 running 2024-12-18T00:05:02.9427967Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:05:02.9428844Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T00:05:02.9430013Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2024-12-18T00:05:02.9430938Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:05:02.9431813Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local 2024-12-18T00:05:02.9432925Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 13s local 2024-12-18T00:05:02.9433949Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 10s local 2024-12-18T00:05:02.9434993Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 10s local ... 2024-12-18T00:05:03.3141583Z 2024-12-18T00:05:03.3143094Z  2024-12-18T00:05:03.3143599Z  2024-12-18T00:05:03.3143968Z  2024-12-18T00:05:03.3144603Z  2024-12-18T00:05:03.3145000Z  2024-12-18T00:05:03.3145421Z  2024-12-18T00:05:03.3145779Z  2024-12-18T00:05:03.3146158Z  2024-12-18T00:05:03.3146747Z [10,487 / 15,187] 48 actions, 47 running 2024-12-18T00:05:03.3149610Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:05:03.3150414Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T00:05:03.3151350Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2024-12-18T00:05:03.3152233Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:05:03.3153054Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local 2024-12-18T00:05:03.3154110Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 14s local 2024-12-18T00:05:03.3155843Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 10s local 2024-12-18T00:05:03.3156605Z @llvm-project//llvm:CodeGen; 9s local ... 2024-12-18T00:05:03.5250739Z 2024-12-18T00:05:03.5251621Z  2024-12-18T00:05:03.5252112Z  2024-12-18T00:05:03.5252511Z  2024-12-18T00:05:03.5252980Z  2024-12-18T00:05:03.5253384Z  2024-12-18T00:05:03.5253765Z  2024-12-18T00:05:03.5254142Z  2024-12-18T00:05:03.5254541Z  2024-12-18T00:05:03.5255111Z [10,489 / 15,187] 48 actions running 2024-12-18T00:05:03.5255841Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:05:03.5256758Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T00:05:03.5257703Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2024-12-18T00:05:03.5258573Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:05:03.5259397Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local 2024-12-18T00:05:03.5260428Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 14s local 2024-12-18T00:05:03.5261556Z Compiling llvm/lib/CodeGen/LiveDebugValues/InstrRefBasedImpl.cpp; 9s local 2024-12-18T00:05:03.5262472Z @llvm-project//llvm:CodeGen; 9s local ... 2024-12-18T00:05:03.7255456Z 2024-12-18T00:05:03.7256294Z  2024-12-18T00:05:03.7256880Z  2024-12-18T00:05:03.7257280Z  2024-12-18T00:05:03.7257652Z  2024-12-18T00:05:03.7258029Z  2024-12-18T00:05:03.7258412Z  2024-12-18T00:05:03.7258766Z  2024-12-18T00:05:03.7259142Z  2024-12-18T00:05:03.7259675Z [10,491 / 15,187] 48 actions running 2024-12-18T00:05:03.7260416Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:05:03.7261252Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T00:05:03.7262240Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2024-12-18T00:05:03.7263544Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:05:03.7264369Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local 2024-12-18T00:05:03.7265364Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 14s local 2024-12-18T00:05:03.7266770Z Compiling llvm/lib/CodeGen/LiveDebugValues/InstrRefBasedImpl.cpp; 9s local 2024-12-18T00:05:03.7267733Z @llvm-project//llvm:CodeGen; 9s local ... 2024-12-18T00:05:04.0052711Z 2024-12-18T00:05:04.0053619Z  2024-12-18T00:05:04.0054103Z  2024-12-18T00:05:04.0054472Z  2024-12-18T00:05:04.0054832Z  2024-12-18T00:05:04.0055214Z  2024-12-18T00:05:04.0055578Z  2024-12-18T00:05:04.0055958Z  2024-12-18T00:05:04.0056330Z  2024-12-18T00:05:04.0057037Z [10,495 / 15,187] 48 actions, 47 running 2024-12-18T00:05:04.0057815Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:05:04.0058601Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T00:05:04.0059536Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2024-12-18T00:05:04.0060398Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:05:04.0061227Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local 2024-12-18T00:05:04.0062299Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 14s local 2024-12-18T00:05:04.0063104Z @llvm-project//llvm:CodeGen; 10s local 2024-12-18T00:05:04.0063669Z @llvm-project//llvm:CodeGen; 9s local ... 2024-12-18T00:05:04.3261635Z 2024-12-18T00:05:04.3262478Z  2024-12-18T00:05:04.3262910Z  2024-12-18T00:05:04.3263238Z  2024-12-18T00:05:04.3263617Z  2024-12-18T00:05:04.3263971Z  2024-12-18T00:05:04.3264351Z  2024-12-18T00:05:04.3264691Z  2024-12-18T00:05:04.3265066Z  2024-12-18T00:05:04.3265548Z [10,496 / 15,187] 48 actions running 2024-12-18T00:05:04.3266272Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:05:04.3267039Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T00:05:04.3267946Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2024-12-18T00:05:04.3268720Z @llvm-project//mlir:mlir-tblgen; 17s local 2024-12-18T00:05:04.3269474Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local 2024-12-18T00:05:04.3270396Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 15s local 2024-12-18T00:05:04.3271153Z @llvm-project//llvm:CodeGen; 10s local 2024-12-18T00:05:04.3271698Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:04.5265853Z 2024-12-18T00:05:04.5266685Z  2024-12-18T00:05:04.5267149Z  2024-12-18T00:05:04.5267546Z  2024-12-18T00:05:04.5267925Z  2024-12-18T00:05:04.5268313Z  2024-12-18T00:05:04.5268672Z  2024-12-18T00:05:04.5269051Z  2024-12-18T00:05:04.5269436Z  2024-12-18T00:05:04.5270026Z [10,497 / 15,187] 48 actions running 2024-12-18T00:05:04.5270701Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:05:04.5271484Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T00:05:04.5272423Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2024-12-18T00:05:04.5273286Z @llvm-project//mlir:mlir-tblgen; 17s local 2024-12-18T00:05:04.5274038Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local 2024-12-18T00:05:04.5275053Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 15s local 2024-12-18T00:05:04.5275861Z @llvm-project//llvm:CodeGen; 10s local 2024-12-18T00:05:04.5276457Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:04.9954591Z 2024-12-18T00:05:04.9955445Z  2024-12-18T00:05:04.9955879Z  2024-12-18T00:05:04.9956256Z  2024-12-18T00:05:04.9956623Z  2024-12-18T00:05:04.9956994Z  2024-12-18T00:05:04.9957701Z  2024-12-18T00:05:04.9958067Z  2024-12-18T00:05:04.9958440Z  2024-12-18T00:05:04.9958968Z [10,498 / 15,187] 48 actions, 47 running 2024-12-18T00:05:04.9959639Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:05:04.9960334Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T00:05:04.9961548Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:05:04.9962390Z @llvm-project//mlir:mlir-tblgen; 17s local 2024-12-18T00:05:04.9963161Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:05:04.9964179Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 15s local 2024-12-18T00:05:04.9964936Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:04.9965508Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:05.2906194Z 2024-12-18T00:05:05.2907047Z  2024-12-18T00:05:05.2907517Z  2024-12-18T00:05:05.2907878Z  2024-12-18T00:05:05.2908298Z  2024-12-18T00:05:05.2908658Z  2024-12-18T00:05:05.2909046Z  2024-12-18T00:05:05.2909420Z  2024-12-18T00:05:05.2909774Z  2024-12-18T00:05:05.2910315Z [10,500 / 15,187] 48 actions, 47 running 2024-12-18T00:05:05.2911047Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:05:05.2911860Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:05:05.2912796Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:05:05.2913651Z @llvm-project//mlir:mlir-tblgen; 18s local 2024-12-18T00:05:05.2914474Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:05:05.2915498Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 16s local 2024-12-18T00:05:05.2916384Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:05.2916989Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:05:05.5274013Z 2024-12-18T00:05:05.5275026Z  2024-12-18T00:05:05.5275446Z  2024-12-18T00:05:05.5275828Z  2024-12-18T00:05:05.5276181Z  2024-12-18T00:05:05.5276570Z  2024-12-18T00:05:05.5276913Z  2024-12-18T00:05:05.5277290Z  2024-12-18T00:05:05.5277665Z  2024-12-18T00:05:05.5278205Z [10,500 / 15,187] 48 actions running 2024-12-18T00:05:05.5278992Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:05:05.5279789Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:05:05.5280764Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:05:05.5281627Z @llvm-project//mlir:mlir-tblgen; 18s local 2024-12-18T00:05:05.5282419Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:05:05.5283422Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 16s local 2024-12-18T00:05:05.5284229Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:05.5284829Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:05:05.7748265Z 2024-12-18T00:05:05.7749155Z  2024-12-18T00:05:05.7749603Z  2024-12-18T00:05:05.7749991Z  2024-12-18T00:05:05.7750360Z  2024-12-18T00:05:05.7750745Z  2024-12-18T00:05:05.7751160Z  2024-12-18T00:05:05.7751520Z  2024-12-18T00:05:05.7751874Z  2024-12-18T00:05:05.7752490Z [10,501 / 15,187] 48 actions, 47 running 2024-12-18T00:05:05.7753215Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:05:05.7754009Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:05:05.7754904Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:05:05.7755744Z @llvm-project//mlir:mlir-tblgen; 18s local 2024-12-18T00:05:05.7756521Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:05:05.7757488Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 16s local 2024-12-18T00:05:05.7758794Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:05.7759403Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:05:06.0442075Z 2024-12-18T00:05:06.0442918Z  2024-12-18T00:05:06.0443395Z  2024-12-18T00:05:06.0443771Z  2024-12-18T00:05:06.0446354Z  2024-12-18T00:05:06.0447020Z  2024-12-18T00:05:06.0447397Z  2024-12-18T00:05:06.0447778Z  2024-12-18T00:05:06.0448530Z  2024-12-18T00:05:06.0449144Z [10,503 / 15,187] 48 actions, 47 running 2024-12-18T00:05:06.0449884Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:05:06.0450682Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:05:06.0451643Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local 2024-12-18T00:05:06.0452494Z @llvm-project//mlir:mlir-tblgen; 19s local 2024-12-18T00:05:06.0453318Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2024-12-18T00:05:06.0454325Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 16s local 2024-12-18T00:05:06.0455199Z @llvm-project//llvm:CodeGen; 12s local 2024-12-18T00:05:06.0455802Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:05:06.3282418Z 2024-12-18T00:05:06.3283302Z  2024-12-18T00:05:06.3283779Z  2024-12-18T00:05:06.3284171Z  2024-12-18T00:05:06.3284545Z  2024-12-18T00:05:06.3285068Z  2024-12-18T00:05:06.3285478Z  2024-12-18T00:05:06.3285852Z  2024-12-18T00:05:06.3286220Z  2024-12-18T00:05:06.3286757Z [10,505 / 15,187] 48 actions running 2024-12-18T00:05:06.3287470Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:05:06.3288242Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T00:05:06.3289156Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local 2024-12-18T00:05:06.3290119Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2024-12-18T00:05:06.3291166Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local 2024-12-18T00:05:06.3291983Z @llvm-project//llvm:CodeGen; 12s local 2024-12-18T00:05:06.3292833Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 12s local 2024-12-18T00:05:06.3293882Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 12s local ... 2024-12-18T00:05:06.5687797Z 2024-12-18T00:05:06.5688663Z  2024-12-18T00:05:06.5689178Z  2024-12-18T00:05:06.5689577Z  2024-12-18T00:05:06.5689984Z  2024-12-18T00:05:06.5690373Z  2024-12-18T00:05:06.5690779Z  2024-12-18T00:05:06.5691156Z  2024-12-18T00:05:06.5691560Z  2024-12-18T00:05:06.5692168Z [10,506 / 15,187] 48 actions, 47 running 2024-12-18T00:05:06.5692971Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:05:06.5693847Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T00:05:06.5694863Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local 2024-12-18T00:05:06.5696138Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2024-12-18T00:05:06.5697360Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local 2024-12-18T00:05:06.5698244Z @llvm-project//llvm:CodeGen; 12s local 2024-12-18T00:05:06.5699173Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 12s local 2024-12-18T00:05:06.5700336Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 12s local ... 2024-12-18T00:05:06.8069387Z 2024-12-18T00:05:06.8070217Z  2024-12-18T00:05:06.8070707Z  2024-12-18T00:05:06.8071115Z  2024-12-18T00:05:06.8071503Z  2024-12-18T00:05:06.8071896Z  2024-12-18T00:05:06.8072278Z  2024-12-18T00:05:06.8072663Z  2024-12-18T00:05:06.8073054Z  2024-12-18T00:05:06.8073654Z [10,508 / 15,187] 48 actions, 47 running 2024-12-18T00:05:06.8074447Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:05:06.8075330Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T00:05:06.8076814Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local 2024-12-18T00:05:06.8077890Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2024-12-18T00:05:06.8078971Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local 2024-12-18T00:05:06.8080100Z @llvm-project//llvm:CodeGen; 13s local 2024-12-18T00:05:06.8081063Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 12s local 2024-12-18T00:05:06.8082179Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 12s local ... 2024-12-18T00:05:07.1288786Z 2024-12-18T00:05:07.1289615Z  2024-12-18T00:05:07.1290130Z  2024-12-18T00:05:07.1290563Z  2024-12-18T00:05:07.1290980Z  2024-12-18T00:05:07.1291414Z  2024-12-18T00:05:07.1291818Z  2024-12-18T00:05:07.1292245Z  2024-12-18T00:05:07.1292659Z  2024-12-18T00:05:07.1293264Z [10,509 / 15,187] 48 actions running 2024-12-18T00:05:07.1294117Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:05:07.1295035Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T00:05:07.1296084Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2024-12-18T00:05:07.1297260Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2024-12-18T00:05:07.1298358Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local 2024-12-18T00:05:07.1299246Z @llvm-project//llvm:CodeGen; 13s local 2024-12-18T00:05:07.1300149Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 13s local 2024-12-18T00:05:07.1301263Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 12s local ... 2024-12-18T00:05:07.3292821Z 2024-12-18T00:05:07.3293697Z  2024-12-18T00:05:07.3294180Z  2024-12-18T00:05:07.3294578Z  2024-12-18T00:05:07.3294956Z  2024-12-18T00:05:07.3295358Z  2024-12-18T00:05:07.3295755Z  2024-12-18T00:05:07.3296205Z  2024-12-18T00:05:07.3296700Z  2024-12-18T00:05:07.3297264Z [10,512 / 15,187] 48 actions running 2024-12-18T00:05:07.3298035Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:05:07.3298879Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T00:05:07.3299931Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2024-12-18T00:05:07.3301194Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2024-12-18T00:05:07.3302342Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2024-12-18T00:05:07.3303282Z @llvm-project//llvm:CodeGen; 13s local 2024-12-18T00:05:07.3304254Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 13s local 2024-12-18T00:05:07.3305415Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 13s local ... 2024-12-18T00:05:07.7289109Z 2024-12-18T00:05:07.7289954Z  2024-12-18T00:05:07.7290425Z  2024-12-18T00:05:07.7290848Z  2024-12-18T00:05:07.7291201Z  2024-12-18T00:05:07.7291555Z  2024-12-18T00:05:07.7291926Z  2024-12-18T00:05:07.7292273Z  2024-12-18T00:05:07.7292626Z  2024-12-18T00:05:07.7293175Z [10,515 / 15,187] 48 actions, 47 running 2024-12-18T00:05:07.7293880Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:05:07.7294678Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T00:05:07.7295608Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2024-12-18T00:05:07.7296667Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2024-12-18T00:05:07.7297635Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2024-12-18T00:05:07.7298450Z @llvm-project//llvm:CodeGen; 13s local 2024-12-18T00:05:07.7299284Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 13s local 2024-12-18T00:05:07.7300329Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 8s local ... 2024-12-18T00:05:07.9300212Z 2024-12-18T00:05:07.9301107Z  2024-12-18T00:05:07.9301576Z  2024-12-18T00:05:07.9301987Z  2024-12-18T00:05:07.9302405Z  2024-12-18T00:05:07.9302835Z  2024-12-18T00:05:07.9303255Z  2024-12-18T00:05:07.9303645Z  2024-12-18T00:05:07.9304059Z  2024-12-18T00:05:07.9304986Z [10,515 / 15,187] 48 actions running 2024-12-18T00:05:07.9305778Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:05:07.9306602Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T00:05:07.9307576Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2024-12-18T00:05:07.9308690Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 20s local 2024-12-18T00:05:07.9309739Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2024-12-18T00:05:07.9310565Z @llvm-project//llvm:CodeGen; 14s local 2024-12-18T00:05:07.9311463Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 13s local 2024-12-18T00:05:07.9312584Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 9s local ... 2024-12-18T00:05:08.1304761Z 2024-12-18T00:05:08.1305553Z  2024-12-18T00:05:08.1306055Z  2024-12-18T00:05:08.1306459Z  2024-12-18T00:05:08.1306851Z  2024-12-18T00:05:08.1307240Z  2024-12-18T00:05:08.1307626Z  2024-12-18T00:05:08.1308054Z  2024-12-18T00:05:08.1308424Z  2024-12-18T00:05:08.1308999Z [10,519 / 15,187] 48 actions, 47 running 2024-12-18T00:05:08.1309782Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:05:08.1310656Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T00:05:08.1311660Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2024-12-18T00:05:08.1312714Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 20s local 2024-12-18T00:05:08.1313765Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2024-12-18T00:05:08.1314665Z @llvm-project//llvm:CodeGen; 14s local 2024-12-18T00:05:08.1315613Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 14s local 2024-12-18T00:05:08.1316763Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 9s local ... 2024-12-18T00:05:08.5308223Z 2024-12-18T00:05:08.5309090Z  2024-12-18T00:05:08.5309554Z  2024-12-18T00:05:08.5310016Z  2024-12-18T00:05:08.5310427Z  2024-12-18T00:05:08.5310829Z  2024-12-18T00:05:08.5311225Z  2024-12-18T00:05:08.5311586Z  2024-12-18T00:05:08.5311952Z  2024-12-18T00:05:08.5312501Z [10,521 / 15,187] 48 actions, 47 running 2024-12-18T00:05:08.5313363Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:05:08.5314194Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T00:05:08.5315121Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2024-12-18T00:05:08.5316228Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local 2024-12-18T00:05:08.5317102Z @llvm-project//llvm:CodeGen; 14s local 2024-12-18T00:05:08.5317988Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 14s local 2024-12-18T00:05:08.5319066Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 9s local 2024-12-18T00:05:08.5320026Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 9s local ... 2024-12-18T00:05:08.9312762Z 2024-12-18T00:05:08.9313579Z  2024-12-18T00:05:08.9314061Z  2024-12-18T00:05:08.9314449Z  2024-12-18T00:05:08.9314845Z  2024-12-18T00:05:08.9315249Z  2024-12-18T00:05:08.9315637Z  2024-12-18T00:05:08.9316026Z  2024-12-18T00:05:08.9316385Z  2024-12-18T00:05:08.9316949Z [10,522 / 15,187] 48 actions running 2024-12-18T00:05:08.9317756Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:05:08.9318567Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T00:05:08.9320076Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 23s local 2024-12-18T00:05:08.9321195Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local 2024-12-18T00:05:08.9322092Z @llvm-project//llvm:CodeGen; 15s local 2024-12-18T00:05:08.9323041Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 14s local 2024-12-18T00:05:08.9324410Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 10s local 2024-12-18T00:05:08.9325421Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 9s local ... 2024-12-18T00:05:09.1316865Z 2024-12-18T00:05:09.1317665Z  2024-12-18T00:05:09.1318151Z  2024-12-18T00:05:09.1318549Z  2024-12-18T00:05:09.1318940Z  2024-12-18T00:05:09.1319313Z  2024-12-18T00:05:09.1319700Z  2024-12-18T00:05:09.1320100Z  2024-12-18T00:05:09.1320484Z  2024-12-18T00:05:09.1321030Z [10,525 / 15,187] 48 actions running 2024-12-18T00:05:09.1321770Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:05:09.1322626Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T00:05:09.1323544Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 23s local 2024-12-18T00:05:09.1324614Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local 2024-12-18T00:05:09.1325455Z @llvm-project//llvm:CodeGen; 15s local 2024-12-18T00:05:09.1326355Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 15s local 2024-12-18T00:05:09.1327426Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 10s local 2024-12-18T00:05:09.1328384Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 10s local ... 2024-12-18T00:05:09.4880365Z 2024-12-18T00:05:09.4881272Z  2024-12-18T00:05:09.4881750Z  2024-12-18T00:05:09.4882184Z  2024-12-18T00:05:09.4882563Z  2024-12-18T00:05:09.4882973Z  2024-12-18T00:05:09.4883336Z  2024-12-18T00:05:09.4883727Z  2024-12-18T00:05:09.4884145Z  2024-12-18T00:05:09.4884711Z [10,530 / 15,187] 47 actions, 46 running 2024-12-18T00:05:09.4885462Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:05:09.4886441Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2024-12-18T00:05:09.4887294Z @llvm-project//llvm:CodeGen; 15s local 2024-12-18T00:05:09.4888369Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 15s local 2024-12-18T00:05:09.4889402Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 10s local 2024-12-18T00:05:09.4890300Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 10s local 2024-12-18T00:05:09.4891138Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 10s local 2024-12-18T00:05:09.4892000Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 10s local ... 2024-12-18T00:05:09.6910849Z 2024-12-18T00:05:09.6911746Z  2024-12-18T00:05:09.6912187Z  2024-12-18T00:05:09.6912585Z  2024-12-18T00:05:09.6912960Z  2024-12-18T00:05:09.6913344Z  2024-12-18T00:05:09.6913709Z  2024-12-18T00:05:09.6914103Z  2024-12-18T00:05:09.6914486Z  2024-12-18T00:05:09.6915048Z [10,547 / 15,187] 48 actions, 47 running 2024-12-18T00:05:09.6915753Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:05:09.6916641Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2024-12-18T00:05:09.6917630Z @llvm-project//llvm:CodeGen; 15s local 2024-12-18T00:05:09.6918689Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 15s local 2024-12-18T00:05:09.6919969Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 10s local 2024-12-18T00:05:09.6921106Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 10s local 2024-12-18T00:05:09.6922159Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 10s local 2024-12-18T00:05:09.6923226Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 10s local ... 2024-12-18T00:05:09.8918511Z 2024-12-18T00:05:09.8919632Z  2024-12-18T00:05:09.8920111Z  2024-12-18T00:05:09.8920525Z  2024-12-18T00:05:09.8920954Z  2024-12-18T00:05:09.8921373Z  2024-12-18T00:05:09.8921797Z  2024-12-18T00:05:09.8922214Z  2024-12-18T00:05:09.8922616Z  2024-12-18T00:05:09.8923222Z [10,556 / 15,187] 48 actions, 47 running 2024-12-18T00:05:09.8924224Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:05:09.8925183Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2024-12-18T00:05:09.8926084Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:05:09.8926988Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 15s local 2024-12-18T00:05:09.8928272Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2024-12-18T00:05:09.8929248Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 10s local 2024-12-18T00:05:09.8930137Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 10s local 2024-12-18T00:05:09.8931053Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 10s local ... 2024-12-18T00:05:10.1099995Z 2024-12-18T00:05:10.1100900Z  2024-12-18T00:05:10.1101371Z  2024-12-18T00:05:10.1101788Z  2024-12-18T00:05:10.1102188Z  2024-12-18T00:05:10.1102613Z  2024-12-18T00:05:10.1103024Z  2024-12-18T00:05:10.1103420Z  2024-12-18T00:05:10.1103829Z  2024-12-18T00:05:10.1104477Z [10,561 / 15,187] 48 actions, 47 running 2024-12-18T00:05:10.1105264Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:05:10.1106227Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2024-12-18T00:05:10.1107096Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:05:10.1107994Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 16s local 2024-12-18T00:05:10.1109108Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2024-12-18T00:05:10.1110066Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local 2024-12-18T00:05:10.1110963Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 11s local 2024-12-18T00:05:10.1111852Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 10s local ... 2024-12-18T00:05:10.3328088Z 2024-12-18T00:05:10.3328972Z  2024-12-18T00:05:10.3329457Z  2024-12-18T00:05:10.3329868Z  2024-12-18T00:05:10.3330273Z  2024-12-18T00:05:10.3330644Z  2024-12-18T00:05:10.3331093Z  2024-12-18T00:05:10.3331490Z  2024-12-18T00:05:10.3331878Z  2024-12-18T00:05:10.3332445Z [10,563 / 15,187] 48 actions running 2024-12-18T00:05:10.3333191Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:05:10.3334104Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2024-12-18T00:05:10.3335164Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:05:10.3336114Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 16s local 2024-12-18T00:05:10.3337465Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2024-12-18T00:05:10.3338499Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local 2024-12-18T00:05:10.3339400Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 11s local 2024-12-18T00:05:10.3340336Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 11s local ... 2024-12-18T00:05:10.5421149Z 2024-12-18T00:05:10.5422022Z  2024-12-18T00:05:10.5422490Z  2024-12-18T00:05:10.5422942Z  2024-12-18T00:05:10.5423325Z  2024-12-18T00:05:10.5423655Z  2024-12-18T00:05:10.5424007Z  2024-12-18T00:05:10.5424361Z  2024-12-18T00:05:10.5424753Z  2024-12-18T00:05:10.5425336Z [10,571 / 15,187] 48 actions, 47 running 2024-12-18T00:05:10.5426132Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:05:10.5427034Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2024-12-18T00:05:10.5427885Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:05:10.5428772Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 16s local 2024-12-18T00:05:10.5430273Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2024-12-18T00:05:10.5431229Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local 2024-12-18T00:05:10.5432049Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 11s local 2024-12-18T00:05:10.5433116Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 11s local ... 2024-12-18T00:05:10.7885564Z 2024-12-18T00:05:10.7886477Z  2024-12-18T00:05:10.7886947Z  2024-12-18T00:05:10.7887390Z  2024-12-18T00:05:10.7887777Z  2024-12-18T00:05:10.7888238Z  2024-12-18T00:05:10.7888626Z  2024-12-18T00:05:10.7888991Z  2024-12-18T00:05:10.7889366Z  2024-12-18T00:05:10.7889938Z [10,582 / 15,187] 48 actions, 47 running 2024-12-18T00:05:10.7890711Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:05:10.7891689Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2024-12-18T00:05:10.7892608Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:05:10.7893499Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 16s local 2024-12-18T00:05:10.7894587Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2024-12-18T00:05:10.7895549Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local 2024-12-18T00:05:10.7896699Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 11s local 2024-12-18T00:05:10.7897602Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 11s local ... 2024-12-18T00:05:11.0676584Z 2024-12-18T00:05:11.0677411Z  2024-12-18T00:05:11.0677875Z  2024-12-18T00:05:11.0678269Z  2024-12-18T00:05:11.0678657Z  2024-12-18T00:05:11.0679053Z  2024-12-18T00:05:11.0679436Z  2024-12-18T00:05:11.0679822Z  2024-12-18T00:05:11.0680213Z  2024-12-18T00:05:11.0680790Z [10,595 / 15,187] 48 actions, 47 running 2024-12-18T00:05:11.0681570Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:05:11.0682329Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:05:11.0683109Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 12s local 2024-12-18T00:05:11.0684037Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local 2024-12-18T00:05:11.0684893Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 11s local 2024-12-18T00:05:11.0685746Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 11s local 2024-12-18T00:05:11.0686640Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 10s local 2024-12-18T00:05:11.0687606Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 10s local ... 2024-12-18T00:05:11.2979324Z 2024-12-18T00:05:11.2980206Z  2024-12-18T00:05:11.2980708Z  2024-12-18T00:05:11.2981060Z  2024-12-18T00:05:11.2981461Z  2024-12-18T00:05:11.2981853Z  2024-12-18T00:05:11.2982297Z  2024-12-18T00:05:11.2982684Z  2024-12-18T00:05:11.2983059Z  2024-12-18T00:05:11.2983710Z [10,599 / 15,187] 48 actions, 47 running 2024-12-18T00:05:11.2984522Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:05:11.2985247Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:05:11.2986053Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 12s local 2024-12-18T00:05:11.2987029Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local 2024-12-18T00:05:11.2987882Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 12s local 2024-12-18T00:05:11.2988715Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 12s local 2024-12-18T00:05:11.2989565Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 11s local 2024-12-18T00:05:11.2990558Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 10s local ... 2024-12-18T00:05:11.5337428Z 2024-12-18T00:05:11.5338289Z  2024-12-18T00:05:11.5338777Z  2024-12-18T00:05:11.5339170Z  2024-12-18T00:05:11.5339564Z  2024-12-18T00:05:11.5339877Z  2024-12-18T00:05:11.5340638Z  2024-12-18T00:05:11.5341024Z  2024-12-18T00:05:11.5341421Z  2024-12-18T00:05:11.5341978Z [10,605 / 15,187] 48 actions running 2024-12-18T00:05:11.5342724Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:05:11.5343434Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:05:11.5344423Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 12s local 2024-12-18T00:05:11.5345634Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local 2024-12-18T00:05:11.5346494Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 12s local 2024-12-18T00:05:11.5347337Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 12s local 2024-12-18T00:05:11.5348250Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 11s local 2024-12-18T00:05:11.5349249Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 11s local ... 2024-12-18T00:05:11.7419526Z 2024-12-18T00:05:11.7420399Z  2024-12-18T00:05:11.7420853Z  2024-12-18T00:05:11.7421292Z  2024-12-18T00:05:11.7421694Z  2024-12-18T00:05:11.7422105Z  2024-12-18T00:05:11.7422487Z  2024-12-18T00:05:11.7423004Z  2024-12-18T00:05:11.7423396Z  2024-12-18T00:05:11.7423977Z [10,611 / 15,187] 48 actions, 47 running 2024-12-18T00:05:11.7424758Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:05:11.7425489Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:05:11.7426299Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 12s local 2024-12-18T00:05:11.7427372Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local 2024-12-18T00:05:11.7428377Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 12s local 2024-12-18T00:05:11.7429212Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 12s local 2024-12-18T00:05:11.7429986Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 11s local 2024-12-18T00:05:11.7431044Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 11s local ... 2024-12-18T00:05:11.9492830Z 2024-12-18T00:05:11.9493702Z  2024-12-18T00:05:11.9494167Z  2024-12-18T00:05:11.9494558Z  2024-12-18T00:05:11.9494978Z  2024-12-18T00:05:11.9495361Z  2024-12-18T00:05:11.9495786Z  2024-12-18T00:05:11.9496277Z  2024-12-18T00:05:11.9496891Z  2024-12-18T00:05:11.9497493Z [10,619 / 15,187] 48 actions, 47 running 2024-12-18T00:05:11.9498278Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:05:11.9499053Z @llvm-project//llvm:CodeGen; 18s local 2024-12-18T00:05:11.9499816Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2024-12-18T00:05:11.9500707Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 12s local 2024-12-18T00:05:11.9501570Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 12s local 2024-12-18T00:05:11.9502547Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 11s local 2024-12-18T00:05:11.9503492Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 11s local 2024-12-18T00:05:11.9504500Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 9s local ... 2024-12-18T00:05:12.1832389Z 2024-12-18T00:05:12.1833279Z  2024-12-18T00:05:12.1833732Z  2024-12-18T00:05:12.1834139Z  2024-12-18T00:05:12.1834460Z  2024-12-18T00:05:12.1834825Z  2024-12-18T00:05:12.1835190Z  2024-12-18T00:05:12.1835567Z  2024-12-18T00:05:12.1835966Z  2024-12-18T00:05:12.1836601Z [10,630 / 15,187] 48 actions, 47 running 2024-12-18T00:05:12.1837326Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:05:12.1837969Z @llvm-project//llvm:CodeGen; 18s local 2024-12-18T00:05:12.1838905Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2024-12-18T00:05:12.1839799Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local 2024-12-18T00:05:12.1840626Z Compiling llvm/lib/CodeGen/MIRSampleProfile.cpp; 12s local 2024-12-18T00:05:12.1841572Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 11s local 2024-12-18T00:05:12.1842907Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 11s local 2024-12-18T00:05:12.1843899Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 10s local ... 2024-12-18T00:05:12.3927915Z 2024-12-18T00:05:12.3928774Z  2024-12-18T00:05:12.3929278Z  2024-12-18T00:05:12.3929711Z  2024-12-18T00:05:12.3930104Z  2024-12-18T00:05:12.3930514Z  2024-12-18T00:05:12.3931259Z  2024-12-18T00:05:12.3931670Z  2024-12-18T00:05:12.3932086Z  2024-12-18T00:05:12.3932798Z [10,638 / 15,187] 48 actions, 47 running 2024-12-18T00:05:12.3933549Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:05:12.3934228Z @llvm-project//llvm:CodeGen; 18s local 2024-12-18T00:05:12.3934954Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2024-12-18T00:05:12.3935818Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local 2024-12-18T00:05:12.3936906Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 12s local 2024-12-18T00:05:12.3937961Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 11s local 2024-12-18T00:05:12.3939002Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 10s local 2024-12-18T00:05:12.3939899Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 9s local ... 2024-12-18T00:05:12.5994064Z 2024-12-18T00:05:12.5994894Z  2024-12-18T00:05:12.5995324Z  2024-12-18T00:05:12.5995674Z  2024-12-18T00:05:12.5996067Z  2024-12-18T00:05:12.5996426Z  2024-12-18T00:05:12.5996798Z  2024-12-18T00:05:12.5997145Z  2024-12-18T00:05:12.5997528Z  2024-12-18T00:05:12.5998075Z [10,647 / 15,187] 48 actions, 47 running 2024-12-18T00:05:12.5998916Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:05:12.5999547Z @llvm-project//llvm:CodeGen; 18s local 2024-12-18T00:05:12.6000197Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2024-12-18T00:05:12.6000961Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local 2024-12-18T00:05:12.6001747Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 12s local 2024-12-18T00:05:12.6002626Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 12s local 2024-12-18T00:05:12.6003548Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 10s local 2024-12-18T00:05:12.6004349Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 9s local ... 2024-12-18T00:05:12.8010839Z 2024-12-18T00:05:12.8011703Z  2024-12-18T00:05:12.8012097Z  2024-12-18T00:05:12.8012427Z  2024-12-18T00:05:12.8012735Z  2024-12-18T00:05:12.8013052Z  2024-12-18T00:05:12.8013351Z  2024-12-18T00:05:12.8013666Z  2024-12-18T00:05:12.8013971Z  2024-12-18T00:05:12.8014454Z [10,656 / 15,187] 48 actions, 47 running 2024-12-18T00:05:12.8015055Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:05:12.8015598Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:05:12.8016200Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2024-12-18T00:05:12.8017061Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local 2024-12-18T00:05:12.8017728Z Compiling llvm/lib/CodeGen/MachineBasicBlock.cpp; 12s local 2024-12-18T00:05:12.8018476Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 12s local 2024-12-18T00:05:12.8019197Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 10s local 2024-12-18T00:05:12.8019880Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 9s local ... 2024-12-18T00:05:13.0086473Z 2024-12-18T00:05:13.0087327Z  2024-12-18T00:05:13.0087773Z  2024-12-18T00:05:13.0088161Z  2024-12-18T00:05:13.0088521Z  2024-12-18T00:05:13.0088876Z  2024-12-18T00:05:13.0089239Z  2024-12-18T00:05:13.0089610Z  2024-12-18T00:05:13.0089982Z  2024-12-18T00:05:13.0090499Z [10,667 / 15,187] 48 actions, 47 running 2024-12-18T00:05:13.0091238Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:05:13.0091925Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:05:13.0093123Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2024-12-18T00:05:13.0093962Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local 2024-12-18T00:05:13.0094808Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 12s local 2024-12-18T00:05:13.0095710Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local 2024-12-18T00:05:13.0097038Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 9s local 2024-12-18T00:05:13.0097887Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 9s local ... 2024-12-18T00:05:13.2493152Z 2024-12-18T00:05:13.2494016Z  2024-12-18T00:05:13.2494506Z  2024-12-18T00:05:13.2494920Z  2024-12-18T00:05:13.2495298Z  2024-12-18T00:05:13.2495679Z  2024-12-18T00:05:13.2496064Z  2024-12-18T00:05:13.2496448Z  2024-12-18T00:05:13.2497005Z  2024-12-18T00:05:13.2497589Z [10,675 / 15,187] 48 actions, 47 running 2024-12-18T00:05:13.2498372Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:05:13.2499650Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:05:13.2500447Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2024-12-18T00:05:13.2501265Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 14s local 2024-12-18T00:05:13.2502124Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 12s local 2024-12-18T00:05:13.2503111Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local 2024-12-18T00:05:13.2503960Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 9s local 2024-12-18T00:05:13.2504774Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 9s local ... 2024-12-18T00:05:13.5029341Z 2024-12-18T00:05:13.5030205Z  2024-12-18T00:05:13.5030676Z  2024-12-18T00:05:13.5031042Z  2024-12-18T00:05:13.5031442Z  2024-12-18T00:05:13.5031815Z  2024-12-18T00:05:13.5032189Z  2024-12-18T00:05:13.5032576Z  2024-12-18T00:05:13.5032949Z  2024-12-18T00:05:13.5033464Z [10,678 / 15,187] 48 actions, 47 running 2024-12-18T00:05:13.5034217Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:05:13.5034915Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:05:13.5035671Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2024-12-18T00:05:13.5036461Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 14s local 2024-12-18T00:05:13.5037350Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 13s local 2024-12-18T00:05:13.5038260Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local 2024-12-18T00:05:13.5039070Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 10s local 2024-12-18T00:05:13.5039879Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 9s local ... 2024-12-18T00:05:13.7038130Z 2024-12-18T00:05:13.7038953Z  2024-12-18T00:05:13.7039416Z  2024-12-18T00:05:13.7039833Z  2024-12-18T00:05:13.7040189Z  2024-12-18T00:05:13.7040578Z  2024-12-18T00:05:13.7040972Z  2024-12-18T00:05:13.7041410Z  2024-12-18T00:05:13.7041785Z  2024-12-18T00:05:13.7042366Z [10,681 / 15,187] 48 actions, 47 running 2024-12-18T00:05:13.7043122Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:05:13.7043847Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:05:13.7044784Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2024-12-18T00:05:13.7045577Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 14s local 2024-12-18T00:05:13.7046428Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 13s local 2024-12-18T00:05:13.7047321Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local 2024-12-18T00:05:13.7048141Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 10s local 2024-12-18T00:05:13.7048976Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 10s local ... 2024-12-18T00:05:13.9049888Z 2024-12-18T00:05:13.9050778Z  2024-12-18T00:05:13.9051187Z  2024-12-18T00:05:13.9051576Z  2024-12-18T00:05:13.9051940Z  2024-12-18T00:05:13.9052747Z  2024-12-18T00:05:13.9053127Z  2024-12-18T00:05:13.9053489Z  2024-12-18T00:05:13.9053855Z  2024-12-18T00:05:13.9054424Z [10,691 / 15,187] 48 actions, 47 running 2024-12-18T00:05:13.9055140Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:05:13.9055793Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:05:13.9056973Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2024-12-18T00:05:13.9057857Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 14s local 2024-12-18T00:05:13.9058874Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 13s local 2024-12-18T00:05:13.9059839Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local 2024-12-18T00:05:13.9060651Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 10s local 2024-12-18T00:05:13.9061442Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 10s local ... 2024-12-18T00:05:14.1121363Z 2024-12-18T00:05:14.1122205Z  2024-12-18T00:05:14.1122742Z  2024-12-18T00:05:14.1123133Z  2024-12-18T00:05:14.1123501Z  2024-12-18T00:05:14.1123878Z  2024-12-18T00:05:14.1124274Z  2024-12-18T00:05:14.1124669Z  2024-12-18T00:05:14.1125043Z  2024-12-18T00:05:14.1125615Z [10,703 / 15,187] 48 actions, 47 running 2024-12-18T00:05:14.1126397Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:05:14.1127146Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:05:14.1127915Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 15s local 2024-12-18T00:05:14.1128756Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 15s local 2024-12-18T00:05:14.1129657Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 13s local 2024-12-18T00:05:14.1130558Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 10s local 2024-12-18T00:05:14.1131388Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 10s local 2024-12-18T00:05:14.1132251Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 8s local ... 2024-12-18T00:05:14.3271364Z 2024-12-18T00:05:14.3272225Z  2024-12-18T00:05:14.3272721Z  2024-12-18T00:05:14.3273148Z  2024-12-18T00:05:14.3273528Z  2024-12-18T00:05:14.3273876Z  2024-12-18T00:05:14.3274187Z  2024-12-18T00:05:14.3274558Z  2024-12-18T00:05:14.3274929Z  2024-12-18T00:05:14.3275493Z [10,716 / 15,187] 48 actions, 47 running 2024-12-18T00:05:14.3276262Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:05:14.3276925Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:05:14.3277829Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 15s local 2024-12-18T00:05:14.3278810Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 13s local 2024-12-18T00:05:14.3279734Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 10s local 2024-12-18T00:05:14.3280546Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 10s local 2024-12-18T00:05:14.3281323Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 8s local 2024-12-18T00:05:14.3282177Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 8s local ... 2024-12-18T00:05:14.5355064Z 2024-12-18T00:05:14.5355880Z  2024-12-18T00:05:14.5356330Z  2024-12-18T00:05:14.5356700Z  2024-12-18T00:05:14.5357060Z  2024-12-18T00:05:14.5357451Z  2024-12-18T00:05:14.5357818Z  2024-12-18T00:05:14.5358197Z  2024-12-18T00:05:14.5358594Z  2024-12-18T00:05:14.5359121Z [10,727 / 15,187] 48 actions running 2024-12-18T00:05:14.5359895Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:05:14.5360596Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:05:14.5361399Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 15s local 2024-12-18T00:05:14.5362309Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 14s local 2024-12-18T00:05:14.5363159Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 11s local 2024-12-18T00:05:14.5363924Z Compiling llvm/lib/CodeGen/MachineLICM.cpp; 10s local 2024-12-18T00:05:14.5365062Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 8s local 2024-12-18T00:05:14.5365848Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 8s local ... 2024-12-18T00:05:14.7386269Z 2024-12-18T00:05:14.7387128Z  2024-12-18T00:05:14.7387608Z  2024-12-18T00:05:14.7387999Z  2024-12-18T00:05:14.7388382Z  2024-12-18T00:05:14.7388780Z  2024-12-18T00:05:14.7389511Z  2024-12-18T00:05:14.7389931Z  2024-12-18T00:05:14.7390304Z  2024-12-18T00:05:14.7390871Z [10,736 / 15,187] 48 actions, 47 running 2024-12-18T00:05:14.7391636Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:05:14.7392328Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:05:14.7393133Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 14s local 2024-12-18T00:05:14.7394051Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 11s local 2024-12-18T00:05:14.7394885Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 8s local 2024-12-18T00:05:14.7395804Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 8s local 2024-12-18T00:05:14.7396666Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 7s local 2024-12-18T00:05:14.7397516Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 7s local ... 2024-12-18T00:05:14.9544952Z 2024-12-18T00:05:14.9545870Z  2024-12-18T00:05:14.9546404Z  2024-12-18T00:05:14.9546883Z  2024-12-18T00:05:14.9547263Z  2024-12-18T00:05:14.9547695Z  2024-12-18T00:05:14.9548077Z  2024-12-18T00:05:14.9548431Z  2024-12-18T00:05:14.9548764Z  2024-12-18T00:05:14.9549278Z [10,745 / 15,187] 48 actions, 47 running 2024-12-18T00:05:14.9550183Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:05:14.9550893Z @llvm-project//llvm:CodeGen; 21s local 2024-12-18T00:05:14.9551581Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 11s local 2024-12-18T00:05:14.9552414Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 9s local 2024-12-18T00:05:14.9553350Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 8s local 2024-12-18T00:05:14.9554260Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 7s local 2024-12-18T00:05:14.9555087Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 7s local 2024-12-18T00:05:14.9555780Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2024-12-18T00:05:15.3359411Z 2024-12-18T00:05:15.3360436Z  2024-12-18T00:05:15.3360941Z  2024-12-18T00:05:15.3361324Z  2024-12-18T00:05:15.3361743Z  2024-12-18T00:05:15.3362161Z  2024-12-18T00:05:15.3362576Z  2024-12-18T00:05:15.3362990Z  2024-12-18T00:05:15.3363395Z  2024-12-18T00:05:15.3364116Z [10,746 / 15,187] 48 actions running 2024-12-18T00:05:15.3364830Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:05:15.3365533Z @llvm-project//llvm:CodeGen; 21s local 2024-12-18T00:05:15.3366252Z Compiling llvm/lib/CodeGen/MachineInstr.cpp; 11s local 2024-12-18T00:05:15.3367087Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 9s local 2024-12-18T00:05:15.3368043Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 9s local 2024-12-18T00:05:15.3368944Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 8s local 2024-12-18T00:05:15.3369836Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 7s local 2024-12-18T00:05:15.3370624Z @llvm-project//llvm:llvm-tblgen; 7s local ... 2024-12-18T00:05:15.5365437Z 2024-12-18T00:05:15.5366408Z  2024-12-18T00:05:15.5366898Z  2024-12-18T00:05:15.5367339Z  2024-12-18T00:05:15.5367764Z  2024-12-18T00:05:15.5368162Z  2024-12-18T00:05:15.5368483Z  2024-12-18T00:05:15.5368813Z  2024-12-18T00:05:15.5369151Z  2024-12-18T00:05:15.5369647Z [10,749 / 15,187] 48 actions running 2024-12-18T00:05:15.5370319Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:05:15.5370939Z @llvm-project//llvm:CodeGen; 21s local 2024-12-18T00:05:15.5371994Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 9s local 2024-12-18T00:05:15.5372819Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 9s local 2024-12-18T00:05:15.5373622Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 8s local 2024-12-18T00:05:15.5374387Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 8s local 2024-12-18T00:05:15.5375008Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:05:15.5375915Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 6s local ... 2024-12-18T00:05:15.9027007Z 2024-12-18T00:05:15.9027986Z  2024-12-18T00:05:15.9028534Z  2024-12-18T00:05:15.9028989Z  2024-12-18T00:05:15.9029430Z  2024-12-18T00:05:15.9029843Z  2024-12-18T00:05:15.9030188Z  2024-12-18T00:05:15.9030670Z  2024-12-18T00:05:15.9031052Z  2024-12-18T00:05:15.9031596Z [10,750 / 15,187] 48 actions, 47 running 2024-12-18T00:05:15.9032272Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:05:15.9032988Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:05:15.9033646Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 9s local 2024-12-18T00:05:15.9034472Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 9s local 2024-12-18T00:05:15.9035327Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 8s local 2024-12-18T00:05:15.9036144Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 8s local 2024-12-18T00:05:15.9036863Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:05:15.9037622Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 7s local ... 2024-12-18T00:05:16.1372757Z 2024-12-18T00:05:16.1373656Z  2024-12-18T00:05:16.1374180Z  2024-12-18T00:05:16.1374616Z  2024-12-18T00:05:16.1375030Z  2024-12-18T00:05:16.1375454Z  2024-12-18T00:05:16.1375818Z  2024-12-18T00:05:16.1376199Z  2024-12-18T00:05:16.1376693Z  2024-12-18T00:05:16.1377281Z [10,751 / 15,187] 48 actions running 2024-12-18T00:05:16.1388220Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:05:16.1388982Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:05:16.1389717Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 10s local 2024-12-18T00:05:16.1390594Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 10s local 2024-12-18T00:05:16.1391481Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 8s local 2024-12-18T00:05:16.1392377Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 8s local 2024-12-18T00:05:16.1393078Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:05:16.1393824Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 7s local ... 2024-12-18T00:05:16.5378055Z 2024-12-18T00:05:16.5378969Z  2024-12-18T00:05:16.5379487Z  2024-12-18T00:05:16.5379941Z  2024-12-18T00:05:16.5380372Z  2024-12-18T00:05:16.5380806Z  2024-12-18T00:05:16.5381180Z  2024-12-18T00:05:16.5381540Z  2024-12-18T00:05:16.5381932Z  2024-12-18T00:05:16.5382478Z [10,753 / 15,187] 48 actions running 2024-12-18T00:05:16.5383259Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:05:16.5383932Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:05:16.5384735Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 10s local 2024-12-18T00:05:16.5385650Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 10s local 2024-12-18T00:05:16.5386583Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 9s local 2024-12-18T00:05:16.5387445Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 9s local 2024-12-18T00:05:16.5388207Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:05:16.5389005Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 7s local ... 2024-12-18T00:05:16.7432626Z 2024-12-18T00:05:16.7433541Z  2024-12-18T00:05:16.7434011Z  2024-12-18T00:05:16.7434398Z  2024-12-18T00:05:16.7434765Z  2024-12-18T00:05:16.7435135Z  2024-12-18T00:05:16.7435499Z  2024-12-18T00:05:16.7435876Z  2024-12-18T00:05:16.7436792Z  2024-12-18T00:05:16.7437484Z [10,754 / 15,187] 48 actions, 47 running 2024-12-18T00:05:16.7438332Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:05:16.7439250Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:05:16.7440034Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 10s local 2024-12-18T00:05:16.7441276Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 10s local 2024-12-18T00:05:16.7442373Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 9s local 2024-12-18T00:05:16.7443269Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 9s local 2024-12-18T00:05:16.7443989Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:05:16.7445119Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 8s local ... 2024-12-18T00:05:17.1385321Z 2024-12-18T00:05:17.1386233Z  2024-12-18T00:05:17.1386751Z  2024-12-18T00:05:17.1388235Z  2024-12-18T00:05:17.1388822Z  2024-12-18T00:05:17.1389263Z  2024-12-18T00:05:17.1389711Z  2024-12-18T00:05:17.1390134Z  2024-12-18T00:05:17.1390554Z  2024-12-18T00:05:17.1391129Z [10,755 / 15,187] 48 actions running 2024-12-18T00:05:17.1391935Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:05:17.1392720Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T00:05:17.1393518Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local 2024-12-18T00:05:17.1394340Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local 2024-12-18T00:05:17.1395209Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 9s local 2024-12-18T00:05:17.1396016Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 9s local 2024-12-18T00:05:17.1396677Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:05:17.1397467Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 8s local ... 2024-12-18T00:05:17.3793670Z 2024-12-18T00:05:17.3794810Z  2024-12-18T00:05:17.3795602Z  2024-12-18T00:05:17.3796396Z  2024-12-18T00:05:17.3797066Z  2024-12-18T00:05:17.3797479Z  2024-12-18T00:05:17.3797899Z  2024-12-18T00:05:17.3798321Z  2024-12-18T00:05:17.3798743Z  2024-12-18T00:05:17.3799347Z [10,759 / 15,187] 48 actions, 47 running 2024-12-18T00:05:17.3800039Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:05:17.3800724Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T00:05:17.3801419Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local 2024-12-18T00:05:17.3802160Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local 2024-12-18T00:05:17.3802964Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local 2024-12-18T00:05:17.3803664Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 9s local 2024-12-18T00:05:17.3804300Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:05:17.3804992Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 8s local ... 2024-12-18T00:05:17.5793377Z 2024-12-18T00:05:17.5794219Z  2024-12-18T00:05:17.5794765Z  2024-12-18T00:05:17.5795135Z  2024-12-18T00:05:17.5795487Z  2024-12-18T00:05:17.5795853Z  2024-12-18T00:05:17.5796219Z  2024-12-18T00:05:17.5796635Z  2024-12-18T00:05:17.5796979Z  2024-12-18T00:05:17.5797554Z [10,763 / 15,187] 48 actions, 47 running 2024-12-18T00:05:17.5798311Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:05:17.5799006Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T00:05:17.5799706Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local 2024-12-18T00:05:17.5800520Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local 2024-12-18T00:05:17.5801384Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local 2024-12-18T00:05:17.5802201Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 10s local 2024-12-18T00:05:17.5802912Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:05:17.5803653Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 8s local ... 2024-12-18T00:05:17.8574365Z 2024-12-18T00:05:17.8575347Z  2024-12-18T00:05:17.8575857Z  2024-12-18T00:05:17.8577121Z  2024-12-18T00:05:17.8577541Z  2024-12-18T00:05:17.8577973Z  2024-12-18T00:05:17.8578393Z  2024-12-18T00:05:17.8578804Z  2024-12-18T00:05:17.8579195Z  2024-12-18T00:05:17.8579790Z [10,765 / 15,187] 48 actions, 47 running 2024-12-18T00:05:17.8581078Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:05:17.8581828Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T00:05:17.8582512Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local 2024-12-18T00:05:17.8583343Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local 2024-12-18T00:05:17.8584163Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local 2024-12-18T00:05:17.8584989Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 10s local 2024-12-18T00:05:17.8585705Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:05:17.8586507Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 9s local ... 2024-12-18T00:05:18.1128126Z 2024-12-18T00:05:18.1129102Z  2024-12-18T00:05:18.1129616Z  2024-12-18T00:05:18.1130040Z  2024-12-18T00:05:18.1130470Z  2024-12-18T00:05:18.1130870Z  2024-12-18T00:05:18.1131299Z  2024-12-18T00:05:18.1131715Z  2024-12-18T00:05:18.1132141Z  2024-12-18T00:05:18.1132830Z [10,770 / 15,187] 48 actions, 47 running 2024-12-18T00:05:18.1133511Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2024-12-18T00:05:18.1134110Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T00:05:18.1134725Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2024-12-18T00:05:18.1135500Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2024-12-18T00:05:18.1136275Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local 2024-12-18T00:05:18.1137319Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 10s local 2024-12-18T00:05:18.1138002Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:05:18.1138721Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 9s local ... 2024-12-18T00:05:18.3395099Z 2024-12-18T00:05:18.3396043Z  2024-12-18T00:05:18.3396562Z  2024-12-18T00:05:18.3397752Z  2024-12-18T00:05:18.3398201Z  2024-12-18T00:05:18.3398633Z  2024-12-18T00:05:18.3399057Z  2024-12-18T00:05:18.3399529Z  2024-12-18T00:05:18.3399941Z  2024-12-18T00:05:18.3400542Z [10,770 / 15,187] 48 actions running 2024-12-18T00:05:18.3401390Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2024-12-18T00:05:18.3402204Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T00:05:18.3402958Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2024-12-18T00:05:18.3403769Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2024-12-18T00:05:18.3404570Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local 2024-12-18T00:05:18.3405355Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 10s local 2024-12-18T00:05:18.3406057Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:05:18.3406741Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 9s local ... 2024-12-18T00:05:18.6123507Z 2024-12-18T00:05:18.6124382Z  2024-12-18T00:05:18.6124880Z  2024-12-18T00:05:18.6125301Z  2024-12-18T00:05:18.6125720Z  2024-12-18T00:05:18.6126176Z  2024-12-18T00:05:18.6126510Z  2024-12-18T00:05:18.6126800Z  2024-12-18T00:05:18.6127107Z  2024-12-18T00:05:18.6127565Z [10,771 / 15,187] 48 actions, 47 running 2024-12-18T00:05:18.6128171Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2024-12-18T00:05:18.6128720Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T00:05:18.6129282Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2024-12-18T00:05:18.6129968Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2024-12-18T00:05:18.6130688Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local 2024-12-18T00:05:18.6131758Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 11s local 2024-12-18T00:05:18.6132331Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:05:18.6132926Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 10s local ... 2024-12-18T00:05:18.8731243Z 2024-12-18T00:05:18.8732185Z  2024-12-18T00:05:18.8732717Z  2024-12-18T00:05:18.8733529Z  2024-12-18T00:05:18.8733955Z  2024-12-18T00:05:18.8734327Z  2024-12-18T00:05:18.8734702Z  2024-12-18T00:05:18.8735074Z  2024-12-18T00:05:18.8735467Z  2024-12-18T00:05:18.8736056Z [10,772 / 15,187] 48 actions, 47 running 2024-12-18T00:05:18.8736993Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2024-12-18T00:05:18.8737687Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T00:05:18.8738402Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2024-12-18T00:05:18.8739317Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2024-12-18T00:05:18.8740281Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local 2024-12-18T00:05:18.8741186Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 11s local 2024-12-18T00:05:18.8741912Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:05:18.8742690Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 10s local ... 2024-12-18T00:05:19.0739923Z 2024-12-18T00:05:19.0740827Z  2024-12-18T00:05:19.0741354Z  2024-12-18T00:05:19.0741825Z  2024-12-18T00:05:19.0742264Z  2024-12-18T00:05:19.0742675Z  2024-12-18T00:05:19.0743132Z  2024-12-18T00:05:19.0743551Z  2024-12-18T00:05:19.0743906Z  2024-12-18T00:05:19.0744859Z [10,773 / 15,187] 48 actions, 47 running 2024-12-18T00:05:19.0745697Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:05:19.0746479Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T00:05:19.0747180Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local 2024-12-18T00:05:19.0748066Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2024-12-18T00:05:19.0748904Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local 2024-12-18T00:05:19.0749703Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 11s local 2024-12-18T00:05:19.0750381Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:05:19.0751125Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 10s local ... 2024-12-18T00:05:19.3403328Z 2024-12-18T00:05:19.3404257Z  2024-12-18T00:05:19.3404800Z  2024-12-18T00:05:19.3405248Z  2024-12-18T00:05:19.3405667Z  2024-12-18T00:05:19.3406084Z  2024-12-18T00:05:19.3406456Z  2024-12-18T00:05:19.3406839Z  2024-12-18T00:05:19.3407219Z  2024-12-18T00:05:19.3407741Z [10,774 / 15,187] 48 actions running 2024-12-18T00:05:19.3408448Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:05:19.3409102Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T00:05:19.3409797Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local 2024-12-18T00:05:19.3410590Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local 2024-12-18T00:05:19.3411364Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 12s local 2024-12-18T00:05:19.3412111Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 11s local 2024-12-18T00:05:19.3412807Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:05:19.3413527Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 10s local ... 2024-12-18T00:05:19.5509134Z 2024-12-18T00:05:19.5510097Z  2024-12-18T00:05:19.5510633Z  2024-12-18T00:05:19.5511053Z  2024-12-18T00:05:19.5511474Z  2024-12-18T00:05:19.5511889Z  2024-12-18T00:05:19.5512257Z  2024-12-18T00:05:19.5512627Z  2024-12-18T00:05:19.5512996Z  2024-12-18T00:05:19.5513576Z [10,777 / 15,187] 48 actions, 47 running 2024-12-18T00:05:19.5514272Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:05:19.5515376Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T00:05:19.5516073Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local 2024-12-18T00:05:19.5516901Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local 2024-12-18T00:05:19.5517755Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 12s local 2024-12-18T00:05:19.5518762Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 12s local 2024-12-18T00:05:19.5519478Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:05:19.5520247Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 10s local ... 2024-12-18T00:05:19.9410293Z 2024-12-18T00:05:19.9411163Z  2024-12-18T00:05:19.9411700Z  2024-12-18T00:05:19.9412125Z  2024-12-18T00:05:19.9412529Z  2024-12-18T00:05:19.9412946Z  2024-12-18T00:05:19.9413303Z  2024-12-18T00:05:19.9413659Z  2024-12-18T00:05:19.9414014Z  2024-12-18T00:05:19.9414551Z [10,779 / 15,187] 48 actions running 2024-12-18T00:05:19.9415315Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:05:19.9416148Z @llvm-project//llvm:CodeGen; 26s local 2024-12-18T00:05:19.9417061Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2024-12-18T00:05:19.9417950Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local 2024-12-18T00:05:19.9418891Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 12s local 2024-12-18T00:05:19.9419737Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 12s local 2024-12-18T00:05:19.9420470Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:05:19.9421272Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 11s local ... 2024-12-18T00:05:20.2318588Z 2024-12-18T00:05:20.2319503Z  2024-12-18T00:05:20.2320186Z  2024-12-18T00:05:20.2320635Z  2024-12-18T00:05:20.2321071Z  2024-12-18T00:05:20.2321480Z  2024-12-18T00:05:20.2321853Z  2024-12-18T00:05:20.2322233Z  2024-12-18T00:05:20.2322634Z  2024-12-18T00:05:20.2323241Z [10,780 / 15,187] 48 actions, 47 running 2024-12-18T00:05:20.2324045Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:05:20.2324774Z @llvm-project//llvm:CodeGen; 26s local 2024-12-18T00:05:20.2325511Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2024-12-18T00:05:20.2326418Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2024-12-18T00:05:20.2327360Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 12s local 2024-12-18T00:05:20.2328067Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:05:20.2328878Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 11s local 2024-12-18T00:05:20.2329802Z Compiling llvm/lib/CodeGen/ModuloSchedule.cpp; 11s local ... 2024-12-18T00:05:20.5418796Z 2024-12-18T00:05:20.5419726Z  2024-12-18T00:05:20.5420257Z  2024-12-18T00:05:20.5420694Z  2024-12-18T00:05:20.5421101Z  2024-12-18T00:05:20.5421514Z  2024-12-18T00:05:20.5421849Z  2024-12-18T00:05:20.5422250Z  2024-12-18T00:05:20.5422603Z  2024-12-18T00:05:20.5423132Z [10,781 / 15,187] 48 actions running 2024-12-18T00:05:20.5423865Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:05:20.5424552Z @llvm-project//llvm:CodeGen; 26s local 2024-12-18T00:05:20.5425258Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2024-12-18T00:05:20.5426122Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2024-12-18T00:05:20.5426905Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 13s local 2024-12-18T00:05:20.5427624Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:05:20.5428360Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 11s local 2024-12-18T00:05:20.5429196Z Compiling llvm/lib/CodeGen/ModuloSchedule.cpp; 11s local ... 2024-12-18T00:05:20.7423746Z 2024-12-18T00:05:20.7424600Z  2024-12-18T00:05:20.7425052Z  2024-12-18T00:05:20.7425497Z  2024-12-18T00:05:20.7425869Z  2024-12-18T00:05:20.7426690Z  2024-12-18T00:05:20.7427141Z  2024-12-18T00:05:20.7427509Z  2024-12-18T00:05:20.7427859Z  2024-12-18T00:05:20.7428385Z [10,783 / 15,187] 48 actions running 2024-12-18T00:05:20.7429101Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:05:20.7429777Z @llvm-project//llvm:CodeGen; 26s local 2024-12-18T00:05:20.7430725Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2024-12-18T00:05:20.7431563Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2024-12-18T00:05:20.7432329Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 13s local 2024-12-18T00:05:20.7433027Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:05:20.7433741Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local 2024-12-18T00:05:20.7434561Z Compiling llvm/lib/CodeGen/ModuloSchedule.cpp; 11s local ... 2024-12-18T00:05:21.0939346Z 2024-12-18T00:05:21.0940242Z  2024-12-18T00:05:21.0940739Z  2024-12-18T00:05:21.0941169Z  2024-12-18T00:05:21.0941546Z  2024-12-18T00:05:21.0941960Z  2024-12-18T00:05:21.0942356Z  2024-12-18T00:05:21.0942753Z  2024-12-18T00:05:21.0943149Z  2024-12-18T00:05:21.0943707Z [10,789 / 15,187] 48 actions, 47 running 2024-12-18T00:05:21.0944728Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:05:21.0945618Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local 2024-12-18T00:05:21.0946584Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T00:05:21.0947419Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:05:21.0948148Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local 2024-12-18T00:05:21.0948967Z Compiling llvm/lib/CodeGen/ModuloSchedule.cpp; 12s local 2024-12-18T00:05:21.0949885Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 10s local 2024-12-18T00:05:21.0950765Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 8s local ... 2024-12-18T00:05:21.3305917Z 2024-12-18T00:05:21.3306769Z  2024-12-18T00:05:21.3307255Z  2024-12-18T00:05:21.3307666Z  2024-12-18T00:05:21.3308052Z  2024-12-18T00:05:21.3308450Z  2024-12-18T00:05:21.3308861Z  2024-12-18T00:05:21.3309255Z  2024-12-18T00:05:21.3309642Z  2024-12-18T00:05:21.3310256Z [10,791 / 15,187] 48 actions, 47 running 2024-12-18T00:05:21.3311093Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:05:21.3311950Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local 2024-12-18T00:05:21.3312886Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T00:05:21.3313702Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:05:21.3314502Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local 2024-12-18T00:05:21.3315511Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 10s local 2024-12-18T00:05:21.3316468Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 8s local 2024-12-18T00:05:21.3317368Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 8s local ... 2024-12-18T00:05:21.5431295Z 2024-12-18T00:05:21.5432185Z  2024-12-18T00:05:21.5432777Z  2024-12-18T00:05:21.5433263Z  2024-12-18T00:05:21.5433638Z  2024-12-18T00:05:21.5434145Z  2024-12-18T00:05:21.5434524Z  2024-12-18T00:05:21.5434917Z  2024-12-18T00:05:21.5435264Z  2024-12-18T00:05:21.5435892Z [10,792 / 15,187] 48 actions running 2024-12-18T00:05:21.5436777Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:05:21.5437732Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local 2024-12-18T00:05:21.5438778Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T00:05:21.5439565Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:05:21.5440367Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local 2024-12-18T00:05:21.5441396Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 11s local 2024-12-18T00:05:21.5442751Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 9s local 2024-12-18T00:05:21.5443647Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 8s local ... 2024-12-18T00:05:21.7718357Z 2024-12-18T00:05:21.7719215Z  2024-12-18T00:05:21.7719682Z  2024-12-18T00:05:21.7720101Z  2024-12-18T00:05:21.7720488Z  2024-12-18T00:05:21.7720888Z  2024-12-18T00:05:21.7721624Z  2024-12-18T00:05:21.7722058Z  2024-12-18T00:05:21.7722468Z  2024-12-18T00:05:21.7723047Z [10,794 / 15,187] 48 actions, 47 running 2024-12-18T00:05:21.7723823Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:05:21.7724688Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T00:05:21.7725599Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local 2024-12-18T00:05:21.7726681Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 11s local 2024-12-18T00:05:21.7727611Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 9s local 2024-12-18T00:05:21.7728473Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 9s local 2024-12-18T00:05:21.7729323Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 7s local 2024-12-18T00:05:21.7730239Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 6s local ... 2024-12-18T00:05:22.0171857Z 2024-12-18T00:05:22.0172839Z  2024-12-18T00:05:22.0173486Z  2024-12-18T00:05:22.0173951Z  2024-12-18T00:05:22.0174362Z  2024-12-18T00:05:22.0174780Z  2024-12-18T00:05:22.0175195Z  2024-12-18T00:05:22.0175618Z  2024-12-18T00:05:22.0176030Z  2024-12-18T00:05:22.0176797Z [10,798 / 15,187] 48 actions, 47 running 2024-12-18T00:05:22.0177612Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:05:22.0178524Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T00:05:22.0179474Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local 2024-12-18T00:05:22.0180887Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 11s local 2024-12-18T00:05:22.0182034Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 9s local 2024-12-18T00:05:22.0183134Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 9s local 2024-12-18T00:05:22.0184100Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 8s local 2024-12-18T00:05:22.0185139Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 7s local ... 2024-12-18T00:05:22.3437959Z 2024-12-18T00:05:22.3438792Z  2024-12-18T00:05:22.3439281Z  2024-12-18T00:05:22.3439698Z  2024-12-18T00:05:22.3440097Z  2024-12-18T00:05:22.3440529Z  2024-12-18T00:05:22.3440910Z  2024-12-18T00:05:22.3441282Z  2024-12-18T00:05:22.3441634Z  2024-12-18T00:05:22.3442174Z [10,799 / 15,187] 48 actions running 2024-12-18T00:05:22.3442927Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:05:22.3443886Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2024-12-18T00:05:22.3445061Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local 2024-12-18T00:05:22.3445915Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 9s local 2024-12-18T00:05:22.3446741Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 9s local 2024-12-18T00:05:22.3447636Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 8s local 2024-12-18T00:05:22.3448443Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 7s local 2024-12-18T00:05:22.3449307Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 7s local ... 2024-12-18T00:05:23.3448872Z 2024-12-18T00:05:23.3449839Z  2024-12-18T00:05:23.3450316Z  2024-12-18T00:05:23.3450720Z  2024-12-18T00:05:23.3451123Z  2024-12-18T00:05:23.3451544Z  2024-12-18T00:05:23.3451920Z  2024-12-18T00:05:23.3452313Z  2024-12-18T00:05:23.3452713Z  2024-12-18T00:05:23.3453290Z [10,799 / 15,187] 48 actions running 2024-12-18T00:05:23.3454062Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:05:23.3455385Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2024-12-18T00:05:23.3456313Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2024-12-18T00:05:23.3457374Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 10s local 2024-12-18T00:05:23.3458366Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 10s local 2024-12-18T00:05:23.3459444Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 9s local 2024-12-18T00:05:23.3460301Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 8s local 2024-12-18T00:05:23.3461124Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 8s local ... 2024-12-18T00:05:23.5451989Z 2024-12-18T00:05:23.5453422Z  2024-12-18T00:05:23.5453935Z  2024-12-18T00:05:23.5455341Z  2024-12-18T00:05:23.5456382Z  2024-12-18T00:05:23.5457613Z  2024-12-18T00:05:23.5458834Z  2024-12-18T00:05:23.5460199Z  2024-12-18T00:05:23.5461461Z  2024-12-18T00:05:23.5462249Z [10,801 / 15,187] 48 actions running 2024-12-18T00:05:23.5463221Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:05:23.5464261Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2024-12-18T00:05:23.5465277Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2024-12-18T00:05:23.5466252Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 11s local 2024-12-18T00:05:23.5467336Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 9s local 2024-12-18T00:05:23.5468314Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 8s local 2024-12-18T00:05:23.5469283Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 8s local 2024-12-18T00:05:23.5470287Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 7s local ... 2024-12-18T00:05:24.3348897Z 2024-12-18T00:05:24.3349822Z  2024-12-18T00:05:24.3350244Z  2024-12-18T00:05:24.3350598Z  2024-12-18T00:05:24.3350935Z  2024-12-18T00:05:24.3351273Z  2024-12-18T00:05:24.3351595Z  2024-12-18T00:05:24.3351939Z  2024-12-18T00:05:24.3352325Z  2024-12-18T00:05:24.3352874Z [10,802 / 15,187] 48 actions, 47 running 2024-12-18T00:05:24.3353531Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:05:24.3354253Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T00:05:24.3355109Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2024-12-18T00:05:24.3355857Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 11s local 2024-12-18T00:05:24.3356605Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 10s local 2024-12-18T00:05:24.3357328Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 9s local 2024-12-18T00:05:24.3358032Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 9s local 2024-12-18T00:05:24.3358764Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 8s local ... 2024-12-18T00:05:24.5460251Z 2024-12-18T00:05:24.5461707Z  2024-12-18T00:05:24.5462210Z  2024-12-18T00:05:24.5463575Z  2024-12-18T00:05:24.5464536Z  2024-12-18T00:05:24.5465712Z  2024-12-18T00:05:24.5466881Z  2024-12-18T00:05:24.5467719Z  2024-12-18T00:05:24.5468832Z  2024-12-18T00:05:24.5470358Z [10,803 / 15,187] 48 actions running 2024-12-18T00:05:24.5471138Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:05:24.5471948Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T00:05:24.5472814Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2024-12-18T00:05:24.5473662Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 12s local 2024-12-18T00:05:24.5474535Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 10s local 2024-12-18T00:05:24.5475365Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 9s local 2024-12-18T00:05:24.5476126Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 9s local 2024-12-18T00:05:24.5476943Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 8s local ... 2024-12-18T00:05:24.8079517Z 2024-12-18T00:05:24.8080457Z  2024-12-18T00:05:24.8080949Z  2024-12-18T00:05:24.8081760Z  2024-12-18T00:05:24.8082128Z  2024-12-18T00:05:24.8082515Z  2024-12-18T00:05:24.8082903Z  2024-12-18T00:05:24.8083267Z  2024-12-18T00:05:24.8083682Z  2024-12-18T00:05:24.8084244Z [10,804 / 15,187] 48 actions, 47 running 2024-12-18T00:05:24.8084982Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:05:24.8086075Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T00:05:24.8086927Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 16s local 2024-12-18T00:05:24.8087747Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 12s local 2024-12-18T00:05:24.8088573Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 10s local 2024-12-18T00:05:24.8089436Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 9s local 2024-12-18T00:05:24.8090277Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 8s local 2024-12-18T00:05:24.8091218Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 8s local ... 2024-12-18T00:05:25.0695625Z 2024-12-18T00:05:25.0696716Z  2024-12-18T00:05:25.0697180Z  2024-12-18T00:05:25.0697554Z  2024-12-18T00:05:25.0697861Z  2024-12-18T00:05:25.0698231Z  2024-12-18T00:05:25.0698596Z  2024-12-18T00:05:25.0698967Z  2024-12-18T00:05:25.0699312Z  2024-12-18T00:05:25.0699877Z [10,808 / 15,187] 48 actions, 47 running 2024-12-18T00:05:25.0700718Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:05:25.0701563Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T00:05:25.0702470Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 11s local 2024-12-18T00:05:25.0703281Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2024-12-18T00:05:25.0704105Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 9s local 2024-12-18T00:05:25.0704983Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 8s local 2024-12-18T00:05:25.0705970Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 7s local 2024-12-18T00:05:25.0706985Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 7s local ... 2024-12-18T00:05:25.3466910Z 2024-12-18T00:05:25.3467764Z  2024-12-18T00:05:25.3468227Z  2024-12-18T00:05:25.3468619Z  2024-12-18T00:05:25.3468952Z  2024-12-18T00:05:25.3469336Z  2024-12-18T00:05:25.3469701Z  2024-12-18T00:05:25.3470039Z  2024-12-18T00:05:25.3470435Z  2024-12-18T00:05:25.3470990Z [10,811 / 15,187] 48 actions, 47 running 2024-12-18T00:05:25.3471762Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:05:25.3472600Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T00:05:25.3473416Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2024-12-18T00:05:25.3474223Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 9s local 2024-12-18T00:05:25.3475062Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 8s local 2024-12-18T00:05:25.3476027Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 8s local 2024-12-18T00:05:25.3477061Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 7s local 2024-12-18T00:05:25.3477900Z @llvm-project//llvm:CodeGen; 7s local ... 2024-12-18T00:05:25.5471317Z 2024-12-18T00:05:25.5472127Z  2024-12-18T00:05:25.5472591Z  2024-12-18T00:05:25.5472990Z  2024-12-18T00:05:25.5473490Z  2024-12-18T00:05:25.5473935Z  2024-12-18T00:05:25.5474313Z  2024-12-18T00:05:25.5474689Z  2024-12-18T00:05:25.5475050Z  2024-12-18T00:05:25.5475617Z [10,811 / 15,187] 48 actions running 2024-12-18T00:05:25.5476385Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:05:25.5477228Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T00:05:25.5478070Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2024-12-18T00:05:25.5478905Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 9s local 2024-12-18T00:05:25.5480281Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 8s local 2024-12-18T00:05:25.5481230Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 8s local 2024-12-18T00:05:25.5482277Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 8s local 2024-12-18T00:05:25.5483129Z @llvm-project//llvm:CodeGen; 8s local ... 2024-12-18T00:05:25.9478090Z 2024-12-18T00:05:25.9480008Z  2024-12-18T00:05:25.9480905Z  2024-12-18T00:05:25.9481339Z  2024-12-18T00:05:25.9481704Z  2024-12-18T00:05:25.9482076Z  2024-12-18T00:05:25.9482462Z  2024-12-18T00:05:25.9482830Z  2024-12-18T00:05:25.9483188Z  2024-12-18T00:05:25.9483731Z [10,813 / 15,187] 48 actions running 2024-12-18T00:05:25.9484477Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:05:25.9485329Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T00:05:25.9486155Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2024-12-18T00:05:25.9487009Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2024-12-18T00:05:25.9487966Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 8s local 2024-12-18T00:05:25.9488961Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 8s local 2024-12-18T00:05:25.9490086Z Compiling llvm/lib/CodeGen/SelectionDAG/FunctionLoweringInfo.cpp; 8s local 2024-12-18T00:05:25.9491332Z Compiling llvm/lib/CodeGen/SelectionDAG/InstrEmitter.cpp; 8s local ... 2024-12-18T00:05:26.1481706Z 2024-12-18T00:05:26.1482607Z  2024-12-18T00:05:26.1483046Z  2024-12-18T00:05:26.1483434Z  2024-12-18T00:05:26.1483830Z  2024-12-18T00:05:26.1484216Z  2024-12-18T00:05:26.1484566Z  2024-12-18T00:05:26.1484938Z  2024-12-18T00:05:26.1485341Z  2024-12-18T00:05:26.1485921Z [10,816 / 15,187] 48 actions running 2024-12-18T00:05:26.1486695Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:05:26.1487522Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:05:26.1488444Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2024-12-18T00:05:26.1489220Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2024-12-18T00:05:26.1490118Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 8s local 2024-12-18T00:05:26.1491133Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 8s local 2024-12-18T00:05:26.1492263Z Compiling llvm/lib/CodeGen/SelectionDAG/FunctionLoweringInfo.cpp; 8s local 2024-12-18T00:05:26.1493469Z Compiling llvm/lib/CodeGen/SelectionDAG/InstrEmitter.cpp; 8s local ... 2024-12-18T00:05:26.3725642Z 2024-12-18T00:05:26.3726598Z  2024-12-18T00:05:26.3727090Z  2024-12-18T00:05:26.3727468Z  2024-12-18T00:05:26.3727871Z  2024-12-18T00:05:26.3728235Z  2024-12-18T00:05:26.3728640Z  2024-12-18T00:05:26.3729039Z  2024-12-18T00:05:26.3729421Z  2024-12-18T00:05:26.3729979Z [10,817 / 15,187] 48 actions, 47 running 2024-12-18T00:05:26.3730760Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:05:26.3731571Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:05:26.3732362Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2024-12-18T00:05:26.3733151Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2024-12-18T00:05:26.3734117Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local 2024-12-18T00:05:26.3735034Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 8s local 2024-12-18T00:05:26.3736078Z Compiling llvm/lib/CodeGen/SelectionDAG/FunctionLoweringInfo.cpp; 8s local 2024-12-18T00:05:26.3737385Z Compiling llvm/lib/CodeGen/SelectionDAG/InstrEmitter.cpp; 8s local ... 2024-12-18T00:05:26.7400706Z 2024-12-18T00:05:26.7402142Z  2024-12-18T00:05:26.7402578Z  2024-12-18T00:05:26.7404049Z  2024-12-18T00:05:26.7405081Z  2024-12-18T00:05:26.7406277Z  2024-12-18T00:05:26.7407533Z  2024-12-18T00:05:26.7408899Z  2024-12-18T00:05:26.7409923Z  2024-12-18T00:05:26.7411390Z [10,818 / 15,187] 48 actions, 47 running 2024-12-18T00:05:26.7412485Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:05:26.7413642Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:05:26.7414642Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2024-12-18T00:05:26.7416205Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2024-12-18T00:05:26.7417319Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local 2024-12-18T00:05:26.7418335Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 9s local 2024-12-18T00:05:26.7419502Z Compiling llvm/lib/CodeGen/SelectionDAG/FunctionLoweringInfo.cpp; 9s local 2024-12-18T00:05:26.7420696Z Compiling llvm/lib/CodeGen/SelectionDAG/InstrEmitter.cpp; 9s local ... 2024-12-18T00:05:26.9490176Z 2024-12-18T00:05:26.9492109Z  2024-12-18T00:05:26.9492517Z  2024-12-18T00:05:26.9492886Z  2024-12-18T00:05:26.9493190Z  2024-12-18T00:05:26.9493506Z  2024-12-18T00:05:26.9493829Z  2024-12-18T00:05:26.9494160Z  2024-12-18T00:05:26.9494463Z  2024-12-18T00:05:26.9494925Z [10,818 / 15,187] 48 actions running 2024-12-18T00:05:26.9495536Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:05:26.9496429Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:05:26.9497271Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2024-12-18T00:05:26.9497913Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 10s local 2024-12-18T00:05:26.9498673Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local 2024-12-18T00:05:26.9499535Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 9s local 2024-12-18T00:05:26.9500459Z Compiling llvm/lib/CodeGen/SelectionDAG/FunctionLoweringInfo.cpp; 9s local 2024-12-18T00:05:26.9501427Z Compiling llvm/lib/CodeGen/SelectionDAG/InstrEmitter.cpp; 9s local ... 2024-12-18T00:05:27.1970606Z 2024-12-18T00:05:27.1971471Z  2024-12-18T00:05:27.1971859Z  2024-12-18T00:05:27.1972186Z  2024-12-18T00:05:27.1972510Z  2024-12-18T00:05:27.1972806Z  2024-12-18T00:05:27.1973117Z  2024-12-18T00:05:27.1973430Z  2024-12-18T00:05:27.1973746Z  2024-12-18T00:05:27.1974266Z [10,819 / 15,187] 48 actions, 47 running 2024-12-18T00:05:27.1975020Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:05:27.1975729Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T00:05:27.1976400Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 12s local 2024-12-18T00:05:27.1977236Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 10s local 2024-12-18T00:05:27.1977984Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local 2024-12-18T00:05:27.1978775Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 9s local 2024-12-18T00:05:27.1979639Z Compiling llvm/lib/CodeGen/SelectionDAG/FunctionLoweringInfo.cpp; 9s local 2024-12-18T00:05:27.1980591Z Compiling llvm/lib/CodeGen/SelectionDAG/InstrEmitter.cpp; 9s local ... 2024-12-18T00:05:27.5402609Z 2024-12-18T00:05:27.5403450Z  2024-12-18T00:05:27.5403934Z  2024-12-18T00:05:27.5404335Z  2024-12-18T00:05:27.5404710Z  2024-12-18T00:05:27.5405230Z  2024-12-18T00:05:27.5405611Z  2024-12-18T00:05:27.5406004Z  2024-12-18T00:05:27.5406359Z  2024-12-18T00:05:27.5406934Z [10,821 / 15,187] 48 actions, 47 running 2024-12-18T00:05:27.5407663Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:05:27.5408519Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T00:05:27.5409380Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 10s local 2024-12-18T00:05:27.5410328Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 10s local 2024-12-18T00:05:27.5411300Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local 2024-12-18T00:05:27.5412578Z @llvm-project//llvm:CodeGen; 10s local 2024-12-18T00:05:27.5413382Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 9s local 2024-12-18T00:05:27.5414189Z @llvm-project//llvm:CodeGen; 9s local ... 2024-12-18T00:05:27.7495393Z 2024-12-18T00:05:27.7496277Z  2024-12-18T00:05:27.7497061Z  2024-12-18T00:05:27.7497442Z  2024-12-18T00:05:27.7498173Z  2024-12-18T00:05:27.7498569Z  2024-12-18T00:05:27.7498936Z  2024-12-18T00:05:27.7499283Z  2024-12-18T00:05:27.7499660Z  2024-12-18T00:05:27.7500228Z [10,824 / 15,187] 48 actions, 47 running 2024-12-18T00:05:27.7500930Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:05:27.7501721Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T00:05:27.7502574Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2024-12-18T00:05:27.7503483Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 10s local 2024-12-18T00:05:27.7504506Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local 2024-12-18T00:05:27.7505508Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local 2024-12-18T00:05:27.7506610Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeFloatTypes.cpp; 9s local 2024-12-18T00:05:27.7507404Z @llvm-project//llvm:CodeGen; 9s local ... 2024-12-18T00:05:28.0146862Z 2024-12-18T00:05:28.0147960Z  2024-12-18T00:05:28.0148444Z  2024-12-18T00:05:28.0148840Z  2024-12-18T00:05:28.0149234Z  2024-12-18T00:05:28.0149633Z  2024-12-18T00:05:28.0150018Z  2024-12-18T00:05:28.0150427Z  2024-12-18T00:05:28.0150815Z  2024-12-18T00:05:28.0151419Z [10,825 / 15,187] 48 actions, 47 running 2024-12-18T00:05:28.0152205Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:05:28.0153056Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2024-12-18T00:05:28.0154073Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 10s local 2024-12-18T00:05:28.0155142Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local 2024-12-18T00:05:28.0156179Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local 2024-12-18T00:05:28.0157373Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeFloatTypes.cpp; 10s local 2024-12-18T00:05:28.0158289Z @llvm-project//llvm:CodeGen; 10s local 2024-12-18T00:05:28.0158928Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:28.3501052Z 2024-12-18T00:05:28.3501915Z  2024-12-18T00:05:28.3502403Z  2024-12-18T00:05:28.3502953Z  2024-12-18T00:05:28.3503468Z  2024-12-18T00:05:28.3503916Z  2024-12-18T00:05:28.3504448Z  2024-12-18T00:05:28.3504859Z  2024-12-18T00:05:28.3505293Z  2024-12-18T00:05:28.3505841Z [10,826 / 15,187] 48 actions running 2024-12-18T00:05:28.3506577Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:05:28.3507509Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2024-12-18T00:05:28.3508502Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 11s local 2024-12-18T00:05:28.3509504Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local 2024-12-18T00:05:28.3510581Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local 2024-12-18T00:05:28.3511454Z @llvm-project//llvm:CodeGen; 10s local 2024-12-18T00:05:28.3512320Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorOps.cpp; 10s local 2024-12-18T00:05:28.3513286Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:28.5504743Z 2024-12-18T00:05:28.5505614Z  2024-12-18T00:05:28.5506129Z  2024-12-18T00:05:28.5506541Z  2024-12-18T00:05:28.5506945Z  2024-12-18T00:05:28.5507338Z  2024-12-18T00:05:28.5507751Z  2024-12-18T00:05:28.5508132Z  2024-12-18T00:05:28.5508515Z  2024-12-18T00:05:28.5509084Z [10,827 / 15,187] 48 actions running 2024-12-18T00:05:28.5510234Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:05:28.5511508Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2024-12-18T00:05:28.5512666Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 11s local 2024-12-18T00:05:28.5513855Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 11s local 2024-12-18T00:05:28.5515349Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local 2024-12-18T00:05:28.5516404Z @llvm-project//llvm:CodeGen; 10s local 2024-12-18T00:05:28.5517471Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorOps.cpp; 10s local 2024-12-18T00:05:28.5518683Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:29.0114266Z 2024-12-18T00:05:29.0115181Z  2024-12-18T00:05:29.0115620Z  2024-12-18T00:05:29.0115985Z  2024-12-18T00:05:29.0116388Z  2024-12-18T00:05:29.0116793Z  2024-12-18T00:05:29.0117194Z  2024-12-18T00:05:29.0117634Z  2024-12-18T00:05:29.0117997Z  2024-12-18T00:05:29.0118595Z [10,828 / 15,187] 48 actions, 47 running 2024-12-18T00:05:29.0119360Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:05:29.0120261Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 12s local 2024-12-18T00:05:29.0121318Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 11s local 2024-12-18T00:05:29.0122365Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 11s local 2024-12-18T00:05:29.0123342Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 11s local 2024-12-18T00:05:29.0124209Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:29.0125077Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorOps.cpp; 11s local 2024-12-18T00:05:29.0126054Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:29.2753713Z 2024-12-18T00:05:29.2754811Z  2024-12-18T00:05:29.2755398Z  2024-12-18T00:05:29.2755886Z  2024-12-18T00:05:29.2756336Z  2024-12-18T00:05:29.2756765Z  2024-12-18T00:05:29.2757218Z  2024-12-18T00:05:29.2757670Z  2024-12-18T00:05:29.2758144Z  2024-12-18T00:05:29.2758739Z [10,829 / 15,187] 48 actions, 47 running 2024-12-18T00:05:29.2759456Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:05:29.2760279Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 12s local 2024-12-18T00:05:29.2761241Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 11s local 2024-12-18T00:05:29.2762264Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 11s local 2024-12-18T00:05:29.2763266Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 11s local 2024-12-18T00:05:29.2764104Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:29.2764974Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorOps.cpp; 11s local 2024-12-18T00:05:29.2765823Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:05:29.4763792Z 2024-12-18T00:05:29.4764717Z  2024-12-18T00:05:29.4765188Z  2024-12-18T00:05:29.4765566Z  2024-12-18T00:05:29.4765935Z  2024-12-18T00:05:29.4766353Z  2024-12-18T00:05:29.4766751Z  2024-12-18T00:05:29.4767155Z  2024-12-18T00:05:29.4767578Z  2024-12-18T00:05:29.4768213Z [10,831 / 15,187] 48 actions, 47 running 2024-12-18T00:05:29.4769004Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:05:29.4769910Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local 2024-12-18T00:05:29.4770980Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 11s local 2024-12-18T00:05:29.4771842Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 11s local 2024-12-18T00:05:29.4772599Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:29.4773574Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorOps.cpp; 11s local 2024-12-18T00:05:29.4774828Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 11s local 2024-12-18T00:05:29.4787528Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 9s local ... 2024-12-18T00:05:29.7085603Z 2024-12-18T00:05:29.7086898Z  2024-12-18T00:05:29.7087408Z  2024-12-18T00:05:29.7087879Z  2024-12-18T00:05:29.7088376Z  2024-12-18T00:05:29.7088754Z  2024-12-18T00:05:29.7089132Z  2024-12-18T00:05:29.7089502Z  2024-12-18T00:05:29.7090270Z  2024-12-18T00:05:29.7090922Z [10,835 / 15,187] 48 actions, 47 running 2024-12-18T00:05:29.7091731Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:05:29.7092677Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local 2024-12-18T00:05:29.7093746Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 12s local 2024-12-18T00:05:29.7094774Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 11s local 2024-12-18T00:05:29.7095576Z @llvm-project//llvm:CodeGen; 11s local 2024-12-18T00:05:29.7096692Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 11s local 2024-12-18T00:05:29.7098060Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 10s local 2024-12-18T00:05:29.7098855Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:29.9515558Z 2024-12-18T00:05:29.9516447Z  2024-12-18T00:05:29.9516945Z  2024-12-18T00:05:29.9517364Z  2024-12-18T00:05:29.9517766Z  2024-12-18T00:05:29.9518223Z  2024-12-18T00:05:29.9518643Z  2024-12-18T00:05:29.9519063Z  2024-12-18T00:05:29.9519467Z  2024-12-18T00:05:29.9520052Z [10,837 / 15,187] 48 actions running 2024-12-18T00:05:29.9520857Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:05:29.9521759Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local 2024-12-18T00:05:29.9522801Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 12s local 2024-12-18T00:05:29.9523884Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 12s local 2024-12-18T00:05:29.9524771Z @llvm-project//llvm:CodeGen; 12s local 2024-12-18T00:05:29.9525718Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 11s local 2024-12-18T00:05:29.9526927Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 10s local 2024-12-18T00:05:29.9527872Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:30.4085414Z 2024-12-18T00:05:30.4086756Z  2024-12-18T00:05:30.4087273Z  2024-12-18T00:05:30.4087666Z  2024-12-18T00:05:30.4088079Z  2024-12-18T00:05:30.4088491Z  2024-12-18T00:05:30.4088894Z  2024-12-18T00:05:30.4089296Z  2024-12-18T00:05:30.4089690Z  2024-12-18T00:05:30.4090308Z [10,838 / 15,187] 48 actions, 47 running 2024-12-18T00:05:30.4091036Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:05:30.4091954Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local 2024-12-18T00:05:30.4092979Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 12s local 2024-12-18T00:05:30.4094023Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 12s local 2024-12-18T00:05:30.4094876Z @llvm-project//llvm:CodeGen; 12s local 2024-12-18T00:05:30.4095818Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 12s local 2024-12-18T00:05:30.4097123Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 10s local 2024-12-18T00:05:30.4098030Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:30.7523117Z 2024-12-18T00:05:30.7524197Z  2024-12-18T00:05:30.7524671Z  2024-12-18T00:05:30.7525057Z  2024-12-18T00:05:30.7525468Z  2024-12-18T00:05:30.7525858Z  2024-12-18T00:05:30.7526250Z  2024-12-18T00:05:30.7526624Z  2024-12-18T00:05:30.7527037Z  2024-12-18T00:05:30.7527610Z [10,842 / 15,187] 48 actions running 2024-12-18T00:05:30.7528438Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:05:30.7529468Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local 2024-12-18T00:05:30.7531009Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 13s local 2024-12-18T00:05:30.7531817Z @llvm-project//llvm:CodeGen; 12s local 2024-12-18T00:05:30.7532685Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 12s local 2024-12-18T00:05:30.7534057Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 11s local 2024-12-18T00:05:30.7535210Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 11s local 2024-12-18T00:05:30.7536124Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:31.0052584Z 2024-12-18T00:05:31.0053469Z  2024-12-18T00:05:31.0053950Z  2024-12-18T00:05:31.0054358Z  2024-12-18T00:05:31.0054734Z  2024-12-18T00:05:31.0055084Z  2024-12-18T00:05:31.0055439Z  2024-12-18T00:05:31.0055828Z  2024-12-18T00:05:31.0056209Z  2024-12-18T00:05:31.0056965Z [10,845 / 15,187] 48 actions, 47 running 2024-12-18T00:05:31.0057774Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:05:31.0058653Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local 2024-12-18T00:05:31.0059646Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 13s local 2024-12-18T00:05:31.0060434Z @llvm-project//llvm:CodeGen; 13s local 2024-12-18T00:05:31.0061339Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 12s local 2024-12-18T00:05:31.0062497Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 11s local 2024-12-18T00:05:31.0063597Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 11s local 2024-12-18T00:05:31.0064556Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:31.3134643Z 2024-12-18T00:05:31.3135544Z  2024-12-18T00:05:31.3135990Z  2024-12-18T00:05:31.3136886Z  2024-12-18T00:05:31.3137346Z  2024-12-18T00:05:31.3137940Z  2024-12-18T00:05:31.3138435Z  2024-12-18T00:05:31.3138973Z  2024-12-18T00:05:31.3139456Z  2024-12-18T00:05:31.3140145Z [10,847 / 15,187] 48 actions, 47 running 2024-12-18T00:05:31.3141105Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:05:31.3142246Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local 2024-12-18T00:05:31.3143500Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 13s local 2024-12-18T00:05:31.3144785Z @llvm-project//llvm:CodeGen; 13s local 2024-12-18T00:05:31.3145839Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 13s local 2024-12-18T00:05:31.3147086Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 11s local 2024-12-18T00:05:31.3148377Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 11s local 2024-12-18T00:05:31.3149440Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:31.5531121Z 2024-12-18T00:05:31.5532062Z  2024-12-18T00:05:31.5532554Z  2024-12-18T00:05:31.5532986Z  2024-12-18T00:05:31.5533362Z  2024-12-18T00:05:31.5533739Z  2024-12-18T00:05:31.5534131Z  2024-12-18T00:05:31.5534525Z  2024-12-18T00:05:31.5534919Z  2024-12-18T00:05:31.5535471Z [10,848 / 15,187] 48 actions running 2024-12-18T00:05:31.5536214Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:05:31.5537341Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local 2024-12-18T00:05:31.5538320Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 13s local 2024-12-18T00:05:31.5539148Z @llvm-project//llvm:CodeGen; 13s local 2024-12-18T00:05:31.5540054Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 13s local 2024-12-18T00:05:31.5541105Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 11s local 2024-12-18T00:05:31.5542201Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 11s local 2024-12-18T00:05:31.5543138Z @llvm-project//llvm:CodeGen; 10s local ... 2024-12-18T00:05:31.9535733Z 2024-12-18T00:05:31.9536661Z  2024-12-18T00:05:31.9537157Z  2024-12-18T00:05:31.9537576Z  2024-12-18T00:05:31.9537973Z  2024-12-18T00:05:31.9538382Z  2024-12-18T00:05:31.9538768Z  2024-12-18T00:05:31.9539157Z  2024-12-18T00:05:31.9539516Z  2024-12-18T00:05:31.9540474Z [10,850 / 15,187] 48 actions running 2024-12-18T00:05:31.9541270Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:05:31.9542239Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local 2024-12-18T00:05:31.9543303Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 14s local 2024-12-18T00:05:31.9544609Z @llvm-project//llvm:CodeGen; 14s local 2024-12-18T00:05:31.9545557Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 13s local 2024-12-18T00:05:31.9546815Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 12s local 2024-12-18T00:05:31.9548073Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 12s local 2024-12-18T00:05:31.9549127Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:05:32.3541677Z 2024-12-18T00:05:32.3543279Z  2024-12-18T00:05:32.3544138Z  2024-12-18T00:05:32.3545356Z  2024-12-18T00:05:32.3545824Z  2024-12-18T00:05:32.3546207Z  2024-12-18T00:05:32.3546623Z  2024-12-18T00:05:32.3547049Z  2024-12-18T00:05:32.3547546Z  2024-12-18T00:05:32.3548187Z [10,852 / 15,187] 48 actions running 2024-12-18T00:05:32.3548967Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:05:32.3549946Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2024-12-18T00:05:32.3551051Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 14s local 2024-12-18T00:05:32.3551942Z @llvm-project//llvm:CodeGen; 14s local 2024-12-18T00:05:32.3552906Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 14s local 2024-12-18T00:05:32.3554209Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 12s local 2024-12-18T00:05:32.3555390Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 12s local 2024-12-18T00:05:32.3556377Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:05:32.6261297Z 2024-12-18T00:05:32.6262138Z  2024-12-18T00:05:32.6262624Z  2024-12-18T00:05:32.6263039Z  2024-12-18T00:05:32.6263426Z  2024-12-18T00:05:32.6263785Z  2024-12-18T00:05:32.6264195Z  2024-12-18T00:05:32.6264527Z  2024-12-18T00:05:32.6264899Z  2024-12-18T00:05:32.6265445Z [10,853 / 15,187] 48 actions, 47 running 2024-12-18T00:05:32.6266033Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:05:32.6266888Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2024-12-18T00:05:32.6268049Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 14s local 2024-12-18T00:05:32.6268905Z @llvm-project//llvm:CodeGen; 14s local 2024-12-18T00:05:32.6269846Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 14s local 2024-12-18T00:05:32.6271054Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 13s local 2024-12-18T00:05:32.6272207Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 12s local 2024-12-18T00:05:32.6273240Z @llvm-project//llvm:CodeGen; 12s local ... 2024-12-18T00:05:32.8540294Z 2024-12-18T00:05:32.8541407Z  2024-12-18T00:05:32.8542068Z  2024-12-18T00:05:32.8542594Z  2024-12-18T00:05:32.8543137Z  2024-12-18T00:05:32.8543664Z  2024-12-18T00:05:32.8544373Z  2024-12-18T00:05:32.8544899Z  2024-12-18T00:05:32.8545429Z  2024-12-18T00:05:32.8546155Z [10,858 / 15,187] 48 actions, 47 running 2024-12-18T00:05:32.8547105Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:05:32.8548148Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2024-12-18T00:05:32.8549734Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 15s local 2024-12-18T00:05:32.8551031Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 14s local 2024-12-18T00:05:32.8552349Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 13s local 2024-12-18T00:05:32.8553691Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 13s local 2024-12-18T00:05:32.8555358Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 12s local 2024-12-18T00:05:32.8556787Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 12s local ... 2024-12-18T00:05:33.1554337Z 2024-12-18T00:05:33.1555202Z  2024-12-18T00:05:33.1555681Z  2024-12-18T00:05:33.1556083Z  2024-12-18T00:05:33.1556497Z  2024-12-18T00:05:33.1556891Z  2024-12-18T00:05:33.1557299Z  2024-12-18T00:05:33.1557701Z  2024-12-18T00:05:33.1558113Z  2024-12-18T00:05:33.1558701Z [10,861 / 15,187] 48 actions running 2024-12-18T00:05:33.1559514Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:05:33.1560475Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2024-12-18T00:05:33.1561539Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 15s local 2024-12-18T00:05:33.1562677Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2024-12-18T00:05:33.1563871Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 13s local 2024-12-18T00:05:33.1565019Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 13s local 2024-12-18T00:05:33.1566230Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 12s local 2024-12-18T00:05:33.1567422Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 12s local ... 2024-12-18T00:05:33.3553777Z 2024-12-18T00:05:33.3554593Z  2024-12-18T00:05:33.3555032Z  2024-12-18T00:05:33.3555384Z  2024-12-18T00:05:33.3555723Z  2024-12-18T00:05:33.3556124Z  2024-12-18T00:05:33.3556486Z  2024-12-18T00:05:33.3556822Z  2024-12-18T00:05:33.3557156Z  2024-12-18T00:05:33.3557800Z [10,863 / 15,187] 48 actions running 2024-12-18T00:05:33.3558514Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:05:33.3559377Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T00:05:33.3560416Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 15s local 2024-12-18T00:05:33.3561548Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2024-12-18T00:05:33.3562635Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 13s local 2024-12-18T00:05:33.3563696Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 13s local 2024-12-18T00:05:33.3564864Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 12s local 2024-12-18T00:05:33.3565958Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 12s local ... 2024-12-18T00:05:33.6994802Z 2024-12-18T00:05:33.6995669Z  2024-12-18T00:05:33.6996516Z  2024-12-18T00:05:33.6997080Z  2024-12-18T00:05:33.6997606Z  2024-12-18T00:05:33.6998089Z  2024-12-18T00:05:33.6998509Z  2024-12-18T00:05:33.6998919Z  2024-12-18T00:05:33.6999322Z  2024-12-18T00:05:33.6999946Z [10,865 / 15,187] 48 actions, 47 running 2024-12-18T00:05:33.7000809Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:05:33.7001852Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T00:05:33.7003033Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 15s local 2024-12-18T00:05:33.7004298Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2024-12-18T00:05:33.7005553Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2024-12-18T00:05:33.7006820Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 14s local 2024-12-18T00:05:33.7008686Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 13s local 2024-12-18T00:05:33.7009921Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 12s local ... 2024-12-18T00:05:33.9001431Z 2024-12-18T00:05:33.9002290Z  2024-12-18T00:05:33.9002783Z  2024-12-18T00:05:33.9003169Z  2024-12-18T00:05:33.9003547Z  2024-12-18T00:05:33.9003938Z  2024-12-18T00:05:33.9006647Z  2024-12-18T00:05:33.9007270Z  2024-12-18T00:05:33.9007652Z  2024-12-18T00:05:33.9008211Z [10,867 / 15,187] 48 actions, 47 running 2024-12-18T00:05:33.9008940Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:05:33.9009842Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T00:05:33.9010826Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local 2024-12-18T00:05:33.9011898Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2024-12-18T00:05:33.9013044Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2024-12-18T00:05:33.9014261Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 14s local 2024-12-18T00:05:33.9015386Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 13s local 2024-12-18T00:05:33.9016426Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 13s local ... 2024-12-18T00:05:34.1112383Z 2024-12-18T00:05:34.1113345Z  2024-12-18T00:05:34.1113799Z  2024-12-18T00:05:34.1114178Z  2024-12-18T00:05:34.1114563Z  2024-12-18T00:05:34.1114943Z  2024-12-18T00:05:34.1115305Z  2024-12-18T00:05:34.1115687Z  2024-12-18T00:05:34.1116083Z  2024-12-18T00:05:34.1116693Z [10,868 / 15,187] 48 actions, 47 running 2024-12-18T00:05:34.1117437Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:05:34.1118365Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T00:05:34.1119487Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local 2024-12-18T00:05:34.1120604Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2024-12-18T00:05:34.1121810Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2024-12-18T00:05:34.1122908Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 14s local 2024-12-18T00:05:34.1124099Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 13s local 2024-12-18T00:05:34.1125286Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 13s local ... 2024-12-18T00:05:34.3561239Z 2024-12-18T00:05:34.3562226Z  2024-12-18T00:05:34.3562681Z  2024-12-18T00:05:34.3563077Z  2024-12-18T00:05:34.3563445Z  2024-12-18T00:05:34.3563820Z  2024-12-18T00:05:34.3564211Z  2024-12-18T00:05:34.3564613Z  2024-12-18T00:05:34.3564997Z  2024-12-18T00:05:34.3565529Z [10,869 / 15,187] 48 actions running 2024-12-18T00:05:34.3566343Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:05:34.3567283Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2024-12-18T00:05:34.3568367Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local 2024-12-18T00:05:34.3569518Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2024-12-18T00:05:34.3570636Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2024-12-18T00:05:34.3571835Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 14s local 2024-12-18T00:05:34.3573046Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 13s local 2024-12-18T00:05:34.3574259Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 13s local ... 2024-12-18T00:05:34.7565211Z 2024-12-18T00:05:34.7566421Z  2024-12-18T00:05:34.7566906Z  2024-12-18T00:05:34.7567283Z  2024-12-18T00:05:34.7567802Z  2024-12-18T00:05:34.7568562Z  2024-12-18T00:05:34.7568910Z  2024-12-18T00:05:34.7569270Z  2024-12-18T00:05:34.7569660Z  2024-12-18T00:05:34.7570231Z [10,871 / 15,187] 48 actions running 2024-12-18T00:05:34.7570930Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:05:34.7571811Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2024-12-18T00:05:34.7573161Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2024-12-18T00:05:34.7574312Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2024-12-18T00:05:34.7575392Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2024-12-18T00:05:34.7576480Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2024-12-18T00:05:34.7577734Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 14s local 2024-12-18T00:05:34.7578859Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 13s local ... 2024-12-18T00:05:34.9652786Z 2024-12-18T00:05:34.9653648Z  2024-12-18T00:05:34.9654101Z  2024-12-18T00:05:34.9654497Z  2024-12-18T00:05:34.9654881Z  2024-12-18T00:05:34.9655261Z  2024-12-18T00:05:34.9655615Z  2024-12-18T00:05:34.9656022Z  2024-12-18T00:05:34.9656432Z  2024-12-18T00:05:34.9657199Z [10,874 / 15,187] 48 actions, 47 running 2024-12-18T00:05:34.9658071Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:05:34.9659093Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2024-12-18T00:05:34.9660259Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2024-12-18T00:05:34.9661514Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2024-12-18T00:05:34.9662779Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2024-12-18T00:05:34.9663996Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2024-12-18T00:05:34.9665310Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 14s local 2024-12-18T00:05:34.9666620Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2024-12-18T00:05:35.1636646Z 2024-12-18T00:05:35.1637623Z  2024-12-18T00:05:35.1638129Z  2024-12-18T00:05:35.1638777Z  2024-12-18T00:05:35.1639190Z  2024-12-18T00:05:35.1639594Z  2024-12-18T00:05:35.1640045Z  2024-12-18T00:05:35.1640448Z  2024-12-18T00:05:35.1640852Z  2024-12-18T00:05:35.1641471Z [10,876 / 15,187] 48 actions, 47 running 2024-12-18T00:05:35.1642277Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:05:35.1643261Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2024-12-18T00:05:35.1644683Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2024-12-18T00:05:35.1645876Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 17s local 2024-12-18T00:05:35.1647135Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2024-12-18T00:05:35.1648343Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2024-12-18T00:05:35.1649524Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 14s local 2024-12-18T00:05:35.1650765Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2024-12-18T00:05:35.5532485Z 2024-12-18T00:05:35.5533795Z  2024-12-18T00:05:35.5534269Z  2024-12-18T00:05:35.5534649Z  2024-12-18T00:05:35.5535075Z  2024-12-18T00:05:35.5535479Z  2024-12-18T00:05:35.5535881Z  2024-12-18T00:05:35.5536276Z  2024-12-18T00:05:35.5536991Z  2024-12-18T00:05:35.5537602Z [10,879 / 15,187] 48 actions, 47 running 2024-12-18T00:05:35.5538326Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:05:35.5539273Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2024-12-18T00:05:35.5540702Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2024-12-18T00:05:35.5541857Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 17s local 2024-12-18T00:05:35.5543059Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2024-12-18T00:05:35.5544388Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2024-12-18T00:05:35.5545854Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 14s local 2024-12-18T00:05:35.5547023Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2024-12-18T00:05:35.7573569Z 2024-12-18T00:05:35.7574937Z  2024-12-18T00:05:35.7575413Z  2024-12-18T00:05:35.7575832Z  2024-12-18T00:05:35.7576235Z  2024-12-18T00:05:35.7576844Z  2024-12-18T00:05:35.7577269Z  2024-12-18T00:05:35.7577679Z  2024-12-18T00:05:35.7578091Z  2024-12-18T00:05:35.7578663Z [10,881 / 15,187] 48 actions running 2024-12-18T00:05:35.7579500Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:05:35.7580510Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2024-12-18T00:05:35.7581632Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 18s local 2024-12-18T00:05:35.7582879Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 17s local 2024-12-18T00:05:35.7584141Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2024-12-18T00:05:35.7585395Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2024-12-18T00:05:35.7586690Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2024-12-18T00:05:35.7587948Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2024-12-18T00:05:35.9742419Z 2024-12-18T00:05:35.9743324Z  2024-12-18T00:05:35.9743828Z  2024-12-18T00:05:35.9744411Z  2024-12-18T00:05:35.9744795Z  2024-12-18T00:05:35.9745188Z  2024-12-18T00:05:35.9745621Z  2024-12-18T00:05:35.9746020Z  2024-12-18T00:05:35.9746396Z  2024-12-18T00:05:35.9747028Z [10,885 / 15,187] 48 actions, 47 running 2024-12-18T00:05:35.9747876Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:05:35.9748866Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2024-12-18T00:05:35.9750099Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 17s local 2024-12-18T00:05:35.9751319Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2024-12-18T00:05:35.9752570Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2024-12-18T00:05:35.9753888Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2024-12-18T00:05:35.9755113Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:05:35.9756240Z Compiling llvm/lib/CodeGen/TargetInstrInfo.cpp; 10s local ... 2024-12-18T00:05:36.3020531Z 2024-12-18T00:05:36.3021766Z  2024-12-18T00:05:36.3022199Z  2024-12-18T00:05:36.3022565Z  2024-12-18T00:05:36.3022938Z  2024-12-18T00:05:36.3023326Z  2024-12-18T00:05:36.3023732Z  2024-12-18T00:05:36.3024077Z  2024-12-18T00:05:36.3024436Z  2024-12-18T00:05:36.3025014Z [10,887 / 15,187] 48 actions, 47 running 2024-12-18T00:05:36.3025831Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:05:36.3026815Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2024-12-18T00:05:36.3027964Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 18s local 2024-12-18T00:05:36.3029158Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2024-12-18T00:05:36.3030391Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2024-12-18T00:05:36.3031611Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2024-12-18T00:05:36.3032822Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:05:36.3034362Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 9s local ... 2024-12-18T00:05:36.5034088Z 2024-12-18T00:05:36.5035308Z  2024-12-18T00:05:36.5035787Z  2024-12-18T00:05:36.5036164Z  2024-12-18T00:05:36.5036537Z  2024-12-18T00:05:36.5036918Z  2024-12-18T00:05:36.5037275Z  2024-12-18T00:05:36.5038044Z  2024-12-18T00:05:36.5038605Z  2024-12-18T00:05:36.5039194Z [10,889 / 15,187] 48 actions, 47 running 2024-12-18T00:05:36.5039969Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:05:36.5040976Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2024-12-18T00:05:36.5042153Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2024-12-18T00:05:36.5043568Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2024-12-18T00:05:36.5045256Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2024-12-18T00:05:36.5046423Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:05:36.5047562Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 10s local 2024-12-18T00:05:36.5048623Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 9s local ... 2024-12-18T00:05:36.7582524Z 2024-12-18T00:05:36.7583422Z  2024-12-18T00:05:36.7583928Z  2024-12-18T00:05:36.7584317Z  2024-12-18T00:05:36.7584704Z  2024-12-18T00:05:36.7585079Z  2024-12-18T00:05:36.7585440Z  2024-12-18T00:05:36.7585807Z  2024-12-18T00:05:36.7586198Z  2024-12-18T00:05:36.7586756Z [10,890 / 15,187] 48 actions running 2024-12-18T00:05:36.7587507Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:05:36.7588449Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2024-12-18T00:05:36.7589548Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2024-12-18T00:05:36.7590803Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2024-12-18T00:05:36.7592026Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 16s local 2024-12-18T00:05:36.7593180Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:05:36.7594308Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 10s local 2024-12-18T00:05:36.7595308Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 9s local ... 2024-12-18T00:05:36.9684616Z 2024-12-18T00:05:36.9685517Z  2024-12-18T00:05:36.9685971Z  2024-12-18T00:05:36.9686375Z  2024-12-18T00:05:36.9686771Z  2024-12-18T00:05:36.9687171Z  2024-12-18T00:05:36.9687573Z  2024-12-18T00:05:36.9687983Z  2024-12-18T00:05:36.9688358Z  2024-12-18T00:05:36.9688940Z [10,892 / 15,187] 48 actions, 47 running 2024-12-18T00:05:36.9689723Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:05:36.9690696Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2024-12-18T00:05:36.9691783Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2024-12-18T00:05:36.9692977Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2024-12-18T00:05:36.9694235Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 16s local 2024-12-18T00:05:36.9695458Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2024-12-18T00:05:36.9696857Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 10s local 2024-12-18T00:05:36.9697829Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 9s local ... 2024-12-18T00:05:37.2877458Z 2024-12-18T00:05:37.2878518Z  2024-12-18T00:05:37.2878969Z  2024-12-18T00:05:37.2881011Z  2024-12-18T00:05:37.2883779Z  2024-12-18T00:05:37.2886842Z  2024-12-18T00:05:37.2889956Z  2024-12-18T00:05:37.2893078Z  2024-12-18T00:05:37.2894329Z  2024-12-18T00:05:37.2895502Z [10,894 / 15,187] 48 actions, 47 running 2024-12-18T00:05:37.2896317Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:05:37.2897401Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2024-12-18T00:05:37.2898544Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2024-12-18T00:05:37.2900047Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2024-12-18T00:05:37.2901293Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 16s local 2024-12-18T00:05:37.2902388Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2024-12-18T00:05:37.2903565Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 10s local 2024-12-18T00:05:37.2904621Z Compiling llvm/lib/CodeGen/WindowScheduler.cpp; 9s local ... 2024-12-18T00:05:37.5590001Z 2024-12-18T00:05:37.5590944Z  2024-12-18T00:05:37.5591461Z  2024-12-18T00:05:37.5591896Z  2024-12-18T00:05:37.5592247Z  2024-12-18T00:05:37.5592642Z  2024-12-18T00:05:37.5593033Z  2024-12-18T00:05:37.5593420Z  2024-12-18T00:05:37.5593809Z  2024-12-18T00:05:37.5594359Z [10,894 / 15,187] 48 actions running 2024-12-18T00:05:37.5595094Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:05:37.5596008Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2024-12-18T00:05:37.5597079Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:05:37.5598371Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2024-12-18T00:05:37.5599594Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 16s local 2024-12-18T00:05:37.5600769Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2024-12-18T00:05:37.5601912Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 11s local 2024-12-18T00:05:37.5603050Z Compiling llvm/lib/CodeGen/WindowScheduler.cpp; 9s local ... 2024-12-18T00:05:37.7594429Z 2024-12-18T00:05:37.7595502Z  2024-12-18T00:05:37.7596012Z  2024-12-18T00:05:37.7596426Z  2024-12-18T00:05:37.7596841Z  2024-12-18T00:05:37.7597275Z  2024-12-18T00:05:37.7597691Z  2024-12-18T00:05:37.7598098Z  2024-12-18T00:05:37.7598517Z  2024-12-18T00:05:37.7599158Z [10,897 / 15,187] 48 actions running 2024-12-18T00:05:37.7600129Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:05:37.7601058Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2024-12-18T00:05:37.7602114Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:05:37.7603218Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2024-12-18T00:05:37.7604424Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2024-12-18T00:05:37.7605530Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2024-12-18T00:05:37.7606598Z Compiling llvm/lib/CodeGen/WindowScheduler.cpp; 9s local 2024-12-18T00:05:37.7607646Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local ... 2024-12-18T00:05:38.0429426Z 2024-12-18T00:05:38.0430318Z  2024-12-18T00:05:38.0430801Z  2024-12-18T00:05:38.0431187Z  2024-12-18T00:05:38.0431743Z  2024-12-18T00:05:38.0432175Z  2024-12-18T00:05:38.0432593Z  2024-12-18T00:05:38.0432995Z  2024-12-18T00:05:38.0433399Z  2024-12-18T00:05:38.0434002Z [10,899 / 15,187] 48 actions, 47 running 2024-12-18T00:05:38.0434771Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:05:38.0435682Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2024-12-18T00:05:38.0436764Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:05:38.0437938Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2024-12-18T00:05:38.0439562Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2024-12-18T00:05:38.0440638Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2024-12-18T00:05:38.0441683Z Compiling llvm/lib/CodeGen/WindowScheduler.cpp; 9s local 2024-12-18T00:05:38.0442975Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local ... 2024-12-18T00:05:38.2694963Z 2024-12-18T00:05:38.2696019Z  2024-12-18T00:05:38.2696626Z  2024-12-18T00:05:38.2698505Z  2024-12-18T00:05:38.2701439Z  2024-12-18T00:05:38.2704328Z  2024-12-18T00:05:38.2707470Z  2024-12-18T00:05:38.2710450Z  2024-12-18T00:05:38.2713465Z  2024-12-18T00:05:38.2714493Z [10,901 / 15,187] 48 actions, 47 running 2024-12-18T00:05:38.2715540Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:05:38.2716759Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2024-12-18T00:05:38.2718191Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:05:38.2719660Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2024-12-18T00:05:38.2721183Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2024-12-18T00:05:38.2722576Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2024-12-18T00:05:38.2723897Z Compiling llvm/lib/CodeGen/WindowScheduler.cpp; 10s local 2024-12-18T00:05:38.2725117Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local ... 2024-12-18T00:05:38.5050755Z 2024-12-18T00:05:38.5052036Z  2024-12-18T00:05:38.5052843Z  2024-12-18T00:05:38.5053951Z  2024-12-18T00:05:38.5054430Z  2024-12-18T00:05:38.5054827Z  2024-12-18T00:05:38.5055215Z  2024-12-18T00:05:38.5055628Z  2024-12-18T00:05:38.5056025Z  2024-12-18T00:05:38.5056828Z [10,903 / 15,187] 48 actions, 47 running 2024-12-18T00:05:38.5057722Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:05:38.5058839Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2024-12-18T00:05:38.5059944Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:05:38.5061148Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2024-12-18T00:05:38.5062357Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2024-12-18T00:05:38.5063463Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2024-12-18T00:05:38.5064505Z Compiling llvm/lib/CodeGen/WindowScheduler.cpp; 10s local 2024-12-18T00:05:38.5065471Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local ... 2024-12-18T00:05:38.7390709Z 2024-12-18T00:05:38.7392091Z  2024-12-18T00:05:38.7392604Z  2024-12-18T00:05:38.7393034Z  2024-12-18T00:05:38.7393430Z  2024-12-18T00:05:38.7393843Z  2024-12-18T00:05:38.7394323Z  2024-12-18T00:05:38.7394757Z  2024-12-18T00:05:38.7395192Z  2024-12-18T00:05:38.7395797Z [10,908 / 15,187] 48 actions, 47 running 2024-12-18T00:05:38.7396557Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:05:38.7397463Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2024-12-18T00:05:38.7398549Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2024-12-18T00:05:38.7399660Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2024-12-18T00:05:38.7400756Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 18s local 2024-12-18T00:05:38.7401931Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2024-12-18T00:05:38.7403052Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:05:38.7404037Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local ... 2024-12-18T00:05:38.9775687Z 2024-12-18T00:05:38.9777023Z  2024-12-18T00:05:38.9777470Z  2024-12-18T00:05:38.9777848Z  2024-12-18T00:05:38.9778199Z  2024-12-18T00:05:38.9778566Z  2024-12-18T00:05:38.9778967Z  2024-12-18T00:05:38.9779359Z  2024-12-18T00:05:38.9779735Z  2024-12-18T00:05:38.9780308Z [10,908 / 15,187] 48 actions, 47 running 2024-12-18T00:05:38.9781239Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:05:38.9782148Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2024-12-18T00:05:38.9783204Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2024-12-18T00:05:38.9784352Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2024-12-18T00:05:38.9785570Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 18s local 2024-12-18T00:05:38.9786725Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2024-12-18T00:05:38.9788290Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:05:38.9789503Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local ... 2024-12-18T00:05:39.3781453Z 2024-12-18T00:05:39.3782345Z  2024-12-18T00:05:39.3782875Z  2024-12-18T00:05:39.3783284Z  2024-12-18T00:05:39.3783699Z  2024-12-18T00:05:39.3784110Z  2024-12-18T00:05:39.3784499Z  2024-12-18T00:05:39.3785022Z  2024-12-18T00:05:39.3785485Z  2024-12-18T00:05:39.3786054Z [10,909 / 15,187] 48 actions running 2024-12-18T00:05:39.3786856Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:05:39.3787815Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2024-12-18T00:05:39.3788951Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2024-12-18T00:05:39.3790027Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2024-12-18T00:05:39.3791269Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 18s local 2024-12-18T00:05:39.3792398Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2024-12-18T00:05:39.3793444Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:05:39.3794335Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local ... 2024-12-18T00:05:39.7302510Z 2024-12-18T00:05:39.7303334Z  2024-12-18T00:05:39.7303803Z  2024-12-18T00:05:39.7304230Z  2024-12-18T00:05:39.7304625Z  2024-12-18T00:05:39.7305017Z  2024-12-18T00:05:39.7305412Z  2024-12-18T00:05:39.7305803Z  2024-12-18T00:05:39.7306159Z  2024-12-18T00:05:39.7306753Z [10,911 / 15,187] 48 actions, 47 running 2024-12-18T00:05:39.7307513Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:05:39.7308454Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2024-12-18T00:05:39.7309528Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2024-12-18T00:05:39.7310696Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2024-12-18T00:05:39.7311860Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2024-12-18T00:05:39.7312978Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2024-12-18T00:05:39.9649177Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:05:39.9650245Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local ... 2024-12-18T00:05:39.9650785Z 2024-12-18T00:05:39.9651253Z  2024-12-18T00:05:39.9651646Z  2024-12-18T00:05:39.9654009Z  2024-12-18T00:05:39.9657265Z  2024-12-18T00:05:39.9660272Z  2024-12-18T00:05:39.9663191Z  2024-12-18T00:05:39.9663999Z  2024-12-18T00:05:39.9664907Z  2024-12-18T00:05:39.9665733Z [10,912 / 15,187] 48 actions, 47 running 2024-12-18T00:05:39.9666557Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:05:39.9667539Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2024-12-18T00:05:39.9669416Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2024-12-18T00:05:39.9670570Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2024-12-18T00:05:39.9671807Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2024-12-18T00:05:39.9673241Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:05:39.9674431Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:05:39.9675395Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local ... 2024-12-18T00:05:40.1788224Z 2024-12-18T00:05:40.1789265Z  2024-12-18T00:05:40.1789733Z  2024-12-18T00:05:40.1790138Z  2024-12-18T00:05:40.1790516Z  2024-12-18T00:05:40.1790887Z  2024-12-18T00:05:40.1791256Z  2024-12-18T00:05:40.1791644Z  2024-12-18T00:05:40.1792068Z  2024-12-18T00:05:40.1792631Z [10,918 / 15,187] 47 actions running 2024-12-18T00:05:40.1793390Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:05:40.1794233Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2024-12-18T00:05:40.1795182Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2024-12-18T00:05:40.1796225Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2024-12-18T00:05:40.1797434Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2024-12-18T00:05:40.1798475Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:05:40.1799525Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:05:40.1800427Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local ... 2024-12-18T00:05:40.3793021Z 2024-12-18T00:05:40.3794142Z  2024-12-18T00:05:40.3795007Z  2024-12-18T00:05:40.3798018Z  2024-12-18T00:05:40.3801206Z  2024-12-18T00:05:40.3804282Z  2024-12-18T00:05:40.3805074Z  2024-12-18T00:05:40.3805704Z  2024-12-18T00:05:40.3806292Z  2024-12-18T00:05:40.3807074Z [10,918 / 15,187] 48 actions running 2024-12-18T00:05:40.3808047Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:05:40.3809196Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T00:05:40.3810737Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2024-12-18T00:05:40.3812119Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2024-12-18T00:05:40.3813542Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2024-12-18T00:05:40.3814930Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:05:40.3816309Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:05:40.3817648Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local ... 2024-12-18T00:05:40.6892117Z 2024-12-18T00:05:40.6893490Z  2024-12-18T00:05:40.6894267Z  2024-12-18T00:05:40.6895542Z  2024-12-18T00:05:40.6895992Z  2024-12-18T00:05:40.6896418Z  2024-12-18T00:05:40.6897009Z  2024-12-18T00:05:40.6897456Z  2024-12-18T00:05:40.6897867Z  2024-12-18T00:05:40.6898483Z [10,922 / 15,187] 48 actions, 47 running 2024-12-18T00:05:40.6899313Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:05:40.6900291Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T00:05:40.6901438Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2024-12-18T00:05:40.6902401Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2024-12-18T00:05:40.6903469Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:05:40.6904546Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:05:40.6905853Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:05:40.6906908Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local ... 2024-12-18T00:05:40.9364186Z 2024-12-18T00:05:40.9365430Z  2024-12-18T00:05:40.9365913Z  2024-12-18T00:05:40.9366311Z  2024-12-18T00:05:40.9366790Z  2024-12-18T00:05:40.9367209Z  2024-12-18T00:05:40.9367606Z  2024-12-18T00:05:40.9368474Z  2024-12-18T00:05:40.9369015Z  2024-12-18T00:05:40.9369644Z [10,923 / 15,187] 48 actions, 47 running 2024-12-18T00:05:40.9370491Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:05:40.9371415Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T00:05:40.9372479Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2024-12-18T00:05:40.9373571Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2024-12-18T00:05:40.9374750Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2024-12-18T00:05:40.9375873Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2024-12-18T00:05:40.9376976Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:05:40.9377770Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local ... 2024-12-18T00:05:41.1687994Z 2024-12-18T00:05:41.1688883Z  2024-12-18T00:05:41.1689359Z  2024-12-18T00:05:41.1689759Z  2024-12-18T00:05:41.1690170Z  2024-12-18T00:05:41.1690561Z  2024-12-18T00:05:41.1690936Z  2024-12-18T00:05:41.1691331Z  2024-12-18T00:05:41.1691716Z  2024-12-18T00:05:41.1692325Z [10,926 / 15,187] 48 actions, 47 running 2024-12-18T00:05:41.1693084Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:05:41.1693956Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T00:05:41.1695599Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2024-12-18T00:05:41.1697194Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2024-12-18T00:05:41.1698419Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2024-12-18T00:05:41.1699811Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2024-12-18T00:05:41.1700910Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:05:41.1701984Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local ... 2024-12-18T00:05:41.3801692Z 2024-12-18T00:05:41.3802549Z  2024-12-18T00:05:41.3802992Z  2024-12-18T00:05:41.3803349Z  2024-12-18T00:05:41.3803699Z  2024-12-18T00:05:41.3804071Z  2024-12-18T00:05:41.3804427Z  2024-12-18T00:05:41.3804795Z  2024-12-18T00:05:41.3805170Z  2024-12-18T00:05:41.3805707Z [10,927 / 15,187] 48 actions running 2024-12-18T00:05:41.3806395Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:05:41.3807255Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2024-12-18T00:05:41.3808342Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2024-12-18T00:05:41.3809776Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2024-12-18T00:05:41.3810961Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2024-12-18T00:05:41.3812068Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2024-12-18T00:05:41.3813033Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 10s local 2024-12-18T00:05:41.3813890Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local ... 2024-12-18T00:05:41.7717467Z 2024-12-18T00:05:41.7718388Z  2024-12-18T00:05:41.7719063Z  2024-12-18T00:05:41.7719565Z  2024-12-18T00:05:41.7720051Z  2024-12-18T00:05:41.7720530Z  2024-12-18T00:05:41.7721011Z  2024-12-18T00:05:41.7721524Z  2024-12-18T00:05:41.7722006Z  2024-12-18T00:05:41.7722672Z [10,933 / 15,187] 48 actions, 47 running 2024-12-18T00:05:41.7724043Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:05:41.7725064Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2024-12-18T00:05:41.7726195Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2024-12-18T00:05:41.7727442Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2024-12-18T00:05:41.7728985Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2024-12-18T00:05:41.7730108Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:05:41.7730999Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:05:41.7732024Z Compiling mlir/lib/AsmParser/AttributeParser.cpp [for tool]; 6s local ... 2024-12-18T00:05:41.9807758Z 2024-12-18T00:05:41.9808633Z  2024-12-18T00:05:41.9809629Z  2024-12-18T00:05:41.9811114Z  2024-12-18T00:05:41.9824893Z  2024-12-18T00:05:41.9827806Z  2024-12-18T00:05:41.9830721Z  2024-12-18T00:05:41.9832086Z  2024-12-18T00:05:41.9832666Z  2024-12-18T00:05:41.9833425Z [10,934 / 15,187] 48 actions running 2024-12-18T00:05:41.9834375Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:05:41.9835496Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2024-12-18T00:05:41.9836753Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2024-12-18T00:05:41.9838076Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2024-12-18T00:05:41.9839358Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:05:41.9840394Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:05:41.9841173Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:05:41.9842266Z Compiling mlir/lib/AsmParser/AttributeParser.cpp [for tool]; 6s local ... 2024-12-18T00:05:42.1811320Z 2024-12-18T00:05:42.1812643Z  2024-12-18T00:05:42.1813309Z  2024-12-18T00:05:42.1813971Z  2024-12-18T00:05:42.1815079Z  2024-12-18T00:05:42.1815549Z  2024-12-18T00:05:42.1815957Z  2024-12-18T00:05:42.1816361Z  2024-12-18T00:05:42.1816955Z  2024-12-18T00:05:42.1817576Z [10,937 / 15,187] 48 actions running 2024-12-18T00:05:42.1818582Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:05:42.1819619Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2024-12-18T00:05:42.1820814Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2024-12-18T00:05:42.1821950Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2024-12-18T00:05:42.1823234Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:05:42.1824215Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:05:42.1824989Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:05:42.1825954Z Compiling mlir/lib/AsmParser/AttributeParser.cpp [for tool]; 6s local ... 2024-12-18T00:05:42.5817478Z 2024-12-18T00:05:42.5818914Z  2024-12-18T00:05:42.5819388Z  2024-12-18T00:05:42.5819796Z  2024-12-18T00:05:42.5820202Z  2024-12-18T00:05:42.5820572Z  2024-12-18T00:05:42.5820958Z  2024-12-18T00:05:42.5821352Z  2024-12-18T00:05:42.5821792Z  2024-12-18T00:05:42.5822366Z [10,939 / 15,187] 48 actions running 2024-12-18T00:05:42.5823172Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:05:42.5824156Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2024-12-18T00:05:42.5825279Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2024-12-18T00:05:42.5826491Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2024-12-18T00:05:42.5827755Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:05:42.5829099Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:05:42.5829929Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:05:42.5830877Z Compiling mlir/lib/AsmParser/AttributeParser.cpp [for tool]; 7s local ... 2024-12-18T00:05:42.7822696Z 2024-12-18T00:05:42.7823593Z  2024-12-18T00:05:42.7824039Z  2024-12-18T00:05:42.7824431Z  2024-12-18T00:05:42.7825216Z  2024-12-18T00:05:42.7825617Z  2024-12-18T00:05:42.7825958Z  2024-12-18T00:05:42.7826332Z  2024-12-18T00:05:42.7826685Z  2024-12-18T00:05:42.7827236Z [10,941 / 15,187] 48 actions running 2024-12-18T00:05:42.7827969Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:05:42.7828867Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2024-12-18T00:05:42.7829914Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2024-12-18T00:05:42.7830916Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2024-12-18T00:05:42.7832085Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:05:42.7833010Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:05:42.7833819Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:05:42.7834785Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 7s local ... 2024-12-18T00:05:43.1828694Z 2024-12-18T00:05:43.1829529Z  2024-12-18T00:05:43.1829992Z  2024-12-18T00:05:43.1830369Z  2024-12-18T00:05:43.1830736Z  2024-12-18T00:05:43.1831126Z  2024-12-18T00:05:43.1831511Z  2024-12-18T00:05:43.1831887Z  2024-12-18T00:05:43.1832255Z  2024-12-18T00:05:43.1832781Z [10,944 / 15,187] 48 actions running 2024-12-18T00:05:43.1833552Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:05:43.1834465Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2024-12-18T00:05:43.1835557Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2024-12-18T00:05:43.1836706Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2024-12-18T00:05:43.1837873Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2024-12-18T00:05:43.1838816Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:05:43.1839788Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:05:43.1840708Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 7s local ... 2024-12-18T00:05:43.6336429Z 2024-12-18T00:05:43.6337448Z  2024-12-18T00:05:43.6337926Z  2024-12-18T00:05:43.6339968Z  2024-12-18T00:05:43.6343058Z  2024-12-18T00:05:43.6346469Z  2024-12-18T00:05:43.6349251Z  2024-12-18T00:05:43.6349906Z  2024-12-18T00:05:43.6350536Z  2024-12-18T00:05:43.6351331Z [10,945 / 15,187] 48 actions, 47 running 2024-12-18T00:05:43.6352381Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:05:43.6353573Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2024-12-18T00:05:43.6354851Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2024-12-18T00:05:43.6356361Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2024-12-18T00:05:43.6357762Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2024-12-18T00:05:43.6358950Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:05:43.6359940Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:05:43.6361063Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 7s local ... 2024-12-18T00:05:43.9633425Z 2024-12-18T00:05:43.9634696Z  2024-12-18T00:05:43.9635290Z  2024-12-18T00:05:43.9635886Z  2024-12-18T00:05:43.9636959Z  2024-12-18T00:05:43.9637370Z  2024-12-18T00:05:43.9637722Z  2024-12-18T00:05:43.9638406Z  2024-12-18T00:05:43.9638767Z  2024-12-18T00:05:43.9639302Z [10,947 / 15,187] 48 actions, 47 running 2024-12-18T00:05:43.9640024Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:05:43.9640922Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2024-12-18T00:05:43.9642129Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2024-12-18T00:05:43.9643152Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2024-12-18T00:05:43.9644450Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2024-12-18T00:05:43.9645397Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:05:43.9646179Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:05:43.9647010Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 8s local ... 2024-12-18T00:05:44.1836329Z 2024-12-18T00:05:44.1837111Z  2024-12-18T00:05:44.1837524Z  2024-12-18T00:05:44.1837903Z  2024-12-18T00:05:44.1838250Z  2024-12-18T00:05:44.1838599Z  2024-12-18T00:05:44.1838922Z  2024-12-18T00:05:44.1839259Z  2024-12-18T00:05:44.1839589Z  2024-12-18T00:05:44.1840113Z [10,947 / 15,187] 48 actions running 2024-12-18T00:05:44.1840805Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:05:44.1841698Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2024-12-18T00:05:44.1842677Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2024-12-18T00:05:44.1843696Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2024-12-18T00:05:44.1845476Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2024-12-18T00:05:44.1846501Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:05:44.1847335Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:05:44.1848290Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 8s local ... 2024-12-18T00:05:44.5057320Z 2024-12-18T00:05:44.5058177Z  2024-12-18T00:05:44.5058761Z  2024-12-18T00:05:44.5059080Z  2024-12-18T00:05:44.5059485Z  2024-12-18T00:05:44.5059903Z  2024-12-18T00:05:44.5060311Z  2024-12-18T00:05:44.5060711Z  2024-12-18T00:05:44.5061048Z  2024-12-18T00:05:44.5061652Z [10,948 / 15,187] 48 actions, 47 running 2024-12-18T00:05:44.5062343Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:05:44.5063153Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T00:05:44.5064078Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2024-12-18T00:05:44.5065049Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2024-12-18T00:05:44.5066030Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2024-12-18T00:05:44.5066877Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:05:44.5067616Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:05:44.5068421Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 8s local ... 2024-12-18T00:05:44.7843620Z 2024-12-18T00:05:44.7844780Z  2024-12-18T00:05:44.7845375Z  2024-12-18T00:05:44.7845757Z  2024-12-18T00:05:44.7846118Z  2024-12-18T00:05:44.7846535Z  2024-12-18T00:05:44.7846916Z  2024-12-18T00:05:44.7847278Z  2024-12-18T00:05:44.7847677Z  2024-12-18T00:05:44.7848239Z [10,949 / 15,187] 48 actions running 2024-12-18T00:05:44.7848972Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:05:44.7849889Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T00:05:44.7851105Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2024-12-18T00:05:44.7852238Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2024-12-18T00:05:44.7853650Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:05:44.7854499Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:05:44.7855245Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:05:44.7856079Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 9s local ... 2024-12-18T00:05:44.9981933Z 2024-12-18T00:05:44.9983211Z  2024-12-18T00:05:44.9983745Z  2024-12-18T00:05:44.9984209Z  2024-12-18T00:05:44.9984590Z  2024-12-18T00:05:44.9985343Z  2024-12-18T00:05:44.9985992Z  2024-12-18T00:05:44.9986592Z  2024-12-18T00:05:44.9987111Z  2024-12-18T00:05:44.9987836Z [10,950 / 15,187] 48 actions, 47 running 2024-12-18T00:05:44.9988716Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:05:44.9989744Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T00:05:44.9990918Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2024-12-18T00:05:44.9992240Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2024-12-18T00:05:44.9993529Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:05:44.9994660Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:05:44.9995737Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:05:44.9996787Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 9s local ... 2024-12-18T00:05:45.2908957Z 2024-12-18T00:05:45.2909828Z  2024-12-18T00:05:45.2910306Z  2024-12-18T00:05:45.2910708Z  2024-12-18T00:05:45.2911091Z  2024-12-18T00:05:45.2911506Z  2024-12-18T00:05:45.2911913Z  2024-12-18T00:05:45.2912304Z  2024-12-18T00:05:45.2912693Z  2024-12-18T00:05:45.2913298Z [10,951 / 15,187] 48 actions, 47 running 2024-12-18T00:05:45.2914090Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:05:45.2915078Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T00:05:45.2916180Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2024-12-18T00:05:45.2917362Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2024-12-18T00:05:45.2918538Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:05:45.2919567Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:05:45.2920525Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:05:45.2921444Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 9s local ... 2024-12-18T00:05:45.5852158Z 2024-12-18T00:05:45.5853155Z  2024-12-18T00:05:45.5853616Z  2024-12-18T00:05:45.5855512Z  2024-12-18T00:05:45.5855912Z  2024-12-18T00:05:45.5857777Z  2024-12-18T00:05:45.5858173Z  2024-12-18T00:05:45.5859798Z  2024-12-18T00:05:45.5860324Z  2024-12-18T00:05:45.5861061Z [10,952 / 15,187] 48 actions running 2024-12-18T00:05:45.5861934Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:05:45.5863009Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2024-12-18T00:05:45.5864271Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:05:45.5865592Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2024-12-18T00:05:45.5866864Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:05:45.5867963Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:05:45.5868837Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:05:45.5869839Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 9s local ... 2024-12-18T00:05:45.9857012Z 2024-12-18T00:05:45.9857965Z  2024-12-18T00:05:45.9858369Z  2024-12-18T00:05:45.9860210Z  2024-12-18T00:05:45.9860976Z  2024-12-18T00:05:45.9861343Z  2024-12-18T00:05:45.9863215Z  2024-12-18T00:05:45.9863554Z  2024-12-18T00:05:45.9865298Z  2024-12-18T00:05:45.9865786Z [10,954 / 15,187] 48 actions running 2024-12-18T00:05:45.9867519Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:05:45.9868535Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2024-12-18T00:05:45.9869362Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:05:45.9870252Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2024-12-18T00:05:45.9871133Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2024-12-18T00:05:45.9871893Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:05:45.9873078Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:05:45.9875193Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 10s local ... 2024-12-18T00:05:46.2675467Z 2024-12-18T00:05:46.2676369Z  2024-12-18T00:05:46.2676824Z  2024-12-18T00:05:46.2677196Z  2024-12-18T00:05:46.2677570Z  2024-12-18T00:05:46.2677967Z  2024-12-18T00:05:46.2678352Z  2024-12-18T00:05:46.2678720Z  2024-12-18T00:05:46.2679107Z  2024-12-18T00:05:46.2679714Z [10,955 / 15,187] 48 actions, 47 running 2024-12-18T00:05:46.2680527Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:05:46.2681449Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2024-12-18T00:05:46.2682526Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:05:46.2684238Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2024-12-18T00:05:46.2685615Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2024-12-18T00:05:46.2686818Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:05:46.2687821Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:05:46.2688878Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 10s local ... 2024-12-18T00:05:46.5381871Z 2024-12-18T00:05:46.5382886Z  2024-12-18T00:05:46.5383353Z  2024-12-18T00:05:46.5383725Z  2024-12-18T00:05:46.5384114Z  2024-12-18T00:05:46.5384512Z  2024-12-18T00:05:46.5384914Z  2024-12-18T00:05:46.5385353Z  2024-12-18T00:05:46.5385722Z  2024-12-18T00:05:46.5386291Z [10,956 / 15,187] 48 actions, 47 running 2024-12-18T00:05:46.5387058Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:05:46.5387907Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2024-12-18T00:05:46.5388932Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:05:46.5390054Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2024-12-18T00:05:46.5391274Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2024-12-18T00:05:46.5392299Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:05:46.5393127Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:05:46.5394066Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 10s local ... 2024-12-18T00:05:46.7864346Z 2024-12-18T00:05:46.7865308Z  2024-12-18T00:05:46.7865784Z  2024-12-18T00:05:46.7867911Z  2024-12-18T00:05:46.7868342Z  2024-12-18T00:05:46.7870046Z  2024-12-18T00:05:46.7870420Z  2024-12-18T00:05:46.7870879Z  2024-12-18T00:05:46.7871284Z  2024-12-18T00:05:46.7871841Z [10,958 / 15,187] 48 actions running 2024-12-18T00:05:46.7872612Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:05:46.7873532Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2024-12-18T00:05:46.7874554Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2024-12-18T00:05:46.7876225Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2024-12-18T00:05:46.7877452Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2024-12-18T00:05:46.7878402Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:05:46.7879213Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:05:46.7880464Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local ... 2024-12-18T00:05:47.0549925Z 2024-12-18T00:05:47.0551520Z  2024-12-18T00:05:47.0552006Z  2024-12-18T00:05:47.0552438Z  2024-12-18T00:05:47.0552867Z  2024-12-18T00:05:47.0553269Z  2024-12-18T00:05:47.0553686Z  2024-12-18T00:05:47.0554110Z  2024-12-18T00:05:47.0554496Z  2024-12-18T00:05:47.0555028Z [10,961 / 15,187] 48 actions, 47 running 2024-12-18T00:05:47.0555783Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:05:47.0556704Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2024-12-18T00:05:47.0557809Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2024-12-18T00:05:47.0558966Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2024-12-18T00:05:47.0560119Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2024-12-18T00:05:47.0561214Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:05:47.0562110Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local 2024-12-18T00:05:47.0563154Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:05:47.3869647Z 2024-12-18T00:05:47.3870649Z  2024-12-18T00:05:47.3871197Z  2024-12-18T00:05:47.3871608Z  2024-12-18T00:05:47.3871984Z  2024-12-18T00:05:47.3872392Z  2024-12-18T00:05:47.3872767Z  2024-12-18T00:05:47.3873172Z  2024-12-18T00:05:47.3873566Z  2024-12-18T00:05:47.3874111Z [10,961 / 15,187] 48 actions running 2024-12-18T00:05:47.3874954Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:05:47.3875858Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2024-12-18T00:05:47.3876975Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2024-12-18T00:05:47.3878192Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2024-12-18T00:05:47.3879355Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2024-12-18T00:05:47.3880300Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:05:47.3881183Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local 2024-12-18T00:05:47.3882273Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:05:47.6034889Z 2024-12-18T00:05:47.6035912Z  2024-12-18T00:05:47.6036387Z  2024-12-18T00:05:47.6036776Z  2024-12-18T00:05:47.6037258Z  2024-12-18T00:05:47.6037726Z  2024-12-18T00:05:47.6038168Z  2024-12-18T00:05:47.6038531Z  2024-12-18T00:05:47.6038897Z  2024-12-18T00:05:47.6039439Z [10,962 / 15,187] 48 actions, 47 running 2024-12-18T00:05:47.6040170Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:05:47.6041075Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2024-12-18T00:05:47.6042116Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2024-12-18T00:05:47.6043253Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2024-12-18T00:05:47.6044672Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2024-12-18T00:05:47.6045621Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:05:47.6046507Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local 2024-12-18T00:05:47.6047531Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:05:47.8096983Z 2024-12-18T00:05:47.8098026Z  2024-12-18T00:05:47.8098557Z  2024-12-18T00:05:47.8098899Z  2024-12-18T00:05:47.8099232Z  2024-12-18T00:05:47.8099587Z  2024-12-18T00:05:47.8099950Z  2024-12-18T00:05:47.8100348Z  2024-12-18T00:05:47.8100742Z  2024-12-18T00:05:47.8101306Z [10,964 / 15,187] 48 actions, 47 running 2024-12-18T00:05:47.8102567Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:05:47.8103568Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2024-12-18T00:05:47.8104621Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2024-12-18T00:05:47.8105620Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2024-12-18T00:05:47.8106646Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:05:47.8107439Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:05:47.8108245Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 12s local 2024-12-18T00:05:47.8109242Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local ... 2024-12-18T00:05:48.1877037Z 2024-12-18T00:05:48.1879037Z  2024-12-18T00:05:48.1879509Z  2024-12-18T00:05:48.1879906Z  2024-12-18T00:05:48.1880256Z  2024-12-18T00:05:48.1880579Z  2024-12-18T00:05:48.1881003Z  2024-12-18T00:05:48.1881461Z  2024-12-18T00:05:48.1881911Z  2024-12-18T00:05:48.1882560Z [10,967 / 15,187] 48 actions running 2024-12-18T00:05:48.1883412Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:05:48.1884304Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2024-12-18T00:05:48.1885315Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2024-12-18T00:05:48.1886466Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2024-12-18T00:05:48.1887642Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:05:48.1888797Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:05:48.1889645Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local 2024-12-18T00:05:48.1890663Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 11s local ... 2024-12-18T00:05:48.4027212Z 2024-12-18T00:05:48.4028227Z  2024-12-18T00:05:48.4028757Z  2024-12-18T00:05:48.4029268Z  2024-12-18T00:05:48.4029764Z  2024-12-18T00:05:48.4030191Z  2024-12-18T00:05:48.4030618Z  2024-12-18T00:05:48.4031109Z  2024-12-18T00:05:48.4031528Z  2024-12-18T00:05:48.4032101Z [10,968 / 15,187] 48 actions, 47 running 2024-12-18T00:05:48.4032896Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:05:48.4033857Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2024-12-18T00:05:48.4035172Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2024-12-18T00:05:48.4036325Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2024-12-18T00:05:48.4037425Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:05:48.4038454Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:05:48.4039388Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local 2024-12-18T00:05:48.4040457Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 11s local ... 2024-12-18T00:05:48.7180883Z 2024-12-18T00:05:48.7181862Z  2024-12-18T00:05:48.7182412Z  2024-12-18T00:05:48.7182875Z  2024-12-18T00:05:48.7183346Z  2024-12-18T00:05:48.7183816Z  2024-12-18T00:05:48.7184168Z  2024-12-18T00:05:48.7184537Z  2024-12-18T00:05:48.7184921Z  2024-12-18T00:05:48.7185617Z [10,969 / 15,187] 48 actions, 47 running 2024-12-18T00:05:48.7186353Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:05:48.7187352Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2024-12-18T00:05:48.7189010Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2024-12-18T00:05:48.7190268Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:05:48.7191440Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:05:48.7192612Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:05:48.7193464Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local 2024-12-18T00:05:48.7194499Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 11s local ... 2024-12-18T00:05:48.9884940Z 2024-12-18T00:05:48.9886901Z  2024-12-18T00:05:48.9887400Z  2024-12-18T00:05:48.9888564Z  2024-12-18T00:05:48.9889817Z  2024-12-18T00:05:48.9891129Z  2024-12-18T00:05:48.9892410Z  2024-12-18T00:05:48.9893676Z  2024-12-18T00:05:48.9895083Z  2024-12-18T00:05:48.9896682Z [10,969 / 15,187] 48 actions running 2024-12-18T00:05:48.9897988Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:05:48.9899261Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2024-12-18T00:05:48.9900477Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2024-12-18T00:05:48.9901783Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:05:48.9903072Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2024-12-18T00:05:48.9903901Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:05:48.9904872Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local 2024-12-18T00:05:48.9905888Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 12s local ... 2024-12-18T00:05:49.3890563Z 2024-12-18T00:05:49.3892638Z  2024-12-18T00:05:49.3893140Z  2024-12-18T00:05:49.3893525Z  2024-12-18T00:05:49.3893952Z  2024-12-18T00:05:49.3894461Z  2024-12-18T00:05:49.3894910Z  2024-12-18T00:05:49.3895338Z  2024-12-18T00:05:49.3895713Z  2024-12-18T00:05:49.3896259Z [10,970 / 15,187] 48 actions running 2024-12-18T00:05:49.3897121Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:05:49.3898019Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2024-12-18T00:05:49.3899089Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2024-12-18T00:05:49.3900211Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:05:49.3901394Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2024-12-18T00:05:49.3902475Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:05:49.3903286Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local 2024-12-18T00:05:49.3904235Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 12s local ... 2024-12-18T00:05:49.5895772Z 2024-12-18T00:05:49.5896946Z  2024-12-18T00:05:49.5897484Z  2024-12-18T00:05:49.5897892Z  2024-12-18T00:05:49.5898284Z  2024-12-18T00:05:49.5898689Z  2024-12-18T00:05:49.5899094Z  2024-12-18T00:05:49.5899470Z  2024-12-18T00:05:49.5899856Z  2024-12-18T00:05:49.5900418Z [10,971 / 15,187] 48 actions running 2024-12-18T00:05:49.5901243Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:05:49.5902229Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2024-12-18T00:05:49.5903376Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 30s local 2024-12-18T00:05:49.5904611Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:05:49.5905872Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2024-12-18T00:05:49.5906987Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:05:49.5907819Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local 2024-12-18T00:05:49.5909240Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 12s local ... 2024-12-18T00:05:49.8045644Z 2024-12-18T00:05:49.8046635Z  2024-12-18T00:05:49.8047170Z  2024-12-18T00:05:49.8047642Z  2024-12-18T00:05:49.8048112Z  2024-12-18T00:05:49.8048674Z  2024-12-18T00:05:49.8049081Z  2024-12-18T00:05:49.8049438Z  2024-12-18T00:05:49.8050223Z  2024-12-18T00:05:49.8050836Z [10,972 / 15,187] 48 actions, 47 running 2024-12-18T00:05:49.8051653Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:05:49.8052644Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2024-12-18T00:05:49.8053792Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 30s local 2024-12-18T00:05:49.8055008Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2024-12-18T00:05:49.8056141Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 29s local 2024-12-18T00:05:49.8057320Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:05:49.8058189Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:05:49.8059271Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 12s local ... 2024-12-18T00:05:50.1901604Z 2024-12-18T00:05:50.1903669Z  2024-12-18T00:05:50.1904227Z  2024-12-18T00:05:50.1904724Z  2024-12-18T00:05:50.1905099Z  2024-12-18T00:05:50.1905473Z  2024-12-18T00:05:50.1905847Z  2024-12-18T00:05:50.1906218Z  2024-12-18T00:05:50.1906596Z  2024-12-18T00:05:50.1907154Z [10,974 / 15,187] 48 actions running 2024-12-18T00:05:50.1907888Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:05:50.1908815Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2024-12-18T00:05:50.1909983Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2024-12-18T00:05:50.1911123Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 29s local 2024-12-18T00:05:50.1912048Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:05:50.1912862Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:05:50.1913853Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local 2024-12-18T00:05:50.1914901Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 11s local ... 2024-12-18T00:05:50.3946980Z 2024-12-18T00:05:50.3948039Z  2024-12-18T00:05:50.3948571Z  2024-12-18T00:05:50.3949007Z  2024-12-18T00:05:50.3949459Z  2024-12-18T00:05:50.3949909Z  2024-12-18T00:05:50.3950344Z  2024-12-18T00:05:50.3950718Z  2024-12-18T00:05:50.3951087Z  2024-12-18T00:05:50.3951669Z [10,977 / 15,187] 48 actions, 47 running 2024-12-18T00:05:50.3952413Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:05:50.3953324Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T00:05:50.3954503Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2024-12-18T00:05:50.3955502Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:05:50.3956379Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:05:50.3957374Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local 2024-12-18T00:05:50.3958461Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 11s local 2024-12-18T00:05:50.3959444Z Compiling llvm/lib/Transforms/IPO/FunctionImport.cpp; 11s local ... 2024-12-18T00:05:50.6002213Z 2024-12-18T00:05:50.6003205Z  2024-12-18T00:05:50.6004622Z  2024-12-18T00:05:50.6005902Z  2024-12-18T00:05:50.6007220Z  2024-12-18T00:05:50.6008528Z  2024-12-18T00:05:50.6009835Z  2024-12-18T00:05:50.6011104Z  2024-12-18T00:05:50.6012421Z  2024-12-18T00:05:50.6013893Z [10,979 / 15,187] 48 actions, 47 running 2024-12-18T00:05:50.6015186Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:05:50.6016218Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T00:05:50.6017364Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2024-12-18T00:05:50.6018257Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:05:50.6019256Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:05:50.6020123Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local 2024-12-18T00:05:50.6020990Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 12s local 2024-12-18T00:05:50.9909734Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 10s local ... 2024-12-18T00:05:50.9910499Z 2024-12-18T00:05:50.9910978Z  2024-12-18T00:05:50.9911325Z  2024-12-18T00:05:50.9911665Z  2024-12-18T00:05:50.9911998Z  2024-12-18T00:05:50.9912316Z  2024-12-18T00:05:50.9912685Z  2024-12-18T00:05:50.9913007Z  2024-12-18T00:05:50.9913333Z  2024-12-18T00:05:50.9913798Z [10,980 / 15,187] 48 actions running 2024-12-18T00:05:50.9914419Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:05:50.9915218Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T00:05:50.9916216Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2024-12-18T00:05:50.9917063Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2024-12-18T00:05:50.9917774Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local 2024-12-18T00:05:50.9918614Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local 2024-12-18T00:05:50.9919513Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 12s local 2024-12-18T00:05:50.9920495Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 10s local ... 2024-12-18T00:05:51.1913886Z 2024-12-18T00:05:51.1914851Z  2024-12-18T00:05:51.1915430Z  2024-12-18T00:05:51.1915853Z  2024-12-18T00:05:51.1916291Z  2024-12-18T00:05:51.1916680Z  2024-12-18T00:05:51.1917073Z  2024-12-18T00:05:51.1917455Z  2024-12-18T00:05:51.1917832Z  2024-12-18T00:05:51.1918414Z [10,983 / 15,187] 48 actions running 2024-12-18T00:05:51.1919351Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:05:51.1920353Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T00:05:51.1921581Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2024-12-18T00:05:51.1922717Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2024-12-18T00:05:51.1923687Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local 2024-12-18T00:05:51.1924846Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local 2024-12-18T00:05:51.1926079Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 12s local 2024-12-18T00:05:51.1927101Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 11s local ... 2024-12-18T00:05:51.5501492Z 2024-12-18T00:05:51.5502483Z  2024-12-18T00:05:51.5502967Z  2024-12-18T00:05:51.5503329Z  2024-12-18T00:05:51.5503687Z  2024-12-18T00:05:51.5504026Z  2024-12-18T00:05:51.5504364Z  2024-12-18T00:05:51.5504689Z  2024-12-18T00:05:51.5505019Z  2024-12-18T00:05:51.5505548Z [10,985 / 15,187] 48 actions, 47 running 2024-12-18T00:05:51.5506203Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:05:51.5506991Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:05:51.5507936Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2024-12-18T00:05:51.5508866Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local 2024-12-18T00:05:51.5509708Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local 2024-12-18T00:05:51.5510601Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 12s local 2024-12-18T00:05:51.5511730Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 11s local 2024-12-18T00:05:51.5512548Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 10s local ... 2024-12-18T00:05:51.7920359Z 2024-12-18T00:05:51.7921755Z  2024-12-18T00:05:51.7922167Z  2024-12-18T00:05:51.7923899Z  2024-12-18T00:05:51.7924425Z  2024-12-18T00:05:51.7925342Z  2024-12-18T00:05:51.7925726Z  2024-12-18T00:05:51.7927474Z  2024-12-18T00:05:51.7927854Z  2024-12-18T00:05:51.7929813Z [10,988 / 15,187] 48 actions running 2024-12-18T00:05:51.7930535Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:05:51.7931409Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:05:51.7932449Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2024-12-18T00:05:51.7933403Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local 2024-12-18T00:05:51.7934314Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local 2024-12-18T00:05:51.7935234Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 13s local 2024-12-18T00:05:51.7936055Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 11s local 2024-12-18T00:05:51.7937083Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 11s local ... 2024-12-18T00:05:51.9925656Z 2024-12-18T00:05:51.9926658Z  2024-12-18T00:05:51.9927156Z  2024-12-18T00:05:51.9929028Z  2024-12-18T00:05:51.9929444Z  2024-12-18T00:05:51.9931232Z  2024-12-18T00:05:51.9931645Z  2024-12-18T00:05:51.9933478Z  2024-12-18T00:05:51.9933880Z  2024-12-18T00:05:51.9935982Z [10,992 / 15,187] 47 actions running 2024-12-18T00:05:51.9936876Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:05:51.9937787Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:05:51.9938951Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2024-12-18T00:05:51.9939997Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local 2024-12-18T00:05:51.9940986Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2024-12-18T00:05:51.9941985Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 11s local 2024-12-18T00:05:51.9942955Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 11s local 2024-12-18T00:05:51.9943759Z @llvm-project//llvm:IPO; 11s local ... 2024-12-18T00:05:52.2401337Z 2024-12-18T00:05:52.2402571Z  2024-12-18T00:05:52.2403074Z  2024-12-18T00:05:52.2403476Z  2024-12-18T00:05:52.2403848Z  2024-12-18T00:05:52.2404219Z  2024-12-18T00:05:52.2404598Z  2024-12-18T00:05:52.2404988Z  2024-12-18T00:05:52.5205126Z  2024-12-18T00:05:52.5205856Z [10,994 / 15,187] 48 actions, 47 running 2024-12-18T00:05:52.5206684Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:05:52.5207738Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:05:52.5208956Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2024-12-18T00:05:52.5210046Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local 2024-12-18T00:05:52.5210980Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2024-12-18T00:05:52.5211955Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 12s local 2024-12-18T00:05:52.5212860Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 11s local 2024-12-18T00:05:52.5213700Z @llvm-project//llvm:IPO; 11s local ... 2024-12-18T00:05:52.5214089Z 2024-12-18T00:05:52.5214402Z  2024-12-18T00:05:52.5214782Z  2024-12-18T00:05:52.5215170Z  2024-12-18T00:05:52.5215555Z  2024-12-18T00:05:52.5215922Z  2024-12-18T00:05:52.5216288Z  2024-12-18T00:05:52.5216858Z  2024-12-18T00:05:52.5217241Z  2024-12-18T00:05:52.5218309Z [10,995 / 15,187] 48 actions, 47 running 2024-12-18T00:05:52.5219043Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:05:52.5219925Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2024-12-18T00:05:52.5221024Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2024-12-18T00:05:52.5222352Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local 2024-12-18T00:05:52.5223358Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2024-12-18T00:05:52.5224344Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 12s local 2024-12-18T00:05:52.5225389Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 11s local 2024-12-18T00:05:52.5226211Z @llvm-project//llvm:IPO; 11s local ... 2024-12-18T00:05:52.7933725Z 2024-12-18T00:05:52.7934648Z  2024-12-18T00:05:52.7935801Z  2024-12-18T00:05:52.7937598Z  2024-12-18T00:05:52.7939110Z  2024-12-18T00:05:52.7940646Z  2024-12-18T00:05:52.7942095Z  2024-12-18T00:05:52.7943587Z  2024-12-18T00:05:52.7945353Z  2024-12-18T00:05:52.7947024Z [10,996 / 15,187] 48 actions running 2024-12-18T00:05:52.7948905Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:05:52.7951032Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2024-12-18T00:05:52.7952837Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2024-12-18T00:05:52.7954383Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:05:52.7955593Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2024-12-18T00:05:52.7956821Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 12s local 2024-12-18T00:05:52.7957973Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 12s local 2024-12-18T00:05:52.7959024Z @llvm-project//llvm:IPO; 12s local ... 2024-12-18T00:05:53.0376357Z 2024-12-18T00:05:53.0377679Z  2024-12-18T00:05:53.0378156Z  2024-12-18T00:05:53.0378516Z  2024-12-18T00:05:53.0378853Z  2024-12-18T00:05:53.0379220Z  2024-12-18T00:05:53.0379578Z  2024-12-18T00:05:53.0379937Z  2024-12-18T00:05:53.0380289Z  2024-12-18T00:05:53.0380824Z [10,997 / 15,187] 48 actions, 47 running 2024-12-18T00:05:53.0381548Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:05:53.0382480Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2024-12-18T00:05:53.0383506Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2024-12-18T00:05:53.0384453Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:05:53.0385378Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local 2024-12-18T00:05:53.0386321Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 12s local 2024-12-18T00:05:53.0387249Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 12s local 2024-12-18T00:05:53.0388156Z @llvm-project//llvm:IPO; 12s local ... 2024-12-18T00:05:53.3735803Z 2024-12-18T00:05:53.3737204Z  2024-12-18T00:05:53.3737636Z  2024-12-18T00:05:53.3737983Z  2024-12-18T00:05:53.3738328Z  2024-12-18T00:05:53.3738661Z  2024-12-18T00:05:53.3739021Z  2024-12-18T00:05:53.3739382Z  2024-12-18T00:05:53.3739727Z  2024-12-18T00:05:53.3740311Z [10,998 / 15,187] 48 actions, 47 running 2024-12-18T00:05:53.3741000Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:05:53.3741827Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T00:05:53.3742832Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2024-12-18T00:05:53.3743744Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:05:53.3744875Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local 2024-12-18T00:05:53.3745752Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 13s local 2024-12-18T00:05:53.3746907Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 12s local 2024-12-18T00:05:53.3747621Z @llvm-project//llvm:IPO; 12s local ... 2024-12-18T00:05:53.5941563Z 2024-12-18T00:05:53.5942393Z  2024-12-18T00:05:53.5942780Z  2024-12-18T00:05:53.5943112Z  2024-12-18T00:05:53.5943435Z  2024-12-18T00:05:53.5943752Z  2024-12-18T00:05:53.5944721Z  2024-12-18T00:05:53.5945089Z  2024-12-18T00:05:53.5945425Z  2024-12-18T00:05:53.5945903Z [10,998 / 15,187] 48 actions running 2024-12-18T00:05:53.5946539Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:05:53.5947635Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T00:05:53.5948534Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2024-12-18T00:05:53.5949535Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:05:53.5950462Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local 2024-12-18T00:05:53.5951379Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 13s local 2024-12-18T00:05:53.5952248Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local 2024-12-18T00:05:53.5953005Z @llvm-project//llvm:IPO; 12s local ... 2024-12-18T00:05:53.9947977Z 2024-12-18T00:05:53.9948934Z  2024-12-18T00:05:53.9949503Z  2024-12-18T00:05:53.9949916Z  2024-12-18T00:05:53.9950279Z  2024-12-18T00:05:53.9950663Z  2024-12-18T00:05:53.9951052Z  2024-12-18T00:05:53.9951435Z  2024-12-18T00:05:53.9951816Z  2024-12-18T00:05:53.9952368Z [11,000 / 15,187] 48 actions running 2024-12-18T00:05:53.9953131Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:05:53.9954066Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T00:05:53.9955206Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:05:53.9956311Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:05:53.9957292Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2024-12-18T00:05:53.9958296Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 13s local 2024-12-18T00:05:53.9959258Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local 2024-12-18T00:05:53.9960110Z @llvm-project//llvm:IPO; 13s local ... 2024-12-18T00:05:54.1952014Z 2024-12-18T00:05:54.1952893Z  2024-12-18T00:05:54.1953365Z  2024-12-18T00:05:54.1953745Z  2024-12-18T00:05:54.1954094Z  2024-12-18T00:05:54.1954426Z  2024-12-18T00:05:54.1954778Z  2024-12-18T00:05:54.1955139Z  2024-12-18T00:05:54.1955500Z  2024-12-18T00:05:54.1956003Z [11,002 / 15,187] 48 actions running 2024-12-18T00:05:54.1956735Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:05:54.1957605Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T00:05:54.1958758Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:05:54.1959799Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:05:54.1960812Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2024-12-18T00:05:54.1961890Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local 2024-12-18T00:05:54.1962726Z @llvm-project//llvm:IPO; 13s local 2024-12-18T00:05:54.1963483Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 13s local ... 2024-12-18T00:05:54.3966195Z 2024-12-18T00:05:54.3967074Z  2024-12-18T00:05:54.3967546Z  2024-12-18T00:05:54.3967935Z  2024-12-18T00:05:54.3968301Z  2024-12-18T00:05:54.3968672Z  2024-12-18T00:05:54.3969034Z  2024-12-18T00:05:54.3969425Z  2024-12-18T00:05:54.3969812Z  2024-12-18T00:05:54.3970382Z [11,004 / 15,187] 48 actions, 47 running 2024-12-18T00:05:54.3971570Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:05:54.3972536Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:05:54.3973667Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:05:54.3974774Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:05:54.3976150Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2024-12-18T00:05:54.3977421Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local 2024-12-18T00:05:54.3978180Z @llvm-project//llvm:IPO; 13s local 2024-12-18T00:05:54.3978910Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 13s local ... 2024-12-18T00:05:54.7805926Z 2024-12-18T00:05:54.7806797Z  2024-12-18T00:05:54.7807278Z  2024-12-18T00:05:54.7807654Z  2024-12-18T00:05:54.7808025Z  2024-12-18T00:05:54.7819713Z  2024-12-18T00:05:54.7820158Z  2024-12-18T00:05:54.7820602Z  2024-12-18T00:05:54.7820992Z  2024-12-18T00:05:54.7821574Z [11,005 / 15,187] 48 actions, 47 running 2024-12-18T00:05:54.7822347Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:05:54.7823279Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:05:54.7824459Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2024-12-18T00:05:54.7825594Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:05:54.7826634Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2024-12-18T00:05:54.7827699Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 14s local 2024-12-18T00:05:54.7828503Z @llvm-project//llvm:IPO; 14s local 2024-12-18T00:05:54.7829260Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 13s local ... 2024-12-18T00:05:54.9957951Z 2024-12-18T00:05:54.9958811Z  2024-12-18T00:05:54.9959431Z  2024-12-18T00:05:54.9959922Z  2024-12-18T00:05:54.9960323Z  2024-12-18T00:05:54.9960682Z  2024-12-18T00:05:54.9961063Z  2024-12-18T00:05:54.9961448Z  2024-12-18T00:05:54.9961831Z  2024-12-18T00:05:54.9962379Z [11,005 / 15,187] 48 actions running 2024-12-18T00:05:54.9963160Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2024-12-18T00:05:54.9964129Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:05:54.9965266Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2024-12-18T00:05:54.9966346Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:05:54.9967352Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2024-12-18T00:05:54.9968388Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 14s local 2024-12-18T00:05:54.9969208Z @llvm-project//llvm:IPO; 14s local 2024-12-18T00:05:54.9970101Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 13s local ... 2024-12-18T00:05:55.1962194Z 2024-12-18T00:05:55.1963612Z  2024-12-18T00:05:55.1964088Z  2024-12-18T00:05:55.1964490Z  2024-12-18T00:05:55.1964863Z  2024-12-18T00:05:55.1965257Z  2024-12-18T00:05:55.1965648Z  2024-12-18T00:05:55.1966029Z  2024-12-18T00:05:55.1966400Z  2024-12-18T00:05:55.1966959Z [11,006 / 15,187] 48 actions running 2024-12-18T00:05:55.1967772Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2024-12-18T00:05:55.1968762Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:05:55.1969889Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2024-12-18T00:05:55.1970869Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:05:55.1971717Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2024-12-18T00:05:55.1972577Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 14s local 2024-12-18T00:05:55.1973693Z @llvm-project//llvm:IPO; 14s local 2024-12-18T00:05:55.1974398Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local ... 2024-12-18T00:05:55.5834727Z 2024-12-18T00:05:55.5835597Z  2024-12-18T00:05:55.5836027Z  2024-12-18T00:05:55.5836389Z  2024-12-18T00:05:55.5836752Z  2024-12-18T00:05:55.5837085Z  2024-12-18T00:05:55.5837408Z  2024-12-18T00:05:55.5838056Z  2024-12-18T00:05:55.5838385Z  2024-12-18T00:05:55.5838874Z [11,009 / 15,187] 48 actions, 47 running 2024-12-18T00:05:55.5839524Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2024-12-18T00:05:55.5840306Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T00:05:55.5841328Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2024-12-18T00:05:55.5842303Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:05:55.5843236Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2024-12-18T00:05:55.5844620Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2024-12-18T00:05:55.5845430Z @llvm-project//llvm:IPO; 14s local 2024-12-18T00:05:55.5846224Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local ... 2024-12-18T00:05:55.7968326Z 2024-12-18T00:05:55.7969180Z  2024-12-18T00:05:55.7969571Z  2024-12-18T00:05:55.7969891Z  2024-12-18T00:05:55.7970286Z  2024-12-18T00:05:55.7970607Z  2024-12-18T00:05:55.7970928Z  2024-12-18T00:05:55.7971249Z  2024-12-18T00:05:55.7971548Z  2024-12-18T00:05:55.7972015Z [11,012 / 15,187] 48 actions running 2024-12-18T00:05:55.7972635Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2024-12-18T00:05:55.7973390Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T00:05:55.7974182Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:05:55.7974982Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2024-12-18T00:05:55.7976368Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2024-12-18T00:05:55.7977156Z @llvm-project//llvm:IPO; 15s local 2024-12-18T00:05:55.7977814Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local 2024-12-18T00:05:55.7978688Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local ... 2024-12-18T00:05:56.0837307Z 2024-12-18T00:05:56.0838244Z  2024-12-18T00:05:56.0838680Z  2024-12-18T00:05:56.0839075Z  2024-12-18T00:05:56.0839458Z  2024-12-18T00:05:56.0839841Z  2024-12-18T00:05:56.0840215Z  2024-12-18T00:05:56.0840592Z  2024-12-18T00:05:56.0840988Z  2024-12-18T00:05:56.0841604Z [11,013 / 15,187] 48 actions, 47 running 2024-12-18T00:05:56.0842519Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T00:05:56.0843551Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:05:56.0844726Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2024-12-18T00:05:56.0845712Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2024-12-18T00:05:56.0846450Z @llvm-project//llvm:IPO; 15s local 2024-12-18T00:05:56.0847189Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local 2024-12-18T00:05:56.0848204Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local 2024-12-18T00:05:56.0849275Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local ... 2024-12-18T00:05:56.3975855Z 2024-12-18T00:05:56.3976923Z  2024-12-18T00:05:56.3977683Z  2024-12-18T00:05:56.3978150Z  2024-12-18T00:05:56.3978603Z  2024-12-18T00:05:56.3979093Z  2024-12-18T00:05:56.3979513Z  2024-12-18T00:05:56.3979927Z  2024-12-18T00:05:56.3980392Z  2024-12-18T00:05:56.3981023Z [11,015 / 15,187] 48 actions running 2024-12-18T00:05:56.3981964Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T00:05:56.3983394Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:05:56.3984454Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2024-12-18T00:05:56.3985545Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2024-12-18T00:05:56.3986363Z @llvm-project//llvm:IPO; 15s local 2024-12-18T00:05:56.3987407Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 15s local 2024-12-18T00:05:56.3988436Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local 2024-12-18T00:05:56.3989768Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local ... 2024-12-18T00:05:56.7427737Z 2024-12-18T00:05:56.7428560Z  2024-12-18T00:05:56.7429047Z  2024-12-18T00:05:56.7429592Z  2024-12-18T00:05:56.7429971Z  2024-12-18T00:05:56.7430373Z  2024-12-18T00:05:56.7430786Z  2024-12-18T00:05:56.7431189Z  2024-12-18T00:05:56.7431583Z  2024-12-18T00:05:56.7432233Z [11,017 / 15,187] 48 actions, 47 running 2024-12-18T00:05:56.7433156Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T00:05:56.7434143Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:05:56.7435179Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2024-12-18T00:05:56.7436302Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2024-12-18T00:05:56.7437143Z @llvm-project//llvm:IPO; 16s local 2024-12-18T00:05:56.7437902Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 15s local 2024-12-18T00:05:56.7438878Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local 2024-12-18T00:05:56.7439987Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local ... 2024-12-18T00:05:56.9983424Z 2024-12-18T00:05:56.9984339Z  2024-12-18T00:05:56.9985434Z  2024-12-18T00:05:56.9986943Z  2024-12-18T00:05:56.9988363Z  2024-12-18T00:05:56.9989959Z  2024-12-18T00:05:56.9991385Z  2024-12-18T00:05:56.9992794Z  2024-12-18T00:05:56.9994185Z  2024-12-18T00:05:56.9995672Z [11,017 / 15,187] 48 actions running 2024-12-18T00:05:56.9996777Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T00:05:56.9998009Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:05:56.9999309Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:05:57.0000625Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2024-12-18T00:05:57.0001666Z @llvm-project//llvm:IPO; 16s local 2024-12-18T00:05:57.0003022Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 15s local 2024-12-18T00:05:57.0004058Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local 2024-12-18T00:05:57.0005214Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local ... 2024-12-18T00:05:57.2805203Z 2024-12-18T00:05:57.2806464Z  2024-12-18T00:05:57.2806963Z  2024-12-18T00:05:57.2807380Z  2024-12-18T00:05:57.2807776Z  2024-12-18T00:05:57.2808193Z  2024-12-18T00:05:57.2808587Z  2024-12-18T00:05:57.2808981Z  2024-12-18T00:05:57.2809376Z  2024-12-18T00:05:57.2809972Z [11,019 / 15,187] 48 actions, 47 running 2024-12-18T00:05:57.2810962Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T00:05:57.2812006Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:05:57.2813085Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:05:57.2814210Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2024-12-18T00:05:57.2815069Z @llvm-project//llvm:IPO; 16s local 2024-12-18T00:05:57.2815846Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2024-12-18T00:05:57.2817229Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local 2024-12-18T00:05:57.2818726Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:05:57.5090034Z 2024-12-18T00:05:57.5090940Z  2024-12-18T00:05:57.5091433Z  2024-12-18T00:05:57.5091822Z  2024-12-18T00:05:57.5092223Z  2024-12-18T00:05:57.5092632Z  2024-12-18T00:05:57.5093031Z  2024-12-18T00:05:57.5093416Z  2024-12-18T00:05:57.5093857Z  2024-12-18T00:05:57.5094810Z [11,021 / 15,187] 47 actions, 46 running 2024-12-18T00:05:57.5095719Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T00:05:57.5096899Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:05:57.5097926Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:05:57.5099029Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2024-12-18T00:05:57.5099893Z @llvm-project//llvm:IPO; 16s local 2024-12-18T00:05:57.5100834Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2024-12-18T00:05:57.5101853Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local 2024-12-18T00:05:57.5102906Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:05:57.7989958Z 2024-12-18T00:05:57.7991214Z  2024-12-18T00:05:57.7991682Z  2024-12-18T00:05:57.7992041Z  2024-12-18T00:05:57.7992437Z  2024-12-18T00:05:57.7992879Z  2024-12-18T00:05:57.7993267Z  2024-12-18T00:05:57.7993670Z  2024-12-18T00:05:57.7994079Z  2024-12-18T00:05:57.7994642Z [11,022 / 15,187] 48 actions running 2024-12-18T00:05:57.7995520Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T00:05:57.7996466Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:05:57.7997518Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:05:57.7998551Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2024-12-18T00:05:57.7999400Z @llvm-project//llvm:IPO; 17s local 2024-12-18T00:05:57.8000157Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2024-12-18T00:05:57.8001111Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local 2024-12-18T00:05:57.8002357Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:05:57.9994405Z 2024-12-18T00:05:57.9995321Z  2024-12-18T00:05:57.9995804Z  2024-12-18T00:05:57.9996196Z  2024-12-18T00:05:57.9996578Z  2024-12-18T00:05:57.9996937Z  2024-12-18T00:05:57.9997318Z  2024-12-18T00:05:57.9997677Z  2024-12-18T00:05:57.9998051Z  2024-12-18T00:05:57.9998622Z [11,024 / 15,187] 48 actions running 2024-12-18T00:05:57.9999465Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T00:05:58.0000455Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:05:58.0001457Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:05:58.0002534Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2024-12-18T00:05:58.0003295Z @llvm-project//llvm:IPO; 17s local 2024-12-18T00:05:58.0004000Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2024-12-18T00:05:58.0004961Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local 2024-12-18T00:05:58.0006031Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:05:58.3490069Z 2024-12-18T00:05:58.3490962Z  2024-12-18T00:05:58.3491674Z  2024-12-18T00:05:58.3492063Z  2024-12-18T00:05:58.3492496Z  2024-12-18T00:05:58.3492951Z  2024-12-18T00:05:58.3493381Z  2024-12-18T00:05:58.3493820Z  2024-12-18T00:05:58.3494206Z  2024-12-18T00:05:58.3494760Z [11,028 / 15,187] 48 actions, 47 running 2024-12-18T00:05:58.3495613Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:05:58.3497135Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:05:58.3498612Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:05:58.3499638Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2024-12-18T00:05:58.3500711Z @llvm-project//llvm:IPO; 17s local 2024-12-18T00:05:58.3501872Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2024-12-18T00:05:58.3503090Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local 2024-12-18T00:05:58.3504289Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local ... 2024-12-18T00:05:58.6002262Z 2024-12-18T00:05:58.6003140Z  2024-12-18T00:05:58.6005612Z  2024-12-18T00:05:58.6008691Z  2024-12-18T00:05:58.6011766Z  2024-12-18T00:05:58.6014826Z  2024-12-18T00:05:58.6017959Z  2024-12-18T00:05:58.6021125Z  2024-12-18T00:05:58.6024059Z  2024-12-18T00:05:58.6027202Z [11,028 / 15,187] 48 actions running 2024-12-18T00:05:58.6030619Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:05:58.6034067Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:05:58.6037619Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:05:58.6041236Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2024-12-18T00:05:58.6044720Z @llvm-project//llvm:IPO; 17s local 2024-12-18T00:05:58.6047744Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2024-12-18T00:05:58.6050958Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:05:58.6054167Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local ... 2024-12-18T00:05:59.0006742Z 2024-12-18T00:05:59.0010082Z  2024-12-18T00:05:59.0010979Z  2024-12-18T00:05:59.0012190Z  2024-12-18T00:05:59.0012658Z  2024-12-18T00:05:59.0013072Z  2024-12-18T00:05:59.0013506Z  2024-12-18T00:05:59.0013930Z  2024-12-18T00:05:59.0014368Z  2024-12-18T00:05:59.0015000Z [11,031 / 15,187] 48 actions running 2024-12-18T00:05:59.0015943Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:05:59.0017288Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 22s local 2024-12-18T00:05:59.0018479Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:05:59.0019526Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2024-12-18T00:05:59.0020347Z @llvm-project//llvm:IPO; 18s local 2024-12-18T00:05:59.0021148Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2024-12-18T00:05:59.0022266Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:05:59.0023377Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local ... 2024-12-18T00:05:59.2011315Z 2024-12-18T00:05:59.2012126Z  2024-12-18T00:05:59.2012560Z  2024-12-18T00:05:59.2012981Z  2024-12-18T00:05:59.2013573Z  2024-12-18T00:05:59.2014043Z  2024-12-18T00:05:59.2014520Z  2024-12-18T00:05:59.2014979Z  2024-12-18T00:05:59.2015446Z  2024-12-18T00:05:59.2016087Z [11,033 / 15,187] 48 actions running 2024-12-18T00:05:59.2017209Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:05:59.2018252Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 22s local 2024-12-18T00:05:59.2019437Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:05:59.2020553Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2024-12-18T00:05:59.2021433Z @llvm-project//llvm:IPO; 18s local 2024-12-18T00:05:59.2022185Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2024-12-18T00:05:59.2023077Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:05:59.2024146Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local ... 2024-12-18T00:05:59.4514320Z 2024-12-18T00:05:59.4515178Z  2024-12-18T00:05:59.4515642Z  2024-12-18T00:05:59.4516046Z  2024-12-18T00:05:59.4516438Z  2024-12-18T00:05:59.4516818Z  2024-12-18T00:05:59.4517170Z  2024-12-18T00:05:59.4517538Z  2024-12-18T00:05:59.4517937Z  2024-12-18T00:05:59.4518817Z [11,036 / 15,187] 48 actions, 47 running 2024-12-18T00:05:59.4520239Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T00:05:59.4521275Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:05:59.4522930Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2024-12-18T00:05:59.4524093Z @llvm-project//llvm:IPO; 18s local 2024-12-18T00:05:59.4525577Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2024-12-18T00:05:59.4526527Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:05:59.4527567Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:05:59.4528533Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:05:59.6575811Z 2024-12-18T00:05:59.6576902Z  2024-12-18T00:05:59.6577357Z  2024-12-18T00:05:59.6577744Z  2024-12-18T00:05:59.6578119Z  2024-12-18T00:05:59.6578491Z  2024-12-18T00:05:59.6578893Z  2024-12-18T00:05:59.6579322Z  2024-12-18T00:05:59.6579721Z  2024-12-18T00:05:59.6580296Z [11,037 / 15,187] 48 actions, 47 running 2024-12-18T00:05:59.6581128Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T00:05:59.6582593Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:05:59.6583780Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local 2024-12-18T00:05:59.6584721Z @llvm-project//llvm:IPO; 18s local 2024-12-18T00:05:59.6585552Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2024-12-18T00:05:59.6586620Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:05:59.6587731Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:05:59.6588762Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:05:59.8605552Z 2024-12-18T00:05:59.8606492Z  2024-12-18T00:05:59.8606955Z  2024-12-18T00:05:59.8607376Z  2024-12-18T00:05:59.8607761Z  2024-12-18T00:05:59.8608137Z  2024-12-18T00:05:59.8608518Z  2024-12-18T00:05:59.8608895Z  2024-12-18T00:05:59.8609268Z  2024-12-18T00:05:59.8609863Z [11,040 / 15,187] 48 actions, 47 running 2024-12-18T00:05:59.8610717Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T00:05:59.8611791Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:05:59.8612781Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local 2024-12-18T00:05:59.8613591Z @llvm-project//llvm:IPO; 19s local 2024-12-18T00:05:59.8614318Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2024-12-18T00:05:59.8615255Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:05:59.8616250Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:05:59.8617286Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:06:00.1211667Z 2024-12-18T00:06:00.1212625Z  2024-12-18T00:06:00.1213113Z  2024-12-18T00:06:00.1213503Z  2024-12-18T00:06:00.1213887Z  2024-12-18T00:06:00.1214268Z  2024-12-18T00:06:00.1214646Z  2024-12-18T00:06:00.1215047Z  2024-12-18T00:06:00.1215430Z  2024-12-18T00:06:00.1216030Z [11,041 / 15,187] 48 actions, 47 running 2024-12-18T00:06:00.1217000Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T00:06:00.1218020Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:06:00.1219324Z @llvm-project//llvm:IPO; 19s local 2024-12-18T00:06:00.1220059Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2024-12-18T00:06:00.1220999Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:06:00.1221975Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:06:00.1223024Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:06:00.1224197Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:06:00.4021962Z 2024-12-18T00:06:00.4023021Z  2024-12-18T00:06:00.4023480Z  2024-12-18T00:06:00.4023881Z  2024-12-18T00:06:00.4024257Z  2024-12-18T00:06:00.4024625Z  2024-12-18T00:06:00.4025010Z  2024-12-18T00:06:00.4025395Z  2024-12-18T00:06:00.4025789Z  2024-12-18T00:06:00.4026379Z [11,041 / 15,187] 48 actions running 2024-12-18T00:06:00.4027232Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T00:06:00.4028336Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:06:00.4029341Z @llvm-project//llvm:IPO; 19s local 2024-12-18T00:06:00.4030239Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2024-12-18T00:06:00.4031242Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:06:00.4032253Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:06:00.4033099Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:06:00.4033861Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:06:00.6664691Z 2024-12-18T00:06:00.6665673Z  2024-12-18T00:06:00.6666133Z  2024-12-18T00:06:00.6668080Z  2024-12-18T00:06:00.6671160Z  2024-12-18T00:06:00.6674268Z  2024-12-18T00:06:00.6677368Z  2024-12-18T00:06:00.6680460Z  2024-12-18T00:06:00.6683510Z  2024-12-18T00:06:00.6686822Z [11,044 / 15,187] 48 actions, 47 running 2024-12-18T00:06:00.6690139Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T00:06:00.6693755Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:06:00.6697481Z @llvm-project//llvm:IPO; 19s local 2024-12-18T00:06:00.6700770Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2024-12-18T00:06:00.6704234Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 19s local 2024-12-18T00:06:00.6707936Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:06:00.6711240Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:06:00.6714518Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:06:01.0029316Z 2024-12-18T00:06:01.0030618Z  2024-12-18T00:06:01.0031376Z  2024-12-18T00:06:01.0032514Z  2024-12-18T00:06:01.0032983Z  2024-12-18T00:06:01.0033373Z  2024-12-18T00:06:01.0033763Z  2024-12-18T00:06:01.0034197Z  2024-12-18T00:06:01.0034547Z  2024-12-18T00:06:01.0035091Z [11,045 / 15,187] 48 actions running 2024-12-18T00:06:01.0035924Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T00:06:01.0036993Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:06:01.0037815Z @llvm-project//llvm:IPO; 20s local 2024-12-18T00:06:01.0038537Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2024-12-18T00:06:01.0039435Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 19s local 2024-12-18T00:06:01.0040396Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:06:01.0041269Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:06:01.0041985Z @llvm-project//llvm:Instrumentation; 13s local ... 2024-12-18T00:06:01.2033406Z 2024-12-18T00:06:01.2034783Z  2024-12-18T00:06:01.2035282Z  2024-12-18T00:06:01.2035652Z  2024-12-18T00:06:01.2036432Z  2024-12-18T00:06:01.2036812Z  2024-12-18T00:06:01.2037330Z  2024-12-18T00:06:01.2037768Z  2024-12-18T00:06:01.2038158Z  2024-12-18T00:06:01.2038679Z [11,046 / 15,187] 48 actions running 2024-12-18T00:06:01.2039586Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T00:06:01.2040960Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:06:01.2041804Z @llvm-project//llvm:IPO; 20s local 2024-12-18T00:06:01.2042498Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:06:01.2043425Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 19s local 2024-12-18T00:06:01.2044750Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:06:01.2045663Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:06:01.2046354Z @llvm-project//llvm:Instrumentation; 13s local ... 2024-12-18T00:06:01.4257327Z 2024-12-18T00:06:01.4258338Z  2024-12-18T00:06:01.4258853Z  2024-12-18T00:06:01.4259265Z  2024-12-18T00:06:01.4259706Z  2024-12-18T00:06:01.4260124Z  2024-12-18T00:06:01.4260543Z  2024-12-18T00:06:01.4260940Z  2024-12-18T00:06:01.4261346Z  2024-12-18T00:06:01.4261939Z [11,049 / 15,187] 48 actions, 47 running 2024-12-18T00:06:01.4262951Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:06:01.4263936Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:06:01.4264670Z @llvm-project//llvm:IPO; 20s local 2024-12-18T00:06:01.4265304Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:06:01.4266289Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:06:01.4267355Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:06:01.4268277Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:06:01.4268974Z @llvm-project//llvm:Vectorize; 9s local ... 2024-12-18T00:06:01.7962911Z 2024-12-18T00:06:01.7963793Z  2024-12-18T00:06:01.7964274Z  2024-12-18T00:06:01.7964637Z  2024-12-18T00:06:01.7965016Z  2024-12-18T00:06:01.7965398Z  2024-12-18T00:06:01.7965776Z  2024-12-18T00:06:01.7966167Z  2024-12-18T00:06:01.7966929Z  2024-12-18T00:06:01.7967725Z [11,052 / 15,187] 48 actions, 47 running 2024-12-18T00:06:01.7968644Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:06:01.7970126Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:06:01.7971200Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:06:01.7971986Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:06:01.7973060Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:06:01.7974162Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:06:01.7975234Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:06:01.7976205Z @llvm-project//llvm:Vectorize; 9s local ... 2024-12-18T00:06:02.0041153Z 2024-12-18T00:06:02.0042071Z  2024-12-18T00:06:02.0042541Z  2024-12-18T00:06:02.0042929Z  2024-12-18T00:06:02.0043299Z  2024-12-18T00:06:02.0043677Z  2024-12-18T00:06:02.0044044Z  2024-12-18T00:06:02.0044654Z  2024-12-18T00:06:02.0045045Z  2024-12-18T00:06:02.0045561Z [11,054 / 15,187] 48 actions running 2024-12-18T00:06:02.0046360Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:06:02.0047375Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:06:02.0048197Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:06:02.0048884Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:06:02.0049749Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:06:02.0051129Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:06:02.0052007Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:06:02.0052638Z @llvm-project//llvm:Vectorize; 10s local ... 2024-12-18T00:06:02.2273180Z 2024-12-18T00:06:02.2274121Z  2024-12-18T00:06:02.2275764Z  2024-12-18T00:06:02.2276406Z  2024-12-18T00:06:02.2277534Z  2024-12-18T00:06:02.2278015Z  2024-12-18T00:06:02.2278409Z  2024-12-18T00:06:02.2278836Z  2024-12-18T00:06:02.2279234Z  2024-12-18T00:06:02.2279805Z [11,058 / 15,187] 48 actions, 47 running 2024-12-18T00:06:02.2280665Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:06:02.2281880Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:06:02.2282678Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:06:02.2283385Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2024-12-18T00:06:02.2284279Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:06:02.2285259Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:06:02.2286122Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:06:02.2286987Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local ... 2024-12-18T00:06:02.4604535Z 2024-12-18T00:06:02.4605582Z  2024-12-18T00:06:02.4606053Z  2024-12-18T00:06:02.4606424Z  2024-12-18T00:06:02.4606791Z  2024-12-18T00:06:02.4607177Z  2024-12-18T00:06:02.4607566Z  2024-12-18T00:06:02.4607943Z  2024-12-18T00:06:02.4608334Z  2024-12-18T00:06:02.4608887Z [11,059 / 15,187] 48 actions, 47 running 2024-12-18T00:06:02.4609739Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T00:06:02.4610742Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:06:02.4611623Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:06:02.4612334Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2024-12-18T00:06:02.4613689Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:06:02.4614670Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:06:02.4615755Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:06:02.4616933Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local ... 2024-12-18T00:06:02.7400046Z 2024-12-18T00:06:02.7401022Z  2024-12-18T00:06:02.7401532Z  2024-12-18T00:06:02.7401975Z  2024-12-18T00:06:02.7402387Z  2024-12-18T00:06:02.7402803Z  2024-12-18T00:06:02.7403210Z  2024-12-18T00:06:02.7403633Z  2024-12-18T00:06:02.7404054Z  2024-12-18T00:06:02.7404666Z [11,064 / 15,187] 48 actions, 47 running 2024-12-18T00:06:02.7405662Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T00:06:02.7406871Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:06:02.7407849Z @llvm-project//llvm:IPO; 22s local 2024-12-18T00:06:02.7408631Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2024-12-18T00:06:02.7410121Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:06:02.7411218Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:06:02.7412287Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:06:02.7413379Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local ... 2024-12-18T00:06:03.0049688Z 2024-12-18T00:06:03.0050662Z  2024-12-18T00:06:03.0051100Z  2024-12-18T00:06:03.0051524Z  2024-12-18T00:06:03.0051935Z  2024-12-18T00:06:03.0052333Z  2024-12-18T00:06:03.0052718Z  2024-12-18T00:06:03.0053421Z  2024-12-18T00:06:03.0053981Z  2024-12-18T00:06:03.0054681Z [11,065 / 15,187] 48 actions running 2024-12-18T00:06:03.0056260Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T00:06:03.0057608Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:06:03.0058630Z @llvm-project//llvm:IPO; 22s local 2024-12-18T00:06:03.0059454Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2024-12-18T00:06:03.0060795Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:06:03.0061988Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:06:03.0063024Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:06:03.0064046Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local ... 2024-12-18T00:06:03.3114249Z 2024-12-18T00:06:03.3115283Z  2024-12-18T00:06:03.3115778Z  2024-12-18T00:06:03.3117501Z  2024-12-18T00:06:03.3117917Z  2024-12-18T00:06:03.3119673Z  2024-12-18T00:06:03.3120134Z  2024-12-18T00:06:03.3121913Z  2024-12-18T00:06:03.3122318Z  2024-12-18T00:06:03.3124307Z [11,066 / 15,187] 48 actions, 47 running 2024-12-18T00:06:03.3125219Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T00:06:03.3126299Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:06:03.3127212Z @llvm-project//llvm:IPO; 22s local 2024-12-18T00:06:03.3127940Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2024-12-18T00:06:03.3128868Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:06:03.3129911Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2024-12-18T00:06:03.3130834Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:06:03.3131760Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local ... 2024-12-18T00:06:03.5129062Z 2024-12-18T00:06:03.5130064Z  2024-12-18T00:06:03.5130568Z  2024-12-18T00:06:03.5132185Z  2024-12-18T00:06:03.5132570Z  2024-12-18T00:06:03.5134347Z  2024-12-18T00:06:03.5134748Z  2024-12-18T00:06:03.5135157Z  2024-12-18T00:06:03.5135547Z  2024-12-18T00:06:03.5136134Z [11,069 / 15,187] 48 actions, 47 running 2024-12-18T00:06:03.5137280Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T00:06:03.5138384Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:06:03.5139255Z @llvm-project//llvm:IPO; 22s local 2024-12-18T00:06:03.5139982Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2024-12-18T00:06:03.5140914Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:06:03.5141756Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:06:03.5142648Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:06:03.5143646Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local ... 2024-12-18T00:06:03.8053760Z 2024-12-18T00:06:03.8054677Z  2024-12-18T00:06:03.8055146Z  2024-12-18T00:06:03.8055520Z  2024-12-18T00:06:03.8055888Z  2024-12-18T00:06:03.8056269Z  2024-12-18T00:06:03.8056722Z  2024-12-18T00:06:03.8057115Z  2024-12-18T00:06:03.8057514Z  2024-12-18T00:06:03.8058168Z [11,073 / 15,187] 48 actions, 47 running 2024-12-18T00:06:03.8058962Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T00:06:03.8059952Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:06:03.8060818Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:06:03.8061530Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2024-12-18T00:06:03.8062624Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:06:03.8063459Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:06:03.8064343Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:06:03.8065956Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local ... 2024-12-18T00:06:04.0058245Z 2024-12-18T00:06:04.0059229Z  2024-12-18T00:06:04.0059761Z  2024-12-18T00:06:04.0060153Z  2024-12-18T00:06:04.0060536Z  2024-12-18T00:06:04.0060921Z  2024-12-18T00:06:04.0061436Z  2024-12-18T00:06:04.0062195Z  2024-12-18T00:06:04.0062615Z  2024-12-18T00:06:04.0063180Z [11,075 / 15,187] 48 actions running 2024-12-18T00:06:04.0064001Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T00:06:04.0065077Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:06:04.0065838Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:06:04.0066536Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2024-12-18T00:06:04.0067400Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:06:04.0068277Z @llvm-project//llvm:Instrumentation; 16s local 2024-12-18T00:06:04.0069134Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:06:04.0070264Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local ... 2024-12-18T00:06:04.2062151Z 2024-12-18T00:06:04.2063126Z  2024-12-18T00:06:04.2063640Z  2024-12-18T00:06:04.2064119Z  2024-12-18T00:06:04.2064546Z  2024-12-18T00:06:04.2064949Z  2024-12-18T00:06:04.2065345Z  2024-12-18T00:06:04.2065740Z  2024-12-18T00:06:04.2066127Z  2024-12-18T00:06:04.2066715Z [11,077 / 15,187] 48 actions running 2024-12-18T00:06:04.2067618Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T00:06:04.2068700Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:06:04.2069604Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:06:04.2070365Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2024-12-18T00:06:04.2071332Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:06:04.2072221Z @llvm-project//llvm:Instrumentation; 16s local 2024-12-18T00:06:04.2073126Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:06:04.2074225Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local ... 2024-12-18T00:06:04.4321866Z 2024-12-18T00:06:04.4322773Z  2024-12-18T00:06:04.4323254Z  2024-12-18T00:06:04.4323640Z  2024-12-18T00:06:04.4324046Z  2024-12-18T00:06:04.4324446Z  2024-12-18T00:06:04.4324843Z  2024-12-18T00:06:04.4325246Z  2024-12-18T00:06:04.4325641Z  2024-12-18T00:06:04.4326229Z [11,080 / 15,187] 48 actions, 47 running 2024-12-18T00:06:04.4327182Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T00:06:04.4328245Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:06:04.4329212Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:06:04.4330001Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2024-12-18T00:06:04.4330969Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:06:04.4332043Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:06:04.4333184Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:06:04.4334289Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:06:04.6803834Z 2024-12-18T00:06:04.6804808Z  2024-12-18T00:06:04.6805287Z  2024-12-18T00:06:04.6805658Z  2024-12-18T00:06:04.6806095Z  2024-12-18T00:06:04.6806511Z  2024-12-18T00:06:04.6806914Z  2024-12-18T00:06:04.6807261Z  2024-12-18T00:06:04.6807701Z  2024-12-18T00:06:04.6808292Z [11,082 / 15,187] 48 actions, 47 running 2024-12-18T00:06:04.6809173Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T00:06:04.6810712Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:06:04.6811520Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:06:04.6812232Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2024-12-18T00:06:04.6813092Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:06:04.6814365Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:06:04.6815675Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:06:04.6816810Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:06:04.9069141Z 2024-12-18T00:06:04.9070112Z  2024-12-18T00:06:04.9070573Z  2024-12-18T00:06:04.9070968Z  2024-12-18T00:06:04.9071390Z  2024-12-18T00:06:04.9071766Z  2024-12-18T00:06:04.9072122Z  2024-12-18T00:06:04.9072515Z  2024-12-18T00:06:04.9072944Z  2024-12-18T00:06:04.9073659Z [11,084 / 15,187] 48 actions, 47 running 2024-12-18T00:06:04.9074500Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T00:06:04.9075523Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:06:04.9076389Z @llvm-project//llvm:IPO; 24s local 2024-12-18T00:06:04.9077127Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2024-12-18T00:06:04.9078033Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:06:04.9079135Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:06:04.9080162Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:06:04.9081138Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:06:05.2070440Z 2024-12-18T00:06:05.2071285Z  2024-12-18T00:06:05.2071680Z  2024-12-18T00:06:05.2071998Z  2024-12-18T00:06:05.2072351Z  2024-12-18T00:06:05.2072664Z  2024-12-18T00:06:05.2072960Z  2024-12-18T00:06:05.2073275Z  2024-12-18T00:06:05.2073590Z  2024-12-18T00:06:05.2074057Z [11,084 / 15,187] 48 actions running 2024-12-18T00:06:05.2074774Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T00:06:05.2075632Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:06:05.2076319Z @llvm-project//llvm:IPO; 24s local 2024-12-18T00:06:05.2076895Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2024-12-18T00:06:05.2077623Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:06:05.2078453Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:06:05.2079301Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:06:05.2080091Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:06:05.5740287Z 2024-12-18T00:06:05.5741847Z  2024-12-18T00:06:05.5742364Z  2024-12-18T00:06:05.5743799Z  2024-12-18T00:06:05.5744891Z  2024-12-18T00:06:05.5746006Z  2024-12-18T00:06:05.5749053Z  2024-12-18T00:06:05.5749627Z  2024-12-18T00:06:05.5750032Z  2024-12-18T00:06:05.5750631Z [11,086 / 15,187] 48 actions, 47 running 2024-12-18T00:06:05.5751626Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T00:06:05.5752685Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:06:05.5753510Z @llvm-project//llvm:IPO; 24s local 2024-12-18T00:06:05.5754213Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2024-12-18T00:06:05.5755187Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:06:05.5756265Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:06:05.5757268Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:06:05.5758690Z Compiling llvm/lib/Transforms/Vectorize/VPlanAnalysis.cpp; 10s local ... 2024-12-18T00:06:05.8077463Z 2024-12-18T00:06:05.8078651Z  2024-12-18T00:06:05.8080219Z  2024-12-18T00:06:05.8081682Z  2024-12-18T00:06:05.8083129Z  2024-12-18T00:06:05.8084610Z  2024-12-18T00:06:05.8086053Z  2024-12-18T00:06:05.8087993Z  2024-12-18T00:06:05.8089523Z  2024-12-18T00:06:05.8091213Z [11,088 / 15,187] 48 actions running 2024-12-18T00:06:05.8093260Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T00:06:05.8095451Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:06:05.8097714Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:06:05.8099534Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2024-12-18T00:06:05.8101739Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:06:05.8103945Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:06:05.8105950Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:06:05.8108040Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local ... 2024-12-18T00:06:06.0080602Z 2024-12-18T00:06:06.0082689Z  2024-12-18T00:06:06.0084160Z  2024-12-18T00:06:06.0085615Z  2024-12-18T00:06:06.0086251Z  2024-12-18T00:06:06.0086634Z  2024-12-18T00:06:06.0087087Z  2024-12-18T00:06:06.0087491Z  2024-12-18T00:06:06.0087943Z  2024-12-18T00:06:06.0088615Z [11,090 / 15,187] 48 actions running 2024-12-18T00:06:06.0089526Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T00:06:06.0090605Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:06:06.0091515Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:06:06.0092358Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2024-12-18T00:06:06.0093381Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:06:06.0094483Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:06:06.0095681Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:06:06.0096885Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local ... 2024-12-18T00:06:06.3693271Z 2024-12-18T00:06:06.3694699Z  2024-12-18T00:06:06.3695174Z  2024-12-18T00:06:06.3695620Z  2024-12-18T00:06:06.3696154Z  2024-12-18T00:06:06.3696684Z  2024-12-18T00:06:06.3697062Z  2024-12-18T00:06:06.3697429Z  2024-12-18T00:06:06.3697794Z  2024-12-18T00:06:06.3698383Z [11,092 / 15,187] 48 actions, 47 running 2024-12-18T00:06:06.3699296Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T00:06:06.3700349Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:06:06.3701312Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:06:06.3702060Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:06:06.3703073Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:06:06.3704213Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:06:06.3705209Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:06:06.3706276Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local ... 2024-12-18T00:06:06.6087290Z 2024-12-18T00:06:06.6088251Z  2024-12-18T00:06:06.6088799Z  2024-12-18T00:06:06.6089307Z  2024-12-18T00:06:06.6089726Z  2024-12-18T00:06:06.6090102Z  2024-12-18T00:06:06.6090513Z  2024-12-18T00:06:06.6090905Z  2024-12-18T00:06:06.6091425Z  2024-12-18T00:06:06.6092057Z [11,093 / 15,187] 48 actions running 2024-12-18T00:06:06.6093493Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T00:06:06.6094574Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:06:06.6106727Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:06:06.6107543Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:06:06.6108894Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:06:06.6110182Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:06:06.6111210Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:06:06.6112161Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local ... 2024-12-18T00:06:06.8092570Z 2024-12-18T00:06:06.8093434Z  2024-12-18T00:06:06.8093946Z  2024-12-18T00:06:06.8094323Z  2024-12-18T00:06:06.8094682Z  2024-12-18T00:06:06.8095056Z  2024-12-18T00:06:06.8095430Z  2024-12-18T00:06:06.8095870Z  2024-12-18T00:06:06.8096254Z  2024-12-18T00:06:06.8096918Z [11,094 / 15,187] 48 actions running 2024-12-18T00:06:06.8097786Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T00:06:06.8099025Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:06:06.8099916Z @llvm-project//llvm:IPO; 26s local 2024-12-18T00:06:06.8100686Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:06:06.8101689Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:06:06.8102856Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:06:06.8103895Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:06:06.8104995Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local ... 2024-12-18T00:06:07.0235898Z 2024-12-18T00:06:07.0237295Z  2024-12-18T00:06:07.0237805Z  2024-12-18T00:06:07.0239206Z  2024-12-18T00:06:07.0240094Z  2024-12-18T00:06:07.0241258Z  2024-12-18T00:06:07.0242507Z  2024-12-18T00:06:07.0243833Z  2024-12-18T00:06:07.0245267Z  2024-12-18T00:06:07.0246757Z [11,096 / 15,187] 48 actions, 47 running 2024-12-18T00:06:07.0247947Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T00:06:07.0249070Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:06:07.0249941Z @llvm-project//llvm:IPO; 26s local 2024-12-18T00:06:07.0250660Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:06:07.0251643Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:06:07.0252715Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:06:07.0253780Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:06:07.0254845Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local ... 2024-12-18T00:06:07.4098233Z 2024-12-18T00:06:07.4099565Z  2024-12-18T00:06:07.4100041Z  2024-12-18T00:06:07.4101506Z  2024-12-18T00:06:07.4102498Z  2024-12-18T00:06:07.4103700Z  2024-12-18T00:06:07.4104835Z  2024-12-18T00:06:07.4106044Z  2024-12-18T00:06:07.4107247Z  2024-12-18T00:06:07.4108637Z [11,096 / 15,187] 48 actions running 2024-12-18T00:06:07.4109550Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T00:06:07.4110685Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:06:07.4111519Z @llvm-project//llvm:IPO; 26s local 2024-12-18T00:06:07.4112259Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:06:07.4113241Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:06:07.4114294Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:06:07.4115785Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:06:07.4116807Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local ... 2024-12-18T00:06:07.6782129Z 2024-12-18T00:06:07.6783418Z  2024-12-18T00:06:07.6783863Z  2024-12-18T00:06:07.6785391Z  2024-12-18T00:06:07.6786160Z  2024-12-18T00:06:07.6787349Z  2024-12-18T00:06:07.6788757Z  2024-12-18T00:06:07.6789594Z  2024-12-18T00:06:07.6790639Z  2024-12-18T00:06:07.6792035Z [11,097 / 15,187] 48 actions, 47 running 2024-12-18T00:06:07.6793112Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T00:06:07.6794169Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:06:07.6794986Z @llvm-project//llvm:IPO; 26s local 2024-12-18T00:06:07.6796466Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:06:07.6797509Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:06:07.6798641Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:06:07.6799674Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:06:07.6800701Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local ... 2024-12-18T00:06:08.0104422Z 2024-12-18T00:06:08.0105261Z  2024-12-18T00:06:08.0105680Z  2024-12-18T00:06:08.0105997Z  2024-12-18T00:06:08.0106318Z  2024-12-18T00:06:08.0106642Z  2024-12-18T00:06:08.0107015Z  2024-12-18T00:06:08.0107394Z  2024-12-18T00:06:08.0107797Z  2024-12-18T00:06:08.0108338Z [11,097 / 15,187] 48 actions running 2024-12-18T00:06:08.0109217Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T00:06:08.0110281Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:06:08.0111128Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:06:08.0111846Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:06:08.0112797Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:06:08.0113802Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:06:08.0114930Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:06:08.0115954Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local ... 2024-12-18T00:06:08.2113852Z 2024-12-18T00:06:08.2115417Z  2024-12-18T00:06:08.2115954Z  2024-12-18T00:06:08.2116369Z  2024-12-18T00:06:08.2116758Z  2024-12-18T00:06:08.2117163Z  2024-12-18T00:06:08.2117593Z  2024-12-18T00:06:08.2118017Z  2024-12-18T00:06:08.2118441Z  2024-12-18T00:06:08.2119030Z [11,099 / 15,187] 48 actions, 47 running 2024-12-18T00:06:08.2119951Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T00:06:08.2121105Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:06:08.2122033Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:06:08.2122759Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:06:08.2123743Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:06:08.2124851Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:06:08.2125897Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:06:08.2126931Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local ... 2024-12-18T00:06:08.4801698Z 2024-12-18T00:06:08.4803083Z  2024-12-18T00:06:08.4803601Z  2024-12-18T00:06:08.4805123Z  2024-12-18T00:06:08.4806030Z  2024-12-18T00:06:08.4807138Z  2024-12-18T00:06:08.4808305Z  2024-12-18T00:06:08.4809426Z  2024-12-18T00:06:08.4810661Z  2024-12-18T00:06:08.4812160Z [11,102 / 15,187] 48 actions, 47 running 2024-12-18T00:06:08.4813536Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T00:06:08.4814610Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:06:08.4815470Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:06:08.4816235Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:06:08.4817614Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:06:08.4818654Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:06:08.4819651Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:06:08.4820759Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local ... 2024-12-18T00:06:08.6822507Z 2024-12-18T00:06:08.6823886Z  2024-12-18T00:06:08.6824385Z  2024-12-18T00:06:08.6824762Z  2024-12-18T00:06:08.6825985Z  2024-12-18T00:06:08.6826912Z  2024-12-18T00:06:08.6828190Z  2024-12-18T00:06:08.6829354Z  2024-12-18T00:06:08.6830530Z  2024-12-18T00:06:08.6831896Z [11,104 / 15,187] 48 actions, 47 running 2024-12-18T00:06:08.6832809Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T00:06:08.6834195Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:06:08.6835121Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:06:08.6835845Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:06:08.6836809Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:06:08.6837873Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:06:08.6838969Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:06:08.6840092Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local ... 2024-12-18T00:06:09.0113660Z 2024-12-18T00:06:09.0114578Z  2024-12-18T00:06:09.0115124Z  2024-12-18T00:06:09.0115530Z  2024-12-18T00:06:09.0115916Z  2024-12-18T00:06:09.0116282Z  2024-12-18T00:06:09.0116668Z  2024-12-18T00:06:09.0117058Z  2024-12-18T00:06:09.0117438Z  2024-12-18T00:06:09.0117973Z [11,107 / 15,187] 48 actions running 2024-12-18T00:06:09.0118858Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T00:06:09.0119899Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:06:09.0120747Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:06:09.0121438Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:06:09.0122397Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:06:09.0123422Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:06:09.0124461Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:06:09.0125602Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local ... 2024-12-18T00:06:09.3610099Z 2024-12-18T00:06:09.3611231Z  2024-12-18T00:06:09.3611969Z  2024-12-18T00:06:09.3613238Z  2024-12-18T00:06:09.3613706Z  2024-12-18T00:06:09.3614076Z  2024-12-18T00:06:09.3614446Z  2024-12-18T00:06:09.3614807Z  2024-12-18T00:06:09.3615212Z  2024-12-18T00:06:09.3615828Z [11,108 / 15,187] 48 actions, 47 running 2024-12-18T00:06:09.3616889Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T00:06:09.3617902Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:06:09.3618763Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:06:09.3619704Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:06:09.3620746Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:06:09.3621870Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:06:09.3625534Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:06:09.3626662Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local ... 2024-12-18T00:06:09.6121182Z 2024-12-18T00:06:09.6122582Z  2024-12-18T00:06:09.6123089Z  2024-12-18T00:06:09.6123502Z  2024-12-18T00:06:09.6124271Z  2024-12-18T00:06:09.6124667Z  2024-12-18T00:06:09.6125184Z  2024-12-18T00:06:09.6125581Z  2024-12-18T00:06:09.6125977Z  2024-12-18T00:06:09.6126518Z [11,111 / 15,187] 48 actions running 2024-12-18T00:06:09.6127335Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T00:06:09.6128486Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:06:09.6129336Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:06:09.6130135Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:06:09.6131049Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:06:09.6132196Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:06:09.6133252Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:06:09.6134340Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local ... 2024-12-18T00:06:09.8124310Z 2024-12-18T00:06:09.8125715Z  2024-12-18T00:06:09.8126321Z  2024-12-18T00:06:09.8126732Z  2024-12-18T00:06:09.8127149Z  2024-12-18T00:06:09.8127599Z  2024-12-18T00:06:09.8128003Z  2024-12-18T00:06:09.8128427Z  2024-12-18T00:06:09.8128870Z  2024-12-18T00:06:09.8129459Z [11,112 / 15,187] 48 actions running 2024-12-18T00:06:09.8130406Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T00:06:09.8131588Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:06:09.8132410Z @llvm-project//llvm:IPO; 29s local 2024-12-18T00:06:09.8133118Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:06:09.8134127Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:06:09.8135112Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:06:09.8136271Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:06:09.8137659Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local ... 2024-12-18T00:06:10.2130689Z 2024-12-18T00:06:10.2132117Z  2024-12-18T00:06:10.2132785Z  2024-12-18T00:06:10.2133407Z  2024-12-18T00:06:10.2133857Z  2024-12-18T00:06:10.2134309Z  2024-12-18T00:06:10.2134726Z  2024-12-18T00:06:10.2135149Z  2024-12-18T00:06:10.2135578Z  2024-12-18T00:06:10.2136092Z [11,113 / 15,187] 48 actions running 2024-12-18T00:06:10.2137098Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T00:06:10.2138095Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:06:10.2138916Z @llvm-project//llvm:IPO; 29s local 2024-12-18T00:06:10.2139619Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:06:10.2140645Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:06:10.2141789Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:06:10.2142866Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:06:10.2144061Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local ... 2024-12-18T00:06:10.4134070Z 2024-12-18T00:06:10.4135002Z  2024-12-18T00:06:10.4135437Z  2024-12-18T00:06:10.4136093Z  2024-12-18T00:06:10.4136482Z  2024-12-18T00:06:10.4137202Z  2024-12-18T00:06:10.4137709Z  2024-12-18T00:06:10.4138603Z  2024-12-18T00:06:10.4139108Z  2024-12-18T00:06:10.4139776Z [11,114 / 15,187] 48 actions running 2024-12-18T00:06:10.4140767Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 53s local 2024-12-18T00:06:10.4141939Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:06:10.4143073Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:06:10.4144600Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:06:10.4145864Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:06:10.4147115Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:06:10.4148346Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:06:10.4149436Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 8s local ... 2024-12-18T00:06:10.6478581Z 2024-12-18T00:06:10.6479532Z  2024-12-18T00:06:10.6480070Z  2024-12-18T00:06:10.6480711Z  2024-12-18T00:06:10.6481208Z  2024-12-18T00:06:10.6481708Z  2024-12-18T00:06:10.6482179Z  2024-12-18T00:06:10.6482648Z  2024-12-18T00:06:10.6483118Z  2024-12-18T00:06:10.6483816Z [11,116 / 15,187] 48 actions, 47 running 2024-12-18T00:06:10.6484766Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 53s local 2024-12-18T00:06:10.6485930Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:06:10.6487040Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:06:10.6488095Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:06:10.6489291Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:06:10.6490647Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:06:10.6491883Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:06:10.6493070Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 8s local ... 2024-12-18T00:06:11.0141602Z 2024-12-18T00:06:11.0142486Z  2024-12-18T00:06:11.0142909Z  2024-12-18T00:06:11.0143265Z  2024-12-18T00:06:11.0143652Z  2024-12-18T00:06:11.0144044Z  2024-12-18T00:06:11.0144626Z  2024-12-18T00:06:11.0144998Z  2024-12-18T00:06:11.0145421Z  2024-12-18T00:06:11.0145930Z [11,117 / 15,187] 48 actions running 2024-12-18T00:06:11.0146774Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 53s local 2024-12-18T00:06:11.0147820Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:06:11.0148754Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:06:11.0149730Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:06:11.0150798Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:06:11.0151863Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:06:11.0152963Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:06:11.0153995Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 8s local ... 2024-12-18T00:06:11.3031164Z 2024-12-18T00:06:11.3032105Z  2024-12-18T00:06:11.3033319Z  2024-12-18T00:06:11.3033983Z  2024-12-18T00:06:11.3034568Z  2024-12-18T00:06:11.3035032Z  2024-12-18T00:06:11.3035691Z  2024-12-18T00:06:11.3037284Z  2024-12-18T00:06:11.3038688Z  2024-12-18T00:06:11.3040340Z [11,119 / 15,187] 48 actions, 47 running 2024-12-18T00:06:11.3042292Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 53s local 2024-12-18T00:06:11.3044639Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:06:11.3046826Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:06:11.3048655Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:06:11.3049978Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2024-12-18T00:06:11.3051157Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 9s local 2024-12-18T00:06:11.3052285Z Compiling llvm/lib/Transforms/Scalar/ADCE.cpp; 8s local 2024-12-18T00:06:11.3053584Z @llvm-project//llvm:Scalar; 7s local ... 2024-12-18T00:06:11.6138520Z 2024-12-18T00:06:11.6139946Z  2024-12-18T00:06:11.6140689Z  2024-12-18T00:06:11.6141312Z  2024-12-18T00:06:11.6141720Z  2024-12-18T00:06:11.6142145Z  2024-12-18T00:06:11.6142632Z  2024-12-18T00:06:11.6143030Z  2024-12-18T00:06:11.6143442Z  2024-12-18T00:06:11.6144051Z [11,121 / 15,187] 48 actions, 47 running 2024-12-18T00:06:11.6145186Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 54s local 2024-12-18T00:06:11.6146340Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:06:11.6147409Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:06:11.6148430Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:06:11.6149404Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 9s local 2024-12-18T00:06:11.6150227Z Compiling llvm/lib/Transforms/Scalar/ADCE.cpp; 9s local 2024-12-18T00:06:11.6151181Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 8s local 2024-12-18T00:06:11.6152385Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 8s local ... 2024-12-18T00:06:11.8149528Z 2024-12-18T00:06:11.8150491Z  2024-12-18T00:06:11.8151186Z  2024-12-18T00:06:11.8151569Z  2024-12-18T00:06:11.8152068Z  2024-12-18T00:06:11.8152550Z  2024-12-18T00:06:11.8153014Z  2024-12-18T00:06:11.8153485Z  2024-12-18T00:06:11.8153960Z  2024-12-18T00:06:11.8154613Z [11,123 / 15,187] 48 actions running 2024-12-18T00:06:11.8155617Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:06:11.8156751Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:06:11.8157873Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:06:11.8158955Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 9s local 2024-12-18T00:06:11.8160129Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 8s local 2024-12-18T00:06:11.8161294Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 8s local 2024-12-18T00:06:11.8162400Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 8s local 2024-12-18T00:06:11.8163457Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 8s local ... 2024-12-18T00:06:12.3219333Z 2024-12-18T00:06:12.3220342Z  2024-12-18T00:06:12.3220850Z  2024-12-18T00:06:12.3221242Z  2024-12-18T00:06:12.3221629Z  2024-12-18T00:06:12.3222519Z  2024-12-18T00:06:12.3222906Z  2024-12-18T00:06:12.3223396Z  2024-12-18T00:06:12.3223879Z  2024-12-18T00:06:12.3224558Z [11,124 / 15,187] 48 actions, 47 running 2024-12-18T00:06:12.3225532Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:06:12.3226719Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:06:12.3227932Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:06:12.3229030Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:06:12.3230174Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 9s local 2024-12-18T00:06:12.3231392Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 8s local 2024-12-18T00:06:12.3232567Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 8s local 2024-12-18T00:06:12.3233688Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 8s local ... 2024-12-18T00:06:12.5947407Z 2024-12-18T00:06:12.5948295Z  2024-12-18T00:06:12.5948747Z  2024-12-18T00:06:12.5949279Z  2024-12-18T00:06:12.5949661Z  2024-12-18T00:06:12.5950047Z  2024-12-18T00:06:12.5950435Z  2024-12-18T00:06:12.5950798Z  2024-12-18T00:06:12.5951185Z  2024-12-18T00:06:12.5951776Z [11,126 / 15,187] 48 actions, 47 running 2024-12-18T00:06:12.5953124Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:06:12.5954282Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:06:12.5955399Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:06:12.5956461Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:06:12.5957537Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 9s local 2024-12-18T00:06:12.5958813Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:06:12.5959923Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 8s local 2024-12-18T00:06:12.5960981Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 8s local ... 2024-12-18T00:06:12.8158696Z 2024-12-18T00:06:12.8159792Z  2024-12-18T00:06:12.8161378Z  2024-12-18T00:06:12.8164358Z  2024-12-18T00:06:12.8167347Z  2024-12-18T00:06:12.8170336Z  2024-12-18T00:06:12.8173412Z  2024-12-18T00:06:12.8176234Z  2024-12-18T00:06:12.8179574Z  2024-12-18T00:06:12.8182724Z [11,127 / 15,187] 48 actions running 2024-12-18T00:06:12.8186264Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:06:12.8189985Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:06:12.8193642Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:06:12.8197217Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:06:12.8200792Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 9s local 2024-12-18T00:06:12.8204448Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:06:12.8208136Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 9s local 2024-12-18T00:06:12.8211741Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 9s local ... 2024-12-18T00:06:13.0161746Z 2024-12-18T00:06:13.0165314Z  2024-12-18T00:06:13.0168216Z  2024-12-18T00:06:13.0171018Z  2024-12-18T00:06:13.0173819Z  2024-12-18T00:06:13.0176864Z  2024-12-18T00:06:13.0179833Z  2024-12-18T00:06:13.0182870Z  2024-12-18T00:06:13.0185814Z  2024-12-18T00:06:13.0189170Z [11,128 / 15,187] 48 actions running 2024-12-18T00:06:13.0192726Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:06:13.0196474Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:06:13.0199303Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:06:13.0200657Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:06:13.0201872Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 9s local 2024-12-18T00:06:13.0203236Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:06:13.0204581Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 9s local 2024-12-18T00:06:13.0205840Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 9s local ... 2024-12-18T00:06:13.2171334Z 2024-12-18T00:06:13.2172748Z  2024-12-18T00:06:13.2173539Z  2024-12-18T00:06:13.2174206Z  2024-12-18T00:06:13.2174668Z  2024-12-18T00:06:13.2175089Z  2024-12-18T00:06:13.2175519Z  2024-12-18T00:06:13.2175937Z  2024-12-18T00:06:13.2176361Z  2024-12-18T00:06:13.2177169Z [11,129 / 15,187] 48 actions, 47 running 2024-12-18T00:06:13.2178473Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:06:13.2179666Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:06:13.2180746Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:06:13.2181766Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:06:13.2182928Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 9s local 2024-12-18T00:06:13.2184048Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:06:13.2185156Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 9s local 2024-12-18T00:06:13.2186278Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 9s local ... 2024-12-18T00:06:13.4382212Z 2024-12-18T00:06:13.4383187Z  2024-12-18T00:06:13.4383700Z  2024-12-18T00:06:13.4384323Z  2024-12-18T00:06:13.4384898Z  2024-12-18T00:06:13.4385367Z  2024-12-18T00:06:13.4385892Z  2024-12-18T00:06:13.4386365Z  2024-12-18T00:06:13.4386833Z  2024-12-18T00:06:13.4387518Z [11,130 / 15,187] 48 actions, 47 running 2024-12-18T00:06:13.4388533Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:06:13.4389771Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:06:13.4390968Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:06:13.4392132Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:06:13.4393326Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 10s local 2024-12-18T00:06:13.4394594Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:06:13.4395853Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 9s local 2024-12-18T00:06:13.4397027Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 9s local ... 2024-12-18T00:06:13.6936428Z 2024-12-18T00:06:13.6937563Z  2024-12-18T00:06:13.6938022Z  2024-12-18T00:06:13.6938417Z  2024-12-18T00:06:13.6938792Z  2024-12-18T00:06:13.6939462Z  2024-12-18T00:06:13.6939937Z  2024-12-18T00:06:13.6940404Z  2024-12-18T00:06:13.6940878Z  2024-12-18T00:06:13.6941557Z [11,131 / 15,187] 48 actions, 47 running 2024-12-18T00:06:13.6942641Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:06:13.6943914Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:06:13.6945270Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:06:13.6946449Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:06:13.6947659Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 10s local 2024-12-18T00:06:13.6948937Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 10s local 2024-12-18T00:06:13.6950247Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 10s local 2024-12-18T00:06:13.6951343Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 9s local ... 2024-12-18T00:06:14.0170116Z 2024-12-18T00:06:14.0170979Z  2024-12-18T00:06:14.0171425Z  2024-12-18T00:06:14.0171814Z  2024-12-18T00:06:14.0172204Z  2024-12-18T00:06:14.0172605Z  2024-12-18T00:06:14.0172994Z  2024-12-18T00:06:14.0173418Z  2024-12-18T00:06:14.0173797Z  2024-12-18T00:06:14.0174351Z [11,131 / 15,187] 48 actions running 2024-12-18T00:06:14.0175289Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:06:14.0176416Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:06:14.0177689Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:06:14.0178747Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:06:14.0179882Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 10s local 2024-12-18T00:06:14.0181514Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 10s local 2024-12-18T00:06:14.0182740Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 10s local 2024-12-18T00:06:14.0183750Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 9s local ... 2024-12-18T00:06:14.2498619Z 2024-12-18T00:06:14.2500054Z  2024-12-18T00:06:14.2500889Z  2024-12-18T00:06:14.2501569Z  2024-12-18T00:06:14.2502136Z  2024-12-18T00:06:14.2502513Z  2024-12-18T00:06:14.2502933Z  2024-12-18T00:06:14.2503356Z  2024-12-18T00:06:14.2503772Z  2024-12-18T00:06:14.2504408Z [11,136 / 15,187] 47 actions, 46 running 2024-12-18T00:06:14.2505426Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:06:14.2506663Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:06:14.2507908Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:06:14.2509140Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:06:14.2510222Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 10s local 2024-12-18T00:06:14.2511370Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 10s local 2024-12-18T00:06:14.2512557Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 9s local 2024-12-18T00:06:14.2513564Z Compiling llvm/lib/Transforms/Scalar/IndVarSimplify.cpp; 9s local ... 2024-12-18T00:06:14.5509690Z 2024-12-18T00:06:14.5510574Z  2024-12-18T00:06:14.5511188Z  2024-12-18T00:06:14.5511620Z  2024-12-18T00:06:14.5512070Z  2024-12-18T00:06:14.5512437Z  2024-12-18T00:06:14.5512862Z  2024-12-18T00:06:14.5513296Z  2024-12-18T00:06:14.5513684Z  2024-12-18T00:06:14.5514251Z [11,140 / 15,187] 48 actions, 47 running 2024-12-18T00:06:14.5515227Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:06:14.5516350Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:06:14.5517377Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:06:14.5518326Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:06:14.5519350Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 11s local 2024-12-18T00:06:14.5520493Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 10s local 2024-12-18T00:06:14.5521418Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 10s local 2024-12-18T00:06:14.5522311Z Compiling llvm/lib/Transforms/Scalar/IndVarSimplify.cpp; 9s local ... 2024-12-18T00:06:14.8177640Z 2024-12-18T00:06:14.8178539Z  2024-12-18T00:06:14.8179005Z  2024-12-18T00:06:14.8179381Z  2024-12-18T00:06:14.8179757Z  2024-12-18T00:06:14.8180128Z  2024-12-18T00:06:14.8180511Z  2024-12-18T00:06:14.8180933Z  2024-12-18T00:06:14.8181307Z  2024-12-18T00:06:14.8181842Z [11,140 / 15,187] 48 actions running 2024-12-18T00:06:14.8182751Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:06:14.8183831Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:06:14.8184917Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:06:14.8185926Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:06:14.8186968Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 11s local 2024-12-18T00:06:14.8188107Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 11s local 2024-12-18T00:06:14.8189274Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 10s local 2024-12-18T00:06:14.8190248Z Compiling llvm/lib/Transforms/Scalar/IndVarSimplify.cpp; 10s local ... 2024-12-18T00:06:15.0245778Z 2024-12-18T00:06:15.0246623Z  2024-12-18T00:06:15.0247386Z  2024-12-18T00:06:15.0247785Z  2024-12-18T00:06:15.0248154Z  2024-12-18T00:06:15.0248532Z  2024-12-18T00:06:15.0248885Z  2024-12-18T00:06:15.0249247Z  2024-12-18T00:06:15.0249638Z  2024-12-18T00:06:15.0250178Z [11,141 / 15,187] 48 actions, 47 running 2024-12-18T00:06:15.0251245Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2024-12-18T00:06:15.0252259Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:06:15.0253327Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:06:15.0254280Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:06:15.0255270Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 11s local 2024-12-18T00:06:15.0256363Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 11s local 2024-12-18T00:06:15.0257475Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 10s local 2024-12-18T00:06:15.0258286Z Compiling llvm/lib/Transforms/Scalar/IndVarSimplify.cpp; 10s local ... 2024-12-18T00:06:15.4188147Z 2024-12-18T00:06:15.4190028Z  2024-12-18T00:06:15.4191394Z  2024-12-18T00:06:15.4192616Z  2024-12-18T00:06:15.4193843Z  2024-12-18T00:06:15.4195078Z  2024-12-18T00:06:15.4196313Z  2024-12-18T00:06:15.4197663Z  2024-12-18T00:06:15.4198912Z  2024-12-18T00:06:15.4200300Z [11,141 / 15,187] 48 actions running 2024-12-18T00:06:15.4201983Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2024-12-18T00:06:15.4203803Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:06:15.4205589Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:06:15.4207356Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:06:15.4209165Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 12s local 2024-12-18T00:06:15.4211064Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 11s local 2024-12-18T00:06:15.4212809Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:06:15.4214548Z Compiling llvm/lib/Transforms/Scalar/IndVarSimplify.cpp; 10s local ... 2024-12-18T00:06:15.7050917Z 2024-12-18T00:06:15.7052802Z  2024-12-18T00:06:15.7054271Z  2024-12-18T00:06:15.7055788Z  2024-12-18T00:06:15.7057308Z  2024-12-18T00:06:15.7058667Z  2024-12-18T00:06:15.7060007Z  2024-12-18T00:06:15.7061803Z  2024-12-18T00:06:15.7063514Z  2024-12-18T00:06:15.7065412Z [11,145 / 15,187] 48 actions, 47 running 2024-12-18T00:06:15.7067615Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2024-12-18T00:06:15.7070054Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:06:15.7072449Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:06:15.7074888Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:06:15.7077333Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 12s local 2024-12-18T00:06:15.7079906Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 12s local 2024-12-18T00:06:15.7082241Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:06:15.7084719Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 9s local ... 2024-12-18T00:06:15.9161933Z 2024-12-18T00:06:15.9164190Z  2024-12-18T00:06:15.9166111Z  2024-12-18T00:06:15.9167862Z  2024-12-18T00:06:15.9169630Z  2024-12-18T00:06:15.9171349Z  2024-12-18T00:06:15.9173157Z  2024-12-18T00:06:15.9174945Z  2024-12-18T00:06:15.9177140Z  2024-12-18T00:06:15.9179206Z [11,148 / 15,187] 48 actions, 47 running 2024-12-18T00:06:15.9181604Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2024-12-18T00:06:15.9184760Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:06:15.9187395Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:06:15.9191277Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:06:15.9192407Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 12s local 2024-12-18T00:06:15.9193792Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:06:15.9194763Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 10s local 2024-12-18T00:06:15.9195972Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 10s local ... 2024-12-18T00:06:16.2194951Z 2024-12-18T00:06:16.2195794Z  2024-12-18T00:06:16.2196251Z  2024-12-18T00:06:16.2196623Z  2024-12-18T00:06:16.2197020Z  2024-12-18T00:06:16.2197416Z  2024-12-18T00:06:16.2197814Z  2024-12-18T00:06:16.2198209Z  2024-12-18T00:06:16.2198595Z  2024-12-18T00:06:16.2199226Z [11,149 / 15,187] 48 actions running 2024-12-18T00:06:16.2200157Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:06:16.2201298Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:06:16.2202364Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:06:16.2203482Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 12s local 2024-12-18T00:06:16.2204514Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:06:16.2205505Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 10s local 2024-12-18T00:06:16.2206492Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 10s local 2024-12-18T00:06:16.2207468Z Compiling llvm/lib/Transforms/Scalar/LoopDistribute.cpp; 9s local ... 2024-12-18T00:06:16.4675645Z 2024-12-18T00:06:16.4676551Z  2024-12-18T00:06:16.4676965Z  2024-12-18T00:06:16.4677271Z  2024-12-18T00:06:16.4677699Z  2024-12-18T00:06:16.4678073Z  2024-12-18T00:06:16.4678461Z  2024-12-18T00:06:16.4678828Z  2024-12-18T00:06:16.4679190Z  2024-12-18T00:06:16.4679735Z [11,150 / 15,187] 48 actions, 47 running 2024-12-18T00:06:16.4680674Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:06:16.4681760Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:06:16.4682940Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:06:16.4683868Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:06:16.4684808Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 10s local 2024-12-18T00:06:16.4685788Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 10s local 2024-12-18T00:06:16.4686766Z Compiling llvm/lib/Transforms/Scalar/LoopDistribute.cpp; 9s local 2024-12-18T00:06:16.4687796Z Compiling llvm/lib/Transforms/Scalar/LoopFlatten.cpp; 9s local ... 2024-12-18T00:06:16.7358373Z 2024-12-18T00:06:16.7359288Z  2024-12-18T00:06:16.7359735Z  2024-12-18T00:06:16.7360122Z  2024-12-18T00:06:16.7360487Z  2024-12-18T00:06:16.7360872Z  2024-12-18T00:06:16.7361268Z  2024-12-18T00:06:16.7361634Z  2024-12-18T00:06:16.7362041Z  2024-12-18T00:06:16.7362595Z [11,152 / 15,187] 48 actions, 47 running 2024-12-18T00:06:16.7363488Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:06:16.7364510Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:06:16.7365540Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:06:16.7366411Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:06:16.7367327Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 10s local 2024-12-18T00:06:16.7368408Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 10s local 2024-12-18T00:06:16.7369837Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 8s local 2024-12-18T00:06:16.7370950Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 8s local ... 2024-12-18T00:06:16.9717296Z 2024-12-18T00:06:16.9718212Z  2024-12-18T00:06:16.9718708Z  2024-12-18T00:06:16.9719153Z  2024-12-18T00:06:16.9719568Z  2024-12-18T00:06:16.9720015Z  2024-12-18T00:06:16.9720792Z  2024-12-18T00:06:16.9721198Z  2024-12-18T00:06:16.9721586Z  2024-12-18T00:06:16.9722190Z [11,156 / 15,187] 48 actions, 47 running 2024-12-18T00:06:16.9723121Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:06:16.9724185Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:06:16.9725197Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:06:16.9726116Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:06:16.9726978Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 11s local 2024-12-18T00:06:16.9728020Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 8s local 2024-12-18T00:06:16.9729109Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 8s local 2024-12-18T00:06:16.9730309Z Compiling llvm/lib/Transforms/Scalar/LoopLoadElimination.cpp; 8s local ... 2024-12-18T00:06:17.1816287Z 2024-12-18T00:06:17.1817389Z  2024-12-18T00:06:17.1817952Z  2024-12-18T00:06:17.1818384Z  2024-12-18T00:06:17.1818761Z  2024-12-18T00:06:17.1819207Z  2024-12-18T00:06:17.1819594Z  2024-12-18T00:06:17.1819960Z  2024-12-18T00:06:17.1820310Z  2024-12-18T00:06:17.1820877Z [11,159 / 15,187] 48 actions, 47 running 2024-12-18T00:06:17.1821801Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:06:17.1822935Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:06:17.1824000Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:06:17.1824932Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:06:17.1825732Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 11s local 2024-12-18T00:06:17.1826737Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 9s local 2024-12-18T00:06:17.1827888Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 8s local 2024-12-18T00:06:17.1829062Z Compiling llvm/lib/Transforms/Scalar/LoopLoadElimination.cpp; 8s local ... 2024-12-18T00:06:17.4201515Z 2024-12-18T00:06:17.4202419Z  2024-12-18T00:06:17.4202864Z  2024-12-18T00:06:17.4203238Z  2024-12-18T00:06:17.4203630Z  2024-12-18T00:06:17.4204032Z  2024-12-18T00:06:17.4204430Z  2024-12-18T00:06:17.4204824Z  2024-12-18T00:06:17.4205192Z  2024-12-18T00:06:17.4205748Z [11,159 / 15,187] 48 actions running 2024-12-18T00:06:17.4206630Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:06:17.4207750Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:06:17.4208914Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:06:17.4210005Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 13s local 2024-12-18T00:06:17.4211420Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 11s local 2024-12-18T00:06:17.4212565Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 9s local 2024-12-18T00:06:17.4213944Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 8s local 2024-12-18T00:06:17.4215262Z Compiling llvm/lib/Transforms/Scalar/LoopLoadElimination.cpp; 8s local ... 2024-12-18T00:06:17.6521240Z 2024-12-18T00:06:17.6522150Z  2024-12-18T00:06:17.6522644Z  2024-12-18T00:06:17.6523056Z  2024-12-18T00:06:17.6523483Z  2024-12-18T00:06:17.6523882Z  2024-12-18T00:06:17.6524276Z  2024-12-18T00:06:17.6524685Z  2024-12-18T00:06:17.6525405Z  2024-12-18T00:06:17.6525998Z [11,163 / 15,187] 48 actions, 47 running 2024-12-18T00:06:17.6527033Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:06:17.6528255Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:06:17.6529390Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:06:17.6530646Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 11s local 2024-12-18T00:06:17.6531517Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 9s local 2024-12-18T00:06:17.6532512Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 9s local 2024-12-18T00:06:17.6533732Z Compiling llvm/lib/Transforms/Scalar/LoopLoadElimination.cpp; 9s local 2024-12-18T00:06:17.6534953Z Compiling llvm/lib/Transforms/Scalar/LoopPredication.cpp; 8s local ... 2024-12-18T00:06:17.9741933Z 2024-12-18T00:06:17.9742965Z  2024-12-18T00:06:17.9743373Z  2024-12-18T00:06:17.9743840Z  2024-12-18T00:06:17.9744404Z  2024-12-18T00:06:17.9744827Z  2024-12-18T00:06:17.9745232Z  2024-12-18T00:06:17.9745614Z  2024-12-18T00:06:17.9745927Z  2024-12-18T00:06:17.9746402Z [11,168 / 15,187] 48 actions, 47 running 2024-12-18T00:06:17.9747274Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:06:17.9748439Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:06:17.9749459Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:06:17.9750376Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 12s local 2024-12-18T00:06:17.9751357Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 9s local 2024-12-18T00:06:17.9752427Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 9s local 2024-12-18T00:06:17.9753471Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 8s local 2024-12-18T00:06:17.9754623Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 7s local ... 2024-12-18T00:06:18.2209086Z 2024-12-18T00:06:18.2209960Z  2024-12-18T00:06:18.2210402Z  2024-12-18T00:06:18.2210779Z  2024-12-18T00:06:18.2211142Z  2024-12-18T00:06:18.2211462Z  2024-12-18T00:06:18.2211805Z  2024-12-18T00:06:18.2212175Z  2024-12-18T00:06:18.2212549Z  2024-12-18T00:06:18.2213134Z [11,168 / 15,187] 48 actions running 2024-12-18T00:06:18.2213997Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:06:18.2215061Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:06:18.2216092Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:06:18.2217223Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 12s local 2024-12-18T00:06:18.2218190Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 10s local 2024-12-18T00:06:18.2219263Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 9s local 2024-12-18T00:06:18.2220323Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 8s local 2024-12-18T00:06:18.2221424Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 7s local ... 2024-12-18T00:06:18.4213925Z 2024-12-18T00:06:18.4214725Z  2024-12-18T00:06:18.4215151Z  2024-12-18T00:06:18.4215507Z  2024-12-18T00:06:18.4215853Z  2024-12-18T00:06:18.4216275Z  2024-12-18T00:06:18.4216937Z  2024-12-18T00:06:18.4217281Z  2024-12-18T00:06:18.4217608Z  2024-12-18T00:06:18.4218106Z [11,169 / 15,187] 48 actions running 2024-12-18T00:06:18.4218930Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:06:18.4219979Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:06:18.4220881Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:06:18.4221668Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 12s local 2024-12-18T00:06:18.4222895Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 10s local 2024-12-18T00:06:18.4223862Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 9s local 2024-12-18T00:06:18.4224832Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 9s local 2024-12-18T00:06:18.4225968Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 7s local ... 2024-12-18T00:06:18.7849168Z 2024-12-18T00:06:18.7850104Z  2024-12-18T00:06:18.7850630Z  2024-12-18T00:06:18.7851785Z  2024-12-18T00:06:18.7852198Z  2024-12-18T00:06:18.7852599Z  2024-12-18T00:06:18.7853022Z  2024-12-18T00:06:18.7853435Z  2024-12-18T00:06:18.7853854Z  2024-12-18T00:06:18.7854458Z [11,170 / 15,187] 48 actions, 47 running 2024-12-18T00:06:18.7855435Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:06:18.7856754Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:06:18.7857801Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:06:18.7858637Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 12s local 2024-12-18T00:06:18.7859592Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 10s local 2024-12-18T00:06:18.7876428Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 10s local 2024-12-18T00:06:18.7877466Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 9s local 2024-12-18T00:06:18.7878675Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 8s local ... 2024-12-18T00:06:19.0223776Z 2024-12-18T00:06:19.0224706Z  2024-12-18T00:06:19.0225216Z  2024-12-18T00:06:19.0226948Z  2024-12-18T00:06:19.0230031Z  2024-12-18T00:06:19.0232916Z  2024-12-18T00:06:19.0233969Z  2024-12-18T00:06:19.0234554Z  2024-12-18T00:06:19.0235115Z  2024-12-18T00:06:19.0235863Z [11,171 / 15,187] 48 actions running 2024-12-18T00:06:19.0237274Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:06:19.0238645Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:06:19.0239842Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:06:19.0240986Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 13s local 2024-12-18T00:06:19.0242316Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 10s local 2024-12-18T00:06:19.0243549Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 10s local 2024-12-18T00:06:19.0245176Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 9s local 2024-12-18T00:06:19.0246345Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 8s local ... 2024-12-18T00:06:19.3063696Z 2024-12-18T00:06:19.3064511Z  2024-12-18T00:06:19.3064974Z  2024-12-18T00:06:19.3065388Z  2024-12-18T00:06:19.3065770Z  2024-12-18T00:06:19.3066163Z  2024-12-18T00:06:19.3066608Z  2024-12-18T00:06:19.3066991Z  2024-12-18T00:06:19.3067360Z  2024-12-18T00:06:19.3067958Z [11,172 / 15,187] 48 actions, 47 running 2024-12-18T00:06:19.3068868Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:06:19.3069969Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:06:19.3071025Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:06:19.3071949Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 13s local 2024-12-18T00:06:19.3072915Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 11s local 2024-12-18T00:06:19.3074027Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 10s local 2024-12-18T00:06:19.3075119Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 9s local 2024-12-18T00:06:19.3076241Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 8s local ... 2024-12-18T00:06:19.6233267Z 2024-12-18T00:06:19.6234494Z  2024-12-18T00:06:19.6234960Z  2024-12-18T00:06:19.6235332Z  2024-12-18T00:06:19.6235711Z  2024-12-18T00:06:19.6236093Z  2024-12-18T00:06:19.6236483Z  2024-12-18T00:06:19.6236846Z  2024-12-18T00:06:19.6237221Z  2024-12-18T00:06:19.6237782Z [11,172 / 15,187] 48 actions running 2024-12-18T00:06:19.6238960Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:06:19.6240006Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:06:19.6240980Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:06:19.6242009Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 13s local 2024-12-18T00:06:19.6242983Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 11s local 2024-12-18T00:06:19.6244094Z Compiling llvm/lib/Transforms/Scalar/LoopInterchange.cpp; 11s local 2024-12-18T00:06:19.6245477Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 10s local 2024-12-18T00:06:19.6246621Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 9s local ... 2024-12-18T00:06:19.8237734Z 2024-12-18T00:06:19.8238584Z  2024-12-18T00:06:19.8239095Z  2024-12-18T00:06:19.8239496Z  2024-12-18T00:06:19.8239876Z  2024-12-18T00:06:19.8240257Z  2024-12-18T00:06:19.8240658Z  2024-12-18T00:06:19.8241090Z  2024-12-18T00:06:19.8241482Z  2024-12-18T00:06:19.8242108Z [11,173 / 15,187] 48 actions running 2024-12-18T00:06:19.8243011Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:06:19.8244137Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:06:19.8245622Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:06:19.8246482Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 13s local 2024-12-18T00:06:19.8247448Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 11s local 2024-12-18T00:06:19.8248602Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 10s local 2024-12-18T00:06:19.8249684Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 9s local 2024-12-18T00:06:19.8250525Z @llvm-project//llvm:Scalar; 8s local ... 2024-12-18T00:06:20.1613565Z 2024-12-18T00:06:20.1614435Z  2024-12-18T00:06:20.1614826Z  2024-12-18T00:06:20.1615201Z  2024-12-18T00:06:20.1615539Z  2024-12-18T00:06:20.1615883Z  2024-12-18T00:06:20.1616230Z  2024-12-18T00:06:20.1616776Z  2024-12-18T00:06:20.1617132Z  2024-12-18T00:06:20.1617660Z [11,176 / 15,187] 48 actions, 47 running 2024-12-18T00:06:20.1618461Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:06:20.1619424Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:06:20.1620398Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:06:20.1621404Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 12s local 2024-12-18T00:06:20.1622423Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 10s local 2024-12-18T00:06:20.1623290Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 9s local 2024-12-18T00:06:20.1624175Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 8s local 2024-12-18T00:06:20.1625123Z Compiling llvm/lib/Transforms/Scalar/MemCpyOptimizer.cpp; 7s local ... 2024-12-18T00:06:20.4244514Z 2024-12-18T00:06:20.4245377Z  2024-12-18T00:06:20.4245861Z  2024-12-18T00:06:20.4246258Z  2024-12-18T00:06:20.4246644Z  2024-12-18T00:06:20.4247013Z  2024-12-18T00:06:20.4247374Z  2024-12-18T00:06:20.4247744Z  2024-12-18T00:06:20.4248115Z  2024-12-18T00:06:20.4248676Z [11,176 / 15,187] 48 actions running 2024-12-18T00:06:20.4249562Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:06:20.4251101Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:06:20.4252127Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:06:20.4253152Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 12s local 2024-12-18T00:06:20.4254248Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2024-12-18T00:06:20.4255645Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 9s local 2024-12-18T00:06:20.4256834Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 8s local 2024-12-18T00:06:20.4257966Z Compiling llvm/lib/Transforms/Scalar/MemCpyOptimizer.cpp; 8s local ... 2024-12-18T00:06:20.8250488Z 2024-12-18T00:06:20.8251338Z  2024-12-18T00:06:20.8251841Z  2024-12-18T00:06:20.8252250Z  2024-12-18T00:06:20.8252649Z  2024-12-18T00:06:20.8253059Z  2024-12-18T00:06:20.8253469Z  2024-12-18T00:06:20.8253874Z  2024-12-18T00:06:20.8254310Z  2024-12-18T00:06:20.8254890Z [11,178 / 15,187] 48 actions running 2024-12-18T00:06:20.8255859Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:06:20.8257375Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:06:20.8258507Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:06:20.8259646Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 12s local 2024-12-18T00:06:20.8260785Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2024-12-18T00:06:20.8261953Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 10s local 2024-12-18T00:06:20.8263137Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 9s local 2024-12-18T00:06:20.8264375Z Compiling llvm/lib/Transforms/Scalar/MemCpyOptimizer.cpp; 8s local ... 2024-12-18T00:06:21.0254319Z 2024-12-18T00:06:21.0255139Z  2024-12-18T00:06:21.0255608Z  2024-12-18T00:06:21.0256201Z  2024-12-18T00:06:21.0256767Z  2024-12-18T00:06:21.0257156Z  2024-12-18T00:06:21.0257502Z  2024-12-18T00:06:21.0257802Z  2024-12-18T00:06:21.0258147Z  2024-12-18T00:06:21.0258650Z [11,179 / 15,187] 48 actions running 2024-12-18T00:06:21.0259517Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:06:21.0260615Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:06:21.0261691Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:06:21.0262810Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 12s local 2024-12-18T00:06:21.0263972Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2024-12-18T00:06:21.0265096Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 10s local 2024-12-18T00:06:21.0266230Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 9s local 2024-12-18T00:06:21.0267452Z Compiling llvm/lib/Transforms/Scalar/MemCpyOptimizer.cpp; 8s local ... 2024-12-18T00:06:21.2372149Z 2024-12-18T00:06:21.2372971Z  2024-12-18T00:06:21.2373412Z  2024-12-18T00:06:21.2373823Z  2024-12-18T00:06:21.2374211Z  2024-12-18T00:06:21.2374588Z  2024-12-18T00:06:21.2374973Z  2024-12-18T00:06:21.2375363Z  2024-12-18T00:06:21.2375750Z  2024-12-18T00:06:21.2376378Z [11,180 / 15,187] 48 actions, 47 running 2024-12-18T00:06:21.2377464Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:06:21.2378584Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:06:21.2379687Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:06:21.2380784Z Compiling llvm/lib/Transforms/Scalar/LoopIdiomRecognize.cpp; 13s local 2024-12-18T00:06:21.2381994Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2024-12-18T00:06:21.2383547Z Compiling llvm/lib/Transforms/Scalar/LoopUnrollPass.cpp; 10s local 2024-12-18T00:06:21.2384795Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 9s local 2024-12-18T00:06:21.2385810Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 8s local ... 2024-12-18T00:06:21.5135741Z 2024-12-18T00:06:21.5137034Z  2024-12-18T00:06:21.5137508Z  2024-12-18T00:06:21.5138390Z  2024-12-18T00:06:21.5138804Z  2024-12-18T00:06:21.5139207Z  2024-12-18T00:06:21.5139599Z  2024-12-18T00:06:21.5139984Z  2024-12-18T00:06:21.5140368Z  2024-12-18T00:06:21.5140933Z [11,183 / 15,187] 48 actions, 47 running 2024-12-18T00:06:21.5141985Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:06:21.5143031Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:06:21.5144007Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:06:21.5145285Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 12s local 2024-12-18T00:06:21.5146406Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 9s local 2024-12-18T00:06:21.5147393Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 8s local 2024-12-18T00:06:21.5148280Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 7s local 2024-12-18T00:06:21.5149106Z @llvm-project//llvm:Scalar; 7s local ... 2024-12-18T00:06:21.8262245Z 2024-12-18T00:06:21.8263127Z  2024-12-18T00:06:21.8263579Z  2024-12-18T00:06:21.8263965Z  2024-12-18T00:06:21.8264361Z  2024-12-18T00:06:21.8264750Z  2024-12-18T00:06:21.8265137Z  2024-12-18T00:06:21.8265505Z  2024-12-18T00:06:21.8265894Z  2024-12-18T00:06:21.8266431Z [11,185 / 15,187] 48 actions running 2024-12-18T00:06:21.8267325Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:06:21.8268461Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:06:21.8269581Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:06:21.8270676Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 12s local 2024-12-18T00:06:21.8271862Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 10s local 2024-12-18T00:06:21.8272884Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 8s local 2024-12-18T00:06:21.8273789Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 7s local 2024-12-18T00:06:21.8274552Z @llvm-project//llvm:Scalar; 7s local ... 2024-12-18T00:06:22.0266158Z 2024-12-18T00:06:22.0267048Z  2024-12-18T00:06:22.0267543Z  2024-12-18T00:06:22.0268083Z  2024-12-18T00:06:22.0268475Z  2024-12-18T00:06:22.0268869Z  2024-12-18T00:06:22.0269266Z  2024-12-18T00:06:22.0269671Z  2024-12-18T00:06:22.0270063Z  2024-12-18T00:06:22.0270625Z [11,188 / 15,187] 48 actions running 2024-12-18T00:06:22.0271580Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:06:22.0272740Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:06:22.0273842Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:06:22.0274928Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 12s local 2024-12-18T00:06:22.0276147Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 10s local 2024-12-18T00:06:22.0277237Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 8s local 2024-12-18T00:06:22.0278208Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 7s local 2024-12-18T00:06:22.0278997Z @llvm-project//llvm:Scalar; 7s local ... 2024-12-18T00:06:22.4271682Z 2024-12-18T00:06:22.4272519Z  2024-12-18T00:06:22.4273005Z  2024-12-18T00:06:22.4273381Z  2024-12-18T00:06:22.4273764Z  2024-12-18T00:06:22.4274133Z  2024-12-18T00:06:22.4274519Z  2024-12-18T00:06:22.4275306Z  2024-12-18T00:06:22.4275669Z  2024-12-18T00:06:22.4276219Z [11,189 / 15,187] 48 actions running 2024-12-18T00:06:22.4277061Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:06:22.4278174Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:06:22.4281262Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:06:22.4282480Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2024-12-18T00:06:22.4283651Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 10s local 2024-12-18T00:06:22.4284590Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 9s local 2024-12-18T00:06:22.4285455Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 8s local 2024-12-18T00:06:22.4286203Z @llvm-project//llvm:Scalar; 8s local ... 2024-12-18T00:06:22.6274764Z 2024-12-18T00:06:22.6275403Z  2024-12-18T00:06:22.6275796Z  2024-12-18T00:06:22.6276167Z  2024-12-18T00:06:22.6276525Z  2024-12-18T00:06:22.6276864Z  2024-12-18T00:06:22.6277209Z  2024-12-18T00:06:22.6277535Z  2024-12-18T00:06:22.6277872Z  2024-12-18T00:06:22.6278356Z [11,190 / 15,187] 48 actions running 2024-12-18T00:06:22.6279157Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:06:22.6280158Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:06:22.6281090Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:06:22.6282016Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2024-12-18T00:06:22.6283103Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 11s local 2024-12-18T00:06:22.6284105Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 9s local 2024-12-18T00:06:22.6284976Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 8s local 2024-12-18T00:06:22.6285806Z @llvm-project//llvm:Scalar; 8s local ... 2024-12-18T00:06:22.8391661Z 2024-12-18T00:06:22.8392470Z  2024-12-18T00:06:22.8392887Z  2024-12-18T00:06:22.8393265Z  2024-12-18T00:06:22.8393632Z  2024-12-18T00:06:22.8393998Z  2024-12-18T00:06:22.8394349Z  2024-12-18T00:06:22.8394712Z  2024-12-18T00:06:22.8395221Z  2024-12-18T00:06:22.8395796Z [11,192 / 15,187] 48 actions, 47 running 2024-12-18T00:06:22.8396633Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:06:22.8397638Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:06:22.8398635Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:06:22.8399566Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2024-12-18T00:06:22.8400633Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 11s local 2024-12-18T00:06:22.8401571Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 9s local 2024-12-18T00:06:22.8402424Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 8s local 2024-12-18T00:06:22.8403140Z @llvm-project//llvm:Scalar; 8s local ... 2024-12-18T00:06:23.2280972Z 2024-12-18T00:06:23.2281792Z  2024-12-18T00:06:23.2282162Z  2024-12-18T00:06:23.2282456Z  2024-12-18T00:06:23.2282765Z  2024-12-18T00:06:23.2283076Z  2024-12-18T00:06:23.2283410Z  2024-12-18T00:06:23.2283693Z  2024-12-18T00:06:23.2283999Z  2024-12-18T00:06:23.2284444Z [11,193 / 15,187] 48 actions running 2024-12-18T00:06:23.2285133Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:06:23.2285949Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:06:23.2286696Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:06:23.2287462Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2024-12-18T00:06:23.2288689Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 11s local 2024-12-18T00:06:23.2289455Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 10s local 2024-12-18T00:06:23.2290134Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 9s local 2024-12-18T00:06:23.2290746Z @llvm-project//llvm:Scalar; 8s local ... 2024-12-18T00:06:23.4402973Z 2024-12-18T00:06:23.4404166Z  2024-12-18T00:06:23.4404682Z  2024-12-18T00:06:23.4405103Z  2024-12-18T00:06:23.4405508Z  2024-12-18T00:06:23.4405919Z  2024-12-18T00:06:23.4406303Z  2024-12-18T00:06:23.4406694Z  2024-12-18T00:06:23.4407097Z  2024-12-18T00:06:23.4407679Z [11,194 / 15,187] 48 actions, 47 running 2024-12-18T00:06:23.4408561Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:06:23.4409705Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:06:23.4410817Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:06:23.4411976Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2024-12-18T00:06:23.4413108Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 11s local 2024-12-18T00:06:23.4414090Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 10s local 2024-12-18T00:06:23.4415032Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 9s local 2024-12-18T00:06:23.4415825Z @llvm-project//llvm:Scalar; 9s local ... 2024-12-18T00:06:23.7180642Z 2024-12-18T00:06:23.7181523Z  2024-12-18T00:06:23.7181985Z  2024-12-18T00:06:23.7182371Z  2024-12-18T00:06:23.7182754Z  2024-12-18T00:06:23.7183158Z  2024-12-18T00:06:23.7183557Z  2024-12-18T00:06:23.7183898Z  2024-12-18T00:06:23.7184267Z  2024-12-18T00:06:23.7184846Z [11,195 / 15,187] 48 actions, 47 running 2024-12-18T00:06:23.7185757Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:06:23.7186832Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:06:23.7187846Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:06:23.7188839Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2024-12-18T00:06:23.7190062Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 12s local 2024-12-18T00:06:23.7191191Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 10s local 2024-12-18T00:06:23.7192079Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 9s local 2024-12-18T00:06:23.7192871Z @llvm-project//llvm:Scalar; 9s local ... 2024-12-18T00:06:24.0288716Z 2024-12-18T00:06:24.0289613Z  2024-12-18T00:06:24.0290031Z  2024-12-18T00:06:24.0290390Z  2024-12-18T00:06:24.0290757Z  2024-12-18T00:06:24.0291136Z  2024-12-18T00:06:24.0291488Z  2024-12-18T00:06:24.0291836Z  2024-12-18T00:06:24.0292206Z  2024-12-18T00:06:24.0292788Z [11,197 / 15,187] 47 actions running 2024-12-18T00:06:24.0293682Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:06:24.0294741Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:06:24.0295740Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:06:24.0296999Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2024-12-18T00:06:24.0298190Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 12s local 2024-12-18T00:06:24.0299224Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 10s local 2024-12-18T00:06:24.0300095Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 9s local 2024-12-18T00:06:24.0300827Z @llvm-project//llvm:Scalar; 9s local ... 2024-12-18T00:06:24.3096873Z 2024-12-18T00:06:24.3097738Z  2024-12-18T00:06:24.3098173Z  2024-12-18T00:06:24.3098509Z  2024-12-18T00:06:24.3098844Z  2024-12-18T00:06:24.3099502Z  2024-12-18T00:06:24.3099839Z  2024-12-18T00:06:24.3100163Z  2024-12-18T00:06:24.3100500Z  2024-12-18T00:06:24.3101036Z [11,198 / 15,187] 48 actions, 47 running 2024-12-18T00:06:24.3101855Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 32s local 2024-12-18T00:06:24.3103009Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:06:24.3103905Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:06:24.3104817Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2024-12-18T00:06:24.3105834Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 12s local 2024-12-18T00:06:24.3106744Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 11s local 2024-12-18T00:06:24.3107576Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 10s local 2024-12-18T00:06:24.3108309Z @llvm-project//llvm:Scalar; 10s local ... 2024-12-18T00:06:24.6067439Z 2024-12-18T00:06:24.6068328Z  2024-12-18T00:06:24.6068807Z  2024-12-18T00:06:24.6069198Z  2024-12-18T00:06:24.6069624Z  2024-12-18T00:06:24.6070011Z  2024-12-18T00:06:24.6070389Z  2024-12-18T00:06:24.6070771Z  2024-12-18T00:06:24.6071160Z  2024-12-18T00:06:24.6071753Z [11,199 / 15,187] 48 actions, 47 running 2024-12-18T00:06:24.6072719Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 32s local 2024-12-18T00:06:24.6073781Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:06:24.6074789Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:06:24.6075869Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 15s local 2024-12-18T00:06:24.6077013Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 12s local 2024-12-18T00:06:24.6078081Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 11s local 2024-12-18T00:06:24.6079023Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 10s local 2024-12-18T00:06:24.6079824Z @llvm-project//llvm:Scalar; 10s local ... 2024-12-18T00:06:24.8182684Z 2024-12-18T00:06:24.8183529Z  2024-12-18T00:06:24.8183977Z  2024-12-18T00:06:24.8184323Z  2024-12-18T00:06:24.8184694Z  2024-12-18T00:06:24.8185058Z  2024-12-18T00:06:24.8185435Z  2024-12-18T00:06:24.8185861Z  2024-12-18T00:06:24.8186267Z  2024-12-18T00:06:24.8186818Z [11,204 / 15,187] 48 actions, 47 running 2024-12-18T00:06:24.8187674Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:06:24.8188686Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:06:24.8189684Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 15s local 2024-12-18T00:06:24.8190807Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 13s local 2024-12-18T00:06:24.8191819Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 11s local 2024-12-18T00:06:24.8192750Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 10s local 2024-12-18T00:06:24.8193534Z @llvm-project//llvm:Scalar; 10s local 2024-12-18T00:06:24.8194247Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 10s local ... 2024-12-18T00:06:25.0296896Z 2024-12-18T00:06:25.0297759Z  2024-12-18T00:06:25.0298247Z  2024-12-18T00:06:25.0298681Z  2024-12-18T00:06:25.0299079Z  2024-12-18T00:06:25.0299471Z  2024-12-18T00:06:25.0299866Z  2024-12-18T00:06:25.0300232Z  2024-12-18T00:06:25.0300615Z  2024-12-18T00:06:25.0301171Z [11,205 / 15,187] 48 actions running 2024-12-18T00:06:25.0302078Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:06:25.0303260Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:06:25.0304308Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 15s local 2024-12-18T00:06:25.0305907Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 13s local 2024-12-18T00:06:25.0306945Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 11s local 2024-12-18T00:06:25.0307840Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 10s local 2024-12-18T00:06:25.0308651Z @llvm-project//llvm:Scalar; 10s local 2024-12-18T00:06:25.0309646Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 10s local ... 2024-12-18T00:06:25.3492857Z 2024-12-18T00:06:25.3493773Z  2024-12-18T00:06:25.3494217Z  2024-12-18T00:06:25.3494567Z  2024-12-18T00:06:25.3494958Z  2024-12-18T00:06:25.3495346Z  2024-12-18T00:06:25.3495738Z  2024-12-18T00:06:25.3496149Z  2024-12-18T00:06:25.3496524Z  2024-12-18T00:06:25.3497303Z [11,207 / 15,187] 48 actions, 47 running 2024-12-18T00:06:25.3498296Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:06:25.3499375Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:06:25.3500666Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 15s local 2024-12-18T00:06:25.3501789Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 13s local 2024-12-18T00:06:25.3502781Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 12s local 2024-12-18T00:06:25.3503745Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 11s local 2024-12-18T00:06:25.3504545Z @llvm-project//llvm:Scalar; 11s local 2024-12-18T00:06:25.3505259Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local ... 2024-12-18T00:06:25.5545699Z 2024-12-18T00:06:25.5546597Z  2024-12-18T00:06:25.5547067Z  2024-12-18T00:06:25.5547456Z  2024-12-18T00:06:25.5547841Z  2024-12-18T00:06:25.5548227Z  2024-12-18T00:06:25.5548623Z  2024-12-18T00:06:25.5549001Z  2024-12-18T00:06:25.5549386Z  2024-12-18T00:06:25.5549972Z [11,208 / 15,187] 48 actions, 47 running 2024-12-18T00:06:25.5550897Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:06:25.5551930Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:06:25.5552962Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2024-12-18T00:06:25.5554153Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 13s local 2024-12-18T00:06:25.5555245Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 12s local 2024-12-18T00:06:25.5556218Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 11s local 2024-12-18T00:06:25.5557036Z @llvm-project//llvm:Scalar; 11s local 2024-12-18T00:06:25.5557807Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local ... 2024-12-18T00:06:25.8304041Z 2024-12-18T00:06:25.8304888Z  2024-12-18T00:06:25.8305340Z  2024-12-18T00:06:25.8305741Z  2024-12-18T00:06:25.8306152Z  2024-12-18T00:06:25.8306528Z  2024-12-18T00:06:25.8306897Z  2024-12-18T00:06:25.8307318Z  2024-12-18T00:06:25.8307676Z  2024-12-18T00:06:25.8308248Z [11,209 / 15,187] 48 actions running 2024-12-18T00:06:25.8309134Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:06:25.8310138Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:06:25.8311195Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2024-12-18T00:06:25.8312394Z Compiling llvm/lib/Transforms/Scalar/LowerMatrixIntrinsics.cpp; 14s local 2024-12-18T00:06:25.8313443Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 12s local 2024-12-18T00:06:25.8314385Z Compiling llvm/lib/Transforms/Scalar/Reassociate.cpp; 11s local 2024-12-18T00:06:25.8315234Z @llvm-project//llvm:Scalar; 11s local 2024-12-18T00:06:25.8315944Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local ... 2024-12-18T00:06:26.1426125Z 2024-12-18T00:06:26.1427130Z  2024-12-18T00:06:26.1427549Z  2024-12-18T00:06:26.1428265Z  2024-12-18T00:06:26.1428617Z  2024-12-18T00:06:26.1428949Z  2024-12-18T00:06:26.1429299Z  2024-12-18T00:06:26.1429651Z  2024-12-18T00:06:26.1430007Z  2024-12-18T00:06:26.1430533Z [11,212 / 15,187] 48 actions, 47 running 2024-12-18T00:06:26.1431324Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:06:26.1432453Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:06:26.1433341Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2024-12-18T00:06:26.1434225Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 12s local 2024-12-18T00:06:26.1434877Z @llvm-project//llvm:Scalar; 11s local 2024-12-18T00:06:26.1435487Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local 2024-12-18T00:06:26.1436369Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 10s local 2024-12-18T00:06:26.1437402Z Compiling llvm/lib/Transforms/Scalar/StructurizeCFG.cpp; 10s local ... 2024-12-18T00:06:26.3562521Z 2024-12-18T00:06:26.3563363Z  2024-12-18T00:06:26.3563829Z  2024-12-18T00:06:26.3564253Z  2024-12-18T00:06:26.3564664Z  2024-12-18T00:06:26.3565077Z  2024-12-18T00:06:26.3565489Z  2024-12-18T00:06:26.3565892Z  2024-12-18T00:06:26.3566294Z  2024-12-18T00:06:26.3566955Z [11,218 / 15,187] 48 actions, 47 running 2024-12-18T00:06:26.3567884Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:06:26.3568995Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:06:26.3570132Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2024-12-18T00:06:26.3571237Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local 2024-12-18T00:06:26.3572132Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:06:26.3573228Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 10s local 2024-12-18T00:06:26.3574503Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:06:26.3575495Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:06:26.6308670Z 2024-12-18T00:06:26.6309478Z  2024-12-18T00:06:26.6309959Z  2024-12-18T00:06:26.6310705Z  2024-12-18T00:06:26.6311109Z  2024-12-18T00:06:26.6311487Z  2024-12-18T00:06:26.6311917Z  2024-12-18T00:06:26.6312304Z  2024-12-18T00:06:26.6312709Z  2024-12-18T00:06:26.6313272Z [11,219 / 15,187] 48 actions running 2024-12-18T00:06:26.6314201Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:06:26.6315299Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:06:26.6316401Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local 2024-12-18T00:06:26.6317475Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local 2024-12-18T00:06:26.6318358Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:06:26.6319350Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 11s local 2024-12-18T00:06:26.6320549Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:06:26.6321503Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:06:26.8311325Z 2024-12-18T00:06:26.8312607Z  2024-12-18T00:06:26.8313150Z  2024-12-18T00:06:26.8313517Z  2024-12-18T00:06:26.8313912Z  2024-12-18T00:06:26.8314326Z  2024-12-18T00:06:26.8314709Z  2024-12-18T00:06:26.8315090Z  2024-12-18T00:06:26.8315452Z  2024-12-18T00:06:26.8316015Z [11,220 / 15,187] 48 actions running 2024-12-18T00:06:26.8316917Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:06:26.8317963Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:06:26.8319178Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local 2024-12-18T00:06:26.8320594Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local 2024-12-18T00:06:26.8321448Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:06:26.8322432Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 11s local 2024-12-18T00:06:26.8323634Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:06:26.8324941Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:06:27.1903018Z 2024-12-18T00:06:27.1904220Z  2024-12-18T00:06:27.1904701Z  2024-12-18T00:06:27.1905092Z  2024-12-18T00:06:27.1905521Z  2024-12-18T00:06:27.1905943Z  2024-12-18T00:06:27.1906325Z  2024-12-18T00:06:27.1906709Z  2024-12-18T00:06:27.1907103Z  2024-12-18T00:06:27.1907709Z [11,222 / 15,187] 48 actions, 47 running 2024-12-18T00:06:27.1908666Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:06:27.1909818Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:06:27.1910910Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local 2024-12-18T00:06:27.1911985Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local 2024-12-18T00:06:27.1912967Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:06:27.1914133Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 11s local 2024-12-18T00:06:27.1915449Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:06:27.1916537Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:06:27.4318075Z 2024-12-18T00:06:27.4319016Z  2024-12-18T00:06:27.4319525Z  2024-12-18T00:06:27.4319933Z  2024-12-18T00:06:27.4320339Z  2024-12-18T00:06:27.4320748Z  2024-12-18T00:06:27.4321134Z  2024-12-18T00:06:27.4321534Z  2024-12-18T00:06:27.4321936Z  2024-12-18T00:06:27.4322530Z [11,223 / 15,187] 48 actions running 2024-12-18T00:06:27.4323559Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:06:27.4324651Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:06:27.4325672Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2024-12-18T00:06:27.4326743Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local 2024-12-18T00:06:27.4327641Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:06:27.4328648Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 11s local 2024-12-18T00:06:27.4329891Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:06:27.4330931Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:06:27.6321854Z 2024-12-18T00:06:27.6322790Z  2024-12-18T00:06:27.6323271Z  2024-12-18T00:06:27.6323652Z  2024-12-18T00:06:27.6324052Z  2024-12-18T00:06:27.6324529Z  2024-12-18T00:06:27.6324936Z  2024-12-18T00:06:27.6325319Z  2024-12-18T00:06:27.6325704Z  2024-12-18T00:06:27.6326286Z [11,224 / 15,187] 48 actions running 2024-12-18T00:06:27.6327246Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:06:27.6328411Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:06:27.6329565Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2024-12-18T00:06:27.6330615Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local 2024-12-18T00:06:27.6331529Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:06:27.6332572Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:06:27.6333807Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:06:27.6334859Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:06:27.9479572Z 2024-12-18T00:06:27.9481185Z  2024-12-18T00:06:27.9481653Z  2024-12-18T00:06:27.9482060Z  2024-12-18T00:06:27.9482468Z  2024-12-18T00:06:27.9482885Z  2024-12-18T00:06:27.9483251Z  2024-12-18T00:06:27.9483680Z  2024-12-18T00:06:27.9484082Z  2024-12-18T00:06:27.9484711Z [11,228 / 15,187] 48 actions, 47 running 2024-12-18T00:06:27.9486004Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:06:27.9487129Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:06:27.9488212Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2024-12-18T00:06:27.9489387Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local 2024-12-18T00:06:27.9490247Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:06:27.9491291Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:06:27.9492454Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:06:27.9493482Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:06:28.2326967Z 2024-12-18T00:06:28.2328159Z  2024-12-18T00:06:28.2328642Z  2024-12-18T00:06:28.2329047Z  2024-12-18T00:06:28.2329434Z  2024-12-18T00:06:28.2329796Z  2024-12-18T00:06:28.2330194Z  2024-12-18T00:06:28.2330587Z  2024-12-18T00:06:28.2331013Z  2024-12-18T00:06:28.2331712Z [11,229 / 15,187] 48 actions running 2024-12-18T00:06:28.2332587Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:06:28.2333590Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:06:28.2334673Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2024-12-18T00:06:28.2335695Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2024-12-18T00:06:28.2336773Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:06:28.2337835Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:06:28.2339083Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:06:28.2340101Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:06:28.4332589Z 2024-12-18T00:06:28.4333536Z  2024-12-18T00:06:28.4334045Z  2024-12-18T00:06:28.4334430Z  2024-12-18T00:06:28.4334860Z  2024-12-18T00:06:28.4335265Z  2024-12-18T00:06:28.4335677Z  2024-12-18T00:06:28.4336069Z  2024-12-18T00:06:28.4336410Z  2024-12-18T00:06:28.4337083Z [11,230 / 15,187] 48 actions running 2024-12-18T00:06:28.4338002Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:06:28.4339132Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:06:28.4340227Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2024-12-18T00:06:28.4341352Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2024-12-18T00:06:28.4342282Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2024-12-18T00:06:28.4343351Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:06:28.4344805Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:06:28.4345870Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:06:28.8338172Z 2024-12-18T00:06:28.8339114Z  2024-12-18T00:06:28.8339719Z  2024-12-18T00:06:28.8340231Z  2024-12-18T00:06:28.8340662Z  2024-12-18T00:06:28.8341028Z  2024-12-18T00:06:28.8341386Z  2024-12-18T00:06:28.8341725Z  2024-12-18T00:06:28.8342107Z  2024-12-18T00:06:28.8342686Z [11,231 / 15,187] 48 actions running 2024-12-18T00:06:28.8343649Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:06:28.8344926Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:06:28.8346359Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2024-12-18T00:06:28.8347402Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2024-12-18T00:06:28.8348302Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2024-12-18T00:06:28.8349348Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 13s local 2024-12-18T00:06:28.8350872Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:06:28.8352008Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:06:29.0341737Z 2024-12-18T00:06:29.0342651Z  2024-12-18T00:06:29.0343119Z  2024-12-18T00:06:29.0343537Z  2024-12-18T00:06:29.0343944Z  2024-12-18T00:06:29.0344576Z  2024-12-18T00:06:29.0344960Z  2024-12-18T00:06:29.0345371Z  2024-12-18T00:06:29.0345777Z  2024-12-18T00:06:29.0346364Z [11,232 / 15,187] 48 actions running 2024-12-18T00:06:29.0347371Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:06:29.0348458Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:06:29.0349566Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2024-12-18T00:06:29.0350631Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2024-12-18T00:06:29.0351552Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2024-12-18T00:06:29.0352521Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 13s local 2024-12-18T00:06:29.0353837Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 12s local 2024-12-18T00:06:29.0354827Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:29.2625389Z 2024-12-18T00:06:29.2626237Z  2024-12-18T00:06:29.2626721Z  2024-12-18T00:06:29.2627097Z  2024-12-18T00:06:29.2627499Z  2024-12-18T00:06:29.2627949Z  2024-12-18T00:06:29.2628413Z  2024-12-18T00:06:29.2628852Z  2024-12-18T00:06:29.2629244Z  2024-12-18T00:06:29.2629829Z [11,236 / 15,187] 48 actions, 47 running 2024-12-18T00:06:29.2630865Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:06:29.2631909Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:06:29.2632990Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2024-12-18T00:06:29.2634082Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 16s local 2024-12-18T00:06:29.2634897Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2024-12-18T00:06:29.2635843Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 13s local 2024-12-18T00:06:29.2636704Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:06:29.2637350Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:29.5316546Z 2024-12-18T00:06:29.5317463Z  2024-12-18T00:06:29.5318082Z  2024-12-18T00:06:29.5318517Z  2024-12-18T00:06:29.5318893Z  2024-12-18T00:06:29.5319257Z  2024-12-18T00:06:29.5319625Z  2024-12-18T00:06:29.5320012Z  2024-12-18T00:06:29.5320399Z  2024-12-18T00:06:29.5320987Z [11,239 / 15,187] 48 actions, 47 running 2024-12-18T00:06:29.5321901Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:06:29.5322965Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:06:29.5324085Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:06:29.5325059Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 16s local 2024-12-18T00:06:29.5325901Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2024-12-18T00:06:29.5326895Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:06:29.5327785Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:06:29.5328491Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:29.8109986Z 2024-12-18T00:06:29.8110935Z  2024-12-18T00:06:29.8111431Z  2024-12-18T00:06:29.8111846Z  2024-12-18T00:06:29.8112282Z  2024-12-18T00:06:29.8112832Z  2024-12-18T00:06:29.8113236Z  2024-12-18T00:06:29.8113641Z  2024-12-18T00:06:29.8114041Z  2024-12-18T00:06:29.8114506Z [11,241 / 15,187] 48 actions, 47 running 2024-12-18T00:06:29.8115865Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:06:29.8116816Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:06:29.8117764Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:06:29.8118747Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2024-12-18T00:06:29.8119743Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:06:29.8120653Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:06:29.8121542Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:06:29.8122568Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:30.0353502Z 2024-12-18T00:06:30.0354389Z  2024-12-18T00:06:30.0354840Z  2024-12-18T00:06:30.0355223Z  2024-12-18T00:06:30.0355578Z  2024-12-18T00:06:30.0355954Z  2024-12-18T00:06:30.0356328Z  2024-12-18T00:06:30.0356749Z  2024-12-18T00:06:30.0357126Z  2024-12-18T00:06:30.0357679Z [11,243 / 15,187] 48 actions running 2024-12-18T00:06:30.0358583Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:06:30.0359614Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:06:30.0360689Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:06:30.0361688Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2024-12-18T00:06:30.0362696Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:06:30.0363637Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:30.0364582Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:06:30.0365511Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:30.2354427Z 2024-12-18T00:06:30.2355343Z  2024-12-18T00:06:30.2355813Z  2024-12-18T00:06:30.2356238Z  2024-12-18T00:06:30.2356625Z  2024-12-18T00:06:30.2357016Z  2024-12-18T00:06:30.2357409Z  2024-12-18T00:06:30.2357777Z  2024-12-18T00:06:30.2358173Z  2024-12-18T00:06:30.2358726Z [11,245 / 15,187] 48 actions running 2024-12-18T00:06:30.2359644Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:06:30.2360724Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:06:30.2361751Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:06:30.2362777Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2024-12-18T00:06:30.2363761Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:06:30.2364665Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:30.2365592Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:06:30.2366729Z @llvm-project//llvm:InstCombine; 13s local ... 2024-12-18T00:06:30.5360379Z 2024-12-18T00:06:30.5361215Z  2024-12-18T00:06:30.5361628Z  2024-12-18T00:06:30.5361999Z  2024-12-18T00:06:30.5362367Z  2024-12-18T00:06:30.5362726Z  2024-12-18T00:06:30.5363080Z  2024-12-18T00:06:30.5363446Z  2024-12-18T00:06:30.5363807Z  2024-12-18T00:06:30.5364352Z [11,246 / 15,187] 47 actions, 46 running 2024-12-18T00:06:30.5365176Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:06:30.5366104Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:06:30.5367348Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 16s local 2024-12-18T00:06:30.5368271Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2024-12-18T00:06:30.5369086Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:30.5369914Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:06:30.5371054Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:30.5371664Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:30.8050542Z 2024-12-18T00:06:30.8051464Z  2024-12-18T00:06:30.8051903Z  2024-12-18T00:06:30.8052286Z  2024-12-18T00:06:30.8052641Z  2024-12-18T00:06:30.8053059Z  2024-12-18T00:06:30.8053434Z  2024-12-18T00:06:30.8053806Z  2024-12-18T00:06:30.8054192Z  2024-12-18T00:06:30.8054781Z [11,249 / 15,187] 48 actions, 47 running 2024-12-18T00:06:30.8055635Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:06:30.8056799Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:06:30.8057774Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2024-12-18T00:06:30.8058657Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:30.8059719Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:06:30.8060621Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:30.8061503Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2024-12-18T00:06:30.8062423Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:06:31.0360479Z 2024-12-18T00:06:31.0361392Z  2024-12-18T00:06:31.0361878Z  2024-12-18T00:06:31.0362263Z  2024-12-18T00:06:31.0362640Z  2024-12-18T00:06:31.0373396Z  2024-12-18T00:06:31.0374109Z  2024-12-18T00:06:31.0374527Z  2024-12-18T00:06:31.0374907Z  2024-12-18T00:06:31.0375479Z [11,251 / 15,187] 48 actions running 2024-12-18T00:06:31.0376378Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:06:31.0377612Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:06:31.0378610Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2024-12-18T00:06:31.0379558Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:31.0380454Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:06:31.0381383Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:31.0382311Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2024-12-18T00:06:31.0383194Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:31.2364083Z 2024-12-18T00:06:31.2364956Z  2024-12-18T00:06:31.2365416Z  2024-12-18T00:06:31.2365796Z  2024-12-18T00:06:31.2366182Z  2024-12-18T00:06:31.2366752Z  2024-12-18T00:06:31.2367097Z  2024-12-18T00:06:31.2367430Z  2024-12-18T00:06:31.2367750Z  2024-12-18T00:06:31.2368267Z [11,252 / 15,187] 48 actions, 47 running 2024-12-18T00:06:31.2369060Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:06:31.2369970Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:06:31.2370892Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2024-12-18T00:06:31.2371650Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:31.2372431Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:06:31.2373234Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:31.2374003Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2024-12-18T00:06:31.2374812Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:06:31.5451477Z 2024-12-18T00:06:31.5452411Z  2024-12-18T00:06:31.5453289Z  2024-12-18T00:06:31.5453712Z  2024-12-18T00:06:31.5454100Z  2024-12-18T00:06:31.5454482Z  2024-12-18T00:06:31.5454915Z  2024-12-18T00:06:31.5455292Z  2024-12-18T00:06:31.5455691Z  2024-12-18T00:06:31.5456296Z [11,254 / 15,187] 47 actions, 46 running 2024-12-18T00:06:31.5457808Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:06:31.5458833Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:06:31.5459833Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2024-12-18T00:06:31.5460729Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:31.5461681Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:06:31.5462636Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:31.5463276Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:06:31.5464100Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local ... 2024-12-18T00:06:31.7775724Z 2024-12-18T00:06:31.7776820Z  2024-12-18T00:06:31.7777376Z  2024-12-18T00:06:31.7777782Z  2024-12-18T00:06:31.7778138Z  2024-12-18T00:06:31.7778556Z  2024-12-18T00:06:31.7778982Z  2024-12-18T00:06:31.7779388Z  2024-12-18T00:06:31.7779796Z  2024-12-18T00:06:31.7780850Z [11,256 / 15,187] 48 actions, 47 running 2024-12-18T00:06:31.7781996Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:06:31.7783280Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:06:31.7784537Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2024-12-18T00:06:31.7785892Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:06:31.7787048Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:31.7787866Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:06:31.7788907Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:06:31.7790174Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local ... 2024-12-18T00:06:32.0370151Z 2024-12-18T00:06:32.0371041Z  2024-12-18T00:06:32.0371523Z  2024-12-18T00:06:32.0371902Z  2024-12-18T00:06:32.0372274Z  2024-12-18T00:06:32.0372676Z  2024-12-18T00:06:32.0373104Z  2024-12-18T00:06:32.0373518Z  2024-12-18T00:06:32.0373918Z  2024-12-18T00:06:32.0374464Z [11,256 / 15,187] 48 actions running 2024-12-18T00:06:32.0375369Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:06:32.0376451Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:06:32.0377762Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2024-12-18T00:06:32.0378942Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:06:32.0379941Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:32.0381075Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:32.0381923Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2024-12-18T00:06:32.0382939Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local ... 2024-12-18T00:06:32.2374313Z 2024-12-18T00:06:32.2375216Z  2024-12-18T00:06:32.2375749Z  2024-12-18T00:06:32.2376322Z  2024-12-18T00:06:32.2376893Z  2024-12-18T00:06:32.2377280Z  2024-12-18T00:06:32.2377648Z  2024-12-18T00:06:32.2378011Z  2024-12-18T00:06:32.2378391Z  2024-12-18T00:06:32.2378925Z [11,258 / 15,187] 48 actions running 2024-12-18T00:06:32.2379833Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:06:32.2380901Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:06:32.2381934Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2024-12-18T00:06:32.2383536Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:06:32.2384381Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:32.2385004Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:32.2385809Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2024-12-18T00:06:32.2387016Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local ... 2024-12-18T00:06:32.5104726Z 2024-12-18T00:06:32.5105691Z  2024-12-18T00:06:32.5106196Z  2024-12-18T00:06:32.5106583Z  2024-12-18T00:06:32.5106993Z  2024-12-18T00:06:32.5107369Z  2024-12-18T00:06:32.5107764Z  2024-12-18T00:06:32.5108162Z  2024-12-18T00:06:32.5108523Z  2024-12-18T00:06:32.5109139Z [11,261 / 15,187] 48 actions, 47 running 2024-12-18T00:06:32.5110092Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:06:32.5111315Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:06:32.5112319Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:06:32.5113412Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:06:32.5114253Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:32.5114921Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:32.5115713Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local 2024-12-18T00:06:32.5116497Z Compiling xla/literal_comparison.cc; 9s local ... 2024-12-18T00:06:32.8380578Z 2024-12-18T00:06:32.8382007Z  2024-12-18T00:06:32.8382441Z  2024-12-18T00:06:32.8383950Z  2024-12-18T00:06:32.8384876Z  2024-12-18T00:06:32.8386057Z  2024-12-18T00:06:32.8387260Z  2024-12-18T00:06:32.8388612Z  2024-12-18T00:06:32.8389765Z  2024-12-18T00:06:32.8391236Z [11,263 / 15,187] 48 actions running 2024-12-18T00:06:32.8392400Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:06:32.8393359Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:06:32.8394688Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:06:32.8395948Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:06:32.8397093Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:32.8397798Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:06:32.8398602Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2024-12-18T00:06:32.8399462Z Compiling xla/literal_comparison.cc; 9s local ... 2024-12-18T00:06:33.1442149Z 2024-12-18T00:06:33.1443607Z  2024-12-18T00:06:33.1444063Z  2024-12-18T00:06:33.1445794Z  2024-12-18T00:06:33.1446722Z  2024-12-18T00:06:33.1448043Z  2024-12-18T00:06:33.1449165Z  2024-12-18T00:06:33.1450566Z  2024-12-18T00:06:33.1451703Z  2024-12-18T00:06:33.1453256Z [11,265 / 15,187] 47 actions, 46 running 2024-12-18T00:06:33.1454430Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:06:33.1455375Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:06:33.1456863Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:06:33.1458092Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:06:33.1459034Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:33.1459668Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:33.1460453Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2024-12-18T00:06:33.1461281Z Compiling xla/literal_comparison.cc; 9s local ... 2024-12-18T00:06:33.4386167Z 2024-12-18T00:06:33.4387673Z  2024-12-18T00:06:33.4388093Z  2024-12-18T00:06:33.4389562Z  2024-12-18T00:06:33.4390469Z  2024-12-18T00:06:33.4391593Z  2024-12-18T00:06:33.4392041Z  2024-12-18T00:06:33.4392458Z  2024-12-18T00:06:33.4392841Z  2024-12-18T00:06:33.4393388Z [11,265 / 15,187] 48 actions running 2024-12-18T00:06:33.4394331Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:06:33.4395711Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2024-12-18T00:06:33.4396857Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:06:33.4398079Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:06:33.4399069Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:06:33.4399661Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:33.4400381Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2024-12-18T00:06:33.4401266Z Compiling xla/literal_comparison.cc; 9s local ... 2024-12-18T00:06:33.7565200Z 2024-12-18T00:06:33.7566306Z  2024-12-18T00:06:33.7566756Z  2024-12-18T00:06:33.7567169Z  2024-12-18T00:06:33.7567571Z  2024-12-18T00:06:33.7567904Z  2024-12-18T00:06:33.7568296Z  2024-12-18T00:06:33.7568666Z  2024-12-18T00:06:33.7569033Z  2024-12-18T00:06:33.7569626Z [11,266 / 15,187] 48 actions, 47 running 2024-12-18T00:06:33.7570641Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:06:33.7571733Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2024-12-18T00:06:33.7572867Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:06:33.7573787Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:06:33.7574425Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:06:33.7575153Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2024-12-18T00:06:33.7575932Z Compiling xla/literal_comparison.cc; 10s local 2024-12-18T00:06:33.7576948Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local ... 2024-12-18T00:06:34.0394197Z 2024-12-18T00:06:34.0395277Z  2024-12-18T00:06:34.0395741Z  2024-12-18T00:06:34.0396141Z  2024-12-18T00:06:34.0396539Z  2024-12-18T00:06:34.0396915Z  2024-12-18T00:06:34.0397305Z  2024-12-18T00:06:34.0397700Z  2024-12-18T00:06:34.0398078Z  2024-12-18T00:06:34.0398670Z [11,268 / 15,187] 48 actions running 2024-12-18T00:06:34.0399617Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:06:34.0400795Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2024-12-18T00:06:34.0401990Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:06:34.0402985Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:06:34.0403675Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:34.0404481Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2024-12-18T00:06:34.0405355Z Compiling xla/literal_comparison.cc; 10s local 2024-12-18T00:06:34.0406173Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local ... 2024-12-18T00:06:34.2465659Z 2024-12-18T00:06:34.2466540Z  2024-12-18T00:06:34.2467004Z  2024-12-18T00:06:34.2467409Z  2024-12-18T00:06:34.2467793Z  2024-12-18T00:06:34.2468206Z  2024-12-18T00:06:34.2468642Z  2024-12-18T00:06:34.2469035Z  2024-12-18T00:06:34.2469435Z  2024-12-18T00:06:34.2470026Z [11,269 / 15,187] 48 actions, 47 running 2024-12-18T00:06:34.2470942Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:06:34.2472028Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2024-12-18T00:06:34.2473207Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2024-12-18T00:06:34.2474139Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:34.2474778Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:34.2476015Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2024-12-18T00:06:34.2476829Z Compiling xla/literal_comparison.cc; 10s local 2024-12-18T00:06:34.2477673Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local ... 2024-12-18T00:06:34.6400524Z 2024-12-18T00:06:34.6401400Z  2024-12-18T00:06:34.6401882Z  2024-12-18T00:06:34.6402694Z  2024-12-18T00:06:34.6403108Z  2024-12-18T00:06:34.6403515Z  2024-12-18T00:06:34.6403915Z  2024-12-18T00:06:34.6404305Z  2024-12-18T00:06:34.6404716Z  2024-12-18T00:06:34.6405272Z [11,270 / 15,187] 48 actions running 2024-12-18T00:06:34.6406187Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:06:34.6407349Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 19s local 2024-12-18T00:06:34.6408546Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2024-12-18T00:06:34.6409537Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:34.6410196Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:34.6410975Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2024-12-18T00:06:34.6411804Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:06:34.6412689Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 10s local ... 2024-12-18T00:06:34.8404480Z 2024-12-18T00:06:34.8405327Z  2024-12-18T00:06:34.8405784Z  2024-12-18T00:06:34.8406160Z  2024-12-18T00:06:34.8406566Z  2024-12-18T00:06:34.8406955Z  2024-12-18T00:06:34.8407350Z  2024-12-18T00:06:34.8407733Z  2024-12-18T00:06:34.8408125Z  2024-12-18T00:06:34.8408694Z [11,274 / 15,187] 47 actions running 2024-12-18T00:06:34.8409655Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:06:34.8410594Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:34.8411257Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:06:34.8412040Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:06:34.8412881Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:06:34.8413765Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local 2024-12-18T00:06:34.8414728Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 8s local 2024-12-18T00:06:34.8415650Z Compiling llvm/lib/Transforms/Utils/LoopConstrainer.cpp; 7s local ... 2024-12-18T00:06:35.1188900Z 2024-12-18T00:06:35.1189745Z  2024-12-18T00:06:35.1190227Z  2024-12-18T00:06:35.1190642Z  2024-12-18T00:06:35.1191044Z  2024-12-18T00:06:35.1191433Z  2024-12-18T00:06:35.1191813Z  2024-12-18T00:06:35.1192188Z  2024-12-18T00:06:35.1192582Z  2024-12-18T00:06:35.1193159Z [11,277 / 15,187] 48 actions, 47 running 2024-12-18T00:06:35.1194055Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:06:35.1194985Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:35.1195693Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:06:35.1196495Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:06:35.1197329Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:06:35.1198221Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local 2024-12-18T00:06:35.1199134Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 8s local 2024-12-18T00:06:35.1200035Z Compiling llvm/lib/Transforms/Utils/LoopPeel.cpp; 7s local ... 2024-12-18T00:06:35.3418695Z 2024-12-18T00:06:35.3419573Z  2024-12-18T00:06:35.3420052Z  2024-12-18T00:06:35.3420448Z  2024-12-18T00:06:35.3420836Z  2024-12-18T00:06:35.3421201Z  2024-12-18T00:06:35.3421581Z  2024-12-18T00:06:35.3421964Z  2024-12-18T00:06:35.3422342Z  2024-12-18T00:06:35.3422944Z [11,282 / 15,187] 48 actions, 47 running 2024-12-18T00:06:35.3424306Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:06:35.3425207Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:35.3425867Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:06:35.3426622Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:06:35.3427607Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:06:35.3428620Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:06:35.3429531Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 8s local 2024-12-18T00:06:35.3430431Z Compiling llvm/lib/Transforms/Utils/LoopPeel.cpp; 8s local ... 2024-12-18T00:06:35.5664133Z 2024-12-18T00:06:35.5665012Z  2024-12-18T00:06:35.5665506Z  2024-12-18T00:06:35.5665887Z  2024-12-18T00:06:35.5666279Z  2024-12-18T00:06:35.5666668Z  2024-12-18T00:06:35.5667083Z  2024-12-18T00:06:35.5667488Z  2024-12-18T00:06:35.5667976Z  2024-12-18T00:06:35.5668639Z [11,289 / 15,187] 48 actions, 47 running 2024-12-18T00:06:35.5669631Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:06:35.5670547Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:35.5671213Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:06:35.5672054Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:06:35.5672835Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:06:35.5673672Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:06:35.5674619Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 8s local 2024-12-18T00:06:35.5675527Z Compiling llvm/lib/Transforms/Utils/LoopPeel.cpp; 8s local ... 2024-12-18T00:06:35.8298750Z 2024-12-18T00:06:35.8299615Z  2024-12-18T00:06:35.8300104Z  2024-12-18T00:06:35.8300510Z  2024-12-18T00:06:35.8300924Z  2024-12-18T00:06:35.8301317Z  2024-12-18T00:06:35.8301762Z  2024-12-18T00:06:35.8302149Z  2024-12-18T00:06:35.8302535Z  2024-12-18T00:06:35.8303092Z [11,293 / 15,187] 48 actions, 47 running 2024-12-18T00:06:35.8304000Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:06:35.8304905Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:35.8305637Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:06:35.8306442Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:06:35.8307231Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:06:35.8308056Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:06:35.8309103Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 9s local 2024-12-18T00:06:35.8310035Z Compiling llvm/lib/Transforms/Utils/LoopPeel.cpp; 8s local ... 2024-12-18T00:06:36.0414114Z 2024-12-18T00:06:36.0414898Z  2024-12-18T00:06:36.0415296Z  2024-12-18T00:06:36.0415702Z  2024-12-18T00:06:36.0416219Z  2024-12-18T00:06:36.0416759Z  2024-12-18T00:06:36.0417150Z  2024-12-18T00:06:36.0417531Z  2024-12-18T00:06:36.0417903Z  2024-12-18T00:06:36.0418497Z [11,300 / 15,187] 48 actions running 2024-12-18T00:06:36.0419408Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:06:36.0420334Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:36.0421013Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:36.0421765Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:06:36.0422568Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:06:36.0423457Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:06:36.0424427Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 9s local 2024-12-18T00:06:36.0425363Z Compiling llvm/lib/Transforms/Utils/LoopPeel.cpp; 8s local ... 2024-12-18T00:06:36.2585953Z 2024-12-18T00:06:36.2586820Z  2024-12-18T00:06:36.2587294Z  2024-12-18T00:06:36.2587718Z  2024-12-18T00:06:36.2588094Z  2024-12-18T00:06:36.2588508Z  2024-12-18T00:06:36.2588912Z  2024-12-18T00:06:36.2589299Z  2024-12-18T00:06:36.2589724Z  2024-12-18T00:06:36.2590308Z [11,317 / 15,187] 48 actions, 47 running 2024-12-18T00:06:36.2591630Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:06:36.2592503Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:36.2593191Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:36.2594000Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:06:36.2594805Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:06:36.2595796Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:06:36.2596650Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 9s local 2024-12-18T00:06:36.2597550Z Compiling llvm/lib/Transforms/Utils/LoopPeel.cpp; 9s local ... 2024-12-18T00:06:36.4629110Z 2024-12-18T00:06:36.4629960Z  2024-12-18T00:06:36.4630448Z  2024-12-18T00:06:36.4630830Z  2024-12-18T00:06:36.4631242Z  2024-12-18T00:06:36.4631606Z  2024-12-18T00:06:36.4631987Z  2024-12-18T00:06:36.4632345Z  2024-12-18T00:06:36.4632711Z  2024-12-18T00:06:36.4633335Z [11,334 / 15,187] 48 actions, 47 running 2024-12-18T00:06:36.4634318Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:06:36.4635162Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:36.4635842Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:36.4636619Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:06:36.4637404Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:06:36.4638251Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:06:36.4639180Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 9s local 2024-12-18T00:06:36.4640168Z Compiling llvm/lib/Transforms/Utils/LoopRotationUtils.cpp; 8s local ... 2024-12-18T00:06:36.6881442Z 2024-12-18T00:06:36.6882318Z  2024-12-18T00:06:36.6882817Z  2024-12-18T00:06:36.6883196Z  2024-12-18T00:06:36.6883548Z  2024-12-18T00:06:36.6883936Z  2024-12-18T00:06:36.6884353Z  2024-12-18T00:06:36.6884749Z  2024-12-18T00:06:36.6885135Z  2024-12-18T00:06:36.6885703Z [11,351 / 15,187] 48 actions, 47 running 2024-12-18T00:06:36.6886555Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:06:36.6887405Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:36.6888076Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:06:36.6888818Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:06:36.6889582Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:06:36.6890504Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:06:36.6891501Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:06:36.6892509Z Compiling llvm/lib/Transforms/Utils/LoopRotationUtils.cpp; 9s local ... 2024-12-18T00:06:36.8881128Z 2024-12-18T00:06:36.8881981Z  2024-12-18T00:06:36.8882449Z  2024-12-18T00:06:36.8882869Z  2024-12-18T00:06:36.8883225Z  2024-12-18T00:06:36.8883575Z  2024-12-18T00:06:36.8883966Z  2024-12-18T00:06:36.8884350Z  2024-12-18T00:06:36.8884710Z  2024-12-18T00:06:36.8885315Z [11,375 / 15,187] 48 actions, 47 running 2024-12-18T00:06:36.8886228Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:06:36.8887135Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:36.8887809Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:36.8888572Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 14s local 2024-12-18T00:06:36.8889788Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:06:36.8890656Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:06:36.8891622Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:06:36.8892563Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 9s local ... 2024-12-18T00:06:37.1016841Z 2024-12-18T00:06:37.1018092Z  2024-12-18T00:06:37.1018593Z  2024-12-18T00:06:37.1019013Z  2024-12-18T00:06:37.1019385Z  2024-12-18T00:06:37.1019782Z  2024-12-18T00:06:37.1020165Z  2024-12-18T00:06:37.1020544Z  2024-12-18T00:06:37.1020925Z  2024-12-18T00:06:37.1021529Z [11,393 / 15,187] 48 actions, 46 running 2024-12-18T00:06:37.1022404Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:06:37.1023243Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:37.1023874Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:37.1024586Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:06:37.1025443Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:06:37.1026362Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:06:37.1027200Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 9s local 2024-12-18T00:06:37.1028245Z Compiling llvm/lib/Transforms/Utils/LoopUnrollAndJam.cpp; 9s local ... 2024-12-18T00:06:37.3086526Z 2024-12-18T00:06:37.3087404Z  2024-12-18T00:06:37.3087880Z  2024-12-18T00:06:37.3088289Z  2024-12-18T00:06:37.3088672Z  2024-12-18T00:06:37.3089066Z  2024-12-18T00:06:37.3089456Z  2024-12-18T00:06:37.3089851Z  2024-12-18T00:06:37.3090213Z  2024-12-18T00:06:37.3090763Z [11,416 / 15,187] 48 actions, 47 running 2024-12-18T00:06:37.3091660Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:06:37.3092617Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:06:37.3093332Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:37.3094053Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:06:37.3094975Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:06:37.3095984Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:06:37.3097130Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 9s local 2024-12-18T00:06:37.3098245Z Compiling llvm/lib/Transforms/Utils/LoopUnrollAndJam.cpp; 9s local ... 2024-12-18T00:06:37.5155097Z 2024-12-18T00:06:37.5155931Z  2024-12-18T00:06:37.5156325Z  2024-12-18T00:06:37.5156662Z  2024-12-18T00:06:37.5157018Z  2024-12-18T00:06:37.5157344Z  2024-12-18T00:06:37.5157744Z  2024-12-18T00:06:37.5158090Z  2024-12-18T00:06:37.5158410Z  2024-12-18T00:06:37.5158912Z [11,450 / 15,187] 44 actions, 43 running 2024-12-18T00:06:37.5159808Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:06:37.5160674Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:06:37.5161232Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:37.5161801Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:06:37.5162563Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:06:37.5163414Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:06:37.5164184Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 9s local 2024-12-18T00:06:37.5165041Z Compiling llvm/lib/Transforms/Utils/LoopUnrollAndJam.cpp; 9s local ... 2024-12-18T00:06:37.7294426Z 2024-12-18T00:06:37.7295204Z  2024-12-18T00:06:37.7295581Z  2024-12-18T00:06:37.7295893Z  2024-12-18T00:06:37.7296227Z  2024-12-18T00:06:37.7296714Z  2024-12-18T00:06:37.7297177Z  2024-12-18T00:06:37.7297566Z  2024-12-18T00:06:37.7298233Z  2024-12-18T00:06:37.7298797Z [11,460 / 15,187] 48 actions, 47 running 2024-12-18T00:06:37.7299751Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:06:37.7300717Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:06:37.7301403Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:06:37.7302491Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:06:37.7303457Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:06:37.7304431Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 9s local 2024-12-18T00:06:37.7305514Z Compiling llvm/lib/Transforms/Utils/LoopUnrollRuntime.cpp; 9s local 2024-12-18T00:06:37.7306663Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 9s local ... 2024-12-18T00:06:37.9925677Z 2024-12-18T00:06:37.9926525Z  2024-12-18T00:06:37.9927012Z  2024-12-18T00:06:37.9927420Z  2024-12-18T00:06:37.9927830Z  2024-12-18T00:06:37.9928276Z  2024-12-18T00:06:37.9928664Z  2024-12-18T00:06:37.9929062Z  2024-12-18T00:06:37.9929453Z  2024-12-18T00:06:37.9930062Z [11,466 / 15,187] 48 actions, 47 running 2024-12-18T00:06:37.9931019Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:06:37.9931972Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:37.9932736Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:06:37.9933650Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:06:37.9934632Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:06:37.9935577Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 10s local 2024-12-18T00:06:37.9936736Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:06:37.9937614Z @llvm-project//llvm:TransformUtils; 7s local ... 2024-12-18T00:06:38.2428532Z 2024-12-18T00:06:38.2429395Z  2024-12-18T00:06:38.2429912Z  2024-12-18T00:06:38.2430295Z  2024-12-18T00:06:38.2430682Z  2024-12-18T00:06:38.2431064Z  2024-12-18T00:06:38.2431450Z  2024-12-18T00:06:38.2431846Z  2024-12-18T00:06:38.2432245Z  2024-12-18T00:06:38.2432782Z [11,469 / 15,187] 48 actions running 2024-12-18T00:06:38.2433755Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:06:38.2434667Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:38.2435387Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:06:38.2436271Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:06:38.2437195Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:06:38.2438128Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:06:38.2439216Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 7s local 2024-12-18T00:06:38.2440376Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 7s local ... 2024-12-18T00:06:38.4432363Z 2024-12-18T00:06:38.4433250Z  2024-12-18T00:06:38.4433752Z  2024-12-18T00:06:38.4434135Z  2024-12-18T00:06:38.4434528Z  2024-12-18T00:06:38.4434926Z  2024-12-18T00:06:38.4435337Z  2024-12-18T00:06:38.4435723Z  2024-12-18T00:06:38.4436140Z  2024-12-18T00:06:38.4436757Z [11,470 / 15,187] 48 actions running 2024-12-18T00:06:38.4437686Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:06:38.4438637Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:38.4439465Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:06:38.4440319Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:06:38.4441244Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:06:38.4442091Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:06:38.4443592Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 7s local 2024-12-18T00:06:38.4444984Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 7s local ... 2024-12-18T00:06:38.7015854Z 2024-12-18T00:06:38.7016814Z  2024-12-18T00:06:38.7017403Z  2024-12-18T00:06:38.7017885Z  2024-12-18T00:06:38.7018265Z  2024-12-18T00:06:38.7018641Z  2024-12-18T00:06:38.7019410Z  2024-12-18T00:06:38.7019904Z  2024-12-18T00:06:38.7020275Z  2024-12-18T00:06:38.7020871Z [11,472 / 15,187] 48 actions, 47 running 2024-12-18T00:06:38.7021822Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:06:38.7022791Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:06:38.7023504Z Compiling xla/literal_comparison.cc; 15s local 2024-12-18T00:06:38.7024363Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:06:38.7025447Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:06:38.7026353Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:06:38.7027462Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 7s local 2024-12-18T00:06:38.7028618Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 7s local ... 2024-12-18T00:06:39.0438205Z 2024-12-18T00:06:39.0439076Z  2024-12-18T00:06:39.0439544Z  2024-12-18T00:06:39.0440001Z  2024-12-18T00:06:39.0440394Z  2024-12-18T00:06:39.0440768Z  2024-12-18T00:06:39.0441124Z  2024-12-18T00:06:39.0441501Z  2024-12-18T00:06:39.0441899Z  2024-12-18T00:06:39.0442466Z [11,472 / 15,187] 48 actions running 2024-12-18T00:06:39.0443393Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:06:39.0444535Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:06:39.0445232Z Compiling xla/literal_comparison.cc; 15s local 2024-12-18T00:06:39.0446103Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:06:39.0447102Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:06:39.0447950Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2024-12-18T00:06:39.0449055Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 8s local 2024-12-18T00:06:39.0450179Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 8s local ... 2024-12-18T00:06:39.2504566Z 2024-12-18T00:06:39.2505478Z  2024-12-18T00:06:39.2505961Z  2024-12-18T00:06:39.2506389Z  2024-12-18T00:06:39.2506817Z  2024-12-18T00:06:39.2507222Z  2024-12-18T00:06:39.2507627Z  2024-12-18T00:06:39.2508009Z  2024-12-18T00:06:39.2508425Z  2024-12-18T00:06:39.2509070Z [11,473 / 15,187] 48 actions, 47 running 2024-12-18T00:06:39.2510069Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:06:39.2511030Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:06:39.2511818Z Compiling xla/literal_comparison.cc; 15s local 2024-12-18T00:06:39.2512740Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:06:39.2513761Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:06:39.2514510Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2024-12-18T00:06:39.2515669Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 8s local 2024-12-18T00:06:39.2516868Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 8s local ... 2024-12-18T00:06:39.4878987Z 2024-12-18T00:06:39.4879860Z  2024-12-18T00:06:39.4880369Z  2024-12-18T00:06:39.4880789Z  2024-12-18T00:06:39.4881173Z  2024-12-18T00:06:39.4881540Z  2024-12-18T00:06:39.4881926Z  2024-12-18T00:06:39.4882326Z  2024-12-18T00:06:39.4882734Z  2024-12-18T00:06:39.4883343Z [11,475 / 15,187] 48 actions, 47 running 2024-12-18T00:06:39.4884660Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:06:39.4885630Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:06:39.4886453Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:06:39.4887427Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:06:39.4890719Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2024-12-18T00:06:39.4892010Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 8s local 2024-12-18T00:06:39.4893113Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 8s local 2024-12-18T00:06:39.4893922Z @llvm-project//llvm:TransformUtils; 7s local ... 2024-12-18T00:06:39.8451755Z 2024-12-18T00:06:39.8452653Z  2024-12-18T00:06:39.8453116Z  2024-12-18T00:06:39.8453489Z  2024-12-18T00:06:39.8453866Z  2024-12-18T00:06:39.8454261Z  2024-12-18T00:06:39.8454732Z  2024-12-18T00:06:39.8455163Z  2024-12-18T00:06:39.8455625Z  2024-12-18T00:06:39.8456220Z [11,477 / 15,187] 48 actions running 2024-12-18T00:06:39.8457341Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:06:39.8458288Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:06:39.8459148Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:06:39.8460166Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:06:39.8461132Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2024-12-18T00:06:39.8462215Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 9s local 2024-12-18T00:06:39.8463315Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 8s local 2024-12-18T00:06:39.8464170Z @llvm-project//llvm:TransformUtils; 7s local ... 2024-12-18T00:06:40.0455678Z 2024-12-18T00:06:40.0456691Z  2024-12-18T00:06:40.0457167Z  2024-12-18T00:06:40.0457563Z  2024-12-18T00:06:40.0458000Z  2024-12-18T00:06:40.0458381Z  2024-12-18T00:06:40.0458833Z  2024-12-18T00:06:40.0459259Z  2024-12-18T00:06:40.0459637Z  2024-12-18T00:06:40.0460203Z [11,479 / 15,187] 48 actions running 2024-12-18T00:06:40.0461184Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:06:40.0462081Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:06:40.0462996Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:06:40.0463953Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:06:40.0464942Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 9s local 2024-12-18T00:06:40.0466003Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 9s local 2024-12-18T00:06:40.0467065Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 7s local 2024-12-18T00:06:40.0468171Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 7s local ... 2024-12-18T00:06:40.3488234Z 2024-12-18T00:06:40.3489078Z  2024-12-18T00:06:40.3489547Z  2024-12-18T00:06:40.3489941Z  2024-12-18T00:06:40.3490328Z  2024-12-18T00:06:40.3490717Z  2024-12-18T00:06:40.3491175Z  2024-12-18T00:06:40.3491671Z  2024-12-18T00:06:40.3492178Z  2024-12-18T00:06:40.3492899Z [11,481 / 15,187] 48 actions, 47 running 2024-12-18T00:06:40.3493759Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:06:40.3494648Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:06:40.3495510Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:06:40.3496880Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:06:40.3497839Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 9s local 2024-12-18T00:06:40.3498942Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:06:40.3500056Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 8s local 2024-12-18T00:06:40.3501294Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 8s local ... 2024-12-18T00:06:40.6365898Z 2024-12-18T00:06:40.6366762Z  2024-12-18T00:06:40.6367218Z  2024-12-18T00:06:40.6367623Z  2024-12-18T00:06:40.6368004Z  2024-12-18T00:06:40.6368406Z  2024-12-18T00:06:40.6368804Z  2024-12-18T00:06:40.6369594Z  2024-12-18T00:06:40.6370043Z  2024-12-18T00:06:40.6370775Z [11,484 / 15,187] 48 actions, 47 running 2024-12-18T00:06:40.6371742Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:06:40.6372684Z Compiling xla/literal_comparison.cc; 17s local 2024-12-18T00:06:40.6373570Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:06:40.6374514Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:06:40.6375425Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 9s local 2024-12-18T00:06:40.6376521Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:06:40.6377800Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 8s local 2024-12-18T00:06:40.6378866Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 8s local ... 2024-12-18T00:06:40.8462482Z 2024-12-18T00:06:40.8463274Z  2024-12-18T00:06:40.8463699Z  2024-12-18T00:06:40.8464083Z  2024-12-18T00:06:40.8464446Z  2024-12-18T00:06:40.8464812Z  2024-12-18T00:06:40.8465173Z  2024-12-18T00:06:40.8465519Z  2024-12-18T00:06:40.8465867Z  2024-12-18T00:06:40.8466541Z [11,485 / 15,187] 48 actions running 2024-12-18T00:06:40.8467377Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:06:40.8468224Z Compiling xla/literal_comparison.cc; 17s local 2024-12-18T00:06:40.8469007Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:06:40.8469875Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:06:40.8470812Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:06:40.8471805Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 8s local 2024-12-18T00:06:40.8472692Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 8s local 2024-12-18T00:06:40.8473640Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 8s local ... 2024-12-18T00:06:41.1092780Z 2024-12-18T00:06:41.1093691Z  2024-12-18T00:06:41.1094112Z  2024-12-18T00:06:41.1094484Z  2024-12-18T00:06:41.1094852Z  2024-12-18T00:06:41.1095205Z  2024-12-18T00:06:41.1095575Z  2024-12-18T00:06:41.1095927Z  2024-12-18T00:06:41.1096275Z  2024-12-18T00:06:41.1096996Z [11,486 / 15,187] 48 actions, 47 running 2024-12-18T00:06:41.1097867Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:06:41.1098744Z Compiling xla/literal_comparison.cc; 17s local 2024-12-18T00:06:41.1099579Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:06:41.1100504Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:06:41.1101496Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:06:41.1102551Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 8s local 2024-12-18T00:06:41.1103547Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 8s local 2024-12-18T00:06:41.1104552Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 8s local ... 2024-12-18T00:06:41.3345389Z 2024-12-18T00:06:41.3346391Z  2024-12-18T00:06:41.3346847Z  2024-12-18T00:06:41.3347247Z  2024-12-18T00:06:41.3347638Z  2024-12-18T00:06:41.3348037Z  2024-12-18T00:06:41.3348413Z  2024-12-18T00:06:41.3348813Z  2024-12-18T00:06:41.3349222Z  2024-12-18T00:06:41.3349786Z [11,488 / 15,187] 48 actions, 47 running 2024-12-18T00:06:41.3351057Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:06:41.3351939Z Compiling xla/literal_comparison.cc; 17s local 2024-12-18T00:06:41.3352785Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:06:41.3353701Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:06:41.3354954Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:06:41.3356249Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2024-12-18T00:06:41.3357124Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:06:41.3358158Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 8s local ... 2024-12-18T00:06:41.6148689Z 2024-12-18T00:06:41.6149528Z  2024-12-18T00:06:41.6150030Z  2024-12-18T00:06:41.6150426Z  2024-12-18T00:06:41.6150848Z  2024-12-18T00:06:41.6151265Z  2024-12-18T00:06:41.6151665Z  2024-12-18T00:06:41.6152021Z  2024-12-18T00:06:41.6152360Z  2024-12-18T00:06:41.6152909Z [11,490 / 15,187] 48 actions, 47 running 2024-12-18T00:06:41.6153783Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:06:41.6154726Z Compiling xla/literal_comparison.cc; 18s local 2024-12-18T00:06:41.6155593Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:06:41.6156487Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:06:41.6157474Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:06:41.6158533Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2024-12-18T00:06:41.6159647Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:06:41.6160686Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local ... 2024-12-18T00:06:41.8468072Z 2024-12-18T00:06:41.8468971Z  2024-12-18T00:06:41.8469497Z  2024-12-18T00:06:41.8469904Z  2024-12-18T00:06:41.8470323Z  2024-12-18T00:06:41.8470694Z  2024-12-18T00:06:41.8471050Z  2024-12-18T00:06:41.8471468Z  2024-12-18T00:06:41.8471853Z  2024-12-18T00:06:41.8472411Z [11,493 / 15,187] 48 actions running 2024-12-18T00:06:41.8473376Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:06:41.8474276Z Compiling xla/literal_comparison.cc; 18s local 2024-12-18T00:06:41.8475117Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:06:41.8476023Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 15s local 2024-12-18T00:06:41.8477037Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:06:41.8478134Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2024-12-18T00:06:41.8479129Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:06:41.8480241Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local ... 2024-12-18T00:06:42.1074251Z 2024-12-18T00:06:42.1075074Z  2024-12-18T00:06:42.1075554Z  2024-12-18T00:06:42.1075945Z  2024-12-18T00:06:42.1076327Z  2024-12-18T00:06:42.1076708Z  2024-12-18T00:06:42.1077116Z  2024-12-18T00:06:42.1077501Z  2024-12-18T00:06:42.1077845Z  2024-12-18T00:06:42.1078456Z [11,494 / 15,187] 48 actions, 47 running 2024-12-18T00:06:42.1079262Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:06:42.1080090Z Compiling xla/literal_comparison.cc; 18s local 2024-12-18T00:06:42.1080936Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:06:42.1081866Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 15s local 2024-12-18T00:06:42.1082878Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:06:42.1083925Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2024-12-18T00:06:42.1085345Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:06:42.1086396Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local ... 2024-12-18T00:06:42.3567253Z 2024-12-18T00:06:42.3568211Z  2024-12-18T00:06:42.3568674Z  2024-12-18T00:06:42.3569063Z  2024-12-18T00:06:42.3569783Z  2024-12-18T00:06:42.3570204Z  2024-12-18T00:06:42.3570559Z  2024-12-18T00:06:42.3570943Z  2024-12-18T00:06:42.3571312Z  2024-12-18T00:06:42.3571878Z [11,498 / 15,187] 48 actions, 47 running 2024-12-18T00:06:42.3582694Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:06:42.3583940Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 16s local 2024-12-18T00:06:42.3585024Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2024-12-18T00:06:42.3586048Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2024-12-18T00:06:42.3587100Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local 2024-12-18T00:06:42.3588020Z Compiling external/xla/xla/xla_data.pb.cc; 6s local 2024-12-18T00:06:42.3588770Z Compiling llvm/lib/Analysis/AliasAnalysis.cpp; 4s local 2024-12-18T00:06:42.3589711Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 4s local ... 2024-12-18T00:06:42.5616185Z 2024-12-18T00:06:42.5617177Z  2024-12-18T00:06:42.5617688Z  2024-12-18T00:06:42.5618099Z  2024-12-18T00:06:42.5618527Z  2024-12-18T00:06:42.5618910Z  2024-12-18T00:06:42.5619280Z  2024-12-18T00:06:42.5619723Z  2024-12-18T00:06:42.5620085Z  2024-12-18T00:06:42.5620671Z [11,501 / 15,187] 48 actions, 47 running 2024-12-18T00:06:42.5621593Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:06:42.5622818Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2024-12-18T00:06:42.5623992Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2024-12-18T00:06:42.5625022Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:06:42.5625968Z Compiling external/xla/xla/xla_data.pb.cc; 6s local 2024-12-18T00:06:42.5626956Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 5s local 2024-12-18T00:06:42.5628000Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 5s local 2024-12-18T00:06:42.5628996Z Compiling llvm/lib/Analysis/AliasSetTracker.cpp; 5s local ... 2024-12-18T00:06:42.8476804Z 2024-12-18T00:06:42.8477655Z  2024-12-18T00:06:42.8478151Z  2024-12-18T00:06:42.8478572Z  2024-12-18T00:06:42.8478996Z  2024-12-18T00:06:42.8479392Z  2024-12-18T00:06:42.8479797Z  2024-12-18T00:06:42.8480184Z  2024-12-18T00:06:42.8480587Z  2024-12-18T00:06:42.8481157Z [11,504 / 15,187] 48 actions running 2024-12-18T00:06:42.8482137Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:06:42.8483418Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2024-12-18T00:06:42.8484594Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2024-12-18T00:06:42.8485665Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:06:42.8486693Z Compiling external/xla/xla/xla_data.pb.cc; 6s local 2024-12-18T00:06:42.8487637Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 5s local 2024-12-18T00:06:42.8488642Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 5s local 2024-12-18T00:06:42.8489615Z Compiling llvm/lib/Analysis/AliasSetTracker.cpp; 5s local ... 2024-12-18T00:06:43.0995129Z 2024-12-18T00:06:43.0995930Z  2024-12-18T00:06:43.0996434Z  2024-12-18T00:06:43.0996842Z  2024-12-18T00:06:43.0997228Z  2024-12-18T00:06:43.0997642Z  2024-12-18T00:06:43.0998058Z  2024-12-18T00:06:43.0998848Z  2024-12-18T00:06:43.0999257Z  2024-12-18T00:06:43.0999860Z [11,508 / 15,187] 48 actions, 47 running 2024-12-18T00:06:43.1000818Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:06:43.1002043Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2024-12-18T00:06:43.1003508Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2024-12-18T00:06:43.1004618Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:06:43.1005557Z Compiling external/xla/xla/xla_data.pb.cc; 6s local 2024-12-18T00:06:43.1006461Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 5s local 2024-12-18T00:06:43.1007466Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 5s local 2024-12-18T00:06:43.1008501Z Compiling llvm/lib/Analysis/AliasSetTracker.cpp; 5s local ... 2024-12-18T00:06:43.3015402Z 2024-12-18T00:06:43.3016359Z  2024-12-18T00:06:43.3016968Z  2024-12-18T00:06:43.3017402Z  2024-12-18T00:06:43.3017799Z  2024-12-18T00:06:43.3018171Z  2024-12-18T00:06:43.3018540Z  2024-12-18T00:06:43.3018932Z  2024-12-18T00:06:43.3019301Z  2024-12-18T00:06:43.3019858Z [11,511 / 15,187] 48 actions, 47 running 2024-12-18T00:06:43.3020783Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:06:43.3021979Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 11s local 2024-12-18T00:06:43.3023095Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2024-12-18T00:06:43.3024158Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:06:43.3025150Z Compiling external/xla/xla/xla_data.pb.cc; 7s local 2024-12-18T00:06:43.3026084Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 5s local 2024-12-18T00:06:43.3027089Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 5s local 2024-12-18T00:06:43.3028236Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 5s local ... 2024-12-18T00:06:43.6038398Z 2024-12-18T00:06:43.6039255Z  2024-12-18T00:06:43.6039748Z  2024-12-18T00:06:43.6040140Z  2024-12-18T00:06:43.6040533Z  2024-12-18T00:06:43.6040931Z  2024-12-18T00:06:43.6041318Z  2024-12-18T00:06:43.6041704Z  2024-12-18T00:06:43.6042088Z  2024-12-18T00:06:43.6042741Z [11,514 / 15,187] 48 actions, 47 running 2024-12-18T00:06:43.6043675Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:06:43.6047433Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2024-12-18T00:06:43.6048454Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 11s local 2024-12-18T00:06:43.6049430Z Compiling external/xla/xla/xla_data.pb.cc; 7s local 2024-12-18T00:06:43.6050313Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local 2024-12-18T00:06:43.6051289Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 6s local 2024-12-18T00:06:43.6052283Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 6s local 2024-12-18T00:06:43.6053287Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 6s local ... 2024-12-18T00:06:43.8484322Z 2024-12-18T00:06:43.8485176Z  2024-12-18T00:06:43.8485659Z  2024-12-18T00:06:43.8486080Z  2024-12-18T00:06:43.8486458Z  2024-12-18T00:06:43.8486861Z  2024-12-18T00:06:43.8487238Z  2024-12-18T00:06:43.8487621Z  2024-12-18T00:06:43.8488004Z  2024-12-18T00:06:43.8488540Z [11,515 / 15,187] 48 actions running 2024-12-18T00:06:43.8489468Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:06:43.8490595Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2024-12-18T00:06:43.8491486Z Compiling external/xla/xla/xla_data.pb.cc; 7s local 2024-12-18T00:06:43.8492377Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local 2024-12-18T00:06:43.8493802Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 6s local 2024-12-18T00:06:43.8494764Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 6s local 2024-12-18T00:06:43.8495663Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 6s local 2024-12-18T00:06:43.8496766Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 6s local ... 2024-12-18T00:06:44.1908281Z 2024-12-18T00:06:44.1909595Z  2024-12-18T00:06:44.1910222Z  2024-12-18T00:06:44.1910651Z  2024-12-18T00:06:44.1911048Z  2024-12-18T00:06:44.1911428Z  2024-12-18T00:06:44.1911820Z  2024-12-18T00:06:44.1912214Z  2024-12-18T00:06:44.1912620Z  2024-12-18T00:06:44.1913228Z [11,517 / 15,187] 48 actions, 47 running 2024-12-18T00:06:44.1914172Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:06:44.1915260Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2024-12-18T00:06:44.1916198Z Compiling external/xla/xla/xla_data.pb.cc; 8s local 2024-12-18T00:06:44.1917168Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local 2024-12-18T00:06:44.1918220Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 6s local 2024-12-18T00:06:44.1919232Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 6s local 2024-12-18T00:06:44.1920265Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 6s local 2024-12-18T00:06:44.1921364Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 6s local ... 2024-12-18T00:06:44.4095240Z 2024-12-18T00:06:44.4096211Z  2024-12-18T00:06:44.4096806Z  2024-12-18T00:06:44.4097229Z  2024-12-18T00:06:44.4097606Z  2024-12-18T00:06:44.4098000Z  2024-12-18T00:06:44.4098363Z  2024-12-18T00:06:44.4098752Z  2024-12-18T00:06:44.4099140Z  2024-12-18T00:06:44.4099703Z [11,519 / 15,187] 48 actions, 47 running 2024-12-18T00:06:44.4100558Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:06:44.4101635Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2024-12-18T00:06:44.4102535Z Compiling external/xla/xla/xla_data.pb.cc; 8s local 2024-12-18T00:06:44.4103424Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local 2024-12-18T00:06:44.4104443Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 6s local 2024-12-18T00:06:44.4105381Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 6s local 2024-12-18T00:06:44.4106430Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 6s local 2024-12-18T00:06:44.4107392Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 6s local ... 2024-12-18T00:06:44.6492356Z 2024-12-18T00:06:44.6493255Z  2024-12-18T00:06:44.6493718Z  2024-12-18T00:06:44.6494104Z  2024-12-18T00:06:44.6494475Z  2024-12-18T00:06:44.6494853Z  2024-12-18T00:06:44.6495224Z  2024-12-18T00:06:44.6495568Z  2024-12-18T00:06:44.6495953Z  2024-12-18T00:06:44.6496742Z [11,520 / 15,187] 48 actions running 2024-12-18T00:06:44.6497653Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:06:44.6498709Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2024-12-18T00:06:44.6499596Z Compiling external/xla/xla/xla_data.pb.cc; 8s local 2024-12-18T00:06:44.6500688Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:06:44.6501644Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local 2024-12-18T00:06:44.6502558Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local 2024-12-18T00:06:44.6503509Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local 2024-12-18T00:06:44.6504508Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 6s local ... 2024-12-18T00:06:44.8529348Z 2024-12-18T00:06:44.8530232Z  2024-12-18T00:06:44.8530759Z  2024-12-18T00:06:44.8531139Z  2024-12-18T00:06:44.8531610Z  2024-12-18T00:06:44.8532380Z  2024-12-18T00:06:44.8532744Z  2024-12-18T00:06:44.8533130Z  2024-12-18T00:06:44.8533521Z  2024-12-18T00:06:44.8534102Z [11,522 / 15,187] 48 actions, 47 running 2024-12-18T00:06:44.8535002Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:06:44.8536070Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2024-12-18T00:06:44.8537434Z Compiling external/xla/xla/xla_data.pb.cc; 8s local 2024-12-18T00:06:44.8538348Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:06:44.8539388Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local 2024-12-18T00:06:44.8540390Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local 2024-12-18T00:06:44.8541306Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local 2024-12-18T00:06:44.8542342Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 7s local ... 2024-12-18T00:06:45.0910793Z 2024-12-18T00:06:45.0911667Z  2024-12-18T00:06:45.0912119Z  2024-12-18T00:06:45.0912511Z  2024-12-18T00:06:45.0912905Z  2024-12-18T00:06:45.0913287Z  2024-12-18T00:06:45.0913675Z  2024-12-18T00:06:45.0914044Z  2024-12-18T00:06:45.0914426Z  2024-12-18T00:06:45.0915007Z [11,524 / 15,187] 48 actions, 47 running 2024-12-18T00:06:45.0915936Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:06:45.0916980Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2024-12-18T00:06:45.0917846Z Compiling external/xla/xla/xla_data.pb.cc; 8s local 2024-12-18T00:06:45.0918718Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:06:45.0919667Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local 2024-12-18T00:06:45.0920622Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local 2024-12-18T00:06:45.0921559Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local 2024-12-18T00:06:45.0922606Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 7s local ... 2024-12-18T00:06:45.4501187Z 2024-12-18T00:06:45.4502073Z  2024-12-18T00:06:45.4502543Z  2024-12-18T00:06:45.4502947Z  2024-12-18T00:06:45.4503342Z  2024-12-18T00:06:45.4503750Z  2024-12-18T00:06:45.4504134Z  2024-12-18T00:06:45.4504516Z  2024-12-18T00:06:45.4504912Z  2024-12-18T00:06:45.4505521Z [11,526 / 15,187] 48 actions running 2024-12-18T00:06:45.4506439Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:06:45.4507447Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:06:45.4508322Z Compiling external/xla/xla/xla_data.pb.cc; 9s local 2024-12-18T00:06:45.4509211Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:06:45.4510198Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local 2024-12-18T00:06:45.4511273Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local 2024-12-18T00:06:45.4512230Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local 2024-12-18T00:06:45.4513226Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 7s local ... 2024-12-18T00:06:45.6505365Z 2024-12-18T00:06:45.6506193Z  2024-12-18T00:06:45.6506692Z  2024-12-18T00:06:45.6507091Z  2024-12-18T00:06:45.6507508Z  2024-12-18T00:06:45.6507933Z  2024-12-18T00:06:45.6508480Z  2024-12-18T00:06:45.6508868Z  2024-12-18T00:06:45.6509234Z  2024-12-18T00:06:45.6509795Z [11,529 / 15,187] 48 actions running 2024-12-18T00:06:45.6510707Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:06:45.6511695Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:06:45.6512648Z Compiling external/xla/xla/xla_data.pb.cc; 9s local 2024-12-18T00:06:45.6513494Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2024-12-18T00:06:45.6514924Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2024-12-18T00:06:45.6515842Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 8s local 2024-12-18T00:06:45.6516707Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 7s local 2024-12-18T00:06:45.6517481Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2024-12-18T00:06:45.9647421Z 2024-12-18T00:06:45.9648705Z  2024-12-18T00:06:45.9649353Z  2024-12-18T00:06:45.9649794Z  2024-12-18T00:06:45.9650158Z  2024-12-18T00:06:45.9650539Z  2024-12-18T00:06:45.9650914Z  2024-12-18T00:06:45.9651288Z  2024-12-18T00:06:45.9651663Z  2024-12-18T00:06:45.9652372Z [11,532 / 15,187] 48 actions, 47 running 2024-12-18T00:06:45.9653332Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:06:45.9654368Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:06:45.9655180Z Compiling external/xla/xla/xla_data.pb.cc; 9s local 2024-12-18T00:06:45.9656046Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2024-12-18T00:06:45.9657114Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2024-12-18T00:06:45.9658052Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 7s local 2024-12-18T00:06:45.9658825Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:06:45.9659591Z Compiling llvm/lib/Analysis/CtxProfAnalysis.cpp; 6s local ... 2024-12-18T00:06:46.2511517Z 2024-12-18T00:06:46.2512437Z  2024-12-18T00:06:46.2512961Z  2024-12-18T00:06:46.2513387Z  2024-12-18T00:06:46.2513846Z  2024-12-18T00:06:46.2514229Z  2024-12-18T00:06:46.2514625Z  2024-12-18T00:06:46.2515113Z  2024-12-18T00:06:46.2515497Z  2024-12-18T00:06:46.2516069Z [11,533 / 15,187] 47 actions running 2024-12-18T00:06:46.2517069Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:06:46.2518293Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:06:46.2519254Z Compiling external/xla/xla/xla_data.pb.cc; 10s local 2024-12-18T00:06:46.2520159Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2024-12-18T00:06:46.2521153Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2024-12-18T00:06:46.2522111Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 7s local 2024-12-18T00:06:46.2522901Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:06:46.2523714Z Compiling llvm/lib/Analysis/CtxProfAnalysis.cpp; 6s local ... 2024-12-18T00:06:46.4515351Z 2024-12-18T00:06:46.4516173Z  2024-12-18T00:06:46.4516576Z  2024-12-18T00:06:46.4516962Z  2024-12-18T00:06:46.4517317Z  2024-12-18T00:06:46.4517688Z  2024-12-18T00:06:46.4518162Z  2024-12-18T00:06:46.4518527Z  2024-12-18T00:06:46.4518887Z  2024-12-18T00:06:46.4519438Z [11,536 / 15,187] 48 actions running 2024-12-18T00:06:46.4520302Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:06:46.4521243Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:06:46.4522069Z Compiling external/xla/xla/xla_data.pb.cc; 10s local 2024-12-18T00:06:46.4522856Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2024-12-18T00:06:46.4523725Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2024-12-18T00:06:46.4524611Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:06:46.4525353Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:06:46.4526121Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 6s local ... 2024-12-18T00:06:46.7212066Z 2024-12-18T00:06:46.7212928Z  2024-12-18T00:06:46.7213402Z  2024-12-18T00:06:46.7213768Z  2024-12-18T00:06:46.7214145Z  2024-12-18T00:06:46.7214526Z  2024-12-18T00:06:46.7214910Z  2024-12-18T00:06:46.7215266Z  2024-12-18T00:06:46.7216091Z  2024-12-18T00:06:46.7216849Z [11,542 / 15,187] 48 actions, 47 running 2024-12-18T00:06:46.7217736Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:06:46.7218787Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:06:46.7219635Z Compiling external/xla/xla/xla_data.pb.cc; 10s local 2024-12-18T00:06:46.7220756Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2024-12-18T00:06:46.7221697Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:06:46.7222409Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:06:46.7223197Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 6s local 2024-12-18T00:06:46.7224186Z Compiling llvm/lib/Analysis/DependenceGraphBuilder.cpp; 6s local ... 2024-12-18T00:06:47.0522281Z 2024-12-18T00:06:47.0523195Z  2024-12-18T00:06:47.0523758Z  2024-12-18T00:06:47.0524209Z  2024-12-18T00:06:47.0524672Z  2024-12-18T00:06:47.0525051Z  2024-12-18T00:06:47.0525398Z  2024-12-18T00:06:47.0525846Z  2024-12-18T00:06:47.0526269Z  2024-12-18T00:06:47.0526829Z [11,544 / 15,187] 48 actions running 2024-12-18T00:06:47.0527704Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:06:47.0528870Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:06:47.0529774Z Compiling external/xla/xla/xla_data.pb.cc; 10s local 2024-12-18T00:06:47.0530717Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2024-12-18T00:06:47.0531592Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:06:47.0532349Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:06:47.0533171Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 6s local 2024-12-18T00:06:47.0534201Z Compiling llvm/lib/Analysis/FunctionPropertiesAnalysis.cpp; 5s local ... 2024-12-18T00:06:47.2526376Z 2024-12-18T00:06:47.2527282Z  2024-12-18T00:06:47.2527763Z  2024-12-18T00:06:47.2528146Z  2024-12-18T00:06:47.2528535Z  2024-12-18T00:06:47.2528922Z  2024-12-18T00:06:47.2529315Z  2024-12-18T00:06:47.2529681Z  2024-12-18T00:06:47.2530073Z  2024-12-18T00:06:47.2530653Z [11,546 / 15,187] 48 actions running 2024-12-18T00:06:47.2531620Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:06:47.2532702Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:06:47.2533682Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2024-12-18T00:06:47.2534615Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:06:47.2535534Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 6s local 2024-12-18T00:06:47.2536764Z Compiling llvm/lib/Analysis/FunctionPropertiesAnalysis.cpp; 5s local 2024-12-18T00:06:47.2537728Z Compiling llvm/lib/Analysis/GlobalsModRef.cpp; 5s local 2024-12-18T00:06:47.2538697Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 5s local ... 2024-12-18T00:06:47.6621271Z 2024-12-18T00:06:47.6622131Z  2024-12-18T00:06:47.6622629Z  2024-12-18T00:06:47.6623005Z  2024-12-18T00:06:47.6623370Z  2024-12-18T00:06:47.6623772Z  2024-12-18T00:06:47.6624154Z  2024-12-18T00:06:47.6624543Z  2024-12-18T00:06:47.6624972Z  2024-12-18T00:06:47.6625543Z [11,547 / 15,187] 48 actions, 47 running 2024-12-18T00:06:47.6626432Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:06:47.6627618Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:06:47.6628600Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:06:47.6629530Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:06:47.6630435Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local 2024-12-18T00:06:47.6631893Z Compiling llvm/lib/Analysis/FunctionPropertiesAnalysis.cpp; 6s local 2024-12-18T00:06:47.6632897Z Compiling llvm/lib/Analysis/GlobalsModRef.cpp; 6s local 2024-12-18T00:06:47.6633862Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 5s local ... 2024-12-18T00:06:48.0533786Z 2024-12-18T00:06:48.0534654Z  2024-12-18T00:06:48.0535087Z  2024-12-18T00:06:48.0535488Z  2024-12-18T00:06:48.0536311Z  2024-12-18T00:06:48.0536896Z  2024-12-18T00:06:48.0537258Z  2024-12-18T00:06:48.0537609Z  2024-12-18T00:06:48.0537969Z  2024-12-18T00:06:48.0538528Z [11,548 / 15,187] 48 actions running 2024-12-18T00:06:48.0539364Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:06:48.0540368Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:06:48.0541231Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:06:48.0542181Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:06:48.0543082Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local 2024-12-18T00:06:48.0544043Z Compiling llvm/lib/Analysis/FunctionPropertiesAnalysis.cpp; 6s local 2024-12-18T00:06:48.0545251Z Compiling llvm/lib/Analysis/GlobalsModRef.cpp; 6s local 2024-12-18T00:06:48.0546241Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 6s local ... 2024-12-18T00:06:48.5325319Z 2024-12-18T00:06:48.5326204Z  2024-12-18T00:06:48.5326581Z  2024-12-18T00:06:48.5326915Z  2024-12-18T00:06:48.5327245Z  2024-12-18T00:06:48.5327572Z  2024-12-18T00:06:48.5327891Z  2024-12-18T00:06:48.5328196Z  2024-12-18T00:06:48.5328518Z  2024-12-18T00:06:48.5329014Z [11,549 / 15,187] 48 actions, 47 running 2024-12-18T00:06:48.5329772Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:06:48.5330636Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:06:48.5331462Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:06:48.5332225Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 10s local 2024-12-18T00:06:48.5332989Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 8s local 2024-12-18T00:06:48.5333830Z Compiling llvm/lib/Analysis/FunctionPropertiesAnalysis.cpp; 7s local 2024-12-18T00:06:48.5334661Z Compiling llvm/lib/Analysis/GlobalsModRef.cpp; 6s local 2024-12-18T00:06:48.5335442Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 6s local ... 2024-12-18T00:06:48.8541363Z 2024-12-18T00:06:48.8542239Z  2024-12-18T00:06:48.8542718Z  2024-12-18T00:06:48.8543101Z  2024-12-18T00:06:48.8543467Z  2024-12-18T00:06:48.8543843Z  2024-12-18T00:06:48.8544455Z  2024-12-18T00:06:48.8544845Z  2024-12-18T00:06:48.8545229Z  2024-12-18T00:06:48.8545764Z [11,552 / 15,187] 48 actions running 2024-12-18T00:06:48.8546672Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:06:48.8547691Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:06:48.8548631Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:06:48.8549532Z Compiling llvm/lib/Analysis/GlobalsModRef.cpp; 7s local 2024-12-18T00:06:48.8550466Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:06:48.8551366Z Compiling xla/service/cpu/cpu_options.cc; 6s local 2024-12-18T00:06:48.8552160Z Compiling llvm/lib/Analysis/InlineAdvisor.cpp; 6s local 2024-12-18T00:06:48.8553010Z Compiling llvm/lib/Analysis/InlineCost.cpp; 6s local ... 2024-12-18T00:06:49.0545675Z 2024-12-18T00:06:49.0546547Z  2024-12-18T00:06:49.0547052Z  2024-12-18T00:06:49.0547487Z  2024-12-18T00:06:49.0547888Z  2024-12-18T00:06:49.0548265Z  2024-12-18T00:06:49.0548653Z  2024-12-18T00:06:49.0549044Z  2024-12-18T00:06:49.0549854Z  2024-12-18T00:06:49.0550417Z [11,555 / 15,187] 48 actions running 2024-12-18T00:06:49.0551313Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:06:49.0552382Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:06:49.0553367Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:06:49.0554569Z Compiling llvm/lib/Analysis/GlobalsModRef.cpp; 7s local 2024-12-18T00:06:49.0555572Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:06:49.0556435Z Compiling xla/service/cpu/cpu_options.cc; 6s local 2024-12-18T00:06:49.0557210Z Compiling llvm/lib/Analysis/InlineAdvisor.cpp; 6s local 2024-12-18T00:06:49.0558078Z Compiling llvm/lib/Analysis/InlineCost.cpp; 6s local ... 2024-12-18T00:06:49.3362122Z 2024-12-18T00:06:49.3363014Z  2024-12-18T00:06:49.3363608Z  2024-12-18T00:06:49.3364128Z  2024-12-18T00:06:49.3364480Z  2024-12-18T00:06:49.3364921Z  2024-12-18T00:06:49.3365313Z  2024-12-18T00:06:49.3365677Z  2024-12-18T00:06:49.3365975Z  2024-12-18T00:06:49.3366554Z [11,558 / 15,187] 48 actions, 47 running 2024-12-18T00:06:49.3367485Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:06:49.3368567Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:06:49.3369530Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:06:49.3370480Z Compiling llvm/lib/Analysis/GlobalsModRef.cpp; 7s local 2024-12-18T00:06:49.3371460Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:06:49.3372406Z Compiling xla/service/cpu/cpu_options.cc; 6s local 2024-12-18T00:06:49.3373182Z Compiling llvm/lib/Analysis/InlineCost.cpp; 6s local 2024-12-18T00:06:49.3374347Z Compiling llvm/lib/Analysis/InlineOrder.cpp; 6s local ... 2024-12-18T00:06:49.6047281Z 2024-12-18T00:06:49.6048215Z  2024-12-18T00:06:49.6048677Z  2024-12-18T00:06:49.6049049Z  2024-12-18T00:06:49.6049485Z  2024-12-18T00:06:49.6049876Z  2024-12-18T00:06:49.6050250Z  2024-12-18T00:06:49.6050652Z  2024-12-18T00:06:49.6051020Z  2024-12-18T00:06:49.6051627Z [11,561 / 15,187] 48 actions, 47 running 2024-12-18T00:06:49.6052604Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:06:49.6053690Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:06:49.6054692Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:06:49.6055697Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:06:49.6056767Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2024-12-18T00:06:49.6057540Z Compiling llvm/lib/Analysis/InlineCost.cpp; 7s local 2024-12-18T00:06:49.6058409Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 6s local 2024-12-18T00:06:49.6059278Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 6s local ... 2024-12-18T00:06:49.8495235Z 2024-12-18T00:06:49.8496072Z  2024-12-18T00:06:49.8496692Z  2024-12-18T00:06:49.8497122Z  2024-12-18T00:06:49.8497451Z  2024-12-18T00:06:49.8497802Z  2024-12-18T00:06:49.8498192Z  2024-12-18T00:06:49.8498591Z  2024-12-18T00:06:49.8498977Z  2024-12-18T00:06:49.8499600Z [11,566 / 15,187] 47 actions, 46 running 2024-12-18T00:06:49.8500534Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:06:49.8501616Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:06:49.8502588Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:06:49.8503570Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 8s local 2024-12-18T00:06:49.8504510Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2024-12-18T00:06:49.8505422Z Compiling llvm/lib/Analysis/InlineCost.cpp; 7s local 2024-12-18T00:06:49.8506808Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 6s local 2024-12-18T00:06:49.8507764Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 6s local ... 2024-12-18T00:06:50.0552097Z 2024-12-18T00:06:50.0552939Z  2024-12-18T00:06:50.0553421Z  2024-12-18T00:06:50.0553859Z  2024-12-18T00:06:50.0554223Z  2024-12-18T00:06:50.0555021Z  2024-12-18T00:06:50.0555551Z  2024-12-18T00:06:50.0555960Z  2024-12-18T00:06:50.0556377Z  2024-12-18T00:06:50.0556988Z [11,567 / 15,187] 48 actions running 2024-12-18T00:06:50.0558026Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:06:50.0559054Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:06:50.0560045Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:06:50.0561027Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 8s local 2024-12-18T00:06:50.0561842Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2024-12-18T00:06:50.0562592Z Compiling llvm/lib/Analysis/InlineCost.cpp; 7s local 2024-12-18T00:06:50.0563429Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 7s local 2024-12-18T00:06:50.0564392Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 6s local ... 2024-12-18T00:06:50.4302740Z 2024-12-18T00:06:50.4305643Z  2024-12-18T00:06:50.4306129Z  2024-12-18T00:06:50.4306498Z  2024-12-18T00:06:50.4306986Z  2024-12-18T00:06:50.4307372Z  2024-12-18T00:06:50.4307747Z  2024-12-18T00:06:50.4308101Z  2024-12-18T00:06:50.4308511Z  2024-12-18T00:06:50.4309148Z [11,571 / 15,187] 48 actions, 47 running 2024-12-18T00:06:50.4310072Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:06:50.4311103Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:06:50.4312029Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:06:50.4313122Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 8s local 2024-12-18T00:06:50.4313960Z Compiling xla/service/cpu/cpu_options.cc; 8s local 2024-12-18T00:06:50.4314726Z Compiling llvm/lib/Analysis/InlineCost.cpp; 7s local 2024-12-18T00:06:50.4315566Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 7s local 2024-12-18T00:06:50.4316480Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 7s local ... 2024-12-18T00:06:50.6486027Z 2024-12-18T00:06:50.6486972Z  2024-12-18T00:06:50.6488997Z  2024-12-18T00:06:50.6489373Z  2024-12-18T00:06:50.6489745Z  2024-12-18T00:06:50.6490095Z  2024-12-18T00:06:50.6490461Z  2024-12-18T00:06:50.6490815Z  2024-12-18T00:06:50.6491151Z  2024-12-18T00:06:50.6491679Z [11,573 / 15,187] 48 actions, 47 running 2024-12-18T00:06:50.6492539Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:06:50.6493515Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:06:50.6494407Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:06:50.6495380Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 8s local 2024-12-18T00:06:50.6496345Z Compiling llvm/lib/Analysis/InlineCost.cpp; 8s local 2024-12-18T00:06:50.6497423Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 7s local 2024-12-18T00:06:50.6498207Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 7s local 2024-12-18T00:06:50.6499010Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 7s local ... 2024-12-18T00:06:50.8558448Z 2024-12-18T00:06:50.8559336Z  2024-12-18T00:06:50.8559839Z  2024-12-18T00:06:50.8560296Z  2024-12-18T00:06:50.8560717Z  2024-12-18T00:06:50.8561138Z  2024-12-18T00:06:50.8561527Z  2024-12-18T00:06:50.8561915Z  2024-12-18T00:06:50.8562319Z  2024-12-18T00:06:50.8562898Z [11,576 / 15,187] 48 actions running 2024-12-18T00:06:50.8564208Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:06:50.8565280Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:06:50.8566247Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:06:50.8567228Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local 2024-12-18T00:06:50.8568431Z Compiling llvm/lib/Analysis/InlineCost.cpp; 8s local 2024-12-18T00:06:50.8569499Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 7s local 2024-12-18T00:06:50.8570465Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 7s local 2024-12-18T00:06:50.8571408Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 7s local ... 2024-12-18T00:06:51.0560371Z 2024-12-18T00:06:51.0561729Z  2024-12-18T00:06:51.0562233Z  2024-12-18T00:06:51.0562642Z  2024-12-18T00:06:51.0563066Z  2024-12-18T00:06:51.0563458Z  2024-12-18T00:06:51.0563849Z  2024-12-18T00:06:51.0564247Z  2024-12-18T00:06:51.0564610Z  2024-12-18T00:06:51.0565179Z [11,577 / 15,187] 48 actions running 2024-12-18T00:06:51.0566073Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:06:51.0567104Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:06:51.0568127Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:06:51.0569128Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local 2024-12-18T00:06:51.0570059Z Compiling llvm/lib/Analysis/InlineCost.cpp; 8s local 2024-12-18T00:06:51.0570950Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local 2024-12-18T00:06:51.0571880Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 7s local 2024-12-18T00:06:51.0572783Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 7s local ... 2024-12-18T00:06:51.4587516Z 2024-12-18T00:06:51.4588654Z  2024-12-18T00:06:51.4589129Z  2024-12-18T00:06:51.4589554Z  2024-12-18T00:06:51.4589911Z  2024-12-18T00:06:51.4590286Z  2024-12-18T00:06:51.4590643Z  2024-12-18T00:06:51.4591005Z  2024-12-18T00:06:51.4591371Z  2024-12-18T00:06:51.4591922Z [11,578 / 15,187] 48 actions, 47 running 2024-12-18T00:06:51.4592766Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:06:51.4593737Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:06:51.4594638Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:06:51.4595580Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local 2024-12-18T00:06:51.4596562Z Compiling llvm/lib/Analysis/InlineCost.cpp; 8s local 2024-12-18T00:06:51.4597405Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local 2024-12-18T00:06:51.4598331Z Compiling llvm/lib/Analysis/LazyCallGraph.cpp; 8s local 2024-12-18T00:06:51.4599225Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 8s local ... 2024-12-18T00:06:51.7097080Z 2024-12-18T00:06:51.7098141Z  2024-12-18T00:06:51.7098616Z  2024-12-18T00:06:51.7098994Z  2024-12-18T00:06:51.7099376Z  2024-12-18T00:06:51.7099774Z  2024-12-18T00:06:51.7100167Z  2024-12-18T00:06:51.7100555Z  2024-12-18T00:06:51.7100944Z  2024-12-18T00:06:51.7101589Z [11,581 / 15,187] 48 actions, 47 running 2024-12-18T00:06:51.7102520Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:06:51.7103582Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:06:51.7104541Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:06:51.7105530Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local 2024-12-18T00:06:51.7106481Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2024-12-18T00:06:51.7107385Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local 2024-12-18T00:06:51.7109187Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 8s local 2024-12-18T00:06:51.7110242Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 7s local ... 2024-12-18T00:06:51.9308723Z 2024-12-18T00:06:51.9310443Z  2024-12-18T00:06:51.9310896Z  2024-12-18T00:06:51.9311262Z  2024-12-18T00:06:51.9311636Z  2024-12-18T00:06:51.9312004Z  2024-12-18T00:06:51.9312826Z  2024-12-18T00:06:51.9313241Z  2024-12-18T00:06:51.9313622Z  2024-12-18T00:06:51.9314203Z [11,583 / 15,187] 48 actions, 47 running 2024-12-18T00:06:51.9315113Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:06:51.9316045Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:06:51.9317090Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:06:51.9318033Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 10s local 2024-12-18T00:06:51.9318963Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2024-12-18T00:06:51.9319800Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local 2024-12-18T00:06:51.9320643Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 8s local 2024-12-18T00:06:51.9321547Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local ... 2024-12-18T00:06:52.2119004Z 2024-12-18T00:06:52.2120066Z  2024-12-18T00:06:52.2120622Z  2024-12-18T00:06:52.2121051Z  2024-12-18T00:06:52.2121483Z  2024-12-18T00:06:52.2121915Z  2024-12-18T00:06:52.2122358Z  2024-12-18T00:06:52.2122767Z  2024-12-18T00:06:52.2123206Z  2024-12-18T00:06:52.2123867Z [11,585 / 15,187] 48 actions, 47 running 2024-12-18T00:06:52.2124906Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:06:52.2126087Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:06:52.2127189Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:06:52.2128507Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 10s local 2024-12-18T00:06:52.2129585Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2024-12-18T00:06:52.2130610Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:06:52.2131600Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 8s local 2024-12-18T00:06:52.2132439Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local ... 2024-12-18T00:06:52.4124863Z 2024-12-18T00:06:52.4126548Z  2024-12-18T00:06:52.4127045Z  2024-12-18T00:06:52.4127444Z  2024-12-18T00:06:52.4127826Z  2024-12-18T00:06:52.4128215Z  2024-12-18T00:06:52.4128608Z  2024-12-18T00:06:52.4128997Z  2024-12-18T00:06:52.4129384Z  2024-12-18T00:06:52.4129959Z [11,588 / 15,187] 48 actions, 47 running 2024-12-18T00:06:52.4130881Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:06:52.4131967Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:06:52.4132936Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:06:52.4133785Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2024-12-18T00:06:52.4134661Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:06:52.4135594Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 9s local 2024-12-18T00:06:52.4136533Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local 2024-12-18T00:06:52.4137640Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 7s local ... 2024-12-18T00:06:52.6152688Z 2024-12-18T00:06:52.6153721Z  2024-12-18T00:06:52.6154181Z  2024-12-18T00:06:52.6154584Z  2024-12-18T00:06:52.6154954Z  2024-12-18T00:06:52.6155325Z  2024-12-18T00:06:52.6155681Z  2024-12-18T00:06:52.6156028Z  2024-12-18T00:06:52.6156386Z  2024-12-18T00:06:52.6156949Z [11,590 / 15,187] 48 actions, 47 running 2024-12-18T00:06:52.6158243Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:06:52.6159319Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:06:52.6160480Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:06:52.6161381Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:06:52.6162541Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:06:52.6163588Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local 2024-12-18T00:06:52.6164465Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 8s local 2024-12-18T00:06:52.6165340Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 7s local ... 2024-12-18T00:06:52.8169850Z 2024-12-18T00:06:52.8170712Z  2024-12-18T00:06:52.8171096Z  2024-12-18T00:06:52.8171426Z  2024-12-18T00:06:52.8171752Z  2024-12-18T00:06:52.8172080Z  2024-12-18T00:06:52.8172388Z  2024-12-18T00:06:52.8172747Z  2024-12-18T00:06:52.8173213Z  2024-12-18T00:06:52.8173723Z [11,594 / 15,187] 48 actions, 47 running 2024-12-18T00:06:52.8174499Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:06:52.8175373Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:06:52.8176217Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:06:52.8177138Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:06:52.8177898Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:06:52.8178723Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local 2024-12-18T00:06:52.8179486Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 8s local 2024-12-18T00:06:52.8180236Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 7s local ... 2024-12-18T00:06:53.0575225Z 2024-12-18T00:06:53.0576089Z  2024-12-18T00:06:53.0576710Z  2024-12-18T00:06:53.0577193Z  2024-12-18T00:06:53.0577619Z  2024-12-18T00:06:53.0578371Z  2024-12-18T00:06:53.0578813Z  2024-12-18T00:06:53.0579225Z  2024-12-18T00:06:53.0579614Z  2024-12-18T00:06:53.0580200Z [11,596 / 15,187] 48 actions running 2024-12-18T00:06:53.0581129Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:06:53.0582282Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:06:53.0583284Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:06:53.0584207Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:06:53.0585123Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:06:53.0586136Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:06:53.0587021Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 8s local 2024-12-18T00:06:53.0587897Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 7s local ... 2024-12-18T00:06:53.4580055Z 2024-12-18T00:06:53.4580939Z  2024-12-18T00:06:53.4581418Z  2024-12-18T00:06:53.4581827Z  2024-12-18T00:06:53.4582225Z  2024-12-18T00:06:53.4582626Z  2024-12-18T00:06:53.4583012Z  2024-12-18T00:06:53.4583409Z  2024-12-18T00:06:53.4583799Z  2024-12-18T00:06:53.4584392Z [11,597 / 15,187] 48 actions running 2024-12-18T00:06:53.4585371Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:06:53.4586482Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:06:53.4587513Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:06:53.4588452Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:06:53.4589402Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:06:53.4590383Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:06:53.4591286Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local 2024-12-18T00:06:53.4592633Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 8s local ... 2024-12-18T00:06:53.6584171Z 2024-12-18T00:06:53.6585015Z  2024-12-18T00:06:53.6585469Z  2024-12-18T00:06:53.6585857Z  2024-12-18T00:06:53.6586256Z  2024-12-18T00:06:53.6586644Z  2024-12-18T00:06:53.6587039Z  2024-12-18T00:06:53.6587781Z  2024-12-18T00:06:53.6588213Z  2024-12-18T00:06:53.6588779Z [11,598 / 15,187] 48 actions running 2024-12-18T00:06:53.6589709Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:06:53.6590740Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:06:53.6591635Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:06:53.6592470Z Compiling llvm/lib/Analysis/InlineCost.cpp; 11s local 2024-12-18T00:06:53.6593381Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:06:53.6594350Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:06:53.6595195Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local 2024-12-18T00:06:53.6596005Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 8s local ... 2024-12-18T00:06:53.8846694Z 2024-12-18T00:06:53.8847568Z  2024-12-18T00:06:53.8848041Z  2024-12-18T00:06:53.8848432Z  2024-12-18T00:06:53.8848859Z  2024-12-18T00:06:53.8849232Z  2024-12-18T00:06:53.8849609Z  2024-12-18T00:06:53.8850002Z  2024-12-18T00:06:53.8850378Z  2024-12-18T00:06:53.8850928Z [11,600 / 15,187] 48 actions, 47 running 2024-12-18T00:06:53.8851852Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:06:53.8852771Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:06:53.8853726Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:06:53.8854714Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:06:53.8855756Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:06:53.8856781Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local 2024-12-18T00:06:53.8857725Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local 2024-12-18T00:06:53.8858749Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local ... 2024-12-18T00:06:54.1056806Z 2024-12-18T00:06:54.1057711Z  2024-12-18T00:06:54.1058224Z  2024-12-18T00:06:54.1058602Z  2024-12-18T00:06:54.1059009Z  2024-12-18T00:06:54.1059388Z  2024-12-18T00:06:54.1059766Z  2024-12-18T00:06:54.1060145Z  2024-12-18T00:06:54.1060531Z  2024-12-18T00:06:54.1061118Z [11,602 / 15,187] 48 actions, 47 running 2024-12-18T00:06:54.1062126Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:06:54.1063141Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:06:54.1064151Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:06:54.1065101Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:06:54.1066122Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2024-12-18T00:06:54.1066990Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local 2024-12-18T00:06:54.1067956Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local 2024-12-18T00:06:54.1068913Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local ... 2024-12-18T00:06:54.4464073Z 2024-12-18T00:06:54.4464948Z  2024-12-18T00:06:54.4465406Z  2024-12-18T00:06:54.4465811Z  2024-12-18T00:06:54.4466218Z  2024-12-18T00:06:54.4466615Z  2024-12-18T00:06:54.4467016Z  2024-12-18T00:06:54.4467406Z  2024-12-18T00:06:54.4467784Z  2024-12-18T00:06:54.4468385Z [11,605 / 15,187] 48 actions, 47 running 2024-12-18T00:06:54.4469340Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:06:54.4470813Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:06:54.4471803Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:06:54.4472795Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:06:54.4474047Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2024-12-18T00:06:54.4475121Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local 2024-12-18T00:06:54.4476083Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local 2024-12-18T00:06:54.4476977Z Compiling llvm/lib/Analysis/MemorySSAUpdater.cpp; 8s local ... 2024-12-18T00:06:54.6593501Z 2024-12-18T00:06:54.6594395Z  2024-12-18T00:06:54.6594934Z  2024-12-18T00:06:54.6595333Z  2024-12-18T00:06:54.6595769Z  2024-12-18T00:06:54.6596147Z  2024-12-18T00:06:54.6596547Z  2024-12-18T00:06:54.6596947Z  2024-12-18T00:06:54.6597464Z  2024-12-18T00:06:54.6598027Z [11,606 / 15,187] 48 actions running 2024-12-18T00:06:54.6599118Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:06:54.6600229Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:06:54.6601193Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2024-12-18T00:06:54.6602196Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:06:54.6603195Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2024-12-18T00:06:54.6604215Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 9s local 2024-12-18T00:06:54.6605120Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local 2024-12-18T00:06:54.6606031Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 8s local ... 2024-12-18T00:06:55.0597934Z 2024-12-18T00:06:55.0598819Z  2024-12-18T00:06:55.0599430Z  2024-12-18T00:06:55.0599962Z  2024-12-18T00:06:55.0600522Z  2024-12-18T00:06:55.0600913Z  2024-12-18T00:06:55.0601376Z  2024-12-18T00:06:55.0601838Z  2024-12-18T00:06:55.0602277Z  2024-12-18T00:06:55.0602875Z [11,608 / 15,187] 48 actions running 2024-12-18T00:06:55.0603856Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:06:55.0604973Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:06:55.0605963Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:06:55.0606963Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:06:55.0608034Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 9s local 2024-12-18T00:06:55.0609009Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2024-12-18T00:06:55.0609965Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 8s local 2024-12-18T00:06:55.0611071Z Compiling llvm/lib/Analysis/RegionInfo.cpp; 6s local ... 2024-12-18T00:06:55.4323560Z 2024-12-18T00:06:55.4324378Z  2024-12-18T00:06:55.4324873Z  2024-12-18T00:06:55.4325307Z  2024-12-18T00:06:55.4325712Z  2024-12-18T00:06:55.4326078Z  2024-12-18T00:06:55.4326429Z  2024-12-18T00:06:55.4326794Z  2024-12-18T00:06:55.4327119Z  2024-12-18T00:06:55.4327814Z [11,610 / 15,187] 48 actions, 47 running 2024-12-18T00:06:55.4328816Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:06:55.4329693Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:06:55.4330569Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:06:55.4331423Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:06:55.4332188Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2024-12-18T00:06:55.4332912Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2024-12-18T00:06:55.4333604Z Compiling llvm/lib/Analysis/RegionInfo.cpp; 6s local 2024-12-18T00:06:55.4334645Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 6s local ... 2024-12-18T00:06:55.6603842Z 2024-12-18T00:06:55.6604711Z  2024-12-18T00:06:55.6605208Z  2024-12-18T00:06:55.6605626Z  2024-12-18T00:06:55.6606040Z  2024-12-18T00:06:55.6606454Z  2024-12-18T00:06:55.6606864Z  2024-12-18T00:06:55.6607275Z  2024-12-18T00:06:55.6608033Z  2024-12-18T00:06:55.6608612Z [11,613 / 15,187] 48 actions running 2024-12-18T00:06:55.6609552Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:06:55.6610636Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:06:55.6611611Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:06:55.6612664Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:06:55.6613612Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2024-12-18T00:06:55.6614604Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2024-12-18T00:06:55.6615531Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 6s local 2024-12-18T00:06:55.6616376Z Compiling llvm/lib/Analysis/StackLifetime.cpp; 6s local ... 2024-12-18T00:06:56.0608885Z 2024-12-18T00:06:56.0609766Z  2024-12-18T00:06:56.0610247Z  2024-12-18T00:06:56.0610648Z  2024-12-18T00:06:56.0611079Z  2024-12-18T00:06:56.0611488Z  2024-12-18T00:06:56.0611882Z  2024-12-18T00:06:56.0612289Z  2024-12-18T00:06:56.0612700Z  2024-12-18T00:06:56.0613314Z [11,618 / 15,187] 48 actions running 2024-12-18T00:06:56.0614215Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:06:56.0615321Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:06:56.0616332Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:06:56.0617419Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2024-12-18T00:06:56.0618406Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2024-12-18T00:06:56.0619422Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 7s local 2024-12-18T00:06:56.0620402Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 6s local 2024-12-18T00:06:56.0621393Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 6s local ... 2024-12-18T00:06:56.2612124Z 2024-12-18T00:06:56.2612993Z  2024-12-18T00:06:56.2613430Z  2024-12-18T00:06:56.2613804Z  2024-12-18T00:06:56.2614183Z  2024-12-18T00:06:56.2614568Z  2024-12-18T00:06:56.2614935Z  2024-12-18T00:06:56.2615317Z  2024-12-18T00:06:56.2615711Z  2024-12-18T00:06:56.2616273Z [11,622 / 15,187] 48 actions running 2024-12-18T00:06:56.2617337Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:06:56.2618400Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:06:56.2619445Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:06:56.2620325Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2024-12-18T00:06:56.2621244Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2024-12-18T00:06:56.2622277Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 7s local 2024-12-18T00:06:56.2623231Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 6s local 2024-12-18T00:06:56.2624189Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 6s local ... 2024-12-18T00:06:56.4912085Z 2024-12-18T00:06:56.4912964Z  2024-12-18T00:06:56.4913446Z  2024-12-18T00:06:56.4913857Z  2024-12-18T00:06:56.4914250Z  2024-12-18T00:06:56.4914641Z  2024-12-18T00:06:56.4915043Z  2024-12-18T00:06:56.4915440Z  2024-12-18T00:06:56.4915815Z  2024-12-18T00:06:56.4916411Z [11,624 / 15,187] 48 actions, 47 running 2024-12-18T00:06:56.4917472Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:06:56.4919063Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:06:56.4920072Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:06:56.4921151Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2024-12-18T00:06:56.4922306Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 7s local 2024-12-18T00:06:56.4923260Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 6s local 2024-12-18T00:06:56.4924275Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 6s local 2024-12-18T00:06:56.4925303Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 6s local ... 2024-12-18T00:06:56.7391357Z 2024-12-18T00:06:56.7392259Z  2024-12-18T00:06:56.7392658Z  2024-12-18T00:06:56.7392991Z  2024-12-18T00:06:56.7393315Z  2024-12-18T00:06:56.7393641Z  2024-12-18T00:06:56.7393946Z  2024-12-18T00:06:56.7394266Z  2024-12-18T00:06:56.7394630Z  2024-12-18T00:06:56.7395124Z [11,626 / 15,187] 48 actions, 47 running 2024-12-18T00:06:56.7395905Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:06:56.7396748Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:06:56.7397645Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:06:56.7398621Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2024-12-18T00:06:56.7399376Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 7s local 2024-12-18T00:06:56.7400142Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 7s local 2024-12-18T00:06:56.7400878Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 6s local 2024-12-18T00:06:56.7401719Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 6s local ... 2024-12-18T00:06:57.0619267Z 2024-12-18T00:06:57.0620171Z  2024-12-18T00:06:57.0620650Z  2024-12-18T00:06:57.0621047Z  2024-12-18T00:06:57.0621503Z  2024-12-18T00:06:57.0621909Z  2024-12-18T00:06:57.0622290Z  2024-12-18T00:06:57.0622688Z  2024-12-18T00:06:57.0623091Z  2024-12-18T00:06:57.0623664Z [11,628 / 15,187] 48 actions running 2024-12-18T00:06:57.0624601Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:06:57.0625757Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:06:57.0626773Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:06:57.0627768Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2024-12-18T00:06:57.0628739Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 8s local 2024-12-18T00:06:57.0629687Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 7s local 2024-12-18T00:06:57.0630675Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 7s local 2024-12-18T00:06:57.0631710Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 7s local ... 2024-12-18T00:06:57.2881652Z 2024-12-18T00:06:57.2882585Z  2024-12-18T00:06:57.2883065Z  2024-12-18T00:06:57.2883478Z  2024-12-18T00:06:57.2883897Z  2024-12-18T00:06:57.2884314Z  2024-12-18T00:06:57.2884723Z  2024-12-18T00:06:57.2885125Z  2024-12-18T00:06:57.2885534Z  2024-12-18T00:06:57.2886147Z [11,629 / 15,187] 48 actions, 47 running 2024-12-18T00:06:57.2887160Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:06:57.2888266Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:06:57.2889290Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:06:57.2890344Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2024-12-18T00:06:57.2891359Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 8s local 2024-12-18T00:06:57.2892339Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 7s local 2024-12-18T00:06:57.2893769Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 7s local 2024-12-18T00:06:57.2894804Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 7s local ... 2024-12-18T00:06:57.5252578Z 2024-12-18T00:06:57.5253476Z  2024-12-18T00:06:57.5254011Z  2024-12-18T00:06:57.5254504Z  2024-12-18T00:06:57.5254887Z  2024-12-18T00:06:57.5255302Z  2024-12-18T00:06:57.5255760Z  2024-12-18T00:06:57.5256659Z  2024-12-18T00:06:57.5257165Z  2024-12-18T00:06:57.5257726Z [11,632 / 15,187] 48 actions, 47 running 2024-12-18T00:06:57.5258705Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:06:57.5259804Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:06:57.5260833Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:06:57.5261859Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2024-12-18T00:06:57.5262799Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 8s local 2024-12-18T00:06:57.5263747Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:06:57.5264892Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 7s local 2024-12-18T00:06:57.5265938Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 7s local ... 2024-12-18T00:06:57.8588631Z 2024-12-18T00:06:57.8589496Z  2024-12-18T00:06:57.8589968Z  2024-12-18T00:06:57.8590399Z  2024-12-18T00:06:57.8590803Z  2024-12-18T00:06:57.8591228Z  2024-12-18T00:06:57.8591688Z  2024-12-18T00:06:57.8592074Z  2024-12-18T00:06:57.8592474Z  2024-12-18T00:06:57.8593024Z [11,634 / 15,187] 48 actions, 47 running 2024-12-18T00:06:57.8593845Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:06:57.8594899Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:06:57.8595914Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:06:57.8596913Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2024-12-18T00:06:57.8597991Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 8s local 2024-12-18T00:06:57.8598787Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:06:57.8599617Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 8s local 2024-12-18T00:06:57.8600613Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local ... 2024-12-18T00:06:58.0601986Z 2024-12-18T00:06:58.0602819Z  2024-12-18T00:06:58.0603278Z  2024-12-18T00:06:58.0603686Z  2024-12-18T00:06:58.0604059Z  2024-12-18T00:06:58.0604450Z  2024-12-18T00:06:58.0604846Z  2024-12-18T00:06:58.0605245Z  2024-12-18T00:06:58.0605618Z  2024-12-18T00:06:58.0606239Z [11,639 / 15,187] 48 actions, 47 running 2024-12-18T00:06:58.0607188Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:06:58.0608268Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2024-12-18T00:06:58.0609323Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 9s local 2024-12-18T00:06:58.0610260Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:06:58.0611177Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 8s local 2024-12-18T00:06:58.0612196Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local 2024-12-18T00:06:58.0613038Z Compiling xla/frontend_attributes.cc; 7s local 2024-12-18T00:06:58.0613897Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local ... 2024-12-18T00:06:58.2629661Z 2024-12-18T00:06:58.2630542Z  2024-12-18T00:06:58.2631054Z  2024-12-18T00:06:58.2631487Z  2024-12-18T00:06:58.2631893Z  2024-12-18T00:06:58.2632299Z  2024-12-18T00:06:58.2632686Z  2024-12-18T00:06:58.2633115Z  2024-12-18T00:06:58.2633532Z  2024-12-18T00:06:58.2634115Z [11,644 / 15,187] 48 actions running 2024-12-18T00:06:58.2635469Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:06:58.2636603Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2024-12-18T00:06:58.2637577Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 9s local 2024-12-18T00:06:58.2638553Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:06:58.2639765Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 8s local 2024-12-18T00:06:58.2640763Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local 2024-12-18T00:06:58.2641544Z Compiling xla/frontend_attributes.cc; 7s local 2024-12-18T00:06:58.2642324Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local ... 2024-12-18T00:06:58.4633570Z 2024-12-18T00:06:58.4634376Z  2024-12-18T00:06:58.4634851Z  2024-12-18T00:06:58.4635237Z  2024-12-18T00:06:58.4635604Z  2024-12-18T00:06:58.4636003Z  2024-12-18T00:06:58.4636397Z  2024-12-18T00:06:58.4637045Z  2024-12-18T00:06:58.4637422Z  2024-12-18T00:06:58.4637993Z [11,646 / 15,187] 48 actions running 2024-12-18T00:06:58.4638921Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:06:58.4640072Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2024-12-18T00:06:58.4641117Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 9s local 2024-12-18T00:06:58.4642145Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:06:58.4643183Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 8s local 2024-12-18T00:06:58.4644476Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local 2024-12-18T00:06:58.4645358Z Compiling xla/frontend_attributes.cc; 7s local 2024-12-18T00:06:58.4646271Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local ... 2024-12-18T00:06:58.7216170Z 2024-12-18T00:06:58.7217116Z  2024-12-18T00:06:58.7217639Z  2024-12-18T00:06:58.7218025Z  2024-12-18T00:06:58.7218443Z  2024-12-18T00:06:58.7218835Z  2024-12-18T00:06:58.7219233Z  2024-12-18T00:06:58.7219640Z  2024-12-18T00:06:58.7220034Z  2024-12-18T00:06:58.7220613Z [11,647 / 15,187] 48 actions, 47 running 2024-12-18T00:06:58.7221530Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:06:58.7222700Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2024-12-18T00:06:58.7223696Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 9s local 2024-12-18T00:06:58.7224649Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:06:58.7225669Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 8s local 2024-12-18T00:06:58.7226724Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local 2024-12-18T00:06:58.7227726Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local 2024-12-18T00:06:58.7228673Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local ... 2024-12-18T00:06:59.0081891Z 2024-12-18T00:06:59.0082764Z  2024-12-18T00:06:59.0083255Z  2024-12-18T00:06:59.0083656Z  2024-12-18T00:06:59.0084079Z  2024-12-18T00:06:59.0084481Z  2024-12-18T00:06:59.0084873Z  2024-12-18T00:06:59.0085286Z  2024-12-18T00:06:59.0085673Z  2024-12-18T00:06:59.0086305Z [11,651 / 15,187] 48 actions, 47 running 2024-12-18T00:06:59.0087314Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:06:59.0088454Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2024-12-18T00:06:59.0089475Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local 2024-12-18T00:06:59.0090442Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:06:59.0091428Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:06:59.0092422Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 9s local 2024-12-18T00:06:59.0093411Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:06:59.0094704Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local ... 2024-12-18T00:06:59.2639568Z 2024-12-18T00:06:59.2640415Z  2024-12-18T00:06:59.2640903Z  2024-12-18T00:06:59.2641317Z  2024-12-18T00:06:59.2641711Z  2024-12-18T00:06:59.2642128Z  2024-12-18T00:06:59.2642542Z  2024-12-18T00:06:59.2642947Z  2024-12-18T00:06:59.2643696Z  2024-12-18T00:06:59.2644623Z [11,653 / 15,187] 48 actions running 2024-12-18T00:06:59.2645583Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:06:59.2646705Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2024-12-18T00:06:59.2647746Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local 2024-12-18T00:06:59.2648757Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:06:59.2649723Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:06:59.2650685Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 9s local 2024-12-18T00:06:59.2651612Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:06:59.2652500Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local ... 2024-12-18T00:06:59.4643683Z 2024-12-18T00:06:59.4644737Z  2024-12-18T00:06:59.4645221Z  2024-12-18T00:06:59.4645616Z  2024-12-18T00:06:59.4646068Z  2024-12-18T00:06:59.4646465Z  2024-12-18T00:06:59.4646842Z  2024-12-18T00:06:59.4647241Z  2024-12-18T00:06:59.4647622Z  2024-12-18T00:06:59.4648209Z [11,657 / 15,187] 48 actions running 2024-12-18T00:06:59.4649132Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:06:59.4650270Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local 2024-12-18T00:06:59.4651207Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local 2024-12-18T00:06:59.4652110Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:06:59.4653130Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:06:59.4654017Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:06:59.4654887Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2024-12-18T00:06:59.4655780Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 7s local ... 2024-12-18T00:06:59.6791503Z 2024-12-18T00:06:59.6792379Z  2024-12-18T00:06:59.6792852Z  2024-12-18T00:06:59.6793305Z  2024-12-18T00:06:59.6793790Z  2024-12-18T00:06:59.6794224Z  2024-12-18T00:06:59.6794618Z  2024-12-18T00:06:59.6795054Z  2024-12-18T00:06:59.6795479Z  2024-12-18T00:06:59.6796060Z [11,658 / 15,187] 48 actions, 47 running 2024-12-18T00:06:59.6797002Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:06:59.6798110Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local 2024-12-18T00:06:59.6799116Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local 2024-12-18T00:06:59.6800118Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:06:59.6801170Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:06:59.6802076Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:06:59.6802971Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2024-12-18T00:06:59.6803866Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local ... 2024-12-18T00:06:59.9026530Z 2024-12-18T00:06:59.9027367Z  2024-12-18T00:06:59.9027834Z  2024-12-18T00:06:59.9028244Z  2024-12-18T00:06:59.9028659Z  2024-12-18T00:06:59.9029070Z  2024-12-18T00:06:59.9029461Z  2024-12-18T00:06:59.9029836Z  2024-12-18T00:06:59.9030250Z  2024-12-18T00:06:59.9030899Z [11,660 / 15,187] 48 actions, 47 running 2024-12-18T00:06:59.9031845Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:06:59.9033376Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:06:59.9034275Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:06:59.9035220Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:06:59.9036087Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:06:59.9037212Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:06:59.9038072Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2024-12-18T00:06:59.9039003Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local ... 2024-12-18T00:07:00.2347253Z 2024-12-18T00:07:00.2348099Z  2024-12-18T00:07:00.2348568Z  2024-12-18T00:07:00.2348987Z  2024-12-18T00:07:00.2349372Z  2024-12-18T00:07:00.2349762Z  2024-12-18T00:07:00.2350160Z  2024-12-18T00:07:00.2350572Z  2024-12-18T00:07:00.2350952Z  2024-12-18T00:07:00.2351586Z [11,667 / 15,187] 48 actions, 47 running 2024-12-18T00:07:00.2352545Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:07:00.2353601Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:07:00.2354571Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:07:00.2355599Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:07:00.2356478Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:07:00.2357309Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:07:00.2358145Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2024-12-18T00:07:00.2359063Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local ... 2024-12-18T00:07:00.4645123Z 2024-12-18T00:07:00.4646034Z  2024-12-18T00:07:00.4646514Z  2024-12-18T00:07:00.4646869Z  2024-12-18T00:07:00.4647261Z  2024-12-18T00:07:00.4647647Z  2024-12-18T00:07:00.4648071Z  2024-12-18T00:07:00.4648472Z  2024-12-18T00:07:00.4648852Z  2024-12-18T00:07:00.4649441Z [11,671 / 15,187] 48 actions, 47 running 2024-12-18T00:07:00.4650365Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:07:00.4651465Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:07:00.4652587Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:07:00.4653635Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:07:00.4654549Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:07:00.4655397Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:07:00.4656200Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2024-12-18T00:07:00.4657253Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local ... 2024-12-18T00:07:00.6653100Z 2024-12-18T00:07:00.6653953Z  2024-12-18T00:07:00.6654474Z  2024-12-18T00:07:00.6654877Z  2024-12-18T00:07:00.6655265Z  2024-12-18T00:07:00.6655666Z  2024-12-18T00:07:00.6656073Z  2024-12-18T00:07:00.6656627Z  2024-12-18T00:07:00.6657015Z  2024-12-18T00:07:00.6657590Z [11,673 / 15,187] 48 actions running 2024-12-18T00:07:00.6658569Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:07:00.6659652Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:07:00.6660616Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 11s local 2024-12-18T00:07:00.6661663Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:07:00.6662558Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:07:00.6663423Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:07:00.6664309Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2024-12-18T00:07:00.6665308Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local ... 2024-12-18T00:07:00.8664117Z 2024-12-18T00:07:00.8665033Z  2024-12-18T00:07:00.8665532Z  2024-12-18T00:07:00.8665902Z  2024-12-18T00:07:00.8666287Z  2024-12-18T00:07:00.8666653Z  2024-12-18T00:07:00.8667024Z  2024-12-18T00:07:00.8667377Z  2024-12-18T00:07:00.8667763Z  2024-12-18T00:07:00.8668720Z [11,677 / 15,187] 48 actions, 47 running 2024-12-18T00:07:00.8669663Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:07:00.8670663Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:07:00.8671599Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:07:00.8672509Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:07:00.8673367Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:07:00.8674202Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:07:00.8675136Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:07:00.8676100Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local ... 2024-12-18T00:07:01.0996368Z 2024-12-18T00:07:01.0997217Z  2024-12-18T00:07:01.0997629Z  2024-12-18T00:07:01.0998021Z  2024-12-18T00:07:01.0998399Z  2024-12-18T00:07:01.0998772Z  2024-12-18T00:07:01.0999190Z  2024-12-18T00:07:01.0999521Z  2024-12-18T00:07:01.0999843Z  2024-12-18T00:07:01.1000363Z [11,680 / 15,187] 48 actions, 47 running 2024-12-18T00:07:01.1001146Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:07:01.1002026Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:07:01.1002795Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:07:01.1003823Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:07:01.1004857Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:07:01.1006040Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:07:01.1007138Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2024-12-18T00:07:01.1008317Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local ... 2024-12-18T00:07:01.3416206Z 2024-12-18T00:07:01.3417149Z  2024-12-18T00:07:01.3417667Z  2024-12-18T00:07:01.3418076Z  2024-12-18T00:07:01.3418487Z  2024-12-18T00:07:01.3418902Z  2024-12-18T00:07:01.3419309Z  2024-12-18T00:07:01.3419720Z  2024-12-18T00:07:01.3420136Z  2024-12-18T00:07:01.3420750Z [11,682 / 15,187] 48 actions, 47 running 2024-12-18T00:07:01.3421742Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:07:01.3422839Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:07:01.3423853Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:07:01.3424869Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:07:01.3425849Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:07:01.3426878Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:07:01.3427786Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:07:01.3428803Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local ... 2024-12-18T00:07:01.5535974Z 2024-12-18T00:07:01.5536963Z  2024-12-18T00:07:01.5537457Z  2024-12-18T00:07:01.5537867Z  2024-12-18T00:07:01.5538276Z  2024-12-18T00:07:01.5538657Z  2024-12-18T00:07:01.5539050Z  2024-12-18T00:07:01.5539466Z  2024-12-18T00:07:01.5539879Z  2024-12-18T00:07:01.5540487Z [11,685 / 15,187] 48 actions, 47 running 2024-12-18T00:07:01.5541417Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:07:01.5542828Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:07:01.5543734Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:07:01.5544922Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:07:01.5545826Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:07:01.5547034Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:07:01.5547930Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:07:01.5548962Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local ... 2024-12-18T00:07:01.7792361Z 2024-12-18T00:07:01.7793189Z  2024-12-18T00:07:01.7793674Z  2024-12-18T00:07:01.7794039Z  2024-12-18T00:07:01.7794449Z  2024-12-18T00:07:01.7794858Z  2024-12-18T00:07:01.7795220Z  2024-12-18T00:07:01.7795614Z  2024-12-18T00:07:01.7795980Z  2024-12-18T00:07:01.7796598Z [11,690 / 15,187] 48 actions, 47 running 2024-12-18T00:07:01.7797575Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:07:01.7798773Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:07:01.7799825Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:07:01.7800779Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:07:01.7801754Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:07:01.7802801Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2024-12-18T00:07:01.7803810Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:07:01.7804798Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local ... 2024-12-18T00:07:01.9823754Z 2024-12-18T00:07:01.9824640Z  2024-12-18T00:07:01.9825129Z  2024-12-18T00:07:01.9825537Z  2024-12-18T00:07:01.9825935Z  2024-12-18T00:07:01.9826310Z  2024-12-18T00:07:01.9826717Z  2024-12-18T00:07:01.9827165Z  2024-12-18T00:07:01.9827555Z  2024-12-18T00:07:01.9828136Z [11,693 / 15,187] 48 actions, 47 running 2024-12-18T00:07:01.9829069Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:07:01.9830147Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:07:01.9831097Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:07:01.9832040Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:07:01.9832967Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:07:01.9833886Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2024-12-18T00:07:01.9834820Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:07:01.9835807Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local ... 2024-12-18T00:07:02.2662805Z 2024-12-18T00:07:02.2663683Z  2024-12-18T00:07:02.2664172Z  2024-12-18T00:07:02.2664630Z  2024-12-18T00:07:02.2665042Z  2024-12-18T00:07:02.2665436Z  2024-12-18T00:07:02.2665828Z  2024-12-18T00:07:02.2666215Z  2024-12-18T00:07:02.2666609Z  2024-12-18T00:07:02.2667181Z [11,697 / 15,187] 48 actions running 2024-12-18T00:07:02.2668134Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:07:02.2669146Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:07:02.2670087Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:07:02.2671015Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:07:02.2671983Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:07:02.2672890Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2024-12-18T00:07:02.2673834Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:07:02.2674974Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local ... 2024-12-18T00:07:02.4812885Z 2024-12-18T00:07:02.4813730Z  2024-12-18T00:07:02.4814216Z  2024-12-18T00:07:02.4814622Z  2024-12-18T00:07:02.4815014Z  2024-12-18T00:07:02.4815423Z  2024-12-18T00:07:02.4815830Z  2024-12-18T00:07:02.4816201Z  2024-12-18T00:07:02.4816732Z  2024-12-18T00:07:02.4817668Z [11,702 / 15,187] 48 actions, 47 running 2024-12-18T00:07:02.4818598Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:07:02.4819567Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:07:02.4820439Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:07:02.4821348Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:07:02.4822264Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:07:02.4823177Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:07:02.4824133Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:07:02.4825099Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:07:02.6935351Z 2024-12-18T00:07:02.6936209Z  2024-12-18T00:07:02.6936831Z  2024-12-18T00:07:02.6937205Z  2024-12-18T00:07:02.6937549Z  2024-12-18T00:07:02.6937867Z  2024-12-18T00:07:02.6938249Z  2024-12-18T00:07:02.6938581Z  2024-12-18T00:07:02.6938915Z  2024-12-18T00:07:02.6939404Z [11,705 / 15,187] 48 actions, 47 running 2024-12-18T00:07:02.6940152Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:07:02.6940974Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:07:02.6941721Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:07:02.6942429Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:07:02.6943142Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:07:02.6943885Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:07:02.6944898Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:07:02.6945658Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:07:02.9065518Z 2024-12-18T00:07:02.9066328Z  2024-12-18T00:07:02.9066855Z  2024-12-18T00:07:02.9067250Z  2024-12-18T00:07:02.9067640Z  2024-12-18T00:07:02.9068038Z  2024-12-18T00:07:02.9068425Z  2024-12-18T00:07:02.9068829Z  2024-12-18T00:07:02.9069223Z  2024-12-18T00:07:02.9069819Z [11,708 / 15,187] 48 actions, 47 running 2024-12-18T00:07:02.9070776Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:07:02.9071839Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:07:02.9072818Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:07:02.9073783Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:07:02.9074770Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:07:02.9075769Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:07:02.9076823Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:07:02.9077941Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:07:03.2403197Z 2024-12-18T00:07:03.2404033Z  2024-12-18T00:07:03.2404510Z  2024-12-18T00:07:03.2404875Z  2024-12-18T00:07:03.2405263Z  2024-12-18T00:07:03.2405632Z  2024-12-18T00:07:03.2405991Z  2024-12-18T00:07:03.2406310Z  2024-12-18T00:07:03.2406643Z  2024-12-18T00:07:03.2407163Z [11,712 / 15,187] 48 actions, 47 running 2024-12-18T00:07:03.2407916Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:07:03.2409247Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:07:03.2410294Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:07:03.2411338Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:07:03.2412442Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:07:03.2413787Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:07:03.2414953Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:07:03.2416167Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local ... 2024-12-18T00:07:03.4673148Z 2024-12-18T00:07:03.4674038Z  2024-12-18T00:07:03.4674581Z  2024-12-18T00:07:03.4674968Z  2024-12-18T00:07:03.4675364Z  2024-12-18T00:07:03.4675763Z  2024-12-18T00:07:03.4676152Z  2024-12-18T00:07:03.4676550Z  2024-12-18T00:07:03.4676920Z  2024-12-18T00:07:03.4677517Z [11,715 / 15,187] 48 actions running 2024-12-18T00:07:03.4678556Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:07:03.4679639Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:07:03.4680654Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:07:03.4681564Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:07:03.4682549Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:07:03.4683515Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:07:03.4684460Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2024-12-18T00:07:03.4685507Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 6s local ... 2024-12-18T00:07:03.6675752Z 2024-12-18T00:07:03.6676596Z  2024-12-18T00:07:03.6677117Z  2024-12-18T00:07:03.6677577Z  2024-12-18T00:07:03.6677942Z  2024-12-18T00:07:03.6678318Z  2024-12-18T00:07:03.6678700Z  2024-12-18T00:07:03.6679085Z  2024-12-18T00:07:03.6679550Z  2024-12-18T00:07:03.6680152Z [11,719 / 15,187] 48 actions running 2024-12-18T00:07:03.6681075Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:07:03.6682093Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:07:03.6683057Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:07:03.6683972Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:07:03.6684886Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:07:03.6685873Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:07:03.6686833Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2024-12-18T00:07:03.6687832Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 7s local ... 2024-12-18T00:07:03.8984469Z 2024-12-18T00:07:03.8985291Z  2024-12-18T00:07:03.8985823Z  2024-12-18T00:07:03.8986225Z  2024-12-18T00:07:03.8986616Z  2024-12-18T00:07:03.8986999Z  2024-12-18T00:07:03.8987412Z  2024-12-18T00:07:03.8988003Z  2024-12-18T00:07:03.8988395Z  2024-12-18T00:07:03.8988986Z [11,723 / 15,187] 48 actions, 47 running 2024-12-18T00:07:03.8989880Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:07:03.8990883Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:07:03.8991855Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:07:03.8992726Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:07:03.8993626Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2024-12-18T00:07:03.8994609Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:07:03.8995552Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2024-12-18T00:07:03.8996583Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 7s local ... 2024-12-18T00:07:04.1193320Z 2024-12-18T00:07:04.1194215Z  2024-12-18T00:07:04.1194727Z  2024-12-18T00:07:04.1195138Z  2024-12-18T00:07:04.1195560Z  2024-12-18T00:07:04.1195987Z  2024-12-18T00:07:04.1196386Z  2024-12-18T00:07:04.1196761Z  2024-12-18T00:07:04.1197147Z  2024-12-18T00:07:04.1198143Z [11,729 / 15,187] 48 actions, 47 running 2024-12-18T00:07:04.1199085Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:07:04.1200113Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:07:04.1201047Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:07:04.1201975Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:07:04.1202861Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2024-12-18T00:07:04.1203875Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:07:04.1204933Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:07:04.1206009Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 7s local ... 2024-12-18T00:07:04.3280883Z 2024-12-18T00:07:04.3281738Z  2024-12-18T00:07:04.3282186Z  2024-12-18T00:07:04.3282598Z  2024-12-18T00:07:04.3282997Z  2024-12-18T00:07:04.3283386Z  2024-12-18T00:07:04.3283795Z  2024-12-18T00:07:04.3284188Z  2024-12-18T00:07:04.3284584Z  2024-12-18T00:07:04.3285177Z [11,734 / 15,187] 48 actions, 47 running 2024-12-18T00:07:04.3286108Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:07:04.3287141Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:07:04.3288094Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:07:04.3289021Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:07:04.3289991Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2024-12-18T00:07:04.3290961Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:07:04.3291909Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:07:04.3292944Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 7s local ... 2024-12-18T00:07:04.5283728Z 2024-12-18T00:07:04.5284635Z  2024-12-18T00:07:04.5285090Z  2024-12-18T00:07:04.5285429Z  2024-12-18T00:07:04.5285794Z  2024-12-18T00:07:04.5286149Z  2024-12-18T00:07:04.5286523Z  2024-12-18T00:07:04.5286879Z  2024-12-18T00:07:04.5287256Z  2024-12-18T00:07:04.5287806Z [11,740 / 15,187] 48 actions, 47 running 2024-12-18T00:07:04.5288683Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:07:04.5289691Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:07:04.5290688Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:07:04.5291611Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:07:04.5292514Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:07:04.5293478Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:07:04.5294494Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 7s local 2024-12-18T00:07:04.5295520Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local ... 2024-12-18T00:07:04.7572583Z 2024-12-18T00:07:04.7573418Z  2024-12-18T00:07:04.7573905Z  2024-12-18T00:07:04.7574339Z  2024-12-18T00:07:04.7574755Z  2024-12-18T00:07:04.7575169Z  2024-12-18T00:07:04.7575590Z  2024-12-18T00:07:04.7576016Z  2024-12-18T00:07:04.7576527Z  2024-12-18T00:07:04.7577167Z [11,745 / 15,187] 48 actions, 47 running 2024-12-18T00:07:04.7578190Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:07:04.7579673Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:07:04.7580685Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:07:04.7581656Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:07:04.7582596Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:07:04.7583867Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:07:04.7584881Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2024-12-18T00:07:04.7585936Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local ... 2024-12-18T00:07:05.0209040Z 2024-12-18T00:07:05.0209912Z  2024-12-18T00:07:05.0210418Z  2024-12-18T00:07:05.0210910Z  2024-12-18T00:07:05.0211428Z  2024-12-18T00:07:05.0211866Z  2024-12-18T00:07:05.0212286Z  2024-12-18T00:07:05.0212692Z  2024-12-18T00:07:05.0213105Z  2024-12-18T00:07:05.0213804Z [11,750 / 15,187] 48 actions, 47 running 2024-12-18T00:07:05.0214787Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:07:05.0215846Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:07:05.0216960Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:07:05.0217946Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:07:05.0218860Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:07:05.0219900Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2024-12-18T00:07:05.0220928Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local 2024-12-18T00:07:05.0221869Z Compiling xla/service/cpu/onednn_util.cc; 6s local ... 2024-12-18T00:07:05.2686984Z 2024-12-18T00:07:05.2687858Z  2024-12-18T00:07:05.2688340Z  2024-12-18T00:07:05.2688771Z  2024-12-18T00:07:05.2689176Z  2024-12-18T00:07:05.2689589Z  2024-12-18T00:07:05.2690043Z  2024-12-18T00:07:05.2690434Z  2024-12-18T00:07:05.2690836Z  2024-12-18T00:07:05.2691415Z [11,754 / 15,187] 48 actions running 2024-12-18T00:07:05.2692346Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:07:05.2693430Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:07:05.2694297Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:07:05.2695113Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:07:05.2695942Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2024-12-18T00:07:05.2697279Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2024-12-18T00:07:05.2698397Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local 2024-12-18T00:07:05.2699327Z Compiling xla/service/cpu/onednn_util.cc; 6s local ... 2024-12-18T00:07:05.4912305Z 2024-12-18T00:07:05.4913181Z  2024-12-18T00:07:05.4913832Z  2024-12-18T00:07:05.4914196Z  2024-12-18T00:07:05.4914592Z  2024-12-18T00:07:05.4914982Z  2024-12-18T00:07:05.4915480Z  2024-12-18T00:07:05.4915948Z  2024-12-18T00:07:05.4916337Z  2024-12-18T00:07:05.4917024Z [11,760 / 15,187] 48 actions, 47 running 2024-12-18T00:07:05.4917991Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:07:05.4919137Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:07:05.4920127Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:07:05.4921055Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:07:05.4922074Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2024-12-18T00:07:05.4923150Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2024-12-18T00:07:05.4924186Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:07:05.4925641Z Compiling xla/service/cpu/onednn_util.cc; 6s local ... 2024-12-18T00:07:05.7135175Z 2024-12-18T00:07:05.7136041Z  2024-12-18T00:07:05.7136703Z  2024-12-18T00:07:05.7137124Z  2024-12-18T00:07:05.7137523Z  2024-12-18T00:07:05.7137952Z  2024-12-18T00:07:05.7138372Z  2024-12-18T00:07:05.7138788Z  2024-12-18T00:07:05.7139190Z  2024-12-18T00:07:05.7140148Z [11,765 / 15,187] 48 actions, 47 running 2024-12-18T00:07:05.7141141Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:07:05.7152890Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:07:05.7154083Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:07:05.7155009Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:07:05.7155922Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2024-12-18T00:07:05.7156948Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 9s local 2024-12-18T00:07:05.7157931Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:07:05.7158846Z Compiling xla/service/cpu/onednn_util.cc; 6s local ... 2024-12-18T00:07:06.0138793Z 2024-12-18T00:07:06.0139679Z  2024-12-18T00:07:06.0140182Z  2024-12-18T00:07:06.0140610Z  2024-12-18T00:07:06.0141026Z  2024-12-18T00:07:06.0141475Z  2024-12-18T00:07:06.0141897Z  2024-12-18T00:07:06.0142282Z  2024-12-18T00:07:06.0142696Z  2024-12-18T00:07:06.0143306Z [11,768 / 15,187] 48 actions, 47 running 2024-12-18T00:07:06.0144552Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:07:06.0145643Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:07:06.0146665Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:07:06.0147617Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:07:06.0148593Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 9s local 2024-12-18T00:07:06.0149597Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:07:06.0150465Z Compiling xla/service/cpu/onednn_util.cc; 7s local 2024-12-18T00:07:06.0151211Z @llvm-project//llvm:llvm-tblgen; 4s local ... 2024-12-18T00:07:06.2696085Z 2024-12-18T00:07:06.2697051Z  2024-12-18T00:07:06.2697560Z  2024-12-18T00:07:06.2697955Z  2024-12-18T00:07:06.2698330Z  2024-12-18T00:07:06.2698719Z  2024-12-18T00:07:06.2699112Z  2024-12-18T00:07:06.2699503Z  2024-12-18T00:07:06.2699889Z  2024-12-18T00:07:06.2700427Z [11,768 / 15,187] 48 actions running 2024-12-18T00:07:06.2701345Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:07:06.2702366Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:07:06.2703284Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:07:06.2704227Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:07:06.2705162Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 9s local 2024-12-18T00:07:06.2706112Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:07:06.2707008Z Compiling xla/service/cpu/onednn_util.cc; 7s local 2024-12-18T00:07:06.2707745Z @llvm-project//llvm:llvm-tblgen; 4s local ... 2024-12-18T00:07:06.5875246Z 2024-12-18T00:07:06.5876056Z  2024-12-18T00:07:06.5876536Z  2024-12-18T00:07:06.5876928Z  2024-12-18T00:07:06.5877292Z  2024-12-18T00:07:06.5877660Z  2024-12-18T00:07:06.5878041Z  2024-12-18T00:07:06.5878414Z  2024-12-18T00:07:06.5878773Z  2024-12-18T00:07:06.5879381Z [11,771 / 15,187] 48 actions, 47 running 2024-12-18T00:07:06.5880295Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:07:06.5881291Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:07:06.5882727Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:07:06.5883619Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:07:06.5884561Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2024-12-18T00:07:06.5885573Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:07:06.5886805Z Compiling xla/service/cpu/onednn_util.cc; 7s local 2024-12-18T00:07:06.5887590Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2024-12-18T00:07:06.8350126Z 2024-12-18T00:07:06.8351004Z  2024-12-18T00:07:06.8351485Z  2024-12-18T00:07:06.8351886Z  2024-12-18T00:07:06.8352300Z  2024-12-18T00:07:06.8352690Z  2024-12-18T00:07:06.8353107Z  2024-12-18T00:07:06.8353501Z  2024-12-18T00:07:06.8353887Z  2024-12-18T00:07:06.8354570Z [11,772 / 15,187] 48 actions, 47 running 2024-12-18T00:07:06.8355521Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:07:06.8356514Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:07:06.8357415Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:07:06.8358312Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:07:06.8359227Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2024-12-18T00:07:06.8360161Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:07:06.8360986Z Compiling xla/service/cpu/onednn_util.cc; 8s local 2024-12-18T00:07:06.8361882Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 5s local ... 2024-12-18T00:07:07.0703139Z 2024-12-18T00:07:07.0703965Z  2024-12-18T00:07:07.0704436Z  2024-12-18T00:07:07.0704814Z  2024-12-18T00:07:07.0705193Z  2024-12-18T00:07:07.0705596Z  2024-12-18T00:07:07.0705976Z  2024-12-18T00:07:07.0706358Z  2024-12-18T00:07:07.0706766Z  2024-12-18T00:07:07.0707314Z [11,774 / 15,187] 47 actions running 2024-12-18T00:07:07.0708255Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:07:07.0709275Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:07:07.0710200Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:07:07.0711139Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:07:07.0712079Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2024-12-18T00:07:07.0713057Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:07:07.0713943Z Compiling xla/service/cpu/onednn_util.cc; 8s local 2024-12-18T00:07:07.0714883Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 5s local ... 2024-12-18T00:07:07.3277192Z 2024-12-18T00:07:07.3278020Z  2024-12-18T00:07:07.3278498Z  2024-12-18T00:07:07.3278878Z  2024-12-18T00:07:07.3279326Z  2024-12-18T00:07:07.3279720Z  2024-12-18T00:07:07.3280100Z  2024-12-18T00:07:07.3280485Z  2024-12-18T00:07:07.3280871Z  2024-12-18T00:07:07.3281455Z [11,777 / 15,187] 48 actions, 47 running 2024-12-18T00:07:07.3282388Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 75s local 2024-12-18T00:07:07.3283442Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:07:07.3284358Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:07:07.3285304Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:07:07.3286288Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2024-12-18T00:07:07.3287283Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:07:07.3288209Z Compiling xla/service/cpu/onednn_util.cc; 8s local 2024-12-18T00:07:07.3289188Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 5s local ... 2024-12-18T00:07:07.5296101Z 2024-12-18T00:07:07.5296992Z  2024-12-18T00:07:07.5297502Z  2024-12-18T00:07:07.5297880Z  2024-12-18T00:07:07.5298301Z  2024-12-18T00:07:07.5298712Z  2024-12-18T00:07:07.5299126Z  2024-12-18T00:07:07.5299544Z  2024-12-18T00:07:07.5299940Z  2024-12-18T00:07:07.5300570Z [11,783 / 15,187] 48 actions, 46 running 2024-12-18T00:07:07.5301909Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 75s local 2024-12-18T00:07:07.5303052Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:07:07.5304004Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:07:07.5304984Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:07:07.5306021Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2024-12-18T00:07:07.5307152Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:07:07.5308118Z Compiling xla/service/cpu/onednn_util.cc; 8s local 2024-12-18T00:07:07.5309137Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 6s local ... 2024-12-18T00:07:07.7664219Z 2024-12-18T00:07:07.7665045Z  2024-12-18T00:07:07.7665560Z  2024-12-18T00:07:07.7665947Z  2024-12-18T00:07:07.7666349Z  2024-12-18T00:07:07.7666761Z  2024-12-18T00:07:07.7667186Z  2024-12-18T00:07:07.7667645Z  2024-12-18T00:07:07.7668067Z  2024-12-18T00:07:07.7668667Z [11,788 / 15,187] 47 actions, 46 running 2024-12-18T00:07:07.7669493Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:07:07.7670458Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:07:07.7671494Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:07:07.7672502Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2024-12-18T00:07:07.7673532Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:07:07.7674503Z Compiling xla/service/cpu/onednn_util.cc; 9s local 2024-12-18T00:07:07.7675503Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 6s local 2024-12-18T00:07:07.7676413Z Compiling xla/shape_util.cc; 5s local ... 2024-12-18T00:07:08.0711249Z 2024-12-18T00:07:08.0712088Z  2024-12-18T00:07:08.0712593Z  2024-12-18T00:07:08.0713023Z  2024-12-18T00:07:08.0713462Z  2024-12-18T00:07:08.0713886Z  2024-12-18T00:07:08.0714299Z  2024-12-18T00:07:08.0714684Z  2024-12-18T00:07:08.0715176Z  2024-12-18T00:07:08.0715785Z [11,788 / 15,187] 48 actions running 2024-12-18T00:07:08.0716594Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:07:08.0717428Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:07:08.0718330Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:07:08.0719227Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2024-12-18T00:07:08.0720336Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:07:08.0721270Z Compiling xla/service/cpu/onednn_util.cc; 9s local 2024-12-18T00:07:08.0722209Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 6s local 2024-12-18T00:07:08.0723076Z Compiling xla/shape_util.cc; 5s local ... 2024-12-18T00:07:08.2714767Z 2024-12-18T00:07:08.2715687Z  2024-12-18T00:07:08.2716192Z  2024-12-18T00:07:08.2716598Z  2024-12-18T00:07:08.2716976Z  2024-12-18T00:07:08.2717377Z  2024-12-18T00:07:08.2717783Z  2024-12-18T00:07:08.2718180Z  2024-12-18T00:07:08.2718576Z  2024-12-18T00:07:08.2719145Z [11,789 / 15,187] 48 actions running 2024-12-18T00:07:08.2719995Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:07:08.2720968Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:07:08.2721915Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:07:08.2723338Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2024-12-18T00:07:08.2724404Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:07:08.2725349Z Compiling xla/service/cpu/onednn_util.cc; 9s local 2024-12-18T00:07:08.2726271Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 6s local 2024-12-18T00:07:08.2727421Z Compiling xla/shape_util.cc; 6s local ... 2024-12-18T00:07:08.6012913Z 2024-12-18T00:07:08.6013748Z  2024-12-18T00:07:08.6014248Z  2024-12-18T00:07:08.6014607Z  2024-12-18T00:07:08.6014966Z  2024-12-18T00:07:08.6015338Z  2024-12-18T00:07:08.6015730Z  2024-12-18T00:07:08.6016103Z  2024-12-18T00:07:08.6016621Z  2024-12-18T00:07:08.6017218Z [11,795 / 15,187] 48 actions, 47 running 2024-12-18T00:07:08.6018018Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:07:08.6018977Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:07:08.6019894Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:07:08.6020833Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2024-12-18T00:07:08.6021836Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:07:08.6023097Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 7s local 2024-12-18T00:07:08.6023982Z Compiling xla/shape_util.cc; 6s local 2024-12-18T00:07:08.6024660Z Compiling llvm/lib/Object/ArchiveWriter.cpp; 4s local ... 2024-12-18T00:07:08.8697421Z 2024-12-18T00:07:08.8698287Z  2024-12-18T00:07:08.8698756Z  2024-12-18T00:07:08.8699142Z  2024-12-18T00:07:08.8699526Z  2024-12-18T00:07:08.8699920Z  2024-12-18T00:07:08.8700297Z  2024-12-18T00:07:08.8700685Z  2024-12-18T00:07:08.8701045Z  2024-12-18T00:07:08.8701642Z [11,799 / 15,187] 48 actions, 47 running 2024-12-18T00:07:08.8702525Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:07:08.8703460Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:07:08.8704400Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:07:08.8705314Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2024-12-18T00:07:08.8706355Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:07:08.8707167Z Compiling xla/shape_util.cc; 6s local 2024-12-18T00:07:08.8707882Z Compiling llvm/lib/Object/ArchiveWriter.cpp; 4s local 2024-12-18T00:07:08.8708653Z Compiling llvm/lib/Object/ELF.cpp; 4s local ... 2024-12-18T00:07:09.0721508Z 2024-12-18T00:07:09.0722405Z  2024-12-18T00:07:09.0722852Z  2024-12-18T00:07:09.0723260Z  2024-12-18T00:07:09.0723645Z  2024-12-18T00:07:09.0724030Z  2024-12-18T00:07:09.0724401Z  2024-12-18T00:07:09.0724824Z  2024-12-18T00:07:09.0725276Z  2024-12-18T00:07:09.0725844Z [11,801 / 15,187] 48 actions running 2024-12-18T00:07:09.0726707Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:07:09.0727672Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:07:09.0728594Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:07:09.0729780Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2024-12-18T00:07:09.0730884Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:07:09.0731950Z Compiling xla/shape_util.cc; 6s local 2024-12-18T00:07:09.0732737Z Compiling llvm/lib/Object/ArchiveWriter.cpp; 4s local 2024-12-18T00:07:09.0733510Z Compiling llvm/lib/Object/ELF.cpp; 4s local ... 2024-12-18T00:07:09.2725409Z 2024-12-18T00:07:09.2726220Z  2024-12-18T00:07:09.2726690Z  2024-12-18T00:07:09.2727081Z  2024-12-18T00:07:09.2727492Z  2024-12-18T00:07:09.2727891Z  2024-12-18T00:07:09.2728636Z  2024-12-18T00:07:09.2729021Z  2024-12-18T00:07:09.2729435Z  2024-12-18T00:07:09.2730007Z [11,803 / 15,187] 48 actions running 2024-12-18T00:07:09.2730844Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:07:09.2731823Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:07:09.2732979Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:07:09.2733953Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2024-12-18T00:07:09.2735012Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:07:09.2735875Z Compiling xla/shape_util.cc; 7s local 2024-12-18T00:07:09.2736771Z Compiling llvm/lib/Object/ArchiveWriter.cpp; 5s local 2024-12-18T00:07:09.2737556Z Compiling llvm/lib/Object/ELF.cpp; 4s local ... 2024-12-18T00:07:09.4980055Z 2024-12-18T00:07:09.4980911Z  2024-12-18T00:07:09.4981404Z  2024-12-18T00:07:09.4981876Z  2024-12-18T00:07:09.4982298Z  2024-12-18T00:07:09.4982724Z  2024-12-18T00:07:09.4983138Z  2024-12-18T00:07:09.4983567Z  2024-12-18T00:07:09.4983994Z  2024-12-18T00:07:09.4984634Z [11,808 / 15,187] 48 actions, 47 running 2024-12-18T00:07:09.4985523Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:07:09.4986567Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:07:09.4987576Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:07:09.4988616Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2024-12-18T00:07:09.4989742Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:07:09.4990647Z Compiling xla/shape_util.cc; 7s local 2024-12-18T00:07:09.4991339Z Compiling llvm/lib/Object/ELF.cpp; 4s local 2024-12-18T00:07:09.4992204Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 4s local ... 2024-12-18T00:07:09.7669132Z 2024-12-18T00:07:09.7669923Z  2024-12-18T00:07:09.7670399Z  2024-12-18T00:07:09.7670831Z  2024-12-18T00:07:09.7671252Z  2024-12-18T00:07:09.7671661Z  2024-12-18T00:07:09.7672069Z  2024-12-18T00:07:09.7672503Z  2024-12-18T00:07:09.7672923Z  2024-12-18T00:07:09.7673546Z [11,812 / 15,187] 48 actions, 47 running 2024-12-18T00:07:09.7674497Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:07:09.7675496Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:07:09.7676510Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 19s local 2024-12-18T00:07:09.7677559Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2024-12-18T00:07:09.7678678Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:07:09.7679602Z Compiling xla/shape_util.cc; 7s local 2024-12-18T00:07:09.7680315Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2024-12-18T00:07:09.7681180Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local ... 2024-12-18T00:07:10.0386372Z 2024-12-18T00:07:10.0387192Z  2024-12-18T00:07:10.0387682Z  2024-12-18T00:07:10.0388115Z  2024-12-18T00:07:10.0388542Z  2024-12-18T00:07:10.0388944Z  2024-12-18T00:07:10.0389375Z  2024-12-18T00:07:10.0389792Z  2024-12-18T00:07:10.0390212Z  2024-12-18T00:07:10.0390868Z [11,817 / 15,187] 48 actions, 47 running 2024-12-18T00:07:10.0391748Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:07:10.0392770Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:07:10.0393843Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2024-12-18T00:07:10.0394962Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:07:10.0395843Z Compiling xla/shape_util.cc; 7s local 2024-12-18T00:07:10.0396536Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2024-12-18T00:07:10.0397684Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local 2024-12-18T00:07:10.0398628Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 5s local ... 2024-12-18T00:07:10.2418395Z 2024-12-18T00:07:10.2419220Z  2024-12-18T00:07:10.2419716Z  2024-12-18T00:07:10.2420145Z  2024-12-18T00:07:10.2420562Z  2024-12-18T00:07:10.2420984Z  2024-12-18T00:07:10.2421386Z  2024-12-18T00:07:10.2422127Z  2024-12-18T00:07:10.2422567Z  2024-12-18T00:07:10.2423185Z [11,822 / 15,187] 48 actions, 47 running 2024-12-18T00:07:10.2424073Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:07:10.2425088Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:07:10.2426385Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2024-12-18T00:07:10.2427540Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:07:10.2428465Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:07:10.2429209Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2024-12-18T00:07:10.2430037Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local 2024-12-18T00:07:10.2431028Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 5s local ... 2024-12-18T00:07:10.4670167Z 2024-12-18T00:07:10.4670942Z  2024-12-18T00:07:10.4671439Z  2024-12-18T00:07:10.4671886Z  2024-12-18T00:07:10.4672346Z  2024-12-18T00:07:10.4672767Z  2024-12-18T00:07:10.4673191Z  2024-12-18T00:07:10.4673620Z  2024-12-18T00:07:10.4674040Z  2024-12-18T00:07:10.4674652Z [11,824 / 15,187] 48 actions, 47 running 2024-12-18T00:07:10.4675543Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:07:10.4676573Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:07:10.4677671Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2024-12-18T00:07:10.4678793Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:07:10.4679722Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:07:10.4680405Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2024-12-18T00:07:10.4681219Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local 2024-12-18T00:07:10.4682169Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 5s local ... 2024-12-18T00:07:10.6735894Z 2024-12-18T00:07:10.6736890Z  2024-12-18T00:07:10.6737415Z  2024-12-18T00:07:10.6737856Z  2024-12-18T00:07:10.6738279Z  2024-12-18T00:07:10.6738723Z  2024-12-18T00:07:10.6739159Z  2024-12-18T00:07:10.6739595Z  2024-12-18T00:07:10.6740021Z  2024-12-18T00:07:10.6740624Z [11,825 / 15,187] 48 actions running 2024-12-18T00:07:10.6741536Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:07:10.6742583Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:07:10.6743698Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2024-12-18T00:07:10.6745082Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:07:10.6745971Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:07:10.6746700Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:07:10.6747717Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local 2024-12-18T00:07:10.6748697Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 5s local ... 2024-12-18T00:07:10.8928136Z 2024-12-18T00:07:10.8928987Z  2024-12-18T00:07:10.8929494Z  2024-12-18T00:07:10.8929919Z  2024-12-18T00:07:10.8930332Z  2024-12-18T00:07:10.8930756Z  2024-12-18T00:07:10.8931170Z  2024-12-18T00:07:10.8931595Z  2024-12-18T00:07:10.8932016Z  2024-12-18T00:07:10.8932633Z [11,829 / 15,187] 48 actions, 47 running 2024-12-18T00:07:10.8933539Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:07:10.8934591Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:07:10.8936036Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2024-12-18T00:07:10.8937271Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:07:10.8938180Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:07:10.8938884Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:07:10.8939879Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local 2024-12-18T00:07:10.8940842Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local ... 2024-12-18T00:07:11.1225541Z 2024-12-18T00:07:11.1226341Z  2024-12-18T00:07:11.1226829Z  2024-12-18T00:07:11.1227242Z  2024-12-18T00:07:11.1227671Z  2024-12-18T00:07:11.1228096Z  2024-12-18T00:07:11.1228522Z  2024-12-18T00:07:11.1228945Z  2024-12-18T00:07:11.1229357Z  2024-12-18T00:07:11.1229974Z [11,833 / 15,187] 48 actions, 47 running 2024-12-18T00:07:11.1231056Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:07:11.1232153Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:07:11.1233264Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2024-12-18T00:07:11.1234410Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:07:11.1235345Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:07:11.1236083Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:07:11.1236920Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local 2024-12-18T00:07:11.1237912Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local ... 2024-12-18T00:07:11.4480107Z 2024-12-18T00:07:11.4480934Z  2024-12-18T00:07:11.4481432Z  2024-12-18T00:07:11.4481858Z  2024-12-18T00:07:11.4482273Z  2024-12-18T00:07:11.4482695Z  2024-12-18T00:07:11.4483102Z  2024-12-18T00:07:11.4483516Z  2024-12-18T00:07:11.4483940Z  2024-12-18T00:07:11.4484563Z [11,838 / 15,187] 48 actions, 47 running 2024-12-18T00:07:11.4485483Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:07:11.4486519Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:07:11.4487600Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2024-12-18T00:07:11.4488508Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:07:11.4489227Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:07:11.4490036Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local 2024-12-18T00:07:11.4490937Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local 2024-12-18T00:07:11.4491898Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 5s local ... 2024-12-18T00:07:11.6743765Z 2024-12-18T00:07:11.6744824Z  2024-12-18T00:07:11.6745333Z  2024-12-18T00:07:11.6745752Z  2024-12-18T00:07:11.6746183Z  2024-12-18T00:07:11.6746608Z  2024-12-18T00:07:11.6747032Z  2024-12-18T00:07:11.6747490Z  2024-12-18T00:07:11.6747909Z  2024-12-18T00:07:11.6748513Z [11,839 / 15,187] 48 actions running 2024-12-18T00:07:11.6749392Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:07:11.6750430Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:07:11.6751606Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:07:11.6752519Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:07:11.6753207Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:07:11.6754004Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:07:11.6754892Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local 2024-12-18T00:07:11.6755834Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:07:11.9113316Z 2024-12-18T00:07:11.9114155Z  2024-12-18T00:07:11.9114639Z  2024-12-18T00:07:11.9115063Z  2024-12-18T00:07:11.9115465Z  2024-12-18T00:07:11.9116245Z  2024-12-18T00:07:11.9116653Z  2024-12-18T00:07:11.9117063Z  2024-12-18T00:07:11.9117486Z  2024-12-18T00:07:11.9118109Z [11,844 / 15,187] 48 actions, 47 running 2024-12-18T00:07:11.9119000Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:07:11.9120014Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:07:11.9121265Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:07:11.9122186Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:07:11.9122891Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:07:11.9123699Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:07:11.9124608Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:07:11.9125576Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:07:12.1210040Z 2024-12-18T00:07:12.1210879Z  2024-12-18T00:07:12.1211372Z  2024-12-18T00:07:12.1211839Z  2024-12-18T00:07:12.1212259Z  2024-12-18T00:07:12.1212658Z  2024-12-18T00:07:12.1213075Z  2024-12-18T00:07:12.1213495Z  2024-12-18T00:07:12.1213912Z  2024-12-18T00:07:12.1214521Z [11,847 / 15,187] 48 actions, 47 running 2024-12-18T00:07:12.1215420Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:07:12.1216568Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:07:12.1217666Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:07:12.1218576Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:07:12.1219280Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:07:12.1220058Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:07:12.1220982Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:07:12.1221946Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:07:12.4709980Z 2024-12-18T00:07:12.4710786Z  2024-12-18T00:07:12.4711276Z  2024-12-18T00:07:12.4711701Z  2024-12-18T00:07:12.4712107Z  2024-12-18T00:07:12.4712541Z  2024-12-18T00:07:12.4712962Z  2024-12-18T00:07:12.4713388Z  2024-12-18T00:07:12.4713810Z  2024-12-18T00:07:12.4714412Z [11,852 / 15,187] 48 actions, 47 running 2024-12-18T00:07:12.4715346Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:07:12.4716373Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:07:12.4717459Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:07:12.4718374Z Compiling xla/shape_util.cc; 10s local 2024-12-18T00:07:12.4719068Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:07:12.4719873Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:07:12.4720792Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:07:12.4721738Z Compiling llvm/lib/AsmParser/LLParser.cpp; 6s local ... 2024-12-18T00:07:12.6745709Z 2024-12-18T00:07:12.6746580Z  2024-12-18T00:07:12.6747077Z  2024-12-18T00:07:12.6747502Z  2024-12-18T00:07:12.6747917Z  2024-12-18T00:07:12.6748320Z  2024-12-18T00:07:12.6748704Z  2024-12-18T00:07:12.6749126Z  2024-12-18T00:07:12.6749541Z  2024-12-18T00:07:12.6750198Z [11,859 / 15,187] 48 actions, 47 running 2024-12-18T00:07:12.6751056Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:07:12.6752061Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:07:12.6753056Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:07:12.6753889Z Compiling xla/shape_util.cc; 10s local 2024-12-18T00:07:12.6754573Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:07:12.6755372Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:07:12.6756653Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:07:12.6757547Z Compiling llvm/lib/AsmParser/LLParser.cpp; 6s local ... 2024-12-18T00:07:12.8749601Z 2024-12-18T00:07:12.8750418Z  2024-12-18T00:07:12.8750891Z  2024-12-18T00:07:12.8751330Z  2024-12-18T00:07:12.8751729Z  2024-12-18T00:07:12.8752201Z  2024-12-18T00:07:12.8752660Z  2024-12-18T00:07:12.8753426Z  2024-12-18T00:07:12.8753865Z  2024-12-18T00:07:12.8754452Z [11,863 / 15,187] 48 actions running 2024-12-18T00:07:12.8755347Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:07:12.8756386Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:07:12.8757486Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:07:12.8758415Z Compiling xla/shape_util.cc; 10s local 2024-12-18T00:07:12.8759121Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:07:12.8759964Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:07:12.8760902Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2024-12-18T00:07:12.8761846Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local ... 2024-12-18T00:07:13.0753199Z 2024-12-18T00:07:13.0754098Z  2024-12-18T00:07:13.0754586Z  2024-12-18T00:07:13.0754976Z  2024-12-18T00:07:13.0755342Z  2024-12-18T00:07:13.0755780Z  2024-12-18T00:07:13.0756185Z  2024-12-18T00:07:13.0756669Z  2024-12-18T00:07:13.0757055Z  2024-12-18T00:07:13.0757622Z [11,866 / 15,187] 48 actions running 2024-12-18T00:07:13.0758504Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:07:13.0759456Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:07:13.0760429Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:07:13.0761260Z Compiling xla/shape_util.cc; 10s local 2024-12-18T00:07:13.0761947Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:07:13.0762819Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:07:13.0763663Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2024-12-18T00:07:13.0764571Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local ... 2024-12-18T00:07:13.2865868Z 2024-12-18T00:07:13.2866731Z  2024-12-18T00:07:13.2867250Z  2024-12-18T00:07:13.2867695Z  2024-12-18T00:07:13.2868077Z  2024-12-18T00:07:13.2868459Z  2024-12-18T00:07:13.2868860Z  2024-12-18T00:07:13.2869231Z  2024-12-18T00:07:13.2869603Z  2024-12-18T00:07:13.2870174Z [11,870 / 15,187] 48 actions, 47 running 2024-12-18T00:07:13.2870967Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:07:13.2871851Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:07:13.2872832Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:07:13.2873830Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:07:13.2874562Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:07:13.2875357Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2024-12-18T00:07:13.2876234Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 6s local 2024-12-18T00:07:13.2877258Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 6s local ... 2024-12-18T00:07:13.5367599Z 2024-12-18T00:07:13.5368489Z  2024-12-18T00:07:13.5368987Z  2024-12-18T00:07:13.5369452Z  2024-12-18T00:07:13.5369884Z  2024-12-18T00:07:13.5370294Z  2024-12-18T00:07:13.5370715Z  2024-12-18T00:07:13.5371129Z  2024-12-18T00:07:13.5371519Z  2024-12-18T00:07:13.5372125Z [11,875 / 15,187] 48 actions, 47 running 2024-12-18T00:07:13.5372994Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:07:13.5373966Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:07:13.5375386Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:07:13.5376266Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:07:13.5377111Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:07:13.5377839Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2024-12-18T00:07:13.5379000Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 7s local 2024-12-18T00:07:13.5379986Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 6s local ... 2024-12-18T00:07:13.8760757Z 2024-12-18T00:07:13.8761673Z  2024-12-18T00:07:13.8762175Z  2024-12-18T00:07:13.8762595Z  2024-12-18T00:07:13.8762988Z  2024-12-18T00:07:13.8763402Z  2024-12-18T00:07:13.8763788Z  2024-12-18T00:07:13.8764181Z  2024-12-18T00:07:13.8764595Z  2024-12-18T00:07:13.8765187Z [11,877 / 15,187] 48 actions running 2024-12-18T00:07:13.8766210Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:07:13.8767282Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:07:13.8768265Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2024-12-18T00:07:13.8769126Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:07:13.8769879Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:07:13.8770708Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:07:13.8771602Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 7s local 2024-12-18T00:07:13.8772649Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 7s local ... 2024-12-18T00:07:14.2009611Z 2024-12-18T00:07:14.2010502Z  2024-12-18T00:07:14.2010966Z  2024-12-18T00:07:14.2011373Z  2024-12-18T00:07:14.2011769Z  2024-12-18T00:07:14.2012168Z  2024-12-18T00:07:14.2012572Z  2024-12-18T00:07:14.2012954Z  2024-12-18T00:07:14.2013357Z  2024-12-18T00:07:14.2013999Z [11,883 / 15,187] 48 actions, 47 running 2024-12-18T00:07:14.2014848Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:07:14.2015787Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:07:14.2016960Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2024-12-18T00:07:14.2017830Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:07:14.2018601Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:07:14.2019415Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:07:14.2020294Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 7s local 2024-12-18T00:07:14.2021284Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 7s local ... 2024-12-18T00:07:14.4766625Z 2024-12-18T00:07:14.4767561Z  2024-12-18T00:07:14.4768009Z  2024-12-18T00:07:14.4768409Z  2024-12-18T00:07:14.4768809Z  2024-12-18T00:07:14.4769227Z  2024-12-18T00:07:14.4769659Z  2024-12-18T00:07:14.4770060Z  2024-12-18T00:07:14.4770466Z  2024-12-18T00:07:14.4771026Z [11,883 / 15,187] 48 actions running 2024-12-18T00:07:14.4771850Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:07:14.4772778Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:07:14.4773787Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2024-12-18T00:07:14.4774646Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:07:14.4775815Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:07:14.4776867Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:07:14.4777879Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local 2024-12-18T00:07:14.4779010Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 7s local ... 2024-12-18T00:07:14.6770498Z 2024-12-18T00:07:14.6771415Z  2024-12-18T00:07:14.6771901Z  2024-12-18T00:07:14.6772764Z  2024-12-18T00:07:14.6773192Z  2024-12-18T00:07:14.6773611Z  2024-12-18T00:07:14.6774036Z  2024-12-18T00:07:14.6774445Z  2024-12-18T00:07:14.6774849Z  2024-12-18T00:07:14.6775452Z [11,886 / 15,187] 48 actions running 2024-12-18T00:07:14.6776348Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:07:14.6777679Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:07:14.6778780Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2024-12-18T00:07:14.6779724Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:07:14.6780562Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:07:14.6781774Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:07:14.6782735Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local 2024-12-18T00:07:14.6783962Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local ... 2024-12-18T00:07:14.8796032Z 2024-12-18T00:07:14.8796890Z  2024-12-18T00:07:14.8797303Z  2024-12-18T00:07:14.8797686Z  2024-12-18T00:07:14.8798069Z  2024-12-18T00:07:14.8798429Z  2024-12-18T00:07:14.8798786Z  2024-12-18T00:07:14.8799133Z  2024-12-18T00:07:14.8799502Z  2024-12-18T00:07:14.8800056Z [11,889 / 15,187] 48 actions, 47 running 2024-12-18T00:07:14.8800882Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:07:14.8801756Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2024-12-18T00:07:14.8802514Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:07:14.8803194Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:07:14.8803942Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2024-12-18T00:07:14.8804731Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local 2024-12-18T00:07:14.8805599Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local 2024-12-18T00:07:14.8806455Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 7s local ... 2024-12-18T00:07:15.0809929Z 2024-12-18T00:07:15.0810805Z  2024-12-18T00:07:15.0811232Z  2024-12-18T00:07:15.0811604Z  2024-12-18T00:07:15.0811946Z  2024-12-18T00:07:15.0812493Z  2024-12-18T00:07:15.0812922Z  2024-12-18T00:07:15.0813361Z  2024-12-18T00:07:15.0813839Z  2024-12-18T00:07:15.0814461Z [11,896 / 15,187] 48 actions, 47 running 2024-12-18T00:07:15.0815282Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:07:15.0816209Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2024-12-18T00:07:15.0817144Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:07:15.0817895Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:07:15.0818703Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2024-12-18T00:07:15.0819549Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local 2024-12-18T00:07:15.0820495Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local 2024-12-18T00:07:15.0821412Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 7s local ... 2024-12-18T00:07:15.3181425Z 2024-12-18T00:07:15.3182305Z  2024-12-18T00:07:15.3182812Z  2024-12-18T00:07:15.3183214Z  2024-12-18T00:07:15.3183778Z  2024-12-18T00:07:15.3184230Z  2024-12-18T00:07:15.3184633Z  2024-12-18T00:07:15.3185041Z  2024-12-18T00:07:15.3185432Z  2024-12-18T00:07:15.3186040Z [11,904 / 15,187] 48 actions, 47 running 2024-12-18T00:07:15.3186874Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:07:15.3187859Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2024-12-18T00:07:15.3188752Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:07:15.3189518Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:07:15.3190327Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2024-12-18T00:07:15.3191586Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local 2024-12-18T00:07:15.3192569Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local 2024-12-18T00:07:15.3193552Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local ... 2024-12-18T00:07:15.5784006Z 2024-12-18T00:07:15.5785039Z  2024-12-18T00:07:15.5785837Z  2024-12-18T00:07:15.5786277Z  2024-12-18T00:07:15.5786692Z  2024-12-18T00:07:15.5787063Z  2024-12-18T00:07:15.5787448Z  2024-12-18T00:07:15.5787815Z  2024-12-18T00:07:15.5788220Z  2024-12-18T00:07:15.5788813Z [11,907 / 15,187] 48 actions, 47 running 2024-12-18T00:07:15.5789600Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:07:15.5790600Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:07:15.5791443Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:07:15.5792244Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:07:15.5793025Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2024-12-18T00:07:15.5793894Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2024-12-18T00:07:15.5794871Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local 2024-12-18T00:07:15.5795800Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local ... 2024-12-18T00:07:15.8003612Z 2024-12-18T00:07:15.8004515Z  2024-12-18T00:07:15.8005028Z  2024-12-18T00:07:15.8005405Z  2024-12-18T00:07:15.8005754Z  2024-12-18T00:07:15.8006129Z  2024-12-18T00:07:15.8006544Z  2024-12-18T00:07:15.8006915Z  2024-12-18T00:07:15.8007302Z  2024-12-18T00:07:15.8007882Z [11,909 / 15,187] 48 actions, 47 running 2024-12-18T00:07:15.8008721Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:07:15.8009675Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:07:15.8010637Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:07:15.8011481Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:07:15.8012358Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:07:15.8013280Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2024-12-18T00:07:15.8014268Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:07:15.8015236Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local ... 2024-12-18T00:07:16.0779683Z 2024-12-18T00:07:16.0780597Z  2024-12-18T00:07:16.0781076Z  2024-12-18T00:07:16.0781435Z  2024-12-18T00:07:16.0781834Z  2024-12-18T00:07:16.0782237Z  2024-12-18T00:07:16.0782638Z  2024-12-18T00:07:16.0783010Z  2024-12-18T00:07:16.0783383Z  2024-12-18T00:07:16.0783994Z [11,909 / 15,187] 48 actions running 2024-12-18T00:07:16.0784878Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:07:16.0785930Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:07:16.0786807Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:07:16.0787590Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:07:16.0788446Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:07:16.0789387Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2024-12-18T00:07:16.0790395Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:07:16.0791417Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local ... 2024-12-18T00:07:16.2794818Z 2024-12-18T00:07:16.2795766Z  2024-12-18T00:07:16.2796270Z  2024-12-18T00:07:16.2796682Z  2024-12-18T00:07:16.2797057Z  2024-12-18T00:07:16.2797470Z  2024-12-18T00:07:16.2797879Z  2024-12-18T00:07:16.2798289Z  2024-12-18T00:07:16.2798664Z  2024-12-18T00:07:16.2799692Z [11,912 / 15,187] 48 actions, 47 running 2024-12-18T00:07:16.2800576Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:07:16.2801604Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:07:16.2802517Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:07:16.2803288Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:07:16.2804327Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:07:16.2805199Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2024-12-18T00:07:16.2806224Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:07:16.2807213Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2024-12-18T00:07:16.5444997Z 2024-12-18T00:07:16.5445930Z  2024-12-18T00:07:16.5446440Z  2024-12-18T00:07:16.5446829Z  2024-12-18T00:07:16.5447198Z  2024-12-18T00:07:16.5447603Z  2024-12-18T00:07:16.5448053Z  2024-12-18T00:07:16.5448467Z  2024-12-18T00:07:16.5448869Z  2024-12-18T00:07:16.5449457Z [11,915 / 15,187] 48 actions, 47 running 2024-12-18T00:07:16.5450275Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:07:16.5451237Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:07:16.5452136Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:07:16.5452923Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:07:16.5453768Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:07:16.5454700Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2024-12-18T00:07:16.5455755Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:07:16.5456891Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2024-12-18T00:07:16.8266358Z 2024-12-18T00:07:16.8267201Z  2024-12-18T00:07:16.8267695Z  2024-12-18T00:07:16.8268153Z  2024-12-18T00:07:16.8268539Z  2024-12-18T00:07:16.8268930Z  2024-12-18T00:07:16.8269346Z  2024-12-18T00:07:16.8269751Z  2024-12-18T00:07:16.8270137Z  2024-12-18T00:07:16.8270728Z [11,924 / 15,187] 48 actions, 47 running 2024-12-18T00:07:16.8271580Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:07:16.8272652Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2024-12-18T00:07:16.8273544Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:07:16.8274327Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:07:16.8275194Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:07:16.8276159Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2024-12-18T00:07:16.8277170Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2024-12-18T00:07:16.8278180Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2024-12-18T00:07:17.0649640Z 2024-12-18T00:07:17.0650546Z  2024-12-18T00:07:17.0650990Z  2024-12-18T00:07:17.0662093Z  2024-12-18T00:07:17.0662888Z  2024-12-18T00:07:17.0663317Z  2024-12-18T00:07:17.0663747Z  2024-12-18T00:07:17.0664163Z  2024-12-18T00:07:17.0664587Z  2024-12-18T00:07:17.0665197Z [11,929 / 15,187] 47 actions, 46 running 2024-12-18T00:07:17.0666129Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:07:17.0667183Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2024-12-18T00:07:17.0668097Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:07:17.0668896Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:07:17.0669770Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:07:17.0670723Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2024-12-18T00:07:17.0671791Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2024-12-18T00:07:17.0673112Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2024-12-18T00:07:17.2792583Z 2024-12-18T00:07:17.2793440Z  2024-12-18T00:07:17.2793913Z  2024-12-18T00:07:17.2794315Z  2024-12-18T00:07:17.2794680Z  2024-12-18T00:07:17.2795069Z  2024-12-18T00:07:17.2795459Z  2024-12-18T00:07:17.2795852Z  2024-12-18T00:07:17.2796552Z  2024-12-18T00:07:17.2797051Z [11,932 / 15,187] 48 actions running 2024-12-18T00:07:17.2797887Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:07:17.2798902Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2024-12-18T00:07:17.2799832Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:07:17.2800633Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:07:17.2801468Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:07:17.2802403Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2024-12-18T00:07:17.2803474Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2024-12-18T00:07:17.2804490Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2024-12-18T00:07:17.4795592Z 2024-12-18T00:07:17.4796488Z  2024-12-18T00:07:17.4796900Z  2024-12-18T00:07:17.4797232Z  2024-12-18T00:07:17.4797574Z  2024-12-18T00:07:17.4797962Z  2024-12-18T00:07:17.4798308Z  2024-12-18T00:07:17.4798629Z  2024-12-18T00:07:17.4798973Z  2024-12-18T00:07:17.4799466Z [11,937 / 15,187] 48 actions running 2024-12-18T00:07:17.4800174Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:07:17.4800989Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2024-12-18T00:07:17.4801699Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:07:17.4802342Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:07:17.4803035Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:07:17.4804001Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2024-12-18T00:07:17.4804868Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2024-12-18T00:07:17.4805717Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2024-12-18T00:07:17.6998943Z 2024-12-18T00:07:17.6999782Z  2024-12-18T00:07:17.7000266Z  2024-12-18T00:07:17.7000631Z  2024-12-18T00:07:17.7000976Z  2024-12-18T00:07:17.7001330Z  2024-12-18T00:07:17.7001686Z  2024-12-18T00:07:17.7002039Z  2024-12-18T00:07:17.7002392Z  2024-12-18T00:07:17.7002952Z [11,939 / 15,187] 48 actions, 47 running 2024-12-18T00:07:17.7003738Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:07:17.7004610Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2024-12-18T00:07:17.7005391Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:07:17.7006118Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 13s local 2024-12-18T00:07:17.7006856Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:07:17.7007667Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2024-12-18T00:07:17.7008570Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 11s local 2024-12-18T00:07:17.7009460Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2024-12-18T00:07:17.9312431Z 2024-12-18T00:07:17.9313328Z  2024-12-18T00:07:17.9313826Z  2024-12-18T00:07:17.9314214Z  2024-12-18T00:07:17.9314812Z  2024-12-18T00:07:17.9315240Z  2024-12-18T00:07:17.9315667Z  2024-12-18T00:07:17.9316094Z  2024-12-18T00:07:17.9316494Z  2024-12-18T00:07:17.9317134Z [11,945 / 15,187] 48 actions, 47 running 2024-12-18T00:07:17.9318034Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:07:17.9319055Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2024-12-18T00:07:17.9320547Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:07:17.9321239Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:07:17.9322135Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2024-12-18T00:07:17.9323245Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:07:17.9324330Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:07:17.9325360Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 5s local ... 2024-12-18T00:07:18.2215940Z 2024-12-18T00:07:18.2216950Z  2024-12-18T00:07:18.2217532Z  2024-12-18T00:07:18.2218010Z  2024-12-18T00:07:18.2218439Z  2024-12-18T00:07:18.2218903Z  2024-12-18T00:07:18.2219358Z  2024-12-18T00:07:18.2219801Z  2024-12-18T00:07:18.2220258Z  2024-12-18T00:07:18.2220896Z [11,948 / 15,187] 48 actions, 47 running 2024-12-18T00:07:18.2221822Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:07:18.2222876Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2024-12-18T00:07:18.2223705Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:07:18.2224470Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:07:18.2225348Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2024-12-18T00:07:18.2226325Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:07:18.2227170Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:07:18.2228243Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 6s local ... 2024-12-18T00:07:18.4301384Z 2024-12-18T00:07:18.4302219Z  2024-12-18T00:07:18.4302716Z  2024-12-18T00:07:18.4303135Z  2024-12-18T00:07:18.4303567Z  2024-12-18T00:07:18.4303988Z  2024-12-18T00:07:18.4304397Z  2024-12-18T00:07:18.4304806Z  2024-12-18T00:07:18.4305195Z  2024-12-18T00:07:18.4305813Z [11,950 / 15,187] 48 actions, 47 running 2024-12-18T00:07:18.4306691Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:07:18.4307692Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2024-12-18T00:07:18.4308592Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:07:18.4309402Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:07:18.4310360Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2024-12-18T00:07:18.4311341Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:07:18.4312265Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:07:18.4313371Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 6s local ... 2024-12-18T00:07:18.6802923Z 2024-12-18T00:07:18.6803811Z  2024-12-18T00:07:18.6804236Z  2024-12-18T00:07:18.6804563Z  2024-12-18T00:07:18.6804883Z  2024-12-18T00:07:18.6805241Z  2024-12-18T00:07:18.6805559Z  2024-12-18T00:07:18.6805908Z  2024-12-18T00:07:18.6806298Z  2024-12-18T00:07:18.6807025Z [11,950 / 15,187] 48 actions running 2024-12-18T00:07:18.6807909Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:07:18.6808800Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:07:18.6809562Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:07:18.6810210Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:07:18.6810960Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2024-12-18T00:07:18.6811744Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:07:18.6812485Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:07:18.6813433Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 6s local ... 2024-12-18T00:07:18.8908216Z 2024-12-18T00:07:18.8909149Z  2024-12-18T00:07:18.8910174Z  2024-12-18T00:07:18.8910581Z  2024-12-18T00:07:18.8910976Z  2024-12-18T00:07:18.8911382Z  2024-12-18T00:07:18.8911785Z  2024-12-18T00:07:18.8912183Z  2024-12-18T00:07:18.8912605Z  2024-12-18T00:07:18.8913200Z [11,952 / 15,187] 48 actions, 47 running 2024-12-18T00:07:18.8914487Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:07:18.8915937Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:07:18.8917000Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:07:18.8917896Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2024-12-18T00:07:18.8918920Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2024-12-18T00:07:18.8920000Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:07:18.8921025Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:07:18.8922217Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 6s local ... 2024-12-18T00:07:19.1404251Z 2024-12-18T00:07:19.1405363Z  2024-12-18T00:07:19.1405878Z  2024-12-18T00:07:19.1406319Z  2024-12-18T00:07:19.1406733Z  2024-12-18T00:07:19.1407134Z  2024-12-18T00:07:19.1407540Z  2024-12-18T00:07:19.1407921Z  2024-12-18T00:07:19.1408319Z  2024-12-18T00:07:19.1408951Z [11,954 / 15,187] 48 actions, 47 running 2024-12-18T00:07:19.1409822Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:07:19.1410824Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:07:19.1411725Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:07:19.1412494Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2024-12-18T00:07:19.1413410Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2024-12-18T00:07:19.1414307Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 12s local 2024-12-18T00:07:19.1415221Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:07:19.1416284Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 7s local ... 2024-12-18T00:07:19.3613789Z 2024-12-18T00:07:19.3614886Z  2024-12-18T00:07:19.3615346Z  2024-12-18T00:07:19.3615735Z  2024-12-18T00:07:19.3616122Z  2024-12-18T00:07:19.3616624Z  2024-12-18T00:07:19.3617036Z  2024-12-18T00:07:19.3617474Z  2024-12-18T00:07:19.3617883Z  2024-12-18T00:07:19.3618489Z [11,960 / 15,187] 48 actions, 47 running 2024-12-18T00:07:19.3619297Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:07:19.3620227Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:07:19.3621045Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:07:19.3621736Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2024-12-18T00:07:19.3622633Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2024-12-18T00:07:19.3623602Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:07:19.3624614Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 7s local 2024-12-18T00:07:19.3625472Z Compiling xla/shape.cc; 6s local ... 2024-12-18T00:07:19.6002996Z 2024-12-18T00:07:19.6003972Z  2024-12-18T00:07:19.6004487Z  2024-12-18T00:07:19.6004902Z  2024-12-18T00:07:19.6005369Z  2024-12-18T00:07:19.6005776Z  2024-12-18T00:07:19.6006168Z  2024-12-18T00:07:19.6006589Z  2024-12-18T00:07:19.6006969Z  2024-12-18T00:07:19.6007536Z [11,962 / 15,187] 48 actions, 47 running 2024-12-18T00:07:19.6008338Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:07:19.6009280Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 23s local 2024-12-18T00:07:19.6010175Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:07:19.6010914Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2024-12-18T00:07:19.6012218Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2024-12-18T00:07:19.6013144Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:07:19.6014094Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 7s local 2024-12-18T00:07:19.6015233Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 5s local ... 2024-12-18T00:07:19.8054673Z 2024-12-18T00:07:19.8055582Z  2024-12-18T00:07:19.8056063Z  2024-12-18T00:07:19.8056603Z  2024-12-18T00:07:19.8057010Z  2024-12-18T00:07:19.8057395Z  2024-12-18T00:07:19.8057758Z  2024-12-18T00:07:19.8058125Z  2024-12-18T00:07:19.8058498Z  2024-12-18T00:07:19.8059083Z [11,963 / 15,187] 48 actions, 47 running 2024-12-18T00:07:19.8059915Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:07:19.8060876Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 23s local 2024-12-18T00:07:19.8061754Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:07:19.8062528Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:07:19.8063567Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2024-12-18T00:07:19.8064510Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:07:19.8065474Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 7s local 2024-12-18T00:07:19.8066568Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 5s local ... 2024-12-18T00:07:20.0812363Z 2024-12-18T00:07:20.0813348Z  2024-12-18T00:07:20.0813835Z  2024-12-18T00:07:20.0814237Z  2024-12-18T00:07:20.0814632Z  2024-12-18T00:07:20.0815037Z  2024-12-18T00:07:20.0815443Z  2024-12-18T00:07:20.0815835Z  2024-12-18T00:07:20.0816248Z  2024-12-18T00:07:20.0817022Z [11,967 / 15,187] 48 actions running 2024-12-18T00:07:20.0818065Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2024-12-18T00:07:20.0818941Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:07:20.0819686Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:07:20.0820595Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2024-12-18T00:07:20.0821492Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:07:20.0822570Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 8s local 2024-12-18T00:07:20.0823590Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 6s local 2024-12-18T00:07:20.0824647Z Compiling llvm/lib/DebugInfo/CodeView/TypeRecordMapping.cpp; 4s local ... 2024-12-18T00:07:20.4817507Z 2024-12-18T00:07:20.4818395Z  2024-12-18T00:07:20.4818818Z  2024-12-18T00:07:20.4819208Z  2024-12-18T00:07:20.4819610Z  2024-12-18T00:07:20.4820037Z  2024-12-18T00:07:20.4820461Z  2024-12-18T00:07:20.4820866Z  2024-12-18T00:07:20.4821266Z  2024-12-18T00:07:20.4821889Z [11,969 / 15,187] 48 actions running 2024-12-18T00:07:20.4822758Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2024-12-18T00:07:20.4823630Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:07:20.4824385Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:07:20.4825359Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2024-12-18T00:07:20.4826389Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:07:20.4827406Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 8s local 2024-12-18T00:07:20.4828414Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 6s local 2024-12-18T00:07:20.4829341Z Compiling llvm/lib/TextAPI/TextStub.cpp; 3s local ... 2024-12-18T00:07:20.7142698Z 2024-12-18T00:07:20.7143547Z  2024-12-18T00:07:20.7144040Z  2024-12-18T00:07:20.7144708Z  2024-12-18T00:07:20.7145124Z  2024-12-18T00:07:20.7145530Z  2024-12-18T00:07:20.7146353Z  2024-12-18T00:07:20.7146754Z  2024-12-18T00:07:20.7147150Z  2024-12-18T00:07:20.7147744Z [11,970 / 15,187] 48 actions, 47 running 2024-12-18T00:07:20.7148583Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:07:20.7149356Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:07:20.7150485Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2024-12-18T00:07:20.7151390Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:07:20.7152383Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 8s local 2024-12-18T00:07:20.7153419Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 6s local 2024-12-18T00:07:20.7154258Z Compiling llvm/lib/TextAPI/TextStub.cpp; 4s local 2024-12-18T00:07:20.7154986Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 4s local ... 2024-12-18T00:07:21.0445296Z 2024-12-18T00:07:21.0446155Z  2024-12-18T00:07:21.0446579Z  2024-12-18T00:07:21.0447011Z  2024-12-18T00:07:21.0447405Z  2024-12-18T00:07:21.0447820Z  2024-12-18T00:07:21.0448236Z  2024-12-18T00:07:21.0448633Z  2024-12-18T00:07:21.0449049Z  2024-12-18T00:07:21.0449635Z [11,973 / 15,187] 48 actions, 47 running 2024-12-18T00:07:21.0450364Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:07:21.0451193Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2024-12-18T00:07:21.0452138Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2024-12-18T00:07:21.0453145Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:07:21.0454117Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 7s local 2024-12-18T00:07:21.0454950Z Compiling llvm/lib/TextAPI/TextStub.cpp; 4s local 2024-12-18T00:07:21.0455752Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 4s local 2024-12-18T00:07:21.0456707Z Compiling llvm/lib/IR/AsmWriter.cpp; 4s local ... 2024-12-18T00:07:21.2827071Z 2024-12-18T00:07:21.2827997Z  2024-12-18T00:07:21.2828491Z  2024-12-18T00:07:21.2828895Z  2024-12-18T00:07:21.2829298Z  2024-12-18T00:07:21.2829664Z  2024-12-18T00:07:21.2830135Z  2024-12-18T00:07:21.2830522Z  2024-12-18T00:07:21.2830927Z  2024-12-18T00:07:21.2831495Z [11,976 / 15,187] 48 actions running 2024-12-18T00:07:21.2832239Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:07:21.2833036Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2024-12-18T00:07:21.2833923Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2024-12-18T00:07:21.2834816Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:07:21.2835709Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 7s local 2024-12-18T00:07:21.2836581Z Compiling llvm/lib/TextAPI/TextStub.cpp; 4s local 2024-12-18T00:07:21.2837380Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 4s local 2024-12-18T00:07:21.2838126Z Compiling llvm/lib/IR/AsmWriter.cpp; 4s local ... 2024-12-18T00:07:21.6951925Z 2024-12-18T00:07:21.6952796Z  2024-12-18T00:07:21.6953271Z  2024-12-18T00:07:21.6953670Z  2024-12-18T00:07:21.6954075Z  2024-12-18T00:07:21.6954459Z  2024-12-18T00:07:21.6954860Z  2024-12-18T00:07:21.6955256Z  2024-12-18T00:07:21.6955657Z  2024-12-18T00:07:21.6956294Z [11,977 / 15,187] 48 actions, 47 running 2024-12-18T00:07:21.6957023Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:07:21.6957768Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2024-12-18T00:07:21.6958653Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2024-12-18T00:07:21.6959603Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:07:21.6960570Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 7s local 2024-12-18T00:07:21.6961448Z Compiling llvm/lib/TextAPI/TextStub.cpp; 5s local 2024-12-18T00:07:21.6962388Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 5s local 2024-12-18T00:07:21.6963533Z Compiling llvm/lib/IR/AsmWriter.cpp; 4s local ... 2024-12-18T00:07:22.0833575Z 2024-12-18T00:07:22.0834445Z  2024-12-18T00:07:22.0834959Z  2024-12-18T00:07:22.0835340Z  2024-12-18T00:07:22.0835698Z  2024-12-18T00:07:22.0836108Z  2024-12-18T00:07:22.0836514Z  2024-12-18T00:07:22.0836901Z  2024-12-18T00:07:22.0837664Z  2024-12-18T00:07:22.0838306Z [11,977 / 15,187] 48 actions running 2024-12-18T00:07:22.0839001Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:07:22.0839761Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2024-12-18T00:07:22.0840709Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2024-12-18T00:07:22.0841673Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:07:22.0842640Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 8s local 2024-12-18T00:07:22.0843569Z Compiling llvm/lib/TextAPI/TextStub.cpp; 5s local 2024-12-18T00:07:22.0844638Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 5s local 2024-12-18T00:07:22.0845435Z Compiling llvm/lib/IR/AsmWriter.cpp; 5s local ... 2024-12-18T00:07:22.3055657Z 2024-12-18T00:07:22.3056747Z  2024-12-18T00:07:22.3057181Z  2024-12-18T00:07:22.3057522Z  2024-12-18T00:07:22.3057853Z  2024-12-18T00:07:22.3058199Z  2024-12-18T00:07:22.3058590Z  2024-12-18T00:07:22.3058930Z  2024-12-18T00:07:22.3059285Z  2024-12-18T00:07:22.3059836Z [11,979 / 15,187] 48 actions, 47 running 2024-12-18T00:07:22.3060467Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:07:22.3061136Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2024-12-18T00:07:22.3061909Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2024-12-18T00:07:22.3062694Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:07:22.3063502Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 8s local 2024-12-18T00:07:22.3064276Z Compiling llvm/lib/TextAPI/TextStub.cpp; 5s local 2024-12-18T00:07:22.3064931Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 5s local 2024-12-18T00:07:22.3065591Z Compiling llvm/lib/IR/AsmWriter.cpp; 5s local ... 2024-12-18T00:07:22.6663114Z 2024-12-18T00:07:22.6663973Z  2024-12-18T00:07:22.6664447Z  2024-12-18T00:07:22.6664885Z  2024-12-18T00:07:22.6665263Z  2024-12-18T00:07:22.6665640Z  2024-12-18T00:07:22.6666016Z  2024-12-18T00:07:22.6666410Z  2024-12-18T00:07:22.6666802Z  2024-12-18T00:07:22.6667407Z [11,983 / 15,187] 48 actions, 47 running 2024-12-18T00:07:22.6668262Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:07:22.6669030Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2024-12-18T00:07:22.6669955Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2024-12-18T00:07:22.6670919Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:07:22.6671854Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 8s local 2024-12-18T00:07:22.6672742Z Compiling llvm/lib/TextAPI/TextStub.cpp; 6s local 2024-12-18T00:07:22.6673500Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 6s local 2024-12-18T00:07:22.6674275Z Compiling llvm/lib/IR/AsmWriter.cpp; 5s local ... 2024-12-18T00:07:22.8840824Z 2024-12-18T00:07:22.8841733Z  2024-12-18T00:07:22.8842232Z  2024-12-18T00:07:22.8842653Z  2024-12-18T00:07:22.8843029Z  2024-12-18T00:07:22.8843412Z  2024-12-18T00:07:22.8843792Z  2024-12-18T00:07:22.8844410Z  2024-12-18T00:07:22.8844776Z  2024-12-18T00:07:22.8845275Z [11,986 / 15,187] 48 actions running 2024-12-18T00:07:22.8845904Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:07:22.8846619Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2024-12-18T00:07:22.8847479Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2024-12-18T00:07:22.8848769Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:07:22.8849670Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 8s local 2024-12-18T00:07:22.8850558Z Compiling llvm/lib/TextAPI/TextStub.cpp; 6s local 2024-12-18T00:07:22.8851342Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 6s local 2024-12-18T00:07:22.8852378Z Compiling llvm/lib/IR/AsmWriter.cpp; 6s local ... 2024-12-18T00:07:23.0844641Z 2024-12-18T00:07:23.0845442Z  2024-12-18T00:07:23.0845904Z  2024-12-18T00:07:23.0846309Z  2024-12-18T00:07:23.0846697Z  2024-12-18T00:07:23.0847099Z  2024-12-18T00:07:23.0847515Z  2024-12-18T00:07:23.0847919Z  2024-12-18T00:07:23.0848304Z  2024-12-18T00:07:23.0848868Z [11,988 / 15,187] 48 actions running 2024-12-18T00:07:23.0849570Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:07:23.0850305Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2024-12-18T00:07:23.0851268Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2024-12-18T00:07:23.0852219Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:07:23.0853175Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 9s local 2024-12-18T00:07:23.0854088Z Compiling llvm/lib/TextAPI/TextStub.cpp; 6s local 2024-12-18T00:07:23.0855049Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 6s local 2024-12-18T00:07:23.0855891Z Compiling llvm/lib/IR/AsmWriter.cpp; 6s local ... 2024-12-18T00:07:23.3495204Z 2024-12-18T00:07:23.3496069Z  2024-12-18T00:07:23.3496686Z  2024-12-18T00:07:23.3497102Z  2024-12-18T00:07:23.3497469Z  2024-12-18T00:07:23.3497857Z  2024-12-18T00:07:23.3498235Z  2024-12-18T00:07:23.3498629Z  2024-12-18T00:07:23.3499002Z  2024-12-18T00:07:23.3499575Z [11,989 / 15,187] 48 actions, 47 running 2024-12-18T00:07:23.3500281Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:07:23.3501022Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2024-12-18T00:07:23.3501998Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2024-12-18T00:07:23.3502894Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:07:23.3503736Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 9s local 2024-12-18T00:07:23.3504572Z Compiling llvm/lib/TextAPI/TextStub.cpp; 6s local 2024-12-18T00:07:23.3505299Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 6s local 2024-12-18T00:07:23.3506002Z Compiling llvm/lib/IR/AsmWriter.cpp; 6s local ... 2024-12-18T00:07:23.6850755Z 2024-12-18T00:07:23.6851613Z  2024-12-18T00:07:23.6852082Z  2024-12-18T00:07:23.6852491Z  2024-12-18T00:07:23.6852889Z  2024-12-18T00:07:23.6853274Z  2024-12-18T00:07:23.6853675Z  2024-12-18T00:07:23.6854063Z  2024-12-18T00:07:23.6854453Z  2024-12-18T00:07:23.6855045Z [11,990 / 15,187] 48 actions running 2024-12-18T00:07:23.6855771Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2024-12-18T00:07:23.6856682Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2024-12-18T00:07:23.6857582Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2024-12-18T00:07:23.6858502Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:07:23.6859440Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 9s local 2024-12-18T00:07:23.6860298Z Compiling llvm/lib/TextAPI/TextStub.cpp; 7s local 2024-12-18T00:07:23.6861091Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 7s local 2024-12-18T00:07:23.6861853Z Compiling llvm/lib/IR/AsmWriter.cpp; 6s local ... 2024-12-18T00:07:23.8854409Z 2024-12-18T00:07:23.8855235Z  2024-12-18T00:07:23.8855723Z  2024-12-18T00:07:23.8856135Z  2024-12-18T00:07:23.8856659Z  2024-12-18T00:07:23.8857103Z  2024-12-18T00:07:23.8857520Z  2024-12-18T00:07:23.8857909Z  2024-12-18T00:07:23.8858228Z  2024-12-18T00:07:23.8859128Z [11,991 / 15,187] 48 actions running 2024-12-18T00:07:23.8859828Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2024-12-18T00:07:23.8860564Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:07:23.8861456Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2024-12-18T00:07:23.8862603Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:07:23.8863519Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 9s local 2024-12-18T00:07:23.8864358Z Compiling llvm/lib/TextAPI/TextStub.cpp; 7s local 2024-12-18T00:07:23.8865128Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 7s local 2024-12-18T00:07:23.8865885Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local ... 2024-12-18T00:07:24.1891206Z 2024-12-18T00:07:24.1892053Z  2024-12-18T00:07:24.1892536Z  2024-12-18T00:07:24.1892937Z  2024-12-18T00:07:24.1893311Z  2024-12-18T00:07:24.1893711Z  2024-12-18T00:07:24.1894158Z  2024-12-18T00:07:24.1894547Z  2024-12-18T00:07:24.1894932Z  2024-12-18T00:07:24.1895528Z [11,994 / 15,187] 48 actions, 47 running 2024-12-18T00:07:24.1896292Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2024-12-18T00:07:24.1897279Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:07:24.1898183Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2024-12-18T00:07:24.1899141Z Compiling llvm/lib/DebugInfo/CodeView/EnumTables.cpp; 10s local 2024-12-18T00:07:24.1900033Z Compiling llvm/lib/TextAPI/TextStub.cpp; 7s local 2024-12-18T00:07:24.1900817Z Compiling llvm/lib/TextAPI/TextStubV5.cpp; 7s local 2024-12-18T00:07:24.1901572Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:07:24.1902319Z Compiling llvm/lib/IR/Attributes.cpp; 7s local ... 2024-12-18T00:07:24.3977532Z 2024-12-18T00:07:24.3978366Z  2024-12-18T00:07:24.3978772Z  2024-12-18T00:07:24.3979099Z  2024-12-18T00:07:24.3979489Z  2024-12-18T00:07:24.3979819Z  2024-12-18T00:07:24.3980152Z  2024-12-18T00:07:24.3980470Z  2024-12-18T00:07:24.3980804Z  2024-12-18T00:07:24.3981319Z [12,000 / 15,187] 48 actions, 47 running 2024-12-18T00:07:24.3981965Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:07:24.3982766Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:07:24.3983483Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:07:24.3984036Z Compiling llvm/lib/IR/Attributes.cpp; 7s local 2024-12-18T00:07:24.3984683Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 7s local 2024-12-18T00:07:24.3985455Z Compiling xla/service/cpu/in_process_collectives.cc; 7s local 2024-12-18T00:07:24.3986134Z Compiling llvm/lib/IR/Constants.cpp; 7s local 2024-12-18T00:07:24.3986759Z Compiling llvm/lib/IR/Core.cpp; 7s local ... 2024-12-18T00:07:24.6116608Z 2024-12-18T00:07:24.6117534Z  2024-12-18T00:07:24.6118027Z  2024-12-18T00:07:24.6118508Z  2024-12-18T00:07:24.6118914Z  2024-12-18T00:07:24.6119302Z  2024-12-18T00:07:24.6119693Z  2024-12-18T00:07:24.6120107Z  2024-12-18T00:07:24.6120518Z  2024-12-18T00:07:24.6121110Z [12,005 / 15,187] 48 actions, 47 running 2024-12-18T00:07:24.6121917Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:07:24.6122826Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:07:24.6123745Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:07:24.6124496Z Compiling llvm/lib/IR/Attributes.cpp; 7s local 2024-12-18T00:07:24.6125231Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 7s local 2024-12-18T00:07:24.6126103Z Compiling xla/service/cpu/in_process_collectives.cc; 7s local 2024-12-18T00:07:24.6126998Z Compiling llvm/lib/IR/Constants.cpp; 7s local 2024-12-18T00:07:24.6127749Z Compiling llvm/lib/IR/Core.cpp; 7s local ... 2024-12-18T00:07:24.8232051Z 2024-12-18T00:07:24.8233256Z  2024-12-18T00:07:24.8233761Z  2024-12-18T00:07:24.8234169Z  2024-12-18T00:07:24.8234596Z  2024-12-18T00:07:24.8234996Z  2024-12-18T00:07:24.8235379Z  2024-12-18T00:07:24.8235766Z  2024-12-18T00:07:24.8236161Z  2024-12-18T00:07:24.8236744Z [12,007 / 15,187] 48 actions, 47 running 2024-12-18T00:07:24.8237826Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:07:24.8238743Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:07:24.8239645Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:07:24.8240388Z Compiling llvm/lib/IR/Attributes.cpp; 7s local 2024-12-18T00:07:24.8241169Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 7s local 2024-12-18T00:07:24.8242012Z Compiling xla/service/cpu/in_process_collectives.cc; 7s local 2024-12-18T00:07:24.8242830Z Compiling llvm/lib/IR/Constants.cpp; 7s local 2024-12-18T00:07:24.8243559Z Compiling llvm/lib/IR/Core.cpp; 7s local ... 2024-12-18T00:07:25.0861357Z 2024-12-18T00:07:25.0862249Z  2024-12-18T00:07:25.0862725Z  2024-12-18T00:07:25.0863142Z  2024-12-18T00:07:25.0863555Z  2024-12-18T00:07:25.0863966Z  2024-12-18T00:07:25.0864346Z  2024-12-18T00:07:25.0864740Z  2024-12-18T00:07:25.0865128Z  2024-12-18T00:07:25.0865704Z [12,010 / 15,187] 48 actions running 2024-12-18T00:07:25.0866548Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:07:25.0867476Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:07:25.0868366Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:07:25.0869087Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 8s local 2024-12-18T00:07:25.0869946Z Compiling xla/service/cpu/in_process_collectives.cc; 8s local 2024-12-18T00:07:25.0870816Z Compiling llvm/lib/IR/Constants.cpp; 7s local 2024-12-18T00:07:25.0871509Z Compiling llvm/lib/IR/Core.cpp; 7s local 2024-12-18T00:07:25.0872223Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2024-12-18T00:07:25.3404079Z 2024-12-18T00:07:25.3405017Z  2024-12-18T00:07:25.3405634Z  2024-12-18T00:07:25.3406025Z  2024-12-18T00:07:25.3406471Z  2024-12-18T00:07:25.3406827Z  2024-12-18T00:07:25.3407185Z  2024-12-18T00:07:25.3407685Z  2024-12-18T00:07:25.3408099Z  2024-12-18T00:07:25.3408737Z [12,014 / 15,187] 48 actions, 47 running 2024-12-18T00:07:25.3409460Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:07:25.3410370Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:07:25.3411235Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:07:25.3412000Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 8s local 2024-12-18T00:07:25.3412903Z Compiling xla/service/cpu/in_process_collectives.cc; 8s local 2024-12-18T00:07:25.3413680Z Compiling llvm/lib/IR/Constants.cpp; 8s local 2024-12-18T00:07:25.3414352Z Compiling llvm/lib/IR/Core.cpp; 7s local 2024-12-18T00:07:25.3415066Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2024-12-18T00:07:25.5581882Z 2024-12-18T00:07:25.5582829Z  2024-12-18T00:07:25.5583333Z  2024-12-18T00:07:25.5583759Z  2024-12-18T00:07:25.5584159Z  2024-12-18T00:07:25.5584563Z  2024-12-18T00:07:25.5584978Z  2024-12-18T00:07:25.5585371Z  2024-12-18T00:07:25.5585790Z  2024-12-18T00:07:25.5586403Z [12,018 / 15,187] 48 actions, 47 running 2024-12-18T00:07:25.5587200Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:07:25.5588142Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:07:25.5589053Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:07:25.5589797Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 8s local 2024-12-18T00:07:25.5590592Z Compiling xla/service/cpu/in_process_collectives.cc; 8s local 2024-12-18T00:07:25.5591453Z Compiling llvm/lib/IR/Constants.cpp; 8s local 2024-12-18T00:07:25.5592542Z Compiling llvm/lib/IR/Core.cpp; 8s local 2024-12-18T00:07:25.5593268Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2024-12-18T00:07:25.7967856Z 2024-12-18T00:07:25.7968762Z  2024-12-18T00:07:25.7969223Z  2024-12-18T00:07:25.7969645Z  2024-12-18T00:07:25.7970069Z  2024-12-18T00:07:25.7970473Z  2024-12-18T00:07:25.7971181Z  2024-12-18T00:07:25.7971607Z  2024-12-18T00:07:25.7971998Z  2024-12-18T00:07:25.7972574Z [12,020 / 15,187] 48 actions, 47 running 2024-12-18T00:07:25.7973349Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2024-12-18T00:07:25.7974202Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:07:25.7975048Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:07:25.7975801Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 8s local 2024-12-18T00:07:25.7976823Z Compiling xla/service/cpu/in_process_collectives.cc; 8s local 2024-12-18T00:07:25.7977699Z Compiling llvm/lib/IR/Constants.cpp; 8s local 2024-12-18T00:07:25.7978387Z Compiling llvm/lib/IR/Core.cpp; 8s local 2024-12-18T00:07:25.7979082Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2024-12-18T00:07:26.0518051Z 2024-12-18T00:07:26.0518913Z  2024-12-18T00:07:26.0519385Z  2024-12-18T00:07:26.0519776Z  2024-12-18T00:07:26.0520185Z  2024-12-18T00:07:26.0520516Z  2024-12-18T00:07:26.0520874Z  2024-12-18T00:07:26.0521269Z  2024-12-18T00:07:26.0521666Z  2024-12-18T00:07:26.0522270Z [12,021 / 15,187] 48 actions, 47 running 2024-12-18T00:07:26.0523030Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2024-12-18T00:07:26.0523931Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:07:26.0524812Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:07:26.0525561Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2024-12-18T00:07:26.0526441Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2024-12-18T00:07:26.0527235Z Compiling llvm/lib/IR/Constants.cpp; 8s local 2024-12-18T00:07:26.0527918Z Compiling llvm/lib/IR/Core.cpp; 8s local 2024-12-18T00:07:26.0528569Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local ... 2024-12-18T00:07:26.2868731Z 2024-12-18T00:07:26.2869625Z  2024-12-18T00:07:26.2870129Z  2024-12-18T00:07:26.2870570Z  2024-12-18T00:07:26.2870950Z  2024-12-18T00:07:26.2871337Z  2024-12-18T00:07:26.2871738Z  2024-12-18T00:07:26.2872155Z  2024-12-18T00:07:26.2872558Z  2024-12-18T00:07:26.2873125Z [12,024 / 15,187] 48 actions running 2024-12-18T00:07:26.2873876Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2024-12-18T00:07:26.2874749Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:07:26.2875594Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:07:26.2876315Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2024-12-18T00:07:26.2877168Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2024-12-18T00:07:26.2877995Z Compiling llvm/lib/IR/Constants.cpp; 8s local 2024-12-18T00:07:26.2878696Z Compiling llvm/lib/IR/Core.cpp; 8s local 2024-12-18T00:07:26.2879378Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local ... 2024-12-18T00:07:26.4872496Z 2024-12-18T00:07:26.4873497Z  2024-12-18T00:07:26.4874222Z  2024-12-18T00:07:26.4874832Z  2024-12-18T00:07:26.4875361Z  2024-12-18T00:07:26.4875872Z  2024-12-18T00:07:26.4876393Z  2024-12-18T00:07:26.4876906Z  2024-12-18T00:07:26.4877425Z  2024-12-18T00:07:26.4878129Z [12,028 / 15,187] 48 actions running 2024-12-18T00:07:26.4879037Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2024-12-18T00:07:26.4880074Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:07:26.4881051Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:07:26.4882467Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2024-12-18T00:07:26.4883439Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2024-12-18T00:07:26.4884408Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2024-12-18T00:07:26.4885212Z Compiling llvm/lib/IR/Core.cpp; 9s local 2024-12-18T00:07:26.4886322Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local ... 2024-12-18T00:07:26.7673727Z 2024-12-18T00:07:26.7674695Z  2024-12-18T00:07:26.7675189Z  2024-12-18T00:07:26.7675751Z  2024-12-18T00:07:26.7676310Z  2024-12-18T00:07:26.7676852Z  2024-12-18T00:07:26.7677386Z  2024-12-18T00:07:26.7677920Z  2024-12-18T00:07:26.7678467Z  2024-12-18T00:07:26.7679221Z [12,031 / 15,187] 48 actions, 47 running 2024-12-18T00:07:26.7680171Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:07:26.7681265Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:07:26.7682370Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:07:26.7683262Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2024-12-18T00:07:26.7684296Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2024-12-18T00:07:26.7685323Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2024-12-18T00:07:26.7686187Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:07:26.7687130Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2024-12-18T00:07:26.9916951Z 2024-12-18T00:07:26.9917855Z  2024-12-18T00:07:26.9918351Z  2024-12-18T00:07:26.9918733Z  2024-12-18T00:07:26.9919104Z  2024-12-18T00:07:26.9919458Z  2024-12-18T00:07:26.9919853Z  2024-12-18T00:07:26.9920238Z  2024-12-18T00:07:26.9920625Z  2024-12-18T00:07:26.9921345Z [12,034 / 15,187] 48 actions, 47 running 2024-12-18T00:07:26.9922101Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:07:26.9923026Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:07:26.9923950Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:07:26.9924690Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2024-12-18T00:07:26.9925448Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2024-12-18T00:07:26.9926245Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2024-12-18T00:07:26.9926984Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2024-12-18T00:07:26.9927796Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local ... 2024-12-18T00:07:27.2746540Z 2024-12-18T00:07:27.2747364Z  2024-12-18T00:07:27.2747823Z  2024-12-18T00:07:27.2748198Z  2024-12-18T00:07:27.2748574Z  2024-12-18T00:07:27.2748964Z  2024-12-18T00:07:27.2749342Z  2024-12-18T00:07:27.2749703Z  2024-12-18T00:07:27.2750047Z  2024-12-18T00:07:27.2750596Z [12,038 / 15,187] 48 actions, 47 running 2024-12-18T00:07:27.2751382Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:07:27.2752237Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:07:27.2753058Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:07:27.2753745Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2024-12-18T00:07:27.2754545Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2024-12-18T00:07:27.2755413Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2024-12-18T00:07:27.2756136Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:07:27.2756867Z Compiling llvm/lib/IR/Dominators.cpp; 9s local ... 2024-12-18T00:07:27.4829941Z 2024-12-18T00:07:27.4830833Z  2024-12-18T00:07:27.4831306Z  2024-12-18T00:07:27.4831685Z  2024-12-18T00:07:27.4832047Z  2024-12-18T00:07:27.4832441Z  2024-12-18T00:07:27.4832798Z  2024-12-18T00:07:27.4833174Z  2024-12-18T00:07:27.4833551Z  2024-12-18T00:07:27.4834222Z [12,041 / 15,187] 48 actions, 47 running 2024-12-18T00:07:27.4835378Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:07:27.4836185Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2024-12-18T00:07:27.4837019Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:07:27.4837731Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2024-12-18T00:07:27.4838780Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2024-12-18T00:07:27.4839631Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:07:27.4840382Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:07:27.4841185Z Compiling llvm/lib/IR/Dominators.cpp; 9s local ... 2024-12-18T00:07:27.6881697Z 2024-12-18T00:07:27.6882580Z  2024-12-18T00:07:27.6883051Z  2024-12-18T00:07:27.6883435Z  2024-12-18T00:07:27.6883805Z  2024-12-18T00:07:27.6884204Z  2024-12-18T00:07:27.6884600Z  2024-12-18T00:07:27.6885078Z  2024-12-18T00:07:27.6885461Z  2024-12-18T00:07:27.6886011Z [12,043 / 15,187] 47 actions running 2024-12-18T00:07:27.6886827Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:07:27.6887674Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2024-12-18T00:07:27.6888542Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:07:27.6889350Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2024-12-18T00:07:27.6890213Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2024-12-18T00:07:27.6891028Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:07:27.6891794Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:07:27.6892599Z Compiling llvm/lib/IR/Dominators.cpp; 9s local ... 2024-12-18T00:07:27.9624014Z 2024-12-18T00:07:27.9625008Z  2024-12-18T00:07:27.9625490Z  2024-12-18T00:07:27.9625853Z  2024-12-18T00:07:27.9626245Z  2024-12-18T00:07:27.9627079Z  2024-12-18T00:07:27.9627496Z  2024-12-18T00:07:27.9627895Z  2024-12-18T00:07:27.9628260Z  2024-12-18T00:07:27.9628859Z [12,048 / 15,187] 48 actions, 47 running 2024-12-18T00:07:27.9629610Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:07:27.9630529Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2024-12-18T00:07:27.9631419Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2024-12-18T00:07:27.9632152Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:07:27.9633030Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2024-12-18T00:07:27.9633861Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:07:27.9634633Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:07:27.9635439Z Compiling llvm/lib/IR/Dominators.cpp; 9s local ... 2024-12-18T00:07:28.2782694Z 2024-12-18T00:07:28.2783575Z  2024-12-18T00:07:28.2785330Z  2024-12-18T00:07:28.2785843Z  2024-12-18T00:07:28.2786258Z  2024-12-18T00:07:28.2786653Z  2024-12-18T00:07:28.2787050Z  2024-12-18T00:07:28.2787449Z  2024-12-18T00:07:28.2787847Z  2024-12-18T00:07:28.2788481Z [12,055 / 15,187] 48 actions, 47 running 2024-12-18T00:07:28.2789266Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:07:28.2790254Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2024-12-18T00:07:28.2791180Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2024-12-18T00:07:28.2792008Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:07:28.2792902Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2024-12-18T00:07:28.2793815Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:07:28.2794665Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:07:28.2795569Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local ... 2024-12-18T00:07:28.4889811Z 2024-12-18T00:07:28.4891012Z  2024-12-18T00:07:28.4891536Z  2024-12-18T00:07:28.4891971Z  2024-12-18T00:07:28.4892352Z  2024-12-18T00:07:28.4892761Z  2024-12-18T00:07:28.4893167Z  2024-12-18T00:07:28.4893588Z  2024-12-18T00:07:28.4894007Z  2024-12-18T00:07:28.4894566Z [12,058 / 15,187] 48 actions running 2024-12-18T00:07:28.4895701Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:07:28.4896827Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:07:28.4897756Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2024-12-18T00:07:28.4910446Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:07:28.4911376Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2024-12-18T00:07:28.4912287Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:07:28.4913061Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:07:28.4913933Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local ... 2024-12-18T00:07:28.6893889Z 2024-12-18T00:07:28.6894699Z  2024-12-18T00:07:28.6895140Z  2024-12-18T00:07:28.6895521Z  2024-12-18T00:07:28.6895906Z  2024-12-18T00:07:28.6896256Z  2024-12-18T00:07:28.6896699Z  2024-12-18T00:07:28.6897013Z  2024-12-18T00:07:28.6897337Z  2024-12-18T00:07:28.6897842Z [12,063 / 15,187] 48 actions running 2024-12-18T00:07:28.6898452Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:07:28.6899174Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:07:28.6899836Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2024-12-18T00:07:28.6900418Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:07:28.6901101Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2024-12-18T00:07:28.6901771Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:07:28.6902393Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:07:28.6903075Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local ... 2024-12-18T00:07:28.9351761Z 2024-12-18T00:07:28.9352629Z  2024-12-18T00:07:28.9353097Z  2024-12-18T00:07:28.9353490Z  2024-12-18T00:07:28.9353891Z  2024-12-18T00:07:28.9354278Z  2024-12-18T00:07:28.9354671Z  2024-12-18T00:07:28.9355056Z  2024-12-18T00:07:28.9355478Z  2024-12-18T00:07:28.9356057Z [12,066 / 15,187] 48 actions, 47 running 2024-12-18T00:07:28.9356814Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:07:28.9357699Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:07:28.9358560Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:07:28.9359317Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:07:28.9360149Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2024-12-18T00:07:28.9360984Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:07:28.9361790Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:07:28.9362636Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local ... 2024-12-18T00:07:29.1755959Z 2024-12-18T00:07:29.1756786Z  2024-12-18T00:07:29.1757258Z  2024-12-18T00:07:29.1757662Z  2024-12-18T00:07:29.1758081Z  2024-12-18T00:07:29.1758490Z  2024-12-18T00:07:29.1758938Z  2024-12-18T00:07:29.1759329Z  2024-12-18T00:07:29.1759749Z  2024-12-18T00:07:29.1760359Z [12,072 / 15,187] 48 actions, 47 running 2024-12-18T00:07:29.1761142Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:07:29.1762073Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:07:29.1762958Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:07:29.1763749Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:07:29.1764597Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2024-12-18T00:07:29.1765906Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:07:29.1766720Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:07:29.1767545Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local ... 2024-12-18T00:07:29.4374792Z 2024-12-18T00:07:29.4375666Z  2024-12-18T00:07:29.4376161Z  2024-12-18T00:07:29.4377140Z  2024-12-18T00:07:29.4377621Z  2024-12-18T00:07:29.4377957Z  2024-12-18T00:07:29.4378301Z  2024-12-18T00:07:29.4378660Z  2024-12-18T00:07:29.4379012Z  2024-12-18T00:07:29.4379536Z [12,075 / 15,187] 48 actions, 47 running 2024-12-18T00:07:29.4380243Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:07:29.4381089Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:07:29.4381961Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:07:29.4382718Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:07:29.4383597Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2024-12-18T00:07:29.4384384Z Compiling llvm/lib/IR/Constants.cpp; 12s local 2024-12-18T00:07:29.4385142Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:07:29.4385975Z Compiling llvm/lib/IR/Metadata.cpp; 8s local ... 2024-12-18T00:07:29.6904124Z 2024-12-18T00:07:29.6905009Z  2024-12-18T00:07:29.6905471Z  2024-12-18T00:07:29.6905885Z  2024-12-18T00:07:29.6906301Z  2024-12-18T00:07:29.6906711Z  2024-12-18T00:07:29.6907067Z  2024-12-18T00:07:29.6907441Z  2024-12-18T00:07:29.6907832Z  2024-12-18T00:07:29.6908389Z [12,076 / 15,187] 48 actions running 2024-12-18T00:07:29.6909118Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:07:29.6910005Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:07:29.6910906Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:07:29.6911690Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:07:29.6912584Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2024-12-18T00:07:29.6913475Z Compiling llvm/lib/IR/Constants.cpp; 12s local 2024-12-18T00:07:29.6914222Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:07:29.6915070Z Compiling llvm/lib/IR/Metadata.cpp; 8s local ... 2024-12-18T00:07:30.0752329Z 2024-12-18T00:07:30.0753171Z  2024-12-18T00:07:30.0753660Z  2024-12-18T00:07:30.0754060Z  2024-12-18T00:07:30.0754466Z  2024-12-18T00:07:30.0754848Z  2024-12-18T00:07:30.0755268Z  2024-12-18T00:07:30.0755652Z  2024-12-18T00:07:30.0756032Z  2024-12-18T00:07:30.0756627Z [12,078 / 15,187] 48 actions, 47 running 2024-12-18T00:07:30.0757394Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2024-12-18T00:07:30.0758344Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:07:30.0759310Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:07:30.0760103Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:07:30.0761012Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2024-12-18T00:07:30.0761962Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2024-12-18T00:07:30.0762799Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:07:30.0763660Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2024-12-18T00:07:30.2800088Z 2024-12-18T00:07:30.2800925Z  2024-12-18T00:07:30.2801404Z  2024-12-18T00:07:30.2801828Z  2024-12-18T00:07:30.2802227Z  2024-12-18T00:07:30.2802648Z  2024-12-18T00:07:30.2803050Z  2024-12-18T00:07:30.2803433Z  2024-12-18T00:07:30.2803817Z  2024-12-18T00:07:30.2804413Z [12,082 / 15,187] 48 actions, 47 running 2024-12-18T00:07:30.2805220Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2024-12-18T00:07:30.2806443Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:07:30.2807339Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:07:30.2808228Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:07:30.2809070Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2024-12-18T00:07:30.2810047Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:07:30.2810685Z Compiling llvm/lib/IR/Type.cpp; 6s local 2024-12-18T00:07:30.2811386Z Compiling llvm/lib/IR/Value.cpp; 5s local ... 2024-12-18T00:07:30.4911993Z 2024-12-18T00:07:30.4912888Z  2024-12-18T00:07:30.4913382Z  2024-12-18T00:07:30.4913789Z  2024-12-18T00:07:30.4914202Z  2024-12-18T00:07:30.4914611Z  2024-12-18T00:07:30.4915029Z  2024-12-18T00:07:30.4915426Z  2024-12-18T00:07:30.4915844Z  2024-12-18T00:07:30.4916432Z [12,086 / 15,187] 48 actions running 2024-12-18T00:07:30.4917359Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:07:30.4918289Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:07:30.4919072Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:07:30.4919993Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2024-12-18T00:07:30.4920856Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:07:30.4921599Z Compiling llvm/lib/IR/Value.cpp; 6s local 2024-12-18T00:07:30.4922274Z Compiling xla/layout_util.cc; 5s local 2024-12-18T00:07:30.4922993Z Compiling llvm/lib/IR/Verifier.cpp; 5s local ... 2024-12-18T00:07:30.6915295Z 2024-12-18T00:07:30.6916144Z  2024-12-18T00:07:30.6916617Z  2024-12-18T00:07:30.6917003Z  2024-12-18T00:07:30.6917435Z  2024-12-18T00:07:30.6917815Z  2024-12-18T00:07:30.6918162Z  2024-12-18T00:07:30.6918543Z  2024-12-18T00:07:30.6918913Z  2024-12-18T00:07:30.6919472Z [12,088 / 15,187] 48 actions running 2024-12-18T00:07:30.6920349Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:07:30.6921127Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:07:30.6921846Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:07:30.6922709Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2024-12-18T00:07:30.6923569Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:07:30.6924285Z Compiling llvm/lib/IR/Value.cpp; 6s local 2024-12-18T00:07:30.6924996Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2024-12-18T00:07:30.6925874Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp; 3s local ... 2024-12-18T00:07:31.0834805Z 2024-12-18T00:07:31.0835683Z  2024-12-18T00:07:31.0836254Z  2024-12-18T00:07:31.0836642Z  2024-12-18T00:07:31.0837024Z  2024-12-18T00:07:31.0837404Z  2024-12-18T00:07:31.0837790Z  2024-12-18T00:07:31.0838172Z  2024-12-18T00:07:31.0838591Z  2024-12-18T00:07:31.0839165Z [12,092 / 15,187] 48 actions, 47 running 2024-12-18T00:07:31.0839920Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:07:31.0840685Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:07:31.0841449Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2024-12-18T00:07:31.0842201Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:07:31.0842784Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2024-12-18T00:07:31.0843470Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp; 3s local 2024-12-18T00:07:31.0844534Z Compiling xla/backends/profiler/plugin/plugin_tracer.cc; 3s local 2024-12-18T00:07:31.0845484Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 3s local ... 2024-12-18T00:07:31.2922965Z 2024-12-18T00:07:31.2923842Z  2024-12-18T00:07:31.2924318Z  2024-12-18T00:07:31.2924710Z  2024-12-18T00:07:31.2925126Z  2024-12-18T00:07:31.2926047Z  2024-12-18T00:07:31.2926431Z  2024-12-18T00:07:31.2926846Z  2024-12-18T00:07:31.2927255Z  2024-12-18T00:07:31.2927852Z [12,093 / 15,187] 48 actions running 2024-12-18T00:07:31.2928757Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:07:31.2929693Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:07:31.2930836Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2024-12-18T00:07:31.2931717Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:07:31.2932441Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2024-12-18T00:07:31.2933264Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp; 4s local 2024-12-18T00:07:31.2934260Z Compiling xla/backends/profiler/plugin/plugin_tracer.cc; 3s local 2024-12-18T00:07:31.2935380Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 3s local ... 2024-12-18T00:07:31.4980427Z 2024-12-18T00:07:31.4981289Z  2024-12-18T00:07:31.4981831Z  2024-12-18T00:07:31.4982269Z  2024-12-18T00:07:31.4982643Z  2024-12-18T00:07:31.4983007Z  2024-12-18T00:07:31.4983370Z  2024-12-18T00:07:31.4983799Z  2024-12-18T00:07:31.4984193Z  2024-12-18T00:07:31.4984736Z [12,096 / 15,187] 47 actions running 2024-12-18T00:07:31.4985527Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:07:31.4986439Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:07:31.4987293Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2024-12-18T00:07:31.4988161Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:07:31.4988863Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2024-12-18T00:07:31.4989668Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 3s local 2024-12-18T00:07:31.4990676Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 3s local 2024-12-18T00:07:31.4991760Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 3s local ... 2024-12-18T00:07:31.6985691Z 2024-12-18T00:07:31.6986570Z  2024-12-18T00:07:31.6987051Z  2024-12-18T00:07:31.6987462Z  2024-12-18T00:07:31.6987845Z  2024-12-18T00:07:31.6988359Z  2024-12-18T00:07:31.6988720Z  2024-12-18T00:07:31.6989087Z  2024-12-18T00:07:31.6989472Z  2024-12-18T00:07:31.6990046Z [12,099 / 15,187] 48 actions running 2024-12-18T00:07:31.6990852Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:07:31.6991733Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:07:31.6992582Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2024-12-18T00:07:31.6993403Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:07:31.6994111Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:07:31.6994933Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 3s local 2024-12-18T00:07:31.6995933Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 3s local 2024-12-18T00:07:31.6997074Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 3s local ... 2024-12-18T00:07:32.0738349Z 2024-12-18T00:07:32.0739148Z  2024-12-18T00:07:32.0739596Z  2024-12-18T00:07:32.0739946Z  2024-12-18T00:07:32.0740280Z  2024-12-18T00:07:32.0740599Z  2024-12-18T00:07:32.0740936Z  2024-12-18T00:07:32.0741300Z  2024-12-18T00:07:32.0741633Z  2024-12-18T00:07:32.0742142Z [12,104 / 15,187] 48 actions, 47 running 2024-12-18T00:07:32.0742904Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:07:32.0743752Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:07:32.0744778Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2024-12-18T00:07:32.0745559Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:07:32.0746183Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:07:32.0747246Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 4s local 2024-12-18T00:07:32.0748176Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 4s local 2024-12-18T00:07:32.0749199Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local ... 2024-12-18T00:07:32.2992474Z 2024-12-18T00:07:32.2993371Z  2024-12-18T00:07:32.2993835Z  2024-12-18T00:07:32.2994553Z  2024-12-18T00:07:32.2994967Z  2024-12-18T00:07:32.2995335Z  2024-12-18T00:07:32.2995703Z  2024-12-18T00:07:32.2996084Z  2024-12-18T00:07:32.2996451Z  2024-12-18T00:07:32.2996992Z [12,106 / 15,187] 47 actions running 2024-12-18T00:07:32.2997828Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:07:32.2998610Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:07:32.2999412Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2024-12-18T00:07:32.3000174Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:07:32.3000873Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:07:32.3001712Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 4s local 2024-12-18T00:07:32.3002750Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 4s local 2024-12-18T00:07:32.3003871Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local ... 2024-12-18T00:07:32.4997459Z 2024-12-18T00:07:32.4998377Z  2024-12-18T00:07:32.4998821Z  2024-12-18T00:07:32.4999286Z  2024-12-18T00:07:32.4999688Z  2024-12-18T00:07:32.5000062Z  2024-12-18T00:07:32.5000453Z  2024-12-18T00:07:32.5000827Z  2024-12-18T00:07:32.5001212Z  2024-12-18T00:07:32.5001775Z [12,107 / 15,187] 48 actions running 2024-12-18T00:07:32.5002631Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:07:32.5003544Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:07:32.5004432Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2024-12-18T00:07:32.5005264Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:07:32.5005994Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:07:32.5006864Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 4s local 2024-12-18T00:07:32.5007965Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 4s local 2024-12-18T00:07:32.5009073Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local ... 2024-12-18T00:07:32.7584918Z 2024-12-18T00:07:32.7585770Z  2024-12-18T00:07:32.7586243Z  2024-12-18T00:07:32.7586629Z  2024-12-18T00:07:32.7587043Z  2024-12-18T00:07:32.7587434Z  2024-12-18T00:07:32.7587833Z  2024-12-18T00:07:32.7588225Z  2024-12-18T00:07:32.7588640Z  2024-12-18T00:07:32.7589249Z [12,109 / 15,187] 48 actions, 47 running 2024-12-18T00:07:32.7590077Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:07:32.7590918Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:07:32.7591752Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2024-12-18T00:07:32.7592489Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:07:32.7593027Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:07:32.7593869Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 4s local 2024-12-18T00:07:32.7594936Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 4s local 2024-12-18T00:07:32.7595979Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local ... 2024-12-18T00:07:33.0649510Z 2024-12-18T00:07:33.0650414Z  2024-12-18T00:07:33.0650931Z  2024-12-18T00:07:33.0651363Z  2024-12-18T00:07:33.0651778Z  2024-12-18T00:07:33.0652176Z  2024-12-18T00:07:33.0652581Z  2024-12-18T00:07:33.0652957Z  2024-12-18T00:07:33.0653336Z  2024-12-18T00:07:33.0654306Z [12,114 / 15,187] 48 actions, 47 running 2024-12-18T00:07:33.0655191Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:07:33.0656088Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:07:33.0657108Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2024-12-18T00:07:33.0657940Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:07:33.0658922Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:07:33.0659812Z Compiling .../rpc/client/remote_profiler_session_manager.cc; 5s local 2024-12-18T00:07:33.0660905Z Compiling external/tsl/tsl/profiler/protobuf/trace_events.pb.cc; 4s local 2024-12-18T00:07:33.0662102Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 4s local ... 2024-12-18T00:07:33.2708806Z 2024-12-18T00:07:33.2709666Z  2024-12-18T00:07:33.2710050Z  2024-12-18T00:07:33.2710379Z  2024-12-18T00:07:33.2710696Z  2024-12-18T00:07:33.2711123Z  2024-12-18T00:07:33.2711504Z  2024-12-18T00:07:33.2711903Z  2024-12-18T00:07:33.2712282Z  2024-12-18T00:07:33.2712821Z [12,115 / 15,187] 48 actions, 47 running 2024-12-18T00:07:33.2713496Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:07:33.2714206Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:07:33.2715084Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2024-12-18T00:07:33.2715912Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:07:33.2716554Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:07:33.2717411Z Compiling external/tsl/tsl/profiler/protobuf/trace_events.pb.cc; 5s local 2024-12-18T00:07:33.2718526Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 4s local 2024-12-18T00:07:33.2719619Z Compiling xla/tsl/profiler/utils/timestamp_utils.cc; 4s local ... 2024-12-18T00:07:33.5003867Z 2024-12-18T00:07:33.5004780Z  2024-12-18T00:07:33.5005258Z  2024-12-18T00:07:33.5005689Z  2024-12-18T00:07:33.5006103Z  2024-12-18T00:07:33.5006523Z  2024-12-18T00:07:33.5006941Z  2024-12-18T00:07:33.5007373Z  2024-12-18T00:07:33.5007807Z  2024-12-18T00:07:33.5008404Z [12,124 / 15,187] 48 actions running 2024-12-18T00:07:33.5009320Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:07:33.5010245Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:07:33.5011181Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2024-12-18T00:07:33.5012015Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:07:33.5012698Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:07:33.5013682Z Compiling external/tsl/tsl/profiler/protobuf/trace_events.pb.cc; 5s local 2024-12-18T00:07:33.5015128Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 5s local 2024-12-18T00:07:33.5016165Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 4s local ... 2024-12-18T00:07:33.7623664Z 2024-12-18T00:07:33.7624549Z  2024-12-18T00:07:33.7625047Z  2024-12-18T00:07:33.7625462Z  2024-12-18T00:07:33.7625862Z  2024-12-18T00:07:33.7626281Z  2024-12-18T00:07:33.7626690Z  2024-12-18T00:07:33.7627105Z  2024-12-18T00:07:33.7627520Z  2024-12-18T00:07:33.7628150Z [12,130 / 15,187] 48 actions, 47 running 2024-12-18T00:07:33.7629057Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:07:33.7629980Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:07:33.7630790Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2024-12-18T00:07:33.7631467Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:07:33.7632082Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:07:33.7632991Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 5s local 2024-12-18T00:07:33.7634035Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 4s local 2024-12-18T00:07:33.7635351Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 4s local ... 2024-12-18T00:07:33.9639485Z 2024-12-18T00:07:33.9640355Z  2024-12-18T00:07:33.9640842Z  2024-12-18T00:07:33.9641206Z  2024-12-18T00:07:33.9641591Z  2024-12-18T00:07:33.9641987Z  2024-12-18T00:07:33.9642358Z  2024-12-18T00:07:33.9643068Z  2024-12-18T00:07:33.9643468Z  2024-12-18T00:07:33.9644085Z [12,132 / 15,187] 48 actions, 47 running 2024-12-18T00:07:33.9645163Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:07:33.9645919Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 17s local 2024-12-18T00:07:33.9646610Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2024-12-18T00:07:33.9647299Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:07:33.9647941Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:07:33.9648840Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 5s local 2024-12-18T00:07:33.9649843Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local 2024-12-18T00:07:33.9650748Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 5s local ... 2024-12-18T00:07:34.2352081Z 2024-12-18T00:07:34.2352916Z  2024-12-18T00:07:34.2353335Z  2024-12-18T00:07:34.2353705Z  2024-12-18T00:07:34.2354087Z  2024-12-18T00:07:34.2354472Z  2024-12-18T00:07:34.2354825Z  2024-12-18T00:07:34.2355180Z  2024-12-18T00:07:34.2355520Z  2024-12-18T00:07:34.2356038Z [12,138 / 15,187] 48 actions, 47 running 2024-12-18T00:07:34.2356833Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:07:34.2357692Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2024-12-18T00:07:34.2358446Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:07:34.2359095Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:07:34.2359901Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 5s local 2024-12-18T00:07:34.2360843Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local 2024-12-18T00:07:34.2361650Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 5s local 2024-12-18T00:07:34.2362526Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local ... 2024-12-18T00:07:34.4972602Z 2024-12-18T00:07:34.4973499Z  2024-12-18T00:07:34.4973985Z  2024-12-18T00:07:34.4974351Z  2024-12-18T00:07:34.4974732Z  2024-12-18T00:07:34.4975133Z  2024-12-18T00:07:34.4975532Z  2024-12-18T00:07:34.4975902Z  2024-12-18T00:07:34.4976273Z  2024-12-18T00:07:34.4976985Z [12,139 / 15,187] 48 actions, 47 running 2024-12-18T00:07:34.4977847Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:07:34.4978816Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2024-12-18T00:07:34.4979635Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:07:34.4980375Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:07:34.4981241Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 6s local 2024-12-18T00:07:34.4982224Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local 2024-12-18T00:07:34.4983082Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 5s local 2024-12-18T00:07:34.4984028Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local ... 2024-12-18T00:07:34.7016904Z 2024-12-18T00:07:34.7017729Z  2024-12-18T00:07:34.7018210Z  2024-12-18T00:07:34.7018623Z  2024-12-18T00:07:34.7019034Z  2024-12-18T00:07:34.7019456Z  2024-12-18T00:07:34.7019864Z  2024-12-18T00:07:34.7020263Z  2024-12-18T00:07:34.7020658Z  2024-12-18T00:07:34.7021212Z [12,141 / 15,187] 48 actions running 2024-12-18T00:07:34.7022065Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:07:34.7023343Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2024-12-18T00:07:34.7024123Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:07:34.7024779Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:07:34.7025680Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 6s local 2024-12-18T00:07:34.7026935Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local 2024-12-18T00:07:34.7027870Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 5s local 2024-12-18T00:07:34.7028937Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local ... 2024-12-18T00:07:34.9037176Z 2024-12-18T00:07:34.9038047Z  2024-12-18T00:07:34.9038519Z  2024-12-18T00:07:34.9038904Z  2024-12-18T00:07:34.9039285Z  2024-12-18T00:07:34.9039670Z  2024-12-18T00:07:34.9040067Z  2024-12-18T00:07:34.9040454Z  2024-12-18T00:07:34.9040857Z  2024-12-18T00:07:34.9041452Z [12,144 / 15,187] 48 actions, 47 running 2024-12-18T00:07:34.9042357Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:07:34.9043371Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2024-12-18T00:07:34.9044473Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:07:34.9045166Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:07:34.9046071Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 6s local 2024-12-18T00:07:34.9047081Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:07:34.9047987Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 6s local 2024-12-18T00:07:34.9048946Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local ... 2024-12-18T00:07:35.1268515Z 2024-12-18T00:07:35.1269265Z  2024-12-18T00:07:35.1269687Z  2024-12-18T00:07:35.1270062Z  2024-12-18T00:07:35.1270412Z  2024-12-18T00:07:35.1270761Z  2024-12-18T00:07:35.1271092Z  2024-12-18T00:07:35.1271454Z  2024-12-18T00:07:35.1271767Z  2024-12-18T00:07:35.1272257Z [12,148 / 15,187] 48 actions, 47 running 2024-12-18T00:07:35.1272956Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:07:35.1273761Z Compiling xla/service/cpu/in_process_collectives.cc; 18s local 2024-12-18T00:07:35.1274462Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:07:35.1275081Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:07:35.1275870Z Compiling mlir/lib/IR/BuiltinDialectBytecode.cpp [for tool]; 6s local 2024-12-18T00:07:35.1276760Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:07:35.1277578Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 6s local 2024-12-18T00:07:35.1278459Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 6s local ... 2024-12-18T00:07:35.3638668Z 2024-12-18T00:07:35.3639589Z  2024-12-18T00:07:35.3640079Z  2024-12-18T00:07:35.3640499Z  2024-12-18T00:07:35.3640950Z  2024-12-18T00:07:35.3641358Z  2024-12-18T00:07:35.3641750Z  2024-12-18T00:07:35.3642140Z  2024-12-18T00:07:35.3642542Z  2024-12-18T00:07:35.3643133Z [12,163 / 15,187] 48 actions, 47 running 2024-12-18T00:07:35.3644014Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 29s local 2024-12-18T00:07:35.3645148Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:07:35.3645864Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:07:35.3646677Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:07:35.3647607Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 6s local 2024-12-18T00:07:35.3648668Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2024-12-18T00:07:35.3649863Z Compiling external/tsl/.../protobuf/profiler_service.grpc.pb.cc; 5s local 2024-12-18T00:07:35.3650994Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local ... 2024-12-18T00:07:35.6097845Z 2024-12-18T00:07:35.6098716Z  2024-12-18T00:07:35.6099186Z  2024-12-18T00:07:35.6099585Z  2024-12-18T00:07:35.6099977Z  2024-12-18T00:07:35.6100361Z  2024-12-18T00:07:35.6100735Z  2024-12-18T00:07:35.6101116Z  2024-12-18T00:07:35.6101499Z  2024-12-18T00:07:35.6102096Z [12,171 / 15,187] 48 actions, 47 running 2024-12-18T00:07:35.6103245Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 29s local 2024-12-18T00:07:35.6104046Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:07:35.6104756Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:07:35.6105499Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:07:35.6106465Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2024-12-18T00:07:35.6107596Z Compiling external/tsl/.../protobuf/profiler_service.grpc.pb.cc; 6s local 2024-12-18T00:07:35.6108681Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local 2024-12-18T00:07:35.6109606Z Compiling xla/layout.cc; 4s local ... 2024-12-18T00:07:35.8179687Z 2024-12-18T00:07:35.8180539Z  2024-12-18T00:07:35.8181071Z  2024-12-18T00:07:35.8181450Z  2024-12-18T00:07:35.8181848Z  2024-12-18T00:07:35.8182248Z  2024-12-18T00:07:35.8182650Z  2024-12-18T00:07:35.8183005Z  2024-12-18T00:07:35.8183424Z  2024-12-18T00:07:35.8184007Z [12,176 / 15,187] 48 actions, 47 running 2024-12-18T00:07:35.8184883Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 29s local 2024-12-18T00:07:35.8185686Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:07:35.8186401Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:07:35.8187189Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:07:35.8188131Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2024-12-18T00:07:35.8189239Z Compiling external/tsl/.../protobuf/profiler_service.grpc.pb.cc; 6s local 2024-12-18T00:07:35.8190341Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local 2024-12-18T00:07:35.8191057Z Compiling xla/layout.cc; 5s local ... 2024-12-18T00:07:36.0378858Z 2024-12-18T00:07:36.0379741Z  2024-12-18T00:07:36.0380244Z  2024-12-18T00:07:36.0380642Z  2024-12-18T00:07:36.0381058Z  2024-12-18T00:07:36.0381500Z  2024-12-18T00:07:36.0381893Z  2024-12-18T00:07:36.0382288Z  2024-12-18T00:07:36.0382691Z  2024-12-18T00:07:36.0383317Z [12,193 / 15,187] 48 actions, 47 running 2024-12-18T00:07:36.0384003Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:07:36.0384730Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:07:36.0385541Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2024-12-18T00:07:36.0386587Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2024-12-18T00:07:36.0387764Z Compiling external/tsl/.../protobuf/profiler_service.grpc.pb.cc; 6s local 2024-12-18T00:07:36.0388894Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local 2024-12-18T00:07:36.0389754Z Compiling xla/layout.cc; 5s local 2024-12-18T00:07:36.0390601Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 4s local ... 2024-12-18T00:07:36.2387055Z 2024-12-18T00:07:36.2387926Z  2024-12-18T00:07:36.2388405Z  2024-12-18T00:07:36.2388826Z  2024-12-18T00:07:36.2389244Z  2024-12-18T00:07:36.2389668Z  2024-12-18T00:07:36.2390071Z  2024-12-18T00:07:36.2390492Z  2024-12-18T00:07:36.2390896Z  2024-12-18T00:07:36.2391480Z [12,201 / 15,187] 48 actions, 47 running 2024-12-18T00:07:36.2392225Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:07:36.2392883Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:07:36.2393653Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2024-12-18T00:07:36.2395069Z Compiling external/tsl/.../protobuf/profiler_service.grpc.pb.cc; 6s local 2024-12-18T00:07:36.2396267Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:07:36.2397142Z Compiling xla/layout.cc; 5s local 2024-12-18T00:07:36.2398000Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 5s local 2024-12-18T00:07:36.2399177Z Compiling xla/pjrt/layout_mode.cc; 4s local ... 2024-12-18T00:07:36.4607616Z 2024-12-18T00:07:36.4608480Z  2024-12-18T00:07:36.4608949Z  2024-12-18T00:07:36.4609376Z  2024-12-18T00:07:36.4609750Z  2024-12-18T00:07:36.4610129Z  2024-12-18T00:07:36.4610536Z  2024-12-18T00:07:36.4610927Z  2024-12-18T00:07:36.4611333Z  2024-12-18T00:07:36.4611931Z [12,209 / 15,187] 48 actions, 47 running 2024-12-18T00:07:36.4612672Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:07:36.4613426Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:07:36.4614381Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:07:36.4615278Z Compiling xla/layout.cc; 5s local 2024-12-18T00:07:36.4616160Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 5s local 2024-12-18T00:07:36.4617253Z Compiling xla/pjrt/layout_mode.cc; 5s local 2024-12-18T00:07:36.4618109Z Compiling xla/client/executable_build_options.cc; 5s local 2024-12-18T00:07:36.4619129Z Compiling external/xla/xla/pjrt/compile_options.pb.cc; 4s local ... 2024-12-18T00:07:36.6591079Z 2024-12-18T00:07:36.6591950Z  2024-12-18T00:07:36.6592436Z  2024-12-18T00:07:36.6592846Z  2024-12-18T00:07:36.6593205Z  2024-12-18T00:07:36.6593601Z  2024-12-18T00:07:36.6594001Z  2024-12-18T00:07:36.6594423Z  2024-12-18T00:07:36.6594804Z  2024-12-18T00:07:36.6595364Z [12,216 / 15,187] 47 actions, 46 running 2024-12-18T00:07:36.6596110Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:07:36.6596871Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:07:36.6597775Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:07:36.6598880Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 5s local 2024-12-18T00:07:36.6599816Z Compiling xla/pjrt/layout_mode.cc; 5s local 2024-12-18T00:07:36.6600652Z Compiling xla/client/executable_build_options.cc; 5s local 2024-12-18T00:07:36.6601559Z Compiling external/xla/xla/pjrt/compile_options.pb.cc; 5s local 2024-12-18T00:07:36.6602567Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 3s local ... 2024-12-18T00:07:36.8596935Z 2024-12-18T00:07:36.8597811Z  2024-12-18T00:07:36.8598293Z  2024-12-18T00:07:36.8598697Z  2024-12-18T00:07:36.8599112Z  2024-12-18T00:07:36.8599525Z  2024-12-18T00:07:36.8599933Z  2024-12-18T00:07:36.8600335Z  2024-12-18T00:07:36.8600718Z  2024-12-18T00:07:36.8601373Z [12,231 / 15,187] 48 actions, 47 running 2024-12-18T00:07:36.8602131Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:07:36.8603015Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:07:36.8604136Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 5s local 2024-12-18T00:07:36.8605006Z Compiling xla/pjrt/layout_mode.cc; 5s local 2024-12-18T00:07:36.8605800Z Compiling xla/client/executable_build_options.cc; 5s local 2024-12-18T00:07:36.8606760Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 3s local 2024-12-18T00:07:36.8607781Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 3s local 2024-12-18T00:07:36.8608819Z @xla//xla/tsl/protobuf:coordination_service_proto_cc_impl; 3s local ... 2024-12-18T00:07:37.0686007Z 2024-12-18T00:07:37.0686889Z  2024-12-18T00:07:37.0687302Z  2024-12-18T00:07:37.0687695Z  2024-12-18T00:07:37.0688059Z  2024-12-18T00:07:37.0689360Z  2024-12-18T00:07:37.0689714Z  2024-12-18T00:07:37.0690048Z  2024-12-18T00:07:37.0690410Z  2024-12-18T00:07:37.0690953Z [12,246 / 15,187] 48 actions, 47 running 2024-12-18T00:07:37.0691616Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:07:37.0692408Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:07:37.0693492Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 5s local 2024-12-18T00:07:37.0694313Z Compiling xla/pjrt/layout_mode.cc; 5s local 2024-12-18T00:07:37.0695049Z Compiling xla/client/executable_build_options.cc; 5s local 2024-12-18T00:07:37.0695926Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 4s local 2024-12-18T00:07:37.0697021Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 3s local 2024-12-18T00:07:37.0698021Z @xla//xla/tsl/protobuf:coordination_service_proto_cc_impl; 3s local ... 2024-12-18T00:07:37.3032828Z 2024-12-18T00:07:37.3033677Z  2024-12-18T00:07:37.3034083Z  2024-12-18T00:07:37.3034422Z  2024-12-18T00:07:37.3034746Z  2024-12-18T00:07:37.3035087Z  2024-12-18T00:07:37.3035398Z  2024-12-18T00:07:37.3035721Z  2024-12-18T00:07:37.3036048Z  2024-12-18T00:07:37.3036524Z [12,252 / 15,187] 48 actions running 2024-12-18T00:07:37.3037130Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:07:37.3037839Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:07:37.3038770Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:07:37.3039550Z Compiling xla/pjrt/layout_mode.cc; 5s local 2024-12-18T00:07:37.3040236Z Compiling xla/client/executable_build_options.cc; 5s local 2024-12-18T00:07:37.3041088Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 4s local 2024-12-18T00:07:37.3042023Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 4s local 2024-12-18T00:07:37.3043037Z @xla//xla/tsl/protobuf:coordination_service_proto_cc_impl; 4s local ... 2024-12-18T00:07:37.5885403Z 2024-12-18T00:07:37.5886229Z  2024-12-18T00:07:37.5886715Z  2024-12-18T00:07:37.5887121Z  2024-12-18T00:07:37.5887502Z  2024-12-18T00:07:37.5887885Z  2024-12-18T00:07:37.5888276Z  2024-12-18T00:07:37.5888669Z  2024-12-18T00:07:37.5889065Z  2024-12-18T00:07:37.5889708Z [12,255 / 15,187] 48 actions, 47 running 2024-12-18T00:07:37.5890464Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:07:37.5891361Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:07:37.5892514Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:07:37.5893462Z Compiling xla/pjrt/layout_mode.cc; 6s local 2024-12-18T00:07:37.5894244Z Compiling xla/client/executable_build_options.cc; 6s local 2024-12-18T00:07:37.5895173Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 4s local 2024-12-18T00:07:37.5896224Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 4s local 2024-12-18T00:07:37.5897444Z @xla//xla/tsl/protobuf:coordination_service_proto_cc_impl; 4s local ... 2024-12-18T00:07:37.8270431Z 2024-12-18T00:07:37.8271282Z  2024-12-18T00:07:37.8271754Z  2024-12-18T00:07:37.8272171Z  2024-12-18T00:07:37.8272558Z  2024-12-18T00:07:37.8272967Z  2024-12-18T00:07:37.8273323Z  2024-12-18T00:07:37.8273714Z  2024-12-18T00:07:37.8274105Z  2024-12-18T00:07:37.8274681Z [12,260 / 15,187] 48 actions, 47 running 2024-12-18T00:07:37.8275408Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:07:37.8276283Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:07:37.8277323Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:07:37.8278235Z Compiling xla/pjrt/layout_mode.cc; 6s local 2024-12-18T00:07:37.8279396Z Compiling xla/client/executable_build_options.cc; 6s local 2024-12-18T00:07:37.8280331Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 4s local 2024-12-18T00:07:37.8281340Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 4s local 2024-12-18T00:07:37.8282376Z @xla//xla/tsl/protobuf:coordination_service_proto_cc_impl; 4s local ... 2024-12-18T00:07:38.0382710Z 2024-12-18T00:07:38.0384181Z  2024-12-18T00:07:38.0384937Z  2024-12-18T00:07:38.0385600Z  2024-12-18T00:07:38.0386597Z  2024-12-18T00:07:38.0387067Z  2024-12-18T00:07:38.0387449Z  2024-12-18T00:07:38.0387824Z  2024-12-18T00:07:38.0388197Z  2024-12-18T00:07:38.0388906Z [12,267 / 15,187] 48 actions, 47 running 2024-12-18T00:07:38.0389582Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:07:38.0390411Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:07:38.0391460Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:07:38.0392565Z Compiling xla/pjrt/layout_mode.cc; 6s local 2024-12-18T00:07:38.0393292Z Compiling xla/client/executable_build_options.cc; 6s local 2024-12-18T00:07:38.0394146Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 5s local 2024-12-18T00:07:38.0395192Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 4s local 2024-12-18T00:07:38.0396220Z @xla//xla/tsl/protobuf:coordination_service_proto_cc_impl; 4s local ... 2024-12-18T00:07:38.2465426Z 2024-12-18T00:07:38.2466945Z  2024-12-18T00:07:38.2467445Z  2024-12-18T00:07:38.2467885Z  2024-12-18T00:07:38.2468291Z  2024-12-18T00:07:38.2468696Z  2024-12-18T00:07:38.2469101Z  2024-12-18T00:07:38.2469513Z  2024-12-18T00:07:38.2469929Z  2024-12-18T00:07:38.2470613Z [12,275 / 15,187] 48 actions, 47 running 2024-12-18T00:07:38.2471418Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:07:38.2472350Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 8s local 2024-12-18T00:07:38.2473458Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:07:38.2474437Z Compiling xla/pjrt/layout_mode.cc; 6s local 2024-12-18T00:07:38.2475248Z Compiling xla/client/executable_build_options.cc; 6s local 2024-12-18T00:07:38.2476072Z Compiling xla/tsl/distributed_runtime/rpc/grpc_util.cc; 5s local 2024-12-18T00:07:38.2476952Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 4s local 2024-12-18T00:07:38.2478051Z @xla//xla/tsl/protobuf:coordination_service_proto_cc_impl; 4s local ... 2024-12-18T00:07:38.4971111Z 2024-12-18T00:07:38.4971963Z  2024-12-18T00:07:38.4972428Z  2024-12-18T00:07:38.4972825Z  2024-12-18T00:07:38.4973213Z  2024-12-18T00:07:38.4973591Z  2024-12-18T00:07:38.4973991Z  2024-12-18T00:07:38.4974395Z  2024-12-18T00:07:38.4974787Z  2024-12-18T00:07:38.4975400Z [12,287 / 15,187] 48 actions, 47 running 2024-12-18T00:07:38.4976146Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:07:38.4977207Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:07:38.4978017Z Compiling xla/pjrt/layout_mode.cc; 7s local 2024-12-18T00:07:38.4978745Z Compiling xla/client/executable_build_options.cc; 7s local 2024-12-18T00:07:38.4979738Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 5s local 2024-12-18T00:07:38.4980816Z Compiling external/xla/.../protobuf/coordination_service.pb.cc; 5s local 2024-12-18T00:07:38.4981957Z Compiling src/cpp/server/health/default_health_check_service.cc; 3s local 2024-12-18T00:07:38.4982953Z Compiling src/cpp/server/server_cc.cc; 3s local ... 2024-12-18T00:07:38.7042753Z 2024-12-18T00:07:38.7043599Z  2024-12-18T00:07:38.7044104Z  2024-12-18T00:07:38.7044815Z  2024-12-18T00:07:38.7045216Z  2024-12-18T00:07:38.7045636Z  2024-12-18T00:07:38.7046408Z  2024-12-18T00:07:38.7046811Z  2024-12-18T00:07:38.7047204Z  2024-12-18T00:07:38.7047788Z [12,290 / 15,187] 48 actions running 2024-12-18T00:07:38.7048533Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:07:38.7049477Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:07:38.7050627Z Compiling xla/pjrt/layout_mode.cc; 7s local 2024-12-18T00:07:38.7051451Z Compiling xla/client/executable_build_options.cc; 7s local 2024-12-18T00:07:38.7052400Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 5s local 2024-12-18T00:07:38.7053491Z Compiling src/cpp/server/health/default_health_check_service.cc; 3s local 2024-12-18T00:07:38.7054404Z Compiling src/cpp/server/server_cc.cc; 3s local 2024-12-18T00:07:38.7055224Z Compiling xla/hlo/builder/lib/broadcast.cc; 3s local ... 2024-12-18T00:07:38.9207247Z 2024-12-18T00:07:38.9208118Z  2024-12-18T00:07:38.9208604Z  2024-12-18T00:07:38.9209032Z  2024-12-18T00:07:38.9209426Z  2024-12-18T00:07:38.9209804Z  2024-12-18T00:07:38.9210203Z  2024-12-18T00:07:38.9210596Z  2024-12-18T00:07:38.9210985Z  2024-12-18T00:07:38.9211572Z [12,307 / 15,187] 48 actions, 47 running 2024-12-18T00:07:38.9212297Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:07:38.9213050Z Compiling xla/pjrt/layout_mode.cc; 7s local 2024-12-18T00:07:38.9213823Z Compiling xla/client/executable_build_options.cc; 7s local 2024-12-18T00:07:38.9214779Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 5s local 2024-12-18T00:07:38.9215913Z Compiling src/cpp/server/health/default_health_check_service.cc; 3s local 2024-12-18T00:07:38.9217022Z Compiling src/cpp/server/server_cc.cc; 3s local 2024-12-18T00:07:38.9217791Z Compiling xla/hlo/builder/lib/broadcast.cc; 3s local 2024-12-18T00:07:38.9218675Z @com_github_grpc_grpc//:grpc_lb_policy_grpclb_secure; 2s local ... 2024-12-18T00:07:39.1617958Z 2024-12-18T00:07:39.1618821Z  2024-12-18T00:07:39.1619323Z  2024-12-18T00:07:39.1619714Z  2024-12-18T00:07:39.1620121Z  2024-12-18T00:07:39.1620530Z  2024-12-18T00:07:39.1620940Z  2024-12-18T00:07:39.1621329Z  2024-12-18T00:07:39.1621732Z  2024-12-18T00:07:39.1622474Z [12,325 / 15,187] 48 actions, 47 running 2024-12-18T00:07:39.1623292Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:07:39.1624043Z Compiling xla/pjrt/layout_mode.cc; 7s local 2024-12-18T00:07:39.1624892Z Compiling xla/client/executable_build_options.cc; 7s local 2024-12-18T00:07:39.1625960Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 5s local 2024-12-18T00:07:39.1627343Z Compiling src/cpp/server/health/default_health_check_service.cc; 3s local 2024-12-18T00:07:39.1628357Z Compiling src/cpp/server/server_cc.cc; 3s local 2024-12-18T00:07:39.1629150Z Compiling xla/hlo/builder/lib/broadcast.cc; 3s local 2024-12-18T00:07:39.1630040Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 2s local ... 2024-12-18T00:07:39.3663594Z 2024-12-18T00:07:39.3664338Z  2024-12-18T00:07:39.3664647Z  2024-12-18T00:07:39.3664887Z  2024-12-18T00:07:39.3665140Z  2024-12-18T00:07:39.3665383Z  2024-12-18T00:07:39.3673245Z  2024-12-18T00:07:39.3673566Z  2024-12-18T00:07:39.3673864Z  2024-12-18T00:07:39.3674244Z [12,336 / 15,187] 47 actions, 46 running 2024-12-18T00:07:39.3674674Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:07:39.3675113Z Compiling xla/pjrt/layout_mode.cc; 8s local 2024-12-18T00:07:39.3675594Z Compiling xla/client/executable_build_options.cc; 8s local 2024-12-18T00:07:39.3676169Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 6s local 2024-12-18T00:07:39.3676813Z Compiling src/cpp/server/health/default_health_check_service.cc; 4s local 2024-12-18T00:07:39.3677363Z Compiling src/cpp/server/server_cc.cc; 4s local 2024-12-18T00:07:39.3678068Z Compiling xla/hlo/builder/lib/broadcast.cc; 4s local 2024-12-18T00:07:39.3678582Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 2s local ... 2024-12-18T00:07:39.6499150Z 2024-12-18T00:07:39.6500068Z  2024-12-18T00:07:39.6500614Z  2024-12-18T00:07:39.6501042Z  2024-12-18T00:07:39.6501419Z  2024-12-18T00:07:39.6502209Z  2024-12-18T00:07:39.6502657Z  2024-12-18T00:07:39.6503068Z  2024-12-18T00:07:39.6503477Z  2024-12-18T00:07:39.6504094Z [12,342 / 15,187] 48 actions, 47 running 2024-12-18T00:07:39.6504880Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:07:39.6505610Z Compiling xla/pjrt/layout_mode.cc; 8s local 2024-12-18T00:07:39.6506416Z Compiling xla/client/executable_build_options.cc; 8s local 2024-12-18T00:07:39.6507395Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 6s local 2024-12-18T00:07:39.6508559Z Compiling src/cpp/server/health/default_health_check_service.cc; 4s local 2024-12-18T00:07:39.6509600Z Compiling src/cpp/server/server_cc.cc; 4s local 2024-12-18T00:07:39.6510389Z Compiling xla/hlo/builder/lib/broadcast.cc; 4s local 2024-12-18T00:07:39.6511249Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 3s local ... 2024-12-18T00:07:39.8640979Z 2024-12-18T00:07:39.8641903Z  2024-12-18T00:07:39.8642417Z  2024-12-18T00:07:39.8642827Z  2024-12-18T00:07:39.8643352Z  2024-12-18T00:07:39.8643764Z  2024-12-18T00:07:39.8644146Z  2024-12-18T00:07:39.8644949Z  2024-12-18T00:07:39.8645369Z  2024-12-18T00:07:39.8645998Z [12,365 / 15,187] 48 actions, 47 running 2024-12-18T00:07:39.8646753Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:07:39.8647478Z Compiling xla/pjrt/layout_mode.cc; 8s local 2024-12-18T00:07:39.8648267Z Compiling xla/client/executable_build_options.cc; 8s local 2024-12-18T00:07:39.8649294Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 6s local 2024-12-18T00:07:39.8650234Z Compiling src/cpp/server/server_cc.cc; 4s local 2024-12-18T00:07:39.8651045Z Compiling xla/hlo/builder/lib/broadcast.cc; 4s local 2024-12-18T00:07:39.8651897Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 3s local 2024-12-18T00:07:39.8652686Z Compiling xla/index_util.cc; 3s local ... 2024-12-18T00:07:40.0704483Z 2024-12-18T00:07:40.0705486Z  2024-12-18T00:07:40.0705959Z  2024-12-18T00:07:40.0706368Z  2024-12-18T00:07:40.0706773Z  2024-12-18T00:07:40.0707193Z  2024-12-18T00:07:40.0707580Z  2024-12-18T00:07:40.0707980Z  2024-12-18T00:07:40.0708369Z  2024-12-18T00:07:40.0708984Z [12,375 / 15,187] 47 actions, 46 running 2024-12-18T00:07:40.0709738Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:07:40.0710418Z Compiling xla/pjrt/layout_mode.cc; 8s local 2024-12-18T00:07:40.0711206Z Compiling xla/client/executable_build_options.cc; 8s local 2024-12-18T00:07:40.0712242Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 6s local 2024-12-18T00:07:40.0713145Z Compiling src/cpp/server/server_cc.cc; 4s local 2024-12-18T00:07:40.0713931Z Compiling xla/hlo/builder/lib/broadcast.cc; 4s local 2024-12-18T00:07:40.0714750Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 3s local 2024-12-18T00:07:40.0715526Z Compiling xla/index_util.cc; 3s local ... 2024-12-18T00:07:40.2705096Z 2024-12-18T00:07:40.2706004Z  2024-12-18T00:07:40.2706489Z  2024-12-18T00:07:40.2706898Z  2024-12-18T00:07:40.2707292Z  2024-12-18T00:07:40.2707702Z  2024-12-18T00:07:40.2708071Z  2024-12-18T00:07:40.2708450Z  2024-12-18T00:07:40.2708861Z  2024-12-18T00:07:40.2709443Z [12,390 / 15,187] 48 actions, 47 running 2024-12-18T00:07:40.2710184Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:07:40.2710939Z Compiling xla/pjrt/layout_mode.cc; 8s local 2024-12-18T00:07:40.2712069Z Compiling xla/client/executable_build_options.cc; 8s local 2024-12-18T00:07:40.2713250Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 6s local 2024-12-18T00:07:40.2714153Z Compiling src/cpp/server/server_cc.cc; 5s local 2024-12-18T00:07:40.2715145Z Compiling xla/hlo/builder/lib/broadcast.cc; 4s local 2024-12-18T00:07:40.2716082Z Compiling xla/index_util.cc; 3s local 2024-12-18T00:07:40.2716956Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 2s local ... 2024-12-18T00:07:40.4885726Z 2024-12-18T00:07:40.4886624Z  2024-12-18T00:07:40.4887121Z  2024-12-18T00:07:40.4887544Z  2024-12-18T00:07:40.4887943Z  2024-12-18T00:07:40.4888354Z  2024-12-18T00:07:40.4888760Z  2024-12-18T00:07:40.4889161Z  2024-12-18T00:07:40.4889516Z  2024-12-18T00:07:40.4890125Z [12,401 / 15,187] 48 actions, 47 running 2024-12-18T00:07:40.4890881Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:07:40.4891651Z Compiling xla/pjrt/layout_mode.cc; 9s local 2024-12-18T00:07:40.4892448Z Compiling xla/client/executable_build_options.cc; 9s local 2024-12-18T00:07:40.4893451Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local 2024-12-18T00:07:40.4894356Z Compiling src/cpp/server/server_cc.cc; 5s local 2024-12-18T00:07:40.4895187Z Compiling xla/hlo/builder/lib/broadcast.cc; 5s local 2024-12-18T00:07:40.4895920Z Compiling xla/index_util.cc; 3s local 2024-12-18T00:07:40.4896886Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 3s local ... 2024-12-18T00:07:40.6988207Z 2024-12-18T00:07:40.6989070Z  2024-12-18T00:07:40.6989544Z  2024-12-18T00:07:40.6989922Z  2024-12-18T00:07:40.6990290Z  2024-12-18T00:07:40.6990685Z  2024-12-18T00:07:40.6991052Z  2024-12-18T00:07:40.6991437Z  2024-12-18T00:07:40.6991807Z  2024-12-18T00:07:40.6992388Z [12,406 / 15,187] 48 actions, 47 running 2024-12-18T00:07:40.6993125Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:07:40.6993843Z Compiling xla/pjrt/layout_mode.cc; 9s local 2024-12-18T00:07:40.6994701Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local 2024-12-18T00:07:40.6995633Z Compiling xla/hlo/builder/lib/broadcast.cc; 5s local 2024-12-18T00:07:40.6996327Z Compiling xla/index_util.cc; 4s local 2024-12-18T00:07:40.6997140Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 3s local 2024-12-18T00:07:40.6997940Z @llvm-project//llvm:llvm-tblgen; 1s local 2024-12-18T00:07:40.6998664Z @com_github_grpc_grpc//:grpc_client_channel; 1s local ... 2024-12-18T00:07:40.9057054Z 2024-12-18T00:07:40.9058188Z  2024-12-18T00:07:40.9058676Z  2024-12-18T00:07:40.9059050Z  2024-12-18T00:07:40.9059465Z  2024-12-18T00:07:40.9059800Z  2024-12-18T00:07:40.9060156Z  2024-12-18T00:07:40.9060483Z  2024-12-18T00:07:40.9060850Z  2024-12-18T00:07:40.9061395Z [12,411 / 15,187] 48 actions running 2024-12-18T00:07:40.9062108Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:07:40.9062839Z Compiling xla/pjrt/layout_mode.cc; 9s local 2024-12-18T00:07:40.9063659Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local 2024-12-18T00:07:40.9064643Z Compiling xla/hlo/builder/lib/broadcast.cc; 5s local 2024-12-18T00:07:40.9065378Z Compiling xla/index_util.cc; 4s local 2024-12-18T00:07:40.9066166Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 3s local 2024-12-18T00:07:40.9067001Z @llvm-project//llvm:llvm-tblgen; 2s local 2024-12-18T00:07:40.9067774Z @com_github_grpc_grpc//:grpc_client_channel; 1s local ... 2024-12-18T00:07:41.1065148Z 2024-12-18T00:07:41.1066048Z  2024-12-18T00:07:41.1066512Z  2024-12-18T00:07:41.1066929Z  2024-12-18T00:07:41.1067335Z  2024-12-18T00:07:41.1067750Z  2024-12-18T00:07:41.1068130Z  2024-12-18T00:07:41.1068542Z  2024-12-18T00:07:41.1069595Z  2024-12-18T00:07:41.1070184Z [12,419 / 15,187] 48 actions running 2024-12-18T00:07:41.1070934Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:07:41.1071652Z Compiling xla/pjrt/layout_mode.cc; 9s local 2024-12-18T00:07:41.1072555Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local 2024-12-18T00:07:41.1073541Z Compiling xla/hlo/builder/lib/broadcast.cc; 5s local 2024-12-18T00:07:41.1074283Z Compiling xla/index_util.cc; 4s local 2024-12-18T00:07:41.1075075Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 3s local 2024-12-18T00:07:41.1075865Z @llvm-project//llvm:llvm-tblgen; 2s local 2024-12-18T00:07:41.1076590Z @com_github_grpc_grpc//:grpc_client_channel; 2s local ... 2024-12-18T00:07:41.3184379Z 2024-12-18T00:07:41.3185203Z  2024-12-18T00:07:41.3185691Z  2024-12-18T00:07:41.3186101Z  2024-12-18T00:07:41.3186510Z  2024-12-18T00:07:41.3186920Z  2024-12-18T00:07:41.3187345Z  2024-12-18T00:07:41.3187747Z  2024-12-18T00:07:41.3188138Z  2024-12-18T00:07:41.3188748Z [12,438 / 15,187] 48 actions, 47 running 2024-12-18T00:07:41.3189422Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:07:41.3190187Z Compiling xla/pjrt/layout_mode.cc; 9s local 2024-12-18T00:07:41.3191099Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2024-12-18T00:07:41.3192047Z Compiling xla/hlo/builder/lib/broadcast.cc; 6s local 2024-12-18T00:07:41.3192928Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 3s local 2024-12-18T00:07:41.3193756Z @llvm-project//llvm:llvm-tblgen; 2s local 2024-12-18T00:07:41.3194666Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 2s local 2024-12-18T00:07:41.3195711Z @com_github_grpc_grpc//:grpc_client_channel; 1s local ... 2024-12-18T00:07:41.5378083Z 2024-12-18T00:07:41.5378965Z  2024-12-18T00:07:41.5379431Z  2024-12-18T00:07:41.5379875Z  2024-12-18T00:07:41.5380254Z  2024-12-18T00:07:41.5380634Z  2024-12-18T00:07:41.5381037Z  2024-12-18T00:07:41.5381415Z  2024-12-18T00:07:41.5381838Z  2024-12-18T00:07:41.5382302Z [12,463 / 15,187] 48 actions, 47 running 2024-12-18T00:07:41.5383028Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:07:41.5383765Z Compiling xla/pjrt/layout_mode.cc; 10s local 2024-12-18T00:07:41.5384643Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2024-12-18T00:07:41.5385581Z Compiling xla/hlo/builder/lib/broadcast.cc; 6s local 2024-12-18T00:07:41.5386432Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 4s local 2024-12-18T00:07:41.5387257Z @llvm-project//llvm:llvm-tblgen; 2s local 2024-12-18T00:07:41.5388176Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 2s local 2024-12-18T00:07:41.5389338Z Compiling src/core/ext/filters/client_channel/subchannel.cc; 1s local ... 2024-12-18T00:07:41.7644629Z 2024-12-18T00:07:41.7645461Z  2024-12-18T00:07:41.7645971Z  2024-12-18T00:07:41.7646402Z  2024-12-18T00:07:41.7646740Z  2024-12-18T00:07:41.7647136Z  2024-12-18T00:07:41.7647499Z  2024-12-18T00:07:41.7647891Z  2024-12-18T00:07:41.7648295Z  2024-12-18T00:07:41.7648883Z [12,472 / 15,187] 48 actions, 47 running 2024-12-18T00:07:41.7649645Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:07:41.7650349Z Compiling xla/pjrt/layout_mode.cc; 10s local 2024-12-18T00:07:41.7651222Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2024-12-18T00:07:41.7652198Z Compiling xla/hlo/builder/lib/broadcast.cc; 6s local 2024-12-18T00:07:41.7653102Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 4s local 2024-12-18T00:07:41.7653939Z @llvm-project//llvm:llvm-tblgen; 3s local 2024-12-18T00:07:41.7654905Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 2s local 2024-12-18T00:07:41.7656331Z @com_github_grpc_grpc//:grpc_transport_chttp2; 1s local ... 2024-12-18T00:07:42.0172475Z 2024-12-18T00:07:42.0173289Z  2024-12-18T00:07:42.0173754Z  2024-12-18T00:07:42.0174115Z  2024-12-18T00:07:42.0174493Z  2024-12-18T00:07:42.0174870Z  2024-12-18T00:07:42.0175238Z  2024-12-18T00:07:42.0175602Z  2024-12-18T00:07:42.0175946Z  2024-12-18T00:07:42.0176981Z [12,489 / 15,187] 48 actions, 47 running 2024-12-18T00:07:42.0177643Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:07:42.0178281Z Compiling xla/pjrt/layout_mode.cc; 10s local 2024-12-18T00:07:42.0179080Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2024-12-18T00:07:42.0179898Z Compiling xla/hlo/builder/lib/broadcast.cc; 6s local 2024-12-18T00:07:42.0180674Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 4s local 2024-12-18T00:07:42.0181395Z @llvm-project//llvm:llvm-tblgen; 3s local 2024-12-18T00:07:42.0182271Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 2s local 2024-12-18T00:07:42.0183298Z @com_github_grpc_grpc//:grpc_transport_chttp2; 2s local ... 2024-12-18T00:07:42.2226666Z 2024-12-18T00:07:42.2227543Z  2024-12-18T00:07:42.2228004Z  2024-12-18T00:07:42.2228396Z  2024-12-18T00:07:42.2228776Z  2024-12-18T00:07:42.2229163Z  2024-12-18T00:07:42.2229608Z  2024-12-18T00:07:42.2230017Z  2024-12-18T00:07:42.2230438Z  2024-12-18T00:07:42.2231048Z [12,512 / 15,187] 48 actions, 47 running 2024-12-18T00:07:42.2231786Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:07:42.2232495Z Compiling xla/pjrt/layout_mode.cc; 10s local 2024-12-18T00:07:42.2233373Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2024-12-18T00:07:42.2234287Z Compiling xla/hlo/builder/lib/broadcast.cc; 6s local 2024-12-18T00:07:42.2235139Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 4s local 2024-12-18T00:07:42.2235986Z @llvm-project//llvm:llvm-tblgen; 3s local 2024-12-18T00:07:42.2236873Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2024-12-18T00:07:42.2237885Z @com_github_grpc_grpc//:grpc_transport_chttp2; 2s local ... 2024-12-18T00:07:42.4198303Z 2024-12-18T00:07:42.4199159Z  2024-12-18T00:07:42.4199719Z  2024-12-18T00:07:42.4200083Z  2024-12-18T00:07:42.4200511Z  2024-12-18T00:07:42.4200872Z  2024-12-18T00:07:42.4201249Z  2024-12-18T00:07:42.4201621Z  2024-12-18T00:07:42.4202022Z  2024-12-18T00:07:42.4202700Z [12,522 / 15,187] 47 actions, 46 running 2024-12-18T00:07:42.4203411Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:07:42.4204309Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2024-12-18T00:07:42.4205251Z Compiling xla/hlo/builder/lib/broadcast.cc; 7s local 2024-12-18T00:07:42.4206114Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 5s local 2024-12-18T00:07:42.4206938Z @llvm-project//llvm:llvm-tblgen; 3s local 2024-12-18T00:07:42.4207845Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2024-12-18T00:07:42.4208781Z Compiling xla/service/name_uniquer.cc; 1s local 2024-12-18T00:07:42.4209591Z Compiling src/core/lib/iomgr/ev_epollex_linux.cc; 1s local ... 2024-12-18T00:07:42.6332009Z 2024-12-18T00:07:42.6332926Z  2024-12-18T00:07:42.6333412Z  2024-12-18T00:07:42.6333801Z  2024-12-18T00:07:42.6334195Z  2024-12-18T00:07:42.6334605Z  2024-12-18T00:07:42.6335024Z  2024-12-18T00:07:42.6335445Z  2024-12-18T00:07:42.6335846Z  2024-12-18T00:07:42.6336611Z [12,533 / 15,187] 48 actions, 47 running 2024-12-18T00:07:42.6337343Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:07:42.6338194Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2024-12-18T00:07:42.6339068Z Compiling xla/hlo/builder/lib/broadcast.cc; 7s local 2024-12-18T00:07:42.6340245Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 5s local 2024-12-18T00:07:42.6341015Z @llvm-project//llvm:llvm-tblgen; 3s local 2024-12-18T00:07:42.6341876Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2024-12-18T00:07:42.6342792Z Compiling xla/service/name_uniquer.cc; 1s local 2024-12-18T00:07:42.6343857Z Compiling src/core/lib/iomgr/resource_quota.cc; 0s local ... 2024-12-18T00:07:42.8359708Z 2024-12-18T00:07:42.8360699Z  2024-12-18T00:07:42.8361196Z  2024-12-18T00:07:42.8361628Z  2024-12-18T00:07:42.8362041Z  2024-12-18T00:07:42.8362472Z  2024-12-18T00:07:42.8362896Z  2024-12-18T00:07:42.8363313Z  2024-12-18T00:07:42.8363724Z  2024-12-18T00:07:42.8364348Z [12,546 / 15,187] 48 actions, 47 running 2024-12-18T00:07:42.8365094Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:07:42.8366235Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2024-12-18T00:07:42.8367227Z Compiling xla/hlo/builder/lib/broadcast.cc; 7s local 2024-12-18T00:07:42.8368201Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 5s local 2024-12-18T00:07:42.8369125Z @llvm-project//llvm:llvm-tblgen; 4s local 2024-12-18T00:07:42.8369936Z Compiling xla/service/name_uniquer.cc; 1s local 2024-12-18T00:07:42.8370872Z Compiling src/core/lib/iomgr/tcp_posix.cc; 0s local 2024-12-18T00:07:42.8371880Z Compiling src/core/lib/iomgr/tcp_server_custom.cc; 0s local ... 2024-12-18T00:07:43.0446093Z 2024-12-18T00:07:43.0447117Z  2024-12-18T00:07:43.0447586Z  2024-12-18T00:07:43.0447993Z  2024-12-18T00:07:43.0448429Z  2024-12-18T00:07:43.0448831Z  2024-12-18T00:07:43.0449248Z  2024-12-18T00:07:43.0449621Z  2024-12-18T00:07:43.0450030Z  2024-12-18T00:07:43.0450634Z [12,575 / 15,187] 48 actions, 47 running 2024-12-18T00:07:43.0451359Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:07:43.0452318Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2024-12-18T00:07:43.0453282Z Compiling xla/hlo/builder/lib/broadcast.cc; 7s local 2024-12-18T00:07:43.0454181Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 5s local 2024-12-18T00:07:43.0455007Z @llvm-project//llvm:llvm-tblgen; 4s local 2024-12-18T00:07:43.0455763Z Compiling xla/service/name_uniquer.cc; 1s local 2024-12-18T00:07:43.0456713Z Compiling src/core/lib/iomgr/tcp_posix.cc; 1s local 2024-12-18T00:07:43.0457599Z Compiling src/core/lib/iomgr/timer_generic.cc; 0s local ... 2024-12-18T00:07:43.2482943Z 2024-12-18T00:07:43.2484175Z  2024-12-18T00:07:43.2484730Z  2024-12-18T00:07:43.2485217Z  2024-12-18T00:07:43.2485686Z  2024-12-18T00:07:43.2486087Z  2024-12-18T00:07:43.2486472Z  2024-12-18T00:07:43.2486886Z  2024-12-18T00:07:43.2487361Z  2024-12-18T00:07:43.2487947Z [12,602 / 15,187] 48 actions, 47 running 2024-12-18T00:07:43.2488766Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:07:43.2489705Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2024-12-18T00:07:43.2490621Z Compiling xla/hlo/builder/lib/broadcast.cc; 7s local 2024-12-18T00:07:43.2491542Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 5s local 2024-12-18T00:07:43.2492420Z @llvm-project//llvm:llvm-tblgen; 4s local 2024-12-18T00:07:43.2493086Z Compiling xla/service/name_uniquer.cc; 2s local 2024-12-18T00:07:43.2493799Z Compiling src/core/lib/iomgr/tcp_posix.cc; 1s local 2024-12-18T00:07:43.2494603Z Compiling src/core/lib/surface/call.cc; 0s local ... 2024-12-18T00:07:43.4600928Z 2024-12-18T00:07:43.4601985Z  2024-12-18T00:07:43.4602504Z  2024-12-18T00:07:43.4602929Z  2024-12-18T00:07:43.4603310Z  2024-12-18T00:07:43.4603701Z  2024-12-18T00:07:43.4604124Z  2024-12-18T00:07:43.4604539Z  2024-12-18T00:07:43.4605311Z  2024-12-18T00:07:43.4605913Z [12,616 / 15,187] 48 actions, 47 running 2024-12-18T00:07:43.4606607Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:07:43.4607524Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:07:43.4608504Z Compiling xla/hlo/builder/lib/broadcast.cc; 8s local 2024-12-18T00:07:43.4609651Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 6s local 2024-12-18T00:07:43.4610475Z @llvm-project//llvm:llvm-tblgen; 4s local 2024-12-18T00:07:43.4611221Z Compiling xla/service/name_uniquer.cc; 2s local 2024-12-18T00:07:43.4611997Z Compiling src/core/lib/surface/call.cc; 1s local 2024-12-18T00:07:43.4612829Z Compiling src/core/lib/surface/channel.cc; 1s local ... 2024-12-18T00:07:43.6733257Z 2024-12-18T00:07:43.6734262Z  2024-12-18T00:07:43.6734778Z  2024-12-18T00:07:43.6735199Z  2024-12-18T00:07:43.6735578Z  2024-12-18T00:07:43.6736003Z  2024-12-18T00:07:43.6736547Z  2024-12-18T00:07:43.6736960Z  2024-12-18T00:07:43.6737353Z  2024-12-18T00:07:43.6737950Z [12,624 / 15,187] 47 actions, 46 running 2024-12-18T00:07:43.6738717Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2024-12-18T00:07:43.6739655Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:07:43.6740659Z Compiling xla/hlo/builder/lib/broadcast.cc; 8s local 2024-12-18T00:07:43.6741528Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 6s local 2024-12-18T00:07:43.6742302Z @llvm-project//llvm:llvm-tblgen; 4s local 2024-12-18T00:07:43.6742966Z Compiling xla/service/name_uniquer.cc; 2s local 2024-12-18T00:07:43.6743702Z Compiling src/core/lib/surface/call.cc; 1s local 2024-12-18T00:07:43.6744873Z Compiling src/core/lib/surface/completion_queue.cc; 1s local ... 2024-12-18T00:07:43.8742251Z 2024-12-18T00:07:43.8745557Z  2024-12-18T00:07:43.8746482Z  2024-12-18T00:07:43.8749199Z  2024-12-18T00:07:43.8749607Z  2024-12-18T00:07:43.8750017Z  2024-12-18T00:07:43.8750354Z  2024-12-18T00:07:43.8750753Z  2024-12-18T00:07:43.8751166Z  2024-12-18T00:07:43.8751774Z [12,629 / 15,187] 48 actions, 47 running 2024-12-18T00:07:43.8752521Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2024-12-18T00:07:43.8753444Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:07:43.8754390Z Compiling xla/hlo/builder/lib/broadcast.cc; 8s local 2024-12-18T00:07:43.8755264Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 6s local 2024-12-18T00:07:43.8756047Z @llvm-project//llvm:llvm-tblgen; 5s local 2024-12-18T00:07:43.8756757Z Compiling xla/service/name_uniquer.cc; 2s local 2024-12-18T00:07:43.8757512Z Compiling src/core/lib/surface/call.cc; 1s local 2024-12-18T00:07:43.8758380Z Compiling src/core/lib/surface/completion_queue.cc; 1s local ... 2024-12-18T00:07:44.0797988Z 2024-12-18T00:07:44.0798811Z  2024-12-18T00:07:44.0799244Z  2024-12-18T00:07:44.0799597Z  2024-12-18T00:07:44.0799944Z  2024-12-18T00:07:44.0800300Z  2024-12-18T00:07:44.0800656Z  2024-12-18T00:07:44.0801007Z  2024-12-18T00:07:44.0801370Z  2024-12-18T00:07:44.0801914Z [12,641 / 15,187] 48 actions, 47 running 2024-12-18T00:07:44.0802594Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2024-12-18T00:07:44.0803409Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:07:44.0804293Z Compiling xla/hlo/builder/lib/broadcast.cc; 8s local 2024-12-18T00:07:44.0805080Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 6s local 2024-12-18T00:07:44.0805820Z @llvm-project//llvm:llvm-tblgen; 5s local 2024-12-18T00:07:44.0806454Z Compiling xla/service/name_uniquer.cc; 2s local 2024-12-18T00:07:44.0807142Z Compiling src/core/lib/surface/server.cc; 1s local 2024-12-18T00:07:44.0807948Z Compiling src/core/lib/transport/static_metadata.cc; 1s local ... 2024-12-18T00:07:44.2834150Z 2024-12-18T00:07:44.2834903Z  2024-12-18T00:07:44.2835342Z  2024-12-18T00:07:44.2835686Z  2024-12-18T00:07:44.2836061Z  2024-12-18T00:07:44.2836429Z  2024-12-18T00:07:44.2836805Z  2024-12-18T00:07:44.2837168Z  2024-12-18T00:07:44.2837505Z  2024-12-18T00:07:44.2838400Z [12,664 / 15,187] 48 actions, 47 running 2024-12-18T00:07:44.2839213Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:07:44.2840056Z Compiling xla/hlo/builder/lib/broadcast.cc; 8s local 2024-12-18T00:07:44.2840853Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 6s local 2024-12-18T00:07:44.2841589Z @llvm-project//llvm:llvm-tblgen; 5s local 2024-12-18T00:07:44.2842213Z Compiling xla/service/name_uniquer.cc; 3s local 2024-12-18T00:07:44.2842982Z Compiling src/core/lib/transport/static_metadata.cc; 1s local 2024-12-18T00:07:44.2843786Z Compiling src/ssl/encrypted_client_hello.cc; 1s local 2024-12-18T00:07:44.2844738Z Compiling src/ssl/extensions.cc; 1s local ... 2024-12-18T00:07:44.4826675Z 2024-12-18T00:07:44.4827529Z  2024-12-18T00:07:44.4827975Z  2024-12-18T00:07:44.4828337Z  2024-12-18T00:07:44.4828680Z  2024-12-18T00:07:44.4829055Z  2024-12-18T00:07:44.4829445Z  2024-12-18T00:07:44.4829808Z  2024-12-18T00:07:44.4830246Z  2024-12-18T00:07:44.4830851Z [12,704 / 15,187] 48 actions, 47 running 2024-12-18T00:07:44.4831698Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:07:44.4832614Z Compiling xla/hlo/builder/lib/broadcast.cc; 9s local 2024-12-18T00:07:44.4833458Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 7s local 2024-12-18T00:07:44.4834239Z @llvm-project//llvm:llvm-tblgen; 5s local 2024-12-18T00:07:44.4834924Z Compiling xla/service/name_uniquer.cc; 3s local 2024-12-18T00:07:44.4835764Z Compiling src/core/lib/transport/static_metadata.cc; 1s local 2024-12-18T00:07:44.4836630Z Compiling src/ssl/encrypted_client_hello.cc; 1s local 2024-12-18T00:07:44.4837329Z Compiling src/ssl/extensions.cc; 1s local ... 2024-12-18T00:07:44.6835281Z 2024-12-18T00:07:44.6836158Z  2024-12-18T00:07:44.6836641Z  2024-12-18T00:07:44.6837008Z  2024-12-18T00:07:44.6837408Z  2024-12-18T00:07:44.6837808Z  2024-12-18T00:07:44.6838238Z  2024-12-18T00:07:44.6838608Z  2024-12-18T00:07:44.6838993Z  2024-12-18T00:07:44.6839589Z [12,742 / 15,187] 48 actions, 47 running 2024-12-18T00:07:44.6840462Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:07:44.6841434Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 7s local 2024-12-18T00:07:44.6842197Z @llvm-project//llvm:llvm-tblgen; 5s local 2024-12-18T00:07:44.6842894Z Compiling xla/service/name_uniquer.cc; 3s local 2024-12-18T00:07:44.6843731Z Compiling src/core/lib/transport/static_metadata.cc; 1s local 2024-12-18T00:07:44.6844830Z Compiling src/ssl/extensions.cc; 1s local 2024-12-18T00:07:44.6845524Z Compiling src/ssl/handshake_client.cc; 1s local 2024-12-18T00:07:44.6846263Z Compiling src/ssl/handshake_server.cc; 1s local ... 2024-12-18T00:07:44.8857163Z 2024-12-18T00:07:44.8858009Z  2024-12-18T00:07:44.8858479Z  2024-12-18T00:07:44.8858878Z  2024-12-18T00:07:44.8859243Z  2024-12-18T00:07:44.8859612Z  2024-12-18T00:07:44.8859963Z  2024-12-18T00:07:44.8860348Z  2024-12-18T00:07:44.8860728Z  2024-12-18T00:07:44.8861507Z [12,795 / 15,187] 48 actions, 47 running 2024-12-18T00:07:44.8862429Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:07:44.8863398Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 7s local 2024-12-18T00:07:44.8864212Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:07:44.8864912Z Compiling xla/service/name_uniquer.cc; 3s local 2024-12-18T00:07:44.8866071Z Compiling src/core/lib/transport/static_metadata.cc; 2s local 2024-12-18T00:07:44.8866890Z Compiling src/ssl/extensions.cc; 1s local 2024-12-18T00:07:44.8867560Z Compiling src/ssl/handshake_client.cc; 1s local 2024-12-18T00:07:44.8868285Z Compiling src/ssl/handshake_server.cc; 1s local ... 2024-12-18T00:07:45.0908915Z 2024-12-18T00:07:45.0909775Z  2024-12-18T00:07:45.0910622Z  2024-12-18T00:07:45.0911053Z  2024-12-18T00:07:45.0911448Z  2024-12-18T00:07:45.0912001Z  2024-12-18T00:07:45.0912397Z  2024-12-18T00:07:45.0912803Z  2024-12-18T00:07:45.0913178Z  2024-12-18T00:07:45.0913766Z [12,836 / 15,187] 48 actions, 47 running 2024-12-18T00:07:45.0914657Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:07:45.0915708Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 7s local 2024-12-18T00:07:45.0916539Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:07:45.0917295Z Compiling xla/service/name_uniquer.cc; 3s local 2024-12-18T00:07:45.0918143Z Compiling src/core/lib/transport/static_metadata.cc; 2s local 2024-12-18T00:07:45.0918832Z Compiling src/ssl/extensions.cc; 1s local 2024-12-18T00:07:45.0919425Z Compiling src/ssl/ssl_lib.cc; 1s local 2024-12-18T00:07:45.0920057Z Compiling src/ssl/tls13_server.cc; 1s local ... 2024-12-18T00:07:45.2911283Z 2024-12-18T00:07:45.2912193Z  2024-12-18T00:07:45.2912685Z  2024-12-18T00:07:45.2913050Z  2024-12-18T00:07:45.2913407Z  2024-12-18T00:07:45.2913769Z  2024-12-18T00:07:45.2914148Z  2024-12-18T00:07:45.2914516Z  2024-12-18T00:07:45.2914885Z  2024-12-18T00:07:45.2915507Z [12,929 / 15,187] 48 actions, 47 running 2024-12-18T00:07:45.2916386Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:07:45.2917393Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 7s local 2024-12-18T00:07:45.2918231Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:07:45.2918932Z Compiling xla/service/name_uniquer.cc; 4s local 2024-12-18T00:07:45.2919589Z Compiling src/ssl/extensions.cc; 2s local 2024-12-18T00:07:45.2920143Z Compiling src/ssl/ssl_lib.cc; 1s local 2024-12-18T00:07:45.2920818Z Compiling src/crypto/curve25519/curve25519.c; 0s local 2024-12-18T00:07:45.2921674Z Compiling xla/hlo/builder/lib/approx_topk.cc; 0s local ... 2024-12-18T00:07:45.5055665Z 2024-12-18T00:07:45.5057123Z  2024-12-18T00:07:45.5058034Z  2024-12-18T00:07:45.5058724Z  2024-12-18T00:07:45.5059268Z  2024-12-18T00:07:45.5060303Z  2024-12-18T00:07:45.5060711Z  2024-12-18T00:07:45.5061051Z  2024-12-18T00:07:45.5061431Z  2024-12-18T00:07:45.5062036Z [13,026 / 15,187] 48 actions, 47 running 2024-12-18T00:07:45.5062785Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:07:45.5063646Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 8s local 2024-12-18T00:07:45.5064309Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:07:45.5064877Z Compiling xla/service/name_uniquer.cc; 4s local 2024-12-18T00:07:45.5065450Z Compiling src/ssl/ssl_lib.cc; 2s local 2024-12-18T00:07:45.5066032Z Compiling src/crypto/curve25519/curve25519.c; 1s local 2024-12-18T00:07:45.5066815Z Compiling xla/hlo/builder/lib/approx_topk.cc; 0s local 2024-12-18T00:07:45.5067649Z Compiling src/crypto/fipsmodule/bcm.c; 0s local ... 2024-12-18T00:07:45.7085690Z 2024-12-18T00:07:45.7086980Z  2024-12-18T00:07:45.7087486Z  2024-12-18T00:07:45.7087912Z  2024-12-18T00:07:45.7088324Z  2024-12-18T00:07:45.7088738Z  2024-12-18T00:07:45.7089148Z  2024-12-18T00:07:45.7089521Z  2024-12-18T00:07:45.7089907Z  2024-12-18T00:07:45.7090402Z [13,029 / 15,187] 48 actions running 2024-12-18T00:07:45.7091262Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:07:45.7092482Z Compiling mlir/lib/IR/BuiltinTypes.cpp [for tool]; 8s local 2024-12-18T00:07:45.7093219Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:07:45.7093864Z Compiling xla/service/name_uniquer.cc; 4s local 2024-12-18T00:07:45.7094579Z Compiling src/crypto/curve25519/curve25519.c; 1s local 2024-12-18T00:07:45.7095619Z Compiling xla/hlo/builder/lib/approx_topk.cc; 1s local 2024-12-18T00:07:45.7096550Z Compiling src/crypto/fipsmodule/bcm.c; 1s local 2024-12-18T00:07:45.7097344Z Compiling torch_xla/csrc/runtime/sys_util.cc; 0s local ... 2024-12-18T00:07:46.0209206Z 2024-12-18T00:07:46.0210141Z  2024-12-18T00:07:46.0210968Z  2024-12-18T00:07:46.0211534Z  2024-12-18T00:07:46.0212078Z  2024-12-18T00:07:46.0212592Z  2024-12-18T00:07:46.0213121Z  2024-12-18T00:07:46.0213651Z  2024-12-18T00:07:46.0214187Z  2024-12-18T00:07:46.0214938Z [13,031 / 15,187] 48 actions, 47 running 2024-12-18T00:07:46.0216035Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:07:46.0217208Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:07:46.0218063Z Compiling src/crypto/curve25519/curve25519.c; 1s local 2024-12-18T00:07:46.0219054Z Compiling xla/hlo/builder/lib/approx_topk.cc; 1s local 2024-12-18T00:07:46.0220333Z Compiling src/crypto/fipsmodule/bcm.c; 1s local 2024-12-18T00:07:46.0221484Z Compiling torch_xla/csrc/runtime/sys_util.cc; 0s local 2024-12-18T00:07:46.0222588Z @xla//xla/service:hlo_execution_profile_data_cc_impl; 0s local 2024-12-18T00:07:46.0223652Z Compiling xla/service/hlo_profile_printer.cc; 0s local ... 2024-12-18T00:07:46.2624605Z 2024-12-18T00:07:46.2625417Z  2024-12-18T00:07:46.2625944Z  2024-12-18T00:07:46.2626368Z  2024-12-18T00:07:46.2626779Z  2024-12-18T00:07:46.2627178Z  2024-12-18T00:07:46.2627578Z  2024-12-18T00:07:46.2628047Z  2024-12-18T00:07:46.2628445Z  2024-12-18T00:07:46.2629053Z [13,036 / 15,187] 48 actions, 47 running 2024-12-18T00:07:46.2629941Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:07:46.2630831Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:07:46.2631593Z Compiling xla/hlo/builder/lib/approx_topk.cc; 1s local 2024-12-18T00:07:46.2632429Z Compiling src/crypto/fipsmodule/bcm.c; 1s local 2024-12-18T00:07:46.2633232Z Compiling torch_xla/csrc/runtime/sys_util.cc; 0s local 2024-12-18T00:07:46.2634139Z @xla//xla/service:hlo_execution_profile_data_cc_impl; 0s local 2024-12-18T00:07:46.2635026Z Compiling xla/service/hlo_profile_printer.cc; 0s local 2024-12-18T00:07:46.2635914Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 0s local ... 2024-12-18T00:07:46.5089388Z 2024-12-18T00:07:46.5090306Z  2024-12-18T00:07:46.5090794Z  2024-12-18T00:07:46.5091153Z  2024-12-18T00:07:46.5091532Z  2024-12-18T00:07:46.5091953Z  2024-12-18T00:07:46.5092311Z  2024-12-18T00:07:46.5092648Z  2024-12-18T00:07:46.5093008Z  2024-12-18T00:07:46.5093573Z [13,041 / 15,187] 48 actions, 47 running 2024-12-18T00:07:46.5094410Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:07:46.5095262Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:07:46.5095953Z Compiling xla/hlo/builder/lib/approx_topk.cc; 1s local 2024-12-18T00:07:46.5096783Z Compiling src/crypto/fipsmodule/bcm.c; 1s local 2024-12-18T00:07:46.5097511Z Compiling torch_xla/csrc/runtime/sys_util.cc; 1s local 2024-12-18T00:07:46.5098327Z @xla//xla/service:hlo_execution_profile_data_cc_impl; 1s local 2024-12-18T00:07:46.5099124Z Compiling xla/service/hlo_profile_printer.cc; 1s local 2024-12-18T00:07:46.5099940Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 1s local ... 2024-12-18T00:07:46.7094900Z 2024-12-18T00:07:46.7095806Z  2024-12-18T00:07:46.7096866Z  2024-12-18T00:07:46.7097265Z  2024-12-18T00:07:46.7097628Z  2024-12-18T00:07:46.7098029Z  2024-12-18T00:07:46.7098426Z  2024-12-18T00:07:46.7098818Z  2024-12-18T00:07:46.7099203Z  2024-12-18T00:07:46.7099797Z [13,042 / 15,187] 48 actions running 2024-12-18T00:07:46.7101084Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:07:46.7101988Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:07:46.7102746Z Compiling xla/hlo/builder/lib/approx_topk.cc; 2s local 2024-12-18T00:07:46.7103531Z Compiling src/crypto/fipsmodule/bcm.c; 2s local 2024-12-18T00:07:46.7104307Z Compiling torch_xla/csrc/runtime/sys_util.cc; 1s local 2024-12-18T00:07:46.7105167Z @xla//xla/service:hlo_execution_profile_data_cc_impl; 1s local 2024-12-18T00:07:46.7106019Z Compiling xla/service/hlo_profile_printer.cc; 1s local 2024-12-18T00:07:46.7106914Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 1s local ... 2024-12-18T00:07:46.9990777Z 2024-12-18T00:07:46.9992016Z  2024-12-18T00:07:46.9992480Z  2024-12-18T00:07:46.9992865Z  2024-12-18T00:07:46.9993273Z  2024-12-18T00:07:46.9993669Z  2024-12-18T00:07:46.9994055Z  2024-12-18T00:07:46.9994425Z  2024-12-18T00:07:46.9994824Z  2024-12-18T00:07:46.9995454Z [13,048 / 15,187] 48 actions, 47 running 2024-12-18T00:07:46.9996356Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:07:46.9997260Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:07:46.9998021Z Compiling xla/hlo/builder/lib/approx_topk.cc; 2s local 2024-12-18T00:07:46.9998826Z Compiling src/crypto/fipsmodule/bcm.c; 2s local 2024-12-18T00:07:46.9999624Z Compiling torch_xla/csrc/runtime/sys_util.cc; 1s local 2024-12-18T00:07:47.0000504Z @xla//xla/service:hlo_execution_profile_data_cc_impl; 1s local 2024-12-18T00:07:47.0001416Z Compiling xla/service/hlo_profile_printer.cc; 1s local 2024-12-18T00:07:47.0002312Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 1s local ... 2024-12-18T00:07:47.2652072Z 2024-12-18T00:07:47.2653007Z  2024-12-18T00:07:47.2653534Z  2024-12-18T00:07:47.2653938Z  2024-12-18T00:07:47.2654327Z  2024-12-18T00:07:47.2654722Z  2024-12-18T00:07:47.2655113Z  2024-12-18T00:07:47.2655476Z  2024-12-18T00:07:47.2655891Z  2024-12-18T00:07:47.2656608Z [13,051 / 15,187] 48 actions, 47 running 2024-12-18T00:07:47.2657517Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:07:47.2658391Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:07:47.2659133Z Compiling xla/hlo/builder/lib/approx_topk.cc; 2s local 2024-12-18T00:07:47.2659905Z Compiling src/crypto/fipsmodule/bcm.c; 2s local 2024-12-18T00:07:47.2660684Z Compiling xla/service/hlo_profile_printer.cc; 1s local 2024-12-18T00:07:47.2661529Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 1s local 2024-12-18T00:07:47.2662507Z Compiling xla/service/human_readable_profile_builder.cc; 1s local 2024-12-18T00:07:47.2663389Z Compiling xla/metric_table_report.cc; 1s local ... 2024-12-18T00:07:47.4819235Z 2024-12-18T00:07:47.4820172Z  2024-12-18T00:07:47.4820674Z  2024-12-18T00:07:47.4821089Z  2024-12-18T00:07:47.4821497Z  2024-12-18T00:07:47.4821921Z  2024-12-18T00:07:47.4822311Z  2024-12-18T00:07:47.4822716Z  2024-12-18T00:07:47.4823105Z  2024-12-18T00:07:47.4823699Z [13,054 / 15,187] 48 actions, 47 running 2024-12-18T00:07:47.4824576Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:07:47.4825501Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:07:47.4826272Z Compiling xla/hlo/builder/lib/approx_topk.cc; 2s local 2024-12-18T00:07:47.4827112Z Compiling src/crypto/fipsmodule/bcm.c; 2s local 2024-12-18T00:07:47.4827908Z Compiling xla/service/hlo_profile_printer.cc; 2s local 2024-12-18T00:07:47.4829223Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 2s local 2024-12-18T00:07:47.4830225Z Compiling xla/service/human_readable_profile_builder.cc; 2s local 2024-12-18T00:07:47.4831178Z Compiling xla/metric_table_report.cc; 2s local ... 2024-12-18T00:07:47.7103620Z 2024-12-18T00:07:47.7104827Z  2024-12-18T00:07:47.7105666Z  2024-12-18T00:07:47.7106091Z  2024-12-18T00:07:47.7106487Z  2024-12-18T00:07:47.7106873Z  2024-12-18T00:07:47.7107288Z  2024-12-18T00:07:47.7107695Z  2024-12-18T00:07:47.7108071Z  2024-12-18T00:07:47.7108658Z [13,058 / 15,187] 48 actions running 2024-12-18T00:07:47.7109568Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:07:47.7110505Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:07:47.7111251Z Compiling xla/hlo/builder/lib/approx_topk.cc; 3s local 2024-12-18T00:07:47.7112093Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2024-12-18T00:07:47.7112940Z Compiling xla/service/hlo_profile_printer.cc; 2s local 2024-12-18T00:07:47.7113791Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 2s local 2024-12-18T00:07:47.7114783Z Compiling xla/service/human_readable_profile_builder.cc; 2s local 2024-12-18T00:07:47.7115742Z Compiling xla/metric_table_report.cc; 2s local ... 2024-12-18T00:07:47.9895429Z 2024-12-18T00:07:47.9896233Z  2024-12-18T00:07:47.9896842Z  2024-12-18T00:07:47.9897249Z  2024-12-18T00:07:47.9897638Z  2024-12-18T00:07:47.9898023Z  2024-12-18T00:07:47.9898415Z  2024-12-18T00:07:47.9898814Z  2024-12-18T00:07:47.9899187Z  2024-12-18T00:07:47.9899767Z [13,060 / 15,187] 48 actions, 47 running 2024-12-18T00:07:47.9900689Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:07:47.9901606Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:07:47.9902395Z Compiling xla/hlo/builder/lib/approx_topk.cc; 3s local 2024-12-18T00:07:47.9903196Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2024-12-18T00:07:47.9903989Z Compiling xla/service/hlo_profile_printer.cc; 2s local 2024-12-18T00:07:47.9904878Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 2s local 2024-12-18T00:07:47.9905885Z Compiling xla/service/human_readable_profile_builder.cc; 2s local 2024-12-18T00:07:47.9906837Z Compiling xla/metric_table_report.cc; 2s local ... 2024-12-18T00:07:48.2585442Z 2024-12-18T00:07:48.2586354Z  2024-12-18T00:07:48.2586822Z  2024-12-18T00:07:48.2587238Z  2024-12-18T00:07:48.2587634Z  2024-12-18T00:07:48.2588055Z  2024-12-18T00:07:48.2588893Z  2024-12-18T00:07:48.2589305Z  2024-12-18T00:07:48.2589716Z  2024-12-18T00:07:48.2590316Z [13,069 / 15,187] 48 actions, 47 running 2024-12-18T00:07:48.2591236Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:07:48.2592221Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:07:48.2594442Z Compiling xla/hlo/builder/lib/approx_topk.cc; 3s local 2024-12-18T00:07:48.2596363Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2024-12-18T00:07:48.2597406Z Compiling xla/service/hlo_profile_printer.cc; 2s local 2024-12-18T00:07:48.2598527Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 2s local 2024-12-18T00:07:48.2599710Z Compiling xla/service/human_readable_profile_builder.cc; 2s local 2024-12-18T00:07:48.2600855Z Compiling xla/metric_table_report.cc; 2s local ... 2024-12-18T00:07:48.4634034Z 2024-12-18T00:07:48.4636413Z  2024-12-18T00:07:48.4641661Z  2024-12-18T00:07:48.4642080Z  2024-12-18T00:07:48.4642454Z  2024-12-18T00:07:48.4642805Z  2024-12-18T00:07:48.4643209Z  2024-12-18T00:07:48.4643603Z  2024-12-18T00:07:48.4644013Z  2024-12-18T00:07:48.4644904Z [13,072 / 15,187] 48 actions, 47 running 2024-12-18T00:07:48.4646181Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:07:48.4647047Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:07:48.4647748Z Compiling xla/hlo/builder/lib/approx_topk.cc; 3s local 2024-12-18T00:07:48.4648498Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2024-12-18T00:07:48.4649465Z Compiling xla/service/hlo_profile_printer.cc; 3s local 2024-12-18T00:07:48.4650290Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 3s local 2024-12-18T00:07:48.4651251Z Compiling xla/service/human_readable_profile_builder.cc; 3s local 2024-12-18T00:07:48.4652138Z Compiling xla/metric_table_report.cc; 3s local ... 2024-12-18T00:07:48.7116400Z 2024-12-18T00:07:48.7117288Z  2024-12-18T00:07:48.7117721Z  2024-12-18T00:07:48.7118128Z  2024-12-18T00:07:48.7118528Z  2024-12-18T00:07:48.7118916Z  2024-12-18T00:07:48.7119309Z  2024-12-18T00:07:48.7119680Z  2024-12-18T00:07:48.7120121Z  2024-12-18T00:07:48.7120697Z [13,077 / 15,187] 48 actions running 2024-12-18T00:07:48.7121575Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:07:48.7122460Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:07:48.7123223Z Compiling xla/hlo/builder/lib/approx_topk.cc; 4s local 2024-12-18T00:07:48.7124035Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:07:48.7124813Z Compiling xla/service/hlo_profile_printer.cc; 3s local 2024-12-18T00:07:48.7125670Z @xla//xla/service:hlo_profile_printer_data_cc_impl; 3s local 2024-12-18T00:07:48.7126624Z Compiling xla/service/human_readable_profile_builder.cc; 3s local 2024-12-18T00:07:48.7127557Z Compiling xla/metric_table_report.cc; 3s local ... 2024-12-18T00:07:48.9380860Z 2024-12-18T00:07:48.9381709Z  2024-12-18T00:07:48.9382179Z  2024-12-18T00:07:48.9382563Z  2024-12-18T00:07:48.9382946Z  2024-12-18T00:07:48.9383314Z  2024-12-18T00:07:48.9383752Z  2024-12-18T00:07:48.9384156Z  2024-12-18T00:07:48.9384542Z  2024-12-18T00:07:48.9385114Z [13,080 / 15,187] 48 actions, 47 running 2024-12-18T00:07:48.9386001Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:07:48.9386882Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:07:48.9387635Z Compiling xla/hlo/builder/lib/approx_topk.cc; 4s local 2024-12-18T00:07:48.9388401Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:07:48.9389271Z Compiling xla/service/human_readable_profile_builder.cc; 3s local 2024-12-18T00:07:48.9390125Z Compiling xla/metric_table_report.cc; 3s local 2024-12-18T00:07:48.9390956Z Compiling xla/service/maybe_owning_device_memory.cc; 3s local 2024-12-18T00:07:48.9391826Z Compiling xla/service/shaped_buffer.cc; 3s local ... 2024-12-18T00:07:49.2040273Z 2024-12-18T00:07:49.2041144Z  2024-12-18T00:07:49.2041628Z  2024-12-18T00:07:49.2042078Z  2024-12-18T00:07:49.2042484Z  2024-12-18T00:07:49.2042869Z  2024-12-18T00:07:49.2043239Z  2024-12-18T00:07:49.2043613Z  2024-12-18T00:07:49.2043956Z  2024-12-18T00:07:49.2044749Z [13,084 / 15,187] 48 actions, 47 running 2024-12-18T00:07:49.2045605Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:07:49.2046478Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:07:49.2047189Z Compiling xla/hlo/builder/lib/approx_topk.cc; 4s local 2024-12-18T00:07:49.2047955Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:07:49.2048822Z Compiling xla/service/human_readable_profile_builder.cc; 3s local 2024-12-18T00:07:49.2049681Z Compiling xla/metric_table_report.cc; 3s local 2024-12-18T00:07:49.2050506Z Compiling xla/service/maybe_owning_device_memory.cc; 3s local 2024-12-18T00:07:49.2051366Z Compiling xla/service/shaped_buffer.cc; 3s local ... 2024-12-18T00:07:49.4107918Z 2024-12-18T00:07:49.4108773Z  2024-12-18T00:07:49.4109249Z  2024-12-18T00:07:49.4109639Z  2024-12-18T00:07:49.4110037Z  2024-12-18T00:07:49.4110418Z  2024-12-18T00:07:49.4110798Z  2024-12-18T00:07:49.4111183Z  2024-12-18T00:07:49.4111568Z  2024-12-18T00:07:49.4112155Z [13,089 / 15,187] 48 actions, 47 running 2024-12-18T00:07:49.4113282Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:07:49.4114160Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:07:49.4114892Z Compiling xla/hlo/builder/lib/approx_topk.cc; 4s local 2024-12-18T00:07:49.4115488Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:07:49.4116216Z Compiling xla/service/human_readable_profile_builder.cc; 4s local 2024-12-18T00:07:49.4117063Z Compiling xla/metric_table_report.cc; 4s local 2024-12-18T00:07:49.4117854Z Compiling xla/service/maybe_owning_device_memory.cc; 4s local 2024-12-18T00:07:49.4130155Z Compiling xla/service/shaped_buffer.cc; 4s local ... 2024-12-18T00:07:49.7124955Z 2024-12-18T00:07:49.7125792Z  2024-12-18T00:07:49.7126245Z  2024-12-18T00:07:49.7126646Z  2024-12-18T00:07:49.7127026Z  2024-12-18T00:07:49.7127412Z  2024-12-18T00:07:49.7127798Z  2024-12-18T00:07:49.7128174Z  2024-12-18T00:07:49.7128563Z  2024-12-18T00:07:49.7129186Z [13,092 / 15,187] 48 actions running 2024-12-18T00:07:49.7130142Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:07:49.7131129Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:07:49.7132005Z Compiling xla/hlo/builder/lib/approx_topk.cc; 5s local 2024-12-18T00:07:49.7132904Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:07:49.7133731Z Compiling xla/service/human_readable_profile_builder.cc; 4s local 2024-12-18T00:07:49.7134558Z Compiling xla/metric_table_report.cc; 4s local 2024-12-18T00:07:49.7135320Z Compiling xla/service/shaped_buffer.cc; 4s local 2024-12-18T00:07:49.7136068Z Compiling xla/service/stream_pool.cc; 4s local ... 2024-12-18T00:07:49.9146815Z 2024-12-18T00:07:49.9147656Z  2024-12-18T00:07:49.9148125Z  2024-12-18T00:07:49.9148547Z  2024-12-18T00:07:49.9149078Z  2024-12-18T00:07:49.9149572Z  2024-12-18T00:07:49.9149976Z  2024-12-18T00:07:49.9150400Z  2024-12-18T00:07:49.9150825Z  2024-12-18T00:07:49.9151460Z [13,096 / 15,187] 48 actions, 47 running 2024-12-18T00:07:49.9152366Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:07:49.9153265Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:07:49.9154059Z Compiling xla/hlo/builder/lib/approx_topk.cc; 5s local 2024-12-18T00:07:49.9154869Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:07:49.9155768Z Compiling xla/service/human_readable_profile_builder.cc; 4s local 2024-12-18T00:07:49.9156736Z Compiling xla/service/shaped_buffer.cc; 4s local 2024-12-18T00:07:49.9157491Z Compiling xla/service/stream_pool.cc; 4s local 2024-12-18T00:07:49.9158387Z Compiling xla/stream_executor/platform_manager.cc; 4s local ... 2024-12-18T00:07:50.1448307Z 2024-12-18T00:07:50.1449135Z  2024-12-18T00:07:50.1449604Z  2024-12-18T00:07:50.1450017Z  2024-12-18T00:07:50.1450445Z  2024-12-18T00:07:50.1450900Z  2024-12-18T00:07:50.1451288Z  2024-12-18T00:07:50.1451693Z  2024-12-18T00:07:50.1452104Z  2024-12-18T00:07:50.1452719Z [13,102 / 15,187] 48 actions, 47 running 2024-12-18T00:07:50.1453675Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:07:50.1454562Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:07:50.1455332Z Compiling xla/hlo/builder/lib/approx_topk.cc; 5s local 2024-12-18T00:07:50.1456142Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:07:50.1457638Z Compiling xla/service/human_readable_profile_builder.cc; 4s local 2024-12-18T00:07:50.1458508Z Compiling xla/service/shaped_buffer.cc; 4s local 2024-12-18T00:07:50.1459235Z Compiling xla/service/stream_pool.cc; 4s local 2024-12-18T00:07:50.1460102Z Compiling xla/stream_executor/platform_manager.cc; 4s local ... 2024-12-18T00:07:50.4060965Z 2024-12-18T00:07:50.4061836Z  2024-12-18T00:07:50.4062628Z  2024-12-18T00:07:50.4063067Z  2024-12-18T00:07:50.4063484Z  2024-12-18T00:07:50.4063863Z  2024-12-18T00:07:50.4064302Z  2024-12-18T00:07:50.4064729Z  2024-12-18T00:07:50.4065113Z  2024-12-18T00:07:50.4065558Z [13,111 / 15,187] 48 actions, 47 running 2024-12-18T00:07:50.4066362Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:07:50.4067139Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:07:50.4067882Z Compiling xla/hlo/builder/lib/approx_topk.cc; 5s local 2024-12-18T00:07:50.4068646Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:07:50.4069473Z Compiling xla/service/human_readable_profile_builder.cc; 5s local 2024-12-18T00:07:50.4070300Z Compiling xla/service/shaped_buffer.cc; 5s local 2024-12-18T00:07:50.4071010Z Compiling xla/service/stream_pool.cc; 5s local 2024-12-18T00:07:50.4071850Z Compiling xla/stream_executor/platform_manager.cc; 5s local ... 2024-12-18T00:07:50.6766248Z 2024-12-18T00:07:50.6767118Z  2024-12-18T00:07:50.6767626Z  2024-12-18T00:07:50.6768063Z  2024-12-18T00:07:50.6768447Z  2024-12-18T00:07:50.6768856Z  2024-12-18T00:07:50.6769530Z  2024-12-18T00:07:50.6770032Z  2024-12-18T00:07:50.6770463Z  2024-12-18T00:07:50.6771034Z [13,117 / 15,187] 48 actions, 47 running 2024-12-18T00:07:50.6771967Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:07:50.6772886Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:07:50.6773735Z Compiling xla/hlo/builder/lib/approx_topk.cc; 6s local 2024-12-18T00:07:50.6774584Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:07:50.6775433Z Compiling xla/service/human_readable_profile_builder.cc; 5s local 2024-12-18T00:07:50.6776298Z Compiling xla/service/shaped_buffer.cc; 5s local 2024-12-18T00:07:50.6777210Z Compiling xla/service/stream_pool.cc; 5s local 2024-12-18T00:07:50.6778100Z Compiling xla/stream_executor/platform_manager.cc; 5s local ... 2024-12-18T00:07:50.9134184Z 2024-12-18T00:07:50.9135046Z  2024-12-18T00:07:50.9135518Z  2024-12-18T00:07:50.9135887Z  2024-12-18T00:07:50.9136282Z  2024-12-18T00:07:50.9136832Z  2024-12-18T00:07:50.9137237Z  2024-12-18T00:07:50.9137607Z  2024-12-18T00:07:50.9137982Z  2024-12-18T00:07:50.9138548Z [13,124 / 15,187] 48 actions running 2024-12-18T00:07:50.9139416Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:07:50.9140335Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:07:50.9141096Z Compiling xla/hlo/builder/lib/approx_topk.cc; 6s local 2024-12-18T00:07:50.9141765Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:07:50.9142499Z Compiling xla/service/shaped_buffer.cc; 5s local 2024-12-18T00:07:50.9143476Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f64.cc; 5s local 2024-12-18T00:07:50.9144996Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 5s local 2024-12-18T00:07:50.9146064Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 5s local ... 2024-12-18T00:07:51.1184959Z 2024-12-18T00:07:51.1185842Z  2024-12-18T00:07:51.1186318Z  2024-12-18T00:07:51.1186729Z  2024-12-18T00:07:51.1187124Z  2024-12-18T00:07:51.1187526Z  2024-12-18T00:07:51.1187915Z  2024-12-18T00:07:51.1188304Z  2024-12-18T00:07:51.1188710Z  2024-12-18T00:07:51.1189276Z [13,129 / 15,187] 48 actions, 47 running 2024-12-18T00:07:51.1190557Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:07:51.1191415Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:07:51.1192202Z Compiling xla/hlo/builder/lib/approx_topk.cc; 6s local 2024-12-18T00:07:51.1193005Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:07:51.1193899Z Compiling xla/service/shaped_buffer.cc; 5s local 2024-12-18T00:07:51.1194840Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f64.cc; 5s local 2024-12-18T00:07:51.1195974Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 5s local 2024-12-18T00:07:51.1197042Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 5s local ... 2024-12-18T00:07:51.3770446Z 2024-12-18T00:07:51.3771276Z  2024-12-18T00:07:51.3771769Z  2024-12-18T00:07:51.3772188Z  2024-12-18T00:07:51.3772578Z  2024-12-18T00:07:51.3773297Z  2024-12-18T00:07:51.3773719Z  2024-12-18T00:07:51.3774189Z  2024-12-18T00:07:51.3774731Z  2024-12-18T00:07:51.3775344Z [13,133 / 15,187] 48 actions, 47 running 2024-12-18T00:07:51.3776364Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:07:51.3777474Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:07:51.3778266Z Compiling xla/hlo/builder/lib/approx_topk.cc; 6s local 2024-12-18T00:07:51.3779275Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:07:51.3780078Z Compiling xla/service/shaped_buffer.cc; 6s local 2024-12-18T00:07:51.3781079Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f64.cc; 5s local 2024-12-18T00:07:51.3782237Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 5s local 2024-12-18T00:07:51.3783352Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 5s local ... 2024-12-18T00:07:51.5979906Z 2024-12-18T00:07:51.5980740Z  2024-12-18T00:07:51.5981220Z  2024-12-18T00:07:51.5981668Z  2024-12-18T00:07:51.5982069Z  2024-12-18T00:07:51.5982447Z  2024-12-18T00:07:51.5982848Z  2024-12-18T00:07:51.5983243Z  2024-12-18T00:07:51.5983623Z  2024-12-18T00:07:51.5984215Z [13,138 / 15,187] 48 actions, 47 running 2024-12-18T00:07:51.5985113Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:07:51.5985998Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:07:51.5986755Z Compiling xla/hlo/builder/lib/approx_topk.cc; 6s local 2024-12-18T00:07:51.5987545Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:07:51.5988289Z Compiling xla/service/shaped_buffer.cc; 6s local 2024-12-18T00:07:51.5989232Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f64.cc; 6s local 2024-12-18T00:07:51.5990395Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 6s local 2024-12-18T00:07:51.5991479Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 6s local ... 2024-12-18T00:07:51.8314716Z 2024-12-18T00:07:51.8315590Z  2024-12-18T00:07:51.8316114Z  2024-12-18T00:07:51.8316563Z  2024-12-18T00:07:51.8317010Z  2024-12-18T00:07:51.8317436Z  2024-12-18T00:07:51.8317888Z  2024-12-18T00:07:51.8318329Z  2024-12-18T00:07:51.8318775Z  2024-12-18T00:07:51.8319458Z [13,144 / 15,187] 48 actions, 47 running 2024-12-18T00:07:51.8320454Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:07:51.8321439Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:07:51.8322276Z Compiling xla/hlo/builder/lib/approx_topk.cc; 7s local 2024-12-18T00:07:51.8323158Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:07:51.8323990Z Compiling xla/service/shaped_buffer.cc; 6s local 2024-12-18T00:07:51.8324966Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f64.cc; 6s local 2024-12-18T00:07:51.8326012Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 6s local 2024-12-18T00:07:51.8327353Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 6s local ... 2024-12-18T00:07:52.0462828Z 2024-12-18T00:07:52.0463626Z  2024-12-18T00:07:52.0464091Z  2024-12-18T00:07:52.0464511Z  2024-12-18T00:07:52.0464895Z  2024-12-18T00:07:52.0465278Z  2024-12-18T00:07:52.0465699Z  2024-12-18T00:07:52.0466462Z  2024-12-18T00:07:52.0466819Z  2024-12-18T00:07:52.0467321Z [13,147 / 15,187] 48 actions, 47 running 2024-12-18T00:07:52.0468097Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:07:52.0468818Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:07:52.0469545Z Compiling xla/hlo/builder/lib/approx_topk.cc; 7s local 2024-12-18T00:07:52.0470469Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:07:52.0471207Z Compiling xla/service/shaped_buffer.cc; 6s local 2024-12-18T00:07:52.0472150Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f64.cc; 6s local 2024-12-18T00:07:52.0473533Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 6s local 2024-12-18T00:07:52.0474587Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 6s local ... 2024-12-18T00:07:52.2445808Z 2024-12-18T00:07:52.2446682Z  2024-12-18T00:07:52.2447168Z  2024-12-18T00:07:52.2447614Z  2024-12-18T00:07:52.2448031Z  2024-12-18T00:07:52.2448445Z  2024-12-18T00:07:52.2448825Z  2024-12-18T00:07:52.2449210Z  2024-12-18T00:07:52.2449592Z  2024-12-18T00:07:52.2450178Z [13,155 / 15,187] 48 actions, 47 running 2024-12-18T00:07:52.2450865Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:07:52.2451599Z Compiling xla/hlo/builder/lib/approx_topk.cc; 7s local 2024-12-18T00:07:52.2452377Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:07:52.2453066Z Compiling xla/service/shaped_buffer.cc; 6s local 2024-12-18T00:07:52.2453960Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 6s local 2024-12-18T00:07:52.2455108Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 6s local 2024-12-18T00:07:52.2456230Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 6s local 2024-12-18T00:07:52.2457478Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 6s local ... 2024-12-18T00:07:52.4871859Z 2024-12-18T00:07:52.4872683Z  2024-12-18T00:07:52.4873151Z  2024-12-18T00:07:52.4873517Z  2024-12-18T00:07:52.4873922Z  2024-12-18T00:07:52.4874335Z  2024-12-18T00:07:52.4874704Z  2024-12-18T00:07:52.4875049Z  2024-12-18T00:07:52.4875376Z  2024-12-18T00:07:52.4875912Z [13,160 / 15,187] 48 actions, 47 running 2024-12-18T00:07:52.4876586Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:07:52.4877270Z Compiling xla/hlo/builder/lib/approx_topk.cc; 7s local 2024-12-18T00:07:52.4878049Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:07:52.4878725Z Compiling xla/service/shaped_buffer.cc; 7s local 2024-12-18T00:07:52.4879502Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:07:52.4880473Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:07:52.4881431Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:07:52.4882324Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 7s local ... 2024-12-18T00:07:52.7148506Z 2024-12-18T00:07:52.7149329Z  2024-12-18T00:07:52.7149783Z  2024-12-18T00:07:52.7150185Z  2024-12-18T00:07:52.7150542Z  2024-12-18T00:07:52.7150903Z  2024-12-18T00:07:52.7151295Z  2024-12-18T00:07:52.7151699Z  2024-12-18T00:07:52.7152097Z  2024-12-18T00:07:52.7152653Z [13,167 / 15,187] 48 actions running 2024-12-18T00:07:52.7153351Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:07:52.7154498Z Compiling xla/hlo/builder/lib/approx_topk.cc; 8s local 2024-12-18T00:07:52.7155267Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2024-12-18T00:07:52.7156043Z Compiling xla/service/shaped_buffer.cc; 7s local 2024-12-18T00:07:52.7156978Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:07:52.7158418Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:07:52.7159610Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:07:52.7160702Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 7s local ... 2024-12-18T00:07:52.9191832Z 2024-12-18T00:07:52.9192639Z  2024-12-18T00:07:52.9193104Z  2024-12-18T00:07:52.9193497Z  2024-12-18T00:07:52.9193907Z  2024-12-18T00:07:52.9194294Z  2024-12-18T00:07:52.9194681Z  2024-12-18T00:07:52.9195088Z  2024-12-18T00:07:52.9195513Z  2024-12-18T00:07:52.9196165Z [13,173 / 15,187] 48 actions, 47 running 2024-12-18T00:07:52.9196890Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:07:52.9197654Z Compiling xla/hlo/builder/lib/approx_topk.cc; 8s local 2024-12-18T00:07:52.9198412Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2024-12-18T00:07:52.9199176Z Compiling xla/service/shaped_buffer.cc; 7s local 2024-12-18T00:07:52.9200183Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:07:52.9201321Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:07:52.9202447Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:07:52.9203557Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 7s local ... 2024-12-18T00:07:53.2354964Z 2024-12-18T00:07:53.2356281Z  2024-12-18T00:07:53.2356781Z  2024-12-18T00:07:53.2357206Z  2024-12-18T00:07:53.2357618Z  2024-12-18T00:07:53.2358075Z  2024-12-18T00:07:53.2358449Z  2024-12-18T00:07:53.2358831Z  2024-12-18T00:07:53.2359217Z  2024-12-18T00:07:53.2359816Z [13,182 / 15,187] 48 actions, 47 running 2024-12-18T00:07:53.2360538Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:07:53.2361207Z Compiling xla/hlo/builder/lib/approx_topk.cc; 8s local 2024-12-18T00:07:53.2362237Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:07:53.2363252Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:07:53.2364372Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:07:53.2365504Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2024-12-18T00:07:53.2366538Z Compiling xla/service/dynamic_window_utils.cc; 7s local 2024-12-18T00:07:53.2367437Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 7s local ... 2024-12-18T00:07:53.4405146Z 2024-12-18T00:07:53.4408656Z  2024-12-18T00:07:53.4409188Z  2024-12-18T00:07:53.4409612Z  2024-12-18T00:07:53.4409992Z  2024-12-18T00:07:53.4410405Z  2024-12-18T00:07:53.4410798Z  2024-12-18T00:07:53.4411197Z  2024-12-18T00:07:53.4411552Z  2024-12-18T00:07:53.4412166Z [13,186 / 15,187] 48 actions, 47 running 2024-12-18T00:07:53.4412950Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:07:53.4413699Z Compiling xla/hlo/builder/lib/approx_topk.cc; 8s local 2024-12-18T00:07:53.4414645Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 8s local 2024-12-18T00:07:53.4415747Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:07:53.4417057Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:07:53.4418191Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2024-12-18T00:07:53.4419657Z Compiling xla/service/dynamic_window_utils.cc; 8s local 2024-12-18T00:07:53.4420601Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 8s local ... 2024-12-18T00:07:53.7014766Z 2024-12-18T00:07:53.7015722Z  2024-12-18T00:07:53.7016197Z  2024-12-18T00:07:53.7018464Z  2024-12-18T00:07:53.7019909Z  2024-12-18T00:07:53.7020691Z  2024-12-18T00:07:53.7021328Z  2024-12-18T00:07:53.7022258Z  2024-12-18T00:07:53.7023099Z  2024-12-18T00:07:53.7024403Z [13,199 / 15,187] 48 actions, 47 running 2024-12-18T00:07:53.7025225Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:07:53.7026042Z Compiling xla/hlo/builder/lib/approx_topk.cc; 9s local 2024-12-18T00:07:53.7027092Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:07:53.7028325Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:07:53.7029690Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2024-12-18T00:07:53.7030781Z Compiling xla/service/dynamic_window_utils.cc; 8s local 2024-12-18T00:07:53.7031859Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:07:53.7032908Z Compiling llvm/lib/Support/CommandLine.cpp; 6s local ... 2024-12-18T00:07:53.9045690Z 2024-12-18T00:07:53.9047002Z  2024-12-18T00:07:53.9047494Z  2024-12-18T00:07:53.9047935Z  2024-12-18T00:07:53.9048338Z  2024-12-18T00:07:53.9048740Z  2024-12-18T00:07:53.9049149Z  2024-12-18T00:07:53.9049517Z  2024-12-18T00:07:53.9049902Z  2024-12-18T00:07:53.9050506Z [13,208 / 15,187] 48 actions, 47 running 2024-12-18T00:07:53.9051230Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:07:53.9052072Z Compiling xla/hlo/builder/lib/approx_topk.cc; 9s local 2024-12-18T00:07:53.9053166Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:07:53.9054417Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:07:53.9055667Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2024-12-18T00:07:53.9056883Z Compiling xla/service/dynamic_window_utils.cc; 8s local 2024-12-18T00:07:53.9057961Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:07:53.9059089Z Compiling external/xla/xla/service/hlo.pb.cc; 5s local ... 2024-12-18T00:07:54.1156090Z 2024-12-18T00:07:54.1156998Z  2024-12-18T00:07:54.1157493Z  2024-12-18T00:07:54.1157931Z  2024-12-18T00:07:54.1158356Z  2024-12-18T00:07:54.1158785Z  2024-12-18T00:07:54.1159200Z  2024-12-18T00:07:54.1159610Z  2024-12-18T00:07:54.1160039Z  2024-12-18T00:07:54.1160649Z [13,211 / 15,187] 48 actions running 2024-12-18T00:07:54.1161412Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:07:54.1162344Z Compiling xla/hlo/builder/lib/approx_topk.cc; 9s local 2024-12-18T00:07:54.1163400Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:07:54.1164578Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:07:54.1165768Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2024-12-18T00:07:54.1166858Z Compiling xla/service/dynamic_window_utils.cc; 8s local 2024-12-18T00:07:54.1167823Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:07:54.1168875Z Compiling external/xla/xla/service/hlo.pb.cc; 5s local ... 2024-12-18T00:07:54.3414144Z 2024-12-18T00:07:54.3415561Z  2024-12-18T00:07:54.3416086Z  2024-12-18T00:07:54.3416581Z  2024-12-18T00:07:54.3417024Z  2024-12-18T00:07:54.3417503Z  2024-12-18T00:07:54.3417974Z  2024-12-18T00:07:54.3418418Z  2024-12-18T00:07:54.3418895Z  2024-12-18T00:07:54.3419591Z [13,215 / 15,187] 48 actions, 47 running 2024-12-18T00:07:54.3420633Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:07:54.3421403Z Compiling xla/hlo/builder/lib/approx_topk.cc; 9s local 2024-12-18T00:07:54.3422295Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:07:54.3423396Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:07:54.3424580Z Compiling xla/service/dynamic_window_utils.cc; 8s local 2024-12-18T00:07:54.3425363Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:07:54.3426261Z Compiling external/xla/xla/service/hlo.pb.cc; 5s local 2024-12-18T00:07:54.3427125Z Compiling llvm/lib/Support/ScopedPrinter.cpp; 3s local ... 2024-12-18T00:07:54.6567663Z 2024-12-18T00:07:54.6568918Z  2024-12-18T00:07:54.6569331Z  2024-12-18T00:07:54.6569677Z  2024-12-18T00:07:54.6570043Z  2024-12-18T00:07:54.6570384Z  2024-12-18T00:07:54.6570743Z  2024-12-18T00:07:54.6571073Z  2024-12-18T00:07:54.6571419Z  2024-12-18T00:07:54.6571934Z [13,220 / 15,187] 48 actions, 47 running 2024-12-18T00:07:54.6572705Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2024-12-18T00:07:54.6573625Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:07:54.6574462Z Compiling xla/service/dynamic_window_utils.cc; 9s local 2024-12-18T00:07:54.6575261Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:07:54.6576083Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local 2024-12-18T00:07:54.6576942Z Compiling llvm/lib/Support/TimeProfiler.cpp; 2s local 2024-12-18T00:07:54.6577565Z Compiling llvm/lib/Support/Timer.cpp; 2s local 2024-12-18T00:07:54.6578271Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 2s local ... 2024-12-18T00:07:54.8587081Z 2024-12-18T00:07:54.8587941Z  2024-12-18T00:07:54.8588375Z  2024-12-18T00:07:54.8588780Z  2024-12-18T00:07:54.8589137Z  2024-12-18T00:07:54.8589457Z  2024-12-18T00:07:54.8589807Z  2024-12-18T00:07:54.8590158Z  2024-12-18T00:07:54.8590514Z  2024-12-18T00:07:54.8591093Z [13,222 / 15,187] 48 actions, 47 running 2024-12-18T00:07:54.8591949Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2024-12-18T00:07:54.8593054Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:07:54.8594012Z Compiling xla/service/dynamic_window_utils.cc; 9s local 2024-12-18T00:07:54.8594961Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:07:54.8595965Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local 2024-12-18T00:07:54.8596797Z Compiling llvm/lib/Support/TimeProfiler.cpp; 2s local 2024-12-18T00:07:54.8597575Z Compiling llvm/lib/Support/Timer.cpp; 2s local 2024-12-18T00:07:54.8598383Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 2s local ... 2024-12-18T00:07:55.1139034Z 2024-12-18T00:07:55.1140239Z  2024-12-18T00:07:55.1141041Z  2024-12-18T00:07:55.1141653Z  2024-12-18T00:07:55.1142285Z  2024-12-18T00:07:55.1142798Z  2024-12-18T00:07:55.1143380Z  2024-12-18T00:07:55.1146720Z  2024-12-18T00:07:55.1147239Z  2024-12-18T00:07:55.1148050Z [13,225 / 15,187] 48 actions, 47 running 2024-12-18T00:07:55.1151456Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:07:55.1152596Z Compiling xla/service/dynamic_window_utils.cc; 9s local 2024-12-18T00:07:55.1153767Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:07:55.1157202Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local 2024-12-18T00:07:55.1158129Z Compiling llvm/lib/Support/TimeProfiler.cpp; 3s local 2024-12-18T00:07:55.1159098Z Compiling llvm/lib/Support/Timer.cpp; 3s local 2024-12-18T00:07:55.1160465Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 2s local 2024-12-18T00:07:55.1161493Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 2s local ... 2024-12-18T00:07:55.3164111Z 2024-12-18T00:07:55.3164967Z  2024-12-18T00:07:55.3165431Z  2024-12-18T00:07:55.3165816Z  2024-12-18T00:07:55.3166194Z  2024-12-18T00:07:55.3166572Z  2024-12-18T00:07:55.3166918Z  2024-12-18T00:07:55.3167638Z  2024-12-18T00:07:55.3168042Z  2024-12-18T00:07:55.3168586Z [13,225 / 15,187] 48 actions running 2024-12-18T00:07:55.3169441Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:07:55.3170406Z Compiling xla/service/dynamic_window_utils.cc; 9s local 2024-12-18T00:07:55.3171393Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:07:55.3172380Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local 2024-12-18T00:07:55.3173157Z Compiling llvm/lib/Support/TimeProfiler.cpp; 3s local 2024-12-18T00:07:55.3173934Z Compiling llvm/lib/Support/Timer.cpp; 3s local 2024-12-18T00:07:55.3174664Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 2s local 2024-12-18T00:07:55.3175601Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 2s local ... 2024-12-18T00:07:55.5621632Z 2024-12-18T00:07:55.5622551Z  2024-12-18T00:07:55.5623061Z  2024-12-18T00:07:55.5623516Z  2024-12-18T00:07:55.5623963Z  2024-12-18T00:07:55.5624392Z  2024-12-18T00:07:55.5624819Z  2024-12-18T00:07:55.5625239Z  2024-12-18T00:07:55.5625658Z  2024-12-18T00:07:55.5626289Z [13,228 / 15,187] 48 actions, 47 running 2024-12-18T00:07:55.5627306Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:07:55.5628424Z Compiling xla/service/dynamic_window_utils.cc; 10s local 2024-12-18T00:07:55.5629355Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local 2024-12-18T00:07:55.5630294Z Compiling llvm/lib/Support/TimeProfiler.cpp; 3s local 2024-12-18T00:07:55.5631269Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 3s local 2024-12-18T00:07:55.5632115Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 3s local 2024-12-18T00:07:55.5632954Z Compiling llvm/lib/Support/YAMLParser.cpp; 3s local 2024-12-18T00:07:55.5633738Z Compiling llvm/lib/Support/YAMLTraits.cpp; 3s local ... 2024-12-18T00:07:55.9178176Z 2024-12-18T00:07:55.9179058Z  2024-12-18T00:07:55.9179543Z  2024-12-18T00:07:55.9179958Z  2024-12-18T00:07:55.9180350Z  2024-12-18T00:07:55.9180731Z  2024-12-18T00:07:55.9181140Z  2024-12-18T00:07:55.9181529Z  2024-12-18T00:07:55.9181921Z  2024-12-18T00:07:55.9182646Z [13,230 / 15,187] 48 actions running 2024-12-18T00:07:55.9183563Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:07:55.9184569Z Compiling xla/service/dynamic_window_utils.cc; 10s local 2024-12-18T00:07:55.9185453Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local 2024-12-18T00:07:55.9186268Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 3s local 2024-12-18T00:07:55.9187100Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 3s local 2024-12-18T00:07:55.9187907Z Compiling llvm/lib/Support/YAMLParser.cpp; 3s local 2024-12-18T00:07:55.9188719Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 2s local 2024-12-18T00:07:55.9189692Z ...ry_space_assignment:memory_space_assignment_proto_cc_impl; 2s local ... 2024-12-18T00:07:56.1187466Z 2024-12-18T00:07:56.1188283Z  2024-12-18T00:07:56.1188773Z  2024-12-18T00:07:56.1189181Z  2024-12-18T00:07:56.1189531Z  2024-12-18T00:07:56.1189933Z  2024-12-18T00:07:56.1190334Z  2024-12-18T00:07:56.1190733Z  2024-12-18T00:07:56.1191118Z  2024-12-18T00:07:56.1191710Z [13,232 / 15,187] 48 actions running 2024-12-18T00:07:56.1192608Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:07:56.1194126Z Compiling xla/service/dynamic_window_utils.cc; 10s local 2024-12-18T00:07:56.1195068Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local 2024-12-18T00:07:56.1195934Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 3s local 2024-12-18T00:07:56.1196830Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 3s local 2024-12-18T00:07:56.1197941Z Compiling llvm/lib/Support/YAMLParser.cpp; 3s local 2024-12-18T00:07:56.1198808Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 2s local 2024-12-18T00:07:56.1199809Z ...ry_space_assignment:memory_space_assignment_proto_cc_impl; 2s local ... 2024-12-18T00:07:56.3411983Z 2024-12-18T00:07:56.3413003Z  2024-12-18T00:07:56.3413430Z  2024-12-18T00:07:56.3413807Z  2024-12-18T00:07:56.3414181Z  2024-12-18T00:07:56.3415245Z  2024-12-18T00:07:56.3415580Z  2024-12-18T00:07:56.3415920Z  2024-12-18T00:07:56.3416269Z  2024-12-18T00:07:56.3416936Z [13,233 / 15,187] 48 actions, 47 running 2024-12-18T00:07:56.3417753Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:07:56.3418619Z Compiling xla/service/dynamic_window_utils.cc; 10s local 2024-12-18T00:07:56.3419338Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local 2024-12-18T00:07:56.3420085Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 3s local 2024-12-18T00:07:56.3420858Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 3s local 2024-12-18T00:07:56.3421589Z Compiling llvm/lib/Support/YAMLParser.cpp; 3s local 2024-12-18T00:07:56.3422361Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local 2024-12-18T00:07:56.3423271Z ...ry_space_assignment:memory_space_assignment_proto_cc_impl; 2s local ... 2024-12-18T00:07:56.7046483Z 2024-12-18T00:07:56.7047412Z  2024-12-18T00:07:56.7047954Z  2024-12-18T00:07:56.7048392Z  2024-12-18T00:07:56.7048823Z  2024-12-18T00:07:56.7049299Z  2024-12-18T00:07:56.7049710Z  2024-12-18T00:07:56.7050158Z  2024-12-18T00:07:56.7050557Z  2024-12-18T00:07:56.7051203Z [13,235 / 15,187] 48 actions, 47 running 2024-12-18T00:07:56.7052184Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:07:56.7053255Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2024-12-18T00:07:56.7054178Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 4s local 2024-12-18T00:07:56.7055101Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 4s local 2024-12-18T00:07:56.7056061Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local 2024-12-18T00:07:56.7057227Z ...memory_space_assignment:memory_space_assignment_proto_cc_impl; 3s local 2024-12-18T00:07:56.7058196Z Compiling xla/hlo/utils/hlo_query.cc; 3s local 2024-12-18T00:07:56.7059087Z Compiling xla/service/collective_ops_utils.cc; 3s local ... 2024-12-18T00:07:56.9189186Z 2024-12-18T00:07:56.9190097Z  2024-12-18T00:07:56.9190604Z  2024-12-18T00:07:56.9190983Z  2024-12-18T00:07:56.9191289Z  2024-12-18T00:07:56.9191595Z  2024-12-18T00:07:56.9191890Z  2024-12-18T00:07:56.9192199Z  2024-12-18T00:07:56.9192610Z  2024-12-18T00:07:56.9193200Z [13,238 / 15,187] 48 actions running 2024-12-18T00:07:56.9194193Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:07:56.9195270Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2024-12-18T00:07:56.9196117Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 4s local 2024-12-18T00:07:56.9197036Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 4s local 2024-12-18T00:07:56.9198061Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local 2024-12-18T00:07:56.9198860Z Compiling xla/hlo/utils/hlo_query.cc; 3s local 2024-12-18T00:07:56.9199632Z Compiling xla/service/collective_ops_utils.cc; 3s local 2024-12-18T00:07:56.9200432Z Compiling xla/hlo/parser/hlo_parser.cc; 3s local ... 2024-12-18T00:07:57.1193219Z 2024-12-18T00:07:57.1194074Z  2024-12-18T00:07:57.1194517Z  2024-12-18T00:07:57.1194882Z  2024-12-18T00:07:57.1195239Z  2024-12-18T00:07:57.1195581Z  2024-12-18T00:07:57.1195924Z  2024-12-18T00:07:57.1196264Z  2024-12-18T00:07:57.1196633Z  2024-12-18T00:07:57.1197578Z [13,239 / 15,187] 48 actions running 2024-12-18T00:07:57.1198495Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:07:57.1199408Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2024-12-18T00:07:57.1200205Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 4s local 2024-12-18T00:07:57.1201027Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 4s local 2024-12-18T00:07:57.1201879Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local 2024-12-18T00:07:57.1202683Z Compiling xla/hlo/utils/hlo_query.cc; 3s local 2024-12-18T00:07:57.1203429Z Compiling xla/service/collective_ops_utils.cc; 3s local 2024-12-18T00:07:57.1204284Z Compiling xla/hlo/parser/hlo_parser.cc; 3s local ... 2024-12-18T00:07:57.4990308Z 2024-12-18T00:07:57.4991175Z  2024-12-18T00:07:57.4991609Z  2024-12-18T00:07:57.4991979Z  2024-12-18T00:07:57.4992358Z  2024-12-18T00:07:57.4992745Z  2024-12-18T00:07:57.4993111Z  2024-12-18T00:07:57.4993474Z  2024-12-18T00:07:57.4993862Z  2024-12-18T00:07:57.4994416Z [13,240 / 15,187] 48 actions, 47 running 2024-12-18T00:07:57.4995264Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:07:57.4996110Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:07:57.4996853Z Compiling mlir/lib/IR/Dialect.cpp [for tool]; 5s local 2024-12-18T00:07:57.4997645Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2024-12-18T00:07:57.4998423Z Compiling xla/hlo/utils/hlo_query.cc; 3s local 2024-12-18T00:07:57.4999266Z Compiling xla/service/collective_ops_utils.cc; 3s local 2024-12-18T00:07:57.4999926Z Compiling xla/hlo/parser/hlo_parser.cc; 3s local 2024-12-18T00:07:57.5000761Z Compiling external/xla/xla/service/gpu/backend_configs.pb.cc; 3s local ... 2024-12-18T00:07:57.7198629Z 2024-12-18T00:07:57.7199488Z  2024-12-18T00:07:57.7199939Z  2024-12-18T00:07:57.7200309Z  2024-12-18T00:07:57.7200733Z  2024-12-18T00:07:57.7201110Z  2024-12-18T00:07:57.7201515Z  2024-12-18T00:07:57.7201875Z  2024-12-18T00:07:57.7202226Z  2024-12-18T00:07:57.7202774Z [13,242 / 15,187] 48 actions running 2024-12-18T00:07:57.7203668Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:07:57.7204729Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:07:57.7205559Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2024-12-18T00:07:57.7206300Z Compiling xla/hlo/utils/hlo_query.cc; 4s local 2024-12-18T00:07:57.7207092Z Compiling xla/service/collective_ops_utils.cc; 4s local 2024-12-18T00:07:57.7207889Z Compiling xla/hlo/parser/hlo_parser.cc; 4s local 2024-12-18T00:07:57.7208808Z Compiling external/xla/xla/service/gpu/backend_configs.pb.cc; 4s local 2024-12-18T00:07:57.7209752Z Compiling xla/stream_executor/dnn.cc; 4s local ... 2024-12-18T00:07:58.0392281Z 2024-12-18T00:07:58.0393143Z  2024-12-18T00:07:58.0393604Z  2024-12-18T00:07:58.0393983Z  2024-12-18T00:07:58.0394353Z  2024-12-18T00:07:58.0394728Z  2024-12-18T00:07:58.0395114Z  2024-12-18T00:07:58.0395505Z  2024-12-18T00:07:58.0395875Z  2024-12-18T00:07:58.0396465Z [13,243 / 15,187] 48 actions, 47 running 2024-12-18T00:07:58.0397308Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:07:58.0398203Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:07:58.0398867Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2024-12-18T00:07:58.0400012Z Compiling xla/hlo/utils/hlo_query.cc; 4s local 2024-12-18T00:07:58.0400723Z Compiling xla/service/collective_ops_utils.cc; 4s local 2024-12-18T00:07:58.0401485Z Compiling xla/hlo/parser/hlo_parser.cc; 4s local 2024-12-18T00:07:58.0402174Z Compiling xla/stream_executor/dnn.cc; 4s local 2024-12-18T00:07:58.0403139Z Compiling xla/service/dot_as_convolution_util.cc; 4s local ... 2024-12-18T00:07:58.3205265Z 2024-12-18T00:07:58.3206092Z  2024-12-18T00:07:58.3206543Z  2024-12-18T00:07:58.3206945Z  2024-12-18T00:07:58.3207327Z  2024-12-18T00:07:58.3207713Z  2024-12-18T00:07:58.3208142Z  2024-12-18T00:07:58.3208569Z  2024-12-18T00:07:58.3208907Z  2024-12-18T00:07:58.3209524Z [13,245 / 15,187] 48 actions running 2024-12-18T00:07:58.3210352Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:07:58.3211274Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:07:58.3212419Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2024-12-18T00:07:58.3213227Z Compiling xla/hlo/utils/hlo_query.cc; 4s local 2024-12-18T00:07:58.3213972Z Compiling xla/service/collective_ops_utils.cc; 4s local 2024-12-18T00:07:58.3214771Z Compiling xla/hlo/parser/hlo_parser.cc; 4s local 2024-12-18T00:07:58.3215538Z Compiling xla/stream_executor/dnn.cc; 4s local 2024-12-18T00:07:58.3216523Z Compiling xla/service/dot_as_convolution_util.cc; 4s local ... 2024-12-18T00:07:58.6916140Z 2024-12-18T00:07:58.6916980Z  2024-12-18T00:07:58.6917438Z  2024-12-18T00:07:58.6917827Z  2024-12-18T00:07:58.6918221Z  2024-12-18T00:07:58.6918601Z  2024-12-18T00:07:58.6918942Z  2024-12-18T00:07:58.6919307Z  2024-12-18T00:07:58.6919677Z  2024-12-18T00:07:58.6920262Z [13,246 / 15,187] 48 actions, 47 running 2024-12-18T00:07:58.6921189Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:07:58.6922217Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2024-12-18T00:07:58.6923066Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2024-12-18T00:07:58.6923874Z Compiling xla/hlo/utils/hlo_query.cc; 5s local 2024-12-18T00:07:58.6924669Z Compiling xla/service/collective_ops_utils.cc; 5s local 2024-12-18T00:07:58.6925492Z Compiling xla/hlo/parser/hlo_parser.cc; 5s local 2024-12-18T00:07:58.6926141Z Compiling xla/stream_executor/dnn.cc; 5s local 2024-12-18T00:07:58.6926872Z Compiling xla/service/dot_as_convolution_util.cc; 4s local ... 2024-12-18T00:07:58.9211327Z 2024-12-18T00:07:58.9212145Z  2024-12-18T00:07:58.9212606Z  2024-12-18T00:07:58.9212992Z  2024-12-18T00:07:58.9213376Z  2024-12-18T00:07:58.9213751Z  2024-12-18T00:07:58.9214135Z  2024-12-18T00:07:58.9214523Z  2024-12-18T00:07:58.9214910Z  2024-12-18T00:07:58.9215497Z [13,247 / 15,187] 48 actions running 2024-12-18T00:07:58.9216561Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:07:58.9217563Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2024-12-18T00:07:58.9218425Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2024-12-18T00:07:58.9219222Z Compiling xla/hlo/utils/hlo_query.cc; 5s local 2024-12-18T00:07:58.9219999Z Compiling xla/service/collective_ops_utils.cc; 5s local 2024-12-18T00:07:58.9220744Z Compiling xla/hlo/parser/hlo_parser.cc; 5s local 2024-12-18T00:07:58.9221451Z Compiling xla/stream_executor/dnn.cc; 5s local 2024-12-18T00:07:58.9222258Z Compiling xla/service/dot_as_convolution_util.cc; 5s local ... 2024-12-18T00:07:59.2410828Z 2024-12-18T00:07:59.2411691Z  2024-12-18T00:07:59.2412161Z  2024-12-18T00:07:59.2412554Z  2024-12-18T00:07:59.2412947Z  2024-12-18T00:07:59.2413326Z  2024-12-18T00:07:59.2413699Z  2024-12-18T00:07:59.2414493Z  2024-12-18T00:07:59.2414882Z  2024-12-18T00:07:59.2415434Z [13,248 / 15,187] 48 actions, 47 running 2024-12-18T00:07:59.2416281Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:07:59.2417362Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2024-12-18T00:07:59.2418493Z Compiling xla/hlo/utils/hlo_query.cc; 5s local 2024-12-18T00:07:59.2419276Z Compiling xla/service/collective_ops_utils.cc; 5s local 2024-12-18T00:07:59.2420033Z Compiling xla/hlo/parser/hlo_parser.cc; 5s local 2024-12-18T00:07:59.2420694Z Compiling xla/stream_executor/dnn.cc; 5s local 2024-12-18T00:07:59.2421455Z Compiling xla/service/dot_as_convolution_util.cc; 5s local 2024-12-18T00:07:59.2422282Z Compiling xla/hlo/builder/xla_builder.cc; 5s local ... 2024-12-18T00:07:59.4738940Z 2024-12-18T00:07:59.4739823Z  2024-12-18T00:07:59.4740434Z  2024-12-18T00:07:59.4740841Z  2024-12-18T00:07:59.4741288Z  2024-12-18T00:07:59.4741682Z  2024-12-18T00:07:59.4742082Z  2024-12-18T00:07:59.4742470Z  2024-12-18T00:07:59.4742851Z  2024-12-18T00:07:59.4743437Z [13,250 / 15,187] 48 actions, 47 running 2024-12-18T00:07:59.4744638Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:07:59.4745749Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2024-12-18T00:07:59.4746575Z Compiling xla/hlo/utils/hlo_query.cc; 5s local 2024-12-18T00:07:59.4747345Z Compiling xla/service/collective_ops_utils.cc; 5s local 2024-12-18T00:07:59.4748129Z Compiling xla/hlo/parser/hlo_parser.cc; 5s local 2024-12-18T00:07:59.4748859Z Compiling xla/stream_executor/dnn.cc; 5s local 2024-12-18T00:07:59.4749656Z Compiling xla/service/dot_as_convolution_util.cc; 5s local 2024-12-18T00:07:59.4750490Z Compiling xla/hlo/builder/xla_builder.cc; 5s local ... 2024-12-18T00:07:59.7223036Z 2024-12-18T00:07:59.7223973Z  2024-12-18T00:07:59.7224471Z  2024-12-18T00:07:59.7224863Z  2024-12-18T00:07:59.7225225Z  2024-12-18T00:07:59.7225610Z  2024-12-18T00:07:59.7225977Z  2024-12-18T00:07:59.7226355Z  2024-12-18T00:07:59.7226743Z  2024-12-18T00:07:59.7227325Z [13,252 / 15,187] 48 actions running 2024-12-18T00:07:59.7228177Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:07:59.7229202Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2024-12-18T00:07:59.7230014Z Compiling xla/hlo/utils/hlo_query.cc; 6s local 2024-12-18T00:07:59.7230751Z Compiling xla/service/collective_ops_utils.cc; 6s local 2024-12-18T00:07:59.7231518Z Compiling xla/hlo/parser/hlo_parser.cc; 6s local 2024-12-18T00:07:59.7232244Z Compiling xla/stream_executor/dnn.cc; 6s local 2024-12-18T00:07:59.7233005Z Compiling xla/service/dot_as_convolution_util.cc; 5s local 2024-12-18T00:07:59.7233857Z Compiling xla/hlo/builder/xla_builder.cc; 5s local ... 2024-12-18T00:07:59.9226162Z 2024-12-18T00:07:59.9227013Z  2024-12-18T00:07:59.9227494Z  2024-12-18T00:07:59.9227884Z  2024-12-18T00:07:59.9228230Z  2024-12-18T00:07:59.9228617Z  2024-12-18T00:07:59.9229001Z  2024-12-18T00:07:59.9229361Z  2024-12-18T00:07:59.9229706Z  2024-12-18T00:07:59.9230246Z [13,254 / 15,187] 48 actions running 2024-12-18T00:07:59.9231132Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:07:59.9232107Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2024-12-18T00:07:59.9232848Z Compiling xla/hlo/utils/hlo_query.cc; 6s local 2024-12-18T00:07:59.9233592Z Compiling xla/service/collective_ops_utils.cc; 6s local 2024-12-18T00:07:59.9234385Z Compiling xla/hlo/parser/hlo_parser.cc; 6s local 2024-12-18T00:07:59.9235114Z Compiling xla/stream_executor/dnn.cc; 6s local 2024-12-18T00:07:59.9235862Z Compiling xla/service/dot_as_convolution_util.cc; 6s local 2024-12-18T00:07:59.9237123Z Compiling xla/hlo/builder/xla_builder.cc; 6s local ... 2024-12-18T00:08:00.3007276Z 2024-12-18T00:08:00.3008206Z  2024-12-18T00:08:00.3008725Z  2024-12-18T00:08:00.3009122Z  2024-12-18T00:08:00.3009539Z  2024-12-18T00:08:00.3009925Z  2024-12-18T00:08:00.3010324Z  2024-12-18T00:08:00.3010734Z  2024-12-18T00:08:00.3011466Z  2024-12-18T00:08:00.3012091Z [13,256 / 15,187] 48 actions, 47 running 2024-12-18T00:08:00.3013027Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:08:00.3014114Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2024-12-18T00:08:00.3014956Z Compiling xla/hlo/utils/hlo_query.cc; 6s local 2024-12-18T00:08:00.3015745Z Compiling xla/service/collective_ops_utils.cc; 6s local 2024-12-18T00:08:00.3016701Z Compiling xla/hlo/parser/hlo_parser.cc; 6s local 2024-12-18T00:08:00.3017456Z Compiling xla/stream_executor/dnn.cc; 6s local 2024-12-18T00:08:00.3018337Z Compiling xla/service/dot_as_convolution_util.cc; 6s local 2024-12-18T00:08:00.3019189Z Compiling xla/hlo/builder/xla_builder.cc; 6s local ... 2024-12-18T00:08:00.5228195Z 2024-12-18T00:08:00.5229409Z  2024-12-18T00:08:00.5229881Z  2024-12-18T00:08:00.5230267Z  2024-12-18T00:08:00.5230657Z  2024-12-18T00:08:00.5231080Z  2024-12-18T00:08:00.5231486Z  2024-12-18T00:08:00.5231867Z  2024-12-18T00:08:00.5232238Z  2024-12-18T00:08:00.5232805Z [13,263 / 15,187] 48 actions running 2024-12-18T00:08:00.5233722Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:08:00.5234770Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 8s local 2024-12-18T00:08:00.5235593Z Compiling xla/hlo/utils/hlo_query.cc; 7s local 2024-12-18T00:08:00.5236364Z Compiling xla/service/collective_ops_utils.cc; 7s local 2024-12-18T00:08:00.5237196Z Compiling xla/hlo/parser/hlo_parser.cc; 6s local 2024-12-18T00:08:00.5237936Z Compiling xla/stream_executor/dnn.cc; 6s local 2024-12-18T00:08:00.5238747Z Compiling xla/service/dot_as_convolution_util.cc; 6s local 2024-12-18T00:08:00.5239597Z Compiling xla/hlo/builder/xla_builder.cc; 6s local ... 2024-12-18T00:08:00.7251766Z 2024-12-18T00:08:00.7252931Z  2024-12-18T00:08:00.7253724Z  2024-12-18T00:08:00.7254299Z  2024-12-18T00:08:00.7254905Z  2024-12-18T00:08:00.7255593Z  2024-12-18T00:08:00.7256817Z  2024-12-18T00:08:00.7257217Z  2024-12-18T00:08:00.7257593Z  2024-12-18T00:08:00.7258204Z [13,269 / 15,187] 48 actions, 47 running 2024-12-18T00:08:00.7259058Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:08:00.7260101Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 8s local 2024-12-18T00:08:00.7260900Z Compiling xla/hlo/utils/hlo_query.cc; 7s local 2024-12-18T00:08:00.7261675Z Compiling xla/service/collective_ops_utils.cc; 7s local 2024-12-18T00:08:00.7262470Z Compiling xla/hlo/parser/hlo_parser.cc; 7s local 2024-12-18T00:08:00.7263190Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:08:00.7264012Z Compiling xla/service/dot_as_convolution_util.cc; 6s local 2024-12-18T00:08:00.7264859Z Compiling xla/hlo/builder/xla_builder.cc; 6s local ... 2024-12-18T00:08:00.9304140Z 2024-12-18T00:08:00.9305415Z  2024-12-18T00:08:00.9305960Z  2024-12-18T00:08:00.9306539Z  2024-12-18T00:08:00.9307029Z  2024-12-18T00:08:00.9307486Z  2024-12-18T00:08:00.9307942Z  2024-12-18T00:08:00.9319113Z  2024-12-18T00:08:00.9320064Z  2024-12-18T00:08:00.9320793Z [13,288 / 15,187] 48 actions, 47 running 2024-12-18T00:08:00.9321818Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:08:00.9322846Z Compiling xla/hlo/utils/hlo_query.cc; 7s local 2024-12-18T00:08:00.9324102Z Compiling xla/service/collective_ops_utils.cc; 7s local 2024-12-18T00:08:00.9325027Z Compiling xla/hlo/parser/hlo_parser.cc; 7s local 2024-12-18T00:08:00.9325840Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:08:00.9326730Z Compiling xla/service/dot_as_convolution_util.cc; 7s local 2024-12-18T00:08:00.9327619Z Compiling xla/hlo/builder/xla_builder.cc; 7s local 2024-12-18T00:08:00.9328727Z Compiling xla/service/shape_inference.cc; 7s local ... 2024-12-18T00:08:01.1322516Z 2024-12-18T00:08:01.1323425Z  2024-12-18T00:08:01.1323860Z  2024-12-18T00:08:01.1324193Z  2024-12-18T00:08:01.1324578Z  2024-12-18T00:08:01.1324965Z  2024-12-18T00:08:01.1325325Z  2024-12-18T00:08:01.1325705Z  2024-12-18T00:08:01.1326063Z  2024-12-18T00:08:01.1326632Z [13,304 / 15,187] 48 actions, 47 running 2024-12-18T00:08:01.1327541Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:08:01.1328480Z Compiling xla/hlo/utils/hlo_query.cc; 7s local 2024-12-18T00:08:01.1329238Z Compiling xla/service/collective_ops_utils.cc; 7s local 2024-12-18T00:08:01.1330038Z Compiling xla/hlo/parser/hlo_parser.cc; 7s local 2024-12-18T00:08:01.1330748Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:08:01.1331512Z Compiling xla/service/dot_as_convolution_util.cc; 7s local 2024-12-18T00:08:01.1332290Z Compiling xla/hlo/builder/xla_builder.cc; 7s local 2024-12-18T00:08:01.1333011Z Compiling xla/service/shape_inference.cc; 7s local ... 2024-12-18T00:08:01.3330097Z 2024-12-18T00:08:01.3334342Z  2024-12-18T00:08:01.3334860Z  2024-12-18T00:08:01.3335204Z  2024-12-18T00:08:01.3335525Z  2024-12-18T00:08:01.3335819Z  2024-12-18T00:08:01.3336134Z  2024-12-18T00:08:01.3336629Z  2024-12-18T00:08:01.3336963Z  2024-12-18T00:08:01.3337511Z [13,321 / 15,187] 48 actions, 47 running 2024-12-18T00:08:01.3338544Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:08:01.3339388Z Compiling xla/hlo/utils/hlo_query.cc; 7s local 2024-12-18T00:08:01.3340128Z Compiling xla/service/collective_ops_utils.cc; 7s local 2024-12-18T00:08:01.3340895Z Compiling xla/hlo/parser/hlo_parser.cc; 7s local 2024-12-18T00:08:01.3341558Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:08:01.3342291Z Compiling xla/service/dot_as_convolution_util.cc; 7s local 2024-12-18T00:08:01.3343029Z Compiling xla/hlo/builder/xla_builder.cc; 7s local 2024-12-18T00:08:01.3343717Z Compiling xla/service/shape_inference.cc; 7s local ... 2024-12-18T00:08:01.5495125Z 2024-12-18T00:08:01.5496104Z  2024-12-18T00:08:01.5496705Z  2024-12-18T00:08:01.5497114Z  2024-12-18T00:08:01.5497517Z  2024-12-18T00:08:01.5497924Z  2024-12-18T00:08:01.5498327Z  2024-12-18T00:08:01.5498732Z  2024-12-18T00:08:01.5499120Z  2024-12-18T00:08:01.5499787Z [13,349 / 15,187] 48 actions, 47 running 2024-12-18T00:08:01.5500680Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:08:01.5501628Z Compiling xla/hlo/utils/hlo_query.cc; 8s local 2024-12-18T00:08:01.5502432Z Compiling xla/service/collective_ops_utils.cc; 8s local 2024-12-18T00:08:01.5503304Z Compiling xla/hlo/parser/hlo_parser.cc; 8s local 2024-12-18T00:08:01.5504064Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:08:01.5504890Z Compiling xla/service/dot_as_convolution_util.cc; 7s local 2024-12-18T00:08:01.5505726Z Compiling xla/hlo/builder/xla_builder.cc; 7s local 2024-12-18T00:08:01.5506530Z Compiling xla/service/shape_inference.cc; 7s local ... 2024-12-18T00:08:01.7640250Z 2024-12-18T00:08:01.7641350Z  2024-12-18T00:08:01.7642083Z  2024-12-18T00:08:01.7642715Z  2024-12-18T00:08:01.7643776Z  2024-12-18T00:08:01.7644403Z  2024-12-18T00:08:01.7645179Z  2024-12-18T00:08:01.7645568Z  2024-12-18T00:08:01.7645989Z  2024-12-18T00:08:01.7646595Z [13,378 / 15,187] 48 actions, 47 running 2024-12-18T00:08:01.7647713Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:08:01.7648738Z Compiling xla/hlo/utils/hlo_query.cc; 8s local 2024-12-18T00:08:01.7649703Z Compiling xla/service/collective_ops_utils.cc; 8s local 2024-12-18T00:08:01.7650565Z Compiling xla/hlo/parser/hlo_parser.cc; 8s local 2024-12-18T00:08:01.7651293Z Compiling xla/stream_executor/dnn.cc; 8s local 2024-12-18T00:08:01.7652080Z Compiling xla/service/dot_as_convolution_util.cc; 7s local 2024-12-18T00:08:01.7652920Z Compiling xla/hlo/builder/xla_builder.cc; 7s local 2024-12-18T00:08:01.7653731Z Compiling xla/service/shape_inference.cc; 7s local ... 2024-12-18T00:08:01.9675690Z 2024-12-18T00:08:01.9676994Z  2024-12-18T00:08:01.9677501Z  2024-12-18T00:08:01.9677899Z  2024-12-18T00:08:01.9678362Z  2024-12-18T00:08:01.9678769Z  2024-12-18T00:08:01.9679189Z  2024-12-18T00:08:01.9679615Z  2024-12-18T00:08:01.9680032Z  2024-12-18T00:08:01.9680668Z [13,401 / 15,187] 48 actions, 47 running 2024-12-18T00:08:01.9681662Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:08:01.9682703Z Compiling xla/hlo/utils/hlo_query.cc; 8s local 2024-12-18T00:08:01.9683480Z Compiling xla/service/collective_ops_utils.cc; 8s local 2024-12-18T00:08:01.9684279Z Compiling xla/hlo/parser/hlo_parser.cc; 8s local 2024-12-18T00:08:01.9685015Z Compiling xla/stream_executor/dnn.cc; 8s local 2024-12-18T00:08:01.9685816Z Compiling xla/service/dot_as_convolution_util.cc; 8s local 2024-12-18T00:08:01.9686695Z Compiling xla/hlo/builder/xla_builder.cc; 8s local 2024-12-18T00:08:01.9687487Z Compiling xla/service/shape_inference.cc; 8s local ... 2024-12-18T00:08:02.1888867Z 2024-12-18T00:08:02.1889953Z  2024-12-18T00:08:02.1890470Z  2024-12-18T00:08:02.1890859Z  2024-12-18T00:08:02.1891255Z  2024-12-18T00:08:02.1891654Z  2024-12-18T00:08:02.1892121Z  2024-12-18T00:08:02.1892500Z  2024-12-18T00:08:02.1892907Z  2024-12-18T00:08:02.1893541Z [13,433 / 15,187] 48 actions, 47 running 2024-12-18T00:08:02.1894485Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:08:02.1895511Z Compiling xla/hlo/utils/hlo_query.cc; 8s local 2024-12-18T00:08:02.1896261Z Compiling xla/service/collective_ops_utils.cc; 8s local 2024-12-18T00:08:02.1897184Z Compiling xla/hlo/parser/hlo_parser.cc; 8s local 2024-12-18T00:08:02.1897905Z Compiling xla/stream_executor/dnn.cc; 8s local 2024-12-18T00:08:02.1898641Z Compiling xla/hlo/builder/xla_builder.cc; 8s local 2024-12-18T00:08:02.1899388Z Compiling xla/service/shape_inference.cc; 8s local 2024-12-18T00:08:02.1900182Z Compiling xla/hlo/ir/dfs_hlo_visitor.cc; 8s local ... 2024-12-18T00:08:02.4747925Z 2024-12-18T00:08:02.4748810Z  2024-12-18T00:08:02.4749361Z  2024-12-18T00:08:02.4749810Z  2024-12-18T00:08:02.4750167Z  2024-12-18T00:08:02.4750676Z  2024-12-18T00:08:02.4751119Z  2024-12-18T00:08:02.4751592Z  2024-12-18T00:08:02.4751965Z  2024-12-18T00:08:02.4752598Z [13,444 / 15,187] 48 actions, 47 running 2024-12-18T00:08:02.4753424Z Compiling xla/hlo/utils/hlo_query.cc; 8s local 2024-12-18T00:08:02.4754190Z Compiling xla/service/collective_ops_utils.cc; 8s local 2024-12-18T00:08:02.4755086Z Compiling xla/hlo/parser/hlo_parser.cc; 8s local 2024-12-18T00:08:02.4755843Z Compiling xla/hlo/builder/xla_builder.cc; 8s local 2024-12-18T00:08:02.4756658Z Compiling xla/service/shape_inference.cc; 8s local 2024-12-18T00:08:02.4757381Z Compiling xla/hlo/ir/dfs_hlo_visitor.cc; 8s local 2024-12-18T00:08:02.4758288Z Compiling xla/hlo/ir/dynamic_parameter_binding.cc; 8s local 2024-12-18T00:08:02.4759677Z Compiling xla/hlo/ir/hlo_computation.cc; 8s local ... 2024-12-18T00:08:02.7085223Z 2024-12-18T00:08:02.7087643Z  2024-12-18T00:08:02.7088158Z  2024-12-18T00:08:02.7088556Z  2024-12-18T00:08:02.7088940Z  2024-12-18T00:08:02.7089339Z  2024-12-18T00:08:02.7089746Z  2024-12-18T00:08:02.7090116Z  2024-12-18T00:08:02.7090505Z  2024-12-18T00:08:02.7091503Z [13,458 / 15,187] 48 actions, 47 running 2024-12-18T00:08:02.7092419Z Compiling xla/hlo/utils/hlo_query.cc; 9s local 2024-12-18T00:08:02.7093182Z Compiling xla/service/collective_ops_utils.cc; 9s local 2024-12-18T00:08:02.7093974Z Compiling xla/hlo/parser/hlo_parser.cc; 9s local 2024-12-18T00:08:02.7094744Z Compiling xla/hlo/builder/xla_builder.cc; 8s local 2024-12-18T00:08:02.7095463Z Compiling xla/service/shape_inference.cc; 8s local 2024-12-18T00:08:02.7096236Z Compiling xla/hlo/ir/dfs_hlo_visitor.cc; 8s local 2024-12-18T00:08:02.7097218Z Compiling xla/hlo/ir/dynamic_parameter_binding.cc; 8s local 2024-12-18T00:08:02.7098062Z Compiling xla/hlo/ir/hlo_computation.cc; 8s local ... 2024-12-18T00:08:02.9243297Z 2024-12-18T00:08:02.9244618Z  2024-12-18T00:08:02.9245416Z  2024-12-18T00:08:02.9246587Z  2024-12-18T00:08:02.9247028Z  2024-12-18T00:08:02.9247392Z  2024-12-18T00:08:02.9247785Z  2024-12-18T00:08:02.9248198Z  2024-12-18T00:08:02.9248586Z  2024-12-18T00:08:02.9249145Z [13,463 / 15,187] 48 actions running 2024-12-18T00:08:02.9249838Z Compiling xla/hlo/utils/hlo_query.cc; 9s local 2024-12-18T00:08:02.9250788Z Compiling xla/service/collective_ops_utils.cc; 9s local 2024-12-18T00:08:02.9251681Z Compiling xla/hlo/parser/hlo_parser.cc; 9s local 2024-12-18T00:08:02.9252494Z Compiling xla/hlo/builder/xla_builder.cc; 9s local 2024-12-18T00:08:02.9253348Z Compiling xla/service/shape_inference.cc; 9s local 2024-12-18T00:08:02.9254157Z Compiling xla/hlo/ir/dynamic_parameter_binding.cc; 8s local 2024-12-18T00:08:02.9255027Z Compiling xla/hlo/ir/hlo_computation.cc; 8s local 2024-12-18T00:08:02.9255982Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 8s local ... 2024-12-18T00:08:03.1283252Z 2024-12-18T00:08:03.1284056Z  2024-12-18T00:08:03.1284513Z  2024-12-18T00:08:03.1284938Z  2024-12-18T00:08:03.1285340Z  2024-12-18T00:08:03.1285776Z  2024-12-18T00:08:03.1286118Z  2024-12-18T00:08:03.1286476Z  2024-12-18T00:08:03.1286865Z  2024-12-18T00:08:03.1287438Z [13,469 / 15,187] 48 actions, 47 running 2024-12-18T00:08:03.1288163Z Compiling xla/hlo/utils/hlo_query.cc; 9s local 2024-12-18T00:08:03.1289094Z Compiling xla/service/collective_ops_utils.cc; 9s local 2024-12-18T00:08:03.1289912Z Compiling xla/hlo/parser/hlo_parser.cc; 9s local 2024-12-18T00:08:03.1290704Z Compiling xla/hlo/builder/xla_builder.cc; 9s local 2024-12-18T00:08:03.1291435Z Compiling xla/service/shape_inference.cc; 9s local 2024-12-18T00:08:03.1292309Z Compiling xla/hlo/ir/dynamic_parameter_binding.cc; 8s local 2024-12-18T00:08:03.1293191Z Compiling xla/hlo/ir/hlo_computation.cc; 8s local 2024-12-18T00:08:03.1294145Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 8s local ... 2024-12-18T00:08:03.3320732Z 2024-12-18T00:08:03.3321736Z  2024-12-18T00:08:03.3322256Z  2024-12-18T00:08:03.3322683Z  2024-12-18T00:08:03.3323059Z  2024-12-18T00:08:03.3323453Z  2024-12-18T00:08:03.3323851Z  2024-12-18T00:08:03.3324249Z  2024-12-18T00:08:03.3324655Z  2024-12-18T00:08:03.3325231Z [13,485 / 15,187] 48 actions, 47 running 2024-12-18T00:08:03.3325927Z Compiling xla/hlo/utils/hlo_query.cc; 9s local 2024-12-18T00:08:03.3326706Z Compiling xla/service/collective_ops_utils.cc; 9s local 2024-12-18T00:08:03.3327462Z Compiling xla/hlo/parser/hlo_parser.cc; 9s local 2024-12-18T00:08:03.3328211Z Compiling xla/hlo/builder/xla_builder.cc; 9s local 2024-12-18T00:08:03.3329429Z Compiling xla/service/shape_inference.cc; 9s local 2024-12-18T00:08:03.3330195Z Compiling xla/hlo/ir/hlo_computation.cc; 9s local 2024-12-18T00:08:03.3331060Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local 2024-12-18T00:08:03.3331951Z Compiling xla/hlo/ir/hlo_instruction.cc; 8s local ... 2024-12-18T00:08:03.5418756Z 2024-12-18T00:08:03.5420019Z  2024-12-18T00:08:03.5420564Z  2024-12-18T00:08:03.5420980Z  2024-12-18T00:08:03.5421368Z  2024-12-18T00:08:03.5421769Z  2024-12-18T00:08:03.5422135Z  2024-12-18T00:08:03.5422528Z  2024-12-18T00:08:03.5422899Z  2024-12-18T00:08:03.5423466Z [13,506 / 15,187] 48 actions, 47 running 2024-12-18T00:08:03.5424136Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2024-12-18T00:08:03.5424888Z Compiling xla/service/collective_ops_utils.cc; 10s local 2024-12-18T00:08:03.5425696Z Compiling xla/hlo/parser/hlo_parser.cc; 9s local 2024-12-18T00:08:03.5426435Z Compiling xla/hlo/builder/xla_builder.cc; 9s local 2024-12-18T00:08:03.5427159Z Compiling xla/service/shape_inference.cc; 9s local 2024-12-18T00:08:03.5427788Z Compiling xla/hlo/ir/hlo_computation.cc; 9s local 2024-12-18T00:08:03.5428621Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local 2024-12-18T00:08:03.5429514Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local ... 2024-12-18T00:08:03.7440165Z 2024-12-18T00:08:03.7441028Z  2024-12-18T00:08:03.7441526Z  2024-12-18T00:08:03.7441944Z  2024-12-18T00:08:03.7442327Z  2024-12-18T00:08:03.7442695Z  2024-12-18T00:08:03.7443110Z  2024-12-18T00:08:03.7443514Z  2024-12-18T00:08:03.7443930Z  2024-12-18T00:08:03.7444753Z [13,533 / 15,187] 48 actions, 47 running 2024-12-18T00:08:03.7445479Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2024-12-18T00:08:03.7446294Z Compiling xla/service/collective_ops_utils.cc; 10s local 2024-12-18T00:08:03.7447179Z Compiling xla/hlo/parser/hlo_parser.cc; 10s local 2024-12-18T00:08:03.7447943Z Compiling xla/hlo/builder/xla_builder.cc; 9s local 2024-12-18T00:08:03.7448728Z Compiling xla/service/shape_inference.cc; 9s local 2024-12-18T00:08:03.7449498Z Compiling xla/hlo/ir/hlo_computation.cc; 9s local 2024-12-18T00:08:03.7450365Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local 2024-12-18T00:08:03.7451281Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local ... 2024-12-18T00:08:03.9537979Z 2024-12-18T00:08:03.9538887Z  2024-12-18T00:08:03.9539369Z  2024-12-18T00:08:03.9539771Z  2024-12-18T00:08:03.9540154Z  2024-12-18T00:08:03.9540536Z  2024-12-18T00:08:03.9540915Z  2024-12-18T00:08:03.9541298Z  2024-12-18T00:08:03.9541681Z  2024-12-18T00:08:03.9542258Z [13,549 / 15,187] 48 actions, 47 running 2024-12-18T00:08:03.9542971Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2024-12-18T00:08:03.9543798Z Compiling xla/service/collective_ops_utils.cc; 10s local 2024-12-18T00:08:03.9544905Z Compiling xla/hlo/parser/hlo_parser.cc; 10s local 2024-12-18T00:08:03.9545702Z Compiling xla/hlo/builder/xla_builder.cc; 10s local 2024-12-18T00:08:03.9546476Z Compiling xla/service/shape_inference.cc; 10s local 2024-12-18T00:08:03.9547259Z Compiling xla/hlo/ir/hlo_computation.cc; 9s local 2024-12-18T00:08:03.9548115Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local 2024-12-18T00:08:03.9549007Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local ... 2024-12-18T00:08:04.3188009Z 2024-12-18T00:08:04.3188964Z  2024-12-18T00:08:04.3189447Z  2024-12-18T00:08:04.3189861Z  2024-12-18T00:08:04.3191070Z  2024-12-18T00:08:04.3192134Z  2024-12-18T00:08:04.3192771Z  2024-12-18T00:08:04.3193374Z  2024-12-18T00:08:04.3193979Z  2024-12-18T00:08:04.3194777Z [13,553 / 15,187] 48 actions, 47 running 2024-12-18T00:08:04.3196172Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2024-12-18T00:08:04.3197173Z Compiling xla/service/collective_ops_utils.cc; 10s local 2024-12-18T00:08:04.3198202Z Compiling xla/hlo/parser/hlo_parser.cc; 10s local 2024-12-18T00:08:04.3199292Z Compiling xla/hlo/builder/xla_builder.cc; 10s local 2024-12-18T00:08:04.3200584Z Compiling xla/service/shape_inference.cc; 10s local 2024-12-18T00:08:04.3201635Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local 2024-12-18T00:08:04.3202757Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2024-12-18T00:08:04.3203893Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local ... 2024-12-18T00:08:04.5258073Z 2024-12-18T00:08:04.5258955Z  2024-12-18T00:08:04.5259451Z  2024-12-18T00:08:04.5259877Z  2024-12-18T00:08:04.5260269Z  2024-12-18T00:08:04.5260703Z  2024-12-18T00:08:04.5261096Z  2024-12-18T00:08:04.5261500Z  2024-12-18T00:08:04.5261967Z  2024-12-18T00:08:04.5262538Z [13,553 / 15,187] 48 actions running 2024-12-18T00:08:04.5263401Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2024-12-18T00:08:04.5264172Z Compiling xla/service/collective_ops_utils.cc; 11s local 2024-12-18T00:08:04.5264953Z Compiling xla/hlo/parser/hlo_parser.cc; 10s local 2024-12-18T00:08:04.5265737Z Compiling xla/hlo/builder/xla_builder.cc; 10s local 2024-12-18T00:08:04.5266455Z Compiling xla/service/shape_inference.cc; 10s local 2024-12-18T00:08:04.5267209Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local 2024-12-18T00:08:04.5268061Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2024-12-18T00:08:04.5268925Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local ... 2024-12-18T00:08:04.7676568Z 2024-12-18T00:08:04.7677453Z  2024-12-18T00:08:04.7677934Z  2024-12-18T00:08:04.7678325Z  2024-12-18T00:08:04.7678740Z  2024-12-18T00:08:04.7679174Z  2024-12-18T00:08:04.7679626Z  2024-12-18T00:08:04.7679988Z  2024-12-18T00:08:04.7680375Z  2024-12-18T00:08:04.7680987Z [13,554 / 15,187] 48 actions, 47 running 2024-12-18T00:08:04.7681700Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2024-12-18T00:08:04.7682509Z Compiling xla/service/collective_ops_utils.cc; 11s local 2024-12-18T00:08:04.7683358Z Compiling xla/hlo/parser/hlo_parser.cc; 11s local 2024-12-18T00:08:04.7684122Z Compiling xla/hlo/builder/xla_builder.cc; 10s local 2024-12-18T00:08:04.7685033Z Compiling xla/service/shape_inference.cc; 10s local 2024-12-18T00:08:04.7685785Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local 2024-12-18T00:08:04.7686634Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2024-12-18T00:08:04.7687502Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local ... 2024-12-18T00:08:04.9781530Z 2024-12-18T00:08:04.9782478Z  2024-12-18T00:08:04.9782983Z  2024-12-18T00:08:04.9783411Z  2024-12-18T00:08:04.9783889Z  2024-12-18T00:08:04.9784322Z  2024-12-18T00:08:04.9784753Z  2024-12-18T00:08:04.9785185Z  2024-12-18T00:08:04.9785603Z  2024-12-18T00:08:04.9786245Z [13,555 / 15,187] 48 actions, 47 running 2024-12-18T00:08:04.9787036Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2024-12-18T00:08:04.9788021Z Compiling xla/service/collective_ops_utils.cc; 11s local 2024-12-18T00:08:04.9788921Z Compiling xla/hlo/parser/hlo_parser.cc; 11s local 2024-12-18T00:08:04.9789700Z Compiling xla/hlo/builder/xla_builder.cc; 11s local 2024-12-18T00:08:04.9790497Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:08:04.9791313Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local 2024-12-18T00:08:04.9792228Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2024-12-18T00:08:04.9793208Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local ... 2024-12-18T00:08:05.1831971Z 2024-12-18T00:08:05.1832866Z  2024-12-18T00:08:05.1833777Z  2024-12-18T00:08:05.1834179Z  2024-12-18T00:08:05.1834542Z  2024-12-18T00:08:05.1834910Z  2024-12-18T00:08:05.1835302Z  2024-12-18T00:08:05.1835651Z  2024-12-18T00:08:05.1835996Z  2024-12-18T00:08:05.1836571Z [13,561 / 15,187] 48 actions, 47 running 2024-12-18T00:08:05.1837238Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2024-12-18T00:08:05.1838263Z Compiling xla/service/collective_ops_utils.cc; 11s local 2024-12-18T00:08:05.1839064Z Compiling xla/hlo/parser/hlo_parser.cc; 11s local 2024-12-18T00:08:05.1839750Z Compiling xla/hlo/builder/xla_builder.cc; 11s local 2024-12-18T00:08:05.1840485Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:08:05.1841196Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local 2024-12-18T00:08:05.1842045Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2024-12-18T00:08:05.1842912Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local ... 2024-12-18T00:08:05.4084172Z 2024-12-18T00:08:05.4085115Z  2024-12-18T00:08:05.4085590Z  2024-12-18T00:08:05.4085985Z  2024-12-18T00:08:05.4086369Z  2024-12-18T00:08:05.4086760Z  2024-12-18T00:08:05.4087150Z  2024-12-18T00:08:05.4087541Z  2024-12-18T00:08:05.4087929Z  2024-12-18T00:08:05.4088529Z [13,569 / 15,187] 48 actions, 47 running 2024-12-18T00:08:05.4089415Z Compiling xla/service/collective_ops_utils.cc; 11s local 2024-12-18T00:08:05.4090186Z Compiling xla/hlo/parser/hlo_parser.cc; 11s local 2024-12-18T00:08:05.4090899Z Compiling xla/hlo/builder/xla_builder.cc; 11s local 2024-12-18T00:08:05.4091767Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:08:05.4092490Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2024-12-18T00:08:05.4093332Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2024-12-18T00:08:05.4094187Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2024-12-18T00:08:05.4094955Z Compiling xla/hlo/ir/hlo_instructions.cc; 11s local ... 2024-12-18T00:08:05.6181604Z 2024-12-18T00:08:05.6182494Z  2024-12-18T00:08:05.6182964Z  2024-12-18T00:08:05.6183336Z  2024-12-18T00:08:05.6183701Z  2024-12-18T00:08:05.6184040Z  2024-12-18T00:08:05.6184394Z  2024-12-18T00:08:05.6184748Z  2024-12-18T00:08:05.6185125Z  2024-12-18T00:08:05.6185700Z [13,574 / 15,187] 48 actions, 47 running 2024-12-18T00:08:05.6186440Z Compiling xla/service/collective_ops_utils.cc; 12s local 2024-12-18T00:08:05.6187217Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local 2024-12-18T00:08:05.6187932Z Compiling xla/hlo/builder/xla_builder.cc; 11s local 2024-12-18T00:08:05.6188662Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:08:05.6189374Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2024-12-18T00:08:05.6190386Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2024-12-18T00:08:05.6191262Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2024-12-18T00:08:05.6192045Z Compiling xla/hlo/ir/hlo_instructions.cc; 11s local ... 2024-12-18T00:08:05.8940520Z 2024-12-18T00:08:05.8941472Z  2024-12-18T00:08:05.8941978Z  2024-12-18T00:08:05.8942522Z  2024-12-18T00:08:05.8942906Z  2024-12-18T00:08:05.8943284Z  2024-12-18T00:08:05.8943681Z  2024-12-18T00:08:05.8944056Z  2024-12-18T00:08:05.8944753Z  2024-12-18T00:08:05.8945329Z [13,579 / 15,187] 48 actions, 47 running 2024-12-18T00:08:05.8946101Z Compiling xla/service/collective_ops_utils.cc; 12s local 2024-12-18T00:08:05.8946891Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local 2024-12-18T00:08:05.8947605Z Compiling xla/hlo/builder/xla_builder.cc; 12s local 2024-12-18T00:08:05.8948330Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:08:05.8949076Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2024-12-18T00:08:05.8950325Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2024-12-18T00:08:05.8951166Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2024-12-18T00:08:05.8951897Z Compiling xla/hlo/ir/hlo_instructions.cc; 11s local ... 2024-12-18T00:08:06.0993372Z 2024-12-18T00:08:06.0994260Z  2024-12-18T00:08:06.0994688Z  2024-12-18T00:08:06.0995043Z  2024-12-18T00:08:06.0995813Z  2024-12-18T00:08:06.0996294Z  2024-12-18T00:08:06.0996773Z  2024-12-18T00:08:06.0997221Z  2024-12-18T00:08:06.0997702Z  2024-12-18T00:08:06.0998364Z [13,586 / 15,187] 48 actions, 47 running 2024-12-18T00:08:06.0999250Z Compiling xla/service/collective_ops_utils.cc; 12s local 2024-12-18T00:08:06.1000131Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local 2024-12-18T00:08:06.1000968Z Compiling xla/hlo/builder/xla_builder.cc; 12s local 2024-12-18T00:08:06.1001789Z Compiling xla/service/shape_inference.cc; 12s local 2024-12-18T00:08:06.1002599Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2024-12-18T00:08:06.1003526Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2024-12-18T00:08:06.1004517Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2024-12-18T00:08:06.1005298Z Compiling xla/hlo/ir/hlo_instructions.cc; 11s local ... 2024-12-18T00:08:06.3309261Z 2024-12-18T00:08:06.3310139Z  2024-12-18T00:08:06.3310640Z  2024-12-18T00:08:06.3311036Z  2024-12-18T00:08:06.3311408Z  2024-12-18T00:08:06.3311792Z  2024-12-18T00:08:06.3312179Z  2024-12-18T00:08:06.3312553Z  2024-12-18T00:08:06.3312938Z  2024-12-18T00:08:06.3313447Z [13,595 / 15,187] 48 actions running 2024-12-18T00:08:06.3314338Z Compiling xla/service/collective_ops_utils.cc; 12s local 2024-12-18T00:08:06.3315097Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local 2024-12-18T00:08:06.3315814Z Compiling xla/hlo/builder/xla_builder.cc; 12s local 2024-12-18T00:08:06.3316581Z Compiling xla/service/shape_inference.cc; 12s local 2024-12-18T00:08:06.3317301Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2024-12-18T00:08:06.3318147Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2024-12-18T00:08:06.3319022Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2024-12-18T00:08:06.3319812Z Compiling xla/hlo/ir/hlo_instructions.cc; 11s local ... 2024-12-18T00:08:06.8950937Z 2024-12-18T00:08:06.8951849Z  2024-12-18T00:08:06.8952294Z  2024-12-18T00:08:06.8952693Z  2024-12-18T00:08:06.8953076Z  2024-12-18T00:08:06.8953463Z  2024-12-18T00:08:06.8953827Z  2024-12-18T00:08:06.8954208Z  2024-12-18T00:08:06.8954600Z  2024-12-18T00:08:06.8955194Z [13,596 / 15,187] 48 actions, 47 running 2024-12-18T00:08:06.8955985Z Compiling xla/service/collective_ops_utils.cc; 13s local 2024-12-18T00:08:06.8956801Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2024-12-18T00:08:06.8957597Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2024-12-18T00:08:06.8958362Z Compiling xla/service/shape_inference.cc; 12s local 2024-12-18T00:08:06.8959128Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2024-12-18T00:08:06.8959990Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2024-12-18T00:08:06.8960864Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2024-12-18T00:08:06.8961652Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local ... 2024-12-18T00:08:07.0953021Z 2024-12-18T00:08:07.0953924Z  2024-12-18T00:08:07.0954375Z  2024-12-18T00:08:07.0954752Z  2024-12-18T00:08:07.0955123Z  2024-12-18T00:08:07.0955486Z  2024-12-18T00:08:07.0955881Z  2024-12-18T00:08:07.0956239Z  2024-12-18T00:08:07.0956619Z  2024-12-18T00:08:07.0957182Z [13,613 / 15,187] 48 actions, 47 running 2024-12-18T00:08:07.0957982Z Compiling xla/service/collective_ops_utils.cc; 13s local 2024-12-18T00:08:07.0959191Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2024-12-18T00:08:07.0959979Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2024-12-18T00:08:07.0960750Z Compiling xla/service/shape_inference.cc; 13s local 2024-12-18T00:08:07.0961507Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2024-12-18T00:08:07.0962601Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2024-12-18T00:08:07.0963535Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2024-12-18T00:08:07.0964372Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local ... 2024-12-18T00:08:07.3095316Z 2024-12-18T00:08:07.3096163Z  2024-12-18T00:08:07.3096755Z  2024-12-18T00:08:07.3097129Z  2024-12-18T00:08:07.3097510Z  2024-12-18T00:08:07.3097837Z  2024-12-18T00:08:07.3098181Z  2024-12-18T00:08:07.3098513Z  2024-12-18T00:08:07.3098853Z  2024-12-18T00:08:07.3099371Z [13,619 / 15,187] 48 actions, 47 running 2024-12-18T00:08:07.3100137Z Compiling xla/service/collective_ops_utils.cc; 13s local 2024-12-18T00:08:07.3100948Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2024-12-18T00:08:07.3101726Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2024-12-18T00:08:07.3102516Z Compiling xla/service/shape_inference.cc; 13s local 2024-12-18T00:08:07.3103228Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2024-12-18T00:08:07.3104039Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 13s local 2024-12-18T00:08:07.3104819Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2024-12-18T00:08:07.3105514Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local ... 2024-12-18T00:08:07.5103033Z 2024-12-18T00:08:07.5103960Z  2024-12-18T00:08:07.5104441Z  2024-12-18T00:08:07.5104831Z  2024-12-18T00:08:07.5105242Z  2024-12-18T00:08:07.5105654Z  2024-12-18T00:08:07.5106044Z  2024-12-18T00:08:07.5106450Z  2024-12-18T00:08:07.5106840Z  2024-12-18T00:08:07.5107469Z [13,633 / 15,187] 48 actions running 2024-12-18T00:08:07.5108216Z Compiling xla/service/collective_ops_utils.cc; 13s local 2024-12-18T00:08:07.5109014Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2024-12-18T00:08:07.5109779Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2024-12-18T00:08:07.5110569Z Compiling xla/service/shape_inference.cc; 13s local 2024-12-18T00:08:07.5111368Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2024-12-18T00:08:07.5112168Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2024-12-18T00:08:07.5113105Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2024-12-18T00:08:07.5113906Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2024-12-18T00:08:07.7285917Z 2024-12-18T00:08:07.7286813Z  2024-12-18T00:08:07.7287302Z  2024-12-18T00:08:07.7287710Z  2024-12-18T00:08:07.7288075Z  2024-12-18T00:08:07.7288456Z  2024-12-18T00:08:07.7288845Z  2024-12-18T00:08:07.7289278Z  2024-12-18T00:08:07.7289648Z  2024-12-18T00:08:07.7290266Z [13,651 / 15,187] 48 actions, 47 running 2024-12-18T00:08:07.7291066Z Compiling xla/service/collective_ops_utils.cc; 14s local 2024-12-18T00:08:07.7291921Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2024-12-18T00:08:07.7292628Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2024-12-18T00:08:07.7293415Z Compiling xla/service/shape_inference.cc; 13s local 2024-12-18T00:08:07.7294200Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2024-12-18T00:08:07.7294977Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2024-12-18T00:08:07.7295784Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2024-12-18T00:08:07.7296724Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2024-12-18T00:08:07.9320091Z 2024-12-18T00:08:07.9321019Z  2024-12-18T00:08:07.9321485Z  2024-12-18T00:08:07.9321890Z  2024-12-18T00:08:07.9322286Z  2024-12-18T00:08:07.9323136Z  2024-12-18T00:08:07.9323560Z  2024-12-18T00:08:07.9323954Z  2024-12-18T00:08:07.9324329Z  2024-12-18T00:08:07.9324835Z [13,658 / 15,187] 48 actions running 2024-12-18T00:08:07.9325591Z Compiling xla/service/collective_ops_utils.cc; 14s local 2024-12-18T00:08:07.9326361Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2024-12-18T00:08:07.9327410Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2024-12-18T00:08:07.9328197Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:08:07.9328990Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2024-12-18T00:08:07.9329754Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2024-12-18T00:08:07.9330472Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2024-12-18T00:08:07.9331211Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2024-12-18T00:08:08.1340323Z 2024-12-18T00:08:08.1341241Z  2024-12-18T00:08:08.1341725Z  2024-12-18T00:08:08.1342133Z  2024-12-18T00:08:08.1342577Z  2024-12-18T00:08:08.1343007Z  2024-12-18T00:08:08.1343395Z  2024-12-18T00:08:08.1343823Z  2024-12-18T00:08:08.1344509Z  2024-12-18T00:08:08.1345128Z [13,669 / 15,187] 48 actions, 47 running 2024-12-18T00:08:08.1345909Z Compiling xla/service/collective_ops_utils.cc; 14s local 2024-12-18T00:08:08.1346777Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2024-12-18T00:08:08.1347574Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2024-12-18T00:08:08.1348354Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:08:08.1349142Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2024-12-18T00:08:08.1349942Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2024-12-18T00:08:08.1350714Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2024-12-18T00:08:08.1351499Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2024-12-18T00:08:08.3402072Z 2024-12-18T00:08:08.3402952Z  2024-12-18T00:08:08.3403442Z  2024-12-18T00:08:08.3403831Z  2024-12-18T00:08:08.3404192Z  2024-12-18T00:08:08.3404562Z  2024-12-18T00:08:08.3404958Z  2024-12-18T00:08:08.3405348Z  2024-12-18T00:08:08.3405732Z  2024-12-18T00:08:08.3406306Z [13,684 / 15,187] 48 actions, 47 running 2024-12-18T00:08:08.3407105Z Compiling xla/service/collective_ops_utils.cc; 14s local 2024-12-18T00:08:08.3407922Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2024-12-18T00:08:08.3408707Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2024-12-18T00:08:08.3409522Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:08:08.3410330Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2024-12-18T00:08:08.3411162Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2024-12-18T00:08:08.3411994Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2024-12-18T00:08:08.3412629Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2024-12-18T00:08:08.5686355Z 2024-12-18T00:08:08.5687273Z  2024-12-18T00:08:08.5687770Z  2024-12-18T00:08:08.5688160Z  2024-12-18T00:08:08.5688714Z  2024-12-18T00:08:08.5689122Z  2024-12-18T00:08:08.5689516Z  2024-12-18T00:08:08.5689889Z  2024-12-18T00:08:08.5690327Z  2024-12-18T00:08:08.5690921Z [13,693 / 15,187] 48 actions, 47 running 2024-12-18T00:08:08.5691729Z Compiling xla/service/collective_ops_utils.cc; 15s local 2024-12-18T00:08:08.5692588Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2024-12-18T00:08:08.5693351Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2024-12-18T00:08:08.5694116Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:08:08.5694934Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2024-12-18T00:08:08.5695738Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2024-12-18T00:08:08.5696682Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2024-12-18T00:08:08.5697946Z Compiling xla/hlo/ir/hlo_module.cc; 14s local ... 2024-12-18T00:08:08.9327789Z 2024-12-18T00:08:08.9328698Z  2024-12-18T00:08:08.9329205Z  2024-12-18T00:08:08.9329614Z  2024-12-18T00:08:08.9329980Z  2024-12-18T00:08:08.9330366Z  2024-12-18T00:08:08.9330735Z  2024-12-18T00:08:08.9331098Z  2024-12-18T00:08:08.9331492Z  2024-12-18T00:08:08.9332448Z [13,694 / 15,187] 48 actions running 2024-12-18T00:08:08.9333261Z Compiling xla/service/collective_ops_utils.cc; 15s local 2024-12-18T00:08:08.9334118Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2024-12-18T00:08:08.9334872Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:08:08.9335661Z Compiling xla/service/shape_inference.cc; 15s local 2024-12-18T00:08:08.9336615Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2024-12-18T00:08:08.9337382Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2024-12-18T00:08:08.9338159Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2024-12-18T00:08:08.9338995Z Compiling xla/hlo/ir/hlo_module.cc; 14s local ... 2024-12-18T00:08:09.3332739Z 2024-12-18T00:08:09.3333599Z  2024-12-18T00:08:09.3334063Z  2024-12-18T00:08:09.3334451Z  2024-12-18T00:08:09.3334844Z  2024-12-18T00:08:09.3335221Z  2024-12-18T00:08:09.3335613Z  2024-12-18T00:08:09.3336010Z  2024-12-18T00:08:09.3336591Z  2024-12-18T00:08:09.3337182Z [13,695 / 15,187] 48 actions running 2024-12-18T00:08:09.3337948Z Compiling xla/service/collective_ops_utils.cc; 15s local 2024-12-18T00:08:09.3338715Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2024-12-18T00:08:09.3339385Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:08:09.3340165Z Compiling xla/service/shape_inference.cc; 15s local 2024-12-18T00:08:09.3340912Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2024-12-18T00:08:09.3341690Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2024-12-18T00:08:09.3342532Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2024-12-18T00:08:09.3343333Z Compiling xla/hlo/ir/hlo_module.cc; 14s local ... 2024-12-18T00:08:09.5336895Z 2024-12-18T00:08:09.5337786Z  2024-12-18T00:08:09.5338240Z  2024-12-18T00:08:09.5338641Z  2024-12-18T00:08:09.5339056Z  2024-12-18T00:08:09.5339449Z  2024-12-18T00:08:09.5339878Z  2024-12-18T00:08:09.5340278Z  2024-12-18T00:08:09.5340659Z  2024-12-18T00:08:09.5341239Z [13,696 / 15,187] 48 actions running 2024-12-18T00:08:09.5342038Z Compiling xla/service/collective_ops_utils.cc; 16s local 2024-12-18T00:08:09.5342869Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2024-12-18T00:08:09.5343692Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:08:09.5344693Z Compiling xla/service/shape_inference.cc; 15s local 2024-12-18T00:08:09.5345479Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2024-12-18T00:08:09.5346353Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2024-12-18T00:08:09.5347047Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2024-12-18T00:08:09.5347819Z Compiling xla/hlo/ir/hlo_module.cc; 15s local ... 2024-12-18T00:08:09.7699275Z 2024-12-18T00:08:09.7700230Z  2024-12-18T00:08:09.7700677Z  2024-12-18T00:08:09.7701051Z  2024-12-18T00:08:09.7701457Z  2024-12-18T00:08:09.7701822Z  2024-12-18T00:08:09.7702160Z  2024-12-18T00:08:09.7702513Z  2024-12-18T00:08:09.7702872Z  2024-12-18T00:08:09.7703394Z [13,697 / 15,187] 48 actions, 47 running 2024-12-18T00:08:09.7704057Z Compiling xla/service/collective_ops_utils.cc; 16s local 2024-12-18T00:08:09.7704724Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2024-12-18T00:08:09.7705354Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:08:09.7705993Z Compiling xla/service/shape_inference.cc; 15s local 2024-12-18T00:08:09.7707034Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2024-12-18T00:08:09.7707749Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2024-12-18T00:08:09.7708428Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2024-12-18T00:08:09.7709126Z Compiling xla/hlo/ir/hlo_module.cc; 15s local ... 2024-12-18T00:08:10.1063733Z 2024-12-18T00:08:10.1064634Z  2024-12-18T00:08:10.1065110Z  2024-12-18T00:08:10.1065859Z  2024-12-18T00:08:10.1066291Z  2024-12-18T00:08:10.1066696Z  2024-12-18T00:08:10.1067113Z  2024-12-18T00:08:10.1067529Z  2024-12-18T00:08:10.1067946Z  2024-12-18T00:08:10.1068553Z [13,700 / 15,187] 48 actions, 47 running 2024-12-18T00:08:10.1069348Z Compiling xla/service/collective_ops_utils.cc; 16s local 2024-12-18T00:08:10.1070240Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2024-12-18T00:08:10.1071071Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2024-12-18T00:08:10.1071917Z Compiling xla/service/shape_inference.cc; 16s local 2024-12-18T00:08:10.1072772Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2024-12-18T00:08:10.1073588Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2024-12-18T00:08:10.1074369Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2024-12-18T00:08:10.1075171Z Compiling xla/hlo/ir/hlo_module.cc; 15s local ... 2024-12-18T00:08:10.3345098Z 2024-12-18T00:08:10.3346007Z  2024-12-18T00:08:10.3346422Z  2024-12-18T00:08:10.3346786Z  2024-12-18T00:08:10.3347138Z  2024-12-18T00:08:10.3347513Z  2024-12-18T00:08:10.3347892Z  2024-12-18T00:08:10.3348287Z  2024-12-18T00:08:10.3348682Z  2024-12-18T00:08:10.3349242Z [13,703 / 15,187] 48 actions running 2024-12-18T00:08:10.3350048Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2024-12-18T00:08:10.3350897Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2024-12-18T00:08:10.3351641Z Compiling xla/service/shape_inference.cc; 16s local 2024-12-18T00:08:10.3352466Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2024-12-18T00:08:10.3353211Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2024-12-18T00:08:10.3353913Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2024-12-18T00:08:10.3354620Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2024-12-18T00:08:10.3355331Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2024-12-18T00:08:10.6370041Z 2024-12-18T00:08:10.6370918Z  2024-12-18T00:08:10.6371380Z  2024-12-18T00:08:10.6371779Z  2024-12-18T00:08:10.6372175Z  2024-12-18T00:08:10.6372562Z  2024-12-18T00:08:10.6372953Z  2024-12-18T00:08:10.6373332Z  2024-12-18T00:08:10.6373746Z  2024-12-18T00:08:10.6374357Z [13,708 / 15,187] 48 actions, 47 running 2024-12-18T00:08:10.6375131Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2024-12-18T00:08:10.6375927Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2024-12-18T00:08:10.6376847Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2024-12-18T00:08:10.6377566Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2024-12-18T00:08:10.6378309Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2024-12-18T00:08:10.6379043Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2024-12-18T00:08:10.6379995Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2024-12-18T00:08:10.6380928Z Compiling xla/literal_util.cc; 15s local ... 2024-12-18T00:08:10.9350241Z 2024-12-18T00:08:10.9351152Z  2024-12-18T00:08:10.9351620Z  2024-12-18T00:08:10.9352017Z  2024-12-18T00:08:10.9352442Z  2024-12-18T00:08:10.9352852Z  2024-12-18T00:08:10.9353252Z  2024-12-18T00:08:10.9353633Z  2024-12-18T00:08:10.9354038Z  2024-12-18T00:08:10.9354615Z [13,709 / 15,187] 48 actions running 2024-12-18T00:08:10.9355385Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2024-12-18T00:08:10.9356563Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:08:10.9357312Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2024-12-18T00:08:10.9358082Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2024-12-18T00:08:10.9358844Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2024-12-18T00:08:10.9359572Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2024-12-18T00:08:10.9360701Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 16s local 2024-12-18T00:08:10.9361680Z Compiling xla/literal_util.cc; 15s local ... 2024-12-18T00:08:11.1354185Z 2024-12-18T00:08:11.1355036Z  2024-12-18T00:08:11.1355530Z  2024-12-18T00:08:11.1355961Z  2024-12-18T00:08:11.1356373Z  2024-12-18T00:08:11.1356764Z  2024-12-18T00:08:11.1357150Z  2024-12-18T00:08:11.1357545Z  2024-12-18T00:08:11.1357893Z  2024-12-18T00:08:11.1358444Z [13,713 / 15,187] 48 actions running 2024-12-18T00:08:11.1359187Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2024-12-18T00:08:11.1359968Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:08:11.1360708Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2024-12-18T00:08:11.1361459Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2024-12-18T00:08:11.1362203Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2024-12-18T00:08:11.1362952Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2024-12-18T00:08:11.1363611Z Compiling xla/literal.cc; 14s local 2024-12-18T00:08:11.1364279Z Compiling xla/debug_options_flags.cc; 11s local ... 2024-12-18T00:08:11.4601901Z 2024-12-18T00:08:11.4602810Z  2024-12-18T00:08:11.4603286Z  2024-12-18T00:08:11.4603707Z  2024-12-18T00:08:11.4604119Z  2024-12-18T00:08:11.4604526Z  2024-12-18T00:08:11.4604926Z  2024-12-18T00:08:11.4605323Z  2024-12-18T00:08:11.4605749Z  2024-12-18T00:08:11.4606376Z [13,715 / 15,187] 48 actions, 47 running 2024-12-18T00:08:11.4607222Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2024-12-18T00:08:11.4608037Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:08:11.4608864Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2024-12-18T00:08:11.4609674Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:08:11.4610432Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2024-12-18T00:08:11.4611246Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2024-12-18T00:08:11.4611961Z Compiling xla/literal.cc; 14s local 2024-12-18T00:08:11.4612683Z Compiling xla/debug_options_flags.cc; 11s local ... 2024-12-18T00:08:11.7360436Z 2024-12-18T00:08:11.7361413Z  2024-12-18T00:08:11.7361911Z  2024-12-18T00:08:11.7362331Z  2024-12-18T00:08:11.7362764Z  2024-12-18T00:08:11.7363175Z  2024-12-18T00:08:11.7363577Z  2024-12-18T00:08:11.7363988Z  2024-12-18T00:08:11.7364402Z  2024-12-18T00:08:11.7364985Z [13,716 / 15,187] 48 actions running 2024-12-18T00:08:11.7365857Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2024-12-18T00:08:11.7366651Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:08:11.7367466Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2024-12-18T00:08:11.7368286Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:08:11.7369120Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2024-12-18T00:08:11.7369897Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2024-12-18T00:08:11.7370591Z Compiling xla/literal.cc; 14s local 2024-12-18T00:08:11.7371290Z Compiling xla/debug_options_flags.cc; 11s local ... 2024-12-18T00:08:12.0789360Z 2024-12-18T00:08:12.0790232Z  2024-12-18T00:08:12.0790735Z  2024-12-18T00:08:12.0791124Z  2024-12-18T00:08:12.0791447Z  2024-12-18T00:08:12.0791871Z  2024-12-18T00:08:12.0792225Z  2024-12-18T00:08:12.0792594Z  2024-12-18T00:08:12.0792949Z  2024-12-18T00:08:12.0794020Z [13,717 / 15,187] 48 actions, 47 running 2024-12-18T00:08:12.0794768Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2024-12-18T00:08:12.0795586Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2024-12-18T00:08:12.0796298Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2024-12-18T00:08:12.0797011Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:08:12.0797995Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2024-12-18T00:08:12.0798892Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2024-12-18T00:08:12.0799550Z Compiling xla/literal.cc; 15s local 2024-12-18T00:08:12.0800229Z Compiling xla/debug_options_flags.cc; 11s local ... 2024-12-18T00:08:12.3055224Z 2024-12-18T00:08:12.3056105Z  2024-12-18T00:08:12.3056776Z  2024-12-18T00:08:12.3057192Z  2024-12-18T00:08:12.3057611Z  2024-12-18T00:08:12.3058029Z  2024-12-18T00:08:12.3058454Z  2024-12-18T00:08:12.3058874Z  2024-12-18T00:08:12.3059328Z  2024-12-18T00:08:12.3059948Z [13,719 / 15,187] 48 actions, 47 running 2024-12-18T00:08:12.3060753Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2024-12-18T00:08:12.3061572Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2024-12-18T00:08:12.3062407Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:08:12.3063240Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:08:12.3063972Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2024-12-18T00:08:12.3064711Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2024-12-18T00:08:12.3065410Z Compiling xla/literal.cc; 15s local 2024-12-18T00:08:12.3066107Z Compiling xla/debug_options_flags.cc; 12s local ... 2024-12-18T00:08:12.5038709Z 2024-12-18T00:08:12.5039613Z  2024-12-18T00:08:12.5040077Z  2024-12-18T00:08:12.5040470Z  2024-12-18T00:08:12.5040870Z  2024-12-18T00:08:12.5041277Z  2024-12-18T00:08:12.5041729Z  2024-12-18T00:08:12.5042094Z  2024-12-18T00:08:12.5042475Z  2024-12-18T00:08:12.5043090Z [13,723 / 15,187] 48 actions, 47 running 2024-12-18T00:08:12.5043797Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2024-12-18T00:08:12.5044797Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2024-12-18T00:08:12.5045510Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:08:12.5046272Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:08:12.5047035Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2024-12-18T00:08:12.5047756Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2024-12-18T00:08:12.5048442Z Compiling xla/literal.cc; 15s local 2024-12-18T00:08:12.5049127Z Compiling xla/debug_options_flags.cc; 12s local ... 2024-12-18T00:08:12.7367788Z 2024-12-18T00:08:12.7368672Z  2024-12-18T00:08:12.7369141Z  2024-12-18T00:08:12.7369534Z  2024-12-18T00:08:12.7369897Z  2024-12-18T00:08:12.7370326Z  2024-12-18T00:08:12.7370708Z  2024-12-18T00:08:12.7371087Z  2024-12-18T00:08:12.7371479Z  2024-12-18T00:08:12.7372024Z [13,725 / 15,187] 48 actions running 2024-12-18T00:08:12.7372772Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2024-12-18T00:08:12.7373507Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2024-12-18T00:08:12.7374328Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:08:12.7375119Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:08:12.7375881Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2024-12-18T00:08:12.7376765Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2024-12-18T00:08:12.7377389Z Compiling xla/literal.cc; 15s local 2024-12-18T00:08:12.7378050Z Compiling xla/debug_options_flags.cc; 12s local ... 2024-12-18T00:08:12.9430699Z 2024-12-18T00:08:12.9431643Z  2024-12-18T00:08:12.9432123Z  2024-12-18T00:08:12.9432504Z  2024-12-18T00:08:12.9433301Z  2024-12-18T00:08:12.9433688Z  2024-12-18T00:08:12.9434072Z  2024-12-18T00:08:12.9434463Z  2024-12-18T00:08:12.9434848Z  2024-12-18T00:08:12.9435415Z [13,728 / 15,187] 48 actions, 47 running 2024-12-18T00:08:12.9436144Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2024-12-18T00:08:12.9436870Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:08:12.9437868Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:08:12.9438595Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:08:12.9439344Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2024-12-18T00:08:12.9439999Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2024-12-18T00:08:12.9440651Z Compiling xla/literal.cc; 16s local 2024-12-18T00:08:12.9441314Z Compiling xla/debug_options_flags.cc; 12s local ... 2024-12-18T00:08:13.1673544Z 2024-12-18T00:08:13.1674421Z  2024-12-18T00:08:13.1674914Z  2024-12-18T00:08:13.1675390Z  2024-12-18T00:08:13.1675758Z  2024-12-18T00:08:13.1676135Z  2024-12-18T00:08:13.1676516Z  2024-12-18T00:08:13.1676902Z  2024-12-18T00:08:13.1677278Z  2024-12-18T00:08:13.1677838Z [13,730 / 15,187] 48 actions, 47 running 2024-12-18T00:08:13.1678589Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2024-12-18T00:08:13.1679362Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:08:13.1680108Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:08:13.1680855Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:08:13.1681590Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2024-12-18T00:08:13.1682300Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2024-12-18T00:08:13.1682934Z Compiling xla/literal.cc; 16s local 2024-12-18T00:08:13.1683595Z Compiling xla/debug_options_flags.cc; 13s local ... 2024-12-18T00:08:13.5374072Z 2024-12-18T00:08:13.5374928Z  2024-12-18T00:08:13.5375361Z  2024-12-18T00:08:13.5375668Z  2024-12-18T00:08:13.5375990Z  2024-12-18T00:08:13.5376307Z  2024-12-18T00:08:13.5376798Z  2024-12-18T00:08:13.5377109Z  2024-12-18T00:08:13.5377414Z  2024-12-18T00:08:13.5377871Z [13,730 / 15,187] 48 actions running 2024-12-18T00:08:13.5378465Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2024-12-18T00:08:13.5379087Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:08:13.5379666Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:08:13.5380244Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:08:13.5380835Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2024-12-18T00:08:13.5381389Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2024-12-18T00:08:13.5381908Z Compiling xla/literal.cc; 16s local 2024-12-18T00:08:13.5382424Z Compiling xla/debug_options_flags.cc; 13s local ... 2024-12-18T00:08:13.7391630Z 2024-12-18T00:08:13.7392553Z  2024-12-18T00:08:13.7393005Z  2024-12-18T00:08:13.7393384Z  2024-12-18T00:08:13.7393744Z  2024-12-18T00:08:13.7394145Z  2024-12-18T00:08:13.7394534Z  2024-12-18T00:08:13.7394906Z  2024-12-18T00:08:13.7395358Z  2024-12-18T00:08:13.7395940Z [13,735 / 15,187] 48 actions, 47 running 2024-12-18T00:08:13.7396717Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2024-12-18T00:08:13.7397490Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:08:13.7398228Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:08:13.7398971Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:08:13.7399668Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2024-12-18T00:08:13.7400392Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2024-12-18T00:08:13.7401029Z Compiling xla/literal.cc; 16s local 2024-12-18T00:08:13.7401684Z Compiling xla/debug_options_flags.cc; 13s local ... 2024-12-18T00:08:14.0434957Z 2024-12-18T00:08:14.0435935Z  2024-12-18T00:08:14.0436454Z  2024-12-18T00:08:14.0436805Z  2024-12-18T00:08:14.0437247Z  2024-12-18T00:08:14.0437621Z  2024-12-18T00:08:14.0438034Z  2024-12-18T00:08:14.0438413Z  2024-12-18T00:08:14.0438786Z  2024-12-18T00:08:14.0439377Z [13,738 / 15,187] 48 actions, 47 running 2024-12-18T00:08:14.0440708Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2024-12-18T00:08:14.0441537Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:08:14.0442350Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:08:14.0443091Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:08:14.0443827Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2024-12-18T00:08:14.0444800Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2024-12-18T00:08:14.0445459Z Compiling xla/literal.cc; 17s local 2024-12-18T00:08:14.0446148Z Compiling xla/debug_options_flags.cc; 13s local ... 2024-12-18T00:08:14.3378670Z 2024-12-18T00:08:14.3379677Z  2024-12-18T00:08:14.3380189Z  2024-12-18T00:08:14.3380602Z  2024-12-18T00:08:14.3380941Z  2024-12-18T00:08:14.3381339Z  2024-12-18T00:08:14.3381739Z  2024-12-18T00:08:14.3382134Z  2024-12-18T00:08:14.3382524Z  2024-12-18T00:08:14.3383135Z [13,740 / 15,187] 48 actions running 2024-12-18T00:08:14.3383853Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2024-12-18T00:08:14.3384635Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:08:14.3385424Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:08:14.3386181Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:08:14.3386934Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2024-12-18T00:08:14.3387660Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2024-12-18T00:08:14.3388356Z Compiling xla/literal.cc; 17s local 2024-12-18T00:08:14.3389034Z Compiling xla/pjrt/transpose.cc; 10s local ... 2024-12-18T00:08:14.5924383Z 2024-12-18T00:08:14.5925684Z  2024-12-18T00:08:14.5926156Z  2024-12-18T00:08:14.5926556Z  2024-12-18T00:08:14.5926960Z  2024-12-18T00:08:14.5927353Z  2024-12-18T00:08:14.5927727Z  2024-12-18T00:08:14.5928133Z  2024-12-18T00:08:14.5928536Z  2024-12-18T00:08:14.5929192Z [13,741 / 15,187] 48 actions, 47 running 2024-12-18T00:08:14.5930102Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2024-12-18T00:08:14.5930827Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:08:14.5931583Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:08:14.5932380Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:08:14.5933162Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:08:14.5933927Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:08:14.5934579Z Compiling xla/literal.cc; 17s local 2024-12-18T00:08:14.5935305Z Compiling xla/pjrt/transpose.cc; 11s local ... 2024-12-18T00:08:14.9085631Z 2024-12-18T00:08:14.9086949Z  2024-12-18T00:08:14.9087426Z  2024-12-18T00:08:14.9087826Z  2024-12-18T00:08:14.9088138Z  2024-12-18T00:08:14.9088490Z  2024-12-18T00:08:14.9088887Z  2024-12-18T00:08:14.9089292Z  2024-12-18T00:08:14.9089712Z  2024-12-18T00:08:14.9090285Z [13,743 / 15,187] 48 actions, 47 running 2024-12-18T00:08:14.9091074Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2024-12-18T00:08:14.9091878Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:08:14.9092703Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:08:14.9093498Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:08:14.9094250Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:08:14.9094989Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:08:14.9096058Z Compiling xla/literal.cc; 18s local 2024-12-18T00:08:14.9096763Z Compiling xla/pjrt/transpose.cc; 11s local ... 2024-12-18T00:08:15.1325423Z 2024-12-18T00:08:15.1326361Z  2024-12-18T00:08:15.1326852Z  2024-12-18T00:08:15.1327237Z  2024-12-18T00:08:15.1327636Z  2024-12-18T00:08:15.1328024Z  2024-12-18T00:08:15.1328370Z  2024-12-18T00:08:15.1329094Z  2024-12-18T00:08:15.1329507Z  2024-12-18T00:08:15.1330106Z [13,745 / 15,187] 48 actions, 47 running 2024-12-18T00:08:15.1330835Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2024-12-18T00:08:15.1331614Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:08:15.1332373Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:08:15.1333134Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:08:15.1333951Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:08:15.1334650Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:08:15.1335284Z Compiling xla/literal.cc; 18s local 2024-12-18T00:08:15.1335932Z Compiling xla/pjrt/transpose.cc; 11s local ... 2024-12-18T00:08:15.3385686Z 2024-12-18T00:08:15.3386920Z  2024-12-18T00:08:15.3387392Z  2024-12-18T00:08:15.3387807Z  2024-12-18T00:08:15.3388208Z  2024-12-18T00:08:15.3388626Z  2024-12-18T00:08:15.3389046Z  2024-12-18T00:08:15.3389438Z  2024-12-18T00:08:15.3389858Z  2024-12-18T00:08:15.3390449Z [13,746 / 15,187] 48 actions running 2024-12-18T00:08:15.3391233Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2024-12-18T00:08:15.3391989Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:08:15.3392793Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:08:15.3393592Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:08:15.3394369Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:08:15.3395124Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:08:15.3395729Z Compiling xla/literal.cc; 18s local 2024-12-18T00:08:15.3396355Z Compiling xla/pjrt/transpose.cc; 11s local ... 2024-12-18T00:08:15.6314881Z 2024-12-18T00:08:15.6315756Z  2024-12-18T00:08:15.6316253Z  2024-12-18T00:08:15.6316662Z  2024-12-18T00:08:15.6317084Z  2024-12-18T00:08:15.6317530Z  2024-12-18T00:08:15.6317930Z  2024-12-18T00:08:15.6318333Z  2024-12-18T00:08:15.6318733Z  2024-12-18T00:08:15.6319357Z [13,747 / 15,187] 48 actions, 47 running 2024-12-18T00:08:15.6320119Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2024-12-18T00:08:15.6320914Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:08:15.6321729Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:08:15.6322523Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:08:15.6323351Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2024-12-18T00:08:15.6324152Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2024-12-18T00:08:15.6324847Z Compiling xla/literal.cc; 18s local 2024-12-18T00:08:15.6325515Z Compiling xla/pjrt/transpose.cc; 12s local ... 2024-12-18T00:08:15.8791100Z 2024-12-18T00:08:15.8791954Z  2024-12-18T00:08:15.8792644Z  2024-12-18T00:08:15.8793075Z  2024-12-18T00:08:15.8793526Z  2024-12-18T00:08:15.8793944Z  2024-12-18T00:08:15.8794374Z  2024-12-18T00:08:15.8794803Z  2024-12-18T00:08:15.8795212Z  2024-12-18T00:08:15.8795868Z [13,753 / 15,187] 48 actions, 47 running 2024-12-18T00:08:15.8796685Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2024-12-18T00:08:15.8797513Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:08:15.8798360Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:08:15.8799188Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:08:15.8800338Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2024-12-18T00:08:15.8801218Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2024-12-18T00:08:15.8801864Z Compiling xla/literal.cc; 19s local 2024-12-18T00:08:15.8802532Z Compiling xla/pjrt/transpose.cc; 12s local ... 2024-12-18T00:08:16.1394436Z 2024-12-18T00:08:16.1395356Z  2024-12-18T00:08:16.1395845Z  2024-12-18T00:08:16.1396673Z  2024-12-18T00:08:16.1397079Z  2024-12-18T00:08:16.1397480Z  2024-12-18T00:08:16.1397835Z  2024-12-18T00:08:16.1398202Z  2024-12-18T00:08:16.1398607Z  2024-12-18T00:08:16.1399184Z [13,754 / 15,187] 48 actions running 2024-12-18T00:08:16.1399941Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2024-12-18T00:08:16.1400743Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:08:16.1401539Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:08:16.1402313Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:08:16.1403255Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2024-12-18T00:08:16.1404019Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2024-12-18T00:08:16.1404724Z Compiling xla/literal.cc; 19s local 2024-12-18T00:08:16.1405372Z Compiling xla/pjrt/transpose.cc; 12s local ... 2024-12-18T00:08:16.4680495Z 2024-12-18T00:08:16.4681377Z  2024-12-18T00:08:16.4681900Z  2024-12-18T00:08:16.4682308Z  2024-12-18T00:08:16.4682713Z  2024-12-18T00:08:16.4683104Z  2024-12-18T00:08:16.4683513Z  2024-12-18T00:08:16.4683891Z  2024-12-18T00:08:16.4684291Z  2024-12-18T00:08:16.4684913Z [13,758 / 15,187] 48 actions, 47 running 2024-12-18T00:08:16.4685682Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2024-12-18T00:08:16.4686451Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:08:16.4687212Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:08:16.4688004Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2024-12-18T00:08:16.4688733Z Compiling xla/literal.cc; 19s local 2024-12-18T00:08:16.4689382Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:08:16.4690192Z Compiling .../coordination/coordination_service.cc; 10s local 2024-12-18T00:08:16.4691031Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2024-12-18T00:08:16.7174098Z 2024-12-18T00:08:16.7175009Z  2024-12-18T00:08:16.7175437Z  2024-12-18T00:08:16.7175796Z  2024-12-18T00:08:16.7176163Z  2024-12-18T00:08:16.7176682Z  2024-12-18T00:08:16.7177015Z  2024-12-18T00:08:16.7177362Z  2024-12-18T00:08:16.7177706Z  2024-12-18T00:08:16.7178233Z [13,761 / 15,187] 48 actions, 47 running 2024-12-18T00:08:16.7178877Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2024-12-18T00:08:16.7179554Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:08:16.7180237Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:08:16.7180937Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2024-12-18T00:08:16.7181533Z Compiling xla/literal.cc; 19s local 2024-12-18T00:08:16.7182089Z Compiling xla/pjrt/transpose.cc; 13s local 2024-12-18T00:08:16.7182782Z Compiling .../coordination/coordination_service.cc; 11s local 2024-12-18T00:08:16.7183524Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2024-12-18T00:08:16.9403884Z 2024-12-18T00:08:16.9404806Z  2024-12-18T00:08:16.9405260Z  2024-12-18T00:08:16.9405635Z  2024-12-18T00:08:16.9406011Z  2024-12-18T00:08:16.9406372Z  2024-12-18T00:08:16.9406722Z  2024-12-18T00:08:16.9407071Z  2024-12-18T00:08:16.9407433Z  2024-12-18T00:08:16.9407991Z [13,766 / 15,187] 48 actions, 47 running 2024-12-18T00:08:16.9408668Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2024-12-18T00:08:16.9409339Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:08:16.9410035Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:08:16.9411207Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2024-12-18T00:08:16.9411807Z Compiling xla/literal.cc; 20s local 2024-12-18T00:08:16.9412422Z Compiling .../coordination/coordination_service.cc; 11s local 2024-12-18T00:08:16.9413383Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2024-12-18T00:08:16.9414607Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2024-12-18T00:08:17.1402668Z 2024-12-18T00:08:17.1403639Z  2024-12-18T00:08:17.1404132Z  2024-12-18T00:08:17.1404564Z  2024-12-18T00:08:17.1404979Z  2024-12-18T00:08:17.1405410Z  2024-12-18T00:08:17.1405844Z  2024-12-18T00:08:17.1406217Z  2024-12-18T00:08:17.1406643Z  2024-12-18T00:08:17.1407264Z [13,767 / 15,187] 48 actions running 2024-12-18T00:08:17.1408091Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2024-12-18T00:08:17.1408776Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:08:17.1409562Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:08:17.1410297Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2024-12-18T00:08:17.1410944Z Compiling xla/literal.cc; 20s local 2024-12-18T00:08:17.1411660Z Compiling .../coordination/coordination_service.cc; 11s local 2024-12-18T00:08:17.1412641Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2024-12-18T00:08:17.1413489Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2024-12-18T00:08:17.4583367Z 2024-12-18T00:08:17.4584278Z  2024-12-18T00:08:17.4584747Z  2024-12-18T00:08:17.4585158Z  2024-12-18T00:08:17.4585532Z  2024-12-18T00:08:17.4585917Z  2024-12-18T00:08:17.4586323Z  2024-12-18T00:08:17.4586733Z  2024-12-18T00:08:17.4587139Z  2024-12-18T00:08:17.4587765Z [13,769 / 15,187] 48 actions, 47 running 2024-12-18T00:08:17.4588521Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2024-12-18T00:08:17.4589353Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:08:17.4590108Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:08:17.4590850Z Compiling xla/hlo/ir/hlo_instructions.cc; 23s local 2024-12-18T00:08:17.4591531Z Compiling xla/literal.cc; 20s local 2024-12-18T00:08:17.4592412Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2024-12-18T00:08:17.4593636Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 7s local 2024-12-18T00:08:17.4594709Z Compiling xla/service/cpu/cpu_runtime.cc; 5s local ... 2024-12-18T00:08:17.7411481Z 2024-12-18T00:08:17.7412355Z  2024-12-18T00:08:17.7412837Z  2024-12-18T00:08:17.7413235Z  2024-12-18T00:08:17.7413609Z  2024-12-18T00:08:17.7414022Z  2024-12-18T00:08:17.7414414Z  2024-12-18T00:08:17.7414815Z  2024-12-18T00:08:17.7415193Z  2024-12-18T00:08:17.7415775Z [13,770 / 15,187] 48 actions running 2024-12-18T00:08:17.7416708Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:08:17.7417412Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:08:17.7418145Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:08:17.7418919Z Compiling xla/literal.cc; 20s local 2024-12-18T00:08:17.7419759Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2024-12-18T00:08:17.7420989Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 7s local 2024-12-18T00:08:17.7422008Z Compiling xla/service/cpu/cpu_runtime.cc; 5s local 2024-12-18T00:08:17.7422853Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local ... 2024-12-18T00:08:17.9415999Z 2024-12-18T00:08:17.9416978Z  2024-12-18T00:08:17.9417460Z  2024-12-18T00:08:17.9417828Z  2024-12-18T00:08:17.9418222Z  2024-12-18T00:08:17.9418610Z  2024-12-18T00:08:17.9419003Z  2024-12-18T00:08:17.9419368Z  2024-12-18T00:08:17.9420220Z  2024-12-18T00:08:17.9420794Z [13,771 / 15,187] 48 actions running 2024-12-18T00:08:17.9421515Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:08:17.9422255Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:08:17.9422994Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:08:17.9423957Z Compiling xla/literal.cc; 21s local 2024-12-18T00:08:17.9424838Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 8s local 2024-12-18T00:08:17.9426014Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 7s local 2024-12-18T00:08:17.9427010Z Compiling xla/service/cpu/cpu_runtime.cc; 5s local 2024-12-18T00:08:17.9427731Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local ... 2024-12-18T00:08:18.2820541Z 2024-12-18T00:08:18.2821407Z  2024-12-18T00:08:18.2821901Z  2024-12-18T00:08:18.2822284Z  2024-12-18T00:08:18.2822705Z  2024-12-18T00:08:18.2823153Z  2024-12-18T00:08:18.2823541Z  2024-12-18T00:08:18.2823918Z  2024-12-18T00:08:18.2824287Z  2024-12-18T00:08:18.2824898Z [13,773 / 15,187] 48 actions, 47 running 2024-12-18T00:08:18.2825798Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:08:18.2826539Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:08:18.2827289Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:08:18.2827929Z Compiling xla/literal.cc; 21s local 2024-12-18T00:08:18.2828770Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 8s local 2024-12-18T00:08:18.2829913Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2024-12-18T00:08:18.2830884Z Compiling xla/service/cpu/cpu_runtime.cc; 6s local 2024-12-18T00:08:18.2831666Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local ... 2024-12-18T00:08:18.4918988Z 2024-12-18T00:08:18.4919835Z  2024-12-18T00:08:18.4920367Z  2024-12-18T00:08:18.4920800Z  2024-12-18T00:08:18.4921214Z  2024-12-18T00:08:18.4921596Z  2024-12-18T00:08:18.4921994Z  2024-12-18T00:08:18.4922375Z  2024-12-18T00:08:18.4922768Z  2024-12-18T00:08:18.4923389Z [13,776 / 15,187] 48 actions, 47 running 2024-12-18T00:08:18.4924146Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:08:18.4924984Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:08:18.4925756Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:08:18.4926462Z Compiling xla/literal.cc; 21s local 2024-12-18T00:08:18.4927358Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2024-12-18T00:08:18.4928393Z Compiling xla/service/cpu/cpu_runtime.cc; 6s local 2024-12-18T00:08:18.4929227Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local 2024-12-18T00:08:18.4930082Z Compiling xla/service/hlo_creation_utils.cc; 5s local ... 2024-12-18T00:08:18.7422383Z 2024-12-18T00:08:18.7423246Z  2024-12-18T00:08:18.7423720Z  2024-12-18T00:08:18.7424128Z  2024-12-18T00:08:18.7424556Z  2024-12-18T00:08:18.7424955Z  2024-12-18T00:08:18.7425354Z  2024-12-18T00:08:18.7425708Z  2024-12-18T00:08:18.7426102Z  2024-12-18T00:08:18.7426696Z [13,779 / 15,187] 48 actions running 2024-12-18T00:08:18.7427526Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2024-12-18T00:08:18.7428342Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:08:18.7429116Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:08:18.7429863Z Compiling xla/literal.cc; 21s local 2024-12-18T00:08:18.7430836Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2024-12-18T00:08:18.7431934Z Compiling xla/service/cpu/cpu_runtime.cc; 6s local 2024-12-18T00:08:18.7432770Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local 2024-12-18T00:08:18.7433634Z Compiling xla/service/hlo_creation_utils.cc; 6s local ... 2024-12-18T00:08:19.2192752Z 2024-12-18T00:08:19.2193613Z  2024-12-18T00:08:19.2194046Z  2024-12-18T00:08:19.2194407Z  2024-12-18T00:08:19.2194740Z  2024-12-18T00:08:19.2195094Z  2024-12-18T00:08:19.2195434Z  2024-12-18T00:08:19.2195781Z  2024-12-18T00:08:19.2196136Z  2024-12-18T00:08:19.2197059Z [13,780 / 15,187] 48 actions, 47 running 2024-12-18T00:08:19.2197741Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2024-12-18T00:08:19.2198400Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:08:19.2198990Z Compiling xla/literal.cc; 22s local 2024-12-18T00:08:19.2199766Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2024-12-18T00:08:19.2200598Z Compiling xla/service/cpu/cpu_runtime.cc; 7s local 2024-12-18T00:08:19.2201230Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2024-12-18T00:08:19.2201886Z Compiling xla/service/hlo_creation_utils.cc; 6s local 2024-12-18T00:08:19.2202811Z Compiling .../coordination/coordination_service_agent.cc; 6s local ... 2024-12-18T00:08:19.5430287Z 2024-12-18T00:08:19.5431123Z  2024-12-18T00:08:19.5431608Z  2024-12-18T00:08:19.5432010Z  2024-12-18T00:08:19.5432418Z  2024-12-18T00:08:19.5432834Z  2024-12-18T00:08:19.5433250Z  2024-12-18T00:08:19.5433704Z  2024-12-18T00:08:19.5434112Z  2024-12-18T00:08:19.5434717Z [13,782 / 15,187] 48 actions running 2024-12-18T00:08:19.5435504Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:08:19.5436320Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:08:19.5436992Z Compiling xla/literal.cc; 22s local 2024-12-18T00:08:19.5437914Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2024-12-18T00:08:19.5438954Z Compiling xla/service/cpu/cpu_runtime.cc; 7s local 2024-12-18T00:08:19.5439706Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2024-12-18T00:08:19.5440527Z Compiling xla/service/hlo_creation_utils.cc; 6s local 2024-12-18T00:08:19.5441468Z Compiling .../coordination/coordination_service_agent.cc; 6s local ... 2024-12-18T00:08:19.7434139Z 2024-12-18T00:08:19.7434937Z  2024-12-18T00:08:19.7435422Z  2024-12-18T00:08:19.7435860Z  2024-12-18T00:08:19.7436249Z  2024-12-18T00:08:19.7436696Z  2024-12-18T00:08:19.7437112Z  2024-12-18T00:08:19.7437506Z  2024-12-18T00:08:19.7437918Z  2024-12-18T00:08:19.7438535Z [13,784 / 15,187] 48 actions running 2024-12-18T00:08:19.7439302Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:08:19.7440230Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:08:19.7440925Z Compiling xla/literal.cc; 22s local 2024-12-18T00:08:19.7441866Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2024-12-18T00:08:19.7442921Z Compiling xla/service/cpu/cpu_runtime.cc; 7s local 2024-12-18T00:08:19.7443742Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2024-12-18T00:08:19.7444788Z Compiling xla/service/hlo_creation_utils.cc; 7s local 2024-12-18T00:08:19.7445774Z Compiling .../coordination/coordination_service_agent.cc; 6s local ... 2024-12-18T00:08:20.0199189Z 2024-12-18T00:08:20.0200046Z  2024-12-18T00:08:20.0200506Z  2024-12-18T00:08:20.0200965Z  2024-12-18T00:08:20.0201485Z  2024-12-18T00:08:20.0201886Z  2024-12-18T00:08:20.0202283Z  2024-12-18T00:08:20.0202676Z  2024-12-18T00:08:20.0203061Z  2024-12-18T00:08:20.0203712Z [13,786 / 15,187] 48 actions, 47 running 2024-12-18T00:08:20.0204501Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:08:20.0205299Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:08:20.0205974Z Compiling xla/literal.cc; 23s local 2024-12-18T00:08:20.0206887Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2024-12-18T00:08:20.0210524Z Compiling xla/service/cpu/cpu_runtime.cc; 7s local 2024-12-18T00:08:20.0211339Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2024-12-18T00:08:20.0212147Z Compiling xla/service/hlo_creation_utils.cc; 7s local 2024-12-18T00:08:20.0213085Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2024-12-18T00:08:20.3440485Z 2024-12-18T00:08:20.3441336Z  2024-12-18T00:08:20.3441822Z  2024-12-18T00:08:20.3442222Z  2024-12-18T00:08:20.3442632Z  2024-12-18T00:08:20.3443057Z  2024-12-18T00:08:20.3443442Z  2024-12-18T00:08:20.3443852Z  2024-12-18T00:08:20.3444412Z  2024-12-18T00:08:20.3445016Z [13,786 / 15,187] 48 actions running 2024-12-18T00:08:20.3445680Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:08:20.3446415Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:08:20.3447118Z Compiling xla/literal.cc; 23s local 2024-12-18T00:08:20.3447795Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:08:20.3448412Z Compiling xla/service/cpu/cpu_runtime.cc; 8s local 2024-12-18T00:08:20.3449146Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2024-12-18T00:08:20.3449862Z Compiling xla/service/hlo_creation_utils.cc; 7s local 2024-12-18T00:08:20.3450706Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2024-12-18T00:08:20.5444614Z 2024-12-18T00:08:20.5445524Z  2024-12-18T00:08:20.5445955Z  2024-12-18T00:08:20.5446378Z  2024-12-18T00:08:20.5446878Z  2024-12-18T00:08:20.5447272Z  2024-12-18T00:08:20.5447655Z  2024-12-18T00:08:20.5448052Z  2024-12-18T00:08:20.5448457Z  2024-12-18T00:08:20.5449037Z [13,788 / 15,187] 48 actions running 2024-12-18T00:08:20.5449811Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:08:20.5450579Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:08:20.5451335Z Compiling xla/literal.cc; 23s local 2024-12-18T00:08:20.5451971Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:08:20.5452688Z Compiling xla/service/cpu/cpu_runtime.cc; 8s local 2024-12-18T00:08:20.5453468Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2024-12-18T00:08:20.5454249Z Compiling xla/service/hlo_creation_utils.cc; 7s local 2024-12-18T00:08:20.5455212Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2024-12-18T00:08:20.8051345Z 2024-12-18T00:08:20.8052179Z  2024-12-18T00:08:20.8052561Z  2024-12-18T00:08:20.8052897Z  2024-12-18T00:08:20.8053231Z  2024-12-18T00:08:20.8053565Z  2024-12-18T00:08:20.8053889Z  2024-12-18T00:08:20.8054198Z  2024-12-18T00:08:20.8054526Z  2024-12-18T00:08:20.8055039Z [13,789 / 15,187] 48 actions, 47 running 2024-12-18T00:08:20.8055670Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:08:20.8056325Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:08:20.8057029Z Compiling xla/literal.cc; 23s local 2024-12-18T00:08:20.8057536Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:08:20.8058102Z Compiling xla/service/cpu/cpu_runtime.cc; 8s local 2024-12-18T00:08:20.8058723Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2024-12-18T00:08:20.8059379Z Compiling xla/service/hlo_creation_utils.cc; 8s local 2024-12-18T00:08:20.8060113Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2024-12-18T00:08:21.0090750Z 2024-12-18T00:08:21.0091577Z  2024-12-18T00:08:21.0092051Z  2024-12-18T00:08:21.0092460Z  2024-12-18T00:08:21.0092856Z  2024-12-18T00:08:21.0093222Z  2024-12-18T00:08:21.0093618Z  2024-12-18T00:08:21.0094007Z  2024-12-18T00:08:21.0094402Z  2024-12-18T00:08:21.0095009Z [13,794 / 15,187] 48 actions, 47 running 2024-12-18T00:08:21.0096186Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:08:21.0097095Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:08:21.0097758Z Compiling xla/literal.cc; 24s local 2024-12-18T00:08:21.0098355Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:08:21.0099046Z Compiling xla/service/cpu/cpu_runtime.cc; 8s local 2024-12-18T00:08:21.0100004Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2024-12-18T00:08:21.0100957Z Compiling xla/service/hlo_creation_utils.cc; 8s local 2024-12-18T00:08:21.0102054Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2024-12-18T00:08:21.2729266Z 2024-12-18T00:08:21.2730146Z  2024-12-18T00:08:21.2730722Z  2024-12-18T00:08:21.2731230Z  2024-12-18T00:08:21.2731722Z  2024-12-18T00:08:21.2732069Z  2024-12-18T00:08:21.2732401Z  2024-12-18T00:08:21.2732781Z  2024-12-18T00:08:21.2733141Z  2024-12-18T00:08:21.2733726Z [13,797 / 15,187] 48 actions, 47 running 2024-12-18T00:08:21.2734543Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:08:21.2735271Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:08:21.2735964Z Compiling xla/literal.cc; 24s local 2024-12-18T00:08:21.2736798Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:08:21.2737566Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2024-12-18T00:08:21.2738375Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2024-12-18T00:08:21.2739151Z Compiling xla/service/hlo_creation_utils.cc; 8s local 2024-12-18T00:08:21.2740115Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2024-12-18T00:08:21.5455813Z 2024-12-18T00:08:21.5456815Z  2024-12-18T00:08:21.5457332Z  2024-12-18T00:08:21.5457721Z  2024-12-18T00:08:21.5458122Z  2024-12-18T00:08:21.5458501Z  2024-12-18T00:08:21.5458879Z  2024-12-18T00:08:21.5459237Z  2024-12-18T00:08:21.5459651Z  2024-12-18T00:08:21.5460192Z [13,798 / 15,187] 48 actions running 2024-12-18T00:08:21.5460948Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:08:21.5461742Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:08:21.5462467Z Compiling xla/literal.cc; 24s local 2024-12-18T00:08:21.5463114Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:08:21.5463832Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2024-12-18T00:08:21.5464602Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2024-12-18T00:08:21.5465434Z Compiling xla/service/hlo_creation_utils.cc; 8s local 2024-12-18T00:08:21.5466316Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2024-12-18T00:08:21.9460976Z 2024-12-18T00:08:21.9461866Z  2024-12-18T00:08:21.9462366Z  2024-12-18T00:08:21.9462801Z  2024-12-18T00:08:21.9463211Z  2024-12-18T00:08:21.9463628Z  2024-12-18T00:08:21.9464025Z  2024-12-18T00:08:21.9464482Z  2024-12-18T00:08:21.9464853Z  2024-12-18T00:08:21.9465408Z [13,801 / 15,187] 48 actions running 2024-12-18T00:08:21.9466140Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:08:21.9466956Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:08:21.9467683Z Compiling xla/literal.cc; 25s local 2024-12-18T00:08:21.9468356Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:08:21.9469103Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2024-12-18T00:08:21.9469947Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2024-12-18T00:08:21.9470768Z Compiling xla/service/hlo_creation_utils.cc; 9s local 2024-12-18T00:08:21.9471763Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2024-12-18T00:08:22.3871805Z 2024-12-18T00:08:22.3872772Z  2024-12-18T00:08:22.3873261Z  2024-12-18T00:08:22.3873650Z  2024-12-18T00:08:22.3874039Z  2024-12-18T00:08:22.3874790Z  2024-12-18T00:08:22.3875175Z  2024-12-18T00:08:22.3875573Z  2024-12-18T00:08:22.3875964Z  2024-12-18T00:08:22.3876589Z [13,802 / 15,187] 48 actions, 47 running 2024-12-18T00:08:22.3877366Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:08:22.3878138Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:08:22.3879155Z Compiling xla/literal.cc; 25s local 2024-12-18T00:08:22.3879821Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:08:22.3880514Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2024-12-18T00:08:22.3881321Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2024-12-18T00:08:22.3882129Z Compiling xla/service/hlo_creation_utils.cc; 9s local 2024-12-18T00:08:22.3883036Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2024-12-18T00:08:22.6060534Z 2024-12-18T00:08:22.6061373Z  2024-12-18T00:08:22.6061842Z  2024-12-18T00:08:22.6062228Z  2024-12-18T00:08:22.6062649Z  2024-12-18T00:08:22.6063045Z  2024-12-18T00:08:22.6063435Z  2024-12-18T00:08:22.6063836Z  2024-12-18T00:08:22.6064221Z  2024-12-18T00:08:22.6064823Z [13,805 / 15,187] 48 actions, 47 running 2024-12-18T00:08:22.6065560Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:08:22.6066357Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:08:22.6067066Z Compiling xla/literal.cc; 25s local 2024-12-18T00:08:22.6067699Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:08:22.6068381Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2024-12-18T00:08:22.6069154Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2024-12-18T00:08:22.6069942Z Compiling xla/service/hlo_creation_utils.cc; 9s local 2024-12-18T00:08:22.6070827Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 8s local ... 2024-12-18T00:08:22.8853603Z 2024-12-18T00:08:22.8854431Z  2024-12-18T00:08:22.8854932Z  2024-12-18T00:08:22.8855327Z  2024-12-18T00:08:22.8855713Z  2024-12-18T00:08:22.8856127Z  2024-12-18T00:08:22.8856822Z  2024-12-18T00:08:22.8857201Z  2024-12-18T00:08:22.8857612Z  2024-12-18T00:08:22.8858149Z [13,807 / 15,187] 48 actions, 47 running 2024-12-18T00:08:22.8858894Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:08:22.8859605Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:08:22.8860282Z Compiling xla/literal.cc; 26s local 2024-12-18T00:08:22.8860910Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:08:22.8861614Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2024-12-18T00:08:22.8862390Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2024-12-18T00:08:22.8863174Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2024-12-18T00:08:22.8864092Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local ... 2024-12-18T00:08:23.1468893Z 2024-12-18T00:08:23.1469777Z  2024-12-18T00:08:23.1470213Z  2024-12-18T00:08:23.1470595Z  2024-12-18T00:08:23.1470962Z  2024-12-18T00:08:23.1471335Z  2024-12-18T00:08:23.1471686Z  2024-12-18T00:08:23.1472062Z  2024-12-18T00:08:23.1472415Z  2024-12-18T00:08:23.1472949Z [13,813 / 15,187] 48 actions running 2024-12-18T00:08:23.1473657Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:08:23.1474370Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:08:23.1475031Z Compiling xla/literal.cc; 26s local 2024-12-18T00:08:23.1475681Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:08:23.1476588Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2024-12-18T00:08:23.1477404Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2024-12-18T00:08:23.1478278Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local 2024-12-18T00:08:23.1479172Z Compiling xla/service/buffer_value.cc; 8s local ... 2024-12-18T00:08:23.4370885Z 2024-12-18T00:08:23.4371741Z  2024-12-18T00:08:23.4372194Z  2024-12-18T00:08:23.4372593Z  2024-12-18T00:08:23.4372998Z  2024-12-18T00:08:23.4373390Z  2024-12-18T00:08:23.4373761Z  2024-12-18T00:08:23.4374157Z  2024-12-18T00:08:23.4374560Z  2024-12-18T00:08:23.4375537Z [13,814 / 15,187] 48 actions, 47 running 2024-12-18T00:08:23.4376308Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:08:23.4377149Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:08:23.4377759Z Compiling xla/literal.cc; 26s local 2024-12-18T00:08:23.4378427Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:08:23.4379163Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2024-12-18T00:08:23.4379915Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2024-12-18T00:08:23.4380767Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local 2024-12-18T00:08:23.4381670Z Compiling xla/service/hlo_cost_analysis.cc; 8s local ... 2024-12-18T00:08:23.6465680Z 2024-12-18T00:08:23.6466569Z  2024-12-18T00:08:23.6467069Z  2024-12-18T00:08:23.6467456Z  2024-12-18T00:08:23.6467829Z  2024-12-18T00:08:23.6468217Z  2024-12-18T00:08:23.6468602Z  2024-12-18T00:08:23.6468981Z  2024-12-18T00:08:23.6469366Z  2024-12-18T00:08:23.6469979Z [13,815 / 15,187] 48 actions, 47 running 2024-12-18T00:08:23.6470713Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:08:23.6471462Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:08:23.6472151Z Compiling xla/literal.cc; 26s local 2024-12-18T00:08:23.6472850Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:08:23.6473616Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2024-12-18T00:08:23.6474455Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2024-12-18T00:08:23.6475382Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local 2024-12-18T00:08:23.6476328Z Compiling xla/service/hlo_cost_analysis.cc; 8s local ... 2024-12-18T00:08:23.8965068Z 2024-12-18T00:08:23.8965969Z  2024-12-18T00:08:23.8966442Z  2024-12-18T00:08:23.8966821Z  2024-12-18T00:08:23.8967196Z  2024-12-18T00:08:23.8967598Z  2024-12-18T00:08:23.8967976Z  2024-12-18T00:08:23.8968389Z  2024-12-18T00:08:23.8968765Z  2024-12-18T00:08:23.8969384Z [13,817 / 15,187] 48 actions, 47 running 2024-12-18T00:08:23.8970172Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:08:23.8970969Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:08:23.8971655Z Compiling xla/literal.cc; 27s local 2024-12-18T00:08:23.8972338Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:08:23.8973148Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2024-12-18T00:08:23.8973968Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2024-12-18T00:08:23.8974874Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local 2024-12-18T00:08:23.8975836Z Compiling xla/service/hlo_cost_analysis.cc; 8s local ... 2024-12-18T00:08:24.1476892Z 2024-12-18T00:08:24.1477734Z  2024-12-18T00:08:24.1478147Z  2024-12-18T00:08:24.1478514Z  2024-12-18T00:08:24.1478875Z  2024-12-18T00:08:24.1479281Z  2024-12-18T00:08:24.1479632Z  2024-12-18T00:08:24.1479986Z  2024-12-18T00:08:24.1480323Z  2024-12-18T00:08:24.1480839Z [13,817 / 15,187] 48 actions running 2024-12-18T00:08:24.1481516Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:08:24.1482201Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:08:24.1482849Z Compiling xla/literal.cc; 27s local 2024-12-18T00:08:24.1483449Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2024-12-18T00:08:24.1484147Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2024-12-18T00:08:24.1485284Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2024-12-18T00:08:24.1486058Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local 2024-12-18T00:08:24.1486845Z Compiling xla/service/hlo_cost_analysis.cc; 9s local ... 2024-12-18T00:08:24.5481758Z 2024-12-18T00:08:24.5482637Z  2024-12-18T00:08:24.5483105Z  2024-12-18T00:08:24.5483924Z  2024-12-18T00:08:24.5484322Z  2024-12-18T00:08:24.5484722Z  2024-12-18T00:08:24.5485116Z  2024-12-18T00:08:24.5485490Z  2024-12-18T00:08:24.5496921Z  2024-12-18T00:08:24.5497904Z [13,820 / 15,187] 48 actions running 2024-12-18T00:08:24.5498684Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2024-12-18T00:08:24.5499508Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:08:24.5500246Z Compiling xla/literal.cc; 27s local 2024-12-18T00:08:24.5500947Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2024-12-18T00:08:24.5501798Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2024-12-18T00:08:24.5502623Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2024-12-18T00:08:24.5503553Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local 2024-12-18T00:08:24.5504479Z Compiling xla/service/hlo_cost_analysis.cc; 9s local ... 2024-12-18T00:08:24.7486549Z 2024-12-18T00:08:24.7487443Z  2024-12-18T00:08:24.7487932Z  2024-12-18T00:08:24.7488291Z  2024-12-18T00:08:24.7488677Z  2024-12-18T00:08:24.7489078Z  2024-12-18T00:08:24.7489458Z  2024-12-18T00:08:24.7489868Z  2024-12-18T00:08:24.7490269Z  2024-12-18T00:08:24.7490837Z [13,822 / 15,187] 48 actions running 2024-12-18T00:08:24.7491694Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2024-12-18T00:08:24.7492438Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:08:24.7493157Z Compiling xla/literal.cc; 27s local 2024-12-18T00:08:24.7493907Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2024-12-18T00:08:24.7494744Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2024-12-18T00:08:24.7495594Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2024-12-18T00:08:24.7496694Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local 2024-12-18T00:08:24.7497680Z Compiling xla/service/hlo_cost_analysis.cc; 9s local ... 2024-12-18T00:08:25.1224568Z 2024-12-18T00:08:25.1225444Z  2024-12-18T00:08:25.1225938Z  2024-12-18T00:08:25.1226353Z  2024-12-18T00:08:25.1226766Z  2024-12-18T00:08:25.1227162Z  2024-12-18T00:08:25.1227556Z  2024-12-18T00:08:25.1227957Z  2024-12-18T00:08:25.1228363Z  2024-12-18T00:08:25.1228989Z [13,825 / 15,187] 48 actions, 47 running 2024-12-18T00:08:25.1229788Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2024-12-18T00:08:25.1230587Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:08:25.1231362Z Compiling xla/literal.cc; 28s local 2024-12-18T00:08:25.1232080Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2024-12-18T00:08:25.1232868Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2024-12-18T00:08:25.1233663Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2024-12-18T00:08:25.1234627Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local 2024-12-18T00:08:25.1235663Z Compiling xla/service/hlo_cost_analysis.cc; 10s local ... 2024-12-18T00:08:25.3492599Z 2024-12-18T00:08:25.3493415Z  2024-12-18T00:08:25.3493897Z  2024-12-18T00:08:25.3494316Z  2024-12-18T00:08:25.3494717Z  2024-12-18T00:08:25.3495124Z  2024-12-18T00:08:25.3495540Z  2024-12-18T00:08:25.3495960Z  2024-12-18T00:08:25.3496472Z  2024-12-18T00:08:25.3497077Z [13,829 / 15,187] 48 actions running 2024-12-18T00:08:25.3497858Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2024-12-18T00:08:25.3498665Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:08:25.3499731Z Compiling xla/literal.cc; 28s local 2024-12-18T00:08:25.3500437Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2024-12-18T00:08:25.3501267Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2024-12-18T00:08:25.3502048Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2024-12-18T00:08:25.3503095Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local 2024-12-18T00:08:25.3503950Z Compiling xla/service/hlo_cost_analysis.cc; 10s local ... 2024-12-18T00:08:25.5496776Z 2024-12-18T00:08:25.5497566Z  2024-12-18T00:08:25.5498049Z  2024-12-18T00:08:25.5498460Z  2024-12-18T00:08:25.5498845Z  2024-12-18T00:08:25.5499259Z  2024-12-18T00:08:25.5499665Z  2024-12-18T00:08:25.5500073Z  2024-12-18T00:08:25.5500469Z  2024-12-18T00:08:25.5501051Z [13,830 / 15,187] 48 actions running 2024-12-18T00:08:25.5501833Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:08:25.5502686Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:08:25.5503422Z Compiling xla/literal.cc; 28s local 2024-12-18T00:08:25.5504101Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2024-12-18T00:08:25.5504932Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2024-12-18T00:08:25.5505811Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2024-12-18T00:08:25.5506672Z Compiling xla/service/hlo_cost_analysis.cc; 10s local 2024-12-18T00:08:25.5507602Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 9s local ... 2024-12-18T00:08:25.8100528Z 2024-12-18T00:08:25.8101370Z  2024-12-18T00:08:25.8101802Z  2024-12-18T00:08:25.8102174Z  2024-12-18T00:08:25.8102527Z  2024-12-18T00:08:25.8102893Z  2024-12-18T00:08:25.8103264Z  2024-12-18T00:08:25.8103627Z  2024-12-18T00:08:25.8103989Z  2024-12-18T00:08:25.8104540Z [13,833 / 15,187] 48 actions, 47 running 2024-12-18T00:08:25.8105290Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:08:25.8106016Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:08:25.8106639Z Compiling xla/literal.cc; 28s local 2024-12-18T00:08:25.8107253Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2024-12-18T00:08:25.8107947Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2024-12-18T00:08:25.8108700Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:08:25.8109461Z Compiling xla/service/hlo_cost_analysis.cc; 10s local 2024-12-18T00:08:25.8110254Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 9s local ... 2024-12-18T00:08:26.1502802Z 2024-12-18T00:08:26.1503659Z  2024-12-18T00:08:26.1504160Z  2024-12-18T00:08:26.1504572Z  2024-12-18T00:08:26.1504972Z  2024-12-18T00:08:26.1505386Z  2024-12-18T00:08:26.1505781Z  2024-12-18T00:08:26.1506168Z  2024-12-18T00:08:26.1506568Z  2024-12-18T00:08:26.1507174Z [13,833 / 15,187] 48 actions running 2024-12-18T00:08:26.1507919Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:08:26.1508685Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:08:26.1509408Z Compiling xla/literal.cc; 29s local 2024-12-18T00:08:26.1510116Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:08:26.1510947Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2024-12-18T00:08:26.1511770Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:08:26.1512557Z Compiling xla/service/hlo_cost_analysis.cc; 11s local 2024-12-18T00:08:26.1513453Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 9s local ... 2024-12-18T00:08:26.3507215Z 2024-12-18T00:08:26.3508084Z  2024-12-18T00:08:26.3508568Z  2024-12-18T00:08:26.3508977Z  2024-12-18T00:08:26.3509375Z  2024-12-18T00:08:26.3509790Z  2024-12-18T00:08:26.3510207Z  2024-12-18T00:08:26.3511048Z  2024-12-18T00:08:26.3511458Z  2024-12-18T00:08:26.3512031Z [13,834 / 15,187] 48 actions running 2024-12-18T00:08:26.3512801Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:08:26.3513602Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:08:26.3514317Z Compiling xla/literal.cc; 29s local 2024-12-18T00:08:26.3515222Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:08:26.3516008Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2024-12-18T00:08:26.3516867Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:08:26.3517709Z Compiling xla/service/hlo_cost_analysis.cc; 11s local 2024-12-18T00:08:26.3518605Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local ... 2024-12-18T00:08:26.6105174Z 2024-12-18T00:08:26.6106048Z  2024-12-18T00:08:26.6106522Z  2024-12-18T00:08:26.6106918Z  2024-12-18T00:08:26.6107325Z  2024-12-18T00:08:26.6107725Z  2024-12-18T00:08:26.6108175Z  2024-12-18T00:08:26.6108695Z  2024-12-18T00:08:26.6109082Z  2024-12-18T00:08:26.6109687Z [13,836 / 15,187] 48 actions, 47 running 2024-12-18T00:08:26.6110449Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:08:26.6111245Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:08:26.6111957Z Compiling xla/literal.cc; 29s local 2024-12-18T00:08:26.6112658Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:08:26.6113436Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2024-12-18T00:08:26.6114249Z Compiling xla/service/hlo_cost_analysis.cc; 11s local 2024-12-18T00:08:26.6115116Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:08:26.6115975Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local ... 2024-12-18T00:08:26.8488398Z 2024-12-18T00:08:26.8489308Z  2024-12-18T00:08:26.8489804Z  2024-12-18T00:08:26.8490198Z  2024-12-18T00:08:26.8490692Z  2024-12-18T00:08:26.8491150Z  2024-12-18T00:08:26.8491607Z  2024-12-18T00:08:26.8491993Z  2024-12-18T00:08:26.8492369Z  2024-12-18T00:08:26.8493086Z [13,838 / 15,187] 48 actions, 47 running 2024-12-18T00:08:26.8493878Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:08:26.8494633Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:08:26.8495452Z Compiling xla/literal.cc; 29s local 2024-12-18T00:08:26.8496125Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:08:26.8497099Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2024-12-18T00:08:26.8497942Z Compiling xla/service/hlo_cost_analysis.cc; 11s local 2024-12-18T00:08:26.8498778Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:08:26.8499737Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local ... 2024-12-18T00:08:27.1514175Z 2024-12-18T00:08:27.1515042Z  2024-12-18T00:08:27.1515580Z  2024-12-18T00:08:27.1515962Z  2024-12-18T00:08:27.1516374Z  2024-12-18T00:08:27.1516774Z  2024-12-18T00:08:27.1517201Z  2024-12-18T00:08:27.1517621Z  2024-12-18T00:08:27.1518016Z  2024-12-18T00:08:27.1518595Z [13,838 / 15,187] 48 actions running 2024-12-18T00:08:27.1519358Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:08:27.1520175Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:08:27.1520788Z Compiling xla/literal.cc; 30s local 2024-12-18T00:08:27.1521507Z Compiling xla/service/cpu/cpu_runtime.cc; 15s local 2024-12-18T00:08:27.1522310Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2024-12-18T00:08:27.1523143Z Compiling xla/service/hlo_cost_analysis.cc; 12s local 2024-12-18T00:08:27.1523964Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:08:27.1524854Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local ... 2024-12-18T00:08:27.3518415Z 2024-12-18T00:08:27.3519667Z  2024-12-18T00:08:27.3520147Z  2024-12-18T00:08:27.3520550Z  2024-12-18T00:08:27.3520921Z  2024-12-18T00:08:27.3521303Z  2024-12-18T00:08:27.3521661Z  2024-12-18T00:08:27.3522048Z  2024-12-18T00:08:27.3522447Z  2024-12-18T00:08:27.3522967Z [13,842 / 15,187] 48 actions running 2024-12-18T00:08:27.3523935Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:08:27.3524734Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:08:27.3525429Z Compiling xla/literal.cc; 30s local 2024-12-18T00:08:27.3526136Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2024-12-18T00:08:27.3526985Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:08:27.3527777Z Compiling xla/service/hlo_value.cc; 10s local 2024-12-18T00:08:27.3528473Z Compiling xla/service/gpu/cublas_cudnn.cc; 9s local 2024-12-18T00:08:27.3529207Z Compiling xla/service/hlo_graph_dumper.cc; 9s local ... 2024-12-18T00:08:27.7522894Z 2024-12-18T00:08:27.7523775Z  2024-12-18T00:08:27.7524228Z  2024-12-18T00:08:27.7524630Z  2024-12-18T00:08:27.7525013Z  2024-12-18T00:08:27.7525405Z  2024-12-18T00:08:27.7525770Z  2024-12-18T00:08:27.7526156Z  2024-12-18T00:08:27.7526547Z  2024-12-18T00:08:27.7527143Z [13,843 / 15,187] 48 actions running 2024-12-18T00:08:27.7527974Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:08:27.7528731Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:08:27.7529442Z Compiling xla/literal.cc; 30s local 2024-12-18T00:08:27.7530150Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2024-12-18T00:08:27.7531028Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:08:27.7531838Z Compiling xla/service/hlo_value.cc; 10s local 2024-12-18T00:08:27.7532554Z Compiling xla/service/gpu/cublas_cudnn.cc; 10s local 2024-12-18T00:08:27.7533407Z Compiling xla/service/hlo_graph_dumper.cc; 10s local ... 2024-12-18T00:08:27.9526365Z 2024-12-18T00:08:27.9527239Z  2024-12-18T00:08:27.9527759Z  2024-12-18T00:08:27.9528176Z  2024-12-18T00:08:27.9528600Z  2024-12-18T00:08:27.9529005Z  2024-12-18T00:08:27.9529418Z  2024-12-18T00:08:27.9529829Z  2024-12-18T00:08:27.9530231Z  2024-12-18T00:08:27.9530843Z [13,846 / 15,187] 47 actions running 2024-12-18T00:08:27.9531574Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:08:27.9532233Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:08:27.9532935Z Compiling xla/literal.cc; 31s local 2024-12-18T00:08:27.9533666Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:08:27.9534439Z Compiling xla/service/hlo_value.cc; 10s local 2024-12-18T00:08:27.9535211Z Compiling xla/service/gpu/cublas_cudnn.cc; 10s local 2024-12-18T00:08:27.9535996Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2024-12-18T00:08:27.9536994Z Compiling xla/hlo/ir/hlo_module_group.cc; 9s local ... 2024-12-18T00:08:28.3530637Z 2024-12-18T00:08:28.3531402Z  2024-12-18T00:08:28.3531812Z  2024-12-18T00:08:28.3532180Z  2024-12-18T00:08:28.3532525Z  2024-12-18T00:08:28.3532861Z  2024-12-18T00:08:28.3533191Z  2024-12-18T00:08:28.3533521Z  2024-12-18T00:08:28.3533904Z  2024-12-18T00:08:28.3534385Z [13,846 / 15,187] 48 actions running 2024-12-18T00:08:28.3535033Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:08:28.3535701Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:08:28.3536321Z Compiling xla/literal.cc; 31s local 2024-12-18T00:08:28.3537274Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 12s local 2024-12-18T00:08:28.3537944Z Compiling xla/service/hlo_value.cc; 11s local 2024-12-18T00:08:28.3538592Z Compiling xla/service/gpu/cublas_cudnn.cc; 10s local 2024-12-18T00:08:28.3539869Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2024-12-18T00:08:28.3540560Z Compiling xla/hlo/ir/hlo_module_group.cc; 9s local ... 2024-12-18T00:08:28.5534189Z 2024-12-18T00:08:28.5535045Z  2024-12-18T00:08:28.5535521Z  2024-12-18T00:08:28.5535920Z  2024-12-18T00:08:28.5536455Z  2024-12-18T00:08:28.5536862Z  2024-12-18T00:08:28.5537255Z  2024-12-18T00:08:28.5538000Z  2024-12-18T00:08:28.5538416Z  2024-12-18T00:08:28.5539011Z [13,848 / 15,187] 48 actions running 2024-12-18T00:08:28.5539791Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:08:28.5540591Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:08:28.5541281Z Compiling xla/literal.cc; 31s local 2024-12-18T00:08:28.5541944Z Compiling xla/service/hlo_value.cc; 11s local 2024-12-18T00:08:28.5542715Z Compiling xla/service/gpu/cublas_cudnn.cc; 11s local 2024-12-18T00:08:28.5543550Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2024-12-18T00:08:28.5544632Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2024-12-18T00:08:28.5545508Z Compiling xla/hlo/analysis/hlo_reachability.cc; 7s local ... 2024-12-18T00:08:28.9193238Z 2024-12-18T00:08:28.9194116Z  2024-12-18T00:08:28.9194555Z  2024-12-18T00:08:28.9194906Z  2024-12-18T00:08:28.9195283Z  2024-12-18T00:08:28.9195709Z  2024-12-18T00:08:28.9196090Z  2024-12-18T00:08:28.9196437Z  2024-12-18T00:08:28.9196764Z  2024-12-18T00:08:28.9197395Z [13,850 / 15,187] 48 actions, 47 running 2024-12-18T00:08:28.9198111Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:08:28.9198839Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:08:28.9199508Z Compiling xla/literal.cc; 32s local 2024-12-18T00:08:28.9200265Z Compiling xla/service/hlo_value.cc; 11s local 2024-12-18T00:08:28.9200992Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2024-12-18T00:08:28.9201802Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2024-12-18T00:08:28.9202607Z Compiling xla/hlo/analysis/hlo_reachability.cc; 8s local 2024-12-18T00:08:28.9203420Z Compiling xla/service/call_graph.cc; 8s local ... 2024-12-18T00:08:29.1540780Z 2024-12-18T00:08:29.1541616Z  2024-12-18T00:08:29.1542083Z  2024-12-18T00:08:29.1542455Z  2024-12-18T00:08:29.1542876Z  2024-12-18T00:08:29.1543278Z  2024-12-18T00:08:29.1543658Z  2024-12-18T00:08:29.1544010Z  2024-12-18T00:08:29.1544697Z  2024-12-18T00:08:29.1545207Z [13,853 / 15,187] 48 actions running 2024-12-18T00:08:29.1545898Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:08:29.1546610Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:08:29.1547236Z Compiling xla/literal.cc; 32s local 2024-12-18T00:08:29.1547848Z Compiling xla/service/hlo_value.cc; 11s local 2024-12-18T00:08:29.1548525Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2024-12-18T00:08:29.1549214Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2024-12-18T00:08:29.1550102Z Compiling xla/hlo/analysis/hlo_reachability.cc; 8s local 2024-12-18T00:08:29.1550886Z Compiling xla/service/call_graph.cc; 8s local ... 2024-12-18T00:08:29.5043527Z 2024-12-18T00:08:29.5044686Z  2024-12-18T00:08:29.5045219Z  2024-12-18T00:08:29.5045622Z  2024-12-18T00:08:29.5046011Z  2024-12-18T00:08:29.5046363Z  2024-12-18T00:08:29.5046737Z  2024-12-18T00:08:29.5047120Z  2024-12-18T00:08:29.5047487Z  2024-12-18T00:08:29.5048107Z [13,854 / 15,187] 48 actions, 47 running 2024-12-18T00:08:29.5048832Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:08:29.5049576Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:08:29.5050406Z Compiling xla/literal.cc; 32s local 2024-12-18T00:08:29.5051064Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2024-12-18T00:08:29.5052319Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2024-12-18T00:08:29.5053126Z Compiling xla/hlo/analysis/hlo_reachability.cc; 8s local 2024-12-18T00:08:29.5053911Z Compiling xla/service/call_graph.cc; 8s local 2024-12-18T00:08:29.5054857Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2024-12-18T00:08:29.7548583Z 2024-12-18T00:08:29.7549875Z  2024-12-18T00:08:29.7550431Z  2024-12-18T00:08:29.7550829Z  2024-12-18T00:08:29.7551224Z  2024-12-18T00:08:29.7551603Z  2024-12-18T00:08:29.7551967Z  2024-12-18T00:08:29.7552326Z  2024-12-18T00:08:29.7552697Z  2024-12-18T00:08:29.7553226Z [13,856 / 15,187] 48 actions running 2024-12-18T00:08:29.7553932Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:08:29.7554659Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:08:29.7555295Z Compiling xla/literal.cc; 32s local 2024-12-18T00:08:29.7555993Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2024-12-18T00:08:29.7556758Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2024-12-18T00:08:29.7557554Z Compiling xla/hlo/analysis/hlo_reachability.cc; 8s local 2024-12-18T00:08:29.7558325Z Compiling xla/service/call_graph.cc; 8s local 2024-12-18T00:08:29.7559277Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2024-12-18T00:08:29.9984173Z 2024-12-18T00:08:29.9985011Z  2024-12-18T00:08:29.9985493Z  2024-12-18T00:08:29.9985874Z  2024-12-18T00:08:29.9986305Z  2024-12-18T00:08:29.9986681Z  2024-12-18T00:08:29.9987059Z  2024-12-18T00:08:29.9987430Z  2024-12-18T00:08:29.9987828Z  2024-12-18T00:08:29.9988435Z [13,857 / 15,187] 48 actions, 47 running 2024-12-18T00:08:29.9989158Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:08:29.9989900Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:08:29.9990597Z Compiling xla/literal.cc; 33s local 2024-12-18T00:08:29.9991256Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2024-12-18T00:08:29.9991996Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2024-12-18T00:08:29.9992780Z Compiling xla/hlo/analysis/hlo_reachability.cc; 9s local 2024-12-18T00:08:29.9993552Z Compiling xla/service/call_graph.cc; 9s local 2024-12-18T00:08:29.9994460Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2024-12-18T00:08:30.2005146Z 2024-12-18T00:08:30.2006010Z  2024-12-18T00:08:30.2006495Z  2024-12-18T00:08:30.2006897Z  2024-12-18T00:08:30.2007277Z  2024-12-18T00:08:30.2007677Z  2024-12-18T00:08:30.2008047Z  2024-12-18T00:08:30.2008440Z  2024-12-18T00:08:30.2008833Z  2024-12-18T00:08:30.2009433Z [13,859 / 15,187] 48 actions, 47 running 2024-12-18T00:08:30.2010177Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:08:30.2010922Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:08:30.2011601Z Compiling xla/literal.cc; 33s local 2024-12-18T00:08:30.2012281Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2024-12-18T00:08:30.2013003Z Compiling xla/hlo/analysis/hlo_reachability.cc; 9s local 2024-12-18T00:08:30.2013773Z Compiling xla/service/call_graph.cc; 9s local 2024-12-18T00:08:30.2014697Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2024-12-18T00:08:30.2015801Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local ... 2024-12-18T00:08:30.4895475Z 2024-12-18T00:08:30.4896498Z  2024-12-18T00:08:30.4896946Z  2024-12-18T00:08:30.4897264Z  2024-12-18T00:08:30.4897722Z  2024-12-18T00:08:30.4898071Z  2024-12-18T00:08:30.4898442Z  2024-12-18T00:08:30.4898818Z  2024-12-18T00:08:30.4899147Z  2024-12-18T00:08:30.4899761Z [13,865 / 15,187] 48 actions, 47 running 2024-12-18T00:08:30.4900879Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:08:30.4901555Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:08:30.4902209Z Compiling xla/literal.cc; 33s local 2024-12-18T00:08:30.4902912Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2024-12-18T00:08:30.4903684Z Compiling xla/hlo/analysis/hlo_reachability.cc; 9s local 2024-12-18T00:08:30.4904747Z Compiling xla/service/call_graph.cc; 9s local 2024-12-18T00:08:30.4905687Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2024-12-18T00:08:30.4906746Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local ... 2024-12-18T00:08:30.7556854Z 2024-12-18T00:08:30.7557736Z  2024-12-18T00:08:30.7558251Z  2024-12-18T00:08:30.7558601Z  2024-12-18T00:08:30.7558964Z  2024-12-18T00:08:30.7559342Z  2024-12-18T00:08:30.7559708Z  2024-12-18T00:08:30.7560099Z  2024-12-18T00:08:30.7560525Z  2024-12-18T00:08:30.7561149Z [13,869 / 15,187] 48 actions running 2024-12-18T00:08:30.7561833Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:08:30.7562536Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:08:30.7563200Z Compiling xla/literal.cc; 33s local 2024-12-18T00:08:30.7563927Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2024-12-18T00:08:30.7564767Z Compiling xla/hlo/analysis/hlo_reachability.cc; 9s local 2024-12-18T00:08:30.7565500Z Compiling xla/service/call_graph.cc; 9s local 2024-12-18T00:08:30.7566433Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2024-12-18T00:08:30.7567597Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local ... 2024-12-18T00:08:31.2526589Z 2024-12-18T00:08:31.2527412Z  2024-12-18T00:08:31.2527817Z  2024-12-18T00:08:31.2528158Z  2024-12-18T00:08:31.2528514Z  2024-12-18T00:08:31.2528831Z  2024-12-18T00:08:31.2529183Z  2024-12-18T00:08:31.2529558Z  2024-12-18T00:08:31.2529899Z  2024-12-18T00:08:31.2530421Z [13,870 / 15,187] 48 actions, 47 running 2024-12-18T00:08:31.2531064Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:08:31.2531723Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:08:31.2532295Z Compiling xla/literal.cc; 34s local 2024-12-18T00:08:31.2532890Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2024-12-18T00:08:31.2533583Z Compiling xla/hlo/analysis/hlo_reachability.cc; 10s local 2024-12-18T00:08:31.2534226Z Compiling xla/service/call_graph.cc; 10s local 2024-12-18T00:08:31.2534958Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2024-12-18T00:08:31.2535909Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2024-12-18T00:08:31.4593190Z 2024-12-18T00:08:31.4593954Z  2024-12-18T00:08:31.4594364Z  2024-12-18T00:08:31.4594730Z  2024-12-18T00:08:31.4595095Z  2024-12-18T00:08:31.4595428Z  2024-12-18T00:08:31.4595756Z  2024-12-18T00:08:31.4596100Z  2024-12-18T00:08:31.4596420Z  2024-12-18T00:08:31.4596941Z [13,871 / 15,187] 48 actions, 47 running 2024-12-18T00:08:31.4597615Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:08:31.4598320Z Compiling xla/hlo/ir/hlo_instruction.cc; 37s local 2024-12-18T00:08:31.4598933Z Compiling xla/literal.cc; 34s local 2024-12-18T00:08:31.4599492Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2024-12-18T00:08:31.4600183Z Compiling xla/hlo/analysis/hlo_reachability.cc; 10s local 2024-12-18T00:08:31.4600846Z Compiling xla/service/call_graph.cc; 10s local 2024-12-18T00:08:31.4601600Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2024-12-18T00:08:31.4602532Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2024-12-18T00:08:31.7208052Z 2024-12-18T00:08:31.7208927Z  2024-12-18T00:08:31.7209797Z  2024-12-18T00:08:31.7210180Z  2024-12-18T00:08:31.7210525Z  2024-12-18T00:08:31.7210894Z  2024-12-18T00:08:31.7211258Z  2024-12-18T00:08:31.7211624Z  2024-12-18T00:08:31.7211991Z  2024-12-18T00:08:31.7212521Z [13,873 / 15,187] 48 actions, 47 running 2024-12-18T00:08:31.7213222Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:08:31.7214285Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2024-12-18T00:08:31.7215141Z Compiling xla/hlo/analysis/hlo_reachability.cc; 10s local 2024-12-18T00:08:31.7215908Z Compiling xla/service/call_graph.cc; 10s local 2024-12-18T00:08:31.7216895Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2024-12-18T00:08:31.7217872Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local 2024-12-18T00:08:31.7218779Z Compiling xla/service/cpu/ir_emission_utils.cc; 9s local 2024-12-18T00:08:31.7219537Z Compiling xla/service/map_inliner.cc; 9s local ... 2024-12-18T00:08:31.9564769Z 2024-12-18T00:08:31.9565627Z  2024-12-18T00:08:31.9566003Z  2024-12-18T00:08:31.9566297Z  2024-12-18T00:08:31.9566603Z  2024-12-18T00:08:31.9566907Z  2024-12-18T00:08:31.9567235Z  2024-12-18T00:08:31.9567618Z  2024-12-18T00:08:31.9567969Z  2024-12-18T00:08:31.9568522Z [13,873 / 15,187] 48 actions running 2024-12-18T00:08:31.9569225Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:08:31.9569958Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2024-12-18T00:08:31.9570729Z Compiling xla/hlo/analysis/hlo_reachability.cc; 11s local 2024-12-18T00:08:31.9571465Z Compiling xla/service/call_graph.cc; 11s local 2024-12-18T00:08:31.9572311Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2024-12-18T00:08:31.9573335Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local 2024-12-18T00:08:31.9574367Z Compiling xla/service/cpu/ir_emission_utils.cc; 10s local 2024-12-18T00:08:31.9575197Z Compiling xla/service/map_inliner.cc; 9s local ... 2024-12-18T00:08:32.4951682Z 2024-12-18T00:08:32.4952541Z  2024-12-18T00:08:32.4953017Z  2024-12-18T00:08:32.4953402Z  2024-12-18T00:08:32.4953794Z  2024-12-18T00:08:32.4954169Z  2024-12-18T00:08:32.4954569Z  2024-12-18T00:08:32.4954937Z  2024-12-18T00:08:32.4955378Z  2024-12-18T00:08:32.4956017Z [13,874 / 15,187] 48 actions, 47 running 2024-12-18T00:08:32.4956750Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:08:32.4957539Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2024-12-18T00:08:32.4958360Z Compiling xla/hlo/analysis/hlo_reachability.cc; 11s local 2024-12-18T00:08:32.4959176Z Compiling xla/service/call_graph.cc; 11s local 2024-12-18T00:08:32.4960125Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2024-12-18T00:08:32.4961211Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local 2024-12-18T00:08:32.4962261Z Compiling xla/service/cpu/ir_emission_utils.cc; 10s local 2024-12-18T00:08:32.4963217Z Compiling xla/service/map_inliner.cc; 9s local ... 2024-12-18T00:08:32.7475876Z 2024-12-18T00:08:32.7476779Z  2024-12-18T00:08:32.7477230Z  2024-12-18T00:08:32.7477611Z  2024-12-18T00:08:32.7477966Z  2024-12-18T00:08:32.7478347Z  2024-12-18T00:08:32.7478725Z  2024-12-18T00:08:32.7479102Z  2024-12-18T00:08:32.7479474Z  2024-12-18T00:08:32.7480175Z [13,878 / 15,187] 48 actions, 47 running 2024-12-18T00:08:32.7480791Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:08:32.7481349Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:08:32.7481928Z Compiling xla/service/call_graph.cc; 11s local 2024-12-18T00:08:32.7482570Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2024-12-18T00:08:32.7483968Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local 2024-12-18T00:08:32.7484799Z Compiling xla/service/cpu/ir_emission_utils.cc; 11s local 2024-12-18T00:08:32.7485366Z Compiling xla/service/map_inliner.cc; 10s local 2024-12-18T00:08:32.7485863Z Compiling xla/pjrt/utils.cc; 9s local ... 2024-12-18T00:08:32.9505699Z 2024-12-18T00:08:32.9506600Z  2024-12-18T00:08:32.9507540Z  2024-12-18T00:08:32.9508075Z  2024-12-18T00:08:32.9508459Z  2024-12-18T00:08:32.9508841Z  2024-12-18T00:08:32.9509207Z  2024-12-18T00:08:32.9509586Z  2024-12-18T00:08:32.9509966Z  2024-12-18T00:08:32.9510560Z [13,880 / 15,187] 48 actions, 47 running 2024-12-18T00:08:32.9511295Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:08:32.9512060Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:08:32.9512742Z Compiling xla/service/call_graph.cc; 12s local 2024-12-18T00:08:32.9513734Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2024-12-18T00:08:32.9514844Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local 2024-12-18T00:08:32.9515802Z Compiling xla/service/cpu/ir_emission_utils.cc; 11s local 2024-12-18T00:08:32.9516567Z Compiling xla/service/map_inliner.cc; 10s local 2024-12-18T00:08:32.9517220Z Compiling xla/pjrt/utils.cc; 10s local ... 2024-12-18T00:08:33.1573890Z 2024-12-18T00:08:33.1574778Z  2024-12-18T00:08:33.1575269Z  2024-12-18T00:08:33.1575641Z  2024-12-18T00:08:33.1575991Z  2024-12-18T00:08:33.1576521Z  2024-12-18T00:08:33.1576887Z  2024-12-18T00:08:33.1577278Z  2024-12-18T00:08:33.1577643Z  2024-12-18T00:08:33.1578161Z [13,880 / 15,187] 48 actions running 2024-12-18T00:08:33.1578964Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:08:33.1579834Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:08:33.1580506Z Compiling xla/service/call_graph.cc; 12s local 2024-12-18T00:08:33.1581412Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2024-12-18T00:08:33.1582450Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2024-12-18T00:08:33.1583288Z Compiling xla/service/cpu/ir_emission_utils.cc; 11s local 2024-12-18T00:08:33.1584088Z Compiling xla/service/map_inliner.cc; 10s local 2024-12-18T00:08:33.1584779Z Compiling xla/pjrt/utils.cc; 10s local ... 2024-12-18T00:08:33.3573352Z 2024-12-18T00:08:33.3574299Z  2024-12-18T00:08:33.3574842Z  2024-12-18T00:08:33.3575214Z  2024-12-18T00:08:33.3575576Z  2024-12-18T00:08:33.3575975Z  2024-12-18T00:08:33.3576508Z  2024-12-18T00:08:33.3576867Z  2024-12-18T00:08:33.3577243Z  2024-12-18T00:08:33.3577864Z [13,882 / 15,187] 48 actions, 47 running 2024-12-18T00:08:33.3578579Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:08:33.3579608Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:08:33.3580285Z Compiling xla/service/call_graph.cc; 12s local 2024-12-18T00:08:33.3581097Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2024-12-18T00:08:33.3582117Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2024-12-18T00:08:33.3583067Z Compiling xla/service/cpu/ir_emission_utils.cc; 11s local 2024-12-18T00:08:33.3583882Z Compiling xla/service/map_inliner.cc; 10s local 2024-12-18T00:08:33.3584602Z Compiling xla/pjrt/utils.cc; 10s local ... 2024-12-18T00:08:33.7575134Z 2024-12-18T00:08:33.7576015Z  2024-12-18T00:08:33.7576658Z  2024-12-18T00:08:33.7577078Z  2024-12-18T00:08:33.7577467Z  2024-12-18T00:08:33.7577879Z  2024-12-18T00:08:33.7578289Z  2024-12-18T00:08:33.7578703Z  2024-12-18T00:08:33.7579097Z  2024-12-18T00:08:33.7579690Z [13,884 / 15,187] 48 actions running 2024-12-18T00:08:33.7581048Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:08:33.7581824Z Compiling xla/service/call_graph.cc; 12s local 2024-12-18T00:08:33.7582744Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2024-12-18T00:08:33.7583833Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2024-12-18T00:08:33.7585027Z Compiling xla/service/cpu/ir_emission_utils.cc; 12s local 2024-12-18T00:08:33.7585852Z Compiling xla/service/map_inliner.cc; 11s local 2024-12-18T00:08:33.7586549Z Compiling xla/pjrt/utils.cc; 10s local 2024-12-18T00:08:33.7587385Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local ... 2024-12-18T00:08:34.1381689Z 2024-12-18T00:08:34.1382612Z  2024-12-18T00:08:34.1383020Z  2024-12-18T00:08:34.1383378Z  2024-12-18T00:08:34.1383730Z  2024-12-18T00:08:34.1384081Z  2024-12-18T00:08:34.1384420Z  2024-12-18T00:08:34.1384752Z  2024-12-18T00:08:34.1385096Z  2024-12-18T00:08:34.1385686Z [13,886 / 15,187] 48 actions, 47 running 2024-12-18T00:08:34.1386366Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:08:34.1387024Z Compiling xla/service/call_graph.cc; 13s local 2024-12-18T00:08:34.1387743Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2024-12-18T00:08:34.1388561Z Compiling xla/service/cpu/ir_emission_utils.cc; 12s local 2024-12-18T00:08:34.1389241Z Compiling xla/service/map_inliner.cc; 11s local 2024-12-18T00:08:34.1389821Z Compiling xla/pjrt/utils.cc; 11s local 2024-12-18T00:08:34.1390482Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2024-12-18T00:08:34.1391255Z Compiling xla/service/hlo_domain_map.cc; 10s local ... 2024-12-18T00:08:34.3583187Z 2024-12-18T00:08:34.3584435Z  2024-12-18T00:08:34.3585347Z  2024-12-18T00:08:34.3586127Z  2024-12-18T00:08:34.3587049Z  2024-12-18T00:08:34.3587424Z  2024-12-18T00:08:34.3587743Z  2024-12-18T00:08:34.3588100Z  2024-12-18T00:08:34.3588403Z  2024-12-18T00:08:34.3588867Z [13,887 / 15,187] 48 actions running 2024-12-18T00:08:34.3589476Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:08:34.3590085Z Compiling xla/service/call_graph.cc; 13s local 2024-12-18T00:08:34.3590802Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2024-12-18T00:08:34.3591542Z Compiling xla/service/cpu/ir_emission_utils.cc; 12s local 2024-12-18T00:08:34.3592172Z Compiling xla/service/map_inliner.cc; 11s local 2024-12-18T00:08:34.3592719Z Compiling xla/pjrt/utils.cc; 11s local 2024-12-18T00:08:34.3593355Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2024-12-18T00:08:34.3594068Z Compiling xla/service/hlo_domain_map.cc; 10s local ... 2024-12-18T00:08:34.7587170Z 2024-12-18T00:08:34.7588262Z  2024-12-18T00:08:34.7589151Z  2024-12-18T00:08:34.7589881Z  2024-12-18T00:08:34.7590880Z  2024-12-18T00:08:34.7591401Z  2024-12-18T00:08:34.7591791Z  2024-12-18T00:08:34.7592142Z  2024-12-18T00:08:34.7592452Z  2024-12-18T00:08:34.7592901Z [13,889 / 15,187] 48 actions running 2024-12-18T00:08:34.7593560Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:08:34.7594197Z Compiling xla/service/call_graph.cc; 13s local 2024-12-18T00:08:34.7595139Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2024-12-18T00:08:34.7596117Z Compiling xla/service/cpu/ir_emission_utils.cc; 13s local 2024-12-18T00:08:34.7596850Z Compiling xla/pjrt/utils.cc; 11s local 2024-12-18T00:08:34.7597665Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2024-12-18T00:08:34.7598539Z Compiling xla/service/hlo_domain_map.cc; 11s local 2024-12-18T00:08:34.7599470Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local ... 2024-12-18T00:08:35.1893762Z 2024-12-18T00:08:35.1894642Z  2024-12-18T00:08:35.1895548Z  2024-12-18T00:08:35.1895927Z  2024-12-18T00:08:35.1896295Z  2024-12-18T00:08:35.1896802Z  2024-12-18T00:08:35.1897184Z  2024-12-18T00:08:35.1897533Z  2024-12-18T00:08:35.1897879Z  2024-12-18T00:08:35.1898498Z [13,890 / 15,187] 48 actions, 47 running 2024-12-18T00:08:35.1899396Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:08:35.1900399Z Compiling xla/service/call_graph.cc; 14s local 2024-12-18T00:08:35.1901382Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2024-12-18T00:08:35.1902361Z Compiling xla/service/cpu/ir_emission_utils.cc; 13s local 2024-12-18T00:08:35.1903152Z Compiling xla/pjrt/utils.cc; 12s local 2024-12-18T00:08:35.1903760Z Compiling xla/service/hlo_domain_map.cc; 11s local 2024-12-18T00:08:35.1904597Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2024-12-18T00:08:35.1905502Z Compiling xla/service/hlo_phi_graph.cc; 10s local ... 2024-12-18T00:08:35.4749399Z 2024-12-18T00:08:35.4750373Z  2024-12-18T00:08:35.4750780Z  2024-12-18T00:08:35.4751172Z  2024-12-18T00:08:35.4751589Z  2024-12-18T00:08:35.4752004Z  2024-12-18T00:08:35.4752433Z  2024-12-18T00:08:35.4752849Z  2024-12-18T00:08:35.4753238Z  2024-12-18T00:08:35.4753833Z [13,891 / 15,187] 48 actions, 47 running 2024-12-18T00:08:35.4754619Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:08:35.4755414Z Compiling xla/service/call_graph.cc; 14s local 2024-12-18T00:08:35.4756307Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2024-12-18T00:08:35.4757238Z Compiling xla/service/cpu/ir_emission_utils.cc; 13s local 2024-12-18T00:08:35.4757989Z Compiling xla/pjrt/utils.cc; 12s local 2024-12-18T00:08:35.4758618Z Compiling xla/service/hlo_domain_map.cc; 12s local 2024-12-18T00:08:35.4759496Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2024-12-18T00:08:35.4760423Z Compiling xla/service/hlo_phi_graph.cc; 11s local ... 2024-12-18T00:08:35.7595244Z 2024-12-18T00:08:35.7596093Z  2024-12-18T00:08:35.7596548Z  2024-12-18T00:08:35.7596932Z  2024-12-18T00:08:35.7597565Z  2024-12-18T00:08:35.7598075Z  2024-12-18T00:08:35.7598612Z  2024-12-18T00:08:35.7599115Z  2024-12-18T00:08:35.7599601Z  2024-12-18T00:08:35.7600351Z [13,892 / 15,187] 48 actions running 2024-12-18T00:08:35.7601239Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:08:35.7602112Z Compiling xla/service/call_graph.cc; 14s local 2024-12-18T00:08:35.7603116Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2024-12-18T00:08:35.7604230Z Compiling xla/service/cpu/ir_emission_utils.cc; 14s local 2024-12-18T00:08:35.7605139Z Compiling xla/pjrt/utils.cc; 12s local 2024-12-18T00:08:35.7606047Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2024-12-18T00:08:35.7607079Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2024-12-18T00:08:35.7608103Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 11s local ... 2024-12-18T00:08:36.1273242Z 2024-12-18T00:08:36.1274060Z  2024-12-18T00:08:36.1274525Z  2024-12-18T00:08:36.1274898Z  2024-12-18T00:08:36.1275246Z  2024-12-18T00:08:36.1275623Z  2024-12-18T00:08:36.1276047Z  2024-12-18T00:08:36.1276418Z  2024-12-18T00:08:36.1276800Z  2024-12-18T00:08:36.1277400Z [13,895 / 15,187] 48 actions, 47 running 2024-12-18T00:08:36.1278150Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:08:36.1278837Z Compiling xla/service/call_graph.cc; 15s local 2024-12-18T00:08:36.1279696Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2024-12-18T00:08:36.1280925Z Compiling xla/pjrt/utils.cc; 13s local 2024-12-18T00:08:36.1281729Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2024-12-18T00:08:36.1283244Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2024-12-18T00:08:36.1284309Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 11s local 2024-12-18T00:08:36.1285538Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local ... 2024-12-18T00:08:36.3603432Z 2024-12-18T00:08:36.3604297Z  2024-12-18T00:08:36.3604812Z  2024-12-18T00:08:36.3605759Z  2024-12-18T00:08:36.3606178Z  2024-12-18T00:08:36.3606552Z  2024-12-18T00:08:36.3606912Z  2024-12-18T00:08:36.3607288Z  2024-12-18T00:08:36.3607638Z  2024-12-18T00:08:36.3608121Z [13,897 / 15,187] 48 actions running 2024-12-18T00:08:36.3608851Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:08:36.3609589Z Compiling xla/service/call_graph.cc; 15s local 2024-12-18T00:08:36.3610395Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2024-12-18T00:08:36.3611274Z Compiling xla/pjrt/utils.cc; 13s local 2024-12-18T00:08:36.3612106Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2024-12-18T00:08:36.3612953Z Compiling xla/service/hlo_phi_graph.cc; 12s local 2024-12-18T00:08:36.3613744Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2024-12-18T00:08:36.3614806Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local ... 2024-12-18T00:08:36.5714352Z 2024-12-18T00:08:36.5715347Z  2024-12-18T00:08:36.5715825Z  2024-12-18T00:08:36.5716218Z  2024-12-18T00:08:36.5716591Z  2024-12-18T00:08:36.5716971Z  2024-12-18T00:08:36.5717352Z  2024-12-18T00:08:36.5717741Z  2024-12-18T00:08:36.5718129Z  2024-12-18T00:08:36.5718817Z [13,899 / 15,187] 48 actions, 47 running 2024-12-18T00:08:36.5719563Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:08:36.5720294Z Compiling xla/service/call_graph.cc; 15s local 2024-12-18T00:08:36.5721120Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2024-12-18T00:08:36.5721977Z Compiling xla/pjrt/utils.cc; 13s local 2024-12-18T00:08:36.5722728Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2024-12-18T00:08:36.5723762Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2024-12-18T00:08:36.5724845Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2024-12-18T00:08:36.5725676Z Compiling xla/service/hlo_cse.cc; 11s local ... 2024-12-18T00:08:36.9609223Z 2024-12-18T00:08:36.9610131Z  2024-12-18T00:08:36.9610634Z  2024-12-18T00:08:36.9611025Z  2024-12-18T00:08:36.9611422Z  2024-12-18T00:08:36.9611795Z  2024-12-18T00:08:36.9612159Z  2024-12-18T00:08:36.9612549Z  2024-12-18T00:08:36.9612929Z  2024-12-18T00:08:36.9613459Z [13,903 / 15,187] 48 actions running 2024-12-18T00:08:36.9614118Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:08:36.9614870Z Compiling xla/service/call_graph.cc; 16s local 2024-12-18T00:08:36.9615675Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2024-12-18T00:08:36.9616619Z Compiling xla/pjrt/utils.cc; 14s local 2024-12-18T00:08:36.9617353Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2024-12-18T00:08:36.9618361Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2024-12-18T00:08:36.9619336Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2024-12-18T00:08:36.9620269Z Compiling xla/service/hlo_cse.cc; 11s local ... 2024-12-18T00:08:37.3596666Z 2024-12-18T00:08:37.3597529Z  2024-12-18T00:08:37.3597993Z  2024-12-18T00:08:37.3598366Z  2024-12-18T00:08:37.3598758Z  2024-12-18T00:08:37.3599153Z  2024-12-18T00:08:37.3599550Z  2024-12-18T00:08:37.3599933Z  2024-12-18T00:08:37.3600325Z  2024-12-18T00:08:37.3600908Z [13,904 / 15,187] 48 actions, 47 running 2024-12-18T00:08:37.3602037Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:08:37.3602790Z Compiling xla/service/call_graph.cc; 16s local 2024-12-18T00:08:37.3603643Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2024-12-18T00:08:37.3604476Z Compiling xla/pjrt/utils.cc; 14s local 2024-12-18T00:08:37.3605529Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2024-12-18T00:08:37.3606536Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2024-12-18T00:08:37.3607554Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2024-12-18T00:08:37.3608365Z Compiling xla/service/hlo_cse.cc; 11s local ... 2024-12-18T00:08:37.5615764Z 2024-12-18T00:08:37.5616862Z  2024-12-18T00:08:37.5617354Z  2024-12-18T00:08:37.5617775Z  2024-12-18T00:08:37.5618175Z  2024-12-18T00:08:37.5618582Z  2024-12-18T00:08:37.5618971Z  2024-12-18T00:08:37.5619355Z  2024-12-18T00:08:37.5619784Z  2024-12-18T00:08:37.5620349Z [13,904 / 15,187] 48 actions running 2024-12-18T00:08:37.5621086Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:08:37.5621821Z Compiling xla/service/call_graph.cc; 16s local 2024-12-18T00:08:37.5622676Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2024-12-18T00:08:37.5623635Z Compiling xla/pjrt/utils.cc; 14s local 2024-12-18T00:08:37.5624403Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2024-12-18T00:08:37.5625481Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2024-12-18T00:08:37.5626490Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2024-12-18T00:08:37.5643543Z Compiling xla/service/hlo_cse.cc; 12s local ... 2024-12-18T00:08:37.9622968Z 2024-12-18T00:08:37.9623852Z  2024-12-18T00:08:37.9624317Z  2024-12-18T00:08:37.9624731Z  2024-12-18T00:08:37.9625109Z  2024-12-18T00:08:37.9625552Z  2024-12-18T00:08:37.9625953Z  2024-12-18T00:08:37.9626348Z  2024-12-18T00:08:37.9626748Z  2024-12-18T00:08:37.9627313Z [13,907 / 15,187] 48 actions running 2024-12-18T00:08:37.9628055Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:08:37.9628956Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2024-12-18T00:08:37.9629920Z Compiling xla/pjrt/utils.cc; 15s local 2024-12-18T00:08:37.9630693Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2024-12-18T00:08:37.9631600Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2024-12-18T00:08:37.9632427Z Compiling xla/service/hlo_cse.cc; 12s local 2024-12-18T00:08:37.9633133Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2024-12-18T00:08:37.9634011Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local ... 2024-12-18T00:08:38.3268641Z 2024-12-18T00:08:38.3269545Z  2024-12-18T00:08:38.3270072Z  2024-12-18T00:08:38.3270484Z  2024-12-18T00:08:38.3270881Z  2024-12-18T00:08:38.3271288Z  2024-12-18T00:08:38.3271708Z  2024-12-18T00:08:38.3272159Z  2024-12-18T00:08:38.3272547Z  2024-12-18T00:08:38.3273134Z [13,910 / 15,187] 48 actions, 47 running 2024-12-18T00:08:38.3273991Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2024-12-18T00:08:38.3275030Z Compiling xla/pjrt/utils.cc; 15s local 2024-12-18T00:08:38.3275897Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2024-12-18T00:08:38.3276820Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:08:38.3277586Z Compiling xla/service/hlo_cse.cc; 12s local 2024-12-18T00:08:38.3278290Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2024-12-18T00:08:38.3279233Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:08:38.3280073Z Compiling xla/service/hlo_verifier.cc; 11s local ... 2024-12-18T00:08:38.5629857Z 2024-12-18T00:08:38.5630724Z  2024-12-18T00:08:38.5631215Z  2024-12-18T00:08:38.5631609Z  2024-12-18T00:08:38.5631979Z  2024-12-18T00:08:38.5632361Z  2024-12-18T00:08:38.5632719Z  2024-12-18T00:08:38.5633108Z  2024-12-18T00:08:38.5633499Z  2024-12-18T00:08:38.5634048Z [13,910 / 15,187] 48 actions running 2024-12-18T00:08:38.5635284Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2024-12-18T00:08:38.5636142Z Compiling xla/pjrt/utils.cc; 15s local 2024-12-18T00:08:38.5636900Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2024-12-18T00:08:38.5637856Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:08:38.5638650Z Compiling xla/service/hlo_cse.cc; 13s local 2024-12-18T00:08:38.5639349Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2024-12-18T00:08:38.5640176Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:08:38.5641045Z Compiling xla/service/hlo_verifier.cc; 11s local ... 2024-12-18T00:08:38.7889909Z 2024-12-18T00:08:38.7890762Z  2024-12-18T00:08:38.7891178Z  2024-12-18T00:08:38.7891533Z  2024-12-18T00:08:38.7891877Z  2024-12-18T00:08:38.7892238Z  2024-12-18T00:08:38.7892586Z  2024-12-18T00:08:38.7892959Z  2024-12-18T00:08:38.7893302Z  2024-12-18T00:08:38.7893883Z [13,911 / 15,187] 48 actions, 47 running 2024-12-18T00:08:38.7894692Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2024-12-18T00:08:38.7895427Z Compiling xla/pjrt/utils.cc; 15s local 2024-12-18T00:08:38.7896140Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2024-12-18T00:08:38.7897227Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:08:38.7898013Z Compiling xla/service/hlo_cse.cc; 13s local 2024-12-18T00:08:38.7898707Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2024-12-18T00:08:38.7899541Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:08:38.7900299Z Compiling xla/service/hlo_verifier.cc; 11s local ... 2024-12-18T00:08:39.0264061Z 2024-12-18T00:08:39.0264931Z  2024-12-18T00:08:39.0265368Z  2024-12-18T00:08:39.0265751Z  2024-12-18T00:08:39.0266118Z  2024-12-18T00:08:39.0266462Z  2024-12-18T00:08:39.0266880Z  2024-12-18T00:08:39.0267213Z  2024-12-18T00:08:39.0267543Z  2024-12-18T00:08:39.0268116Z [13,912 / 15,187] 48 actions, 47 running 2024-12-18T00:08:39.0268898Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2024-12-18T00:08:39.0269643Z Compiling xla/pjrt/utils.cc; 16s local 2024-12-18T00:08:39.0270368Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2024-12-18T00:08:39.0271267Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:08:39.0272073Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2024-12-18T00:08:39.0272894Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:08:39.0273653Z Compiling xla/service/hlo_verifier.cc; 11s local 2024-12-18T00:08:39.0274432Z Compiling xla/service/hlo_execution_profile.cc; 11s local ... 2024-12-18T00:08:39.2795668Z 2024-12-18T00:08:39.2796541Z  2024-12-18T00:08:39.2796985Z  2024-12-18T00:08:39.2797416Z  2024-12-18T00:08:39.2797811Z  2024-12-18T00:08:39.2798208Z  2024-12-18T00:08:39.2798560Z  2024-12-18T00:08:39.2798939Z  2024-12-18T00:08:39.2799455Z  2024-12-18T00:08:39.2800049Z [13,913 / 15,187] 48 actions, 47 running 2024-12-18T00:08:39.2800938Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2024-12-18T00:08:39.2801791Z Compiling xla/pjrt/utils.cc; 16s local 2024-12-18T00:08:39.2802629Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2024-12-18T00:08:39.2803656Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:08:39.2804964Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2024-12-18T00:08:39.2805773Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:08:39.2806513Z Compiling xla/service/hlo_verifier.cc; 12s local 2024-12-18T00:08:39.2807318Z Compiling xla/service/hlo_execution_profile.cc; 12s local ... 2024-12-18T00:08:39.4875029Z 2024-12-18T00:08:39.4875923Z  2024-12-18T00:08:39.4876389Z  2024-12-18T00:08:39.4876800Z  2024-12-18T00:08:39.4877191Z  2024-12-18T00:08:39.4877577Z  2024-12-18T00:08:39.4877970Z  2024-12-18T00:08:39.4878372Z  2024-12-18T00:08:39.4878770Z  2024-12-18T00:08:39.4879353Z [13,916 / 15,187] 48 actions, 47 running 2024-12-18T00:08:39.4880240Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2024-12-18T00:08:39.4881070Z Compiling xla/pjrt/utils.cc; 16s local 2024-12-18T00:08:39.4881891Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2024-12-18T00:08:39.4882870Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:08:39.4883740Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2024-12-18T00:08:39.4884558Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:08:39.4885408Z Compiling xla/service/hlo_verifier.cc; 12s local 2024-12-18T00:08:39.4886150Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local ... 2024-12-18T00:08:39.7640416Z 2024-12-18T00:08:39.7641315Z  2024-12-18T00:08:39.7641814Z  2024-12-18T00:08:39.7642212Z  2024-12-18T00:08:39.7642575Z  2024-12-18T00:08:39.7643099Z  2024-12-18T00:08:39.7643472Z  2024-12-18T00:08:39.7643856Z  2024-12-18T00:08:39.7644480Z  2024-12-18T00:08:39.7645029Z [13,916 / 15,187] 48 actions running 2024-12-18T00:08:39.7645824Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2024-12-18T00:08:39.7646634Z Compiling xla/pjrt/utils.cc; 16s local 2024-12-18T00:08:39.7647355Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 16s local 2024-12-18T00:08:39.7648202Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:08:39.7648989Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2024-12-18T00:08:39.7649794Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:08:39.7650526Z Compiling xla/service/hlo_verifier.cc; 12s local 2024-12-18T00:08:39.7651225Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local ... 2024-12-18T00:08:40.0232345Z 2024-12-18T00:08:40.0233162Z  2024-12-18T00:08:40.0233654Z  2024-12-18T00:08:40.0234004Z  2024-12-18T00:08:40.0234413Z  2024-12-18T00:08:40.0234788Z  2024-12-18T00:08:40.0235198Z  2024-12-18T00:08:40.0235575Z  2024-12-18T00:08:40.0235921Z  2024-12-18T00:08:40.0236504Z [13,920 / 15,187] 48 actions, 47 running 2024-12-18T00:08:40.0237359Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2024-12-18T00:08:40.0238102Z Compiling xla/pjrt/utils.cc; 17s local 2024-12-18T00:08:40.0238870Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:08:40.0239687Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2024-12-18T00:08:40.0240544Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:08:40.0241352Z Compiling xla/service/hlo_verifier.cc; 12s local 2024-12-18T00:08:40.0242026Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:08:40.0242745Z Compiling xla/service/instruction_fusion.cc; 12s local ... 2024-12-18T00:08:40.2328209Z 2024-12-18T00:08:40.2329100Z  2024-12-18T00:08:40.2329574Z  2024-12-18T00:08:40.2329961Z  2024-12-18T00:08:40.2330313Z  2024-12-18T00:08:40.2330698Z  2024-12-18T00:08:40.2331050Z  2024-12-18T00:08:40.2331434Z  2024-12-18T00:08:40.2331800Z  2024-12-18T00:08:40.2335021Z [13,922 / 15,187] 48 actions, 47 running 2024-12-18T00:08:40.2335862Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2024-12-18T00:08:40.2336848Z Compiling xla/pjrt/utils.cc; 17s local 2024-12-18T00:08:40.2337574Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:08:40.2338767Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:08:40.2339508Z Compiling xla/service/hlo_verifier.cc; 13s local 2024-12-18T00:08:40.2340202Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:08:40.2340918Z Compiling xla/service/instruction_fusion.cc; 12s local 2024-12-18T00:08:40.2341766Z Compiling .../translate/hlo_to_mhlo/location_importer.cc; 11s local ... 2024-12-18T00:08:40.5648612Z 2024-12-18T00:08:40.5649550Z  2024-12-18T00:08:40.5650030Z  2024-12-18T00:08:40.5650452Z  2024-12-18T00:08:40.5650873Z  2024-12-18T00:08:40.5651296Z  2024-12-18T00:08:40.5651744Z  2024-12-18T00:08:40.5652164Z  2024-12-18T00:08:40.5652580Z  2024-12-18T00:08:40.5653126Z [13,923 / 15,187] 48 actions running 2024-12-18T00:08:40.5654017Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2024-12-18T00:08:40.5654916Z Compiling xla/pjrt/utils.cc; 17s local 2024-12-18T00:08:40.5655768Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2024-12-18T00:08:40.5656867Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:08:40.5657743Z Compiling xla/service/hlo_verifier.cc; 13s local 2024-12-18T00:08:40.5658562Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:08:40.5659348Z Compiling xla/service/instruction_fusion.cc; 12s local 2024-12-18T00:08:40.5660348Z Compiling .../translate/hlo_to_mhlo/location_importer.cc; 12s local ... 2024-12-18T00:08:40.8986139Z 2024-12-18T00:08:40.8987070Z  2024-12-18T00:08:40.8987531Z  2024-12-18T00:08:40.8987952Z  2024-12-18T00:08:40.8988351Z  2024-12-18T00:08:40.8988725Z  2024-12-18T00:08:40.8989108Z  2024-12-18T00:08:40.8989478Z  2024-12-18T00:08:40.8989873Z  2024-12-18T00:08:40.8990448Z [13,926 / 15,187] 48 actions, 47 running 2024-12-18T00:08:40.8991295Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2024-12-18T00:08:40.8992170Z Compiling xla/pjrt/utils.cc; 18s local 2024-12-18T00:08:40.8992936Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2024-12-18T00:08:40.8993876Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:08:40.8994706Z Compiling xla/service/hlo_verifier.cc; 13s local 2024-12-18T00:08:40.8995417Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:08:40.8996180Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:08:40.8997102Z Compiling .../translate/hlo_to_mhlo/location_importer.cc; 12s local ... 2024-12-18T00:08:41.1465999Z 2024-12-18T00:08:41.1466922Z  2024-12-18T00:08:41.1467397Z  2024-12-18T00:08:41.1467799Z  2024-12-18T00:08:41.1468161Z  2024-12-18T00:08:41.1468541Z  2024-12-18T00:08:41.1468927Z  2024-12-18T00:08:41.1469319Z  2024-12-18T00:08:41.1469708Z  2024-12-18T00:08:41.1470277Z [13,929 / 15,187] 48 actions, 47 running 2024-12-18T00:08:41.1471194Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2024-12-18T00:08:41.1472010Z Compiling xla/pjrt/utils.cc; 18s local 2024-12-18T00:08:41.1472766Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2024-12-18T00:08:41.1473683Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:08:41.1474539Z Compiling xla/service/hlo_verifier.cc; 13s local 2024-12-18T00:08:41.1475248Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:08:41.1476196Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 12s local 2024-12-18T00:08:41.1477646Z Compiling xla/service/host_offload_utils.cc; 12s local ... 2024-12-18T00:08:41.3654421Z 2024-12-18T00:08:41.3655279Z  2024-12-18T00:08:41.3655779Z  2024-12-18T00:08:41.3656172Z  2024-12-18T00:08:41.3656732Z  2024-12-18T00:08:41.3657145Z  2024-12-18T00:08:41.3657556Z  2024-12-18T00:08:41.3657960Z  2024-12-18T00:08:41.3658381Z  2024-12-18T00:08:41.3659401Z [13,930 / 15,187] 48 actions running 2024-12-18T00:08:41.3660444Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2024-12-18T00:08:41.3661297Z Compiling xla/pjrt/utils.cc; 18s local 2024-12-18T00:08:41.3662103Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:08:41.3663132Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:08:41.3664023Z Compiling xla/service/hlo_verifier.cc; 14s local 2024-12-18T00:08:41.3664854Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:08:41.3665870Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 12s local 2024-12-18T00:08:41.3666937Z Compiling xla/service/hlo_domain_verifier.cc; 11s local ... 2024-12-18T00:08:41.5858776Z 2024-12-18T00:08:41.5859676Z  2024-12-18T00:08:41.5860179Z  2024-12-18T00:08:41.5860619Z  2024-12-18T00:08:41.5861052Z  2024-12-18T00:08:41.5861476Z  2024-12-18T00:08:41.5861834Z  2024-12-18T00:08:41.5862179Z  2024-12-18T00:08:41.5862501Z  2024-12-18T00:08:41.5863021Z [13,933 / 15,187] 48 actions, 47 running 2024-12-18T00:08:41.5863895Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2024-12-18T00:08:41.5864769Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:08:41.5865671Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:08:41.5866566Z Compiling xla/service/hlo_verifier.cc; 14s local 2024-12-18T00:08:41.5867334Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:08:41.5868225Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2024-12-18T00:08:41.5869171Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2024-12-18T00:08:41.5870061Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local ... 2024-12-18T00:08:41.9662048Z 2024-12-18T00:08:41.9663026Z  2024-12-18T00:08:41.9663582Z  2024-12-18T00:08:41.9664030Z  2024-12-18T00:08:41.9664481Z  2024-12-18T00:08:41.9664925Z  2024-12-18T00:08:41.9665332Z  2024-12-18T00:08:41.9665761Z  2024-12-18T00:08:41.9666197Z  2024-12-18T00:08:41.9666812Z [13,933 / 15,187] 48 actions running 2024-12-18T00:08:41.9667699Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2024-12-18T00:08:41.9668677Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:08:41.9669593Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:08:41.9670595Z Compiling xla/service/hlo_verifier.cc; 14s local 2024-12-18T00:08:41.9671387Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:08:41.9672351Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2024-12-18T00:08:41.9673350Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2024-12-18T00:08:41.9674296Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local ... 2024-12-18T00:08:42.1812835Z 2024-12-18T00:08:42.1813683Z  2024-12-18T00:08:42.1814116Z  2024-12-18T00:08:42.1814479Z  2024-12-18T00:08:42.1814872Z  2024-12-18T00:08:42.1815264Z  2024-12-18T00:08:42.1815665Z  2024-12-18T00:08:42.1816017Z  2024-12-18T00:08:42.1816512Z  2024-12-18T00:08:42.1817075Z [13,934 / 15,187] 48 actions, 47 running 2024-12-18T00:08:42.1817956Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:08:42.1818907Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:08:42.1820112Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:08:42.1820830Z Compiling xla/service/hlo_verifier.cc; 14s local 2024-12-18T00:08:42.1821529Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:08:42.1822284Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2024-12-18T00:08:42.1823226Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2024-12-18T00:08:42.1824028Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 11s local ... 2024-12-18T00:08:42.4913577Z 2024-12-18T00:08:42.4914489Z  2024-12-18T00:08:42.4914955Z  2024-12-18T00:08:42.4915364Z  2024-12-18T00:08:42.4915781Z  2024-12-18T00:08:42.4916188Z  2024-12-18T00:08:42.4916566Z  2024-12-18T00:08:42.4916973Z  2024-12-18T00:08:42.4917359Z  2024-12-18T00:08:42.4917939Z [13,936 / 15,187] 48 actions, 47 running 2024-12-18T00:08:42.4918862Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:08:42.4919836Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:08:42.4920756Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:08:42.4921588Z Compiling xla/service/hlo_verifier.cc; 15s local 2024-12-18T00:08:42.4922390Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:08:42.4923229Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2024-12-18T00:08:42.4924045Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:08:42.4924900Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 11s local ... 2024-12-18T00:08:42.7664183Z 2024-12-18T00:08:42.7665035Z  2024-12-18T00:08:42.7665481Z  2024-12-18T00:08:42.7665848Z  2024-12-18T00:08:42.7666222Z  2024-12-18T00:08:42.7666571Z  2024-12-18T00:08:42.7666932Z  2024-12-18T00:08:42.7667290Z  2024-12-18T00:08:42.7667712Z  2024-12-18T00:08:42.7668284Z [13,938 / 15,187] 48 actions, 47 running 2024-12-18T00:08:42.7669123Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:08:42.7670049Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:08:42.7670922Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:08:42.7671732Z Compiling xla/service/hlo_verifier.cc; 15s local 2024-12-18T00:08:42.7672456Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:08:42.7673271Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:08:42.7674085Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:08:42.7674890Z Compiling xla/service/hlo_domain_remover.cc; 11s local ... 2024-12-18T00:08:42.9669026Z 2024-12-18T00:08:42.9669892Z  2024-12-18T00:08:42.9670366Z  2024-12-18T00:08:42.9670762Z  2024-12-18T00:08:42.9671153Z  2024-12-18T00:08:42.9671583Z  2024-12-18T00:08:42.9671941Z  2024-12-18T00:08:42.9672320Z  2024-12-18T00:08:42.9672832Z  2024-12-18T00:08:42.9673396Z [13,939 / 15,187] 48 actions running 2024-12-18T00:08:42.9674226Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:08:42.9675174Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:08:42.9676088Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:08:42.9676930Z Compiling xla/service/hlo_verifier.cc; 15s local 2024-12-18T00:08:42.9677698Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:08:42.9678547Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:08:42.9679366Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:08:42.9680171Z Compiling xla/service/hlo_domain_remover.cc; 11s local ... 2024-12-18T00:08:43.1674603Z 2024-12-18T00:08:43.1675501Z  2024-12-18T00:08:43.1676434Z  2024-12-18T00:08:43.1676831Z  2024-12-18T00:08:43.1677237Z  2024-12-18T00:08:43.1677633Z  2024-12-18T00:08:43.1678024Z  2024-12-18T00:08:43.1678412Z  2024-12-18T00:08:43.1678780Z  2024-12-18T00:08:43.1679343Z [13,940 / 15,187] 48 actions running 2024-12-18T00:08:43.1680494Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:08:43.1681506Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:08:43.1682421Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:08:43.1683198Z Compiling xla/service/hlo_verifier.cc; 15s local 2024-12-18T00:08:43.1683961Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:08:43.1684807Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:08:43.1685642Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:08:43.1686471Z Compiling xla/service/hlo_domain_remover.cc; 11s local ... 2024-12-18T00:08:43.4640869Z 2024-12-18T00:08:43.4641804Z  2024-12-18T00:08:43.4642400Z  2024-12-18T00:08:43.4642934Z  2024-12-18T00:08:43.4643461Z  2024-12-18T00:08:43.4643898Z  2024-12-18T00:08:43.4644791Z  2024-12-18T00:08:43.4645283Z  2024-12-18T00:08:43.4645782Z  2024-12-18T00:08:43.4646404Z [13,942 / 15,187] 48 actions, 47 running 2024-12-18T00:08:43.4647363Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:08:43.4648398Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2024-12-18T00:08:43.4649457Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:08:43.4650339Z Compiling xla/service/hlo_verifier.cc; 16s local 2024-12-18T00:08:43.4651195Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:08:43.4652130Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:08:43.4653083Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:08:43.4654024Z Compiling xla/service/sharding_propagation.cc; 11s local ... 2024-12-18T00:08:43.7680682Z 2024-12-18T00:08:43.7681633Z  2024-12-18T00:08:43.7682154Z  2024-12-18T00:08:43.7682570Z  2024-12-18T00:08:43.7682955Z  2024-12-18T00:08:43.7683343Z  2024-12-18T00:08:43.7683874Z  2024-12-18T00:08:43.7684322Z  2024-12-18T00:08:43.7684709Z  2024-12-18T00:08:43.7685257Z [13,944 / 15,187] 48 actions running 2024-12-18T00:08:43.7686171Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:08:43.7687064Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2024-12-18T00:08:43.7687848Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:08:43.7688635Z Compiling xla/service/hlo_verifier.cc; 16s local 2024-12-18T00:08:43.7689367Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:08:43.7690208Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:08:43.7690962Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:08:43.7691745Z Compiling xla/service/sharding_propagation.cc; 12s local ... 2024-12-18T00:08:43.9683836Z 2024-12-18T00:08:43.9684744Z  2024-12-18T00:08:43.9685232Z  2024-12-18T00:08:43.9685631Z  2024-12-18T00:08:43.9686056Z  2024-12-18T00:08:43.9686461Z  2024-12-18T00:08:43.9686824Z  2024-12-18T00:08:43.9687220Z  2024-12-18T00:08:43.9687608Z  2024-12-18T00:08:43.9688184Z [13,946 / 15,187] 48 actions running 2024-12-18T00:08:43.9689014Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:08:43.9689944Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2024-12-18T00:08:43.9690812Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:08:43.9691584Z Compiling xla/service/hlo_verifier.cc; 16s local 2024-12-18T00:08:43.9692754Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:08:43.9693699Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:08:43.9694501Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:08:43.9695319Z Compiling xla/service/sharding_propagation.cc; 12s local ... 2024-12-18T00:08:44.3376594Z 2024-12-18T00:08:44.3377627Z  2024-12-18T00:08:44.3378099Z  2024-12-18T00:08:44.3378491Z  2024-12-18T00:08:44.3378890Z  2024-12-18T00:08:44.3379274Z  2024-12-18T00:08:44.3379664Z  2024-12-18T00:08:44.3380047Z  2024-12-18T00:08:44.3380457Z  2024-12-18T00:08:44.3381051Z [13,951 / 15,187] 48 actions, 47 running 2024-12-18T00:08:44.3381923Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:08:44.3382881Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2024-12-18T00:08:44.3383819Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:08:44.3384634Z Compiling xla/service/hlo_verifier.cc; 17s local 2024-12-18T00:08:44.3385409Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:08:44.3386221Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:08:44.3387026Z Compiling xla/service/sharding_propagation.cc; 12s local 2024-12-18T00:08:44.3387818Z Compiling xla/hlo/builder/lib/prng.cc; 10s local ... 2024-12-18T00:08:44.5690464Z 2024-12-18T00:08:44.5691376Z  2024-12-18T00:08:44.5691863Z  2024-12-18T00:08:44.5692259Z  2024-12-18T00:08:44.5692660Z  2024-12-18T00:08:44.5693059Z  2024-12-18T00:08:44.5693426Z  2024-12-18T00:08:44.5693809Z  2024-12-18T00:08:44.5694205Z  2024-12-18T00:08:44.5694748Z [13,951 / 15,187] 48 actions running 2024-12-18T00:08:44.5695576Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:08:44.5696714Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2024-12-18T00:08:44.5697573Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:08:44.5698321Z Compiling xla/service/hlo_verifier.cc; 17s local 2024-12-18T00:08:44.5699055Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:08:44.5699996Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:08:44.5700818Z Compiling xla/service/sharding_propagation.cc; 12s local 2024-12-18T00:08:44.5701619Z Compiling xla/hlo/builder/lib/prng.cc; 11s local ... 2024-12-18T00:08:44.9625113Z 2024-12-18T00:08:44.9625954Z  2024-12-18T00:08:44.9626377Z  2024-12-18T00:08:44.9626762Z  2024-12-18T00:08:44.9627136Z  2024-12-18T00:08:44.9627506Z  2024-12-18T00:08:44.9627888Z  2024-12-18T00:08:44.9628238Z  2024-12-18T00:08:44.9628613Z  2024-12-18T00:08:44.9629175Z [13,952 / 15,187] 48 actions, 47 running 2024-12-18T00:08:44.9630022Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:08:44.9630902Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:08:44.9631673Z Compiling xla/service/hlo_verifier.cc; 17s local 2024-12-18T00:08:44.9632409Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:08:44.9633195Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:08:44.9633934Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:08:44.9634674Z Compiling xla/hlo/builder/lib/prng.cc; 11s local 2024-12-18T00:08:44.9635412Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local ... 2024-12-18T00:08:45.1697428Z 2024-12-18T00:08:45.1698274Z  2024-12-18T00:08:45.1698745Z  2024-12-18T00:08:45.1699159Z  2024-12-18T00:08:45.1699532Z  2024-12-18T00:08:45.1699933Z  2024-12-18T00:08:45.1700335Z  2024-12-18T00:08:45.1700717Z  2024-12-18T00:08:45.1701503Z  2024-12-18T00:08:45.1702062Z [13,954 / 15,187] 48 actions running 2024-12-18T00:08:45.1702901Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:08:45.1703785Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:08:45.1704608Z Compiling xla/service/hlo_verifier.cc; 17s local 2024-12-18T00:08:45.1705602Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:08:45.1706414Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:08:45.1707213Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:08:45.1708046Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2024-12-18T00:08:45.1708851Z Compiling xla/service/sharding_remover.cc; 10s local ... 2024-12-18T00:08:45.5702487Z 2024-12-18T00:08:45.5703383Z  2024-12-18T00:08:45.5703854Z  2024-12-18T00:08:45.5704244Z  2024-12-18T00:08:45.5704653Z  2024-12-18T00:08:45.5705105Z  2024-12-18T00:08:45.5705518Z  2024-12-18T00:08:45.5705850Z  2024-12-18T00:08:45.5706210Z  2024-12-18T00:08:45.5706758Z [13,955 / 15,187] 48 actions running 2024-12-18T00:08:45.5707585Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:08:45.5708511Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:08:45.5709318Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:08:45.5710061Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:08:45.5710794Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:08:45.5711603Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:08:45.5712377Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2024-12-18T00:08:45.5713161Z Compiling xla/service/sharding_remover.cc; 11s local ... 2024-12-18T00:08:45.8331822Z 2024-12-18T00:08:45.8332720Z  2024-12-18T00:08:45.8333193Z  2024-12-18T00:08:45.8333608Z  2024-12-18T00:08:45.8334024Z  2024-12-18T00:08:45.8334403Z  2024-12-18T00:08:45.8334778Z  2024-12-18T00:08:45.8335148Z  2024-12-18T00:08:45.8335505Z  2024-12-18T00:08:45.8336084Z [13,956 / 15,187] 48 actions, 47 running 2024-12-18T00:08:45.8337168Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:08:45.8338118Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:08:45.8338923Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:08:45.8339633Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:08:45.8340402Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:08:45.8341202Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:08:45.8342015Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2024-12-18T00:08:45.8342839Z Compiling xla/service/sharding_remover.cc; 11s local ... 2024-12-18T00:08:46.0612957Z 2024-12-18T00:08:46.0613872Z  2024-12-18T00:08:46.0614319Z  2024-12-18T00:08:46.0614706Z  2024-12-18T00:08:46.0615093Z  2024-12-18T00:08:46.0615478Z  2024-12-18T00:08:46.0615882Z  2024-12-18T00:08:46.0616284Z  2024-12-18T00:08:46.0616835Z  2024-12-18T00:08:46.0617451Z [13,958 / 15,187] 48 actions, 47 running 2024-12-18T00:08:46.0618405Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:08:46.0619495Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:08:46.0620281Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:08:46.0621058Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:08:46.0621854Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:08:46.0622648Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:08:46.0623405Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2024-12-18T00:08:46.0624717Z Compiling xla/service/sharding_remover.cc; 11s local ... 2024-12-18T00:08:46.3714853Z 2024-12-18T00:08:46.3715750Z  2024-12-18T00:08:46.3716218Z  2024-12-18T00:08:46.3716567Z  2024-12-18T00:08:46.3716956Z  2024-12-18T00:08:46.3717337Z  2024-12-18T00:08:46.3717716Z  2024-12-18T00:08:46.3718093Z  2024-12-18T00:08:46.3718899Z  2024-12-18T00:08:46.3719494Z [13,959 / 15,187] 48 actions running 2024-12-18T00:08:46.3720282Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:08:46.3721193Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:08:46.3722067Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:08:46.3722766Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:08:46.3723547Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:08:46.3724339Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:08:46.3725164Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:08:46.3725989Z ...//llvm:X86CommonTableGen__gen_subtarget_genrule; 10s local ... 2024-12-18T00:08:46.9305982Z 2024-12-18T00:08:46.9306912Z  2024-12-18T00:08:46.9307385Z  2024-12-18T00:08:46.9307780Z  2024-12-18T00:08:46.9308183Z  2024-12-18T00:08:46.9308596Z  2024-12-18T00:08:46.9308986Z  2024-12-18T00:08:46.9309371Z  2024-12-18T00:08:46.9309756Z  2024-12-18T00:08:46.9310320Z [13,960 / 15,187] 48 actions, 47 running 2024-12-18T00:08:46.9311170Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:08:46.9312060Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:08:46.9312827Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:08:46.9313552Z Compiling xla/service/instruction_fusion.cc; 19s local 2024-12-18T00:08:46.9314286Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:08:46.9315062Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:08:46.9315839Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:08:46.9316663Z ...//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local ... 2024-12-18T00:08:47.1722632Z 2024-12-18T00:08:47.1723526Z  2024-12-18T00:08:47.1724026Z  2024-12-18T00:08:47.1724424Z  2024-12-18T00:08:47.1724817Z  2024-12-18T00:08:47.1725141Z  2024-12-18T00:08:47.1725437Z  2024-12-18T00:08:47.1725785Z  2024-12-18T00:08:47.1726101Z  2024-12-18T00:08:47.1726637Z [13,961 / 15,187] 48 actions running 2024-12-18T00:08:47.1727589Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:08:47.1728446Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:08:47.1729051Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:08:47.1729691Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:08:47.1730365Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:08:47.1731149Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:08:47.1732038Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local 2024-12-18T00:08:47.1733060Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local ... 2024-12-18T00:08:47.3726609Z 2024-12-18T00:08:47.3727413Z  2024-12-18T00:08:47.3727889Z  2024-12-18T00:08:47.3728301Z  2024-12-18T00:08:47.3728699Z  2024-12-18T00:08:47.3729116Z  2024-12-18T00:08:47.3729516Z  2024-12-18T00:08:47.3729897Z  2024-12-18T00:08:47.3730299Z  2024-12-18T00:08:47.3730855Z [13,963 / 15,187] 48 actions running 2024-12-18T00:08:47.3731670Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:08:47.3732632Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:08:47.3733806Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:08:47.3734578Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:08:47.3735406Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:08:47.3736230Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:08:47.3737605Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local 2024-12-18T00:08:47.3738665Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local ... 2024-12-18T00:08:47.7406001Z 2024-12-18T00:08:47.7406910Z  2024-12-18T00:08:47.7407360Z  2024-12-18T00:08:47.7407747Z  2024-12-18T00:08:47.7408131Z  2024-12-18T00:08:47.7408528Z  2024-12-18T00:08:47.7408895Z  2024-12-18T00:08:47.7409275Z  2024-12-18T00:08:47.7409659Z  2024-12-18T00:08:47.7410213Z [13,966 / 15,187] 48 actions, 47 running 2024-12-18T00:08:47.7411095Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:08:47.7411989Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:08:47.7412758Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:08:47.7413491Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:08:47.7414290Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:08:47.7415220Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:08:47.7416046Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2024-12-18T00:08:47.7417059Z Compiling xla/service/call_inliner.cc; 11s local ... 2024-12-18T00:08:47.9732732Z 2024-12-18T00:08:47.9733617Z  2024-12-18T00:08:47.9734045Z  2024-12-18T00:08:47.9734425Z  2024-12-18T00:08:47.9734791Z  2024-12-18T00:08:47.9735128Z  2024-12-18T00:08:47.9735492Z  2024-12-18T00:08:47.9735848Z  2024-12-18T00:08:47.9736179Z  2024-12-18T00:08:47.9736917Z [13,967 / 15,187] 48 actions running 2024-12-18T00:08:47.9737675Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:08:47.9738464Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:08:47.9739178Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:08:47.9739899Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:08:47.9740829Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:08:47.9741590Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2024-12-18T00:08:47.9742372Z Compiling xla/service/call_inliner.cc; 11s local 2024-12-18T00:08:47.9743168Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 10s local ... 2024-12-18T00:08:48.1736290Z 2024-12-18T00:08:48.1737270Z  2024-12-18T00:08:48.1737700Z  2024-12-18T00:08:48.1738061Z  2024-12-18T00:08:48.1738419Z  2024-12-18T00:08:48.1738781Z  2024-12-18T00:08:48.1739163Z  2024-12-18T00:08:48.1739524Z  2024-12-18T00:08:48.1739883Z  2024-12-18T00:08:48.1740395Z [13,969 / 15,187] 48 actions running 2024-12-18T00:08:48.1741162Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:08:48.1741964Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:08:48.1742828Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:08:48.1743578Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:08:48.1744639Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 12s local 2024-12-18T00:08:48.1745377Z Compiling xla/service/call_inliner.cc; 11s local 2024-12-18T00:08:48.1746109Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 10s local 2024-12-18T00:08:48.1746816Z Compiling xla/service/while_util.cc; 10s local ... 2024-12-18T00:08:48.5347428Z 2024-12-18T00:08:48.5348314Z  2024-12-18T00:08:48.5348785Z  2024-12-18T00:08:48.5349530Z  2024-12-18T00:08:48.5349895Z  2024-12-18T00:08:48.5350283Z  2024-12-18T00:08:48.5350655Z  2024-12-18T00:08:48.5351023Z  2024-12-18T00:08:48.5351408Z  2024-12-18T00:08:48.5351976Z [13,970 / 15,187] 48 actions, 47 running 2024-12-18T00:08:48.5352875Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:08:48.5354132Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:08:48.5355008Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:08:48.5355771Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:08:48.5356575Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 12s local 2024-12-18T00:08:48.5357392Z Compiling xla/service/call_inliner.cc; 11s local 2024-12-18T00:08:48.5358275Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 10s local 2024-12-18T00:08:48.5359065Z Compiling xla/service/while_util.cc; 10s local ... 2024-12-18T00:08:48.7738839Z 2024-12-18T00:08:48.7739748Z  2024-12-18T00:08:48.7740237Z  2024-12-18T00:08:48.7740666Z  2024-12-18T00:08:48.7741083Z  2024-12-18T00:08:48.7741493Z  2024-12-18T00:08:48.7741894Z  2024-12-18T00:08:48.7742296Z  2024-12-18T00:08:48.7742699Z  2024-12-18T00:08:48.7743299Z [13,973 / 15,187] 48 actions running 2024-12-18T00:08:48.7744520Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:08:48.7745495Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:08:48.7746366Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:08:48.7747276Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:08:48.7748119Z Compiling xla/service/call_inliner.cc; 12s local 2024-12-18T00:08:48.7749508Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local 2024-12-18T00:08:48.7750552Z Compiling xla/service/while_util.cc; 10s local 2024-12-18T00:08:48.7751508Z Compiling xla/service/conditional_simplifier.cc; 9s local ... 2024-12-18T00:08:49.1195101Z 2024-12-18T00:08:49.1196115Z  2024-12-18T00:08:49.1196800Z  2024-12-18T00:08:49.1197350Z  2024-12-18T00:08:49.1197784Z  2024-12-18T00:08:49.1198322Z  2024-12-18T00:08:49.1198866Z  2024-12-18T00:08:49.1199371Z  2024-12-18T00:08:49.1199940Z  2024-12-18T00:08:49.1200680Z [13,974 / 15,187] 48 actions, 47 running 2024-12-18T00:08:49.1201723Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:08:49.1202788Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:08:49.1203750Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:08:49.1204721Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:08:49.1205693Z Compiling xla/service/call_inliner.cc; 12s local 2024-12-18T00:08:49.1206710Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local 2024-12-18T00:08:49.1207723Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:08:49.1208694Z Compiling xla/service/conditional_simplifier.cc; 10s local ... 2024-12-18T00:08:49.3745703Z 2024-12-18T00:08:49.3746661Z  2024-12-18T00:08:49.3747319Z  2024-12-18T00:08:49.3747770Z  2024-12-18T00:08:49.3748304Z  2024-12-18T00:08:49.3748815Z  2024-12-18T00:08:49.3749403Z  2024-12-18T00:08:49.3749918Z  2024-12-18T00:08:49.3750428Z  2024-12-18T00:08:49.3751148Z [13,974 / 15,187] 48 actions running 2024-12-18T00:08:49.3752150Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:08:49.3753038Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:08:49.3753900Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:08:49.3755025Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:08:49.3755968Z Compiling xla/service/call_inliner.cc; 12s local 2024-12-18T00:08:49.3757298Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local 2024-12-18T00:08:49.3758279Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:08:49.3759303Z Compiling xla/service/conditional_simplifier.cc; 10s local ... 2024-12-18T00:08:49.7751224Z 2024-12-18T00:08:49.7752114Z  2024-12-18T00:08:49.7752540Z  2024-12-18T00:08:49.7753280Z  2024-12-18T00:08:49.7753638Z  2024-12-18T00:08:49.7753962Z  2024-12-18T00:08:49.7754294Z  2024-12-18T00:08:49.7754646Z  2024-12-18T00:08:49.7754999Z  2024-12-18T00:08:49.7755492Z [13,976 / 15,187] 48 actions running 2024-12-18T00:08:49.7756241Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:08:49.7757027Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:08:49.7757751Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:08:49.7758500Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:08:49.7759214Z Compiling xla/service/call_inliner.cc; 13s local 2024-12-18T00:08:49.7759945Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:08:49.7760670Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:08:49.7761390Z Compiling xla/service/conditional_simplifier.cc; 10s local ... 2024-12-18T00:08:50.0092851Z 2024-12-18T00:08:50.0093732Z  2024-12-18T00:08:50.0094179Z  2024-12-18T00:08:50.0094577Z  2024-12-18T00:08:50.0094924Z  2024-12-18T00:08:50.0095294Z  2024-12-18T00:08:50.0095691Z  2024-12-18T00:08:50.0096074Z  2024-12-18T00:08:50.0096588Z  2024-12-18T00:08:50.0097177Z [13,979 / 15,187] 48 actions, 47 running 2024-12-18T00:08:50.0097914Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:08:50.0098760Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:08:50.0099661Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:08:50.0100364Z Compiling xla/service/call_inliner.cc; 13s local 2024-12-18T00:08:50.0101206Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:08:50.0102592Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:08:50.0103454Z Compiling xla/service/conditional_simplifier.cc; 10s local 2024-12-18T00:08:50.0104596Z Compiling .../transforms/simplifiers/tuple_simplifier.cc; 10s local ... 2024-12-18T00:08:50.3755370Z 2024-12-18T00:08:50.3756273Z  2024-12-18T00:08:50.3756785Z  2024-12-18T00:08:50.3757184Z  2024-12-18T00:08:50.3757567Z  2024-12-18T00:08:50.3757961Z  2024-12-18T00:08:50.3758338Z  2024-12-18T00:08:50.3758715Z  2024-12-18T00:08:50.3759093Z  2024-12-18T00:08:50.3760099Z [13,980 / 15,187] 48 actions running 2024-12-18T00:08:50.3761064Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:08:50.3762082Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:08:50.3763036Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:08:50.3764041Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:08:50.3764965Z Compiling xla/service/while_util.cc; 12s local 2024-12-18T00:08:50.3765892Z Compiling xla/service/conditional_simplifier.cc; 11s local 2024-12-18T00:08:50.3766955Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2024-12-18T00:08:50.3768077Z Compiling xla/service/cpu/conv_canonicalization.cc; 10s local ... 2024-12-18T00:08:50.6379982Z 2024-12-18T00:08:50.6380822Z  2024-12-18T00:08:50.6381259Z  2024-12-18T00:08:50.6381626Z  2024-12-18T00:08:50.6382009Z  2024-12-18T00:08:50.6393244Z  2024-12-18T00:08:50.6394113Z  2024-12-18T00:08:50.6394517Z  2024-12-18T00:08:50.6394910Z  2024-12-18T00:08:50.6395512Z [13,981 / 15,187] 48 actions, 47 running 2024-12-18T00:08:50.6396713Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:08:50.6397544Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:08:50.6398369Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:08:50.6399669Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:08:50.6400930Z Compiling xla/service/while_util.cc; 12s local 2024-12-18T00:08:50.6401861Z Compiling xla/service/conditional_simplifier.cc; 11s local 2024-12-18T00:08:50.6403033Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2024-12-18T00:08:50.6404258Z Compiling xla/service/cpu/conv_canonicalization.cc; 10s local ... 2024-12-18T00:08:50.9761506Z 2024-12-18T00:08:50.9762407Z  2024-12-18T00:08:50.9762910Z  2024-12-18T00:08:50.9763330Z  2024-12-18T00:08:50.9763738Z  2024-12-18T00:08:50.9764133Z  2024-12-18T00:08:50.9764494Z  2024-12-18T00:08:50.9764923Z  2024-12-18T00:08:50.9765319Z  2024-12-18T00:08:50.9765873Z [13,982 / 15,187] 48 actions running 2024-12-18T00:08:50.9766669Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:08:50.9767535Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:08:50.9768415Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:08:50.9769864Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2024-12-18T00:08:50.9770697Z Compiling xla/service/while_util.cc; 12s local 2024-12-18T00:08:50.9771777Z Compiling xla/service/conditional_simplifier.cc; 11s local 2024-12-18T00:08:50.9772979Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 11s local 2024-12-18T00:08:50.9774230Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local ... 2024-12-18T00:08:51.2218899Z 2024-12-18T00:08:51.2219853Z  2024-12-18T00:08:51.2221227Z  2024-12-18T00:08:51.2222189Z  2024-12-18T00:08:51.2222913Z  2024-12-18T00:08:51.2223320Z  2024-12-18T00:08:51.2223671Z  2024-12-18T00:08:51.2224042Z  2024-12-18T00:08:51.2224409Z  2024-12-18T00:08:51.2224964Z [13,986 / 15,187] 48 actions, 47 running 2024-12-18T00:08:51.2225655Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:08:51.2226489Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:08:51.2227318Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:08:51.2228199Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2024-12-18T00:08:51.2229031Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:08:51.2229853Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:08:51.2230803Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local 2024-12-18T00:08:51.2231810Z Compiling xla/service/layout_assignment.cc; 11s local ... 2024-12-18T00:08:51.5768271Z 2024-12-18T00:08:51.5769153Z  2024-12-18T00:08:51.5769608Z  2024-12-18T00:08:51.5770017Z  2024-12-18T00:08:51.5770424Z  2024-12-18T00:08:51.5770834Z  2024-12-18T00:08:51.5771243Z  2024-12-18T00:08:51.5771633Z  2024-12-18T00:08:51.5772032Z  2024-12-18T00:08:51.5772610Z [13,986 / 15,187] 48 actions running 2024-12-18T00:08:51.5773433Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:08:51.5774289Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:08:51.5775137Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:08:51.5776023Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2024-12-18T00:08:51.5776992Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:08:51.5777800Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:08:51.5778733Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local 2024-12-18T00:08:51.5779993Z Compiling xla/service/layout_assignment.cc; 11s local ... 2024-12-18T00:08:51.7772047Z 2024-12-18T00:08:51.7772944Z  2024-12-18T00:08:51.7773449Z  2024-12-18T00:08:51.7773832Z  2024-12-18T00:08:51.7774223Z  2024-12-18T00:08:51.7774596Z  2024-12-18T00:08:51.7774947Z  2024-12-18T00:08:51.7775288Z  2024-12-18T00:08:51.7775647Z  2024-12-18T00:08:51.7776718Z [13,987 / 15,187] 48 actions running 2024-12-18T00:08:51.7777486Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:08:51.7778233Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:08:51.7778993Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:08:51.7779804Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2024-12-18T00:08:51.7780551Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:08:51.7781278Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:08:51.7782177Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local 2024-12-18T00:08:51.7783124Z Compiling xla/service/layout_assignment.cc; 11s local ... 2024-12-18T00:08:51.9966436Z 2024-12-18T00:08:51.9967442Z  2024-12-18T00:08:51.9967950Z  2024-12-18T00:08:51.9968367Z  2024-12-18T00:08:51.9968787Z  2024-12-18T00:08:51.9969153Z  2024-12-18T00:08:51.9969582Z  2024-12-18T00:08:51.9969991Z  2024-12-18T00:08:51.9970383Z  2024-12-18T00:08:51.9971002Z [13,989 / 15,187] 48 actions, 47 running 2024-12-18T00:08:51.9971771Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:08:51.9972586Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:08:51.9973484Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:08:51.9974414Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2024-12-18T00:08:51.9975728Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:08:51.9976639Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:08:51.9977770Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2024-12-18T00:08:51.9978851Z Compiling xla/service/layout_assignment.cc; 11s local ... 2024-12-18T00:08:52.3777519Z 2024-12-18T00:08:52.3778344Z  2024-12-18T00:08:52.3779635Z  2024-12-18T00:08:52.3780042Z  2024-12-18T00:08:52.3780385Z  2024-12-18T00:08:52.3780726Z  2024-12-18T00:08:52.3781093Z  2024-12-18T00:08:52.3781464Z  2024-12-18T00:08:52.3781799Z  2024-12-18T00:08:52.3782277Z [13,989 / 15,187] 48 actions running 2024-12-18T00:08:52.3782967Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:08:52.3783702Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:08:52.3784438Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:08:52.3785214Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2024-12-18T00:08:52.3785965Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:08:52.3786637Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:08:52.3787423Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2024-12-18T00:08:52.3788220Z Compiling xla/service/layout_assignment.cc; 12s local ... 2024-12-18T00:08:53.1540915Z 2024-12-18T00:08:53.1541836Z  2024-12-18T00:08:53.1542288Z  2024-12-18T00:08:53.1542685Z  2024-12-18T00:08:53.1543081Z  2024-12-18T00:08:53.1543489Z  2024-12-18T00:08:53.1543882Z  2024-12-18T00:08:53.1544505Z  2024-12-18T00:08:53.1544921Z  2024-12-18T00:08:53.1545554Z [13,990 / 15,187] 48 actions, 47 running 2024-12-18T00:08:53.1546346Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:08:53.1547156Z Compiling xla/service/sharding_propagation.cc; 21s local 2024-12-18T00:08:53.1547988Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:08:53.1549169Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2024-12-18T00:08:53.1549969Z Compiling xla/service/while_util.cc; 15s local 2024-12-18T00:08:53.1550764Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:08:53.1551647Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2024-12-18T00:08:53.1552807Z Compiling xla/service/layout_assignment.cc; 13s local ... 2024-12-18T00:08:53.3789445Z 2024-12-18T00:08:53.3790298Z  2024-12-18T00:08:53.3790775Z  2024-12-18T00:08:53.3791297Z  2024-12-18T00:08:53.3791662Z  2024-12-18T00:08:53.3792015Z  2024-12-18T00:08:53.3792373Z  2024-12-18T00:08:53.3792746Z  2024-12-18T00:08:53.3793104Z  2024-12-18T00:08:53.3793656Z [13,991 / 15,187] 48 actions running 2024-12-18T00:08:53.3794358Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 23s local 2024-12-18T00:08:53.3795203Z Compiling xla/service/sharding_propagation.cc; 21s local 2024-12-18T00:08:53.3796024Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:08:53.3796862Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2024-12-18T00:08:53.3797670Z Compiling xla/service/while_util.cc; 15s local 2024-12-18T00:08:53.3798503Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:08:53.3799358Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2024-12-18T00:08:53.3800402Z Compiling xla/service/layout_assignment.cc; 13s local ... 2024-12-18T00:08:53.6455832Z 2024-12-18T00:08:53.6456885Z  2024-12-18T00:08:53.6457336Z  2024-12-18T00:08:53.6457716Z  2024-12-18T00:08:53.6458096Z  2024-12-18T00:08:53.6458467Z  2024-12-18T00:08:53.6458824Z  2024-12-18T00:08:53.6459202Z  2024-12-18T00:08:53.6459581Z  2024-12-18T00:08:53.6460181Z [13,992 / 15,187] 48 actions, 47 running 2024-12-18T00:08:53.6460966Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 23s local 2024-12-18T00:08:53.6461770Z Compiling xla/service/sharding_propagation.cc; 21s local 2024-12-18T00:08:53.6462558Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:08:53.6463411Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2024-12-18T00:08:53.6464353Z Compiling xla/service/while_util.cc; 15s local 2024-12-18T00:08:53.6465159Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:08:53.6466055Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2024-12-18T00:08:53.6466861Z Compiling xla/service/layout_assignment.cc; 13s local ... 2024-12-18T00:08:53.9814233Z 2024-12-18T00:08:53.9815088Z  2024-12-18T00:08:53.9815578Z  2024-12-18T00:08:53.9815961Z  2024-12-18T00:08:53.9816327Z  2024-12-18T00:08:53.9816884Z  2024-12-18T00:08:53.9817309Z  2024-12-18T00:08:53.9817672Z  2024-12-18T00:08:53.9818097Z  2024-12-18T00:08:53.9818715Z [13,996 / 15,187] 48 actions, 47 running 2024-12-18T00:08:53.9819515Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:08:53.9820502Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:08:53.9821344Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2024-12-18T00:08:53.9822248Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:08:53.9823164Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:08:53.9824014Z Compiling xla/service/layout_assignment.cc; 13s local 2024-12-18T00:08:53.9824769Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2024-12-18T00:08:53.9825587Z @llvm-project//mlir:X86VectorDialect; 12s local ... 2024-12-18T00:08:54.1796045Z 2024-12-18T00:08:54.1796900Z  2024-12-18T00:08:54.1797380Z  2024-12-18T00:08:54.1797771Z  2024-12-18T00:08:54.1798162Z  2024-12-18T00:08:54.1798843Z  2024-12-18T00:08:54.1799207Z  2024-12-18T00:08:54.1799555Z  2024-12-18T00:08:54.1799938Z  2024-12-18T00:08:54.1800496Z [13,998 / 15,187] 48 actions running 2024-12-18T00:08:54.1801270Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:08:54.1802108Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:08:54.1803281Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2024-12-18T00:08:54.1804331Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:08:54.1805229Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:08:54.1806068Z Compiling xla/service/layout_assignment.cc; 14s local 2024-12-18T00:08:54.1806841Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2024-12-18T00:08:54.1807577Z @llvm-project//mlir:X86VectorDialect; 12s local ... 2024-12-18T00:08:54.5607543Z 2024-12-18T00:08:54.5608476Z  2024-12-18T00:08:54.5608910Z  2024-12-18T00:08:54.5609329Z  2024-12-18T00:08:54.5609691Z  2024-12-18T00:08:54.5610064Z  2024-12-18T00:08:54.5610424Z  2024-12-18T00:08:54.5610781Z  2024-12-18T00:08:54.5611130Z  2024-12-18T00:08:54.5611680Z [14,002 / 15,187] 47 actions, 46 running 2024-12-18T00:08:54.5612428Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:08:54.5613225Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:08:54.5614017Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2024-12-18T00:08:54.5614863Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:08:54.5616106Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:08:54.5617012Z Compiling xla/service/layout_assignment.cc; 14s local 2024-12-18T00:08:54.5617733Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:08:54.5618587Z @llvm-project//mlir:X86VectorDialect; 13s local ... 2024-12-18T00:08:54.7799874Z 2024-12-18T00:08:54.7800784Z  2024-12-18T00:08:54.7801346Z  2024-12-18T00:08:54.7801708Z  2024-12-18T00:08:54.7802062Z  2024-12-18T00:08:54.7802420Z  2024-12-18T00:08:54.7802756Z  2024-12-18T00:08:54.7803100Z  2024-12-18T00:08:54.7803423Z  2024-12-18T00:08:54.7803930Z [14,002 / 15,187] 48 actions running 2024-12-18T00:08:54.7804685Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:08:54.7805458Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:08:54.7806275Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 17s local 2024-12-18T00:08:54.7807094Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:08:54.7808238Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:08:54.7809003Z Compiling xla/service/layout_assignment.cc; 14s local 2024-12-18T00:08:54.7809710Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:08:54.7810407Z @llvm-project//mlir:X86VectorDialect; 13s local ... 2024-12-18T00:08:55.2305865Z 2024-12-18T00:08:55.2306744Z  2024-12-18T00:08:55.2307238Z  2024-12-18T00:08:55.2307633Z  2024-12-18T00:08:55.2308035Z  2024-12-18T00:08:55.2308437Z  2024-12-18T00:08:55.2308869Z  2024-12-18T00:08:55.2309278Z  2024-12-18T00:08:55.2309712Z  2024-12-18T00:08:55.2310242Z [14,007 / 15,187] 47 actions running 2024-12-18T00:08:55.2311045Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:08:55.2311920Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:08:55.2312797Z Compiling xla/service/cpu/conv_canonicalization.cc; 15s local 2024-12-18T00:08:55.2313608Z Compiling xla/service/layout_assignment.cc; 15s local 2024-12-18T00:08:55.2314528Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:08:55.2315370Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2024-12-18T00:08:55.2316653Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2024-12-18T00:08:55.2317734Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 11s local ... 2024-12-18T00:08:55.6310136Z 2024-12-18T00:08:55.6311492Z  2024-12-18T00:08:55.6311956Z  2024-12-18T00:08:55.6312319Z  2024-12-18T00:08:55.6312656Z  2024-12-18T00:08:55.6313364Z  2024-12-18T00:08:55.6313764Z  2024-12-18T00:08:55.6314122Z  2024-12-18T00:08:55.6314476Z  2024-12-18T00:08:55.6314973Z [14,010 / 15,187] 48 actions running 2024-12-18T00:08:55.6315757Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:08:55.6316645Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:08:55.6317530Z Compiling xla/service/cpu/conv_canonicalization.cc; 15s local 2024-12-18T00:08:55.6318393Z Compiling xla/service/layout_assignment.cc; 15s local 2024-12-18T00:08:55.6319283Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:08:55.6320281Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2024-12-18T00:08:55.6321309Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 11s local 2024-12-18T00:08:55.6322391Z Compiling xla/service/memory_space_assignment/slice.cc; 11s local ... 2024-12-18T00:08:56.0314961Z 2024-12-18T00:08:56.0315936Z  2024-12-18T00:08:56.0316514Z  2024-12-18T00:08:56.0316925Z  2024-12-18T00:08:56.0317358Z  2024-12-18T00:08:56.0317834Z  2024-12-18T00:08:56.0318248Z  2024-12-18T00:08:56.0318605Z  2024-12-18T00:08:56.0318986Z  2024-12-18T00:08:56.0319637Z [14,011 / 15,187] 48 actions running 2024-12-18T00:08:56.0320503Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:08:56.0321499Z Compiling xla/service/cpu/conv_canonicalization.cc; 16s local 2024-12-18T00:08:56.0322359Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:08:56.0323361Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:08:56.0324393Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2024-12-18T00:08:56.0325440Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2024-12-18T00:08:56.0326519Z Compiling xla/service/memory_space_assignment/slice.cc; 11s local 2024-12-18T00:08:56.0327571Z Compiling xla/service/conditional_to_select.cc; 11s local ... 2024-12-18T00:08:56.4132963Z 2024-12-18T00:08:56.4134255Z  2024-12-18T00:08:56.4134756Z  2024-12-18T00:08:56.4135153Z  2024-12-18T00:08:56.4135500Z  2024-12-18T00:08:56.4135919Z  2024-12-18T00:08:56.4136869Z  2024-12-18T00:08:56.4137247Z  2024-12-18T00:08:56.4137624Z  2024-12-18T00:08:56.4138212Z [14,013 / 15,187] 48 actions, 47 running 2024-12-18T00:08:56.4138956Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2024-12-18T00:08:56.4139847Z Compiling xla/service/cpu/conv_canonicalization.cc; 16s local 2024-12-18T00:08:56.4140702Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:08:56.4141600Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:08:56.4142552Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2024-12-18T00:08:56.4143643Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2024-12-18T00:08:56.4144932Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2024-12-18T00:08:56.4145866Z Compiling xla/service/conditional_to_select.cc; 11s local ... 2024-12-18T00:08:56.6321106Z 2024-12-18T00:08:56.6321959Z  2024-12-18T00:08:56.6322541Z  2024-12-18T00:08:56.6323044Z  2024-12-18T00:08:56.6323488Z  2024-12-18T00:08:56.6323896Z  2024-12-18T00:08:56.6324282Z  2024-12-18T00:08:56.6324684Z  2024-12-18T00:08:56.6325057Z  2024-12-18T00:08:56.6325949Z [14,014 / 15,187] 48 actions running 2024-12-18T00:08:56.6326713Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2024-12-18T00:08:56.6327451Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:08:56.6328327Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2024-12-18T00:08:56.6329293Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2024-12-18T00:08:56.6330626Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2024-12-18T00:08:56.6331638Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2024-12-18T00:08:56.6332713Z Compiling xla/service/conditional_to_select.cc; 11s local 2024-12-18T00:08:56.6333591Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 11s local ... 2024-12-18T00:08:56.8690285Z 2024-12-18T00:08:56.8691189Z  2024-12-18T00:08:56.8691694Z  2024-12-18T00:08:56.8692064Z  2024-12-18T00:08:56.8692466Z  2024-12-18T00:08:56.8692824Z  2024-12-18T00:08:56.8693324Z  2024-12-18T00:08:56.8693761Z  2024-12-18T00:08:56.8694125Z  2024-12-18T00:08:56.8694836Z [14,017 / 15,187] 47 actions, 46 running 2024-12-18T00:08:56.8695543Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:08:56.8696585Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2024-12-18T00:08:56.8697482Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2024-12-18T00:08:56.8698426Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2024-12-18T00:08:56.8699456Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2024-12-18T00:08:56.8700378Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 11s local 2024-12-18T00:08:56.8701206Z Compiling xla/service/topk_rewriter.cc; 10s local 2024-12-18T00:08:56.8702101Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 9s local ... 2024-12-18T00:08:57.2327068Z 2024-12-18T00:08:57.2327962Z  2024-12-18T00:08:57.2328462Z  2024-12-18T00:08:57.2328858Z  2024-12-18T00:08:57.2329229Z  2024-12-18T00:08:57.2329600Z  2024-12-18T00:08:57.2329973Z  2024-12-18T00:08:57.2330345Z  2024-12-18T00:08:57.2330720Z  2024-12-18T00:08:57.2331322Z [14,018 / 15,187] 48 actions running 2024-12-18T00:08:57.2332048Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:08:57.2332947Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2024-12-18T00:08:57.2334052Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2024-12-18T00:08:57.2335133Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:08:57.2336201Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2024-12-18T00:08:57.2337763Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local 2024-12-18T00:08:57.2338611Z Compiling xla/service/topk_rewriter.cc; 11s local 2024-12-18T00:08:57.2339430Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 10s local ... 2024-12-18T00:08:57.6125960Z 2024-12-18T00:08:57.6126850Z  2024-12-18T00:08:57.6127429Z  2024-12-18T00:08:57.6127809Z  2024-12-18T00:08:57.6128173Z  2024-12-18T00:08:57.6128524Z  2024-12-18T00:08:57.6129033Z  2024-12-18T00:08:57.6129418Z  2024-12-18T00:08:57.6129820Z  2024-12-18T00:08:57.6130493Z [14,019 / 15,187] 48 actions, 47 running 2024-12-18T00:08:57.6131209Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:08:57.6132020Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:08:57.6133018Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2024-12-18T00:08:57.6134052Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:08:57.6135028Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local 2024-12-18T00:08:57.6135753Z Compiling xla/service/topk_rewriter.cc; 11s local 2024-12-18T00:08:57.6136908Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 10s local 2024-12-18T00:08:57.6137772Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local ... 2024-12-18T00:08:57.8333359Z 2024-12-18T00:08:57.8334252Z  2024-12-18T00:08:57.8334693Z  2024-12-18T00:08:57.8335080Z  2024-12-18T00:08:57.8335470Z  2024-12-18T00:08:57.8335884Z  2024-12-18T00:08:57.8336774Z  2024-12-18T00:08:57.8337196Z  2024-12-18T00:08:57.8337578Z  2024-12-18T00:08:57.8338148Z [14,019 / 15,187] 48 actions running 2024-12-18T00:08:57.8338927Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:08:57.8339868Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:08:57.8340916Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2024-12-18T00:08:57.8341997Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:08:57.8342984Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local 2024-12-18T00:08:57.8343811Z Compiling xla/service/topk_rewriter.cc; 11s local 2024-12-18T00:08:57.8344851Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 10s local 2024-12-18T00:08:57.8345811Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local ... 2024-12-18T00:08:58.0648582Z 2024-12-18T00:08:58.0649489Z  2024-12-18T00:08:58.0650009Z  2024-12-18T00:08:58.0650423Z  2024-12-18T00:08:58.0650823Z  2024-12-18T00:08:58.0651198Z  2024-12-18T00:08:58.0651587Z  2024-12-18T00:08:58.0651985Z  2024-12-18T00:08:58.0652378Z  2024-12-18T00:08:58.0652997Z [14,023 / 15,187] 48 actions, 47 running 2024-12-18T00:08:58.0653695Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:08:58.0654539Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:08:58.0655489Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2024-12-18T00:08:58.0656640Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:08:58.0657490Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local 2024-12-18T00:08:58.0658163Z Compiling xla/service/topk_rewriter.cc; 11s local 2024-12-18T00:08:58.0659004Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 11s local 2024-12-18T00:08:58.0659947Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local ... 2024-12-18T00:08:58.2835419Z 2024-12-18T00:08:58.2836414Z  2024-12-18T00:08:58.2836906Z  2024-12-18T00:08:58.2837305Z  2024-12-18T00:08:58.2837697Z  2024-12-18T00:08:58.2837988Z  2024-12-18T00:08:58.2838291Z  2024-12-18T00:08:58.2838915Z  2024-12-18T00:08:58.2839300Z  2024-12-18T00:08:58.2839893Z [14,024 / 15,187] 48 actions, 47 running 2024-12-18T00:08:58.2840689Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:08:58.2841659Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:08:58.2842738Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2024-12-18T00:08:58.2843756Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:08:58.2845113Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local 2024-12-18T00:08:58.2846000Z Compiling xla/service/topk_rewriter.cc; 12s local 2024-12-18T00:08:58.2846877Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 11s local 2024-12-18T00:08:58.2847892Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local ... 2024-12-18T00:08:58.5700408Z 2024-12-18T00:08:58.5701290Z  2024-12-18T00:08:58.5701798Z  2024-12-18T00:08:58.5702236Z  2024-12-18T00:08:58.5702773Z  2024-12-18T00:08:58.5703162Z  2024-12-18T00:08:58.5703571Z  2024-12-18T00:08:58.5703960Z  2024-12-18T00:08:58.5704343Z  2024-12-18T00:08:58.5704916Z [14,025 / 15,187] 48 actions, 47 running 2024-12-18T00:08:58.5706026Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:08:58.5706895Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:08:58.5707882Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2024-12-18T00:08:58.5708911Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:08:58.5710106Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local 2024-12-18T00:08:58.5710914Z Compiling xla/service/topk_rewriter.cc; 12s local 2024-12-18T00:08:58.5711745Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 11s local 2024-12-18T00:08:58.5712695Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local ... 2024-12-18T00:08:58.8340919Z 2024-12-18T00:08:58.8341823Z  2024-12-18T00:08:58.8342311Z  2024-12-18T00:08:58.8342718Z  2024-12-18T00:08:58.8343128Z  2024-12-18T00:08:58.8343531Z  2024-12-18T00:08:58.8343935Z  2024-12-18T00:08:58.8344644Z  2024-12-18T00:08:58.8345044Z  2024-12-18T00:08:58.8345566Z [14,027 / 15,187] 48 actions running 2024-12-18T00:08:58.8346249Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:08:58.8347081Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:08:58.8348143Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2024-12-18T00:08:58.8349237Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:08:58.8350176Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local 2024-12-18T00:08:58.8351017Z Compiling xla/service/topk_rewriter.cc; 12s local 2024-12-18T00:08:58.8351879Z Compiling mlir/lib/Dialect/AMX/IR/AMXDialect.cpp; 11s local 2024-12-18T00:08:58.8352836Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local ... 2024-12-18T00:08:59.2346572Z 2024-12-18T00:08:59.2347472Z  2024-12-18T00:08:59.2347948Z  2024-12-18T00:08:59.2348342Z  2024-12-18T00:08:59.2348771Z  2024-12-18T00:08:59.2349148Z  2024-12-18T00:08:59.2349582Z  2024-12-18T00:08:59.2350013Z  2024-12-18T00:08:59.2350411Z  2024-12-18T00:08:59.2350976Z [14,029 / 15,187] 48 actions running 2024-12-18T00:08:59.2351717Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:08:59.2352656Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:08:59.2353679Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2024-12-18T00:08:59.2354725Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:08:59.2355696Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:08:59.2356906Z Compiling xla/service/topk_rewriter.cc; 13s local 2024-12-18T00:08:59.2357822Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2024-12-18T00:08:59.2358914Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local ... 2024-12-18T00:08:59.4350338Z 2024-12-18T00:08:59.4351240Z  2024-12-18T00:08:59.4351660Z  2024-12-18T00:08:59.4352009Z  2024-12-18T00:08:59.4352352Z  2024-12-18T00:08:59.4352720Z  2024-12-18T00:08:59.4353067Z  2024-12-18T00:08:59.4353406Z  2024-12-18T00:08:59.4353745Z  2024-12-18T00:08:59.4354232Z [14,030 / 15,187] 47 actions running 2024-12-18T00:08:59.4354960Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:08:59.4355749Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:08:59.4356647Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2024-12-18T00:08:59.4357607Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:08:59.4358455Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:08:59.4359185Z Compiling xla/service/topk_rewriter.cc; 13s local 2024-12-18T00:08:59.4360023Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:08:59.4361240Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local ... 2024-12-18T00:08:59.7571604Z 2024-12-18T00:08:59.7572491Z  2024-12-18T00:08:59.7572963Z  2024-12-18T00:08:59.7573395Z  2024-12-18T00:08:59.7573786Z  2024-12-18T00:08:59.7574151Z  2024-12-18T00:08:59.7574527Z  2024-12-18T00:08:59.7575271Z  2024-12-18T00:08:59.7575665Z  2024-12-18T00:08:59.7576530Z [14,032 / 15,187] 48 actions, 47 running 2024-12-18T00:08:59.7577301Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:08:59.7578194Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:08:59.7579182Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2024-12-18T00:08:59.7580226Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:08:59.7581168Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:08:59.7582045Z Compiling xla/service/topk_rewriter.cc; 13s local 2024-12-18T00:08:59.7582981Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:08:59.7584066Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local ... 2024-12-18T00:09:00.0357261Z 2024-12-18T00:09:00.0358110Z  2024-12-18T00:09:00.0358581Z  2024-12-18T00:09:00.0359003Z  2024-12-18T00:09:00.0359353Z  2024-12-18T00:09:00.0359726Z  2024-12-18T00:09:00.0360065Z  2024-12-18T00:09:00.0360362Z  2024-12-18T00:09:00.0360640Z  2024-12-18T00:09:00.0361073Z [14,032 / 15,187] 48 actions running 2024-12-18T00:09:00.0361820Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:09:00.0362868Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:09:00.0363946Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2024-12-18T00:09:00.0365055Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:09:00.0366022Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:09:00.0366888Z Compiling xla/service/topk_rewriter.cc; 13s local 2024-12-18T00:09:00.0367877Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:09:00.0369063Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local ... 2024-12-18T00:09:00.2360685Z 2024-12-18T00:09:00.2361741Z  2024-12-18T00:09:00.2362233Z  2024-12-18T00:09:00.2362651Z  2024-12-18T00:09:00.2363042Z  2024-12-18T00:09:00.2363445Z  2024-12-18T00:09:00.2363817Z  2024-12-18T00:09:00.2364211Z  2024-12-18T00:09:00.2364930Z  2024-12-18T00:09:00.2365460Z [14,033 / 15,187] 48 actions running 2024-12-18T00:09:00.2366224Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:09:00.2367053Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:09:00.2368010Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2024-12-18T00:09:00.2369025Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:09:00.2369986Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:09:00.2370821Z Compiling xla/service/topk_rewriter.cc; 14s local 2024-12-18T00:09:00.2371782Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:09:00.2372881Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local ... 2024-12-18T00:09:00.4650623Z 2024-12-18T00:09:00.4651521Z  2024-12-18T00:09:00.4652008Z  2024-12-18T00:09:00.4652408Z  2024-12-18T00:09:00.4652832Z  2024-12-18T00:09:00.4653226Z  2024-12-18T00:09:00.4653618Z  2024-12-18T00:09:00.4654018Z  2024-12-18T00:09:00.4654410Z  2024-12-18T00:09:00.4655028Z [14,036 / 15,187] 48 actions, 47 running 2024-12-18T00:09:00.4656090Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:09:00.4657203Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:09:00.4658354Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:09:00.4659363Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:09:00.4660560Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:09:00.4661408Z Compiling xla/service/topk_rewriter.cc; 14s local 2024-12-18T00:09:00.4662342Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:09:00.4663419Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local ... 2024-12-18T00:09:00.6662072Z 2024-12-18T00:09:00.6663394Z  2024-12-18T00:09:00.6663906Z  2024-12-18T00:09:00.6664300Z  2024-12-18T00:09:00.6664669Z  2024-12-18T00:09:00.6665060Z  2024-12-18T00:09:00.6665449Z  2024-12-18T00:09:00.6665883Z  2024-12-18T00:09:00.6666256Z  2024-12-18T00:09:00.6666835Z [14,037 / 15,187] 48 actions, 47 running 2024-12-18T00:09:00.6667631Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:09:00.6668501Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:09:00.6669460Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:09:00.6670617Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:09:00.6671572Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:09:00.6672405Z Compiling xla/service/topk_rewriter.cc; 14s local 2024-12-18T00:09:00.6673362Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:09:00.6674453Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local ... 2024-12-18T00:09:00.9428465Z 2024-12-18T00:09:00.9429445Z  2024-12-18T00:09:00.9429928Z  2024-12-18T00:09:00.9430358Z  2024-12-18T00:09:00.9430736Z  2024-12-18T00:09:00.9431147Z  2024-12-18T00:09:00.9431544Z  2024-12-18T00:09:00.9431917Z  2024-12-18T00:09:00.9432297Z  2024-12-18T00:09:00.9432924Z [14,040 / 15,187] 48 actions, 47 running 2024-12-18T00:09:00.9433696Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:09:00.9434690Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:09:00.9435726Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:09:00.9436773Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:09:00.9437918Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:09:00.9439004Z Compiling xla/service/topk_rewriter.cc; 14s local 2024-12-18T00:09:00.9439906Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:09:00.9440996Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2024-12-18T00:09:01.2369244Z 2024-12-18T00:09:01.2370210Z  2024-12-18T00:09:01.2370753Z  2024-12-18T00:09:01.2371160Z  2024-12-18T00:09:01.2371551Z  2024-12-18T00:09:01.2372010Z  2024-12-18T00:09:01.2372371Z  2024-12-18T00:09:01.2372694Z  2024-12-18T00:09:01.2373022Z  2024-12-18T00:09:01.2373604Z [14,040 / 15,187] 48 actions running 2024-12-18T00:09:01.2374349Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:09:01.2375345Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:09:01.2376499Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:09:01.2377615Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:09:01.2378550Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:09:01.2379354Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:09:01.2380727Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:09:01.2381863Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2024-12-18T00:09:01.7347363Z 2024-12-18T00:09:01.7348316Z  2024-12-18T00:09:01.7348752Z  2024-12-18T00:09:01.7349147Z  2024-12-18T00:09:01.7349513Z  2024-12-18T00:09:01.7349887Z  2024-12-18T00:09:01.7350653Z  2024-12-18T00:09:01.7351003Z  2024-12-18T00:09:01.7351351Z  2024-12-18T00:09:01.7351926Z [14,041 / 15,187] 48 actions, 47 running 2024-12-18T00:09:01.7352602Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:09:01.7353442Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:09:01.7354373Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:09:01.7355323Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:09:01.7356178Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:09:01.7356928Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:09:01.7357764Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2024-12-18T00:09:01.7358849Z Compiling .../memory_space_assignment/tuning_utils.cc; 13s local ... 2024-12-18T00:09:02.0021508Z 2024-12-18T00:09:02.0024299Z  2024-12-18T00:09:02.0024813Z  2024-12-18T00:09:02.0025215Z  2024-12-18T00:09:02.0025600Z  2024-12-18T00:09:02.0025974Z  2024-12-18T00:09:02.0026367Z  2024-12-18T00:09:02.0026742Z  2024-12-18T00:09:02.0027124Z  2024-12-18T00:09:02.0027696Z [14,043 / 15,187] 48 actions, 47 running 2024-12-18T00:09:02.0028482Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:09:02.0029359Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:09:02.0030345Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:09:02.0031365Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:09:02.0032322Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:09:02.0033108Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:09:02.0034017Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2024-12-18T00:09:02.0035071Z Compiling .../memory_space_assignment/tuning_utils.cc; 13s local ... 2024-12-18T00:09:02.2380731Z 2024-12-18T00:09:02.2381626Z  2024-12-18T00:09:02.2382049Z  2024-12-18T00:09:02.2382373Z  2024-12-18T00:09:02.2382697Z  2024-12-18T00:09:02.2383032Z  2024-12-18T00:09:02.2383729Z  2024-12-18T00:09:02.2384229Z  2024-12-18T00:09:02.2384672Z  2024-12-18T00:09:02.2385189Z [14,046 / 15,187] 48 actions running 2024-12-18T00:09:02.2385862Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:09:02.2386684Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:09:02.2387562Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:09:02.2388502Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:09:02.2389381Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:09:02.2390146Z Compiling xla/service/topk_rewriter.cc; 16s local 2024-12-18T00:09:02.2391003Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2024-12-18T00:09:02.2391992Z Compiling .../memory_space_assignment/tuning_utils.cc; 13s local ... 2024-12-18T00:09:02.8574847Z 2024-12-18T00:09:02.8575700Z  2024-12-18T00:09:02.8576198Z  2024-12-18T00:09:02.8576752Z  2024-12-18T00:09:02.8577159Z  2024-12-18T00:09:02.8577550Z  2024-12-18T00:09:02.8577916Z  2024-12-18T00:09:02.8578285Z  2024-12-18T00:09:02.8578675Z  2024-12-18T00:09:02.8579282Z [14,047 / 15,187] 48 actions, 47 running 2024-12-18T00:09:02.8580427Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:09:02.8581317Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2024-12-18T00:09:02.8582359Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:09:02.8583365Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:09:02.8584619Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:09:02.8585443Z Compiling xla/service/topk_rewriter.cc; 16s local 2024-12-18T00:09:02.8586384Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 15s local 2024-12-18T00:09:02.8587539Z Compiling llvm/lib/ExecutionEngine/Orc/ELFNixPlatform.cpp; 12s local ... 2024-12-18T00:09:03.1022033Z 2024-12-18T00:09:03.1022924Z  2024-12-18T00:09:03.1023403Z  2024-12-18T00:09:03.1023803Z  2024-12-18T00:09:03.1024195Z  2024-12-18T00:09:03.1024565Z  2024-12-18T00:09:03.1024967Z  2024-12-18T00:09:03.1025348Z  2024-12-18T00:09:03.1025738Z  2024-12-18T00:09:03.1026299Z [14,051 / 15,187] 48 actions, 47 running 2024-12-18T00:09:03.1027015Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:09:03.1027909Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2024-12-18T00:09:03.1028968Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:09:03.1030159Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:09:03.1031089Z Compiling xla/service/topk_rewriter.cc; 16s local 2024-12-18T00:09:03.1032034Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2024-12-18T00:09:03.1033054Z Compiling xla/hlo/builder/lib/math.cc; 9s local 2024-12-18T00:09:03.1033824Z Compiling xla/service/scatter_expander.cc; 9s local ... 2024-12-18T00:09:03.3039210Z 2024-12-18T00:09:03.3040091Z  2024-12-18T00:09:03.3040539Z  2024-12-18T00:09:03.3040903Z  2024-12-18T00:09:03.3041291Z  2024-12-18T00:09:03.3041650Z  2024-12-18T00:09:03.3042007Z  2024-12-18T00:09:03.3042349Z  2024-12-18T00:09:03.3042710Z  2024-12-18T00:09:03.3043259Z [14,052 / 15,187] 48 actions, 47 running 2024-12-18T00:09:03.3058935Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:09:03.3060135Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2024-12-18T00:09:03.3061058Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:09:03.3062168Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:09:03.3063196Z Compiling xla/service/topk_rewriter.cc; 17s local 2024-12-18T00:09:03.3064695Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2024-12-18T00:09:03.3065860Z Compiling xla/hlo/builder/lib/math.cc; 9s local 2024-12-18T00:09:03.3066807Z Compiling xla/service/scatter_expander.cc; 9s local ... 2024-12-18T00:09:03.6394147Z 2024-12-18T00:09:03.6395031Z  2024-12-18T00:09:03.6395582Z  2024-12-18T00:09:03.6396039Z  2024-12-18T00:09:03.6396480Z  2024-12-18T00:09:03.6396917Z  2024-12-18T00:09:03.6397293Z  2024-12-18T00:09:03.6397726Z  2024-12-18T00:09:03.6398154Z  2024-12-18T00:09:03.6398827Z [14,053 / 15,187] 48 actions running 2024-12-18T00:09:03.6399626Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:09:03.6400608Z Compiling xla/service/dynamic_dimension_inference.cc; 22s local 2024-12-18T00:09:03.6401721Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:09:03.6402743Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:09:03.6403635Z Compiling xla/service/topk_rewriter.cc; 17s local 2024-12-18T00:09:03.6404604Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2024-12-18T00:09:03.6405843Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2024-12-18T00:09:03.6406640Z Compiling xla/service/scatter_expander.cc; 9s local ... 2024-12-18T00:09:04.1226983Z 2024-12-18T00:09:04.1227888Z  2024-12-18T00:09:04.1228357Z  2024-12-18T00:09:04.1228769Z  2024-12-18T00:09:04.1229183Z  2024-12-18T00:09:04.1229578Z  2024-12-18T00:09:04.1230340Z  2024-12-18T00:09:04.1230745Z  2024-12-18T00:09:04.1231144Z  2024-12-18T00:09:04.1231709Z [14,054 / 15,187] 48 actions, 47 running 2024-12-18T00:09:04.1232469Z Compiling xla/service/layout_assignment.cc; 24s local 2024-12-18T00:09:04.1233497Z Compiling xla/service/dynamic_dimension_inference.cc; 22s local 2024-12-18T00:09:04.1234568Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:09:04.1235661Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:09:04.1236533Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:09:04.1237532Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2024-12-18T00:09:04.1238584Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2024-12-18T00:09:04.1239396Z Compiling xla/service/scatter_expander.cc; 10s local ... 2024-12-18T00:09:04.3941399Z 2024-12-18T00:09:04.3942294Z  2024-12-18T00:09:04.3942773Z  2024-12-18T00:09:04.3943206Z  2024-12-18T00:09:04.3943611Z  2024-12-18T00:09:04.3943998Z  2024-12-18T00:09:04.3944650Z  2024-12-18T00:09:04.3945030Z  2024-12-18T00:09:04.3945437Z  2024-12-18T00:09:04.3946033Z [14,055 / 15,187] 48 actions, 47 running 2024-12-18T00:09:04.3946928Z Compiling xla/service/dynamic_dimension_inference.cc; 22s local 2024-12-18T00:09:04.3947945Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:09:04.3949019Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:09:04.3949977Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:09:04.3950969Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2024-12-18T00:09:04.3951988Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2024-12-18T00:09:04.3952780Z Compiling xla/service/scatter_expander.cc; 10s local 2024-12-18T00:09:04.3953708Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 10s local ... 2024-12-18T00:09:04.6402357Z 2024-12-18T00:09:04.6403234Z  2024-12-18T00:09:04.6403692Z  2024-12-18T00:09:04.6404085Z  2024-12-18T00:09:04.6404498Z  2024-12-18T00:09:04.6404873Z  2024-12-18T00:09:04.6405255Z  2024-12-18T00:09:04.6405620Z  2024-12-18T00:09:04.6406344Z  2024-12-18T00:09:04.6406885Z [14,057 / 15,187] 48 actions running 2024-12-18T00:09:04.6407750Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2024-12-18T00:09:04.6408792Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:09:04.6409708Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:09:04.6410690Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2024-12-18T00:09:04.6411666Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2024-12-18T00:09:04.6412412Z Compiling xla/service/scatter_expander.cc; 10s local 2024-12-18T00:09:04.6413387Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2024-12-18T00:09:04.6414433Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 10s local ... 2024-12-18T00:09:04.8406881Z 2024-12-18T00:09:04.8407707Z  2024-12-18T00:09:04.8408133Z  2024-12-18T00:09:04.8408554Z  2024-12-18T00:09:04.8408980Z  2024-12-18T00:09:04.8409378Z  2024-12-18T00:09:04.8409763Z  2024-12-18T00:09:04.8410158Z  2024-12-18T00:09:04.8410535Z  2024-12-18T00:09:04.8411236Z [14,058 / 15,187] 48 actions running 2024-12-18T00:09:04.8412407Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2024-12-18T00:09:04.8413442Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:09:04.8414321Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:09:04.8415261Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2024-12-18T00:09:04.8416662Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2024-12-18T00:09:04.8417556Z Compiling xla/service/scatter_expander.cc; 11s local 2024-12-18T00:09:04.8418451Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2024-12-18T00:09:04.8419436Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 10s local ... 2024-12-18T00:09:05.2462000Z 2024-12-18T00:09:05.2462870Z  2024-12-18T00:09:05.2463305Z  2024-12-18T00:09:05.2463704Z  2024-12-18T00:09:05.2464084Z  2024-12-18T00:09:05.2464460Z  2024-12-18T00:09:05.2464852Z  2024-12-18T00:09:05.2465282Z  2024-12-18T00:09:05.2465683Z  2024-12-18T00:09:05.2466267Z [14,059 / 15,187] 48 actions, 47 running 2024-12-18T00:09:05.2467121Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2024-12-18T00:09:05.2468129Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:09:05.2469019Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:09:05.2469798Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2024-12-18T00:09:05.2470541Z Compiling xla/service/scatter_expander.cc; 11s local 2024-12-18T00:09:05.2471439Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2024-12-18T00:09:05.2472395Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 11s local 2024-12-18T00:09:05.2473399Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 10s local ... 2024-12-18T00:09:05.6413919Z 2024-12-18T00:09:05.6414792Z  2024-12-18T00:09:05.6415196Z  2024-12-18T00:09:05.6415537Z  2024-12-18T00:09:05.6415932Z  2024-12-18T00:09:05.6416330Z  2024-12-18T00:09:05.6416889Z  2024-12-18T00:09:05.6417293Z  2024-12-18T00:09:05.6417691Z  2024-12-18T00:09:05.6418238Z [14,059 / 15,187] 48 actions running 2024-12-18T00:09:05.6419085Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:09:05.6420117Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:09:05.6420970Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:09:05.6421696Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:09:05.6422324Z Compiling xla/service/scatter_expander.cc; 11s local 2024-12-18T00:09:05.6423256Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2024-12-18T00:09:05.6424747Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 11s local 2024-12-18T00:09:05.6425771Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 10s local ... 2024-12-18T00:09:05.9534872Z 2024-12-18T00:09:05.9535661Z  2024-12-18T00:09:05.9536093Z  2024-12-18T00:09:05.9536619Z  2024-12-18T00:09:05.9536966Z  2024-12-18T00:09:05.9537330Z  2024-12-18T00:09:05.9537680Z  2024-12-18T00:09:05.9538028Z  2024-12-18T00:09:05.9538368Z  2024-12-18T00:09:05.9538900Z [14,060 / 15,187] 48 actions, 47 running 2024-12-18T00:09:05.9539704Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:09:05.9540673Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:09:05.9541461Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:09:05.9542134Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:09:05.9542816Z Compiling xla/service/scatter_expander.cc; 12s local 2024-12-18T00:09:05.9543644Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2024-12-18T00:09:05.9544852Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 11s local 2024-12-18T00:09:05.9546000Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 11s local ... 2024-12-18T00:09:06.2420350Z 2024-12-18T00:09:06.2421372Z  2024-12-18T00:09:06.2421862Z  2024-12-18T00:09:06.2422268Z  2024-12-18T00:09:06.2422616Z  2024-12-18T00:09:06.2422985Z  2024-12-18T00:09:06.2423346Z  2024-12-18T00:09:06.2423749Z  2024-12-18T00:09:06.2424531Z  2024-12-18T00:09:06.2425113Z [14,060 / 15,187] 48 actions running 2024-12-18T00:09:06.2425972Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:09:06.2427108Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:09:06.2427960Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:09:06.2428675Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:09:06.2429389Z Compiling xla/service/scatter_expander.cc; 12s local 2024-12-18T00:09:06.2430156Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2024-12-18T00:09:06.2431076Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 12s local 2024-12-18T00:09:06.2432037Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 11s local ... 2024-12-18T00:09:06.4424684Z 2024-12-18T00:09:06.4425562Z  2024-12-18T00:09:06.4426038Z  2024-12-18T00:09:06.4426431Z  2024-12-18T00:09:06.4426846Z  2024-12-18T00:09:06.4427245Z  2024-12-18T00:09:06.4427653Z  2024-12-18T00:09:06.4427997Z  2024-12-18T00:09:06.4428299Z  2024-12-18T00:09:06.4428767Z [14,063 / 15,187] 48 actions running 2024-12-18T00:09:06.4429565Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:09:06.4430644Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:09:06.4431635Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:09:06.4432400Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:09:06.4433198Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2024-12-18T00:09:06.4434171Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 12s local 2024-12-18T00:09:06.4435130Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 11s local 2024-12-18T00:09:06.4436251Z Compiling .../transforms/expanders/comparison_expander.cc; 11s local ... 2024-12-18T00:09:06.7682982Z 2024-12-18T00:09:06.7683975Z  2024-12-18T00:09:06.7684407Z  2024-12-18T00:09:06.7684814Z  2024-12-18T00:09:06.7685192Z  2024-12-18T00:09:06.7685508Z  2024-12-18T00:09:06.7685863Z  2024-12-18T00:09:06.7686233Z  2024-12-18T00:09:06.7686626Z  2024-12-18T00:09:06.7687551Z [14,065 / 15,187] 48 actions, 47 running 2024-12-18T00:09:06.7688427Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:09:06.7689516Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:09:06.7690318Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:09:06.7691043Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:09:06.7691889Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2024-12-18T00:09:06.7692982Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 12s local 2024-12-18T00:09:06.7693893Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 11s local 2024-12-18T00:09:06.7694898Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local ... 2024-12-18T00:09:07.0431077Z 2024-12-18T00:09:07.0432008Z  2024-12-18T00:09:07.0432474Z  2024-12-18T00:09:07.0432882Z  2024-12-18T00:09:07.0433284Z  2024-12-18T00:09:07.0433701Z  2024-12-18T00:09:07.0434086Z  2024-12-18T00:09:07.0434416Z  2024-12-18T00:09:07.0434765Z  2024-12-18T00:09:07.0435338Z [14,065 / 15,187] 48 actions running 2024-12-18T00:09:07.0436168Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:09:07.0437517Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:09:07.0438434Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:09:07.0439156Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:09:07.0440128Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2024-12-18T00:09:07.0441439Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 12s local 2024-12-18T00:09:07.0442430Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 12s local 2024-12-18T00:09:07.0443497Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local ... 2024-12-18T00:09:07.2435187Z 2024-12-18T00:09:07.2436079Z  2024-12-18T00:09:07.2436561Z  2024-12-18T00:09:07.2436971Z  2024-12-18T00:09:07.2437362Z  2024-12-18T00:09:07.2437778Z  2024-12-18T00:09:07.2438174Z  2024-12-18T00:09:07.2438540Z  2024-12-18T00:09:07.2438964Z  2024-12-18T00:09:07.2439560Z [14,067 / 15,187] 48 actions running 2024-12-18T00:09:07.2440433Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:09:07.2441491Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:09:07.2442413Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:09:07.2443218Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:09:07.2444055Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 13s local 2024-12-18T00:09:07.2445298Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 12s local 2024-12-18T00:09:07.2446381Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local 2024-12-18T00:09:07.2447344Z @xla//xla/hlo/evaluator:hlo_evaluator; 11s local ... 2024-12-18T00:09:08.1949853Z 2024-12-18T00:09:08.1950734Z  2024-12-18T00:09:08.1951190Z  2024-12-18T00:09:08.1951580Z  2024-12-18T00:09:08.1951977Z  2024-12-18T00:09:08.1952372Z  2024-12-18T00:09:08.1952752Z  2024-12-18T00:09:08.1953117Z  2024-12-18T00:09:08.1953506Z  2024-12-18T00:09:08.1954058Z [14,068 / 15,187] 48 actions, 47 running 2024-12-18T00:09:08.1954910Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2024-12-18T00:09:08.1955966Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:09:08.1956884Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:09:08.1957635Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2024-12-18T00:09:08.1958446Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 13s local 2024-12-18T00:09:08.1959437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 13s local 2024-12-18T00:09:08.1960761Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local 2024-12-18T00:09:08.1961677Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2024-12-18T00:09:08.4445265Z 2024-12-18T00:09:08.4446115Z  2024-12-18T00:09:08.4446585Z  2024-12-18T00:09:08.4446973Z  2024-12-18T00:09:08.4447391Z  2024-12-18T00:09:08.4447778Z  2024-12-18T00:09:08.4448174Z  2024-12-18T00:09:08.4448570Z  2024-12-18T00:09:08.4448886Z  2024-12-18T00:09:08.4449416Z [14,071 / 15,187] 48 actions running 2024-12-18T00:09:08.4450237Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2024-12-18T00:09:08.4451212Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:09:08.4452066Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:09:08.4452759Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2024-12-18T00:09:08.4453581Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 14s local 2024-12-18T00:09:08.4454484Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 13s local 2024-12-18T00:09:08.4455471Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2024-12-18T00:09:08.4456918Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2024-12-18T00:09:08.8450372Z 2024-12-18T00:09:08.8451171Z  2024-12-18T00:09:08.8451596Z  2024-12-18T00:09:08.8451940Z  2024-12-18T00:09:08.8452280Z  2024-12-18T00:09:08.8452628Z  2024-12-18T00:09:08.8452964Z  2024-12-18T00:09:08.8453309Z  2024-12-18T00:09:08.8453648Z  2024-12-18T00:09:08.8454506Z [14,074 / 15,187] 48 actions running 2024-12-18T00:09:08.8455239Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:09:08.8456142Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:09:08.8457060Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:09:08.8457776Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 14s local 2024-12-18T00:09:08.8458572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 14s local 2024-12-18T00:09:08.8459450Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2024-12-18T00:09:08.8460345Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2024-12-18T00:09:08.8461225Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local ... 2024-12-18T00:09:09.0454950Z 2024-12-18T00:09:09.0455808Z  2024-12-18T00:09:09.0456213Z  2024-12-18T00:09:09.0456699Z  2024-12-18T00:09:09.0457084Z  2024-12-18T00:09:09.0457443Z  2024-12-18T00:09:09.0457809Z  2024-12-18T00:09:09.0458165Z  2024-12-18T00:09:09.0458505Z  2024-12-18T00:09:09.0459019Z [14,075 / 15,187] 48 actions running 2024-12-18T00:09:09.0459936Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:09:09.0460839Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:09:09.0461629Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:09:09.0462352Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 14s local 2024-12-18T00:09:09.0463196Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 14s local 2024-12-18T00:09:09.0464110Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2024-12-18T00:09:09.0465120Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2024-12-18T00:09:09.0466021Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local ... 2024-12-18T00:09:09.3319241Z 2024-12-18T00:09:09.3320359Z  2024-12-18T00:09:09.3320838Z  2024-12-18T00:09:09.3321198Z  2024-12-18T00:09:09.3321575Z  2024-12-18T00:09:09.3321927Z  2024-12-18T00:09:09.3322300Z  2024-12-18T00:09:09.3322671Z  2024-12-18T00:09:09.3323440Z  2024-12-18T00:09:09.3324064Z [14,078 / 15,187] 48 actions, 47 running 2024-12-18T00:09:09.3324901Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:09:09.3325898Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:09:09.3326884Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local 2024-12-18T00:09:09.3327831Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 14s local 2024-12-18T00:09:09.3328850Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2024-12-18T00:09:09.3329893Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2024-12-18T00:09:09.3330946Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2024-12-18T00:09:09.3331812Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 11s local ... 2024-12-18T00:09:09.5730270Z 2024-12-18T00:09:09.5731254Z  2024-12-18T00:09:09.5731740Z  2024-12-18T00:09:09.5732166Z  2024-12-18T00:09:09.5732590Z  2024-12-18T00:09:09.5732964Z  2024-12-18T00:09:09.5733343Z  2024-12-18T00:09:09.5733702Z  2024-12-18T00:09:09.5734066Z  2024-12-18T00:09:09.5734640Z [14,080 / 15,187] 48 actions, 47 running 2024-12-18T00:09:09.5735805Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:09:09.5736973Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:09:09.5737970Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local 2024-12-18T00:09:09.5738926Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 14s local 2024-12-18T00:09:09.5740353Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2024-12-18T00:09:09.5741435Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2024-12-18T00:09:09.5742488Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 11s local 2024-12-18T00:09:09.5743479Z @xla//xla/hlo/transforms:algebraic_simplifier; 11s local ... 2024-12-18T00:09:09.8458276Z 2024-12-18T00:09:09.8459519Z  2024-12-18T00:09:09.8459987Z  2024-12-18T00:09:09.8460463Z  2024-12-18T00:09:09.8460923Z  2024-12-18T00:09:09.8461308Z  2024-12-18T00:09:09.8461708Z  2024-12-18T00:09:09.8462086Z  2024-12-18T00:09:09.8462475Z  2024-12-18T00:09:09.8463003Z [14,080 / 15,187] 48 actions running 2024-12-18T00:09:09.8463807Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:09:09.8464821Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:09:09.8465869Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local 2024-12-18T00:09:09.8466814Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local 2024-12-18T00:09:09.8467808Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2024-12-18T00:09:09.8468803Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2024-12-18T00:09:09.8469898Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 12s local 2024-12-18T00:09:09.8470867Z @xla//xla/hlo/transforms:algebraic_simplifier; 11s local ... 2024-12-18T00:09:10.0462643Z 2024-12-18T00:09:10.0463855Z  2024-12-18T00:09:10.0464286Z  2024-12-18T00:09:10.0464649Z  2024-12-18T00:09:10.0464990Z  2024-12-18T00:09:10.0465342Z  2024-12-18T00:09:10.0465693Z  2024-12-18T00:09:10.0466026Z  2024-12-18T00:09:10.0466372Z  2024-12-18T00:09:10.0466880Z [14,081 / 15,187] 48 actions running 2024-12-18T00:09:10.0467737Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:09:10.0468711Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:09:10.0469651Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local 2024-12-18T00:09:10.0470704Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local 2024-12-18T00:09:10.0472119Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2024-12-18T00:09:10.0472990Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2024-12-18T00:09:10.0474028Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 12s local 2024-12-18T00:09:10.0474932Z @xla//xla/hlo/transforms:algebraic_simplifier; 12s local ... 2024-12-18T00:09:10.3576609Z 2024-12-18T00:09:10.3577566Z  2024-12-18T00:09:10.3578080Z  2024-12-18T00:09:10.3578491Z  2024-12-18T00:09:10.3578910Z  2024-12-18T00:09:10.3579317Z  2024-12-18T00:09:10.3579728Z  2024-12-18T00:09:10.3580147Z  2024-12-18T00:09:10.3580597Z  2024-12-18T00:09:10.3581197Z [14,082 / 15,187] 48 actions, 47 running 2024-12-18T00:09:10.3582033Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:09:10.3583023Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:09:10.3583987Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:09:10.3584924Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local 2024-12-18T00:09:10.3585910Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2024-12-18T00:09:10.3587276Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2024-12-18T00:09:10.3588384Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 12s local 2024-12-18T00:09:10.3589375Z @xla//xla/hlo/transforms:algebraic_simplifier; 12s local ... 2024-12-18T00:09:10.6470552Z 2024-12-18T00:09:10.6471457Z  2024-12-18T00:09:10.6471961Z  2024-12-18T00:09:10.6472809Z  2024-12-18T00:09:10.6473241Z  2024-12-18T00:09:10.6473613Z  2024-12-18T00:09:10.6474020Z  2024-12-18T00:09:10.6474427Z  2024-12-18T00:09:10.6474844Z  2024-12-18T00:09:10.6475450Z [14,082 / 15,187] 48 actions running 2024-12-18T00:09:10.6476373Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:09:10.6477488Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:09:10.6478474Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:09:10.6479489Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local 2024-12-18T00:09:10.6480616Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2024-12-18T00:09:10.6481745Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2024-12-18T00:09:10.6482873Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2024-12-18T00:09:10.6483914Z @xla//xla/hlo/transforms:algebraic_simplifier; 12s local ... 2024-12-18T00:09:10.8474623Z 2024-12-18T00:09:10.8475579Z  2024-12-18T00:09:10.8476078Z  2024-12-18T00:09:10.8476484Z  2024-12-18T00:09:10.8476890Z  2024-12-18T00:09:10.8477302Z  2024-12-18T00:09:10.8477688Z  2024-12-18T00:09:10.8478126Z  2024-12-18T00:09:10.8478539Z  2024-12-18T00:09:10.8479141Z [14,083 / 15,187] 48 actions running 2024-12-18T00:09:10.8480005Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:09:10.8481045Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:09:10.8482093Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:09:10.8483141Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2024-12-18T00:09:10.8484292Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2024-12-18T00:09:10.8485480Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2024-12-18T00:09:10.8486620Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2024-12-18T00:09:10.8487706Z @xla//xla/hlo/transforms:algebraic_simplifier; 12s local ... 2024-12-18T00:09:11.1302877Z 2024-12-18T00:09:11.1304241Z  2024-12-18T00:09:11.1305166Z  2024-12-18T00:09:11.1305557Z  2024-12-18T00:09:11.1305958Z  2024-12-18T00:09:11.1306324Z  2024-12-18T00:09:11.1306700Z  2024-12-18T00:09:11.1307055Z  2024-12-18T00:09:11.1307461Z  2024-12-18T00:09:11.1308086Z [14,084 / 15,187] 48 actions, 47 running 2024-12-18T00:09:11.1308961Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:09:11.1310059Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:09:11.1311118Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:09:11.1312151Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2024-12-18T00:09:11.1313298Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2024-12-18T00:09:11.1314473Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2024-12-18T00:09:11.1315604Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2024-12-18T00:09:11.1316683Z @xla//xla/hlo/transforms:algebraic_simplifier; 13s local ... 2024-12-18T00:09:11.3313395Z 2024-12-18T00:09:11.3314310Z  2024-12-18T00:09:11.3314801Z  2024-12-18T00:09:11.3315221Z  2024-12-18T00:09:11.3315838Z  2024-12-18T00:09:11.3316225Z  2024-12-18T00:09:11.3316602Z  2024-12-18T00:09:11.3316997Z  2024-12-18T00:09:11.3317396Z  2024-12-18T00:09:11.3318122Z [14,086 / 15,187] 48 actions, 47 running 2024-12-18T00:09:11.3319096Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:09:11.3322350Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local 2024-12-18T00:09:11.3323515Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2024-12-18T00:09:11.3324446Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2024-12-18T00:09:11.3325453Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2024-12-18T00:09:11.3326587Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2024-12-18T00:09:11.3327730Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2024-12-18T00:09:11.3328873Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local ... 2024-12-18T00:09:11.5693671Z 2024-12-18T00:09:11.5695419Z  2024-12-18T00:09:11.5696243Z  2024-12-18T00:09:11.5697111Z  2024-12-18T00:09:11.5698111Z  2024-12-18T00:09:11.5698617Z  2024-12-18T00:09:11.5699058Z  2024-12-18T00:09:11.5699449Z  2024-12-18T00:09:11.5699856Z  2024-12-18T00:09:11.5700519Z [14,089 / 15,187] 48 actions, 47 running 2024-12-18T00:09:11.5701467Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:09:11.5702509Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local 2024-12-18T00:09:11.5703569Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2024-12-18T00:09:11.5704712Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2024-12-18T00:09:11.5705924Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2024-12-18T00:09:11.5707066Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2024-12-18T00:09:11.5708429Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2024-12-18T00:09:11.5709588Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local ... 2024-12-18T00:09:11.8482742Z 2024-12-18T00:09:11.8483696Z  2024-12-18T00:09:11.8484141Z  2024-12-18T00:09:11.8484573Z  2024-12-18T00:09:11.8484966Z  2024-12-18T00:09:11.8485394Z  2024-12-18T00:09:11.8485791Z  2024-12-18T00:09:11.8486180Z  2024-12-18T00:09:11.8486586Z  2024-12-18T00:09:11.8487131Z [14,089 / 15,187] 48 actions running 2024-12-18T00:09:11.8487998Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:09:11.8489318Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local 2024-12-18T00:09:11.8490310Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 17s local 2024-12-18T00:09:11.8491311Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2024-12-18T00:09:11.8492437Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 16s local 2024-12-18T00:09:11.8493545Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2024-12-18T00:09:11.8494858Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2024-12-18T00:09:11.8496040Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local ... 2024-12-18T00:09:12.2488399Z 2024-12-18T00:09:12.2489253Z  2024-12-18T00:09:12.2489707Z  2024-12-18T00:09:12.2490077Z  2024-12-18T00:09:12.2490463Z  2024-12-18T00:09:12.2490855Z  2024-12-18T00:09:12.2491236Z  2024-12-18T00:09:12.2491609Z  2024-12-18T00:09:12.2492043Z  2024-12-18T00:09:12.2492592Z [14,092 / 15,187] 48 actions running 2024-12-18T00:09:12.2493458Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:09:12.2494446Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local 2024-12-18T00:09:12.2495696Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 17s local 2024-12-18T00:09:12.2496882Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2024-12-18T00:09:12.2497984Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:09:12.2499446Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2024-12-18T00:09:12.2500515Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 12s local 2024-12-18T00:09:12.2501565Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 11s local ... 2024-12-18T00:09:12.4492461Z 2024-12-18T00:09:12.4493354Z  2024-12-18T00:09:12.4493823Z  2024-12-18T00:09:12.4494264Z  2024-12-18T00:09:12.4494669Z  2024-12-18T00:09:12.4494999Z  2024-12-18T00:09:12.4495365Z  2024-12-18T00:09:12.4495768Z  2024-12-18T00:09:12.4496163Z  2024-12-18T00:09:12.4496847Z [14,093 / 15,187] 48 actions running 2024-12-18T00:09:12.4497703Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:09:12.4498662Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local 2024-12-18T00:09:12.4499572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 17s local 2024-12-18T00:09:12.4500610Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2024-12-18T00:09:12.4501669Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:09:12.4502671Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2024-12-18T00:09:12.4503722Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 12s local 2024-12-18T00:09:12.4504878Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local ... 2024-12-18T00:09:12.8020521Z 2024-12-18T00:09:12.8021363Z  2024-12-18T00:09:12.8021786Z  2024-12-18T00:09:12.8022128Z  2024-12-18T00:09:12.8022466Z  2024-12-18T00:09:12.8022824Z  2024-12-18T00:09:12.8023177Z  2024-12-18T00:09:12.8023556Z  2024-12-18T00:09:12.8023904Z  2024-12-18T00:09:12.8024570Z [14,095 / 15,187] 48 actions, 47 running 2024-12-18T00:09:12.8025346Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:09:12.8026245Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local 2024-12-18T00:09:12.8027103Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 17s local 2024-12-18T00:09:12.8028002Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2024-12-18T00:09:12.8028962Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:09:12.8030214Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2024-12-18T00:09:12.8031549Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local 2024-12-18T00:09:12.8032523Z Compiling xla/hlo/builder/lib/matrix.cc; 12s local ... 2024-12-18T00:09:13.0498137Z 2024-12-18T00:09:13.0499002Z  2024-12-18T00:09:13.0499489Z  2024-12-18T00:09:13.0499906Z  2024-12-18T00:09:13.0500310Z  2024-12-18T00:09:13.0500721Z  2024-12-18T00:09:13.0501131Z  2024-12-18T00:09:13.0501548Z  2024-12-18T00:09:13.0501962Z  2024-12-18T00:09:13.0502540Z [14,098 / 15,187] 48 actions running 2024-12-18T00:09:13.0503474Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:09:13.0504629Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local 2024-12-18T00:09:13.0505912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local 2024-12-18T00:09:13.0506972Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2024-12-18T00:09:13.0508239Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:09:13.0509498Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2024-12-18T00:09:13.0511034Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local 2024-12-18T00:09:13.0512161Z Compiling xla/tools/hlo_extractor.cc; 12s local ... 2024-12-18T00:09:13.3710988Z 2024-12-18T00:09:13.3711897Z  2024-12-18T00:09:13.3712338Z  2024-12-18T00:09:13.3712693Z  2024-12-18T00:09:13.3713045Z  2024-12-18T00:09:13.3713427Z  2024-12-18T00:09:13.3713766Z  2024-12-18T00:09:13.3714437Z  2024-12-18T00:09:13.3714789Z  2024-12-18T00:09:13.3715340Z [14,099 / 15,187] 48 actions, 47 running 2024-12-18T00:09:13.3716152Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:09:13.3717076Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:09:13.3717930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local 2024-12-18T00:09:13.3718891Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2024-12-18T00:09:13.3719900Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:09:13.3720877Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2024-12-18T00:09:13.3721855Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:09:13.3722742Z Compiling xla/tools/hlo_extractor.cc; 12s local ... 2024-12-18T00:09:13.6505562Z 2024-12-18T00:09:13.6506481Z  2024-12-18T00:09:13.6507883Z  2024-12-18T00:09:13.6508730Z  2024-12-18T00:09:13.6509403Z  2024-12-18T00:09:13.6510823Z  2024-12-18T00:09:13.6512735Z  2024-12-18T00:09:13.6514652Z  2024-12-18T00:09:13.6516552Z  2024-12-18T00:09:13.6518623Z [14,099 / 15,187] 48 actions running 2024-12-18T00:09:13.6520985Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:09:13.6524652Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:09:13.6525574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local 2024-12-18T00:09:13.6526564Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2024-12-18T00:09:13.6527572Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:09:13.6528603Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2024-12-18T00:09:13.6529679Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:09:13.6530605Z Compiling xla/tools/hlo_extractor.cc; 12s local ... 2024-12-18T00:09:14.0263977Z 2024-12-18T00:09:14.0264848Z  2024-12-18T00:09:14.0265313Z  2024-12-18T00:09:14.0265713Z  2024-12-18T00:09:14.0266102Z  2024-12-18T00:09:14.0266482Z  2024-12-18T00:09:14.0267162Z  2024-12-18T00:09:14.0267560Z  2024-12-18T00:09:14.0267950Z  2024-12-18T00:09:14.0268519Z [14,100 / 15,187] 48 actions, 47 running 2024-12-18T00:09:14.0269430Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:09:14.0270411Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:09:14.0271394Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2024-12-18T00:09:14.0272468Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2024-12-18T00:09:14.0273462Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:09:14.0274562Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:09:14.0275449Z Compiling xla/tools/hlo_extractor.cc; 13s local 2024-12-18T00:09:14.0276302Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local ... 2024-12-18T00:09:14.2513324Z 2024-12-18T00:09:14.2514238Z  2024-12-18T00:09:14.2514718Z  2024-12-18T00:09:14.2515114Z  2024-12-18T00:09:14.2515483Z  2024-12-18T00:09:14.2515872Z  2024-12-18T00:09:14.2516260Z  2024-12-18T00:09:14.2516642Z  2024-12-18T00:09:14.2517030Z  2024-12-18T00:09:14.2517943Z [14,100 / 15,187] 48 actions running 2024-12-18T00:09:14.2518789Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:09:14.2519783Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:09:14.2520731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2024-12-18T00:09:14.2522138Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2024-12-18T00:09:14.2523220Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:09:14.2524299Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:09:14.2525230Z Compiling xla/tools/hlo_extractor.cc; 13s local 2024-12-18T00:09:14.2526024Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local ... 2024-12-18T00:09:14.4958622Z 2024-12-18T00:09:14.4959510Z  2024-12-18T00:09:14.4959935Z  2024-12-18T00:09:14.4960312Z  2024-12-18T00:09:14.4960734Z  2024-12-18T00:09:14.4961131Z  2024-12-18T00:09:14.4961519Z  2024-12-18T00:09:14.4961871Z  2024-12-18T00:09:14.4962222Z  2024-12-18T00:09:14.4962793Z [14,101 / 15,187] 48 actions, 47 running 2024-12-18T00:09:14.4963660Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:09:14.4964577Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:09:14.4965452Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2024-12-18T00:09:14.4966430Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2024-12-18T00:09:14.4967466Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:09:14.4968589Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:09:14.4969501Z Compiling xla/tools/hlo_extractor.cc; 13s local 2024-12-18T00:09:14.4970278Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local ... 2024-12-18T00:09:14.8519994Z 2024-12-18T00:09:14.8520830Z  2024-12-18T00:09:14.8521290Z  2024-12-18T00:09:14.8521645Z  2024-12-18T00:09:14.8522017Z  2024-12-18T00:09:14.8522381Z  2024-12-18T00:09:14.8522745Z  2024-12-18T00:09:14.8523095Z  2024-12-18T00:09:14.8523466Z  2024-12-18T00:09:14.8523998Z [14,102 / 15,187] 48 actions running 2024-12-18T00:09:14.8524968Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:09:14.8525857Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:09:14.8526675Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:09:14.8527536Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 17s local 2024-12-18T00:09:14.8528656Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:09:14.8529565Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:09:14.8530343Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:09:14.8531041Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local ... 2024-12-18T00:09:15.0523678Z 2024-12-18T00:09:15.0524573Z  2024-12-18T00:09:15.0525028Z  2024-12-18T00:09:15.0525431Z  2024-12-18T00:09:15.0525914Z  2024-12-18T00:09:15.0526480Z  2024-12-18T00:09:15.0526959Z  2024-12-18T00:09:15.0527387Z  2024-12-18T00:09:15.0527780Z  2024-12-18T00:09:15.0528352Z [14,105 / 15,187] 48 actions running 2024-12-18T00:09:15.0529263Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:09:15.0530313Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:09:15.0531317Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:09:15.0532412Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:09:15.0533628Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:09:15.0534888Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:09:15.0535769Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2024-12-18T00:09:15.0536976Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local ... 2024-12-18T00:09:15.3487350Z 2024-12-18T00:09:15.3488251Z  2024-12-18T00:09:15.3489107Z  2024-12-18T00:09:15.3489538Z  2024-12-18T00:09:15.3489952Z  2024-12-18T00:09:15.3490369Z  2024-12-18T00:09:15.3490754Z  2024-12-18T00:09:15.3491149Z  2024-12-18T00:09:15.3491548Z  2024-12-18T00:09:15.3492143Z [14,106 / 15,187] 48 actions, 47 running 2024-12-18T00:09:15.3493035Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:09:15.3494138Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:09:15.3495261Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:09:15.3496317Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:09:15.3497590Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 15s local 2024-12-18T00:09:15.3498558Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:09:15.3499371Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2024-12-18T00:09:15.3500312Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local ... 2024-12-18T00:09:15.6530081Z 2024-12-18T00:09:15.6530917Z  2024-12-18T00:09:15.6531404Z  2024-12-18T00:09:15.6531799Z  2024-12-18T00:09:15.6532312Z  2024-12-18T00:09:15.6532721Z  2024-12-18T00:09:15.6533107Z  2024-12-18T00:09:15.6533545Z  2024-12-18T00:09:15.6533940Z  2024-12-18T00:09:15.6534495Z [14,106 / 15,187] 48 actions running 2024-12-18T00:09:15.6535171Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:09:15.6535990Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:09:15.6537091Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:09:15.6538109Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:09:15.6539189Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 15s local 2024-12-18T00:09:15.6540099Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:09:15.6540902Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2024-12-18T00:09:15.6541846Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local ... 2024-12-18T00:09:15.8534686Z 2024-12-18T00:09:15.8535539Z  2024-12-18T00:09:15.8536311Z  2024-12-18T00:09:15.8536854Z  2024-12-18T00:09:15.8537221Z  2024-12-18T00:09:15.8537595Z  2024-12-18T00:09:15.8537991Z  2024-12-18T00:09:15.8538380Z  2024-12-18T00:09:15.8538716Z  2024-12-18T00:09:15.8539197Z [14,110 / 15,187] 48 actions running 2024-12-18T00:09:15.8540102Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:09:15.8541077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:09:15.8542013Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2024-12-18T00:09:15.8543066Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:09:15.8543996Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:09:15.8545022Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2024-12-18T00:09:15.8545907Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2024-12-18T00:09:15.8546791Z Compiling .../memory_space_assignment/cost_analysis.cc; 12s local ... 2024-12-18T00:09:16.1551537Z 2024-12-18T00:09:16.1552422Z  2024-12-18T00:09:16.1552916Z  2024-12-18T00:09:16.1553323Z  2024-12-18T00:09:16.1553734Z  2024-12-18T00:09:16.1554117Z  2024-12-18T00:09:16.1554799Z  2024-12-18T00:09:16.1555193Z  2024-12-18T00:09:16.1555582Z  2024-12-18T00:09:16.1556171Z [14,111 / 15,187] 48 actions, 47 running 2024-12-18T00:09:16.1557003Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:09:16.1557994Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:09:16.1559213Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2024-12-18T00:09:16.1560249Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2024-12-18T00:09:16.1561096Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:09:16.1561892Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2024-12-18T00:09:16.1562801Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2024-12-18T00:09:16.1563787Z Compiling .../memory_space_assignment/cost_analysis.cc; 13s local ... 2024-12-18T00:09:16.3810200Z 2024-12-18T00:09:16.3811052Z  2024-12-18T00:09:16.3811545Z  2024-12-18T00:09:16.3811980Z  2024-12-18T00:09:16.3812318Z  2024-12-18T00:09:16.3812721Z  2024-12-18T00:09:16.3813128Z  2024-12-18T00:09:16.3813544Z  2024-12-18T00:09:16.3813884Z  2024-12-18T00:09:16.3814424Z [14,113 / 15,187] 48 actions, 47 running 2024-12-18T00:09:16.3815472Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:09:16.3816608Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:09:16.3817561Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2024-12-18T00:09:16.3818565Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2024-12-18T00:09:16.3819466Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:09:16.3820228Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2024-12-18T00:09:16.3821162Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2024-12-18T00:09:16.3822143Z Compiling .../memory_space_assignment/cost_analysis.cc; 13s local ... 2024-12-18T00:09:16.6541926Z 2024-12-18T00:09:16.6542826Z  2024-12-18T00:09:16.6543301Z  2024-12-18T00:09:16.6543683Z  2024-12-18T00:09:16.6544049Z  2024-12-18T00:09:16.6544687Z  2024-12-18T00:09:16.6545080Z  2024-12-18T00:09:16.6545465Z  2024-12-18T00:09:16.6545896Z  2024-12-18T00:09:16.6546453Z [14,113 / 15,187] 48 actions running 2024-12-18T00:09:16.6547327Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:09:16.6548281Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:09:16.6549217Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2024-12-18T00:09:16.6550581Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2024-12-18T00:09:16.6551489Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:09:16.6552308Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2024-12-18T00:09:16.6565197Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2024-12-18T00:09:16.6566498Z Compiling .../memory_space_assignment/cost_analysis.cc; 13s local ... 2024-12-18T00:09:17.2291798Z 2024-12-18T00:09:17.2292666Z  2024-12-18T00:09:17.2293134Z  2024-12-18T00:09:17.2293519Z  2024-12-18T00:09:17.2293899Z  2024-12-18T00:09:17.2294313Z  2024-12-18T00:09:17.2294714Z  2024-12-18T00:09:17.2295100Z  2024-12-18T00:09:17.2295541Z  2024-12-18T00:09:17.2296149Z [14,114 / 15,187] 48 actions, 47 running 2024-12-18T00:09:17.2297152Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:09:17.2298139Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:09:17.2299130Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2024-12-18T00:09:17.2300171Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:09:17.2301419Z Compiling xla/tools/hlo_extractor.cc; 16s local 2024-12-18T00:09:17.2302278Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2024-12-18T00:09:17.2303237Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local 2024-12-18T00:09:17.2304123Z Compiling .../memory_space_assignment/cost_analysis.cc; 14s local ... 2024-12-18T00:09:17.4549710Z 2024-12-18T00:09:17.4550565Z  2024-12-18T00:09:17.4551023Z  2024-12-18T00:09:17.4551408Z  2024-12-18T00:09:17.4551825Z  2024-12-18T00:09:17.4552217Z  2024-12-18T00:09:17.4552583Z  2024-12-18T00:09:17.4552949Z  2024-12-18T00:09:17.4553325Z  2024-12-18T00:09:17.4553922Z [14,115 / 15,187] 48 actions running 2024-12-18T00:09:17.4554813Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:09:17.4555779Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:09:17.4556713Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2024-12-18T00:09:17.4557709Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:09:17.4558692Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2024-12-18T00:09:17.4559628Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local 2024-12-18T00:09:17.4560650Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2024-12-18T00:09:17.4561712Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local ... 2024-12-18T00:09:17.8111905Z 2024-12-18T00:09:17.8112712Z  2024-12-18T00:09:17.8113121Z  2024-12-18T00:09:17.8113458Z  2024-12-18T00:09:17.8113828Z  2024-12-18T00:09:17.8114150Z  2024-12-18T00:09:17.8114486Z  2024-12-18T00:09:17.8114834Z  2024-12-18T00:09:17.8115177Z  2024-12-18T00:09:17.8115667Z [14,116 / 15,187] 48 actions, 47 running 2024-12-18T00:09:17.8116440Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:09:17.8117269Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:09:17.8118068Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2024-12-18T00:09:17.8118935Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:09:17.8119788Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2024-12-18T00:09:17.8120556Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:09:17.8121431Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2024-12-18T00:09:17.8122411Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local ... 2024-12-18T00:09:18.0563788Z 2024-12-18T00:09:18.0564690Z  2024-12-18T00:09:18.0565278Z  2024-12-18T00:09:18.0565653Z  2024-12-18T00:09:18.0565985Z  2024-12-18T00:09:18.0566368Z  2024-12-18T00:09:18.0566737Z  2024-12-18T00:09:18.0567136Z  2024-12-18T00:09:18.0567505Z  2024-12-18T00:09:18.0568017Z [14,118 / 15,187] 48 actions running 2024-12-18T00:09:18.0568855Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2024-12-18T00:09:18.0569800Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:09:18.0570735Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2024-12-18T00:09:18.0571744Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:09:18.0572735Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2024-12-18T00:09:18.0573635Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:09:18.0574570Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local 2024-12-18T00:09:18.0575404Z Compiling xla/service/dynamic_padder.cc; 13s local ... 2024-12-18T00:09:18.4560941Z 2024-12-18T00:09:18.4561782Z  2024-12-18T00:09:18.4562499Z  2024-12-18T00:09:18.4562884Z  2024-12-18T00:09:18.4563283Z  2024-12-18T00:09:18.4563659Z  2024-12-18T00:09:18.4564006Z  2024-12-18T00:09:18.4564329Z  2024-12-18T00:09:18.4564717Z  2024-12-18T00:09:18.4565259Z [14,119 / 15,187] 48 actions running 2024-12-18T00:09:18.4566173Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2024-12-18T00:09:18.4567365Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:09:18.4568295Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2024-12-18T00:09:18.4569341Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:09:18.4570339Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2024-12-18T00:09:18.4571271Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:09:18.4572231Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 15s local 2024-12-18T00:09:18.4573098Z Compiling xla/service/dynamic_padder.cc; 14s local ... 2024-12-18T00:09:18.6565316Z 2024-12-18T00:09:18.6566162Z  2024-12-18T00:09:18.6566646Z  2024-12-18T00:09:18.6567039Z  2024-12-18T00:09:18.6567422Z  2024-12-18T00:09:18.6567840Z  2024-12-18T00:09:18.6568216Z  2024-12-18T00:09:18.6568597Z  2024-12-18T00:09:18.6568979Z  2024-12-18T00:09:18.6569579Z [14,121 / 15,187] 48 actions running 2024-12-18T00:09:18.6570480Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2024-12-18T00:09:18.6571463Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:09:18.6572480Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2024-12-18T00:09:18.6573689Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:09:18.6574745Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:09:18.6575682Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 15s local 2024-12-18T00:09:18.6576747Z Compiling xla/service/dynamic_padder.cc; 14s local 2024-12-18T00:09:18.6577546Z @xla//xla/hlo/transforms:hlo_constant_folding; 12s local ... 2024-12-18T00:09:19.1979398Z 2024-12-18T00:09:19.1980264Z  2024-12-18T00:09:19.1980736Z  2024-12-18T00:09:19.1981108Z  2024-12-18T00:09:19.1981457Z  2024-12-18T00:09:19.1981853Z  2024-12-18T00:09:19.1982294Z  2024-12-18T00:09:19.1982680Z  2024-12-18T00:09:19.1983000Z  2024-12-18T00:09:19.1983597Z [14,122 / 15,187] 48 actions, 47 running 2024-12-18T00:09:19.1984467Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:09:19.1985420Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:09:19.1986622Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:09:19.1987591Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:09:19.1988555Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 17s local 2024-12-18T00:09:19.1989423Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:09:19.1990246Z Compiling xla/service/dynamic_padder.cc; 14s local 2024-12-18T00:09:19.1991038Z @xla//xla/hlo/transforms:hlo_constant_folding; 12s local ... 2024-12-18T00:09:19.4573055Z 2024-12-18T00:09:19.4573911Z  2024-12-18T00:09:19.4574411Z  2024-12-18T00:09:19.4574810Z  2024-12-18T00:09:19.4575183Z  2024-12-18T00:09:19.4575488Z  2024-12-18T00:09:19.4575808Z  2024-12-18T00:09:19.4576169Z  2024-12-18T00:09:19.4576722Z  2024-12-18T00:09:19.4577297Z [14,123 / 15,187] 48 actions running 2024-12-18T00:09:19.4578193Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:09:19.4579167Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:09:19.4580161Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:09:19.4581424Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:09:19.4582431Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:09:19.4583275Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:09:19.4584158Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2024-12-18T00:09:19.4585565Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local ... 2024-12-18T00:09:19.7468797Z 2024-12-18T00:09:19.7469631Z  2024-12-18T00:09:19.7470048Z  2024-12-18T00:09:19.7470406Z  2024-12-18T00:09:19.7470741Z  2024-12-18T00:09:19.7471088Z  2024-12-18T00:09:19.7471476Z  2024-12-18T00:09:19.7471842Z  2024-12-18T00:09:19.7472200Z  2024-12-18T00:09:19.7472758Z [14,124 / 15,187] 48 actions, 47 running 2024-12-18T00:09:19.7473632Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:09:19.7474551Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:09:19.7475489Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:09:19.7476532Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:09:19.7477474Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:09:19.7478300Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:09:19.7479159Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2024-12-18T00:09:19.7480151Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local ... 2024-12-18T00:09:20.0579247Z 2024-12-18T00:09:20.0580109Z  2024-12-18T00:09:20.0580509Z  2024-12-18T00:09:20.0580833Z  2024-12-18T00:09:20.0581171Z  2024-12-18T00:09:20.0581500Z  2024-12-18T00:09:20.0581825Z  2024-12-18T00:09:20.0582150Z  2024-12-18T00:09:20.0582454Z  2024-12-18T00:09:20.0582938Z [14,125 / 15,187] 48 actions running 2024-12-18T00:09:20.0583666Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:09:20.0584524Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:09:20.0585359Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:09:20.0586226Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:09:20.0587154Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:09:20.0587945Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:09:20.0588737Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2024-12-18T00:09:20.0589984Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local ... 2024-12-18T00:09:20.2582788Z 2024-12-18T00:09:20.2583636Z  2024-12-18T00:09:20.2584023Z  2024-12-18T00:09:20.2584342Z  2024-12-18T00:09:20.2584679Z  2024-12-18T00:09:20.2584993Z  2024-12-18T00:09:20.2585308Z  2024-12-18T00:09:20.2585614Z  2024-12-18T00:09:20.2585918Z  2024-12-18T00:09:20.2586353Z [14,126 / 15,187] 48 actions running 2024-12-18T00:09:20.2587042Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:09:20.2587839Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:09:20.2588582Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:09:20.2589359Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:09:20.2590046Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:09:20.2590754Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2024-12-18T00:09:20.2591569Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:09:20.2592312Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 11s local ... 2024-12-18T00:09:20.5416170Z 2024-12-18T00:09:20.5417153Z  2024-12-18T00:09:20.5417693Z  2024-12-18T00:09:20.5418059Z  2024-12-18T00:09:20.5418470Z  2024-12-18T00:09:20.5418853Z  2024-12-18T00:09:20.5419261Z  2024-12-18T00:09:20.5419664Z  2024-12-18T00:09:20.5420055Z  2024-12-18T00:09:20.5420622Z [14,128 / 15,187] 48 actions, 47 running 2024-12-18T00:09:20.5423511Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:09:20.5424737Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:09:20.5425702Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:09:20.5426751Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:09:20.5427735Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:09:20.5428675Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 14s local 2024-12-18T00:09:20.5429810Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:09:20.5430990Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local ... 2024-12-18T00:09:20.8589843Z 2024-12-18T00:09:20.8590733Z  2024-12-18T00:09:20.8591185Z  2024-12-18T00:09:20.8591580Z  2024-12-18T00:09:20.8591925Z  2024-12-18T00:09:20.8592296Z  2024-12-18T00:09:20.8592652Z  2024-12-18T00:09:20.8593078Z  2024-12-18T00:09:20.8593491Z  2024-12-18T00:09:20.8594017Z [14,129 / 15,187] 48 actions running 2024-12-18T00:09:20.8594880Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:09:20.8595900Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:09:20.8596817Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:09:20.8597880Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:09:20.8598964Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:09:20.8599907Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:09:20.8600927Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local 2024-12-18T00:09:20.8601966Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local ... 2024-12-18T00:09:21.0594521Z 2024-12-18T00:09:21.0595310Z  2024-12-18T00:09:21.0595767Z  2024-12-18T00:09:21.0596186Z  2024-12-18T00:09:21.0596560Z  2024-12-18T00:09:21.0596956Z  2024-12-18T00:09:21.0597341Z  2024-12-18T00:09:21.0597692Z  2024-12-18T00:09:21.0598077Z  2024-12-18T00:09:21.0598667Z [14,130 / 15,187] 48 actions running 2024-12-18T00:09:21.0599892Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2024-12-18T00:09:21.0600886Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:09:21.0601867Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:09:21.0602959Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:09:21.0603903Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:09:21.0604843Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:09:21.0605791Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local 2024-12-18T00:09:21.0606779Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local ... 2024-12-18T00:09:21.3639269Z 2024-12-18T00:09:21.3640139Z  2024-12-18T00:09:21.3640618Z  2024-12-18T00:09:21.3640957Z  2024-12-18T00:09:21.3641287Z  2024-12-18T00:09:21.3641622Z  2024-12-18T00:09:21.3641988Z  2024-12-18T00:09:21.3642402Z  2024-12-18T00:09:21.3642771Z  2024-12-18T00:09:21.3643359Z [14,133 / 15,187] 48 actions, 47 running 2024-12-18T00:09:21.3644531Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2024-12-18T00:09:21.3645497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:09:21.3646744Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:09:21.3647772Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:09:21.3648659Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:09:21.3649846Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:09:21.3650794Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local 2024-12-18T00:09:21.3651736Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 11s local ... 2024-12-18T00:09:21.6600509Z 2024-12-18T00:09:21.6601386Z  2024-12-18T00:09:21.6601853Z  2024-12-18T00:09:21.6602269Z  2024-12-18T00:09:21.6602631Z  2024-12-18T00:09:21.6603018Z  2024-12-18T00:09:21.6603391Z  2024-12-18T00:09:21.6603769Z  2024-12-18T00:09:21.6604144Z  2024-12-18T00:09:21.6604685Z [14,133 / 15,187] 48 actions running 2024-12-18T00:09:21.6605558Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2024-12-18T00:09:21.6606497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:09:21.6607406Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:09:21.6608376Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:09:21.6609328Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:09:21.6610265Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:09:21.6611161Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2024-12-18T00:09:21.6612064Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local ... 2024-12-18T00:09:21.9597634Z 2024-12-18T00:09:21.9598503Z  2024-12-18T00:09:21.9598982Z  2024-12-18T00:09:21.9599373Z  2024-12-18T00:09:21.9599771Z  2024-12-18T00:09:21.9600151Z  2024-12-18T00:09:21.9600614Z  2024-12-18T00:09:21.9601149Z  2024-12-18T00:09:21.9601564Z  2024-12-18T00:09:21.9602166Z [14,134 / 15,187] 48 actions, 47 running 2024-12-18T00:09:21.9603021Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:09:21.9603990Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:09:21.9604969Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:09:21.9606007Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:09:21.9606941Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:09:21.9607917Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:09:21.9609142Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2024-12-18T00:09:21.9610123Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local ... 2024-12-18T00:09:22.2518586Z 2024-12-18T00:09:22.2519523Z  2024-12-18T00:09:22.2520002Z  2024-12-18T00:09:22.2520385Z  2024-12-18T00:09:22.2520900Z  2024-12-18T00:09:22.2521284Z  2024-12-18T00:09:22.2521666Z  2024-12-18T00:09:22.2522033Z  2024-12-18T00:09:22.2522430Z  2024-12-18T00:09:22.2523045Z [14,136 / 15,187] 48 actions, 47 running 2024-12-18T00:09:22.2523939Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:09:22.2524973Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:09:22.2525925Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:09:22.2526876Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2024-12-18T00:09:22.2527830Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:09:22.2528714Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local 2024-12-18T00:09:22.2529698Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2024-12-18T00:09:22.2530794Z @xla//xla/hlo/evaluator:hlo_evaluator; 10s local ... 2024-12-18T00:09:22.4607876Z 2024-12-18T00:09:22.4608739Z  2024-12-18T00:09:22.4609169Z  2024-12-18T00:09:22.4609539Z  2024-12-18T00:09:22.4609899Z  2024-12-18T00:09:22.4610231Z  2024-12-18T00:09:22.4610590Z  2024-12-18T00:09:22.4610921Z  2024-12-18T00:09:22.4611250Z  2024-12-18T00:09:22.4612124Z [14,136 / 15,187] 48 actions running 2024-12-18T00:09:22.4612938Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:09:22.4613828Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:09:22.4614692Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:09:22.4615610Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2024-12-18T00:09:22.4616627Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:09:22.4617407Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local 2024-12-18T00:09:22.4618298Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2024-12-18T00:09:22.4619007Z @xla//xla/hlo/evaluator:hlo_evaluator; 11s local ... 2024-12-18T00:09:23.0584842Z 2024-12-18T00:09:23.0585684Z  2024-12-18T00:09:23.0586191Z  2024-12-18T00:09:23.0586585Z  2024-12-18T00:09:23.0586985Z  2024-12-18T00:09:23.0587401Z  2024-12-18T00:09:23.0587780Z  2024-12-18T00:09:23.0588184Z  2024-12-18T00:09:23.0588576Z  2024-12-18T00:09:23.0589159Z [14,137 / 15,187] 48 actions, 47 running 2024-12-18T00:09:23.0590064Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:09:23.0591084Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:09:23.0592060Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:09:23.0593221Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:09:23.0594153Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:09:23.0594918Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2024-12-18T00:09:23.0595859Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 11s local 2024-12-18T00:09:23.0596924Z Compiling xla/service/select_and_scatter_expander.cc; 11s local ... 2024-12-18T00:09:23.2615513Z 2024-12-18T00:09:23.2616582Z  2024-12-18T00:09:23.2617109Z  2024-12-18T00:09:23.2617511Z  2024-12-18T00:09:23.2617909Z  2024-12-18T00:09:23.2618310Z  2024-12-18T00:09:23.2618690Z  2024-12-18T00:09:23.2619059Z  2024-12-18T00:09:23.2619445Z  2024-12-18T00:09:23.2620287Z [14,137 / 15,187] 48 actions running 2024-12-18T00:09:23.2621191Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:09:23.2622204Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:09:23.2623186Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:09:23.2624218Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:09:23.2625174Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:09:23.2625977Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2024-12-18T00:09:23.2626962Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 11s local 2024-12-18T00:09:23.2628008Z Compiling xla/service/select_and_scatter_expander.cc; 11s local ... 2024-12-18T00:09:23.6621010Z 2024-12-18T00:09:23.6621855Z  2024-12-18T00:09:23.6622313Z  2024-12-18T00:09:23.6622707Z  2024-12-18T00:09:23.6623086Z  2024-12-18T00:09:23.6623477Z  2024-12-18T00:09:23.6623847Z  2024-12-18T00:09:23.6624202Z  2024-12-18T00:09:23.6624553Z  2024-12-18T00:09:23.6625064Z [14,141 / 15,187] 48 actions running 2024-12-18T00:09:23.6625898Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:09:23.6627187Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:09:23.6628131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:09:23.6629165Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:09:23.6630077Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:09:23.6631110Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:09:23.6632067Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 12s local 2024-12-18T00:09:23.6633285Z Compiling xla/service/select_and_scatter_expander.cc; 12s local ... 2024-12-18T00:09:23.9001335Z 2024-12-18T00:09:23.9002204Z  2024-12-18T00:09:23.9002666Z  2024-12-18T00:09:23.9003086Z  2024-12-18T00:09:23.9003450Z  2024-12-18T00:09:23.9003829Z  2024-12-18T00:09:23.9004204Z  2024-12-18T00:09:23.9004597Z  2024-12-18T00:09:23.9005026Z  2024-12-18T00:09:23.9005610Z [14,142 / 15,187] 48 actions, 47 running 2024-12-18T00:09:23.9006479Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:09:23.9007435Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:09:23.9008422Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:09:23.9009477Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:09:23.9010363Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:09:23.9011167Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:09:23.9012111Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 12s local 2024-12-18T00:09:23.9013135Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local ... 2024-12-18T00:09:24.1819299Z 2024-12-18T00:09:24.1820189Z  2024-12-18T00:09:24.1820655Z  2024-12-18T00:09:24.1821059Z  2024-12-18T00:09:24.1821593Z  2024-12-18T00:09:24.1821952Z  2024-12-18T00:09:24.1822310Z  2024-12-18T00:09:24.1822668Z  2024-12-18T00:09:24.1823040Z  2024-12-18T00:09:24.1823596Z [14,143 / 15,187] 48 actions, 47 running 2024-12-18T00:09:24.1824464Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:09:24.1825478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:09:24.1826429Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:09:24.1827462Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:09:24.1828400Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:09:24.1829413Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:09:24.1830352Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 12s local 2024-12-18T00:09:24.1831330Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local ... 2024-12-18T00:09:24.4067166Z 2024-12-18T00:09:24.4068036Z  2024-12-18T00:09:24.4068518Z  2024-12-18T00:09:24.4068914Z  2024-12-18T00:09:24.4069288Z  2024-12-18T00:09:24.4069678Z  2024-12-18T00:09:24.4070072Z  2024-12-18T00:09:24.4070464Z  2024-12-18T00:09:24.4070846Z  2024-12-18T00:09:24.4071439Z [14,146 / 15,187] 48 actions, 47 running 2024-12-18T00:09:24.4072389Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:09:24.4073382Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:09:24.4074379Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:09:24.4075509Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:09:24.4076536Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:09:24.4077529Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2024-12-18T00:09:24.4078817Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2024-12-18T00:09:24.4079645Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2024-12-18T00:09:24.6629400Z 2024-12-18T00:09:24.6630245Z  2024-12-18T00:09:24.6630688Z  2024-12-18T00:09:24.6631078Z  2024-12-18T00:09:24.6631443Z  2024-12-18T00:09:24.6631770Z  2024-12-18T00:09:24.6632142Z  2024-12-18T00:09:24.6632855Z  2024-12-18T00:09:24.6633236Z  2024-12-18T00:09:24.6633801Z [14,146 / 15,187] 48 actions running 2024-12-18T00:09:24.6634651Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:09:24.6635583Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:09:24.6636530Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:09:24.6637480Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:09:24.6638426Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2024-12-18T00:09:24.6639304Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2024-12-18T00:09:24.6640279Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2024-12-18T00:09:24.6641050Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2024-12-18T00:09:24.8634180Z 2024-12-18T00:09:24.8635017Z  2024-12-18T00:09:24.8635497Z  2024-12-18T00:09:24.8635884Z  2024-12-18T00:09:24.8636231Z  2024-12-18T00:09:24.8636609Z  2024-12-18T00:09:24.8636992Z  2024-12-18T00:09:24.8637366Z  2024-12-18T00:09:24.8637853Z  2024-12-18T00:09:24.8638484Z [14,147 / 15,187] 48 actions running 2024-12-18T00:09:24.8639250Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:09:24.8640077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:09:24.8640977Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:09:24.8641974Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:09:24.8642911Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2024-12-18T00:09:24.8643870Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2024-12-18T00:09:24.8645101Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2024-12-18T00:09:24.8645856Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2024-12-18T00:09:25.1786532Z 2024-12-18T00:09:25.1787386Z  2024-12-18T00:09:25.1787850Z  2024-12-18T00:09:25.1788239Z  2024-12-18T00:09:25.1788636Z  2024-12-18T00:09:25.1789006Z  2024-12-18T00:09:25.1789380Z  2024-12-18T00:09:25.1790039Z  2024-12-18T00:09:25.1790438Z  2024-12-18T00:09:25.1791014Z [14,149 / 15,187] 48 actions, 47 running 2024-12-18T00:09:25.1791916Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:09:25.1792941Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:09:25.1793952Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:09:25.1795126Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:09:25.1796135Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2024-12-18T00:09:25.1797187Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2024-12-18T00:09:25.1798221Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2024-12-18T00:09:25.1799067Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:09:25.4641017Z 2024-12-18T00:09:25.4641824Z  2024-12-18T00:09:25.4642321Z  2024-12-18T00:09:25.4642770Z  2024-12-18T00:09:25.4643171Z  2024-12-18T00:09:25.4643588Z  2024-12-18T00:09:25.4644000Z  2024-12-18T00:09:25.4644644Z  2024-12-18T00:09:25.4645045Z  2024-12-18T00:09:25.4645625Z [14,149 / 15,187] 48 actions running 2024-12-18T00:09:25.4646813Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:09:25.4647902Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:09:25.4648861Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:09:25.4650033Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:09:25.4651301Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2024-12-18T00:09:25.4652247Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2024-12-18T00:09:25.4653172Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2024-12-18T00:09:25.4653926Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:09:25.9032729Z 2024-12-18T00:09:25.9033573Z  2024-12-18T00:09:25.9034048Z  2024-12-18T00:09:25.9034449Z  2024-12-18T00:09:25.9034819Z  2024-12-18T00:09:25.9035181Z  2024-12-18T00:09:25.9035616Z  2024-12-18T00:09:25.9035985Z  2024-12-18T00:09:25.9036360Z  2024-12-18T00:09:25.9036935Z [14,150 / 15,187] 48 actions, 47 running 2024-12-18T00:09:25.9037797Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:09:25.9038781Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:09:25.9039680Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:09:25.9040671Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:09:25.9041630Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:09:25.9042539Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2024-12-18T00:09:25.9043493Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2024-12-18T00:09:25.9044532Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:09:26.2648347Z 2024-12-18T00:09:26.2649239Z  2024-12-18T00:09:26.2649887Z  2024-12-18T00:09:26.2650309Z  2024-12-18T00:09:26.2650703Z  2024-12-18T00:09:26.2651075Z  2024-12-18T00:09:26.2651495Z  2024-12-18T00:09:26.2651898Z  2024-12-18T00:09:26.2652288Z  2024-12-18T00:09:26.2652859Z [14,151 / 15,187] 48 actions running 2024-12-18T00:09:26.2653698Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:09:26.2654705Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2024-12-18T00:09:26.2655719Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:09:26.2656950Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:09:26.2658242Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:09:26.2659261Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2024-12-18T00:09:26.2660342Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2024-12-18T00:09:26.2661227Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:09:26.9159181Z 2024-12-18T00:09:26.9160064Z  2024-12-18T00:09:26.9160553Z  2024-12-18T00:09:26.9160954Z  2024-12-18T00:09:26.9161325Z  2024-12-18T00:09:26.9161667Z  2024-12-18T00:09:26.9162016Z  2024-12-18T00:09:26.9162382Z  2024-12-18T00:09:26.9162744Z  2024-12-18T00:09:26.9163338Z [14,152 / 15,187] 48 actions, 47 running 2024-12-18T00:09:26.9164170Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:09:26.9165312Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2024-12-18T00:09:26.9166314Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:09:26.9167369Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:09:26.9168383Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:09:26.9169396Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2024-12-18T00:09:26.9170652Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2024-12-18T00:09:26.9171603Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:09:27.2657211Z 2024-12-18T00:09:27.2658045Z  2024-12-18T00:09:27.2658499Z  2024-12-18T00:09:27.2658880Z  2024-12-18T00:09:27.2659282Z  2024-12-18T00:09:27.2660007Z  2024-12-18T00:09:27.2660422Z  2024-12-18T00:09:27.2660948Z  2024-12-18T00:09:27.2661370Z  2024-12-18T00:09:27.2661967Z [14,153 / 15,187] 48 actions running 2024-12-18T00:09:27.2662897Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:09:27.2663989Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:09:27.2665032Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:09:27.2666101Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:09:27.2667109Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:09:27.2668092Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2024-12-18T00:09:27.2669010Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2024-12-18T00:09:27.2669850Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:27.5099316Z 2024-12-18T00:09:27.5100251Z  2024-12-18T00:09:27.5100696Z  2024-12-18T00:09:27.5101097Z  2024-12-18T00:09:27.5101462Z  2024-12-18T00:09:27.5101867Z  2024-12-18T00:09:27.5102220Z  2024-12-18T00:09:27.5102620Z  2024-12-18T00:09:27.5103036Z  2024-12-18T00:09:27.5103663Z [14,154 / 15,187] 48 actions, 47 running 2024-12-18T00:09:27.5104583Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:09:27.5105624Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:09:27.5106670Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:09:27.5107800Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:09:27.5108854Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:09:27.5109852Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 16s local 2024-12-18T00:09:27.5110863Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2024-12-18T00:09:27.5111743Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:27.8664032Z 2024-12-18T00:09:27.8664880Z  2024-12-18T00:09:27.8665349Z  2024-12-18T00:09:27.8665747Z  2024-12-18T00:09:27.8666162Z  2024-12-18T00:09:27.8666877Z  2024-12-18T00:09:27.8667303Z  2024-12-18T00:09:27.8667709Z  2024-12-18T00:09:27.8668117Z  2024-12-18T00:09:27.8668692Z [14,155 / 15,187] 48 actions running 2024-12-18T00:09:27.8669651Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:09:27.8670758Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:09:27.8671743Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:09:27.8672850Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:09:27.8673910Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:09:27.8674819Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2024-12-18T00:09:27.8675781Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2024-12-18T00:09:27.8676786Z @llvm-project//mlir:ControlFlowDialect; 12s local ... 2024-12-18T00:09:28.2138390Z 2024-12-18T00:09:28.2139261Z  2024-12-18T00:09:28.2139758Z  2024-12-18T00:09:28.2140164Z  2024-12-18T00:09:28.2140579Z  2024-12-18T00:09:28.2140969Z  2024-12-18T00:09:28.2141381Z  2024-12-18T00:09:28.2141781Z  2024-12-18T00:09:28.2142201Z  2024-12-18T00:09:28.2143035Z [14,157 / 15,187] 48 actions, 47 running 2024-12-18T00:09:28.2143971Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:09:28.2145296Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:09:28.2146307Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:09:28.2147648Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:09:28.2148703Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:09:28.2149517Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2024-12-18T00:09:28.2150751Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2024-12-18T00:09:28.2151931Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local ... 2024-12-18T00:09:28.4669892Z 2024-12-18T00:09:28.4670866Z  2024-12-18T00:09:28.4671355Z  2024-12-18T00:09:28.4671763Z  2024-12-18T00:09:28.4672156Z  2024-12-18T00:09:28.4672524Z  2024-12-18T00:09:28.4672872Z  2024-12-18T00:09:28.4673251Z  2024-12-18T00:09:28.4673627Z  2024-12-18T00:09:28.4674208Z [14,158 / 15,187] 48 actions running 2024-12-18T00:09:28.4675104Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:09:28.4676123Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:09:28.4677114Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:09:28.4678163Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:09:28.4679144Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:09:28.4680010Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2024-12-18T00:09:28.4680985Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2024-12-18T00:09:28.4682113Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local ... 2024-12-18T00:09:28.6672385Z 2024-12-18T00:09:28.6673246Z  2024-12-18T00:09:28.6673722Z  2024-12-18T00:09:28.6674114Z  2024-12-18T00:09:28.6674503Z  2024-12-18T00:09:28.6674876Z  2024-12-18T00:09:28.6675268Z  2024-12-18T00:09:28.6675660Z  2024-12-18T00:09:28.6676069Z  2024-12-18T00:09:28.6676592Z [14,160 / 15,187] 48 actions running 2024-12-18T00:09:28.6677473Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:09:28.6678324Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:09:28.6679247Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:09:28.6680211Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:09:28.6681411Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2024-12-18T00:09:28.6682213Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2024-12-18T00:09:28.6683169Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2024-12-18T00:09:28.6684265Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local ... 2024-12-18T00:09:29.0677575Z 2024-12-18T00:09:29.0678472Z  2024-12-18T00:09:29.0679007Z  2024-12-18T00:09:29.0679411Z  2024-12-18T00:09:29.0679821Z  2024-12-18T00:09:29.0680272Z  2024-12-18T00:09:29.0680738Z  2024-12-18T00:09:29.0681118Z  2024-12-18T00:09:29.0681516Z  2024-12-18T00:09:29.0682210Z [14,161 / 15,187] 48 actions running 2024-12-18T00:09:29.0683090Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:09:29.0684106Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:09:29.0685071Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:09:29.0686113Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:09:29.0687070Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2024-12-18T00:09:29.0688206Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2024-12-18T00:09:29.0689163Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2024-12-18T00:09:29.0690137Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local ... 2024-12-18T00:09:29.2684219Z 2024-12-18T00:09:29.2685069Z  2024-12-18T00:09:29.2685995Z  2024-12-18T00:09:29.2686405Z  2024-12-18T00:09:29.2686786Z  2024-12-18T00:09:29.2687174Z  2024-12-18T00:09:29.2687561Z  2024-12-18T00:09:29.2687948Z  2024-12-18T00:09:29.2688328Z  2024-12-18T00:09:29.2688881Z [14,162 / 15,187] 48 actions running 2024-12-18T00:09:29.2689773Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:09:29.2690842Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:09:29.2691816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:09:29.2692928Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:09:29.2693861Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2024-12-18T00:09:29.2694619Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2024-12-18T00:09:29.2695532Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2024-12-18T00:09:29.2696602Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local ... 2024-12-18T00:09:29.6689947Z 2024-12-18T00:09:29.6690851Z  2024-12-18T00:09:29.6691335Z  2024-12-18T00:09:29.6691729Z  2024-12-18T00:09:29.6692131Z  2024-12-18T00:09:29.6692495Z  2024-12-18T00:09:29.6692907Z  2024-12-18T00:09:29.6693318Z  2024-12-18T00:09:29.6693698Z  2024-12-18T00:09:29.6694260Z [14,163 / 15,187] 48 actions running 2024-12-18T00:09:29.6695084Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:09:29.6696024Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:09:29.6697103Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:09:29.6698119Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:09:29.6699073Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:09:29.6699790Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2024-12-18T00:09:29.6700701Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2024-12-18T00:09:29.6701627Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local ... 2024-12-18T00:09:29.9321329Z 2024-12-18T00:09:29.9322177Z  2024-12-18T00:09:29.9322614Z  2024-12-18T00:09:29.9323240Z  2024-12-18T00:09:29.9323611Z  2024-12-18T00:09:29.9323989Z  2024-12-18T00:09:29.9324359Z  2024-12-18T00:09:29.9324731Z  2024-12-18T00:09:29.9325109Z  2024-12-18T00:09:29.9325674Z [14,165 / 15,187] 48 actions, 47 running 2024-12-18T00:09:29.9326479Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:09:29.9327383Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:09:29.9328234Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2024-12-18T00:09:29.9329164Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:09:29.9330048Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:09:29.9330793Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:09:29.9331610Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2024-12-18T00:09:29.9332443Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local ... 2024-12-18T00:09:30.1449397Z 2024-12-18T00:09:30.1450189Z  2024-12-18T00:09:30.1450591Z  2024-12-18T00:09:30.1450951Z  2024-12-18T00:09:30.1451311Z  2024-12-18T00:09:30.1451676Z  2024-12-18T00:09:30.1452274Z  2024-12-18T00:09:30.1452614Z  2024-12-18T00:09:30.1452968Z  2024-12-18T00:09:30.1453494Z [14,166 / 15,187] 48 actions, 47 running 2024-12-18T00:09:30.1454274Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:09:30.1455284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:09:30.1456322Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2024-12-18T00:09:30.1457464Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:09:30.1458314Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:09:30.1459066Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:09:30.1459869Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2024-12-18T00:09:30.1460675Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local ... 2024-12-18T00:09:30.4698047Z 2024-12-18T00:09:30.4698901Z  2024-12-18T00:09:30.4699408Z  2024-12-18T00:09:30.4699820Z  2024-12-18T00:09:30.4700204Z  2024-12-18T00:09:30.4700574Z  2024-12-18T00:09:30.4700943Z  2024-12-18T00:09:30.4701319Z  2024-12-18T00:09:30.4701705Z  2024-12-18T00:09:30.4702279Z [14,167 / 15,187] 48 actions running 2024-12-18T00:09:30.4703205Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:09:30.4704105Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:09:30.4705158Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2024-12-18T00:09:30.4706142Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:09:30.4707111Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:09:30.4707956Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:09:30.4708836Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2024-12-18T00:09:30.4709727Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local ... 2024-12-18T00:09:30.8703070Z 2024-12-18T00:09:30.8703930Z  2024-12-18T00:09:30.8704457Z  2024-12-18T00:09:30.8704832Z  2024-12-18T00:09:30.8705228Z  2024-12-18T00:09:30.8705613Z  2024-12-18T00:09:30.8706004Z  2024-12-18T00:09:30.8706378Z  2024-12-18T00:09:30.8706757Z  2024-12-18T00:09:30.8707354Z [14,168 / 15,187] 48 actions running 2024-12-18T00:09:30.8708247Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:09:30.8709236Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:09:30.8710236Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:09:30.8711695Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:09:30.8712615Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:09:30.8713449Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:09:30.8714382Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2024-12-18T00:09:30.8715345Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local ... 2024-12-18T00:09:31.0707479Z 2024-12-18T00:09:31.0708343Z  2024-12-18T00:09:31.0708817Z  2024-12-18T00:09:31.0709251Z  2024-12-18T00:09:31.0709651Z  2024-12-18T00:09:31.0721244Z  2024-12-18T00:09:31.0722006Z  2024-12-18T00:09:31.0722392Z  2024-12-18T00:09:31.0722724Z  2024-12-18T00:09:31.0723419Z [14,170 / 15,187] 48 actions running 2024-12-18T00:09:31.0724352Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:09:31.0725263Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:09:31.0726159Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:09:31.0727241Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:09:31.0728419Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:09:31.0729223Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:09:31.0730091Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2024-12-18T00:09:31.0731027Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local ... 2024-12-18T00:09:31.4846417Z 2024-12-18T00:09:31.4847581Z  2024-12-18T00:09:31.4848111Z  2024-12-18T00:09:31.4848493Z  2024-12-18T00:09:31.4848874Z  2024-12-18T00:09:31.4849221Z  2024-12-18T00:09:31.4849538Z  2024-12-18T00:09:31.4849921Z  2024-12-18T00:09:31.4850314Z  2024-12-18T00:09:31.4850869Z [14,171 / 15,187] 48 actions, 47 running 2024-12-18T00:09:31.4851714Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:09:31.4852698Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:09:31.4853663Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:09:31.4854657Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:09:31.4855578Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:09:31.4856322Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:09:31.4857559Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2024-12-18T00:09:31.4858475Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local ... 2024-12-18T00:09:31.8715208Z 2024-12-18T00:09:31.8716085Z  2024-12-18T00:09:31.8716525Z  2024-12-18T00:09:31.8716914Z  2024-12-18T00:09:31.8717310Z  2024-12-18T00:09:31.8717715Z  2024-12-18T00:09:31.8718128Z  2024-12-18T00:09:31.8718513Z  2024-12-18T00:09:31.8718887Z  2024-12-18T00:09:31.8719389Z [14,172 / 15,187] 48 actions running 2024-12-18T00:09:31.8720237Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:09:31.8721238Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:09:31.8722156Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:09:31.8723091Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:09:31.8724064Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:09:31.8724913Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:09:31.8725750Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2024-12-18T00:09:31.8726616Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local ... 2024-12-18T00:09:32.2472420Z 2024-12-18T00:09:32.2473493Z  2024-12-18T00:09:32.2473990Z  2024-12-18T00:09:32.2474408Z  2024-12-18T00:09:32.2474784Z  2024-12-18T00:09:32.2475201Z  2024-12-18T00:09:32.2475585Z  2024-12-18T00:09:32.2475982Z  2024-12-18T00:09:32.2476357Z  2024-12-18T00:09:32.2476999Z [14,173 / 15,187] 48 actions, 47 running 2024-12-18T00:09:32.2477888Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:09:32.2478870Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:09:32.2479862Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:09:32.2480897Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:09:32.2481851Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:09:32.2482719Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:09:32.2483696Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2024-12-18T00:09:32.2484666Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local ... 2024-12-18T00:09:32.4720812Z 2024-12-18T00:09:32.4721824Z  2024-12-18T00:09:32.4722306Z  2024-12-18T00:09:32.4722712Z  2024-12-18T00:09:32.4723087Z  2024-12-18T00:09:32.4723723Z  2024-12-18T00:09:32.4724085Z  2024-12-18T00:09:32.4724439Z  2024-12-18T00:09:32.4724817Z  2024-12-18T00:09:32.4725341Z [14,175 / 15,187] 48 actions running 2024-12-18T00:09:32.4726215Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:09:32.4727180Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:09:32.4728372Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:09:32.4729401Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:09:32.4730315Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:09:32.4731093Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:09:32.4731972Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2024-12-18T00:09:32.4732901Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local ... 2024-12-18T00:09:32.6724835Z 2024-12-18T00:09:32.6725721Z  2024-12-18T00:09:32.6726228Z  2024-12-18T00:09:32.6726569Z  2024-12-18T00:09:32.6726960Z  2024-12-18T00:09:32.6727355Z  2024-12-18T00:09:32.6727748Z  2024-12-18T00:09:32.6728121Z  2024-12-18T00:09:32.6728487Z  2024-12-18T00:09:32.6729037Z [14,177 / 15,187] 48 actions running 2024-12-18T00:09:32.6729925Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:09:32.6730947Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:09:32.6731907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:09:32.6732925Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:09:32.6733900Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:09:32.6734692Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:09:32.6735788Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2024-12-18T00:09:32.6736966Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local ... 2024-12-18T00:09:32.9246832Z 2024-12-18T00:09:32.9247704Z  2024-12-18T00:09:32.9248193Z  2024-12-18T00:09:32.9248600Z  2024-12-18T00:09:32.9248994Z  2024-12-18T00:09:32.9249392Z  2024-12-18T00:09:32.9249775Z  2024-12-18T00:09:32.9250181Z  2024-12-18T00:09:32.9250613Z  2024-12-18T00:09:32.9251233Z [14,179 / 15,187] 48 actions, 47 running 2024-12-18T00:09:32.9252175Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2024-12-18T00:09:32.9253231Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:09:32.9254456Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2024-12-18T00:09:32.9255597Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:09:32.9256764Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:09:32.9257712Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:09:32.9258684Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2024-12-18T00:09:32.9259693Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local ... 2024-12-18T00:09:33.2731194Z 2024-12-18T00:09:33.2732114Z  2024-12-18T00:09:33.2732598Z  2024-12-18T00:09:33.2732999Z  2024-12-18T00:09:33.2733444Z  2024-12-18T00:09:33.2733847Z  2024-12-18T00:09:33.2734242Z  2024-12-18T00:09:33.2734634Z  2024-12-18T00:09:33.2735033Z  2024-12-18T00:09:33.2735618Z [14,181 / 15,187] 48 actions running 2024-12-18T00:09:33.2736680Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2024-12-18T00:09:33.2737671Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:09:33.2738629Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2024-12-18T00:09:33.2739682Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2024-12-18T00:09:33.2740928Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:09:33.2741787Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:09:33.2742667Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2024-12-18T00:09:33.2743608Z Compiling xla/service/while_loop_simplifier.cc; 17s local ... 2024-12-18T00:09:34.2740441Z 2024-12-18T00:09:34.2741280Z  2024-12-18T00:09:34.2741696Z  2024-12-18T00:09:34.2742032Z  2024-12-18T00:09:34.2742368Z  2024-12-18T00:09:34.2742686Z  2024-12-18T00:09:34.2743011Z  2024-12-18T00:09:34.2743343Z  2024-12-18T00:09:34.2743674Z  2024-12-18T00:09:34.2744377Z [14,181 / 15,187] 48 actions running 2024-12-18T00:09:34.2745126Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:09:34.2745968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 40s local 2024-12-18T00:09:34.2746809Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:09:34.2747701Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:09:34.2748529Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:09:34.2749242Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:09:34.2749985Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2024-12-18T00:09:34.2750724Z Compiling xla/service/while_loop_simplifier.cc; 18s local ... 2024-12-18T00:09:34.4745568Z 2024-12-18T00:09:34.4746403Z  2024-12-18T00:09:34.4746792Z  2024-12-18T00:09:34.4747109Z  2024-12-18T00:09:34.4747404Z  2024-12-18T00:09:34.4747756Z  2024-12-18T00:09:34.4748067Z  2024-12-18T00:09:34.4748377Z  2024-12-18T00:09:34.4748678Z  2024-12-18T00:09:34.4749132Z [14,182 / 15,187] 48 actions running 2024-12-18T00:09:34.4749787Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:09:34.4750540Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 40s local 2024-12-18T00:09:34.4751244Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:09:34.4751996Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:09:34.4752870Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:09:34.4753527Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:09:34.4754184Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2024-12-18T00:09:34.4754881Z Compiling xla/service/while_loop_simplifier.cc; 18s local ... 2024-12-18T00:09:34.6890339Z 2024-12-18T00:09:34.6891212Z  2024-12-18T00:09:34.6891697Z  2024-12-18T00:09:34.6892089Z  2024-12-18T00:09:34.6892466Z  2024-12-18T00:09:34.6892857Z  2024-12-18T00:09:34.6893255Z  2024-12-18T00:09:34.6893640Z  2024-12-18T00:09:34.6894047Z  2024-12-18T00:09:34.6894629Z [14,185 / 15,187] 48 actions, 47 running 2024-12-18T00:09:34.6895490Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:09:34.6896627Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:09:34.6897701Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:09:34.6898684Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:09:34.6899520Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:09:34.6900413Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2024-12-18T00:09:34.6901278Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2024-12-18T00:09:34.6902261Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local ... 2024-12-18T00:09:35.0156394Z 2024-12-18T00:09:35.0157248Z  2024-12-18T00:09:35.0157719Z  2024-12-18T00:09:35.0158103Z  2024-12-18T00:09:35.0158835Z  2024-12-18T00:09:35.0159227Z  2024-12-18T00:09:35.0159575Z  2024-12-18T00:09:35.0159944Z  2024-12-18T00:09:35.0160293Z  2024-12-18T00:09:35.0160908Z [14,186 / 15,187] 48 actions, 47 running 2024-12-18T00:09:35.0161761Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:09:35.0163231Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:09:35.0164259Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:09:35.0165194Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:09:35.0166021Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:09:35.0166899Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2024-12-18T00:09:35.0167702Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:09:35.0168530Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local ... 2024-12-18T00:09:35.2166965Z 2024-12-18T00:09:35.2167870Z  2024-12-18T00:09:35.2168325Z  2024-12-18T00:09:35.2168674Z  2024-12-18T00:09:35.2169087Z  2024-12-18T00:09:35.2169477Z  2024-12-18T00:09:35.2169860Z  2024-12-18T00:09:35.2170212Z  2024-12-18T00:09:35.2170603Z  2024-12-18T00:09:35.2171196Z [14,188 / 15,187] 48 actions, 47 running 2024-12-18T00:09:35.2172120Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:09:35.2173121Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:09:35.2174128Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:09:35.2175258Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:09:35.2176148Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:09:35.2177148Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2024-12-18T00:09:35.2178056Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:09:35.2178961Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local ... 2024-12-18T00:09:35.4175989Z 2024-12-18T00:09:35.4176979Z  2024-12-18T00:09:35.4177426Z  2024-12-18T00:09:35.4177834Z  2024-12-18T00:09:35.4178192Z  2024-12-18T00:09:35.4178571Z  2024-12-18T00:09:35.4178936Z  2024-12-18T00:09:35.4179366Z  2024-12-18T00:09:35.4179729Z  2024-12-18T00:09:35.4180323Z [14,191 / 15,187] 48 actions, 47 running 2024-12-18T00:09:35.4181206Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:09:35.4182219Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:09:35.4183567Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:09:35.4184559Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:09:35.4185452Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:09:35.4186356Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2024-12-18T00:09:35.4187241Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:09:35.4188172Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local ... 2024-12-18T00:09:35.6755101Z 2024-12-18T00:09:35.6755988Z  2024-12-18T00:09:35.6756483Z  2024-12-18T00:09:35.6756928Z  2024-12-18T00:09:35.6757335Z  2024-12-18T00:09:35.6757724Z  2024-12-18T00:09:35.6758135Z  2024-12-18T00:09:35.6758525Z  2024-12-18T00:09:35.6758929Z  2024-12-18T00:09:35.6759525Z [14,191 / 15,187] 48 actions running 2024-12-18T00:09:35.6760460Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:09:35.6761554Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:09:35.6762647Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:09:35.6763927Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:09:35.6764839Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:09:35.6765777Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2024-12-18T00:09:35.6766690Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:09:35.6767932Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local ... 2024-12-18T00:09:35.9496613Z 2024-12-18T00:09:35.9497467Z  2024-12-18T00:09:35.9497938Z  2024-12-18T00:09:35.9498308Z  2024-12-18T00:09:35.9498658Z  2024-12-18T00:09:35.9499015Z  2024-12-18T00:09:35.9499346Z  2024-12-18T00:09:35.9499698Z  2024-12-18T00:09:35.9500103Z  2024-12-18T00:09:35.9500648Z [14,193 / 15,187] 48 actions, 47 running 2024-12-18T00:09:35.9501478Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:09:35.9502384Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:09:35.9503333Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:09:35.9504250Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:09:35.9505238Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:09:35.9505940Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2024-12-18T00:09:35.9506647Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:09:35.9507372Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local ... 2024-12-18T00:09:36.2125438Z 2024-12-18T00:09:36.2126439Z  2024-12-18T00:09:36.2126909Z  2024-12-18T00:09:36.2127269Z  2024-12-18T00:09:36.2127676Z  2024-12-18T00:09:36.2128041Z  2024-12-18T00:09:36.2128398Z  2024-12-18T00:09:36.2128727Z  2024-12-18T00:09:36.2129127Z  2024-12-18T00:09:36.2129752Z [14,194 / 15,187] 48 actions, 47 running 2024-12-18T00:09:36.2130690Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:09:36.2131755Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:09:36.2132882Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:09:36.2133946Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:09:36.2134902Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:09:36.2135870Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2024-12-18T00:09:36.2137026Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:09:36.2138065Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local ... 2024-12-18T00:09:36.4175294Z 2024-12-18T00:09:36.4176167Z  2024-12-18T00:09:36.4176708Z  2024-12-18T00:09:36.4177063Z  2024-12-18T00:09:36.4177420Z  2024-12-18T00:09:36.4177780Z  2024-12-18T00:09:36.4178118Z  2024-12-18T00:09:36.4178473Z  2024-12-18T00:09:36.4178855Z  2024-12-18T00:09:36.4179402Z [14,196 / 15,187] 48 actions, 47 running 2024-12-18T00:09:36.4180338Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:09:36.4181223Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:09:36.4182131Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:09:36.4182989Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:09:36.4183733Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:09:36.4184496Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2024-12-18T00:09:36.4185270Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:09:36.4186083Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local ... 2024-12-18T00:09:36.6762373Z 2024-12-18T00:09:36.6763274Z  2024-12-18T00:09:36.6763684Z  2024-12-18T00:09:36.6764006Z  2024-12-18T00:09:36.6764642Z  2024-12-18T00:09:36.6764972Z  2024-12-18T00:09:36.6765301Z  2024-12-18T00:09:36.6765613Z  2024-12-18T00:09:36.6765949Z  2024-12-18T00:09:36.6766438Z [14,197 / 15,187] 48 actions running 2024-12-18T00:09:36.6767188Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:09:36.6768308Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:09:36.6769203Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:09:36.6769998Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:09:36.6770705Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:09:36.6771453Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2024-12-18T00:09:36.6772178Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:09:36.6772955Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local ... 2024-12-18T00:09:36.9510030Z 2024-12-18T00:09:36.9510892Z  2024-12-18T00:09:36.9511305Z  2024-12-18T00:09:36.9511673Z  2024-12-18T00:09:36.9512040Z  2024-12-18T00:09:36.9512412Z  2024-12-18T00:09:36.9512751Z  2024-12-18T00:09:36.9513105Z  2024-12-18T00:09:36.9513459Z  2024-12-18T00:09:36.9514030Z [14,198 / 15,187] 48 actions, 47 running 2024-12-18T00:09:36.9514907Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:09:36.9515845Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:09:36.9516807Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:09:36.9517725Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:09:36.9518528Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:09:36.9519360Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2024-12-18T00:09:36.9520184Z Compiling xla/service/while_loop_simplifier.cc; 21s local 2024-12-18T00:09:36.9521046Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local ... 2024-12-18T00:09:37.2768080Z 2024-12-18T00:09:37.2769008Z  2024-12-18T00:09:37.2769452Z  2024-12-18T00:09:37.2769801Z  2024-12-18T00:09:37.2770154Z  2024-12-18T00:09:37.2770512Z  2024-12-18T00:09:37.2770863Z  2024-12-18T00:09:37.2771238Z  2024-12-18T00:09:37.2771600Z  2024-12-18T00:09:37.2772143Z [14,199 / 15,187] 48 actions running 2024-12-18T00:09:37.2772938Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:09:37.2773860Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:09:37.2775063Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:09:37.2775934Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:09:37.2776870Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:09:37.2777664Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2024-12-18T00:09:37.2778465Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:09:37.2779487Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local ... 2024-12-18T00:09:37.6116249Z 2024-12-18T00:09:37.6117093Z  2024-12-18T00:09:37.6117637Z  2024-12-18T00:09:37.6118045Z  2024-12-18T00:09:37.6118409Z  2024-12-18T00:09:37.6118774Z  2024-12-18T00:09:37.6119117Z  2024-12-18T00:09:37.6119481Z  2024-12-18T00:09:37.6119832Z  2024-12-18T00:09:37.6120377Z [14,200 / 15,187] 48 actions, 47 running 2024-12-18T00:09:37.6121193Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:09:37.6122121Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:09:37.6123083Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:09:37.6124223Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:09:37.6124997Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:09:37.6125795Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2024-12-18T00:09:37.6126619Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:09:37.6127781Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local ... 2024-12-18T00:09:37.8773983Z 2024-12-18T00:09:37.8774856Z  2024-12-18T00:09:37.8775266Z  2024-12-18T00:09:37.8775589Z  2024-12-18T00:09:37.8775924Z  2024-12-18T00:09:37.8776263Z  2024-12-18T00:09:37.8776725Z  2024-12-18T00:09:37.8777063Z  2024-12-18T00:09:37.8777415Z  2024-12-18T00:09:37.8777901Z [14,201 / 15,187] 48 actions running 2024-12-18T00:09:37.8778650Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:09:37.8779533Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:09:37.8780434Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:09:37.8781247Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:09:37.8782133Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:09:37.8782894Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2024-12-18T00:09:37.8783694Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:09:37.8784558Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local ... 2024-12-18T00:09:38.2815701Z 2024-12-18T00:09:38.2816775Z  2024-12-18T00:09:38.2817278Z  2024-12-18T00:09:38.2817662Z  2024-12-18T00:09:38.2818078Z  2024-12-18T00:09:38.2818452Z  2024-12-18T00:09:38.2818851Z  2024-12-18T00:09:38.2819260Z  2024-12-18T00:09:38.2819653Z  2024-12-18T00:09:38.2820254Z [14,202 / 15,187] 48 actions, 47 running 2024-12-18T00:09:38.2821133Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:09:38.2822077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:09:38.2823032Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:09:38.2823949Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:09:38.2824780Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:09:38.2825723Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2024-12-18T00:09:38.2826520Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:09:38.2827440Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local ... 2024-12-18T00:09:38.5246416Z 2024-12-18T00:09:38.5247251Z  2024-12-18T00:09:38.5247649Z  2024-12-18T00:09:38.5247977Z  2024-12-18T00:09:38.5248276Z  2024-12-18T00:09:38.5248594Z  2024-12-18T00:09:38.5248914Z  2024-12-18T00:09:38.5249266Z  2024-12-18T00:09:38.5249570Z  2024-12-18T00:09:38.5250068Z [14,205 / 15,187] 48 actions, 47 running 2024-12-18T00:09:38.5250771Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:09:38.5251555Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:09:38.5252385Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:09:38.5253128Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:09:38.5253776Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:09:38.5254447Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2024-12-18T00:09:38.5255144Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:09:38.5255909Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local ... 2024-12-18T00:09:38.8782297Z 2024-12-18T00:09:38.8783141Z  2024-12-18T00:09:38.8783636Z  2024-12-18T00:09:38.8784304Z  2024-12-18T00:09:38.8784732Z  2024-12-18T00:09:38.8785142Z  2024-12-18T00:09:38.8785565Z  2024-12-18T00:09:38.8785987Z  2024-12-18T00:09:38.8786407Z  2024-12-18T00:09:38.8786982Z [14,205 / 15,187] 48 actions running 2024-12-18T00:09:38.8787935Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:09:38.8789263Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:09:38.8790428Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:09:38.8791490Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:09:38.8792432Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:09:38.8793371Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2024-12-18T00:09:38.8794333Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:09:38.8795425Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local ... 2024-12-18T00:09:39.1196805Z 2024-12-18T00:09:39.1197651Z  2024-12-18T00:09:39.1198139Z  2024-12-18T00:09:39.1198677Z  2024-12-18T00:09:39.1199073Z  2024-12-18T00:09:39.1199487Z  2024-12-18T00:09:39.1199902Z  2024-12-18T00:09:39.1200313Z  2024-12-18T00:09:39.1200665Z  2024-12-18T00:09:39.1201243Z [14,206 / 15,187] 48 actions, 47 running 2024-12-18T00:09:39.1202193Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:09:39.1203225Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:09:39.1204265Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:09:39.1205195Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:09:39.1206028Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:09:39.1206949Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:09:39.1207924Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2024-12-18T00:09:39.1208837Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:09:39.4788353Z 2024-12-18T00:09:39.4789261Z  2024-12-18T00:09:39.4789765Z  2024-12-18T00:09:39.4790180Z  2024-12-18T00:09:39.4790587Z  2024-12-18T00:09:39.4790993Z  2024-12-18T00:09:39.4791434Z  2024-12-18T00:09:39.4791852Z  2024-12-18T00:09:39.4792267Z  2024-12-18T00:09:39.4792841Z [14,206 / 15,187] 48 actions running 2024-12-18T00:09:39.4793774Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:09:39.4794816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:09:39.4796151Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:09:39.4797146Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:09:39.4797997Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:09:39.4798909Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:09:39.4799870Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2024-12-18T00:09:39.4800824Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:09:39.8793197Z 2024-12-18T00:09:39.8794080Z  2024-12-18T00:09:39.8794503Z  2024-12-18T00:09:39.8794921Z  2024-12-18T00:09:39.8795309Z  2024-12-18T00:09:39.8795673Z  2024-12-18T00:09:39.8796044Z  2024-12-18T00:09:39.8796416Z  2024-12-18T00:09:39.8796807Z  2024-12-18T00:09:39.8797354Z [14,207 / 15,187] 48 actions running 2024-12-18T00:09:39.8798258Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:09:39.8799268Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:09:39.8800262Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:09:39.8801490Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:09:39.8802290Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:09:39.8803172Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:09:39.8804072Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2024-12-18T00:09:39.8805226Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:40.5577701Z 2024-12-18T00:09:40.5578567Z  2024-12-18T00:09:40.5579036Z  2024-12-18T00:09:40.5579409Z  2024-12-18T00:09:40.5579757Z  2024-12-18T00:09:40.5580123Z  2024-12-18T00:09:40.5580505Z  2024-12-18T00:09:40.5580873Z  2024-12-18T00:09:40.5581276Z  2024-12-18T00:09:40.5581845Z [14,208 / 15,187] 48 actions, 47 running 2024-12-18T00:09:40.5582730Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:09:40.5583731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:09:40.5584989Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:09:40.5586099Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:09:40.5586943Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:09:40.5587806Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:09:40.5588783Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2024-12-18T00:09:40.5589690Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:40.8802953Z 2024-12-18T00:09:40.8803875Z  2024-12-18T00:09:40.8804348Z  2024-12-18T00:09:40.8804751Z  2024-12-18T00:09:40.8805182Z  2024-12-18T00:09:40.8805585Z  2024-12-18T00:09:40.8805966Z  2024-12-18T00:09:40.8806362Z  2024-12-18T00:09:40.8806761Z  2024-12-18T00:09:40.8807318Z [14,209 / 15,187] 48 actions running 2024-12-18T00:09:40.8808217Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:09:40.8809278Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2024-12-18T00:09:40.8810394Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:09:40.8811372Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:09:40.8812371Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:09:40.8813245Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:09:40.8814227Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2024-12-18T00:09:40.8815074Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:09:41.8811677Z 2024-12-18T00:09:41.8812687Z  2024-12-18T00:09:41.8813179Z  2024-12-18T00:09:41.8813615Z  2024-12-18T00:09:41.8814107Z  2024-12-18T00:09:41.8814608Z  2024-12-18T00:09:41.8815016Z  2024-12-18T00:09:41.8815488Z  2024-12-18T00:09:41.8815878Z  2024-12-18T00:09:41.8816579Z [14,209 / 15,187] 48 actions running 2024-12-18T00:09:41.8817461Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:09:41.8818481Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:09:41.8819537Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:09:41.8820507Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:09:41.8821276Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:09:41.8822104Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:09:41.8823008Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2024-12-18T00:09:41.8823908Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:42.0816407Z 2024-12-18T00:09:42.0817264Z  2024-12-18T00:09:42.0817730Z  2024-12-18T00:09:42.0818081Z  2024-12-18T00:09:42.0818822Z  2024-12-18T00:09:42.0819222Z  2024-12-18T00:09:42.0819614Z  2024-12-18T00:09:42.0819994Z  2024-12-18T00:09:42.0820354Z  2024-12-18T00:09:42.0820904Z [14,210 / 15,187] 48 actions running 2024-12-18T00:09:42.0821761Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:09:42.0823073Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:09:42.0824149Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:09:42.0825112Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:09:42.0825929Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:09:42.0826812Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:09:42.0827727Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2024-12-18T00:09:42.0828613Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:09:42.3248267Z 2024-12-18T00:09:42.3249164Z  2024-12-18T00:09:42.3249631Z  2024-12-18T00:09:42.3250000Z  2024-12-18T00:09:42.3250355Z  2024-12-18T00:09:42.3250712Z  2024-12-18T00:09:42.3251064Z  2024-12-18T00:09:42.3251431Z  2024-12-18T00:09:42.3251798Z  2024-12-18T00:09:42.3252354Z [14,212 / 15,187] 48 actions, 47 running 2024-12-18T00:09:42.3253227Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:09:42.3254179Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:09:42.3255157Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:09:42.3256226Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:09:42.3257184Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:09:42.3257949Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:09:42.3258671Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:09:42.3259354Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:09:42.5967068Z 2024-12-18T00:09:42.5967999Z  2024-12-18T00:09:42.5968489Z  2024-12-18T00:09:42.5968933Z  2024-12-18T00:09:42.5969318Z  2024-12-18T00:09:42.5969720Z  2024-12-18T00:09:42.5970085Z  2024-12-18T00:09:42.5970503Z  2024-12-18T00:09:42.5971020Z  2024-12-18T00:09:42.5971599Z [14,214 / 15,187] 48 actions, 47 running 2024-12-18T00:09:42.5972460Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:09:42.5973407Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:09:42.5974664Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:09:42.5975547Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:09:42.5976495Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:09:42.5977360Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:09:42.5978315Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:09:42.5979307Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local ... 2024-12-18T00:09:42.8819728Z 2024-12-18T00:09:42.8820618Z  2024-12-18T00:09:42.8821026Z  2024-12-18T00:09:42.8821399Z  2024-12-18T00:09:42.8821731Z  2024-12-18T00:09:42.8822063Z  2024-12-18T00:09:42.8822408Z  2024-12-18T00:09:42.8822742Z  2024-12-18T00:09:42.8823088Z  2024-12-18T00:09:42.8823583Z [14,219 / 15,187] 48 actions running 2024-12-18T00:09:42.8824343Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:09:42.8825206Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:09:42.8826085Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:09:42.8827225Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:09:42.8827974Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:09:42.8828759Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:09:42.8829598Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:09:42.8830608Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:43.4736972Z 2024-12-18T00:09:43.4737844Z  2024-12-18T00:09:43.4738333Z  2024-12-18T00:09:43.4738737Z  2024-12-18T00:09:43.4739139Z  2024-12-18T00:09:43.4739505Z  2024-12-18T00:09:43.4739880Z  2024-12-18T00:09:43.4740252Z  2024-12-18T00:09:43.4740653Z  2024-12-18T00:09:43.4741218Z [14,220 / 15,187] 48 actions, 47 running 2024-12-18T00:09:43.4742078Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:09:43.4743114Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:09:43.4744527Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:09:43.4745492Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:09:43.4746527Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:09:43.4747630Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:09:43.4748868Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2024-12-18T00:09:43.4749811Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:43.6828589Z 2024-12-18T00:09:43.6829466Z  2024-12-18T00:09:43.6829898Z  2024-12-18T00:09:43.6830267Z  2024-12-18T00:09:43.6830675Z  2024-12-18T00:09:43.6831050Z  2024-12-18T00:09:43.6831412Z  2024-12-18T00:09:43.6831798Z  2024-12-18T00:09:43.6832176Z  2024-12-18T00:09:43.6832737Z [14,220 / 15,187] 48 actions running 2024-12-18T00:09:43.6833644Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:09:43.6834653Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:09:43.6835647Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:09:43.6836612Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:09:43.6837491Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:09:43.6838376Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:09:43.6839318Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2024-12-18T00:09:43.6840171Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:43.8833316Z 2024-12-18T00:09:43.8834345Z  2024-12-18T00:09:43.8834811Z  2024-12-18T00:09:43.8835185Z  2024-12-18T00:09:43.8835561Z  2024-12-18T00:09:43.8835901Z  2024-12-18T00:09:43.8836273Z  2024-12-18T00:09:43.8836642Z  2024-12-18T00:09:43.8837072Z  2024-12-18T00:09:43.8837611Z [14,222 / 15,187] 48 actions running 2024-12-18T00:09:43.8838487Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:09:43.8839549Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:09:43.8840857Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:09:43.8842084Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:09:43.8843069Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:09:43.8844110Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:09:43.8845498Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2024-12-18T00:09:43.8846395Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:09:44.3198407Z 2024-12-18T00:09:44.3199244Z  2024-12-18T00:09:44.3199681Z  2024-12-18T00:09:44.3200073Z  2024-12-18T00:09:44.3200760Z  2024-12-18T00:09:44.3201163Z  2024-12-18T00:09:44.3201538Z  2024-12-18T00:09:44.3201891Z  2024-12-18T00:09:44.3202294Z  2024-12-18T00:09:44.3202905Z [14,223 / 15,187] 48 actions, 47 running 2024-12-18T00:09:44.3203820Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:09:44.3205155Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:09:44.3206185Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:09:44.3207215Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:09:44.3208084Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:09:44.3209033Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:09:44.3209971Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 27s local 2024-12-18T00:09:44.3210842Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:09:44.6841415Z 2024-12-18T00:09:44.6842241Z  2024-12-18T00:09:44.6842698Z  2024-12-18T00:09:44.6843096Z  2024-12-18T00:09:44.6843479Z  2024-12-18T00:09:44.6843852Z  2024-12-18T00:09:44.6844451Z  2024-12-18T00:09:44.6844852Z  2024-12-18T00:09:44.6845211Z  2024-12-18T00:09:44.6845829Z [14,227 / 15,187] 48 actions, 47 running 2024-12-18T00:09:44.6846763Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:09:44.6847776Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:09:44.6848805Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:09:44.6849794Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:09:44.6850609Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:09:44.6851491Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:09:44.6852461Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 27s local 2024-12-18T00:09:44.6853351Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:09:44.8845524Z 2024-12-18T00:09:44.8846423Z  2024-12-18T00:09:44.8846909Z  2024-12-18T00:09:44.8847297Z  2024-12-18T00:09:44.8847725Z  2024-12-18T00:09:44.8848153Z  2024-12-18T00:09:44.8848564Z  2024-12-18T00:09:44.8848946Z  2024-12-18T00:09:44.8849351Z  2024-12-18T00:09:44.8849892Z [14,228 / 15,187] 48 actions running 2024-12-18T00:09:44.8850797Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:09:44.8851791Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:09:44.8853020Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:09:44.8854051Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:09:44.8854965Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:09:44.8855943Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 27s local 2024-12-18T00:09:44.8857160Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2024-12-18T00:09:44.8858234Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local ... 2024-12-18T00:09:45.5116949Z 2024-12-18T00:09:45.5117789Z  2024-12-18T00:09:45.5118260Z  2024-12-18T00:09:45.5118687Z  2024-12-18T00:09:45.5119055Z  2024-12-18T00:09:45.5119437Z  2024-12-18T00:09:45.5119828Z  2024-12-18T00:09:45.5120208Z  2024-12-18T00:09:45.5120577Z  2024-12-18T00:09:45.5121170Z [14,229 / 15,187] 48 actions, 47 running 2024-12-18T00:09:45.5122077Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:09:45.5123087Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:09:45.5124110Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:09:45.5125384Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:09:45.5126386Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:09:45.5127393Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2024-12-18T00:09:45.5128423Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2024-12-18T00:09:45.5129593Z .../memory_space_assignment:prefetch_interval_picker; 13s local ... 2024-12-18T00:09:45.8296818Z 2024-12-18T00:09:45.8297723Z  2024-12-18T00:09:45.8298206Z  2024-12-18T00:09:45.8298612Z  2024-12-18T00:09:45.8299017Z  2024-12-18T00:09:45.8299382Z  2024-12-18T00:09:45.8299752Z  2024-12-18T00:09:45.8300166Z  2024-12-18T00:09:45.8300563Z  2024-12-18T00:09:45.8301154Z [14,231 / 15,187] 48 actions, 47 running 2024-12-18T00:09:45.8302008Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:09:45.8303037Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:09:45.8304054Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:09:45.8304962Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:09:45.8305801Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:09:45.8306807Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:09:45.8307809Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2024-12-18T00:09:45.8308816Z .../memory_space_assignment:prefetch_interval_picker; 13s local ... 2024-12-18T00:09:46.0856725Z 2024-12-18T00:09:46.0857611Z  2024-12-18T00:09:46.0858077Z  2024-12-18T00:09:46.0858450Z  2024-12-18T00:09:46.0858825Z  2024-12-18T00:09:46.0859169Z  2024-12-18T00:09:46.0859512Z  2024-12-18T00:09:46.0859862Z  2024-12-18T00:09:46.0860210Z  2024-12-18T00:09:46.0860711Z [14,232 / 15,187] 48 actions running 2024-12-18T00:09:46.0861497Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:09:46.0862524Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:09:46.0863412Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:09:46.0864273Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:09:46.0865032Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:09:46.0865867Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:09:46.0866710Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2024-12-18T00:09:46.0867809Z .../memory_space_assignment:prefetch_interval_picker; 13s local ... 2024-12-18T00:09:46.3395158Z 2024-12-18T00:09:46.3396046Z  2024-12-18T00:09:46.3396513Z  2024-12-18T00:09:46.3396925Z  2024-12-18T00:09:46.3397326Z  2024-12-18T00:09:46.3397756Z  2024-12-18T00:09:46.3398144Z  2024-12-18T00:09:46.3398538Z  2024-12-18T00:09:46.3398920Z  2024-12-18T00:09:46.3410095Z [14,233 / 15,187] 48 actions, 47 running 2024-12-18T00:09:46.3411087Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:09:46.3412004Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:09:46.3412909Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:09:46.3413692Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:09:46.3414426Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:09:46.3415233Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:09:46.3419870Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2024-12-18T00:09:46.3420921Z .../memory_space_assignment:prefetch_interval_picker; 14s local ... 2024-12-18T00:09:46.5832762Z 2024-12-18T00:09:46.5833667Z  2024-12-18T00:09:46.5834102Z  2024-12-18T00:09:46.5834512Z  2024-12-18T00:09:46.5834915Z  2024-12-18T00:09:46.5835308Z  2024-12-18T00:09:46.5835688Z  2024-12-18T00:09:46.5836079Z  2024-12-18T00:09:46.5836465Z  2024-12-18T00:09:46.5837062Z [14,237 / 15,187] 48 actions, 47 running 2024-12-18T00:09:46.5838096Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:09:46.5839121Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:09:46.5840103Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:09:46.5841074Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:09:46.5841957Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:09:46.5843009Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:09:46.5843961Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2024-12-18T00:09:46.5845035Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local ... 2024-12-18T00:09:46.8395977Z 2024-12-18T00:09:46.8396825Z  2024-12-18T00:09:46.8397268Z  2024-12-18T00:09:46.8397621Z  2024-12-18T00:09:46.8397981Z  2024-12-18T00:09:46.8398352Z  2024-12-18T00:09:46.8398716Z  2024-12-18T00:09:46.8399083Z  2024-12-18T00:09:46.8399452Z  2024-12-18T00:09:46.8400023Z [14,240 / 15,187] 48 actions, 47 running 2024-12-18T00:09:46.8400885Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:09:46.8401847Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:09:46.8402819Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:09:46.8403897Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:09:46.8404744Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:09:46.8405708Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:09:46.8406674Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2024-12-18T00:09:46.8407640Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local ... 2024-12-18T00:09:47.0863607Z 2024-12-18T00:09:47.0864426Z  2024-12-18T00:09:47.0864902Z  2024-12-18T00:09:47.0865299Z  2024-12-18T00:09:47.0865689Z  2024-12-18T00:09:47.0866070Z  2024-12-18T00:09:47.0866441Z  2024-12-18T00:09:47.0866814Z  2024-12-18T00:09:47.0867199Z  2024-12-18T00:09:47.0867722Z [14,240 / 15,187] 48 actions running 2024-12-18T00:09:47.0868823Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:09:47.0869830Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:09:47.0870829Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:09:47.0871797Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:09:47.0872623Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:09:47.0873499Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:09:47.0874368Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2024-12-18T00:09:47.0875313Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local ... 2024-12-18T00:09:47.4871381Z 2024-12-18T00:09:47.4872372Z  2024-12-18T00:09:47.4872886Z  2024-12-18T00:09:47.4873358Z  2024-12-18T00:09:47.4873827Z  2024-12-18T00:09:47.4874265Z  2024-12-18T00:09:47.4874771Z  2024-12-18T00:09:47.4875195Z  2024-12-18T00:09:47.4875658Z  2024-12-18T00:09:47.4876640Z [14,241 / 15,187] 48 actions running 2024-12-18T00:09:47.4877593Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:09:47.4878817Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:09:47.4879927Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:09:47.4880926Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:09:47.4881837Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:09:47.4882982Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:09:47.4884037Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2024-12-18T00:09:47.4885116Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local ... 2024-12-18T00:09:47.7000483Z 2024-12-18T00:09:47.7001401Z  2024-12-18T00:09:47.7001838Z  2024-12-18T00:09:47.7002194Z  2024-12-18T00:09:47.7002555Z  2024-12-18T00:09:47.7002938Z  2024-12-18T00:09:47.7003299Z  2024-12-18T00:09:47.7003634Z  2024-12-18T00:09:47.7004006Z  2024-12-18T00:09:47.7004569Z [14,242 / 15,187] 48 actions, 47 running 2024-12-18T00:09:47.7005385Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:09:47.7006314Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:09:47.7007233Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:09:47.7008123Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:09:47.7008920Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:09:47.7009824Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:09:47.7010750Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2024-12-18T00:09:47.7011702Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local ... 2024-12-18T00:09:48.0876572Z 2024-12-18T00:09:48.0877428Z  2024-12-18T00:09:48.0877831Z  2024-12-18T00:09:48.0878199Z  2024-12-18T00:09:48.0878576Z  2024-12-18T00:09:48.0878934Z  2024-12-18T00:09:48.0879289Z  2024-12-18T00:09:48.0879641Z  2024-12-18T00:09:48.0879987Z  2024-12-18T00:09:48.0880520Z [14,243 / 15,187] 48 actions running 2024-12-18T00:09:48.0881314Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:09:48.0882365Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:09:48.0883279Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:09:48.0884121Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:09:48.0884891Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:09:48.0886006Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:09:48.0886900Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2024-12-18T00:09:48.0887764Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local ... 2024-12-18T00:09:48.3750899Z 2024-12-18T00:09:48.3751751Z  2024-12-18T00:09:48.3752216Z  2024-12-18T00:09:48.3752556Z  2024-12-18T00:09:48.3752897Z  2024-12-18T00:09:48.3753252Z  2024-12-18T00:09:48.3753595Z  2024-12-18T00:09:48.3753928Z  2024-12-18T00:09:48.3754246Z  2024-12-18T00:09:48.3754809Z [14,246 / 15,187] 48 actions, 47 running 2024-12-18T00:09:48.3755590Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:09:48.3756492Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:09:48.3757393Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:09:48.3758261Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:09:48.3759299Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:09:48.3760183Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:09:48.3761181Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2024-12-18T00:09:48.3762079Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local ... 2024-12-18T00:09:48.6882744Z 2024-12-18T00:09:48.6883591Z  2024-12-18T00:09:48.6884042Z  2024-12-18T00:09:48.6884422Z  2024-12-18T00:09:48.6884798Z  2024-12-18T00:09:48.6885165Z  2024-12-18T00:09:48.6885814Z  2024-12-18T00:09:48.6886201Z  2024-12-18T00:09:48.6886570Z  2024-12-18T00:09:48.6887103Z [14,246 / 15,187] 48 actions running 2024-12-18T00:09:48.6887930Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:09:48.6888901Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:09:48.6889914Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:09:48.6890815Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:09:48.6891635Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:09:48.6892540Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:09:48.6893494Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2024-12-18T00:09:48.6894448Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 16s local ... 2024-12-18T00:09:49.0739498Z 2024-12-18T00:09:49.0740409Z  2024-12-18T00:09:49.0740811Z  2024-12-18T00:09:49.0741155Z  2024-12-18T00:09:49.0741470Z  2024-12-18T00:09:49.0741797Z  2024-12-18T00:09:49.0742127Z  2024-12-18T00:09:49.0742456Z  2024-12-18T00:09:49.0742785Z  2024-12-18T00:09:49.0743282Z [14,247 / 15,187] 48 actions, 47 running 2024-12-18T00:09:49.0744020Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:09:49.0745123Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:09:49.0745955Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:09:49.0746725Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:09:49.0747422Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:09:49.0748202Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:09:49.0749023Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2024-12-18T00:09:49.0749838Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 16s local ... 2024-12-18T00:09:49.2889532Z 2024-12-18T00:09:49.2890371Z  2024-12-18T00:09:49.2890861Z  2024-12-18T00:09:49.2891293Z  2024-12-18T00:09:49.2891712Z  2024-12-18T00:09:49.2892432Z  2024-12-18T00:09:49.2892861Z  2024-12-18T00:09:49.2893287Z  2024-12-18T00:09:49.2893716Z  2024-12-18T00:09:49.2894321Z [14,249 / 15,187] 48 actions running 2024-12-18T00:09:49.2895287Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:09:49.2896567Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:09:49.2897725Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:09:49.2898779Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:09:49.2899736Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:09:49.2900852Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:09:49.2901954Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2024-12-18T00:09:49.2903024Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:09:49.6895217Z 2024-12-18T00:09:49.6896106Z  2024-12-18T00:09:49.6896663Z  2024-12-18T00:09:49.6897079Z  2024-12-18T00:09:49.6897476Z  2024-12-18T00:09:49.6898103Z  2024-12-18T00:09:49.6898484Z  2024-12-18T00:09:49.6898992Z  2024-12-18T00:09:49.6899612Z  2024-12-18T00:09:49.6900263Z [14,250 / 15,187] 48 actions running 2024-12-18T00:09:49.6901106Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:09:49.6902102Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:09:49.6903268Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:09:49.6904458Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:09:49.6905353Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:09:49.6906329Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:09:49.6907373Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2024-12-18T00:09:49.6908260Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:49.8927485Z 2024-12-18T00:09:49.8928391Z  2024-12-18T00:09:49.8928858Z  2024-12-18T00:09:49.8929256Z  2024-12-18T00:09:49.8929634Z  2024-12-18T00:09:49.8930007Z  2024-12-18T00:09:49.8930407Z  2024-12-18T00:09:49.8930789Z  2024-12-18T00:09:49.8931165Z  2024-12-18T00:09:49.8931747Z [14,251 / 15,187] 48 actions, 47 running 2024-12-18T00:09:49.8932594Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:09:49.8933609Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:09:49.8934672Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:09:49.8935645Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:09:49.8936612Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:09:49.8937620Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:09:49.8938613Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2024-12-18T00:09:49.8939461Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:50.2902418Z 2024-12-18T00:09:50.2903277Z  2024-12-18T00:09:50.2903739Z  2024-12-18T00:09:50.2904160Z  2024-12-18T00:09:50.2904566Z  2024-12-18T00:09:50.2904956Z  2024-12-18T00:09:50.2905336Z  2024-12-18T00:09:50.2905745Z  2024-12-18T00:09:50.2906138Z  2024-12-18T00:09:50.2906692Z [14,251 / 15,187] 48 actions running 2024-12-18T00:09:50.2907635Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:09:50.2908691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:09:50.2909763Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:09:50.2910773Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:09:50.2912012Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:09:50.2913102Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:09:50.2914133Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2024-12-18T00:09:50.2914972Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:50.4964694Z 2024-12-18T00:09:50.4965526Z  2024-12-18T00:09:50.4965957Z  2024-12-18T00:09:50.4966318Z  2024-12-18T00:09:50.4966678Z  2024-12-18T00:09:50.4967038Z  2024-12-18T00:09:50.4967379Z  2024-12-18T00:09:50.4967753Z  2024-12-18T00:09:50.4968100Z  2024-12-18T00:09:50.4968653Z [14,252 / 15,187] 48 actions, 47 running 2024-12-18T00:09:50.4969430Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:09:50.4970289Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:09:50.4971150Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:09:50.4972235Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:09:50.4972971Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:09:50.4973885Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:09:50.4974720Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2024-12-18T00:09:50.4975563Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 15s local ... 2024-12-18T00:09:50.7990908Z 2024-12-18T00:09:50.7991845Z  2024-12-18T00:09:50.7992557Z  2024-12-18T00:09:50.7992965Z  2024-12-18T00:09:50.7993351Z  2024-12-18T00:09:50.7993725Z  2024-12-18T00:09:50.7994079Z  2024-12-18T00:09:50.7994463Z  2024-12-18T00:09:50.7994847Z  2024-12-18T00:09:50.7995417Z [14,253 / 15,187] 48 actions, 47 running 2024-12-18T00:09:50.7996302Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:09:50.7997331Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:09:50.7998421Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:09:50.7999322Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:09:50.8000055Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:09:50.8001095Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:09:50.8002134Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 15s local 2024-12-18T00:09:50.8003236Z .../memory_space_assignment:memory_bound_loop_optimizer; 15s local ... 2024-12-18T00:09:51.0145756Z 2024-12-18T00:09:51.0146614Z  2024-12-18T00:09:51.0147072Z  2024-12-18T00:09:51.0147443Z  2024-12-18T00:09:51.0147812Z  2024-12-18T00:09:51.0148175Z  2024-12-18T00:09:51.0148588Z  2024-12-18T00:09:51.0148992Z  2024-12-18T00:09:51.0149377Z  2024-12-18T00:09:51.0149974Z [14,254 / 15,187] 48 actions, 47 running 2024-12-18T00:09:51.0150837Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:09:51.0151877Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:09:51.0152914Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:09:51.0153859Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:09:51.0154758Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:09:51.0155698Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:09:51.0156766Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 15s local 2024-12-18T00:09:51.0157829Z .../memory_space_assignment:memory_bound_loop_optimizer; 15s local ... 2024-12-18T00:09:51.2911231Z 2024-12-18T00:09:51.2912411Z  2024-12-18T00:09:51.2912881Z  2024-12-18T00:09:51.2913257Z  2024-12-18T00:09:51.2913631Z  2024-12-18T00:09:51.2914032Z  2024-12-18T00:09:51.2914554Z  2024-12-18T00:09:51.2914916Z  2024-12-18T00:09:51.2915327Z  2024-12-18T00:09:51.2915928Z [14,255 / 15,187] 48 actions running 2024-12-18T00:09:51.2916775Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:09:51.2917844Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:09:51.2918869Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:09:51.2919867Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:09:51.2920701Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:09:51.2921684Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:09:51.2922836Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:09:51.2923890Z .../memory_space_assignment:memory_bound_loop_optimizer; 16s local ... 2024-12-18T00:09:51.4917046Z 2024-12-18T00:09:51.4917917Z  2024-12-18T00:09:51.4918385Z  2024-12-18T00:09:51.4918939Z  2024-12-18T00:09:51.4919338Z  2024-12-18T00:09:51.4919736Z  2024-12-18T00:09:51.4920121Z  2024-12-18T00:09:51.4920517Z  2024-12-18T00:09:51.4920910Z  2024-12-18T00:09:51.4921480Z [14,256 / 15,187] 48 actions running 2024-12-18T00:09:51.4922385Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:09:51.4923600Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:09:51.4924662Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:09:51.4925645Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:09:51.4926515Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:09:51.4927528Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:09:51.4928648Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:09:51.4929763Z .../memory_space_assignment:memory_bound_loop_optimizer; 16s local ... 2024-12-18T00:09:51.7716360Z 2024-12-18T00:09:51.7717271Z  2024-12-18T00:09:51.7717741Z  2024-12-18T00:09:51.7718113Z  2024-12-18T00:09:51.7718504Z  2024-12-18T00:09:51.7718902Z  2024-12-18T00:09:51.7719290Z  2024-12-18T00:09:51.7719665Z  2024-12-18T00:09:51.7720040Z  2024-12-18T00:09:51.7720652Z [14,259 / 15,187] 48 actions, 47 running 2024-12-18T00:09:51.7721428Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:09:51.7722397Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:09:51.7723412Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:09:51.7724411Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:09:51.7725325Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:09:51.7726250Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:09:51.7727399Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:09:51.7728447Z .../memory_space_assignment:memory_bound_loop_optimizer; 16s local ... 2024-12-18T00:09:52.0237423Z 2024-12-18T00:09:52.0238349Z  2024-12-18T00:09:52.0238809Z  2024-12-18T00:09:52.0239203Z  2024-12-18T00:09:52.0239611Z  2024-12-18T00:09:52.0240038Z  2024-12-18T00:09:52.0240470Z  2024-12-18T00:09:52.0240969Z  2024-12-18T00:09:52.0241340Z  2024-12-18T00:09:52.0241909Z [14,260 / 15,187] 48 actions, 47 running 2024-12-18T00:09:52.0242827Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:09:52.0244539Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:09:52.0245594Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:09:52.0246692Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:09:52.0247667Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:09:52.0248721Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:09:52.0249931Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:09:52.0251030Z .../memory_space_assignment:memory_bound_loop_optimizer; 16s local ... 2024-12-18T00:09:52.2874730Z 2024-12-18T00:09:52.2875593Z  2024-12-18T00:09:52.2876047Z  2024-12-18T00:09:52.2876429Z  2024-12-18T00:09:52.2876819Z  2024-12-18T00:09:52.2877207Z  2024-12-18T00:09:52.2877591Z  2024-12-18T00:09:52.2877976Z  2024-12-18T00:09:52.2878402Z  2024-12-18T00:09:52.2879005Z [14,262 / 15,187] 48 actions, 47 running 2024-12-18T00:09:52.2880146Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:09:52.2881143Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:09:52.2882334Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:09:52.2883290Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:09:52.2884165Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:09:52.2885316Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:09:52.2886638Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:09:52.2887753Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2024-12-18T00:09:52.4924509Z 2024-12-18T00:09:52.4925382Z  2024-12-18T00:09:52.4925952Z  2024-12-18T00:09:52.4926417Z  2024-12-18T00:09:52.4926959Z  2024-12-18T00:09:52.4927342Z  2024-12-18T00:09:52.4927729Z  2024-12-18T00:09:52.4928177Z  2024-12-18T00:09:52.4928588Z  2024-12-18T00:09:52.4929166Z [14,263 / 15,187] 48 actions running 2024-12-18T00:09:52.4930148Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:09:52.4931159Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:09:52.4932196Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:09:52.4933286Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:09:52.4934194Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:09:52.4935201Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:09:52.4936499Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:09:52.4937623Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2024-12-18T00:09:52.9508417Z 2024-12-18T00:09:52.9509275Z  2024-12-18T00:09:52.9509776Z  2024-12-18T00:09:52.9510193Z  2024-12-18T00:09:52.9510566Z  2024-12-18T00:09:52.9510925Z  2024-12-18T00:09:52.9511309Z  2024-12-18T00:09:52.9511691Z  2024-12-18T00:09:52.9512204Z  2024-12-18T00:09:52.9512847Z [14,264 / 15,187] 48 actions, 47 running 2024-12-18T00:09:52.9513701Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:09:52.9514803Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:09:52.9516082Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:09:52.9517084Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:09:52.9517948Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:09:52.9518952Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:09:52.9520480Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:09:52.9521620Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2024-12-18T00:09:53.2932151Z 2024-12-18T00:09:53.2932990Z  2024-12-18T00:09:53.2933433Z  2024-12-18T00:09:53.2933803Z  2024-12-18T00:09:53.2934138Z  2024-12-18T00:09:53.2934474Z  2024-12-18T00:09:53.2934819Z  2024-12-18T00:09:53.2935173Z  2024-12-18T00:09:53.2935518Z  2024-12-18T00:09:53.2936001Z [14,265 / 15,187] 48 actions running 2024-12-18T00:09:53.2936935Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:09:53.2937808Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:09:53.2938603Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:09:53.2939376Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:09:53.2940272Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:09:53.2941631Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 18s local 2024-12-18T00:09:53.2942608Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2024-12-18T00:09:53.2943827Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local ... 2024-12-18T00:09:53.4938696Z 2024-12-18T00:09:53.4939492Z  2024-12-18T00:09:53.4939915Z  2024-12-18T00:09:53.4940281Z  2024-12-18T00:09:53.4940617Z  2024-12-18T00:09:53.4940957Z  2024-12-18T00:09:53.4941330Z  2024-12-18T00:09:53.4942008Z  2024-12-18T00:09:53.4942354Z  2024-12-18T00:09:53.4942875Z [14,267 / 15,187] 48 actions running 2024-12-18T00:09:53.4943667Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:09:53.4944819Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:09:53.4945631Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:09:53.4946364Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:09:53.4947258Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:09:53.4948260Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2024-12-18T00:09:53.4949363Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:09:53.4950210Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:09:53.9121027Z 2024-12-18T00:09:53.9121869Z  2024-12-18T00:09:53.9122375Z  2024-12-18T00:09:53.9122779Z  2024-12-18T00:09:53.9123158Z  2024-12-18T00:09:53.9123498Z  2024-12-18T00:09:53.9123849Z  2024-12-18T00:09:53.9124281Z  2024-12-18T00:09:53.9124799Z  2024-12-18T00:09:53.9125505Z [14,268 / 15,187] 48 actions, 47 running 2024-12-18T00:09:53.9126476Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:09:53.9127337Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:09:53.9128266Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:09:53.9129161Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:09:53.9130209Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2024-12-18T00:09:53.9131276Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:09:53.9132317Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 16s local 2024-12-18T00:09:53.9133312Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 14s local ... 2024-12-18T00:09:54.2946540Z 2024-12-18T00:09:54.2947423Z  2024-12-18T00:09:54.2947880Z  2024-12-18T00:09:54.2948234Z  2024-12-18T00:09:54.2948618Z  2024-12-18T00:09:54.2948999Z  2024-12-18T00:09:54.2949653Z  2024-12-18T00:09:54.2950021Z  2024-12-18T00:09:54.2950380Z  2024-12-18T00:09:54.2950962Z [14,270 / 15,187] 48 actions running 2024-12-18T00:09:54.2951788Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:09:54.2952723Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:09:54.2953580Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:09:54.2954534Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:09:54.2955792Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:09:54.2956910Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:09:54.2957953Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local 2024-12-18T00:09:54.2958857Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:09:54.5016870Z 2024-12-18T00:09:54.5017890Z  2024-12-18T00:09:54.5018326Z  2024-12-18T00:09:54.5018689Z  2024-12-18T00:09:54.5019082Z  2024-12-18T00:09:54.5019728Z  2024-12-18T00:09:54.5020142Z  2024-12-18T00:09:54.5020571Z  2024-12-18T00:09:54.5023409Z  2024-12-18T00:09:54.5024008Z [14,272 / 15,187] 48 actions, 47 running 2024-12-18T00:09:54.5024825Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:09:54.5025910Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:09:54.5026980Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:09:54.5028379Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:09:54.5029666Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:09:54.5030842Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 18s local 2024-12-18T00:09:54.5032053Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local 2024-12-18T00:09:54.5033129Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:09:54.7026995Z 2024-12-18T00:09:54.7027848Z  2024-12-18T00:09:54.7028329Z  2024-12-18T00:09:54.7028726Z  2024-12-18T00:09:54.7029102Z  2024-12-18T00:09:54.7029518Z  2024-12-18T00:09:54.7029890Z  2024-12-18T00:09:54.7030251Z  2024-12-18T00:09:54.7030613Z  2024-12-18T00:09:54.7031178Z [14,274 / 15,187] 48 actions, 47 running 2024-12-18T00:09:54.7031995Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:09:54.7032876Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:09:54.7033685Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:09:54.7034620Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:09:54.7035617Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:09:54.7036749Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local 2024-12-18T00:09:54.7037747Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 13s local 2024-12-18T00:09:54.7038707Z Compiling llvm/lib/Target/X86/X86AsmPrinter.cpp; 12s local ... 2024-12-18T00:09:54.9055220Z 2024-12-18T00:09:54.9056047Z  2024-12-18T00:09:54.9056718Z  2024-12-18T00:09:54.9057136Z  2024-12-18T00:09:54.9057558Z  2024-12-18T00:09:54.9057946Z  2024-12-18T00:09:54.9058298Z  2024-12-18T00:09:54.9058662Z  2024-12-18T00:09:54.9059015Z  2024-12-18T00:09:54.9059637Z [14,276 / 15,187] 48 actions, 47 running 2024-12-18T00:09:54.9060454Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:09:54.9061320Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:09:54.9062096Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:09:54.9063308Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:09:54.9064380Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:09:54.9065470Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local 2024-12-18T00:09:54.9066501Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2024-12-18T00:09:54.9067475Z Compiling llvm/lib/Target/X86/X86AsmPrinter.cpp; 12s local ... 2024-12-18T00:09:55.2781794Z 2024-12-18T00:09:55.2782635Z  2024-12-18T00:09:55.2783092Z  2024-12-18T00:09:55.2783475Z  2024-12-18T00:09:55.2783888Z  2024-12-18T00:09:55.2784254Z  2024-12-18T00:09:55.2784625Z  2024-12-18T00:09:55.2785011Z  2024-12-18T00:09:55.2785386Z  2024-12-18T00:09:55.2785937Z [14,279 / 15,187] 48 actions, 47 running 2024-12-18T00:09:55.2786731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:09:55.2787629Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:09:55.2788800Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:09:55.2789749Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:09:55.2790991Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:09:55.2792055Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2024-12-18T00:09:55.2793132Z Compiling llvm/lib/Target/X86/X86AsmPrinter.cpp; 12s local 2024-12-18T00:09:55.2794200Z Compiling llvm/lib/Target/X86/X86CallingConv.cpp; 11s local ... 2024-12-18T00:09:55.4956181Z 2024-12-18T00:09:55.4957018Z  2024-12-18T00:09:55.4957526Z  2024-12-18T00:09:55.4957978Z  2024-12-18T00:09:55.4958407Z  2024-12-18T00:09:55.4958848Z  2024-12-18T00:09:55.4959303Z  2024-12-18T00:09:55.4959753Z  2024-12-18T00:09:55.4960218Z  2024-12-18T00:09:55.4960845Z [14,280 / 15,187] 48 actions running 2024-12-18T00:09:55.4961860Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:09:55.4962925Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:09:55.4963943Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:09:55.4965219Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:09:55.4966501Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:09:55.4967771Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2024-12-18T00:09:55.4968934Z Compiling llvm/lib/Target/X86/X86AsmPrinter.cpp; 13s local 2024-12-18T00:09:55.4970039Z Compiling llvm/lib/Target/X86/X86CallingConv.cpp; 11s local ... 2024-12-18T00:09:55.7119096Z 2024-12-18T00:09:55.7119974Z  2024-12-18T00:09:55.7120432Z  2024-12-18T00:09:55.7120831Z  2024-12-18T00:09:55.7121245Z  2024-12-18T00:09:55.7121615Z  2024-12-18T00:09:55.7122008Z  2024-12-18T00:09:55.7122385Z  2024-12-18T00:09:55.7122752Z  2024-12-18T00:09:55.7123308Z [14,281 / 15,187] 48 actions, 47 running 2024-12-18T00:09:55.7124143Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:09:55.7125067Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:09:55.7125952Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:09:55.7126874Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:09:55.7127930Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:09:55.7129012Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2024-12-18T00:09:55.7129981Z Compiling llvm/lib/Target/X86/X86AsmPrinter.cpp; 13s local 2024-12-18T00:09:55.7130873Z Compiling llvm/lib/Target/X86/X86CallingConv.cpp; 11s local ... 2024-12-18T00:09:56.0962768Z 2024-12-18T00:09:56.0963609Z  2024-12-18T00:09:56.0964080Z  2024-12-18T00:09:56.0964527Z  2024-12-18T00:09:56.0964940Z  2024-12-18T00:09:56.0965363Z  2024-12-18T00:09:56.0965787Z  2024-12-18T00:09:56.0966195Z  2024-12-18T00:09:56.0966595Z  2024-12-18T00:09:56.0967190Z [14,283 / 15,187] 48 actions running 2024-12-18T00:09:56.0968101Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:09:56.0969105Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:09:56.0970064Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:09:56.0971146Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:09:56.0972312Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:09:56.0973494Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2024-12-18T00:09:56.0974580Z Compiling llvm/lib/Target/X86/X86CallingConv.cpp; 12s local 2024-12-18T00:09:56.0975985Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 11s local ... 2024-12-18T00:09:56.2966263Z 2024-12-18T00:09:56.2967432Z  2024-12-18T00:09:56.2967893Z  2024-12-18T00:09:56.2968290Z  2024-12-18T00:09:56.2968681Z  2024-12-18T00:09:56.2969058Z  2024-12-18T00:09:56.2969434Z  2024-12-18T00:09:56.2969816Z  2024-12-18T00:09:56.2970183Z  2024-12-18T00:09:56.2970654Z [14,284 / 15,187] 48 actions running 2024-12-18T00:09:56.2971572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:09:56.2972367Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:09:56.2973307Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:09:56.2974397Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:09:56.2975461Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 21s local 2024-12-18T00:09:56.2976842Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2024-12-18T00:09:56.2977821Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 11s local 2024-12-18T00:09:56.2978896Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 11s local ... 2024-12-18T00:09:56.5087950Z 2024-12-18T00:09:56.5088802Z  2024-12-18T00:09:56.5089276Z  2024-12-18T00:09:56.5089674Z  2024-12-18T00:09:56.5090031Z  2024-12-18T00:09:56.5090403Z  2024-12-18T00:09:56.5090794Z  2024-12-18T00:09:56.5091189Z  2024-12-18T00:09:56.5091713Z  2024-12-18T00:09:56.5092569Z [14,286 / 15,187] 48 actions, 47 running 2024-12-18T00:09:56.5093422Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:09:56.5094365Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:09:56.5095225Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:09:56.5096230Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:09:56.5097609Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2024-12-18T00:09:56.5098885Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2024-12-18T00:09:56.5100051Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 12s local 2024-12-18T00:09:56.5101139Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 10s local ... 2024-12-18T00:09:56.8971954Z 2024-12-18T00:09:56.8972933Z  2024-12-18T00:09:56.8973517Z  2024-12-18T00:09:56.8973999Z  2024-12-18T00:09:56.8974511Z  2024-12-18T00:09:56.8974943Z  2024-12-18T00:09:56.8975423Z  2024-12-18T00:09:56.8975931Z  2024-12-18T00:09:56.8976487Z  2024-12-18T00:09:56.8977173Z [14,286 / 15,187] 48 actions running 2024-12-18T00:09:56.8978560Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:09:56.8979659Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:09:56.8980631Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:09:56.8981617Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:09:56.8982527Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 16s local 2024-12-18T00:09:56.8983554Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2024-12-18T00:09:56.8984702Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 12s local 2024-12-18T00:09:56.8985673Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 11s local ... 2024-12-18T00:09:57.1331755Z 2024-12-18T00:09:57.1332653Z  2024-12-18T00:09:57.1333098Z  2024-12-18T00:09:57.1333504Z  2024-12-18T00:09:57.1333894Z  2024-12-18T00:09:57.1334285Z  2024-12-18T00:09:57.1334702Z  2024-12-18T00:09:57.1335081Z  2024-12-18T00:09:57.1335475Z  2024-12-18T00:09:57.1336507Z [14,287 / 15,187] 48 actions, 47 running 2024-12-18T00:09:57.1337405Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:09:57.1338468Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:09:57.1339328Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:09:57.1340312Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:09:57.1341384Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 16s local 2024-12-18T00:09:57.1342804Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2024-12-18T00:09:57.1343916Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 12s local 2024-12-18T00:09:57.1345227Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 11s local ... 2024-12-18T00:09:57.4979052Z 2024-12-18T00:09:57.4979855Z  2024-12-18T00:09:57.4980269Z  2024-12-18T00:09:57.4980622Z  2024-12-18T00:09:57.4980972Z  2024-12-18T00:09:57.4981340Z  2024-12-18T00:09:57.4981677Z  2024-12-18T00:09:57.4982023Z  2024-12-18T00:09:57.4982367Z  2024-12-18T00:09:57.4982921Z [14,288 / 15,187] 48 actions running 2024-12-18T00:09:57.4983698Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:09:57.4984589Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:09:57.4985407Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:09:57.4986317Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:09:57.4987340Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:09:57.4988426Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 13s local 2024-12-18T00:09:57.4989324Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 11s local 2024-12-18T00:09:57.4990290Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 11s local ... 2024-12-18T00:09:57.8088365Z 2024-12-18T00:09:57.8089251Z  2024-12-18T00:09:57.8089660Z  2024-12-18T00:09:57.8090004Z  2024-12-18T00:09:57.8090357Z  2024-12-18T00:09:57.8090670Z  2024-12-18T00:09:57.8091002Z  2024-12-18T00:09:57.8091330Z  2024-12-18T00:09:57.8091657Z  2024-12-18T00:09:57.8092419Z [14,290 / 15,187] 48 actions, 47 running 2024-12-18T00:09:57.8093121Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:09:57.8093857Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:09:57.8094544Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:09:57.8095333Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2024-12-18T00:09:57.8096211Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:09:57.8097511Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 13s local 2024-12-18T00:09:57.8098391Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 12s local 2024-12-18T00:09:57.8099241Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local ... 2024-12-18T00:09:58.0984280Z 2024-12-18T00:09:58.0985061Z  2024-12-18T00:09:58.0985429Z  2024-12-18T00:09:58.0985733Z  2024-12-18T00:09:58.0986020Z  2024-12-18T00:09:58.0986321Z  2024-12-18T00:09:58.0986620Z  2024-12-18T00:09:58.0986917Z  2024-12-18T00:09:58.0987198Z  2024-12-18T00:09:58.0987671Z [14,290 / 15,187] 48 actions running 2024-12-18T00:09:58.0988319Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:09:58.0988992Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:09:58.0989628Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:09:58.0990345Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2024-12-18T00:09:58.0991409Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:09:58.0992216Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 13s local 2024-12-18T00:09:58.0993089Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 12s local 2024-12-18T00:09:58.0993869Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local ... 2024-12-18T00:09:58.3144048Z 2024-12-18T00:09:58.3145076Z  2024-12-18T00:09:58.3145450Z  2024-12-18T00:09:58.3145758Z  2024-12-18T00:09:58.3146059Z  2024-12-18T00:09:58.3146349Z  2024-12-18T00:09:58.3146929Z  2024-12-18T00:09:58.3147248Z  2024-12-18T00:09:58.3147554Z  2024-12-18T00:09:58.3148018Z [14,291 / 15,187] 48 actions, 47 running 2024-12-18T00:09:58.3148677Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:09:58.3149363Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:09:58.3150083Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2024-12-18T00:09:58.3150895Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:09:58.3151709Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 13s local 2024-12-18T00:09:58.3152476Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 12s local 2024-12-18T00:09:58.3153244Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local 2024-12-18T00:09:58.3153924Z @llvm-project//mlir:TransformDialect; 11s local ... 2024-12-18T00:09:58.6991340Z 2024-12-18T00:09:58.6992243Z  2024-12-18T00:09:58.6992701Z  2024-12-18T00:09:58.6993112Z  2024-12-18T00:09:58.6993490Z  2024-12-18T00:09:58.6993886Z  2024-12-18T00:09:58.6994244Z  2024-12-18T00:09:58.6994739Z  2024-12-18T00:09:58.6995132Z  2024-12-18T00:09:58.6995702Z [14,292 / 15,187] 48 actions running 2024-12-18T00:09:58.6996578Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:09:58.6997537Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:09:58.6998462Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2024-12-18T00:09:58.6999587Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2024-12-18T00:09:58.7000732Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 14s local 2024-12-18T00:09:58.7001788Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 13s local 2024-12-18T00:09:58.7002881Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local 2024-12-18T00:09:58.7003807Z @llvm-project//mlir:TransformDialect; 12s local ... 2024-12-18T00:09:59.0257175Z 2024-12-18T00:09:59.0258016Z  2024-12-18T00:09:59.0258454Z  2024-12-18T00:09:59.0258813Z  2024-12-18T00:09:59.0259183Z  2024-12-18T00:09:59.0259575Z  2024-12-18T00:09:59.0260210Z  2024-12-18T00:09:59.0260594Z  2024-12-18T00:09:59.0260974Z  2024-12-18T00:09:59.0261712Z [14,293 / 15,187] 48 actions, 47 running 2024-12-18T00:09:59.0262577Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:09:59.0263535Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:09:59.0264471Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2024-12-18T00:09:59.0265501Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2024-12-18T00:09:59.0266482Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 14s local 2024-12-18T00:09:59.0279236Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 13s local 2024-12-18T00:09:59.0280279Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local 2024-12-18T00:09:59.0281344Z @llvm-project//mlir:TransformDialect; 12s local ... 2024-12-18T00:09:59.2997281Z 2024-12-18T00:09:59.2998305Z  2024-12-18T00:09:59.2998790Z  2024-12-18T00:09:59.2999211Z  2024-12-18T00:09:59.2999610Z  2024-12-18T00:09:59.3000319Z  2024-12-18T00:09:59.3000761Z  2024-12-18T00:09:59.3001168Z  2024-12-18T00:09:59.3001545Z  2024-12-18T00:09:59.3002273Z [14,296 / 15,187] 48 actions running 2024-12-18T00:09:59.3003119Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:09:59.3004057Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:09:59.3005032Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 14s local 2024-12-18T00:09:59.3006286Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 13s local 2024-12-18T00:09:59.3007340Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local 2024-12-18T00:09:59.3008462Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 12s local 2024-12-18T00:09:59.3009593Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 12s local 2024-12-18T00:09:59.3010543Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2024-12-18T00:09:59.5655732Z 2024-12-18T00:09:59.5656745Z  2024-12-18T00:09:59.5657238Z  2024-12-18T00:09:59.5657600Z  2024-12-18T00:09:59.5658010Z  2024-12-18T00:09:59.5658392Z  2024-12-18T00:09:59.5658757Z  2024-12-18T00:09:59.5659148Z  2024-12-18T00:09:59.5659514Z  2024-12-18T00:09:59.5660101Z [14,297 / 15,187] 48 actions, 47 running 2024-12-18T00:09:59.5661107Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:09:59.5662027Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:09:59.5662934Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 15s local 2024-12-18T00:09:59.5664030Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 14s local 2024-12-18T00:09:59.5665115Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local 2024-12-18T00:09:59.5666260Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2024-12-18T00:09:59.5667292Z @llvm-project//mlir:ControlFlowToLLVM; 12s local 2024-12-18T00:09:59.5668230Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 11s local ... 2024-12-18T00:09:59.9003772Z 2024-12-18T00:09:59.9004640Z  2024-12-18T00:09:59.9005106Z  2024-12-18T00:09:59.9005461Z  2024-12-18T00:09:59.9005792Z  2024-12-18T00:09:59.9006118Z  2024-12-18T00:09:59.9006473Z  2024-12-18T00:09:59.9006840Z  2024-12-18T00:09:59.9007204Z  2024-12-18T00:09:59.9007753Z [14,297 / 15,187] 48 actions running 2024-12-18T00:09:59.9008627Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2024-12-18T00:09:59.9009477Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:09:59.9010424Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 15s local 2024-12-18T00:09:59.9011481Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 14s local 2024-12-18T00:09:59.9012837Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local 2024-12-18T00:09:59.9013842Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2024-12-18T00:09:59.9014786Z @llvm-project//mlir:ControlFlowToLLVM; 12s local 2024-12-18T00:09:59.9015829Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 11s local ... 2024-12-18T00:10:00.8736610Z 2024-12-18T00:10:00.8737543Z  2024-12-18T00:10:00.8738005Z  2024-12-18T00:10:00.8738375Z  2024-12-18T00:10:00.8738737Z  2024-12-18T00:10:00.8739108Z  2024-12-18T00:10:00.8739473Z  2024-12-18T00:10:00.8739837Z  2024-12-18T00:10:00.8740203Z  2024-12-18T00:10:00.8740793Z [14,298 / 15,187] 48 actions, 47 running 2024-12-18T00:10:00.8741625Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:10:00.8742476Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:10:00.8743335Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local 2024-12-18T00:10:00.8744934Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 15s local 2024-12-18T00:10:00.8745957Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local 2024-12-18T00:10:00.8747226Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:10:00.8748099Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2024-12-18T00:10:00.8748990Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 12s local ... 2024-12-18T00:10:01.1014551Z 2024-12-18T00:10:01.1015445Z  2024-12-18T00:10:01.1016206Z  2024-12-18T00:10:01.1016800Z  2024-12-18T00:10:01.1017178Z  2024-12-18T00:10:01.1017553Z  2024-12-18T00:10:01.1017925Z  2024-12-18T00:10:01.1018297Z  2024-12-18T00:10:01.1018678Z  2024-12-18T00:10:01.1019216Z [14,299 / 15,187] 48 actions running 2024-12-18T00:10:01.1020067Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:10:01.1020968Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:10:01.1021919Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local 2024-12-18T00:10:01.1023134Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 15s local 2024-12-18T00:10:01.1024083Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local 2024-12-18T00:10:01.1025037Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:10:01.1025905Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2024-12-18T00:10:01.1026770Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 12s local ... 2024-12-18T00:10:01.3019317Z 2024-12-18T00:10:01.3020213Z  2024-12-18T00:10:01.3020716Z  2024-12-18T00:10:01.3021095Z  2024-12-18T00:10:01.3021496Z  2024-12-18T00:10:01.3021904Z  2024-12-18T00:10:01.3022284Z  2024-12-18T00:10:01.3022671Z  2024-12-18T00:10:01.3023090Z  2024-12-18T00:10:01.3023669Z [14,300 / 15,187] 48 actions running 2024-12-18T00:10:01.3024568Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:10:01.3025506Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:10:01.3026386Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local 2024-12-18T00:10:01.3027398Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 15s local 2024-12-18T00:10:01.3028400Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local 2024-12-18T00:10:01.3029450Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:10:01.3030390Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:10:01.3031287Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 13s local ... 2024-12-18T00:10:01.5138868Z 2024-12-18T00:10:01.5139790Z  2024-12-18T00:10:01.5140604Z  2024-12-18T00:10:01.5141001Z  2024-12-18T00:10:01.5141410Z  2024-12-18T00:10:01.5141792Z  2024-12-18T00:10:01.5142173Z  2024-12-18T00:10:01.5142543Z  2024-12-18T00:10:01.5142932Z  2024-12-18T00:10:01.5143530Z [14,302 / 15,187] 48 actions, 47 running 2024-12-18T00:10:01.5144633Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:10:01.5145580Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2024-12-18T00:10:01.5146518Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local 2024-12-18T00:10:01.5147758Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 15s local 2024-12-18T00:10:01.5148784Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local 2024-12-18T00:10:01.5149905Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:10:01.5150849Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:10:01.5151756Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 13s local ... 2024-12-18T00:10:01.8712589Z 2024-12-18T00:10:01.8713445Z  2024-12-18T00:10:01.8714128Z  2024-12-18T00:10:01.8714495Z  2024-12-18T00:10:01.8714855Z  2024-12-18T00:10:01.8715333Z  2024-12-18T00:10:01.8715697Z  2024-12-18T00:10:01.8716039Z  2024-12-18T00:10:01.8716400Z  2024-12-18T00:10:01.8716945Z [14,305 / 15,187] 48 actions, 47 running 2024-12-18T00:10:01.8717699Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:10:01.8718627Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local 2024-12-18T00:10:01.8719677Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local 2024-12-18T00:10:01.8720614Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2024-12-18T00:10:01.8721591Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:10:01.8722445Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:10:01.8723272Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 13s local 2024-12-18T00:10:01.8724195Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 11s local ... 2024-12-18T00:10:02.1027431Z 2024-12-18T00:10:02.1028304Z  2024-12-18T00:10:02.1028706Z  2024-12-18T00:10:02.1029075Z  2024-12-18T00:10:02.1029452Z  2024-12-18T00:10:02.1029797Z  2024-12-18T00:10:02.1030138Z  2024-12-18T00:10:02.1030489Z  2024-12-18T00:10:02.1030869Z  2024-12-18T00:10:02.1031385Z [14,307 / 15,187] 48 actions running 2024-12-18T00:10:02.1032203Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:10:02.1033192Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local 2024-12-18T00:10:02.1034162Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local 2024-12-18T00:10:02.1035140Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2024-12-18T00:10:02.1036209Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:10:02.1037121Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:10:02.1038037Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 13s local 2024-12-18T00:10:02.1038913Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 11s local ... 2024-12-18T00:10:02.4785054Z 2024-12-18T00:10:02.4785916Z  2024-12-18T00:10:02.4786292Z  2024-12-18T00:10:02.4786613Z  2024-12-18T00:10:02.4786940Z  2024-12-18T00:10:02.4787301Z  2024-12-18T00:10:02.4787628Z  2024-12-18T00:10:02.4788033Z  2024-12-18T00:10:02.4788394Z  2024-12-18T00:10:02.4788901Z [14,308 / 15,187] 48 actions, 47 running 2024-12-18T00:10:02.4789624Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:10:02.4790464Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2024-12-18T00:10:02.4791750Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local 2024-12-18T00:10:02.4792639Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2024-12-18T00:10:02.4793542Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:10:02.4794384Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2024-12-18T00:10:02.4795153Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2024-12-18T00:10:02.4795998Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 11s local ... 2024-12-18T00:10:02.7033282Z 2024-12-18T00:10:02.7034131Z  2024-12-18T00:10:02.7034571Z  2024-12-18T00:10:02.7035008Z  2024-12-18T00:10:02.7035402Z  2024-12-18T00:10:02.7035798Z  2024-12-18T00:10:02.7036173Z  2024-12-18T00:10:02.7036568Z  2024-12-18T00:10:02.7036964Z  2024-12-18T00:10:02.7037536Z [14,308 / 15,187] 48 actions running 2024-12-18T00:10:02.7038444Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:10:02.7039808Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2024-12-18T00:10:02.7040964Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:10:02.7042172Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2024-12-18T00:10:02.7043340Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:10:02.7044608Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2024-12-18T00:10:02.7045559Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2024-12-18T00:10:02.7046795Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 11s local ... 2024-12-18T00:10:02.9038064Z 2024-12-18T00:10:02.9038992Z  2024-12-18T00:10:02.9039485Z  2024-12-18T00:10:02.9039882Z  2024-12-18T00:10:02.9040260Z  2024-12-18T00:10:02.9040640Z  2024-12-18T00:10:02.9041174Z  2024-12-18T00:10:02.9041581Z  2024-12-18T00:10:02.9041962Z  2024-12-18T00:10:02.9042511Z [14,309 / 15,187] 48 actions running 2024-12-18T00:10:02.9043366Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:10:02.9044651Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2024-12-18T00:10:02.9045692Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:10:02.9046724Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2024-12-18T00:10:02.9047798Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:10:02.9048884Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2024-12-18T00:10:02.9049876Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 12s local 2024-12-18T00:10:02.9050700Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 11s local ... 2024-12-18T00:10:03.3042783Z 2024-12-18T00:10:03.3043670Z  2024-12-18T00:10:03.3044417Z  2024-12-18T00:10:03.3044816Z  2024-12-18T00:10:03.3045196Z  2024-12-18T00:10:03.3045568Z  2024-12-18T00:10:03.3045968Z  2024-12-18T00:10:03.3046370Z  2024-12-18T00:10:03.3046750Z  2024-12-18T00:10:03.3047286Z [14,312 / 15,187] 48 actions running 2024-12-18T00:10:03.3048110Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:10:03.3049071Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2024-12-18T00:10:03.3050146Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:10:03.3051213Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2024-12-18T00:10:03.3052331Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:10:03.3053438Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2024-12-18T00:10:03.3054362Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 12s local 2024-12-18T00:10:03.3055676Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 12s local ... 2024-12-18T00:10:03.5046434Z 2024-12-18T00:10:03.5047367Z  2024-12-18T00:10:03.5047857Z  2024-12-18T00:10:03.5048386Z  2024-12-18T00:10:03.5048776Z  2024-12-18T00:10:03.5049168Z  2024-12-18T00:10:03.5049523Z  2024-12-18T00:10:03.5049919Z  2024-12-18T00:10:03.5050314Z  2024-12-18T00:10:03.5050861Z [14,313 / 15,187] 48 actions running 2024-12-18T00:10:03.5051707Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:10:03.5052754Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2024-12-18T00:10:03.5053818Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:10:03.5054840Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2024-12-18T00:10:03.5055959Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:10:03.5057231Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2024-12-18T00:10:03.5058595Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 12s local 2024-12-18T00:10:03.5059566Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 12s local ... 2024-12-18T00:10:03.8821206Z 2024-12-18T00:10:03.8822100Z  2024-12-18T00:10:03.8822486Z  2024-12-18T00:10:03.8822791Z  2024-12-18T00:10:03.8823090Z  2024-12-18T00:10:03.8823396Z  2024-12-18T00:10:03.8823694Z  2024-12-18T00:10:03.8824008Z  2024-12-18T00:10:03.8824311Z  2024-12-18T00:10:03.8824796Z [14,314 / 15,187] 48 actions, 47 running 2024-12-18T00:10:03.8825825Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:10:03.8826681Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2024-12-18T00:10:03.8827505Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:10:03.8828503Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T00:10:03.8829504Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:10:03.8830457Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2024-12-18T00:10:03.8831311Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 13s local 2024-12-18T00:10:03.8832205Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 12s local ... 2024-12-18T00:10:04.1052787Z 2024-12-18T00:10:04.1053636Z  2024-12-18T00:10:04.1054086Z  2024-12-18T00:10:04.1054425Z  2024-12-18T00:10:04.1054789Z  2024-12-18T00:10:04.1055162Z  2024-12-18T00:10:04.1055507Z  2024-12-18T00:10:04.1055904Z  2024-12-18T00:10:04.1056286Z  2024-12-18T00:10:04.1056978Z [14,316 / 15,187] 48 actions running 2024-12-18T00:10:04.1057795Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:10:04.1058763Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2024-12-18T00:10:04.1059882Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:10:04.1060906Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T00:10:04.1061958Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:10:04.1063089Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2024-12-18T00:10:04.1064005Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 13s local 2024-12-18T00:10:04.1064886Z Compiling llvm/lib/Target/X86/X86FastPreTileConfig.cpp; 11s local ... 2024-12-18T00:10:04.3056845Z 2024-12-18T00:10:04.3057780Z  2024-12-18T00:10:04.3058249Z  2024-12-18T00:10:04.3058656Z  2024-12-18T00:10:04.3059036Z  2024-12-18T00:10:04.3059411Z  2024-12-18T00:10:04.3059769Z  2024-12-18T00:10:04.3060121Z  2024-12-18T00:10:04.3060467Z  2024-12-18T00:10:04.3060981Z [14,317 / 15,187] 48 actions running 2024-12-18T00:10:04.3062075Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:10:04.3063011Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2024-12-18T00:10:04.3064007Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:10:04.3065172Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T00:10:04.3066259Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:10:04.3067313Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2024-12-18T00:10:04.3068302Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 13s local 2024-12-18T00:10:04.3069084Z @llvm-project//mlir:ComplexToLLVM; 11s local ... 2024-12-18T00:10:04.5900858Z 2024-12-18T00:10:04.5901733Z  2024-12-18T00:10:04.5902182Z  2024-12-18T00:10:04.5902554Z  2024-12-18T00:10:04.5902925Z  2024-12-18T00:10:04.5903317Z  2024-12-18T00:10:04.5903691Z  2024-12-18T00:10:04.5904077Z  2024-12-18T00:10:04.5904457Z  2024-12-18T00:10:04.5905283Z [14,319 / 15,187] 48 actions, 47 running 2024-12-18T00:10:04.5906173Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:10:04.5907459Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2024-12-18T00:10:04.5908518Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:10:04.5909604Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T00:10:04.5910714Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:10:04.5912046Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2024-12-18T00:10:04.5913036Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 13s local 2024-12-18T00:10:04.5913834Z @llvm-project//mlir:ComplexToLLVM; 11s local ... 2024-12-18T00:10:04.9062757Z 2024-12-18T00:10:04.9063640Z  2024-12-18T00:10:04.9064150Z  2024-12-18T00:10:04.9064534Z  2024-12-18T00:10:04.9064937Z  2024-12-18T00:10:04.9065338Z  2024-12-18T00:10:04.9065763Z  2024-12-18T00:10:04.9066145Z  2024-12-18T00:10:04.9066552Z  2024-12-18T00:10:04.9067153Z [14,320 / 15,187] 48 actions running 2024-12-18T00:10:04.9068029Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:10:04.9069079Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2024-12-18T00:10:04.9070180Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:10:04.9071280Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T00:10:04.9072436Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:10:04.9073663Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2024-12-18T00:10:04.9074616Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 13s local 2024-12-18T00:10:04.9075456Z @llvm-project//mlir:ComplexToLLVM; 11s local ... 2024-12-18T00:10:05.7806262Z 2024-12-18T00:10:05.7807168Z  2024-12-18T00:10:05.7807634Z  2024-12-18T00:10:05.7808046Z  2024-12-18T00:10:05.7808424Z  2024-12-18T00:10:05.7808788Z  2024-12-18T00:10:05.7809157Z  2024-12-18T00:10:05.7809517Z  2024-12-18T00:10:05.7809874Z  2024-12-18T00:10:05.7810442Z [14,321 / 15,187] 48 actions, 47 running 2024-12-18T00:10:05.7811264Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:10:05.7812318Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2024-12-18T00:10:05.7813404Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:10:05.7814459Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T00:10:05.7815604Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:10:05.7817218Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2024-12-18T00:10:05.7818204Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 14s local 2024-12-18T00:10:05.7819014Z @llvm-project//mlir:ComplexToLLVM; 12s local ... 2024-12-18T00:10:06.0378087Z 2024-12-18T00:10:06.0378893Z  2024-12-18T00:10:06.0379343Z  2024-12-18T00:10:06.0379746Z  2024-12-18T00:10:06.0380132Z  2024-12-18T00:10:06.0380537Z  2024-12-18T00:10:06.0380946Z  2024-12-18T00:10:06.0381356Z  2024-12-18T00:10:06.0381766Z  2024-12-18T00:10:06.0382330Z [14,323 / 15,187] 48 actions, 47 running 2024-12-18T00:10:06.0383139Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:10:06.0384123Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2024-12-18T00:10:06.0385226Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:10:06.0386329Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T00:10:06.0387407Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:10:06.0388850Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2024-12-18T00:10:06.0389848Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 14s local 2024-12-18T00:10:06.0390800Z @llvm-project//mlir:ComplexToLLVM; 12s local ... 2024-12-18T00:10:06.3072233Z 2024-12-18T00:10:06.3073139Z  2024-12-18T00:10:06.3073560Z  2024-12-18T00:10:06.3073930Z  2024-12-18T00:10:06.3074317Z  2024-12-18T00:10:06.3074671Z  2024-12-18T00:10:06.3075043Z  2024-12-18T00:10:06.3075751Z  2024-12-18T00:10:06.3076134Z  2024-12-18T00:10:06.3076660Z [14,323 / 15,187] 48 actions running 2024-12-18T00:10:06.3077525Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:10:06.3078584Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2024-12-18T00:10:06.3079492Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:10:06.3080440Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T00:10:06.3081400Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:10:06.3082367Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2024-12-18T00:10:06.3083194Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2024-12-18T00:10:06.3083890Z @llvm-project//mlir:ComplexToLLVM; 13s local ... 2024-12-18T00:10:06.5817891Z 2024-12-18T00:10:06.5818699Z  2024-12-18T00:10:06.5819132Z  2024-12-18T00:10:06.5819546Z  2024-12-18T00:10:06.5819904Z  2024-12-18T00:10:06.5820295Z  2024-12-18T00:10:06.5820674Z  2024-12-18T00:10:06.5821047Z  2024-12-18T00:10:06.5821405Z  2024-12-18T00:10:06.5821958Z [14,324 / 15,187] 48 actions, 47 running 2024-12-18T00:10:06.5822790Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:10:06.5823786Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:10:06.5824780Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T00:10:06.5825830Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:10:06.5826879Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2024-12-18T00:10:06.5827803Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2024-12-18T00:10:06.5828766Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 13s local 2024-12-18T00:10:06.5829904Z Compiling llvm/lib/Target/X86/X86FlagsCopyLowering.cpp; 12s local ... 2024-12-18T00:10:06.9079296Z 2024-12-18T00:10:06.9080172Z  2024-12-18T00:10:06.9080649Z  2024-12-18T00:10:06.9081054Z  2024-12-18T00:10:06.9081464Z  2024-12-18T00:10:06.9081857Z  2024-12-18T00:10:06.9082260Z  2024-12-18T00:10:06.9082993Z  2024-12-18T00:10:06.9083396Z  2024-12-18T00:10:06.9083969Z [14,326 / 15,187] 48 actions running 2024-12-18T00:10:06.9084877Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:10:06.9085961Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:10:06.9087156Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T00:10:06.9088294Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:10:06.9089435Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2024-12-18T00:10:06.9090462Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2024-12-18T00:10:06.9091497Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 13s local 2024-12-18T00:10:06.9092705Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 12s local ... 2024-12-18T00:10:07.2738395Z 2024-12-18T00:10:07.2739257Z  2024-12-18T00:10:07.2739975Z  2024-12-18T00:10:07.2740343Z  2024-12-18T00:10:07.2740700Z  2024-12-18T00:10:07.2741057Z  2024-12-18T00:10:07.2741665Z  2024-12-18T00:10:07.2742009Z  2024-12-18T00:10:07.2742362Z  2024-12-18T00:10:07.2743045Z [14,327 / 15,187] 48 actions, 47 running 2024-12-18T00:10:07.2743854Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:10:07.2745097Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:10:07.2746089Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T00:10:07.2747234Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:10:07.2748140Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:10:07.2748916Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2024-12-18T00:10:07.2749726Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:10:07.2750667Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 12s local ... 2024-12-18T00:10:07.5085358Z 2024-12-18T00:10:07.5086214Z  2024-12-18T00:10:07.5086699Z  2024-12-18T00:10:07.5087094Z  2024-12-18T00:10:07.5087511Z  2024-12-18T00:10:07.5087919Z  2024-12-18T00:10:07.5088308Z  2024-12-18T00:10:07.5088714Z  2024-12-18T00:10:07.5089140Z  2024-12-18T00:10:07.5089751Z [14,329 / 15,187] 48 actions running 2024-12-18T00:10:07.5090541Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:10:07.5091428Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:10:07.5092503Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T00:10:07.5093590Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:10:07.5094732Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2024-12-18T00:10:07.5095743Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:10:07.5097052Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 12s local 2024-12-18T00:10:07.5098052Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 12s local ... 2024-12-18T00:10:07.8024429Z 2024-12-18T00:10:07.8025329Z  2024-12-18T00:10:07.8025814Z  2024-12-18T00:10:07.8026198Z  2024-12-18T00:10:07.8026584Z  2024-12-18T00:10:07.8026954Z  2024-12-18T00:10:07.8027332Z  2024-12-18T00:10:07.8027694Z  2024-12-18T00:10:07.8028078Z  2024-12-18T00:10:07.8028701Z [14,330 / 15,187] 48 actions, 47 running 2024-12-18T00:10:07.8029548Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:10:07.8030600Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:10:07.8031669Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:10:07.8032919Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2024-12-18T00:10:07.8033970Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:10:07.8035129Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local 2024-12-18T00:10:07.8036168Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 12s local 2024-12-18T00:10:07.8037250Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 12s local ... 2024-12-18T00:10:08.1091576Z 2024-12-18T00:10:08.1092463Z  2024-12-18T00:10:08.1092931Z  2024-12-18T00:10:08.1093342Z  2024-12-18T00:10:08.1093734Z  2024-12-18T00:10:08.1094140Z  2024-12-18T00:10:08.1094543Z  2024-12-18T00:10:08.1094940Z  2024-12-18T00:10:08.1095340Z  2024-12-18T00:10:08.1096064Z [14,332 / 15,187] 48 actions running 2024-12-18T00:10:08.1097125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:10:08.1098217Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:10:08.1099713Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:10:08.1100748Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2024-12-18T00:10:08.1101966Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:10:08.1103123Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local 2024-12-18T00:10:08.1104148Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 12s local 2024-12-18T00:10:08.1105072Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 12s local ... 2024-12-18T00:10:08.4957626Z 2024-12-18T00:10:08.4958745Z  2024-12-18T00:10:08.4959243Z  2024-12-18T00:10:08.4959631Z  2024-12-18T00:10:08.4960020Z  2024-12-18T00:10:08.4960419Z  2024-12-18T00:10:08.4960818Z  2024-12-18T00:10:08.4961197Z  2024-12-18T00:10:08.4961583Z  2024-12-18T00:10:08.4962184Z [14,333 / 15,187] 48 actions, 47 running 2024-12-18T00:10:08.4963075Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:10:08.4964084Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:10:08.4965093Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2024-12-18T00:10:08.4966029Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2024-12-18T00:10:08.4967019Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:10:08.4968352Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local 2024-12-18T00:10:08.4969375Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 13s local 2024-12-18T00:10:08.4970404Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 13s local ... 2024-12-18T00:10:08.7097896Z 2024-12-18T00:10:08.7098811Z  2024-12-18T00:10:08.7099304Z  2024-12-18T00:10:08.7099684Z  2024-12-18T00:10:08.7100067Z  2024-12-18T00:10:08.7100468Z  2024-12-18T00:10:08.7100858Z  2024-12-18T00:10:08.7101256Z  2024-12-18T00:10:08.7101648Z  2024-12-18T00:10:08.7102235Z [14,334 / 15,187] 48 actions running 2024-12-18T00:10:08.7103074Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:10:08.7104215Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2024-12-18T00:10:08.7105213Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2024-12-18T00:10:08.7106135Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2024-12-18T00:10:08.7107106Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:10:08.7108180Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:10:08.7109213Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 13s local 2024-12-18T00:10:08.7110194Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 13s local ... 2024-12-18T00:10:09.1460176Z 2024-12-18T00:10:09.1460993Z  2024-12-18T00:10:09.1461479Z  2024-12-18T00:10:09.1461857Z  2024-12-18T00:10:09.1462279Z  2024-12-18T00:10:09.1462662Z  2024-12-18T00:10:09.1463042Z  2024-12-18T00:10:09.1463433Z  2024-12-18T00:10:09.1463830Z  2024-12-18T00:10:09.1464423Z [14,335 / 15,187] 48 actions, 47 running 2024-12-18T00:10:09.1465300Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:10:09.1466372Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2024-12-18T00:10:09.1467520Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2024-12-18T00:10:09.1468527Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T00:10:09.1469573Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:10:09.1470756Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:10:09.1471784Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 13s local 2024-12-18T00:10:09.1473023Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 13s local ... 2024-12-18T00:10:09.4923092Z 2024-12-18T00:10:09.4923948Z  2024-12-18T00:10:09.4924412Z  2024-12-18T00:10:09.4925099Z  2024-12-18T00:10:09.4925517Z  2024-12-18T00:10:09.4926052Z  2024-12-18T00:10:09.4926430Z  2024-12-18T00:10:09.4926748Z  2024-12-18T00:10:09.4927116Z  2024-12-18T00:10:09.4927682Z [14,337 / 15,187] 48 actions, 47 running 2024-12-18T00:10:09.4928538Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:10:09.4929625Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2024-12-18T00:10:09.4930661Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2024-12-18T00:10:09.4931599Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T00:10:09.4932612Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:10:09.4933799Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:10:09.4934856Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 14s local 2024-12-18T00:10:09.4935825Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 14s local ... 2024-12-18T00:10:09.7093161Z 2024-12-18T00:10:09.7093989Z  2024-12-18T00:10:09.7094423Z  2024-12-18T00:10:09.7094781Z  2024-12-18T00:10:09.7095140Z  2024-12-18T00:10:09.7095495Z  2024-12-18T00:10:09.7095837Z  2024-12-18T00:10:09.7096189Z  2024-12-18T00:10:09.7096679Z  2024-12-18T00:10:09.7097250Z [14,338 / 15,187] 48 actions, 47 running 2024-12-18T00:10:09.7098015Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:10:09.7099060Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 24s local 2024-12-18T00:10:09.7100045Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2024-12-18T00:10:09.7100937Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T00:10:09.7101867Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:10:09.7102971Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:10:09.7103936Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 14s local 2024-12-18T00:10:09.7104838Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 14s local ... 2024-12-18T00:10:09.9107039Z 2024-12-18T00:10:09.9107882Z  2024-12-18T00:10:09.9108284Z  2024-12-18T00:10:09.9108626Z  2024-12-18T00:10:09.9108966Z  2024-12-18T00:10:09.9109332Z  2024-12-18T00:10:09.9109668Z  2024-12-18T00:10:09.9109985Z  2024-12-18T00:10:09.9110315Z  2024-12-18T00:10:09.9110954Z [14,338 / 15,187] 48 actions running 2024-12-18T00:10:09.9111731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:10:09.9112967Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 24s local 2024-12-18T00:10:09.9113823Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2024-12-18T00:10:09.9114619Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T00:10:09.9115484Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:10:09.9116459Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:10:09.9117341Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 14s local 2024-12-18T00:10:09.9118179Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 14s local ... 2024-12-18T00:10:10.3225161Z 2024-12-18T00:10:10.3226016Z  2024-12-18T00:10:10.3226504Z  2024-12-18T00:10:10.3226918Z  2024-12-18T00:10:10.3227306Z  2024-12-18T00:10:10.3227675Z  2024-12-18T00:10:10.3228041Z  2024-12-18T00:10:10.3228420Z  2024-12-18T00:10:10.3228797Z  2024-12-18T00:10:10.3229390Z [14,339 / 15,187] 48 actions, 47 running 2024-12-18T00:10:10.3230530Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:10:10.3231564Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 24s local 2024-12-18T00:10:10.3232932Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:10:10.3233909Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2024-12-18T00:10:10.3234879Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:10:10.3235925Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 15s local 2024-12-18T00:10:10.3237258Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 14s local 2024-12-18T00:10:10.3238293Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 14s local ... 2024-12-18T00:10:10.7114558Z 2024-12-18T00:10:10.7115423Z  2024-12-18T00:10:10.7115914Z  2024-12-18T00:10:10.7116301Z  2024-12-18T00:10:10.7116728Z  2024-12-18T00:10:10.7117095Z  2024-12-18T00:10:10.7117428Z  2024-12-18T00:10:10.7117788Z  2024-12-18T00:10:10.7118155Z  2024-12-18T00:10:10.7118715Z [14,340 / 15,187] 48 actions running 2024-12-18T00:10:10.7119542Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:10:10.7120606Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:10:10.7121554Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2024-12-18T00:10:10.7122443Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:10:10.7123650Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 15s local 2024-12-18T00:10:10.7124765Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 15s local 2024-12-18T00:10:10.7125771Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 14s local 2024-12-18T00:10:10.7126841Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 14s local ... 2024-12-18T00:10:11.1593470Z 2024-12-18T00:10:11.1594381Z  2024-12-18T00:10:11.1594864Z  2024-12-18T00:10:11.1595226Z  2024-12-18T00:10:11.1595636Z  2024-12-18T00:10:11.1596008Z  2024-12-18T00:10:11.1596404Z  2024-12-18T00:10:11.1596796Z  2024-12-18T00:10:11.1597186Z  2024-12-18T00:10:11.1597840Z [14,341 / 15,187] 48 actions, 47 running 2024-12-18T00:10:11.1598709Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:10:11.1599718Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:10:11.1600653Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2024-12-18T00:10:11.1601598Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:10:11.1602611Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 15s local 2024-12-18T00:10:11.1603546Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 15s local 2024-12-18T00:10:11.1604453Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 15s local 2024-12-18T00:10:11.1605818Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 15s local ... 2024-12-18T00:10:11.3706129Z 2024-12-18T00:10:11.3707058Z  2024-12-18T00:10:11.3707519Z  2024-12-18T00:10:11.3707864Z  2024-12-18T00:10:11.3708247Z  2024-12-18T00:10:11.3708648Z  2024-12-18T00:10:11.3709043Z  2024-12-18T00:10:11.3709409Z  2024-12-18T00:10:11.3709772Z  2024-12-18T00:10:11.3710318Z [14,342 / 15,187] 48 actions, 47 running 2024-12-18T00:10:11.3711207Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:10:11.3712309Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:10:11.3713233Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2024-12-18T00:10:11.3714237Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:10:11.3715371Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 16s local 2024-12-18T00:10:11.3716269Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 15s local 2024-12-18T00:10:11.3717473Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 15s local 2024-12-18T00:10:11.3718492Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 15s local ... 2024-12-18T00:10:11.7123701Z 2024-12-18T00:10:11.7124577Z  2024-12-18T00:10:11.7125053Z  2024-12-18T00:10:11.7125436Z  2024-12-18T00:10:11.7125839Z  2024-12-18T00:10:11.7126232Z  2024-12-18T00:10:11.7126610Z  2024-12-18T00:10:11.7127012Z  2024-12-18T00:10:11.7127391Z  2024-12-18T00:10:11.7128248Z [14,343 / 15,187] 48 actions running 2024-12-18T00:10:11.7129127Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:10:11.7130162Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:10:11.7131160Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2024-12-18T00:10:11.7132149Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:10:11.7133193Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 16s local 2024-12-18T00:10:11.7134133Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 16s local 2024-12-18T00:10:11.7135086Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 15s local 2024-12-18T00:10:11.7136107Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 15s local ... 2024-12-18T00:10:12.0644532Z 2024-12-18T00:10:12.0645419Z  2024-12-18T00:10:12.0645867Z  2024-12-18T00:10:12.0646445Z  2024-12-18T00:10:12.0646837Z  2024-12-18T00:10:12.0647206Z  2024-12-18T00:10:12.0647607Z  2024-12-18T00:10:12.0647935Z  2024-12-18T00:10:12.0648291Z  2024-12-18T00:10:12.0648871Z [14,344 / 15,187] 48 actions, 47 running 2024-12-18T00:10:12.0649722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:10:12.0650747Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:10:12.0651698Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T00:10:12.0652658Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:10:12.0653674Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 16s local 2024-12-18T00:10:12.0654604Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 16s local 2024-12-18T00:10:12.0655391Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 16s local 2024-12-18T00:10:12.0656165Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 16s local ... 2024-12-18T00:10:12.3128622Z 2024-12-18T00:10:12.3129423Z  2024-12-18T00:10:12.3129917Z  2024-12-18T00:10:12.3130280Z  2024-12-18T00:10:12.3130628Z  2024-12-18T00:10:12.3130980Z  2024-12-18T00:10:12.3131360Z  2024-12-18T00:10:12.3131724Z  2024-12-18T00:10:12.3132077Z  2024-12-18T00:10:12.3132716Z [14,344 / 15,187] 48 actions running 2024-12-18T00:10:12.3133817Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:10:12.3134824Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:10:12.3135699Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T00:10:12.3136732Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:10:12.3137609Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local 2024-12-18T00:10:12.3138440Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 16s local 2024-12-18T00:10:12.3139250Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 16s local 2024-12-18T00:10:12.3140131Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 16s local ... 2024-12-18T00:10:12.5306165Z 2024-12-18T00:10:12.5307077Z  2024-12-18T00:10:12.5307633Z  2024-12-18T00:10:12.5308107Z  2024-12-18T00:10:12.5308582Z  2024-12-18T00:10:12.5308955Z  2024-12-18T00:10:12.5309381Z  2024-12-18T00:10:12.5309764Z  2024-12-18T00:10:12.5310116Z  2024-12-18T00:10:12.5310892Z [14,346 / 15,187] 47 actions, 46 running 2024-12-18T00:10:12.5311659Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:10:12.5312702Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:10:12.5313546Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T00:10:12.5314404Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:10:12.5315389Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local 2024-12-18T00:10:12.5316433Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 17s local 2024-12-18T00:10:12.5317297Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 16s local 2024-12-18T00:10:12.5318212Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:10:12.8255352Z 2024-12-18T00:10:12.8256274Z  2024-12-18T00:10:12.8256977Z  2024-12-18T00:10:12.8257388Z  2024-12-18T00:10:12.8257805Z  2024-12-18T00:10:12.8258220Z  2024-12-18T00:10:12.8258648Z  2024-12-18T00:10:12.8259049Z  2024-12-18T00:10:12.8259424Z  2024-12-18T00:10:12.8260027Z [14,347 / 15,187] 48 actions, 47 running 2024-12-18T00:10:12.8260893Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:10:12.8261843Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:10:12.8262730Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T00:10:12.8263699Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2024-12-18T00:10:12.8264638Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local 2024-12-18T00:10:12.8265508Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 17s local 2024-12-18T00:10:12.8266416Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 17s local 2024-12-18T00:10:12.8267432Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:10:13.0757708Z 2024-12-18T00:10:13.0764316Z  2024-12-18T00:10:13.0765046Z  2024-12-18T00:10:13.0765606Z  2024-12-18T00:10:13.0766021Z  2024-12-18T00:10:13.0766531Z  2024-12-18T00:10:13.0766823Z  2024-12-18T00:10:13.0767326Z  2024-12-18T00:10:13.0767732Z  2024-12-18T00:10:13.0768689Z [14,349 / 15,187] 48 actions, 47 running 2024-12-18T00:10:13.0769688Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:10:13.0771040Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:10:13.0772126Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2024-12-18T00:10:13.0773403Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2024-12-18T00:10:13.0774290Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local 2024-12-18T00:10:13.0775514Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 17s local 2024-12-18T00:10:13.0776568Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 17s local 2024-12-18T00:10:13.0777616Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:10:13.3134384Z 2024-12-18T00:10:13.3135355Z  2024-12-18T00:10:13.3135868Z  2024-12-18T00:10:13.3136264Z  2024-12-18T00:10:13.3136841Z  2024-12-18T00:10:13.3137246Z  2024-12-18T00:10:13.3137638Z  2024-12-18T00:10:13.3137997Z  2024-12-18T00:10:13.3138377Z  2024-12-18T00:10:13.3138955Z [14,350 / 15,187] 48 actions running 2024-12-18T00:10:13.3139815Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:10:13.3140814Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:10:13.3141727Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2024-12-18T00:10:13.3142798Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2024-12-18T00:10:13.3143797Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 18s local 2024-12-18T00:10:13.3145254Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 17s local 2024-12-18T00:10:13.3146210Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 17s local 2024-12-18T00:10:13.3147326Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:10:13.5647209Z 2024-12-18T00:10:13.5648193Z  2024-12-18T00:10:13.5648714Z  2024-12-18T00:10:13.5649128Z  2024-12-18T00:10:13.5649527Z  2024-12-18T00:10:13.5649902Z  2024-12-18T00:10:13.5650297Z  2024-12-18T00:10:13.5650981Z  2024-12-18T00:10:13.5651400Z  2024-12-18T00:10:13.5651963Z [14,353 / 15,187] 48 actions, 47 running 2024-12-18T00:10:13.5652812Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:10:13.5653874Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:10:13.5654843Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2024-12-18T00:10:13.5655797Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2024-12-18T00:10:13.5656961Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local 2024-12-18T00:10:13.5657875Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 17s local 2024-12-18T00:10:13.5658862Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:10:13.5660056Z .../service/memory_space_assignment:memory_space_assignment; 15s local ... 2024-12-18T00:10:13.8077991Z 2024-12-18T00:10:13.8078930Z  2024-12-18T00:10:13.8079418Z  2024-12-18T00:10:13.8079793Z  2024-12-18T00:10:13.8080159Z  2024-12-18T00:10:13.8080561Z  2024-12-18T00:10:13.8080944Z  2024-12-18T00:10:13.8081328Z  2024-12-18T00:10:13.8081697Z  2024-12-18T00:10:13.8082235Z [14,354 / 15,187] 48 actions, 47 running 2024-12-18T00:10:13.8083080Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:10:13.8084064Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:10:13.8084995Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2024-12-18T00:10:13.8085916Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:10:13.8086867Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local 2024-12-18T00:10:13.8087718Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local 2024-12-18T00:10:13.8088667Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:10:13.8089715Z .../service/memory_space_assignment:memory_space_assignment; 15s local ... 2024-12-18T00:10:14.1141276Z 2024-12-18T00:10:14.1142167Z  2024-12-18T00:10:14.1142643Z  2024-12-18T00:10:14.1143050Z  2024-12-18T00:10:14.1143448Z  2024-12-18T00:10:14.1143798Z  2024-12-18T00:10:14.1146801Z  2024-12-18T00:10:14.1147190Z  2024-12-18T00:10:14.1147576Z  2024-12-18T00:10:14.1148157Z [14,354 / 15,187] 48 actions running 2024-12-18T00:10:14.1149023Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:10:14.1150107Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:10:14.1151107Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 23s local 2024-12-18T00:10:14.1152024Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:10:14.1153041Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local 2024-12-18T00:10:14.1153988Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local 2024-12-18T00:10:14.1154955Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:10:14.1155996Z .../service/memory_space_assignment:memory_space_assignment; 16s local ... 2024-12-18T00:10:14.5147721Z 2024-12-18T00:10:14.5148579Z  2024-12-18T00:10:14.5149099Z  2024-12-18T00:10:14.5149483Z  2024-12-18T00:10:14.5149844Z  2024-12-18T00:10:14.5150225Z  2024-12-18T00:10:14.5150915Z  2024-12-18T00:10:14.5151319Z  2024-12-18T00:10:14.5151684Z  2024-12-18T00:10:14.5152365Z [14,356 / 15,187] 48 actions running 2024-12-18T00:10:14.5153179Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:10:14.5154183Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:10:14.5155271Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:10:14.5156444Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2024-12-18T00:10:14.5157390Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local 2024-12-18T00:10:14.5158426Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:10:14.5159502Z .../xla/service/memory_space_assignment:memory_space_assignment; 16s local 2024-12-18T00:10:14.5160632Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local ... 2024-12-18T00:10:15.4583499Z 2024-12-18T00:10:15.4584405Z  2024-12-18T00:10:15.4584898Z  2024-12-18T00:10:15.4585299Z  2024-12-18T00:10:15.4585717Z  2024-12-18T00:10:15.4586115Z  2024-12-18T00:10:15.4586504Z  2024-12-18T00:10:15.4586900Z  2024-12-18T00:10:15.4587308Z  2024-12-18T00:10:15.4587849Z [14,357 / 15,187] 48 actions, 47 running 2024-12-18T00:10:15.4588753Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:10:15.4589848Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:10:15.4590940Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2024-12-18T00:10:15.4592045Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T00:10:15.4593037Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local 2024-12-18T00:10:15.4594150Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:10:15.4595335Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2024-12-18T00:10:15.4596550Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local ... 2024-12-18T00:10:15.7156298Z 2024-12-18T00:10:15.7157475Z  2024-12-18T00:10:15.7157952Z  2024-12-18T00:10:15.7158346Z  2024-12-18T00:10:15.7158724Z  2024-12-18T00:10:15.7159117Z  2024-12-18T00:10:15.7159492Z  2024-12-18T00:10:15.7159864Z  2024-12-18T00:10:15.7160243Z  2024-12-18T00:10:15.7160831Z [14,357 / 15,187] 48 actions running 2024-12-18T00:10:15.7161714Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:10:15.7162805Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:10:15.7163904Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2024-12-18T00:10:15.7165283Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T00:10:15.7166208Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local 2024-12-18T00:10:15.7167210Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:10:15.7168365Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2024-12-18T00:10:15.7169505Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local ... 2024-12-18T00:10:15.9161857Z 2024-12-18T00:10:15.9162720Z  2024-12-18T00:10:15.9163187Z  2024-12-18T00:10:15.9163550Z  2024-12-18T00:10:15.9163914Z  2024-12-18T00:10:15.9164309Z  2024-12-18T00:10:15.9164691Z  2024-12-18T00:10:15.9165072Z  2024-12-18T00:10:15.9165459Z  2024-12-18T00:10:15.9165997Z [14,358 / 15,187] 48 actions running 2024-12-18T00:10:15.9166812Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:10:15.9167814Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:10:15.9169129Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2024-12-18T00:10:15.9170114Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T00:10:15.9171166Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2024-12-18T00:10:15.9172208Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:10:15.9173253Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:10:15.9174417Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local ... 2024-12-18T00:10:16.2694978Z 2024-12-18T00:10:16.2695787Z  2024-12-18T00:10:16.2696248Z  2024-12-18T00:10:16.2696741Z  2024-12-18T00:10:16.2697133Z  2024-12-18T00:10:16.2697517Z  2024-12-18T00:10:16.2697888Z  2024-12-18T00:10:16.2698234Z  2024-12-18T00:10:16.2698627Z  2024-12-18T00:10:16.2699249Z [14,362 / 15,187] 48 actions, 47 running 2024-12-18T00:10:16.2700171Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:10:16.2701222Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:10:16.2702253Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2024-12-18T00:10:16.2703286Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T00:10:16.2704160Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2024-12-18T00:10:16.2705112Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:10:16.2706220Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:10:16.2707316Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local ... 2024-12-18T00:10:16.5168631Z 2024-12-18T00:10:16.5169515Z  2024-12-18T00:10:16.5169956Z  2024-12-18T00:10:16.5170366Z  2024-12-18T00:10:16.5170730Z  2024-12-18T00:10:16.5171095Z  2024-12-18T00:10:16.5171449Z  2024-12-18T00:10:16.5171843Z  2024-12-18T00:10:16.5172214Z  2024-12-18T00:10:16.5172797Z [14,363 / 15,187] 48 actions running 2024-12-18T00:10:16.5173578Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:10:16.5174530Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:10:16.5175541Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2024-12-18T00:10:16.5176588Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2024-12-18T00:10:16.5177464Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2024-12-18T00:10:16.5178494Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:10:16.5179489Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:10:16.5180547Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local ... 2024-12-18T00:10:16.7172709Z 2024-12-18T00:10:16.7173614Z  2024-12-18T00:10:16.7174117Z  2024-12-18T00:10:16.7174524Z  2024-12-18T00:10:16.7174932Z  2024-12-18T00:10:16.7175341Z  2024-12-18T00:10:16.7175751Z  2024-12-18T00:10:16.7176123Z  2024-12-18T00:10:16.7176606Z  2024-12-18T00:10:16.7177143Z [14,364 / 15,187] 48 actions running 2024-12-18T00:10:16.7177976Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:10:16.7178943Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:10:16.7179966Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:10:16.7180922Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2024-12-18T00:10:16.7181784Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2024-12-18T00:10:16.7182839Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:10:16.7183890Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:10:16.7185247Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local ... 2024-12-18T00:10:17.2563658Z 2024-12-18T00:10:17.2564798Z  2024-12-18T00:10:17.2565299Z  2024-12-18T00:10:17.2565698Z  2024-12-18T00:10:17.2566114Z  2024-12-18T00:10:17.2566517Z  2024-12-18T00:10:17.2566876Z  2024-12-18T00:10:17.2567261Z  2024-12-18T00:10:17.2567664Z  2024-12-18T00:10:17.2568270Z [14,365 / 15,187] 48 actions, 47 running 2024-12-18T00:10:17.2569354Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:10:17.2570432Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:10:17.2571480Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:10:17.2572440Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2024-12-18T00:10:17.2573373Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2024-12-18T00:10:17.2574370Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:10:17.2575469Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2024-12-18T00:10:17.2576761Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local ... 2024-12-18T00:10:17.5126882Z 2024-12-18T00:10:17.5127733Z  2024-12-18T00:10:17.5128158Z  2024-12-18T00:10:17.5128506Z  2024-12-18T00:10:17.5128865Z  2024-12-18T00:10:17.5129238Z  2024-12-18T00:10:17.5129592Z  2024-12-18T00:10:17.5130034Z  2024-12-18T00:10:17.5130401Z  2024-12-18T00:10:17.5130922Z [14,366 / 15,187] 48 actions, 47 running 2024-12-18T00:10:17.5131768Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:10:17.5132906Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:10:17.5134056Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:10:17.5135133Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2024-12-18T00:10:17.5136038Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2024-12-18T00:10:17.5137223Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:10:17.5138241Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2024-12-18T00:10:17.5139407Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local ... 2024-12-18T00:10:17.7180859Z 2024-12-18T00:10:17.7181807Z  2024-12-18T00:10:17.7182423Z  2024-12-18T00:10:17.7182839Z  2024-12-18T00:10:17.7183220Z  2024-12-18T00:10:17.7183610Z  2024-12-18T00:10:17.7184002Z  2024-12-18T00:10:17.7184396Z  2024-12-18T00:10:17.7184788Z  2024-12-18T00:10:17.7185360Z [14,366 / 15,187] 48 actions running 2024-12-18T00:10:17.7186547Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:10:17.7187748Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:10:17.7188804Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2024-12-18T00:10:17.7189744Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2024-12-18T00:10:17.7190614Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2024-12-18T00:10:17.7191640Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:10:17.7192749Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2024-12-18T00:10:17.7193889Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local ... 2024-12-18T00:10:17.9184483Z 2024-12-18T00:10:17.9185326Z  2024-12-18T00:10:17.9185787Z  2024-12-18T00:10:17.9186152Z  2024-12-18T00:10:17.9186561Z  2024-12-18T00:10:17.9186958Z  2024-12-18T00:10:17.9187364Z  2024-12-18T00:10:17.9187789Z  2024-12-18T00:10:17.9188180Z  2024-12-18T00:10:17.9189004Z [14,367 / 15,187] 48 actions running 2024-12-18T00:10:17.9189868Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:10:17.9190954Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:10:17.9192027Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2024-12-18T00:10:17.9193070Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2024-12-18T00:10:17.9193897Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2024-12-18T00:10:17.9195091Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:10:17.9196093Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2024-12-18T00:10:17.9197186Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local ... 2024-12-18T00:10:18.6001366Z 2024-12-18T00:10:18.6002239Z  2024-12-18T00:10:18.6002736Z  2024-12-18T00:10:18.6003122Z  2024-12-18T00:10:18.6003526Z  2024-12-18T00:10:18.6003873Z  2024-12-18T00:10:18.6004222Z  2024-12-18T00:10:18.6004601Z  2024-12-18T00:10:18.6004996Z  2024-12-18T00:10:18.6005562Z [14,368 / 15,187] 48 actions, 47 running 2024-12-18T00:10:18.6006384Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:10:18.6007367Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2024-12-18T00:10:18.6008460Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2024-12-18T00:10:18.6009509Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2024-12-18T00:10:18.6010395Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2024-12-18T00:10:18.6011364Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:10:18.6012393Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2024-12-18T00:10:18.6013439Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local ... 2024-12-18T00:10:18.9194533Z 2024-12-18T00:10:18.9195444Z  2024-12-18T00:10:18.9195847Z  2024-12-18T00:10:18.9196213Z  2024-12-18T00:10:18.9196593Z  2024-12-18T00:10:18.9196960Z  2024-12-18T00:10:18.9197353Z  2024-12-18T00:10:18.9197728Z  2024-12-18T00:10:18.9198115Z  2024-12-18T00:10:18.9198665Z [14,369 / 15,187] 48 actions running 2024-12-18T00:10:18.9199459Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:10:18.9200424Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2024-12-18T00:10:18.9201425Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2024-12-18T00:10:18.9202387Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2024-12-18T00:10:18.9203278Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2024-12-18T00:10:18.9204598Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:10:18.9205647Z .../xla/service/memory_space_assignment:memory_space_assignment; 21s local 2024-12-18T00:10:18.9206625Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 17s local ... 2024-12-18T00:10:19.3198035Z 2024-12-18T00:10:19.3198862Z  2024-12-18T00:10:19.3199274Z  2024-12-18T00:10:19.3199627Z  2024-12-18T00:10:19.3199950Z  2024-12-18T00:10:19.3200290Z  2024-12-18T00:10:19.3200647Z  2024-12-18T00:10:19.3200976Z  2024-12-18T00:10:19.3201311Z  2024-12-18T00:10:19.3201838Z [14,373 / 15,187] 48 actions running 2024-12-18T00:10:19.3202592Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:10:19.3203523Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2024-12-18T00:10:19.3204417Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2024-12-18T00:10:19.3205242Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2024-12-18T00:10:19.3206338Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:10:19.3207196Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 17s local 2024-12-18T00:10:19.3208090Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local 2024-12-18T00:10:19.3208850Z Compiling xla/service/buffer_assignment.cc; 13s local ... 2024-12-18T00:10:20.3071930Z 2024-12-18T00:10:20.3072846Z  2024-12-18T00:10:20.3073217Z  2024-12-18T00:10:20.3073555Z  2024-12-18T00:10:20.3073866Z  2024-12-18T00:10:20.3074423Z  2024-12-18T00:10:20.3074735Z  2024-12-18T00:10:20.3075023Z  2024-12-18T00:10:20.3075331Z  2024-12-18T00:10:20.3075823Z [14,374 / 15,187] 48 actions, 47 running 2024-12-18T00:10:20.3076518Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:10:20.3077328Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:10:20.3078097Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2024-12-18T00:10:20.3078818Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2024-12-18T00:10:20.3079590Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:10:20.3080346Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2024-12-18T00:10:20.3081003Z Compiling xla/service/buffer_assignment.cc; 14s local 2024-12-18T00:10:20.3081622Z @llvm-project//mlir:SparseTensorDialect; 14s local ... 2024-12-18T00:10:20.5208534Z 2024-12-18T00:10:20.5209445Z  2024-12-18T00:10:20.5209958Z  2024-12-18T00:10:20.5210370Z  2024-12-18T00:10:20.5210761Z  2024-12-18T00:10:20.5211163Z  2024-12-18T00:10:20.5211569Z  2024-12-18T00:10:20.5211957Z  2024-12-18T00:10:20.5212290Z  2024-12-18T00:10:20.5212855Z [14,374 / 15,187] 48 actions running 2024-12-18T00:10:20.5213753Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:10:20.5214876Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:10:20.5215941Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2024-12-18T00:10:20.5217070Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2024-12-18T00:10:20.5218101Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:10:20.5219069Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2024-12-18T00:10:20.5219897Z Compiling xla/service/buffer_assignment.cc; 14s local 2024-12-18T00:10:20.5220746Z @llvm-project//mlir:SparseTensorDialect; 14s local ... 2024-12-18T00:10:20.9516658Z 2024-12-18T00:10:20.9517509Z  2024-12-18T00:10:20.9517958Z  2024-12-18T00:10:20.9518351Z  2024-12-18T00:10:20.9518744Z  2024-12-18T00:10:20.9519103Z  2024-12-18T00:10:20.9519491Z  2024-12-18T00:10:20.9520137Z  2024-12-18T00:10:20.9520519Z  2024-12-18T00:10:20.9521091Z [14,375 / 15,187] 48 actions, 47 running 2024-12-18T00:10:20.9521952Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:10:20.9523007Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2024-12-18T00:10:20.9524014Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2024-12-18T00:10:20.9524923Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T00:10:20.9525897Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:10:20.9526845Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2024-12-18T00:10:20.9527677Z Compiling xla/service/buffer_assignment.cc; 15s local 2024-12-18T00:10:20.9528476Z @llvm-project//mlir:SparseTensorDialect; 14s local ... 2024-12-18T00:10:21.3215705Z 2024-12-18T00:10:21.3216739Z  2024-12-18T00:10:21.3217217Z  2024-12-18T00:10:21.3217637Z  2024-12-18T00:10:21.3218019Z  2024-12-18T00:10:21.3218397Z  2024-12-18T00:10:21.3218798Z  2024-12-18T00:10:21.3219479Z  2024-12-18T00:10:21.3219902Z  2024-12-18T00:10:21.3220453Z [14,376 / 15,187] 48 actions running 2024-12-18T00:10:21.3221454Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:10:21.3222445Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2024-12-18T00:10:21.3223401Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2024-12-18T00:10:21.3224293Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T00:10:21.3225467Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:10:21.3226442Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2024-12-18T00:10:21.3227218Z Compiling xla/service/buffer_assignment.cc; 15s local 2024-12-18T00:10:21.3227962Z @llvm-project//mlir:SparseTensorDialect; 15s local ... 2024-12-18T00:10:21.5301329Z 2024-12-18T00:10:21.5302212Z  2024-12-18T00:10:21.5302687Z  2024-12-18T00:10:21.5303098Z  2024-12-18T00:10:21.5303486Z  2024-12-18T00:10:21.5303858Z  2024-12-18T00:10:21.5304256Z  2024-12-18T00:10:21.5304621Z  2024-12-18T00:10:21.5305007Z  2024-12-18T00:10:21.5305573Z [14,377 / 15,187] 48 actions, 47 running 2024-12-18T00:10:21.5306393Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:10:21.5307396Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2024-12-18T00:10:21.5308342Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2024-12-18T00:10:21.5309205Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T00:10:21.5310119Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:10:21.5311056Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2024-12-18T00:10:21.5311858Z Compiling xla/service/buffer_assignment.cc; 15s local 2024-12-18T00:10:21.5312631Z @llvm-project//mlir:SparseTensorDialect; 15s local ... 2024-12-18T00:10:21.9224179Z 2024-12-18T00:10:21.9225079Z  2024-12-18T00:10:21.9225612Z  2024-12-18T00:10:21.9226002Z  2024-12-18T00:10:21.9226410Z  2024-12-18T00:10:21.9226803Z  2024-12-18T00:10:21.9227208Z  2024-12-18T00:10:21.9227568Z  2024-12-18T00:10:21.9227933Z  2024-12-18T00:10:21.9228484Z [14,378 / 15,187] 48 actions running 2024-12-18T00:10:21.9229336Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:10:21.9230367Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2024-12-18T00:10:21.9231366Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2024-12-18T00:10:21.9232284Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2024-12-18T00:10:21.9233277Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:10:21.9234624Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2024-12-18T00:10:21.9235476Z Compiling xla/service/buffer_assignment.cc; 16s local 2024-12-18T00:10:21.9236295Z @llvm-project//mlir:SparseTensorDialect; 15s local ... 2024-12-18T00:10:22.3230378Z 2024-12-18T00:10:22.3231241Z  2024-12-18T00:10:22.3231716Z  2024-12-18T00:10:22.3232100Z  2024-12-18T00:10:22.3232460Z  2024-12-18T00:10:22.3232835Z  2024-12-18T00:10:22.3233195Z  2024-12-18T00:10:22.3233567Z  2024-12-18T00:10:22.3233917Z  2024-12-18T00:10:22.3234496Z [14,379 / 15,187] 48 actions running 2024-12-18T00:10:22.3235306Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:10:22.3236216Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2024-12-18T00:10:22.3237145Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2024-12-18T00:10:22.3238138Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:10:22.3239360Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2024-12-18T00:10:22.3240174Z Compiling xla/service/buffer_assignment.cc; 16s local 2024-12-18T00:10:22.3241039Z @llvm-project//mlir:SparseTensorDialect; 16s local 2024-12-18T00:10:22.3241724Z @llvm-project//llvm:X86CodeGen; 14s local ... 2024-12-18T00:10:22.9912313Z 2024-12-18T00:10:22.9913185Z  2024-12-18T00:10:22.9913689Z  2024-12-18T00:10:22.9914062Z  2024-12-18T00:10:22.9914414Z  2024-12-18T00:10:22.9914806Z  2024-12-18T00:10:22.9915151Z  2024-12-18T00:10:22.9915913Z  2024-12-18T00:10:22.9916326Z  2024-12-18T00:10:22.9916906Z [14,380 / 15,187] 48 actions, 47 running 2024-12-18T00:10:22.9917731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:10:22.9918663Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2024-12-18T00:10:22.9919554Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2024-12-18T00:10:22.9920533Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2024-12-18T00:10:22.9921441Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2024-12-18T00:10:22.9922202Z Compiling xla/service/buffer_assignment.cc; 17s local 2024-12-18T00:10:22.9922925Z @llvm-project//mlir:SparseTensorDialect; 16s local 2024-12-18T00:10:22.9923572Z @llvm-project//llvm:X86CodeGen; 15s local ... 2024-12-18T00:10:23.3237021Z 2024-12-18T00:10:23.3237909Z  2024-12-18T00:10:23.3238385Z  2024-12-18T00:10:23.3238787Z  2024-12-18T00:10:23.3239237Z  2024-12-18T00:10:23.3239639Z  2024-12-18T00:10:23.3240017Z  2024-12-18T00:10:23.3240400Z  2024-12-18T00:10:23.3240806Z  2024-12-18T00:10:23.3241385Z [14,381 / 15,187] 48 actions running 2024-12-18T00:10:23.3242279Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:10:23.3243316Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2024-12-18T00:10:23.3244436Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2024-12-18T00:10:23.3245328Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2024-12-18T00:10:23.3246193Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2024-12-18T00:10:23.3246930Z Compiling xla/service/buffer_assignment.cc; 17s local 2024-12-18T00:10:23.3247638Z @llvm-project//mlir:SparseTensorDialect; 17s local 2024-12-18T00:10:23.3248476Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 15s local ... 2024-12-18T00:10:23.8269552Z 2024-12-18T00:10:23.8270393Z  2024-12-18T00:10:23.8270810Z  2024-12-18T00:10:23.8271173Z  2024-12-18T00:10:23.8271504Z  2024-12-18T00:10:23.8271844Z  2024-12-18T00:10:23.8272200Z  2024-12-18T00:10:23.8272706Z  2024-12-18T00:10:23.8273038Z  2024-12-18T00:10:23.8273821Z [14,382 / 15,187] 48 actions, 47 running 2024-12-18T00:10:23.8274577Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:10:23.8275429Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 28s local 2024-12-18T00:10:23.8276291Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T00:10:23.8277184Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:10:23.8277988Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 22s local 2024-12-18T00:10:23.8278707Z Compiling xla/service/buffer_assignment.cc; 18s local 2024-12-18T00:10:23.8279418Z @llvm-project//mlir:SparseTensorDialect; 17s local 2024-12-18T00:10:23.8280198Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 15s local ... 2024-12-18T00:10:24.0751567Z 2024-12-18T00:10:24.0752359Z  2024-12-18T00:10:24.0752766Z  2024-12-18T00:10:24.0753096Z  2024-12-18T00:10:24.0753437Z  2024-12-18T00:10:24.0753817Z  2024-12-18T00:10:24.0754160Z  2024-12-18T00:10:24.0754506Z  2024-12-18T00:10:24.0754850Z  2024-12-18T00:10:24.0755681Z [14,386 / 15,187] 48 actions, 47 running 2024-12-18T00:10:24.0756444Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:10:24.0757371Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 28s local 2024-12-18T00:10:24.0758168Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T00:10:24.0759025Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:10:24.0759851Z Compiling xla/service/buffer_assignment.cc; 18s local 2024-12-18T00:10:24.0760621Z @llvm-project//mlir:SparseTensorDialect; 18s local 2024-12-18T00:10:24.0761382Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local 2024-12-18T00:10:24.0762098Z Compiling xla/service/dump.cc; 14s local ... 2024-12-18T00:10:24.2787550Z 2024-12-18T00:10:24.2788395Z  2024-12-18T00:10:24.2788821Z  2024-12-18T00:10:24.2789164Z  2024-12-18T00:10:24.2789490Z  2024-12-18T00:10:24.2789836Z  2024-12-18T00:10:24.2790193Z  2024-12-18T00:10:24.2790562Z  2024-12-18T00:10:24.2790944Z  2024-12-18T00:10:24.2791438Z [14,389 / 15,187] 48 actions, 47 running 2024-12-18T00:10:24.2792212Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:10:24.2793037Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T00:10:24.2793914Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:10:24.2794731Z Compiling xla/service/buffer_assignment.cc; 18s local 2024-12-18T00:10:24.2795364Z @llvm-project//mlir:SparseTensorDialect; 18s local 2024-12-18T00:10:24.2796088Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local 2024-12-18T00:10:24.2796773Z Compiling xla/service/dump.cc; 14s local 2024-12-18T00:10:24.2797346Z Compiling xla/runtime/buffer_use.cc; 13s local ... 2024-12-18T00:10:24.5249099Z 2024-12-18T00:10:24.5250004Z  2024-12-18T00:10:24.5250451Z  2024-12-18T00:10:24.5250816Z  2024-12-18T00:10:24.5251153Z  2024-12-18T00:10:24.5251478Z  2024-12-18T00:10:24.5251805Z  2024-12-18T00:10:24.5252130Z  2024-12-18T00:10:24.5252463Z  2024-12-18T00:10:24.5252950Z [14,389 / 15,187] 48 actions running 2024-12-18T00:10:24.5253661Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:10:24.5254463Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T00:10:24.5255290Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:10:24.5256043Z Compiling xla/service/buffer_assignment.cc; 18s local 2024-12-18T00:10:24.5256841Z @llvm-project//mlir:SparseTensorDialect; 18s local 2024-12-18T00:10:24.5257538Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local 2024-12-18T00:10:24.5258191Z Compiling xla/service/dump.cc; 15s local 2024-12-18T00:10:24.5259086Z Compiling xla/runtime/buffer_use.cc; 14s local ... 2024-12-18T00:10:25.2940925Z 2024-12-18T00:10:25.2941772Z  2024-12-18T00:10:25.2942257Z  2024-12-18T00:10:25.2942812Z  2024-12-18T00:10:25.2943250Z  2024-12-18T00:10:25.2943654Z  2024-12-18T00:10:25.2944033Z  2024-12-18T00:10:25.2944686Z  2024-12-18T00:10:25.2945095Z  2024-12-18T00:10:25.2945673Z [14,390 / 15,187] 48 actions, 47 running 2024-12-18T00:10:25.2946516Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:10:25.2947513Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T00:10:25.2948562Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:10:25.2949520Z Compiling xla/service/buffer_assignment.cc; 19s local 2024-12-18T00:10:25.2950295Z @llvm-project//mlir:SparseTensorDialect; 19s local 2024-12-18T00:10:25.2951206Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local 2024-12-18T00:10:25.2952058Z Compiling xla/service/dump.cc; 15s local 2024-12-18T00:10:25.2953066Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local ... 2024-12-18T00:10:25.5258169Z 2024-12-18T00:10:25.5259340Z  2024-12-18T00:10:25.5259771Z  2024-12-18T00:10:25.5260132Z  2024-12-18T00:10:25.5260506Z  2024-12-18T00:10:25.5260885Z  2024-12-18T00:10:25.5261259Z  2024-12-18T00:10:25.5261626Z  2024-12-18T00:10:25.5261981Z  2024-12-18T00:10:25.5262514Z [14,391 / 15,187] 48 actions running 2024-12-18T00:10:25.5263519Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:10:25.5264459Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T00:10:25.5265428Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:10:25.5266444Z Compiling xla/service/buffer_assignment.cc; 19s local 2024-12-18T00:10:25.5267231Z @llvm-project//mlir:SparseTensorDialect; 19s local 2024-12-18T00:10:25.5268066Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local 2024-12-18T00:10:25.5268859Z Compiling xla/service/dump.cc; 16s local 2024-12-18T00:10:25.5269622Z Compiling xla/service/cpu/buffer_info_util.cc; 14s local ... 2024-12-18T00:10:25.9264143Z 2024-12-18T00:10:25.9265032Z  2024-12-18T00:10:25.9265512Z  2024-12-18T00:10:25.9265884Z  2024-12-18T00:10:25.9266228Z  2024-12-18T00:10:25.9266578Z  2024-12-18T00:10:25.9266932Z  2024-12-18T00:10:25.9267311Z  2024-12-18T00:10:25.9267651Z  2024-12-18T00:10:25.9268192Z [14,392 / 15,187] 48 actions running 2024-12-18T00:10:25.9269050Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:10:25.9270091Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T00:10:25.9271023Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:10:25.9271877Z Compiling xla/service/buffer_assignment.cc; 20s local 2024-12-18T00:10:25.9272600Z @llvm-project//mlir:SparseTensorDialect; 19s local 2024-12-18T00:10:25.9273414Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2024-12-18T00:10:25.9274230Z Compiling xla/service/dump.cc; 16s local 2024-12-18T00:10:25.9275108Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local ... 2024-12-18T00:10:26.2927588Z 2024-12-18T00:10:26.2928453Z  2024-12-18T00:10:26.2928941Z  2024-12-18T00:10:26.2929356Z  2024-12-18T00:10:26.2929764Z  2024-12-18T00:10:26.2930144Z  2024-12-18T00:10:26.2930558Z  2024-12-18T00:10:26.2930919Z  2024-12-18T00:10:26.2931270Z  2024-12-18T00:10:26.2931860Z [14,393 / 15,187] 48 actions, 47 running 2024-12-18T00:10:26.2932696Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:10:26.2933695Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T00:10:26.2934982Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:10:26.2935909Z Compiling xla/service/buffer_assignment.cc; 20s local 2024-12-18T00:10:26.2936737Z @llvm-project//mlir:SparseTensorDialect; 20s local 2024-12-18T00:10:26.2937544Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2024-12-18T00:10:26.2938265Z Compiling xla/service/dump.cc; 16s local 2024-12-18T00:10:26.2939022Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local ... 2024-12-18T00:10:26.5269866Z 2024-12-18T00:10:26.5270751Z  2024-12-18T00:10:26.5271206Z  2024-12-18T00:10:26.5271597Z  2024-12-18T00:10:26.5271940Z  2024-12-18T00:10:26.5272288Z  2024-12-18T00:10:26.5272658Z  2024-12-18T00:10:26.5273028Z  2024-12-18T00:10:26.5273386Z  2024-12-18T00:10:26.5273888Z [14,394 / 15,187] 48 actions running 2024-12-18T00:10:26.5274732Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:10:26.5275947Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T00:10:26.5276898Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:10:26.5277973Z Compiling xla/service/buffer_assignment.cc; 20s local 2024-12-18T00:10:26.5278714Z @llvm-project//mlir:SparseTensorDialect; 20s local 2024-12-18T00:10:26.5279515Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2024-12-18T00:10:26.5280253Z Compiling xla/service/dump.cc; 17s local 2024-12-18T00:10:26.5283127Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local ... 2024-12-18T00:10:26.8157570Z 2024-12-18T00:10:26.8158450Z  2024-12-18T00:10:26.8158914Z  2024-12-18T00:10:26.8159297Z  2024-12-18T00:10:26.8159674Z  2024-12-18T00:10:26.8160018Z  2024-12-18T00:10:26.8160402Z  2024-12-18T00:10:26.8160787Z  2024-12-18T00:10:26.8161190Z  2024-12-18T00:10:26.8161755Z [14,395 / 15,187] 48 actions, 47 running 2024-12-18T00:10:26.8162604Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:10:26.8163554Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T00:10:26.8164685Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:10:26.8165600Z Compiling xla/service/buffer_assignment.cc; 21s local 2024-12-18T00:10:26.8166389Z @llvm-project//mlir:SparseTensorDialect; 20s local 2024-12-18T00:10:26.8167209Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2024-12-18T00:10:26.8167933Z Compiling xla/service/dump.cc; 17s local 2024-12-18T00:10:26.8168717Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local ... 2024-12-18T00:10:27.1276470Z 2024-12-18T00:10:27.1277284Z  2024-12-18T00:10:27.1277767Z  2024-12-18T00:10:27.1278165Z  2024-12-18T00:10:27.1278547Z  2024-12-18T00:10:27.1278991Z  2024-12-18T00:10:27.1279393Z  2024-12-18T00:10:27.1279762Z  2024-12-18T00:10:27.1280210Z  2024-12-18T00:10:27.1280831Z [14,395 / 15,187] 48 actions running 2024-12-18T00:10:27.1281696Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2024-12-18T00:10:27.1282687Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T00:10:27.1283720Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:10:27.1284733Z Compiling xla/service/buffer_assignment.cc; 21s local 2024-12-18T00:10:27.1285584Z @llvm-project//mlir:SparseTensorDialect; 21s local 2024-12-18T00:10:27.1286644Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2024-12-18T00:10:27.1287496Z Compiling xla/service/dump.cc; 17s local 2024-12-18T00:10:27.1288355Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local ... 2024-12-18T00:10:28.0929555Z 2024-12-18T00:10:28.0930674Z  2024-12-18T00:10:28.0931160Z  2024-12-18T00:10:28.0931538Z  2024-12-18T00:10:28.0931899Z  2024-12-18T00:10:28.0932273Z  2024-12-18T00:10:28.0932586Z  2024-12-18T00:10:28.0932952Z  2024-12-18T00:10:28.0933300Z  2024-12-18T00:10:28.0933877Z [14,396 / 15,187] 48 actions, 47 running 2024-12-18T00:10:28.0934620Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:10:28.0935502Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T00:10:28.0936394Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2024-12-18T00:10:28.0937442Z Compiling xla/service/buffer_assignment.cc; 22s local 2024-12-18T00:10:28.0938215Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:10:28.0938868Z Compiling xla/service/dump.cc; 18s local 2024-12-18T00:10:28.0939643Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:10:28.0940519Z Compiling xla/service/executable.cc; 15s local ... 2024-12-18T00:10:28.3282539Z 2024-12-18T00:10:28.3283368Z  2024-12-18T00:10:28.3284153Z  2024-12-18T00:10:28.3284545Z  2024-12-18T00:10:28.3284893Z  2024-12-18T00:10:28.3285230Z  2024-12-18T00:10:28.3285696Z  2024-12-18T00:10:28.3286032Z  2024-12-18T00:10:28.3286384Z  2024-12-18T00:10:28.3286888Z [14,396 / 15,187] 48 actions running 2024-12-18T00:10:28.3287655Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:10:28.3288518Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T00:10:28.3289543Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2024-12-18T00:10:28.3290385Z Compiling xla/service/buffer_assignment.cc; 22s local 2024-12-18T00:10:28.3291065Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:10:28.3291674Z Compiling xla/service/dump.cc; 18s local 2024-12-18T00:10:28.3292423Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:10:28.3293214Z Compiling xla/service/executable.cc; 15s local ... 2024-12-18T00:10:28.5407101Z 2024-12-18T00:10:28.5407972Z  2024-12-18T00:10:28.5408400Z  2024-12-18T00:10:28.5408779Z  2024-12-18T00:10:28.5409133Z  2024-12-18T00:10:28.5409506Z  2024-12-18T00:10:28.5409852Z  2024-12-18T00:10:28.5410210Z  2024-12-18T00:10:28.5410578Z  2024-12-18T00:10:28.5411150Z [14,397 / 15,187] 48 actions, 47 running 2024-12-18T00:10:28.5411890Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:10:28.5412728Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T00:10:28.5413587Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:10:28.5414399Z Compiling xla/service/buffer_assignment.cc; 22s local 2024-12-18T00:10:28.5415090Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:10:28.5415865Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:10:28.5416733Z Compiling xla/service/executable.cc; 16s local 2024-12-18T00:10:28.5417338Z Compiling xla/service/compiler.cc; 15s local ... 2024-12-18T00:10:28.9288295Z 2024-12-18T00:10:28.9289236Z  2024-12-18T00:10:28.9289711Z  2024-12-18T00:10:28.9290109Z  2024-12-18T00:10:28.9290465Z  2024-12-18T00:10:28.9290843Z  2024-12-18T00:10:28.9291191Z  2024-12-18T00:10:28.9291579Z  2024-12-18T00:10:28.9291961Z  2024-12-18T00:10:28.9292519Z [14,397 / 15,187] 48 actions running 2024-12-18T00:10:28.9293384Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:10:28.9294473Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T00:10:28.9295452Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:10:28.9296576Z Compiling xla/service/buffer_assignment.cc; 23s local 2024-12-18T00:10:28.9297715Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:10:28.9298610Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:10:28.9299702Z Compiling xla/service/executable.cc; 16s local 2024-12-18T00:10:28.9300439Z Compiling xla/service/compiler.cc; 16s local ... 2024-12-18T00:10:29.1293461Z 2024-12-18T00:10:29.1294255Z  2024-12-18T00:10:29.1294640Z  2024-12-18T00:10:29.1294993Z  2024-12-18T00:10:29.1295375Z  2024-12-18T00:10:29.1295718Z  2024-12-18T00:10:29.1296056Z  2024-12-18T00:10:29.1296389Z  2024-12-18T00:10:29.1296888Z  2024-12-18T00:10:29.1297371Z [14,398 / 15,187] 48 actions running 2024-12-18T00:10:29.1298099Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:10:29.1298937Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T00:10:29.1299855Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:10:29.1300780Z Compiling xla/service/buffer_assignment.cc; 23s local 2024-12-18T00:10:29.1301625Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:10:29.1302304Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:10:29.1303268Z Compiling xla/service/executable.cc; 16s local 2024-12-18T00:10:29.1303921Z Compiling xla/service/compiler.cc; 16s local ... 2024-12-18T00:10:29.5453715Z 2024-12-18T00:10:29.5454541Z  2024-12-18T00:10:29.5455019Z  2024-12-18T00:10:29.5455402Z  2024-12-18T00:10:29.5455795Z  2024-12-18T00:10:29.5456625Z  2024-12-18T00:10:29.5457030Z  2024-12-18T00:10:29.5457428Z  2024-12-18T00:10:29.5457810Z  2024-12-18T00:10:29.5458404Z [14,399 / 15,187] 48 actions, 47 running 2024-12-18T00:10:29.5459306Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:10:29.5460289Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T00:10:29.5461263Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:10:29.5462194Z Compiling xla/service/buffer_assignment.cc; 23s local 2024-12-18T00:10:29.5462978Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:10:29.5463855Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:10:29.5464706Z Compiling xla/service/executable.cc; 17s local 2024-12-18T00:10:29.5465465Z Compiling xla/service/compiler.cc; 16s local ... 2024-12-18T00:10:29.9298485Z 2024-12-18T00:10:29.9299388Z  2024-12-18T00:10:29.9299824Z  2024-12-18T00:10:29.9300133Z  2024-12-18T00:10:29.9300451Z  2024-12-18T00:10:29.9300770Z  2024-12-18T00:10:29.9301084Z  2024-12-18T00:10:29.9301381Z  2024-12-18T00:10:29.9301693Z  2024-12-18T00:10:29.9302151Z [14,400 / 15,187] 48 actions running 2024-12-18T00:10:29.9302856Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:10:29.9303604Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T00:10:29.9304351Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:10:29.9305099Z Compiling xla/service/buffer_assignment.cc; 24s local 2024-12-18T00:10:29.9305714Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:10:29.9306387Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:10:29.9307053Z Compiling xla/service/executable.cc; 17s local 2024-12-18T00:10:29.9307609Z Compiling xla/service/compiler.cc; 17s local ... 2024-12-18T00:10:30.1302405Z 2024-12-18T00:10:30.1303362Z  2024-12-18T00:10:30.1303813Z  2024-12-18T00:10:30.1304163Z  2024-12-18T00:10:30.1304498Z  2024-12-18T00:10:30.1304855Z  2024-12-18T00:10:30.1305229Z  2024-12-18T00:10:30.1305610Z  2024-12-18T00:10:30.1306245Z  2024-12-18T00:10:30.1306769Z [14,401 / 15,187] 48 actions running 2024-12-18T00:10:30.1307643Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:10:30.1308597Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T00:10:30.1309588Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:10:30.1310535Z Compiling xla/service/buffer_assignment.cc; 24s local 2024-12-18T00:10:30.1311347Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:10:30.1312288Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:10:30.1313218Z Compiling xla/service/executable.cc; 17s local 2024-12-18T00:10:30.1313925Z Compiling xla/service/compiler.cc; 17s local ... 2024-12-18T00:10:30.5307970Z 2024-12-18T00:10:30.5308862Z  2024-12-18T00:10:30.5309290Z  2024-12-18T00:10:30.5320041Z  2024-12-18T00:10:30.5320719Z  2024-12-18T00:10:30.5321105Z  2024-12-18T00:10:30.5321468Z  2024-12-18T00:10:30.5321820Z  2024-12-18T00:10:30.5322181Z  2024-12-18T00:10:30.5324780Z [14,403 / 15,187] 48 actions running 2024-12-18T00:10:30.5325661Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:10:30.5326635Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T00:10:30.5327474Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:10:30.5328281Z Compiling xla/service/buffer_assignment.cc; 24s local 2024-12-18T00:10:30.5328987Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:10:30.5329847Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:10:30.5330657Z Compiling xla/service/executable.cc; 17s local 2024-12-18T00:10:30.5331336Z Compiling xla/pjrt/pjrt_executable.cc; 17s local ... 2024-12-18T00:10:30.7316088Z 2024-12-18T00:10:30.7317030Z  2024-12-18T00:10:30.7317540Z  2024-12-18T00:10:30.7317901Z  2024-12-18T00:10:30.7318256Z  2024-12-18T00:10:30.7318627Z  2024-12-18T00:10:30.7319019Z  2024-12-18T00:10:30.7319407Z  2024-12-18T00:10:30.7319812Z  2024-12-18T00:10:30.7320278Z [14,405 / 15,187] 48 actions running 2024-12-18T00:10:30.7321014Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:10:30.7321816Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T00:10:30.7322640Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:10:30.7323427Z Compiling xla/service/buffer_assignment.cc; 24s local 2024-12-18T00:10:30.7324060Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:10:30.7324802Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2024-12-18T00:10:30.7325531Z Compiling xla/service/executable.cc; 18s local 2024-12-18T00:10:30.7326163Z Compiling xla/pjrt/pjrt_executable.cc; 17s local ... 2024-12-18T00:10:30.9473224Z 2024-12-18T00:10:30.9474097Z  2024-12-18T00:10:30.9474547Z  2024-12-18T00:10:30.9474966Z  2024-12-18T00:10:30.9475409Z  2024-12-18T00:10:30.9475880Z  2024-12-18T00:10:30.9476376Z  2024-12-18T00:10:30.9476820Z  2024-12-18T00:10:30.9477167Z  2024-12-18T00:10:30.9477745Z [14,409 / 15,187] 48 actions, 47 running 2024-12-18T00:10:30.9478627Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:10:30.9479597Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T00:10:30.9480630Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:10:30.9481594Z Compiling xla/service/buffer_assignment.cc; 25s local 2024-12-18T00:10:30.9482542Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:10:30.9483291Z Compiling xla/service/executable.cc; 18s local 2024-12-18T00:10:30.9484067Z Compiling xla/pjrt/pjrt_executable.cc; 17s local 2024-12-18T00:10:30.9485160Z Compiling xla/service/hlo_module_util.cc; 17s local ... 2024-12-18T00:10:31.3318457Z 2024-12-18T00:10:31.3319302Z  2024-12-18T00:10:31.3319830Z  2024-12-18T00:10:31.3320217Z  2024-12-18T00:10:31.3320656Z  2024-12-18T00:10:31.3321049Z  2024-12-18T00:10:31.3321471Z  2024-12-18T00:10:31.3321939Z  2024-12-18T00:10:31.3322339Z  2024-12-18T00:10:31.3322935Z [14,410 / 15,187] 48 actions running 2024-12-18T00:10:31.3323813Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:10:31.3324828Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T00:10:31.3325847Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:10:31.3326833Z Compiling xla/service/buffer_assignment.cc; 25s local 2024-12-18T00:10:31.3327665Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:10:31.3328453Z Compiling xla/service/executable.cc; 18s local 2024-12-18T00:10:31.3329215Z Compiling xla/pjrt/pjrt_executable.cc; 18s local 2024-12-18T00:10:31.3330421Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local ... 2024-12-18T00:10:31.7796680Z 2024-12-18T00:10:31.7797825Z  2024-12-18T00:10:31.7798301Z  2024-12-18T00:10:31.7798690Z  2024-12-18T00:10:31.7799066Z  2024-12-18T00:10:31.7799430Z  2024-12-18T00:10:31.7799819Z  2024-12-18T00:10:31.7800179Z  2024-12-18T00:10:31.7800572Z  2024-12-18T00:10:31.7801171Z [14,411 / 15,187] 48 actions, 47 running 2024-12-18T00:10:31.7802263Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:10:31.7803247Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T00:10:31.7804248Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:10:31.7805187Z Compiling xla/service/buffer_assignment.cc; 25s local 2024-12-18T00:10:31.7806014Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:10:31.7806798Z Compiling xla/pjrt/pjrt_executable.cc; 18s local 2024-12-18T00:10:31.7807666Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:10:31.7808553Z Compiling xla/service/llvm_compiler.cc; 17s local ... 2024-12-18T00:10:32.0359413Z 2024-12-18T00:10:32.0360311Z  2024-12-18T00:10:32.0361191Z  2024-12-18T00:10:32.0361628Z  2024-12-18T00:10:32.0362051Z  2024-12-18T00:10:32.0362441Z  2024-12-18T00:10:32.0362836Z  2024-12-18T00:10:32.0363366Z  2024-12-18T00:10:32.0363777Z  2024-12-18T00:10:32.0364409Z [14,412 / 15,187] 48 actions, 47 running 2024-12-18T00:10:32.0365293Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:10:32.0366240Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T00:10:32.0367306Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:10:32.0368323Z Compiling xla/service/buffer_assignment.cc; 26s local 2024-12-18T00:10:32.0369184Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:10:32.0369999Z Compiling xla/pjrt/pjrt_executable.cc; 18s local 2024-12-18T00:10:32.0370888Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:10:32.0371781Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T00:10:32.3327675Z 2024-12-18T00:10:32.3328512Z  2024-12-18T00:10:32.3328964Z  2024-12-18T00:10:32.3329340Z  2024-12-18T00:10:32.3329735Z  2024-12-18T00:10:32.3330128Z  2024-12-18T00:10:32.3330533Z  2024-12-18T00:10:32.3330911Z  2024-12-18T00:10:32.3331296Z  2024-12-18T00:10:32.3331860Z [14,412 / 15,187] 48 actions running 2024-12-18T00:10:32.3332711Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:10:32.3333662Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T00:10:32.3334906Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:10:32.3335814Z Compiling xla/service/buffer_assignment.cc; 26s local 2024-12-18T00:10:32.3336755Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:10:32.3337511Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2024-12-18T00:10:32.3338335Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:10:32.3339221Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T00:10:32.8190641Z 2024-12-18T00:10:32.8191517Z  2024-12-18T00:10:32.8192007Z  2024-12-18T00:10:32.8192402Z  2024-12-18T00:10:32.8192766Z  2024-12-18T00:10:32.8193123Z  2024-12-18T00:10:32.8193465Z  2024-12-18T00:10:32.8193840Z  2024-12-18T00:10:32.8194195Z  2024-12-18T00:10:32.8194765Z [14,413 / 15,187] 48 actions, 47 running 2024-12-18T00:10:32.8195713Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:10:32.8196852Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T00:10:32.8197759Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:10:32.8198765Z Compiling xla/service/buffer_assignment.cc; 27s local 2024-12-18T00:10:32.8199506Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:10:32.8200195Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2024-12-18T00:10:32.8200958Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:10:32.8201998Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2024-12-18T00:10:33.0824508Z 2024-12-18T00:10:33.0825395Z  2024-12-18T00:10:33.0825847Z  2024-12-18T00:10:33.0826208Z  2024-12-18T00:10:33.0826555Z  2024-12-18T00:10:33.0826915Z  2024-12-18T00:10:33.0827282Z  2024-12-18T00:10:33.0827635Z  2024-12-18T00:10:33.0828037Z  2024-12-18T00:10:33.0828545Z [14,415 / 15,187] 48 actions, 47 running 2024-12-18T00:10:33.0829336Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:10:33.0830216Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T00:10:33.0831136Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:10:33.0831996Z Compiling xla/service/buffer_assignment.cc; 27s local 2024-12-18T00:10:33.0832717Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:10:33.0833490Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:10:33.0834298Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local 2024-12-18T00:10:33.0835047Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2024-12-18T00:10:33.3336522Z 2024-12-18T00:10:33.3337379Z  2024-12-18T00:10:33.3337825Z  2024-12-18T00:10:33.3338160Z  2024-12-18T00:10:33.3338494Z  2024-12-18T00:10:33.3338846Z  2024-12-18T00:10:33.3339169Z  2024-12-18T00:10:33.3339520Z  2024-12-18T00:10:33.3339853Z  2024-12-18T00:10:33.3340367Z [14,415 / 15,187] 48 actions running 2024-12-18T00:10:33.3341199Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:10:33.3342088Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T00:10:33.3343006Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:10:33.3343883Z Compiling xla/service/buffer_assignment.cc; 27s local 2024-12-18T00:10:33.3344777Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:10:33.3345672Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:10:33.3346528Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local 2024-12-18T00:10:33.3347264Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2024-12-18T00:10:33.5914094Z 2024-12-18T00:10:33.5915275Z  2024-12-18T00:10:33.5915761Z  2024-12-18T00:10:33.5916191Z  2024-12-18T00:10:33.5916630Z  2024-12-18T00:10:33.5917190Z  2024-12-18T00:10:33.5917601Z  2024-12-18T00:10:33.5917941Z  2024-12-18T00:10:33.5918668Z  2024-12-18T00:10:33.5919305Z [14,416 / 15,187] 48 actions, 47 running 2024-12-18T00:10:33.5920172Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:10:33.5921125Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T00:10:33.5922141Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:10:33.5923112Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:10:33.5923942Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:10:33.5924740Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2024-12-18T00:10:33.5925525Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local 2024-12-18T00:10:33.5926249Z Compiling xla/pjrt/pjrt_compiler.cc; 17s local ... 2024-12-18T00:10:33.9341485Z 2024-12-18T00:10:33.9342379Z  2024-12-18T00:10:33.9343129Z  2024-12-18T00:10:33.9343559Z  2024-12-18T00:10:33.9343946Z  2024-12-18T00:10:33.9344697Z  2024-12-18T00:10:33.9345093Z  2024-12-18T00:10:33.9347014Z  2024-12-18T00:10:33.9347406Z  2024-12-18T00:10:33.9347959Z [14,416 / 15,187] 48 actions running 2024-12-18T00:10:33.9348843Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:10:33.9349832Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T00:10:33.9351062Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:10:33.9352004Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:10:33.9352822Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:10:33.9353693Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2024-12-18T00:10:33.9354557Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local 2024-12-18T00:10:33.9355347Z Compiling xla/pjrt/pjrt_compiler.cc; 17s local ... 2024-12-18T00:10:34.1740737Z 2024-12-18T00:10:34.1741737Z  2024-12-18T00:10:34.1742220Z  2024-12-18T00:10:34.1742616Z  2024-12-18T00:10:34.1743031Z  2024-12-18T00:10:34.1743439Z  2024-12-18T00:10:34.1743861Z  2024-12-18T00:10:34.1744522Z  2024-12-18T00:10:34.1744933Z  2024-12-18T00:10:34.1745512Z [14,418 / 15,187] 48 actions, 47 running 2024-12-18T00:10:34.1746376Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:10:34.1747348Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T00:10:34.1748252Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:10:34.1749110Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:10:34.1749885Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:10:34.1750708Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2024-12-18T00:10:34.1751422Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local 2024-12-18T00:10:34.1752096Z Compiling xla/service/copy_insertion.cc; 17s local ... 2024-12-18T00:10:34.4243364Z 2024-12-18T00:10:34.4244500Z  2024-12-18T00:10:34.4245008Z  2024-12-18T00:10:34.4245402Z  2024-12-18T00:10:34.4245792Z  2024-12-18T00:10:34.4246157Z  2024-12-18T00:10:34.4246545Z  2024-12-18T00:10:34.4246929Z  2024-12-18T00:10:34.4247441Z  2024-12-18T00:10:34.4248083Z [14,420 / 15,187] 48 actions, 47 running 2024-12-18T00:10:34.4248940Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:10:34.4249937Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T00:10:34.4251046Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:10:34.4252220Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:10:34.4253078Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:10:34.4253899Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local 2024-12-18T00:10:34.4254608Z Compiling xla/service/copy_insertion.cc; 18s local 2024-12-18T00:10:34.4255359Z Compiling xla/pjrt/pjrt_client.cc; 17s local ... 2024-12-18T00:10:34.7363377Z 2024-12-18T00:10:34.7364215Z  2024-12-18T00:10:34.7364623Z  2024-12-18T00:10:34.7364984Z  2024-12-18T00:10:34.7365318Z  2024-12-18T00:10:34.7365676Z  2024-12-18T00:10:34.7365992Z  2024-12-18T00:10:34.7366488Z  2024-12-18T00:10:34.7366852Z  2024-12-18T00:10:34.7367352Z [14,420 / 15,187] 48 actions running 2024-12-18T00:10:34.7368109Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:10:34.7368934Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T00:10:34.7369794Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:10:34.7370923Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:10:34.7371682Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:10:34.7372503Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local 2024-12-18T00:10:34.7373142Z Compiling xla/service/copy_insertion.cc; 18s local 2024-12-18T00:10:34.7373794Z Compiling xla/pjrt/pjrt_client.cc; 18s local ... 2024-12-18T00:10:35.0494228Z 2024-12-18T00:10:35.0495119Z  2024-12-18T00:10:35.0495576Z  2024-12-18T00:10:35.0495947Z  2024-12-18T00:10:35.0496421Z  2024-12-18T00:10:35.0497032Z  2024-12-18T00:10:35.0497416Z  2024-12-18T00:10:35.0497788Z  2024-12-18T00:10:35.0498149Z  2024-12-18T00:10:35.0498676Z [14,421 / 15,187] 48 actions, 47 running 2024-12-18T00:10:35.0499606Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:10:35.0500497Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T00:10:35.0501403Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:10:35.0502246Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:10:35.0503028Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:10:35.0503757Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local 2024-12-18T00:10:35.0504425Z Compiling xla/service/copy_insertion.cc; 18s local 2024-12-18T00:10:35.0505097Z Compiling xla/pjrt/pjrt_client.cc; 18s local ... 2024-12-18T00:10:35.3355713Z 2024-12-18T00:10:35.3356644Z  2024-12-18T00:10:35.3357179Z  2024-12-18T00:10:35.3357576Z  2024-12-18T00:10:35.3358006Z  2024-12-18T00:10:35.3358409Z  2024-12-18T00:10:35.3358819Z  2024-12-18T00:10:35.3359200Z  2024-12-18T00:10:35.3359572Z  2024-12-18T00:10:35.3360126Z [14,421 / 15,187] 48 actions running 2024-12-18T00:10:35.3361009Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:10:35.3361975Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T00:10:35.3363100Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:10:35.3363961Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:10:35.3364784Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:10:35.3365651Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local 2024-12-18T00:10:35.3366421Z Compiling xla/service/copy_insertion.cc; 19s local 2024-12-18T00:10:35.3367207Z Compiling xla/pjrt/pjrt_client.cc; 18s local ... 2024-12-18T00:10:35.7359564Z 2024-12-18T00:10:35.7360515Z  2024-12-18T00:10:35.7361202Z  2024-12-18T00:10:35.7361735Z  2024-12-18T00:10:35.7362230Z  2024-12-18T00:10:35.7362714Z  2024-12-18T00:10:35.7363219Z  2024-12-18T00:10:35.7363736Z  2024-12-18T00:10:35.7364594Z  2024-12-18T00:10:35.7365310Z [14,422 / 15,187] 48 actions running 2024-12-18T00:10:35.7366342Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:10:35.7367451Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T00:10:35.7368589Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:10:35.7369668Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:10:35.7370654Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:10:35.7371645Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local 2024-12-18T00:10:35.7372547Z Compiling xla/service/copy_insertion.cc; 19s local 2024-12-18T00:10:35.7373422Z Compiling xla/pjrt/pjrt_client.cc; 19s local ... 2024-12-18T00:10:36.3250185Z 2024-12-18T00:10:36.3251126Z  2024-12-18T00:10:36.3251633Z  2024-12-18T00:10:36.3252046Z  2024-12-18T00:10:36.3252438Z  2024-12-18T00:10:36.3252843Z  2024-12-18T00:10:36.3253233Z  2024-12-18T00:10:36.3253626Z  2024-12-18T00:10:36.3254002Z  2024-12-18T00:10:36.3254891Z [14,423 / 15,187] 48 actions, 47 running 2024-12-18T00:10:36.3255780Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:10:36.3256977Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T00:10:36.3257950Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:10:36.3258842Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:10:36.3259684Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:10:36.3260683Z Compiling xla/service/copy_insertion.cc; 19s local 2024-12-18T00:10:36.3261397Z Compiling xla/pjrt/pjrt_client.cc; 19s local 2024-12-18T00:10:36.3262205Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local ... 2024-12-18T00:10:36.5367055Z 2024-12-18T00:10:36.5368343Z  2024-12-18T00:10:36.5368895Z  2024-12-18T00:10:36.5369320Z  2024-12-18T00:10:36.5369705Z  2024-12-18T00:10:36.5370079Z  2024-12-18T00:10:36.5370488Z  2024-12-18T00:10:36.5370851Z  2024-12-18T00:10:36.5371220Z  2024-12-18T00:10:36.5371796Z [14,426 / 15,187] 48 actions running 2024-12-18T00:10:36.5372687Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:10:36.5373780Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T00:10:36.5374756Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2024-12-18T00:10:36.5375707Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:10:36.5376663Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:10:36.5377506Z Compiling xla/service/copy_insertion.cc; 20s local 2024-12-18T00:10:36.5378218Z Compiling xla/pjrt/pjrt_client.cc; 19s local 2024-12-18T00:10:36.5379061Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local ... 2024-12-18T00:10:36.8065797Z 2024-12-18T00:10:36.8066778Z  2024-12-18T00:10:36.8067283Z  2024-12-18T00:10:36.8067731Z  2024-12-18T00:10:36.8068106Z  2024-12-18T00:10:36.8068513Z  2024-12-18T00:10:36.8068939Z  2024-12-18T00:10:36.8069296Z  2024-12-18T00:10:36.8069693Z  2024-12-18T00:10:36.8070254Z [14,427 / 15,187] 48 actions, 47 running 2024-12-18T00:10:36.8071102Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:10:36.8072118Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T00:10:36.8073115Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2024-12-18T00:10:36.8074056Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:10:36.8074903Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:10:36.8075796Z Compiling xla/service/copy_insertion.cc; 20s local 2024-12-18T00:10:36.8076945Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2024-12-18T00:10:36.8077812Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local ... 2024-12-18T00:10:37.1373651Z 2024-12-18T00:10:37.1374978Z  2024-12-18T00:10:37.1375409Z  2024-12-18T00:10:37.1375779Z  2024-12-18T00:10:37.1376127Z  2024-12-18T00:10:37.1376575Z  2024-12-18T00:10:37.1376918Z  2024-12-18T00:10:37.1377240Z  2024-12-18T00:10:37.1377599Z  2024-12-18T00:10:37.1378076Z [14,428 / 15,187] 48 actions running 2024-12-18T00:10:37.1378806Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:10:37.1379638Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T00:10:37.1380478Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2024-12-18T00:10:37.1381268Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:10:37.1381962Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:10:37.1382679Z Compiling xla/service/copy_insertion.cc; 20s local 2024-12-18T00:10:37.1383595Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2024-12-18T00:10:37.1384310Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local ... 2024-12-18T00:10:37.5378673Z 2024-12-18T00:10:37.5379617Z  2024-12-18T00:10:37.5381358Z  2024-12-18T00:10:37.5381822Z  2024-12-18T00:10:37.5382216Z  2024-12-18T00:10:37.5382608Z  2024-12-18T00:10:37.5382993Z  2024-12-18T00:10:37.5383380Z  2024-12-18T00:10:37.5383776Z  2024-12-18T00:10:37.5384363Z [14,430 / 15,187] 48 actions running 2024-12-18T00:10:37.5385469Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:10:37.5386739Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T00:10:37.5387789Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2024-12-18T00:10:37.5388807Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:10:37.5389731Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:10:37.5390670Z Compiling xla/service/copy_insertion.cc; 21s local 2024-12-18T00:10:37.5391427Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2024-12-18T00:10:37.5392366Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local ... 2024-12-18T00:10:38.4210987Z 2024-12-18T00:10:38.4211895Z  2024-12-18T00:10:38.4212342Z  2024-12-18T00:10:38.4212698Z  2024-12-18T00:10:38.4213087Z  2024-12-18T00:10:38.4213421Z  2024-12-18T00:10:38.4213780Z  2024-12-18T00:10:38.4214108Z  2024-12-18T00:10:38.4214477Z  2024-12-18T00:10:38.4215043Z [14,431 / 15,187] 48 actions, 47 running 2024-12-18T00:10:38.4215890Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:10:38.4216959Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T00:10:38.4217939Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:10:38.4218833Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:10:38.4219700Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:10:38.4220436Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:10:38.4221071Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2024-12-18T00:10:38.4221822Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local ... 2024-12-18T00:10:38.6265056Z 2024-12-18T00:10:38.6265947Z  2024-12-18T00:10:38.6266443Z  2024-12-18T00:10:38.6266845Z  2024-12-18T00:10:38.6267264Z  2024-12-18T00:10:38.6267665Z  2024-12-18T00:10:38.6268049Z  2024-12-18T00:10:38.6268441Z  2024-12-18T00:10:38.6268819Z  2024-12-18T00:10:38.6269416Z [14,433 / 15,187] 48 actions, 47 running 2024-12-18T00:10:38.6270232Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:10:38.6271483Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T00:10:38.6272463Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:10:38.6273423Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:10:38.6274295Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:10:38.6275136Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:10:38.6275873Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T00:10:38.6276738Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local ... 2024-12-18T00:10:38.9388125Z 2024-12-18T00:10:38.9389030Z  2024-12-18T00:10:38.9389521Z  2024-12-18T00:10:38.9389926Z  2024-12-18T00:10:38.9390324Z  2024-12-18T00:10:38.9390710Z  2024-12-18T00:10:38.9391112Z  2024-12-18T00:10:38.9391530Z  2024-12-18T00:10:38.9391913Z  2024-12-18T00:10:38.9392466Z [14,435 / 15,187] 48 actions running 2024-12-18T00:10:38.9393357Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:10:38.9394593Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T00:10:38.9395624Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:10:38.9396787Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:10:38.9397652Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:10:38.9398472Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:10:38.9399203Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T00:10:38.9400203Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local ... 2024-12-18T00:10:39.1392415Z 2024-12-18T00:10:39.1393394Z  2024-12-18T00:10:39.1393832Z  2024-12-18T00:10:39.1394250Z  2024-12-18T00:10:39.1394639Z  2024-12-18T00:10:39.1395029Z  2024-12-18T00:10:39.1395451Z  2024-12-18T00:10:39.1395823Z  2024-12-18T00:10:39.1396215Z  2024-12-18T00:10:39.1396788Z [14,438 / 15,187] 48 actions running 2024-12-18T00:10:39.1397653Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:10:39.1398636Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T00:10:39.1399480Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:10:39.1400322Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:10:39.1401173Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:10:39.1401884Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T00:10:39.1402707Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2024-12-18T00:10:39.1403586Z Compiling xla/service/spmd/dot_handler.cc; 20s local ... 2024-12-18T00:10:39.7185296Z 2024-12-18T00:10:39.7186148Z  2024-12-18T00:10:39.7186605Z  2024-12-18T00:10:39.7187032Z  2024-12-18T00:10:39.7187462Z  2024-12-18T00:10:39.7187847Z  2024-12-18T00:10:39.7188234Z  2024-12-18T00:10:39.7188614Z  2024-12-18T00:10:39.7189028Z  2024-12-18T00:10:39.7189618Z [14,439 / 15,187] 48 actions, 47 running 2024-12-18T00:10:39.7190525Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:10:39.7191563Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T00:10:39.7192468Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:10:39.7193427Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:10:39.7194232Z Compiling xla/service/copy_insertion.cc; 23s local 2024-12-18T00:10:39.7194935Z Compiling xla/pjrt/pjrt_client.cc; 23s local 2024-12-18T00:10:39.7195698Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2024-12-18T00:10:39.7196567Z Compiling xla/service/spmd/dot_handler.cc; 20s local ... 2024-12-18T00:10:39.9398189Z 2024-12-18T00:10:39.9399313Z  2024-12-18T00:10:39.9399746Z  2024-12-18T00:10:39.9400113Z  2024-12-18T00:10:39.9400485Z  2024-12-18T00:10:39.9400840Z  2024-12-18T00:10:39.9401206Z  2024-12-18T00:10:39.9401562Z  2024-12-18T00:10:39.9401923Z  2024-12-18T00:10:39.9402424Z [14,439 / 15,187] 48 actions running 2024-12-18T00:10:39.9403140Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:10:39.9403984Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T00:10:39.9404750Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:10:39.9405694Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:10:39.9406458Z Compiling xla/service/copy_insertion.cc; 23s local 2024-12-18T00:10:39.9407108Z Compiling xla/pjrt/pjrt_client.cc; 23s local 2024-12-18T00:10:39.9407857Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2024-12-18T00:10:39.9408661Z Compiling xla/service/spmd/dot_handler.cc; 20s local ... 2024-12-18T00:10:40.1403270Z 2024-12-18T00:10:40.1404225Z  2024-12-18T00:10:40.1406271Z  2024-12-18T00:10:40.1406765Z  2024-12-18T00:10:40.1407171Z  2024-12-18T00:10:40.1407704Z  2024-12-18T00:10:40.1408100Z  2024-12-18T00:10:40.1408478Z  2024-12-18T00:10:40.1408857Z  2024-12-18T00:10:40.1409430Z [14,440 / 15,187] 48 actions running 2024-12-18T00:10:40.1410253Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:10:40.1411209Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T00:10:40.1412306Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:10:40.1413153Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:10:40.1414005Z Compiling xla/service/copy_insertion.cc; 23s local 2024-12-18T00:10:40.1414840Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2024-12-18T00:10:40.1415754Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2024-12-18T00:10:40.1416795Z Compiling xla/service/spmd/gather_scatter_handler.cc; 16s local ... 2024-12-18T00:10:40.5019727Z 2024-12-18T00:10:40.5020572Z  2024-12-18T00:10:40.5021019Z  2024-12-18T00:10:40.5021391Z  2024-12-18T00:10:40.5021770Z  2024-12-18T00:10:40.5022117Z  2024-12-18T00:10:40.5022594Z  2024-12-18T00:10:40.5022926Z  2024-12-18T00:10:40.5023278Z  2024-12-18T00:10:40.5023836Z [14,441 / 15,187] 48 actions, 47 running 2024-12-18T00:10:40.5024658Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:10:40.5025536Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T00:10:40.5026259Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:10:40.5027018Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:10:40.5027832Z Compiling xla/service/copy_insertion.cc; 24s local 2024-12-18T00:10:40.5028663Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2024-12-18T00:10:40.5029470Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2024-12-18T00:10:40.5030306Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local ... 2024-12-18T00:10:40.7409750Z 2024-12-18T00:10:40.7410582Z  2024-12-18T00:10:40.7411138Z  2024-12-18T00:10:40.7411613Z  2024-12-18T00:10:40.7412089Z  2024-12-18T00:10:40.7412582Z  2024-12-18T00:10:40.7413067Z  2024-12-18T00:10:40.7413480Z  2024-12-18T00:10:40.7413932Z  2024-12-18T00:10:40.7414546Z [14,441 / 15,187] 48 actions running 2024-12-18T00:10:40.7415550Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:10:40.7416780Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T00:10:40.7417704Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:10:40.7418828Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:10:40.7419547Z Compiling xla/service/copy_insertion.cc; 24s local 2024-12-18T00:10:40.7420231Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2024-12-18T00:10:40.7420939Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2024-12-18T00:10:40.7421651Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local ... 2024-12-18T00:10:41.1144904Z 2024-12-18T00:10:41.1145778Z  2024-12-18T00:10:41.1146237Z  2024-12-18T00:10:41.1146599Z  2024-12-18T00:10:41.1146984Z  2024-12-18T00:10:41.1147360Z  2024-12-18T00:10:41.1147731Z  2024-12-18T00:10:41.1148118Z  2024-12-18T00:10:41.1148492Z  2024-12-18T00:10:41.1149061Z [14,442 / 15,187] 48 actions, 47 running 2024-12-18T00:10:41.1149903Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:10:41.1150909Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T00:10:41.1151762Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:10:41.1152834Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:10:41.1153688Z Compiling xla/service/copy_insertion.cc; 24s local 2024-12-18T00:10:41.1154629Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2024-12-18T00:10:41.1155449Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2024-12-18T00:10:41.1156261Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local ... 2024-12-18T00:10:41.3417180Z 2024-12-18T00:10:41.3418093Z  2024-12-18T00:10:41.3418573Z  2024-12-18T00:10:41.3419298Z  2024-12-18T00:10:41.3419723Z  2024-12-18T00:10:41.3420123Z  2024-12-18T00:10:41.3420527Z  2024-12-18T00:10:41.3420922Z  2024-12-18T00:10:41.3421292Z  2024-12-18T00:10:41.3421850Z [14,443 / 15,187] 48 actions running 2024-12-18T00:10:41.3422681Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:10:41.3423698Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T00:10:41.3424573Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:10:41.3425414Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:10:41.3426411Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2024-12-18T00:10:41.3427290Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2024-12-18T00:10:41.3428155Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2024-12-18T00:10:41.3429024Z Compiling xla/pjrt/host_callback.cc; 17s local ... 2024-12-18T00:10:41.7247373Z 2024-12-18T00:10:41.7248291Z  2024-12-18T00:10:41.7248769Z  2024-12-18T00:10:41.7249166Z  2024-12-18T00:10:41.7249524Z  2024-12-18T00:10:41.7249902Z  2024-12-18T00:10:41.7250284Z  2024-12-18T00:10:41.7250685Z  2024-12-18T00:10:41.7251071Z  2024-12-18T00:10:41.7251656Z [14,444 / 15,187] 48 actions, 47 running 2024-12-18T00:10:41.7252534Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:10:41.7253446Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T00:10:41.7254296Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:10:41.7255122Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:10:41.7256030Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2024-12-18T00:10:41.7257046Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2024-12-18T00:10:41.7257922Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2024-12-18T00:10:41.7258774Z Compiling xla/pjrt/host_callback.cc; 17s local ... 2024-12-18T00:10:41.9421864Z 2024-12-18T00:10:41.9422750Z  2024-12-18T00:10:41.9423222Z  2024-12-18T00:10:41.9423592Z  2024-12-18T00:10:41.9423981Z  2024-12-18T00:10:41.9424350Z  2024-12-18T00:10:41.9425072Z  2024-12-18T00:10:41.9425441Z  2024-12-18T00:10:41.9425805Z  2024-12-18T00:10:41.9426364Z [14,444 / 15,187] 48 actions running 2024-12-18T00:10:41.9427197Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:10:41.9428164Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T00:10:41.9429048Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:10:41.9429852Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:10:41.9430775Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2024-12-18T00:10:41.9431635Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2024-12-18T00:10:41.9432497Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2024-12-18T00:10:41.9433368Z Compiling xla/pjrt/host_callback.cc; 18s local ... 2024-12-18T00:10:42.2491174Z 2024-12-18T00:10:42.2492201Z  2024-12-18T00:10:42.2492847Z  2024-12-18T00:10:42.2493265Z  2024-12-18T00:10:42.2493586Z  2024-12-18T00:10:42.2493962Z  2024-12-18T00:10:42.2494304Z  2024-12-18T00:10:42.2494906Z  2024-12-18T00:10:42.2495247Z  2024-12-18T00:10:42.2495800Z [14,447 / 15,187] 48 actions, 47 running 2024-12-18T00:10:42.2496836Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:10:42.2497689Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T00:10:42.2498443Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:10:42.2499182Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:10:42.2500156Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2024-12-18T00:10:42.2500939Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2024-12-18T00:10:42.2501720Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local 2024-12-18T00:10:42.2502605Z Compiling xla/pjrt/host_callback.cc; 18s local ... 2024-12-18T00:10:42.5064354Z 2024-12-18T00:10:42.5068217Z  2024-12-18T00:10:42.5068703Z  2024-12-18T00:10:42.5069127Z  2024-12-18T00:10:42.5069504Z  2024-12-18T00:10:42.5069889Z  2024-12-18T00:10:42.5070212Z  2024-12-18T00:10:42.5070604Z  2024-12-18T00:10:42.5070984Z  2024-12-18T00:10:42.5071535Z [14,448 / 15,187] 48 actions, 47 running 2024-12-18T00:10:42.5072358Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:10:42.5073298Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T00:10:42.5074138Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:10:42.5075106Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:10:42.5076067Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2024-12-18T00:10:42.5076959Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2024-12-18T00:10:42.5077825Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local 2024-12-18T00:10:42.5078729Z Compiling xla/pjrt/host_callback.cc; 18s local ... 2024-12-18T00:10:42.7429005Z 2024-12-18T00:10:42.7429963Z  2024-12-18T00:10:42.7431632Z  2024-12-18T00:10:42.7432094Z  2024-12-18T00:10:42.7432505Z  2024-12-18T00:10:42.7432921Z  2024-12-18T00:10:42.7433341Z  2024-12-18T00:10:42.7433747Z  2024-12-18T00:10:42.7434158Z  2024-12-18T00:10:42.7434759Z [14,450 / 15,187] 48 actions running 2024-12-18T00:10:42.7435700Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:10:42.7436966Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2024-12-18T00:10:42.7437943Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:10:42.7438904Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:10:42.7439876Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2024-12-18T00:10:42.7441147Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local 2024-12-18T00:10:42.7442131Z Compiling xla/pjrt/host_callback.cc; 18s local 2024-12-18T00:10:42.7443018Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local ... 2024-12-18T00:10:43.4365223Z 2024-12-18T00:10:43.4366271Z  2024-12-18T00:10:43.4366752Z  2024-12-18T00:10:43.4367168Z  2024-12-18T00:10:43.4367611Z  2024-12-18T00:10:43.4368050Z  2024-12-18T00:10:43.4368460Z  2024-12-18T00:10:43.4368862Z  2024-12-18T00:10:43.4369278Z  2024-12-18T00:10:43.4369898Z [14,451 / 15,187] 48 actions, 47 running 2024-12-18T00:10:43.4370798Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:10:43.4371752Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2024-12-18T00:10:43.4372606Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:10:43.4373453Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:10:43.4374334Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2024-12-18T00:10:43.4375511Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T00:10:43.4376530Z Compiling xla/pjrt/host_callback.cc; 19s local 2024-12-18T00:10:43.4377406Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local ... 2024-12-18T00:10:43.7440443Z 2024-12-18T00:10:43.7441219Z  2024-12-18T00:10:43.7441620Z  2024-12-18T00:10:43.7441944Z  2024-12-18T00:10:43.7442300Z  2024-12-18T00:10:43.7442652Z  2024-12-18T00:10:43.7443007Z  2024-12-18T00:10:43.7443380Z  2024-12-18T00:10:43.7443710Z  2024-12-18T00:10:43.7444710Z [14,451 / 15,187] 48 actions running 2024-12-18T00:10:43.7445483Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:10:43.7446362Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T00:10:43.7447043Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:10:43.7447860Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:10:43.7448608Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2024-12-18T00:10:43.7449371Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T00:10:43.7450121Z Compiling xla/pjrt/host_callback.cc; 19s local 2024-12-18T00:10:43.7450816Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local ... 2024-12-18T00:10:44.2297894Z 2024-12-18T00:10:44.2298814Z  2024-12-18T00:10:44.2299336Z  2024-12-18T00:10:44.2299764Z  2024-12-18T00:10:44.2300150Z  2024-12-18T00:10:44.2300450Z  2024-12-18T00:10:44.2300795Z  2024-12-18T00:10:44.2301102Z  2024-12-18T00:10:44.2301446Z  2024-12-18T00:10:44.2302061Z [14,452 / 15,187] 48 actions, 47 running 2024-12-18T00:10:44.2302961Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:10:44.2304125Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T00:10:44.2305219Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:10:44.2306054Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2024-12-18T00:10:44.2306888Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2024-12-18T00:10:44.2307750Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T00:10:44.2308585Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T00:10:44.2309361Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local ... 2024-12-18T00:10:44.5452939Z 2024-12-18T00:10:44.5453854Z  2024-12-18T00:10:44.5454352Z  2024-12-18T00:10:44.5454802Z  2024-12-18T00:10:44.5455199Z  2024-12-18T00:10:44.5455567Z  2024-12-18T00:10:44.5455925Z  2024-12-18T00:10:44.5456476Z  2024-12-18T00:10:44.5457039Z  2024-12-18T00:10:44.5457626Z [14,455 / 15,187] 48 actions running 2024-12-18T00:10:44.5458883Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:10:44.5459945Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T00:10:44.5460855Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:10:44.5461658Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2024-12-18T00:10:44.5462443Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T00:10:44.5463350Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T00:10:44.5464172Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2024-12-18T00:10:44.5465096Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local ... 2024-12-18T00:10:45.0791340Z 2024-12-18T00:10:45.0792275Z  2024-12-18T00:10:45.0792756Z  2024-12-18T00:10:45.0793142Z  2024-12-18T00:10:45.0793527Z  2024-12-18T00:10:45.0793879Z  2024-12-18T00:10:45.0794252Z  2024-12-18T00:10:45.0794611Z  2024-12-18T00:10:45.0794992Z  2024-12-18T00:10:45.0795581Z [14,456 / 15,187] 48 actions, 47 running 2024-12-18T00:10:45.0796678Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:10:45.0797640Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T00:10:45.0798657Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:10:45.0799435Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T00:10:45.0800313Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T00:10:45.0801177Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T00:10:45.0802068Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T00:10:45.0802916Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local ... 2024-12-18T00:10:45.3454957Z 2024-12-18T00:10:45.3455866Z  2024-12-18T00:10:45.3456318Z  2024-12-18T00:10:45.3456845Z  2024-12-18T00:10:45.3457235Z  2024-12-18T00:10:45.3457604Z  2024-12-18T00:10:45.3458001Z  2024-12-18T00:10:45.3458385Z  2024-12-18T00:10:45.3458759Z  2024-12-18T00:10:45.3459477Z [14,456 / 15,187] 48 actions running 2024-12-18T00:10:45.3460338Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:10:45.3461299Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T00:10:45.3462145Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:10:45.3462915Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T00:10:45.3463809Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T00:10:45.3464605Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T00:10:45.3465350Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T00:10:45.3466233Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local ... 2024-12-18T00:10:45.6515213Z 2024-12-18T00:10:45.6516003Z  2024-12-18T00:10:45.6516419Z  2024-12-18T00:10:45.6516792Z  2024-12-18T00:10:45.6517168Z  2024-12-18T00:10:45.6517534Z  2024-12-18T00:10:45.6527610Z  2024-12-18T00:10:45.6528258Z  2024-12-18T00:10:45.6528633Z  2024-12-18T00:10:45.6529157Z [14,459 / 15,187] 48 actions, 47 running 2024-12-18T00:10:45.6529902Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:10:45.6530734Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T00:10:45.6531486Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:10:45.6532165Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T00:10:45.6532967Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T00:10:45.6533872Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T00:10:45.6534505Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T00:10:45.6535290Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local ... 2024-12-18T00:10:45.9461147Z 2024-12-18T00:10:45.9462023Z  2024-12-18T00:10:45.9462513Z  2024-12-18T00:10:45.9462922Z  2024-12-18T00:10:45.9463338Z  2024-12-18T00:10:45.9463735Z  2024-12-18T00:10:45.9464134Z  2024-12-18T00:10:45.9464515Z  2024-12-18T00:10:45.9464900Z  2024-12-18T00:10:45.9465459Z [14,459 / 15,187] 48 actions running 2024-12-18T00:10:45.9466355Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:10:45.9467381Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2024-12-18T00:10:45.9468252Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:10:45.9469196Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T00:10:45.9469999Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T00:10:45.9470830Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T00:10:45.9471585Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T00:10:45.9472438Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local ... 2024-12-18T00:10:46.5120192Z 2024-12-18T00:10:46.5121350Z  2024-12-18T00:10:46.5121884Z  2024-12-18T00:10:46.5122279Z  2024-12-18T00:10:46.5122667Z  2024-12-18T00:10:46.5123207Z  2024-12-18T00:10:46.5123583Z  2024-12-18T00:10:46.5123957Z  2024-12-18T00:10:46.5124337Z  2024-12-18T00:10:46.5124892Z [14,460 / 15,187] 48 actions, 47 running 2024-12-18T00:10:46.5125725Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:10:46.5126727Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2024-12-18T00:10:46.5127714Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:10:46.5128535Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2024-12-18T00:10:46.5129366Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T00:10:46.5130242Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T00:10:46.5131044Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2024-12-18T00:10:46.5132008Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local ... 2024-12-18T00:10:46.7466991Z 2024-12-18T00:10:46.7467867Z  2024-12-18T00:10:46.7468363Z  2024-12-18T00:10:46.7468768Z  2024-12-18T00:10:46.7469146Z  2024-12-18T00:10:46.7469521Z  2024-12-18T00:10:46.7469877Z  2024-12-18T00:10:46.7470244Z  2024-12-18T00:10:46.7470641Z  2024-12-18T00:10:46.7471202Z [14,460 / 15,187] 48 actions running 2024-12-18T00:10:46.7472058Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:10:46.7473041Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2024-12-18T00:10:46.7473874Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:10:46.7474714Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2024-12-18T00:10:46.7475529Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T00:10:46.7476335Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T00:10:46.7477165Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2024-12-18T00:10:46.7478027Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local ... 2024-12-18T00:10:47.2178579Z 2024-12-18T00:10:47.2179475Z  2024-12-18T00:10:47.2179930Z  2024-12-18T00:10:47.2180307Z  2024-12-18T00:10:47.2180663Z  2024-12-18T00:10:47.2181134Z  2024-12-18T00:10:47.2181635Z  2024-12-18T00:10:47.2182072Z  2024-12-18T00:10:47.2182514Z  2024-12-18T00:10:47.2183264Z [14,461 / 15,187] 48 actions, 47 running 2024-12-18T00:10:47.2184262Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:10:47.2185282Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2024-12-18T00:10:47.2186096Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:10:47.2187434Z Compiling xla/service/spmd/gather_scatter_handler.cc; 24s local 2024-12-18T00:10:47.2188211Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T00:10:47.2188933Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T00:10:47.2189710Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T00:10:47.2190618Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local ... 2024-12-18T00:10:47.5472424Z 2024-12-18T00:10:47.5473303Z  2024-12-18T00:10:47.5473754Z  2024-12-18T00:10:47.5474103Z  2024-12-18T00:10:47.5474456Z  2024-12-18T00:10:47.5474823Z  2024-12-18T00:10:47.5475217Z  2024-12-18T00:10:47.5475618Z  2024-12-18T00:10:47.5476048Z  2024-12-18T00:10:47.5476618Z [14,461 / 15,187] 48 actions running 2024-12-18T00:10:47.5477443Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:10:47.5478560Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2024-12-18T00:10:47.5479451Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:10:47.5480534Z Compiling xla/service/spmd/gather_scatter_handler.cc; 24s local 2024-12-18T00:10:47.5481405Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T00:10:47.5482339Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T00:10:47.5483026Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T00:10:47.5483978Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local ... 2024-12-18T00:10:47.7983368Z 2024-12-18T00:10:47.7984289Z  2024-12-18T00:10:47.7984799Z  2024-12-18T00:10:47.7985177Z  2024-12-18T00:10:47.7985827Z  2024-12-18T00:10:47.7986244Z  2024-12-18T00:10:47.7986597Z  2024-12-18T00:10:47.7987021Z  2024-12-18T00:10:47.7987401Z  2024-12-18T00:10:47.7988007Z [14,463 / 15,187] 48 actions, 47 running 2024-12-18T00:10:47.7988880Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:10:47.7989911Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T00:10:47.7990831Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:10:47.7991601Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T00:10:47.7992392Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T00:10:47.7993235Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T00:10:47.7994482Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:10:47.7995279Z Compiling xla/service/service.cc; 22s local ... 2024-12-18T00:10:48.0953400Z 2024-12-18T00:10:48.0954356Z  2024-12-18T00:10:48.0954820Z  2024-12-18T00:10:48.0955206Z  2024-12-18T00:10:48.0955578Z  2024-12-18T00:10:48.0955943Z  2024-12-18T00:10:48.0956309Z  2024-12-18T00:10:48.0956674Z  2024-12-18T00:10:48.0957043Z  2024-12-18T00:10:48.0957635Z [14,464 / 15,187] 48 actions, 47 running 2024-12-18T00:10:48.0958487Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:10:48.0959427Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T00:10:48.0960277Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:10:48.0961030Z Compiling xla/pjrt/host_callback.cc; 24s local 2024-12-18T00:10:48.0961763Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T00:10:48.0962581Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T00:10:48.0963446Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:10:48.0964391Z Compiling xla/service/service.cc; 22s local ... 2024-12-18T00:10:48.3478320Z 2024-12-18T00:10:48.3479234Z  2024-12-18T00:10:48.3479742Z  2024-12-18T00:10:48.3480143Z  2024-12-18T00:10:48.3480507Z  2024-12-18T00:10:48.3480910Z  2024-12-18T00:10:48.3481315Z  2024-12-18T00:10:48.3482010Z  2024-12-18T00:10:48.3482408Z  2024-12-18T00:10:48.3482974Z [14,465 / 15,187] 48 actions running 2024-12-18T00:10:48.3483881Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:10:48.3484855Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T00:10:48.3485680Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:10:48.3486424Z Compiling xla/pjrt/host_callback.cc; 24s local 2024-12-18T00:10:48.3487148Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T00:10:48.3487918Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T00:10:48.3488821Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:10:48.3489602Z Compiling xla/service/service.cc; 22s local ... 2024-12-18T00:10:48.5483222Z 2024-12-18T00:10:48.5484107Z  2024-12-18T00:10:48.5484632Z  2024-12-18T00:10:48.5484977Z  2024-12-18T00:10:48.5485361Z  2024-12-18T00:10:48.5485771Z  2024-12-18T00:10:48.5486132Z  2024-12-18T00:10:48.5486482Z  2024-12-18T00:10:48.5486832Z  2024-12-18T00:10:48.5487707Z [14,466 / 15,187] 48 actions running 2024-12-18T00:10:48.5488656Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:10:48.5489833Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T00:10:48.5490804Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:10:48.5491513Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T00:10:48.5492261Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T00:10:48.5493276Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:10:48.5494266Z Compiling xla/service/service.cc; 22s local 2024-12-18T00:10:48.5495271Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local ... 2024-12-18T00:10:48.7933069Z 2024-12-18T00:10:48.7933937Z  2024-12-18T00:10:48.7934456Z  2024-12-18T00:10:48.7934833Z  2024-12-18T00:10:48.7935199Z  2024-12-18T00:10:48.7935573Z  2024-12-18T00:10:48.7935977Z  2024-12-18T00:10:48.7936530Z  2024-12-18T00:10:48.7936882Z  2024-12-18T00:10:48.7937375Z [14,468 / 15,187] 48 actions, 47 running 2024-12-18T00:10:48.7938077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:10:48.7938881Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T00:10:48.7939604Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:10:48.7940348Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T00:10:48.7941149Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T00:10:48.7942022Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:10:48.7942939Z Compiling xla/service/service.cc; 23s local 2024-12-18T00:10:48.7943753Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local ... 2024-12-18T00:10:49.1352055Z 2024-12-18T00:10:49.1352949Z  2024-12-18T00:10:49.1353451Z  2024-12-18T00:10:49.1353886Z  2024-12-18T00:10:49.1354263Z  2024-12-18T00:10:49.1354720Z  2024-12-18T00:10:49.1355145Z  2024-12-18T00:10:49.1355523Z  2024-12-18T00:10:49.1355855Z  2024-12-18T00:10:49.1356299Z [14,469 / 15,187] 48 actions, 47 running 2024-12-18T00:10:49.1356988Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:10:49.1357769Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T00:10:49.1358670Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:10:49.1359436Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 25s local 2024-12-18T00:10:49.1360283Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2024-12-18T00:10:49.1361196Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:10:49.1362242Z Compiling xla/service/service.cc; 23s local 2024-12-18T00:10:49.1362915Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local ... 2024-12-18T00:10:49.3489892Z 2024-12-18T00:10:49.3490797Z  2024-12-18T00:10:49.3491276Z  2024-12-18T00:10:49.3491757Z  2024-12-18T00:10:49.3492153Z  2024-12-18T00:10:49.3492525Z  2024-12-18T00:10:49.3492846Z  2024-12-18T00:10:49.3493220Z  2024-12-18T00:10:49.3493551Z  2024-12-18T00:10:49.3494020Z [14,470 / 15,187] 48 actions running 2024-12-18T00:10:49.3494816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:10:49.3495752Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T00:10:49.3496704Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:10:49.3497577Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2024-12-18T00:10:49.3498400Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:10:49.3499192Z Compiling xla/service/service.cc; 23s local 2024-12-18T00:10:49.3500243Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:10:49.3501197Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2024-12-18T00:10:49.5493887Z 2024-12-18T00:10:49.5494776Z  2024-12-18T00:10:49.5495299Z  2024-12-18T00:10:49.5495711Z  2024-12-18T00:10:49.5496121Z  2024-12-18T00:10:49.5496611Z  2024-12-18T00:10:49.5497040Z  2024-12-18T00:10:49.5497418Z  2024-12-18T00:10:49.5497842Z  2024-12-18T00:10:49.5498421Z [14,471 / 15,187] 48 actions running 2024-12-18T00:10:49.5499652Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:10:49.5500677Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T00:10:49.5501597Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2024-12-18T00:10:49.5502509Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:10:49.5503337Z Compiling xla/service/service.cc; 23s local 2024-12-18T00:10:49.5504634Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:10:49.5505574Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local 2024-12-18T00:10:49.5506404Z Compiling xla/python/ifrt/client.cc; 18s local ... 2024-12-18T00:10:50.5501646Z 2024-12-18T00:10:50.5502513Z  2024-12-18T00:10:50.5502951Z  2024-12-18T00:10:50.5503328Z  2024-12-18T00:10:50.5503680Z  2024-12-18T00:10:50.5504027Z  2024-12-18T00:10:50.5504363Z  2024-12-18T00:10:50.5504711Z  2024-12-18T00:10:50.5505088Z  2024-12-18T00:10:50.5505598Z [14,471 / 15,187] 48 actions running 2024-12-18T00:10:50.5506369Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:10:50.5507242Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T00:10:50.5508047Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T00:10:50.5508904Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:10:50.5509624Z Compiling xla/service/service.cc; 24s local 2024-12-18T00:10:50.5510324Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:10:50.5511111Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local 2024-12-18T00:10:50.5511842Z Compiling xla/python/ifrt/client.cc; 19s local ... 2024-12-18T00:10:50.7728855Z 2024-12-18T00:10:50.7729898Z  2024-12-18T00:10:50.7730344Z  2024-12-18T00:10:50.7730729Z  2024-12-18T00:10:50.7731110Z  2024-12-18T00:10:50.7731519Z  2024-12-18T00:10:50.7731886Z  2024-12-18T00:10:50.7732273Z  2024-12-18T00:10:50.7732666Z  2024-12-18T00:10:50.7733262Z [14,475 / 15,187] 48 actions, 47 running 2024-12-18T00:10:50.7734135Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:10:50.7735324Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2024-12-18T00:10:50.7736211Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T00:10:50.7737322Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:10:50.7738176Z Compiling xla/service/service.cc; 25s local 2024-12-18T00:10:50.7739006Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:10:50.7739951Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T00:10:50.7740814Z Compiling xla/python/ifrt/client.cc; 19s local ... 2024-12-18T00:10:51.1508682Z 2024-12-18T00:10:51.1509578Z  2024-12-18T00:10:51.1510115Z  2024-12-18T00:10:51.1510537Z  2024-12-18T00:10:51.1510901Z  2024-12-18T00:10:51.1511265Z  2024-12-18T00:10:51.1511673Z  2024-12-18T00:10:51.1512067Z  2024-12-18T00:10:51.1512427Z  2024-12-18T00:10:51.1512923Z [14,475 / 15,187] 48 actions running 2024-12-18T00:10:51.1513733Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:10:51.1514870Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2024-12-18T00:10:51.1515727Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T00:10:51.1516700Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:10:51.1517418Z Compiling xla/service/service.cc; 25s local 2024-12-18T00:10:51.1518190Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:10:51.1519085Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T00:10:51.1520030Z Compiling xla/python/ifrt/client.cc; 20s local ... 2024-12-18T00:10:52.0143520Z 2024-12-18T00:10:52.0144601Z  2024-12-18T00:10:52.0145133Z  2024-12-18T00:10:52.0145545Z  2024-12-18T00:10:52.0145913Z  2024-12-18T00:10:52.0146279Z  2024-12-18T00:10:52.0146660Z  2024-12-18T00:10:52.0147020Z  2024-12-18T00:10:52.0147443Z  2024-12-18T00:10:52.0148040Z [14,476 / 15,187] 48 actions, 47 running 2024-12-18T00:10:52.0148894Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:10:52.0149853Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T00:10:52.0150736Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T00:10:52.0151625Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:10:52.0152400Z Compiling xla/service/service.cc; 26s local 2024-12-18T00:10:52.0153197Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2024-12-18T00:10:52.0154110Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T00:10:52.0154917Z Compiling xla/python/ifrt/client.cc; 21s local ... 2024-12-18T00:10:52.2559590Z 2024-12-18T00:10:52.2560702Z  2024-12-18T00:10:52.2561183Z  2024-12-18T00:10:52.2561609Z  2024-12-18T00:10:52.2561987Z  2024-12-18T00:10:52.2562422Z  2024-12-18T00:10:52.2562811Z  2024-12-18T00:10:52.2563176Z  2024-12-18T00:10:52.2563569Z  2024-12-18T00:10:52.2564175Z [14,477 / 15,187] 48 actions, 47 running 2024-12-18T00:10:52.2565036Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:10:52.2566054Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T00:10:52.2566975Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T00:10:52.2567886Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:10:52.2568712Z Compiling xla/service/service.cc; 26s local 2024-12-18T00:10:52.2569521Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:10:52.2570626Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T00:10:52.2571590Z Compiling xla/python/ifrt/client.cc; 21s local ... 2024-12-18T00:10:52.5519183Z 2024-12-18T00:10:52.5520046Z  2024-12-18T00:10:52.5520789Z  2024-12-18T00:10:52.5521193Z  2024-12-18T00:10:52.5521600Z  2024-12-18T00:10:52.5521996Z  2024-12-18T00:10:52.5522423Z  2024-12-18T00:10:52.5522786Z  2024-12-18T00:10:52.5523165Z  2024-12-18T00:10:52.5523746Z [14,477 / 15,187] 48 actions running 2024-12-18T00:10:52.5524638Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:10:52.5525664Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T00:10:52.5526586Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T00:10:52.5527495Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:10:52.5528341Z Compiling xla/service/service.cc; 26s local 2024-12-18T00:10:52.5529171Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:10:52.5530081Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T00:10:52.5530920Z Compiling xla/python/ifrt/client.cc; 21s local ... 2024-12-18T00:10:52.7608898Z 2024-12-18T00:10:52.7609841Z  2024-12-18T00:10:52.7610344Z  2024-12-18T00:10:52.7611010Z  2024-12-18T00:10:52.7611420Z  2024-12-18T00:10:52.7611795Z  2024-12-18T00:10:52.7612182Z  2024-12-18T00:10:52.7612794Z  2024-12-18T00:10:52.7613170Z  2024-12-18T00:10:52.7613749Z [14,478 / 15,187] 48 actions, 47 running 2024-12-18T00:10:52.7614620Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:10:52.7616061Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T00:10:52.7617435Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T00:10:52.7618515Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:10:52.7619606Z Compiling xla/service/service.cc; 27s local 2024-12-18T00:10:52.7620397Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:10:52.7621267Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T00:10:52.7622091Z Compiling xla/python/ifrt/client.cc; 21s local ... 2024-12-18T00:10:53.0275676Z 2024-12-18T00:10:53.0276592Z  2024-12-18T00:10:53.0277098Z  2024-12-18T00:10:53.0277485Z  2024-12-18T00:10:53.0277879Z  2024-12-18T00:10:53.0278252Z  2024-12-18T00:10:53.0278621Z  2024-12-18T00:10:53.0278991Z  2024-12-18T00:10:53.0279396Z  2024-12-18T00:10:53.0279968Z [14,479 / 15,187] 48 actions, 47 running 2024-12-18T00:10:53.0280814Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:10:53.0281748Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T00:10:53.0282663Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T00:10:53.0283574Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:10:53.0284353Z Compiling xla/service/service.cc; 27s local 2024-12-18T00:10:53.0285166Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:10:53.0286026Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T00:10:53.0286823Z Compiling xla/python/ifrt/client.cc; 22s local ... 2024-12-18T00:10:53.3524713Z 2024-12-18T00:10:53.3525596Z  2024-12-18T00:10:53.3526067Z  2024-12-18T00:10:53.3526459Z  2024-12-18T00:10:53.3526842Z  2024-12-18T00:10:53.3527265Z  2024-12-18T00:10:53.3527683Z  2024-12-18T00:10:53.3528059Z  2024-12-18T00:10:53.3528459Z  2024-12-18T00:10:53.3529051Z [14,479 / 15,187] 48 actions running 2024-12-18T00:10:53.3529993Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:10:53.3530983Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T00:10:53.3531851Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T00:10:53.3532712Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:10:53.3533810Z Compiling xla/service/service.cc; 27s local 2024-12-18T00:10:53.3534585Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:10:53.3535512Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T00:10:53.3536675Z Compiling xla/python/ifrt/client.cc; 22s local ... 2024-12-18T00:10:53.6467600Z 2024-12-18T00:10:53.6468465Z  2024-12-18T00:10:53.6468966Z  2024-12-18T00:10:53.6469370Z  2024-12-18T00:10:53.6469752Z  2024-12-18T00:10:53.6470139Z  2024-12-18T00:10:53.6470516Z  2024-12-18T00:10:53.6470903Z  2024-12-18T00:10:53.6471280Z  2024-12-18T00:10:53.6471876Z [14,480 / 15,187] 48 actions, 47 running 2024-12-18T00:10:53.6472724Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:10:53.6473695Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T00:10:53.6474569Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T00:10:53.6475439Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:10:53.6476494Z Compiling xla/service/service.cc; 27s local 2024-12-18T00:10:53.6477344Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:10:53.6478367Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T00:10:53.6479149Z Compiling xla/python/ifrt/client.cc; 22s local ... 2024-12-18T00:10:53.8970734Z 2024-12-18T00:10:53.8971724Z  2024-12-18T00:10:53.8972286Z  2024-12-18T00:10:53.8972645Z  2024-12-18T00:10:53.8972983Z  2024-12-18T00:10:53.8973316Z  2024-12-18T00:10:53.8973962Z  2024-12-18T00:10:53.8974400Z  2024-12-18T00:10:53.8974743Z  2024-12-18T00:10:53.8975279Z [14,485 / 15,187] 48 actions, 47 running 2024-12-18T00:10:53.8976104Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:10:53.8977091Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T00:10:53.8977894Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T00:10:53.8978692Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:10:53.8979381Z Compiling xla/service/service.cc; 28s local 2024-12-18T00:10:53.8980083Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:10:53.8980864Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T00:10:53.8981640Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local ... 2024-12-18T00:10:54.1531814Z 2024-12-18T00:10:54.1532671Z  2024-12-18T00:10:54.1533182Z  2024-12-18T00:10:54.1533625Z  2024-12-18T00:10:54.1534031Z  2024-12-18T00:10:54.1534429Z  2024-12-18T00:10:54.1534829Z  2024-12-18T00:10:54.1535228Z  2024-12-18T00:10:54.1535616Z  2024-12-18T00:10:54.1536171Z [14,485 / 15,187] 48 actions running 2024-12-18T00:10:54.1537172Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:10:54.1538164Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T00:10:54.1539074Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T00:10:54.1540006Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:10:54.1540816Z Compiling xla/service/service.cc; 28s local 2024-12-18T00:10:54.1541612Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:10:54.1542514Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T00:10:54.1543466Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local ... 2024-12-18T00:10:54.4108281Z 2024-12-18T00:10:54.4109213Z  2024-12-18T00:10:54.4109692Z  2024-12-18T00:10:54.4110067Z  2024-12-18T00:10:54.4110421Z  2024-12-18T00:10:54.4110748Z  2024-12-18T00:10:54.4111110Z  2024-12-18T00:10:54.4111479Z  2024-12-18T00:10:54.4112143Z  2024-12-18T00:10:54.4112735Z [14,486 / 15,187] 48 actions, 47 running 2024-12-18T00:10:54.4113572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:10:54.4114499Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T00:10:54.4115413Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T00:10:54.4116299Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:10:54.4117100Z Compiling xla/service/service.cc; 28s local 2024-12-18T00:10:54.4117863Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:10:54.4118776Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T00:10:54.4119707Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local ... 2024-12-18T00:10:54.6371572Z 2024-12-18T00:10:54.6372479Z  2024-12-18T00:10:54.6372982Z  2024-12-18T00:10:54.6373381Z  2024-12-18T00:10:54.6373803Z  2024-12-18T00:10:54.6374180Z  2024-12-18T00:10:54.6374551Z  2024-12-18T00:10:54.6374915Z  2024-12-18T00:10:54.6375560Z  2024-12-18T00:10:54.6376179Z [14,487 / 15,187] 48 actions, 47 running 2024-12-18T00:10:54.6377133Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:10:54.6378259Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T00:10:54.6379151Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T00:10:54.6380049Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:10:54.6380867Z Compiling xla/service/service.cc; 28s local 2024-12-18T00:10:54.6381807Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:10:54.6382742Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2024-12-18T00:10:54.6383603Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local ... 2024-12-18T00:10:54.9539559Z 2024-12-18T00:10:54.9540616Z  2024-12-18T00:10:54.9541079Z  2024-12-18T00:10:54.9541477Z  2024-12-18T00:10:54.9541852Z  2024-12-18T00:10:54.9542254Z  2024-12-18T00:10:54.9542633Z  2024-12-18T00:10:54.9543034Z  2024-12-18T00:10:54.9543438Z  2024-12-18T00:10:54.9543988Z [14,487 / 15,187] 48 actions running 2024-12-18T00:10:54.9545166Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:10:54.9546099Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T00:10:54.9546978Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T00:10:54.9547889Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:10:54.9548685Z Compiling xla/service/service.cc; 29s local 2024-12-18T00:10:54.9549496Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:10:54.9550386Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2024-12-18T00:10:54.9551273Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local ... 2024-12-18T00:10:55.1542597Z 2024-12-18T00:10:55.1543500Z  2024-12-18T00:10:55.1544018Z  2024-12-18T00:10:55.1544692Z  2024-12-18T00:10:55.1545079Z  2024-12-18T00:10:55.1545476Z  2024-12-18T00:10:55.1545832Z  2024-12-18T00:10:55.1546201Z  2024-12-18T00:10:55.1546589Z  2024-12-18T00:10:55.1547132Z [14,488 / 15,187] 48 actions running 2024-12-18T00:10:55.1547965Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:10:55.1548918Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T00:10:55.1549791Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T00:10:55.1550838Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:10:55.1551733Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:10:55.1552658Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2024-12-18T00:10:55.1553818Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:10:55.1554581Z Compiling xla/python/ifrt/executable.cc; 16s local ... 2024-12-18T00:10:55.4277248Z 2024-12-18T00:10:55.4278141Z  2024-12-18T00:10:55.4278687Z  2024-12-18T00:10:55.4279086Z  2024-12-18T00:10:55.4279468Z  2024-12-18T00:10:55.4279839Z  2024-12-18T00:10:55.4280249Z  2024-12-18T00:10:55.4280647Z  2024-12-18T00:10:55.4281011Z  2024-12-18T00:10:55.4282383Z [14,489 / 15,187] 48 actions, 47 running 2024-12-18T00:10:55.4283318Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:10:55.4284316Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T00:10:55.4285223Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T00:10:55.4286156Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:10:55.4287137Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:10:55.4288350Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2024-12-18T00:10:55.4289332Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:10:55.4290110Z Compiling xla/python/ifrt/executable.cc; 17s local ... 2024-12-18T00:10:55.7552490Z 2024-12-18T00:10:55.7553516Z  2024-12-18T00:10:55.7554012Z  2024-12-18T00:10:55.7554399Z  2024-12-18T00:10:55.7554773Z  2024-12-18T00:10:55.7555141Z  2024-12-18T00:10:55.7555517Z  2024-12-18T00:10:55.7555891Z  2024-12-18T00:10:55.7556281Z  2024-12-18T00:10:55.7557095Z [14,489 / 15,187] 48 actions running 2024-12-18T00:10:55.7557931Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:10:55.7558868Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T00:10:55.7559712Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T00:10:55.7560638Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:10:55.7561584Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:10:55.7562455Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2024-12-18T00:10:55.7563297Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:10:55.7564039Z Compiling xla/python/ifrt/executable.cc; 17s local ... 2024-12-18T00:10:55.9553198Z 2024-12-18T00:10:55.9554084Z  2024-12-18T00:10:55.9554553Z  2024-12-18T00:10:55.9554961Z  2024-12-18T00:10:55.9555364Z  2024-12-18T00:10:55.9555744Z  2024-12-18T00:10:55.9556160Z  2024-12-18T00:10:55.9556551Z  2024-12-18T00:10:55.9556960Z  2024-12-18T00:10:55.9557513Z [14,490 / 15,187] 48 actions running 2024-12-18T00:10:55.9558428Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:10:55.9559440Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T00:10:55.9560398Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T00:10:55.9561278Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:10:55.9562204Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:10:55.9563156Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2024-12-18T00:10:55.9564195Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2024-12-18T00:10:55.9565010Z Compiling xla/python/ifrt/executable.cc; 17s local ... 2024-12-18T00:10:57.1560022Z 2024-12-18T00:10:57.1560915Z  2024-12-18T00:10:57.1561387Z  2024-12-18T00:10:57.1561780Z  2024-12-18T00:10:57.1562164Z  2024-12-18T00:10:57.1562537Z  2024-12-18T00:10:57.1562907Z  2024-12-18T00:10:57.1563298Z  2024-12-18T00:10:57.1563670Z  2024-12-18T00:10:57.1564229Z [14,490 / 15,187] 48 actions running 2024-12-18T00:10:57.1565679Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:10:57.1567127Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T00:10:57.1568135Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2024-12-18T00:10:57.1569195Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:10:57.1570273Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:10:57.1571372Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2024-12-18T00:10:57.1572341Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:10:57.1573298Z Compiling xla/python/ifrt/executable.cc; 18s local ... 2024-12-18T00:10:57.3655923Z 2024-12-18T00:10:57.3657036Z  2024-12-18T00:10:57.3657502Z  2024-12-18T00:10:57.3657877Z  2024-12-18T00:10:57.3658249Z  2024-12-18T00:10:57.3658626Z  2024-12-18T00:10:57.3659000Z  2024-12-18T00:10:57.3659314Z  2024-12-18T00:10:57.3659655Z  2024-12-18T00:10:57.3660146Z [14,491 / 15,187] 48 actions, 47 running 2024-12-18T00:10:57.3661102Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:10:57.3662032Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T00:10:57.3663047Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2024-12-18T00:10:57.3663979Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:10:57.3664909Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:10:57.3665866Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2024-12-18T00:10:57.3666835Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:10:57.3667599Z Compiling xla/python/ifrt/executable.cc; 18s local ... 2024-12-18T00:10:57.5822999Z 2024-12-18T00:10:57.5823872Z  2024-12-18T00:10:57.5824386Z  2024-12-18T00:10:57.5824777Z  2024-12-18T00:10:57.5825160Z  2024-12-18T00:10:57.5825603Z  2024-12-18T00:10:57.5825975Z  2024-12-18T00:10:57.5826373Z  2024-12-18T00:10:57.5826753Z  2024-12-18T00:10:57.5827357Z [14,494 / 15,187] 47 actions, 46 running 2024-12-18T00:10:57.5828211Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:10:57.5829210Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T00:10:57.5830121Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:10:57.5831028Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:10:57.5831949Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2024-12-18T00:10:57.5832776Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:10:57.5833415Z Compiling xla/python/ifrt/executable.cc; 19s local 2024-12-18T00:10:57.5834306Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local ... 2024-12-18T00:10:57.9005403Z 2024-12-18T00:10:57.9006295Z  2024-12-18T00:10:57.9006815Z  2024-12-18T00:10:57.9007227Z  2024-12-18T00:10:57.9007619Z  2024-12-18T00:10:57.9008016Z  2024-12-18T00:10:57.9008391Z  2024-12-18T00:10:57.9008764Z  2024-12-18T00:10:57.9009161Z  2024-12-18T00:10:57.9009781Z [14,495 / 15,187] 48 actions, 47 running 2024-12-18T00:10:57.9010681Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:10:57.9011586Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T00:10:57.9012554Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:10:57.9013683Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:10:57.9014626Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2024-12-18T00:10:57.9015446Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:10:57.9016227Z Compiling xla/python/ifrt/executable.cc; 19s local 2024-12-18T00:10:57.9017609Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local ... 2024-12-18T00:10:58.1567591Z 2024-12-18T00:10:58.1568495Z  2024-12-18T00:10:58.1568924Z  2024-12-18T00:10:58.1569291Z  2024-12-18T00:10:58.1569688Z  2024-12-18T00:10:58.1570141Z  2024-12-18T00:10:58.1570510Z  2024-12-18T00:10:58.1570916Z  2024-12-18T00:10:58.1571306Z  2024-12-18T00:10:58.1571884Z [14,495 / 15,187] 48 actions running 2024-12-18T00:10:58.1572760Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:10:58.1573756Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T00:10:58.1574690Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:10:58.1575577Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:10:58.1576363Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2024-12-18T00:10:58.1577322Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:10:58.1578130Z Compiling xla/python/ifrt/executable.cc; 19s local 2024-12-18T00:10:58.1579345Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local ... 2024-12-18T00:10:58.3624349Z 2024-12-18T00:10:58.3625267Z  2024-12-18T00:10:58.3626157Z  2024-12-18T00:10:58.3626554Z  2024-12-18T00:10:58.3626935Z  2024-12-18T00:10:58.3627288Z  2024-12-18T00:10:58.3627663Z  2024-12-18T00:10:58.3628049Z  2024-12-18T00:10:58.3628424Z  2024-12-18T00:10:58.3628985Z [14,496 / 15,187] 48 actions, 47 running 2024-12-18T00:10:58.3630035Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:10:58.3631045Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T00:10:58.3631958Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:10:58.3632812Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:10:58.3633717Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2024-12-18T00:10:58.3634574Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:10:58.3635402Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2024-12-18T00:10:58.3636282Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local ... 2024-12-18T00:10:58.7151458Z 2024-12-18T00:10:58.7152351Z  2024-12-18T00:10:58.7152835Z  2024-12-18T00:10:58.7153223Z  2024-12-18T00:10:58.7153621Z  2024-12-18T00:10:58.7153978Z  2024-12-18T00:10:58.7154321Z  2024-12-18T00:10:58.7154615Z  2024-12-18T00:10:58.7154953Z  2024-12-18T00:10:58.7155546Z [14,498 / 15,187] 48 actions, 47 running 2024-12-18T00:10:58.7156356Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:10:58.7157490Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T00:10:58.7158595Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:10:58.7159521Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:10:58.7160271Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2024-12-18T00:10:58.7160961Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:10:58.7161730Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2024-12-18T00:10:58.7162761Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local ... 2024-12-18T00:10:58.9578358Z 2024-12-18T00:10:58.9579265Z  2024-12-18T00:10:58.9579718Z  2024-12-18T00:10:58.9580112Z  2024-12-18T00:10:58.9580493Z  2024-12-18T00:10:58.9580922Z  2024-12-18T00:10:58.9581313Z  2024-12-18T00:10:58.9581699Z  2024-12-18T00:10:58.9582092Z  2024-12-18T00:10:58.9582641Z [14,499 / 15,187] 48 actions running 2024-12-18T00:10:58.9583497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:10:58.9584716Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T00:10:58.9585661Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:10:58.9586598Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:10:58.9587519Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2024-12-18T00:10:58.9588377Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:10:58.9589244Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2024-12-18T00:10:58.9590187Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local ... 2024-12-18T00:10:59.3583258Z 2024-12-18T00:10:59.3584091Z  2024-12-18T00:10:59.3584579Z  2024-12-18T00:10:59.3584957Z  2024-12-18T00:10:59.3585336Z  2024-12-18T00:10:59.3585720Z  2024-12-18T00:10:59.3586086Z  2024-12-18T00:10:59.3586442Z  2024-12-18T00:10:59.3586790Z  2024-12-18T00:10:59.3587284Z [14,500 / 15,187] 48 actions running 2024-12-18T00:10:59.3588129Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:10:59.3589344Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T00:10:59.3590303Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:10:59.3591359Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2024-12-18T00:10:59.3592284Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2024-12-18T00:10:59.3593164Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:10:59.3594029Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2024-12-18T00:10:59.3595070Z Compiling xla/pjrt/distributed/topology_util.cc; 19s local ... 2024-12-18T00:11:00.3591833Z 2024-12-18T00:11:00.3592726Z  2024-12-18T00:11:00.3593221Z  2024-12-18T00:11:00.3593615Z  2024-12-18T00:11:00.3593986Z  2024-12-18T00:11:00.3594369Z  2024-12-18T00:11:00.3594743Z  2024-12-18T00:11:00.3595168Z  2024-12-18T00:11:00.3595536Z  2024-12-18T00:11:00.3596077Z [14,500 / 15,187] 48 actions running 2024-12-18T00:11:00.3596931Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:11:00.3597922Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2024-12-18T00:11:00.3598809Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 36s local 2024-12-18T00:11:00.3599688Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:11:00.3600604Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2024-12-18T00:11:00.3601496Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:11:00.3602335Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T00:11:00.3603254Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local ... 2024-12-18T00:11:00.6151376Z 2024-12-18T00:11:00.6152204Z  2024-12-18T00:11:00.6152689Z  2024-12-18T00:11:00.6153122Z  2024-12-18T00:11:00.6153529Z  2024-12-18T00:11:00.6153926Z  2024-12-18T00:11:00.6154315Z  2024-12-18T00:11:00.6154695Z  2024-12-18T00:11:00.6155062Z  2024-12-18T00:11:00.6155635Z [14,501 / 15,187] 48 actions, 47 running 2024-12-18T00:11:00.6156467Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:11:00.6157338Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2024-12-18T00:11:00.6158225Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 36s local 2024-12-18T00:11:00.6159114Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:11:00.6160062Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2024-12-18T00:11:00.6160861Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:11:00.6161706Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T00:11:00.6162614Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local ... 2024-12-18T00:11:00.9597703Z 2024-12-18T00:11:00.9598551Z  2024-12-18T00:11:00.9598965Z  2024-12-18T00:11:00.9599335Z  2024-12-18T00:11:00.9599669Z  2024-12-18T00:11:00.9600019Z  2024-12-18T00:11:00.9600364Z  2024-12-18T00:11:00.9600712Z  2024-12-18T00:11:00.9601052Z  2024-12-18T00:11:00.9601527Z [14,501 / 15,187] 48 actions running 2024-12-18T00:11:00.9602284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:11:00.9603122Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2024-12-18T00:11:00.9603984Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 36s local 2024-12-18T00:11:00.9604813Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:11:00.9605604Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2024-12-18T00:11:00.9606342Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:11:00.9607091Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T00:11:00.9608267Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local ... 2024-12-18T00:11:01.3794347Z 2024-12-18T00:11:01.3795239Z  2024-12-18T00:11:01.3795637Z  2024-12-18T00:11:01.3796226Z  2024-12-18T00:11:01.3796563Z  2024-12-18T00:11:01.3796895Z  2024-12-18T00:11:01.3797209Z  2024-12-18T00:11:01.3797541Z  2024-12-18T00:11:01.3797871Z  2024-12-18T00:11:01.3798397Z [14,502 / 15,187] 48 actions, 47 running 2024-12-18T00:11:01.3799164Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:11:01.3810696Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2024-12-18T00:11:01.3811707Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 37s local 2024-12-18T00:11:01.3812533Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:11:01.3813317Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2024-12-18T00:11:01.3814061Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:11:01.3814804Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T00:11:01.3815603Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local ... 2024-12-18T00:11:01.7604673Z 2024-12-18T00:11:01.7605550Z  2024-12-18T00:11:01.7605998Z  2024-12-18T00:11:01.7606385Z  2024-12-18T00:11:01.7606776Z  2024-12-18T00:11:01.7607161Z  2024-12-18T00:11:01.7607515Z  2024-12-18T00:11:01.7607897Z  2024-12-18T00:11:01.7608280Z  2024-12-18T00:11:01.7608849Z [14,502 / 15,187] 48 actions running 2024-12-18T00:11:01.7609691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:11:01.7610644Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T00:11:01.7611562Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 37s local 2024-12-18T00:11:01.7612473Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:11:01.7613368Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2024-12-18T00:11:01.7614215Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:11:01.7615024Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T00:11:01.7615909Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local ... 2024-12-18T00:11:02.0231973Z 2024-12-18T00:11:02.0232861Z  2024-12-18T00:11:02.0233322Z  2024-12-18T00:11:02.0233692Z  2024-12-18T00:11:02.0234044Z  2024-12-18T00:11:02.0234383Z  2024-12-18T00:11:02.0234741Z  2024-12-18T00:11:02.0235124Z  2024-12-18T00:11:02.0235502Z  2024-12-18T00:11:02.0236072Z [14,503 / 15,187] 48 actions, 47 running 2024-12-18T00:11:02.0236907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:11:02.0237864Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T00:11:02.0239126Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 37s local 2024-12-18T00:11:02.0240048Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:11:02.0240950Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2024-12-18T00:11:02.0241736Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:11:02.0242514Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T00:11:02.0243425Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local ... 2024-12-18T00:11:02.3610839Z 2024-12-18T00:11:02.3611687Z  2024-12-18T00:11:02.3612182Z  2024-12-18T00:11:02.3612599Z  2024-12-18T00:11:02.3612991Z  2024-12-18T00:11:02.3613368Z  2024-12-18T00:11:02.3613744Z  2024-12-18T00:11:02.3614119Z  2024-12-18T00:11:02.3614494Z  2024-12-18T00:11:02.3615044Z [14,505 / 15,187] 48 actions running 2024-12-18T00:11:02.3615835Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:11:02.3617502Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T00:11:02.3618465Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:11:02.3619530Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2024-12-18T00:11:02.3620375Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:11:02.3621217Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T00:11:02.3622126Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2024-12-18T00:11:02.3623204Z Compiling xla/service/elemental_ir_emitter.cc; 19s local ... 2024-12-18T00:11:02.7640180Z 2024-12-18T00:11:02.7641020Z  2024-12-18T00:11:02.7641486Z  2024-12-18T00:11:02.7641867Z  2024-12-18T00:11:02.7642242Z  2024-12-18T00:11:02.7642629Z  2024-12-18T00:11:02.7643021Z  2024-12-18T00:11:02.7643389Z  2024-12-18T00:11:02.7643801Z  2024-12-18T00:11:02.7644638Z [14,506 / 15,187] 48 actions, 47 running 2024-12-18T00:11:02.7645544Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:11:02.7646532Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T00:11:02.7647450Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:11:02.7648368Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2024-12-18T00:11:02.7649275Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:11:02.7650135Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2024-12-18T00:11:02.7651022Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2024-12-18T00:11:02.7651866Z Compiling xla/service/elemental_ir_emitter.cc; 20s local ... 2024-12-18T00:11:02.9646546Z 2024-12-18T00:11:02.9647428Z  2024-12-18T00:11:02.9647887Z  2024-12-18T00:11:02.9648295Z  2024-12-18T00:11:02.9648724Z  2024-12-18T00:11:02.9649107Z  2024-12-18T00:11:02.9649470Z  2024-12-18T00:11:02.9649858Z  2024-12-18T00:11:02.9650253Z  2024-12-18T00:11:02.9650818Z [14,506 / 15,187] 48 actions running 2024-12-18T00:11:02.9651649Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:11:02.9652660Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T00:11:02.9653627Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:11:02.9654538Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2024-12-18T00:11:02.9655364Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:11:02.9656213Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2024-12-18T00:11:02.9657292Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2024-12-18T00:11:02.9658209Z Compiling xla/service/elemental_ir_emitter.cc; 20s local ... 2024-12-18T00:11:03.6209249Z 2024-12-18T00:11:03.6210352Z  2024-12-18T00:11:03.6210812Z  2024-12-18T00:11:03.6211184Z  2024-12-18T00:11:03.6211533Z  2024-12-18T00:11:03.6211921Z  2024-12-18T00:11:03.6212274Z  2024-12-18T00:11:03.6212574Z  2024-12-18T00:11:03.6212934Z  2024-12-18T00:11:03.6213481Z [14,507 / 15,187] 48 actions, 47 running 2024-12-18T00:11:03.6214295Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:11:03.6215244Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T00:11:03.6216104Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:11:03.6217228Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2024-12-18T00:11:03.6218043Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:11:03.6218868Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2024-12-18T00:11:03.6219754Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T00:11:03.6220551Z Compiling xla/service/elemental_ir_emitter.cc; 21s local ... 2024-12-18T00:11:03.8403374Z 2024-12-18T00:11:03.8404489Z  2024-12-18T00:11:03.8405036Z  2024-12-18T00:11:03.8405460Z  2024-12-18T00:11:03.8405824Z  2024-12-18T00:11:03.8406345Z  2024-12-18T00:11:03.8406738Z  2024-12-18T00:11:03.8407123Z  2024-12-18T00:11:03.8407486Z  2024-12-18T00:11:03.8408041Z [14,508 / 15,187] 48 actions, 47 running 2024-12-18T00:11:03.8408930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:11:03.8410050Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2024-12-18T00:11:03.8411027Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:11:03.8412022Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:11:03.8412870Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:11:03.8413747Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T00:11:03.8414646Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T00:11:03.8415604Z Compiling xla/service/elemental_ir_emitter.cc; 21s local ... 2024-12-18T00:11:04.1654003Z 2024-12-18T00:11:04.1654823Z  2024-12-18T00:11:04.1655198Z  2024-12-18T00:11:04.1655536Z  2024-12-18T00:11:04.1655891Z  2024-12-18T00:11:04.1656276Z  2024-12-18T00:11:04.1656744Z  2024-12-18T00:11:04.1657055Z  2024-12-18T00:11:04.1657372Z  2024-12-18T00:11:04.1657875Z [14,508 / 15,187] 48 actions running 2024-12-18T00:11:04.1658596Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:11:04.1659514Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2024-12-18T00:11:04.1660242Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:11:04.1661016Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:11:04.1661839Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:11:04.1662593Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T00:11:04.1663313Z Compiling xla/pjrt/distributed/topology_util.cc; 24s local 2024-12-18T00:11:04.1664144Z Compiling xla/service/elemental_ir_emitter.cc; 21s local ... 2024-12-18T00:11:04.5422301Z 2024-12-18T00:11:04.5423192Z  2024-12-18T00:11:04.5423694Z  2024-12-18T00:11:04.5424094Z  2024-12-18T00:11:04.5424488Z  2024-12-18T00:11:04.5424853Z  2024-12-18T00:11:04.5425221Z  2024-12-18T00:11:04.5425590Z  2024-12-18T00:11:04.5425962Z  2024-12-18T00:11:04.5426583Z [14,512 / 15,187] 48 actions, 47 running 2024-12-18T00:11:04.5427419Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:11:04.5428367Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2024-12-18T00:11:04.5429288Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:11:04.5430535Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:11:04.5431399Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:11:04.5432229Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T00:11:04.5433096Z Compiling xla/service/elemental_ir_emitter.cc; 22s local 2024-12-18T00:11:04.5434095Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local ... 2024-12-18T00:11:04.7662624Z 2024-12-18T00:11:04.7663532Z  2024-12-18T00:11:04.7664192Z  2024-12-18T00:11:04.7664616Z  2024-12-18T00:11:04.7665028Z  2024-12-18T00:11:04.7665451Z  2024-12-18T00:11:04.7665835Z  2024-12-18T00:11:04.7666236Z  2024-12-18T00:11:04.7666629Z  2024-12-18T00:11:04.7667211Z [14,512 / 15,187] 48 actions running 2024-12-18T00:11:04.7668097Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:11:04.7669095Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T00:11:04.7670389Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:11:04.7671354Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:11:04.7672364Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:11:04.7673248Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T00:11:04.7674274Z Compiling xla/service/elemental_ir_emitter.cc; 22s local 2024-12-18T00:11:04.7675370Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local ... 2024-12-18T00:11:05.4709767Z 2024-12-18T00:11:05.4710893Z  2024-12-18T00:11:05.4711405Z  2024-12-18T00:11:05.4711776Z  2024-12-18T00:11:05.4712154Z  2024-12-18T00:11:05.4712515Z  2024-12-18T00:11:05.4712877Z  2024-12-18T00:11:05.4713271Z  2024-12-18T00:11:05.4713635Z  2024-12-18T00:11:05.4714193Z [14,513 / 15,187] 48 actions, 47 running 2024-12-18T00:11:05.4714974Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:11:05.4715936Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T00:11:05.4716812Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:11:05.4717720Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:11:05.4718573Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:11:05.4719431Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T00:11:05.4720246Z Compiling xla/service/elemental_ir_emitter.cc; 22s local 2024-12-18T00:11:05.4721220Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local ... 2024-12-18T00:11:05.7260880Z 2024-12-18T00:11:05.7261770Z  2024-12-18T00:11:05.7262241Z  2024-12-18T00:11:05.7262751Z  2024-12-18T00:11:05.7263132Z  2024-12-18T00:11:05.7263518Z  2024-12-18T00:11:05.7263932Z  2024-12-18T00:11:05.7264323Z  2024-12-18T00:11:05.7264691Z  2024-12-18T00:11:05.7265307Z [14,514 / 15,187] 48 actions, 47 running 2024-12-18T00:11:05.7266420Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:11:05.7267475Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2024-12-18T00:11:05.7268398Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:11:05.7269330Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:11:05.7270353Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:11:05.7271246Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T00:11:05.7272141Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2024-12-18T00:11:05.7273157Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local ... 2024-12-18T00:11:05.9669003Z 2024-12-18T00:11:05.9670163Z  2024-12-18T00:11:05.9670646Z  2024-12-18T00:11:05.9671037Z  2024-12-18T00:11:05.9671429Z  2024-12-18T00:11:05.9671830Z  2024-12-18T00:11:05.9672211Z  2024-12-18T00:11:05.9672585Z  2024-12-18T00:11:05.9672971Z  2024-12-18T00:11:05.9673538Z [14,514 / 15,187] 48 actions running 2024-12-18T00:11:05.9674424Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:11:05.9675349Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2024-12-18T00:11:05.9676237Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:11:05.9677116Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:11:05.9678098Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:11:05.9678946Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2024-12-18T00:11:05.9679778Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2024-12-18T00:11:05.9680771Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local ... 2024-12-18T00:11:06.8505547Z 2024-12-18T00:11:06.8506369Z  2024-12-18T00:11:06.8507140Z  2024-12-18T00:11:06.8507550Z  2024-12-18T00:11:06.8507928Z  2024-12-18T00:11:06.8508434Z  2024-12-18T00:11:06.8508826Z  2024-12-18T00:11:06.8509218Z  2024-12-18T00:11:06.8509606Z  2024-12-18T00:11:06.8510177Z [14,515 / 15,187] 48 actions, 47 running 2024-12-18T00:11:06.8511043Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:11:06.8511997Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T00:11:06.8513095Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:11:06.8514052Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:11:06.8514883Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:11:06.8515743Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2024-12-18T00:11:06.8516643Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2024-12-18T00:11:06.8517668Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local ... 2024-12-18T00:11:07.1678638Z 2024-12-18T00:11:07.1679559Z  2024-12-18T00:11:07.1680019Z  2024-12-18T00:11:07.1680432Z  2024-12-18T00:11:07.1680821Z  2024-12-18T00:11:07.1681187Z  2024-12-18T00:11:07.1681565Z  2024-12-18T00:11:07.1681985Z  2024-12-18T00:11:07.1682386Z  2024-12-18T00:11:07.1682950Z [14,515 / 15,187] 48 actions running 2024-12-18T00:11:07.1683814Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:11:07.1684720Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T00:11:07.1685596Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:11:07.1686499Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:11:07.1687307Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:11:07.1688137Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2024-12-18T00:11:07.1688976Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2024-12-18T00:11:07.1689981Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local ... 2024-12-18T00:11:07.4520261Z 2024-12-18T00:11:07.4521111Z  2024-12-18T00:11:07.4521595Z  2024-12-18T00:11:07.4522003Z  2024-12-18T00:11:07.4522389Z  2024-12-18T00:11:07.4522755Z  2024-12-18T00:11:07.4523155Z  2024-12-18T00:11:07.4523568Z  2024-12-18T00:11:07.4523992Z  2024-12-18T00:11:07.4524722Z [14,516 / 15,187] 48 actions, 47 running 2024-12-18T00:11:07.4525582Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:11:07.4526527Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T00:11:07.4527424Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:11:07.4528643Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:11:07.4529463Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:11:07.4530244Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2024-12-18T00:11:07.4531239Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:11:07.4532301Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local ... 2024-12-18T00:11:07.7683790Z 2024-12-18T00:11:07.7684625Z  2024-12-18T00:11:07.7685090Z  2024-12-18T00:11:07.7685505Z  2024-12-18T00:11:07.7685918Z  2024-12-18T00:11:07.7686377Z  2024-12-18T00:11:07.7686911Z  2024-12-18T00:11:07.7687286Z  2024-12-18T00:11:07.7687639Z  2024-12-18T00:11:07.7688192Z [14,517 / 15,187] 48 actions running 2024-12-18T00:11:07.7689006Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:11:07.7689943Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T00:11:07.7691160Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:11:07.7692178Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:11:07.7693226Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:11:07.7694022Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2024-12-18T00:11:07.7694972Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:11:07.7696003Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local ... 2024-12-18T00:11:08.1288388Z 2024-12-18T00:11:08.1289420Z  2024-12-18T00:11:08.1289906Z  2024-12-18T00:11:08.1290285Z  2024-12-18T00:11:08.1290665Z  2024-12-18T00:11:08.1291023Z  2024-12-18T00:11:08.1291401Z  2024-12-18T00:11:08.1291783Z  2024-12-18T00:11:08.1292178Z  2024-12-18T00:11:08.1292757Z [14,518 / 15,187] 48 actions, 47 running 2024-12-18T00:11:08.1293587Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:11:08.1294537Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T00:11:08.1295448Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:11:08.1296258Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:11:08.1297186Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2024-12-18T00:11:08.1298128Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:11:08.1299134Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2024-12-18T00:11:08.1300097Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2024-12-18T00:11:08.3689457Z 2024-12-18T00:11:08.3690319Z  2024-12-18T00:11:08.3690781Z  2024-12-18T00:11:08.3691182Z  2024-12-18T00:11:08.3691557Z  2024-12-18T00:11:08.3691954Z  2024-12-18T00:11:08.3692332Z  2024-12-18T00:11:08.3692698Z  2024-12-18T00:11:08.3693100Z  2024-12-18T00:11:08.3693685Z [14,519 / 15,187] 48 actions running 2024-12-18T00:11:08.3694574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:11:08.3695504Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T00:11:08.3696551Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:11:08.3697423Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:11:08.3698155Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2024-12-18T00:11:08.3699113Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:11:08.3700081Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2024-12-18T00:11:08.3700987Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2024-12-18T00:11:08.7694297Z 2024-12-18T00:11:08.7695558Z  2024-12-18T00:11:08.7696061Z  2024-12-18T00:11:08.7696541Z  2024-12-18T00:11:08.7696937Z  2024-12-18T00:11:08.7697341Z  2024-12-18T00:11:08.7697720Z  2024-12-18T00:11:08.7698091Z  2024-12-18T00:11:08.7698429Z  2024-12-18T00:11:08.7698997Z [14,520 / 15,187] 48 actions running 2024-12-18T00:11:08.7699835Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:11:08.7700751Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T00:11:08.7701485Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:11:08.7702246Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:11:08.7702942Z Compiling xla/service/elemental_ir_emitter.cc; 26s local 2024-12-18T00:11:08.7703892Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:11:08.7704738Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2024-12-18T00:11:08.7705704Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2024-12-18T00:11:09.0789966Z 2024-12-18T00:11:09.0791099Z  2024-12-18T00:11:09.0791551Z  2024-12-18T00:11:09.0791922Z  2024-12-18T00:11:09.0792280Z  2024-12-18T00:11:09.0792750Z  2024-12-18T00:11:09.0793107Z  2024-12-18T00:11:09.0793441Z  2024-12-18T00:11:09.0793795Z  2024-12-18T00:11:09.0794373Z [14,523 / 15,187] 48 actions, 47 running 2024-12-18T00:11:09.0795292Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:11:09.0796067Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T00:11:09.0798814Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:11:09.0799710Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:11:09.0800462Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:11:09.0801276Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2024-12-18T00:11:09.0801973Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T00:11:09.0802793Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local ... 2024-12-18T00:11:09.3700674Z 2024-12-18T00:11:09.3701511Z  2024-12-18T00:11:09.3701979Z  2024-12-18T00:11:09.3702370Z  2024-12-18T00:11:09.3702771Z  2024-12-18T00:11:09.3703169Z  2024-12-18T00:11:09.3703565Z  2024-12-18T00:11:09.3703962Z  2024-12-18T00:11:09.3704340Z  2024-12-18T00:11:09.3704903Z [14,523 / 15,187] 48 actions running 2024-12-18T00:11:09.3705760Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:11:09.3706782Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T00:11:09.3707668Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:11:09.3708548Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:11:09.3709506Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:11:09.3710570Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T00:11:09.3711443Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T00:11:09.3712383Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local ... 2024-12-18T00:11:09.5704095Z 2024-12-18T00:11:09.5704999Z  2024-12-18T00:11:09.5705400Z  2024-12-18T00:11:09.5705772Z  2024-12-18T00:11:09.5706131Z  2024-12-18T00:11:09.5706489Z  2024-12-18T00:11:09.5706838Z  2024-12-18T00:11:09.5707183Z  2024-12-18T00:11:09.5707522Z  2024-12-18T00:11:09.5708091Z [14,524 / 15,187] 48 actions running 2024-12-18T00:11:09.5709035Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:11:09.5709931Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T00:11:09.5710770Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:11:09.5712370Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:11:09.5713253Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:11:09.5714179Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T00:11:09.5714887Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T00:11:09.5715673Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local ... 2024-12-18T00:11:09.9710067Z 2024-12-18T00:11:09.9710895Z  2024-12-18T00:11:09.9711376Z  2024-12-18T00:11:09.9711777Z  2024-12-18T00:11:09.9712173Z  2024-12-18T00:11:09.9712609Z  2024-12-18T00:11:09.9713004Z  2024-12-18T00:11:09.9713378Z  2024-12-18T00:11:09.9713873Z  2024-12-18T00:11:09.9714534Z [14,527 / 15,187] 48 actions running 2024-12-18T00:11:09.9715383Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:11:09.9716397Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T00:11:09.9717571Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:11:09.9718446Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:11:09.9719526Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:11:09.9720529Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T00:11:09.9721355Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T00:11:09.9722286Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local ... 2024-12-18T00:11:10.4023021Z 2024-12-18T00:11:10.4024157Z  2024-12-18T00:11:10.4024637Z  2024-12-18T00:11:10.4025032Z  2024-12-18T00:11:10.4025427Z  2024-12-18T00:11:10.4025797Z  2024-12-18T00:11:10.4026186Z  2024-12-18T00:11:10.4026580Z  2024-12-18T00:11:10.4026974Z  2024-12-18T00:11:10.4027564Z [14,528 / 15,187] 48 actions, 47 running 2024-12-18T00:11:10.4028422Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:11:10.4029394Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T00:11:10.4030318Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:11:10.4031328Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:11:10.4032259Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2024-12-18T00:11:10.4033215Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T00:11:10.4034030Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T00:11:10.4034905Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local ... 2024-12-18T00:11:10.7716158Z 2024-12-18T00:11:10.7717074Z  2024-12-18T00:11:10.7717567Z  2024-12-18T00:11:10.7717965Z  2024-12-18T00:11:10.7718363Z  2024-12-18T00:11:10.7718757Z  2024-12-18T00:11:10.7719185Z  2024-12-18T00:11:10.7719581Z  2024-12-18T00:11:10.7719968Z  2024-12-18T00:11:10.7720536Z [14,528 / 15,187] 48 actions running 2024-12-18T00:11:10.7721377Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:11:10.7722352Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T00:11:10.7723387Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:11:10.7724172Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:11:10.7725079Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2024-12-18T00:11:10.7726048Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T00:11:10.7726800Z Compiling xla/pjrt/host_memory_spaces.cc; 22s local 2024-12-18T00:11:10.7727695Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local ... 2024-12-18T00:11:11.2236793Z 2024-12-18T00:11:11.2237618Z  2024-12-18T00:11:11.2238361Z  2024-12-18T00:11:11.2238766Z  2024-12-18T00:11:11.2239154Z  2024-12-18T00:11:11.2239556Z  2024-12-18T00:11:11.2239932Z  2024-12-18T00:11:11.2240333Z  2024-12-18T00:11:11.2240694Z  2024-12-18T00:11:11.2241216Z [14,529 / 15,187] 48 actions, 47 running 2024-12-18T00:11:11.2242029Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:11:11.2242989Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T00:11:11.2243904Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2024-12-18T00:11:11.2244988Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:11:11.2245908Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2024-12-18T00:11:11.2246968Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T00:11:11.2247911Z Compiling xla/pjrt/host_memory_spaces.cc; 22s local 2024-12-18T00:11:11.2248821Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local ... 2024-12-18T00:11:11.4619540Z 2024-12-18T00:11:11.4620373Z  2024-12-18T00:11:11.4621130Z  2024-12-18T00:11:11.4621523Z  2024-12-18T00:11:11.4621934Z  2024-12-18T00:11:11.4622332Z  2024-12-18T00:11:11.4622869Z  2024-12-18T00:11:11.4623263Z  2024-12-18T00:11:11.4623623Z  2024-12-18T00:11:11.4624227Z [14,531 / 15,187] 48 actions, 47 running 2024-12-18T00:11:11.4625095Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:11:11.4626067Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T00:11:11.4627125Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2024-12-18T00:11:11.4627998Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:11:11.4628960Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:11:11.4629985Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T00:11:11.4630853Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2024-12-18T00:11:11.4631669Z Compiling xla/pjrt/pjrt_api.cc; 22s local ... 2024-12-18T00:11:11.7528519Z 2024-12-18T00:11:11.7529310Z  2024-12-18T00:11:11.7529748Z  2024-12-18T00:11:11.7530106Z  2024-12-18T00:11:11.7530456Z  2024-12-18T00:11:11.7530802Z  2024-12-18T00:11:11.7531153Z  2024-12-18T00:11:11.7531487Z  2024-12-18T00:11:11.7531844Z  2024-12-18T00:11:11.7532348Z [14,534 / 15,187] 48 actions, 47 running 2024-12-18T00:11:11.7533099Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:11:11.7533971Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T00:11:11.7534818Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2024-12-18T00:11:11.7535710Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:11:11.7536711Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T00:11:11.7537541Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2024-12-18T00:11:11.7538251Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T00:11:11.7538990Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local ... 2024-12-18T00:11:11.9725275Z 2024-12-18T00:11:11.9726137Z  2024-12-18T00:11:11.9726559Z  2024-12-18T00:11:11.9726891Z  2024-12-18T00:11:11.9727229Z  2024-12-18T00:11:11.9727552Z  2024-12-18T00:11:11.9727876Z  2024-12-18T00:11:11.9728201Z  2024-12-18T00:11:11.9728521Z  2024-12-18T00:11:11.9729031Z [14,535 / 15,187] 48 actions running 2024-12-18T00:11:11.9729762Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:11:11.9730555Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T00:11:11.9731312Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:11:11.9732359Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T00:11:11.9733148Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2024-12-18T00:11:11.9733828Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T00:11:11.9734517Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2024-12-18T00:11:11.9735426Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local ... 2024-12-18T00:11:12.3730981Z 2024-12-18T00:11:12.3731854Z  2024-12-18T00:11:12.3732341Z  2024-12-18T00:11:12.3732723Z  2024-12-18T00:11:12.3733119Z  2024-12-18T00:11:12.3733520Z  2024-12-18T00:11:12.3733954Z  2024-12-18T00:11:12.3734330Z  2024-12-18T00:11:12.3734707Z  2024-12-18T00:11:12.3735300Z [14,536 / 15,187] 48 actions running 2024-12-18T00:11:12.3736208Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:11:12.3737398Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T00:11:12.3738446Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:11:12.3739605Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T00:11:12.3740550Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2024-12-18T00:11:12.3741534Z Compiling xla/pjrt/pjrt_api.cc; 23s local 2024-12-18T00:11:12.3742334Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2024-12-18T00:11:12.3743270Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local ... 2024-12-18T00:11:12.5735008Z 2024-12-18T00:11:12.5735881Z  2024-12-18T00:11:12.5736340Z  2024-12-18T00:11:12.5737206Z  2024-12-18T00:11:12.5737623Z  2024-12-18T00:11:12.5738025Z  2024-12-18T00:11:12.5738372Z  2024-12-18T00:11:12.5738773Z  2024-12-18T00:11:12.5739280Z  2024-12-18T00:11:12.5739894Z [14,538 / 15,187] 48 actions running 2024-12-18T00:11:12.5740712Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:11:12.5741808Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T00:11:12.5742699Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:11:12.5743645Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T00:11:12.5744872Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2024-12-18T00:11:12.5745884Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2024-12-18T00:11:12.5746766Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:11:12.5747796Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local ... 2024-12-18T00:11:12.9545278Z 2024-12-18T00:11:12.9546162Z  2024-12-18T00:11:12.9546619Z  2024-12-18T00:11:12.9546997Z  2024-12-18T00:11:12.9547387Z  2024-12-18T00:11:12.9547774Z  2024-12-18T00:11:12.9548160Z  2024-12-18T00:11:12.9548532Z  2024-12-18T00:11:12.9548961Z  2024-12-18T00:11:12.9549559Z [14,539 / 15,187] 48 actions, 47 running 2024-12-18T00:11:12.9550451Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:11:12.9551414Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T00:11:12.9552339Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:11:12.9553259Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T00:11:12.9554192Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2024-12-18T00:11:12.9555190Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2024-12-18T00:11:12.9556116Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:11:12.9557007Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local ... 2024-12-18T00:11:13.1740729Z 2024-12-18T00:11:13.1741602Z  2024-12-18T00:11:13.1742102Z  2024-12-18T00:11:13.1742525Z  2024-12-18T00:11:13.1743292Z  2024-12-18T00:11:13.1743817Z  2024-12-18T00:11:13.1744416Z  2024-12-18T00:11:13.1744794Z  2024-12-18T00:11:13.1745186Z  2024-12-18T00:11:13.1745702Z [14,539 / 15,187] 48 actions running 2024-12-18T00:11:13.1746351Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:11:13.1747060Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T00:11:13.1747865Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:11:13.1748764Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T00:11:13.1749788Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2024-12-18T00:11:13.1750801Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2024-12-18T00:11:13.1751797Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:11:13.1752715Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local ... 2024-12-18T00:11:13.5467162Z 2024-12-18T00:11:13.5468005Z  2024-12-18T00:11:13.5468473Z  2024-12-18T00:11:13.5468880Z  2024-12-18T00:11:13.5469529Z  2024-12-18T00:11:13.5469950Z  2024-12-18T00:11:13.5470320Z  2024-12-18T00:11:13.5470886Z  2024-12-18T00:11:13.5471294Z  2024-12-18T00:11:13.5471915Z [14,540 / 15,187] 48 actions, 47 running 2024-12-18T00:11:13.5472815Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:11:13.5473790Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T00:11:13.5474886Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:11:13.5475742Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T00:11:13.5476694Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2024-12-18T00:11:13.5477654Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2024-12-18T00:11:13.5478574Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:11:13.5479539Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2024-12-18T00:11:13.7746610Z 2024-12-18T00:11:13.7747495Z  2024-12-18T00:11:13.7747992Z  2024-12-18T00:11:13.7748412Z  2024-12-18T00:11:13.7748824Z  2024-12-18T00:11:13.7749217Z  2024-12-18T00:11:13.7749610Z  2024-12-18T00:11:13.7750022Z  2024-12-18T00:11:13.7750395Z  2024-12-18T00:11:13.7751011Z [14,541 / 15,187] 48 actions running 2024-12-18T00:11:13.7751988Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:11:13.7753140Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T00:11:13.7754132Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:11:13.7755055Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T00:11:13.7756005Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2024-12-18T00:11:13.7757243Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2024-12-18T00:11:13.7758193Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:11:13.7759142Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2024-12-18T00:11:14.1532604Z 2024-12-18T00:11:14.1533395Z  2024-12-18T00:11:14.1533772Z  2024-12-18T00:11:14.1534114Z  2024-12-18T00:11:14.1534450Z  2024-12-18T00:11:14.1534783Z  2024-12-18T00:11:14.1535108Z  2024-12-18T00:11:14.1535440Z  2024-12-18T00:11:14.1535770Z  2024-12-18T00:11:14.1536309Z [14,542 / 15,187] 48 actions, 47 running 2024-12-18T00:11:14.1537181Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:11:14.1537984Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T00:11:14.1538766Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2024-12-18T00:11:14.1539796Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T00:11:14.1540641Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2024-12-18T00:11:14.1541506Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2024-12-18T00:11:14.1542298Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:11:14.1543058Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2024-12-18T00:11:14.3751177Z 2024-12-18T00:11:14.3752015Z  2024-12-18T00:11:14.3752436Z  2024-12-18T00:11:14.3752802Z  2024-12-18T00:11:14.3753138Z  2024-12-18T00:11:14.3753464Z  2024-12-18T00:11:14.3753826Z  2024-12-18T00:11:14.3754209Z  2024-12-18T00:11:14.3754545Z  2024-12-18T00:11:14.3755041Z [14,542 / 15,187] 48 actions running 2024-12-18T00:11:14.3755796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:11:14.3756665Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T00:11:14.3757516Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2024-12-18T00:11:14.3758697Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T00:11:14.3759530Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2024-12-18T00:11:14.3760527Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2024-12-18T00:11:14.3761334Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:11:14.3762091Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2024-12-18T00:11:14.5755353Z 2024-12-18T00:11:14.5756201Z  2024-12-18T00:11:14.5756682Z  2024-12-18T00:11:14.5757372Z  2024-12-18T00:11:14.5757771Z  2024-12-18T00:11:14.5758186Z  2024-12-18T00:11:14.5758600Z  2024-12-18T00:11:14.5759005Z  2024-12-18T00:11:14.5759422Z  2024-12-18T00:11:14.5759982Z [14,544 / 15,187] 48 actions running 2024-12-18T00:11:14.5760892Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:11:14.5761926Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T00:11:14.5762937Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2024-12-18T00:11:14.5763921Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T00:11:14.5764907Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2024-12-18T00:11:14.5765961Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2024-12-18T00:11:14.5766943Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:11:14.5767927Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2024-12-18T00:11:14.9380630Z 2024-12-18T00:11:14.9381502Z  2024-12-18T00:11:14.9381960Z  2024-12-18T00:11:14.9382342Z  2024-12-18T00:11:14.9382694Z  2024-12-18T00:11:14.9383071Z  2024-12-18T00:11:14.9383442Z  2024-12-18T00:11:14.9383819Z  2024-12-18T00:11:14.9384233Z  2024-12-18T00:11:14.9384780Z [14,545 / 15,187] 48 actions, 47 running 2024-12-18T00:11:14.9385745Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:11:14.9386619Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2024-12-18T00:11:14.9387610Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:11:14.9388491Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T00:11:14.9389254Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2024-12-18T00:11:14.9390154Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2024-12-18T00:11:14.9391034Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:11:14.9392014Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2024-12-18T00:11:15.1761037Z 2024-12-18T00:11:15.1761925Z  2024-12-18T00:11:15.1762396Z  2024-12-18T00:11:15.1762810Z  2024-12-18T00:11:15.1763569Z  2024-12-18T00:11:15.1764024Z  2024-12-18T00:11:15.1764367Z  2024-12-18T00:11:15.1764726Z  2024-12-18T00:11:15.1765177Z  2024-12-18T00:11:15.1765814Z [14,545 / 15,187] 48 actions running 2024-12-18T00:11:15.1766912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:11:15.1768025Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2024-12-18T00:11:15.1768964Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:11:15.1769839Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T00:11:15.1770756Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2024-12-18T00:11:15.1771681Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2024-12-18T00:11:15.1772531Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2024-12-18T00:11:15.1773342Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2024-12-18T00:11:16.1765971Z 2024-12-18T00:11:16.1766896Z  2024-12-18T00:11:16.1767399Z  2024-12-18T00:11:16.1767835Z  2024-12-18T00:11:16.1768495Z  2024-12-18T00:11:16.1768900Z  2024-12-18T00:11:16.1769304Z  2024-12-18T00:11:16.1769813Z  2024-12-18T00:11:16.1770222Z  2024-12-18T00:11:16.1770790Z [14,545 / 15,187] 48 actions running 2024-12-18T00:11:16.1771665Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:11:16.1772660Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T00:11:16.1773775Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2024-12-18T00:11:16.1774938Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2024-12-18T00:11:16.1775955Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2024-12-18T00:11:16.1777087Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2024-12-18T00:11:16.1777784Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:11:16.1778636Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local ... 2024-12-18T00:11:16.5770552Z 2024-12-18T00:11:16.5771481Z  2024-12-18T00:11:16.5771986Z  2024-12-18T00:11:16.5772462Z  2024-12-18T00:11:16.5772917Z  2024-12-18T00:11:16.5773270Z  2024-12-18T00:11:16.5773618Z  2024-12-18T00:11:16.5773933Z  2024-12-18T00:11:16.5774239Z  2024-12-18T00:11:16.5774910Z [14,547 / 15,187] 48 actions running 2024-12-18T00:11:16.5775775Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:11:16.5776867Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T00:11:16.5777810Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2024-12-18T00:11:16.5778719Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T00:11:16.5779814Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2024-12-18T00:11:16.5780808Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2024-12-18T00:11:16.5781753Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:11:16.5782650Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local ... 2024-12-18T00:11:16.9660575Z 2024-12-18T00:11:16.9661535Z  2024-12-18T00:11:16.9662060Z  2024-12-18T00:11:16.9662538Z  2024-12-18T00:11:16.9662937Z  2024-12-18T00:11:16.9663307Z  2024-12-18T00:11:16.9663706Z  2024-12-18T00:11:16.9664115Z  2024-12-18T00:11:16.9664511Z  2024-12-18T00:11:16.9665130Z [14,548 / 15,187] 48 actions, 47 running 2024-12-18T00:11:16.9666090Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:11:16.9667185Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T00:11:16.9668127Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:11:16.9669274Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T00:11:16.9670122Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2024-12-18T00:11:16.9670828Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 26s local 2024-12-18T00:11:16.9671704Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:11:16.9672552Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local ... 2024-12-18T00:11:17.1776075Z 2024-12-18T00:11:17.1777146Z  2024-12-18T00:11:17.1777635Z  2024-12-18T00:11:17.1778060Z  2024-12-18T00:11:17.1778417Z  2024-12-18T00:11:17.1778775Z  2024-12-18T00:11:17.1779152Z  2024-12-18T00:11:17.1779564Z  2024-12-18T00:11:17.1779943Z  2024-12-18T00:11:17.1780499Z [14,548 / 15,187] 48 actions running 2024-12-18T00:11:17.1781354Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:11:17.1782314Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T00:11:17.1783230Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:11:17.1784398Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T00:11:17.1796259Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2024-12-18T00:11:17.1797664Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 26s local 2024-12-18T00:11:17.1798701Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:11:17.1799664Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local ... 2024-12-18T00:11:17.5396223Z 2024-12-18T00:11:17.5397138Z  2024-12-18T00:11:17.5397596Z  2024-12-18T00:11:17.5398262Z  2024-12-18T00:11:17.5398665Z  2024-12-18T00:11:17.5399061Z  2024-12-18T00:11:17.5399463Z  2024-12-18T00:11:17.5399849Z  2024-12-18T00:11:17.5400230Z  2024-12-18T00:11:17.5400811Z [14,550 / 15,187] 48 actions, 47 running 2024-12-18T00:11:17.5401624Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:11:17.5402531Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T00:11:17.5403401Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:11:17.5404225Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T00:11:17.5405110Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2024-12-18T00:11:17.5405964Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:11:17.5406835Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2024-12-18T00:11:17.5407693Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local ... 2024-12-18T00:11:17.7782535Z 2024-12-18T00:11:17.7783515Z  2024-12-18T00:11:17.7783999Z  2024-12-18T00:11:17.7784364Z  2024-12-18T00:11:17.7784675Z  2024-12-18T00:11:17.7785020Z  2024-12-18T00:11:17.7785432Z  2024-12-18T00:11:17.7785835Z  2024-12-18T00:11:17.7786257Z  2024-12-18T00:11:17.7786787Z [14,551 / 15,187] 48 actions running 2024-12-18T00:11:17.7787631Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:11:17.7788668Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T00:11:17.7789779Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:11:17.7790781Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T00:11:17.7791781Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2024-12-18T00:11:17.7792757Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:11:17.7793755Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2024-12-18T00:11:17.7794625Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local ... 2024-12-18T00:11:17.9819526Z 2024-12-18T00:11:17.9820466Z  2024-12-18T00:11:17.9820982Z  2024-12-18T00:11:17.9821399Z  2024-12-18T00:11:17.9821986Z  2024-12-18T00:11:17.9822321Z  2024-12-18T00:11:17.9822647Z  2024-12-18T00:11:17.9822952Z  2024-12-18T00:11:17.9823295Z  2024-12-18T00:11:17.9823783Z [14,552 / 15,187] 48 actions, 47 running 2024-12-18T00:11:17.9824504Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:11:17.9825267Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T00:11:17.9825971Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:11:17.9826707Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T00:11:17.9827480Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2024-12-18T00:11:17.9828211Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:11:17.9828900Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2024-12-18T00:11:17.9829611Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local ... 2024-12-18T00:11:18.3787358Z 2024-12-18T00:11:18.3788236Z  2024-12-18T00:11:18.3788753Z  2024-12-18T00:11:18.3789223Z  2024-12-18T00:11:18.3789903Z  2024-12-18T00:11:18.3790381Z  2024-12-18T00:11:18.3790729Z  2024-12-18T00:11:18.3791092Z  2024-12-18T00:11:18.3791598Z  2024-12-18T00:11:18.3792144Z [14,552 / 15,187] 48 actions running 2024-12-18T00:11:18.3792971Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:11:18.3793967Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T00:11:18.3794901Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:11:18.3796034Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:11:18.3796962Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2024-12-18T00:11:18.3797856Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:11:18.3798733Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2024-12-18T00:11:18.3799634Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local ... 2024-12-18T00:11:18.5791297Z 2024-12-18T00:11:18.5792356Z  2024-12-18T00:11:18.5792839Z  2024-12-18T00:11:18.5793277Z  2024-12-18T00:11:18.5793696Z  2024-12-18T00:11:18.5794159Z  2024-12-18T00:11:18.5794543Z  2024-12-18T00:11:18.5794876Z  2024-12-18T00:11:18.5795272Z  2024-12-18T00:11:18.5795795Z [14,554 / 15,187] 48 actions running 2024-12-18T00:11:18.5796582Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:11:18.5797562Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T00:11:18.5798451Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:11:18.5799362Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:11:18.5800229Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2024-12-18T00:11:18.5800971Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:11:18.5801745Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2024-12-18T00:11:18.5802603Z Compiling xla/pjrt/tracked_device_buffer.cc; 24s local ... 2024-12-18T00:11:18.8826544Z 2024-12-18T00:11:18.8827484Z  2024-12-18T00:11:18.8827991Z  2024-12-18T00:11:18.8828407Z  2024-12-18T00:11:18.8828828Z  2024-12-18T00:11:18.8829288Z  2024-12-18T00:11:18.8829762Z  2024-12-18T00:11:18.8830162Z  2024-12-18T00:11:18.8830583Z  2024-12-18T00:11:18.8831123Z [14,557 / 15,187] 48 actions, 47 running 2024-12-18T00:11:18.8831980Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:11:18.8832990Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T00:11:18.8833868Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:11:18.8834754Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:11:18.8835918Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2024-12-18T00:11:18.8836930Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:11:18.8837711Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2024-12-18T00:11:18.8838646Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local ... 2024-12-18T00:11:19.1797761Z 2024-12-18T00:11:19.1799938Z  2024-12-18T00:11:19.1800357Z  2024-12-18T00:11:19.1800700Z  2024-12-18T00:11:19.1801040Z  2024-12-18T00:11:19.1801377Z  2024-12-18T00:11:19.1801724Z  2024-12-18T00:11:19.1802075Z  2024-12-18T00:11:19.1802458Z  2024-12-18T00:11:19.1802961Z [14,559 / 15,187] 48 actions running 2024-12-18T00:11:19.1803727Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:11:19.1804587Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T00:11:19.1805426Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:11:19.1806475Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:11:19.1807322Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:11:19.1808214Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2024-12-18T00:11:19.1808983Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2024-12-18T00:11:19.1809847Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local ... 2024-12-18T00:11:19.3800309Z 2024-12-18T00:11:19.3801331Z  2024-12-18T00:11:19.3801766Z  2024-12-18T00:11:19.3802126Z  2024-12-18T00:11:19.3802697Z  2024-12-18T00:11:19.3803069Z  2024-12-18T00:11:19.3803418Z  2024-12-18T00:11:19.3803786Z  2024-12-18T00:11:19.3804122Z  2024-12-18T00:11:19.3804605Z [14,561 / 15,187] 48 actions running 2024-12-18T00:11:19.3805349Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:11:19.3806220Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T00:11:19.3807074Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:11:19.3807907Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T00:11:19.3808776Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:11:19.3809580Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2024-12-18T00:11:19.3810284Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2024-12-18T00:11:19.3811051Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local ... 2024-12-18T00:11:20.5808276Z 2024-12-18T00:11:20.5809125Z  2024-12-18T00:11:20.5809535Z  2024-12-18T00:11:20.5809883Z  2024-12-18T00:11:20.5810254Z  2024-12-18T00:11:20.5810622Z  2024-12-18T00:11:20.5810984Z  2024-12-18T00:11:20.5811335Z  2024-12-18T00:11:20.5811705Z  2024-12-18T00:11:20.5812194Z [14,561 / 15,187] 48 actions running 2024-12-18T00:11:20.5813006Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:11:20.5813910Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2024-12-18T00:11:20.5814785Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:11:20.5815670Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T00:11:20.5816723Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2024-12-18T00:11:20.5817606Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:11:20.5818436Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2024-12-18T00:11:20.5819331Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local ... 2024-12-18T00:11:20.7812070Z 2024-12-18T00:11:20.7812916Z  2024-12-18T00:11:20.7813318Z  2024-12-18T00:11:20.7813658Z  2024-12-18T00:11:20.7813978Z  2024-12-18T00:11:20.7814594Z  2024-12-18T00:11:20.7814926Z  2024-12-18T00:11:20.7815265Z  2024-12-18T00:11:20.7815594Z  2024-12-18T00:11:20.7816067Z [14,562 / 15,187] 48 actions running 2024-12-18T00:11:20.7816974Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:11:20.7817810Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T00:11:20.7818595Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:11:20.7819370Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T00:11:20.7820138Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2024-12-18T00:11:20.7820929Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:11:20.7821664Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2024-12-18T00:11:20.7822470Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local ... 2024-12-18T00:11:21.1817496Z 2024-12-18T00:11:21.1818382Z  2024-12-18T00:11:21.1818777Z  2024-12-18T00:11:21.1819113Z  2024-12-18T00:11:21.1819430Z  2024-12-18T00:11:21.1820015Z  2024-12-18T00:11:21.1820363Z  2024-12-18T00:11:21.1820691Z  2024-12-18T00:11:21.1821000Z  2024-12-18T00:11:21.1821576Z [14,563 / 15,187] 48 actions running 2024-12-18T00:11:21.1822299Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:11:21.1823089Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T00:11:21.1823842Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:11:21.1824696Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T00:11:21.1825457Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:11:21.1826208Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:11:21.1826934Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2024-12-18T00:11:21.1827732Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local ... 2024-12-18T00:11:21.3822685Z 2024-12-18T00:11:21.3823634Z  2024-12-18T00:11:21.3824119Z  2024-12-18T00:11:21.3824511Z  2024-12-18T00:11:21.3824919Z  2024-12-18T00:11:21.3825361Z  2024-12-18T00:11:21.3825746Z  2024-12-18T00:11:21.3826135Z  2024-12-18T00:11:21.3826518Z  2024-12-18T00:11:21.3827083Z [14,564 / 15,187] 48 actions running 2024-12-18T00:11:21.3827907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:11:21.3828890Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T00:11:21.3829810Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:11:21.3830681Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T00:11:21.3831604Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:11:21.3832431Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:11:21.3833297Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2024-12-18T00:11:21.3834228Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local ... 2024-12-18T00:11:21.8167582Z 2024-12-18T00:11:21.8168496Z  2024-12-18T00:11:21.8168952Z  2024-12-18T00:11:21.8169377Z  2024-12-18T00:11:21.8169735Z  2024-12-18T00:11:21.8170110Z  2024-12-18T00:11:21.8170481Z  2024-12-18T00:11:21.8170850Z  2024-12-18T00:11:21.8171241Z  2024-12-18T00:11:21.8171815Z [14,565 / 15,187] 48 actions, 47 running 2024-12-18T00:11:21.8172676Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:11:21.8173576Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T00:11:21.8174486Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:11:21.8175386Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T00:11:21.8176719Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:11:21.8177575Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:11:21.8178394Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2024-12-18T00:11:21.8179293Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local ... 2024-12-18T00:11:22.1829375Z 2024-12-18T00:11:22.1830245Z  2024-12-18T00:11:22.1830653Z  2024-12-18T00:11:22.1831032Z  2024-12-18T00:11:22.1831381Z  2024-12-18T00:11:22.1831740Z  2024-12-18T00:11:22.1832125Z  2024-12-18T00:11:22.1832497Z  2024-12-18T00:11:22.1832892Z  2024-12-18T00:11:22.1833418Z [14,565 / 15,187] 48 actions running 2024-12-18T00:11:22.1834203Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:11:22.1835061Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T00:11:22.1835825Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:11:22.1836651Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T00:11:22.1837831Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:11:22.1838745Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:11:22.1839517Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2024-12-18T00:11:22.1840354Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local ... 2024-12-18T00:11:22.3833124Z 2024-12-18T00:11:22.3834152Z  2024-12-18T00:11:22.3834649Z  2024-12-18T00:11:22.3835121Z  2024-12-18T00:11:22.3835823Z  2024-12-18T00:11:22.3836278Z  2024-12-18T00:11:22.3836725Z  2024-12-18T00:11:22.3837149Z  2024-12-18T00:11:22.3837578Z  2024-12-18T00:11:22.3838201Z [14,566 / 15,187] 48 actions running 2024-12-18T00:11:22.3839203Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:11:22.3840325Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T00:11:22.3841416Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:11:22.3842491Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2024-12-18T00:11:22.3843589Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:11:22.3844949Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:11:22.3845976Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:11:22.3847073Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local ... 2024-12-18T00:11:22.7034182Z 2024-12-18T00:11:22.7035097Z  2024-12-18T00:11:22.7035564Z  2024-12-18T00:11:22.7035934Z  2024-12-18T00:11:22.7036310Z  2024-12-18T00:11:22.7036706Z  2024-12-18T00:11:22.7037099Z  2024-12-18T00:11:22.7037461Z  2024-12-18T00:11:22.7037839Z  2024-12-18T00:11:22.7038435Z [14,568 / 15,187] 48 actions, 47 running 2024-12-18T00:11:22.7039304Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:11:22.7040259Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T00:11:22.7041159Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:11:22.7042037Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2024-12-18T00:11:22.7042914Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:11:22.7043790Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:11:22.7044931Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:11:22.7045844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local ... 2024-12-18T00:11:22.9838967Z 2024-12-18T00:11:22.9839833Z  2024-12-18T00:11:22.9840304Z  2024-12-18T00:11:22.9840708Z  2024-12-18T00:11:22.9841081Z  2024-12-18T00:11:22.9841775Z  2024-12-18T00:11:22.9842138Z  2024-12-18T00:11:22.9842509Z  2024-12-18T00:11:22.9842883Z  2024-12-18T00:11:22.9843440Z [14,568 / 15,187] 48 actions running 2024-12-18T00:11:22.9844543Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:11:22.9845515Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T00:11:22.9846403Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:11:22.9847336Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2024-12-18T00:11:22.9848319Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:11:22.9849353Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:11:22.9850328Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:11:22.9851394Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local ... 2024-12-18T00:11:23.4011991Z 2024-12-18T00:11:23.4012875Z  2024-12-18T00:11:23.4013299Z  2024-12-18T00:11:23.4013644Z  2024-12-18T00:11:23.4013984Z  2024-12-18T00:11:23.4014312Z  2024-12-18T00:11:23.4015019Z  2024-12-18T00:11:23.4015344Z  2024-12-18T00:11:23.4015667Z  2024-12-18T00:11:23.4016277Z [14,569 / 15,187] 48 actions, 47 running 2024-12-18T00:11:23.4017131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:11:23.4017910Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T00:11:23.4018642Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:11:23.4019491Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T00:11:23.4020256Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:11:23.4021033Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:11:23.4021832Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:11:23.4022697Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local ... 2024-12-18T00:11:23.6406670Z 2024-12-18T00:11:23.6408659Z  2024-12-18T00:11:23.6409851Z  2024-12-18T00:11:23.6410761Z  2024-12-18T00:11:23.6411860Z  2024-12-18T00:11:23.6413018Z  2024-12-18T00:11:23.6414069Z  2024-12-18T00:11:23.6415257Z  2024-12-18T00:11:23.6416597Z  2024-12-18T00:11:23.6418382Z [14,571 / 15,187] 48 actions, 47 running 2024-12-18T00:11:23.6419287Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:11:23.6420265Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T00:11:23.6421571Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:11:23.6422590Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T00:11:23.6423624Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:11:23.6424618Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:11:23.6425609Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:11:23.6426947Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local ... 2024-12-18T00:11:23.9847846Z 2024-12-18T00:11:23.9848721Z  2024-12-18T00:11:23.9849167Z  2024-12-18T00:11:23.9849560Z  2024-12-18T00:11:23.9849957Z  2024-12-18T00:11:23.9850356Z  2024-12-18T00:11:23.9850720Z  2024-12-18T00:11:23.9851101Z  2024-12-18T00:11:23.9851491Z  2024-12-18T00:11:23.9852019Z [14,571 / 15,187] 48 actions running 2024-12-18T00:11:23.9852921Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:11:23.9853893Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T00:11:23.9854829Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2024-12-18T00:11:23.9855791Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T00:11:23.9857194Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:11:23.9858190Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:11:23.9859134Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:11:23.9860153Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local ... 2024-12-18T00:11:24.9856278Z 2024-12-18T00:11:24.9857430Z  2024-12-18T00:11:24.9857915Z  2024-12-18T00:11:24.9858321Z  2024-12-18T00:11:24.9858903Z  2024-12-18T00:11:24.9859314Z  2024-12-18T00:11:24.9859844Z  2024-12-18T00:11:24.9860352Z  2024-12-18T00:11:24.9860832Z  2024-12-18T00:11:24.9861552Z [14,571 / 15,187] 48 actions running 2024-12-18T00:11:24.9862533Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:11:24.9863650Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T00:11:24.9864731Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:11:24.9865804Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T00:11:24.9867209Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2024-12-18T00:11:24.9868286Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:11:24.9869427Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2024-12-18T00:11:24.9870550Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local ... 2024-12-18T00:11:25.2470809Z 2024-12-18T00:11:25.2471657Z  2024-12-18T00:11:25.2472139Z  2024-12-18T00:11:25.2472513Z  2024-12-18T00:11:25.2472891Z  2024-12-18T00:11:25.2473576Z  2024-12-18T00:11:25.2473988Z  2024-12-18T00:11:25.2474323Z  2024-12-18T00:11:25.2474699Z  2024-12-18T00:11:25.2475247Z [14,573 / 15,187] 48 actions, 47 running 2024-12-18T00:11:25.2476053Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:11:25.2476992Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T00:11:25.2477885Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:11:25.2478787Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T00:11:25.2479706Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:11:25.2480621Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:11:25.2481507Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2024-12-18T00:11:25.2482428Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local ... 2024-12-18T00:11:25.4915425Z 2024-12-18T00:11:25.4916343Z  2024-12-18T00:11:25.4916801Z  2024-12-18T00:11:25.4917180Z  2024-12-18T00:11:25.4917558Z  2024-12-18T00:11:25.4917912Z  2024-12-18T00:11:25.4918298Z  2024-12-18T00:11:25.4918658Z  2024-12-18T00:11:25.4919049Z  2024-12-18T00:11:25.4919642Z [14,574 / 15,187] 48 actions, 47 running 2024-12-18T00:11:25.4920525Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:11:25.4921552Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T00:11:25.4922524Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:11:25.4923487Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T00:11:25.4924473Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:11:25.4925410Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:11:25.4926333Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:11:25.4927301Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local ... 2024-12-18T00:11:25.7862064Z 2024-12-18T00:11:25.7862992Z  2024-12-18T00:11:25.7863493Z  2024-12-18T00:11:25.7863895Z  2024-12-18T00:11:25.7864255Z  2024-12-18T00:11:25.7864605Z  2024-12-18T00:11:25.7865420Z  2024-12-18T00:11:25.7865802Z  2024-12-18T00:11:25.7866167Z  2024-12-18T00:11:25.7866728Z [14,575 / 15,187] 48 actions running 2024-12-18T00:11:25.7867580Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:11:25.7868517Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2024-12-18T00:11:25.7869410Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:11:25.7870326Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T00:11:25.7871246Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:11:25.7872118Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:11:25.7872988Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:11:25.7873950Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local ... 2024-12-18T00:11:25.9905505Z 2024-12-18T00:11:25.9906407Z  2024-12-18T00:11:25.9906869Z  2024-12-18T00:11:25.9907219Z  2024-12-18T00:11:25.9907580Z  2024-12-18T00:11:25.9907953Z  2024-12-18T00:11:25.9908545Z  2024-12-18T00:11:25.9908931Z  2024-12-18T00:11:25.9909300Z  2024-12-18T00:11:25.9910022Z [14,576 / 15,187] 48 actions, 47 running 2024-12-18T00:11:25.9910859Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:11:25.9911770Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2024-12-18T00:11:25.9912665Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2024-12-18T00:11:25.9913697Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T00:11:25.9914625Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:11:25.9915538Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:11:25.9916302Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:11:25.9917157Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local ... 2024-12-18T00:11:26.3867976Z 2024-12-18T00:11:26.3868851Z  2024-12-18T00:11:26.3869350Z  2024-12-18T00:11:26.3869747Z  2024-12-18T00:11:26.3870122Z  2024-12-18T00:11:26.3870530Z  2024-12-18T00:11:26.3870919Z  2024-12-18T00:11:26.3871327Z  2024-12-18T00:11:26.3871693Z  2024-12-18T00:11:26.3872139Z [14,577 / 15,187] 48 actions running 2024-12-18T00:11:26.3872841Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:11:26.3873728Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2024-12-18T00:11:26.3874654Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2024-12-18T00:11:26.3875565Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T00:11:26.3876376Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T00:11:26.3877243Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:11:26.3878281Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:11:26.3879285Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local ... 2024-12-18T00:11:26.5871361Z 2024-12-18T00:11:26.5872274Z  2024-12-18T00:11:26.5872777Z  2024-12-18T00:11:26.5873144Z  2024-12-18T00:11:26.5873532Z  2024-12-18T00:11:26.5873925Z  2024-12-18T00:11:26.5874301Z  2024-12-18T00:11:26.5874678Z  2024-12-18T00:11:26.5875058Z  2024-12-18T00:11:26.5875622Z [14,578 / 15,187] 48 actions running 2024-12-18T00:11:26.5876527Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:11:26.5877459Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2024-12-18T00:11:26.5878372Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2024-12-18T00:11:26.5879274Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T00:11:26.5880436Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T00:11:26.5881392Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:11:26.5882279Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:11:26.5883246Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local ... 2024-12-18T00:11:26.9876478Z 2024-12-18T00:11:26.9877376Z  2024-12-18T00:11:26.9877814Z  2024-12-18T00:11:26.9878175Z  2024-12-18T00:11:26.9878520Z  2024-12-18T00:11:26.9878874Z  2024-12-18T00:11:26.9879241Z  2024-12-18T00:11:26.9879593Z  2024-12-18T00:11:26.9879938Z  2024-12-18T00:11:26.9880463Z [14,579 / 15,187] 48 actions running 2024-12-18T00:11:26.9881237Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:11:26.9882148Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T00:11:26.9883027Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2024-12-18T00:11:26.9883835Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T00:11:26.9884889Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T00:11:26.9885717Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:11:26.9886571Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:11:26.9887368Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local ... 2024-12-18T00:11:27.2150103Z 2024-12-18T00:11:27.2151006Z  2024-12-18T00:11:27.2151461Z  2024-12-18T00:11:27.2151823Z  2024-12-18T00:11:27.2152161Z  2024-12-18T00:11:27.2152748Z  2024-12-18T00:11:27.2153080Z  2024-12-18T00:11:27.2153415Z  2024-12-18T00:11:27.2153753Z  2024-12-18T00:11:27.2154275Z [14,580 / 15,187] 48 actions, 47 running 2024-12-18T00:11:27.2155041Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:11:27.2155856Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T00:11:27.2156649Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2024-12-18T00:11:27.2157418Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T00:11:27.2158225Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T00:11:27.2158992Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2024-12-18T00:11:27.2159699Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:11:27.2160534Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local ... 2024-12-18T00:11:27.5882635Z 2024-12-18T00:11:27.5883591Z  2024-12-18T00:11:27.5884037Z  2024-12-18T00:11:27.5884464Z  2024-12-18T00:11:27.5884826Z  2024-12-18T00:11:27.5885177Z  2024-12-18T00:11:27.5885534Z  2024-12-18T00:11:27.5885892Z  2024-12-18T00:11:27.5886252Z  2024-12-18T00:11:27.5886808Z [14,581 / 15,187] 48 actions running 2024-12-18T00:11:27.5887623Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:11:27.5888605Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T00:11:27.5889523Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2024-12-18T00:11:27.5890442Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2024-12-18T00:11:27.5891366Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T00:11:27.5892318Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2024-12-18T00:11:27.5893188Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:11:27.5894118Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local ... 2024-12-18T00:11:28.3054415Z 2024-12-18T00:11:28.3055236Z  2024-12-18T00:11:28.3055658Z  2024-12-18T00:11:28.3056007Z  2024-12-18T00:11:28.3056352Z  2024-12-18T00:11:28.3056847Z  2024-12-18T00:11:28.3057480Z  2024-12-18T00:11:28.3057809Z  2024-12-18T00:11:28.3058132Z  2024-12-18T00:11:28.3058683Z [14,582 / 15,187] 48 actions, 47 running 2024-12-18T00:11:28.3059437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:11:28.3060319Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2024-12-18T00:11:28.3061123Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:11:28.3061893Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T00:11:28.3062741Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T00:11:28.3063526Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:11:28.3064282Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:11:28.3065121Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local ... 2024-12-18T00:11:28.5889544Z 2024-12-18T00:11:28.5890451Z  2024-12-18T00:11:28.5890993Z  2024-12-18T00:11:28.5891401Z  2024-12-18T00:11:28.5891768Z  2024-12-18T00:11:28.5892136Z  2024-12-18T00:11:28.5892742Z  2024-12-18T00:11:28.5893127Z  2024-12-18T00:11:28.5893511Z  2024-12-18T00:11:28.5894037Z [14,583 / 15,187] 48 actions running 2024-12-18T00:11:28.5895049Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:11:28.5896046Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2024-12-18T00:11:28.5897136Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:11:28.5898248Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T00:11:28.5899203Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T00:11:28.5900135Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:11:28.5901026Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:11:28.5901980Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local ... 2024-12-18T00:11:29.5865316Z 2024-12-18T00:11:29.5866244Z  2024-12-18T00:11:29.5866862Z  2024-12-18T00:11:29.5867257Z  2024-12-18T00:11:29.5867640Z  2024-12-18T00:11:29.5868013Z  2024-12-18T00:11:29.5868395Z  2024-12-18T00:11:29.5868775Z  2024-12-18T00:11:29.5869127Z  2024-12-18T00:11:29.5869709Z [14,584 / 15,187] 48 actions, 47 running 2024-12-18T00:11:29.5870491Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:11:29.5871389Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2024-12-18T00:11:29.5872329Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2024-12-18T00:11:29.5873201Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T00:11:29.5874098Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2024-12-18T00:11:29.5874969Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:11:29.5875818Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:11:29.5876745Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local ... 2024-12-18T00:11:29.7900411Z 2024-12-18T00:11:29.7901448Z  2024-12-18T00:11:29.7901935Z  2024-12-18T00:11:29.7902328Z  2024-12-18T00:11:29.7902735Z  2024-12-18T00:11:29.7903125Z  2024-12-18T00:11:29.7903516Z  2024-12-18T00:11:29.7903897Z  2024-12-18T00:11:29.7904275Z  2024-12-18T00:11:29.7904847Z [14,586 / 15,187] 48 actions running 2024-12-18T00:11:29.7905735Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:11:29.7906702Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T00:11:29.7907587Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2024-12-18T00:11:29.7908521Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T00:11:29.7909656Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2024-12-18T00:11:29.7910581Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:11:29.7911635Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:11:29.7912633Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local ... 2024-12-18T00:11:29.9904139Z 2024-12-18T00:11:29.9905063Z  2024-12-18T00:11:29.9905539Z  2024-12-18T00:11:29.9905977Z  2024-12-18T00:11:29.9906359Z  2024-12-18T00:11:29.9906777Z  2024-12-18T00:11:29.9907193Z  2024-12-18T00:11:29.9907588Z  2024-12-18T00:11:29.9908008Z  2024-12-18T00:11:29.9908638Z [14,587 / 15,187] 48 actions running 2024-12-18T00:11:29.9909563Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:11:29.9910582Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T00:11:29.9911600Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:11:29.9912644Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T00:11:29.9913926Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2024-12-18T00:11:29.9915076Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:11:29.9916147Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:11:29.9917125Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local ... 2024-12-18T00:11:30.2790261Z 2024-12-18T00:11:30.2791150Z  2024-12-18T00:11:30.2791633Z  2024-12-18T00:11:30.2792041Z  2024-12-18T00:11:30.2792452Z  2024-12-18T00:11:30.2793104Z  2024-12-18T00:11:30.2793516Z  2024-12-18T00:11:30.2793932Z  2024-12-18T00:11:30.2794351Z  2024-12-18T00:11:30.2794966Z [14,589 / 15,187] 48 actions, 47 running 2024-12-18T00:11:30.2795889Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:11:30.2796909Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T00:11:30.2797921Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:11:30.2798844Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T00:11:30.2799798Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T00:11:30.2800738Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:11:30.2801639Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:11:30.2802644Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local ... 2024-12-18T00:11:30.5908598Z 2024-12-18T00:11:30.5909638Z  2024-12-18T00:11:30.5910094Z  2024-12-18T00:11:30.5910481Z  2024-12-18T00:11:30.5910847Z  2024-12-18T00:11:30.5911226Z  2024-12-18T00:11:30.5911596Z  2024-12-18T00:11:30.5911986Z  2024-12-18T00:11:30.5912368Z  2024-12-18T00:11:30.5912921Z [14,589 / 15,187] 48 actions running 2024-12-18T00:11:30.5913772Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:11:30.5915051Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T00:11:30.5915982Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:11:30.5917116Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T00:11:30.5918187Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T00:11:30.5919268Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:11:30.5920422Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:11:30.5921532Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local ... 2024-12-18T00:11:30.8053445Z 2024-12-18T00:11:30.8054442Z  2024-12-18T00:11:30.8054942Z  2024-12-18T00:11:30.8055365Z  2024-12-18T00:11:30.8055739Z  2024-12-18T00:11:30.8056112Z  2024-12-18T00:11:30.8056903Z  2024-12-18T00:11:30.8057301Z  2024-12-18T00:11:30.8057703Z  2024-12-18T00:11:30.8058305Z [14,590 / 15,187] 48 actions, 47 running 2024-12-18T00:11:30.8059212Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:11:30.8060170Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T00:11:30.8061149Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:11:30.8062097Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T00:11:30.8063038Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T00:11:30.8064094Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:11:30.8065041Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:11:30.8066079Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local ... 2024-12-18T00:11:31.1195073Z 2024-12-18T00:11:31.1195948Z  2024-12-18T00:11:31.1196469Z  2024-12-18T00:11:31.1196888Z  2024-12-18T00:11:31.1197261Z  2024-12-18T00:11:31.1197675Z  2024-12-18T00:11:31.1198299Z  2024-12-18T00:11:31.1198718Z  2024-12-18T00:11:31.1199088Z  2024-12-18T00:11:31.1199656Z [14,591 / 15,187] 48 actions, 47 running 2024-12-18T00:11:31.1200710Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:11:31.1201645Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T00:11:31.1202518Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:11:31.1203402Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T00:11:31.1204519Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T00:11:31.1205475Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:11:31.1206355Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:11:31.1207273Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local ... 2024-12-18T00:11:31.3916378Z 2024-12-18T00:11:31.3917239Z  2024-12-18T00:11:31.3917681Z  2024-12-18T00:11:31.3918032Z  2024-12-18T00:11:31.3918405Z  2024-12-18T00:11:31.3918770Z  2024-12-18T00:11:31.3919154Z  2024-12-18T00:11:31.3919507Z  2024-12-18T00:11:31.3919887Z  2024-12-18T00:11:31.3920451Z [14,592 / 15,187] 48 actions running 2024-12-18T00:11:31.3921331Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:11:31.3922327Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T00:11:31.3923253Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:11:31.3924138Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T00:11:31.3925261Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T00:11:31.3926194Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:11:31.3927107Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2024-12-18T00:11:31.3928077Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local ... 2024-12-18T00:11:31.7640010Z 2024-12-18T00:11:31.7640897Z  2024-12-18T00:11:31.7641424Z  2024-12-18T00:11:31.7641832Z  2024-12-18T00:11:31.7642252Z  2024-12-18T00:11:31.7642639Z  2024-12-18T00:11:31.7643020Z  2024-12-18T00:11:31.7643401Z  2024-12-18T00:11:31.7643804Z  2024-12-18T00:11:31.7644625Z [14,593 / 15,187] 48 actions, 47 running 2024-12-18T00:11:31.7645546Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:11:31.7646473Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T00:11:31.7647398Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:11:31.7648379Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T00:11:31.7649285Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T00:11:31.7650437Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:11:31.7651362Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2024-12-18T00:11:31.7652299Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local ... 2024-12-18T00:11:31.9924485Z 2024-12-18T00:11:31.9925329Z  2024-12-18T00:11:31.9925796Z  2024-12-18T00:11:31.9926183Z  2024-12-18T00:11:31.9926599Z  2024-12-18T00:11:31.9927001Z  2024-12-18T00:11:31.9927401Z  2024-12-18T00:11:31.9927794Z  2024-12-18T00:11:31.9928166Z  2024-12-18T00:11:31.9928773Z [14,594 / 15,187] 48 actions running 2024-12-18T00:11:31.9929591Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:11:31.9930530Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T00:11:31.9931454Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:11:31.9932374Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T00:11:31.9933615Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T00:11:31.9934539Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:11:31.9935578Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2024-12-18T00:11:31.9936662Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local ... 2024-12-18T00:11:32.2899543Z 2024-12-18T00:11:32.2900349Z  2024-12-18T00:11:32.2900794Z  2024-12-18T00:11:32.2901163Z  2024-12-18T00:11:32.2901497Z  2024-12-18T00:11:32.2901852Z  2024-12-18T00:11:32.2902478Z  2024-12-18T00:11:32.2902874Z  2024-12-18T00:11:32.2903232Z  2024-12-18T00:11:32.2903739Z [14,595 / 15,187] 48 actions, 47 running 2024-12-18T00:11:32.2904493Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:11:32.2905336Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T00:11:32.2906152Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:11:32.2906941Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T00:11:32.2907764Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T00:11:32.2908581Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:11:32.2909363Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:11:32.2910168Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local ... 2024-12-18T00:11:32.5930542Z 2024-12-18T00:11:32.5931408Z  2024-12-18T00:11:32.5931907Z  2024-12-18T00:11:32.5932285Z  2024-12-18T00:11:32.5932669Z  2024-12-18T00:11:32.5933055Z  2024-12-18T00:11:32.5933455Z  2024-12-18T00:11:32.5933824Z  2024-12-18T00:11:32.5934201Z  2024-12-18T00:11:32.5934805Z [14,598 / 15,187] 48 actions running 2024-12-18T00:11:32.5935682Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:11:32.5936822Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T00:11:32.5937725Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:11:32.5938669Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T00:11:32.5939658Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T00:11:32.5940655Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:11:32.5941599Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:11:32.5942574Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local ... 2024-12-18T00:11:32.8189194Z 2024-12-18T00:11:32.8189981Z  2024-12-18T00:11:32.8190371Z  2024-12-18T00:11:32.8190736Z  2024-12-18T00:11:32.8191109Z  2024-12-18T00:11:32.8191452Z  2024-12-18T00:11:32.8191996Z  2024-12-18T00:11:32.8192336Z  2024-12-18T00:11:32.8192619Z  2024-12-18T00:11:32.8193121Z [14,599 / 15,187] 48 actions, 47 running 2024-12-18T00:11:32.8193859Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:11:32.8194762Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T00:11:32.8195633Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:11:32.8196452Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T00:11:32.8197379Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T00:11:32.8198297Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:11:32.8215102Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:11:32.8216179Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local ... 2024-12-18T00:11:33.1936658Z 2024-12-18T00:11:33.1937466Z  2024-12-18T00:11:33.1937964Z  2024-12-18T00:11:33.1938354Z  2024-12-18T00:11:33.1938765Z  2024-12-18T00:11:33.1939165Z  2024-12-18T00:11:33.1939780Z  2024-12-18T00:11:33.1940182Z  2024-12-18T00:11:33.1940594Z  2024-12-18T00:11:33.1941170Z [14,601 / 15,187] 48 actions running 2024-12-18T00:11:33.1942122Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:11:33.1943116Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T00:11:33.1944043Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:11:33.1945233Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T00:11:33.1946341Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2024-12-18T00:11:33.1947376Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:11:33.1948321Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:11:33.1949260Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local ... 2024-12-18T00:11:33.5823703Z 2024-12-18T00:11:33.5824636Z  2024-12-18T00:11:33.5825126Z  2024-12-18T00:11:33.5825518Z  2024-12-18T00:11:33.5825897Z  2024-12-18T00:11:33.5826279Z  2024-12-18T00:11:33.5826646Z  2024-12-18T00:11:33.5827035Z  2024-12-18T00:11:33.5827449Z  2024-12-18T00:11:33.5828009Z [14,603 / 15,187] 48 actions, 47 running 2024-12-18T00:11:33.5828812Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:11:33.5829699Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T00:11:33.5830594Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:11:33.5831465Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T00:11:33.5832353Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2024-12-18T00:11:33.5833233Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:11:33.5834111Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:11:33.5834988Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local ... 2024-12-18T00:11:33.7943233Z 2024-12-18T00:11:33.7944054Z  2024-12-18T00:11:33.7944724Z  2024-12-18T00:11:33.7945077Z  2024-12-18T00:11:33.7945417Z  2024-12-18T00:11:33.7945767Z  2024-12-18T00:11:33.7946132Z  2024-12-18T00:11:33.7946466Z  2024-12-18T00:11:33.7946824Z  2024-12-18T00:11:33.7947341Z [14,603 / 15,187] 48 actions running 2024-12-18T00:11:33.7948125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:11:33.7949006Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T00:11:33.7949817Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:11:33.7950645Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T00:11:33.7951789Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2024-12-18T00:11:33.7952658Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:11:33.7953494Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:11:33.7954390Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local ... 2024-12-18T00:11:34.1947940Z 2024-12-18T00:11:34.1948831Z  2024-12-18T00:11:34.1949332Z  2024-12-18T00:11:34.1949748Z  2024-12-18T00:11:34.1950170Z  2024-12-18T00:11:34.1950554Z  2024-12-18T00:11:34.1950956Z  2024-12-18T00:11:34.1951363Z  2024-12-18T00:11:34.1951776Z  2024-12-18T00:11:34.1952389Z [14,604 / 15,187] 48 actions running 2024-12-18T00:11:34.1953266Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:11:34.1954285Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T00:11:34.1955258Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T00:11:34.1956265Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T00:11:34.1957481Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:11:34.1958440Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:11:34.1959518Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T00:11:34.1960551Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 25s local ... 2024-12-18T00:11:34.7778806Z 2024-12-18T00:11:34.7779708Z  2024-12-18T00:11:34.7780175Z  2024-12-18T00:11:34.7780565Z  2024-12-18T00:11:34.7780954Z  2024-12-18T00:11:34.7781612Z  2024-12-18T00:11:34.7782044Z  2024-12-18T00:11:34.7782431Z  2024-12-18T00:11:34.7782851Z  2024-12-18T00:11:34.7783467Z [14,605 / 15,187] 48 actions, 47 running 2024-12-18T00:11:34.7784380Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:11:34.7785422Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2024-12-18T00:11:34.7786382Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T00:11:34.7787408Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T00:11:34.7788413Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2024-12-18T00:11:34.7789396Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:11:34.7790304Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T00:11:34.7791363Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 26s local ... 2024-12-18T00:11:34.9953318Z 2024-12-18T00:11:34.9954148Z  2024-12-18T00:11:34.9954792Z  2024-12-18T00:11:34.9955200Z  2024-12-18T00:11:34.9955579Z  2024-12-18T00:11:34.9955976Z  2024-12-18T00:11:34.9956353Z  2024-12-18T00:11:34.9956714Z  2024-12-18T00:11:34.9957104Z  2024-12-18T00:11:34.9957670Z [14,606 / 15,187] 48 actions running 2024-12-18T00:11:34.9958548Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:11:34.9959494Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2024-12-18T00:11:34.9960429Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T00:11:34.9961389Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T00:11:34.9962339Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2024-12-18T00:11:34.9963284Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:11:34.9964213Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T00:11:34.9965255Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 26s local ... 2024-12-18T00:11:35.5595631Z 2024-12-18T00:11:35.5596574Z  2024-12-18T00:11:35.5597137Z  2024-12-18T00:11:35.5597530Z  2024-12-18T00:11:35.5597996Z  2024-12-18T00:11:35.5598418Z  2024-12-18T00:11:35.5599173Z  2024-12-18T00:11:35.5599602Z  2024-12-18T00:11:35.5600008Z  2024-12-18T00:11:35.5600697Z [14,607 / 15,187] 48 actions, 47 running 2024-12-18T00:11:35.5601503Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:11:35.5602454Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2024-12-18T00:11:35.5603348Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T00:11:35.5604288Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2024-12-18T00:11:35.5605222Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:11:35.5606146Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:11:35.5607069Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T00:11:35.5608079Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 27s local ... 2024-12-18T00:11:35.7959118Z 2024-12-18T00:11:35.7959956Z  2024-12-18T00:11:35.7960437Z  2024-12-18T00:11:35.7960851Z  2024-12-18T00:11:35.7961236Z  2024-12-18T00:11:35.7961848Z  2024-12-18T00:11:35.7962252Z  2024-12-18T00:11:35.7962648Z  2024-12-18T00:11:35.7963043Z  2024-12-18T00:11:35.7963722Z [14,607 / 15,187] 48 actions running 2024-12-18T00:11:35.7964626Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:11:35.7965636Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2024-12-18T00:11:35.7966590Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T00:11:35.7967697Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2024-12-18T00:11:35.7968676Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:11:35.7969641Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:11:35.7970579Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T00:11:35.7971627Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 27s local ... 2024-12-18T00:11:35.9962988Z 2024-12-18T00:11:35.9963868Z  2024-12-18T00:11:35.9964306Z  2024-12-18T00:11:35.9964686Z  2024-12-18T00:11:35.9965088Z  2024-12-18T00:11:35.9965497Z  2024-12-18T00:11:35.9965876Z  2024-12-18T00:11:35.9966251Z  2024-12-18T00:11:35.9966614Z  2024-12-18T00:11:35.9967156Z [14,608 / 15,187] 48 actions running 2024-12-18T00:11:35.9967987Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:11:35.9968977Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2024-12-18T00:11:35.9969875Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T00:11:35.9970817Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2024-12-18T00:11:35.9971787Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:11:35.9972742Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:11:35.9973694Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T00:11:35.9974744Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 27s local ... 2024-12-18T00:11:36.2529650Z 2024-12-18T00:11:36.2530586Z  2024-12-18T00:11:36.2531069Z  2024-12-18T00:11:36.2531454Z  2024-12-18T00:11:36.2531815Z  2024-12-18T00:11:36.2532138Z  2024-12-18T00:11:36.2532489Z  2024-12-18T00:11:36.2532833Z  2024-12-18T00:11:36.2533152Z  2024-12-18T00:11:36.2533650Z [14,609 / 15,187] 48 actions, 47 running 2024-12-18T00:11:36.2534447Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:11:36.2535230Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2024-12-18T00:11:36.2535969Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T00:11:36.2536879Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:11:36.2537948Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:11:36.2538913Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:11:36.2539781Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T00:11:36.2540788Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local ... 2024-12-18T00:11:36.5008941Z 2024-12-18T00:11:36.5009885Z  2024-12-18T00:11:36.5010347Z  2024-12-18T00:11:36.5010828Z  2024-12-18T00:11:36.5011204Z  2024-12-18T00:11:36.5011587Z  2024-12-18T00:11:36.5011971Z  2024-12-18T00:11:36.5012331Z  2024-12-18T00:11:36.5012712Z  2024-12-18T00:11:36.5013288Z [14,612 / 15,187] 48 actions, 47 running 2024-12-18T00:11:36.5014157Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:11:36.5015128Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T00:11:36.5016100Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:11:36.5017604Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:11:36.5018580Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:11:36.5019666Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T00:11:36.5020674Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local 2024-12-18T00:11:36.5021760Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local ... 2024-12-18T00:11:36.7423835Z 2024-12-18T00:11:36.7424714Z  2024-12-18T00:11:36.7425169Z  2024-12-18T00:11:36.7425526Z  2024-12-18T00:11:36.7426145Z  2024-12-18T00:11:36.7426578Z  2024-12-18T00:11:36.7426948Z  2024-12-18T00:11:36.7427330Z  2024-12-18T00:11:36.7427761Z  2024-12-18T00:11:36.7428348Z [14,614 / 15,187] 48 actions, 47 running 2024-12-18T00:11:36.7429203Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:11:36.7430151Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T00:11:36.7431052Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:11:36.7432038Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:11:36.7432863Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:11:36.7433738Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T00:11:36.7434697Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local 2024-12-18T00:11:36.7435766Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local ... 2024-12-18T00:11:36.9970724Z 2024-12-18T00:11:36.9971710Z  2024-12-18T00:11:36.9972204Z  2024-12-18T00:11:36.9972578Z  2024-12-18T00:11:36.9972972Z  2024-12-18T00:11:36.9973325Z  2024-12-18T00:11:36.9973692Z  2024-12-18T00:11:36.9974057Z  2024-12-18T00:11:36.9974438Z  2024-12-18T00:11:36.9974991Z [14,616 / 15,187] 48 actions running 2024-12-18T00:11:36.9975852Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:11:36.9977096Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T00:11:36.9978013Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:11:36.9978926Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:11:36.9979821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:11:36.9980738Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T00:11:36.9981616Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local 2024-12-18T00:11:36.9982592Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local ... 2024-12-18T00:11:37.6355063Z 2024-12-18T00:11:37.6356069Z  2024-12-18T00:11:37.6356573Z  2024-12-18T00:11:37.6356962Z  2024-12-18T00:11:37.6357613Z  2024-12-18T00:11:37.6357964Z  2024-12-18T00:11:37.6358347Z  2024-12-18T00:11:37.6358720Z  2024-12-18T00:11:37.6359089Z  2024-12-18T00:11:37.6359638Z [14,617 / 15,187] 48 actions, 47 running 2024-12-18T00:11:37.6360495Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:11:37.6361423Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2024-12-18T00:11:37.6362317Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2024-12-18T00:11:37.6363215Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2024-12-18T00:11:37.6364118Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:11:37.6364956Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T00:11:37.6365823Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local 2024-12-18T00:11:37.6366874Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 28s local ... 2024-12-18T00:11:37.9977908Z 2024-12-18T00:11:37.9978763Z  2024-12-18T00:11:37.9979186Z  2024-12-18T00:11:37.9979526Z  2024-12-18T00:11:37.9980142Z  2024-12-18T00:11:37.9980502Z  2024-12-18T00:11:37.9980894Z  2024-12-18T00:11:37.9981356Z  2024-12-18T00:11:37.9981692Z  2024-12-18T00:11:37.9982204Z [14,619 / 15,187] 48 actions running 2024-12-18T00:11:37.9982978Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:11:37.9983831Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2024-12-18T00:11:37.9984809Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2024-12-18T00:11:37.9985672Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2024-12-18T00:11:37.9986495Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:11:37.9987365Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T00:11:37.9988228Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local 2024-12-18T00:11:37.9989241Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local ... 2024-12-18T00:11:38.2231778Z 2024-12-18T00:11:38.2232743Z  2024-12-18T00:11:38.2233149Z  2024-12-18T00:11:38.2233499Z  2024-12-18T00:11:38.2233809Z  2024-12-18T00:11:38.2234127Z  2024-12-18T00:11:38.2234448Z  2024-12-18T00:11:38.2234775Z  2024-12-18T00:11:38.2235093Z  2024-12-18T00:11:38.2235564Z [14,620 / 15,187] 48 actions, 47 running 2024-12-18T00:11:38.2236251Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:11:38.2237016Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T00:11:38.2237761Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T00:11:38.2238509Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2024-12-18T00:11:38.2239241Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:11:38.2239983Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T00:11:38.2240751Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local 2024-12-18T00:11:38.2241614Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local ... 2024-12-18T00:11:38.5983676Z 2024-12-18T00:11:38.5984672Z  2024-12-18T00:11:38.5985061Z  2024-12-18T00:11:38.5985344Z  2024-12-18T00:11:38.5985652Z  2024-12-18T00:11:38.5985982Z  2024-12-18T00:11:38.5986280Z  2024-12-18T00:11:38.5986569Z  2024-12-18T00:11:38.5986841Z  2024-12-18T00:11:38.5987390Z [14,620 / 15,187] 48 actions running 2024-12-18T00:11:38.5988196Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:11:38.5989091Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T00:11:38.5989988Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T00:11:38.5991161Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2024-12-18T00:11:38.5992058Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:11:38.5992972Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T00:11:38.5993883Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local 2024-12-18T00:11:38.5994928Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local ... 2024-12-18T00:11:39.5672525Z 2024-12-18T00:11:39.5673372Z  2024-12-18T00:11:39.5673752Z  2024-12-18T00:11:39.5674067Z  2024-12-18T00:11:39.5674374Z  2024-12-18T00:11:39.5674683Z  2024-12-18T00:11:39.5675022Z  2024-12-18T00:11:39.5675354Z  2024-12-18T00:11:39.5675734Z  2024-12-18T00:11:39.5676315Z [14,621 / 15,187] 48 actions, 47 running 2024-12-18T00:11:39.5677205Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:11:39.5678225Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T00:11:39.5679398Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T00:11:39.5680541Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:11:39.5681622Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:11:39.5682357Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 37s local 2024-12-18T00:11:39.5683236Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2024-12-18T00:11:39.5684553Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local ... 2024-12-18T00:11:39.7992668Z 2024-12-18T00:11:39.7993850Z  2024-12-18T00:11:39.7994362Z  2024-12-18T00:11:39.7994737Z  2024-12-18T00:11:39.7995104Z  2024-12-18T00:11:39.7995479Z  2024-12-18T00:11:39.7995851Z  2024-12-18T00:11:39.7996218Z  2024-12-18T00:11:39.7996612Z  2024-12-18T00:11:39.7997163Z [14,621 / 15,187] 48 actions running 2024-12-18T00:11:39.7998074Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:11:39.7999077Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T00:11:39.7999980Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T00:11:39.8000926Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:11:39.8001883Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:11:39.8002801Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 37s local 2024-12-18T00:11:39.8003779Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2024-12-18T00:11:39.8004984Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local ... 2024-12-18T00:11:40.1918215Z 2024-12-18T00:11:40.1919113Z  2024-12-18T00:11:40.1919613Z  2024-12-18T00:11:40.1919989Z  2024-12-18T00:11:40.1920356Z  2024-12-18T00:11:40.1920743Z  2024-12-18T00:11:40.1921168Z  2024-12-18T00:11:40.1921572Z  2024-12-18T00:11:40.1921971Z  2024-12-18T00:11:40.1922579Z [14,623 / 15,187] 48 actions, 47 running 2024-12-18T00:11:40.1923483Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:11:40.1924462Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T00:11:40.1925462Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T00:11:40.1926474Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:11:40.1927413Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:11:40.1928398Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 38s local 2024-12-18T00:11:40.1929402Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2024-12-18T00:11:40.1930490Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local ... 2024-12-18T00:11:40.4001556Z 2024-12-18T00:11:40.4002406Z  2024-12-18T00:11:40.4003166Z  2024-12-18T00:11:40.4003547Z  2024-12-18T00:11:40.4003971Z  2024-12-18T00:11:40.4004387Z  2024-12-18T00:11:40.4004808Z  2024-12-18T00:11:40.4005214Z  2024-12-18T00:11:40.4005619Z  2024-12-18T00:11:40.4006213Z [14,624 / 15,187] 48 actions running 2024-12-18T00:11:40.4007124Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:11:40.4008128Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T00:11:40.4009113Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T00:11:40.4010098Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:11:40.4011067Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:11:40.4012038Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 38s local 2024-12-18T00:11:40.4013045Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2024-12-18T00:11:40.4014180Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local ... 2024-12-18T00:11:40.6005258Z 2024-12-18T00:11:40.6006532Z  2024-12-18T00:11:40.6006988Z  2024-12-18T00:11:40.6007361Z  2024-12-18T00:11:40.6007742Z  2024-12-18T00:11:40.6008226Z  2024-12-18T00:11:40.6008595Z  2024-12-18T00:11:40.6008952Z  2024-12-18T00:11:40.6009305Z  2024-12-18T00:11:40.6009854Z [14,625 / 15,187] 48 actions running 2024-12-18T00:11:40.6010725Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:11:40.6011683Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T00:11:40.6012765Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T00:11:40.6013700Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:11:40.6014643Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:11:40.6015589Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 38s local 2024-12-18T00:11:40.6016754Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2024-12-18T00:11:40.6017753Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local ... 2024-12-18T00:11:40.8308725Z 2024-12-18T00:11:40.8309616Z  2024-12-18T00:11:40.8310073Z  2024-12-18T00:11:40.8310458Z  2024-12-18T00:11:40.8310815Z  2024-12-18T00:11:40.8311172Z  2024-12-18T00:11:40.8311541Z  2024-12-18T00:11:40.8311934Z  2024-12-18T00:11:40.8312292Z  2024-12-18T00:11:40.8312884Z [14,627 / 15,187] 48 actions, 47 running 2024-12-18T00:11:40.8313797Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:11:40.8314736Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T00:11:40.8315660Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T00:11:40.8316645Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:11:40.8317583Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:11:40.8318557Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2024-12-18T00:11:40.8319578Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:11:40.8320400Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local ... 2024-12-18T00:11:41.2011346Z 2024-12-18T00:11:41.2012160Z  2024-12-18T00:11:41.2012623Z  2024-12-18T00:11:41.2013018Z  2024-12-18T00:11:41.2013384Z  2024-12-18T00:11:41.2013761Z  2024-12-18T00:11:41.2014136Z  2024-12-18T00:11:41.2014517Z  2024-12-18T00:11:41.2014917Z  2024-12-18T00:11:41.2015466Z [14,627 / 15,187] 48 actions running 2024-12-18T00:11:41.2016372Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:11:41.2017506Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T00:11:41.2018824Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2024-12-18T00:11:41.2019731Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:11:41.2020663Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:11:41.2021677Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2024-12-18T00:11:41.2022657Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:11:41.2023561Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local ... 2024-12-18T00:11:42.2019814Z 2024-12-18T00:11:42.2020689Z  2024-12-18T00:11:42.2021187Z  2024-12-18T00:11:42.2021613Z  2024-12-18T00:11:42.2022046Z  2024-12-18T00:11:42.2022444Z  2024-12-18T00:11:42.2022833Z  2024-12-18T00:11:42.2023212Z  2024-12-18T00:11:42.2023603Z  2024-12-18T00:11:42.2024177Z [14,627 / 15,187] 48 actions running 2024-12-18T00:11:42.2025058Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:11:42.2026089Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T00:11:42.2027389Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:11:42.2028408Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:11:42.2029505Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:11:42.2030529Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2024-12-18T00:11:42.2031567Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2024-12-18T00:11:42.2032516Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local ... 2024-12-18T00:11:42.4024689Z 2024-12-18T00:11:42.4025520Z  2024-12-18T00:11:42.4026079Z  2024-12-18T00:11:42.4026409Z  2024-12-18T00:11:42.4026740Z  2024-12-18T00:11:42.4027088Z  2024-12-18T00:11:42.4027447Z  2024-12-18T00:11:42.4027822Z  2024-12-18T00:11:42.4028178Z  2024-12-18T00:11:42.4028731Z [14,628 / 15,187] 48 actions running 2024-12-18T00:11:42.4029517Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:11:42.4030344Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T00:11:42.4031181Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:11:42.4031975Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:11:42.4032771Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:11:42.4033642Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2024-12-18T00:11:42.4034573Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2024-12-18T00:11:42.4035417Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local ... 2024-12-18T00:11:42.7692242Z 2024-12-18T00:11:42.7693065Z  2024-12-18T00:11:42.7693509Z  2024-12-18T00:11:42.7693890Z  2024-12-18T00:11:42.7694252Z  2024-12-18T00:11:42.7694631Z  2024-12-18T00:11:42.7695027Z  2024-12-18T00:11:42.7695372Z  2024-12-18T00:11:42.7695732Z  2024-12-18T00:11:42.7696237Z [14,630 / 15,187] 48 actions, 47 running 2024-12-18T00:11:42.7697261Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:11:42.7698228Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T00:11:42.7699184Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:11:42.7700104Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:11:42.7701027Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:11:42.7701979Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2024-12-18T00:11:42.7703011Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:11:42.7703907Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local ... 2024-12-18T00:11:43.0029663Z 2024-12-18T00:11:43.0030776Z  2024-12-18T00:11:43.0031232Z  2024-12-18T00:11:43.0031627Z  2024-12-18T00:11:43.0031998Z  2024-12-18T00:11:43.0032398Z  2024-12-18T00:11:43.0032789Z  2024-12-18T00:11:43.0033172Z  2024-12-18T00:11:43.0033555Z  2024-12-18T00:11:43.0034109Z [14,630 / 15,187] 48 actions running 2024-12-18T00:11:43.0034981Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:11:43.0035941Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T00:11:43.0036891Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:11:43.0037819Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:11:43.0038724Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:11:43.0039695Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2024-12-18T00:11:43.0040711Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:11:43.0041646Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local ... 2024-12-18T00:11:43.2033755Z 2024-12-18T00:11:43.2034856Z  2024-12-18T00:11:43.2035367Z  2024-12-18T00:11:43.2035773Z  2024-12-18T00:11:43.2036271Z  2024-12-18T00:11:43.2036655Z  2024-12-18T00:11:43.2037046Z  2024-12-18T00:11:43.2037426Z  2024-12-18T00:11:43.2037811Z  2024-12-18T00:11:43.2038323Z [14,631 / 15,187] 48 actions running 2024-12-18T00:11:43.2039183Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:11:43.2040264Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T00:11:43.2041129Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T00:11:43.2042066Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:11:43.2042984Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:11:43.2043992Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2024-12-18T00:11:43.2045296Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:11:43.2046144Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local ... 2024-12-18T00:11:43.4189602Z 2024-12-18T00:11:43.4190419Z  2024-12-18T00:11:43.4190873Z  2024-12-18T00:11:43.4191281Z  2024-12-18T00:11:43.4191648Z  2024-12-18T00:11:43.4192031Z  2024-12-18T00:11:43.4192443Z  2024-12-18T00:11:43.4192818Z  2024-12-18T00:11:43.4193165Z  2024-12-18T00:11:43.4193798Z [14,633 / 15,187] 48 actions, 47 running 2024-12-18T00:11:43.4194731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:11:43.4195734Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T00:11:43.4196649Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T00:11:43.4197579Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:11:43.4198528Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:11:43.4199477Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2024-12-18T00:11:43.4200473Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:11:43.4201445Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2024-12-18T00:11:43.8039478Z 2024-12-18T00:11:43.8040291Z  2024-12-18T00:11:43.8040769Z  2024-12-18T00:11:43.8041199Z  2024-12-18T00:11:43.8041602Z  2024-12-18T00:11:43.8042022Z  2024-12-18T00:11:43.8042429Z  2024-12-18T00:11:43.8042842Z  2024-12-18T00:11:43.8043282Z  2024-12-18T00:11:43.8043878Z [14,633 / 15,187] 48 actions running 2024-12-18T00:11:43.8045002Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:11:43.8045995Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T00:11:43.8047251Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T00:11:43.8048287Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:11:43.8049289Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:11:43.8050257Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2024-12-18T00:11:43.8051050Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:11:43.8051742Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2024-12-18T00:11:44.2824424Z 2024-12-18T00:11:44.2825190Z  2024-12-18T00:11:44.2825594Z  2024-12-18T00:11:44.2825949Z  2024-12-18T00:11:44.2826318Z  2024-12-18T00:11:44.2826663Z  2024-12-18T00:11:44.2827005Z  2024-12-18T00:11:44.2827339Z  2024-12-18T00:11:44.2827654Z  2024-12-18T00:11:44.2828184Z [14,634 / 15,187] 48 actions, 47 running 2024-12-18T00:11:44.2828938Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:11:44.2829790Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T00:11:44.2830879Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T00:11:44.2831738Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:11:44.2832630Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:11:44.2833475Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:11:44.2834262Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2024-12-18T00:11:44.2835133Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local ... 2024-12-18T00:11:44.6046083Z 2024-12-18T00:11:44.6046898Z  2024-12-18T00:11:44.6047304Z  2024-12-18T00:11:44.6047642Z  2024-12-18T00:11:44.6047994Z  2024-12-18T00:11:44.6048341Z  2024-12-18T00:11:44.6048684Z  2024-12-18T00:11:44.6049017Z  2024-12-18T00:11:44.6049391Z  2024-12-18T00:11:44.6049893Z [14,634 / 15,187] 48 actions running 2024-12-18T00:11:44.6050691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:11:44.6051591Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T00:11:44.6052453Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T00:11:44.6053281Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:11:44.6054106Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:11:44.6054970Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:11:44.6055800Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2024-12-18T00:11:44.6056769Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local ... 2024-12-18T00:11:44.8394035Z 2024-12-18T00:11:44.8394820Z  2024-12-18T00:11:44.8395221Z  2024-12-18T00:11:44.8395555Z  2024-12-18T00:11:44.8395902Z  2024-12-18T00:11:44.8396237Z  2024-12-18T00:11:44.8396564Z  2024-12-18T00:11:44.8396895Z  2024-12-18T00:11:44.8397223Z  2024-12-18T00:11:44.8397722Z [14,636 / 15,187] 48 actions, 47 running 2024-12-18T00:11:44.8398426Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2024-12-18T00:11:44.8399164Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T00:11:44.8399930Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T00:11:44.8400684Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:11:44.8401425Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:11:44.8402197Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:11:44.8402902Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2024-12-18T00:11:44.8403618Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local ... 2024-12-18T00:11:45.2053343Z 2024-12-18T00:11:45.2054210Z  2024-12-18T00:11:45.2054672Z  2024-12-18T00:11:45.2055136Z  2024-12-18T00:11:45.2055525Z  2024-12-18T00:11:45.2055921Z  2024-12-18T00:11:45.2056310Z  2024-12-18T00:11:45.2056812Z  2024-12-18T00:11:45.2057191Z  2024-12-18T00:11:45.2057732Z [14,637 / 15,187] 48 actions running 2024-12-18T00:11:45.2058593Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2024-12-18T00:11:45.2059583Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T00:11:45.2060499Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T00:11:45.2061385Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:11:45.2062282Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:11:45.2063208Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:11:45.2064119Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2024-12-18T00:11:45.2064945Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local ... 2024-12-18T00:11:45.4463184Z 2024-12-18T00:11:45.4464073Z  2024-12-18T00:11:45.4464563Z  2024-12-18T00:11:45.4464965Z  2024-12-18T00:11:45.4465539Z  2024-12-18T00:11:45.4465901Z  2024-12-18T00:11:45.4466265Z  2024-12-18T00:11:45.4466657Z  2024-12-18T00:11:45.4467045Z  2024-12-18T00:11:45.4467645Z [14,639 / 15,187] 48 actions, 47 running 2024-12-18T00:11:45.4468469Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T00:11:45.4469578Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T00:11:45.4470523Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:11:45.4471381Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:11:45.4472350Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:11:45.4473204Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:11:45.4474041Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2024-12-18T00:11:45.4474876Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 18s local ... 2024-12-18T00:11:45.8058800Z 2024-12-18T00:11:45.8059665Z  2024-12-18T00:11:45.8060101Z  2024-12-18T00:11:45.8060484Z  2024-12-18T00:11:45.8060850Z  2024-12-18T00:11:45.8061213Z  2024-12-18T00:11:45.8061585Z  2024-12-18T00:11:45.8061952Z  2024-12-18T00:11:45.8062304Z  2024-12-18T00:11:45.8062822Z [14,639 / 15,187] 48 actions running 2024-12-18T00:11:45.8063617Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T00:11:45.8064348Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T00:11:45.8065197Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:11:45.8066097Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2024-12-18T00:11:45.8067077Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:11:45.8067955Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:11:45.8068746Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T00:11:45.8069640Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 19s local ... 2024-12-18T00:11:46.0892801Z 2024-12-18T00:11:46.0893635Z  2024-12-18T00:11:46.0894108Z  2024-12-18T00:11:46.0894512Z  2024-12-18T00:11:46.0894860Z  2024-12-18T00:11:46.0895234Z  2024-12-18T00:11:46.0895610Z  2024-12-18T00:11:46.0895987Z  2024-12-18T00:11:46.0896375Z  2024-12-18T00:11:46.0897092Z [14,642 / 15,187] 48 actions, 47 running 2024-12-18T00:11:46.0897849Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T00:11:46.0898772Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T00:11:46.0900046Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:11:46.0900934Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2024-12-18T00:11:46.0901920Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:11:46.0902800Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:11:46.0903622Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T00:11:46.0904528Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 19s local ... 2024-12-18T00:11:46.4064053Z 2024-12-18T00:11:46.4064913Z  2024-12-18T00:11:46.4065418Z  2024-12-18T00:11:46.4065839Z  2024-12-18T00:11:46.4066253Z  2024-12-18T00:11:46.4066636Z  2024-12-18T00:11:46.4067031Z  2024-12-18T00:11:46.4067420Z  2024-12-18T00:11:46.4067815Z  2024-12-18T00:11:46.4068368Z [14,642 / 15,187] 48 actions running 2024-12-18T00:11:46.4069122Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T00:11:46.4070051Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T00:11:46.4071228Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2024-12-18T00:11:46.4072141Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2024-12-18T00:11:46.4073231Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:11:46.4074082Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:11:46.4074898Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T00:11:46.4075952Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 19s local ... 2024-12-18T00:11:46.8068584Z 2024-12-18T00:11:46.8069457Z  2024-12-18T00:11:46.8069885Z  2024-12-18T00:11:46.8070273Z  2024-12-18T00:11:46.8070656Z  2024-12-18T00:11:46.8071027Z  2024-12-18T00:11:46.8071415Z  2024-12-18T00:11:46.8071765Z  2024-12-18T00:11:46.8072128Z  2024-12-18T00:11:46.8072678Z [14,643 / 15,187] 47 actions running 2024-12-18T00:11:46.8073447Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T00:11:46.8074326Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T00:11:46.8075283Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2024-12-18T00:11:46.8076152Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:11:46.8077078Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:11:46.8077915Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:11:46.8078747Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T00:11:46.8079634Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 20s local ... 2024-12-18T00:11:47.0072292Z 2024-12-18T00:11:47.0073177Z  2024-12-18T00:11:47.0073613Z  2024-12-18T00:11:47.0074013Z  2024-12-18T00:11:47.0074407Z  2024-12-18T00:11:47.0074739Z  2024-12-18T00:11:47.0075154Z  2024-12-18T00:11:47.0075552Z  2024-12-18T00:11:47.0075956Z  2024-12-18T00:11:47.0076530Z [14,644 / 15,187] 48 actions running 2024-12-18T00:11:47.0077367Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T00:11:47.0078349Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T00:11:47.0079303Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2024-12-18T00:11:47.0080278Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:11:47.0081304Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:11:47.0082230Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:11:47.0083078Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T00:11:47.0084003Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 20s local ... 2024-12-18T00:11:47.3999794Z 2024-12-18T00:11:47.4000608Z  2024-12-18T00:11:47.4001346Z  2024-12-18T00:11:47.4001736Z  2024-12-18T00:11:47.4002153Z  2024-12-18T00:11:47.4002600Z  2024-12-18T00:11:47.4003042Z  2024-12-18T00:11:47.4003463Z  2024-12-18T00:11:47.4003883Z  2024-12-18T00:11:47.4004474Z [14,647 / 15,187] 48 actions, 47 running 2024-12-18T00:11:47.4005238Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T00:11:47.4006199Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T00:11:47.4007170Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:11:47.4008006Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:11:47.4008891Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:11:47.4009700Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:11:47.4010493Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T00:11:47.4011344Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 20s local ... 2024-12-18T00:11:47.7247230Z 2024-12-18T00:11:47.7248132Z  2024-12-18T00:11:47.7248871Z  2024-12-18T00:11:47.7249288Z  2024-12-18T00:11:47.7249662Z  2024-12-18T00:11:47.7250004Z  2024-12-18T00:11:47.7250668Z  2024-12-18T00:11:47.7251054Z  2024-12-18T00:11:47.7251424Z  2024-12-18T00:11:47.7251949Z [14,647 / 15,187] 48 actions running 2024-12-18T00:11:47.7252687Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T00:11:47.7253603Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T00:11:47.7254696Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:11:47.7255561Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:11:47.7256690Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2024-12-18T00:11:47.7257517Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:11:47.7258362Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T00:11:47.7259281Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 21s local ... 2024-12-18T00:11:48.1256939Z 2024-12-18T00:11:48.1257770Z  2024-12-18T00:11:48.1258266Z  2024-12-18T00:11:48.1258653Z  2024-12-18T00:11:48.1259026Z  2024-12-18T00:11:48.1259403Z  2024-12-18T00:11:48.1259786Z  2024-12-18T00:11:48.1260151Z  2024-12-18T00:11:48.1260498Z  2024-12-18T00:11:48.1261028Z [14,649 / 15,187] 48 actions running 2024-12-18T00:11:48.1261797Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T00:11:48.1262737Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T00:11:48.1263635Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:11:48.1264481Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:11:48.1265395Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2024-12-18T00:11:48.1266386Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:11:48.1267265Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T00:11:48.1268270Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 21s local ... 2024-12-18T00:11:48.9267003Z 2024-12-18T00:11:48.9267884Z  2024-12-18T00:11:48.9268335Z  2024-12-18T00:11:48.9268701Z  2024-12-18T00:11:48.9269084Z  2024-12-18T00:11:48.9269450Z  2024-12-18T00:11:48.9269839Z  2024-12-18T00:11:48.9270217Z  2024-12-18T00:11:48.9270602Z  2024-12-18T00:11:48.9271205Z [14,650 / 15,187] 48 actions, 47 running 2024-12-18T00:11:48.9271957Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T00:11:48.9272910Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T00:11:48.9273852Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:11:48.9275061Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:11:48.9276056Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:11:48.9276927Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:11:48.9277775Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T00:11:48.9278721Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 22s local ... 2024-12-18T00:11:49.1285324Z 2024-12-18T00:11:49.1285864Z  2024-12-18T00:11:49.1286263Z  2024-12-18T00:11:49.1295972Z  2024-12-18T00:11:49.1296772Z  2024-12-18T00:11:49.1297131Z  2024-12-18T00:11:49.1297525Z  2024-12-18T00:11:49.1297879Z  2024-12-18T00:11:49.1298385Z  2024-12-18T00:11:49.1298924Z [14,650 / 15,187] 48 actions running 2024-12-18T00:11:49.1299654Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T00:11:49.1300554Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T00:11:49.1301457Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:11:49.1302545Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:11:49.1303456Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:11:49.1304399Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:11:49.1305199Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T00:11:49.1306095Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 22s local ... 2024-12-18T00:11:49.3600445Z 2024-12-18T00:11:49.3601255Z  2024-12-18T00:11:49.3602023Z  2024-12-18T00:11:49.3602447Z  2024-12-18T00:11:49.3602815Z  2024-12-18T00:11:49.3603222Z  2024-12-18T00:11:49.3603638Z  2024-12-18T00:11:49.3603994Z  2024-12-18T00:11:49.3604343Z  2024-12-18T00:11:49.3604898Z [14,651 / 15,187] 48 actions, 47 running 2024-12-18T00:11:49.3605650Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T00:11:49.3606555Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T00:11:49.3607466Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:11:49.3608358Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:11:49.3609290Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:11:49.3610193Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:11:49.3611097Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T00:11:49.3612144Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 22s local ... 2024-12-18T00:11:49.7297541Z 2024-12-18T00:11:49.7298415Z  2024-12-18T00:11:49.7298985Z  2024-12-18T00:11:49.7299357Z  2024-12-18T00:11:49.7299717Z  2024-12-18T00:11:49.7300088Z  2024-12-18T00:11:49.7300447Z  2024-12-18T00:11:49.7300847Z  2024-12-18T00:11:49.7301209Z  2024-12-18T00:11:49.7301742Z [14,652 / 15,187] 48 actions running 2024-12-18T00:11:49.7302528Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T00:11:49.7303420Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T00:11:49.7304305Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:11:49.7305158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:11:49.7306070Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:11:49.7306906Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:11:49.7307736Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2024-12-18T00:11:49.7308614Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local ... 2024-12-18T00:11:50.1284488Z 2024-12-18T00:11:50.1285272Z  2024-12-18T00:11:50.1285679Z  2024-12-18T00:11:50.1286242Z  2024-12-18T00:11:50.1286572Z  2024-12-18T00:11:50.1286901Z  2024-12-18T00:11:50.1287230Z  2024-12-18T00:11:50.1287646Z  2024-12-18T00:11:50.1288013Z  2024-12-18T00:11:50.1288515Z [14,653 / 15,187] 48 actions, 47 running 2024-12-18T00:11:50.1289212Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T00:11:50.1289991Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T00:11:50.1290811Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:11:50.1291630Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:11:50.1292516Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:11:50.1293291Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:11:50.1294059Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2024-12-18T00:11:50.1294845Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local ... 2024-12-18T00:11:50.3311272Z 2024-12-18T00:11:50.3312135Z  2024-12-18T00:11:50.3312543Z  2024-12-18T00:11:50.3312875Z  2024-12-18T00:11:50.3313456Z  2024-12-18T00:11:50.3313779Z  2024-12-18T00:11:50.3314109Z  2024-12-18T00:11:50.3314532Z  2024-12-18T00:11:50.3314854Z  2024-12-18T00:11:50.3315334Z [14,654 / 15,187] 48 actions running 2024-12-18T00:11:50.3315986Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T00:11:50.3316765Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T00:11:50.3317542Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2024-12-18T00:11:50.3318455Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:11:50.3319250Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:11:50.3319972Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:11:50.3320638Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local 2024-12-18T00:11:50.3321440Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local ... 2024-12-18T00:11:50.7321595Z 2024-12-18T00:11:50.7322573Z  2024-12-18T00:11:50.7323074Z  2024-12-18T00:11:50.7323498Z  2024-12-18T00:11:50.7323898Z  2024-12-18T00:11:50.7324302Z  2024-12-18T00:11:50.7324698Z  2024-12-18T00:11:50.7325110Z  2024-12-18T00:11:50.7325522Z  2024-12-18T00:11:50.7326045Z [14,655 / 15,187] 48 actions running 2024-12-18T00:11:50.7326768Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T00:11:50.7327738Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T00:11:50.7328568Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2024-12-18T00:11:50.7329419Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2024-12-18T00:11:50.7330429Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:11:50.7331331Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:11:50.7332120Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local 2024-12-18T00:11:50.7333085Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local ... 2024-12-18T00:11:51.3298349Z 2024-12-18T00:11:51.3299343Z  2024-12-18T00:11:51.3299825Z  2024-12-18T00:11:51.3300272Z  2024-12-18T00:11:51.3300692Z  2024-12-18T00:11:51.3301064Z  2024-12-18T00:11:51.3301448Z  2024-12-18T00:11:51.3301820Z  2024-12-18T00:11:51.3302176Z  2024-12-18T00:11:51.3302805Z [14,656 / 15,187] 48 actions, 47 running 2024-12-18T00:11:51.3303644Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T00:11:51.3304588Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T00:11:51.3305558Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:11:51.3306462Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2024-12-18T00:11:51.3307802Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:11:51.3308733Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:11:51.3309557Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local 2024-12-18T00:11:51.3310507Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 18s local ... 2024-12-18T00:11:51.5343736Z 2024-12-18T00:11:51.5344878Z  2024-12-18T00:11:51.5345349Z  2024-12-18T00:11:51.5345756Z  2024-12-18T00:11:51.5346137Z  2024-12-18T00:11:51.5346527Z  2024-12-18T00:11:51.5346914Z  2024-12-18T00:11:51.5347306Z  2024-12-18T00:11:51.5347694Z  2024-12-18T00:11:51.5348259Z [14,659 / 15,187] 48 actions running 2024-12-18T00:11:51.5349621Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T00:11:51.5350576Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T00:11:51.5351492Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:11:51.5352644Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2024-12-18T00:11:51.5353628Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:11:51.5354665Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:11:51.5355496Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local 2024-12-18T00:11:51.5356402Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 18s local ... 2024-12-18T00:11:51.9353800Z 2024-12-18T00:11:51.9354668Z  2024-12-18T00:11:51.9355137Z  2024-12-18T00:11:51.9355553Z  2024-12-18T00:11:51.9356308Z  2024-12-18T00:11:51.9356746Z  2024-12-18T00:11:51.9357158Z  2024-12-18T00:11:51.9357542Z  2024-12-18T00:11:51.9357924Z  2024-12-18T00:11:51.9358472Z [14,660 / 15,187] 48 actions running 2024-12-18T00:11:51.9359419Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T00:11:51.9360469Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T00:11:51.9361524Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:11:51.9362513Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:11:51.9363583Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:11:51.9364530Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:11:51.9365946Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local 2024-12-18T00:11:51.9367132Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 19s local ... 2024-12-18T00:11:52.2801445Z 2024-12-18T00:11:52.2802411Z  2024-12-18T00:11:52.2802914Z  2024-12-18T00:11:52.2803330Z  2024-12-18T00:11:52.2803744Z  2024-12-18T00:11:52.2804143Z  2024-12-18T00:11:52.2804543Z  2024-12-18T00:11:52.2804954Z  2024-12-18T00:11:52.2805341Z  2024-12-18T00:11:52.2805967Z [14,661 / 15,187] 48 actions, 47 running 2024-12-18T00:11:52.2806946Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T00:11:52.2807957Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:11:52.2808960Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:11:52.2809886Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:11:52.2810914Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:11:52.2811855Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:11:52.2812704Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local 2024-12-18T00:11:52.2813705Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 19s local ... 2024-12-18T00:11:52.5369468Z 2024-12-18T00:11:52.5370604Z  2024-12-18T00:11:52.5371090Z  2024-12-18T00:11:52.5371469Z  2024-12-18T00:11:52.5371884Z  2024-12-18T00:11:52.5372579Z  2024-12-18T00:11:52.5372928Z  2024-12-18T00:11:52.5373300Z  2024-12-18T00:11:52.5373676Z  2024-12-18T00:11:52.5374295Z [14,662 / 15,187] 48 actions running 2024-12-18T00:11:52.5375101Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T00:11:52.5376038Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:11:52.5377174Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:11:52.5378059Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:11:52.5378992Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:11:52.5379897Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:11:52.5380688Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local 2024-12-18T00:11:52.5381663Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 19s local ... 2024-12-18T00:11:52.7376288Z 2024-12-18T00:11:52.7377356Z  2024-12-18T00:11:52.7377834Z  2024-12-18T00:11:52.7378140Z  2024-12-18T00:11:52.7378470Z  2024-12-18T00:11:52.7379083Z  2024-12-18T00:11:52.7379495Z  2024-12-18T00:11:52.7379848Z  2024-12-18T00:11:52.7380213Z  2024-12-18T00:11:52.7380892Z [14,663 / 15,187] 48 actions running 2024-12-18T00:11:52.7381701Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T00:11:52.7382627Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:11:52.7383576Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:11:52.7384629Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:11:52.7385628Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:11:52.7386532Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:11:52.7387345Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local 2024-12-18T00:11:52.7388313Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 19s local ... 2024-12-18T00:11:53.0416299Z 2024-12-18T00:11:53.0417341Z  2024-12-18T00:11:53.0417824Z  2024-12-18T00:11:53.0418230Z  2024-12-18T00:11:53.0418643Z  2024-12-18T00:11:53.0419051Z  2024-12-18T00:11:53.0419450Z  2024-12-18T00:11:53.0419853Z  2024-12-18T00:11:53.0420234Z  2024-12-18T00:11:53.0420865Z [14,664 / 15,187] 48 actions, 47 running 2024-12-18T00:11:53.0421713Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T00:11:53.0422724Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:11:53.0423729Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:11:53.0424651Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:11:53.0425661Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:11:53.0426583Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:11:53.0427404Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local 2024-12-18T00:11:53.0428554Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 20s local ... 2024-12-18T00:11:53.3394712Z 2024-12-18T00:11:53.3395628Z  2024-12-18T00:11:53.3396103Z  2024-12-18T00:11:53.3396506Z  2024-12-18T00:11:53.3396883Z  2024-12-18T00:11:53.3397261Z  2024-12-18T00:11:53.3397664Z  2024-12-18T00:11:53.3398065Z  2024-12-18T00:11:53.3398457Z  2024-12-18T00:11:53.3398956Z [14,665 / 15,187] 48 actions running 2024-12-18T00:11:53.3399722Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T00:11:53.3400636Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T00:11:53.3401525Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:11:53.3402408Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:11:53.3403643Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:11:53.3404563Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:11:53.3405308Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local 2024-12-18T00:11:53.3406255Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 20s local ... 2024-12-18T00:11:53.7405029Z 2024-12-18T00:11:53.7405892Z  2024-12-18T00:11:53.7406380Z  2024-12-18T00:11:53.7406930Z  2024-12-18T00:11:53.7407317Z  2024-12-18T00:11:53.7407710Z  2024-12-18T00:11:53.7408098Z  2024-12-18T00:11:53.7408502Z  2024-12-18T00:11:53.7408880Z  2024-12-18T00:11:53.7409449Z [14,666 / 15,187] 48 actions running 2024-12-18T00:11:53.7410250Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T00:11:53.7411190Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T00:11:53.7412105Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:11:53.7413022Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:11:53.7414229Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:11:53.7415102Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:11:53.7415982Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2024-12-18T00:11:53.7417105Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 20s local ... 2024-12-18T00:11:54.0937385Z 2024-12-18T00:11:54.0938283Z  2024-12-18T00:11:54.0938761Z  2024-12-18T00:11:54.0939171Z  2024-12-18T00:11:54.0939584Z  2024-12-18T00:11:54.0940233Z  2024-12-18T00:11:54.0940654Z  2024-12-18T00:11:54.0941046Z  2024-12-18T00:11:54.0941434Z  2024-12-18T00:11:54.0942025Z [14,668 / 15,187] 48 actions, 47 running 2024-12-18T00:11:54.0942828Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T00:11:54.0943818Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T00:11:54.0945169Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:11:54.0946061Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:11:54.0947003Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:11:54.0947860Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:11:54.0948620Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2024-12-18T00:11:54.0949558Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 21s local ... 2024-12-18T00:11:54.3422311Z 2024-12-18T00:11:54.3423141Z  2024-12-18T00:11:54.3423559Z  2024-12-18T00:11:54.3423939Z  2024-12-18T00:11:54.3424294Z  2024-12-18T00:11:54.3424652Z  2024-12-18T00:11:54.3425012Z  2024-12-18T00:11:54.3425347Z  2024-12-18T00:11:54.3425694Z  2024-12-18T00:11:54.3426192Z [14,668 / 15,187] 48 actions running 2024-12-18T00:11:54.3426921Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T00:11:54.3427764Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T00:11:54.3428617Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:11:54.3429445Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:11:54.3430262Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:11:54.3431027Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:11:54.3431717Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2024-12-18T00:11:54.3432568Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 21s local ... 2024-12-18T00:11:55.1744496Z 2024-12-18T00:11:55.1745339Z  2024-12-18T00:11:55.1745826Z  2024-12-18T00:11:55.1746319Z  2024-12-18T00:11:55.1746700Z  2024-12-18T00:11:55.1747091Z  2024-12-18T00:11:55.1747798Z  2024-12-18T00:11:55.1748172Z  2024-12-18T00:11:55.1748514Z  2024-12-18T00:11:55.1749246Z [14,669 / 15,187] 48 actions, 47 running 2024-12-18T00:11:55.1750033Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T00:11:55.1750936Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T00:11:55.1751822Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:11:55.1752753Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:11:55.1753679Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2024-12-18T00:11:55.1754567Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:11:55.1755343Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:11:55.1756299Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 22s local ... 2024-12-18T00:11:55.5455625Z 2024-12-18T00:11:55.5456640Z  2024-12-18T00:11:55.5457198Z  2024-12-18T00:11:55.5457599Z  2024-12-18T00:11:55.5458009Z  2024-12-18T00:11:55.5458386Z  2024-12-18T00:11:55.5459077Z  2024-12-18T00:11:55.5459526Z  2024-12-18T00:11:55.5459915Z  2024-12-18T00:11:55.5460480Z [14,669 / 15,187] 48 actions running 2024-12-18T00:11:55.5461440Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T00:11:55.5462305Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T00:11:55.5463212Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:11:55.5464066Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:11:55.5465139Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:11:55.5465988Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:11:55.5466787Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:11:55.5467728Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 22s local ... 2024-12-18T00:11:55.9466650Z 2024-12-18T00:11:55.9467466Z  2024-12-18T00:11:55.9467915Z  2024-12-18T00:11:55.9468301Z  2024-12-18T00:11:55.9468705Z  2024-12-18T00:11:55.9469086Z  2024-12-18T00:11:55.9469449Z  2024-12-18T00:11:55.9469809Z  2024-12-18T00:11:55.9470187Z  2024-12-18T00:11:55.9470773Z [14,670 / 15,187] 48 actions running 2024-12-18T00:11:55.9471578Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T00:11:55.9472491Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T00:11:55.9473480Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:11:55.9474485Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:11:55.9475393Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:11:55.9476222Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:11:55.9476935Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:11:55.9477912Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local ... 2024-12-18T00:11:56.2297351Z 2024-12-18T00:11:56.2298238Z  2024-12-18T00:11:56.2298737Z  2024-12-18T00:11:56.2299133Z  2024-12-18T00:11:56.2299534Z  2024-12-18T00:11:56.2300086Z  2024-12-18T00:11:56.2300423Z  2024-12-18T00:11:56.2300788Z  2024-12-18T00:11:56.2301170Z  2024-12-18T00:11:56.2301772Z [14,671 / 15,187] 48 actions, 47 running 2024-12-18T00:11:56.2302524Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T00:11:56.2303501Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:11:56.2304611Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:11:56.2305727Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:11:56.2306719Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:11:56.2307882Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:11:56.2308713Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:11:56.2309618Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local ... 2024-12-18T00:11:56.5414156Z 2024-12-18T00:11:56.5415013Z  2024-12-18T00:11:56.5415474Z  2024-12-18T00:11:56.5415859Z  2024-12-18T00:11:56.5416244Z  2024-12-18T00:11:56.5416788Z  2024-12-18T00:11:56.5417197Z  2024-12-18T00:11:56.5417596Z  2024-12-18T00:11:56.5418021Z  2024-12-18T00:11:56.5418589Z [14,673 / 15,187] 48 actions, 47 running 2024-12-18T00:11:56.5419375Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T00:11:56.5420293Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:11:56.5421221Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:11:56.5422143Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:11:56.5423274Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:11:56.5424072Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:11:56.5425016Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:11:56.5425978Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local ... 2024-12-18T00:11:56.7487596Z 2024-12-18T00:11:56.7488439Z  2024-12-18T00:11:56.7488865Z  2024-12-18T00:11:56.7489208Z  2024-12-18T00:11:56.7489561Z  2024-12-18T00:11:56.7489920Z  2024-12-18T00:11:56.7490511Z  2024-12-18T00:11:56.7490859Z  2024-12-18T00:11:56.7491196Z  2024-12-18T00:11:56.7491681Z [14,673 / 15,187] 48 actions running 2024-12-18T00:11:56.7492382Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T00:11:56.7493239Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:11:56.7494073Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:11:56.7494878Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:11:56.7495698Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:11:56.7496612Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:11:56.7497310Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:11:56.7498146Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local ... 2024-12-18T00:11:57.1309635Z 2024-12-18T00:11:57.1310488Z  2024-12-18T00:11:57.1310895Z  2024-12-18T00:11:57.1311250Z  2024-12-18T00:11:57.1311578Z  2024-12-18T00:11:57.1311908Z  2024-12-18T00:11:57.1312227Z  2024-12-18T00:11:57.1312557Z  2024-12-18T00:11:57.1312888Z  2024-12-18T00:11:57.1313391Z [14,674 / 15,187] 48 actions, 47 running 2024-12-18T00:11:57.1314105Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T00:11:57.1314922Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:11:57.1315754Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:11:57.1316586Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:11:57.1317342Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:11:57.1318058Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:11:57.1318693Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:11:57.1319445Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local ... 2024-12-18T00:11:57.3504736Z 2024-12-18T00:11:57.3505550Z  2024-12-18T00:11:57.3506035Z  2024-12-18T00:11:57.3506436Z  2024-12-18T00:11:57.3506830Z  2024-12-18T00:11:57.3507191Z  2024-12-18T00:11:57.3507582Z  2024-12-18T00:11:57.3508275Z  2024-12-18T00:11:57.3508673Z  2024-12-18T00:11:57.3509240Z [14,674 / 15,187] 48 actions running 2024-12-18T00:11:57.3510026Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T00:11:57.3510957Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T00:11:57.3511933Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:11:57.3512852Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:11:57.3513783Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:11:57.3514649Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:11:57.3515457Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:11:57.3516430Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local ... 2024-12-18T00:11:57.7515993Z 2024-12-18T00:11:57.7516915Z  2024-12-18T00:11:57.7517370Z  2024-12-18T00:11:57.7517751Z  2024-12-18T00:11:57.7518186Z  2024-12-18T00:11:57.7518515Z  2024-12-18T00:11:57.7518824Z  2024-12-18T00:11:57.7519211Z  2024-12-18T00:11:57.7519861Z  2024-12-18T00:11:57.7520438Z [14,675 / 15,187] 48 actions running 2024-12-18T00:11:57.7521293Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T00:11:57.7522222Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T00:11:57.7523053Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:11:57.7523899Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:11:57.7525103Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:11:57.7525975Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:11:57.7526764Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:11:57.7527716Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local ... 2024-12-18T00:11:58.0964902Z 2024-12-18T00:11:58.0965784Z  2024-12-18T00:11:58.0966261Z  2024-12-18T00:11:58.0966621Z  2024-12-18T00:11:58.0967022Z  2024-12-18T00:11:58.0967390Z  2024-12-18T00:11:58.0967740Z  2024-12-18T00:11:58.0968099Z  2024-12-18T00:11:58.0968559Z  2024-12-18T00:11:58.0969185Z [14,676 / 15,187] 48 actions, 47 running 2024-12-18T00:11:58.0969978Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T00:11:58.0970960Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T00:11:58.0971915Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:11:58.0972913Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:11:58.0973973Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:11:58.0974799Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:11:58.0975529Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:11:58.0976428Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local ... 2024-12-18T00:11:58.3532646Z 2024-12-18T00:11:58.3533534Z  2024-12-18T00:11:58.3534030Z  2024-12-18T00:11:58.3534410Z  2024-12-18T00:11:58.3534838Z  2024-12-18T00:11:58.3535202Z  2024-12-18T00:11:58.3535574Z  2024-12-18T00:11:58.3535989Z  2024-12-18T00:11:58.3536348Z  2024-12-18T00:11:58.3536997Z [14,677 / 15,187] 48 actions running 2024-12-18T00:11:58.3537780Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T00:11:58.3538763Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2024-12-18T00:11:58.3539687Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:11:58.3540599Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:11:58.3541583Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:11:58.3542760Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:11:58.3543549Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:11:58.3544696Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local ... 2024-12-18T00:11:59.1017864Z 2024-12-18T00:11:59.1018752Z  2024-12-18T00:11:59.1019256Z  2024-12-18T00:11:59.1019635Z  2024-12-18T00:11:59.1019989Z  2024-12-18T00:11:59.1020366Z  2024-12-18T00:11:59.1020747Z  2024-12-18T00:11:59.1021112Z  2024-12-18T00:11:59.1021469Z  2024-12-18T00:11:59.1022046Z [14,678 / 15,187] 48 actions, 47 running 2024-12-18T00:11:59.1022845Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T00:11:59.1023774Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2024-12-18T00:11:59.1024707Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:11:59.1025600Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:11:59.1026590Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:11:59.1027751Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:11:59.1028548Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:11:59.1029676Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2024-12-18T00:11:59.3560088Z 2024-12-18T00:11:59.3560925Z  2024-12-18T00:11:59.3561360Z  2024-12-18T00:11:59.3561732Z  2024-12-18T00:11:59.3562093Z  2024-12-18T00:11:59.3562459Z  2024-12-18T00:11:59.3562811Z  2024-12-18T00:11:59.3563404Z  2024-12-18T00:11:59.3563780Z  2024-12-18T00:11:59.3564318Z [14,678 / 15,187] 48 actions running 2024-12-18T00:11:59.3565057Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T00:11:59.3565936Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:11:59.3566808Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:11:59.3567671Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:11:59.3568605Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:11:59.3569402Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:11:59.3570062Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:11:59.3570943Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2024-12-18T00:11:59.5564924Z 2024-12-18T00:11:59.5565932Z  2024-12-18T00:11:59.5566411Z  2024-12-18T00:11:59.5566801Z  2024-12-18T00:11:59.5567193Z  2024-12-18T00:11:59.5567604Z  2024-12-18T00:11:59.5567980Z  2024-12-18T00:11:59.5568344Z  2024-12-18T00:11:59.5568723Z  2024-12-18T00:11:59.5569263Z [14,679 / 15,187] 48 actions running 2024-12-18T00:11:59.5570072Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T00:11:59.5571014Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:11:59.5571982Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:11:59.5572887Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:11:59.5573853Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:11:59.5574732Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:11:59.5575510Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:11:59.5576588Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2024-12-18T00:11:59.7587368Z 2024-12-18T00:11:59.7588257Z  2024-12-18T00:11:59.7588724Z  2024-12-18T00:11:59.7589131Z  2024-12-18T00:11:59.7589537Z  2024-12-18T00:11:59.7590092Z  2024-12-18T00:11:59.7590473Z  2024-12-18T00:11:59.7590902Z  2024-12-18T00:11:59.7591308Z  2024-12-18T00:11:59.7592209Z [14,682 / 15,187] 48 actions, 47 running 2024-12-18T00:11:59.7593108Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T00:11:59.7594060Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:11:59.7595041Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:11:59.7595936Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:11:59.7596780Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:11:59.7597638Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:11:59.7598448Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:11:59.7599387Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2024-12-18T00:11:59.9812988Z 2024-12-18T00:11:59.9813844Z  2024-12-18T00:11:59.9814303Z  2024-12-18T00:11:59.9814674Z  2024-12-18T00:11:59.9815037Z  2024-12-18T00:11:59.9815422Z  2024-12-18T00:11:59.9815782Z  2024-12-18T00:11:59.9816152Z  2024-12-18T00:11:59.9816669Z  2024-12-18T00:11:59.9817504Z [14,683 / 15,187] 48 actions, 47 running 2024-12-18T00:11:59.9818260Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T00:11:59.9819285Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:11:59.9820173Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:11:59.9821094Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:11:59.9822187Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:11:59.9823056Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:11:59.9823839Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:11:59.9824805Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local ... 2024-12-18T00:12:00.2056641Z 2024-12-18T00:12:00.2057559Z  2024-12-18T00:12:00.2057969Z  2024-12-18T00:12:00.2058316Z  2024-12-18T00:12:00.2058652Z  2024-12-18T00:12:00.2059011Z  2024-12-18T00:12:00.2059341Z  2024-12-18T00:12:00.2059680Z  2024-12-18T00:12:00.2060022Z  2024-12-18T00:12:00.2060548Z [14,684 / 15,187] 48 actions, 47 running 2024-12-18T00:12:00.2061251Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T00:12:00.2062040Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T00:12:00.2062872Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:12:00.2063701Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:12:00.2064610Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:12:00.2065447Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:12:00.2066186Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:12:00.2067183Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local ... 2024-12-18T00:12:00.5363536Z 2024-12-18T00:12:00.5364463Z  2024-12-18T00:12:00.5364900Z  2024-12-18T00:12:00.5365275Z  2024-12-18T00:12:00.5365640Z  2024-12-18T00:12:00.5366009Z  2024-12-18T00:12:00.5366361Z  2024-12-18T00:12:00.5366715Z  2024-12-18T00:12:00.5367079Z  2024-12-18T00:12:00.5367647Z [14,687 / 15,187] 48 actions, 47 running 2024-12-18T00:12:00.5368389Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T00:12:00.5369273Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T00:12:00.5370244Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:12:00.5371248Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:12:00.5371998Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:12:00.5372665Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:12:00.5373714Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2024-12-18T00:12:00.5374513Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local ... 2024-12-18T00:12:00.7596542Z 2024-12-18T00:12:00.7597457Z  2024-12-18T00:12:00.7597914Z  2024-12-18T00:12:00.7598315Z  2024-12-18T00:12:00.7598717Z  2024-12-18T00:12:00.7599105Z  2024-12-18T00:12:00.7599472Z  2024-12-18T00:12:00.7599858Z  2024-12-18T00:12:00.7600259Z  2024-12-18T00:12:00.7600826Z [14,687 / 15,187] 48 actions running 2024-12-18T00:12:00.7601638Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T00:12:00.7602577Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T00:12:00.7603548Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:12:00.7604566Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:12:00.7605521Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:12:00.7606606Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:12:00.7607591Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2024-12-18T00:12:00.7608695Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local ... 2024-12-18T00:12:01.0783921Z 2024-12-18T00:12:01.0784814Z  2024-12-18T00:12:01.0785271Z  2024-12-18T00:12:01.0785646Z  2024-12-18T00:12:01.0786019Z  2024-12-18T00:12:01.0786373Z  2024-12-18T00:12:01.0786729Z  2024-12-18T00:12:01.0787098Z  2024-12-18T00:12:01.0787471Z  2024-12-18T00:12:01.0788280Z [14,689 / 15,187] 48 actions, 47 running 2024-12-18T00:12:01.0789038Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T00:12:01.0789923Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T00:12:01.0790820Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:12:01.0791738Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:12:01.0792714Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:12:01.0793418Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:12:01.0794279Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2024-12-18T00:12:01.0795143Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local ... 2024-12-18T00:12:01.3607136Z 2024-12-18T00:12:01.3608026Z  2024-12-18T00:12:01.3608444Z  2024-12-18T00:12:01.3608811Z  2024-12-18T00:12:01.3609168Z  2024-12-18T00:12:01.3609562Z  2024-12-18T00:12:01.3609902Z  2024-12-18T00:12:01.3610257Z  2024-12-18T00:12:01.3610624Z  2024-12-18T00:12:01.3611146Z [14,691 / 15,187] 48 actions running 2024-12-18T00:12:01.3611899Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T00:12:01.3612779Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T00:12:01.3613662Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:12:01.3614540Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:12:01.3615379Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:12:01.3616110Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:12:01.3617218Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2024-12-18T00:12:01.3618037Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local ... 2024-12-18T00:12:01.6446033Z 2024-12-18T00:12:01.6446879Z  2024-12-18T00:12:01.6447395Z  2024-12-18T00:12:01.6447792Z  2024-12-18T00:12:01.6448202Z  2024-12-18T00:12:01.6448627Z  2024-12-18T00:12:01.6449007Z  2024-12-18T00:12:01.6449388Z  2024-12-18T00:12:01.6449751Z  2024-12-18T00:12:01.6450327Z [14,692 / 15,187] 48 actions, 47 running 2024-12-18T00:12:01.6451439Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T00:12:01.6452449Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T00:12:01.6453372Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:12:01.6454359Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2024-12-18T00:12:01.6455243Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:12:01.6455943Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:12:01.6456928Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2024-12-18T00:12:01.6457830Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local ... 2024-12-18T00:12:01.9612843Z 2024-12-18T00:12:01.9613770Z  2024-12-18T00:12:01.9614242Z  2024-12-18T00:12:01.9614666Z  2024-12-18T00:12:01.9615082Z  2024-12-18T00:12:01.9615624Z  2024-12-18T00:12:01.9616021Z  2024-12-18T00:12:01.9616443Z  2024-12-18T00:12:01.9617013Z  2024-12-18T00:12:01.9617612Z [14,693 / 15,187] 47 actions running 2024-12-18T00:12:01.9618730Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T00:12:01.9619774Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T00:12:01.9620937Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:12:01.9621919Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2024-12-18T00:12:01.9622808Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:12:01.9623630Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 35s local 2024-12-18T00:12:01.9625150Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T00:12:01.9626126Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local ... 2024-12-18T00:12:02.3587993Z 2024-12-18T00:12:02.3588854Z  2024-12-18T00:12:02.3589298Z  2024-12-18T00:12:02.3589684Z  2024-12-18T00:12:02.3590100Z  2024-12-18T00:12:02.3590479Z  2024-12-18T00:12:02.3590852Z  2024-12-18T00:12:02.3591232Z  2024-12-18T00:12:02.3591650Z  2024-12-18T00:12:02.3592255Z [14,696 / 15,187] 48 actions, 47 running 2024-12-18T00:12:02.3593097Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T00:12:02.3594082Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T00:12:02.3595039Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:12:02.3595987Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2024-12-18T00:12:02.3596909Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:12:02.3597813Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T00:12:02.3598707Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2024-12-18T00:12:02.3599593Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local ... 2024-12-18T00:12:02.5618747Z 2024-12-18T00:12:02.5619651Z  2024-12-18T00:12:02.5620058Z  2024-12-18T00:12:02.5620440Z  2024-12-18T00:12:02.5620856Z  2024-12-18T00:12:02.5621247Z  2024-12-18T00:12:02.5621616Z  2024-12-18T00:12:02.5622025Z  2024-12-18T00:12:02.5622404Z  2024-12-18T00:12:02.5622971Z [14,696 / 15,187] 48 actions running 2024-12-18T00:12:02.5623774Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T00:12:02.5624671Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T00:12:02.5625625Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:12:02.5626638Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:12:02.5627517Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T00:12:02.5628435Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T00:12:02.5629261Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2024-12-18T00:12:02.5630445Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local ... 2024-12-18T00:12:02.7621897Z 2024-12-18T00:12:02.7622766Z  2024-12-18T00:12:02.7623209Z  2024-12-18T00:12:02.7623623Z  2024-12-18T00:12:02.7623995Z  2024-12-18T00:12:02.7624364Z  2024-12-18T00:12:02.7624748Z  2024-12-18T00:12:02.7625130Z  2024-12-18T00:12:02.7625517Z  2024-12-18T00:12:02.7626087Z [14,698 / 15,187] 48 actions running 2024-12-18T00:12:02.7626911Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T00:12:02.7627894Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T00:12:02.7628850Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:12:02.7629787Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:12:02.7630653Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T00:12:02.7631535Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T00:12:02.7632735Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2024-12-18T00:12:02.7633582Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local ... 2024-12-18T00:12:03.1627792Z 2024-12-18T00:12:03.1628677Z  2024-12-18T00:12:03.1629144Z  2024-12-18T00:12:03.1629517Z  2024-12-18T00:12:03.1629894Z  2024-12-18T00:12:03.1630290Z  2024-12-18T00:12:03.1630655Z  2024-12-18T00:12:03.1631037Z  2024-12-18T00:12:03.1631438Z  2024-12-18T00:12:03.1631985Z [14,699 / 15,187] 48 actions running 2024-12-18T00:12:03.1633132Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T00:12:03.1634139Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:12:03.1635097Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:12:03.1636096Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:12:03.1637001Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T00:12:03.1637944Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2024-12-18T00:12:03.1639027Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2024-12-18T00:12:03.1639980Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local ... 2024-12-18T00:12:03.3847089Z 2024-12-18T00:12:03.3847926Z  2024-12-18T00:12:03.3848334Z  2024-12-18T00:12:03.3848670Z  2024-12-18T00:12:03.3849021Z  2024-12-18T00:12:03.3849381Z  2024-12-18T00:12:03.3849717Z  2024-12-18T00:12:03.3850065Z  2024-12-18T00:12:03.3850430Z  2024-12-18T00:12:03.3850970Z [14,700 / 15,187] 48 actions, 47 running 2024-12-18T00:12:03.3851674Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T00:12:03.3852504Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:12:03.3853334Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:12:03.3854177Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:12:03.3854948Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2024-12-18T00:12:03.3855745Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2024-12-18T00:12:03.3856725Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2024-12-18T00:12:03.3857495Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local ... 2024-12-18T00:12:03.7634035Z 2024-12-18T00:12:03.7634890Z  2024-12-18T00:12:03.7635333Z  2024-12-18T00:12:03.7635701Z  2024-12-18T00:12:03.7636096Z  2024-12-18T00:12:03.7636473Z  2024-12-18T00:12:03.7636851Z  2024-12-18T00:12:03.7648253Z  2024-12-18T00:12:03.7648707Z  2024-12-18T00:12:03.7649289Z [14,700 / 15,187] 48 actions running 2024-12-18T00:12:03.7650066Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T00:12:03.7651276Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:12:03.7652259Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2024-12-18T00:12:03.7653192Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:12:03.7654112Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2024-12-18T00:12:03.7655012Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2024-12-18T00:12:03.7655902Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2024-12-18T00:12:03.7656919Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local ... 2024-12-18T00:12:04.0156486Z 2024-12-18T00:12:04.0157362Z  2024-12-18T00:12:04.0157827Z  2024-12-18T00:12:04.0158232Z  2024-12-18T00:12:04.0158619Z  2024-12-18T00:12:04.0158980Z  2024-12-18T00:12:04.0159401Z  2024-12-18T00:12:04.0159790Z  2024-12-18T00:12:04.0160165Z  2024-12-18T00:12:04.0160749Z [14,701 / 15,187] 48 actions, 47 running 2024-12-18T00:12:04.0161818Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T00:12:04.0162761Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:12:04.0163826Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2024-12-18T00:12:04.0164755Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:12:04.0165621Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2024-12-18T00:12:04.0166480Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2024-12-18T00:12:04.0167508Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2024-12-18T00:12:04.0168398Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local ... 2024-12-18T00:12:04.3639715Z 2024-12-18T00:12:04.3640604Z  2024-12-18T00:12:04.3641043Z  2024-12-18T00:12:04.3641439Z  2024-12-18T00:12:04.3641831Z  2024-12-18T00:12:04.3642270Z  2024-12-18T00:12:04.3642650Z  2024-12-18T00:12:04.3643018Z  2024-12-18T00:12:04.3643363Z  2024-12-18T00:12:04.3643881Z [14,701 / 15,187] 48 actions running 2024-12-18T00:12:04.3644982Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T00:12:04.3645912Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2024-12-18T00:12:04.3646885Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2024-12-18T00:12:04.3647882Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:12:04.3648785Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2024-12-18T00:12:04.3649651Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2024-12-18T00:12:04.3650461Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2024-12-18T00:12:04.3651386Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local ... 2024-12-18T00:12:05.0959575Z 2024-12-18T00:12:05.0960455Z  2024-12-18T00:12:05.0960946Z  2024-12-18T00:12:05.0961332Z  2024-12-18T00:12:05.0961693Z  2024-12-18T00:12:05.0962055Z  2024-12-18T00:12:05.0962370Z  2024-12-18T00:12:05.0962737Z  2024-12-18T00:12:05.0963142Z  2024-12-18T00:12:05.0963741Z [14,702 / 15,187] 48 actions, 47 running 2024-12-18T00:12:05.0964515Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T00:12:05.0965506Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2024-12-18T00:12:05.0966509Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2024-12-18T00:12:05.0967526Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:12:05.0968381Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T00:12:05.0969294Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2024-12-18T00:12:05.0970208Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2024-12-18T00:12:05.0971366Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local ... 2024-12-18T00:12:05.3648982Z 2024-12-18T00:12:05.3649931Z  2024-12-18T00:12:05.3650411Z  2024-12-18T00:12:05.3650800Z  2024-12-18T00:12:05.3651142Z  2024-12-18T00:12:05.3651449Z  2024-12-18T00:12:05.3651888Z  2024-12-18T00:12:05.3652244Z  2024-12-18T00:12:05.3652728Z  2024-12-18T00:12:05.3653350Z [14,703 / 15,187] 48 actions running 2024-12-18T00:12:05.3654135Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T00:12:05.3655096Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T00:12:05.3656114Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2024-12-18T00:12:05.3657237Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:12:05.3657960Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T00:12:05.3658824Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2024-12-18T00:12:05.3659725Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2024-12-18T00:12:05.3660850Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local ... 2024-12-18T00:12:05.7076966Z 2024-12-18T00:12:05.7078135Z  2024-12-18T00:12:05.7078623Z  2024-12-18T00:12:05.7079023Z  2024-12-18T00:12:05.7079433Z  2024-12-18T00:12:05.7079854Z  2024-12-18T00:12:05.7080255Z  2024-12-18T00:12:05.7080622Z  2024-12-18T00:12:05.7081040Z  2024-12-18T00:12:05.7081655Z [14,704 / 15,187] 48 actions, 47 running 2024-12-18T00:12:05.7082688Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T00:12:05.7083651Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T00:12:05.7084749Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2024-12-18T00:12:05.7085754Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:12:05.7086652Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T00:12:05.7087581Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2024-12-18T00:12:05.7088497Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2024-12-18T00:12:05.7089409Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local ... 2024-12-18T00:12:05.9654156Z 2024-12-18T00:12:05.9654934Z  2024-12-18T00:12:05.9655363Z  2024-12-18T00:12:05.9655869Z  2024-12-18T00:12:05.9656215Z  2024-12-18T00:12:05.9656687Z  2024-12-18T00:12:05.9657056Z  2024-12-18T00:12:05.9657385Z  2024-12-18T00:12:05.9657726Z  2024-12-18T00:12:05.9658274Z [14,705 / 15,187] 48 actions running 2024-12-18T00:12:05.9658977Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T00:12:05.9659828Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T00:12:05.9660718Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2024-12-18T00:12:05.9661678Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:12:05.9662565Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T00:12:05.9663376Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2024-12-18T00:12:05.9664203Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2024-12-18T00:12:05.9665040Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local ... 2024-12-18T00:12:06.9662139Z 2024-12-18T00:12:06.9663012Z  2024-12-18T00:12:06.9663477Z  2024-12-18T00:12:06.9663845Z  2024-12-18T00:12:06.9664235Z  2024-12-18T00:12:06.9664604Z  2024-12-18T00:12:06.9664924Z  2024-12-18T00:12:06.9665274Z  2024-12-18T00:12:06.9665659Z  2024-12-18T00:12:06.9666272Z [14,705 / 15,187] 48 actions running 2024-12-18T00:12:06.9667077Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T00:12:06.9668348Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2024-12-18T00:12:06.9669311Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2024-12-18T00:12:06.9670236Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:12:06.9671103Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T00:12:06.9672013Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2024-12-18T00:12:06.9672919Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2024-12-18T00:12:06.9673818Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local ... 2024-12-18T00:12:07.3666940Z 2024-12-18T00:12:07.3667815Z  2024-12-18T00:12:07.3668251Z  2024-12-18T00:12:07.3668679Z  2024-12-18T00:12:07.3669108Z  2024-12-18T00:12:07.3669507Z  2024-12-18T00:12:07.3669926Z  2024-12-18T00:12:07.3670303Z  2024-12-18T00:12:07.3670710Z  2024-12-18T00:12:07.3671287Z [14,706 / 15,187] 48 actions running 2024-12-18T00:12:07.3672117Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T00:12:07.3673334Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T00:12:07.3674392Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2024-12-18T00:12:07.3675430Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:12:07.3676224Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T00:12:07.3677012Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2024-12-18T00:12:07.3677896Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2024-12-18T00:12:07.3678921Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local ... 2024-12-18T00:12:07.9052069Z 2024-12-18T00:12:07.9052952Z  2024-12-18T00:12:07.9053406Z  2024-12-18T00:12:07.9053802Z  2024-12-18T00:12:07.9054169Z  2024-12-18T00:12:07.9054558Z  2024-12-18T00:12:07.9054957Z  2024-12-18T00:12:07.9055392Z  2024-12-18T00:12:07.9055789Z  2024-12-18T00:12:07.9056395Z [14,707 / 15,187] 48 actions, 47 running 2024-12-18T00:12:07.9057356Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T00:12:07.9058366Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T00:12:07.9059334Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:12:07.9060277Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:12:07.9061001Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T00:12:07.9061729Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T00:12:07.9062588Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:12:07.9063428Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local ... 2024-12-18T00:12:08.1074655Z 2024-12-18T00:12:08.1075521Z  2024-12-18T00:12:08.1076013Z  2024-12-18T00:12:08.1076450Z  2024-12-18T00:12:08.1076838Z  2024-12-18T00:12:08.1077246Z  2024-12-18T00:12:08.1077637Z  2024-12-18T00:12:08.1078033Z  2024-12-18T00:12:08.1078388Z  2024-12-18T00:12:08.1078941Z [14,708 / 15,187] 48 actions, 47 running 2024-12-18T00:12:08.1079741Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T00:12:08.1080725Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T00:12:08.1081714Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:12:08.1082786Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:12:08.1083709Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T00:12:08.1084596Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T00:12:08.1085488Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:12:08.1086358Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local ... 2024-12-18T00:12:08.3264687Z 2024-12-18T00:12:08.3265536Z  2024-12-18T00:12:08.3266029Z  2024-12-18T00:12:08.3266468Z  2024-12-18T00:12:08.3266911Z  2024-12-18T00:12:08.3267264Z  2024-12-18T00:12:08.3267696Z  2024-12-18T00:12:08.3268115Z  2024-12-18T00:12:08.3268536Z  2024-12-18T00:12:08.3269127Z [14,709 / 15,187] 48 actions, 47 running 2024-12-18T00:12:08.3270088Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2024-12-18T00:12:08.3271030Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T00:12:08.3272048Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:12:08.3273060Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:12:08.3273951Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T00:12:08.3274864Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T00:12:08.3275834Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:12:08.3276977Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local ... 2024-12-18T00:12:08.5676684Z 2024-12-18T00:12:08.5677524Z  2024-12-18T00:12:08.5678002Z  2024-12-18T00:12:08.5678630Z  2024-12-18T00:12:08.5679038Z  2024-12-18T00:12:08.5679468Z  2024-12-18T00:12:08.5679889Z  2024-12-18T00:12:08.5680277Z  2024-12-18T00:12:08.5680679Z  2024-12-18T00:12:08.5681265Z [14,709 / 15,187] 48 actions running 2024-12-18T00:12:08.5682061Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2024-12-18T00:12:08.5683138Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T00:12:08.5684105Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:12:08.5685088Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:12:08.5686047Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T00:12:08.5687036Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T00:12:08.5688019Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:12:08.5688971Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local ... 2024-12-18T00:12:09.4123300Z 2024-12-18T00:12:09.4124191Z  2024-12-18T00:12:09.4124656Z  2024-12-18T00:12:09.4125061Z  2024-12-18T00:12:09.4125454Z  2024-12-18T00:12:09.4125824Z  2024-12-18T00:12:09.4126194Z  2024-12-18T00:12:09.4126583Z  2024-12-18T00:12:09.4126990Z  2024-12-18T00:12:09.4127551Z [14,710 / 15,187] 48 actions, 47 running 2024-12-18T00:12:09.4128262Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T00:12:09.4129240Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T00:12:09.4130288Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:12:09.4131276Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:12:09.4132196Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T00:12:09.4133033Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2024-12-18T00:12:09.4133963Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2024-12-18T00:12:09.4134832Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local ... 2024-12-18T00:12:09.6144099Z 2024-12-18T00:12:09.6145204Z  2024-12-18T00:12:09.6145661Z  2024-12-18T00:12:09.6146049Z  2024-12-18T00:12:09.6146409Z  2024-12-18T00:12:09.6146784Z  2024-12-18T00:12:09.6147203Z  2024-12-18T00:12:09.6147606Z  2024-12-18T00:12:09.6147998Z  2024-12-18T00:12:09.6148598Z [14,713 / 15,187] 48 actions, 47 running 2024-12-18T00:12:09.6149418Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T00:12:09.6150401Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T00:12:09.6151698Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:12:09.6152771Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:12:09.6153656Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T00:12:09.6154399Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2024-12-18T00:12:09.6155258Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2024-12-18T00:12:09.6156133Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local ... 2024-12-18T00:12:09.9685779Z 2024-12-18T00:12:09.9686639Z  2024-12-18T00:12:09.9687067Z  2024-12-18T00:12:09.9687464Z  2024-12-18T00:12:09.9687827Z  2024-12-18T00:12:09.9688177Z  2024-12-18T00:12:09.9688535Z  2024-12-18T00:12:09.9688890Z  2024-12-18T00:12:09.9689249Z  2024-12-18T00:12:09.9689735Z [14,713 / 15,187] 48 actions running 2024-12-18T00:12:09.9690497Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T00:12:09.9691654Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T00:12:09.9692552Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2024-12-18T00:12:09.9693571Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:12:09.9694430Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T00:12:09.9695157Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2024-12-18T00:12:09.9695941Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T00:12:09.9697175Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local ... 2024-12-18T00:12:10.2975672Z 2024-12-18T00:12:10.2976597Z  2024-12-18T00:12:10.2977007Z  2024-12-18T00:12:10.2977377Z  2024-12-18T00:12:10.2977747Z  2024-12-18T00:12:10.2978120Z  2024-12-18T00:12:10.2978465Z  2024-12-18T00:12:10.2978819Z  2024-12-18T00:12:10.2979204Z  2024-12-18T00:12:10.2979726Z [14,714 / 15,187] 48 actions, 47 running 2024-12-18T00:12:10.2980493Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T00:12:10.2981303Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T00:12:10.2982163Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2024-12-18T00:12:10.2983002Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:12:10.2983760Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T00:12:10.2984413Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2024-12-18T00:12:10.2985166Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T00:12:10.2985946Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local ... 2024-12-18T00:12:10.5692069Z 2024-12-18T00:12:10.5692921Z  2024-12-18T00:12:10.5693359Z  2024-12-18T00:12:10.5693731Z  2024-12-18T00:12:10.5694096Z  2024-12-18T00:12:10.5694475Z  2024-12-18T00:12:10.5694831Z  2024-12-18T00:12:10.5695197Z  2024-12-18T00:12:10.5695555Z  2024-12-18T00:12:10.5696055Z [14,715 / 15,187] 48 actions running 2024-12-18T00:12:10.5696903Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T00:12:10.5697791Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T00:12:10.5698636Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2024-12-18T00:12:10.5699517Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:12:10.5700259Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T00:12:10.5700954Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2024-12-18T00:12:10.5701738Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T00:12:10.5702610Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local ... 2024-12-18T00:12:10.8690970Z 2024-12-18T00:12:10.8691833Z  2024-12-18T00:12:10.8692502Z  2024-12-18T00:12:10.8692828Z  2024-12-18T00:12:10.8693146Z  2024-12-18T00:12:10.8693454Z  2024-12-18T00:12:10.8693762Z  2024-12-18T00:12:10.8694074Z  2024-12-18T00:12:10.8694384Z  2024-12-18T00:12:10.8694881Z [14,716 / 15,187] 48 actions, 47 running 2024-12-18T00:12:10.8695509Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T00:12:10.8696206Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T00:12:10.8697105Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:12:10.8697843Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:12:10.8698519Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T00:12:10.8699106Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:12:10.8699745Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T00:12:10.8700432Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local ... 2024-12-18T00:12:11.1523472Z 2024-12-18T00:12:11.1524293Z  2024-12-18T00:12:11.1525024Z  2024-12-18T00:12:11.1525391Z  2024-12-18T00:12:11.1525696Z  2024-12-18T00:12:11.1526058Z  2024-12-18T00:12:11.1526585Z  2024-12-18T00:12:11.1526957Z  2024-12-18T00:12:11.1527308Z  2024-12-18T00:12:11.1527875Z [14,717 / 15,187] 48 actions, 47 running 2024-12-18T00:12:11.1528677Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T00:12:11.1529604Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T00:12:11.1530882Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:12:11.1531775Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:12:11.1532675Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T00:12:11.1533472Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:12:11.1534318Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2024-12-18T00:12:11.1535220Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local ... 2024-12-18T00:12:11.3543380Z 2024-12-18T00:12:11.3544568Z  2024-12-18T00:12:11.3545013Z  2024-12-18T00:12:11.3545476Z  2024-12-18T00:12:11.3545811Z  2024-12-18T00:12:11.3546154Z  2024-12-18T00:12:11.3546525Z  2024-12-18T00:12:11.3546894Z  2024-12-18T00:12:11.3547284Z  2024-12-18T00:12:11.3547870Z [14,719 / 15,187] 48 actions, 47 running 2024-12-18T00:12:11.3548653Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T00:12:11.3549485Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T00:12:11.3550409Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:12:11.3551319Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:12:11.3552175Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T00:12:11.3552921Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:12:11.3553757Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2024-12-18T00:12:11.3554572Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local ... 2024-12-18T00:12:11.5700709Z 2024-12-18T00:12:11.5701544Z  2024-12-18T00:12:11.5701991Z  2024-12-18T00:12:11.5702407Z  2024-12-18T00:12:11.5702805Z  2024-12-18T00:12:11.5703204Z  2024-12-18T00:12:11.5703586Z  2024-12-18T00:12:11.5703979Z  2024-12-18T00:12:11.5704383Z  2024-12-18T00:12:11.5704979Z [14,719 / 15,187] 48 actions running 2024-12-18T00:12:11.5705801Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T00:12:11.5706773Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T00:12:11.5707751Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:12:11.5708978Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:12:11.5709920Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T00:12:11.5710698Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:12:11.5711545Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2024-12-18T00:12:11.5712481Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local ... 2024-12-18T00:12:11.9705482Z 2024-12-18T00:12:11.9706393Z  2024-12-18T00:12:11.9706858Z  2024-12-18T00:12:11.9707224Z  2024-12-18T00:12:11.9707566Z  2024-12-18T00:12:11.9707942Z  2024-12-18T00:12:11.9708329Z  2024-12-18T00:12:11.9708769Z  2024-12-18T00:12:11.9709151Z  2024-12-18T00:12:11.9709715Z [14,720 / 15,187] 47 actions running 2024-12-18T00:12:11.9710506Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T00:12:11.9711358Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T00:12:11.9712356Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:12:11.9713590Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:12:11.9714495Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T00:12:11.9715398Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:12:11.9716204Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2024-12-18T00:12:11.9717168Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local ... 2024-12-18T00:12:12.2503397Z 2024-12-18T00:12:12.2504296Z  2024-12-18T00:12:12.2504781Z  2024-12-18T00:12:12.2505398Z  2024-12-18T00:12:12.2505765Z  2024-12-18T00:12:12.2506121Z  2024-12-18T00:12:12.2506459Z  2024-12-18T00:12:12.2506813Z  2024-12-18T00:12:12.2507145Z  2024-12-18T00:12:12.2507805Z [14,721 / 15,187] 48 actions, 47 running 2024-12-18T00:12:12.2508576Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T00:12:12.2509522Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2024-12-18T00:12:12.2510461Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:12:12.2511453Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:12:12.2512287Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T00:12:12.2513044Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:12:12.2513866Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2024-12-18T00:12:12.2514770Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local ... 2024-12-18T00:12:12.5711526Z 2024-12-18T00:12:12.5712364Z  2024-12-18T00:12:12.5712833Z  2024-12-18T00:12:12.5713214Z  2024-12-18T00:12:12.5713597Z  2024-12-18T00:12:12.5713979Z  2024-12-18T00:12:12.5714293Z  2024-12-18T00:12:12.5714608Z  2024-12-18T00:12:12.5714948Z  2024-12-18T00:12:12.5715518Z [14,721 / 15,187] 48 actions running 2024-12-18T00:12:12.5716287Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T00:12:12.5717201Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2024-12-18T00:12:12.5718145Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:12:12.5719086Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:12:12.5719926Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T00:12:12.5720709Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:12:12.5721493Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2024-12-18T00:12:12.5722384Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local ... 2024-12-18T00:12:12.8154960Z 2024-12-18T00:12:12.8155902Z  2024-12-18T00:12:12.8156336Z  2024-12-18T00:12:12.8156710Z  2024-12-18T00:12:12.8157077Z  2024-12-18T00:12:12.8157748Z  2024-12-18T00:12:12.8158126Z  2024-12-18T00:12:12.8158486Z  2024-12-18T00:12:12.8158847Z  2024-12-18T00:12:12.8159434Z [14,722 / 15,187] 48 actions, 47 running 2024-12-18T00:12:12.8160207Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T00:12:12.8161077Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2024-12-18T00:12:12.8161951Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:12:12.8162877Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:12:12.8163655Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T00:12:12.8164372Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:12:12.8165183Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2024-12-18T00:12:12.8166058Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local ... 2024-12-18T00:12:13.0282765Z 2024-12-18T00:12:13.0283677Z  2024-12-18T00:12:13.0284242Z  2024-12-18T00:12:13.0284638Z  2024-12-18T00:12:13.0285000Z  2024-12-18T00:12:13.0285389Z  2024-12-18T00:12:13.0286063Z  2024-12-18T00:12:13.0286482Z  2024-12-18T00:12:13.0286899Z  2024-12-18T00:12:13.0287613Z [14,723 / 15,187] 48 actions, 47 running 2024-12-18T00:12:13.0288386Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T00:12:13.0289367Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:12:13.0290291Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:12:13.0291332Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T00:12:13.0292302Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:12:13.0293171Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2024-12-18T00:12:13.0294144Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2024-12-18T00:12:13.0294922Z Compiling xla/service/cpu/ir_emitter.cc; 32s local ... 2024-12-18T00:12:13.2341571Z 2024-12-18T00:12:13.2342438Z  2024-12-18T00:12:13.2342895Z  2024-12-18T00:12:13.2343253Z  2024-12-18T00:12:13.2343644Z  2024-12-18T00:12:13.2344136Z  2024-12-18T00:12:13.2344881Z  2024-12-18T00:12:13.2345397Z  2024-12-18T00:12:13.2345767Z  2024-12-18T00:12:13.2346384Z [14,724 / 15,187] 48 actions, 47 running 2024-12-18T00:12:13.2347156Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T00:12:13.2348004Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:12:13.2348955Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:12:13.2349708Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T00:12:13.2350358Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:12:13.2351099Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2024-12-18T00:12:13.2351973Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2024-12-18T00:12:13.2352783Z Compiling xla/service/cpu/ir_emitter.cc; 32s local ... 2024-12-18T00:12:13.5719480Z 2024-12-18T00:12:13.5720414Z  2024-12-18T00:12:13.5720987Z  2024-12-18T00:12:13.5721439Z  2024-12-18T00:12:13.5721803Z  2024-12-18T00:12:13.5722162Z  2024-12-18T00:12:13.5722512Z  2024-12-18T00:12:13.5722929Z  2024-12-18T00:12:13.5723346Z  2024-12-18T00:12:13.5723906Z [14,724 / 15,187] 48 actions running 2024-12-18T00:12:13.5724678Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T00:12:13.5725634Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:12:13.5726645Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:12:13.5727698Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2024-12-18T00:12:13.5728463Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:12:13.5729521Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2024-12-18T00:12:13.5730204Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T00:12:13.5730916Z Compiling xla/service/cpu/ir_emitter.cc; 32s local ... 2024-12-18T00:12:14.3848897Z 2024-12-18T00:12:14.3849778Z  2024-12-18T00:12:14.3850323Z  2024-12-18T00:12:14.3850882Z  2024-12-18T00:12:14.3851307Z  2024-12-18T00:12:14.3851704Z  2024-12-18T00:12:14.3852083Z  2024-12-18T00:12:14.3852485Z  2024-12-18T00:12:14.3852896Z  2024-12-18T00:12:14.3853506Z [14,725 / 15,187] 48 actions, 47 running 2024-12-18T00:12:14.3854448Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T00:12:14.3855406Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2024-12-18T00:12:14.3856648Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:12:14.3857597Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T00:12:14.3858404Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2024-12-18T00:12:14.3859557Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T00:12:14.3860632Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T00:12:14.3861668Z Compiling xla/service/cpu/ir_emitter.cc; 33s local ... 2024-12-18T00:12:14.7729348Z 2024-12-18T00:12:14.7730159Z  2024-12-18T00:12:14.7730617Z  2024-12-18T00:12:14.7731076Z  2024-12-18T00:12:14.7731511Z  2024-12-18T00:12:14.7731887Z  2024-12-18T00:12:14.7732231Z  2024-12-18T00:12:14.7732578Z  2024-12-18T00:12:14.7733205Z  2024-12-18T00:12:14.7733756Z [14,726 / 15,187] 48 actions running 2024-12-18T00:12:14.7734601Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T00:12:14.7735587Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:12:14.7736670Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:12:14.7737581Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T00:12:14.7738353Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2024-12-18T00:12:14.7739363Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T00:12:14.7740189Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T00:12:14.7740912Z Compiling xla/service/cpu/ir_emitter.cc; 33s local ... 2024-12-18T00:12:14.9732886Z 2024-12-18T00:12:14.9733772Z  2024-12-18T00:12:14.9734254Z  2024-12-18T00:12:14.9734649Z  2024-12-18T00:12:14.9735037Z  2024-12-18T00:12:14.9735441Z  2024-12-18T00:12:14.9735811Z  2024-12-18T00:12:14.9736193Z  2024-12-18T00:12:14.9736717Z  2024-12-18T00:12:14.9737309Z [14,727 / 15,187] 48 actions running 2024-12-18T00:12:14.9738106Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T00:12:14.9739078Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:12:14.9740082Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:12:14.9740969Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T00:12:14.9741750Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2024-12-18T00:12:14.9742528Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T00:12:14.9743274Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T00:12:14.9744459Z Compiling xla/service/cpu/ir_emitter.cc; 34s local ... 2024-12-18T00:12:15.3738117Z 2024-12-18T00:12:15.3738958Z  2024-12-18T00:12:15.3739453Z  2024-12-18T00:12:15.3739829Z  2024-12-18T00:12:15.3740205Z  2024-12-18T00:12:15.3740579Z  2024-12-18T00:12:15.3741071Z  2024-12-18T00:12:15.3741524Z  2024-12-18T00:12:15.3741976Z  2024-12-18T00:12:15.3742600Z [14,729 / 15,187] 48 actions running 2024-12-18T00:12:15.3743856Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T00:12:15.3745157Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:12:15.3746241Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:12:15.3747192Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T00:12:15.3748028Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T00:12:15.3748977Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T00:12:15.3749806Z Compiling xla/service/cpu/ir_emitter2.cc; 28s local 2024-12-18T00:12:15.3750700Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local ... 2024-12-18T00:12:15.6692171Z 2024-12-18T00:12:15.6693090Z  2024-12-18T00:12:15.6693597Z  2024-12-18T00:12:15.6694023Z  2024-12-18T00:12:15.6694395Z  2024-12-18T00:12:15.6694770Z  2024-12-18T00:12:15.6695110Z  2024-12-18T00:12:15.6695564Z  2024-12-18T00:12:15.6696012Z  2024-12-18T00:12:15.6696826Z [14,731 / 15,187] 48 actions, 47 running 2024-12-18T00:12:15.6697875Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T00:12:15.6698815Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:12:15.6699993Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:12:15.6701050Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T00:12:15.6701988Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T00:12:15.6702923Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T00:12:15.6704005Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T00:12:15.6704954Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local ... 2024-12-18T00:12:15.9744642Z 2024-12-18T00:12:15.9745535Z  2024-12-18T00:12:15.9746007Z  2024-12-18T00:12:15.9746451Z  2024-12-18T00:12:15.9746955Z  2024-12-18T00:12:15.9747354Z  2024-12-18T00:12:15.9747766Z  2024-12-18T00:12:15.9748213Z  2024-12-18T00:12:15.9748602Z  2024-12-18T00:12:15.9749164Z [14,732 / 15,187] 47 actions running 2024-12-18T00:12:15.9750059Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T00:12:15.9751046Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:12:15.9752097Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:12:15.9752983Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T00:12:15.9753900Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T00:12:15.9754851Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T00:12:15.9755777Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T00:12:15.9756736Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local ... 2024-12-18T00:12:16.3749431Z 2024-12-18T00:12:16.3750311Z  2024-12-18T00:12:16.3750798Z  2024-12-18T00:12:16.3751200Z  2024-12-18T00:12:16.3751627Z  2024-12-18T00:12:16.3752001Z  2024-12-18T00:12:16.3752528Z  2024-12-18T00:12:16.3752912Z  2024-12-18T00:12:16.3753320Z  2024-12-18T00:12:16.3753904Z [14,732 / 15,187] 48 actions running 2024-12-18T00:12:16.3754782Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T00:12:16.3755739Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:12:16.3756711Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:12:16.3757628Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T00:12:16.3758583Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T00:12:16.3759538Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T00:12:16.3760465Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T00:12:16.3761618Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local ... 2024-12-18T00:12:16.6826860Z 2024-12-18T00:12:16.6827822Z  2024-12-18T00:12:16.6828310Z  2024-12-18T00:12:16.6828703Z  2024-12-18T00:12:16.6829068Z  2024-12-18T00:12:16.6829425Z  2024-12-18T00:12:16.6829773Z  2024-12-18T00:12:16.6830121Z  2024-12-18T00:12:16.6830508Z  2024-12-18T00:12:16.6831050Z [14,733 / 15,187] 48 actions, 47 running 2024-12-18T00:12:16.6831689Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T00:12:16.6832464Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:12:16.6833375Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:12:16.6834215Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T00:12:16.6835030Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T00:12:16.6835837Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T00:12:16.6836745Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T00:12:16.6837786Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local ... 2024-12-18T00:12:16.9755222Z 2024-12-18T00:12:16.9756368Z  2024-12-18T00:12:16.9756842Z  2024-12-18T00:12:16.9757232Z  2024-12-18T00:12:16.9757756Z  2024-12-18T00:12:16.9758171Z  2024-12-18T00:12:16.9758531Z  2024-12-18T00:12:16.9758919Z  2024-12-18T00:12:16.9759300Z  2024-12-18T00:12:16.9759789Z [14,733 / 15,187] 48 actions running 2024-12-18T00:12:16.9760804Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T00:12:16.9761783Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2024-12-18T00:12:16.9762792Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:12:16.9763609Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T00:12:16.9764437Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T00:12:16.9765327Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T00:12:16.9766256Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T00:12:16.9767117Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local ... 2024-12-18T00:12:17.3759871Z 2024-12-18T00:12:17.3760828Z  2024-12-18T00:12:17.3761368Z  2024-12-18T00:12:17.3761746Z  2024-12-18T00:12:17.3762115Z  2024-12-18T00:12:17.3762483Z  2024-12-18T00:12:17.3762862Z  2024-12-18T00:12:17.3763277Z  2024-12-18T00:12:17.3763675Z  2024-12-18T00:12:17.3764307Z [14,734 / 15,187] 48 actions running 2024-12-18T00:12:17.3765119Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T00:12:17.3766047Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2024-12-18T00:12:17.3767063Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:12:17.3767937Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T00:12:17.3768848Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T00:12:17.3769773Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2024-12-18T00:12:17.3770680Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T00:12:17.3771502Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local ... 2024-12-18T00:12:17.5763456Z 2024-12-18T00:12:17.5764312Z  2024-12-18T00:12:17.5764762Z  2024-12-18T00:12:17.5765141Z  2024-12-18T00:12:17.5765518Z  2024-12-18T00:12:17.5765871Z  2024-12-18T00:12:17.5766261Z  2024-12-18T00:12:17.5766608Z  2024-12-18T00:12:17.5766962Z  2024-12-18T00:12:17.5767508Z [14,735 / 15,187] 48 actions running 2024-12-18T00:12:17.5768285Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T00:12:17.5769171Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2024-12-18T00:12:17.5770476Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2024-12-18T00:12:17.5771466Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T00:12:17.5772322Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T00:12:17.5773161Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2024-12-18T00:12:17.5774062Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2024-12-18T00:12:17.5774933Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local ... 2024-12-18T00:12:18.7772825Z 2024-12-18T00:12:18.7773635Z  2024-12-18T00:12:18.7774079Z  2024-12-18T00:12:18.7774444Z  2024-12-18T00:12:18.7774808Z  2024-12-18T00:12:18.7775173Z  2024-12-18T00:12:18.7775512Z  2024-12-18T00:12:18.7775825Z  2024-12-18T00:12:18.7776170Z  2024-12-18T00:12:18.7776822Z [14,735 / 15,187] 48 actions running 2024-12-18T00:12:18.7777531Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T00:12:18.7778671Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2024-12-18T00:12:18.7779547Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:12:18.7780689Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T00:12:18.7781438Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T00:12:18.7783832Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T00:12:18.7784638Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2024-12-18T00:12:18.7787413Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local ... 2024-12-18T00:12:19.1777665Z 2024-12-18T00:12:19.1778493Z  2024-12-18T00:12:19.1778915Z  2024-12-18T00:12:19.1779269Z  2024-12-18T00:12:19.1779607Z  2024-12-18T00:12:19.1779920Z  2024-12-18T00:12:19.1780253Z  2024-12-18T00:12:19.1780575Z  2024-12-18T00:12:19.1780938Z  2024-12-18T00:12:19.1781416Z [14,736 / 15,187] 48 actions running 2024-12-18T00:12:19.1782097Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T00:12:19.1782849Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2024-12-18T00:12:19.1783646Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:12:19.1784388Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T00:12:19.1785093Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2024-12-18T00:12:19.1785802Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T00:12:19.1786568Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2024-12-18T00:12:19.1787300Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local ... 2024-12-18T00:12:19.9974922Z 2024-12-18T00:12:19.9975787Z  2024-12-18T00:12:19.9976272Z  2024-12-18T00:12:19.9976810Z  2024-12-18T00:12:19.9977208Z  2024-12-18T00:12:19.9977561Z  2024-12-18T00:12:19.9977900Z  2024-12-18T00:12:19.9978259Z  2024-12-18T00:12:19.9978640Z  2024-12-18T00:12:19.9979220Z [14,737 / 15,187] 48 actions, 47 running 2024-12-18T00:12:19.9980024Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2024-12-18T00:12:19.9980939Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2024-12-18T00:12:19.9981864Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2024-12-18T00:12:19.9982730Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T00:12:19.9983567Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2024-12-18T00:12:19.9984427Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T00:12:19.9985308Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2024-12-18T00:12:19.9986204Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local ... 2024-12-18T00:12:20.3787084Z 2024-12-18T00:12:20.3788273Z  2024-12-18T00:12:20.3788729Z  2024-12-18T00:12:20.3789137Z  2024-12-18T00:12:20.3789620Z  2024-12-18T00:12:20.3790063Z  2024-12-18T00:12:20.3790420Z  2024-12-18T00:12:20.3790788Z  2024-12-18T00:12:20.3791205Z  2024-12-18T00:12:20.3791730Z [14,738 / 15,187] 48 actions running 2024-12-18T00:12:20.3792619Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2024-12-18T00:12:20.3793579Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2024-12-18T00:12:20.3794509Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2024-12-18T00:12:20.3795497Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T00:12:20.3796352Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2024-12-18T00:12:20.3797265Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T00:12:20.3798187Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2024-12-18T00:12:20.3798934Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local ... 2024-12-18T00:12:20.7792420Z 2024-12-18T00:12:20.7793547Z  2024-12-18T00:12:20.7794041Z  2024-12-18T00:12:20.7794410Z  2024-12-18T00:12:20.7794760Z  2024-12-18T00:12:20.7795264Z  2024-12-18T00:12:20.7795589Z  2024-12-18T00:12:20.7795899Z  2024-12-18T00:12:20.7796210Z  2024-12-18T00:12:20.7796767Z [14,739 / 15,187] 48 actions running 2024-12-18T00:12:20.7797612Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2024-12-18T00:12:20.7798576Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:12:20.7799618Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2024-12-18T00:12:20.7800469Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2024-12-18T00:12:20.7801372Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T00:12:20.7802265Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T00:12:20.7803080Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2024-12-18T00:12:20.7803894Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local ... 2024-12-18T00:12:21.0858505Z 2024-12-18T00:12:21.0859360Z  2024-12-18T00:12:21.0859831Z  2024-12-18T00:12:21.0860235Z  2024-12-18T00:12:21.0860633Z  2024-12-18T00:12:21.0861042Z  2024-12-18T00:12:21.0861450Z  2024-12-18T00:12:21.0861857Z  2024-12-18T00:12:21.0862251Z  2024-12-18T00:12:21.0862872Z [14,742 / 15,187] 48 actions, 47 running 2024-12-18T00:12:21.0863818Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:12:21.0864882Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T00:12:21.0875478Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T00:12:21.0876546Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T00:12:21.0877511Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T00:12:21.0878492Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2024-12-18T00:12:21.0879387Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2024-12-18T00:12:21.0880277Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local ... 2024-12-18T00:12:21.3796485Z 2024-12-18T00:12:21.3797293Z  2024-12-18T00:12:21.3797743Z  2024-12-18T00:12:21.3798140Z  2024-12-18T00:12:21.3798521Z  2024-12-18T00:12:21.3798916Z  2024-12-18T00:12:21.3799298Z  2024-12-18T00:12:21.3799672Z  2024-12-18T00:12:21.3800058Z  2024-12-18T00:12:21.3800635Z [14,745 / 15,187] 48 actions running 2024-12-18T00:12:21.3801500Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:12:21.3802437Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T00:12:21.3803321Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2024-12-18T00:12:21.3804452Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T00:12:21.3805440Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T00:12:21.3806357Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2024-12-18T00:12:21.3807250Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2024-12-18T00:12:21.3808140Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 21s local ... 2024-12-18T00:12:22.3681141Z 2024-12-18T00:12:22.3681961Z  2024-12-18T00:12:22.3682410Z  2024-12-18T00:12:22.3682796Z  2024-12-18T00:12:22.3683195Z  2024-12-18T00:12:22.3683636Z  2024-12-18T00:12:22.3684038Z  2024-12-18T00:12:22.3684422Z  2024-12-18T00:12:22.3684810Z  2024-12-18T00:12:22.3685395Z [14,746 / 15,187] 48 actions, 47 running 2024-12-18T00:12:22.3686288Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:12:22.3687217Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T00:12:22.3688382Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T00:12:22.3689270Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T00:12:22.3690351Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T00:12:22.3691275Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2024-12-18T00:12:22.3692174Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2024-12-18T00:12:22.3693071Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local ... 2024-12-18T00:12:22.5806147Z 2024-12-18T00:12:22.5807277Z  2024-12-18T00:12:22.5807743Z  2024-12-18T00:12:22.5808153Z  2024-12-18T00:12:22.5808556Z  2024-12-18T00:12:22.5808956Z  2024-12-18T00:12:22.5809358Z  2024-12-18T00:12:22.5809740Z  2024-12-18T00:12:22.5810146Z  2024-12-18T00:12:22.5810731Z [14,747 / 15,187] 48 actions running 2024-12-18T00:12:22.5811650Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:12:22.5812652Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T00:12:22.5813556Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T00:12:22.5814468Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T00:12:22.5815422Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T00:12:22.5816380Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2024-12-18T00:12:22.5817593Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2024-12-18T00:12:22.5818485Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local ... 2024-12-18T00:12:22.9337588Z 2024-12-18T00:12:22.9338501Z  2024-12-18T00:12:22.9338973Z  2024-12-18T00:12:22.9339366Z  2024-12-18T00:12:22.9339743Z  2024-12-18T00:12:22.9340155Z  2024-12-18T00:12:22.9340549Z  2024-12-18T00:12:22.9340926Z  2024-12-18T00:12:22.9341294Z  2024-12-18T00:12:22.9341886Z [14,749 / 15,187] 48 actions, 47 running 2024-12-18T00:12:22.9342848Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:12:22.9343869Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T00:12:22.9344963Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T00:12:22.9345805Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T00:12:22.9346677Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T00:12:22.9347644Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T00:12:22.9348529Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2024-12-18T00:12:22.9349476Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local ... 2024-12-18T00:12:23.1811341Z 2024-12-18T00:12:23.1813393Z  2024-12-18T00:12:23.1813873Z  2024-12-18T00:12:23.1814254Z  2024-12-18T00:12:23.1814645Z  2024-12-18T00:12:23.1815085Z  2024-12-18T00:12:23.1815476Z  2024-12-18T00:12:23.1815880Z  2024-12-18T00:12:23.1816292Z  2024-12-18T00:12:23.1817037Z [14,749 / 15,187] 48 actions running 2024-12-18T00:12:23.1817960Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:12:23.1818965Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T00:12:23.1819937Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T00:12:23.1820920Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T00:12:23.1821946Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T00:12:23.1822936Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T00:12:23.1823843Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2024-12-18T00:12:23.1824837Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local ... 2024-12-18T00:12:23.4423904Z 2024-12-18T00:12:23.4424927Z  2024-12-18T00:12:23.4425347Z  2024-12-18T00:12:23.4425688Z  2024-12-18T00:12:23.4426012Z  2024-12-18T00:12:23.4426429Z  2024-12-18T00:12:23.4426754Z  2024-12-18T00:12:23.4427079Z  2024-12-18T00:12:23.4427410Z  2024-12-18T00:12:23.4427932Z [14,751 / 15,187] 48 actions, 47 running 2024-12-18T00:12:23.4428662Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:12:23.4429484Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T00:12:23.4430369Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T00:12:23.4431135Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T00:12:23.4431926Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T00:12:23.4432694Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T00:12:23.4433599Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2024-12-18T00:12:23.4434507Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2024-12-18T00:12:23.7817730Z 2024-12-18T00:12:23.7818656Z  2024-12-18T00:12:23.7819142Z  2024-12-18T00:12:23.7819553Z  2024-12-18T00:12:23.7819971Z  2024-12-18T00:12:23.7820377Z  2024-12-18T00:12:23.7820751Z  2024-12-18T00:12:23.7821117Z  2024-12-18T00:12:23.7821513Z  2024-12-18T00:12:23.7822088Z [14,751 / 15,187] 48 actions running 2024-12-18T00:12:23.7823143Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:12:23.7824158Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T00:12:23.7825078Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T00:12:23.7825989Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T00:12:23.7827011Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T00:12:23.7828036Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T00:12:23.7828987Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2024-12-18T00:12:23.7829965Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2024-12-18T00:12:23.9821375Z 2024-12-18T00:12:23.9822256Z  2024-12-18T00:12:23.9822777Z  2024-12-18T00:12:23.9823165Z  2024-12-18T00:12:23.9823559Z  2024-12-18T00:12:23.9823950Z  2024-12-18T00:12:23.9824361Z  2024-12-18T00:12:23.9824754Z  2024-12-18T00:12:23.9825182Z  2024-12-18T00:12:23.9825769Z [14,752 / 15,187] 48 actions running 2024-12-18T00:12:23.9826675Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:12:23.9827814Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T00:12:23.9828992Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T00:12:23.9829932Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T00:12:23.9830918Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T00:12:23.9831926Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T00:12:23.9832819Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2024-12-18T00:12:23.9833809Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2024-12-18T00:12:24.1910958Z 2024-12-18T00:12:24.1911887Z  2024-12-18T00:12:24.1912397Z  2024-12-18T00:12:24.1912820Z  2024-12-18T00:12:24.1913218Z  2024-12-18T00:12:24.1913591Z  2024-12-18T00:12:24.1913948Z  2024-12-18T00:12:24.1914324Z  2024-12-18T00:12:24.1914692Z  2024-12-18T00:12:24.1915279Z [14,754 / 15,187] 48 actions, 47 running 2024-12-18T00:12:24.1916166Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:12:24.1917144Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T00:12:24.1918337Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T00:12:24.1919245Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T00:12:24.1920352Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T00:12:24.1921465Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T00:12:24.1922350Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T00:12:24.1923231Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2024-12-18T00:12:24.5829260Z 2024-12-18T00:12:24.5830143Z  2024-12-18T00:12:24.5830621Z  2024-12-18T00:12:24.5831028Z  2024-12-18T00:12:24.5831400Z  2024-12-18T00:12:24.5831797Z  2024-12-18T00:12:24.5832223Z  2024-12-18T00:12:24.5832621Z  2024-12-18T00:12:24.5832952Z  2024-12-18T00:12:24.5833539Z [14,755 / 15,187] 48 actions running 2024-12-18T00:12:24.5834375Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:12:24.5835386Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T00:12:24.5836290Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T00:12:24.5837218Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T00:12:24.5838206Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T00:12:24.5839142Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T00:12:24.5840166Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T00:12:24.5841066Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local ... 2024-12-18T00:12:24.7830568Z 2024-12-18T00:12:24.7831525Z  2024-12-18T00:12:24.7831973Z  2024-12-18T00:12:24.7832392Z  2024-12-18T00:12:24.7832762Z  2024-12-18T00:12:24.7833173Z  2024-12-18T00:12:24.7833566Z  2024-12-18T00:12:24.7833949Z  2024-12-18T00:12:24.7834706Z  2024-12-18T00:12:24.7835438Z [14,757 / 15,187] 47 actions running 2024-12-18T00:12:24.7836476Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:12:24.7837626Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T00:12:24.7838661Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T00:12:24.7839746Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T00:12:24.7840887Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T00:12:24.7842031Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T00:12:24.7843072Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T00:12:24.7844130Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local ... 2024-12-18T00:12:25.1836481Z 2024-12-18T00:12:25.1837826Z  2024-12-18T00:12:25.1838272Z  2024-12-18T00:12:25.1838644Z  2024-12-18T00:12:25.1839051Z  2024-12-18T00:12:25.1839476Z  2024-12-18T00:12:25.1839862Z  2024-12-18T00:12:25.1840243Z  2024-12-18T00:12:25.1840623Z  2024-12-18T00:12:25.1841166Z [14,757 / 15,187] 48 actions running 2024-12-18T00:12:25.1842030Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:12:25.1843038Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T00:12:25.1843896Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T00:12:25.1845017Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T00:12:25.1845954Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T00:12:25.1846868Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T00:12:25.1847757Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T00:12:25.1848690Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local ... 2024-12-18T00:12:25.4490922Z 2024-12-18T00:12:25.4493926Z  2024-12-18T00:12:25.4494664Z  2024-12-18T00:12:25.4495054Z  2024-12-18T00:12:25.4495622Z  2024-12-18T00:12:25.4495983Z  2024-12-18T00:12:25.4496342Z  2024-12-18T00:12:25.4496869Z  2024-12-18T00:12:25.4497275Z  2024-12-18T00:12:25.4497855Z [14,758 / 15,187] 48 actions, 47 running 2024-12-18T00:12:25.4498725Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:12:25.4499837Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T00:12:25.4500741Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T00:12:25.4501585Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T00:12:25.4502453Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T00:12:25.4503345Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T00:12:25.4504236Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T00:12:25.4505141Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2024-12-18T00:12:25.7841826Z 2024-12-18T00:12:25.7842736Z  2024-12-18T00:12:25.7843191Z  2024-12-18T00:12:25.7843585Z  2024-12-18T00:12:25.7843964Z  2024-12-18T00:12:25.7844577Z  2024-12-18T00:12:25.7844919Z  2024-12-18T00:12:25.7845350Z  2024-12-18T00:12:25.7845757Z  2024-12-18T00:12:25.7846309Z [14,759 / 15,187] 48 actions running 2024-12-18T00:12:25.7847217Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:12:25.7848222Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T00:12:25.7849087Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T00:12:25.7850003Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T00:12:25.7850920Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2024-12-18T00:12:25.7851877Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T00:12:25.7852666Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T00:12:25.7853604Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2024-12-18T00:12:25.9866230Z 2024-12-18T00:12:25.9867213Z  2024-12-18T00:12:25.9867699Z  2024-12-18T00:12:25.9868044Z  2024-12-18T00:12:25.9868390Z  2024-12-18T00:12:25.9868727Z  2024-12-18T00:12:25.9869061Z  2024-12-18T00:12:25.9869393Z  2024-12-18T00:12:25.9869761Z  2024-12-18T00:12:25.9870260Z [14,760 / 15,187] 48 actions, 47 running 2024-12-18T00:12:25.9870951Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:12:25.9871728Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T00:12:25.9872678Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T00:12:25.9873397Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T00:12:25.9874139Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2024-12-18T00:12:25.9874885Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T00:12:25.9875576Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T00:12:25.9876295Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2024-12-18T00:12:26.3848195Z 2024-12-18T00:12:26.3849518Z  2024-12-18T00:12:26.3849975Z  2024-12-18T00:12:26.3850336Z  2024-12-18T00:12:26.3850749Z  2024-12-18T00:12:26.3851139Z  2024-12-18T00:12:26.3851516Z  2024-12-18T00:12:26.3851901Z  2024-12-18T00:12:26.3852303Z  2024-12-18T00:12:26.3852896Z [14,761 / 15,187] 48 actions running 2024-12-18T00:12:26.3853796Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:12:26.3854837Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T00:12:26.3856033Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2024-12-18T00:12:26.3857170Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T00:12:26.3858261Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2024-12-18T00:12:26.3859201Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T00:12:26.3860108Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2024-12-18T00:12:26.3861010Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local ... 2024-12-18T00:12:27.3856682Z 2024-12-18T00:12:27.3857663Z  2024-12-18T00:12:27.3858139Z  2024-12-18T00:12:27.3858545Z  2024-12-18T00:12:27.3858943Z  2024-12-18T00:12:27.3859347Z  2024-12-18T00:12:27.3859741Z  2024-12-18T00:12:27.3860133Z  2024-12-18T00:12:27.3860546Z  2024-12-18T00:12:27.3861130Z [14,761 / 15,187] 48 actions running 2024-12-18T00:12:27.3862047Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:12:27.3862979Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2024-12-18T00:12:27.3863853Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T00:12:27.3864774Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2024-12-18T00:12:27.3865696Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2024-12-18T00:12:27.3866613Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2024-12-18T00:12:27.3867491Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T00:12:27.3868440Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2024-12-18T00:12:28.0863939Z 2024-12-18T00:12:28.0864971Z  2024-12-18T00:12:28.0865473Z  2024-12-18T00:12:28.0865841Z  2024-12-18T00:12:28.0866200Z  2024-12-18T00:12:28.0866587Z  2024-12-18T00:12:28.0866914Z  2024-12-18T00:12:28.0867273Z  2024-12-18T00:12:28.0867663Z  2024-12-18T00:12:28.0868276Z [14,762 / 15,187] 48 actions, 47 running 2024-12-18T00:12:28.0869175Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:12:28.0870158Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2024-12-18T00:12:28.0871103Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T00:12:28.0872045Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T00:12:28.0873060Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T00:12:28.0874046Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2024-12-18T00:12:28.0874895Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T00:12:28.0875748Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2024-12-18T00:12:28.3864617Z 2024-12-18T00:12:28.3865507Z  2024-12-18T00:12:28.3866024Z  2024-12-18T00:12:28.3866375Z  2024-12-18T00:12:28.3866757Z  2024-12-18T00:12:28.3867127Z  2024-12-18T00:12:28.3867584Z  2024-12-18T00:12:28.3867956Z  2024-12-18T00:12:28.3868353Z  2024-12-18T00:12:28.3868902Z [14,762 / 15,187] 48 actions running 2024-12-18T00:12:28.3869814Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:12:28.3870800Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2024-12-18T00:12:28.3871737Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T00:12:28.3872648Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T00:12:28.3873574Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T00:12:28.3874552Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2024-12-18T00:12:28.3875497Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T00:12:28.3876424Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2024-12-18T00:12:28.9197812Z 2024-12-18T00:12:28.9198952Z  2024-12-18T00:12:28.9199465Z  2024-12-18T00:12:28.9199865Z  2024-12-18T00:12:28.9200432Z  2024-12-18T00:12:28.9200803Z  2024-12-18T00:12:28.9201158Z  2024-12-18T00:12:28.9201528Z  2024-12-18T00:12:28.9201905Z  2024-12-18T00:12:28.9202479Z [14,763 / 15,187] 48 actions, 47 running 2024-12-18T00:12:28.9203307Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:12:28.9204446Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T00:12:28.9205325Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T00:12:28.9206147Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T00:12:28.9207185Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T00:12:28.9208094Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T00:12:28.9209008Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T00:12:28.9209922Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2024-12-18T00:12:29.1870637Z 2024-12-18T00:12:29.1871520Z  2024-12-18T00:12:29.1871982Z  2024-12-18T00:12:29.1872361Z  2024-12-18T00:12:29.1872704Z  2024-12-18T00:12:29.1873059Z  2024-12-18T00:12:29.1873422Z  2024-12-18T00:12:29.1873782Z  2024-12-18T00:12:29.1874155Z  2024-12-18T00:12:29.1874687Z [14,764 / 15,187] 48 actions running 2024-12-18T00:12:29.1875575Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:12:29.1876490Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T00:12:29.1877316Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T00:12:29.1878146Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T00:12:29.1879064Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T00:12:29.1879943Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T00:12:29.1880803Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T00:12:29.1881718Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2024-12-18T00:12:29.4260434Z 2024-12-18T00:12:29.4261343Z  2024-12-18T00:12:29.4261811Z  2024-12-18T00:12:29.4262219Z  2024-12-18T00:12:29.4262625Z  2024-12-18T00:12:29.4263032Z  2024-12-18T00:12:29.4263438Z  2024-12-18T00:12:29.4263857Z  2024-12-18T00:12:29.4264221Z  2024-12-18T00:12:29.4264816Z [14,766 / 15,187] 48 actions, 47 running 2024-12-18T00:12:29.4265713Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:12:29.4266708Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T00:12:29.4267926Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T00:12:29.4268878Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T00:12:29.4269870Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T00:12:29.4270823Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T00:12:29.4271767Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T00:12:29.4272728Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local ... 2024-12-18T00:12:29.7876670Z 2024-12-18T00:12:29.7877577Z  2024-12-18T00:12:29.7878169Z  2024-12-18T00:12:29.7878566Z  2024-12-18T00:12:29.7878958Z  2024-12-18T00:12:29.7879361Z  2024-12-18T00:12:29.7879740Z  2024-12-18T00:12:29.7880097Z  2024-12-18T00:12:29.7880471Z  2024-12-18T00:12:29.7881042Z [14,767 / 15,187] 48 actions running 2024-12-18T00:12:29.7881918Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:12:29.7882921Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T00:12:29.7884076Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T00:12:29.7885069Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T00:12:29.7886191Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T00:12:29.7887139Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T00:12:29.7888088Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T00:12:29.7889186Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local ... 2024-12-18T00:12:29.9880084Z 2024-12-18T00:12:29.9881519Z  2024-12-18T00:12:29.9882050Z  2024-12-18T00:12:29.9882517Z  2024-12-18T00:12:29.9882975Z  2024-12-18T00:12:29.9883414Z  2024-12-18T00:12:29.9883762Z  2024-12-18T00:12:29.9884096Z  2024-12-18T00:12:29.9884469Z  2024-12-18T00:12:29.9884980Z [14,768 / 15,187] 48 actions running 2024-12-18T00:12:29.9885773Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:12:29.9886678Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T00:12:29.9887469Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T00:12:29.9888272Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T00:12:29.9889152Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T00:12:29.9889989Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T00:12:29.9890801Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T00:12:29.9891634Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local ... 2024-12-18T00:12:30.3462713Z 2024-12-18T00:12:30.3463696Z  2024-12-18T00:12:30.3464277Z  2024-12-18T00:12:30.3464654Z  2024-12-18T00:12:30.3465027Z  2024-12-18T00:12:30.3465387Z  2024-12-18T00:12:30.3465739Z  2024-12-18T00:12:30.3466083Z  2024-12-18T00:12:30.3466453Z  2024-12-18T00:12:30.3466980Z [14,770 / 15,187] 48 actions, 47 running 2024-12-18T00:12:30.3467768Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:12:30.3468668Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T00:12:30.3469476Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:12:30.3470211Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T00:12:30.3471004Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T00:12:30.3471797Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T00:12:30.3472561Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T00:12:30.3473388Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local ... 2024-12-18T00:12:30.5886304Z 2024-12-18T00:12:30.5887237Z  2024-12-18T00:12:30.5887779Z  2024-12-18T00:12:30.5888249Z  2024-12-18T00:12:30.5888690Z  2024-12-18T00:12:30.5889046Z  2024-12-18T00:12:30.5889385Z  2024-12-18T00:12:30.5889702Z  2024-12-18T00:12:30.5890053Z  2024-12-18T00:12:30.5890547Z [14,770 / 15,187] 48 actions running 2024-12-18T00:12:30.5891328Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:12:30.5892209Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T00:12:30.5893027Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:12:30.5893840Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T00:12:30.5894729Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T00:12:30.5895640Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T00:12:30.5896434Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T00:12:30.5897409Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local ... 2024-12-18T00:12:30.9625536Z 2024-12-18T00:12:30.9626523Z  2024-12-18T00:12:30.9626973Z  2024-12-18T00:12:30.9627381Z  2024-12-18T00:12:30.9627950Z  2024-12-18T00:12:30.9628334Z  2024-12-18T00:12:30.9628747Z  2024-12-18T00:12:30.9629108Z  2024-12-18T00:12:30.9629511Z  2024-12-18T00:12:30.9630138Z [14,771 / 15,187] 48 actions, 47 running 2024-12-18T00:12:30.9630952Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:12:30.9632138Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T00:12:30.9633027Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:12:30.9633778Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T00:12:30.9634534Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T00:12:30.9635477Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T00:12:30.9636313Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T00:12:30.9637253Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local ... 2024-12-18T00:12:31.1893354Z 2024-12-18T00:12:31.1894240Z  2024-12-18T00:12:31.1894835Z  2024-12-18T00:12:31.1895245Z  2024-12-18T00:12:31.1895634Z  2024-12-18T00:12:31.1896007Z  2024-12-18T00:12:31.1896384Z  2024-12-18T00:12:31.1896912Z  2024-12-18T00:12:31.1897317Z  2024-12-18T00:12:31.1897992Z [14,772 / 15,187] 48 actions running 2024-12-18T00:12:31.1898884Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:12:31.1899860Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T00:12:31.1900790Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:12:31.1901641Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T00:12:31.1902544Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T00:12:31.1903499Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T00:12:31.1904399Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T00:12:31.1905282Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local ... 2024-12-18T00:12:31.4163260Z 2024-12-18T00:12:31.4164372Z  2024-12-18T00:12:31.4164894Z  2024-12-18T00:12:31.4165389Z  2024-12-18T00:12:31.4165775Z  2024-12-18T00:12:31.4166156Z  2024-12-18T00:12:31.4166537Z  2024-12-18T00:12:31.4166928Z  2024-12-18T00:12:31.4167266Z  2024-12-18T00:12:31.4167808Z [14,774 / 15,187] 48 actions, 47 running 2024-12-18T00:12:31.4168620Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:12:31.4169538Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T00:12:31.4170625Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T00:12:31.4171477Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T00:12:31.4172470Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T00:12:31.4173364Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T00:12:31.4174157Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T00:12:31.4175020Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local ... 2024-12-18T00:12:31.7899012Z 2024-12-18T00:12:31.7900023Z  2024-12-18T00:12:31.7900481Z  2024-12-18T00:12:31.7900951Z  2024-12-18T00:12:31.7901338Z  2024-12-18T00:12:31.7901627Z  2024-12-18T00:12:31.7901930Z  2024-12-18T00:12:31.7902234Z  2024-12-18T00:12:31.7902576Z  2024-12-18T00:12:31.7903131Z [14,774 / 15,187] 48 actions running 2024-12-18T00:12:31.7904013Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2024-12-18T00:12:31.7905361Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T00:12:31.7906077Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T00:12:31.7907037Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2024-12-18T00:12:31.7907994Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T00:12:31.7908933Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T00:12:31.7909834Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T00:12:31.7910922Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local ... 2024-12-18T00:12:32.5060869Z 2024-12-18T00:12:32.5061829Z  2024-12-18T00:12:32.5062358Z  2024-12-18T00:12:32.5062829Z  2024-12-18T00:12:32.5063236Z  2024-12-18T00:12:32.5063580Z  2024-12-18T00:12:32.5063930Z  2024-12-18T00:12:32.5064295Z  2024-12-18T00:12:32.5064694Z  2024-12-18T00:12:32.5065267Z [14,775 / 15,187] 48 actions, 47 running 2024-12-18T00:12:32.5066082Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:12:32.5067062Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2024-12-18T00:12:32.5068012Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T00:12:32.5068877Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2024-12-18T00:12:32.5069920Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T00:12:32.5070847Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T00:12:32.5071744Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T00:12:32.5072649Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local ... 2024-12-18T00:12:32.7907256Z 2024-12-18T00:12:32.7908266Z  2024-12-18T00:12:32.7908810Z  2024-12-18T00:12:32.7909195Z  2024-12-18T00:12:32.7909611Z  2024-12-18T00:12:32.7909984Z  2024-12-18T00:12:32.7910350Z  2024-12-18T00:12:32.7910721Z  2024-12-18T00:12:32.7911122Z  2024-12-18T00:12:32.7911850Z [14,775 / 15,187] 48 actions running 2024-12-18T00:12:32.7912761Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:12:32.7913645Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2024-12-18T00:12:32.7914530Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T00:12:32.7915455Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T00:12:32.7916491Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T00:12:32.7917487Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T00:12:32.7918424Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T00:12:32.7919391Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local ... 2024-12-18T00:12:32.9911254Z 2024-12-18T00:12:32.9912231Z  2024-12-18T00:12:32.9912608Z  2024-12-18T00:12:32.9912981Z  2024-12-18T00:12:32.9913371Z  2024-12-18T00:12:32.9913755Z  2024-12-18T00:12:32.9914135Z  2024-12-18T00:12:32.9914530Z  2024-12-18T00:12:32.9914931Z  2024-12-18T00:12:32.9915479Z [14,777 / 15,187] 48 actions running 2024-12-18T00:12:32.9916362Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:12:32.9917326Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2024-12-18T00:12:32.9918189Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T00:12:32.9919023Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T00:12:32.9920016Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T00:12:32.9920949Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T00:12:32.9921973Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T00:12:32.9923050Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local ... 2024-12-18T00:12:33.3915683Z 2024-12-18T00:12:33.3917011Z  2024-12-18T00:12:33.3917488Z  2024-12-18T00:12:33.3918148Z  2024-12-18T00:12:33.3918537Z  2024-12-18T00:12:33.3918932Z  2024-12-18T00:12:33.3919321Z  2024-12-18T00:12:33.3919687Z  2024-12-18T00:12:33.3920067Z  2024-12-18T00:12:33.3920579Z [14,778 / 15,187] 48 actions running 2024-12-18T00:12:33.3921485Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:12:33.3922692Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2024-12-18T00:12:33.3923580Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:12:33.3924467Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T00:12:33.3925385Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T00:12:33.3926319Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T00:12:33.3927209Z Compiling torch_xla/csrc/lowering_context.cpp; 33s local 2024-12-18T00:12:33.3928138Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local ... 2024-12-18T00:12:33.6295346Z 2024-12-18T00:12:33.6296327Z  2024-12-18T00:12:33.6296890Z  2024-12-18T00:12:33.6297280Z  2024-12-18T00:12:33.6297689Z  2024-12-18T00:12:33.6298047Z  2024-12-18T00:12:33.6298443Z  2024-12-18T00:12:33.6298825Z  2024-12-18T00:12:33.6299208Z  2024-12-18T00:12:33.6299812Z [14,779 / 15,187] 48 actions, 47 running 2024-12-18T00:12:33.6300761Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:12:33.6301771Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2024-12-18T00:12:33.6302627Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:12:33.6303374Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T00:12:33.6304335Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T00:12:33.6305282Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T00:12:33.6306220Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2024-12-18T00:12:33.6307345Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local ... 2024-12-18T00:12:33.8306842Z 2024-12-18T00:12:33.8307852Z  2024-12-18T00:12:33.8308412Z  2024-12-18T00:12:33.8308751Z  2024-12-18T00:12:33.8309105Z  2024-12-18T00:12:33.8309464Z  2024-12-18T00:12:33.8309861Z  2024-12-18T00:12:33.8310226Z  2024-12-18T00:12:33.8310574Z  2024-12-18T00:12:33.8311122Z [14,782 / 15,187] 48 actions, 47 running 2024-12-18T00:12:33.8311939Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:12:33.8312856Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:12:33.8313897Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T00:12:33.8314722Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2024-12-18T00:12:33.8315569Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T00:12:33.8316405Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2024-12-18T00:12:33.8317241Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2024-12-18T00:12:33.8318070Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local ... 2024-12-18T00:12:34.1922779Z 2024-12-18T00:12:34.1923750Z  2024-12-18T00:12:34.1924237Z  2024-12-18T00:12:34.1924628Z  2024-12-18T00:12:34.1925018Z  2024-12-18T00:12:34.1925406Z  2024-12-18T00:12:34.1925768Z  2024-12-18T00:12:34.1926157Z  2024-12-18T00:12:34.1926554Z  2024-12-18T00:12:34.1927149Z [14,782 / 15,187] 48 actions running 2024-12-18T00:12:34.1928052Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:12:34.1929305Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:12:34.1930218Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T00:12:34.1931329Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2024-12-18T00:12:34.1932309Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T00:12:34.1933283Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2024-12-18T00:12:34.1934250Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2024-12-18T00:12:34.1935260Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local ... 2024-12-18T00:12:35.1931877Z 2024-12-18T00:12:35.1932808Z  2024-12-18T00:12:35.1933287Z  2024-12-18T00:12:35.1933714Z  2024-12-18T00:12:35.1934096Z  2024-12-18T00:12:35.1934454Z  2024-12-18T00:12:35.1934847Z  2024-12-18T00:12:35.1935294Z  2024-12-18T00:12:35.1935677Z  2024-12-18T00:12:35.1936224Z [14,782 / 15,187] 48 actions running 2024-12-18T00:12:35.1937235Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2024-12-18T00:12:35.1938103Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2024-12-18T00:12:35.1938989Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2024-12-18T00:12:35.1940053Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T00:12:35.1941003Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2024-12-18T00:12:35.1941955Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2024-12-18T00:12:35.1942900Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2024-12-18T00:12:35.1943775Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local ... 2024-12-18T00:12:35.5564423Z 2024-12-18T00:12:35.5565302Z  2024-12-18T00:12:35.5565786Z  2024-12-18T00:12:35.5566237Z  2024-12-18T00:12:35.5566636Z  2024-12-18T00:12:35.5567010Z  2024-12-18T00:12:35.5567397Z  2024-12-18T00:12:35.5567808Z  2024-12-18T00:12:35.5568204Z  2024-12-18T00:12:35.5568776Z [14,783 / 15,187] 48 actions, 47 running 2024-12-18T00:12:35.5570083Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:12:35.5571202Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T00:12:35.5572208Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T00:12:35.5573304Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T00:12:35.5574379Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2024-12-18T00:12:35.5575408Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2024-12-18T00:12:35.5576607Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2024-12-18T00:12:35.5577633Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local ... 2024-12-18T00:12:35.7937626Z 2024-12-18T00:12:35.7938483Z  2024-12-18T00:12:35.7938896Z  2024-12-18T00:12:35.7939273Z  2024-12-18T00:12:35.7939640Z  2024-12-18T00:12:35.7939991Z  2024-12-18T00:12:35.7940336Z  2024-12-18T00:12:35.7940711Z  2024-12-18T00:12:35.7941052Z  2024-12-18T00:12:35.7941559Z [14,783 / 15,187] 48 actions running 2024-12-18T00:12:35.7942328Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:12:35.7943208Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T00:12:35.7944018Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T00:12:35.7945100Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T00:12:35.7945911Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2024-12-18T00:12:35.7946718Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2024-12-18T00:12:35.7947567Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2024-12-18T00:12:35.7948729Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local ... 2024-12-18T00:12:35.9942668Z 2024-12-18T00:12:35.9943677Z  2024-12-18T00:12:35.9944438Z  2024-12-18T00:12:35.9945154Z  2024-12-18T00:12:35.9945535Z  2024-12-18T00:12:35.9945950Z  2024-12-18T00:12:35.9946330Z  2024-12-18T00:12:35.9946709Z  2024-12-18T00:12:35.9947101Z  2024-12-18T00:12:35.9947665Z [14,785 / 15,187] 48 actions running 2024-12-18T00:12:35.9948565Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:12:35.9949760Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T00:12:35.9950567Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T00:12:35.9951508Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T00:12:35.9952462Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T00:12:35.9953377Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2024-12-18T00:12:35.9954274Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2024-12-18T00:12:35.9955165Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local ... 2024-12-18T00:12:36.3946613Z 2024-12-18T00:12:36.3947514Z  2024-12-18T00:12:36.3947981Z  2024-12-18T00:12:36.3948383Z  2024-12-18T00:12:36.3948781Z  2024-12-18T00:12:36.3949165Z  2024-12-18T00:12:36.3949564Z  2024-12-18T00:12:36.3949961Z  2024-12-18T00:12:36.3950363Z  2024-12-18T00:12:36.3950975Z [14,786 / 15,187] 48 actions running 2024-12-18T00:12:36.3951857Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:12:36.3952832Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T00:12:36.3953766Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T00:12:36.3954759Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T00:12:36.3955723Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T00:12:36.3956807Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2024-12-18T00:12:36.3957726Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2024-12-18T00:12:36.3958618Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local ... 2024-12-18T00:12:36.6228179Z 2024-12-18T00:12:36.6229182Z  2024-12-18T00:12:36.6229717Z  2024-12-18T00:12:36.6230099Z  2024-12-18T00:12:36.6230455Z  2024-12-18T00:12:36.6230837Z  2024-12-18T00:12:36.6231210Z  2024-12-18T00:12:36.6231659Z  2024-12-18T00:12:36.6232041Z  2024-12-18T00:12:36.6232585Z [14,787 / 15,187] 48 actions, 47 running 2024-12-18T00:12:36.6233459Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:12:36.6234396Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T00:12:36.6235529Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T00:12:36.6236451Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T00:12:36.6237346Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T00:12:36.6238263Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2024-12-18T00:12:36.6239186Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2024-12-18T00:12:36.6240047Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local ... 2024-12-18T00:12:36.9954028Z 2024-12-18T00:12:36.9955037Z  2024-12-18T00:12:36.9955492Z  2024-12-18T00:12:36.9955927Z  2024-12-18T00:12:36.9956310Z  2024-12-18T00:12:36.9956613Z  2024-12-18T00:12:36.9956934Z  2024-12-18T00:12:36.9957363Z  2024-12-18T00:12:36.9957761Z  2024-12-18T00:12:36.9958319Z [14,788 / 15,187] 48 actions running 2024-12-18T00:12:36.9959224Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:12:36.9960558Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T00:12:36.9961446Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T00:12:36.9962490Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T00:12:36.9963401Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T00:12:36.9964276Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2024-12-18T00:12:36.9965134Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2024-12-18T00:12:36.9966154Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local ... 2024-12-18T00:12:37.2393118Z 2024-12-18T00:12:37.2394022Z  2024-12-18T00:12:37.2394527Z  2024-12-18T00:12:37.2394926Z  2024-12-18T00:12:37.2395344Z  2024-12-18T00:12:37.2395757Z  2024-12-18T00:12:37.2396155Z  2024-12-18T00:12:37.2396557Z  2024-12-18T00:12:37.2396973Z  2024-12-18T00:12:37.2397567Z [14,789 / 15,187] 48 actions, 47 running 2024-12-18T00:12:37.2398537Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:12:37.2399504Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T00:12:37.2400461Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T00:12:37.2412142Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T00:12:37.2413374Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T00:12:37.2414363Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2024-12-18T00:12:37.2415350Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2024-12-18T00:12:37.2416200Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local ... 2024-12-18T00:12:37.5959277Z 2024-12-18T00:12:37.5960269Z  2024-12-18T00:12:37.5960751Z  2024-12-18T00:12:37.5961169Z  2024-12-18T00:12:37.5961593Z  2024-12-18T00:12:37.5962000Z  2024-12-18T00:12:37.5962426Z  2024-12-18T00:12:37.5962829Z  2024-12-18T00:12:37.5963238Z  2024-12-18T00:12:37.5963838Z [14,790 / 15,187] 48 actions running 2024-12-18T00:12:37.5964740Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2024-12-18T00:12:37.5965754Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T00:12:37.5966723Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T00:12:37.5967646Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T00:12:37.5968569Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T00:12:37.5969477Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2024-12-18T00:12:37.5970423Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2024-12-18T00:12:37.5971496Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local ... 2024-12-18T00:12:38.2586990Z 2024-12-18T00:12:38.2587972Z  2024-12-18T00:12:38.2588436Z  2024-12-18T00:12:38.2588882Z  2024-12-18T00:12:38.2589284Z  2024-12-18T00:12:38.2589695Z  2024-12-18T00:12:38.2590052Z  2024-12-18T00:12:38.2590448Z  2024-12-18T00:12:38.2590826Z  2024-12-18T00:12:38.2591395Z [14,791 / 15,187] 48 actions, 47 running 2024-12-18T00:12:38.2592262Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2024-12-18T00:12:38.2593182Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:12:38.2594087Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T00:12:38.2595068Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T00:12:38.2595972Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2024-12-18T00:12:38.2596889Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2024-12-18T00:12:38.2597848Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2024-12-18T00:12:38.2598927Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local ... 2024-12-18T00:12:38.5967398Z 2024-12-18T00:12:38.5968358Z  2024-12-18T00:12:38.5968805Z  2024-12-18T00:12:38.5969345Z  2024-12-18T00:12:38.5969774Z  2024-12-18T00:12:38.5970208Z  2024-12-18T00:12:38.5970604Z  2024-12-18T00:12:38.5971012Z  2024-12-18T00:12:38.5971377Z  2024-12-18T00:12:38.5971938Z [14,791 / 15,187] 48 actions running 2024-12-18T00:12:38.5972830Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:12:38.5974010Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:12:38.5974991Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2024-12-18T00:12:38.5975962Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T00:12:38.5977097Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2024-12-18T00:12:38.5978238Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T00:12:38.5979207Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2024-12-18T00:12:38.5980033Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local ... 2024-12-18T00:12:38.7971030Z 2024-12-18T00:12:38.7972020Z  2024-12-18T00:12:38.7972464Z  2024-12-18T00:12:38.7972807Z  2024-12-18T00:12:38.7973179Z  2024-12-18T00:12:38.7973561Z  2024-12-18T00:12:38.7973967Z  2024-12-18T00:12:38.7974364Z  2024-12-18T00:12:38.7974721Z  2024-12-18T00:12:38.7975225Z [14,792 / 15,187] 48 actions running 2024-12-18T00:12:38.7976105Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:12:38.7977276Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:12:38.7978168Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2024-12-18T00:12:38.7979144Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2024-12-18T00:12:38.7980234Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2024-12-18T00:12:38.7981141Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T00:12:38.7982032Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2024-12-18T00:12:38.7982890Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local ... 2024-12-18T00:12:39.0389803Z 2024-12-18T00:12:39.0390941Z  2024-12-18T00:12:39.0391436Z  2024-12-18T00:12:39.0391822Z  2024-12-18T00:12:39.0392229Z  2024-12-18T00:12:39.0392591Z  2024-12-18T00:12:39.0392977Z  2024-12-18T00:12:39.0393365Z  2024-12-18T00:12:39.0393710Z  2024-12-18T00:12:39.0394314Z [14,793 / 15,187] 48 actions, 47 running 2024-12-18T00:12:39.0395158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:12:39.0396069Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:12:39.0397236Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2024-12-18T00:12:39.0398197Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2024-12-18T00:12:39.0399108Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2024-12-18T00:12:39.0400110Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T00:12:39.0401088Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2024-12-18T00:12:39.0401920Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local ... 2024-12-18T00:12:39.3976826Z 2024-12-18T00:12:39.3977675Z  2024-12-18T00:12:39.3978147Z  2024-12-18T00:12:39.3978666Z  2024-12-18T00:12:39.3979062Z  2024-12-18T00:12:39.3979547Z  2024-12-18T00:12:39.3980015Z  2024-12-18T00:12:39.3980387Z  2024-12-18T00:12:39.3980713Z  2024-12-18T00:12:39.3981149Z [14,793 / 15,187] 48 actions running 2024-12-18T00:12:39.3981887Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:12:39.3983080Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T00:12:39.3983839Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2024-12-18T00:12:39.3984954Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2024-12-18T00:12:39.3985865Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2024-12-18T00:12:39.3986777Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2024-12-18T00:12:39.3987673Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T00:12:39.3988817Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local ... 2024-12-18T00:12:39.9196917Z 2024-12-18T00:12:39.9197833Z  2024-12-18T00:12:39.9198290Z  2024-12-18T00:12:39.9198682Z  2024-12-18T00:12:39.9199095Z  2024-12-18T00:12:39.9199505Z  2024-12-18T00:12:39.9199909Z  2024-12-18T00:12:39.9200321Z  2024-12-18T00:12:39.9200743Z  2024-12-18T00:12:39.9201372Z [14,794 / 15,187] 48 actions, 47 running 2024-12-18T00:12:39.9202364Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2024-12-18T00:12:39.9203407Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T00:12:39.9204366Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T00:12:39.9205319Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T00:12:39.9206357Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T00:12:39.9207406Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2024-12-18T00:12:39.9208352Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T00:12:39.9209301Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local ... 2024-12-18T00:12:40.1983518Z 2024-12-18T00:12:40.1984398Z  2024-12-18T00:12:40.1984873Z  2024-12-18T00:12:40.1985269Z  2024-12-18T00:12:40.1985737Z  2024-12-18T00:12:40.1986121Z  2024-12-18T00:12:40.1986527Z  2024-12-18T00:12:40.1986915Z  2024-12-18T00:12:40.1987326Z  2024-12-18T00:12:40.1987895Z [14,795 / 15,187] 48 actions running 2024-12-18T00:12:40.1988797Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2024-12-18T00:12:40.1989808Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T00:12:40.1990768Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T00:12:40.1991803Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T00:12:40.1992856Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T00:12:40.1993820Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2024-12-18T00:12:40.1994820Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T00:12:40.1995777Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local ... 2024-12-18T00:12:40.5115874Z 2024-12-18T00:12:40.5116711Z  2024-12-18T00:12:40.5117161Z  2024-12-18T00:12:40.5117504Z  2024-12-18T00:12:40.5118049Z  2024-12-18T00:12:40.5118444Z  2024-12-18T00:12:40.5118816Z  2024-12-18T00:12:40.5119197Z  2024-12-18T00:12:40.5119560Z  2024-12-18T00:12:40.5120133Z [14,798 / 15,187] 48 actions, 47 running 2024-12-18T00:12:40.5120965Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:12:40.5121914Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T00:12:40.5122803Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T00:12:40.5123777Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T00:12:40.5124639Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T00:12:40.5125739Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T00:12:40.5126624Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2024-12-18T00:12:40.5127533Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local ... 2024-12-18T00:12:40.7989766Z 2024-12-18T00:12:40.7991775Z  2024-12-18T00:12:40.7993059Z  2024-12-18T00:12:40.7993999Z  2024-12-18T00:12:40.7995362Z  2024-12-18T00:12:40.7996521Z  2024-12-18T00:12:40.7997260Z  2024-12-18T00:12:40.7997698Z  2024-12-18T00:12:40.7998098Z  2024-12-18T00:12:40.7998648Z [14,798 / 15,187] 48 actions running 2024-12-18T00:12:40.7999508Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:12:40.8000655Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T00:12:40.8001611Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T00:12:40.8002591Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T00:12:40.8003516Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T00:12:40.8004505Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T00:12:40.8005465Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2024-12-18T00:12:40.8006357Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local ... 2024-12-18T00:12:41.1268715Z 2024-12-18T00:12:41.1270071Z  2024-12-18T00:12:41.1270595Z  2024-12-18T00:12:41.1271020Z  2024-12-18T00:12:41.1271416Z  2024-12-18T00:12:41.1271818Z  2024-12-18T00:12:41.1272218Z  2024-12-18T00:12:41.1272717Z  2024-12-18T00:12:41.1273165Z  2024-12-18T00:12:41.1273760Z [14,799 / 15,187] 48 actions, 47 running 2024-12-18T00:12:41.1274726Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:12:41.1275741Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T00:12:41.1276721Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T00:12:41.1277749Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T00:12:41.1278832Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T00:12:41.1279847Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T00:12:41.1280914Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2024-12-18T00:12:41.1281943Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local ... 2024-12-18T00:12:41.3319851Z 2024-12-18T00:12:41.3321431Z  2024-12-18T00:12:41.3321881Z  2024-12-18T00:12:41.3323495Z  2024-12-18T00:12:41.3324659Z  2024-12-18T00:12:41.3326071Z  2024-12-18T00:12:41.3327370Z  2024-12-18T00:12:41.3328904Z  2024-12-18T00:12:41.3330196Z  2024-12-18T00:12:41.3331807Z [14,800 / 15,187] 48 actions, 47 running 2024-12-18T00:12:41.3333145Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:12:41.3334291Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:12:41.3335571Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T00:12:41.3336805Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T00:12:41.3338055Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T00:12:41.3339417Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T00:12:41.3340420Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T00:12:41.3341573Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local ... 2024-12-18T00:12:41.5997726Z 2024-12-18T00:12:41.5998906Z  2024-12-18T00:12:41.5999364Z  2024-12-18T00:12:41.5999787Z  2024-12-18T00:12:41.6000188Z  2024-12-18T00:12:41.6000547Z  2024-12-18T00:12:41.6000895Z  2024-12-18T00:12:41.6001278Z  2024-12-18T00:12:41.6001633Z  2024-12-18T00:12:41.6002155Z [14,802 / 15,187] 48 actions running 2024-12-18T00:12:41.6002963Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:12:41.6003852Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:12:41.6005013Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T00:12:41.6005916Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T00:12:41.6006950Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T00:12:41.6007813Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T00:12:41.6008822Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T00:12:41.6009925Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local ... 2024-12-18T00:12:41.8000360Z 2024-12-18T00:12:41.8001632Z  2024-12-18T00:12:41.8002125Z  2024-12-18T00:12:41.8002527Z  2024-12-18T00:12:41.8002946Z  2024-12-18T00:12:41.8003376Z  2024-12-18T00:12:41.8003808Z  2024-12-18T00:12:41.8004220Z  2024-12-18T00:12:41.8004663Z  2024-12-18T00:12:41.8005222Z [14,803 / 15,187] 48 actions running 2024-12-18T00:12:41.8006164Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:12:41.8007211Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:12:41.8008123Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T00:12:41.8009145Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T00:12:41.8010148Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T00:12:41.8011134Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T00:12:41.8012146Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T00:12:41.8013108Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local ... 2024-12-18T00:12:42.1130022Z 2024-12-18T00:12:42.1133271Z  2024-12-18T00:12:42.1135770Z  2024-12-18T00:12:42.1136701Z  2024-12-18T00:12:42.1138774Z  2024-12-18T00:12:42.1141057Z  2024-12-18T00:12:42.1141842Z  2024-12-18T00:12:42.1143773Z  2024-12-18T00:12:42.1146229Z  2024-12-18T00:12:42.1147273Z [14,805 / 15,187] 48 actions, 47 running 2024-12-18T00:12:42.1149837Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:12:42.1152545Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:12:42.1153807Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T00:12:42.1156257Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T00:12:42.1158964Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T00:12:42.1160272Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T00:12:42.1162844Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T00:12:42.1165563Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local ... 2024-12-18T00:12:42.4007084Z 2024-12-18T00:12:42.4008006Z  2024-12-18T00:12:42.4008477Z  2024-12-18T00:12:42.4008897Z  2024-12-18T00:12:42.4009300Z  2024-12-18T00:12:42.4009611Z  2024-12-18T00:12:42.4009918Z  2024-12-18T00:12:42.4010276Z  2024-12-18T00:12:42.4010653Z  2024-12-18T00:12:42.4011225Z [14,806 / 15,187] 48 actions running 2024-12-18T00:12:42.4012102Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:12:42.4013015Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T00:12:42.4013946Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T00:12:42.4014889Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T00:12:42.4015839Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T00:12:42.4016858Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T00:12:42.4017759Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T00:12:42.4018559Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local ... 2024-12-18T00:12:42.9849705Z 2024-12-18T00:12:42.9850508Z  2024-12-18T00:12:42.9850878Z  2024-12-18T00:12:42.9851184Z  2024-12-18T00:12:42.9851583Z  2024-12-18T00:12:42.9851953Z  2024-12-18T00:12:42.9852257Z  2024-12-18T00:12:42.9852561Z  2024-12-18T00:12:42.9852844Z  2024-12-18T00:12:42.9853319Z [14,807 / 15,187] 48 actions, 47 running 2024-12-18T00:12:42.9853925Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T00:12:42.9854718Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2024-12-18T00:12:42.9855428Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T00:12:42.9856125Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T00:12:42.9856955Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T00:12:42.9857652Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T00:12:42.9858293Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T00:12:42.9858899Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local ... 2024-12-18T00:12:43.2017047Z 2024-12-18T00:12:43.2017932Z  2024-12-18T00:12:43.2018440Z  2024-12-18T00:12:43.2018842Z  2024-12-18T00:12:43.2019232Z  2024-12-18T00:12:43.2019648Z  2024-12-18T00:12:43.2020025Z  2024-12-18T00:12:43.2020438Z  2024-12-18T00:12:43.2020815Z  2024-12-18T00:12:43.2021475Z [14,808 / 15,187] 47 actions running 2024-12-18T00:12:43.2022228Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T00:12:43.2023109Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2024-12-18T00:12:43.2023995Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T00:12:43.2024856Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T00:12:43.2025797Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T00:12:43.2026715Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T00:12:43.2027523Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T00:12:43.2028279Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local ... 2024-12-18T00:12:43.6023879Z 2024-12-18T00:12:43.6024755Z  2024-12-18T00:12:43.6025220Z  2024-12-18T00:12:43.6025574Z  2024-12-18T00:12:43.6026020Z  2024-12-18T00:12:43.6026372Z  2024-12-18T00:12:43.6026725Z  2024-12-18T00:12:43.6027091Z  2024-12-18T00:12:43.6027504Z  2024-12-18T00:12:43.6028039Z [14,808 / 15,187] 48 actions running 2024-12-18T00:12:43.6028807Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2024-12-18T00:12:43.6029730Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T00:12:43.6030655Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T00:12:43.6031882Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T00:12:43.6032814Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T00:12:43.6033757Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T00:12:43.6034603Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T00:12:43.6035432Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local ... 2024-12-18T00:12:43.8027166Z 2024-12-18T00:12:43.8028036Z  2024-12-18T00:12:43.8028546Z  2024-12-18T00:12:43.8028922Z  2024-12-18T00:12:43.8029364Z  2024-12-18T00:12:43.8029701Z  2024-12-18T00:12:43.8030070Z  2024-12-18T00:12:43.8030433Z  2024-12-18T00:12:43.8030811Z  2024-12-18T00:12:43.8031360Z [14,809 / 15,187] 48 actions running 2024-12-18T00:12:43.8032101Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2024-12-18T00:12:43.8033035Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T00:12:43.8034269Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T00:12:43.8035252Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T00:12:43.8036314Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T00:12:43.8037225Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T00:12:43.8037994Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T00:12:43.8038834Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local ... 2024-12-18T00:12:44.0716634Z 2024-12-18T00:12:44.0719584Z  2024-12-18T00:12:44.0720263Z  2024-12-18T00:12:44.0720675Z  2024-12-18T00:12:44.0721053Z  2024-12-18T00:12:44.0721447Z  2024-12-18T00:12:44.0721847Z  2024-12-18T00:12:44.0722230Z  2024-12-18T00:12:44.0722639Z  2024-12-18T00:12:44.0723195Z [14,810 / 15,187] 48 actions, 47 running 2024-12-18T00:12:44.0723933Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2024-12-18T00:12:44.0724836Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T00:12:44.0725814Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T00:12:44.0726814Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T00:12:44.0727736Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T00:12:44.0728704Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T00:12:44.0729593Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T00:12:44.0730489Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local ... 2024-12-18T00:12:44.4032479Z 2024-12-18T00:12:44.4033414Z  2024-12-18T00:12:44.4033894Z  2024-12-18T00:12:44.4034260Z  2024-12-18T00:12:44.4034659Z  2024-12-18T00:12:44.4035030Z  2024-12-18T00:12:44.4035459Z  2024-12-18T00:12:44.4035835Z  2024-12-18T00:12:44.4036317Z  2024-12-18T00:12:44.4036868Z [14,810 / 15,187] 48 actions running 2024-12-18T00:12:44.4037669Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T00:12:44.4038597Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T00:12:44.4039548Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T00:12:44.4040405Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T00:12:44.4041285Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T00:12:44.4042206Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T00:12:44.4043004Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T00:12:44.4043789Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local ... 2024-12-18T00:12:44.6036673Z 2024-12-18T00:12:44.6037470Z  2024-12-18T00:12:44.6038229Z  2024-12-18T00:12:44.6038679Z  2024-12-18T00:12:44.6039061Z  2024-12-18T00:12:44.6039465Z  2024-12-18T00:12:44.6039879Z  2024-12-18T00:12:44.6040322Z  2024-12-18T00:12:44.6040725Z  2024-12-18T00:12:44.6041298Z [14,811 / 15,187] 48 actions running 2024-12-18T00:12:44.6042066Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T00:12:44.6042989Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T00:12:44.6043966Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T00:12:44.6045205Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T00:12:44.6046170Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T00:12:44.6047251Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T00:12:44.6048019Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T00:12:44.6048840Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local ... 2024-12-18T00:12:45.0414182Z 2024-12-18T00:12:45.0415061Z  2024-12-18T00:12:45.0415550Z  2024-12-18T00:12:45.0416232Z  2024-12-18T00:12:45.0416835Z  2024-12-18T00:12:45.0417221Z  2024-12-18T00:12:45.0417783Z  2024-12-18T00:12:45.0418182Z  2024-12-18T00:12:45.0418580Z  2024-12-18T00:12:45.0419145Z [14,812 / 15,187] 48 actions, 47 running 2024-12-18T00:12:45.0419941Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T00:12:45.0421020Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T00:12:45.0422120Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T00:12:45.0423072Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T00:12:45.0424022Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T00:12:45.0424880Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T00:12:45.0425707Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T00:12:45.0426483Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local ... 2024-12-18T00:12:45.4043420Z 2024-12-18T00:12:45.4044487Z  2024-12-18T00:12:45.4045006Z  2024-12-18T00:12:45.4045405Z  2024-12-18T00:12:45.4045770Z  2024-12-18T00:12:45.4046140Z  2024-12-18T00:12:45.4046505Z  2024-12-18T00:12:45.4046892Z  2024-12-18T00:12:45.4047274Z  2024-12-18T00:12:45.4047818Z [14,812 / 15,187] 48 actions running 2024-12-18T00:12:45.4048592Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T00:12:45.4049488Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T00:12:45.4050429Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T00:12:45.4051372Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T00:12:45.4052300Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2024-12-18T00:12:45.4053248Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T00:12:45.4054109Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T00:12:45.4054877Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local ... 2024-12-18T00:12:45.6047282Z 2024-12-18T00:12:45.6048152Z  2024-12-18T00:12:45.6048575Z  2024-12-18T00:12:45.6048935Z  2024-12-18T00:12:45.6049286Z  2024-12-18T00:12:45.6049615Z  2024-12-18T00:12:45.6049958Z  2024-12-18T00:12:45.6050329Z  2024-12-18T00:12:45.6050687Z  2024-12-18T00:12:45.6051217Z [14,813 / 15,187] 48 actions running 2024-12-18T00:12:45.6051924Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T00:12:45.6052776Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T00:12:45.6053677Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T00:12:45.6054798Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T00:12:45.6055656Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2024-12-18T00:12:45.6056661Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T00:12:45.6057473Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T00:12:45.6058221Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local ... 2024-12-18T00:12:45.9157359Z 2024-12-18T00:12:45.9158256Z  2024-12-18T00:12:45.9158659Z  2024-12-18T00:12:45.9158985Z  2024-12-18T00:12:45.9159342Z  2024-12-18T00:12:45.9159708Z  2024-12-18T00:12:45.9160077Z  2024-12-18T00:12:45.9160469Z  2024-12-18T00:12:45.9160841Z  2024-12-18T00:12:45.9161426Z [14,814 / 15,187] 48 actions, 47 running 2024-12-18T00:12:45.9162211Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T00:12:45.9163085Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T00:12:45.9164034Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T00:12:45.9165308Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T00:12:45.9166181Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2024-12-18T00:12:45.9167181Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T00:12:45.9167982Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T00:12:45.9168734Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local ... 2024-12-18T00:12:46.2053239Z 2024-12-18T00:12:46.2054070Z  2024-12-18T00:12:46.2054529Z  2024-12-18T00:12:46.2055193Z  2024-12-18T00:12:46.2055596Z  2024-12-18T00:12:46.2056006Z  2024-12-18T00:12:46.2056413Z  2024-12-18T00:12:46.2056956Z  2024-12-18T00:12:46.2057358Z  2024-12-18T00:12:46.2057933Z [14,814 / 15,187] 48 actions running 2024-12-18T00:12:46.2058758Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T00:12:46.2059741Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T00:12:46.2060749Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T00:12:46.2061747Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T00:12:46.2062752Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2024-12-18T00:12:46.2063748Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T00:12:46.2064648Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T00:12:46.2065648Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local ... 2024-12-18T00:12:46.4057788Z 2024-12-18T00:12:46.4058702Z  2024-12-18T00:12:46.4059209Z  2024-12-18T00:12:46.4059640Z  2024-12-18T00:12:46.4060051Z  2024-12-18T00:12:46.4060432Z  2024-12-18T00:12:46.4060822Z  2024-12-18T00:12:46.4061203Z  2024-12-18T00:12:46.4061642Z  2024-12-18T00:12:46.4062207Z [14,815 / 15,187] 48 actions running 2024-12-18T00:12:46.4062986Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T00:12:46.4063915Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T00:12:46.4064873Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T00:12:46.4065832Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T00:12:46.4066792Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2024-12-18T00:12:46.4067631Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T00:12:46.4068431Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T00:12:46.4069405Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local ... 2024-12-18T00:12:46.8062824Z 2024-12-18T00:12:46.8063666Z  2024-12-18T00:12:46.8064065Z  2024-12-18T00:12:46.8064400Z  2024-12-18T00:12:46.8065093Z  2024-12-18T00:12:46.8065427Z  2024-12-18T00:12:46.8065752Z  2024-12-18T00:12:46.8066074Z  2024-12-18T00:12:46.8066391Z  2024-12-18T00:12:46.8066861Z [14,816 / 15,187] 48 actions running 2024-12-18T00:12:46.8067515Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T00:12:46.8068253Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T00:12:46.8068999Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T00:12:46.8069713Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T00:12:46.8070480Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2024-12-18T00:12:46.8071150Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2024-12-18T00:12:46.8071800Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T00:12:46.8072594Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local ... 2024-12-18T00:12:47.0066312Z 2024-12-18T00:12:47.0067379Z  2024-12-18T00:12:47.0067878Z  2024-12-18T00:12:47.0068287Z  2024-12-18T00:12:47.0068709Z  2024-12-18T00:12:47.0069344Z  2024-12-18T00:12:47.0069763Z  2024-12-18T00:12:47.0070153Z  2024-12-18T00:12:47.0070660Z  2024-12-18T00:12:47.0071215Z [14,818 / 15,187] 48 actions running 2024-12-18T00:12:47.0071999Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T00:12:47.0072942Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T00:12:47.0073921Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T00:12:47.0075019Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T00:12:47.0076041Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2024-12-18T00:12:47.0076869Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2024-12-18T00:12:47.0077568Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T00:12:47.0078550Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local ... 2024-12-18T00:12:47.5987420Z 2024-12-18T00:12:47.5988373Z  2024-12-18T00:12:47.5988905Z  2024-12-18T00:12:47.5989318Z  2024-12-18T00:12:47.5989682Z  2024-12-18T00:12:47.5990056Z  2024-12-18T00:12:47.5990421Z  2024-12-18T00:12:47.5990858Z  2024-12-18T00:12:47.5991312Z  2024-12-18T00:12:47.5991948Z [14,819 / 15,187] 48 actions, 47 running 2024-12-18T00:12:47.5992764Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2024-12-18T00:12:47.5993792Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T00:12:47.5994860Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T00:12:47.5995876Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T00:12:47.5996889Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T00:12:47.5997869Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T00:12:47.5998871Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2024-12-18T00:12:47.5999867Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local ... 2024-12-18T00:12:47.8073556Z 2024-12-18T00:12:47.8074462Z  2024-12-18T00:12:47.8074925Z  2024-12-18T00:12:47.8075312Z  2024-12-18T00:12:47.8075694Z  2024-12-18T00:12:47.8076060Z  2024-12-18T00:12:47.8076419Z  2024-12-18T00:12:47.8076771Z  2024-12-18T00:12:47.8077168Z  2024-12-18T00:12:47.8077727Z [14,820 / 15,187] 48 actions running 2024-12-18T00:12:47.8078551Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2024-12-18T00:12:47.8079470Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T00:12:47.8080354Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T00:12:47.8081310Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T00:12:47.8082536Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T00:12:47.8083389Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T00:12:47.8084162Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2024-12-18T00:12:47.8085132Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local ... 2024-12-18T00:12:48.6392599Z 2024-12-18T00:12:48.6393570Z  2024-12-18T00:12:48.6393949Z  2024-12-18T00:12:48.6394258Z  2024-12-18T00:12:48.6394552Z  2024-12-18T00:12:48.6394853Z  2024-12-18T00:12:48.6395149Z  2024-12-18T00:12:48.6395445Z  2024-12-18T00:12:48.6395760Z  2024-12-18T00:12:48.6396227Z [14,821 / 15,187] 48 actions, 47 running 2024-12-18T00:12:48.6396839Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T00:12:48.6397514Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T00:12:48.6398224Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2024-12-18T00:12:48.6399228Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T00:12:48.6399923Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T00:12:48.6400681Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T00:12:48.6401273Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2024-12-18T00:12:48.6402038Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local ... 2024-12-18T00:12:48.8638786Z 2024-12-18T00:12:48.8639675Z  2024-12-18T00:12:48.8640154Z  2024-12-18T00:12:48.8640549Z  2024-12-18T00:12:48.8641217Z  2024-12-18T00:12:48.8641649Z  2024-12-18T00:12:48.8642055Z  2024-12-18T00:12:48.8642438Z  2024-12-18T00:12:48.8642839Z  2024-12-18T00:12:48.8643462Z [14,823 / 15,187] 48 actions, 47 running 2024-12-18T00:12:48.8644534Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T00:12:48.8645469Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T00:12:48.8646444Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T00:12:48.8647427Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T00:12:48.8648556Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T00:12:48.8649425Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T00:12:48.8650218Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2024-12-18T00:12:48.8651248Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local ... 2024-12-18T00:12:49.2083391Z 2024-12-18T00:12:49.2084212Z  2024-12-18T00:12:49.2084682Z  2024-12-18T00:12:49.2085081Z  2024-12-18T00:12:49.2085453Z  2024-12-18T00:12:49.2085835Z  2024-12-18T00:12:49.2086211Z  2024-12-18T00:12:49.2086602Z  2024-12-18T00:12:49.2086970Z  2024-12-18T00:12:49.2087532Z [14,823 / 15,187] 48 actions running 2024-12-18T00:12:49.2088255Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T00:12:49.2089182Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T00:12:49.2090089Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T00:12:49.2091031Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T00:12:49.2091865Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T00:12:49.2092664Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T00:12:49.2093361Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2024-12-18T00:12:49.2094369Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local ... 2024-12-18T00:12:49.4087050Z 2024-12-18T00:12:49.4087921Z  2024-12-18T00:12:49.4088416Z  2024-12-18T00:12:49.4088814Z  2024-12-18T00:12:49.4089173Z  2024-12-18T00:12:49.4089556Z  2024-12-18T00:12:49.4090248Z  2024-12-18T00:12:49.4090616Z  2024-12-18T00:12:49.4091039Z  2024-12-18T00:12:49.4091603Z [14,825 / 15,187] 48 actions running 2024-12-18T00:12:49.4092341Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2024-12-18T00:12:49.4093234Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T00:12:49.4094143Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T00:12:49.4095013Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T00:12:49.4095933Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T00:12:49.4096945Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T00:12:49.4097699Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2024-12-18T00:12:49.4098682Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local ... 2024-12-18T00:12:50.4095694Z 2024-12-18T00:12:50.4096696Z  2024-12-18T00:12:50.4097236Z  2024-12-18T00:12:50.4097667Z  2024-12-18T00:12:50.4098070Z  2024-12-18T00:12:50.4098477Z  2024-12-18T00:12:50.4099204Z  2024-12-18T00:12:50.4099638Z  2024-12-18T00:12:50.4100041Z  2024-12-18T00:12:50.4100771Z [14,825 / 15,187] 48 actions running 2024-12-18T00:12:50.4101577Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2024-12-18T00:12:50.4102524Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2024-12-18T00:12:50.4103350Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2024-12-18T00:12:50.4104247Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T00:12:50.4105289Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2024-12-18T00:12:50.4106110Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T00:12:50.4106878Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2024-12-18T00:12:50.4107921Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local ... 2024-12-18T00:12:50.9528560Z 2024-12-18T00:12:50.9529413Z  2024-12-18T00:12:50.9529860Z  2024-12-18T00:12:50.9530207Z  2024-12-18T00:12:50.9530554Z  2024-12-18T00:12:50.9530923Z  2024-12-18T00:12:50.9531283Z  2024-12-18T00:12:50.9531656Z  2024-12-18T00:12:50.9532017Z  2024-12-18T00:12:50.9532525Z [14,826 / 15,187] 48 actions, 47 running 2024-12-18T00:12:50.9533230Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2024-12-18T00:12:50.9534041Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2024-12-18T00:12:50.9534851Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T00:12:50.9535626Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T00:12:50.9536592Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2024-12-18T00:12:50.9537336Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T00:12:50.9538027Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2024-12-18T00:12:50.9538864Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local ... 2024-12-18T00:12:51.2102528Z 2024-12-18T00:12:51.2103317Z  2024-12-18T00:12:51.2103720Z  2024-12-18T00:12:51.2104039Z  2024-12-18T00:12:51.2104337Z  2024-12-18T00:12:51.2104644Z  2024-12-18T00:12:51.2104940Z  2024-12-18T00:12:51.2105246Z  2024-12-18T00:12:51.2105539Z  2024-12-18T00:12:51.2105978Z [14,827 / 15,187] 48 actions running 2024-12-18T00:12:51.2106595Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2024-12-18T00:12:51.2107285Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2024-12-18T00:12:51.2107999Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T00:12:51.2108684Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T00:12:51.2109690Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2024-12-18T00:12:51.2110344Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T00:12:51.2110947Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T00:12:51.2111710Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local ... 2024-12-18T00:12:51.4702786Z 2024-12-18T00:12:51.4703624Z  2024-12-18T00:12:51.4704069Z  2024-12-18T00:12:51.4704460Z  2024-12-18T00:12:51.4704852Z  2024-12-18T00:12:51.4705241Z  2024-12-18T00:12:51.4705612Z  2024-12-18T00:12:51.4705984Z  2024-12-18T00:12:51.4706363Z  2024-12-18T00:12:51.4706963Z [14,828 / 15,187] 48 actions, 47 running 2024-12-18T00:12:51.4707578Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T00:12:51.4708326Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2024-12-18T00:12:51.4709183Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T00:12:51.4710103Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T00:12:51.4711269Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T00:12:51.4712116Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T00:12:51.4713066Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T00:12:51.4713926Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local ... 2024-12-18T00:12:51.6834108Z 2024-12-18T00:12:51.6834966Z  2024-12-18T00:12:51.6835422Z  2024-12-18T00:12:51.6835815Z  2024-12-18T00:12:51.6836199Z  2024-12-18T00:12:51.6836883Z  2024-12-18T00:12:51.6837296Z  2024-12-18T00:12:51.6837689Z  2024-12-18T00:12:51.6838056Z  2024-12-18T00:12:51.6838662Z [14,830 / 15,187] 48 actions, 47 running 2024-12-18T00:12:51.6839454Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T00:12:51.6840507Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T00:12:51.6841430Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T00:12:51.6842329Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T00:12:51.6843159Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T00:12:51.6844077Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T00:12:51.6845433Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2024-12-18T00:12:51.6846402Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local ... 2024-12-18T00:12:51.9819893Z 2024-12-18T00:12:51.9820809Z  2024-12-18T00:12:51.9821274Z  2024-12-18T00:12:51.9821655Z  2024-12-18T00:12:51.9822025Z  2024-12-18T00:12:51.9822413Z  2024-12-18T00:12:51.9822807Z  2024-12-18T00:12:51.9823163Z  2024-12-18T00:12:51.9823527Z  2024-12-18T00:12:51.9824083Z [14,832 / 15,187] 48 actions, 47 running 2024-12-18T00:12:51.9824941Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T00:12:51.9825904Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2024-12-18T00:12:51.9826805Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T00:12:51.9827744Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T00:12:51.9828660Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T00:12:51.9829643Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T00:12:51.9830702Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2024-12-18T00:12:51.9831622Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local ... 2024-12-18T00:12:52.2110680Z 2024-12-18T00:12:52.2111524Z  2024-12-18T00:12:52.2112003Z  2024-12-18T00:12:52.2112389Z  2024-12-18T00:12:52.2112782Z  2024-12-18T00:12:52.2113143Z  2024-12-18T00:12:52.2113824Z  2024-12-18T00:12:52.2114203Z  2024-12-18T00:12:52.2114561Z  2024-12-18T00:12:52.2115122Z [14,833 / 15,187] 48 actions running 2024-12-18T00:12:52.2115915Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T00:12:52.2116826Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2024-12-18T00:12:52.2117790Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T00:12:52.2118709Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T00:12:52.2119615Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T00:12:52.2120585Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T00:12:52.2121733Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T00:12:52.2122765Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local ... 2024-12-18T00:12:52.7094594Z 2024-12-18T00:12:52.7095468Z  2024-12-18T00:12:52.7095898Z  2024-12-18T00:12:52.7096247Z  2024-12-18T00:12:52.7096785Z  2024-12-18T00:12:52.7097177Z  2024-12-18T00:12:52.7097856Z  2024-12-18T00:12:52.7098265Z  2024-12-18T00:12:52.7098633Z  2024-12-18T00:12:52.7099224Z [14,834 / 15,187] 48 actions, 47 running 2024-12-18T00:12:52.7100105Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T00:12:52.7101011Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2024-12-18T00:12:52.7101933Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T00:12:52.7102948Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T00:12:52.7103812Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T00:12:52.7114635Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2024-12-18T00:12:52.7115963Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T00:12:52.7116991Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 23s local ... 2024-12-18T00:12:52.9838321Z 2024-12-18T00:12:52.9839187Z  2024-12-18T00:12:52.9839719Z  2024-12-18T00:12:52.9840090Z  2024-12-18T00:12:52.9840460Z  2024-12-18T00:12:52.9840824Z  2024-12-18T00:12:52.9841233Z  2024-12-18T00:12:52.9841635Z  2024-12-18T00:12:52.9842027Z  2024-12-18T00:12:52.9842590Z [14,835 / 15,187] 48 actions, 47 running 2024-12-18T00:12:52.9843365Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T00:12:52.9844526Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T00:12:52.9845487Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T00:12:52.9846435Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T00:12:52.9847278Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T00:12:52.9848168Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2024-12-18T00:12:52.9849261Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T00:12:52.9850158Z @stablehlo//:stablehlo_passes; 23s local ... 2024-12-18T00:12:53.2119112Z 2024-12-18T00:12:53.2119983Z  2024-12-18T00:12:53.2120479Z  2024-12-18T00:12:53.2120866Z  2024-12-18T00:12:53.2121272Z  2024-12-18T00:12:53.2121631Z  2024-12-18T00:12:53.2121997Z  2024-12-18T00:12:53.2122371Z  2024-12-18T00:12:53.2122720Z  2024-12-18T00:12:53.2123237Z [14,835 / 15,187] 48 actions running 2024-12-18T00:12:53.2124028Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T00:12:53.2124932Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T00:12:53.2125871Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T00:12:53.2126815Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T00:12:53.2127684Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T00:12:53.2129016Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2024-12-18T00:12:53.2130156Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T00:12:53.2131127Z @stablehlo//:stablehlo_passes; 23s local ... 2024-12-18T00:12:53.5731080Z 2024-12-18T00:12:53.5731931Z  2024-12-18T00:12:53.5732400Z  2024-12-18T00:12:53.5732800Z  2024-12-18T00:12:53.5733168Z  2024-12-18T00:12:53.5733571Z  2024-12-18T00:12:53.5733966Z  2024-12-18T00:12:53.5734355Z  2024-12-18T00:12:53.5734727Z  2024-12-18T00:12:53.5735366Z [14,836 / 15,187] 48 actions, 47 running 2024-12-18T00:12:53.5736173Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T00:12:53.5737306Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T00:12:53.5738273Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T00:12:53.5739255Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2024-12-18T00:12:53.5740453Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T00:12:53.5741440Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T00:12:53.5742454Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T00:12:53.5743225Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 20s local ... 2024-12-18T00:12:53.8124379Z 2024-12-18T00:12:53.8125250Z  2024-12-18T00:12:53.8125728Z  2024-12-18T00:12:53.8126125Z  2024-12-18T00:12:53.8126493Z  2024-12-18T00:12:53.8126832Z  2024-12-18T00:12:53.8127514Z  2024-12-18T00:12:53.8127907Z  2024-12-18T00:12:53.8128288Z  2024-12-18T00:12:53.8128833Z [14,836 / 15,187] 48 actions running 2024-12-18T00:12:53.8129576Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T00:12:53.8130466Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T00:12:53.8131413Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T00:12:53.8132356Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2024-12-18T00:12:53.8133223Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T00:12:53.8134188Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T00:12:53.8135089Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T00:12:53.8135872Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 20s local ... 2024-12-18T00:12:54.0242050Z 2024-12-18T00:12:54.0242920Z  2024-12-18T00:12:54.0243375Z  2024-12-18T00:12:54.0243806Z  2024-12-18T00:12:54.0244407Z  2024-12-18T00:12:54.0244822Z  2024-12-18T00:12:54.0245189Z  2024-12-18T00:12:54.0245585Z  2024-12-18T00:12:54.0245948Z  2024-12-18T00:12:54.0246476Z [14,837 / 15,187] 48 actions, 47 running 2024-12-18T00:12:54.0247208Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T00:12:54.0248085Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2024-12-18T00:12:54.0249005Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T00:12:54.0249913Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2024-12-18T00:12:54.0250751Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T00:12:54.0251648Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T00:12:54.0252521Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T00:12:54.0253331Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 20s local ... 2024-12-18T00:12:54.4130736Z 2024-12-18T00:12:54.4131625Z  2024-12-18T00:12:54.4132084Z  2024-12-18T00:12:54.4132467Z  2024-12-18T00:12:54.4132838Z  2024-12-18T00:12:54.4133196Z  2024-12-18T00:12:54.4133560Z  2024-12-18T00:12:54.4133958Z  2024-12-18T00:12:54.4134583Z  2024-12-18T00:12:54.4135032Z [14,837 / 15,187] 48 actions running 2024-12-18T00:12:54.4135812Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T00:12:54.4136807Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2024-12-18T00:12:54.4137704Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T00:12:54.4138610Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T00:12:54.4139434Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T00:12:54.4140306Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T00:12:54.4141105Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T00:12:54.4141863Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2024-12-18T00:12:54.6675875Z 2024-12-18T00:12:54.6676765Z  2024-12-18T00:12:54.6677230Z  2024-12-18T00:12:54.6677659Z  2024-12-18T00:12:54.6678043Z  2024-12-18T00:12:54.6678451Z  2024-12-18T00:12:54.6678821Z  2024-12-18T00:12:54.6679220Z  2024-12-18T00:12:54.6679609Z  2024-12-18T00:12:54.6680476Z [14,838 / 15,187] 48 actions, 47 running 2024-12-18T00:12:54.6681290Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T00:12:54.6682239Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2024-12-18T00:12:54.6683092Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T00:12:54.6683936Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T00:12:54.6684706Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T00:12:54.6685750Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T00:12:54.6686631Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T00:12:54.6687377Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2024-12-18T00:12:55.0137277Z 2024-12-18T00:12:55.0138109Z  2024-12-18T00:12:55.0138592Z  2024-12-18T00:12:55.0138974Z  2024-12-18T00:12:55.0139347Z  2024-12-18T00:12:55.0139726Z  2024-12-18T00:12:55.0140142Z  2024-12-18T00:12:55.0140488Z  2024-12-18T00:12:55.0140858Z  2024-12-18T00:12:55.0141426Z [14,839 / 15,187] 48 actions running 2024-12-18T00:12:55.0142183Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T00:12:55.0143091Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T00:12:55.0144019Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T00:12:55.0145176Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T00:12:55.0146006Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T00:12:55.0146872Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T00:12:55.0147958Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T00:12:55.0148733Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2024-12-18T00:12:55.2797585Z 2024-12-18T00:12:55.2798449Z  2024-12-18T00:12:55.2798862Z  2024-12-18T00:12:55.2799218Z  2024-12-18T00:12:55.2799589Z  2024-12-18T00:12:55.2799948Z  2024-12-18T00:12:55.2800304Z  2024-12-18T00:12:55.2800653Z  2024-12-18T00:12:55.2801012Z  2024-12-18T00:12:55.2801549Z [14,840 / 15,187] 48 actions, 47 running 2024-12-18T00:12:55.2802263Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T00:12:55.2803043Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T00:12:55.2803865Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T00:12:55.2804673Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T00:12:55.2805415Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T00:12:55.2806263Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T00:12:55.2807470Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T00:12:55.2808183Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2024-12-18T00:12:55.6142464Z 2024-12-18T00:12:55.6143309Z  2024-12-18T00:12:55.6143760Z  2024-12-18T00:12:55.6144104Z  2024-12-18T00:12:55.6144663Z  2024-12-18T00:12:55.6145001Z  2024-12-18T00:12:55.6145344Z  2024-12-18T00:12:55.6145688Z  2024-12-18T00:12:55.6146031Z  2024-12-18T00:12:55.6146531Z [14,840 / 15,187] 48 actions running 2024-12-18T00:12:55.6147209Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T00:12:55.6148028Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T00:12:55.6148829Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T00:12:55.6149645Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T00:12:55.6150376Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T00:12:55.6151185Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T00:12:55.6152189Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T00:12:55.6152883Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2024-12-18T00:12:55.8145734Z 2024-12-18T00:12:55.8146546Z  2024-12-18T00:12:55.8146960Z  2024-12-18T00:12:55.8147335Z  2024-12-18T00:12:55.8147708Z  2024-12-18T00:12:55.8148087Z  2024-12-18T00:12:55.8148446Z  2024-12-18T00:12:55.8148812Z  2024-12-18T00:12:55.8149189Z  2024-12-18T00:12:55.8149993Z [14,841 / 15,187] 48 actions running 2024-12-18T00:12:55.8150732Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T00:12:55.8151566Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T00:12:55.8152421Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T00:12:55.8153266Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T00:12:55.8154057Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T00:12:55.8154910Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T00:12:55.8155703Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T00:12:55.8156430Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2024-12-18T00:12:56.2148524Z 2024-12-18T00:12:56.2149378Z  2024-12-18T00:12:56.2149891Z  2024-12-18T00:12:56.2150298Z  2024-12-18T00:12:56.2150710Z  2024-12-18T00:12:56.2151123Z  2024-12-18T00:12:56.2151459Z  2024-12-18T00:12:56.2151800Z  2024-12-18T00:12:56.2152093Z  2024-12-18T00:12:56.2152561Z [14,842 / 15,187] 48 actions running 2024-12-18T00:12:56.2153225Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T00:12:56.2154142Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2024-12-18T00:12:56.2154962Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T00:12:56.2155799Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T00:12:56.2156560Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T00:12:56.2157402Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T00:12:56.2158227Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T00:12:56.2158922Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 23s local ... 2024-12-18T00:12:56.5943679Z 2024-12-18T00:12:56.5945011Z  2024-12-18T00:12:56.5945505Z  2024-12-18T00:12:56.5945938Z  2024-12-18T00:12:56.5946396Z  2024-12-18T00:12:56.5946808Z  2024-12-18T00:12:56.5947269Z  2024-12-18T00:12:56.5947707Z  2024-12-18T00:12:56.5948181Z  2024-12-18T00:12:56.5948843Z [14,843 / 15,187] 48 actions, 47 running 2024-12-18T00:12:56.5949664Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2024-12-18T00:12:56.5950883Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T00:12:56.5951833Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2024-12-18T00:12:56.5952705Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T00:12:56.5953702Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T00:12:56.5954615Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T00:12:56.5955463Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T00:12:56.5956452Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local ... 2024-12-18T00:12:56.8153823Z 2024-12-18T00:12:56.8154975Z  2024-12-18T00:12:56.8155483Z  2024-12-18T00:12:56.8155907Z  2024-12-18T00:12:56.8156338Z  2024-12-18T00:12:56.8156762Z  2024-12-18T00:12:56.8157084Z  2024-12-18T00:12:56.8157396Z  2024-12-18T00:12:56.8157741Z  2024-12-18T00:12:56.8158262Z [14,844 / 15,187] 48 actions running 2024-12-18T00:12:56.8159431Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2024-12-18T00:12:56.8160125Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T00:12:56.8161030Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T00:12:56.8161874Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T00:12:56.8162713Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T00:12:56.8163504Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T00:12:56.8164587Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T00:12:56.8165312Z @stablehlo//:linalg_passes; 22s local ... 2024-12-18T00:12:57.0162309Z 2024-12-18T00:12:57.0163182Z  2024-12-18T00:12:57.0163697Z  2024-12-18T00:12:57.0164122Z  2024-12-18T00:12:57.0164541Z  2024-12-18T00:12:57.0165125Z  2024-12-18T00:12:57.0165605Z  2024-12-18T00:12:57.0166002Z  2024-12-18T00:12:57.0166381Z  2024-12-18T00:12:57.0166980Z [14,845 / 15,187] 48 actions, 47 running 2024-12-18T00:12:57.0167769Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2024-12-18T00:12:57.0168666Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T00:12:57.0169520Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T00:12:57.0170476Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T00:12:57.0171193Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T00:12:57.0171986Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T00:12:57.0172868Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T00:12:57.0173558Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T00:12:57.3834316Z 2024-12-18T00:12:57.3835266Z  2024-12-18T00:12:57.3835767Z  2024-12-18T00:12:57.3836217Z  2024-12-18T00:12:57.3836768Z  2024-12-18T00:12:57.3837180Z  2024-12-18T00:12:57.3837628Z  2024-12-18T00:12:57.3838011Z  2024-12-18T00:12:57.3838386Z  2024-12-18T00:12:57.3838956Z [14,846 / 15,187] 48 actions, 47 running 2024-12-18T00:12:57.3839742Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T00:12:57.3840616Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T00:12:57.3841580Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T00:12:57.3842491Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T00:12:57.3843345Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T00:12:57.3843993Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T00:12:57.3845124Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T00:12:57.3845872Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T00:12:57.6161206Z 2024-12-18T00:12:57.6162078Z  2024-12-18T00:12:57.6162614Z  2024-12-18T00:12:57.6163045Z  2024-12-18T00:12:57.6163483Z  2024-12-18T00:12:57.6163938Z  2024-12-18T00:12:57.6164287Z  2024-12-18T00:12:57.6164635Z  2024-12-18T00:12:57.6165021Z  2024-12-18T00:12:57.6165589Z [14,846 / 15,187] 48 actions running 2024-12-18T00:12:57.6166346Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T00:12:57.6167210Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T00:12:57.6168042Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T00:12:57.6168972Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T00:12:57.6169952Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T00:12:57.6170613Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T00:12:57.6171387Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T00:12:57.6172189Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T00:12:57.8228849Z 2024-12-18T00:12:57.8229823Z  2024-12-18T00:12:57.8230624Z  2024-12-18T00:12:57.8231073Z  2024-12-18T00:12:57.8231503Z  2024-12-18T00:12:57.8232090Z  2024-12-18T00:12:57.8232518Z  2024-12-18T00:12:57.8232868Z  2024-12-18T00:12:57.8233234Z  2024-12-18T00:12:57.8233839Z [14,847 / 15,187] 48 actions, 47 running 2024-12-18T00:12:57.8234641Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T00:12:57.8235566Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T00:12:57.8236636Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T00:12:57.8237647Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T00:12:57.8238525Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T00:12:57.8239356Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T00:12:57.8240372Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T00:12:57.8241139Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T00:12:58.2166389Z 2024-12-18T00:12:58.2167266Z  2024-12-18T00:12:58.2167790Z  2024-12-18T00:12:58.2168255Z  2024-12-18T00:12:58.2168668Z  2024-12-18T00:12:58.2169079Z  2024-12-18T00:12:58.2169443Z  2024-12-18T00:12:58.2169823Z  2024-12-18T00:12:58.2170191Z  2024-12-18T00:12:58.2170855Z [14,847 / 15,187] 48 actions running 2024-12-18T00:12:58.2171597Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T00:12:58.2172519Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T00:12:58.2173445Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T00:12:58.2174376Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T00:12:58.2175213Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T00:12:58.2176095Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T00:12:58.2177156Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T00:12:58.2177850Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T00:12:58.6171496Z 2024-12-18T00:12:58.6172361Z  2024-12-18T00:12:58.6172900Z  2024-12-18T00:12:58.6173323Z  2024-12-18T00:12:58.6173745Z  2024-12-18T00:12:58.6174165Z  2024-12-18T00:12:58.6174564Z  2024-12-18T00:12:58.6174987Z  2024-12-18T00:12:58.6175393Z  2024-12-18T00:12:58.6175894Z [14,848 / 15,187] 48 actions running 2024-12-18T00:12:58.6176822Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T00:12:58.6177685Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2024-12-18T00:12:58.6178505Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T00:12:58.6179420Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T00:12:58.6180522Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T00:12:58.6181294Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T00:12:58.6182188Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T00:12:58.6182883Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T00:12:58.8238078Z 2024-12-18T00:12:58.8239047Z  2024-12-18T00:12:58.8239600Z  2024-12-18T00:12:58.8241129Z  2024-12-18T00:12:58.8241720Z  2024-12-18T00:12:58.8242157Z  2024-12-18T00:12:58.8242579Z  2024-12-18T00:12:58.8242998Z  2024-12-18T00:12:58.8243452Z  2024-12-18T00:12:58.8244032Z [14,849 / 15,187] 48 actions, 47 running 2024-12-18T00:12:58.8245123Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T00:12:58.8246121Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2024-12-18T00:12:58.8246944Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T00:12:58.8247817Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T00:12:58.8248966Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T00:12:58.8249731Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T00:12:58.8250735Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T00:12:58.8251445Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T00:12:59.2181877Z 2024-12-18T00:12:59.2182734Z  2024-12-18T00:12:59.2183166Z  2024-12-18T00:12:59.2183508Z  2024-12-18T00:12:59.2183846Z  2024-12-18T00:12:59.2184184Z  2024-12-18T00:12:59.2184764Z  2024-12-18T00:12:59.2185107Z  2024-12-18T00:12:59.2185446Z  2024-12-18T00:12:59.2185938Z [14,852 / 15,187] 48 actions running 2024-12-18T00:12:59.2186622Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T00:12:59.2187291Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T00:12:59.2188088Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T00:12:59.2188849Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T00:12:59.2189544Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 26s local 2024-12-18T00:12:59.2190357Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T00:12:59.2190962Z @stablehlo//:linalg_passes; 25s local 2024-12-18T00:12:59.2191609Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local ... 2024-12-18T00:12:59.9025060Z 2024-12-18T00:12:59.9025883Z  2024-12-18T00:12:59.9026298Z  2024-12-18T00:12:59.9026680Z  2024-12-18T00:12:59.9027014Z  2024-12-18T00:12:59.9027365Z  2024-12-18T00:12:59.9027707Z  2024-12-18T00:12:59.9028035Z  2024-12-18T00:12:59.9028349Z  2024-12-18T00:12:59.9028868Z [14,853 / 15,187] 48 actions, 47 running 2024-12-18T00:12:59.9029608Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T00:12:59.9030331Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T00:12:59.9031215Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T00:12:59.9032028Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T00:12:59.9032743Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 26s local 2024-12-18T00:12:59.9033495Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T00:12:59.9034094Z @stablehlo//:linalg_passes; 26s local 2024-12-18T00:12:59.9034670Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local ... 2024-12-18T00:13:00.2189221Z 2024-12-18T00:13:00.2190080Z  2024-12-18T00:13:00.2190552Z  2024-12-18T00:13:00.2190942Z  2024-12-18T00:13:00.2191343Z  2024-12-18T00:13:00.2191718Z  2024-12-18T00:13:00.2192115Z  2024-12-18T00:13:00.2192507Z  2024-12-18T00:13:00.2192890Z  2024-12-18T00:13:00.2193692Z [14,853 / 15,187] 48 actions running 2024-12-18T00:13:00.2194461Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T00:13:00.2195359Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T00:13:00.2196369Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2024-12-18T00:13:00.2197305Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T00:13:00.2198155Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T00:13:00.2199064Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T00:13:00.2199724Z @stablehlo//:linalg_passes; 26s local 2024-12-18T00:13:00.2200482Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local ... 2024-12-18T00:13:00.8055965Z 2024-12-18T00:13:00.8057014Z  2024-12-18T00:13:00.8057460Z  2024-12-18T00:13:00.8057863Z  2024-12-18T00:13:00.8058265Z  2024-12-18T00:13:00.8058635Z  2024-12-18T00:13:00.8058993Z  2024-12-18T00:13:00.8059394Z  2024-12-18T00:13:00.8059772Z  2024-12-18T00:13:00.8060584Z [14,854 / 15,187] 48 actions, 47 running 2024-12-18T00:13:00.8061372Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T00:13:00.8062301Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T00:13:00.8063196Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2024-12-18T00:13:00.8064087Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T00:13:00.8064878Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T00:13:00.8065947Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2024-12-18T00:13:00.8066606Z @stablehlo//:linalg_passes; 26s local 2024-12-18T00:13:00.8067319Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local ... 2024-12-18T00:13:01.0194641Z 2024-12-18T00:13:01.0195511Z  2024-12-18T00:13:01.0195987Z  2024-12-18T00:13:01.0196401Z  2024-12-18T00:13:01.0196988Z  2024-12-18T00:13:01.0197400Z  2024-12-18T00:13:01.0197800Z  2024-12-18T00:13:01.0198197Z  2024-12-18T00:13:01.0198635Z  2024-12-18T00:13:01.0199260Z [14,855 / 15,187] 48 actions, 47 running 2024-12-18T00:13:01.0200100Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T00:13:01.0200963Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T00:13:01.0201954Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2024-12-18T00:13:01.0202862Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T00:13:01.0203711Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T00:13:01.0204734Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2024-12-18T00:13:01.0205472Z @stablehlo//:linalg_passes; 27s local 2024-12-18T00:13:01.0206410Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local ... 2024-12-18T00:13:01.3037972Z 2024-12-18T00:13:01.3038866Z  2024-12-18T00:13:01.3039336Z  2024-12-18T00:13:01.3039758Z  2024-12-18T00:13:01.3040158Z  2024-12-18T00:13:01.3040579Z  2024-12-18T00:13:01.3040977Z  2024-12-18T00:13:01.3041385Z  2024-12-18T00:13:01.3041802Z  2024-12-18T00:13:01.3042407Z [14,858 / 15,187] 48 actions, 47 running 2024-12-18T00:13:01.3043199Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T00:13:01.3044020Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T00:13:01.3045263Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T00:13:01.3046219Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T00:13:01.3047110Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T00:13:01.3048000Z @stablehlo//:linalg_passes; 27s local 2024-12-18T00:13:01.3048781Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2024-12-18T00:13:01.3049722Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 23s local ... 2024-12-18T00:13:01.6198861Z 2024-12-18T00:13:01.6199806Z  2024-12-18T00:13:01.6200284Z  2024-12-18T00:13:01.6200835Z  2024-12-18T00:13:01.6201218Z  2024-12-18T00:13:01.6201599Z  2024-12-18T00:13:01.6201997Z  2024-12-18T00:13:01.6202375Z  2024-12-18T00:13:01.6202771Z  2024-12-18T00:13:01.6203347Z [14,858 / 15,187] 48 actions running 2024-12-18T00:13:01.6204070Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T00:13:01.6204778Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T00:13:01.6205669Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T00:13:01.6206475Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T00:13:01.6207232Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T00:13:01.6207998Z @stablehlo//:linalg_passes; 27s local 2024-12-18T00:13:01.6208691Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2024-12-18T00:13:01.6209547Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 23s local ... 2024-12-18T00:13:02.0204844Z 2024-12-18T00:13:02.0205693Z  2024-12-18T00:13:02.0206152Z  2024-12-18T00:13:02.0206703Z  2024-12-18T00:13:02.0207103Z  2024-12-18T00:13:02.0207498Z  2024-12-18T00:13:02.0207885Z  2024-12-18T00:13:02.0208282Z  2024-12-18T00:13:02.0208682Z  2024-12-18T00:13:02.0209225Z [14,860 / 15,187] 48 actions running 2024-12-18T00:13:02.0210011Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T00:13:02.0210861Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T00:13:02.0211781Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T00:13:02.0212574Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T00:13:02.0213335Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T00:13:02.0214120Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:02.0214760Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2024-12-18T00:13:02.0215631Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 23s local ... 2024-12-18T00:13:02.8181973Z 2024-12-18T00:13:02.8182832Z  2024-12-18T00:13:02.8183297Z  2024-12-18T00:13:02.8183705Z  2024-12-18T00:13:02.8184106Z  2024-12-18T00:13:02.8184507Z  2024-12-18T00:13:02.8184902Z  2024-12-18T00:13:02.8185287Z  2024-12-18T00:13:02.8185686Z  2024-12-18T00:13:02.8186275Z [14,861 / 15,187] 48 actions, 47 running 2024-12-18T00:13:02.8187102Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T00:13:02.8187971Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T00:13:02.8188916Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2024-12-18T00:13:02.8189799Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T00:13:02.8190663Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T00:13:02.8191566Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:02.8192302Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T00:13:02.8193222Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local ... 2024-12-18T00:13:03.0213156Z 2024-12-18T00:13:03.0213983Z  2024-12-18T00:13:03.0214450Z  2024-12-18T00:13:03.0214862Z  2024-12-18T00:13:03.0215258Z  2024-12-18T00:13:03.0215668Z  2024-12-18T00:13:03.0216039Z  2024-12-18T00:13:03.0216580Z  2024-12-18T00:13:03.0216996Z  2024-12-18T00:13:03.0217592Z [14,862 / 15,187] 48 actions running 2024-12-18T00:13:03.0218372Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T00:13:03.0219255Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T00:13:03.0220297Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2024-12-18T00:13:03.0221454Z @stablehlo//:stablehlo_passes; 33s local 2024-12-18T00:13:03.0222310Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T00:13:03.0223173Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:03.0223893Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T00:13:03.0224811Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local ... 2024-12-18T00:13:03.2541218Z 2024-12-18T00:13:03.2542114Z  2024-12-18T00:13:03.2542628Z  2024-12-18T00:13:03.2543094Z  2024-12-18T00:13:03.2543594Z  2024-12-18T00:13:03.2543994Z  2024-12-18T00:13:03.2544670Z  2024-12-18T00:13:03.2545035Z  2024-12-18T00:13:03.2545392Z  2024-12-18T00:13:03.2545965Z [14,863 / 15,187] 48 actions, 47 running 2024-12-18T00:13:03.2546753Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T00:13:03.2547693Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T00:13:03.2548649Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T00:13:03.2549787Z @stablehlo//:stablehlo_passes; 33s local 2024-12-18T00:13:03.2550634Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T00:13:03.2551588Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:03.2552342Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T00:13:03.2553261Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local ... 2024-12-18T00:13:03.5536741Z 2024-12-18T00:13:03.5537581Z  2024-12-18T00:13:03.5538022Z  2024-12-18T00:13:03.5538387Z  2024-12-18T00:13:03.5539092Z  2024-12-18T00:13:03.5539498Z  2024-12-18T00:13:03.5539890Z  2024-12-18T00:13:03.5540296Z  2024-12-18T00:13:03.5540693Z  2024-12-18T00:13:03.5541288Z [14,866 / 15,187] 48 actions, 47 running 2024-12-18T00:13:03.5542044Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T00:13:03.5542864Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T00:13:03.5543863Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T00:13:03.5545254Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T00:13:03.5546123Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:03.5546859Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T00:13:03.5547786Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T00:13:03.5548777Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 23s local ... 2024-12-18T00:13:03.8220929Z 2024-12-18T00:13:03.8221830Z  2024-12-18T00:13:03.8222291Z  2024-12-18T00:13:03.8222718Z  2024-12-18T00:13:03.8223132Z  2024-12-18T00:13:03.8223529Z  2024-12-18T00:13:03.8223870Z  2024-12-18T00:13:03.8224230Z  2024-12-18T00:13:03.8224591Z  2024-12-18T00:13:03.8225132Z [14,866 / 15,187] 48 actions running 2024-12-18T00:13:03.8225908Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T00:13:03.8226687Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T00:13:03.8227605Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T00:13:03.8228689Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T00:13:03.8229511Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:03.8230253Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T00:13:03.8231145Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T00:13:03.8232180Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 23s local ... 2024-12-18T00:13:04.0224428Z 2024-12-18T00:13:04.0225264Z  2024-12-18T00:13:04.0225722Z  2024-12-18T00:13:04.0226109Z  2024-12-18T00:13:04.0226506Z  2024-12-18T00:13:04.0226856Z  2024-12-18T00:13:04.0227661Z  2024-12-18T00:13:04.0228028Z  2024-12-18T00:13:04.0228426Z  2024-12-18T00:13:04.0228972Z [14,867 / 15,187] 48 actions running 2024-12-18T00:13:04.0229723Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T00:13:04.0230543Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T00:13:04.0231441Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T00:13:04.0232365Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T00:13:04.0233078Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:04.0233686Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T00:13:04.0234435Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T00:13:04.0235273Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local ... 2024-12-18T00:13:04.3962204Z 2024-12-18T00:13:04.3963021Z  2024-12-18T00:13:04.3963466Z  2024-12-18T00:13:04.3963823Z  2024-12-18T00:13:04.3964165Z  2024-12-18T00:13:04.3964488Z  2024-12-18T00:13:04.3965072Z  2024-12-18T00:13:04.3965418Z  2024-12-18T00:13:04.3965782Z  2024-12-18T00:13:04.3966322Z [14,869 / 15,187] 47 actions, 46 running 2024-12-18T00:13:04.3967126Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2024-12-18T00:13:04.3967825Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T00:13:04.3968663Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2024-12-18T00:13:04.3969667Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T00:13:04.3970644Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:04.3971358Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T00:13:04.3972213Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2024-12-18T00:13:04.3973039Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local ... 2024-12-18T00:13:04.6230629Z 2024-12-18T00:13:04.6231473Z  2024-12-18T00:13:04.6231952Z  2024-12-18T00:13:04.6232376Z  2024-12-18T00:13:04.6232766Z  2024-12-18T00:13:04.6233164Z  2024-12-18T00:13:04.6233569Z  2024-12-18T00:13:04.6233988Z  2024-12-18T00:13:04.6234401Z  2024-12-18T00:13:04.6234951Z [14,869 / 15,187] 48 actions running 2024-12-18T00:13:04.6235806Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2024-12-18T00:13:04.6236709Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T00:13:04.6237767Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2024-12-18T00:13:04.6238953Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T00:13:04.6239804Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:04.6240546Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2024-12-18T00:13:04.6241471Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2024-12-18T00:13:04.6242417Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local ... 2024-12-18T00:13:05.3697219Z 2024-12-18T00:13:05.3698076Z  2024-12-18T00:13:05.3698561Z  2024-12-18T00:13:05.3698959Z  2024-12-18T00:13:05.3699384Z  2024-12-18T00:13:05.3699781Z  2024-12-18T00:13:05.3700188Z  2024-12-18T00:13:05.3700610Z  2024-12-18T00:13:05.3701018Z  2024-12-18T00:13:05.3701621Z [14,870 / 15,187] 48 actions, 47 running 2024-12-18T00:13:05.3702396Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T00:13:05.3703199Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T00:13:05.3704146Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2024-12-18T00:13:05.3705281Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2024-12-18T00:13:05.3706159Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:05.3707081Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2024-12-18T00:13:05.3707889Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T00:13:05.3708589Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local ... 2024-12-18T00:13:05.6240031Z 2024-12-18T00:13:05.6240908Z  2024-12-18T00:13:05.6241358Z  2024-12-18T00:13:05.6241743Z  2024-12-18T00:13:05.6242104Z  2024-12-18T00:13:05.6242481Z  2024-12-18T00:13:05.6242849Z  2024-12-18T00:13:05.6243201Z  2024-12-18T00:13:05.6243569Z  2024-12-18T00:13:05.6244122Z [14,870 / 15,187] 48 actions running 2024-12-18T00:13:05.6245171Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T00:13:05.6245966Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T00:13:05.6246984Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2024-12-18T00:13:05.6248020Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2024-12-18T00:13:05.6248842Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:05.6249860Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T00:13:05.6250726Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T00:13:05.6251694Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local ... 2024-12-18T00:13:05.9915663Z 2024-12-18T00:13:05.9916512Z  2024-12-18T00:13:05.9916915Z  2024-12-18T00:13:05.9917245Z  2024-12-18T00:13:05.9917572Z  2024-12-18T00:13:05.9917883Z  2024-12-18T00:13:05.9918209Z  2024-12-18T00:13:05.9918537Z  2024-12-18T00:13:05.9918861Z  2024-12-18T00:13:05.9919587Z [14,871 / 15,187] 48 actions, 47 running 2024-12-18T00:13:05.9920374Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T00:13:05.9921031Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T00:13:05.9921782Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2024-12-18T00:13:05.9922651Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2024-12-18T00:13:05.9923318Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:05.9923879Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T00:13:05.9924590Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T00:13:05.9925294Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local ... 2024-12-18T00:13:06.2244753Z 2024-12-18T00:13:06.2245577Z  2024-12-18T00:13:06.2245945Z  2024-12-18T00:13:06.2246260Z  2024-12-18T00:13:06.2246568Z  2024-12-18T00:13:06.2246909Z  2024-12-18T00:13:06.2247205Z  2024-12-18T00:13:06.2247516Z  2024-12-18T00:13:06.2247836Z  2024-12-18T00:13:06.2248278Z [14,872 / 15,187] 48 actions running 2024-12-18T00:13:06.2248890Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T00:13:06.2249534Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T00:13:06.2250259Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2024-12-18T00:13:06.2250931Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:06.2251496Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T00:13:06.2252182Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T00:13:06.2252854Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2024-12-18T00:13:06.2253574Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local ... 2024-12-18T00:13:06.8645428Z 2024-12-18T00:13:06.8646314Z  2024-12-18T00:13:06.8646852Z  2024-12-18T00:13:06.8647247Z  2024-12-18T00:13:06.8647623Z  2024-12-18T00:13:06.8647977Z  2024-12-18T00:13:06.8648334Z  2024-12-18T00:13:06.8648696Z  2024-12-18T00:13:06.8649047Z  2024-12-18T00:13:06.8649537Z [14,873 / 15,187] 48 actions, 47 running 2024-12-18T00:13:06.8650507Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T00:13:06.8651209Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T00:13:06.8651994Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2024-12-18T00:13:06.8652724Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:06.8653334Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T00:13:06.8654034Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T00:13:06.8654757Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2024-12-18T00:13:06.8655546Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local ... 2024-12-18T00:13:07.2252371Z 2024-12-18T00:13:07.2253505Z  2024-12-18T00:13:07.2253938Z  2024-12-18T00:13:07.2254330Z  2024-12-18T00:13:07.2254698Z  2024-12-18T00:13:07.2255075Z  2024-12-18T00:13:07.2255425Z  2024-12-18T00:13:07.2255809Z  2024-12-18T00:13:07.2256226Z  2024-12-18T00:13:07.2256952Z [14,873 / 15,187] 48 actions running 2024-12-18T00:13:07.2258054Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T00:13:07.2258728Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T00:13:07.2259652Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T00:13:07.2260393Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:07.2261131Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T00:13:07.2261907Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T00:13:07.2262787Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2024-12-18T00:13:07.2263528Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local ... 2024-12-18T00:13:07.4256758Z 2024-12-18T00:13:07.4257564Z  2024-12-18T00:13:07.4258013Z  2024-12-18T00:13:07.4258426Z  2024-12-18T00:13:07.4258837Z  2024-12-18T00:13:07.4259254Z  2024-12-18T00:13:07.4259663Z  2024-12-18T00:13:07.4260076Z  2024-12-18T00:13:07.4260490Z  2024-12-18T00:13:07.4261087Z [14,874 / 15,187] 48 actions running 2024-12-18T00:13:07.4261845Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T00:13:07.4262740Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T00:13:07.4263752Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T00:13:07.4264695Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:07.4265510Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T00:13:07.4266448Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2024-12-18T00:13:07.4267436Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2024-12-18T00:13:07.4268342Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T00:13:07.6796483Z 2024-12-18T00:13:07.6797329Z  2024-12-18T00:13:07.6797821Z  2024-12-18T00:13:07.6798246Z  2024-12-18T00:13:07.6798657Z  2024-12-18T00:13:07.6799062Z  2024-12-18T00:13:07.6799458Z  2024-12-18T00:13:07.6799853Z  2024-12-18T00:13:07.6800253Z  2024-12-18T00:13:07.6800861Z [14,876 / 15,187] 48 actions, 47 running 2024-12-18T00:13:07.6801701Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T00:13:07.6802555Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T00:13:07.6803571Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T00:13:07.6804517Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:07.6805340Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T00:13:07.6806270Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2024-12-18T00:13:07.6807236Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2024-12-18T00:13:07.6808139Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T00:13:08.0262402Z 2024-12-18T00:13:08.0263259Z  2024-12-18T00:13:08.0263663Z  2024-12-18T00:13:08.0264003Z  2024-12-18T00:13:08.0264364Z  2024-12-18T00:13:08.0273651Z  2024-12-18T00:13:08.0274201Z  2024-12-18T00:13:08.0274574Z  2024-12-18T00:13:08.0274919Z  2024-12-18T00:13:08.0275426Z [14,876 / 15,187] 48 actions running 2024-12-18T00:13:08.0276111Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T00:13:08.0276803Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T00:13:08.0277637Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T00:13:08.0278450Z @stablehlo//:linalg_passes; 34s local 2024-12-18T00:13:08.0279187Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T00:13:08.0279984Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2024-12-18T00:13:08.0280807Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2024-12-18T00:13:08.0281591Z @stablehlo//:linalg_passes; 26s local ... 2024-12-18T00:13:09.0270297Z 2024-12-18T00:13:09.0271372Z  2024-12-18T00:13:09.0271784Z  2024-12-18T00:13:09.0272098Z  2024-12-18T00:13:09.0272409Z  2024-12-18T00:13:09.0272911Z  2024-12-18T00:13:09.0273226Z  2024-12-18T00:13:09.0273537Z  2024-12-18T00:13:09.0273833Z  2024-12-18T00:13:09.0274282Z [14,876 / 15,187] 48 actions running 2024-12-18T00:13:09.0274900Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T00:13:09.0275535Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2024-12-18T00:13:09.0276365Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2024-12-18T00:13:09.0277030Z @stablehlo//:linalg_passes; 35s local 2024-12-18T00:13:09.0277620Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local 2024-12-18T00:13:09.0278286Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2024-12-18T00:13:09.0278991Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2024-12-18T00:13:09.0279645Z @stablehlo//:linalg_passes; 27s local ... 2024-12-18T00:13:09.2275716Z 2024-12-18T00:13:09.2276691Z  2024-12-18T00:13:09.2277188Z  2024-12-18T00:13:09.2277617Z  2024-12-18T00:13:09.2278014Z  2024-12-18T00:13:09.2278416Z  2024-12-18T00:13:09.2278829Z  2024-12-18T00:13:09.2279240Z  2024-12-18T00:13:09.2279633Z  2024-12-18T00:13:09.2280103Z [14,879 / 15,187] 48 actions running 2024-12-18T00:13:09.2280808Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T00:13:09.2281569Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2024-12-18T00:13:09.2282336Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T00:13:09.2283068Z @stablehlo//:linalg_passes; 35s local 2024-12-18T00:13:09.2283672Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T00:13:09.2284469Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2024-12-18T00:13:09.2285198Z @stablehlo//:linalg_passes; 27s local 2024-12-18T00:13:09.2285795Z Compiling stablehlo/reference/Ops.cpp; 23s local ... 2024-12-18T00:13:09.6285189Z 2024-12-18T00:13:09.6285698Z  2024-12-18T00:13:09.6286072Z  2024-12-18T00:13:09.6286404Z  2024-12-18T00:13:09.6286713Z  2024-12-18T00:13:09.6287036Z  2024-12-18T00:13:09.6287363Z  2024-12-18T00:13:09.6287696Z  2024-12-18T00:13:09.6288009Z  2024-12-18T00:13:09.6288474Z [14,881 / 15,187] 48 actions running 2024-12-18T00:13:09.6289137Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2024-12-18T00:13:09.6289811Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T00:13:09.6290577Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T00:13:09.6291267Z @stablehlo//:linalg_passes; 35s local 2024-12-18T00:13:09.6292063Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T00:13:09.6292807Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2024-12-18T00:13:09.6293466Z @stablehlo//:linalg_passes; 27s local 2024-12-18T00:13:09.6294055Z Compiling stablehlo/reference/Ops.cpp; 23s local ... 2024-12-18T00:13:09.9994079Z 2024-12-18T00:13:09.9994953Z  2024-12-18T00:13:09.9995322Z  2024-12-18T00:13:09.9995649Z  2024-12-18T00:13:09.9995971Z  2024-12-18T00:13:09.9996294Z  2024-12-18T00:13:09.9996614Z  2024-12-18T00:13:09.9996924Z  2024-12-18T00:13:09.9997253Z  2024-12-18T00:13:09.9997795Z [14,882 / 15,187] 48 actions, 47 running 2024-12-18T00:13:09.9998598Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2024-12-18T00:13:09.9999255Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T00:13:10.0000032Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T00:13:10.0000766Z @stablehlo//:linalg_passes; 36s local 2024-12-18T00:13:10.0001684Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T00:13:10.0002473Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2024-12-18T00:13:10.0003254Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:10.0003810Z Compiling stablehlo/reference/Ops.cpp; 24s local ... 2024-12-18T00:13:10.2286063Z 2024-12-18T00:13:10.2286921Z  2024-12-18T00:13:10.2287331Z  2024-12-18T00:13:10.2287648Z  2024-12-18T00:13:10.2287978Z  2024-12-18T00:13:10.2288305Z  2024-12-18T00:13:10.2288629Z  2024-12-18T00:13:10.2289220Z  2024-12-18T00:13:10.2289576Z  2024-12-18T00:13:10.2290065Z [14,882 / 15,187] 48 actions running 2024-12-18T00:13:10.2290743Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2024-12-18T00:13:10.2291432Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T00:13:10.2292213Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T00:13:10.2292947Z @stablehlo//:linalg_passes; 36s local 2024-12-18T00:13:10.2293520Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T00:13:10.2294275Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2024-12-18T00:13:10.2294933Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:10.2295482Z Compiling stablehlo/reference/Ops.cpp; 24s local ... 2024-12-18T00:13:10.5614228Z 2024-12-18T00:13:10.5615067Z  2024-12-18T00:13:10.5615433Z  2024-12-18T00:13:10.5615756Z  2024-12-18T00:13:10.5616094Z  2024-12-18T00:13:10.5616601Z  2024-12-18T00:13:10.5616905Z  2024-12-18T00:13:10.5617227Z  2024-12-18T00:13:10.5617543Z  2024-12-18T00:13:10.5618018Z [14,884 / 15,187] 48 actions, 47 running 2024-12-18T00:13:10.5618639Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T00:13:10.5619391Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T00:13:10.5620121Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T00:13:10.5620781Z @stablehlo//:linalg_passes; 36s local 2024-12-18T00:13:10.5621315Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T00:13:10.5622141Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2024-12-18T00:13:10.5622762Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:10.5623314Z Compiling stablehlo/reference/Ops.cpp; 24s local ... 2024-12-18T00:13:10.8291956Z 2024-12-18T00:13:10.8292819Z  2024-12-18T00:13:10.8293246Z  2024-12-18T00:13:10.8293596Z  2024-12-18T00:13:10.8293944Z  2024-12-18T00:13:10.8294272Z  2024-12-18T00:13:10.8294592Z  2024-12-18T00:13:10.8294918Z  2024-12-18T00:13:10.8295241Z  2024-12-18T00:13:10.8295731Z [14,884 / 15,187] 48 actions running 2024-12-18T00:13:10.8296828Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T00:13:10.8297518Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T00:13:10.8298279Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T00:13:10.8298997Z @stablehlo//:linalg_passes; 36s local 2024-12-18T00:13:10.8299583Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T00:13:10.8300340Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2024-12-18T00:13:10.8301025Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:10.8301584Z Compiling stablehlo/reference/Ops.cpp; 24s local ... 2024-12-18T00:13:11.3629147Z 2024-12-18T00:13:11.3629929Z  2024-12-18T00:13:11.3630366Z  2024-12-18T00:13:11.3630730Z  2024-12-18T00:13:11.3631209Z  2024-12-18T00:13:11.3631594Z  2024-12-18T00:13:11.3631962Z  2024-12-18T00:13:11.3632322Z  2024-12-18T00:13:11.3632674Z  2024-12-18T00:13:11.3633230Z [14,885 / 15,187] 48 actions, 47 running 2024-12-18T00:13:11.3634216Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T00:13:11.3634951Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T00:13:11.3635898Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T00:13:11.3636689Z @stablehlo//:linalg_passes; 37s local 2024-12-18T00:13:11.3637320Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T00:13:11.3638164Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2024-12-18T00:13:11.3638931Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:11.3639715Z Compiling stablehlo/reference/Ops.cpp; 25s local ... 2024-12-18T00:13:11.6298262Z 2024-12-18T00:13:11.6299096Z  2024-12-18T00:13:11.6299501Z  2024-12-18T00:13:11.6299855Z  2024-12-18T00:13:11.6300206Z  2024-12-18T00:13:11.6300539Z  2024-12-18T00:13:11.6300891Z  2024-12-18T00:13:11.6301257Z  2024-12-18T00:13:11.6301609Z  2024-12-18T00:13:11.6302119Z [14,885 / 15,187] 48 actions running 2024-12-18T00:13:11.6302795Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T00:13:11.6303531Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T00:13:11.6304369Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T00:13:11.6305140Z @stablehlo//:linalg_passes; 37s local 2024-12-18T00:13:11.6305751Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T00:13:11.6306539Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2024-12-18T00:13:11.6307286Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:11.6307892Z Compiling stablehlo/reference/Ops.cpp; 25s local ... 2024-12-18T00:13:11.9512396Z 2024-12-18T00:13:11.9513220Z  2024-12-18T00:13:11.9513668Z  2024-12-18T00:13:11.9514223Z  2024-12-18T00:13:11.9514648Z  2024-12-18T00:13:11.9515047Z  2024-12-18T00:13:11.9515433Z  2024-12-18T00:13:11.9515819Z  2024-12-18T00:13:11.9516240Z  2024-12-18T00:13:11.9516841Z [14,886 / 15,187] 48 actions, 47 running 2024-12-18T00:13:11.9517604Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T00:13:11.9518343Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T00:13:11.9519214Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T00:13:11.9520038Z @stablehlo//:linalg_passes; 38s local 2024-12-18T00:13:11.9520686Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T00:13:11.9521533Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T00:13:11.9522301Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:11.9522924Z Compiling stablehlo/reference/Ops.cpp; 26s local ... 2024-12-18T00:13:12.2305110Z 2024-12-18T00:13:12.2305958Z  2024-12-18T00:13:12.2306715Z  2024-12-18T00:13:12.2307064Z  2024-12-18T00:13:12.2307429Z  2024-12-18T00:13:12.2307789Z  2024-12-18T00:13:12.2308167Z  2024-12-18T00:13:12.2308503Z  2024-12-18T00:13:12.2308848Z  2024-12-18T00:13:12.2309370Z [14,887 / 15,187] 48 actions running 2024-12-18T00:13:12.2310064Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T00:13:12.2310771Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T00:13:12.2311557Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T00:13:12.2312450Z @stablehlo//:linalg_passes; 38s local 2024-12-18T00:13:12.2313105Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2024-12-18T00:13:12.2313920Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T00:13:12.2314665Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:12.2315286Z Compiling stablehlo/reference/Ops.cpp; 26s local ... 2024-12-18T00:13:12.5417705Z 2024-12-18T00:13:12.5418563Z  2024-12-18T00:13:12.5419030Z  2024-12-18T00:13:12.5419425Z  2024-12-18T00:13:12.5420071Z  2024-12-18T00:13:12.5420446Z  2024-12-18T00:13:12.5420833Z  2024-12-18T00:13:12.5421327Z  2024-12-18T00:13:12.5421700Z  2024-12-18T00:13:12.5422282Z [14,889 / 15,187] 48 actions, 47 running 2024-12-18T00:13:12.5423059Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T00:13:12.5423861Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T00:13:12.5424783Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T00:13:12.5425846Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2024-12-18T00:13:12.5426773Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T00:13:12.5427578Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:12.5428248Z Compiling stablehlo/reference/Ops.cpp; 26s local 2024-12-18T00:13:12.5429043Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local ... 2024-12-18T00:13:12.7824392Z 2024-12-18T00:13:12.7825259Z  2024-12-18T00:13:12.7825713Z  2024-12-18T00:13:12.7826116Z  2024-12-18T00:13:12.7826534Z  2024-12-18T00:13:12.7826902Z  2024-12-18T00:13:12.7827296Z  2024-12-18T00:13:12.7827702Z  2024-12-18T00:13:12.7828097Z  2024-12-18T00:13:12.7828672Z [14,891 / 15,187] 48 actions, 47 running 2024-12-18T00:13:12.7829485Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T00:13:12.7830266Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T00:13:12.7830975Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T00:13:12.7831716Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2024-12-18T00:13:12.7832397Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T00:13:12.7833006Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:12.7833547Z Compiling stablehlo/reference/Ops.cpp; 26s local 2024-12-18T00:13:12.7834274Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local ... 2024-12-18T00:13:13.0025104Z 2024-12-18T00:13:13.0025925Z  2024-12-18T00:13:13.0026332Z  2024-12-18T00:13:13.0026647Z  2024-12-18T00:13:13.0026962Z  2024-12-18T00:13:13.0027284Z  2024-12-18T00:13:13.0027593Z  2024-12-18T00:13:13.0027896Z  2024-12-18T00:13:13.0028186Z  2024-12-18T00:13:13.0028662Z [14,893 / 15,187] 48 actions, 47 running 2024-12-18T00:13:13.0029297Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T00:13:13.0029928Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T00:13:13.0030680Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T00:13:13.0031418Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2024-12-18T00:13:13.0032130Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T00:13:13.0033068Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:13.0033609Z Compiling stablehlo/reference/Ops.cpp; 27s local 2024-12-18T00:13:13.0034236Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local ... 2024-12-18T00:13:13.2312800Z 2024-12-18T00:13:13.2313647Z  2024-12-18T00:13:13.2314037Z  2024-12-18T00:13:13.2314353Z  2024-12-18T00:13:13.2314667Z  2024-12-18T00:13:13.2314984Z  2024-12-18T00:13:13.2315298Z  2024-12-18T00:13:13.2315600Z  2024-12-18T00:13:13.2315892Z  2024-12-18T00:13:13.2316362Z [14,893 / 15,187] 48 actions running 2024-12-18T00:13:13.2316989Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T00:13:13.2317624Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T00:13:13.2318361Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T00:13:13.2319129Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T00:13:13.2320070Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T00:13:13.2320724Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:13.2321245Z Compiling stablehlo/reference/Ops.cpp; 27s local 2024-12-18T00:13:13.2321966Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local ... 2024-12-18T00:13:13.7511882Z 2024-12-18T00:13:13.7512755Z  2024-12-18T00:13:13.7513210Z  2024-12-18T00:13:13.7513609Z  2024-12-18T00:13:13.7513998Z  2024-12-18T00:13:13.7514386Z  2024-12-18T00:13:13.7514762Z  2024-12-18T00:13:13.7515161Z  2024-12-18T00:13:13.7515814Z  2024-12-18T00:13:13.7516407Z [14,895 / 15,187] 47 actions, 46 running 2024-12-18T00:13:13.7517129Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2024-12-18T00:13:13.7517893Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T00:13:13.7518772Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T00:13:13.7519535Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T00:13:13.7520223Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T00:13:13.7520866Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:13.7521357Z Compiling stablehlo/reference/Ops.cpp; 27s local 2024-12-18T00:13:13.7521989Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local ... 2024-12-18T00:13:13.9611001Z 2024-12-18T00:13:13.9611825Z  2024-12-18T00:13:13.9612303Z  2024-12-18T00:13:13.9612724Z  2024-12-18T00:13:13.9613115Z  2024-12-18T00:13:13.9613538Z  2024-12-18T00:13:13.9613946Z  2024-12-18T00:13:13.9614344Z  2024-12-18T00:13:13.9614725Z  2024-12-18T00:13:13.9615308Z [14,898 / 15,187] 48 actions, 47 running 2024-12-18T00:13:13.9616122Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2024-12-18T00:13:13.9617135Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T00:13:13.9618101Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T00:13:13.9619050Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T00:13:13.9620013Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T00:13:13.9620888Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:13.9621570Z Compiling stablehlo/reference/Ops.cpp; 28s local 2024-12-18T00:13:13.9622303Z @stablehlo//:linalg_passes; 22s local ... 2024-12-18T00:13:14.1876283Z 2024-12-18T00:13:14.1877177Z  2024-12-18T00:13:14.1877614Z  2024-12-18T00:13:14.1878029Z  2024-12-18T00:13:14.1878401Z  2024-12-18T00:13:14.1878757Z  2024-12-18T00:13:14.1879119Z  2024-12-18T00:13:14.1879508Z  2024-12-18T00:13:14.1879850Z  2024-12-18T00:13:14.1880424Z [14,899 / 15,187] 48 actions, 47 running 2024-12-18T00:13:14.1881502Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2024-12-18T00:13:14.1882363Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T00:13:14.1883293Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T00:13:14.1884277Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T00:13:14.1885157Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T00:13:14.1885853Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:14.1886406Z Compiling stablehlo/reference/Ops.cpp; 28s local 2024-12-18T00:13:14.1887032Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T00:13:14.4322207Z 2024-12-18T00:13:14.4323049Z  2024-12-18T00:13:14.4323542Z  2024-12-18T00:13:14.4323952Z  2024-12-18T00:13:14.4324346Z  2024-12-18T00:13:14.4324734Z  2024-12-18T00:13:14.4325132Z  2024-12-18T00:13:14.4325516Z  2024-12-18T00:13:14.4325893Z  2024-12-18T00:13:14.4326482Z [14,899 / 15,187] 48 actions running 2024-12-18T00:13:14.4327658Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T00:13:14.4328558Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T00:13:14.4329575Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T00:13:14.4330866Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T00:13:14.4331830Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T00:13:14.4332633Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:14.4333319Z Compiling stablehlo/reference/Ops.cpp; 28s local 2024-12-18T00:13:14.4334148Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T00:13:14.7455017Z 2024-12-18T00:13:14.7455992Z  2024-12-18T00:13:14.7456614Z  2024-12-18T00:13:14.7456999Z  2024-12-18T00:13:14.7457352Z  2024-12-18T00:13:14.7457730Z  2024-12-18T00:13:14.7458129Z  2024-12-18T00:13:14.7458549Z  2024-12-18T00:13:14.7458922Z  2024-12-18T00:13:14.7459538Z [14,900 / 15,187] 48 actions, 47 running 2024-12-18T00:13:14.7460356Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T00:13:14.7461191Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T00:13:14.7462201Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T00:13:14.7463225Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T00:13:14.7464170Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T00:13:14.7465015Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:14.7465704Z Compiling stablehlo/reference/Ops.cpp; 28s local 2024-12-18T00:13:14.7466439Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T00:13:15.0328379Z 2024-12-18T00:13:15.0329228Z  2024-12-18T00:13:15.0329705Z  2024-12-18T00:13:15.0330124Z  2024-12-18T00:13:15.0330497Z  2024-12-18T00:13:15.0330855Z  2024-12-18T00:13:15.0331156Z  2024-12-18T00:13:15.0331492Z  2024-12-18T00:13:15.0331863Z  2024-12-18T00:13:15.0332399Z [14,900 / 15,187] 48 actions running 2024-12-18T00:13:15.0333194Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T00:13:15.0334012Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T00:13:15.0334910Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T00:13:15.0335859Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T00:13:15.0336913Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T00:13:15.0337712Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:15.0338378Z Compiling stablehlo/reference/Ops.cpp; 29s local 2024-12-18T00:13:15.0339064Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T00:13:15.2504708Z 2024-12-18T00:13:15.2505548Z  2024-12-18T00:13:15.2506322Z  2024-12-18T00:13:15.2506747Z  2024-12-18T00:13:15.2507129Z  2024-12-18T00:13:15.2507487Z  2024-12-18T00:13:15.2507832Z  2024-12-18T00:13:15.2508239Z  2024-12-18T00:13:15.2508633Z  2024-12-18T00:13:15.2509224Z [14,901 / 15,187] 48 actions, 47 running 2024-12-18T00:13:15.2510018Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T00:13:15.2510825Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T00:13:15.2511530Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T00:13:15.2512407Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T00:13:15.2513254Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:15.2513933Z Compiling stablehlo/reference/Ops.cpp; 29s local 2024-12-18T00:13:15.2514600Z @stablehlo//:linalg_passes; 24s local 2024-12-18T00:13:15.2515271Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 23s local ... 2024-12-18T00:13:15.6330602Z 2024-12-18T00:13:15.6331518Z  2024-12-18T00:13:15.6331998Z  2024-12-18T00:13:15.6332412Z  2024-12-18T00:13:15.6333109Z  2024-12-18T00:13:15.6333525Z  2024-12-18T00:13:15.6333901Z  2024-12-18T00:13:15.6334262Z  2024-12-18T00:13:15.6334786Z  2024-12-18T00:13:15.6335343Z [14,901 / 15,187] 48 actions running 2024-12-18T00:13:15.6336152Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T00:13:15.6337126Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T00:13:15.6337873Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T00:13:15.6338964Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T00:13:15.6339817Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:15.6340494Z Compiling stablehlo/reference/Ops.cpp; 29s local 2024-12-18T00:13:15.6341144Z @stablehlo//:linalg_passes; 24s local 2024-12-18T00:13:15.6341835Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 23s local ... 2024-12-18T00:13:15.8335761Z 2024-12-18T00:13:15.8336750Z  2024-12-18T00:13:15.8337269Z  2024-12-18T00:13:15.8337714Z  2024-12-18T00:13:15.8338098Z  2024-12-18T00:13:15.8338468Z  2024-12-18T00:13:15.8338855Z  2024-12-18T00:13:15.8339234Z  2024-12-18T00:13:15.8339628Z  2024-12-18T00:13:15.8340234Z [14,903 / 15,187] 48 actions, 47 running 2024-12-18T00:13:15.8341039Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T00:13:15.8341856Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T00:13:15.8342690Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T00:13:15.8343611Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T00:13:15.8344719Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:15.8345306Z @stablehlo//:linalg_passes; 24s local 2024-12-18T00:13:15.8346194Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2024-12-18T00:13:15.8347132Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2024-12-18T00:13:16.1062080Z 2024-12-18T00:13:16.1063330Z  2024-12-18T00:13:16.1063798Z  2024-12-18T00:13:16.1064185Z  2024-12-18T00:13:16.1064580Z  2024-12-18T00:13:16.1064990Z  2024-12-18T00:13:16.1065381Z  2024-12-18T00:13:16.1065768Z  2024-12-18T00:13:16.1066139Z  2024-12-18T00:13:16.1066746Z [14,904 / 15,187] 48 actions, 47 running 2024-12-18T00:13:16.1067507Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T00:13:16.1068372Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T00:13:16.1069133Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T00:13:16.4339730Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T00:13:16.4340640Z @stablehlo//:linalg_passes; 25s local 2024-12-18T00:13:16.4341537Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T00:13:16.4342797Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T00:13:16.4343512Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T00:13:16.4343943Z 2024-12-18T00:13:16.4345085Z  2024-12-18T00:13:16.4346221Z  2024-12-18T00:13:16.4346682Z  2024-12-18T00:13:16.4347076Z  2024-12-18T00:13:16.4347490Z  2024-12-18T00:13:16.4347882Z  2024-12-18T00:13:16.4348402Z  2024-12-18T00:13:16.4348811Z  2024-12-18T00:13:16.4349367Z [14,908 / 15,187] 48 actions running 2024-12-18T00:13:16.4350184Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T00:13:16.4350976Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T00:13:16.4351747Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T00:13:16.4352697Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T00:13:16.4353572Z @stablehlo//:linalg_passes; 25s local 2024-12-18T00:13:16.4354373Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T00:13:16.4355511Z @stablehlo//:linalg_passes; 18s local 2024-12-18T00:13:16.4356366Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 17s local ... 2024-12-18T00:13:16.9937531Z 2024-12-18T00:13:16.9938527Z  2024-12-18T00:13:16.9939008Z  2024-12-18T00:13:16.9939403Z  2024-12-18T00:13:16.9939800Z  2024-12-18T00:13:16.9940195Z  2024-12-18T00:13:16.9940558Z  2024-12-18T00:13:16.9940926Z  2024-12-18T00:13:16.9941294Z  2024-12-18T00:13:16.9941996Z [14,909 / 15,187] 48 actions, 47 running 2024-12-18T00:13:16.9942729Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T00:13:16.9943470Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T00:13:16.9944461Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T00:13:16.9945302Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T00:13:16.9946119Z @stablehlo//:linalg_passes; 25s local 2024-12-18T00:13:16.9946899Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T00:13:16.9947764Z @stablehlo//:linalg_passes; 19s local 2024-12-18T00:13:16.9948549Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 18s local ... 2024-12-18T00:13:17.2346194Z 2024-12-18T00:13:17.2347063Z  2024-12-18T00:13:17.2347568Z  2024-12-18T00:13:17.2348289Z  2024-12-18T00:13:17.2348849Z  2024-12-18T00:13:17.2349385Z  2024-12-18T00:13:17.2349889Z  2024-12-18T00:13:17.2350450Z  2024-12-18T00:13:17.2350967Z  2024-12-18T00:13:17.2351649Z [14,909 / 15,187] 48 actions running 2024-12-18T00:13:17.2352605Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T00:13:17.2353547Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T00:13:17.2354496Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T00:13:17.2355547Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T00:13:17.2356552Z @stablehlo//:linalg_passes; 26s local 2024-12-18T00:13:17.2357537Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T00:13:17.2358535Z @stablehlo//:linalg_passes; 19s local 2024-12-18T00:13:17.2359449Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 18s local ... 2024-12-18T00:13:17.4512412Z 2024-12-18T00:13:17.4513317Z  2024-12-18T00:13:17.4513816Z  2024-12-18T00:13:17.4514216Z  2024-12-18T00:13:17.4514572Z  2024-12-18T00:13:17.4514949Z  2024-12-18T00:13:17.4515314Z  2024-12-18T00:13:17.4515636Z  2024-12-18T00:13:17.4515970Z  2024-12-18T00:13:17.4516535Z [14,910 / 15,187] 48 actions, 47 running 2024-12-18T00:13:17.4517364Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T00:13:17.4518393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T00:13:17.4519117Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T00:13:17.4519968Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T00:13:17.4520755Z @stablehlo//:linalg_passes; 26s local 2024-12-18T00:13:17.4521591Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T00:13:17.4522369Z @stablehlo//:linalg_passes; 19s local 2024-12-18T00:13:17.4523138Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 18s local ... 2024-12-18T00:13:17.8087195Z 2024-12-18T00:13:17.8088016Z  2024-12-18T00:13:17.8088532Z  2024-12-18T00:13:17.8088935Z  2024-12-18T00:13:17.8089334Z  2024-12-18T00:13:17.8089716Z  2024-12-18T00:13:17.8090120Z  2024-12-18T00:13:17.8090513Z  2024-12-18T00:13:17.8090910Z  2024-12-18T00:13:17.8091497Z [14,911 / 15,187] 48 actions, 47 running 2024-12-18T00:13:17.8092356Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T00:13:17.8093513Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T00:13:17.8094282Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T00:13:17.8095336Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T00:13:17.8096126Z @stablehlo//:linalg_passes; 26s local 2024-12-18T00:13:17.8097122Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T00:13:17.8097913Z @stablehlo//:linalg_passes; 19s local 2024-12-18T00:13:17.8098804Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 18s local ... 2024-12-18T00:13:18.0351588Z 2024-12-18T00:13:18.0352405Z  2024-12-18T00:13:18.0352907Z  2024-12-18T00:13:18.0353242Z  2024-12-18T00:13:18.0353583Z  2024-12-18T00:13:18.0353928Z  2024-12-18T00:13:18.0354255Z  2024-12-18T00:13:18.0354587Z  2024-12-18T00:13:18.0354947Z  2024-12-18T00:13:18.0355427Z [14,911 / 15,187] 48 actions running 2024-12-18T00:13:18.0356109Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T00:13:18.0356794Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T00:13:18.0357456Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T00:13:18.0358226Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T00:13:18.0358944Z @stablehlo//:linalg_passes; 27s local 2024-12-18T00:13:18.0359652Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2024-12-18T00:13:18.0360384Z @stablehlo//:linalg_passes; 20s local 2024-12-18T00:13:18.0361041Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 19s local ... 2024-12-18T00:13:19.0140363Z 2024-12-18T00:13:19.0141232Z  2024-12-18T00:13:19.0141708Z  2024-12-18T00:13:19.0142100Z  2024-12-18T00:13:19.0142482Z  2024-12-18T00:13:19.0142896Z  2024-12-18T00:13:19.0143340Z  2024-12-18T00:13:19.0143744Z  2024-12-18T00:13:19.0144138Z  2024-12-18T00:13:19.0145021Z [14,912 / 15,187] 48 actions, 47 running 2024-12-18T00:13:19.0145876Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T00:13:19.0146726Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T00:13:19.0147481Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T00:13:19.0148407Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T00:13:19.0149224Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:19.0150130Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T00:13:19.0151033Z @stablehlo//:linalg_passes; 21s local 2024-12-18T00:13:19.0151871Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 20s local ... 2024-12-18T00:13:19.2197034Z 2024-12-18T00:13:19.2198020Z  2024-12-18T00:13:19.2198471Z  2024-12-18T00:13:19.2199151Z  2024-12-18T00:13:19.2199560Z  2024-12-18T00:13:19.2199957Z  2024-12-18T00:13:19.2200348Z  2024-12-18T00:13:19.2200741Z  2024-12-18T00:13:19.2201136Z  2024-12-18T00:13:19.2201735Z [14,914 / 15,187] 48 actions, 47 running 2024-12-18T00:13:19.2202529Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T00:13:19.2203422Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T00:13:19.2204208Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2024-12-18T00:13:19.2205146Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T00:13:19.2205999Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:19.2206860Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T00:13:19.2207749Z @stablehlo//:linalg_passes; 21s local 2024-12-18T00:13:19.2208533Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 20s local ... 2024-12-18T00:13:19.4363088Z 2024-12-18T00:13:19.4363993Z  2024-12-18T00:13:19.4364468Z  2024-12-18T00:13:19.4364871Z  2024-12-18T00:13:19.4365684Z  2024-12-18T00:13:19.4366093Z  2024-12-18T00:13:19.4366462Z  2024-12-18T00:13:19.4366859Z  2024-12-18T00:13:19.4367353Z  2024-12-18T00:13:19.4367805Z [14,915 / 15,187] 48 actions running 2024-12-18T00:13:19.4368492Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2024-12-18T00:13:19.4369415Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T00:13:19.4370316Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2024-12-18T00:13:19.4371372Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T00:13:19.4372229Z @stablehlo//:linalg_passes; 28s local 2024-12-18T00:13:19.4373117Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T00:13:19.4374318Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 20s local 2024-12-18T00:13:19.4375344Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local ... 2024-12-18T00:13:20.2320082Z 2024-12-18T00:13:20.2321126Z  2024-12-18T00:13:20.2321607Z  2024-12-18T00:13:20.2322002Z  2024-12-18T00:13:20.2322431Z  2024-12-18T00:13:20.2322819Z  2024-12-18T00:13:20.2323219Z  2024-12-18T00:13:20.2323597Z  2024-12-18T00:13:20.2323994Z  2024-12-18T00:13:20.2324579Z [14,916 / 15,187] 48 actions, 47 running 2024-12-18T00:13:20.2325364Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2024-12-18T00:13:20.2326210Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T00:13:20.2327021Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T00:13:20.2327986Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T00:13:20.2328838Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:20.2329736Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2024-12-18T00:13:20.2331295Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 21s local 2024-12-18T00:13:20.2332510Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local ... 2024-12-18T00:13:20.4369501Z 2024-12-18T00:13:20.4370384Z  2024-12-18T00:13:20.4370827Z  2024-12-18T00:13:20.4371221Z  2024-12-18T00:13:20.4371620Z  2024-12-18T00:13:20.4372015Z  2024-12-18T00:13:20.4372356Z  2024-12-18T00:13:20.4372748Z  2024-12-18T00:13:20.4373132Z  2024-12-18T00:13:20.4373720Z [14,916 / 15,187] 48 actions running 2024-12-18T00:13:20.4374544Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T00:13:20.4375365Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T00:13:20.4376149Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T00:13:20.4377224Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T00:13:20.4378530Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:20.4379390Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2024-12-18T00:13:20.4380208Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 21s local 2024-12-18T00:13:20.4381134Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local ... 2024-12-18T00:13:20.7004998Z 2024-12-18T00:13:20.7005878Z  2024-12-18T00:13:20.7006331Z  2024-12-18T00:13:20.7006762Z  2024-12-18T00:13:20.7007139Z  2024-12-18T00:13:20.7007463Z  2024-12-18T00:13:20.7007772Z  2024-12-18T00:13:20.7008127Z  2024-12-18T00:13:20.7008520Z  2024-12-18T00:13:20.7009108Z [14,917 / 15,187] 48 actions, 47 running 2024-12-18T00:13:20.7009874Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T00:13:20.7010699Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T00:13:20.7011450Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T00:13:20.7012394Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T00:13:20.7013431Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:20.7014264Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2024-12-18T00:13:20.7017723Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 21s local 2024-12-18T00:13:20.9923142Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local ... 2024-12-18T00:13:20.9923858Z 2024-12-18T00:13:20.9924305Z  2024-12-18T00:13:20.9924692Z  2024-12-18T00:13:20.9925056Z  2024-12-18T00:13:20.9925456Z  2024-12-18T00:13:20.9926094Z  2024-12-18T00:13:20.9926511Z  2024-12-18T00:13:20.9926927Z  2024-12-18T00:13:20.9927324Z  2024-12-18T00:13:20.9927899Z [14,918 / 15,187] 48 actions, 47 running 2024-12-18T00:13:20.9928712Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T00:13:20.9929554Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T00:13:20.9930388Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T00:13:20.9931307Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T00:13:20.9932197Z @stablehlo//:linalg_passes; 29s local 2024-12-18T00:13:20.9933082Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T00:13:20.9934094Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 22s local 2024-12-18T00:13:20.9935128Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local ... 2024-12-18T00:13:21.2376367Z 2024-12-18T00:13:21.2377368Z  2024-12-18T00:13:21.2377847Z  2024-12-18T00:13:21.2378232Z  2024-12-18T00:13:21.2378558Z  2024-12-18T00:13:21.2378870Z  2024-12-18T00:13:21.2379212Z  2024-12-18T00:13:21.2379565Z  2024-12-18T00:13:21.2379933Z  2024-12-18T00:13:21.2380434Z [14,918 / 15,187] 48 actions running 2024-12-18T00:13:21.2381400Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T00:13:21.2382214Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T00:13:21.2382975Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T00:13:21.2383856Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T00:13:21.2384705Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:21.2385486Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T00:13:21.2386511Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 22s local 2024-12-18T00:13:21.2387511Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local ... 2024-12-18T00:13:21.6514027Z 2024-12-18T00:13:21.6514879Z  2024-12-18T00:13:21.6515354Z  2024-12-18T00:13:21.6515737Z  2024-12-18T00:13:21.6516122Z  2024-12-18T00:13:21.6516484Z  2024-12-18T00:13:21.6516843Z  2024-12-18T00:13:21.6517476Z  2024-12-18T00:13:21.6517848Z  2024-12-18T00:13:21.6518453Z [14,919 / 15,187] 48 actions, 47 running 2024-12-18T00:13:21.6519163Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T00:13:21.6520072Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T00:13:21.6521049Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T00:13:21.6521942Z @stablehlo//:linalg_passes; 30s local 2024-12-18T00:13:21.6523015Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T00:13:21.6524124Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 22s local 2024-12-18T00:13:21.6525124Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T00:13:21.6526267Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local ... 2024-12-18T00:13:22.0383402Z 2024-12-18T00:13:22.0384243Z  2024-12-18T00:13:22.0384742Z  2024-12-18T00:13:22.0385132Z  2024-12-18T00:13:22.0385506Z  2024-12-18T00:13:22.0385887Z  2024-12-18T00:13:22.0386504Z  2024-12-18T00:13:22.0386904Z  2024-12-18T00:13:22.0387288Z  2024-12-18T00:13:22.0387856Z [14,919 / 15,187] 48 actions running 2024-12-18T00:13:22.0388735Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T00:13:22.0389497Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T00:13:22.0390374Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T00:13:22.0391206Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:22.0392199Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2024-12-18T00:13:22.0393184Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local 2024-12-18T00:13:22.0394171Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T00:13:22.0395289Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local ... 2024-12-18T00:13:22.6098635Z 2024-12-18T00:13:22.6099531Z  2024-12-18T00:13:22.6100045Z  2024-12-18T00:13:22.6100451Z  2024-12-18T00:13:22.6100837Z  2024-12-18T00:13:22.6101389Z  2024-12-18T00:13:22.6101810Z  2024-12-18T00:13:22.6102181Z  2024-12-18T00:13:22.6102562Z  2024-12-18T00:13:22.6103137Z [14,920 / 15,187] 48 actions, 47 running 2024-12-18T00:13:22.6103815Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T00:13:22.6104441Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T00:13:22.6105252Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T00:13:22.6105956Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:22.6106713Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2024-12-18T00:13:22.6107700Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local 2024-12-18T00:13:22.6108744Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2024-12-18T00:13:22.6109927Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local ... 2024-12-18T00:13:22.8393507Z 2024-12-18T00:13:22.8394362Z  2024-12-18T00:13:22.8394909Z  2024-12-18T00:13:22.8395320Z  2024-12-18T00:13:22.8395695Z  2024-12-18T00:13:22.8396046Z  2024-12-18T00:13:22.8396415Z  2024-12-18T00:13:22.8396764Z  2024-12-18T00:13:22.8397132Z  2024-12-18T00:13:22.8397667Z [14,920 / 15,187] 48 actions running 2024-12-18T00:13:22.8398394Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T00:13:22.8399136Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T00:13:22.8400026Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T00:13:22.8400871Z @stablehlo//:linalg_passes; 31s local 2024-12-18T00:13:22.8401657Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2024-12-18T00:13:22.8402937Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local 2024-12-18T00:13:22.8403923Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2024-12-18T00:13:22.8405058Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local ... 2024-12-18T00:13:23.1280028Z 2024-12-18T00:13:23.1280860Z  2024-12-18T00:13:23.1281303Z  2024-12-18T00:13:23.1281694Z  2024-12-18T00:13:23.1282078Z  2024-12-18T00:13:23.1282444Z  2024-12-18T00:13:23.1282833Z  2024-12-18T00:13:23.1283202Z  2024-12-18T00:13:23.1283556Z  2024-12-18T00:13:23.1284168Z [14,922 / 15,187] 48 actions, 47 running 2024-12-18T00:13:23.1284851Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T00:13:23.1285574Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T00:13:23.1286536Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T00:13:23.1287463Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:23.1288552Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T00:13:23.1289543Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2024-12-18T00:13:23.1290620Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2024-12-18T00:13:23.1291661Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local ... 2024-12-18T00:13:23.4399477Z 2024-12-18T00:13:23.4400333Z  2024-12-18T00:13:23.4400764Z  2024-12-18T00:13:23.4401105Z  2024-12-18T00:13:23.4401499Z  2024-12-18T00:13:23.4402116Z  2024-12-18T00:13:23.4402514Z  2024-12-18T00:13:23.4402874Z  2024-12-18T00:13:23.4403241Z  2024-12-18T00:13:23.4414301Z [14,924 / 15,187] 48 actions running 2024-12-18T00:13:23.4415315Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T00:13:23.4416081Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T00:13:23.4417137Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T00:13:23.4417961Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:23.4418806Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T00:13:23.4419801Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2024-12-18T00:13:23.4420805Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T00:13:23.4421989Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local ... 2024-12-18T00:13:23.6526787Z 2024-12-18T00:13:23.6527667Z  2024-12-18T00:13:23.6528121Z  2024-12-18T00:13:23.6528484Z  2024-12-18T00:13:23.6528875Z  2024-12-18T00:13:23.6529276Z  2024-12-18T00:13:23.6529661Z  2024-12-18T00:13:23.6530043Z  2024-12-18T00:13:23.6530457Z  2024-12-18T00:13:23.6531049Z [14,925 / 15,187] 48 actions, 47 running 2024-12-18T00:13:23.6531842Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T00:13:23.6532704Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T00:13:23.6533426Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:23.6534316Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T00:13:23.6535377Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2024-12-18T00:13:23.6536609Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T00:13:23.6537802Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2024-12-18T00:13:23.6538809Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T00:13:23.8947529Z 2024-12-18T00:13:23.8948406Z  2024-12-18T00:13:23.8948896Z  2024-12-18T00:13:23.8949322Z  2024-12-18T00:13:23.8949700Z  2024-12-18T00:13:23.8950064Z  2024-12-18T00:13:23.8950421Z  2024-12-18T00:13:23.8951081Z  2024-12-18T00:13:23.8951463Z  2024-12-18T00:13:23.8952062Z [14,927 / 15,187] 48 actions, 47 running 2024-12-18T00:13:23.8952796Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T00:13:23.8953531Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T00:13:23.8954212Z @stablehlo//:linalg_passes; 32s local 2024-12-18T00:13:23.8955063Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T00:13:23.8956020Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2024-12-18T00:13:23.8956966Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T00:13:23.8958050Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2024-12-18T00:13:23.8958985Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T00:13:24.1466410Z 2024-12-18T00:13:24.1467262Z  2024-12-18T00:13:24.1467769Z  2024-12-18T00:13:24.1468192Z  2024-12-18T00:13:24.1468564Z  2024-12-18T00:13:24.1468961Z  2024-12-18T00:13:24.1469333Z  2024-12-18T00:13:24.1469977Z  2024-12-18T00:13:24.1470369Z  2024-12-18T00:13:24.1470983Z [14,930 / 15,187] 48 actions, 47 running 2024-12-18T00:13:24.1471883Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T00:13:24.1472669Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T00:13:24.1473375Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:24.1474255Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T00:13:24.1475504Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2024-12-18T00:13:24.1476563Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T00:13:24.1477642Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2024-12-18T00:13:24.1478521Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2024-12-18T00:13:24.4407964Z 2024-12-18T00:13:24.4408825Z  2024-12-18T00:13:24.4409298Z  2024-12-18T00:13:24.4409671Z  2024-12-18T00:13:24.4410063Z  2024-12-18T00:13:24.4410447Z  2024-12-18T00:13:24.4410813Z  2024-12-18T00:13:24.4411216Z  2024-12-18T00:13:24.4411610Z  2024-12-18T00:13:24.4412172Z [14,931 / 15,187] 48 actions running 2024-12-18T00:13:24.4412918Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T00:13:24.4413698Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T00:13:24.4414359Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:24.4415163Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T00:13:24.4416110Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2024-12-18T00:13:24.4417213Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2024-12-18T00:13:24.4418220Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2024-12-18T00:13:24.4419117Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2024-12-18T00:13:24.6645672Z 2024-12-18T00:13:24.6646592Z  2024-12-18T00:13:24.6647035Z  2024-12-18T00:13:24.6647419Z  2024-12-18T00:13:24.6647828Z  2024-12-18T00:13:24.6648229Z  2024-12-18T00:13:24.6648627Z  2024-12-18T00:13:24.6649012Z  2024-12-18T00:13:24.6649395Z  2024-12-18T00:13:24.6649988Z [14,932 / 15,187] 48 actions, 47 running 2024-12-18T00:13:24.6650685Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T00:13:24.6651516Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T00:13:24.6652236Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:24.6653107Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T00:13:24.6654170Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2024-12-18T00:13:24.6655208Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2024-12-18T00:13:24.6656816Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2024-12-18T00:13:24.6657728Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2024-12-18T00:13:24.9547020Z 2024-12-18T00:13:24.9547888Z  2024-12-18T00:13:24.9548514Z  2024-12-18T00:13:24.9548912Z  2024-12-18T00:13:24.9549299Z  2024-12-18T00:13:24.9549685Z  2024-12-18T00:13:24.9550035Z  2024-12-18T00:13:24.9550410Z  2024-12-18T00:13:24.9550787Z  2024-12-18T00:13:24.9551362Z [14,933 / 15,187] 48 actions, 47 running 2024-12-18T00:13:24.9552157Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T00:13:24.9552950Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T00:13:24.9553639Z @stablehlo//:linalg_passes; 33s local 2024-12-18T00:13:24.9554490Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T00:13:24.9555556Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2024-12-18T00:13:24.9556820Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2024-12-18T00:13:24.9557994Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 18s local 2024-12-18T00:13:24.9559075Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T00:13:25.2415350Z 2024-12-18T00:13:25.2416239Z  2024-12-18T00:13:25.2416824Z  2024-12-18T00:13:25.2417178Z  2024-12-18T00:13:25.2417562Z  2024-12-18T00:13:25.2417937Z  2024-12-18T00:13:25.2418298Z  2024-12-18T00:13:25.2418677Z  2024-12-18T00:13:25.2419385Z  2024-12-18T00:13:25.2419964Z [14,933 / 15,187] 48 actions running 2024-12-18T00:13:25.2420684Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T00:13:25.2421444Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T00:13:25.2422138Z @stablehlo//:linalg_passes; 34s local 2024-12-18T00:13:25.2422983Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T00:13:25.2423997Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2024-12-18T00:13:25.2425007Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2024-12-18T00:13:25.2426156Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 19s local 2024-12-18T00:13:25.2427036Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T00:13:25.5179197Z 2024-12-18T00:13:25.5180056Z  2024-12-18T00:13:25.5180552Z  2024-12-18T00:13:25.5180970Z  2024-12-18T00:13:25.5181379Z  2024-12-18T00:13:25.5181791Z  2024-12-18T00:13:25.5182195Z  2024-12-18T00:13:25.5182539Z  2024-12-18T00:13:25.5182913Z  2024-12-18T00:13:25.5183531Z [14,934 / 15,187] 48 actions, 47 running 2024-12-18T00:13:25.5184277Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T00:13:25.5185253Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T00:13:25.5185958Z @stablehlo//:linalg_passes; 34s local 2024-12-18T00:13:25.5186773Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T00:13:25.5187811Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2024-12-18T00:13:25.5188802Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2024-12-18T00:13:25.5189907Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 19s local 2024-12-18T00:13:25.5190873Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T00:13:25.8421635Z 2024-12-18T00:13:25.8422566Z  2024-12-18T00:13:25.8423037Z  2024-12-18T00:13:25.8423431Z  2024-12-18T00:13:25.8423808Z  2024-12-18T00:13:25.8424212Z  2024-12-18T00:13:25.8424624Z  2024-12-18T00:13:25.8425028Z  2024-12-18T00:13:25.8425399Z  2024-12-18T00:13:25.8425947Z [14,935 / 15,187] 48 actions running 2024-12-18T00:13:25.8427072Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T00:13:25.8428004Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T00:13:25.8428726Z @stablehlo//:linalg_passes; 34s local 2024-12-18T00:13:25.8429586Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T00:13:25.8430686Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2024-12-18T00:13:25.8431709Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T00:13:25.8432824Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 19s local 2024-12-18T00:13:25.8433813Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2024-12-18T00:13:26.0425197Z 2024-12-18T00:13:26.0426047Z  2024-12-18T00:13:26.0426535Z  2024-12-18T00:13:26.0426918Z  2024-12-18T00:13:26.0427298Z  2024-12-18T00:13:26.0427666Z  2024-12-18T00:13:26.0428064Z  2024-12-18T00:13:26.0428505Z  2024-12-18T00:13:26.0428906Z  2024-12-18T00:13:26.0429486Z [14,936 / 15,187] 48 actions running 2024-12-18T00:13:26.0430519Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T00:13:26.0431197Z @stablehlo//:linalg_passes; 35s local 2024-12-18T00:13:26.0432190Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T00:13:26.0433181Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2024-12-18T00:13:26.0434433Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T00:13:26.0435727Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 20s local 2024-12-18T00:13:26.0436649Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T00:13:26.0437504Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 16s local ... 2024-12-18T00:13:26.4429853Z 2024-12-18T00:13:26.4430749Z  2024-12-18T00:13:26.4431238Z  2024-12-18T00:13:26.4431666Z  2024-12-18T00:13:26.4432025Z  2024-12-18T00:13:26.4432393Z  2024-12-18T00:13:26.4432743Z  2024-12-18T00:13:26.4433135Z  2024-12-18T00:13:26.4433525Z  2024-12-18T00:13:26.4434058Z [14,938 / 15,187] 48 actions running 2024-12-18T00:13:26.4434794Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T00:13:26.4435450Z @stablehlo//:linalg_passes; 35s local 2024-12-18T00:13:26.4436262Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T00:13:26.4437241Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2024-12-18T00:13:26.4438215Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T00:13:26.4439226Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 20s local 2024-12-18T00:13:26.4440175Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T00:13:26.4441152Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 17s local ... 2024-12-18T00:13:26.6436297Z 2024-12-18T00:13:26.6437168Z  2024-12-18T00:13:26.6437637Z  2024-12-18T00:13:26.6438048Z  2024-12-18T00:13:26.6438434Z  2024-12-18T00:13:26.6438817Z  2024-12-18T00:13:26.6439171Z  2024-12-18T00:13:26.6439548Z  2024-12-18T00:13:26.6439935Z  2024-12-18T00:13:26.6440517Z [14,939 / 15,187] 48 actions, 47 running 2024-12-18T00:13:26.6441286Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T00:13:26.6441933Z @stablehlo//:linalg_passes; 35s local 2024-12-18T00:13:26.6442693Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T00:13:26.6443628Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2024-12-18T00:13:26.6444876Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T00:13:26.6445922Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 20s local 2024-12-18T00:13:26.6447114Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T00:13:26.6448010Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 17s local ... 2024-12-18T00:13:26.9700150Z 2024-12-18T00:13:26.9701050Z  2024-12-18T00:13:26.9701504Z  2024-12-18T00:13:26.9701941Z  2024-12-18T00:13:26.9702301Z  2024-12-18T00:13:26.9702681Z  2024-12-18T00:13:26.9703065Z  2024-12-18T00:13:26.9703460Z  2024-12-18T00:13:26.9703859Z  2024-12-18T00:13:26.9704436Z [14,940 / 15,187] 48 actions, 47 running 2024-12-18T00:13:26.9705216Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T00:13:26.9705971Z @stablehlo//:linalg_passes; 35s local 2024-12-18T00:13:26.9706884Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T00:13:26.9707978Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2024-12-18T00:13:26.9709219Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2024-12-18T00:13:26.9710389Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 20s local 2024-12-18T00:13:26.9711630Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T00:13:26.9712558Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 17s local ... 2024-12-18T00:13:27.2437085Z 2024-12-18T00:13:27.2437918Z  2024-12-18T00:13:27.2438389Z  2024-12-18T00:13:27.2438759Z  2024-12-18T00:13:27.2439138Z  2024-12-18T00:13:27.2439502Z  2024-12-18T00:13:27.2439857Z  2024-12-18T00:13:27.2440234Z  2024-12-18T00:13:27.2440605Z  2024-12-18T00:13:27.2441461Z [14,940 / 15,187] 48 actions running 2024-12-18T00:13:27.2442207Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T00:13:27.2442928Z @stablehlo//:linalg_passes; 36s local 2024-12-18T00:13:27.2443791Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T00:13:27.2445236Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2024-12-18T00:13:27.2446232Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2024-12-18T00:13:27.2447304Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2024-12-18T00:13:27.2448240Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T00:13:27.2449104Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 18s local ... 2024-12-18T00:13:27.5814438Z 2024-12-18T00:13:27.5815314Z  2024-12-18T00:13:27.5815778Z  2024-12-18T00:13:27.5816177Z  2024-12-18T00:13:27.5816769Z  2024-12-18T00:13:27.5817128Z  2024-12-18T00:13:27.5817516Z  2024-12-18T00:13:27.5817932Z  2024-12-18T00:13:27.5818305Z  2024-12-18T00:13:27.5818851Z [14,942 / 15,187] 48 actions, 47 running 2024-12-18T00:13:27.5819612Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T00:13:27.5820302Z @stablehlo//:linalg_passes; 36s local 2024-12-18T00:13:27.5821196Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T00:13:27.5822285Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2024-12-18T00:13:27.5823349Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2024-12-18T00:13:27.5824546Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2024-12-18T00:13:27.5825530Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T00:13:27.5826392Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 18s local ... 2024-12-18T00:13:27.8442757Z 2024-12-18T00:13:27.8443618Z  2024-12-18T00:13:27.8444084Z  2024-12-18T00:13:27.8444843Z  2024-12-18T00:13:27.8445231Z  2024-12-18T00:13:27.8445631Z  2024-12-18T00:13:27.8446010Z  2024-12-18T00:13:27.8446398Z  2024-12-18T00:13:27.8446764Z  2024-12-18T00:13:27.8447328Z [14,944 / 15,187] 47 actions running 2024-12-18T00:13:27.8448057Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T00:13:27.8449128Z @stablehlo//:linalg_passes; 36s local 2024-12-18T00:13:27.8450008Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T00:13:27.8451053Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2024-12-18T00:13:27.8452041Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T00:13:27.8453105Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2024-12-18T00:13:27.8454029Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T00:13:27.8454963Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 18s local ... 2024-12-18T00:13:28.0446892Z 2024-12-18T00:13:28.0447754Z  2024-12-18T00:13:28.0448242Z  2024-12-18T00:13:28.0448644Z  2024-12-18T00:13:28.0449029Z  2024-12-18T00:13:28.0449410Z  2024-12-18T00:13:28.0449793Z  2024-12-18T00:13:28.0450192Z  2024-12-18T00:13:28.0450615Z  2024-12-18T00:13:28.0451156Z [14,946 / 15,187] 48 actions running 2024-12-18T00:13:28.0452163Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T00:13:28.0452893Z @stablehlo//:linalg_passes; 37s local 2024-12-18T00:13:28.0453893Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T00:13:28.0454901Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2024-12-18T00:13:28.0455939Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T00:13:28.0457227Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2024-12-18T00:13:28.0458335Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T00:13:28.0459324Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 18s local ... 2024-12-18T00:13:28.3330691Z 2024-12-18T00:13:28.3331598Z  2024-12-18T00:13:28.3332080Z  2024-12-18T00:13:28.3332478Z  2024-12-18T00:13:28.3332882Z  2024-12-18T00:13:28.3333251Z  2024-12-18T00:13:28.3333626Z  2024-12-18T00:13:28.3333962Z  2024-12-18T00:13:28.3334315Z  2024-12-18T00:13:28.3334862Z [14,947 / 15,187] 48 actions, 47 running 2024-12-18T00:13:28.3335584Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T00:13:28.3336299Z @stablehlo//:linalg_passes; 37s local 2024-12-18T00:13:28.3337300Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T00:13:28.3338366Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2024-12-18T00:13:28.3339354Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T00:13:28.3340535Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2024-12-18T00:13:28.3341487Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T00:13:28.3342376Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 19s local ... 2024-12-18T00:13:28.6461841Z 2024-12-18T00:13:28.6462727Z  2024-12-18T00:13:28.6463171Z  2024-12-18T00:13:28.6463563Z  2024-12-18T00:13:28.6463947Z  2024-12-18T00:13:28.6464319Z  2024-12-18T00:13:28.6464656Z  2024-12-18T00:13:28.6465022Z  2024-12-18T00:13:28.6465402Z  2024-12-18T00:13:28.6465938Z [14,947 / 15,187] 48 actions running 2024-12-18T00:13:28.6466612Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T00:13:28.6467263Z @stablehlo//:linalg_passes; 37s local 2024-12-18T00:13:28.6468036Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T00:13:28.6469110Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2024-12-18T00:13:28.6470140Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T00:13:28.6471340Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2024-12-18T00:13:28.6472287Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T00:13:28.6473448Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 19s local ... 2024-12-18T00:13:29.0985412Z 2024-12-18T00:13:29.0986314Z  2024-12-18T00:13:29.0986782Z  2024-12-18T00:13:29.0987169Z  2024-12-18T00:13:29.0987575Z  2024-12-18T00:13:29.0987969Z  2024-12-18T00:13:29.0988336Z  2024-12-18T00:13:29.0988709Z  2024-12-18T00:13:29.0989098Z  2024-12-18T00:13:29.0989689Z [14,948 / 15,187] 48 actions, 47 running 2024-12-18T00:13:29.0990405Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T00:13:29.0991082Z @stablehlo//:linalg_passes; 38s local 2024-12-18T00:13:29.0991984Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T00:13:29.0993109Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2024-12-18T00:13:29.0994173Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 26s local 2024-12-18T00:13:29.0995329Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2024-12-18T00:13:29.0996257Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T00:13:29.0997438Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 19s local ... 2024-12-18T00:13:29.3689424Z 2024-12-18T00:13:29.3690295Z  2024-12-18T00:13:29.3690755Z  2024-12-18T00:13:29.3691146Z  2024-12-18T00:13:29.3691545Z  2024-12-18T00:13:29.3691941Z  2024-12-18T00:13:29.3692340Z  2024-12-18T00:13:29.3692727Z  2024-12-18T00:13:29.3693104Z  2024-12-18T00:13:29.3693677Z [14,950 / 15,187] 48 actions, 47 running 2024-12-18T00:13:29.3694895Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T00:13:29.3695649Z @stablehlo//:linalg_passes; 38s local 2024-12-18T00:13:29.3696677Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T00:13:29.3697751Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2024-12-18T00:13:29.3698871Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2024-12-18T00:13:29.3699908Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T00:13:29.3700822Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 20s local 2024-12-18T00:13:29.3701923Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local ... 2024-12-18T00:13:29.6461956Z 2024-12-18T00:13:29.6462829Z  2024-12-18T00:13:29.6463299Z  2024-12-18T00:13:29.6463671Z  2024-12-18T00:13:29.6464033Z  2024-12-18T00:13:29.6464393Z  2024-12-18T00:13:29.6464768Z  2024-12-18T00:13:29.6465150Z  2024-12-18T00:13:29.6465562Z  2024-12-18T00:13:29.6466099Z [14,950 / 15,187] 48 actions running 2024-12-18T00:13:29.6466882Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T00:13:29.6467560Z @stablehlo//:linalg_passes; 38s local 2024-12-18T00:13:29.6468439Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T00:13:29.6469519Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2024-12-18T00:13:29.6470596Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2024-12-18T00:13:29.6471587Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T00:13:29.6472483Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 20s local 2024-12-18T00:13:29.6473516Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local ... 2024-12-18T00:13:29.8502878Z 2024-12-18T00:13:29.8503730Z  2024-12-18T00:13:29.8504170Z  2024-12-18T00:13:29.8504553Z  2024-12-18T00:13:29.8504924Z  2024-12-18T00:13:29.8505358Z  2024-12-18T00:13:29.8505750Z  2024-12-18T00:13:29.8506137Z  2024-12-18T00:13:29.8506503Z  2024-12-18T00:13:29.8507076Z [14,951 / 15,187] 48 actions, 47 running 2024-12-18T00:13:29.8507817Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T00:13:29.8508828Z @stablehlo//:linalg_passes; 38s local 2024-12-18T00:13:29.8509712Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T00:13:29.8510805Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2024-12-18T00:13:29.8511912Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2024-12-18T00:13:29.8512951Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:29.8513822Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 20s local 2024-12-18T00:13:29.8514894Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local ... 2024-12-18T00:13:30.1333010Z 2024-12-18T00:13:30.1333833Z  2024-12-18T00:13:30.1334320Z  2024-12-18T00:13:30.1334723Z  2024-12-18T00:13:30.1335117Z  2024-12-18T00:13:30.1335510Z  2024-12-18T00:13:30.1335927Z  2024-12-18T00:13:30.1336327Z  2024-12-18T00:13:30.1336873Z  2024-12-18T00:13:30.1337447Z [14,952 / 15,187] 48 actions, 47 running 2024-12-18T00:13:30.1338196Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T00:13:30.1339174Z @stablehlo//:linalg_passes; 39s local 2024-12-18T00:13:30.1340057Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T00:13:30.1341291Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2024-12-18T00:13:30.1342381Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 24s local 2024-12-18T00:13:30.1343392Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:30.1344544Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 20s local 2024-12-18T00:13:30.1345743Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local ... 2024-12-18T00:13:30.4468719Z 2024-12-18T00:13:30.4469559Z  2024-12-18T00:13:30.4469996Z  2024-12-18T00:13:30.4470385Z  2024-12-18T00:13:30.4470794Z  2024-12-18T00:13:30.4471198Z  2024-12-18T00:13:30.4471598Z  2024-12-18T00:13:30.4472024Z  2024-12-18T00:13:30.4472420Z  2024-12-18T00:13:30.4473029Z [14,953 / 15,187] 48 actions running 2024-12-18T00:13:30.4473712Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T00:13:30.4474418Z @stablehlo//:linalg_passes; 39s local 2024-12-18T00:13:30.4475293Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T00:13:30.4476332Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2024-12-18T00:13:30.4477395Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 24s local 2024-12-18T00:13:30.4478362Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:30.4479226Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 21s local 2024-12-18T00:13:30.4480224Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local ... 2024-12-18T00:13:30.6996701Z 2024-12-18T00:13:30.6997560Z  2024-12-18T00:13:30.6998047Z  2024-12-18T00:13:30.6998481Z  2024-12-18T00:13:30.6998879Z  2024-12-18T00:13:30.6999288Z  2024-12-18T00:13:30.6999701Z  2024-12-18T00:13:30.7000131Z  2024-12-18T00:13:30.7000548Z  2024-12-18T00:13:30.7001142Z [14,954 / 15,187] 48 actions, 47 running 2024-12-18T00:13:30.7001928Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T00:13:30.7002674Z @stablehlo//:linalg_passes; 39s local 2024-12-18T00:13:30.7003603Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T00:13:30.7004648Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2024-12-18T00:13:30.7005648Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 24s local 2024-12-18T00:13:30.7006478Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:30.7007316Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 21s local 2024-12-18T00:13:30.7008205Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local ... 2024-12-18T00:13:31.0473275Z 2024-12-18T00:13:31.0474064Z  2024-12-18T00:13:31.0474505Z  2024-12-18T00:13:31.0474914Z  2024-12-18T00:13:31.0475318Z  2024-12-18T00:13:31.0475700Z  2024-12-18T00:13:31.0476132Z  2024-12-18T00:13:31.0476559Z  2024-12-18T00:13:31.0476917Z  2024-12-18T00:13:31.0477482Z [14,955 / 15,187] 48 actions running 2024-12-18T00:13:31.0478236Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T00:13:31.0478900Z @stablehlo//:linalg_passes; 40s local 2024-12-18T00:13:31.0479777Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2024-12-18T00:13:31.0480742Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2024-12-18T00:13:31.0481814Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 25s local 2024-12-18T00:13:31.0482776Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:31.0483614Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 21s local 2024-12-18T00:13:31.0484631Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local ... 2024-12-18T00:13:31.2882262Z 2024-12-18T00:13:31.2883125Z  2024-12-18T00:13:31.2883605Z  2024-12-18T00:13:31.2884186Z  2024-12-18T00:13:31.2884570Z  2024-12-18T00:13:31.2884975Z  2024-12-18T00:13:31.2885377Z  2024-12-18T00:13:31.2885765Z  2024-12-18T00:13:31.2886127Z  2024-12-18T00:13:31.2886692Z [14,956 / 15,187] 48 actions, 47 running 2024-12-18T00:13:31.2887489Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T00:13:31.2888335Z @stablehlo//:linalg_passes; 40s local 2024-12-18T00:13:31.2889191Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2024-12-18T00:13:31.2890384Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 25s local 2024-12-18T00:13:31.2891392Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:31.2892334Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 22s local 2024-12-18T00:13:31.2893416Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local 2024-12-18T00:13:31.2894289Z @xla//xla/mlir_hlo:mhlo_passes; 21s local ... 2024-12-18T00:13:31.6479373Z 2024-12-18T00:13:31.6480201Z  2024-12-18T00:13:31.6480780Z  2024-12-18T00:13:31.6481190Z  2024-12-18T00:13:31.6481758Z  2024-12-18T00:13:31.6482170Z  2024-12-18T00:13:31.6482563Z  2024-12-18T00:13:31.6482950Z  2024-12-18T00:13:31.6483356Z  2024-12-18T00:13:31.6483910Z [14,956 / 15,187] 48 actions running 2024-12-18T00:13:31.6484666Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T00:13:31.6485359Z @stablehlo//:linalg_passes; 40s local 2024-12-18T00:13:31.6486244Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2024-12-18T00:13:31.6487443Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 25s local 2024-12-18T00:13:31.6488458Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:31.6489350Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 22s local 2024-12-18T00:13:31.6490349Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2024-12-18T00:13:31.6491224Z @xla//xla/mlir_hlo:mhlo_passes; 21s local ... 2024-12-18T00:13:32.0484470Z 2024-12-18T00:13:32.0485367Z  2024-12-18T00:13:32.0485836Z  2024-12-18T00:13:32.0486225Z  2024-12-18T00:13:32.0486629Z  2024-12-18T00:13:32.0487021Z  2024-12-18T00:13:32.0487424Z  2024-12-18T00:13:32.0487828Z  2024-12-18T00:13:32.0488238Z  2024-12-18T00:13:32.0488835Z [14,957 / 15,187] 48 actions running 2024-12-18T00:13:32.0489619Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T00:13:32.0490378Z @stablehlo//:linalg_passes; 41s local 2024-12-18T00:13:32.0491251Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2024-12-18T00:13:32.0492754Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2024-12-18T00:13:32.0493760Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T00:13:32.0494809Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 22s local 2024-12-18T00:13:32.0495861Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2024-12-18T00:13:32.0496886Z @xla//xla/mlir_hlo:mhlo_passes; 22s local ... 2024-12-18T00:13:33.2494007Z 2024-12-18T00:13:33.2494898Z  2024-12-18T00:13:33.2495408Z  2024-12-18T00:13:33.2495793Z  2024-12-18T00:13:33.2496180Z  2024-12-18T00:13:33.2496695Z  2024-12-18T00:13:33.2497124Z  2024-12-18T00:13:33.2497509Z  2024-12-18T00:13:33.2497886Z  2024-12-18T00:13:33.2498427Z [14,957 / 15,187] 48 actions running 2024-12-18T00:13:33.2499114Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T00:13:33.2499783Z @stablehlo//:linalg_passes; 42s local 2024-12-18T00:13:33.2500619Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2024-12-18T00:13:33.2501993Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2024-12-18T00:13:33.2502946Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T00:13:33.2503881Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 24s local 2024-12-18T00:13:33.2504826Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 23s local 2024-12-18T00:13:33.2505635Z @xla//xla/mlir_hlo:mhlo_passes; 23s local ... 2024-12-18T00:13:33.4498087Z 2024-12-18T00:13:33.4498921Z  2024-12-18T00:13:33.4499382Z  2024-12-18T00:13:33.4500097Z  2024-12-18T00:13:33.4500498Z  2024-12-18T00:13:33.4500887Z  2024-12-18T00:13:33.4501272Z  2024-12-18T00:13:33.4501659Z  2024-12-18T00:13:33.4502049Z  2024-12-18T00:13:33.4502636Z [14,958 / 15,187] 48 actions, 47 running 2024-12-18T00:13:33.4503389Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T00:13:33.4504090Z @stablehlo//:linalg_passes; 42s local 2024-12-18T00:13:33.4505008Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2024-12-18T00:13:33.4506142Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2024-12-18T00:13:33.4507095Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T00:13:33.4507986Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 24s local 2024-12-18T00:13:33.4509035Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2024-12-18T00:13:33.4509893Z @xla//xla/mlir_hlo:mhlo_passes; 23s local ... 2024-12-18T00:13:33.7072456Z 2024-12-18T00:13:33.7073350Z  2024-12-18T00:13:33.7073833Z  2024-12-18T00:13:33.7074223Z  2024-12-18T00:13:33.7074640Z  2024-12-18T00:13:33.7075048Z  2024-12-18T00:13:33.7075439Z  2024-12-18T00:13:33.7075827Z  2024-12-18T00:13:33.7076277Z  2024-12-18T00:13:33.7076877Z [14,959 / 15,187] 48 actions, 47 running 2024-12-18T00:13:33.7077645Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T00:13:33.7078336Z @stablehlo//:linalg_passes; 42s local 2024-12-18T00:13:33.7079249Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2024-12-18T00:13:33.7080436Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2024-12-18T00:13:33.7081476Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T00:13:33.7082537Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 24s local 2024-12-18T00:13:33.7083554Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2024-12-18T00:13:33.7084351Z @xla//xla/mlir_hlo:mhlo_passes; 23s local ... 2024-12-18T00:13:33.9084783Z 2024-12-18T00:13:33.9085646Z  2024-12-18T00:13:33.9086100Z  2024-12-18T00:13:33.9086471Z  2024-12-18T00:13:33.9086859Z  2024-12-18T00:13:33.9087232Z  2024-12-18T00:13:33.9087929Z  2024-12-18T00:13:33.9088318Z  2024-12-18T00:13:33.9088702Z  2024-12-18T00:13:33.9089300Z [14,960 / 15,187] 48 actions, 47 running 2024-12-18T00:13:33.9090088Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T00:13:33.9090825Z @stablehlo//:linalg_passes; 42s local 2024-12-18T00:13:33.9091740Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2024-12-18T00:13:33.9092948Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2024-12-18T00:13:33.9093955Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T00:13:33.9094797Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 24s local 2024-12-18T00:13:33.9095787Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2024-12-18T00:13:33.9096646Z @xla//xla/mlir_hlo:mhlo_passes; 23s local ... 2024-12-18T00:13:34.1366058Z 2024-12-18T00:13:34.1366915Z  2024-12-18T00:13:34.1367416Z  2024-12-18T00:13:34.1367831Z  2024-12-18T00:13:34.1368208Z  2024-12-18T00:13:34.1368607Z  2024-12-18T00:13:34.1369243Z  2024-12-18T00:13:34.1369636Z  2024-12-18T00:13:34.1370005Z  2024-12-18T00:13:34.1370564Z [14,961 / 15,187] 48 actions, 47 running 2024-12-18T00:13:34.1371455Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T00:13:34.1372161Z @stablehlo//:linalg_passes; 43s local 2024-12-18T00:13:34.1373056Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T00:13:34.1374289Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 28s local 2024-12-18T00:13:34.1375434Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T00:13:34.1376311Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 24s local 2024-12-18T00:13:34.1377519Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2024-12-18T00:13:34.1378334Z @xla//xla/mlir_hlo:mhlo_passes; 24s local ... 2024-12-18T00:13:34.3464535Z 2024-12-18T00:13:34.3465433Z  2024-12-18T00:13:34.3465903Z  2024-12-18T00:13:34.3466323Z  2024-12-18T00:13:34.3466717Z  2024-12-18T00:13:34.3467123Z  2024-12-18T00:13:34.3467518Z  2024-12-18T00:13:34.3467923Z  2024-12-18T00:13:34.3468294Z  2024-12-18T00:13:34.3468884Z [14,962 / 15,187] 48 actions, 47 running 2024-12-18T00:13:34.3469663Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T00:13:34.3470381Z @stablehlo//:linalg_passes; 43s local 2024-12-18T00:13:34.3471227Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T00:13:34.3472169Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T00:13:34.3473021Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local 2024-12-18T00:13:34.3474061Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2024-12-18T00:13:34.3474880Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T00:13:34.3475571Z @xla//xla/mlir_hlo:mhlo_passes; 20s local ... 2024-12-18T00:13:34.6080898Z 2024-12-18T00:13:34.6081815Z  2024-12-18T00:13:34.6082258Z  2024-12-18T00:13:34.6082653Z  2024-12-18T00:13:34.6083011Z  2024-12-18T00:13:34.6083378Z  2024-12-18T00:13:34.6083743Z  2024-12-18T00:13:34.6084132Z  2024-12-18T00:13:34.6084507Z  2024-12-18T00:13:34.6085080Z [14,963 / 15,187] 48 actions, 47 running 2024-12-18T00:13:34.6085812Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T00:13:34.6086503Z @stablehlo//:linalg_passes; 43s local 2024-12-18T00:13:34.6087406Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T00:13:34.6088482Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local 2024-12-18T00:13:34.6089485Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2024-12-18T00:13:34.6090319Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T00:13:34.6091261Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T00:13:34.6091952Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2024-12-18T00:13:34.8224114Z 2024-12-18T00:13:34.8225010Z  2024-12-18T00:13:34.8225497Z  2024-12-18T00:13:34.8225886Z  2024-12-18T00:13:34.8226279Z  2024-12-18T00:13:34.8226688Z  2024-12-18T00:13:34.8227083Z  2024-12-18T00:13:34.8227480Z  2024-12-18T00:13:34.8227852Z  2024-12-18T00:13:34.8228458Z [14,964 / 15,187] 48 actions, 47 running 2024-12-18T00:13:34.8229199Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T00:13:34.8229905Z @stablehlo//:linalg_passes; 43s local 2024-12-18T00:13:34.8230829Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T00:13:34.8231951Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local 2024-12-18T00:13:34.8232912Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2024-12-18T00:13:34.8233777Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T00:13:34.8234699Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T00:13:34.8235440Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2024-12-18T00:13:35.0509531Z 2024-12-18T00:13:35.0510446Z  2024-12-18T00:13:35.0510916Z  2024-12-18T00:13:35.0511320Z  2024-12-18T00:13:35.0511710Z  2024-12-18T00:13:35.0512087Z  2024-12-18T00:13:35.0512477Z  2024-12-18T00:13:35.0512858Z  2024-12-18T00:13:35.0513200Z  2024-12-18T00:13:35.0513732Z [14,964 / 15,187] 48 actions running 2024-12-18T00:13:35.0514774Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T00:13:35.0515514Z @stablehlo//:linalg_passes; 44s local 2024-12-18T00:13:35.0516408Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T00:13:35.0517527Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local 2024-12-18T00:13:35.0518499Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2024-12-18T00:13:35.0519310Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T00:13:35.0519926Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T00:13:35.0520796Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:35.5754800Z 2024-12-18T00:13:35.5755679Z  2024-12-18T00:13:35.5756172Z  2024-12-18T00:13:35.5756579Z  2024-12-18T00:13:35.5756986Z  2024-12-18T00:13:35.5757372Z  2024-12-18T00:13:35.5757782Z  2024-12-18T00:13:35.5758170Z  2024-12-18T00:13:35.5758555Z  2024-12-18T00:13:35.5759161Z [14,965 / 15,187] 48 actions, 47 running 2024-12-18T00:13:35.5759880Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T00:13:35.5760562Z @stablehlo//:linalg_passes; 44s local 2024-12-18T00:13:35.5761305Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T00:13:35.5762370Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local 2024-12-18T00:13:35.5763251Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local 2024-12-18T00:13:35.5763974Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T00:13:35.5764542Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T00:13:35.5765176Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:35.8516630Z 2024-12-18T00:13:35.8517542Z  2024-12-18T00:13:35.8517990Z  2024-12-18T00:13:35.8518360Z  2024-12-18T00:13:35.8518767Z  2024-12-18T00:13:35.8519173Z  2024-12-18T00:13:35.8519571Z  2024-12-18T00:13:35.8520001Z  2024-12-18T00:13:35.8520382Z  2024-12-18T00:13:35.8520965Z [14,965 / 15,187] 48 actions running 2024-12-18T00:13:35.8521723Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T00:13:35.8522438Z @stablehlo//:linalg_passes; 44s local 2024-12-18T00:13:35.8523301Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T00:13:35.8524728Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local 2024-12-18T00:13:35.8525754Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local 2024-12-18T00:13:35.8526603Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T00:13:35.8527258Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T00:13:35.8527983Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:36.0532490Z 2024-12-18T00:13:36.0533375Z  2024-12-18T00:13:36.0533827Z  2024-12-18T00:13:36.0534242Z  2024-12-18T00:13:36.0534642Z  2024-12-18T00:13:36.0535083Z  2024-12-18T00:13:36.0535477Z  2024-12-18T00:13:36.0535844Z  2024-12-18T00:13:36.0536250Z  2024-12-18T00:13:36.0536966Z [14,967 / 15,187] 48 actions, 47 running 2024-12-18T00:13:36.0537716Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T00:13:36.0538442Z @stablehlo//:linalg_passes; 45s local 2024-12-18T00:13:36.0539253Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T00:13:36.0540631Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local 2024-12-18T00:13:36.0541732Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local 2024-12-18T00:13:36.0542567Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:36.0543241Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T00:13:36.0543936Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:36.4523216Z 2024-12-18T00:13:36.4524055Z  2024-12-18T00:13:36.4524508Z  2024-12-18T00:13:36.4525127Z  2024-12-18T00:13:36.4525525Z  2024-12-18T00:13:36.4525883Z  2024-12-18T00:13:36.4526238Z  2024-12-18T00:13:36.4526550Z  2024-12-18T00:13:36.4526868Z  2024-12-18T00:13:36.4527433Z [14,967 / 15,187] 48 actions running 2024-12-18T00:13:36.4528238Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T00:13:36.4528916Z @stablehlo//:linalg_passes; 45s local 2024-12-18T00:13:36.4529692Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T00:13:36.4530708Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 27s local 2024-12-18T00:13:36.4531790Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2024-12-18T00:13:36.4532562Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:36.4533140Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T00:13:36.4533787Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:36.6526838Z 2024-12-18T00:13:36.6527738Z  2024-12-18T00:13:36.6528199Z  2024-12-18T00:13:36.6528542Z  2024-12-18T00:13:36.6528867Z  2024-12-18T00:13:36.6529202Z  2024-12-18T00:13:36.6529584Z  2024-12-18T00:13:36.6529959Z  2024-12-18T00:13:36.6530332Z  2024-12-18T00:13:36.6530897Z [14,968 / 15,187] 47 actions running 2024-12-18T00:13:36.6531660Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T00:13:36.6532375Z @stablehlo//:linalg_passes; 45s local 2024-12-18T00:13:36.6533263Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T00:13:36.6534432Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 27s local 2024-12-18T00:13:36.6535268Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:36.6535884Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T00:13:36.6536903Z Compiling mlir/lib/Dialect/Linalg/Transforms/HoistPadding.cpp; 14s local 2024-12-18T00:13:36.6538132Z Compiling mlir/lib/Dialect/Linalg/Transforms/Hoisting.cpp; 13s local ... 2024-12-18T00:13:36.8856544Z 2024-12-18T00:13:36.8857433Z  2024-12-18T00:13:36.8857886Z  2024-12-18T00:13:36.8858283Z  2024-12-18T00:13:36.8858642Z  2024-12-18T00:13:36.8858999Z  2024-12-18T00:13:36.8859382Z  2024-12-18T00:13:36.8860026Z  2024-12-18T00:13:36.8860395Z  2024-12-18T00:13:36.8860991Z [14,969 / 15,187] 48 actions, 47 running 2024-12-18T00:13:36.8861753Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T00:13:36.8862730Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T00:13:36.8863823Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 27s local 2024-12-18T00:13:36.8864694Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:36.8865320Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T00:13:36.8866170Z Compiling mlir/lib/Dialect/Linalg/Transforms/HoistPadding.cpp; 15s local 2024-12-18T00:13:36.8867373Z Compiling mlir/lib/Dialect/Linalg/Transforms/Hoisting.cpp; 13s local 2024-12-18T00:13:36.8868320Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2024-12-18T00:13:37.1601231Z 2024-12-18T00:13:37.1602081Z  2024-12-18T00:13:37.1602561Z  2024-12-18T00:13:37.1603001Z  2024-12-18T00:13:37.1603415Z  2024-12-18T00:13:37.1603812Z  2024-12-18T00:13:37.1604227Z  2024-12-18T00:13:37.1604930Z  2024-12-18T00:13:37.1605364Z  2024-12-18T00:13:37.1605966Z [14,970 / 15,187] 48 actions, 47 running 2024-12-18T00:13:37.1606856Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T00:13:37.1607874Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T00:13:37.1608833Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T00:13:37.1609518Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T00:13:37.1610584Z Compiling mlir/lib/Dialect/Linalg/Transforms/HoistPadding.cpp; 15s local 2024-12-18T00:13:37.1611690Z Compiling mlir/lib/Dialect/Linalg/Transforms/Hoisting.cpp; 14s local 2024-12-18T00:13:37.1612620Z @llvm-project//mlir:LinalgTransforms; 13s local 2024-12-18T00:13:37.1613256Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2024-12-18T00:13:37.4533940Z 2024-12-18T00:13:37.4534857Z  2024-12-18T00:13:37.4535339Z  2024-12-18T00:13:37.4535743Z  2024-12-18T00:13:37.4536143Z  2024-12-18T00:13:37.4536731Z  2024-12-18T00:13:37.4537103Z  2024-12-18T00:13:37.4537484Z  2024-12-18T00:13:37.4537886Z  2024-12-18T00:13:37.4538448Z [14,970 / 15,187] 48 actions running 2024-12-18T00:13:37.4539207Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T00:13:37.4540179Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T00:13:37.4541091Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T00:13:37.4541772Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T00:13:37.4542603Z Compiling mlir/lib/Dialect/Linalg/Transforms/HoistPadding.cpp; 15s local 2024-12-18T00:13:37.4543787Z Compiling mlir/lib/Dialect/Linalg/Transforms/Hoisting.cpp; 14s local 2024-12-18T00:13:37.4548109Z @llvm-project//mlir:LinalgTransforms; 14s local 2024-12-18T00:13:37.4549074Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2024-12-18T00:13:38.1985828Z 2024-12-18T00:13:38.1986647Z  2024-12-18T00:13:38.1987140Z  2024-12-18T00:13:38.1987541Z  2024-12-18T00:13:38.1987938Z  2024-12-18T00:13:38.1988356Z  2024-12-18T00:13:38.1988765Z  2024-12-18T00:13:38.1989134Z  2024-12-18T00:13:38.1989519Z  2024-12-18T00:13:38.1990063Z [14,971 / 15,187] 48 actions, 47 running 2024-12-18T00:13:38.1990821Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T00:13:38.1991749Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T00:13:38.1992697Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T00:13:38.1993349Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T00:13:38.1994278Z Compiling mlir/lib/Dialect/Linalg/Transforms/HoistPadding.cpp; 16s local 2024-12-18T00:13:38.1995295Z @llvm-project//mlir:LinalgTransforms; 14s local 2024-12-18T00:13:38.1996601Z Compiling mlir/lib/Dialect/Linalg/Transforms/Interchange.cpp; 14s local 2024-12-18T00:13:38.1997634Z Compiling xla/pjrt/mlir_to_hlo.cc; 14s local ... 2024-12-18T00:13:38.4532807Z 2024-12-18T00:13:38.4533674Z  2024-12-18T00:13:38.4534161Z  2024-12-18T00:13:38.4534605Z  2024-12-18T00:13:38.4535016Z  2024-12-18T00:13:38.4535411Z  2024-12-18T00:13:38.4535782Z  2024-12-18T00:13:38.4536165Z  2024-12-18T00:13:38.4536725Z  2024-12-18T00:13:38.4537302Z [14,972 / 15,187] 48 actions, 47 running 2024-12-18T00:13:38.4538067Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T00:13:38.4539060Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T00:13:38.4540000Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T00:13:38.4540659Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T00:13:38.4541549Z Compiling mlir/lib/Dialect/Linalg/Transforms/HoistPadding.cpp; 16s local 2024-12-18T00:13:38.4542520Z @llvm-project//mlir:LinalgTransforms; 15s local 2024-12-18T00:13:38.4543562Z Compiling xla/pjrt/mlir_to_hlo.cc; 14s local 2024-12-18T00:13:38.4544733Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 14s local ... 2024-12-18T00:13:38.6542837Z 2024-12-18T00:13:38.6543699Z  2024-12-18T00:13:38.6544416Z  2024-12-18T00:13:38.6544800Z  2024-12-18T00:13:38.6545163Z  2024-12-18T00:13:38.6545562Z  2024-12-18T00:13:38.6545946Z  2024-12-18T00:13:38.6546341Z  2024-12-18T00:13:38.6546735Z  2024-12-18T00:13:38.6547291Z [14,972 / 15,187] 48 actions running 2024-12-18T00:13:38.6548333Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T00:13:38.6549371Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T00:13:38.6550259Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T00:13:38.6550893Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T00:13:38.6551805Z Compiling mlir/lib/Dialect/Linalg/Transforms/HoistPadding.cpp; 16s local 2024-12-18T00:13:38.6552786Z @llvm-project//mlir:LinalgTransforms; 15s local 2024-12-18T00:13:38.6553546Z Compiling xla/pjrt/mlir_to_hlo.cc; 14s local 2024-12-18T00:13:38.6554500Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 14s local ... 2024-12-18T00:13:38.8548287Z 2024-12-18T00:13:38.8549119Z  2024-12-18T00:13:38.8549592Z  2024-12-18T00:13:38.8549983Z  2024-12-18T00:13:38.8550378Z  2024-12-18T00:13:38.8550777Z  2024-12-18T00:13:38.8551176Z  2024-12-18T00:13:38.8551574Z  2024-12-18T00:13:38.8551953Z  2024-12-18T00:13:38.8552550Z [14,973 / 15,187] 48 actions running 2024-12-18T00:13:38.8553295Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T00:13:38.8554267Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T00:13:38.8555202Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T00:13:38.8555837Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T00:13:38.8556546Z @llvm-project//mlir:LinalgTransforms; 15s local 2024-12-18T00:13:38.8557271Z Compiling xla/pjrt/mlir_to_hlo.cc; 14s local 2024-12-18T00:13:38.8558147Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 14s local 2024-12-18T00:13:38.8559089Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:39.2552212Z 2024-12-18T00:13:39.2553030Z  2024-12-18T00:13:39.2553490Z  2024-12-18T00:13:39.2553902Z  2024-12-18T00:13:39.2554297Z  2024-12-18T00:13:39.2554701Z  2024-12-18T00:13:39.2555073Z  2024-12-18T00:13:39.2555498Z  2024-12-18T00:13:39.2555887Z  2024-12-18T00:13:39.2556457Z [14,974 / 15,187] 48 actions running 2024-12-18T00:13:39.2557200Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T00:13:39.2558301Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2024-12-18T00:13:39.2559559Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T00:13:39.2560204Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T00:13:39.2560893Z Compiling xla/pjrt/mlir_to_hlo.cc; 15s local 2024-12-18T00:13:39.2561790Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 14s local 2024-12-18T00:13:39.2562658Z @llvm-project//mlir:LinalgTransforms; 14s local 2024-12-18T00:13:39.2563552Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 14s local ... 2024-12-18T00:13:39.9810755Z 2024-12-18T00:13:39.9811610Z  2024-12-18T00:13:39.9812074Z  2024-12-18T00:13:39.9812485Z  2024-12-18T00:13:39.9812892Z  2024-12-18T00:13:39.9813292Z  2024-12-18T00:13:39.9813822Z  2024-12-18T00:13:39.9814223Z  2024-12-18T00:13:39.9814615Z  2024-12-18T00:13:39.9815198Z [14,975 / 15,187] 48 actions, 47 running 2024-12-18T00:13:39.9815899Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2024-12-18T00:13:39.9816980Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2024-12-18T00:13:39.9818202Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T00:13:39.9818920Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:39.9819559Z Compiling xla/pjrt/mlir_to_hlo.cc; 15s local 2024-12-18T00:13:39.9820784Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 15s local 2024-12-18T00:13:39.9821844Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 15s local 2024-12-18T00:13:39.9822767Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:40.2559790Z 2024-12-18T00:13:40.2560622Z  2024-12-18T00:13:40.2561089Z  2024-12-18T00:13:40.2561851Z  2024-12-18T00:13:40.2562231Z  2024-12-18T00:13:40.2562678Z  2024-12-18T00:13:40.2563046Z  2024-12-18T00:13:40.2563416Z  2024-12-18T00:13:40.2563810Z  2024-12-18T00:13:40.2564387Z [14,975 / 15,187] 48 actions running 2024-12-18T00:13:40.2565256Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2024-12-18T00:13:40.2566293Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2024-12-18T00:13:40.2567257Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T00:13:40.2567884Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:40.2568542Z Compiling xla/pjrt/mlir_to_hlo.cc; 16s local 2024-12-18T00:13:40.2569370Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 15s local 2024-12-18T00:13:40.2570407Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 15s local 2024-12-18T00:13:40.2571221Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T00:13:40.5238880Z 2024-12-18T00:13:40.5239745Z  2024-12-18T00:13:40.5240229Z  2024-12-18T00:13:40.5240643Z  2024-12-18T00:13:40.5241184Z  2024-12-18T00:13:40.5241580Z  2024-12-18T00:13:40.5241956Z  2024-12-18T00:13:40.5242362Z  2024-12-18T00:13:40.5242767Z  2024-12-18T00:13:40.5243392Z [14,976 / 15,187] 48 actions, 47 running 2024-12-18T00:13:40.5244417Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2024-12-18T00:13:40.5245206Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T00:13:40.5245868Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:40.5246587Z Compiling xla/pjrt/mlir_to_hlo.cc; 16s local 2024-12-18T00:13:40.5247411Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local 2024-12-18T00:13:40.5248441Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 15s local 2024-12-18T00:13:40.5249295Z @llvm-project//mlir:LinalgTransforms; 15s local 2024-12-18T00:13:40.5250256Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 14s local ... 2024-12-18T00:13:40.7267139Z 2024-12-18T00:13:40.7268005Z  2024-12-18T00:13:40.7268405Z  2024-12-18T00:13:40.7268775Z  2024-12-18T00:13:40.7269109Z  2024-12-18T00:13:40.7269426Z  2024-12-18T00:13:40.7269761Z  2024-12-18T00:13:40.7270470Z  2024-12-18T00:13:40.7270805Z  2024-12-18T00:13:40.7271308Z [14,977 / 15,187] 48 actions, 47 running 2024-12-18T00:13:40.7271966Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T00:13:40.7272571Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T00:13:40.7273125Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T00:13:40.7273685Z Compiling xla/pjrt/mlir_to_hlo.cc; 16s local 2024-12-18T00:13:40.7274395Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local 2024-12-18T00:13:40.7275160Z @llvm-project//mlir:LinalgTransforms; 15s local 2024-12-18T00:13:40.7275869Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 15s local 2024-12-18T00:13:40.7276605Z Compiling xla/pjrt/pjrt_c_api_client.cc; 14s local ... 2024-12-18T00:13:41.0584187Z 2024-12-18T00:13:41.0585021Z  2024-12-18T00:13:41.0585483Z  2024-12-18T00:13:41.0585851Z  2024-12-18T00:13:41.0586217Z  2024-12-18T00:13:41.0586612Z  2024-12-18T00:13:41.0586973Z  2024-12-18T00:13:41.0587460Z  2024-12-18T00:13:41.0587848Z  2024-12-18T00:13:41.0588656Z [14,977 / 15,187] 48 actions running 2024-12-18T00:13:41.0589398Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T00:13:41.0592527Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T00:13:41.0593155Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T00:13:41.0593885Z Compiling xla/pjrt/mlir_to_hlo.cc; 16s local 2024-12-18T00:13:41.0594728Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local 2024-12-18T00:13:41.0595607Z @llvm-project//mlir:LinalgTransforms; 15s local 2024-12-18T00:13:41.0596661Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 15s local 2024-12-18T00:13:41.0597651Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T00:13:41.5851774Z 2024-12-18T00:13:41.5852643Z  2024-12-18T00:13:41.5853081Z  2024-12-18T00:13:41.5853480Z  2024-12-18T00:13:41.5853855Z  2024-12-18T00:13:41.5854199Z  2024-12-18T00:13:41.5854547Z  2024-12-18T00:13:41.5854907Z  2024-12-18T00:13:41.5855291Z  2024-12-18T00:13:41.5855918Z [14,978 / 15,187] 48 actions, 47 running 2024-12-18T00:13:41.5856810Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T00:13:41.5857518Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T00:13:41.5858320Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T00:13:41.5858920Z Compiling xla/pjrt/mlir_to_hlo.cc; 17s local 2024-12-18T00:13:41.5859730Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 17s local 2024-12-18T00:13:41.5860623Z @llvm-project//mlir:LinalgTransforms; 16s local 2024-12-18T00:13:41.5861437Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 15s local 2024-12-18T00:13:41.5862272Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T00:13:41.8572525Z 2024-12-18T00:13:41.8573309Z  2024-12-18T00:13:41.8573759Z  2024-12-18T00:13:41.8574129Z  2024-12-18T00:13:41.8574483Z  2024-12-18T00:13:41.8574824Z  2024-12-18T00:13:41.8575206Z  2024-12-18T00:13:41.8575555Z  2024-12-18T00:13:41.8575903Z  2024-12-18T00:13:41.8576554Z [14,978 / 15,187] 48 actions running 2024-12-18T00:13:41.8577238Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T00:13:41.8577888Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T00:13:41.8578423Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T00:13:41.8578992Z Compiling xla/pjrt/mlir_to_hlo.cc; 17s local 2024-12-18T00:13:41.8579733Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 17s local 2024-12-18T00:13:41.8580491Z @llvm-project//mlir:LinalgTransforms; 16s local 2024-12-18T00:13:41.8581223Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 16s local 2024-12-18T00:13:41.8581958Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T00:13:42.7677765Z 2024-12-18T00:13:42.7678692Z  2024-12-18T00:13:42.7679263Z  2024-12-18T00:13:42.7679727Z  2024-12-18T00:13:42.7680112Z  2024-12-18T00:13:42.7680465Z  2024-12-18T00:13:42.7680811Z  2024-12-18T00:13:42.7681180Z  2024-12-18T00:13:42.7681578Z  2024-12-18T00:13:42.7682274Z [14,979 / 15,187] 48 actions, 47 running 2024-12-18T00:13:42.7683057Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T00:13:42.7683727Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T00:13:42.7684331Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T00:13:42.7684956Z Compiling xla/pjrt/mlir_to_hlo.cc; 18s local 2024-12-18T00:13:42.7685719Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 18s local 2024-12-18T00:13:42.7686511Z @llvm-project//mlir:LinalgTransforms; 17s local 2024-12-18T00:13:42.7687320Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 17s local 2024-12-18T00:13:42.7688377Z Compiling xla/pjrt/pjrt_c_api_client.cc; 16s local ... 2024-12-18T00:13:42.9901872Z 2024-12-18T00:13:42.9902796Z  2024-12-18T00:13:42.9903347Z  2024-12-18T00:13:42.9904056Z  2024-12-18T00:13:42.9904613Z  2024-12-18T00:13:42.9905035Z  2024-12-18T00:13:42.9905627Z  2024-12-18T00:13:42.9906147Z  2024-12-18T00:13:42.9906594Z  2024-12-18T00:13:42.9907236Z [14,980 / 15,187] 48 actions, 47 running 2024-12-18T00:13:42.9908082Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T00:13:42.9908945Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T00:13:42.9909548Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T00:13:42.9910396Z Compiling xla/pjrt/mlir_to_hlo.cc; 18s local 2024-12-18T00:13:42.9911126Z @llvm-project//mlir:LinalgTransforms; 17s local 2024-12-18T00:13:42.9912051Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 17s local 2024-12-18T00:13:42.9912990Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local 2024-12-18T00:13:42.9914006Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local ... 2024-12-18T00:13:43.2583754Z 2024-12-18T00:13:43.2584611Z  2024-12-18T00:13:43.2585073Z  2024-12-18T00:13:43.2585438Z  2024-12-18T00:13:43.2585857Z  2024-12-18T00:13:43.2586242Z  2024-12-18T00:13:43.2586608Z  2024-12-18T00:13:43.2586969Z  2024-12-18T00:13:43.2587320Z  2024-12-18T00:13:43.2587872Z [14,980 / 15,187] 48 actions running 2024-12-18T00:13:43.2588604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T00:13:43.2589328Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T00:13:43.2589984Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T00:13:43.2590672Z Compiling xla/pjrt/mlir_to_hlo.cc; 19s local 2024-12-18T00:13:43.2591525Z @llvm-project//mlir:LinalgTransforms; 17s local 2024-12-18T00:13:43.2592346Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 17s local 2024-12-18T00:13:43.2593174Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local 2024-12-18T00:13:43.2594058Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local ... 2024-12-18T00:13:43.6100474Z 2024-12-18T00:13:43.6101391Z  2024-12-18T00:13:43.6101977Z  2024-12-18T00:13:43.6102500Z  2024-12-18T00:13:43.6102909Z  2024-12-18T00:13:43.6103264Z  2024-12-18T00:13:43.6103627Z  2024-12-18T00:13:43.6104004Z  2024-12-18T00:13:43.6104396Z  2024-12-18T00:13:43.6104972Z [14,981 / 15,187] 48 actions, 47 running 2024-12-18T00:13:43.6105827Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T00:13:43.6106707Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T00:13:43.6107492Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T00:13:43.6108105Z Compiling xla/pjrt/mlir_to_hlo.cc; 19s local 2024-12-18T00:13:43.6108749Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T00:13:43.6109522Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 17s local 2024-12-18T00:13:43.6110643Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local 2024-12-18T00:13:43.6111527Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local ... 2024-12-18T00:13:43.8586688Z 2024-12-18T00:13:43.8587513Z  2024-12-18T00:13:43.8587981Z  2024-12-18T00:13:43.8588345Z  2024-12-18T00:13:43.8588711Z  2024-12-18T00:13:43.8589083Z  2024-12-18T00:13:43.8589464Z  2024-12-18T00:13:43.8589855Z  2024-12-18T00:13:43.8590236Z  2024-12-18T00:13:43.8590811Z [14,981 / 15,187] 48 actions running 2024-12-18T00:13:43.8591526Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T00:13:43.8592288Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T00:13:43.8592954Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T00:13:43.8593630Z Compiling xla/pjrt/mlir_to_hlo.cc; 19s local 2024-12-18T00:13:43.8594324Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T00:13:43.8595163Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 18s local 2024-12-18T00:13:43.8596326Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local 2024-12-18T00:13:43.8597232Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local ... 2024-12-18T00:13:44.2429108Z 2024-12-18T00:13:44.2430370Z  2024-12-18T00:13:44.2431045Z  2024-12-18T00:13:44.2431713Z  2024-12-18T00:13:44.2432861Z  2024-12-18T00:13:44.2433449Z  2024-12-18T00:13:44.2433954Z  2024-12-18T00:13:44.2434493Z  2024-12-18T00:13:44.2434980Z  2024-12-18T00:13:44.2436028Z [14,982 / 15,187] 48 actions, 47 running 2024-12-18T00:13:44.2436833Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T00:13:44.2437718Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T00:13:44.2438519Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T00:13:44.2439347Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local 2024-12-18T00:13:44.2440262Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T00:13:44.2441241Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 18s local 2024-12-18T00:13:44.2442272Z Compiling xla/pjrt/pjrt_c_api_client.cc; 18s local 2024-12-18T00:13:44.2443387Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local ... 2024-12-18T00:13:44.4592543Z 2024-12-18T00:13:44.4593429Z  2024-12-18T00:13:44.4593880Z  2024-12-18T00:13:44.4594254Z  2024-12-18T00:13:44.4594645Z  2024-12-18T00:13:44.4595038Z  2024-12-18T00:13:44.4595419Z  2024-12-18T00:13:44.4595789Z  2024-12-18T00:13:44.4596170Z  2024-12-18T00:13:44.4596729Z [14,982 / 15,187] 48 actions running 2024-12-18T00:13:44.4597445Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T00:13:44.4598192Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T00:13:44.4598819Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T00:13:44.4599425Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local 2024-12-18T00:13:44.4600070Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T00:13:44.4600830Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 18s local 2024-12-18T00:13:44.4601617Z Compiling xla/pjrt/pjrt_c_api_client.cc; 18s local 2024-12-18T00:13:44.4602528Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local ... 2024-12-18T00:13:45.6600301Z 2024-12-18T00:13:45.6601580Z  2024-12-18T00:13:45.6602314Z  2024-12-18T00:13:45.6686608Z  2024-12-18T00:13:45.6687089Z  2024-12-18T00:13:45.6687479Z  2024-12-18T00:13:45.6687873Z  2024-12-18T00:13:45.6688309Z  2024-12-18T00:13:45.6688715Z  2024-12-18T00:13:45.6689286Z [14,982 / 15,187] 48 actions running 2024-12-18T00:13:45.6690050Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2024-12-18T00:13:45.6690780Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T00:13:45.6691451Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T00:13:45.6692612Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local 2024-12-18T00:13:45.6693341Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T00:13:45.6694117Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 19s local 2024-12-18T00:13:45.6694937Z Compiling xla/pjrt/pjrt_c_api_client.cc; 19s local 2024-12-18T00:13:45.6695831Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local ... 2024-12-18T00:13:46.5817462Z 2024-12-18T00:13:46.5818399Z  2024-12-18T00:13:46.5819031Z  2024-12-18T00:13:46.5819436Z  2024-12-18T00:13:46.5819822Z  2024-12-18T00:13:46.5820220Z  2024-12-18T00:13:46.5820631Z  2024-12-18T00:13:46.5821024Z  2024-12-18T00:13:46.5821413Z  2024-12-18T00:13:46.5822028Z [14,983 / 15,187] 48 actions, 47 running 2024-12-18T00:13:46.5822816Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T00:13:46.5823535Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T00:13:46.5824237Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T00:13:46.5825260Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2024-12-18T00:13:46.5826003Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T00:13:46.5826965Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 20s local 2024-12-18T00:13:46.5827882Z Compiling xla/pjrt/pjrt_c_api_client.cc; 20s local 2024-12-18T00:13:46.5829022Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local ... 2024-12-18T00:13:46.8609754Z 2024-12-18T00:13:46.8610638Z  2024-12-18T00:13:46.8611093Z  2024-12-18T00:13:46.8611507Z  2024-12-18T00:13:46.8612139Z  2024-12-18T00:13:46.8612497Z  2024-12-18T00:13:46.8612827Z  2024-12-18T00:13:46.8613198Z  2024-12-18T00:13:46.8613584Z  2024-12-18T00:13:46.8614094Z [14,983 / 15,187] 48 actions running 2024-12-18T00:13:46.8614778Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T00:13:46.8615471Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T00:13:46.8616074Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T00:13:46.8616878Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2024-12-18T00:13:46.8617549Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T00:13:46.8618282Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 21s local 2024-12-18T00:13:46.8619058Z Compiling xla/pjrt/pjrt_c_api_client.cc; 20s local 2024-12-18T00:13:46.8619954Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local ... 2024-12-18T00:13:47.0618243Z 2024-12-18T00:13:47.0619085Z  2024-12-18T00:13:47.0619562Z  2024-12-18T00:13:47.0619949Z  2024-12-18T00:13:47.0620331Z  2024-12-18T00:13:47.0620713Z  2024-12-18T00:13:47.0621089Z  2024-12-18T00:13:47.0621466Z  2024-12-18T00:13:47.0621871Z  2024-12-18T00:13:47.0622403Z [14,984 / 15,187] 48 actions running 2024-12-18T00:13:47.0623155Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T00:13:47.0623895Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T00:13:47.0624566Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T00:13:47.0625227Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2024-12-18T00:13:47.0625938Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T00:13:47.0626762Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 21s local 2024-12-18T00:13:47.0627525Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local 2024-12-18T00:13:47.0628353Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local ... 2024-12-18T00:13:47.8624739Z 2024-12-18T00:13:47.8625605Z  2024-12-18T00:13:47.8626085Z  2024-12-18T00:13:47.8626458Z  2024-12-18T00:13:47.8626814Z  2024-12-18T00:13:47.8627165Z  2024-12-18T00:13:47.8627539Z  2024-12-18T00:13:47.8627934Z  2024-12-18T00:13:47.8628324Z  2024-12-18T00:13:47.8629192Z [14,985 / 15,187] 47 actions running 2024-12-18T00:13:47.8629950Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T00:13:47.8630675Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T00:13:47.8631307Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T00:13:47.8631929Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2024-12-18T00:13:47.8632582Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:47.8633408Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2024-12-18T00:13:47.8634141Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local 2024-12-18T00:13:47.8635151Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local ... 2024-12-18T00:13:48.0693164Z 2024-12-18T00:13:48.0694049Z  2024-12-18T00:13:48.0694540Z  2024-12-18T00:13:48.0694936Z  2024-12-18T00:13:48.0695297Z  2024-12-18T00:13:48.0695647Z  2024-12-18T00:13:48.0696012Z  2024-12-18T00:13:48.0696548Z  2024-12-18T00:13:48.0696962Z  2024-12-18T00:13:48.0697499Z [14,988 / 15,187] 48 actions, 46 running 2024-12-18T00:13:48.0698519Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T00:13:48.0699253Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T00:13:48.0700047Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2024-12-18T00:13:48.0700735Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:48.0701460Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2024-12-18T00:13:48.0702226Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2024-12-18T00:13:48.0703342Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2024-12-18T00:13:48.0704293Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2024-12-18T00:13:48.4328617Z 2024-12-18T00:13:48.4329458Z  2024-12-18T00:13:48.4329933Z  2024-12-18T00:13:48.4330329Z  2024-12-18T00:13:48.4330705Z  2024-12-18T00:13:48.4331089Z  2024-12-18T00:13:48.4331492Z  2024-12-18T00:13:48.4331823Z  2024-12-18T00:13:48.4332200Z  2024-12-18T00:13:48.4332786Z [14,989 / 15,187] 48 actions, 47 running 2024-12-18T00:13:48.4333570Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T00:13:48.4334306Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T00:13:48.4334933Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2024-12-18T00:13:48.4335625Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:48.4336561Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2024-12-18T00:13:48.4337407Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2024-12-18T00:13:48.4338215Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T00:13:48.4339077Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 20s local ... 2024-12-18T00:13:48.6631266Z 2024-12-18T00:13:48.6632143Z  2024-12-18T00:13:48.6632687Z  2024-12-18T00:13:48.6633180Z  2024-12-18T00:13:48.6633616Z  2024-12-18T00:13:48.6634030Z  2024-12-18T00:13:48.6634387Z  2024-12-18T00:13:48.6634750Z  2024-12-18T00:13:48.6635107Z  2024-12-18T00:13:48.6635639Z [14,989 / 15,187] 48 actions running 2024-12-18T00:13:48.6636356Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T00:13:48.6637077Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T00:13:48.6637703Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2024-12-18T00:13:48.6638416Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:48.6639203Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2024-12-18T00:13:48.6640047Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2024-12-18T00:13:48.6640799Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:48.6641658Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 20s local ... 2024-12-18T00:13:49.2368975Z 2024-12-18T00:13:49.2369835Z  2024-12-18T00:13:49.2370577Z  2024-12-18T00:13:49.2370876Z  2024-12-18T00:13:49.2371191Z  2024-12-18T00:13:49.2371533Z  2024-12-18T00:13:49.2371856Z  2024-12-18T00:13:49.2372158Z  2024-12-18T00:13:49.2372468Z  2024-12-18T00:13:49.2372927Z [14,990 / 15,187] 48 actions, 47 running 2024-12-18T00:13:49.2373513Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T00:13:49.2374051Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T00:13:49.2374539Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2024-12-18T00:13:49.2375139Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2024-12-18T00:13:49.2375766Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2024-12-18T00:13:49.2376329Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:49.2377093Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 21s local 2024-12-18T00:13:49.2377804Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 21s local ... 2024-12-18T00:13:49.4638470Z 2024-12-18T00:13:49.4639368Z  2024-12-18T00:13:49.4639803Z  2024-12-18T00:13:49.4640183Z  2024-12-18T00:13:49.4640877Z  2024-12-18T00:13:49.4641283Z  2024-12-18T00:13:49.4641666Z  2024-12-18T00:13:49.4642087Z  2024-12-18T00:13:49.4642618Z  2024-12-18T00:13:49.4643214Z [14,990 / 15,187] 48 actions running 2024-12-18T00:13:49.4643997Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T00:13:49.4644999Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T00:13:49.4645678Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2024-12-18T00:13:49.4646612Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2024-12-18T00:13:49.4647488Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2024-12-18T00:13:49.4648269Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T00:13:49.4649067Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 21s local 2024-12-18T00:13:49.4649983Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 21s local ... 2024-12-18T00:13:50.4645605Z 2024-12-18T00:13:50.4646507Z  2024-12-18T00:13:50.4646988Z  2024-12-18T00:13:50.4647374Z  2024-12-18T00:13:50.4647712Z  2024-12-18T00:13:50.4648078Z  2024-12-18T00:13:50.4648460Z  2024-12-18T00:13:50.4648812Z  2024-12-18T00:13:50.4649150Z  2024-12-18T00:13:50.4649695Z [14,990 / 15,187] 48 actions running 2024-12-18T00:13:50.4650398Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2024-12-18T00:13:50.4651085Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T00:13:50.4651687Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2024-12-18T00:13:50.4652446Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2024-12-18T00:13:50.4653253Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2024-12-18T00:13:50.4653955Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:50.4654741Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 22s local 2024-12-18T00:13:50.4655724Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 22s local ... 2024-12-18T00:13:50.8026399Z 2024-12-18T00:13:50.8027316Z  2024-12-18T00:13:50.8027806Z  2024-12-18T00:13:50.8028225Z  2024-12-18T00:13:50.8028588Z  2024-12-18T00:13:50.8028926Z  2024-12-18T00:13:50.8029260Z  2024-12-18T00:13:50.8029603Z  2024-12-18T00:13:50.8029969Z  2024-12-18T00:13:50.8030529Z [14,991 / 15,187] 48 actions, 47 running 2024-12-18T00:13:50.8031230Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T00:13:50.8031864Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T00:13:50.8032471Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2024-12-18T00:13:50.8033171Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 25s local 2024-12-18T00:13:50.8033919Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2024-12-18T00:13:50.8034579Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T00:13:50.8035699Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 22s local 2024-12-18T00:13:50.8036523Z Compiling xla/service/cpu/cpu_compiler.cc; 22s local ... 2024-12-18T00:13:51.0650766Z 2024-12-18T00:13:51.0651758Z  2024-12-18T00:13:51.0652295Z  2024-12-18T00:13:51.0652717Z  2024-12-18T00:13:51.0653052Z  2024-12-18T00:13:51.0653387Z  2024-12-18T00:13:51.0653725Z  2024-12-18T00:13:51.0654079Z  2024-12-18T00:13:51.0654399Z  2024-12-18T00:13:51.0654917Z [14,992 / 15,187] 48 actions running 2024-12-18T00:13:51.0655654Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T00:13:51.0656293Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T00:13:51.0657135Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 25s local 2024-12-18T00:13:51.0657947Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2024-12-18T00:13:51.0658606Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T00:13:51.0659405Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 23s local 2024-12-18T00:13:51.0660472Z Compiling xla/service/cpu/cpu_compiler.cc; 23s local 2024-12-18T00:13:51.0661217Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2024-12-18T00:13:52.0658229Z 2024-12-18T00:13:52.0659228Z  2024-12-18T00:13:52.0659743Z  2024-12-18T00:13:52.0660183Z  2024-12-18T00:13:52.0660527Z  2024-12-18T00:13:52.0660808Z  2024-12-18T00:13:52.0661148Z  2024-12-18T00:13:52.0661630Z  2024-12-18T00:13:52.0661977Z  2024-12-18T00:13:52.0662471Z [14,993 / 15,187] 47 actions running 2024-12-18T00:13:52.0663428Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T00:13:52.0664089Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2024-12-18T00:13:52.0664789Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2024-12-18T00:13:52.0665729Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T00:13:52.0666446Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T00:13:52.0667202Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local 2024-12-18T00:13:52.0667983Z Compiling xla/service/cpu/cpu_compiler.cc; 24s local 2024-12-18T00:13:52.0668724Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2024-12-18T00:13:52.2663115Z 2024-12-18T00:13:52.2665464Z  2024-12-18T00:13:52.2665974Z  2024-12-18T00:13:52.2666352Z  2024-12-18T00:13:52.2666716Z  2024-12-18T00:13:52.2667048Z  2024-12-18T00:13:52.2667373Z  2024-12-18T00:13:52.2667711Z  2024-12-18T00:13:52.2668072Z  2024-12-18T00:13:52.2668663Z [14,994 / 15,187] 48 actions running 2024-12-18T00:13:52.2669310Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T00:13:52.2669954Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2024-12-18T00:13:52.2670654Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2024-12-18T00:13:52.2671459Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T00:13:52.2672254Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local 2024-12-18T00:13:52.2673063Z Compiling xla/service/cpu/cpu_compiler.cc; 24s local 2024-12-18T00:13:52.2673744Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:52.2674548Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 22s local ... 2024-12-18T00:13:53.1383222Z 2024-12-18T00:13:53.1384187Z  2024-12-18T00:13:53.1384742Z  2024-12-18T00:13:53.1385091Z  2024-12-18T00:13:53.1385475Z  2024-12-18T00:13:53.1385840Z  2024-12-18T00:13:53.1386226Z  2024-12-18T00:13:53.1386651Z  2024-12-18T00:13:53.1387029Z  2024-12-18T00:13:53.1387617Z [14,995 / 15,187] 48 actions, 47 running 2024-12-18T00:13:53.1388346Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2024-12-18T00:13:53.1389047Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2024-12-18T00:13:53.1390101Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2024-12-18T00:13:53.1390899Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2024-12-18T00:13:53.1391769Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2024-12-18T00:13:53.1392633Z Compiling xla/service/cpu/cpu_compiler.cc; 25s local 2024-12-18T00:13:53.1393417Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T00:13:53.1394223Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 23s local ... 2024-12-18T00:13:53.4669575Z 2024-12-18T00:13:53.4670617Z  2024-12-18T00:13:53.4671027Z  2024-12-18T00:13:53.4671424Z  2024-12-18T00:13:53.4671791Z  2024-12-18T00:13:53.4672177Z  2024-12-18T00:13:53.4672526Z  2024-12-18T00:13:53.4672890Z  2024-12-18T00:13:53.4673266Z  2024-12-18T00:13:53.4673818Z [14,995 / 15,187] 48 actions running 2024-12-18T00:13:53.4674578Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2024-12-18T00:13:53.4675309Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2024-12-18T00:13:53.4676047Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2024-12-18T00:13:53.4677131Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2024-12-18T00:13:53.4677984Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2024-12-18T00:13:53.4678958Z Compiling xla/service/cpu/cpu_compiler.cc; 25s local 2024-12-18T00:13:53.4679625Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T00:13:53.4680304Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 23s local ... 2024-12-18T00:13:54.1527294Z 2024-12-18T00:13:54.1528228Z  2024-12-18T00:13:54.1528745Z  2024-12-18T00:13:54.1529487Z  2024-12-18T00:13:54.1529914Z  2024-12-18T00:13:54.1530305Z  2024-12-18T00:13:54.1530681Z  2024-12-18T00:13:54.1531049Z  2024-12-18T00:13:54.1531412Z  2024-12-18T00:13:54.1531957Z [14,996 / 15,187] 48 actions, 47 running 2024-12-18T00:13:54.1532538Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2024-12-18T00:13:54.1533089Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T00:13:54.1533785Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 28s local 2024-12-18T00:13:54.1534599Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2024-12-18T00:13:54.1535494Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2024-12-18T00:13:54.1536525Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2024-12-18T00:13:54.1537360Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T00:13:54.1538128Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 24s local ... 2024-12-18T00:13:54.3633150Z 2024-12-18T00:13:54.3634077Z  2024-12-18T00:13:54.3634574Z  2024-12-18T00:13:54.3634947Z  2024-12-18T00:13:54.3635336Z  2024-12-18T00:13:54.3635718Z  2024-12-18T00:13:54.3636098Z  2024-12-18T00:13:54.3636477Z  2024-12-18T00:13:54.3636839Z  2024-12-18T00:13:54.3637406Z [14,996 / 15,187] 48 actions, 47 running 2024-12-18T00:13:54.3638459Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2024-12-18T00:13:54.3639195Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T00:13:54.3639979Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 28s local 2024-12-18T00:13:54.3640830Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2024-12-18T00:13:54.3641688Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2024-12-18T00:13:54.3642569Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2024-12-18T00:13:54.3643339Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T00:13:54.3644429Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 24s local ... 2024-12-18T00:13:54.7173151Z 2024-12-18T00:13:54.7174237Z  2024-12-18T00:13:54.7174716Z  2024-12-18T00:13:54.7175111Z  2024-12-18T00:13:54.7175507Z  2024-12-18T00:13:54.7175920Z  2024-12-18T00:13:54.7176343Z  2024-12-18T00:13:54.7176955Z  2024-12-18T00:13:54.7177707Z  2024-12-18T00:13:54.7178281Z [14,996 / 15,187] 48 actions running 2024-12-18T00:13:54.7179017Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T00:13:54.7179719Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T00:13:54.7180459Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2024-12-18T00:13:54.7181297Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2024-12-18T00:13:54.7182143Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2024-12-18T00:13:54.7183002Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2024-12-18T00:13:54.7183780Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T00:13:54.7184611Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 24s local ... 2024-12-18T00:13:55.2818493Z 2024-12-18T00:13:55.2819461Z  2024-12-18T00:13:55.2820047Z  2024-12-18T00:13:55.2820577Z  2024-12-18T00:13:55.2821072Z  2024-12-18T00:13:55.2821661Z  2024-12-18T00:13:55.2822328Z  2024-12-18T00:13:55.2822835Z  2024-12-18T00:13:55.2823337Z  2024-12-18T00:13:55.2824297Z [14,997 / 15,187] 48 actions, 47 running 2024-12-18T00:13:55.2825109Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T00:13:55.2826089Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T00:13:55.2826922Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2024-12-18T00:13:55.2827785Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2024-12-18T00:13:55.2828661Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 27s local 2024-12-18T00:13:55.2829651Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2024-12-18T00:13:55.2830436Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T00:13:55.2831288Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 25s local ... 2024-12-18T00:13:55.5179080Z 2024-12-18T00:13:55.5180028Z  2024-12-18T00:13:55.5180512Z  2024-12-18T00:13:55.5180955Z  2024-12-18T00:13:55.5181375Z  2024-12-18T00:13:55.5181795Z  2024-12-18T00:13:55.5182215Z  2024-12-18T00:13:55.5182623Z  2024-12-18T00:13:55.5182964Z  2024-12-18T00:13:55.5183431Z [14,997 / 15,187] 48 actions running 2024-12-18T00:13:55.5184066Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T00:13:55.5184679Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T00:13:55.5185342Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2024-12-18T00:13:55.5186047Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2024-12-18T00:13:55.5186771Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 27s local 2024-12-18T00:13:55.5187492Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2024-12-18T00:13:55.5188131Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T00:13:55.5188840Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 25s local ... 2024-12-18T00:13:56.2911929Z 2024-12-18T00:13:56.2913053Z  2024-12-18T00:13:56.2913483Z  2024-12-18T00:13:56.2913873Z  2024-12-18T00:13:56.2914257Z  2024-12-18T00:13:56.2914646Z  2024-12-18T00:13:56.2915004Z  2024-12-18T00:13:56.2915376Z  2024-12-18T00:13:56.2915747Z  2024-12-18T00:13:56.2916328Z [14,998 / 15,187] 48 actions, 47 running 2024-12-18T00:13:56.2917072Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T00:13:56.2917743Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2024-12-18T00:13:56.2918420Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T00:13:56.2919226Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 28s local 2024-12-18T00:13:56.2920070Z Compiling xla/service/cpu/cpu_compiler.cc; 28s local 2024-12-18T00:13:56.2920810Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T00:13:56.2921567Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 26s local 2024-12-18T00:13:56.2922317Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local ... 2024-12-18T00:13:56.5187260Z 2024-12-18T00:13:56.5188169Z  2024-12-18T00:13:56.5188686Z  2024-12-18T00:13:56.5189084Z  2024-12-18T00:13:56.5189474Z  2024-12-18T00:13:56.5189837Z  2024-12-18T00:13:56.5190215Z  2024-12-18T00:13:56.5190605Z  2024-12-18T00:13:56.5191018Z  2024-12-18T00:13:56.5191565Z [14,998 / 15,187] 48 actions running 2024-12-18T00:13:56.5192312Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T00:13:56.5193188Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2024-12-18T00:13:56.5193894Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T00:13:56.5194740Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 28s local 2024-12-18T00:13:56.5195553Z Compiling xla/service/cpu/cpu_compiler.cc; 28s local 2024-12-18T00:13:56.5196277Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T00:13:56.5197031Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 26s local 2024-12-18T00:13:56.5197815Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local ... 2024-12-18T00:13:57.4759504Z 2024-12-18T00:13:57.4760361Z  2024-12-18T00:13:57.4770467Z  2024-12-18T00:13:57.4771208Z  2024-12-18T00:13:57.4771564Z  2024-12-18T00:13:57.4772033Z  2024-12-18T00:13:57.4772383Z  2024-12-18T00:13:57.4772713Z  2024-12-18T00:13:57.4773059Z  2024-12-18T00:13:57.4773568Z [14,999 / 15,187] 48 actions, 47 running 2024-12-18T00:13:57.4774206Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2024-12-18T00:13:57.4774813Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2024-12-18T00:13:57.4775508Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2024-12-18T00:13:57.4776226Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2024-12-18T00:13:57.4777085Z Compiling xla/service/cpu/cpu_compiler.cc; 29s local 2024-12-18T00:13:57.4777732Z @llvm-project//mlir:LinalgTransforms; 28s local 2024-12-18T00:13:57.4778397Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 27s local 2024-12-18T00:13:57.4779061Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local ... 2024-12-18T00:13:57.7195296Z 2024-12-18T00:13:57.7196230Z  2024-12-18T00:13:57.7196865Z  2024-12-18T00:13:57.7197414Z  2024-12-18T00:13:57.7197880Z  2024-12-18T00:13:57.7198377Z  2024-12-18T00:13:57.7198874Z  2024-12-18T00:13:57.7199373Z  2024-12-18T00:13:57.7199881Z  2024-12-18T00:13:57.7200543Z [14,999 / 15,187] 48 actions running 2024-12-18T00:13:57.7201383Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2024-12-18T00:13:57.7202220Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2024-12-18T00:13:57.7203010Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2024-12-18T00:13:57.7203946Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2024-12-18T00:13:57.7204891Z Compiling xla/service/cpu/cpu_compiler.cc; 29s local 2024-12-18T00:13:57.7205720Z @llvm-project//mlir:LinalgTransforms; 28s local 2024-12-18T00:13:57.7206637Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 27s local 2024-12-18T00:13:57.7207569Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local ... 2024-12-18T00:13:58.7203261Z 2024-12-18T00:13:58.7205484Z  2024-12-18T00:13:58.7206126Z  2024-12-18T00:13:58.7206572Z  2024-12-18T00:13:58.7206988Z  2024-12-18T00:13:58.7207353Z  2024-12-18T00:13:58.7207742Z  2024-12-18T00:13:58.7208134Z  2024-12-18T00:13:58.7208506Z  2024-12-18T00:13:58.7209051Z [14,999 / 15,187] 48 actions running 2024-12-18T00:13:58.7209820Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2024-12-18T00:13:58.7210548Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2024-12-18T00:13:58.7211247Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2024-12-18T00:13:58.7212036Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2024-12-18T00:13:58.7212808Z Compiling xla/service/cpu/cpu_compiler.cc; 30s local 2024-12-18T00:13:58.7213850Z @llvm-project//mlir:LinalgTransforms; 29s local 2024-12-18T00:13:58.7214678Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local 2024-12-18T00:13:58.7215478Z Compiling xla/pjrt/cpu/cpu_client.cc; 28s local ... 2024-12-18T00:13:59.7213504Z 2024-12-18T00:13:59.7214415Z  2024-12-18T00:13:59.7214883Z  2024-12-18T00:13:59.7215283Z  2024-12-18T00:13:59.7215652Z  2024-12-18T00:13:59.7216044Z  2024-12-18T00:13:59.7216577Z  2024-12-18T00:13:59.7216975Z  2024-12-18T00:13:59.7217331Z  2024-12-18T00:13:59.7217881Z [14,999 / 15,187] 48 actions running 2024-12-18T00:13:59.7218653Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T00:13:59.7219370Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2024-12-18T00:13:59.7220058Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2024-12-18T00:13:59.7220876Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2024-12-18T00:13:59.7221740Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2024-12-18T00:13:59.7222788Z @llvm-project//mlir:LinalgTransforms; 30s local 2024-12-18T00:13:59.7223532Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2024-12-18T00:13:59.7224403Z Compiling xla/pjrt/cpu/cpu_client.cc; 29s local ... 2024-12-18T00:14:00.1939370Z 2024-12-18T00:14:00.1940223Z  2024-12-18T00:14:00.1940699Z  2024-12-18T00:14:00.1941063Z  2024-12-18T00:14:00.1941439Z  2024-12-18T00:14:00.1941797Z  2024-12-18T00:14:00.1942178Z  2024-12-18T00:14:00.1942556Z  2024-12-18T00:14:00.1942913Z  2024-12-18T00:14:00.1943792Z [15,000 / 15,187] 48 actions, 47 running 2024-12-18T00:14:00.1944762Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T00:14:00.1945412Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2024-12-18T00:14:00.1946158Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2024-12-18T00:14:00.1946984Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2024-12-18T00:14:00.1947717Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T00:14:00.1948441Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2024-12-18T00:14:00.1949186Z Compiling xla/pjrt/cpu/cpu_client.cc; 30s local 2024-12-18T00:14:00.1950010Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 29s local ... 2024-12-18T00:14:00.5220664Z 2024-12-18T00:14:00.5221562Z  2024-12-18T00:14:00.5222041Z  2024-12-18T00:14:00.5222400Z  2024-12-18T00:14:00.5222754Z  2024-12-18T00:14:00.5223132Z  2024-12-18T00:14:00.5223517Z  2024-12-18T00:14:00.5223916Z  2024-12-18T00:14:00.5224299Z  2024-12-18T00:14:00.5224807Z [15,000 / 15,187] 48 actions running 2024-12-18T00:14:00.5225543Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T00:14:00.5226168Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2024-12-18T00:14:00.5226908Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2024-12-18T00:14:00.5227750Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2024-12-18T00:14:00.5228506Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T00:14:00.5229227Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2024-12-18T00:14:00.5229991Z Compiling xla/pjrt/cpu/cpu_client.cc; 30s local 2024-12-18T00:14:00.5230739Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 29s local ... 2024-12-18T00:14:01.5130250Z 2024-12-18T00:14:01.5131102Z  2024-12-18T00:14:01.5131659Z  2024-12-18T00:14:01.5132201Z  2024-12-18T00:14:01.5132596Z  2024-12-18T00:14:01.5133003Z  2024-12-18T00:14:01.5133339Z  2024-12-18T00:14:01.5133708Z  2024-12-18T00:14:01.5134074Z  2024-12-18T00:14:01.5134632Z [15,001 / 15,187] 48 actions, 47 running 2024-12-18T00:14:01.5135324Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T00:14:01.5136261Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2024-12-18T00:14:01.5137254Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2024-12-18T00:14:01.5138238Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2024-12-18T00:14:01.5138988Z @llvm-project//mlir:LinalgTransforms; 32s local 2024-12-18T00:14:01.5139720Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T00:14:01.5140407Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2024-12-18T00:14:01.5141231Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local ... 2024-12-18T00:14:01.7230168Z 2024-12-18T00:14:01.7231048Z  2024-12-18T00:14:01.7231503Z  2024-12-18T00:14:01.7232034Z  2024-12-18T00:14:01.7232397Z  2024-12-18T00:14:01.7232756Z  2024-12-18T00:14:01.7233117Z  2024-12-18T00:14:01.7233453Z  2024-12-18T00:14:01.7233792Z  2024-12-18T00:14:01.7234320Z [15,001 / 15,187] 48 actions running 2024-12-18T00:14:01.7235083Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2024-12-18T00:14:01.7235803Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2024-12-18T00:14:01.7236792Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2024-12-18T00:14:01.7237623Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2024-12-18T00:14:01.7238409Z @llvm-project//mlir:LinalgTransforms; 32s local 2024-12-18T00:14:01.7239111Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T00:14:01.7239815Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2024-12-18T00:14:01.7240639Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local ... 2024-12-18T00:14:02.7238082Z 2024-12-18T00:14:02.7239214Z  2024-12-18T00:14:02.7239643Z  2024-12-18T00:14:02.7239991Z  2024-12-18T00:14:02.7240322Z  2024-12-18T00:14:02.7240634Z  2024-12-18T00:14:02.7240975Z  2024-12-18T00:14:02.7241302Z  2024-12-18T00:14:02.7241620Z  2024-12-18T00:14:02.7242105Z [15,001 / 15,187] 48 actions running 2024-12-18T00:14:02.7242744Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T00:14:02.7243365Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2024-12-18T00:14:02.7244031Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2024-12-18T00:14:02.7245044Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2024-12-18T00:14:02.7245677Z @llvm-project//mlir:LinalgTransforms; 33s local 2024-12-18T00:14:02.7246333Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2024-12-18T00:14:02.7246957Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2024-12-18T00:14:02.7247712Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 31s local ... 2024-12-18T00:14:03.0356097Z 2024-12-18T00:14:03.0356920Z  2024-12-18T00:14:03.0357386Z  2024-12-18T00:14:03.0357776Z  2024-12-18T00:14:03.0358143Z  2024-12-18T00:14:03.0358530Z  2024-12-18T00:14:03.0359061Z  2024-12-18T00:14:03.0359461Z  2024-12-18T00:14:03.0359796Z  2024-12-18T00:14:03.0360353Z [15,002 / 15,187] 48 actions, 47 running 2024-12-18T00:14:03.0361118Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T00:14:03.0361788Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T00:14:03.0362525Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2024-12-18T00:14:03.0363329Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2024-12-18T00:14:03.0364068Z @llvm-project//mlir:LinalgTransforms; 33s local 2024-12-18T00:14:03.0364811Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2024-12-18T00:14:03.0365562Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2024-12-18T00:14:03.0366448Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local ... 2024-12-18T00:14:03.3244534Z 2024-12-18T00:14:03.3245449Z  2024-12-18T00:14:03.3245899Z  2024-12-18T00:14:03.3246267Z  2024-12-18T00:14:03.3246635Z  2024-12-18T00:14:03.3247218Z  2024-12-18T00:14:03.3247548Z  2024-12-18T00:14:03.3247914Z  2024-12-18T00:14:03.3248259Z  2024-12-18T00:14:03.3248797Z [15,002 / 15,187] 48 actions running 2024-12-18T00:14:03.3249498Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T00:14:03.3250263Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T00:14:03.3250992Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2024-12-18T00:14:03.3251842Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2024-12-18T00:14:03.3252602Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T00:14:03.3253367Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2024-12-18T00:14:03.3254090Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2024-12-18T00:14:03.3254803Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local ... 2024-12-18T00:14:03.5955178Z 2024-12-18T00:14:03.5956026Z  2024-12-18T00:14:03.5956520Z  2024-12-18T00:14:03.5956907Z  2024-12-18T00:14:03.5957282Z  2024-12-18T00:14:03.5957674Z  2024-12-18T00:14:03.5958244Z  2024-12-18T00:14:03.5958637Z  2024-12-18T00:14:03.5959017Z  2024-12-18T00:14:03.5959587Z [15,003 / 15,187] 48 actions, 47 running 2024-12-18T00:14:03.5960402Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T00:14:03.5961074Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T00:14:03.5961863Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2024-12-18T00:14:03.5962711Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2024-12-18T00:14:03.5963613Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T00:14:03.5964329Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2024-12-18T00:14:03.5965187Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local 2024-12-18T00:14:03.5966289Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local ... 2024-12-18T00:14:03.9249833Z 2024-12-18T00:14:03.9250732Z  2024-12-18T00:14:03.9251191Z  2024-12-18T00:14:03.9251565Z  2024-12-18T00:14:03.9251982Z  2024-12-18T00:14:03.9252345Z  2024-12-18T00:14:03.9252869Z  2024-12-18T00:14:03.9253272Z  2024-12-18T00:14:03.9253653Z  2024-12-18T00:14:03.9254200Z [15,003 / 15,187] 48 actions running 2024-12-18T00:14:03.9254796Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T00:14:03.9255454Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2024-12-18T00:14:03.9256215Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T00:14:03.9257209Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2024-12-18T00:14:03.9257916Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T00:14:03.9258586Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2024-12-18T00:14:03.9259440Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2024-12-18T00:14:03.9260552Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local ... 2024-12-18T00:14:04.2979521Z 2024-12-18T00:14:04.2980320Z  2024-12-18T00:14:04.2980718Z  2024-12-18T00:14:04.2981053Z  2024-12-18T00:14:04.2981425Z  2024-12-18T00:14:04.2981734Z  2024-12-18T00:14:04.2982054Z  2024-12-18T00:14:04.2982385Z  2024-12-18T00:14:04.2982678Z  2024-12-18T00:14:04.2983152Z [15,004 / 15,187] 48 actions, 47 running 2024-12-18T00:14:04.2983701Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T00:14:04.2984212Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2024-12-18T00:14:04.2984781Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T00:14:04.2985374Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local 2024-12-18T00:14:04.2985912Z @llvm-project//mlir:LinalgTransforms; 35s local 2024-12-18T00:14:04.2986433Z Compiling xla/pjrt/cpu/cpu_client.cc; 34s local 2024-12-18T00:14:04.2987374Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2024-12-18T00:14:04.2988161Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local ... 2024-12-18T00:14:04.5256284Z 2024-12-18T00:14:04.5257255Z  2024-12-18T00:14:04.5257743Z  2024-12-18T00:14:04.5258140Z  2024-12-18T00:14:04.5258528Z  2024-12-18T00:14:04.5258921Z  2024-12-18T00:14:04.5259312Z  2024-12-18T00:14:04.5259701Z  2024-12-18T00:14:04.5260103Z  2024-12-18T00:14:04.5260676Z [15,004 / 15,187] 48 actions running 2024-12-18T00:14:04.5261482Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T00:14:04.5262252Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2024-12-18T00:14:04.5263048Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T00:14:04.5263935Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local 2024-12-18T00:14:04.5264740Z @llvm-project//mlir:LinalgTransforms; 35s local 2024-12-18T00:14:04.5265516Z Compiling xla/pjrt/cpu/cpu_client.cc; 34s local 2024-12-18T00:14:04.5266701Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2024-12-18T00:14:04.5267886Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local ... 2024-12-18T00:14:05.5262982Z 2024-12-18T00:14:05.5263827Z  2024-12-18T00:14:05.5264324Z  2024-12-18T00:14:05.5264740Z  2024-12-18T00:14:05.5265167Z  2024-12-18T00:14:05.5265557Z  2024-12-18T00:14:05.5265981Z  2024-12-18T00:14:05.5266390Z  2024-12-18T00:14:05.5266781Z  2024-12-18T00:14:05.5267661Z [15,005 / 15,187] 47 actions running 2024-12-18T00:14:05.5268416Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T00:14:05.5269153Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2024-12-18T00:14:05.5269910Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2024-12-18T00:14:05.5270738Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local 2024-12-18T00:14:05.5271467Z @llvm-project//mlir:LinalgTransforms; 36s local 2024-12-18T00:14:05.5272210Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local 2024-12-18T00:14:05.5273071Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2024-12-18T00:14:05.5274095Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local ... 2024-12-18T00:14:05.9267606Z 2024-12-18T00:14:05.9268446Z  2024-12-18T00:14:05.9268852Z  2024-12-18T00:14:05.9269240Z  2024-12-18T00:14:05.9269597Z  2024-12-18T00:14:05.9269926Z  2024-12-18T00:14:05.9270264Z  2024-12-18T00:14:05.9270611Z  2024-12-18T00:14:05.9270989Z  2024-12-18T00:14:05.9271498Z [15,005 / 15,187] 48 actions running 2024-12-18T00:14:05.9272158Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2024-12-18T00:14:05.9272812Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2024-12-18T00:14:05.9273514Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2024-12-18T00:14:05.9274295Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local 2024-12-18T00:14:05.9274988Z @llvm-project//mlir:LinalgTransforms; 36s local 2024-12-18T00:14:05.9275617Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local 2024-12-18T00:14:05.9276411Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2024-12-18T00:14:05.9277408Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local ... 2024-12-18T00:14:06.3271471Z 2024-12-18T00:14:06.3272381Z  2024-12-18T00:14:06.3272778Z  2024-12-18T00:14:06.3273128Z  2024-12-18T00:14:06.3273471Z  2024-12-18T00:14:06.3273875Z  2024-12-18T00:14:06.3274247Z  2024-12-18T00:14:06.3274610Z  2024-12-18T00:14:06.3274973Z  2024-12-18T00:14:06.3275511Z [15,006 / 15,187] 47 actions running 2024-12-18T00:14:06.3276240Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2024-12-18T00:14:06.3277325Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2024-12-18T00:14:06.3278066Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2024-12-18T00:14:06.3278889Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2024-12-18T00:14:06.3279612Z @llvm-project//mlir:LinalgTransforms; 37s local 2024-12-18T00:14:06.3280252Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2024-12-18T00:14:06.3280996Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2024-12-18T00:14:06.3281941Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local ... 2024-12-18T00:14:06.6319606Z 2024-12-18T00:14:06.6320574Z  2024-12-18T00:14:06.6321169Z  2024-12-18T00:14:06.6321554Z  2024-12-18T00:14:06.6321928Z  2024-12-18T00:14:06.6322313Z  2024-12-18T00:14:06.6322700Z  2024-12-18T00:14:06.6323081Z  2024-12-18T00:14:06.6323454Z  2024-12-18T00:14:06.6324067Z [15,007 / 15,187] 48 actions, 47 running 2024-12-18T00:14:06.6324864Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T00:14:06.6325882Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2024-12-18T00:14:06.6326640Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2024-12-18T00:14:06.6327558Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2024-12-18T00:14:06.6328290Z @llvm-project//mlir:LinalgTransforms; 37s local 2024-12-18T00:14:06.6329017Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2024-12-18T00:14:06.6329868Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2024-12-18T00:14:06.6331155Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local ... 2024-12-18T00:14:06.9278223Z 2024-12-18T00:14:06.9279081Z  2024-12-18T00:14:06.9279547Z  2024-12-18T00:14:06.9279932Z  2024-12-18T00:14:06.9280315Z  2024-12-18T00:14:06.9280714Z  2024-12-18T00:14:06.9281096Z  2024-12-18T00:14:06.9281451Z  2024-12-18T00:14:06.9281870Z  2024-12-18T00:14:06.9282418Z [15,008 / 15,187] 48 actions running 2024-12-18T00:14:06.9283198Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T00:14:06.9283939Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2024-12-18T00:14:06.9284734Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2024-12-18T00:14:06.9285609Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2024-12-18T00:14:06.9286388Z @llvm-project//mlir:LinalgTransforms; 37s local 2024-12-18T00:14:06.9287154Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2024-12-18T00:14:06.9288102Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 36s local 2024-12-18T00:14:06.9289192Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local ... 2024-12-18T00:14:07.9286311Z 2024-12-18T00:14:07.9287164Z  2024-12-18T00:14:07.9287620Z  2024-12-18T00:14:07.9287954Z  2024-12-18T00:14:07.9288347Z  2024-12-18T00:14:07.9288782Z  2024-12-18T00:14:07.9289161Z  2024-12-18T00:14:07.9289553Z  2024-12-18T00:14:07.9289940Z  2024-12-18T00:14:07.9290501Z [15,008 / 15,187] 48 actions running 2024-12-18T00:14:07.9291247Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2024-12-18T00:14:07.9291974Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2024-12-18T00:14:07.9292735Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2024-12-18T00:14:07.9293554Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2024-12-18T00:14:07.9294299Z @llvm-project//mlir:LinalgTransforms; 38s local 2024-12-18T00:14:07.9295013Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local 2024-12-18T00:14:07.9295878Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 37s local 2024-12-18T00:14:07.9297188Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local ... 2024-12-18T00:14:08.9294574Z 2024-12-18T00:14:08.9295499Z  2024-12-18T00:14:08.9295967Z  2024-12-18T00:14:08.9296806Z  2024-12-18T00:14:08.9297199Z  2024-12-18T00:14:08.9297562Z  2024-12-18T00:14:08.9297953Z  2024-12-18T00:14:08.9298373Z  2024-12-18T00:14:08.9298778Z  2024-12-18T00:14:08.9299401Z [15,008 / 15,187] 48 actions running 2024-12-18T00:14:08.9300078Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2024-12-18T00:14:08.9300728Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2024-12-18T00:14:08.9301562Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 41s local 2024-12-18T00:14:08.9302356Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2024-12-18T00:14:08.9303099Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T00:14:08.9303790Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2024-12-18T00:14:08.9304525Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2024-12-18T00:14:08.9305584Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local ... 2024-12-18T00:14:09.5035945Z 2024-12-18T00:14:09.5036751Z  2024-12-18T00:14:09.5037263Z  2024-12-18T00:14:09.5037679Z  2024-12-18T00:14:09.5038504Z  2024-12-18T00:14:09.5038965Z  2024-12-18T00:14:09.5039355Z  2024-12-18T00:14:09.5039904Z  2024-12-18T00:14:09.5040270Z  2024-12-18T00:14:09.5040871Z [15,009 / 15,187] 48 actions, 47 running 2024-12-18T00:14:09.5041687Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2024-12-18T00:14:09.5042369Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2024-12-18T00:14:09.5043097Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2024-12-18T00:14:09.5044049Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T00:14:09.5045005Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2024-12-18T00:14:09.5045928Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2024-12-18T00:14:09.5047007Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2024-12-18T00:14:09.5048126Z Compiling torch_xla/csrc/init_python_bindings.cpp; 35s local ... 2024-12-18T00:14:09.7300990Z 2024-12-18T00:14:09.7301993Z  2024-12-18T00:14:09.7302365Z  2024-12-18T00:14:09.7302704Z  2024-12-18T00:14:09.7303071Z  2024-12-18T00:14:09.7303430Z  2024-12-18T00:14:09.7303813Z  2024-12-18T00:14:09.7304188Z  2024-12-18T00:14:09.7304562Z  2024-12-18T00:14:09.7305101Z [15,009 / 15,187] 48 actions running 2024-12-18T00:14:09.7305826Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T00:14:09.7306473Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2024-12-18T00:14:09.7307151Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2024-12-18T00:14:09.7307872Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T00:14:09.7308545Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2024-12-18T00:14:09.7309371Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2024-12-18T00:14:09.7310397Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2024-12-18T00:14:09.7311164Z Compiling torch_xla/csrc/init_python_bindings.cpp; 35s local ... 2024-12-18T00:14:09.9302625Z 2024-12-18T00:14:09.9303449Z  2024-12-18T00:14:09.9303949Z  2024-12-18T00:14:09.9304508Z  2024-12-18T00:14:09.9304869Z  2024-12-18T00:14:09.9305258Z  2024-12-18T00:14:09.9305640Z  2024-12-18T00:14:09.9306022Z  2024-12-18T00:14:09.9306373Z  2024-12-18T00:14:09.9306913Z [15,010 / 15,187] 47 actions running 2024-12-18T00:14:09.9307641Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T00:14:09.9308329Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T00:14:09.9309017Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2024-12-18T00:14:09.9309719Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T00:14:09.9310418Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2024-12-18T00:14:09.9311552Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2024-12-18T00:14:09.9312571Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2024-12-18T00:14:09.9313564Z Compiling torch_xla/csrc/init_python_bindings.cpp; 36s local ... 2024-12-18T00:14:10.3307089Z 2024-12-18T00:14:10.3307991Z  2024-12-18T00:14:10.3308446Z  2024-12-18T00:14:10.3308837Z  2024-12-18T00:14:10.3309232Z  2024-12-18T00:14:10.3309613Z  2024-12-18T00:14:10.3309976Z  2024-12-18T00:14:10.3310366Z  2024-12-18T00:14:10.3310819Z  2024-12-18T00:14:10.3311394Z [15,010 / 15,187] 48 actions running 2024-12-18T00:14:10.3312124Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T00:14:10.3312840Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T00:14:10.3313554Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T00:14:10.3314310Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T00:14:10.3315033Z Compiling xla/pjrt/cpu/cpu_client.cc; 40s local 2024-12-18T00:14:10.3316152Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2024-12-18T00:14:10.3317227Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2024-12-18T00:14:10.3318350Z Compiling torch_xla/csrc/init_python_bindings.cpp; 36s local ... 2024-12-18T00:14:10.7052037Z 2024-12-18T00:14:10.7052880Z  2024-12-18T00:14:10.7053264Z  2024-12-18T00:14:10.7053597Z  2024-12-18T00:14:10.7053947Z  2024-12-18T00:14:10.7054287Z  2024-12-18T00:14:10.7054616Z  2024-12-18T00:14:10.7054946Z  2024-12-18T00:14:10.7055578Z  2024-12-18T00:14:10.7056102Z [15,011 / 15,187] 48 actions, 47 running 2024-12-18T00:14:10.7056826Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T00:14:10.7057407Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T00:14:10.7058173Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T00:14:10.7058870Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T00:14:10.7059625Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2024-12-18T00:14:10.7060521Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local 2024-12-18T00:14:10.7061349Z Compiling torch_xla/csrc/init_python_bindings.cpp; 36s local 2024-12-18T00:14:10.7062084Z Compiling torch_xla/csrc/aten_fallback.cpp; 36s local ... 2024-12-18T00:14:10.9312069Z 2024-12-18T00:14:10.9312962Z  2024-12-18T00:14:10.9313421Z  2024-12-18T00:14:10.9313805Z  2024-12-18T00:14:10.9314197Z  2024-12-18T00:14:10.9314607Z  2024-12-18T00:14:10.9314986Z  2024-12-18T00:14:10.9315362Z  2024-12-18T00:14:10.9315738Z  2024-12-18T00:14:10.9316269Z [15,011 / 15,187] 48 actions running 2024-12-18T00:14:10.9317368Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T00:14:10.9318242Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2024-12-18T00:14:10.9319116Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T00:14:10.9319973Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T00:14:10.9320952Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2024-12-18T00:14:10.9322176Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local 2024-12-18T00:14:10.9323284Z Compiling torch_xla/csrc/init_python_bindings.cpp; 37s local 2024-12-18T00:14:10.9324264Z Compiling torch_xla/csrc/aten_fallback.cpp; 37s local ... 2024-12-18T00:14:11.1694236Z 2024-12-18T00:14:11.1695136Z  2024-12-18T00:14:11.1695638Z  2024-12-18T00:14:11.1696038Z  2024-12-18T00:14:11.1696591Z  2024-12-18T00:14:11.1697000Z  2024-12-18T00:14:11.1697402Z  2024-12-18T00:14:11.1697763Z  2024-12-18T00:14:11.1698097Z  2024-12-18T00:14:11.1698574Z [15,012 / 15,187] 48 actions, 47 running 2024-12-18T00:14:11.1699531Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T00:14:11.1700251Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2024-12-18T00:14:11.1700938Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2024-12-18T00:14:11.1701688Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T00:14:11.1702602Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2024-12-18T00:14:11.1703603Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local 2024-12-18T00:14:11.1704567Z Compiling torch_xla/csrc/init_python_bindings.cpp; 37s local 2024-12-18T00:14:11.1705429Z Compiling torch_xla/csrc/aten_fallback.cpp; 37s local ... 2024-12-18T00:14:11.5316975Z 2024-12-18T00:14:11.5317871Z  2024-12-18T00:14:11.5318329Z  2024-12-18T00:14:11.5318718Z  2024-12-18T00:14:11.5319108Z  2024-12-18T00:14:11.5319514Z  2024-12-18T00:14:11.5319886Z  2024-12-18T00:14:11.5320368Z  2024-12-18T00:14:11.5320910Z  2024-12-18T00:14:11.5321573Z [15,013 / 15,187] 48 actions running 2024-12-18T00:14:11.5322598Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T00:14:11.5323319Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2024-12-18T00:14:11.5324201Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2024-12-18T00:14:11.5325040Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T00:14:11.5325881Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2024-12-18T00:14:11.5326956Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T00:14:11.5328149Z Compiling torch_xla/csrc/init_python_bindings.cpp; 37s local 2024-12-18T00:14:11.5329541Z Compiling torch_xla/csrc/aten_fallback.cpp; 37s local ... 2024-12-18T00:14:12.2291564Z 2024-12-18T00:14:12.2292453Z  2024-12-18T00:14:12.2292925Z  2024-12-18T00:14:12.2293301Z  2024-12-18T00:14:12.2293689Z  2024-12-18T00:14:12.2294094Z  2024-12-18T00:14:12.2294489Z  2024-12-18T00:14:12.2295023Z  2024-12-18T00:14:12.2295399Z  2024-12-18T00:14:12.2296041Z [15,014 / 15,187] 48 actions, 47 running 2024-12-18T00:14:12.2296926Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2024-12-18T00:14:12.2297748Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2024-12-18T00:14:12.2298558Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T00:14:12.2299252Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T00:14:12.2300103Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T00:14:12.2301109Z Compiling torch_xla/csrc/init_python_bindings.cpp; 38s local 2024-12-18T00:14:12.2301905Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local 2024-12-18T00:14:12.2302779Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local ... 2024-12-18T00:14:12.5325500Z 2024-12-18T00:14:12.5326464Z  2024-12-18T00:14:12.5327959Z  2024-12-18T00:14:12.5328468Z  2024-12-18T00:14:12.5328859Z  2024-12-18T00:14:12.5329247Z  2024-12-18T00:14:12.5329627Z  2024-12-18T00:14:12.5330026Z  2024-12-18T00:14:12.5330432Z  2024-12-18T00:14:12.5331024Z [15,014 / 15,187] 48 actions running 2024-12-18T00:14:12.5331791Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2024-12-18T00:14:12.5332518Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2024-12-18T00:14:12.5333270Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T00:14:12.5333994Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T00:14:12.5334941Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 41s local 2024-12-18T00:14:12.5336038Z Compiling torch_xla/csrc/init_python_bindings.cpp; 38s local 2024-12-18T00:14:12.5337067Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local 2024-12-18T00:14:12.5337906Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local ... 2024-12-18T00:14:12.9331973Z 2024-12-18T00:14:12.9332857Z  2024-12-18T00:14:12.9333308Z  2024-12-18T00:14:12.9333690Z  2024-12-18T00:14:12.9334112Z  2024-12-18T00:14:12.9334504Z  2024-12-18T00:14:12.9334870Z  2024-12-18T00:14:12.9335235Z  2024-12-18T00:14:12.9335634Z  2024-12-18T00:14:12.9336291Z [15,015 / 15,187] 47 actions running 2024-12-18T00:14:12.9337303Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T00:14:12.9337931Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2024-12-18T00:14:12.9338559Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T00:14:12.9339285Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T00:14:12.9340037Z Compiling torch_xla/csrc/init_python_bindings.cpp; 39s local 2024-12-18T00:14:12.9340879Z Compiling torch_xla/csrc/aten_fallback.cpp; 39s local 2024-12-18T00:14:12.9341566Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local 2024-12-18T00:14:12.9342373Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local ... 2024-12-18T00:14:13.1336633Z 2024-12-18T00:14:13.1337528Z  2024-12-18T00:14:13.1338244Z  2024-12-18T00:14:13.1338580Z  2024-12-18T00:14:13.1338924Z  2024-12-18T00:14:13.1339424Z  2024-12-18T00:14:13.1339767Z  2024-12-18T00:14:13.1340112Z  2024-12-18T00:14:13.1340460Z  2024-12-18T00:14:13.1341011Z [15,015 / 15,187] 48 actions running 2024-12-18T00:14:13.1341728Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T00:14:13.1342418Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2024-12-18T00:14:13.1345474Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T00:14:13.1346491Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T00:14:13.1347293Z Compiling torch_xla/csrc/init_python_bindings.cpp; 39s local 2024-12-18T00:14:13.1348084Z Compiling torch_xla/csrc/aten_fallback.cpp; 39s local 2024-12-18T00:14:13.1348860Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local 2024-12-18T00:14:13.1349747Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local ... 2024-12-18T00:14:13.6338218Z 2024-12-18T00:14:13.6339127Z  2024-12-18T00:14:13.6339594Z  2024-12-18T00:14:13.6340017Z  2024-12-18T00:14:13.6340400Z  2024-12-18T00:14:13.6340756Z  2024-12-18T00:14:13.6341137Z  2024-12-18T00:14:13.6341525Z  2024-12-18T00:14:13.6341896Z  2024-12-18T00:14:13.6342437Z [15,016 / 15,187] 48 actions, 47 running 2024-12-18T00:14:13.6343147Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T00:14:13.6343859Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2024-12-18T00:14:13.6344810Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T00:14:13.6345522Z @llvm-project//mlir:LinalgTransforms; 44s local 2024-12-18T00:14:13.6346270Z Compiling torch_xla/csrc/init_python_bindings.cpp; 39s local 2024-12-18T00:14:13.6347107Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 39s local 2024-12-18T00:14:13.6347909Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local 2024-12-18T00:14:13.6348753Z Compiling torch_xla/csrc/aten_xla_type.cpp; 38s local ... 2024-12-18T00:14:13.9343582Z 2024-12-18T00:14:13.9344685Z  2024-12-18T00:14:13.9345188Z  2024-12-18T00:14:13.9345572Z  2024-12-18T00:14:13.9345950Z  2024-12-18T00:14:13.9346326Z  2024-12-18T00:14:13.9346701Z  2024-12-18T00:14:13.9347048Z  2024-12-18T00:14:13.9347383Z  2024-12-18T00:14:13.9347940Z [15,017 / 15,187] 48 actions running 2024-12-18T00:14:13.9348690Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T00:14:13.9349460Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2024-12-18T00:14:13.9350286Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T00:14:13.9350981Z @llvm-project//mlir:LinalgTransforms; 44s local 2024-12-18T00:14:13.9351759Z Compiling torch_xla/csrc/init_python_bindings.cpp; 40s local 2024-12-18T00:14:13.9352901Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 39s local 2024-12-18T00:14:13.9353698Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local 2024-12-18T00:14:13.9354531Z Compiling torch_xla/csrc/aten_xla_type.cpp; 39s local ... 2024-12-18T00:14:14.4469659Z 2024-12-18T00:14:14.4470577Z  2024-12-18T00:14:14.4471087Z  2024-12-18T00:14:14.4471502Z  2024-12-18T00:14:14.4471896Z  2024-12-18T00:14:14.4472290Z  2024-12-18T00:14:14.4472694Z  2024-12-18T00:14:14.4473100Z  2024-12-18T00:14:14.4473504Z  2024-12-18T00:14:14.4474125Z [15,018 / 15,187] 48 actions, 47 running 2024-12-18T00:14:14.4474914Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T00:14:14.4475673Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2024-12-18T00:14:14.4476397Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2024-12-18T00:14:14.4477193Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T00:14:14.4478038Z Compiling torch_xla/csrc/init_python_bindings.cpp; 40s local 2024-12-18T00:14:14.4479212Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2024-12-18T00:14:14.4480082Z Compiling torch_xla/csrc/aten_xla_type.cpp; 39s local 2024-12-18T00:14:14.4481033Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 37s local ... 2024-12-18T00:14:14.7347371Z 2024-12-18T00:14:14.7348241Z  2024-12-18T00:14:14.7348750Z  2024-12-18T00:14:14.7349122Z  2024-12-18T00:14:14.7349523Z  2024-12-18T00:14:14.7349920Z  2024-12-18T00:14:14.7350317Z  2024-12-18T00:14:14.7350718Z  2024-12-18T00:14:14.7351387Z  2024-12-18T00:14:14.7351972Z [15,018 / 15,187] 48 actions running 2024-12-18T00:14:14.7352774Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2024-12-18T00:14:14.7353514Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2024-12-18T00:14:14.7354232Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2024-12-18T00:14:14.7355025Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T00:14:14.7355881Z Compiling torch_xla/csrc/init_python_bindings.cpp; 40s local 2024-12-18T00:14:14.7356836Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2024-12-18T00:14:14.7357894Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2024-12-18T00:14:14.7358843Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 37s local ... 2024-12-18T00:14:14.9349751Z 2024-12-18T00:14:14.9351027Z  2024-12-18T00:14:14.9351519Z  2024-12-18T00:14:14.9351925Z  2024-12-18T00:14:14.9352321Z  2024-12-18T00:14:14.9352715Z  2024-12-18T00:14:14.9353140Z  2024-12-18T00:14:14.9353540Z  2024-12-18T00:14:14.9353954Z  2024-12-18T00:14:14.9354643Z [15,019 / 15,187] 48 actions running 2024-12-18T00:14:14.9355401Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2024-12-18T00:14:14.9356131Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T00:14:14.9356873Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2024-12-18T00:14:14.9357650Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T00:14:14.9358612Z Compiling torch_xla/csrc/init_python_bindings.cpp; 41s local 2024-12-18T00:14:14.9359469Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2024-12-18T00:14:14.9360316Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2024-12-18T00:14:14.9361204Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 37s local ... 2024-12-18T00:14:15.7127745Z 2024-12-18T00:14:15.7128544Z  2024-12-18T00:14:15.7128961Z  2024-12-18T00:14:15.7129318Z  2024-12-18T00:14:15.7129623Z  2024-12-18T00:14:15.7129930Z  2024-12-18T00:14:15.7130245Z  2024-12-18T00:14:15.7130561Z  2024-12-18T00:14:15.7130883Z  2024-12-18T00:14:15.7131354Z [15,020 / 15,187] 48 actions, 47 running 2024-12-18T00:14:15.7131951Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2024-12-18T00:14:15.7132756Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T00:14:15.7133349Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2024-12-18T00:14:15.7133986Z @llvm-project//mlir:LinalgTransforms; 46s local 2024-12-18T00:14:15.7134663Z Compiling torch_xla/csrc/init_python_bindings.cpp; 41s local 2024-12-18T00:14:15.7135357Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2024-12-18T00:14:15.7135983Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2024-12-18T00:14:15.7136825Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 38s local ... 2024-12-18T00:14:15.9312872Z 2024-12-18T00:14:15.9313863Z  2024-12-18T00:14:15.9314358Z  2024-12-18T00:14:15.9314746Z  2024-12-18T00:14:15.9315158Z  2024-12-18T00:14:15.9315561Z  2024-12-18T00:14:15.9315965Z  2024-12-18T00:14:15.9316363Z  2024-12-18T00:14:15.9316770Z  2024-12-18T00:14:15.9317373Z [15,021 / 15,187] 48 actions, 47 running 2024-12-18T00:14:15.9318158Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2024-12-18T00:14:15.9319111Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T00:14:15.9319866Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2024-12-18T00:14:15.9320782Z @llvm-project//mlir:LinalgTransforms; 46s local 2024-12-18T00:14:15.9321628Z Compiling torch_xla/csrc/init_python_bindings.cpp; 42s local 2024-12-18T00:14:15.9322565Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2024-12-18T00:14:15.9323444Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2024-12-18T00:14:15.9324446Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 38s local ... 2024-12-18T00:14:16.1359188Z 2024-12-18T00:14:16.1360156Z  2024-12-18T00:14:16.1360632Z  2024-12-18T00:14:16.1361014Z  2024-12-18T00:14:16.1361400Z  2024-12-18T00:14:16.1361773Z  2024-12-18T00:14:16.1362149Z  2024-12-18T00:14:16.1362541Z  2024-12-18T00:14:16.1362974Z  2024-12-18T00:14:16.1363513Z [15,022 / 15,187] 48 actions running 2024-12-18T00:14:16.1364184Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T00:14:16.1364891Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2024-12-18T00:14:16.1365675Z @llvm-project//mlir:LinalgTransforms; 46s local 2024-12-18T00:14:16.1366502Z Compiling torch_xla/csrc/init_python_bindings.cpp; 42s local 2024-12-18T00:14:16.1367398Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2024-12-18T00:14:16.1368251Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2024-12-18T00:14:16.1369132Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local 2024-12-18T00:14:16.1369988Z Compiling torch_xla/csrc/debug_util.cpp; 37s local ... 2024-12-18T00:14:16.5364071Z 2024-12-18T00:14:16.5364983Z  2024-12-18T00:14:16.5365486Z  2024-12-18T00:14:16.5365870Z  2024-12-18T00:14:16.5366266Z  2024-12-18T00:14:16.5366699Z  2024-12-18T00:14:16.5367077Z  2024-12-18T00:14:16.5367473Z  2024-12-18T00:14:16.5367863Z  2024-12-18T00:14:16.5368457Z [15,023 / 15,187] 47 actions running 2024-12-18T00:14:16.5369112Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T00:14:16.5369857Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2024-12-18T00:14:16.5370606Z @llvm-project//mlir:LinalgTransforms; 47s local 2024-12-18T00:14:16.5371425Z Compiling torch_xla/csrc/init_python_bindings.cpp; 42s local 2024-12-18T00:14:16.5372280Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2024-12-18T00:14:16.5373086Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2024-12-18T00:14:16.5373930Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local 2024-12-18T00:14:16.5375396Z Compiling torch_xla/csrc/debug_util.cpp; 38s local ... 2024-12-18T00:14:16.9367844Z 2024-12-18T00:14:16.9369191Z  2024-12-18T00:14:16.9370087Z  2024-12-18T00:14:16.9371256Z  2024-12-18T00:14:16.9372342Z  2024-12-18T00:14:16.9372739Z  2024-12-18T00:14:16.9373123Z  2024-12-18T00:14:16.9373528Z  2024-12-18T00:14:16.9373896Z  2024-12-18T00:14:16.9374391Z [15,023 / 15,187] 48 actions running 2024-12-18T00:14:16.9375051Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2024-12-18T00:14:16.9375739Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2024-12-18T00:14:16.9376698Z @llvm-project//mlir:LinalgTransforms; 47s local 2024-12-18T00:14:16.9377508Z Compiling torch_xla/csrc/init_python_bindings.cpp; 43s local 2024-12-18T00:14:16.9378354Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2024-12-18T00:14:16.9379297Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2024-12-18T00:14:16.9380128Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local 2024-12-18T00:14:16.9380956Z Compiling torch_xla/csrc/debug_util.cpp; 38s local ... 2024-12-18T00:14:17.8791321Z 2024-12-18T00:14:17.8792227Z  2024-12-18T00:14:17.8792707Z  2024-12-18T00:14:17.8793103Z  2024-12-18T00:14:17.8793485Z  2024-12-18T00:14:17.8794191Z  2024-12-18T00:14:17.8794635Z  2024-12-18T00:14:17.8795039Z  2024-12-18T00:14:17.8795542Z  2024-12-18T00:14:17.8796127Z [15,024 / 15,187] 48 actions, 47 running 2024-12-18T00:14:17.8796782Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2024-12-18T00:14:17.8797510Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T00:14:17.8798263Z @llvm-project//mlir:LinalgTransforms; 48s local 2024-12-18T00:14:17.8799175Z Compiling torch_xla/csrc/init_python_bindings.cpp; 44s local 2024-12-18T00:14:17.8800035Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2024-12-18T00:14:17.8800856Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2024-12-18T00:14:17.8801631Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local 2024-12-18T00:14:17.8802262Z Compiling torch_xla/csrc/debug_util.cpp; 39s local ... 2024-12-18T00:14:18.1312073Z 2024-12-18T00:14:18.1313060Z  2024-12-18T00:14:18.1313517Z  2024-12-18T00:14:18.1324944Z  2024-12-18T00:14:18.1325760Z  2024-12-18T00:14:18.1326133Z  2024-12-18T00:14:18.1326546Z  2024-12-18T00:14:18.1326946Z  2024-12-18T00:14:18.1327357Z  2024-12-18T00:14:18.1328025Z [15,025 / 15,187] 48 actions, 47 running 2024-12-18T00:14:18.1328772Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2024-12-18T00:14:18.1329488Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T00:14:18.1330271Z @llvm-project//mlir:LinalgTransforms; 48s local 2024-12-18T00:14:18.1331106Z Compiling torch_xla/csrc/init_python_bindings.cpp; 44s local 2024-12-18T00:14:18.1332028Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2024-12-18T00:14:18.1332855Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2024-12-18T00:14:18.1333665Z Compiling torch_xla/csrc/debug_util.cpp; 39s local 2024-12-18T00:14:18.1334498Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local ... 2024-12-18T00:14:18.3379312Z 2024-12-18T00:14:18.3382393Z  2024-12-18T00:14:18.3382936Z  2024-12-18T00:14:18.3383379Z  2024-12-18T00:14:18.3383812Z  2024-12-18T00:14:18.3384187Z  2024-12-18T00:14:18.3384555Z  2024-12-18T00:14:18.3384940Z  2024-12-18T00:14:18.3385312Z  2024-12-18T00:14:18.3385896Z [15,025 / 15,187] 48 actions running 2024-12-18T00:14:18.3386592Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2024-12-18T00:14:18.3387305Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T00:14:18.3388102Z @llvm-project//mlir:LinalgTransforms; 49s local 2024-12-18T00:14:18.3388893Z Compiling torch_xla/csrc/init_python_bindings.cpp; 44s local 2024-12-18T00:14:18.3389866Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2024-12-18T00:14:18.3390723Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2024-12-18T00:14:18.3391813Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2024-12-18T00:14:18.3392773Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local ... 2024-12-18T00:14:19.3388795Z 2024-12-18T00:14:19.3389673Z  2024-12-18T00:14:19.3390168Z  2024-12-18T00:14:19.3390529Z  2024-12-18T00:14:19.3391016Z  2024-12-18T00:14:19.3391510Z  2024-12-18T00:14:19.3391929Z  2024-12-18T00:14:19.3392317Z  2024-12-18T00:14:19.3392700Z  2024-12-18T00:14:19.3393214Z [15,025 / 15,187] 48 actions running 2024-12-18T00:14:19.3393827Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2024-12-18T00:14:19.3394532Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2024-12-18T00:14:19.3395342Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T00:14:19.3396138Z Compiling torch_xla/csrc/init_python_bindings.cpp; 45s local 2024-12-18T00:14:19.3396981Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2024-12-18T00:14:19.3397771Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2024-12-18T00:14:19.3398865Z Compiling torch_xla/csrc/debug_util.cpp; 41s local 2024-12-18T00:14:19.3399651Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local ... 2024-12-18T00:14:20.3396680Z 2024-12-18T00:14:20.3397565Z  2024-12-18T00:14:20.3398043Z  2024-12-18T00:14:20.3398461Z  2024-12-18T00:14:20.3398865Z  2024-12-18T00:14:20.3399257Z  2024-12-18T00:14:20.3399698Z  2024-12-18T00:14:20.3400195Z  2024-12-18T00:14:20.3400699Z  2024-12-18T00:14:20.3401388Z [15,025 / 15,187] 48 actions running 2024-12-18T00:14:20.3402534Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2024-12-18T00:14:20.3403313Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2024-12-18T00:14:20.3404200Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T00:14:20.3404950Z Compiling torch_xla/csrc/init_python_bindings.cpp; 46s local 2024-12-18T00:14:20.3405785Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2024-12-18T00:14:20.3406555Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2024-12-18T00:14:20.3407303Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2024-12-18T00:14:20.3408099Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local ... 2024-12-18T00:14:20.7401557Z 2024-12-18T00:14:20.7402390Z  2024-12-18T00:14:20.7402876Z  2024-12-18T00:14:20.7403298Z  2024-12-18T00:14:20.7403695Z  2024-12-18T00:14:20.7404113Z  2024-12-18T00:14:20.7404517Z  2024-12-18T00:14:20.7404900Z  2024-12-18T00:14:20.7405270Z  2024-12-18T00:14:20.7405842Z [15,026 / 15,187] 48 actions running 2024-12-18T00:14:20.7406486Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2024-12-18T00:14:20.7407198Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2024-12-18T00:14:20.7407943Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T00:14:20.7408686Z Compiling torch_xla/csrc/init_python_bindings.cpp; 46s local 2024-12-18T00:14:20.7409576Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T00:14:20.7410361Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2024-12-18T00:14:20.7411102Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local 2024-12-18T00:14:20.7411932Z Compiling torch_xla/csrc/reduction.cpp; 37s local ... 2024-12-18T00:14:20.9405070Z 2024-12-18T00:14:20.9405994Z  2024-12-18T00:14:20.9406504Z  2024-12-18T00:14:20.9406876Z  2024-12-18T00:14:20.9407238Z  2024-12-18T00:14:20.9407599Z  2024-12-18T00:14:20.9407965Z  2024-12-18T00:14:20.9408305Z  2024-12-18T00:14:20.9408701Z  2024-12-18T00:14:20.9409234Z [15,027 / 15,187] 48 actions running 2024-12-18T00:14:20.9409935Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2024-12-18T00:14:20.9410620Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2024-12-18T00:14:20.9411347Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T00:14:20.9412431Z Compiling torch_xla/csrc/init_python_bindings.cpp; 47s local 2024-12-18T00:14:20.9413289Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T00:14:20.9414037Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2024-12-18T00:14:20.9414790Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local 2024-12-18T00:14:20.9415509Z Compiling torch_xla/csrc/tensor.cpp; 33s local ... 2024-12-18T00:14:21.4449168Z 2024-12-18T00:14:21.4450013Z  2024-12-18T00:14:21.4450482Z  2024-12-18T00:14:21.4450856Z  2024-12-18T00:14:21.4451247Z  2024-12-18T00:14:21.4451631Z  2024-12-18T00:14:21.4452032Z  2024-12-18T00:14:21.4452403Z  2024-12-18T00:14:21.4452790Z  2024-12-18T00:14:21.4453280Z [15,028 / 15,187] 48 actions, 47 running 2024-12-18T00:14:21.4453792Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2024-12-18T00:14:21.4454336Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2024-12-18T00:14:21.4454919Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T00:14:21.4456038Z Compiling torch_xla/csrc/init_python_bindings.cpp; 47s local 2024-12-18T00:14:21.4457175Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T00:14:21.4458046Z Compiling torch_xla/csrc/debug_util.cpp; 43s local 2024-12-18T00:14:21.4458775Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2024-12-18T00:14:21.4459471Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2024-12-18T00:14:21.7411314Z 2024-12-18T00:14:21.7412192Z  2024-12-18T00:14:21.7412674Z  2024-12-18T00:14:21.7413057Z  2024-12-18T00:14:21.7413719Z  2024-12-18T00:14:21.7414114Z  2024-12-18T00:14:21.7414516Z  2024-12-18T00:14:21.7414913Z  2024-12-18T00:14:21.7415312Z  2024-12-18T00:14:21.7415836Z [15,028 / 15,187] 48 actions running 2024-12-18T00:14:21.7416565Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2024-12-18T00:14:21.7417264Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2024-12-18T00:14:21.7417978Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T00:14:21.7418762Z Compiling torch_xla/csrc/init_python_bindings.cpp; 47s local 2024-12-18T00:14:21.7419612Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T00:14:21.7420377Z Compiling torch_xla/csrc/debug_util.cpp; 43s local 2024-12-18T00:14:21.7421127Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2024-12-18T00:14:21.7421914Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2024-12-18T00:14:22.1416025Z 2024-12-18T00:14:22.1416964Z  2024-12-18T00:14:22.1417396Z  2024-12-18T00:14:22.1417771Z  2024-12-18T00:14:22.1418134Z  2024-12-18T00:14:22.1418494Z  2024-12-18T00:14:22.1418987Z  2024-12-18T00:14:22.1419323Z  2024-12-18T00:14:22.1419658Z  2024-12-18T00:14:22.1420136Z [15,029 / 15,187] 47 actions running 2024-12-18T00:14:22.1420707Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T00:14:22.1421329Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2024-12-18T00:14:22.1422000Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T00:14:22.1422705Z Compiling torch_xla/csrc/init_python_bindings.cpp; 48s local 2024-12-18T00:14:22.1423430Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T00:14:22.1424081Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2024-12-18T00:14:22.1424722Z Compiling torch_xla/csrc/tensor.cpp; 35s local 2024-12-18T00:14:22.1425409Z Compiling torch_xla/csrc/tensor_methods.cpp; 34s local ... 2024-12-18T00:14:22.5420604Z 2024-12-18T00:14:22.5421394Z  2024-12-18T00:14:22.5421817Z  2024-12-18T00:14:22.5422176Z  2024-12-18T00:14:22.5422527Z  2024-12-18T00:14:22.5422894Z  2024-12-18T00:14:22.5423255Z  2024-12-18T00:14:22.5423625Z  2024-12-18T00:14:22.5423952Z  2024-12-18T00:14:22.5424617Z [15,029 / 15,187] 48 actions running 2024-12-18T00:14:22.5425540Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T00:14:22.5426289Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2024-12-18T00:14:22.5427084Z @llvm-project//mlir:LinalgTransforms; 53s local 2024-12-18T00:14:22.5427925Z Compiling torch_xla/csrc/init_python_bindings.cpp; 48s local 2024-12-18T00:14:22.5428824Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T00:14:22.5429633Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2024-12-18T00:14:22.5430406Z Compiling torch_xla/csrc/tensor.cpp; 35s local 2024-12-18T00:14:22.5431245Z Compiling torch_xla/csrc/tensor_methods.cpp; 34s local ... 2024-12-18T00:14:23.4838700Z 2024-12-18T00:14:23.4839571Z  2024-12-18T00:14:23.4839980Z  2024-12-18T00:14:23.4840325Z  2024-12-18T00:14:23.4840699Z  2024-12-18T00:14:23.4841093Z  2024-12-18T00:14:23.4841464Z  2024-12-18T00:14:23.4841830Z  2024-12-18T00:14:23.4842189Z  2024-12-18T00:14:23.4842673Z [15,030 / 15,187] 48 actions, 47 running 2024-12-18T00:14:23.4843520Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2024-12-18T00:14:23.4844131Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T00:14:23.4845302Z @llvm-project//mlir:LinalgTransforms; 54s local 2024-12-18T00:14:23.4845955Z Compiling torch_xla/csrc/init_python_bindings.cpp; 49s local 2024-12-18T00:14:23.4846706Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2024-12-18T00:14:23.4847398Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2024-12-18T00:14:23.4848056Z Compiling torch_xla/csrc/tensor.cpp; 36s local 2024-12-18T00:14:23.4848927Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local ... 2024-12-18T00:14:23.7430501Z 2024-12-18T00:14:23.7431355Z  2024-12-18T00:14:23.7431818Z  2024-12-18T00:14:23.7432305Z  2024-12-18T00:14:23.7432662Z  2024-12-18T00:14:23.7433028Z  2024-12-18T00:14:23.7433430Z  2024-12-18T00:14:23.7433992Z  2024-12-18T00:14:23.7434348Z  2024-12-18T00:14:23.7434909Z [15,030 / 15,187] 48 actions running 2024-12-18T00:14:23.7435570Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2024-12-18T00:14:23.7436249Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T00:14:23.7436956Z @llvm-project//mlir:LinalgTransforms; 54s local 2024-12-18T00:14:23.7437775Z Compiling torch_xla/csrc/init_python_bindings.cpp; 49s local 2024-12-18T00:14:23.7438575Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2024-12-18T00:14:23.7439355Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2024-12-18T00:14:23.7440010Z Compiling torch_xla/csrc/tensor.cpp; 36s local 2024-12-18T00:14:23.7440730Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local ... 2024-12-18T00:14:24.7438720Z 2024-12-18T00:14:24.7439631Z  2024-12-18T00:14:24.7440134Z  2024-12-18T00:14:24.7440541Z  2024-12-18T00:14:24.7440943Z  2024-12-18T00:14:24.7441356Z  2024-12-18T00:14:24.7441725Z  2024-12-18T00:14:24.7442098Z  2024-12-18T00:14:24.7442476Z  2024-12-18T00:14:24.7442996Z [15,030 / 15,187] 48 actions running 2024-12-18T00:14:24.7443662Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2024-12-18T00:14:24.7444670Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2024-12-18T00:14:24.7445436Z @llvm-project//mlir:LinalgTransforms; 55s local 2024-12-18T00:14:24.7446218Z Compiling torch_xla/csrc/init_python_bindings.cpp; 50s local 2024-12-18T00:14:24.7447062Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2024-12-18T00:14:24.7447861Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2024-12-18T00:14:24.7448582Z Compiling torch_xla/csrc/tensor.cpp; 37s local 2024-12-18T00:14:24.7449345Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local ... 2024-12-18T00:14:25.3084539Z 2024-12-18T00:14:25.3085420Z  2024-12-18T00:14:25.3085868Z  2024-12-18T00:14:25.3086545Z  2024-12-18T00:14:25.3086917Z  2024-12-18T00:14:25.3087304Z  2024-12-18T00:14:25.3087697Z  2024-12-18T00:14:25.3088097Z  2024-12-18T00:14:25.3088487Z  2024-12-18T00:14:25.3089060Z [15,031 / 15,187] 48 actions, 47 running 2024-12-18T00:14:25.3089700Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2024-12-18T00:14:25.3090314Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2024-12-18T00:14:25.3090994Z @llvm-project//mlir:LinalgTransforms; 56s local 2024-12-18T00:14:25.3091759Z Compiling torch_xla/csrc/init_python_bindings.cpp; 51s local 2024-12-18T00:14:25.3092605Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2024-12-18T00:14:25.3093334Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2024-12-18T00:14:25.3093945Z Compiling torch_xla/csrc/tensor.cpp; 38s local 2024-12-18T00:14:25.3094667Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local ... 2024-12-18T00:14:25.5446824Z 2024-12-18T00:14:25.5447735Z  2024-12-18T00:14:25.5448203Z  2024-12-18T00:14:25.5448584Z  2024-12-18T00:14:25.5448959Z  2024-12-18T00:14:25.5449586Z  2024-12-18T00:14:25.5449988Z  2024-12-18T00:14:25.5450362Z  2024-12-18T00:14:25.5450874Z  2024-12-18T00:14:25.5451414Z [15,031 / 15,187] 48 actions running 2024-12-18T00:14:25.5452105Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2024-12-18T00:14:25.5452804Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2024-12-18T00:14:25.5453560Z @llvm-project//mlir:LinalgTransforms; 56s local 2024-12-18T00:14:25.5454519Z Compiling torch_xla/csrc/init_python_bindings.cpp; 51s local 2024-12-18T00:14:25.5455381Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2024-12-18T00:14:25.5456172Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2024-12-18T00:14:25.5457047Z Compiling torch_xla/csrc/tensor.cpp; 38s local 2024-12-18T00:14:25.5457841Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local ... 2024-12-18T00:14:26.5454043Z 2024-12-18T00:14:26.5454882Z  2024-12-18T00:14:26.5455339Z  2024-12-18T00:14:26.5455742Z  2024-12-18T00:14:26.5456120Z  2024-12-18T00:14:26.5456682Z  2024-12-18T00:14:26.5457094Z  2024-12-18T00:14:26.5457409Z  2024-12-18T00:14:26.5457724Z  2024-12-18T00:14:26.5458181Z [15,031 / 15,187] 48 actions running 2024-12-18T00:14:26.5458729Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2024-12-18T00:14:26.5459330Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2024-12-18T00:14:26.5459925Z @llvm-project//mlir:LinalgTransforms; 57s local 2024-12-18T00:14:26.5460673Z Compiling torch_xla/csrc/init_python_bindings.cpp; 52s local 2024-12-18T00:14:26.5461510Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2024-12-18T00:14:26.5462275Z Compiling torch_xla/csrc/ir_dump_util.cpp; 46s local 2024-12-18T00:14:26.5463010Z Compiling torch_xla/csrc/tensor.cpp; 39s local 2024-12-18T00:14:26.5463778Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local ... 2024-12-18T00:14:27.0609183Z 2024-12-18T00:14:27.0610038Z  2024-12-18T00:14:27.0610423Z  2024-12-18T00:14:27.0610744Z  2024-12-18T00:14:27.0611047Z  2024-12-18T00:14:27.0611379Z  2024-12-18T00:14:27.0611697Z  2024-12-18T00:14:27.0612012Z  2024-12-18T00:14:27.0612333Z  2024-12-18T00:14:27.0612792Z [15,032 / 15,187] 48 actions, 47 running 2024-12-18T00:14:27.0613331Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2024-12-18T00:14:27.0613889Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2024-12-18T00:14:27.0614495Z @llvm-project//mlir:LinalgTransforms; 57s local 2024-12-18T00:14:27.0615133Z Compiling torch_xla/csrc/init_python_bindings.cpp; 53s local 2024-12-18T00:14:27.0615945Z Compiling torch_xla/csrc/aten_xla_type.cpp; 52s local 2024-12-18T00:14:27.0616707Z Compiling torch_xla/csrc/ir_dump_util.cpp; 46s local 2024-12-18T00:14:27.0617599Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2024-12-18T00:14:27.0618246Z Compiling torch_xla/csrc/tensor_methods.cpp; 39s local ... 2024-12-18T00:14:27.3459942Z 2024-12-18T00:14:27.3460706Z  2024-12-18T00:14:27.3461099Z  2024-12-18T00:14:27.3461462Z  2024-12-18T00:14:27.3461801Z  2024-12-18T00:14:27.3462147Z  2024-12-18T00:14:27.3462463Z  2024-12-18T00:14:27.3462803Z  2024-12-18T00:14:27.3463158Z  2024-12-18T00:14:27.3463667Z [15,032 / 15,187] 48 actions running 2024-12-18T00:14:27.3464246Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2024-12-18T00:14:27.3464891Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2024-12-18T00:14:27.3465547Z @llvm-project//mlir:LinalgTransforms; 58s local 2024-12-18T00:14:27.3466274Z Compiling torch_xla/csrc/init_python_bindings.cpp; 53s local 2024-12-18T00:14:27.3467057Z Compiling torch_xla/csrc/aten_xla_type.cpp; 52s local 2024-12-18T00:14:27.3467893Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2024-12-18T00:14:27.3468550Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2024-12-18T00:14:27.3469567Z Compiling torch_xla/csrc/tensor_methods.cpp; 39s local ... 2024-12-18T00:14:28.3468164Z 2024-12-18T00:14:28.3469352Z  2024-12-18T00:14:28.3469801Z  2024-12-18T00:14:28.3470139Z  2024-12-18T00:14:28.3470509Z  2024-12-18T00:14:28.3470883Z  2024-12-18T00:14:28.3471267Z  2024-12-18T00:14:28.3471649Z  2024-12-18T00:14:28.3471995Z  2024-12-18T00:14:28.3472538Z [15,032 / 15,187] 48 actions running 2024-12-18T00:14:28.3473564Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2024-12-18T00:14:28.3474252Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2024-12-18T00:14:28.3474958Z @llvm-project//mlir:LinalgTransforms; 59s local 2024-12-18T00:14:28.3475663Z Compiling torch_xla/csrc/init_python_bindings.cpp; 54s local 2024-12-18T00:14:28.3476519Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2024-12-18T00:14:28.3477254Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2024-12-18T00:14:28.3477944Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2024-12-18T00:14:28.3478693Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local ... 2024-12-18T00:14:29.3474630Z 2024-12-18T00:14:29.3475451Z  2024-12-18T00:14:29.3475926Z  2024-12-18T00:14:29.3476331Z  2024-12-18T00:14:29.3476741Z  2024-12-18T00:14:29.3477132Z  2024-12-18T00:14:29.3477532Z  2024-12-18T00:14:29.3477933Z  2024-12-18T00:14:29.3478334Z  2024-12-18T00:14:29.3478893Z [15,033 / 15,187] 47 actions running 2024-12-18T00:14:29.3479592Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T00:14:29.3480310Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T00:14:29.3481073Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T00:14:29.3481884Z Compiling torch_xla/csrc/init_python_bindings.cpp; 55s local 2024-12-18T00:14:29.3482746Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2024-12-18T00:14:29.3483525Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2024-12-18T00:14:29.3484269Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2024-12-18T00:14:29.3485074Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local ... 2024-12-18T00:14:29.7479472Z 2024-12-18T00:14:29.7480355Z  2024-12-18T00:14:29.7480826Z  2024-12-18T00:14:29.7481217Z  2024-12-18T00:14:29.7481605Z  2024-12-18T00:14:29.7482023Z  2024-12-18T00:14:29.7482411Z  2024-12-18T00:14:29.7482789Z  2024-12-18T00:14:29.7483159Z  2024-12-18T00:14:29.7483737Z [15,033 / 15,187] 48 actions running 2024-12-18T00:14:29.7484397Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T00:14:29.7485098Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T00:14:29.7485875Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T00:14:29.7487061Z Compiling torch_xla/csrc/init_python_bindings.cpp; 55s local 2024-12-18T00:14:29.7487882Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T00:14:29.7488612Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2024-12-18T00:14:29.7489330Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2024-12-18T00:14:29.7490263Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local ... 2024-12-18T00:14:29.9482990Z 2024-12-18T00:14:29.9483835Z  2024-12-18T00:14:29.9484285Z  2024-12-18T00:14:29.9484751Z  2024-12-18T00:14:29.9485127Z  2024-12-18T00:14:29.9485473Z  2024-12-18T00:14:29.9485874Z  2024-12-18T00:14:29.9486269Z  2024-12-18T00:14:29.9486628Z  2024-12-18T00:14:29.9487180Z [15,034 / 15,187] 48 actions, 47 running 2024-12-18T00:14:29.9487803Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T00:14:29.9488456Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T00:14:29.9489176Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T00:14:29.9489908Z Compiling torch_xla/csrc/init_python_bindings.cpp; 56s local 2024-12-18T00:14:29.9491146Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T00:14:29.9491873Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2024-12-18T00:14:29.9492718Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2024-12-18T00:14:29.9493530Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local ... 2024-12-18T00:14:30.3487781Z 2024-12-18T00:14:30.3488630Z  2024-12-18T00:14:30.3489130Z  2024-12-18T00:14:30.3489527Z  2024-12-18T00:14:30.3489943Z  2024-12-18T00:14:30.3490674Z  2024-12-18T00:14:30.3491060Z  2024-12-18T00:14:30.3491458Z  2024-12-18T00:14:30.3491856Z  2024-12-18T00:14:30.3492398Z [15,034 / 15,187] 48 actions running 2024-12-18T00:14:30.3493091Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T00:14:30.3493775Z Compiling xla/service/cpu/cpu_compiler.cc; 62s local 2024-12-18T00:14:30.3494477Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T00:14:30.3495254Z Compiling torch_xla/csrc/init_python_bindings.cpp; 56s local 2024-12-18T00:14:30.3496059Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T00:14:30.3497007Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2024-12-18T00:14:30.3497678Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2024-12-18T00:14:30.3498467Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local ... 2024-12-18T00:14:30.5581776Z 2024-12-18T00:14:30.5582682Z  2024-12-18T00:14:30.5583155Z  2024-12-18T00:14:30.5583538Z  2024-12-18T00:14:30.5583956Z  2024-12-18T00:14:30.5584322Z  2024-12-18T00:14:30.5584704Z  2024-12-18T00:14:30.5585104Z  2024-12-18T00:14:30.5585496Z  2024-12-18T00:14:30.5586077Z [15,035 / 15,187] 48 actions, 47 running 2024-12-18T00:14:30.5586762Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T00:14:30.5587420Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T00:14:30.5588238Z Compiling torch_xla/csrc/init_python_bindings.cpp; 56s local 2024-12-18T00:14:30.5589082Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T00:14:30.5589864Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2024-12-18T00:14:30.5590614Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2024-12-18T00:14:30.5591372Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local 2024-12-18T00:14:30.5592166Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local ... 2024-12-18T00:14:30.9493965Z 2024-12-18T00:14:30.9494845Z  2024-12-18T00:14:30.9495264Z  2024-12-18T00:14:30.9495667Z  2024-12-18T00:14:30.9496020Z  2024-12-18T00:14:30.9496542Z  2024-12-18T00:14:30.9496919Z  2024-12-18T00:14:30.9497302Z  2024-12-18T00:14:30.9497684Z  2024-12-18T00:14:30.9498233Z [15,035 / 15,187] 48 actions running 2024-12-18T00:14:30.9499182Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2024-12-18T00:14:30.9499852Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T00:14:30.9500635Z Compiling torch_xla/csrc/init_python_bindings.cpp; 57s local 2024-12-18T00:14:30.9501455Z Compiling torch_xla/csrc/aten_xla_type.cpp; 56s local 2024-12-18T00:14:30.9502203Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2024-12-18T00:14:30.9502936Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2024-12-18T00:14:30.9503725Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local 2024-12-18T00:14:30.9504544Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local ... 2024-12-18T00:14:32.1373812Z 2024-12-18T00:14:32.1374659Z  2024-12-18T00:14:32.1375112Z  2024-12-18T00:14:32.1375532Z  2024-12-18T00:14:32.1375914Z  2024-12-18T00:14:32.1376271Z  2024-12-18T00:14:32.1376766Z  2024-12-18T00:14:32.1377236Z  2024-12-18T00:14:32.1377732Z  2024-12-18T00:14:32.1378425Z [15,036 / 15,187] 48 actions, 47 running 2024-12-18T00:14:32.1379043Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2024-12-18T00:14:32.1379928Z @llvm-project//mlir:LinalgTransforms; 62s local 2024-12-18T00:14:32.1380700Z Compiling torch_xla/csrc/init_python_bindings.cpp; 58s local 2024-12-18T00:14:32.1381594Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2024-12-18T00:14:32.1382156Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2024-12-18T00:14:32.1382688Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2024-12-18T00:14:32.1383399Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2024-12-18T00:14:32.1384064Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local ... 2024-12-18T00:14:32.3503784Z 2024-12-18T00:14:32.3504700Z  2024-12-18T00:14:32.3505164Z  2024-12-18T00:14:32.3505723Z  2024-12-18T00:14:32.3506074Z  2024-12-18T00:14:32.3506441Z  2024-12-18T00:14:32.3506818Z  2024-12-18T00:14:32.3507233Z  2024-12-18T00:14:32.3507596Z  2024-12-18T00:14:32.3508140Z [15,036 / 15,187] 48 actions running 2024-12-18T00:14:32.3508806Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2024-12-18T00:14:32.3509451Z @llvm-project//mlir:LinalgTransforms; 63s local 2024-12-18T00:14:32.3510266Z Compiling torch_xla/csrc/init_python_bindings.cpp; 58s local 2024-12-18T00:14:32.3511091Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2024-12-18T00:14:32.3511876Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2024-12-18T00:14:32.3512590Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2024-12-18T00:14:32.3513312Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2024-12-18T00:14:32.3514030Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local ... 2024-12-18T00:14:33.5270199Z 2024-12-18T00:14:33.5271070Z  2024-12-18T00:14:33.5271538Z  2024-12-18T00:14:33.5271932Z  2024-12-18T00:14:33.5272341Z  2024-12-18T00:14:33.5272719Z  2024-12-18T00:14:33.5273112Z  2024-12-18T00:14:33.5273484Z  2024-12-18T00:14:33.5273872Z  2024-12-18T00:14:33.5274476Z [15,037 / 15,187] 48 actions, 47 running 2024-12-18T00:14:33.5275164Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2024-12-18T00:14:33.5275856Z @llvm-project//mlir:LinalgTransforms; 64s local 2024-12-18T00:14:33.5276652Z Compiling torch_xla/csrc/init_python_bindings.cpp; 59s local 2024-12-18T00:14:33.5277463Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2024-12-18T00:14:33.5278195Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2024-12-18T00:14:33.5278920Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2024-12-18T00:14:33.5279673Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2024-12-18T00:14:33.5280499Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local ... 2024-12-18T00:14:33.7513509Z 2024-12-18T00:14:33.7514342Z  2024-12-18T00:14:33.7514760Z  2024-12-18T00:14:33.7515129Z  2024-12-18T00:14:33.7515807Z  2024-12-18T00:14:33.7516333Z  2024-12-18T00:14:33.7516659Z  2024-12-18T00:14:33.7517009Z  2024-12-18T00:14:33.7517381Z  2024-12-18T00:14:33.7517906Z [15,037 / 15,187] 48 actions running 2024-12-18T00:14:33.7518551Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2024-12-18T00:14:33.7519192Z @llvm-project//mlir:LinalgTransforms; 64s local 2024-12-18T00:14:33.7519922Z Compiling torch_xla/csrc/init_python_bindings.cpp; 59s local 2024-12-18T00:14:33.7520742Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2024-12-18T00:14:33.7521490Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2024-12-18T00:14:33.7522170Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2024-12-18T00:14:33.7522700Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2024-12-18T00:14:33.7523292Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local ... 2024-12-18T00:14:34.9522297Z 2024-12-18T00:14:34.9523187Z  2024-12-18T00:14:34.9523684Z  2024-12-18T00:14:34.9524082Z  2024-12-18T00:14:34.9524452Z  2024-12-18T00:14:34.9524849Z  2024-12-18T00:14:34.9525563Z  2024-12-18T00:14:34.9525969Z  2024-12-18T00:14:34.9526375Z  2024-12-18T00:14:34.9527226Z [15,037 / 15,187] 48 actions running 2024-12-18T00:14:34.9528068Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T00:14:34.9528715Z @llvm-project//mlir:LinalgTransforms; 65s local 2024-12-18T00:14:34.9529480Z Compiling torch_xla/csrc/init_python_bindings.cpp; 61s local 2024-12-18T00:14:34.9530266Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T00:14:34.9531246Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2024-12-18T00:14:34.9532107Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2024-12-18T00:14:34.9532880Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T00:14:34.9533738Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local ... 2024-12-18T00:14:35.4305699Z 2024-12-18T00:14:35.4306603Z  2024-12-18T00:14:35.4307091Z  2024-12-18T00:14:35.4307499Z  2024-12-18T00:14:35.4307951Z  2024-12-18T00:14:35.4308360Z  2024-12-18T00:14:35.4308766Z  2024-12-18T00:14:35.4309173Z  2024-12-18T00:14:35.4309595Z  2024-12-18T00:14:35.4310195Z [15,038 / 15,187] 48 actions, 47 running 2024-12-18T00:14:35.4310901Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T00:14:35.4311592Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T00:14:35.4312457Z Compiling torch_xla/csrc/init_python_bindings.cpp; 61s local 2024-12-18T00:14:35.4313355Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T00:14:35.4314115Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2024-12-18T00:14:35.4314844Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T00:14:35.4315536Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2024-12-18T00:14:35.4316348Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local ... 2024-12-18T00:14:35.7529056Z 2024-12-18T00:14:35.7529883Z  2024-12-18T00:14:35.7530335Z  2024-12-18T00:14:35.7530667Z  2024-12-18T00:14:35.7531035Z  2024-12-18T00:14:35.7531387Z  2024-12-18T00:14:35.7531762Z  2024-12-18T00:14:35.7532109Z  2024-12-18T00:14:35.7532433Z  2024-12-18T00:14:35.7532947Z [15,039 / 15,187] 48 actions running 2024-12-18T00:14:35.7533562Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T00:14:35.7534172Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T00:14:35.7534879Z Compiling torch_xla/csrc/init_python_bindings.cpp; 61s local 2024-12-18T00:14:35.7535589Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T00:14:35.7536241Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2024-12-18T00:14:35.7537039Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T00:14:35.7537719Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2024-12-18T00:14:35.7538759Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local ... 2024-12-18T00:14:35.9533082Z 2024-12-18T00:14:35.9533922Z  2024-12-18T00:14:35.9534311Z  2024-12-18T00:14:35.9534655Z  2024-12-18T00:14:35.9535007Z  2024-12-18T00:14:35.9535340Z  2024-12-18T00:14:35.9535667Z  2024-12-18T00:14:35.9536008Z  2024-12-18T00:14:35.9536490Z  2024-12-18T00:14:35.9536971Z [15,040 / 15,187] 48 actions running 2024-12-18T00:14:35.9537563Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2024-12-18T00:14:35.9538143Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T00:14:35.9538861Z Compiling torch_xla/csrc/init_python_bindings.cpp; 62s local 2024-12-18T00:14:35.9539610Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T00:14:35.9540263Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2024-12-18T00:14:35.9540901Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2024-12-18T00:14:35.9541551Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2024-12-18T00:14:35.9542578Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local ... 2024-12-18T00:14:36.1796563Z 2024-12-18T00:14:36.1797347Z  2024-12-18T00:14:36.1798210Z  2024-12-18T00:14:36.1798560Z  2024-12-18T00:14:36.1798894Z  2024-12-18T00:14:36.1799233Z  2024-12-18T00:14:36.1799565Z  2024-12-18T00:14:36.1799883Z  2024-12-18T00:14:36.1800213Z  2024-12-18T00:14:36.1800713Z [15,041 / 15,187] 48 actions, 47 running 2024-12-18T00:14:36.1801286Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2024-12-18T00:14:36.1802030Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T00:14:36.1802719Z Compiling torch_xla/csrc/init_python_bindings.cpp; 62s local 2024-12-18T00:14:36.1803445Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T00:14:36.1804080Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2024-12-18T00:14:36.1804724Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2024-12-18T00:14:36.1805377Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2024-12-18T00:14:36.1806050Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local ... 2024-12-18T00:14:36.5538839Z 2024-12-18T00:14:36.5539685Z  2024-12-18T00:14:36.5540100Z  2024-12-18T00:14:36.5540457Z  2024-12-18T00:14:36.5540799Z  2024-12-18T00:14:36.5541154Z  2024-12-18T00:14:36.5541479Z  2024-12-18T00:14:36.5541829Z  2024-12-18T00:14:36.5542180Z  2024-12-18T00:14:36.5542694Z [15,041 / 15,187] 48 actions running 2024-12-18T00:14:36.5543443Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2024-12-18T00:14:36.5544042Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T00:14:36.5544957Z Compiling torch_xla/csrc/init_python_bindings.cpp; 62s local 2024-12-18T00:14:36.5545718Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T00:14:36.5546386Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2024-12-18T00:14:36.5547024Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2024-12-18T00:14:36.5547684Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2024-12-18T00:14:36.5548443Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local ... 2024-12-18T00:14:37.5547959Z 2024-12-18T00:14:37.5548795Z  2024-12-18T00:14:37.5549165Z  2024-12-18T00:14:37.5549477Z  2024-12-18T00:14:37.5549787Z  2024-12-18T00:14:37.5550105Z  2024-12-18T00:14:37.5550410Z  2024-12-18T00:14:37.5550709Z  2024-12-18T00:14:37.5551016Z  2024-12-18T00:14:37.5551499Z [15,041 / 15,187] 48 actions running 2024-12-18T00:14:37.5552022Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2024-12-18T00:14:37.5552575Z @llvm-project//mlir:LinalgTransforms; 68s local 2024-12-18T00:14:37.5553184Z Compiling torch_xla/csrc/init_python_bindings.cpp; 63s local 2024-12-18T00:14:37.5554129Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2024-12-18T00:14:37.5554703Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2024-12-18T00:14:37.5555304Z Compiling torch_xla/csrc/tensor_methods.cpp; 49s local 2024-12-18T00:14:37.5555897Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2024-12-18T00:14:37.5556535Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local ... 2024-12-18T00:14:38.0528571Z 2024-12-18T00:14:38.0529470Z  2024-12-18T00:14:38.0529939Z  2024-12-18T00:14:38.0530319Z  2024-12-18T00:14:38.0530678Z  2024-12-18T00:14:38.0531048Z  2024-12-18T00:14:38.0531409Z  2024-12-18T00:14:38.0531815Z  2024-12-18T00:14:38.0532159Z  2024-12-18T00:14:38.0532768Z [15,042 / 15,187] 48 actions, 47 running 2024-12-18T00:14:38.0533438Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2024-12-18T00:14:38.0534502Z @llvm-project//mlir:LinalgTransforms; 68s local 2024-12-18T00:14:38.0535572Z Compiling torch_xla/csrc/init_python_bindings.cpp; 64s local 2024-12-18T00:14:38.0536854Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T00:14:38.0538006Z Compiling torch_xla/csrc/tensor.cpp; 51s local 2024-12-18T00:14:38.0538886Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2024-12-18T00:14:38.0539902Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2024-12-18T00:14:38.0540850Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local ... 2024-12-18T00:14:38.3553761Z 2024-12-18T00:14:38.3554638Z  2024-12-18T00:14:38.3555077Z  2024-12-18T00:14:38.3555477Z  2024-12-18T00:14:38.3555850Z  2024-12-18T00:14:38.3558426Z  2024-12-18T00:14:38.3559208Z  2024-12-18T00:14:38.3559520Z  2024-12-18T00:14:38.3559831Z  2024-12-18T00:14:38.3560384Z [15,043 / 15,187] 48 actions running 2024-12-18T00:14:38.3561037Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2024-12-18T00:14:38.3561708Z @llvm-project//mlir:LinalgTransforms; 69s local 2024-12-18T00:14:38.3562533Z Compiling torch_xla/csrc/init_python_bindings.cpp; 64s local 2024-12-18T00:14:38.3563398Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T00:14:38.3564169Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2024-12-18T00:14:38.3564951Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2024-12-18T00:14:38.3565774Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2024-12-18T00:14:38.3566624Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local ... 2024-12-18T00:14:39.3562069Z 2024-12-18T00:14:39.3562971Z  2024-12-18T00:14:39.3563438Z  2024-12-18T00:14:39.3563888Z  2024-12-18T00:14:39.3564274Z  2024-12-18T00:14:39.3564668Z  2024-12-18T00:14:39.3565051Z  2024-12-18T00:14:39.3565426Z  2024-12-18T00:14:39.3565815Z  2024-12-18T00:14:39.3566378Z [15,043 / 15,187] 48 actions running 2024-12-18T00:14:39.3567010Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2024-12-18T00:14:39.3567708Z @llvm-project//mlir:LinalgTransforms; 70s local 2024-12-18T00:14:39.3568538Z Compiling torch_xla/csrc/init_python_bindings.cpp; 65s local 2024-12-18T00:14:39.3569374Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T00:14:39.3570270Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2024-12-18T00:14:39.3570984Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2024-12-18T00:14:39.3571755Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2024-12-18T00:14:39.3572589Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local ... 2024-12-18T00:14:40.3569992Z 2024-12-18T00:14:40.3570947Z  2024-12-18T00:14:40.3571790Z  2024-12-18T00:14:40.3572140Z  2024-12-18T00:14:40.3572572Z  2024-12-18T00:14:40.3572897Z  2024-12-18T00:14:40.3574187Z  2024-12-18T00:14:40.3574629Z  2024-12-18T00:14:40.3576438Z  2024-12-18T00:14:40.3576963Z [15,043 / 15,187] 48 actions running 2024-12-18T00:14:40.3577733Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2024-12-18T00:14:40.3578266Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T00:14:40.3578909Z Compiling torch_xla/csrc/init_python_bindings.cpp; 66s local 2024-12-18T00:14:40.3579606Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2024-12-18T00:14:40.3580261Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2024-12-18T00:14:40.3580907Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2024-12-18T00:14:40.3581559Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2024-12-18T00:14:40.3582384Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local ... 2024-12-18T00:14:40.8148873Z 2024-12-18T00:14:40.8149826Z  2024-12-18T00:14:40.8150403Z  2024-12-18T00:14:40.8150915Z  2024-12-18T00:14:40.8151353Z  2024-12-18T00:14:40.8151699Z  2024-12-18T00:14:40.8152066Z  2024-12-18T00:14:40.8152396Z  2024-12-18T00:14:40.8152924Z  2024-12-18T00:14:40.8153485Z [15,044 / 15,187] 48 actions, 47 running 2024-12-18T00:14:40.8154406Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T00:14:40.8155189Z Compiling torch_xla/csrc/init_python_bindings.cpp; 67s local 2024-12-18T00:14:40.8156096Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T00:14:40.8156694Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2024-12-18T00:14:40.8157586Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2024-12-18T00:14:40.8158344Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2024-12-18T00:14:40.8159282Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2024-12-18T00:14:40.8159985Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local ... 2024-12-18T00:14:41.1578113Z 2024-12-18T00:14:41.1578974Z  2024-12-18T00:14:41.1579414Z  2024-12-18T00:14:41.1579790Z  2024-12-18T00:14:41.1580144Z  2024-12-18T00:14:41.1580555Z  2024-12-18T00:14:41.1580937Z  2024-12-18T00:14:41.1581299Z  2024-12-18T00:14:41.1581653Z  2024-12-18T00:14:41.1582213Z [15,045 / 15,187] 47 actions running 2024-12-18T00:14:41.1582959Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T00:14:41.1583794Z Compiling torch_xla/csrc/init_python_bindings.cpp; 67s local 2024-12-18T00:14:41.1584712Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T00:14:41.1585539Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2024-12-18T00:14:41.1586263Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T00:14:41.1587140Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2024-12-18T00:14:41.1587985Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2024-12-18T00:14:41.1588754Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local ... 2024-12-18T00:14:41.3580309Z 2024-12-18T00:14:41.3581171Z  2024-12-18T00:14:41.3581566Z  2024-12-18T00:14:41.3581930Z  2024-12-18T00:14:41.3582272Z  2024-12-18T00:14:41.3582607Z  2024-12-18T00:14:41.3582921Z  2024-12-18T00:14:41.3583259Z  2024-12-18T00:14:41.3583635Z  2024-12-18T00:14:41.3584159Z [15,046 / 15,187] 47 actions running 2024-12-18T00:14:41.3584819Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T00:14:41.3585551Z Compiling torch_xla/csrc/init_python_bindings.cpp; 67s local 2024-12-18T00:14:41.3586364Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T00:14:41.3587058Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2024-12-18T00:14:41.3587781Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T00:14:41.3588558Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2024-12-18T00:14:41.3589360Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2024-12-18T00:14:41.3590199Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local ... 2024-12-18T00:14:41.7585801Z 2024-12-18T00:14:41.7586700Z  2024-12-18T00:14:41.7587158Z  2024-12-18T00:14:41.7587549Z  2024-12-18T00:14:41.7587993Z  2024-12-18T00:14:41.7588397Z  2024-12-18T00:14:41.7588751Z  2024-12-18T00:14:41.7589119Z  2024-12-18T00:14:41.7589464Z  2024-12-18T00:14:41.7589967Z [15,046 / 15,187] 48 actions running 2024-12-18T00:14:41.7590628Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T00:14:41.7591359Z Compiling torch_xla/csrc/init_python_bindings.cpp; 67s local 2024-12-18T00:14:41.7592169Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2024-12-18T00:14:41.7592983Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2024-12-18T00:14:41.7593768Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T00:14:41.7594616Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2024-12-18T00:14:41.7595471Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2024-12-18T00:14:41.7596380Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local ... 2024-12-18T00:14:41.9831889Z 2024-12-18T00:14:41.9832781Z  2024-12-18T00:14:41.9833493Z  2024-12-18T00:14:41.9833901Z  2024-12-18T00:14:41.9834284Z  2024-12-18T00:14:41.9834767Z  2024-12-18T00:14:41.9835150Z  2024-12-18T00:14:41.9835532Z  2024-12-18T00:14:41.9835924Z  2024-12-18T00:14:41.9836936Z [15,047 / 15,187] 48 actions, 47 running 2024-12-18T00:14:41.9837782Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T00:14:41.9838697Z Compiling torch_xla/csrc/init_python_bindings.cpp; 68s local 2024-12-18T00:14:41.9839831Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2024-12-18T00:14:41.9840732Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2024-12-18T00:14:41.9841609Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T00:14:41.9842524Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2024-12-18T00:14:41.9843484Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2024-12-18T00:14:41.9844714Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local ... 2024-12-18T00:14:42.3591956Z 2024-12-18T00:14:42.3592854Z  2024-12-18T00:14:42.3602902Z  2024-12-18T00:14:42.3603263Z  2024-12-18T00:14:42.3603610Z  2024-12-18T00:14:42.3603970Z  2024-12-18T00:14:42.3604318Z  2024-12-18T00:14:42.3604675Z  2024-12-18T00:14:42.3605012Z  2024-12-18T00:14:42.3605501Z [15,048 / 15,187] 47 actions running 2024-12-18T00:14:42.3606136Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T00:14:42.3606859Z Compiling torch_xla/csrc/init_python_bindings.cpp; 68s local 2024-12-18T00:14:42.3607593Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2024-12-18T00:14:42.3608276Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2024-12-18T00:14:42.3608994Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T00:14:42.3609707Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T00:14:42.3610462Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2024-12-18T00:14:42.3611184Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local ... 2024-12-18T00:14:42.5647992Z 2024-12-18T00:14:42.5648820Z  2024-12-18T00:14:42.5649245Z  2024-12-18T00:14:42.5649591Z  2024-12-18T00:14:42.5649916Z  2024-12-18T00:14:42.5650263Z  2024-12-18T00:14:42.5650619Z  2024-12-18T00:14:42.5650964Z  2024-12-18T00:14:42.5651301Z  2024-12-18T00:14:42.5651852Z [15,049 / 15,187] 48 actions, 47 running 2024-12-18T00:14:42.5652545Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T00:14:42.5653266Z Compiling torch_xla/csrc/init_python_bindings.cpp; 68s local 2024-12-18T00:14:42.5654018Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2024-12-18T00:14:42.5654716Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2024-12-18T00:14:42.5655684Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T00:14:42.5656551Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T00:14:42.5657328Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2024-12-18T00:14:42.5658114Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local ... 2024-12-18T00:14:42.9596595Z 2024-12-18T00:14:42.9597473Z  2024-12-18T00:14:42.9597913Z  2024-12-18T00:14:42.9598290Z  2024-12-18T00:14:42.9598640Z  2024-12-18T00:14:42.9599018Z  2024-12-18T00:14:42.9599372Z  2024-12-18T00:14:42.9599738Z  2024-12-18T00:14:42.9600090Z  2024-12-18T00:14:42.9600634Z [15,049 / 15,187] 48 actions running 2024-12-18T00:14:42.9601425Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T00:14:42.9602191Z Compiling torch_xla/csrc/init_python_bindings.cpp; 69s local 2024-12-18T00:14:42.9602975Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T00:14:42.9603722Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2024-12-18T00:14:42.9604623Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T00:14:42.9605365Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T00:14:42.9606207Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2024-12-18T00:14:42.9606976Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local ... 2024-12-18T00:14:43.1600502Z 2024-12-18T00:14:43.1601490Z  2024-12-18T00:14:43.1602047Z  2024-12-18T00:14:43.1602490Z  2024-12-18T00:14:43.1602923Z  2024-12-18T00:14:43.1603341Z  2024-12-18T00:14:43.1604098Z  2024-12-18T00:14:43.1604546Z  2024-12-18T00:14:43.1604974Z  2024-12-18T00:14:43.1605584Z [15,050 / 15,187] 48 actions running 2024-12-18T00:14:43.1606332Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T00:14:43.1607144Z Compiling torch_xla/csrc/init_python_bindings.cpp; 69s local 2024-12-18T00:14:43.1608016Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T00:14:43.1608858Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2024-12-18T00:14:43.1609643Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2024-12-18T00:14:43.1610461Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T00:14:43.1611298Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2024-12-18T00:14:43.1612157Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local ... 2024-12-18T00:14:43.4485018Z 2024-12-18T00:14:43.4485933Z  2024-12-18T00:14:43.4486390Z  2024-12-18T00:14:43.4486797Z  2024-12-18T00:14:43.4487199Z  2024-12-18T00:14:43.4487572Z  2024-12-18T00:14:43.4487961Z  2024-12-18T00:14:43.4488318Z  2024-12-18T00:14:43.4488685Z  2024-12-18T00:14:43.4489237Z [15,051 / 15,187] 48 actions, 47 running 2024-12-18T00:14:43.4489952Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T00:14:43.4490766Z Compiling torch_xla/csrc/init_python_bindings.cpp; 69s local 2024-12-18T00:14:43.4491625Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T00:14:43.4492412Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2024-12-18T00:14:43.4493151Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2024-12-18T00:14:43.4493893Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2024-12-18T00:14:43.4494711Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2024-12-18T00:14:43.4495552Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local ... 2024-12-18T00:14:43.7606058Z 2024-12-18T00:14:43.7607018Z  2024-12-18T00:14:43.7607482Z  2024-12-18T00:14:43.7607882Z  2024-12-18T00:14:43.7608241Z  2024-12-18T00:14:43.7608624Z  2024-12-18T00:14:43.7609010Z  2024-12-18T00:14:43.7609400Z  2024-12-18T00:14:43.7609722Z  2024-12-18T00:14:43.7610275Z [15,051 / 15,187] 48 actions running 2024-12-18T00:14:43.7611218Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T00:14:43.7612077Z Compiling torch_xla/csrc/init_python_bindings.cpp; 69s local 2024-12-18T00:14:43.7612980Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2024-12-18T00:14:43.7613793Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2024-12-18T00:14:43.7614545Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2024-12-18T00:14:43.7615344Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2024-12-18T00:14:43.7616199Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2024-12-18T00:14:43.7617213Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local ... 2024-12-18T00:14:44.1611019Z 2024-12-18T00:14:44.1611917Z  2024-12-18T00:14:44.1612408Z  2024-12-18T00:14:44.1612833Z  2024-12-18T00:14:44.1613223Z  2024-12-18T00:14:44.1613612Z  2024-12-18T00:14:44.1614000Z  2024-12-18T00:14:44.1614415Z  2024-12-18T00:14:44.1614798Z  2024-12-18T00:14:44.1615333Z [15,052 / 15,187] 47 actions running 2024-12-18T00:14:44.1616254Z @llvm-project//mlir:LinalgTransforms; 75s local 2024-12-18T00:14:44.1617261Z Compiling torch_xla/csrc/init_python_bindings.cpp; 70s local 2024-12-18T00:14:44.1618261Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2024-12-18T00:14:44.1619038Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2024-12-18T00:14:44.1619790Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2024-12-18T00:14:44.1620601Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2024-12-18T00:14:44.1621585Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2024-12-18T00:14:44.1622427Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local ... 2024-12-18T00:14:44.5615706Z 2024-12-18T00:14:44.5616673Z  2024-12-18T00:14:44.5617169Z  2024-12-18T00:14:44.5617587Z  2024-12-18T00:14:44.5617974Z  2024-12-18T00:14:44.5618400Z  2024-12-18T00:14:44.5618797Z  2024-12-18T00:14:44.5619205Z  2024-12-18T00:14:44.5619610Z  2024-12-18T00:14:44.5620100Z [15,052 / 15,187] 48 actions running 2024-12-18T00:14:44.5620674Z @llvm-project//mlir:LinalgTransforms; 75s local 2024-12-18T00:14:44.5621313Z Compiling torch_xla/csrc/init_python_bindings.cpp; 70s local 2024-12-18T00:14:44.5621970Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2024-12-18T00:14:44.5622589Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2024-12-18T00:14:44.5623167Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2024-12-18T00:14:44.5623895Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2024-12-18T00:14:44.5624794Z Compiling torch_xla/csrc/xla_op_builder.cpp; 51s local 2024-12-18T00:14:44.5625588Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local ... 2024-12-18T00:14:44.9478018Z 2024-12-18T00:14:44.9478907Z  2024-12-18T00:14:44.9479385Z  2024-12-18T00:14:44.9479772Z  2024-12-18T00:14:44.9480153Z  2024-12-18T00:14:44.9480557Z  2024-12-18T00:14:44.9480967Z  2024-12-18T00:14:44.9481345Z  2024-12-18T00:14:44.9481693Z  2024-12-18T00:14:44.9482274Z [15,053 / 15,187] 48 actions, 47 running 2024-12-18T00:14:44.9483025Z @llvm-project//mlir:LinalgTransforms; 75s local 2024-12-18T00:14:44.9483859Z Compiling torch_xla/csrc/init_python_bindings.cpp; 71s local 2024-12-18T00:14:44.9484746Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T00:14:44.9485568Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2024-12-18T00:14:44.9486281Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2024-12-18T00:14:44.9486915Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2024-12-18T00:14:44.9487572Z Compiling torch_xla/csrc/xla_op_builder.cpp; 51s local 2024-12-18T00:14:44.9488228Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local ... 2024-12-18T00:14:45.1621624Z 2024-12-18T00:14:45.1622483Z  2024-12-18T00:14:45.1622871Z  2024-12-18T00:14:45.1623304Z  2024-12-18T00:14:45.1623659Z  2024-12-18T00:14:45.1623972Z  2024-12-18T00:14:45.1624267Z  2024-12-18T00:14:45.1624583Z  2024-12-18T00:14:45.1624884Z  2024-12-18T00:14:45.1625396Z [15,053 / 15,187] 48 actions running 2024-12-18T00:14:45.1625961Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T00:14:45.1626583Z Compiling torch_xla/csrc/init_python_bindings.cpp; 71s local 2024-12-18T00:14:45.1627231Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T00:14:45.1627852Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2024-12-18T00:14:45.1628438Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2024-12-18T00:14:45.1629053Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2024-12-18T00:14:45.1629667Z Compiling torch_xla/csrc/xla_op_builder.cpp; 51s local 2024-12-18T00:14:45.1630317Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local ... 2024-12-18T00:14:45.5626534Z 2024-12-18T00:14:45.5627666Z  2024-12-18T00:14:45.5628070Z  2024-12-18T00:14:45.5628376Z  2024-12-18T00:14:45.5628860Z  2024-12-18T00:14:45.5629179Z  2024-12-18T00:14:45.5629490Z  2024-12-18T00:14:45.5629785Z  2024-12-18T00:14:45.5630091Z  2024-12-18T00:14:45.5630538Z [15,055 / 15,187] 46 actions running 2024-12-18T00:14:45.5631100Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T00:14:45.5631737Z Compiling torch_xla/csrc/init_python_bindings.cpp; 71s local 2024-12-18T00:14:45.5632541Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T00:14:45.5633198Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2024-12-18T00:14:45.5633841Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2024-12-18T00:14:45.5634507Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2024-12-18T00:14:45.5635200Z Compiling torch_xla/csrc/xla_op_builder.cpp; 52s local 2024-12-18T00:14:45.5635923Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local ... 2024-12-18T00:14:45.7631080Z 2024-12-18T00:14:45.7632081Z  2024-12-18T00:14:45.7632598Z  2024-12-18T00:14:45.7632979Z  2024-12-18T00:14:45.7633343Z  2024-12-18T00:14:45.7633725Z  2024-12-18T00:14:45.7634089Z  2024-12-18T00:14:45.7634449Z  2024-12-18T00:14:45.7634785Z  2024-12-18T00:14:45.7635322Z [15,055 / 15,187] 48 actions running 2024-12-18T00:14:45.7636012Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T00:14:45.7636889Z Compiling torch_xla/csrc/init_python_bindings.cpp; 71s local 2024-12-18T00:14:45.7637744Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2024-12-18T00:14:45.7638529Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2024-12-18T00:14:45.7639289Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2024-12-18T00:14:45.7640038Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2024-12-18T00:14:45.7640893Z Compiling torch_xla/csrc/xla_op_builder.cpp; 52s local 2024-12-18T00:14:45.7641773Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local ... 2024-12-18T00:14:46.9639925Z 2024-12-18T00:14:46.9640827Z  2024-12-18T00:14:46.9641237Z  2024-12-18T00:14:46.9641592Z  2024-12-18T00:14:46.9641947Z  2024-12-18T00:14:46.9642300Z  2024-12-18T00:14:46.9642648Z  2024-12-18T00:14:46.9642984Z  2024-12-18T00:14:46.9643335Z  2024-12-18T00:14:46.9643879Z [15,055 / 15,187] 48 actions running 2024-12-18T00:14:46.9644764Z @llvm-project//mlir:LinalgTransforms; 77s local 2024-12-18T00:14:46.9645501Z Compiling torch_xla/csrc/init_python_bindings.cpp; 73s local 2024-12-18T00:14:46.9646251Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2024-12-18T00:14:46.9646963Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2024-12-18T00:14:46.9647935Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2024-12-18T00:14:46.9648684Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2024-12-18T00:14:46.9649437Z Compiling torch_xla/csrc/xla_op_builder.cpp; 53s local 2024-12-18T00:14:46.9650225Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local ... 2024-12-18T00:14:47.4584707Z 2024-12-18T00:14:47.4585592Z  2024-12-18T00:14:47.4586222Z  2024-12-18T00:14:47.4586701Z  2024-12-18T00:14:47.4587195Z  2024-12-18T00:14:47.4587668Z  2024-12-18T00:14:47.4588094Z  2024-12-18T00:14:47.4588458Z  2024-12-18T00:14:47.4588867Z  2024-12-18T00:14:47.4589438Z [15,057 / 15,187] 47 actions, 46 running 2024-12-18T00:14:47.4590099Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T00:14:47.4590842Z Compiling torch_xla/csrc/init_python_bindings.cpp; 73s local 2024-12-18T00:14:47.4591630Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2024-12-18T00:14:47.4592534Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2024-12-18T00:14:47.4593700Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2024-12-18T00:14:47.4594686Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T00:14:47.4595985Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2024-12-18T00:14:47.4596840Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local ... 2024-12-18T00:14:47.7039703Z 2024-12-18T00:14:47.7040647Z  2024-12-18T00:14:47.7041209Z  2024-12-18T00:14:47.7041717Z  2024-12-18T00:14:47.7042240Z  2024-12-18T00:14:47.7042588Z  2024-12-18T00:14:47.7043175Z  2024-12-18T00:14:47.7043520Z  2024-12-18T00:14:47.7043875Z  2024-12-18T00:14:47.7044683Z [15,057 / 15,187] 48 actions, 46 running 2024-12-18T00:14:47.7045383Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T00:14:47.7046010Z Compiling torch_xla/csrc/init_python_bindings.cpp; 73s local 2024-12-18T00:14:47.7046651Z Compiling torch_xla/csrc/aten_xla_type.cpp; 73s local 2024-12-18T00:14:47.7047235Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2024-12-18T00:14:47.7047839Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2024-12-18T00:14:47.7048439Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T00:14:47.7049113Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2024-12-18T00:14:47.7049732Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local ... 2024-12-18T00:14:47.9930751Z 2024-12-18T00:14:47.9931636Z  2024-12-18T00:14:47.9932082Z  2024-12-18T00:14:47.9932479Z  2024-12-18T00:14:47.9932886Z  2024-12-18T00:14:47.9933288Z  2024-12-18T00:14:47.9933658Z  2024-12-18T00:14:47.9934001Z  2024-12-18T00:14:47.9934380Z  2024-12-18T00:14:47.9934972Z [15,059 / 15,187] 48 actions, 47 running 2024-12-18T00:14:47.9935622Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T00:14:47.9936264Z Compiling torch_xla/csrc/init_python_bindings.cpp; 74s local 2024-12-18T00:14:47.9937141Z Compiling torch_xla/csrc/aten_xla_type.cpp; 73s local 2024-12-18T00:14:47.9937898Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2024-12-18T00:14:47.9938708Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2024-12-18T00:14:47.9939503Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T00:14:47.9940342Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2024-12-18T00:14:47.9941113Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local ... 2024-12-18T00:14:48.2186841Z 2024-12-18T00:14:48.2187719Z  2024-12-18T00:14:48.2188220Z  2024-12-18T00:14:48.2188612Z  2024-12-18T00:14:48.2188982Z  2024-12-18T00:14:48.2189351Z  2024-12-18T00:14:48.2189734Z  2024-12-18T00:14:48.2190118Z  2024-12-18T00:14:48.2190501Z  2024-12-18T00:14:48.2191399Z [15,061 / 15,187] 47 actions, 46 running 2024-12-18T00:14:48.2192125Z @llvm-project//mlir:LinalgTransforms; 79s local 2024-12-18T00:14:48.2192944Z Compiling torch_xla/csrc/init_python_bindings.cpp; 74s local 2024-12-18T00:14:48.2193792Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2024-12-18T00:14:48.2194574Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2024-12-18T00:14:48.2195375Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2024-12-18T00:14:48.2196170Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2024-12-18T00:14:48.2196972Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2024-12-18T00:14:48.2197737Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local ... 2024-12-18T00:14:48.5045820Z 2024-12-18T00:14:48.5046723Z  2024-12-18T00:14:48.5047209Z  2024-12-18T00:14:48.5047625Z  2024-12-18T00:14:48.5047986Z  2024-12-18T00:14:48.5048395Z  2024-12-18T00:14:48.5048793Z  2024-12-18T00:14:48.5049213Z  2024-12-18T00:14:48.5049555Z  2024-12-18T00:14:48.5050095Z [15,061 / 15,187] 48 actions running 2024-12-18T00:14:48.5051091Z @llvm-project//mlir:LinalgTransforms; 79s local 2024-12-18T00:14:48.5051940Z Compiling torch_xla/csrc/init_python_bindings.cpp; 74s local 2024-12-18T00:14:48.5052935Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2024-12-18T00:14:48.5053744Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2024-12-18T00:14:48.5054510Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2024-12-18T00:14:48.5055308Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2024-12-18T00:14:48.5056472Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2024-12-18T00:14:48.5057243Z Compiling torch_xla/csrc/ops/cast.cpp; 37s local ... 2024-12-18T00:14:49.5053854Z 2024-12-18T00:14:49.5054737Z  2024-12-18T00:14:49.5055229Z  2024-12-18T00:14:49.5055615Z  2024-12-18T00:14:49.5055969Z  2024-12-18T00:14:49.5056516Z  2024-12-18T00:14:49.5056906Z  2024-12-18T00:14:49.5057277Z  2024-12-18T00:14:49.5057611Z  2024-12-18T00:14:49.5058128Z [15,061 / 15,187] 48 actions running 2024-12-18T00:14:49.5058738Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T00:14:49.5059410Z Compiling torch_xla/csrc/init_python_bindings.cpp; 75s local 2024-12-18T00:14:49.5060230Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2024-12-18T00:14:49.5060949Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2024-12-18T00:14:49.5061674Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2024-12-18T00:14:49.5062501Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2024-12-18T00:14:49.5063256Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2024-12-18T00:14:49.5064001Z Compiling torch_xla/csrc/ops/cast.cpp; 38s local ... 2024-12-18T00:14:49.7497340Z 2024-12-18T00:14:49.7498204Z  2024-12-18T00:14:49.7498682Z  2024-12-18T00:14:49.7499059Z  2024-12-18T00:14:49.7499432Z  2024-12-18T00:14:49.7499864Z  2024-12-18T00:14:49.7500272Z  2024-12-18T00:14:49.7500663Z  2024-12-18T00:14:49.7501029Z  2024-12-18T00:14:49.7501588Z [15,062 / 15,187] 48 actions, 47 running 2024-12-18T00:14:49.7502271Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T00:14:49.7503072Z Compiling torch_xla/csrc/init_python_bindings.cpp; 75s local 2024-12-18T00:14:49.7503909Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2024-12-18T00:14:49.7504810Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2024-12-18T00:14:49.7505433Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2024-12-18T00:14:49.7506033Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2024-12-18T00:14:49.7506612Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2024-12-18T00:14:49.7507191Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local ... 2024-12-18T00:14:50.1059371Z 2024-12-18T00:14:50.1060250Z  2024-12-18T00:14:50.1060719Z  2024-12-18T00:14:50.1061072Z  2024-12-18T00:14:50.1061437Z  2024-12-18T00:14:50.1061824Z  2024-12-18T00:14:50.1062227Z  2024-12-18T00:14:50.1062620Z  2024-12-18T00:14:50.1062982Z  2024-12-18T00:14:50.1063480Z [15,064 / 15,187] 47 actions running 2024-12-18T00:14:50.1064212Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T00:14:50.1065038Z Compiling torch_xla/csrc/init_python_bindings.cpp; 76s local 2024-12-18T00:14:50.1065844Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2024-12-18T00:14:50.1066635Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2024-12-18T00:14:50.1067482Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2024-12-18T00:14:50.1068300Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2024-12-18T00:14:50.1069114Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2024-12-18T00:14:50.1069933Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local ... 2024-12-18T00:14:50.5064222Z 2024-12-18T00:14:50.5065330Z  2024-12-18T00:14:50.5065847Z  2024-12-18T00:14:50.5066220Z  2024-12-18T00:14:50.5066603Z  2024-12-18T00:14:50.5067120Z  2024-12-18T00:14:50.5067466Z  2024-12-18T00:14:50.5067802Z  2024-12-18T00:14:50.5068150Z  2024-12-18T00:14:50.5068629Z [15,064 / 15,187] 48 actions running 2024-12-18T00:14:50.5069308Z @llvm-project//mlir:LinalgTransforms; 81s local 2024-12-18T00:14:50.5070092Z Compiling torch_xla/csrc/init_python_bindings.cpp; 76s local 2024-12-18T00:14:50.5071066Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2024-12-18T00:14:50.5071889Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2024-12-18T00:14:50.5072792Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2024-12-18T00:14:50.5073629Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2024-12-18T00:14:50.5074447Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2024-12-18T00:14:50.5075266Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local ... 2024-12-18T00:14:51.0627951Z 2024-12-18T00:14:51.0628832Z  2024-12-18T00:14:51.0629322Z  2024-12-18T00:14:51.0629734Z  2024-12-18T00:14:51.0630109Z  2024-12-18T00:14:51.0630510Z  2024-12-18T00:14:51.0630892Z  2024-12-18T00:14:51.0631298Z  2024-12-18T00:14:51.0631690Z  2024-12-18T00:14:51.0632247Z [15,065 / 15,187] 48 actions, 47 running 2024-12-18T00:14:51.0632955Z @llvm-project//mlir:LinalgTransforms; 81s local 2024-12-18T00:14:51.0633750Z Compiling torch_xla/csrc/init_python_bindings.cpp; 77s local 2024-12-18T00:14:51.0634594Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2024-12-18T00:14:51.0635342Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2024-12-18T00:14:51.0635950Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2024-12-18T00:14:51.0636651Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2024-12-18T00:14:51.0637282Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2024-12-18T00:14:51.0637886Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local ... 2024-12-18T00:14:51.3070680Z 2024-12-18T00:14:51.3071556Z  2024-12-18T00:14:51.3072029Z  2024-12-18T00:14:51.3072372Z  2024-12-18T00:14:51.3072746Z  2024-12-18T00:14:51.3073104Z  2024-12-18T00:14:51.3073467Z  2024-12-18T00:14:51.3073820Z  2024-12-18T00:14:51.3074193Z  2024-12-18T00:14:51.3074756Z [15,065 / 15,187] 48 actions running 2024-12-18T00:14:51.3075458Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T00:14:51.3076235Z Compiling torch_xla/csrc/init_python_bindings.cpp; 77s local 2024-12-18T00:14:51.3077081Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2024-12-18T00:14:51.3077822Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2024-12-18T00:14:51.3078934Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2024-12-18T00:14:51.3079716Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2024-12-18T00:14:51.3080469Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2024-12-18T00:14:51.3081160Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local ... 2024-12-18T00:14:52.3766086Z 2024-12-18T00:14:52.3766909Z  2024-12-18T00:14:52.3767376Z  2024-12-18T00:14:52.3767789Z  2024-12-18T00:14:52.3768112Z  2024-12-18T00:14:52.3768515Z  2024-12-18T00:14:52.3768819Z  2024-12-18T00:14:52.3769137Z  2024-12-18T00:14:52.3769458Z  2024-12-18T00:14:52.3769972Z [15,066 / 15,187] 48 actions, 47 running 2024-12-18T00:14:52.3770558Z @llvm-project//mlir:LinalgTransforms; 83s local 2024-12-18T00:14:52.3771185Z Compiling torch_xla/csrc/init_python_bindings.cpp; 78s local 2024-12-18T00:14:52.3771826Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2024-12-18T00:14:52.3772441Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2024-12-18T00:14:52.3773308Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2024-12-18T00:14:52.3773896Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2024-12-18T00:14:52.3774559Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T00:14:52.3775166Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local ... 2024-12-18T00:14:52.7080535Z 2024-12-18T00:14:52.7081419Z  2024-12-18T00:14:52.7081847Z  2024-12-18T00:14:52.7082185Z  2024-12-18T00:14:52.7082515Z  2024-12-18T00:14:52.7082859Z  2024-12-18T00:14:52.7083199Z  2024-12-18T00:14:52.7083861Z  2024-12-18T00:14:52.7084203Z  2024-12-18T00:14:52.7084680Z [15,066 / 15,187] 48 actions running 2024-12-18T00:14:52.7085276Z @llvm-project//mlir:LinalgTransforms; 83s local 2024-12-18T00:14:52.7085954Z Compiling torch_xla/csrc/init_python_bindings.cpp; 78s local 2024-12-18T00:14:52.7086651Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2024-12-18T00:14:52.7087348Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2024-12-18T00:14:52.7087990Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2024-12-18T00:14:52.7088615Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T00:14:52.7089230Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T00:14:52.7089880Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local ... 2024-12-18T00:14:52.9912563Z 2024-12-18T00:14:52.9913423Z  2024-12-18T00:14:52.9913879Z  2024-12-18T00:14:52.9914255Z  2024-12-18T00:14:52.9914638Z  2024-12-18T00:14:52.9915027Z  2024-12-18T00:14:52.9915405Z  2024-12-18T00:14:52.9915772Z  2024-12-18T00:14:52.9916161Z  2024-12-18T00:14:52.9916745Z [15,067 / 15,187] 48 actions, 47 running 2024-12-18T00:14:52.9917458Z @llvm-project//mlir:LinalgTransforms; 83s local 2024-12-18T00:14:52.9918250Z Compiling torch_xla/csrc/init_python_bindings.cpp; 79s local 2024-12-18T00:14:52.9919050Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2024-12-18T00:14:52.9919820Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2024-12-18T00:14:52.9920639Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2024-12-18T00:14:52.9921380Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T00:14:52.9922096Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T00:14:52.9922875Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local ... 2024-12-18T00:14:53.3085951Z 2024-12-18T00:14:53.3086909Z  2024-12-18T00:14:53.3087332Z  2024-12-18T00:14:53.3087715Z  2024-12-18T00:14:53.3088066Z  2024-12-18T00:14:53.3088416Z  2024-12-18T00:14:53.3088794Z  2024-12-18T00:14:53.3089160Z  2024-12-18T00:14:53.3089493Z  2024-12-18T00:14:53.3090021Z [15,067 / 15,187] 48 actions running 2024-12-18T00:14:53.3090922Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T00:14:53.3091660Z Compiling torch_xla/csrc/init_python_bindings.cpp; 79s local 2024-12-18T00:14:53.3092423Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2024-12-18T00:14:53.3093174Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2024-12-18T00:14:53.3093890Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2024-12-18T00:14:53.3094572Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T00:14:53.3095219Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2024-12-18T00:14:53.3095984Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local ... 2024-12-18T00:14:54.0420116Z 2024-12-18T00:14:54.0421032Z  2024-12-18T00:14:54.0421528Z  2024-12-18T00:14:54.0421956Z  2024-12-18T00:14:54.0422378Z  2024-12-18T00:14:54.0422776Z  2024-12-18T00:14:54.0423185Z  2024-12-18T00:14:54.0423575Z  2024-12-18T00:14:54.0423979Z  2024-12-18T00:14:54.0424575Z [15,068 / 15,187] 48 actions, 47 running 2024-12-18T00:14:54.0425286Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T00:14:54.0426589Z Compiling torch_xla/csrc/init_python_bindings.cpp; 80s local 2024-12-18T00:14:54.0427398Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2024-12-18T00:14:54.0428287Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2024-12-18T00:14:54.0429060Z Compiling torch_xla/csrc/ops/cumprod.cpp; 37s local 2024-12-18T00:14:54.0429803Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2024-12-18T00:14:54.0430606Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2024-12-18T00:14:54.0431641Z Compiling torch_xla/csrc/ops/as_strided.cpp; 32s local ... 2024-12-18T00:14:54.2653552Z 2024-12-18T00:14:54.2654408Z  2024-12-18T00:14:54.2654900Z  2024-12-18T00:14:54.2655280Z  2024-12-18T00:14:54.2655706Z  2024-12-18T00:14:54.2656110Z  2024-12-18T00:14:54.2656655Z  2024-12-18T00:14:54.2657054Z  2024-12-18T00:14:54.2657412Z  2024-12-18T00:14:54.2657992Z [15,069 / 15,187] 48 actions, 47 running 2024-12-18T00:14:54.2658722Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T00:14:54.2659532Z Compiling torch_xla/csrc/init_python_bindings.cpp; 80s local 2024-12-18T00:14:54.2660368Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2024-12-18T00:14:54.2661107Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2024-12-18T00:14:54.2661854Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T00:14:54.2662528Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2024-12-18T00:14:54.2663357Z Compiling torch_xla/csrc/ops/as_strided.cpp; 32s local 2024-12-18T00:14:54.2664223Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 32s local ... 2024-12-18T00:14:54.5078621Z 2024-12-18T00:14:54.5079515Z  2024-12-18T00:14:54.5079961Z  2024-12-18T00:14:54.5080368Z  2024-12-18T00:14:54.5080809Z  2024-12-18T00:14:54.5081167Z  2024-12-18T00:14:54.5081547Z  2024-12-18T00:14:54.5081919Z  2024-12-18T00:14:54.5082315Z  2024-12-18T00:14:54.5082912Z [15,070 / 15,187] 48 actions, 47 running 2024-12-18T00:14:54.5083616Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T00:14:54.5084418Z Compiling torch_xla/csrc/init_python_bindings.cpp; 80s local 2024-12-18T00:14:54.5085202Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2024-12-18T00:14:54.5085870Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T00:14:54.5086647Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2024-12-18T00:14:54.5087405Z Compiling torch_xla/csrc/ops/as_strided.cpp; 32s local 2024-12-18T00:14:54.5088311Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 32s local 2024-12-18T00:14:54.5089196Z Compiling torch_xla/csrc/ops/view.cpp; 30s local ... 2024-12-18T00:14:54.7096542Z 2024-12-18T00:14:54.7097392Z  2024-12-18T00:14:54.7098236Z  2024-12-18T00:14:54.7098643Z  2024-12-18T00:14:54.7099027Z  2024-12-18T00:14:54.7099429Z  2024-12-18T00:14:54.7099833Z  2024-12-18T00:14:54.7100239Z  2024-12-18T00:14:54.7100601Z  2024-12-18T00:14:54.7101169Z [15,070 / 15,187] 48 actions running 2024-12-18T00:14:54.7101918Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T00:14:54.7102737Z Compiling torch_xla/csrc/init_python_bindings.cpp; 80s local 2024-12-18T00:14:54.7103637Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2024-12-18T00:14:54.7104402Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T00:14:54.7105226Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2024-12-18T00:14:54.7106034Z Compiling torch_xla/csrc/ops/as_strided.cpp; 33s local 2024-12-18T00:14:54.7106954Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 32s local 2024-12-18T00:14:54.7107978Z Compiling torch_xla/csrc/ops/view.cpp; 31s local ... 2024-12-18T00:14:55.6026494Z 2024-12-18T00:14:55.6027373Z  2024-12-18T00:14:55.6027826Z  2024-12-18T00:14:55.6028449Z  2024-12-18T00:14:55.6028845Z  2024-12-18T00:14:55.6029207Z  2024-12-18T00:14:55.6029572Z  2024-12-18T00:14:55.6030150Z  2024-12-18T00:14:55.6030520Z  2024-12-18T00:14:55.6031196Z [15,072 / 15,187] 47 actions, 46 running 2024-12-18T00:14:55.6031930Z @llvm-project//mlir:LinalgTransforms; 86s local 2024-12-18T00:14:55.6032699Z Compiling torch_xla/csrc/init_python_bindings.cpp; 81s local 2024-12-18T00:14:55.6033642Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2024-12-18T00:14:55.6034553Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2024-12-18T00:14:55.6035295Z Compiling torch_xla/csrc/ops/as_strided.cpp; 34s local 2024-12-18T00:14:55.6036100Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 33s local 2024-12-18T00:14:55.6036806Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2024-12-18T00:14:55.6037607Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 28s local ... 2024-12-18T00:14:55.9105355Z 2024-12-18T00:14:55.9106244Z  2024-12-18T00:14:55.9106706Z  2024-12-18T00:14:55.9107104Z  2024-12-18T00:14:55.9107536Z  2024-12-18T00:14:55.9107919Z  2024-12-18T00:14:55.9108295Z  2024-12-18T00:14:55.9108680Z  2024-12-18T00:14:55.9109076Z  2024-12-18T00:14:55.9109636Z [15,072 / 15,187] 48 actions running 2024-12-18T00:14:55.9110310Z @llvm-project//mlir:LinalgTransforms; 86s local 2024-12-18T00:14:55.9111133Z Compiling torch_xla/csrc/init_python_bindings.cpp; 82s local 2024-12-18T00:14:55.9111975Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2024-12-18T00:14:55.9112714Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2024-12-18T00:14:55.9113465Z Compiling torch_xla/csrc/ops/as_strided.cpp; 34s local 2024-12-18T00:14:55.9114305Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 33s local 2024-12-18T00:14:55.9115209Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2024-12-18T00:14:55.9116099Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 28s local ... 2024-12-18T00:14:56.8763767Z 2024-12-18T00:14:56.8764670Z  2024-12-18T00:14:56.8765103Z  2024-12-18T00:14:56.8765480Z  2024-12-18T00:14:56.8765829Z  2024-12-18T00:14:56.8766206Z  2024-12-18T00:14:56.8766587Z  2024-12-18T00:14:56.8766978Z  2024-12-18T00:14:56.8767368Z  2024-12-18T00:14:56.8767898Z [15,074 / 15,187] 47 actions, 46 running 2024-12-18T00:14:56.8768653Z @llvm-project//mlir:LinalgTransforms; 87s local 2024-12-18T00:14:56.8769653Z Compiling torch_xla/csrc/init_python_bindings.cpp; 83s local 2024-12-18T00:14:56.8770535Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2024-12-18T00:14:56.8771292Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2024-12-18T00:14:56.8772422Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 34s local 2024-12-18T00:14:56.8773120Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2024-12-18T00:14:56.8773955Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2024-12-18T00:14:56.8774910Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 27s local ... 2024-12-18T00:14:57.1115036Z 2024-12-18T00:14:57.1116398Z  2024-12-18T00:14:57.1116855Z  2024-12-18T00:14:57.1117225Z  2024-12-18T00:14:57.1117599Z  2024-12-18T00:14:57.1117971Z  2024-12-18T00:14:57.1118496Z  2024-12-18T00:14:57.1118845Z  2024-12-18T00:14:57.1119229Z  2024-12-18T00:14:57.1119814Z [15,075 / 15,187] 48 actions, 47 running 2024-12-18T00:14:57.1120541Z @llvm-project//mlir:LinalgTransforms; 87s local 2024-12-18T00:14:57.1121285Z Compiling torch_xla/csrc/init_python_bindings.cpp; 83s local 2024-12-18T00:14:57.1121926Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2024-12-18T00:14:57.1122688Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2024-12-18T00:14:57.1123832Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 34s local 2024-12-18T00:14:57.1124804Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2024-12-18T00:14:57.1128090Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 27s local 2024-12-18T00:14:57.1128905Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local ... 2024-12-18T00:14:57.5119554Z 2024-12-18T00:14:57.5120384Z  2024-12-18T00:14:57.5120837Z  2024-12-18T00:14:57.5121183Z  2024-12-18T00:14:57.5121555Z  2024-12-18T00:14:57.5121905Z  2024-12-18T00:14:57.5122581Z  2024-12-18T00:14:57.5122965Z  2024-12-18T00:14:57.5123379Z  2024-12-18T00:14:57.5123912Z [15,075 / 15,187] 48 actions running 2024-12-18T00:14:57.5124638Z @llvm-project//mlir:LinalgTransforms; 88s local 2024-12-18T00:14:57.5125477Z Compiling torch_xla/csrc/init_python_bindings.cpp; 83s local 2024-12-18T00:14:57.5126362Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2024-12-18T00:14:57.5127118Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2024-12-18T00:14:57.5127991Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2024-12-18T00:14:57.5129024Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2024-12-18T00:14:57.5129953Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2024-12-18T00:14:57.5130892Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local ... 2024-12-18T00:14:58.5075880Z 2024-12-18T00:14:58.5076689Z  2024-12-18T00:14:58.5077094Z  2024-12-18T00:14:58.5077490Z  2024-12-18T00:14:58.5077878Z  2024-12-18T00:14:58.5078239Z  2024-12-18T00:14:58.5078569Z  2024-12-18T00:14:58.5078882Z  2024-12-18T00:14:58.5079223Z  2024-12-18T00:14:58.5079738Z [15,076 / 15,187] 48 actions, 47 running 2024-12-18T00:14:58.5080371Z @llvm-project//mlir:LinalgTransforms; 89s local 2024-12-18T00:14:58.5081126Z Compiling torch_xla/csrc/init_python_bindings.cpp; 84s local 2024-12-18T00:14:58.5081863Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2024-12-18T00:14:58.5082577Z Compiling torch_xla/csrc/ops/as_strided.cpp; 36s local 2024-12-18T00:14:58.5083388Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local 2024-12-18T00:14:58.5084261Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2024-12-18T00:14:58.5085056Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2024-12-18T00:14:58.5085795Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 27s local ... 2024-12-18T00:14:58.7128689Z 2024-12-18T00:14:58.7129557Z  2024-12-18T00:14:58.7130034Z  2024-12-18T00:14:58.7130425Z  2024-12-18T00:14:58.7130794Z  2024-12-18T00:14:58.7131159Z  2024-12-18T00:14:58.7131523Z  2024-12-18T00:14:58.7131858Z  2024-12-18T00:14:58.7132557Z  2024-12-18T00:14:58.7133130Z [15,076 / 15,187] 48 actions running 2024-12-18T00:14:58.7133862Z @llvm-project//mlir:LinalgTransforms; 89s local 2024-12-18T00:14:58.7134635Z Compiling torch_xla/csrc/init_python_bindings.cpp; 84s local 2024-12-18T00:14:58.7135511Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2024-12-18T00:14:58.7136449Z Compiling torch_xla/csrc/ops/as_strided.cpp; 37s local 2024-12-18T00:14:58.7137366Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local 2024-12-18T00:14:58.7138309Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2024-12-18T00:14:58.7139324Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2024-12-18T00:14:58.7140109Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 28s local ... 2024-12-18T00:14:59.6348269Z 2024-12-18T00:14:59.6349171Z  2024-12-18T00:14:59.6349605Z  2024-12-18T00:14:59.6349992Z  2024-12-18T00:14:59.6350377Z  2024-12-18T00:14:59.6350786Z  2024-12-18T00:14:59.6351148Z  2024-12-18T00:14:59.6351540Z  2024-12-18T00:14:59.6351880Z  2024-12-18T00:14:59.6352690Z [15,078 / 15,187] 47 actions, 46 running 2024-12-18T00:14:59.6353415Z @llvm-project//mlir:LinalgTransforms; 90s local 2024-12-18T00:14:59.6354305Z Compiling torch_xla/csrc/init_python_bindings.cpp; 85s local 2024-12-18T00:14:59.6355149Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2024-12-18T00:14:59.6355977Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2024-12-18T00:14:59.6356868Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2024-12-18T00:14:59.6357784Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2024-12-18T00:14:59.6358606Z Compiling torch_xla/csrc/ops/dot_general.cpp; 27s local 2024-12-18T00:14:59.6359462Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 26s local ... 2024-12-18T00:14:59.9138300Z 2024-12-18T00:14:59.9139154Z  2024-12-18T00:14:59.9139616Z  2024-12-18T00:14:59.9140055Z  2024-12-18T00:14:59.9140420Z  2024-12-18T00:14:59.9140811Z  2024-12-18T00:14:59.9141227Z  2024-12-18T00:14:59.9141638Z  2024-12-18T00:14:59.9142055Z  2024-12-18T00:14:59.9142573Z [15,078 / 15,187] 48 actions running 2024-12-18T00:14:59.9143329Z @llvm-project//mlir:LinalgTransforms; 90s local 2024-12-18T00:14:59.9144109Z Compiling torch_xla/csrc/init_python_bindings.cpp; 86s local 2024-12-18T00:14:59.9145215Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2024-12-18T00:14:59.9146024Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2024-12-18T00:14:59.9146972Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2024-12-18T00:14:59.9147747Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2024-12-18T00:14:59.9148538Z Compiling torch_xla/csrc/ops/dot_general.cpp; 27s local 2024-12-18T00:14:59.9149400Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 26s local ... 2024-12-18T00:15:00.9147142Z 2024-12-18T00:15:00.9148012Z  2024-12-18T00:15:00.9148495Z  2024-12-18T00:15:00.9148900Z  2024-12-18T00:15:00.9149290Z  2024-12-18T00:15:00.9149647Z  2024-12-18T00:15:00.9150019Z  2024-12-18T00:15:00.9150403Z  2024-12-18T00:15:00.9150775Z  2024-12-18T00:15:00.9151318Z [15,078 / 15,187] 48 actions running 2024-12-18T00:15:00.9152024Z @llvm-project//mlir:LinalgTransforms; 91s local 2024-12-18T00:15:00.9152827Z Compiling torch_xla/csrc/init_python_bindings.cpp; 87s local 2024-12-18T00:15:00.9153669Z Compiling torch_xla/csrc/tensor_util.cpp; 72s local 2024-12-18T00:15:00.9154536Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2024-12-18T00:15:00.9155424Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2024-12-18T00:15:00.9156297Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2024-12-18T00:15:00.9157167Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local 2024-12-18T00:15:00.9158360Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 27s local ... 2024-12-18T00:15:01.6080107Z 2024-12-18T00:15:01.6081670Z  2024-12-18T00:15:01.6082241Z  2024-12-18T00:15:01.6082621Z  2024-12-18T00:15:01.6082981Z  2024-12-18T00:15:01.6083375Z  2024-12-18T00:15:01.6083753Z  2024-12-18T00:15:01.6084136Z  2024-12-18T00:15:01.6084571Z  2024-12-18T00:15:01.6085180Z [15,079 / 15,187] 48 actions, 47 running 2024-12-18T00:15:01.6085886Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T00:15:01.6086633Z Compiling torch_xla/csrc/init_python_bindings.cpp; 87s local 2024-12-18T00:15:01.6087466Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2024-12-18T00:15:01.6088290Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2024-12-18T00:15:01.6089249Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2024-12-18T00:15:01.6090057Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2024-12-18T00:15:01.6090863Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2024-12-18T00:15:01.6091943Z Compiling torch_xla/csrc/ops/eigh.cpp; 26s local ... 2024-12-18T00:15:01.9154441Z 2024-12-18T00:15:01.9155852Z  2024-12-18T00:15:01.9156841Z  2024-12-18T00:15:01.9157253Z  2024-12-18T00:15:01.9157620Z  2024-12-18T00:15:01.9157975Z  2024-12-18T00:15:01.9158357Z  2024-12-18T00:15:01.9158744Z  2024-12-18T00:15:01.9159123Z  2024-12-18T00:15:01.9159661Z [15,079 / 15,187] 48 actions running 2024-12-18T00:15:01.9160332Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T00:15:01.9161319Z Compiling torch_xla/csrc/init_python_bindings.cpp; 88s local 2024-12-18T00:15:01.9162146Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2024-12-18T00:15:01.9162926Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2024-12-18T00:15:01.9163604Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2024-12-18T00:15:01.9164394Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2024-12-18T00:15:01.9165219Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2024-12-18T00:15:01.9166054Z Compiling torch_xla/csrc/ops/eigh.cpp; 26s local ... 2024-12-18T00:15:02.9162090Z 2024-12-18T00:15:02.9163374Z  2024-12-18T00:15:02.9163872Z  2024-12-18T00:15:02.9164267Z  2024-12-18T00:15:02.9164640Z  2024-12-18T00:15:02.9165025Z  2024-12-18T00:15:02.9165382Z  2024-12-18T00:15:02.9165760Z  2024-12-18T00:15:02.9166163Z  2024-12-18T00:15:02.9166729Z [15,079 / 15,187] 48 actions running 2024-12-18T00:15:02.9167432Z @llvm-project//mlir:LinalgTransforms; 93s local 2024-12-18T00:15:02.9168170Z Compiling torch_xla/csrc/init_python_bindings.cpp; 89s local 2024-12-18T00:15:02.9168982Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2024-12-18T00:15:02.9169933Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2024-12-18T00:15:02.9170813Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2024-12-18T00:15:02.9171655Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2024-12-18T00:15:02.9172490Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local 2024-12-18T00:15:02.9173347Z Compiling torch_xla/csrc/ops/eigh.cpp; 27s local ... 2024-12-18T00:15:03.9170122Z 2024-12-18T00:15:03.9171408Z  2024-12-18T00:15:03.9171850Z  2024-12-18T00:15:03.9172199Z  2024-12-18T00:15:03.9172518Z  2024-12-18T00:15:03.9172840Z  2024-12-18T00:15:03.9173176Z  2024-12-18T00:15:03.9173504Z  2024-12-18T00:15:03.9173866Z  2024-12-18T00:15:03.9174323Z [15,079 / 15,187] 48 actions running 2024-12-18T00:15:03.9174949Z @llvm-project//mlir:LinalgTransforms; 94s local 2024-12-18T00:15:03.9175642Z Compiling torch_xla/csrc/init_python_bindings.cpp; 90s local 2024-12-18T00:15:03.9176474Z Compiling torch_xla/csrc/tensor_util.cpp; 75s local 2024-12-18T00:15:03.9177413Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2024-12-18T00:15:03.9178132Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T00:15:03.9178827Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2024-12-18T00:15:03.9179551Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2024-12-18T00:15:03.9180248Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local ... 2024-12-18T00:15:04.4419729Z 2024-12-18T00:15:04.4420619Z  2024-12-18T00:15:04.4421032Z  2024-12-18T00:15:04.4421363Z  2024-12-18T00:15:04.4421666Z  2024-12-18T00:15:04.4422049Z  2024-12-18T00:15:04.4422448Z  2024-12-18T00:15:04.4422832Z  2024-12-18T00:15:04.4423248Z  2024-12-18T00:15:04.4423855Z [15,080 / 15,187] 48 actions, 47 running 2024-12-18T00:15:04.4424612Z @llvm-project//mlir:LinalgTransforms; 95s local 2024-12-18T00:15:04.4425434Z Compiling torch_xla/csrc/init_python_bindings.cpp; 90s local 2024-12-18T00:15:04.4426347Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T00:15:04.4427512Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2024-12-18T00:15:04.4428440Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T00:15:04.4429382Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2024-12-18T00:15:04.4430158Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local 2024-12-18T00:15:04.4430738Z Compiling torch_xla/csrc/ops/einsum.cpp; 28s local ... 2024-12-18T00:15:04.7177419Z 2024-12-18T00:15:04.7178262Z  2024-12-18T00:15:04.7178734Z  2024-12-18T00:15:04.7179149Z  2024-12-18T00:15:04.7179989Z  2024-12-18T00:15:04.7180496Z  2024-12-18T00:15:04.7180864Z  2024-12-18T00:15:04.7181227Z  2024-12-18T00:15:04.7181623Z  2024-12-18T00:15:04.7182190Z [15,081 / 15,187] 47 actions running 2024-12-18T00:15:04.7182929Z @llvm-project//mlir:LinalgTransforms; 95s local 2024-12-18T00:15:04.7183676Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T00:15:04.7184504Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T00:15:04.7185344Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2024-12-18T00:15:04.7186203Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 31s local 2024-12-18T00:15:04.7186992Z Compiling torch_xla/csrc/ops/eigh.cpp; 29s local 2024-12-18T00:15:04.7187719Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local 2024-12-18T00:15:04.7188377Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 28s local ... 2024-12-18T00:15:04.9181186Z 2024-12-18T00:15:04.9182034Z  2024-12-18T00:15:04.9182485Z  2024-12-18T00:15:04.9182871Z  2024-12-18T00:15:04.9183254Z  2024-12-18T00:15:04.9183631Z  2024-12-18T00:15:04.9184007Z  2024-12-18T00:15:04.9184393Z  2024-12-18T00:15:04.9184775Z  2024-12-18T00:15:04.9185333Z [15,081 / 15,187] 48 actions running 2024-12-18T00:15:04.9186069Z @llvm-project//mlir:LinalgTransforms; 95s local 2024-12-18T00:15:04.9186744Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T00:15:04.9187559Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T00:15:04.9188389Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2024-12-18T00:15:04.9189155Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 31s local 2024-12-18T00:15:04.9189911Z Compiling torch_xla/csrc/ops/eigh.cpp; 29s local 2024-12-18T00:15:04.9190635Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local 2024-12-18T00:15:04.9191326Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local ... 2024-12-18T00:15:06.1190051Z 2024-12-18T00:15:06.1190902Z  2024-12-18T00:15:06.1191305Z  2024-12-18T00:15:06.1191649Z  2024-12-18T00:15:06.1191984Z  2024-12-18T00:15:06.1192323Z  2024-12-18T00:15:06.1192665Z  2024-12-18T00:15:06.1193002Z  2024-12-18T00:15:06.1193793Z  2024-12-18T00:15:06.1194272Z [15,081 / 15,187] 48 actions running 2024-12-18T00:15:06.1194890Z @llvm-project//mlir:LinalgTransforms; 96s local 2024-12-18T00:15:06.1195547Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2024-12-18T00:15:06.1196294Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2024-12-18T00:15:06.1197051Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2024-12-18T00:15:06.1197797Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 32s local 2024-12-18T00:15:06.1198487Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2024-12-18T00:15:06.1199157Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2024-12-18T00:15:06.1199917Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local ... 2024-12-18T00:15:06.3193496Z 2024-12-18T00:15:06.3194293Z  2024-12-18T00:15:06.3194656Z  2024-12-18T00:15:06.3194975Z  2024-12-18T00:15:06.3195286Z  2024-12-18T00:15:06.3195624Z  2024-12-18T00:15:06.3195934Z  2024-12-18T00:15:06.3196222Z  2024-12-18T00:15:06.3196526Z  2024-12-18T00:15:06.3197493Z [15,082 / 15,187] 48 actions, 47 running 2024-12-18T00:15:06.3198074Z @llvm-project//mlir:LinalgTransforms; 97s local 2024-12-18T00:15:06.3198727Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2024-12-18T00:15:06.3199358Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2024-12-18T00:15:06.3200011Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2024-12-18T00:15:06.3200587Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2024-12-18T00:15:06.3201240Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2024-12-18T00:15:06.3201865Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2024-12-18T00:15:06.3202524Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local ... 2024-12-18T00:15:06.7198323Z 2024-12-18T00:15:06.7199109Z  2024-12-18T00:15:06.7199567Z  2024-12-18T00:15:06.7199976Z  2024-12-18T00:15:06.7200335Z  2024-12-18T00:15:06.7200707Z  2024-12-18T00:15:06.7201066Z  2024-12-18T00:15:06.7201451Z  2024-12-18T00:15:06.7201812Z  2024-12-18T00:15:06.7202359Z [15,082 / 15,187] 48 actions running 2024-12-18T00:15:06.7203085Z @llvm-project//mlir:LinalgTransforms; 97s local 2024-12-18T00:15:06.7203814Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2024-12-18T00:15:06.7204619Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 37s local 2024-12-18T00:15:06.7205449Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T00:15:06.7206235Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T00:15:06.7206917Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2024-12-18T00:15:06.7207706Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2024-12-18T00:15:06.7208552Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local ... 2024-12-18T00:15:07.5205699Z 2024-12-18T00:15:07.5206617Z  2024-12-18T00:15:07.5207076Z  2024-12-18T00:15:07.5207463Z  2024-12-18T00:15:07.5207867Z  2024-12-18T00:15:07.5208292Z  2024-12-18T00:15:07.5208660Z  2024-12-18T00:15:07.5209061Z  2024-12-18T00:15:07.5209472Z  2024-12-18T00:15:07.5210048Z [15,083 / 15,187] 47 actions running 2024-12-18T00:15:07.5210756Z @llvm-project//mlir:LinalgTransforms; 98s local 2024-12-18T00:15:07.5211477Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2024-12-18T00:15:07.5212267Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T00:15:07.5213075Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2024-12-18T00:15:07.5213836Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2024-12-18T00:15:07.5214641Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2024-12-18T00:15:07.5215492Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2024-12-18T00:15:07.5216572Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local ... 2024-12-18T00:15:07.9210763Z 2024-12-18T00:15:07.9211611Z  2024-12-18T00:15:07.9212111Z  2024-12-18T00:15:07.9212501Z  2024-12-18T00:15:07.9212887Z  2024-12-18T00:15:07.9213274Z  2024-12-18T00:15:07.9213682Z  2024-12-18T00:15:07.9214052Z  2024-12-18T00:15:07.9214427Z  2024-12-18T00:15:07.9214971Z [15,084 / 15,187] 48 actions running 2024-12-18T00:15:07.9215655Z @llvm-project//mlir:LinalgTransforms; 98s local 2024-12-18T00:15:07.9216526Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2024-12-18T00:15:07.9217311Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2024-12-18T00:15:07.9218077Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2024-12-18T00:15:07.9218889Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 32s local 2024-12-18T00:15:07.9219746Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2024-12-18T00:15:07.9220590Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2024-12-18T00:15:07.9221367Z Compiling torch_xla/csrc/ops/expand.cpp; 29s local ... 2024-12-18T00:15:08.3214816Z 2024-12-18T00:15:08.3215692Z  2024-12-18T00:15:08.3216152Z  2024-12-18T00:15:08.3216710Z  2024-12-18T00:15:08.3217282Z  2024-12-18T00:15:08.3217679Z  2024-12-18T00:15:08.3218091Z  2024-12-18T00:15:08.3218510Z  2024-12-18T00:15:08.3218909Z  2024-12-18T00:15:08.3219501Z [15,085 / 15,187] 47 actions running 2024-12-18T00:15:08.3220285Z @llvm-project//mlir:LinalgTransforms; 99s local 2024-12-18T00:15:08.3221203Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2024-12-18T00:15:08.3222016Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2024-12-18T00:15:08.3222813Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2024-12-18T00:15:08.3223594Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2024-12-18T00:15:08.3224449Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2024-12-18T00:15:08.3225312Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2024-12-18T00:15:08.3226088Z Compiling torch_xla/csrc/ops/exponential.cpp; 27s local ... 2024-12-18T00:15:08.7219441Z 2024-12-18T00:15:08.7220298Z  2024-12-18T00:15:08.7220922Z  2024-12-18T00:15:08.7221420Z  2024-12-18T00:15:08.7221936Z  2024-12-18T00:15:08.7222275Z  2024-12-18T00:15:08.7222652Z  2024-12-18T00:15:08.7223004Z  2024-12-18T00:15:08.7223376Z  2024-12-18T00:15:08.7223920Z [15,085 / 15,187] 48 actions running 2024-12-18T00:15:08.7224654Z @llvm-project//mlir:LinalgTransforms; 99s local 2024-12-18T00:15:08.7225388Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2024-12-18T00:15:08.7226162Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T00:15:08.7226911Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T00:15:08.7227694Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2024-12-18T00:15:08.7228965Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2024-12-18T00:15:08.7229941Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2024-12-18T00:15:08.7230878Z Compiling torch_xla/csrc/ops/exponential.cpp; 27s local ... 2024-12-18T00:15:09.0187587Z 2024-12-18T00:15:09.0188481Z  2024-12-18T00:15:09.0188898Z  2024-12-18T00:15:09.0189268Z  2024-12-18T00:15:09.0189652Z  2024-12-18T00:15:09.0190009Z  2024-12-18T00:15:09.0190384Z  2024-12-18T00:15:09.0190748Z  2024-12-18T00:15:09.0191137Z  2024-12-18T00:15:09.0191764Z [15,086 / 15,187] 48 actions, 47 running 2024-12-18T00:15:09.0192574Z @llvm-project//mlir:LinalgTransforms; 99s local 2024-12-18T00:15:09.0193336Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2024-12-18T00:15:09.0194086Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T00:15:09.0194858Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2024-12-18T00:15:09.0196149Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2024-12-18T00:15:09.0197012Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2024-12-18T00:15:09.0197848Z Compiling torch_xla/csrc/ops/exponential.cpp; 28s local 2024-12-18T00:15:09.0198642Z Compiling torch_xla/csrc/ops/flip.cpp; 27s local ... 2024-12-18T00:15:09.3226677Z 2024-12-18T00:15:09.3227650Z  2024-12-18T00:15:09.3228130Z  2024-12-18T00:15:09.3228516Z  2024-12-18T00:15:09.3228909Z  2024-12-18T00:15:09.3229310Z  2024-12-18T00:15:09.3229691Z  2024-12-18T00:15:09.3230057Z  2024-12-18T00:15:09.3230465Z  2024-12-18T00:15:09.3231071Z [15,086 / 15,187] 48 actions running 2024-12-18T00:15:09.3231819Z @llvm-project//mlir:LinalgTransforms; 100s local 2024-12-18T00:15:09.3232616Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2024-12-18T00:15:09.3233383Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T00:15:09.3234180Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 33s local 2024-12-18T00:15:09.3235073Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2024-12-18T00:15:09.3235671Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local 2024-12-18T00:15:09.3236358Z Compiling torch_xla/csrc/ops/exponential.cpp; 28s local 2024-12-18T00:15:09.3237140Z Compiling torch_xla/csrc/ops/flip.cpp; 28s local ... 2024-12-18T00:15:09.9745681Z 2024-12-18T00:15:09.9746609Z  2024-12-18T00:15:09.9747091Z  2024-12-18T00:15:09.9747466Z  2024-12-18T00:15:09.9747814Z  2024-12-18T00:15:09.9748203Z  2024-12-18T00:15:09.9748577Z  2024-12-18T00:15:09.9749289Z  2024-12-18T00:15:09.9749703Z  2024-12-18T00:15:09.9750268Z [15,088 / 15,187] 47 actions, 46 running 2024-12-18T00:15:09.9750971Z @llvm-project//mlir:LinalgTransforms; 100s local 2024-12-18T00:15:09.9751718Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2024-12-18T00:15:09.9752416Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2024-12-18T00:15:09.9753371Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2024-12-18T00:15:09.9754149Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2024-12-18T00:15:09.9755141Z Compiling torch_xla/csrc/ops/flip.cpp; 28s local 2024-12-18T00:15:09.9755838Z Compiling torch_xla/csrc/ops/gather.cpp; 28s local 2024-12-18T00:15:09.9756554Z Compiling torch_xla/csrc/ops/generic.cpp; 27s local ... 2024-12-18T00:15:10.3233705Z 2024-12-18T00:15:10.3234964Z  2024-12-18T00:15:10.3235389Z  2024-12-18T00:15:10.3235738Z  2024-12-18T00:15:10.3236066Z  2024-12-18T00:15:10.3236426Z  2024-12-18T00:15:10.3236763Z  2024-12-18T00:15:10.3237101Z  2024-12-18T00:15:10.3237441Z  2024-12-18T00:15:10.3237930Z [15,088 / 15,187] 48 actions running 2024-12-18T00:15:10.3238562Z @llvm-project//mlir:LinalgTransforms; 101s local 2024-12-18T00:15:10.3239226Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2024-12-18T00:15:10.3239875Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2024-12-18T00:15:10.3240557Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2024-12-18T00:15:10.3241434Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2024-12-18T00:15:10.3242118Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local 2024-12-18T00:15:10.3242761Z Compiling torch_xla/csrc/ops/gather.cpp; 28s local 2024-12-18T00:15:10.3243444Z Compiling torch_xla/csrc/ops/generic.cpp; 28s local ... 2024-12-18T00:15:11.3242836Z 2024-12-18T00:15:11.3244103Z  2024-12-18T00:15:11.3244705Z  2024-12-18T00:15:11.3245058Z  2024-12-18T00:15:11.3245387Z  2024-12-18T00:15:11.3245703Z  2024-12-18T00:15:11.3245996Z  2024-12-18T00:15:11.3246310Z  2024-12-18T00:15:11.3246617Z  2024-12-18T00:15:11.3247063Z [15,088 / 15,187] 48 actions running 2024-12-18T00:15:11.3247626Z @llvm-project//mlir:LinalgTransforms; 102s local 2024-12-18T00:15:11.3248488Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2024-12-18T00:15:11.3249091Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2024-12-18T00:15:11.3249705Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2024-12-18T00:15:11.3250378Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2024-12-18T00:15:11.3250993Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2024-12-18T00:15:11.3251554Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local 2024-12-18T00:15:11.3252174Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local ... 2024-12-18T00:15:12.2302961Z 2024-12-18T00:15:12.2303893Z  2024-12-18T00:15:12.2304353Z  2024-12-18T00:15:12.2304737Z  2024-12-18T00:15:12.2305111Z  2024-12-18T00:15:12.2305488Z  2024-12-18T00:15:12.2305871Z  2024-12-18T00:15:12.2306243Z  2024-12-18T00:15:12.2306596Z  2024-12-18T00:15:12.2307187Z [15,089 / 15,187] 48 actions, 47 running 2024-12-18T00:15:12.2307949Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T00:15:12.2309207Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2024-12-18T00:15:12.2309953Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2024-12-18T00:15:12.2310836Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T00:15:12.2311601Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2024-12-18T00:15:12.2312296Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2024-12-18T00:15:12.2312995Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2024-12-18T00:15:12.2313919Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local ... 2024-12-18T00:15:12.5253022Z 2024-12-18T00:15:12.5254202Z  2024-12-18T00:15:12.5254757Z  2024-12-18T00:15:12.5255150Z  2024-12-18T00:15:12.5255499Z  2024-12-18T00:15:12.5255886Z  2024-12-18T00:15:12.5256267Z  2024-12-18T00:15:12.5256803Z  2024-12-18T00:15:12.5257185Z  2024-12-18T00:15:12.5257729Z [15,089 / 15,187] 48 actions running 2024-12-18T00:15:12.5258446Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T00:15:12.5259199Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2024-12-18T00:15:12.5259962Z Compiling torch_xla/csrc/ops/eigh.cpp; 37s local 2024-12-18T00:15:12.5260754Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T00:15:12.5261479Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2024-12-18T00:15:12.5262199Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2024-12-18T00:15:12.5262948Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2024-12-18T00:15:12.5263860Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local ... 2024-12-18T00:15:12.9162004Z 2024-12-18T00:15:12.9162871Z  2024-12-18T00:15:12.9163355Z  2024-12-18T00:15:12.9163716Z  2024-12-18T00:15:12.9164076Z  2024-12-18T00:15:12.9164455Z  2024-12-18T00:15:12.9164872Z  2024-12-18T00:15:12.9165256Z  2024-12-18T00:15:12.9165626Z  2024-12-18T00:15:12.9166215Z [15,090 / 15,187] 48 actions, 47 running 2024-12-18T00:15:12.9166947Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T00:15:12.9167699Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2024-12-18T00:15:12.9168409Z Compiling torch_xla/csrc/ops/eigh.cpp; 37s local 2024-12-18T00:15:12.9169159Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T00:15:12.9169926Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2024-12-18T00:15:12.9170629Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2024-12-18T00:15:12.9171430Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2024-12-18T00:15:12.9172338Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local ... 2024-12-18T00:15:13.1258407Z 2024-12-18T00:15:13.1259850Z  2024-12-18T00:15:13.1260344Z  2024-12-18T00:15:13.1260738Z  2024-12-18T00:15:13.1261431Z  2024-12-18T00:15:13.1261795Z  2024-12-18T00:15:13.1262167Z  2024-12-18T00:15:13.1262547Z  2024-12-18T00:15:13.1262921Z  2024-12-18T00:15:13.1263457Z [15,091 / 15,187] 47 actions running 2024-12-18T00:15:13.1264211Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T00:15:13.1264918Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2024-12-18T00:15:13.1265729Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T00:15:13.1266540Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2024-12-18T00:15:13.1267308Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2024-12-18T00:15:13.1268121Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2024-12-18T00:15:13.1269028Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2024-12-18T00:15:13.1269958Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local ... 2024-12-18T00:15:13.3263283Z 2024-12-18T00:15:13.3264674Z  2024-12-18T00:15:13.3265216Z  2024-12-18T00:15:13.3265607Z  2024-12-18T00:15:13.3266022Z  2024-12-18T00:15:13.3266703Z  2024-12-18T00:15:13.3267136Z  2024-12-18T00:15:13.3267509Z  2024-12-18T00:15:13.3268049Z  2024-12-18T00:15:13.3268616Z [15,092 / 15,187] 48 actions, 47 running 2024-12-18T00:15:13.3269392Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T00:15:13.3270159Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2024-12-18T00:15:13.3270947Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2024-12-18T00:15:13.3272016Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2024-12-18T00:15:13.3272908Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2024-12-18T00:15:13.3273765Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2024-12-18T00:15:13.3274679Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T00:15:13.3275614Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local ... 2024-12-18T00:15:13.7267101Z 2024-12-18T00:15:13.7268409Z  2024-12-18T00:15:13.7268930Z  2024-12-18T00:15:13.7269363Z  2024-12-18T00:15:13.7269754Z  2024-12-18T00:15:13.7270116Z  2024-12-18T00:15:13.7270537Z  2024-12-18T00:15:13.7270945Z  2024-12-18T00:15:13.7271336Z  2024-12-18T00:15:13.7271873Z [15,092 / 15,187] 48 actions running 2024-12-18T00:15:13.7272548Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T00:15:13.7273295Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2024-12-18T00:15:13.7274104Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2024-12-18T00:15:13.7274933Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2024-12-18T00:15:13.7275750Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2024-12-18T00:15:13.7276669Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2024-12-18T00:15:13.7277575Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T00:15:13.7278528Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local ... 2024-12-18T00:15:13.9270913Z 2024-12-18T00:15:13.9272281Z  2024-12-18T00:15:13.9272824Z  2024-12-18T00:15:13.9273351Z  2024-12-18T00:15:13.9273840Z  2024-12-18T00:15:13.9274351Z  2024-12-18T00:15:13.9274864Z  2024-12-18T00:15:13.9275317Z  2024-12-18T00:15:13.9275666Z  2024-12-18T00:15:13.9276196Z [15,093 / 15,187] 48 actions running 2024-12-18T00:15:13.9276942Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T00:15:13.9277653Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2024-12-18T00:15:13.9278440Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2024-12-18T00:15:13.9279239Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2024-12-18T00:15:13.9280136Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2024-12-18T00:15:13.9281380Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T00:15:13.9282308Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2024-12-18T00:15:13.9283212Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local ... 2024-12-18T00:15:15.1278830Z 2024-12-18T00:15:15.1280275Z  2024-12-18T00:15:15.1280744Z  2024-12-18T00:15:15.1282190Z  2024-12-18T00:15:15.1283098Z  2024-12-18T00:15:15.1284200Z  2024-12-18T00:15:15.1285590Z  2024-12-18T00:15:15.1286779Z  2024-12-18T00:15:15.1288307Z  2024-12-18T00:15:15.1289600Z [15,093 / 15,187] 48 actions running 2024-12-18T00:15:15.1290678Z @llvm-project//mlir:LinalgTransforms; 105s local 2024-12-18T00:15:15.1291684Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2024-12-18T00:15:15.1292913Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2024-12-18T00:15:15.1294060Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T00:15:15.1295289Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T00:15:15.1296938Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 32s local 2024-12-18T00:15:15.1297832Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2024-12-18T00:15:15.1298884Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local ... 2024-12-18T00:15:15.3283675Z 2024-12-18T00:15:15.3285136Z  2024-12-18T00:15:15.3285562Z  2024-12-18T00:15:15.3287107Z  2024-12-18T00:15:15.3288181Z  2024-12-18T00:15:15.3289352Z  2024-12-18T00:15:15.3290572Z  2024-12-18T00:15:15.3291922Z  2024-12-18T00:15:15.3293389Z  2024-12-18T00:15:15.3294770Z [15,094 / 15,187] 48 actions running 2024-12-18T00:15:15.3295801Z @llvm-project//mlir:LinalgTransforms; 106s local 2024-12-18T00:15:15.3297106Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2024-12-18T00:15:15.3298245Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2024-12-18T00:15:15.3299473Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T00:15:15.3300376Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T00:15:15.3301579Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2024-12-18T00:15:15.3302724Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2024-12-18T00:15:15.3303835Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local ... 2024-12-18T00:15:15.9288940Z 2024-12-18T00:15:15.9289820Z  2024-12-18T00:15:15.9290296Z  2024-12-18T00:15:15.9290742Z  2024-12-18T00:15:15.9291130Z  2024-12-18T00:15:15.9291553Z  2024-12-18T00:15:15.9291943Z  2024-12-18T00:15:15.9292337Z  2024-12-18T00:15:15.9292728Z  2024-12-18T00:15:15.9293267Z [15,096 / 15,187] 46 actions running 2024-12-18T00:15:15.9293975Z @llvm-project//mlir:LinalgTransforms; 106s local 2024-12-18T00:15:15.9294711Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2024-12-18T00:15:15.9295529Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2024-12-18T00:15:15.9296789Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T00:15:15.9297588Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2024-12-18T00:15:15.9298353Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2024-12-18T00:15:15.9299152Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2024-12-18T00:15:15.9299991Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local ... 2024-12-18T00:15:16.1292510Z 2024-12-18T00:15:16.1293379Z  2024-12-18T00:15:16.1293849Z  2024-12-18T00:15:16.1294282Z  2024-12-18T00:15:16.1294696Z  2024-12-18T00:15:16.1295100Z  2024-12-18T00:15:16.1295472Z  2024-12-18T00:15:16.1295864Z  2024-12-18T00:15:16.1296248Z  2024-12-18T00:15:16.1296918Z [15,096 / 15,187] 48 actions running 2024-12-18T00:15:16.1297939Z @llvm-project//mlir:LinalgTransforms; 106s local 2024-12-18T00:15:16.1298667Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2024-12-18T00:15:16.1299502Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2024-12-18T00:15:16.1300417Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T00:15:16.1301304Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2024-12-18T00:15:16.1302100Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2024-12-18T00:15:16.1302884Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2024-12-18T00:15:16.1303751Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local ... 2024-12-18T00:15:16.5297860Z 2024-12-18T00:15:16.5298739Z  2024-12-18T00:15:16.5299206Z  2024-12-18T00:15:16.5299600Z  2024-12-18T00:15:16.5299974Z  2024-12-18T00:15:16.5300343Z  2024-12-18T00:15:16.5300744Z  2024-12-18T00:15:16.5301112Z  2024-12-18T00:15:16.5301490Z  2024-12-18T00:15:16.5302060Z [15,097 / 15,187] 48 actions running 2024-12-18T00:15:16.5302788Z @llvm-project//mlir:LinalgTransforms; 107s local 2024-12-18T00:15:16.5303849Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2024-12-18T00:15:16.5304704Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2024-12-18T00:15:16.5305747Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T00:15:16.5306590Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2024-12-18T00:15:16.5307350Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2024-12-18T00:15:16.5308138Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2024-12-18T00:15:16.5309145Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local ... 2024-12-18T00:15:17.2126352Z 2024-12-18T00:15:17.2127255Z  2024-12-18T00:15:17.2127737Z  2024-12-18T00:15:17.2128300Z  2024-12-18T00:15:17.2128684Z  2024-12-18T00:15:17.2129024Z  2024-12-18T00:15:17.2129344Z  2024-12-18T00:15:17.2129686Z  2024-12-18T00:15:17.2130032Z  2024-12-18T00:15:17.2130622Z [15,098 / 15,187] 48 actions, 47 running 2024-12-18T00:15:17.2131348Z @llvm-project//mlir:LinalgTransforms; 108s local 2024-12-18T00:15:17.2132117Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2024-12-18T00:15:17.2132918Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2024-12-18T00:15:17.2133988Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2024-12-18T00:15:17.2134851Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T00:15:17.2135670Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2024-12-18T00:15:17.2136649Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2024-12-18T00:15:17.2137479Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local ... 2024-12-18T00:15:17.5305962Z 2024-12-18T00:15:17.5306872Z  2024-12-18T00:15:17.5307355Z  2024-12-18T00:15:17.5307749Z  2024-12-18T00:15:17.5308135Z  2024-12-18T00:15:17.5308451Z  2024-12-18T00:15:17.5308819Z  2024-12-18T00:15:17.5309181Z  2024-12-18T00:15:17.5309580Z  2024-12-18T00:15:17.5310119Z [15,100 / 15,187] 47 actions running 2024-12-18T00:15:17.5310853Z @llvm-project//mlir:LinalgTransforms; 108s local 2024-12-18T00:15:17.5311600Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2024-12-18T00:15:17.5312413Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2024-12-18T00:15:17.5313253Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T00:15:17.5314033Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2024-12-18T00:15:17.5314901Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local 2024-12-18T00:15:17.5315925Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2024-12-18T00:15:17.5316926Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 29s local ... 2024-12-18T00:15:17.9310369Z 2024-12-18T00:15:17.9311531Z  2024-12-18T00:15:17.9311941Z  2024-12-18T00:15:17.9312305Z  2024-12-18T00:15:17.9312719Z  2024-12-18T00:15:17.9313106Z  2024-12-18T00:15:17.9313487Z  2024-12-18T00:15:17.9313866Z  2024-12-18T00:15:17.9314191Z  2024-12-18T00:15:17.9314662Z [15,100 / 15,187] 48 actions running 2024-12-18T00:15:17.9315367Z @llvm-project//mlir:LinalgTransforms; 108s local 2024-12-18T00:15:17.9316092Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2024-12-18T00:15:17.9316846Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2024-12-18T00:15:17.9317701Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T00:15:17.9318431Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T00:15:17.9319293Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2024-12-18T00:15:17.9320200Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2024-12-18T00:15:17.9321009Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 29s local ... 2024-12-18T00:15:19.1318444Z 2024-12-18T00:15:19.1319325Z  2024-12-18T00:15:19.1319782Z  2024-12-18T00:15:19.1320477Z  2024-12-18T00:15:19.1320889Z  2024-12-18T00:15:19.1321253Z  2024-12-18T00:15:19.1321757Z  2024-12-18T00:15:19.1322145Z  2024-12-18T00:15:19.1322522Z  2024-12-18T00:15:19.1323070Z [15,100 / 15,187] 48 actions running 2024-12-18T00:15:19.1323767Z @llvm-project//mlir:LinalgTransforms; 109s local 2024-12-18T00:15:19.1324483Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2024-12-18T00:15:19.1325500Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T00:15:19.1326349Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T00:15:19.1327108Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2024-12-18T00:15:19.1327970Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local 2024-12-18T00:15:19.1328866Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2024-12-18T00:15:19.1329724Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local ... 2024-12-18T00:15:19.3322291Z 2024-12-18T00:15:19.3323163Z  2024-12-18T00:15:19.3323629Z  2024-12-18T00:15:19.3324015Z  2024-12-18T00:15:19.3324394Z  2024-12-18T00:15:19.3324767Z  2024-12-18T00:15:19.3325102Z  2024-12-18T00:15:19.3325392Z  2024-12-18T00:15:19.3325701Z  2024-12-18T00:15:19.3326161Z [15,101 / 15,187] 48 actions running 2024-12-18T00:15:19.3326878Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T00:15:19.3327636Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2024-12-18T00:15:19.3328272Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T00:15:19.3328910Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T00:15:19.3329712Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2024-12-18T00:15:19.3330477Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2024-12-18T00:15:19.3331264Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T00:15:19.3332184Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local ... 2024-12-18T00:15:19.5379116Z 2024-12-18T00:15:19.5380243Z  2024-12-18T00:15:19.5380649Z  2024-12-18T00:15:19.5381014Z  2024-12-18T00:15:19.5381390Z  2024-12-18T00:15:19.5381778Z  2024-12-18T00:15:19.5382148Z  2024-12-18T00:15:19.5382474Z  2024-12-18T00:15:19.5382840Z  2024-12-18T00:15:19.5383390Z [15,102 / 15,187] 48 actions, 47 running 2024-12-18T00:15:19.5384011Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T00:15:19.5384660Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2024-12-18T00:15:19.5385370Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 37s local 2024-12-18T00:15:19.5386084Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T00:15:19.5387011Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2024-12-18T00:15:19.5388013Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T00:15:19.5388837Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2024-12-18T00:15:19.5389738Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 29s local ... 2024-12-18T00:15:19.7892763Z 2024-12-18T00:15:19.7893666Z  2024-12-18T00:15:19.7894137Z  2024-12-18T00:15:19.7894530Z  2024-12-18T00:15:19.7894902Z  2024-12-18T00:15:19.7895274Z  2024-12-18T00:15:19.7895683Z  2024-12-18T00:15:19.7896075Z  2024-12-18T00:15:19.7896618Z  2024-12-18T00:15:19.7897248Z [15,104 / 15,187] 47 actions, 46 running 2024-12-18T00:15:19.7897960Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T00:15:19.7898669Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2024-12-18T00:15:19.7899464Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 37s local 2024-12-18T00:15:19.7900304Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T00:15:19.7901110Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T00:15:19.7902218Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 29s local 2024-12-18T00:15:19.7903023Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 29s local 2024-12-18T00:15:19.7904036Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local ... 2024-12-18T00:15:20.0327512Z 2024-12-18T00:15:20.0328358Z  2024-12-18T00:15:20.0328853Z  2024-12-18T00:15:20.0329275Z  2024-12-18T00:15:20.0329679Z  2024-12-18T00:15:20.0330077Z  2024-12-18T00:15:20.0330489Z  2024-12-18T00:15:20.0331180Z  2024-12-18T00:15:20.0331586Z  2024-12-18T00:15:20.0332209Z [15,105 / 15,187] 48 actions, 47 running 2024-12-18T00:15:20.0332960Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T00:15:20.0333746Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2024-12-18T00:15:20.0334549Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2024-12-18T00:15:20.0335376Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T00:15:20.0336256Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2024-12-18T00:15:20.0337211Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local 2024-12-18T00:15:20.0338089Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2024-12-18T00:15:20.0338988Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 28s local ... 2024-12-18T00:15:20.3329506Z 2024-12-18T00:15:20.3330368Z  2024-12-18T00:15:20.3330864Z  2024-12-18T00:15:20.3331282Z  2024-12-18T00:15:20.3331688Z  2024-12-18T00:15:20.3332043Z  2024-12-18T00:15:20.3332419Z  2024-12-18T00:15:20.3332775Z  2024-12-18T00:15:20.3333117Z  2024-12-18T00:15:20.3333651Z [15,105 / 15,187] 48 actions running 2024-12-18T00:15:20.3334371Z @llvm-project//mlir:LinalgTransforms; 111s local 2024-12-18T00:15:20.3335072Z Compiling torch_xla/csrc/tensor_util.cpp; 92s local 2024-12-18T00:15:20.3335871Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2024-12-18T00:15:20.3336791Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2024-12-18T00:15:20.3337611Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2024-12-18T00:15:20.3338410Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local 2024-12-18T00:15:20.3339254Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2024-12-18T00:15:20.3340131Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local ... 2024-12-18T00:15:21.3973157Z 2024-12-18T00:15:21.3974037Z  2024-12-18T00:15:21.3974522Z  2024-12-18T00:15:21.3974949Z  2024-12-18T00:15:21.3975368Z  2024-12-18T00:15:21.3975740Z  2024-12-18T00:15:21.3976103Z  2024-12-18T00:15:21.3976678Z  2024-12-18T00:15:21.3977069Z  2024-12-18T00:15:21.3977633Z [15,106 / 15,187] 48 actions, 47 running 2024-12-18T00:15:21.3978635Z @llvm-project//mlir:LinalgTransforms; 112s local 2024-12-18T00:15:21.3979412Z Compiling torch_xla/csrc/tensor_util.cpp; 93s local 2024-12-18T00:15:21.3980178Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2024-12-18T00:15:21.3980972Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2024-12-18T00:15:21.3981786Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2024-12-18T00:15:21.3982626Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2024-12-18T00:15:21.3983450Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2024-12-18T00:15:21.3984278Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 28s local ... 2024-12-18T00:15:21.7339162Z 2024-12-18T00:15:21.7339992Z  2024-12-18T00:15:21.7340565Z  2024-12-18T00:15:21.7340915Z  2024-12-18T00:15:21.7341279Z  2024-12-18T00:15:21.7341666Z  2024-12-18T00:15:21.7342042Z  2024-12-18T00:15:21.7342407Z  2024-12-18T00:15:21.7342782Z  2024-12-18T00:15:21.7343348Z [15,106 / 15,187] 48 actions running 2024-12-18T00:15:21.7344584Z @llvm-project//mlir:LinalgTransforms; 112s local 2024-12-18T00:15:21.7345375Z Compiling torch_xla/csrc/tensor_util.cpp; 93s local 2024-12-18T00:15:21.7346157Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2024-12-18T00:15:21.7347101Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2024-12-18T00:15:21.7347894Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2024-12-18T00:15:21.7348706Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2024-12-18T00:15:21.7349560Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2024-12-18T00:15:21.7350612Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 29s local ... 2024-12-18T00:15:22.5345985Z 2024-12-18T00:15:22.5346840Z  2024-12-18T00:15:22.5347267Z  2024-12-18T00:15:22.5347583Z  2024-12-18T00:15:22.5347903Z  2024-12-18T00:15:22.5348229Z  2024-12-18T00:15:22.5348551Z  2024-12-18T00:15:22.5348908Z  2024-12-18T00:15:22.5349226Z  2024-12-18T00:15:22.5349702Z [15,107 / 15,187] 47 actions running 2024-12-18T00:15:22.5350307Z @llvm-project//mlir:LinalgTransforms; 113s local 2024-12-18T00:15:22.5350924Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2024-12-18T00:15:22.5351569Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2024-12-18T00:15:22.5352231Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2024-12-18T00:15:22.5352898Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2024-12-18T00:15:22.5353574Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2024-12-18T00:15:22.5354276Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2024-12-18T00:15:22.5355046Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 29s local ... 2024-12-18T00:15:22.7349314Z 2024-12-18T00:15:22.7350183Z  2024-12-18T00:15:22.7350632Z  2024-12-18T00:15:22.7351000Z  2024-12-18T00:15:22.7351420Z  2024-12-18T00:15:22.7351805Z  2024-12-18T00:15:22.7352175Z  2024-12-18T00:15:22.7352510Z  2024-12-18T00:15:22.7352875Z  2024-12-18T00:15:22.7353398Z [15,108 / 15,187] 48 actions running 2024-12-18T00:15:22.7354110Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2024-12-18T00:15:22.7354834Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2024-12-18T00:15:22.7355577Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2024-12-18T00:15:22.7356339Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2024-12-18T00:15:22.7357113Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2024-12-18T00:15:22.7357960Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2024-12-18T00:15:22.7358809Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 29s local 2024-12-18T00:15:22.7359722Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 28s local ... 2024-12-18T00:15:23.8338332Z 2024-12-18T00:15:23.8341432Z  2024-12-18T00:15:23.8341939Z  2024-12-18T00:15:23.8342320Z  2024-12-18T00:15:23.8342691Z  2024-12-18T00:15:23.8343129Z  2024-12-18T00:15:23.8343522Z  2024-12-18T00:15:23.8343880Z  2024-12-18T00:15:23.8344538Z  2024-12-18T00:15:23.8345163Z [15,109 / 15,187] 48 actions, 47 running 2024-12-18T00:15:23.8345884Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2024-12-18T00:15:23.8346643Z Compiling torch_xla/csrc/ops/index_ops.cpp; 38s local 2024-12-18T00:15:23.8347438Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2024-12-18T00:15:23.8348241Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2024-12-18T00:15:23.8349051Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2024-12-18T00:15:23.8349970Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local 2024-12-18T00:15:23.8350913Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 29s local 2024-12-18T00:15:23.8351693Z Compiling torch_xla/csrc/ops/mean.cpp; 29s local ... 2024-12-18T00:15:24.1358696Z 2024-12-18T00:15:24.1359557Z  2024-12-18T00:15:24.1360294Z  2024-12-18T00:15:24.1360711Z  2024-12-18T00:15:24.1361102Z  2024-12-18T00:15:24.1361479Z  2024-12-18T00:15:24.1362023Z  2024-12-18T00:15:24.1362398Z  2024-12-18T00:15:24.1362795Z  2024-12-18T00:15:24.1363372Z [15,109 / 15,187] 48 actions running 2024-12-18T00:15:24.1364124Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2024-12-18T00:15:24.1364930Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2024-12-18T00:15:24.1365907Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2024-12-18T00:15:24.1366797Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2024-12-18T00:15:24.1367635Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2024-12-18T00:15:24.1368528Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local 2024-12-18T00:15:24.1369514Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2024-12-18T00:15:24.1370304Z Compiling torch_xla/csrc/ops/mean.cpp; 29s local ... 2024-12-18T00:15:24.8803497Z 2024-12-18T00:15:24.8804422Z  2024-12-18T00:15:24.8804891Z  2024-12-18T00:15:24.8805407Z  2024-12-18T00:15:24.8805907Z  2024-12-18T00:15:24.8806378Z  2024-12-18T00:15:24.8806878Z  2024-12-18T00:15:24.8807252Z  2024-12-18T00:15:24.8807599Z  2024-12-18T00:15:24.8808118Z [15,110 / 15,187] 48 actions, 47 running 2024-12-18T00:15:24.8808775Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2024-12-18T00:15:24.8809840Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2024-12-18T00:15:24.8810631Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2024-12-18T00:15:24.8811410Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T00:15:24.8812273Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local 2024-12-18T00:15:24.8813179Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2024-12-18T00:15:24.8813955Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T00:15:24.8814737Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local ... 2024-12-18T00:15:25.0884452Z 2024-12-18T00:15:25.0885274Z  2024-12-18T00:15:25.0885864Z  2024-12-18T00:15:25.0886368Z  2024-12-18T00:15:25.0886857Z  2024-12-18T00:15:25.0887357Z  2024-12-18T00:15:25.0887860Z  2024-12-18T00:15:25.0888371Z  2024-12-18T00:15:25.0888854Z  2024-12-18T00:15:25.0889518Z [15,111 / 15,187] 48 actions, 47 running 2024-12-18T00:15:25.0890453Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2024-12-18T00:15:25.0891346Z Compiling torch_xla/csrc/ops/index_ops.cpp; 40s local 2024-12-18T00:15:25.0892332Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2024-12-18T00:15:25.0893226Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T00:15:25.0894381Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2024-12-18T00:15:25.0895149Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T00:15:25.0896020Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2024-12-18T00:15:25.0897024Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local ... 2024-12-18T00:15:25.3368706Z 2024-12-18T00:15:25.3369471Z  2024-12-18T00:15:25.3369853Z  2024-12-18T00:15:25.3370176Z  2024-12-18T00:15:25.3370501Z  2024-12-18T00:15:25.3370823Z  2024-12-18T00:15:25.3371122Z  2024-12-18T00:15:25.3371444Z  2024-12-18T00:15:25.3371768Z  2024-12-18T00:15:25.3372265Z [15,112 / 15,187] 47 actions running 2024-12-18T00:15:25.3372847Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2024-12-18T00:15:25.3373493Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 37s local 2024-12-18T00:15:25.3374158Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T00:15:25.3374838Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T00:15:25.3375760Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T00:15:25.3376539Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2024-12-18T00:15:25.3377158Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local 2024-12-18T00:15:25.3377946Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 29s local ... 2024-12-18T00:15:25.5372467Z 2024-12-18T00:15:25.5373305Z  2024-12-18T00:15:25.5373782Z  2024-12-18T00:15:25.5374177Z  2024-12-18T00:15:25.5374548Z  2024-12-18T00:15:25.5374938Z  2024-12-18T00:15:25.5375346Z  2024-12-18T00:15:25.5376022Z  2024-12-18T00:15:25.5376540Z  2024-12-18T00:15:25.5377108Z [15,112 / 15,187] 48 actions running 2024-12-18T00:15:25.5377903Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2024-12-18T00:15:25.5378726Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 37s local 2024-12-18T00:15:25.5379615Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T00:15:25.5380510Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T00:15:25.5381354Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T00:15:25.5382178Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2024-12-18T00:15:25.5383044Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local 2024-12-18T00:15:25.5383944Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 29s local ... 2024-12-18T00:15:25.9377030Z 2024-12-18T00:15:25.9377998Z  2024-12-18T00:15:25.9378460Z  2024-12-18T00:15:25.9378861Z  2024-12-18T00:15:25.9379240Z  2024-12-18T00:15:25.9379658Z  2024-12-18T00:15:25.9380043Z  2024-12-18T00:15:25.9380432Z  2024-12-18T00:15:25.9380834Z  2024-12-18T00:15:25.9381370Z [15,113 / 15,187] 47 actions running 2024-12-18T00:15:25.9382105Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2024-12-18T00:15:25.9382919Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2024-12-18T00:15:25.9383776Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T00:15:25.9384741Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T00:15:25.9385679Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2024-12-18T00:15:25.9386515Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T00:15:25.9387372Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 30s local 2024-12-18T00:15:25.9388356Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 28s local ... 2024-12-18T00:15:26.3381164Z 2024-12-18T00:15:26.3381984Z  2024-12-18T00:15:26.3382412Z  2024-12-18T00:15:26.3382785Z  2024-12-18T00:15:26.3383160Z  2024-12-18T00:15:26.3383521Z  2024-12-18T00:15:26.3383862Z  2024-12-18T00:15:26.3384190Z  2024-12-18T00:15:26.3384525Z  2024-12-18T00:15:26.3385005Z [15,113 / 15,187] 48 actions running 2024-12-18T00:15:26.3385987Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2024-12-18T00:15:26.3386679Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2024-12-18T00:15:26.3387428Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2024-12-18T00:15:26.3388107Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T00:15:26.3388753Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2024-12-18T00:15:26.3389423Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T00:15:26.3390154Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 30s local 2024-12-18T00:15:26.3390963Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 29s local ... 2024-12-18T00:15:26.5386500Z 2024-12-18T00:15:26.5387400Z  2024-12-18T00:15:26.5387807Z  2024-12-18T00:15:26.5388158Z  2024-12-18T00:15:26.5388514Z  2024-12-18T00:15:26.5388860Z  2024-12-18T00:15:26.5389212Z  2024-12-18T00:15:26.5389544Z  2024-12-18T00:15:26.5389920Z  2024-12-18T00:15:26.5390419Z [15,114 / 15,187] 48 actions running 2024-12-18T00:15:26.5391333Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2024-12-18T00:15:26.5392015Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2024-12-18T00:15:26.5392856Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2024-12-18T00:15:26.5393589Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T00:15:26.5394269Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T00:15:26.5395009Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 30s local 2024-12-18T00:15:26.5395953Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 29s local 2024-12-18T00:15:26.5396772Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local ... 2024-12-18T00:15:27.1031181Z 2024-12-18T00:15:27.1032004Z  2024-12-18T00:15:27.1032553Z  2024-12-18T00:15:27.1032921Z  2024-12-18T00:15:27.1033322Z  2024-12-18T00:15:27.1033684Z  2024-12-18T00:15:27.1034147Z  2024-12-18T00:15:27.1034755Z  2024-12-18T00:15:27.1035206Z  2024-12-18T00:15:27.1035896Z [15,115 / 15,187] 48 actions, 47 running 2024-12-18T00:15:27.1036756Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2024-12-18T00:15:27.1037683Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 37s local 2024-12-18T00:15:27.1038644Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2024-12-18T00:15:27.1039596Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T00:15:27.1040392Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 31s local 2024-12-18T00:15:27.1041179Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T00:15:27.1042040Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T00:15:27.1043063Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local ... 2024-12-18T00:15:27.3390409Z 2024-12-18T00:15:27.3391707Z  2024-12-18T00:15:27.3392518Z  2024-12-18T00:15:27.3393066Z  2024-12-18T00:15:27.3394167Z  2024-12-18T00:15:27.3394558Z  2024-12-18T00:15:27.3394894Z  2024-12-18T00:15:27.3395244Z  2024-12-18T00:15:27.3395543Z  2024-12-18T00:15:27.3396022Z [15,116 / 15,187] 48 actions running 2024-12-18T00:15:27.3396650Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2024-12-18T00:15:27.3397324Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T00:15:27.3398027Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2024-12-18T00:15:27.3398692Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 31s local 2024-12-18T00:15:27.3399475Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T00:15:27.3400235Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T00:15:27.3401063Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2024-12-18T00:15:27.3402019Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local ... 2024-12-18T00:15:27.5749004Z 2024-12-18T00:15:27.5749873Z  2024-12-18T00:15:27.5750237Z  2024-12-18T00:15:27.5750597Z  2024-12-18T00:15:27.5750913Z  2024-12-18T00:15:27.5751224Z  2024-12-18T00:15:27.5751542Z  2024-12-18T00:15:27.5751856Z  2024-12-18T00:15:27.5752162Z  2024-12-18T00:15:27.5752647Z [15,117 / 15,187] 48 actions, 47 running 2024-12-18T00:15:27.5753237Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2024-12-18T00:15:27.5753853Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T00:15:27.5754472Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2024-12-18T00:15:27.5755104Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T00:15:27.5755765Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T00:15:27.5756495Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2024-12-18T00:15:27.5757272Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local 2024-12-18T00:15:27.5758337Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 27s local ... 2024-12-18T00:15:27.9395003Z 2024-12-18T00:15:27.9395830Z  2024-12-18T00:15:27.9396211Z  2024-12-18T00:15:27.9396800Z  2024-12-18T00:15:27.9397109Z  2024-12-18T00:15:27.9397392Z  2024-12-18T00:15:27.9397693Z  2024-12-18T00:15:27.9397996Z  2024-12-18T00:15:27.9398329Z  2024-12-18T00:15:27.9398775Z [15,117 / 15,187] 48 actions running 2024-12-18T00:15:27.9399333Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2024-12-18T00:15:27.9400054Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T00:15:27.9400667Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2024-12-18T00:15:27.9401287Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T00:15:27.9401940Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T00:15:27.9402634Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2024-12-18T00:15:27.9403429Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2024-12-18T00:15:27.9404166Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local ... 2024-12-18T00:15:28.7404350Z 2024-12-18T00:15:28.7405248Z  2024-12-18T00:15:28.7405725Z  2024-12-18T00:15:28.7406109Z  2024-12-18T00:15:28.7406487Z  2024-12-18T00:15:28.7406885Z  2024-12-18T00:15:28.7407235Z  2024-12-18T00:15:28.7407606Z  2024-12-18T00:15:28.7408005Z  2024-12-18T00:15:28.7408561Z [15,118 / 15,187] 47 actions running 2024-12-18T00:15:28.7409368Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2024-12-18T00:15:28.7410212Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2024-12-18T00:15:28.7410970Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T00:15:28.7411755Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 31s local 2024-12-18T00:15:28.7412748Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2024-12-18T00:15:28.7413633Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T00:15:28.7414677Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2024-12-18T00:15:28.7415527Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 28s local ... 2024-12-18T00:15:29.0248444Z 2024-12-18T00:15:29.0249296Z  2024-12-18T00:15:29.0249760Z  2024-12-18T00:15:29.0250182Z  2024-12-18T00:15:29.0250578Z  2024-12-18T00:15:29.0250962Z  2024-12-18T00:15:29.0251345Z  2024-12-18T00:15:29.0251730Z  2024-12-18T00:15:29.0252158Z  2024-12-18T00:15:29.0252756Z [15,119 / 15,187] 48 actions, 47 running 2024-12-18T00:15:29.0253421Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2024-12-18T00:15:29.0254158Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T00:15:29.0254951Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 32s local 2024-12-18T00:15:29.0256067Z Compiling torch_xla/csrc/ops/multinomial.cpp; 32s local 2024-12-18T00:15:29.0257157Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T00:15:29.0258085Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2024-12-18T00:15:29.0258894Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2024-12-18T00:15:29.0259722Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 27s local ... 2024-12-18T00:15:29.2390209Z 2024-12-18T00:15:29.2391083Z  2024-12-18T00:15:29.2391533Z  2024-12-18T00:15:29.2391924Z  2024-12-18T00:15:29.2392278Z  2024-12-18T00:15:29.2392691Z  2024-12-18T00:15:29.2393004Z  2024-12-18T00:15:29.2393313Z  2024-12-18T00:15:29.2393637Z  2024-12-18T00:15:29.2394185Z [15,121 / 15,187] 48 actions, 47 running 2024-12-18T00:15:29.2394952Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2024-12-18T00:15:29.2395770Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T00:15:29.2396912Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T00:15:29.2397930Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2024-12-18T00:15:29.2398874Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2024-12-18T00:15:29.2399597Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 27s local 2024-12-18T00:15:29.2400430Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 24s local 2024-12-18T00:15:29.2401396Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 24s local ... 2024-12-18T00:15:29.5412771Z 2024-12-18T00:15:29.5413641Z  2024-12-18T00:15:29.5414436Z  2024-12-18T00:15:29.5414855Z  2024-12-18T00:15:29.5415264Z  2024-12-18T00:15:29.5415655Z  2024-12-18T00:15:29.5416054Z  2024-12-18T00:15:29.5416600Z  2024-12-18T00:15:29.5416982Z  2024-12-18T00:15:29.5417541Z [15,121 / 15,187] 48 actions running 2024-12-18T00:15:29.5418312Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2024-12-18T00:15:29.5419073Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2024-12-18T00:15:29.5420053Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T00:15:29.5420917Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2024-12-18T00:15:29.5421704Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2024-12-18T00:15:29.5422511Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 27s local 2024-12-18T00:15:29.5423365Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local 2024-12-18T00:15:29.5424263Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 24s local ... 2024-12-18T00:15:30.2643318Z 2024-12-18T00:15:30.2644436Z  2024-12-18T00:15:30.2644908Z  2024-12-18T00:15:30.2645296Z  2024-12-18T00:15:30.2645670Z  2024-12-18T00:15:30.2646037Z  2024-12-18T00:15:30.2646371Z  2024-12-18T00:15:30.2646699Z  2024-12-18T00:15:30.2647035Z  2024-12-18T00:15:30.2647614Z [15,122 / 15,187] 48 actions, 47 running 2024-12-18T00:15:30.2648403Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2024-12-18T00:15:30.2649178Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2024-12-18T00:15:30.2650077Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2024-12-18T00:15:30.2651007Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2024-12-18T00:15:30.2651730Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2024-12-18T00:15:30.2652494Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local 2024-12-18T00:15:30.2653357Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local 2024-12-18T00:15:30.2654290Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 25s local ... 2024-12-18T00:15:30.4709394Z 2024-12-18T00:15:30.4710163Z  2024-12-18T00:15:30.4710576Z  2024-12-18T00:15:30.4710906Z  2024-12-18T00:15:30.4711499Z  2024-12-18T00:15:30.4711861Z  2024-12-18T00:15:30.4712210Z  2024-12-18T00:15:30.4712568Z  2024-12-18T00:15:30.4712928Z  2024-12-18T00:15:30.4713480Z [15,123 / 15,187] 48 actions, 47 running 2024-12-18T00:15:30.4714187Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2024-12-18T00:15:30.4714878Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2024-12-18T00:15:30.4715610Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2024-12-18T00:15:30.4716364Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2024-12-18T00:15:30.4717137Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local 2024-12-18T00:15:30.4717944Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local 2024-12-18T00:15:30.4718797Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 25s local 2024-12-18T00:15:30.4719521Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local ... 2024-12-18T00:15:30.7421619Z 2024-12-18T00:15:30.7422464Z  2024-12-18T00:15:30.7422896Z  2024-12-18T00:15:30.7423274Z  2024-12-18T00:15:30.7423615Z  2024-12-18T00:15:30.7424227Z  2024-12-18T00:15:30.7424597Z  2024-12-18T00:15:30.7424955Z  2024-12-18T00:15:30.7425298Z  2024-12-18T00:15:30.7425881Z [15,123 / 15,187] 48 actions running 2024-12-18T00:15:30.7426655Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2024-12-18T00:15:30.7427348Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2024-12-18T00:15:30.7428054Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 31s local 2024-12-18T00:15:30.7429011Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2024-12-18T00:15:30.7429826Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2024-12-18T00:15:30.7430559Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 26s local 2024-12-18T00:15:30.7431329Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 25s local 2024-12-18T00:15:30.7432015Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local ... 2024-12-18T00:15:31.1426330Z 2024-12-18T00:15:31.1427125Z  2024-12-18T00:15:31.1427529Z  2024-12-18T00:15:31.1427883Z  2024-12-18T00:15:31.1428215Z  2024-12-18T00:15:31.1428534Z  2024-12-18T00:15:31.1428856Z  2024-12-18T00:15:31.1429179Z  2024-12-18T00:15:31.1429503Z  2024-12-18T00:15:31.1429983Z [15,124 / 15,187] 47 actions running 2024-12-18T00:15:31.1430600Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2024-12-18T00:15:31.1431200Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2024-12-18T00:15:31.1431801Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2024-12-18T00:15:31.1432446Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2024-12-18T00:15:31.1433146Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 26s local 2024-12-18T00:15:31.1433899Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2024-12-18T00:15:31.1434537Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local 2024-12-18T00:15:31.1435172Z Compiling torch_xla/csrc/ops/nonzero.cpp; 23s local ... 2024-12-18T00:15:31.5262407Z 2024-12-18T00:15:31.5263279Z  2024-12-18T00:15:31.5263746Z  2024-12-18T00:15:31.5264154Z  2024-12-18T00:15:31.5264574Z  2024-12-18T00:15:31.5264955Z  2024-12-18T00:15:31.5265358Z  2024-12-18T00:15:31.5265749Z  2024-12-18T00:15:31.5266155Z  2024-12-18T00:15:31.5266748Z [15,125 / 15,187] 48 actions, 47 running 2024-12-18T00:15:31.5267673Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2024-12-18T00:15:31.5268455Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2024-12-18T00:15:31.5269226Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2024-12-18T00:15:31.5270172Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 27s local 2024-12-18T00:15:31.5271167Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2024-12-18T00:15:31.5272061Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local 2024-12-18T00:15:31.5273228Z Compiling torch_xla/csrc/ops/nonzero.cpp; 23s local 2024-12-18T00:15:31.5274085Z Compiling torch_xla/csrc/ops/normal.cpp; 23s local ... 2024-12-18T00:15:31.7431756Z 2024-12-18T00:15:31.7432562Z  2024-12-18T00:15:31.7432939Z  2024-12-18T00:15:31.7433238Z  2024-12-18T00:15:31.7433526Z  2024-12-18T00:15:31.7433840Z  2024-12-18T00:15:31.7434165Z  2024-12-18T00:15:31.7434543Z  2024-12-18T00:15:31.7434881Z  2024-12-18T00:15:31.7435375Z [15,125 / 15,187] 48 actions running 2024-12-18T00:15:31.7436091Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2024-12-18T00:15:31.7436815Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2024-12-18T00:15:31.7437532Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2024-12-18T00:15:31.7438328Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 27s local 2024-12-18T00:15:31.7439158Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2024-12-18T00:15:31.7439903Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local 2024-12-18T00:15:31.7440906Z Compiling torch_xla/csrc/ops/nonzero.cpp; 24s local 2024-12-18T00:15:31.7441820Z Compiling torch_xla/csrc/ops/normal.cpp; 24s local ... 2024-12-18T00:15:32.7440294Z 2024-12-18T00:15:32.7441187Z  2024-12-18T00:15:32.7441730Z  2024-12-18T00:15:32.7442123Z  2024-12-18T00:15:32.7442552Z  2024-12-18T00:15:32.7442930Z  2024-12-18T00:15:32.7443348Z  2024-12-18T00:15:32.7443761Z  2024-12-18T00:15:32.7444415Z  2024-12-18T00:15:32.7445296Z [15,125 / 15,187] 48 actions running 2024-12-18T00:15:32.7446237Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2024-12-18T00:15:32.7447012Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 32s local 2024-12-18T00:15:32.7447770Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2024-12-18T00:15:32.7448649Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 28s local 2024-12-18T00:15:32.7449619Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local 2024-12-18T00:15:32.7450468Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local 2024-12-18T00:15:32.7451212Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2024-12-18T00:15:32.7452035Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local ... 2024-12-18T00:15:32.9443477Z 2024-12-18T00:15:32.9444605Z  2024-12-18T00:15:32.9445119Z  2024-12-18T00:15:32.9445477Z  2024-12-18T00:15:32.9445910Z  2024-12-18T00:15:32.9446398Z  2024-12-18T00:15:32.9446768Z  2024-12-18T00:15:32.9447117Z  2024-12-18T00:15:32.9447514Z  2024-12-18T00:15:32.9448066Z [15,126 / 15,187] 47 actions running 2024-12-18T00:15:32.9448782Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2024-12-18T00:15:32.9449577Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2024-12-18T00:15:32.9450436Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 28s local 2024-12-18T00:15:32.9451383Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 28s local 2024-12-18T00:15:32.9452310Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local 2024-12-18T00:15:32.9452929Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2024-12-18T00:15:32.9453604Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2024-12-18T00:15:32.9454405Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local ... 2024-12-18T00:15:33.3448712Z 2024-12-18T00:15:33.3449578Z  2024-12-18T00:15:33.3450074Z  2024-12-18T00:15:33.3450502Z  2024-12-18T00:15:33.3450906Z  2024-12-18T00:15:33.3451296Z  2024-12-18T00:15:33.3451670Z  2024-12-18T00:15:33.3452069Z  2024-12-18T00:15:33.3452425Z  2024-12-18T00:15:33.3452949Z [15,126 / 15,187] 48 actions running 2024-12-18T00:15:33.3453639Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2024-12-18T00:15:33.3454375Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2024-12-18T00:15:33.3455514Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 28s local 2024-12-18T00:15:33.3456782Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 28s local 2024-12-18T00:15:33.3457643Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local 2024-12-18T00:15:33.3458384Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2024-12-18T00:15:33.3459091Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2024-12-18T00:15:33.3459908Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local ... 2024-12-18T00:15:33.6052144Z 2024-12-18T00:15:33.6053018Z  2024-12-18T00:15:33.6053473Z  2024-12-18T00:15:33.6053887Z  2024-12-18T00:15:33.6054285Z  2024-12-18T00:15:33.6054656Z  2024-12-18T00:15:33.6055008Z  2024-12-18T00:15:33.6055369Z  2024-12-18T00:15:33.6055728Z  2024-12-18T00:15:33.6056286Z [15,127 / 15,187] 48 actions, 47 running 2024-12-18T00:15:33.6057142Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2024-12-18T00:15:33.6058274Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2024-12-18T00:15:33.6059162Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 28s local 2024-12-18T00:15:33.6060081Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2024-12-18T00:15:33.6060762Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2024-12-18T00:15:33.6061502Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2024-12-18T00:15:33.6062313Z Compiling torch_xla/csrc/ops/not_supported.cpp; 25s local 2024-12-18T00:15:33.6063105Z Compiling torch_xla/csrc/ops/ops.cpp; 24s local ... 2024-12-18T00:15:33.9454788Z 2024-12-18T00:15:33.9455663Z  2024-12-18T00:15:33.9456107Z  2024-12-18T00:15:33.9456698Z  2024-12-18T00:15:33.9457054Z  2024-12-18T00:15:33.9457419Z  2024-12-18T00:15:33.9457794Z  2024-12-18T00:15:33.9458175Z  2024-12-18T00:15:33.9458551Z  2024-12-18T00:15:33.9459117Z [15,127 / 15,187] 48 actions running 2024-12-18T00:15:33.9459864Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2024-12-18T00:15:33.9460662Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2024-12-18T00:15:33.9461557Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2024-12-18T00:15:33.9462391Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2024-12-18T00:15:33.9463106Z Compiling torch_xla/csrc/ops/nonzero.cpp; 26s local 2024-12-18T00:15:33.9463854Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2024-12-18T00:15:33.9464678Z Compiling torch_xla/csrc/ops/not_supported.cpp; 25s local 2024-12-18T00:15:33.9465470Z Compiling torch_xla/csrc/ops/ops.cpp; 24s local ... 2024-12-18T00:15:35.1462893Z 2024-12-18T00:15:35.1463746Z  2024-12-18T00:15:35.1464373Z  2024-12-18T00:15:35.1464666Z  2024-12-18T00:15:35.1464939Z  2024-12-18T00:15:35.1465226Z  2024-12-18T00:15:35.1465515Z  2024-12-18T00:15:35.1465833Z  2024-12-18T00:15:35.1466100Z  2024-12-18T00:15:35.1466535Z [15,127 / 15,187] 48 actions running 2024-12-18T00:15:35.1467080Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2024-12-18T00:15:35.1467725Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2024-12-18T00:15:35.1468444Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local 2024-12-18T00:15:35.1469125Z Compiling torch_xla/csrc/ops/nms.cpp; 28s local 2024-12-18T00:15:35.1469803Z Compiling torch_xla/csrc/ops/nonzero.cpp; 27s local 2024-12-18T00:15:35.1470506Z Compiling torch_xla/csrc/ops/normal.cpp; 27s local 2024-12-18T00:15:35.1471321Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2024-12-18T00:15:35.1472092Z Compiling torch_xla/csrc/ops/ops.cpp; 26s local ... 2024-12-18T00:15:36.1470144Z 2024-12-18T00:15:36.1471019Z  2024-12-18T00:15:36.1471492Z  2024-12-18T00:15:36.1471887Z  2024-12-18T00:15:36.1472589Z  2024-12-18T00:15:36.1472985Z  2024-12-18T00:15:36.1473359Z  2024-12-18T00:15:36.1473739Z  2024-12-18T00:15:36.1474153Z  2024-12-18T00:15:36.1474740Z [15,127 / 15,187] 48 actions running 2024-12-18T00:15:36.1475476Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2024-12-18T00:15:36.1476326Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2024-12-18T00:15:36.1477284Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2024-12-18T00:15:36.1478047Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2024-12-18T00:15:36.1478795Z Compiling torch_xla/csrc/ops/nonzero.cpp; 28s local 2024-12-18T00:15:36.1479699Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local 2024-12-18T00:15:36.1480447Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2024-12-18T00:15:36.1481379Z Compiling torch_xla/csrc/ops/ops.cpp; 27s local ... 2024-12-18T00:15:36.3473994Z 2024-12-18T00:15:36.3474828Z  2024-12-18T00:15:36.3475331Z  2024-12-18T00:15:36.3475727Z  2024-12-18T00:15:36.3476088Z  2024-12-18T00:15:36.3476492Z  2024-12-18T00:15:36.3477174Z  2024-12-18T00:15:36.3477568Z  2024-12-18T00:15:36.3477958Z  2024-12-18T00:15:36.3478597Z [15,128 / 15,187] 48 actions running 2024-12-18T00:15:36.3479350Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2024-12-18T00:15:36.3480201Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2024-12-18T00:15:36.3481020Z Compiling torch_xla/csrc/ops/nms.cpp; 30s local 2024-12-18T00:15:36.3481750Z Compiling torch_xla/csrc/ops/nonzero.cpp; 28s local 2024-12-18T00:15:36.3482598Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local 2024-12-18T00:15:36.3483424Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2024-12-18T00:15:36.3484225Z Compiling torch_xla/csrc/ops/ops.cpp; 27s local 2024-12-18T00:15:36.3485036Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 26s local ... 2024-12-18T00:15:37.5483497Z 2024-12-18T00:15:37.5484476Z  2024-12-18T00:15:37.5484961Z  2024-12-18T00:15:37.5485360Z  2024-12-18T00:15:37.5485806Z  2024-12-18T00:15:37.5486193Z  2024-12-18T00:15:37.5486587Z  2024-12-18T00:15:37.5486939Z  2024-12-18T00:15:37.5487242Z  2024-12-18T00:15:37.5487708Z [15,128 / 15,187] 48 actions running 2024-12-18T00:15:37.5488592Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2024-12-18T00:15:37.5489371Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 32s local 2024-12-18T00:15:37.5490104Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local 2024-12-18T00:15:37.5490776Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2024-12-18T00:15:37.5491449Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2024-12-18T00:15:37.5492143Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2024-12-18T00:15:37.5492879Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2024-12-18T00:15:37.5493605Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 27s local ... 2024-12-18T00:15:37.7485354Z 2024-12-18T00:15:37.7486296Z  2024-12-18T00:15:37.7486725Z  2024-12-18T00:15:37.7487100Z  2024-12-18T00:15:37.7487481Z  2024-12-18T00:15:37.7487849Z  2024-12-18T00:15:37.7488186Z  2024-12-18T00:15:37.7488559Z  2024-12-18T00:15:37.7488926Z  2024-12-18T00:15:37.7489489Z [15,129 / 15,187] 48 actions, 47 running 2024-12-18T00:15:37.7490220Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2024-12-18T00:15:37.7491167Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 32s local 2024-12-18T00:15:37.7492015Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2024-12-18T00:15:37.7492752Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2024-12-18T00:15:37.7493526Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2024-12-18T00:15:37.7494342Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2024-12-18T00:15:37.7495496Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 27s local 2024-12-18T00:15:37.7496568Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 25s local ... 2024-12-18T00:15:38.1490566Z 2024-12-18T00:15:38.1491409Z  2024-12-18T00:15:38.1491899Z  2024-12-18T00:15:38.1492270Z  2024-12-18T00:15:38.1492620Z  2024-12-18T00:15:38.1492996Z  2024-12-18T00:15:38.1493387Z  2024-12-18T00:15:38.1493781Z  2024-12-18T00:15:38.1494157Z  2024-12-18T00:15:38.1494702Z [15,129 / 15,187] 48 actions running 2024-12-18T00:15:38.1495436Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2024-12-18T00:15:38.1496270Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 33s local 2024-12-18T00:15:38.1497241Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2024-12-18T00:15:38.1497934Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2024-12-18T00:15:38.1498741Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2024-12-18T00:15:38.1499541Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T00:15:38.1500656Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2024-12-18T00:15:38.1501608Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 25s local ... 2024-12-18T00:15:38.7496842Z 2024-12-18T00:15:38.7497736Z  2024-12-18T00:15:38.7498233Z  2024-12-18T00:15:38.7498597Z  2024-12-18T00:15:38.7499060Z  2024-12-18T00:15:38.7499439Z  2024-12-18T00:15:38.7499847Z  2024-12-18T00:15:38.7500212Z  2024-12-18T00:15:38.7500577Z  2024-12-18T00:15:38.7501124Z [15,130 / 15,187] 47 actions running 2024-12-18T00:15:38.7502224Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2024-12-18T00:15:38.7503034Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2024-12-18T00:15:38.7503813Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2024-12-18T00:15:38.7504634Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2024-12-18T00:15:38.7505478Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T00:15:38.7506290Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2024-12-18T00:15:38.7507212Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local 2024-12-18T00:15:38.7508164Z Compiling torch_xla/csrc/ops/permute.cpp; 25s local ... 2024-12-18T00:15:39.1500817Z 2024-12-18T00:15:39.1501658Z  2024-12-18T00:15:39.1502083Z  2024-12-18T00:15:39.1502422Z  2024-12-18T00:15:39.1502903Z  2024-12-18T00:15:39.1503260Z  2024-12-18T00:15:39.1503608Z  2024-12-18T00:15:39.1503954Z  2024-12-18T00:15:39.1504279Z  2024-12-18T00:15:39.1504822Z [15,130 / 15,187] 48 actions running 2024-12-18T00:15:39.1505625Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2024-12-18T00:15:39.1506294Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2024-12-18T00:15:39.1506940Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2024-12-18T00:15:39.1507627Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2024-12-18T00:15:39.1508314Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2024-12-18T00:15:39.1508978Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T00:15:39.1509766Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local 2024-12-18T00:15:39.1510568Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local ... 2024-12-18T00:15:39.3504082Z 2024-12-18T00:15:39.3505028Z  2024-12-18T00:15:39.3505415Z  2024-12-18T00:15:39.3505776Z  2024-12-18T00:15:39.3506109Z  2024-12-18T00:15:39.3506470Z  2024-12-18T00:15:39.3506838Z  2024-12-18T00:15:39.3507197Z  2024-12-18T00:15:39.3507547Z  2024-12-18T00:15:39.3508081Z [15,131 / 15,187] 48 actions, 47 running 2024-12-18T00:15:39.3508743Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2024-12-18T00:15:39.3509565Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2024-12-18T00:15:39.3510617Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2024-12-18T00:15:39.3511364Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2024-12-18T00:15:39.3512050Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T00:15:39.3512851Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2024-12-18T00:15:39.3513609Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local 2024-12-18T00:15:39.3514246Z Compiling torch_xla/csrc/ops/prod.cpp; 26s local ... 2024-12-18T00:15:39.7508878Z 2024-12-18T00:15:39.7509670Z  2024-12-18T00:15:39.7510064Z  2024-12-18T00:15:39.7510395Z  2024-12-18T00:15:39.7510764Z  2024-12-18T00:15:39.7511098Z  2024-12-18T00:15:39.7511426Z  2024-12-18T00:15:39.7511749Z  2024-12-18T00:15:39.7512091Z  2024-12-18T00:15:39.7512639Z [15,131 / 15,187] 48 actions running 2024-12-18T00:15:39.7513358Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2024-12-18T00:15:39.7514037Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2024-12-18T00:15:39.7515029Z Compiling torch_xla/csrc/ops/not_supported.cpp; 31s local 2024-12-18T00:15:39.7515724Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2024-12-18T00:15:39.7516511Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T00:15:39.7517301Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2024-12-18T00:15:39.7518071Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local 2024-12-18T00:15:39.7518724Z Compiling torch_xla/csrc/ops/prod.cpp; 26s local ... 2024-12-18T00:15:40.1513580Z 2024-12-18T00:15:40.1514602Z  2024-12-18T00:15:40.1515031Z  2024-12-18T00:15:40.1515394Z  2024-12-18T00:15:40.1515725Z  2024-12-18T00:15:40.1516261Z  2024-12-18T00:15:40.1516640Z  2024-12-18T00:15:40.1517001Z  2024-12-18T00:15:40.1517345Z  2024-12-18T00:15:40.1517826Z [15,132 / 15,187] 48 actions running 2024-12-18T00:15:40.1518503Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2024-12-18T00:15:40.1519253Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2024-12-18T00:15:40.1519981Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2024-12-18T00:15:40.1520740Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2024-12-18T00:15:40.1521570Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2024-12-18T00:15:40.1522310Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local 2024-12-18T00:15:40.1522971Z Compiling torch_xla/csrc/ops/prod.cpp; 26s local 2024-12-18T00:15:40.1523666Z Compiling torch_xla/csrc/ops/put.cpp; 26s local ... 2024-12-18T00:15:41.3523427Z 2024-12-18T00:15:41.3524330Z  2024-12-18T00:15:41.3524975Z  2024-12-18T00:15:41.3525540Z  2024-12-18T00:15:41.3525929Z  2024-12-18T00:15:41.3526313Z  2024-12-18T00:15:41.3526690Z  2024-12-18T00:15:41.3527083Z  2024-12-18T00:15:41.3527508Z  2024-12-18T00:15:41.3528078Z [15,132 / 15,187] 48 actions running 2024-12-18T00:15:41.3528865Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2024-12-18T00:15:41.3529627Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2024-12-18T00:15:41.3530378Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2024-12-18T00:15:41.3531106Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2024-12-18T00:15:41.3532000Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2024-12-18T00:15:41.3532888Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2024-12-18T00:15:41.3533625Z Compiling torch_xla/csrc/ops/prod.cpp; 28s local 2024-12-18T00:15:41.3534375Z Compiling torch_xla/csrc/ops/put.cpp; 27s local ... 2024-12-18T00:15:42.3400651Z 2024-12-18T00:15:42.3401584Z  2024-12-18T00:15:42.3402024Z  2024-12-18T00:15:42.3402399Z  2024-12-18T00:15:42.3402771Z  2024-12-18T00:15:42.3403167Z  2024-12-18T00:15:42.3403877Z  2024-12-18T00:15:42.3404249Z  2024-12-18T00:15:42.3404600Z  2024-12-18T00:15:42.3405145Z [15,133 / 15,187] 48 actions, 47 running 2024-12-18T00:15:42.3405907Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2024-12-18T00:15:42.3406674Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2024-12-18T00:15:42.3407427Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 32s local 2024-12-18T00:15:42.3408285Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T00:15:42.3409107Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2024-12-18T00:15:42.3409842Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local 2024-12-18T00:15:42.3410540Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2024-12-18T00:15:42.3411440Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local ... 2024-12-18T00:15:42.5529464Z 2024-12-18T00:15:42.5530310Z  2024-12-18T00:15:42.5530767Z  2024-12-18T00:15:42.5531165Z  2024-12-18T00:15:42.5531561Z  2024-12-18T00:15:42.5531915Z  2024-12-18T00:15:42.5532283Z  2024-12-18T00:15:42.5532653Z  2024-12-18T00:15:42.5533342Z  2024-12-18T00:15:42.5533926Z [15,133 / 15,187] 48 actions running 2024-12-18T00:15:42.5534779Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2024-12-18T00:15:42.5535466Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2024-12-18T00:15:42.5536221Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 32s local 2024-12-18T00:15:42.5537222Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T00:15:42.5538063Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2024-12-18T00:15:42.5538987Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local 2024-12-18T00:15:42.5539685Z Compiling torch_xla/csrc/ops/put.cpp; 29s local 2024-12-18T00:15:42.5540372Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local ... 2024-12-18T00:15:43.5535906Z 2024-12-18T00:15:43.5537285Z  2024-12-18T00:15:43.5538140Z  2024-12-18T00:15:43.5538761Z  2024-12-18T00:15:43.5539827Z  2024-12-18T00:15:43.5540280Z  2024-12-18T00:15:43.5540675Z  2024-12-18T00:15:43.5541051Z  2024-12-18T00:15:43.5541429Z  2024-12-18T00:15:43.5542000Z [15,133 / 15,187] 48 actions running 2024-12-18T00:15:43.5542728Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2024-12-18T00:15:43.5543455Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2024-12-18T00:15:43.5544426Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2024-12-18T00:15:43.5545373Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2024-12-18T00:15:43.5546254Z Compiling torch_xla/csrc/ops/permute.cpp; 30s local 2024-12-18T00:15:43.5546984Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2024-12-18T00:15:43.5547664Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2024-12-18T00:15:43.5548367Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local ... 2024-12-18T00:15:44.5544996Z 2024-12-18T00:15:44.5546000Z  2024-12-18T00:15:44.5546483Z  2024-12-18T00:15:44.5546856Z  2024-12-18T00:15:44.5547249Z  2024-12-18T00:15:44.5547603Z  2024-12-18T00:15:44.5547983Z  2024-12-18T00:15:44.5548336Z  2024-12-18T00:15:44.5548711Z  2024-12-18T00:15:44.5549230Z [15,133 / 15,187] 48 actions running 2024-12-18T00:15:44.5549937Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2024-12-18T00:15:44.5550615Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2024-12-18T00:15:44.5551361Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T00:15:44.5552237Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2024-12-18T00:15:44.5553033Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T00:15:44.5553738Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2024-12-18T00:15:44.5554394Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2024-12-18T00:15:44.5555441Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local ... 2024-12-18T00:15:45.0262905Z 2024-12-18T00:15:45.0264989Z  2024-12-18T00:15:45.0265472Z  2024-12-18T00:15:45.0265834Z  2024-12-18T00:15:45.0266228Z  2024-12-18T00:15:45.0266613Z  2024-12-18T00:15:45.0267026Z  2024-12-18T00:15:45.0267364Z  2024-12-18T00:15:45.0267722Z  2024-12-18T00:15:45.0268305Z [15,134 / 15,187] 48 actions, 47 running 2024-12-18T00:15:45.0269039Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2024-12-18T00:15:45.0269791Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2024-12-18T00:15:45.0270707Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T00:15:45.0271598Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2024-12-18T00:15:45.0272430Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2024-12-18T00:15:45.0273112Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2024-12-18T00:15:45.0273803Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T00:15:45.0274586Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 29s local ... 2024-12-18T00:15:45.3029471Z 2024-12-18T00:15:45.3030304Z  2024-12-18T00:15:45.3030769Z  2024-12-18T00:15:45.3031179Z  2024-12-18T00:15:45.3031741Z  2024-12-18T00:15:45.3032153Z  2024-12-18T00:15:45.3032545Z  2024-12-18T00:15:45.3032936Z  2024-12-18T00:15:45.3033306Z  2024-12-18T00:15:45.3033922Z [15,135 / 15,187] 48 actions, 47 running 2024-12-18T00:15:45.3034711Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2024-12-18T00:15:45.3035681Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T00:15:45.3036427Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T00:15:45.3037287Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2024-12-18T00:15:45.3038102Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2024-12-18T00:15:45.3038863Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T00:15:45.3039603Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2024-12-18T00:15:45.3040389Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local ... 2024-12-18T00:15:45.5555743Z 2024-12-18T00:15:45.5556714Z  2024-12-18T00:15:45.5557163Z  2024-12-18T00:15:45.5557521Z  2024-12-18T00:15:45.5558056Z  2024-12-18T00:15:45.5558425Z  2024-12-18T00:15:45.5558817Z  2024-12-18T00:15:45.5559165Z  2024-12-18T00:15:45.5559539Z  2024-12-18T00:15:45.5560081Z [15,135 / 15,187] 48 actions running 2024-12-18T00:15:45.5560724Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2024-12-18T00:15:45.5561351Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T00:15:45.5562066Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T00:15:45.5562942Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2024-12-18T00:15:45.5563787Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2024-12-18T00:15:45.5564522Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T00:15:45.5565309Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2024-12-18T00:15:45.5566097Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local ... 2024-12-18T00:15:45.7697358Z 2024-12-18T00:15:45.7698218Z  2024-12-18T00:15:45.7698678Z  2024-12-18T00:15:45.7699058Z  2024-12-18T00:15:45.7699427Z  2024-12-18T00:15:45.7699779Z  2024-12-18T00:15:45.7700145Z  2024-12-18T00:15:45.7700540Z  2024-12-18T00:15:45.7700930Z  2024-12-18T00:15:45.7701522Z [15,136 / 15,187] 48 actions, 47 running 2024-12-18T00:15:45.7702234Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2024-12-18T00:15:45.7702999Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T00:15:45.7703780Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T00:15:45.7704679Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2024-12-18T00:15:45.7705819Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2024-12-18T00:15:45.7706451Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2024-12-18T00:15:45.7707040Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local 2024-12-18T00:15:45.7707629Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local ... 2024-12-18T00:15:46.1563729Z 2024-12-18T00:15:46.1564627Z  2024-12-18T00:15:46.1565078Z  2024-12-18T00:15:46.1565446Z  2024-12-18T00:15:46.1565798Z  2024-12-18T00:15:46.1566150Z  2024-12-18T00:15:46.1566511Z  2024-12-18T00:15:46.1566838Z  2024-12-18T00:15:46.1567201Z  2024-12-18T00:15:46.1567742Z [15,136 / 15,187] 48 actions running 2024-12-18T00:15:46.1568561Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2024-12-18T00:15:46.1569381Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2024-12-18T00:15:46.1570219Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2024-12-18T00:15:46.1571527Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2024-12-18T00:15:46.1572838Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2024-12-18T00:15:46.1573532Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2024-12-18T00:15:46.1574322Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2024-12-18T00:15:46.1575087Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local ... 2024-12-18T00:15:47.1565990Z 2024-12-18T00:15:47.1577380Z  2024-12-18T00:15:47.1578092Z  2024-12-18T00:15:47.1578469Z  2024-12-18T00:15:47.1578817Z  2024-12-18T00:15:47.1579171Z  2024-12-18T00:15:47.1579893Z  2024-12-18T00:15:47.1580260Z  2024-12-18T00:15:47.1580651Z  2024-12-18T00:15:47.1581180Z [15,137 / 15,187] 47 actions running 2024-12-18T00:15:47.1581890Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2024-12-18T00:15:47.1582550Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2024-12-18T00:15:47.1583415Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T00:15:47.1584211Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2024-12-18T00:15:47.1585121Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2024-12-18T00:15:47.1586436Z Compiling torch_xla/csrc/ops/randperm.cpp; 31s local 2024-12-18T00:15:47.1587270Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2024-12-18T00:15:47.1588194Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local ... 2024-12-18T00:15:47.3569999Z 2024-12-18T00:15:47.3570931Z  2024-12-18T00:15:47.3571368Z  2024-12-18T00:15:47.3571705Z  2024-12-18T00:15:47.3572097Z  2024-12-18T00:15:47.3572461Z  2024-12-18T00:15:47.3572805Z  2024-12-18T00:15:47.3573167Z  2024-12-18T00:15:47.3573546Z  2024-12-18T00:15:47.3574063Z [15,139 / 15,187] 47 actions running 2024-12-18T00:15:47.3574768Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2024-12-18T00:15:47.3575489Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2024-12-18T00:15:47.3576178Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T00:15:47.3576894Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2024-12-18T00:15:47.3577672Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2024-12-18T00:15:47.3578436Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2024-12-18T00:15:47.3579251Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2024-12-18T00:15:47.3580243Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local ... 2024-12-18T00:15:47.7575167Z 2024-12-18T00:15:47.7576087Z  2024-12-18T00:15:47.7576702Z  2024-12-18T00:15:47.7577115Z  2024-12-18T00:15:47.7577500Z  2024-12-18T00:15:47.7577918Z  2024-12-18T00:15:47.7578307Z  2024-12-18T00:15:47.7578704Z  2024-12-18T00:15:47.7579045Z  2024-12-18T00:15:47.7579591Z [15,140 / 15,187] 46 actions running 2024-12-18T00:15:47.7580687Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2024-12-18T00:15:47.7581424Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2024-12-18T00:15:47.7582203Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T00:15:47.7583130Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2024-12-18T00:15:47.7583866Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2024-12-18T00:15:47.7584705Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2024-12-18T00:15:47.7585801Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2024-12-18T00:15:47.7586777Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local ... 2024-12-18T00:15:48.3580941Z 2024-12-18T00:15:48.3581926Z  2024-12-18T00:15:48.3582407Z  2024-12-18T00:15:48.3582814Z  2024-12-18T00:15:48.3583191Z  2024-12-18T00:15:48.3583828Z  2024-12-18T00:15:48.3584215Z  2024-12-18T00:15:48.3584794Z  2024-12-18T00:15:48.3585325Z  2024-12-18T00:15:48.3585997Z [15,141 / 15,187] 45 actions running 2024-12-18T00:15:48.3587188Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2024-12-18T00:15:48.3588102Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2024-12-18T00:15:48.3589143Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T00:15:48.3590076Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 32s local 2024-12-18T00:15:48.3591092Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2024-12-18T00:15:48.3592132Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2024-12-18T00:15:48.3593412Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2024-12-18T00:15:48.3594547Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local ... 2024-12-18T00:15:48.9347643Z 2024-12-18T00:15:48.9348592Z  2024-12-18T00:15:48.9349004Z  2024-12-18T00:15:48.9349377Z  2024-12-18T00:15:48.9349744Z  2024-12-18T00:15:48.9350067Z  2024-12-18T00:15:48.9350406Z  2024-12-18T00:15:48.9350749Z  2024-12-18T00:15:48.9351090Z  2024-12-18T00:15:48.9351701Z [15,143 / 15,187] 43 actions running 2024-12-18T00:15:48.9352359Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2024-12-18T00:15:48.9353034Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2024-12-18T00:15:48.9353674Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T00:15:48.9354481Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2024-12-18T00:15:48.9355555Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2024-12-18T00:15:48.9356363Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2024-12-18T00:15:48.9357136Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2024-12-18T00:15:48.9357774Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local ... 2024-12-18T00:15:49.1351593Z 2024-12-18T00:15:49.1352413Z  2024-12-18T00:15:49.1352807Z  2024-12-18T00:15:49.1353162Z  2024-12-18T00:15:49.1353533Z  2024-12-18T00:15:49.1353910Z  2024-12-18T00:15:49.1354239Z  2024-12-18T00:15:49.1354548Z  2024-12-18T00:15:49.1354876Z  2024-12-18T00:15:49.1355359Z [15,144 / 15,187] 42 actions running 2024-12-18T00:15:49.1355987Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2024-12-18T00:15:49.1356616Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T00:15:49.1357229Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T00:15:49.1357967Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2024-12-18T00:15:49.1358832Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2024-12-18T00:15:49.1359632Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2024-12-18T00:15:49.1360257Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2024-12-18T00:15:49.1360954Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local ... 2024-12-18T00:15:49.5358420Z 2024-12-18T00:15:49.5359249Z  2024-12-18T00:15:49.5359636Z  2024-12-18T00:15:49.5359992Z  2024-12-18T00:15:49.5360324Z  2024-12-18T00:15:49.5360633Z  2024-12-18T00:15:49.5360972Z  2024-12-18T00:15:49.5361406Z  2024-12-18T00:15:49.5361894Z  2024-12-18T00:15:49.5362360Z [15,145 / 15,187] 41 actions running 2024-12-18T00:15:49.5362961Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2024-12-18T00:15:49.5363581Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T00:15:49.5364203Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2024-12-18T00:15:49.5364967Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2024-12-18T00:15:49.5365752Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2024-12-18T00:15:49.5366383Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2024-12-18T00:15:49.5367032Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local 2024-12-18T00:15:49.5367861Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local ... 2024-12-18T00:15:50.5362217Z 2024-12-18T00:15:50.5363680Z  2024-12-18T00:15:50.5364146Z  2024-12-18T00:15:50.5364729Z  2024-12-18T00:15:50.5365078Z  2024-12-18T00:15:50.5365438Z  2024-12-18T00:15:50.5365808Z  2024-12-18T00:15:50.5366172Z  2024-12-18T00:15:50.5366525Z  2024-12-18T00:15:50.5367069Z [15,145 / 15,187] 41 actions running 2024-12-18T00:15:50.5367795Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2024-12-18T00:15:50.5368718Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2024-12-18T00:15:50.5369409Z Compiling torch_xla/csrc/ops/prod.cpp; 37s local 2024-12-18T00:15:50.5370219Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2024-12-18T00:15:50.5371073Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2024-12-18T00:15:50.5371796Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2024-12-18T00:15:50.5372756Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2024-12-18T00:15:50.5373759Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local ... 2024-12-18T00:15:50.9364326Z 2024-12-18T00:15:50.9365200Z  2024-12-18T00:15:50.9365673Z  2024-12-18T00:15:50.9366069Z  2024-12-18T00:15:50.9366447Z  2024-12-18T00:15:50.9366842Z  2024-12-18T00:15:50.9367220Z  2024-12-18T00:15:50.9367553Z  2024-12-18T00:15:50.9367921Z  2024-12-18T00:15:50.9368478Z [15,148 / 15,187] 38 actions running 2024-12-18T00:15:50.9369180Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2024-12-18T00:15:50.9369891Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2024-12-18T00:15:50.9370622Z Compiling torch_xla/csrc/ops/roll.cpp; 31s local 2024-12-18T00:15:50.9371365Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 31s local 2024-12-18T00:15:50.9372189Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2024-12-18T00:15:50.9373123Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2024-12-18T00:15:50.9373910Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local 2024-12-18T00:15:50.9374767Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local ... 2024-12-18T00:15:51.3367946Z 2024-12-18T00:15:51.3368796Z  2024-12-18T00:15:51.3369240Z  2024-12-18T00:15:51.3369610Z  2024-12-18T00:15:51.3369981Z  2024-12-18T00:15:51.3370354Z  2024-12-18T00:15:51.3370713Z  2024-12-18T00:15:51.3371099Z  2024-12-18T00:15:51.3371485Z  2024-12-18T00:15:51.3372034Z [15,151 / 15,187] 35 actions running 2024-12-18T00:15:51.3372718Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2024-12-18T00:15:51.3373481Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 31s local 2024-12-18T00:15:51.3374249Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2024-12-18T00:15:51.3375345Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local 2024-12-18T00:15:51.3376090Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2024-12-18T00:15:51.3377035Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2024-12-18T00:15:51.3377811Z Compiling torch_xla/csrc/ops/select.cpp; 26s local 2024-12-18T00:15:51.3378561Z Compiling torch_xla/csrc/ops/send.cpp; 26s local ... 2024-12-18T00:15:51.7371756Z 2024-12-18T00:15:51.7372580Z  2024-12-18T00:15:51.7373035Z  2024-12-18T00:15:51.7373401Z  2024-12-18T00:15:51.7373781Z  2024-12-18T00:15:51.7374150Z  2024-12-18T00:15:51.7374502Z  2024-12-18T00:15:51.7374916Z  2024-12-18T00:15:51.7375271Z  2024-12-18T00:15:51.7375790Z [15,152 / 15,187] 34 actions running 2024-12-18T00:15:51.7376662Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2024-12-18T00:15:51.7377354Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2024-12-18T00:15:51.7378080Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2024-12-18T00:15:51.7378902Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2024-12-18T00:15:51.7379991Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2024-12-18T00:15:51.7380803Z Compiling torch_xla/csrc/ops/select.cpp; 26s local 2024-12-18T00:15:51.7381552Z Compiling torch_xla/csrc/ops/send.cpp; 26s local 2024-12-18T00:15:51.7382206Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 26s local ... 2024-12-18T00:15:52.7378966Z 2024-12-18T00:15:52.7379776Z  2024-12-18T00:15:52.7380263Z  2024-12-18T00:15:52.7380702Z  2024-12-18T00:15:52.7381134Z  2024-12-18T00:15:52.7381793Z  2024-12-18T00:15:52.7382231Z  2024-12-18T00:15:52.7382664Z  2024-12-18T00:15:52.7383098Z  2024-12-18T00:15:52.7383707Z [15,152 / 15,187] 34 actions running 2024-12-18T00:15:52.7384521Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T00:15:52.7385356Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2024-12-18T00:15:52.7386235Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2024-12-18T00:15:52.7387158Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2024-12-18T00:15:52.7388129Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 28s local 2024-12-18T00:15:52.7389056Z Compiling torch_xla/csrc/ops/select.cpp; 27s local 2024-12-18T00:15:52.7389906Z Compiling torch_xla/csrc/ops/send.cpp; 27s local 2024-12-18T00:15:52.7390879Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local ... 2024-12-18T00:15:53.3383832Z 2024-12-18T00:15:53.3384663Z  2024-12-18T00:15:53.3385104Z  2024-12-18T00:15:53.3385511Z  2024-12-18T00:15:53.3385883Z  2024-12-18T00:15:53.3386255Z  2024-12-18T00:15:53.3386607Z  2024-12-18T00:15:53.3386988Z  2024-12-18T00:15:53.3387360Z  2024-12-18T00:15:53.3387888Z [15,153 / 15,187] 33 actions running 2024-12-18T00:15:53.3388571Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2024-12-18T00:15:53.3389241Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2024-12-18T00:15:53.3389905Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2024-12-18T00:15:53.3390630Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T00:15:53.3391407Z Compiling torch_xla/csrc/ops/select.cpp; 28s local 2024-12-18T00:15:53.3392097Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T00:15:53.3392894Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local 2024-12-18T00:15:53.3393727Z Compiling torch_xla/csrc/ops/softmax.cpp; 27s local ... 2024-12-18T00:15:53.7387821Z 2024-12-18T00:15:53.7388646Z  2024-12-18T00:15:53.7389123Z  2024-12-18T00:15:53.7389517Z  2024-12-18T00:15:53.7389878Z  2024-12-18T00:15:53.7390224Z  2024-12-18T00:15:53.7390589Z  2024-12-18T00:15:53.7390989Z  2024-12-18T00:15:53.7391381Z  2024-12-18T00:15:53.7391863Z [15,154 / 15,187] 32 actions running 2024-12-18T00:15:53.7392803Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2024-12-18T00:15:53.7393525Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2024-12-18T00:15:53.7394259Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T00:15:53.7395033Z Compiling torch_xla/csrc/ops/select.cpp; 28s local 2024-12-18T00:15:53.7395725Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T00:15:53.7396496Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2024-12-18T00:15:53.7397227Z Compiling torch_xla/csrc/ops/softmax.cpp; 27s local 2024-12-18T00:15:53.7398068Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local ... 2024-12-18T00:15:54.1391895Z 2024-12-18T00:15:54.1392738Z  2024-12-18T00:15:54.1393180Z  2024-12-18T00:15:54.1393551Z  2024-12-18T00:15:54.1393937Z  2024-12-18T00:15:54.1394289Z  2024-12-18T00:15:54.1394603Z  2024-12-18T00:15:54.1394980Z  2024-12-18T00:15:54.1395364Z  2024-12-18T00:15:54.1395896Z [15,155 / 15,187] 31 actions running 2024-12-18T00:15:54.1396787Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2024-12-18T00:15:54.1397534Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2024-12-18T00:15:54.1398398Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T00:15:54.1399081Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2024-12-18T00:15:54.1399858Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2024-12-18T00:15:54.1400586Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2024-12-18T00:15:54.1401455Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local 2024-12-18T00:15:54.1402291Z Compiling torch_xla/csrc/ops/squeeze.cpp; 26s local ... 2024-12-18T00:15:54.5395474Z 2024-12-18T00:15:54.5396265Z  2024-12-18T00:15:54.5396715Z  2024-12-18T00:15:54.5397131Z  2024-12-18T00:15:54.5397511Z  2024-12-18T00:15:54.5397895Z  2024-12-18T00:15:54.5398255Z  2024-12-18T00:15:54.5398622Z  2024-12-18T00:15:54.5398977Z  2024-12-18T00:15:54.5399519Z [15,157 / 15,187] 29 actions running 2024-12-18T00:15:54.5400264Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2024-12-18T00:15:54.5401050Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T00:15:54.5401756Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2024-12-18T00:15:54.5402476Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2024-12-18T00:15:54.5403276Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2024-12-18T00:15:54.5404092Z Compiling torch_xla/csrc/ops/squeeze.cpp; 27s local 2024-12-18T00:15:54.5404839Z Compiling torch_xla/csrc/ops/split.cpp; 27s local 2024-12-18T00:15:54.5405598Z Compiling torch_xla/csrc/ops/var_mean.cpp; 26s local ... 2024-12-18T00:15:54.7399170Z 2024-12-18T00:15:54.7400002Z  2024-12-18T00:15:54.7400416Z  2024-12-18T00:15:54.7400799Z  2024-12-18T00:15:54.7401157Z  2024-12-18T00:15:54.7401518Z  2024-12-18T00:15:54.7401875Z  2024-12-18T00:15:54.7402290Z  2024-12-18T00:15:54.7402650Z  2024-12-18T00:15:54.7403169Z [15,158 / 15,187] 28 actions running 2024-12-18T00:15:54.7403929Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2024-12-18T00:15:54.7404680Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2024-12-18T00:15:54.7405334Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2024-12-18T00:15:54.7406089Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2024-12-18T00:15:54.7406853Z Compiling torch_xla/csrc/ops/squeeze.cpp; 27s local 2024-12-18T00:15:54.7407572Z Compiling torch_xla/csrc/ops/split.cpp; 27s local 2024-12-18T00:15:54.7408318Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local 2024-12-18T00:15:54.7409061Z Compiling torch_xla/csrc/ops/stack.cpp; 25s local ... 2024-12-18T00:15:55.1403111Z 2024-12-18T00:15:55.1404154Z  2024-12-18T00:15:55.1404623Z  2024-12-18T00:15:55.1405006Z  2024-12-18T00:15:55.1405400Z  2024-12-18T00:15:55.1405777Z  2024-12-18T00:15:55.1406102Z  2024-12-18T00:15:55.1406458Z  2024-12-18T00:15:55.1406808Z  2024-12-18T00:15:55.1407326Z [15,159 / 15,187] 27 actions running 2024-12-18T00:15:55.1408153Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 31s local 2024-12-18T00:15:55.1408900Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2024-12-18T00:15:55.1409652Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2024-12-18T00:15:55.1410380Z Compiling torch_xla/csrc/ops/squeeze.cpp; 27s local 2024-12-18T00:15:55.1410936Z Compiling torch_xla/csrc/ops/split.cpp; 27s local 2024-12-18T00:15:55.1411578Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local 2024-12-18T00:15:55.1412272Z Compiling torch_xla/csrc/ops/stack.cpp; 26s local 2024-12-18T00:15:55.1412986Z Compiling torch_xla/csrc/ops/std.cpp; 26s local ... 2024-12-18T00:15:55.5406754Z 2024-12-18T00:15:55.5407590Z  2024-12-18T00:15:55.5408025Z  2024-12-18T00:15:55.5408660Z  2024-12-18T00:15:55.5409024Z  2024-12-18T00:15:55.5409407Z  2024-12-18T00:15:55.5409775Z  2024-12-18T00:15:55.5410303Z  2024-12-18T00:15:55.5410662Z  2024-12-18T00:15:55.5411208Z [15,161 / 15,187] 25 actions running 2024-12-18T00:15:55.5411902Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2024-12-18T00:15:55.5412577Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2024-12-18T00:15:55.5413272Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2024-12-18T00:15:55.5414207Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local 2024-12-18T00:15:55.5414954Z Compiling torch_xla/csrc/ops/stack.cpp; 26s local 2024-12-18T00:15:55.5415680Z Compiling torch_xla/csrc/ops/std.cpp; 26s local 2024-12-18T00:15:55.5416540Z Compiling torch_xla/csrc/ops/std_mean.cpp; 26s local 2024-12-18T00:15:55.5417281Z Compiling torch_xla/csrc/ops/sum.cpp; 26s local ... 2024-12-18T00:15:56.7415121Z 2024-12-18T00:15:56.7415984Z  2024-12-18T00:15:56.7416582Z  2024-12-18T00:15:56.7416998Z  2024-12-18T00:15:56.7417370Z  2024-12-18T00:15:56.7417750Z  2024-12-18T00:15:56.7418113Z  2024-12-18T00:15:56.7418476Z  2024-12-18T00:15:56.7418849Z  2024-12-18T00:15:56.7419371Z [15,162 / 15,187] 24 actions running 2024-12-18T00:15:56.7420103Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2024-12-18T00:15:56.7420735Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2024-12-18T00:15:56.7421484Z Compiling torch_xla/csrc/ops/var_mean.cpp; 29s local 2024-12-18T00:15:56.7422210Z Compiling torch_xla/csrc/ops/stack.cpp; 27s local 2024-12-18T00:15:56.7422890Z Compiling torch_xla/csrc/ops/std.cpp; 27s local 2024-12-18T00:15:56.7423601Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2024-12-18T00:15:56.7424291Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local 2024-12-18T00:15:56.7424915Z Compiling torch_xla/csrc/ops/svd.cpp; 26s local ... 2024-12-18T00:15:57.1419144Z 2024-12-18T00:15:57.1420007Z  2024-12-18T00:15:57.1420452Z  2024-12-18T00:15:57.1420826Z  2024-12-18T00:15:57.1421225Z  2024-12-18T00:15:57.1421599Z  2024-12-18T00:15:57.1421966Z  2024-12-18T00:15:57.1422325Z  2024-12-18T00:15:57.1422676Z  2024-12-18T00:15:57.1423210Z [15,163 / 15,187] 23 actions running 2024-12-18T00:15:57.1423931Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2024-12-18T00:15:57.1424701Z Compiling torch_xla/csrc/ops/var_mean.cpp; 29s local 2024-12-18T00:15:57.1425391Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local 2024-12-18T00:15:57.1426096Z Compiling torch_xla/csrc/ops/std.cpp; 28s local 2024-12-18T00:15:57.1426768Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2024-12-18T00:15:57.1427478Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local 2024-12-18T00:15:57.1428385Z Compiling torch_xla/csrc/ops/svd.cpp; 26s local 2024-12-18T00:15:57.1429102Z Compiling torch_xla/csrc/ops/symeig.cpp; 26s local ... 2024-12-18T00:15:57.5422421Z 2024-12-18T00:15:57.5423247Z  2024-12-18T00:15:57.5423719Z  2024-12-18T00:15:57.5424095Z  2024-12-18T00:15:57.5424447Z  2024-12-18T00:15:57.5424800Z  2024-12-18T00:15:57.5425152Z  2024-12-18T00:15:57.5425496Z  2024-12-18T00:15:57.5425879Z  2024-12-18T00:15:57.5426393Z [15,164 / 15,187] 22 actions running 2024-12-18T00:15:57.5427100Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2024-12-18T00:15:57.5427833Z Compiling torch_xla/csrc/ops/var_mean.cpp; 29s local 2024-12-18T00:15:57.5428546Z Compiling torch_xla/csrc/ops/std.cpp; 28s local 2024-12-18T00:15:57.5429201Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local 2024-12-18T00:15:57.5429871Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2024-12-18T00:15:57.5430539Z Compiling torch_xla/csrc/ops/svd.cpp; 27s local 2024-12-18T00:15:57.5431453Z Compiling torch_xla/csrc/ops/symeig.cpp; 26s local 2024-12-18T00:15:57.5432244Z Compiling torch_xla/csrc/ops/threshold.cpp; 26s local ... 2024-12-18T00:15:58.5429015Z 2024-12-18T00:15:58.5429767Z  2024-12-18T00:15:58.5430204Z  2024-12-18T00:15:58.5430568Z  2024-12-18T00:15:58.5430938Z  2024-12-18T00:15:58.5431288Z  2024-12-18T00:15:58.5431670Z  2024-12-18T00:15:58.5432035Z  2024-12-18T00:15:58.5432383Z  2024-12-18T00:15:58.5432933Z [15,165 / 15,187] 21 actions running 2024-12-18T00:15:58.5433844Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2024-12-18T00:15:58.5434576Z Compiling torch_xla/csrc/ops/var_mean.cpp; 30s local 2024-12-18T00:15:58.5435306Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2024-12-18T00:15:58.5436017Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2024-12-18T00:15:58.5436715Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T00:15:58.5437390Z Compiling torch_xla/csrc/ops/svd.cpp; 28s local 2024-12-18T00:15:58.5438099Z Compiling torch_xla/csrc/ops/threshold.cpp; 27s local 2024-12-18T00:15:58.5438945Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 26s local ... 2024-12-18T00:15:58.9434889Z 2024-12-18T00:15:58.9435730Z  2024-12-18T00:15:58.9436175Z  2024-12-18T00:15:58.9436584Z  2024-12-18T00:15:58.9436963Z  2024-12-18T00:15:58.9437343Z  2024-12-18T00:15:58.9437715Z  2024-12-18T00:15:58.9438094Z  2024-12-18T00:15:58.9438510Z  2024-12-18T00:15:58.9439099Z [15,166 / 15,187] 20 actions running 2024-12-18T00:15:58.9439843Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local 2024-12-18T00:15:58.9440589Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2024-12-18T00:15:58.9441317Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2024-12-18T00:15:58.9442015Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T00:15:58.9442729Z Compiling torch_xla/csrc/ops/svd.cpp; 28s local 2024-12-18T00:15:58.9443450Z Compiling torch_xla/csrc/ops/threshold.cpp; 27s local 2024-12-18T00:15:58.9444554Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 27s local 2024-12-18T00:15:58.9445394Z Compiling torch_xla/csrc/ops/topk.cpp; 25s local ... 2024-12-18T00:15:59.3438738Z 2024-12-18T00:15:59.3439556Z  2024-12-18T00:15:59.3440028Z  2024-12-18T00:15:59.3440417Z  2024-12-18T00:15:59.3440787Z  2024-12-18T00:15:59.3441185Z  2024-12-18T00:15:59.3441572Z  2024-12-18T00:15:59.3441948Z  2024-12-18T00:15:59.3442378Z  2024-12-18T00:15:59.3442919Z [15,168 / 15,187] 18 actions running 2024-12-18T00:15:59.3443689Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local 2024-12-18T00:15:59.3444719Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T00:15:59.3445439Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2024-12-18T00:15:59.3446416Z Compiling torch_xla/csrc/ops/threshold.cpp; 28s local 2024-12-18T00:15:59.3447317Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 27s local 2024-12-18T00:15:59.3448181Z Compiling torch_xla/csrc/ops/topk.cpp; 26s local 2024-12-18T00:15:59.3449017Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 25s local 2024-12-18T00:15:59.3449977Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local ... 2024-12-18T00:15:59.7443924Z 2024-12-18T00:15:59.7444880Z  2024-12-18T00:15:59.7445243Z  2024-12-18T00:15:59.7445527Z  2024-12-18T00:15:59.7445806Z  2024-12-18T00:15:59.7446072Z  2024-12-18T00:15:59.7446371Z  2024-12-18T00:15:59.7446657Z  2024-12-18T00:15:59.7446936Z  2024-12-18T00:15:59.7447316Z [15,172 / 15,187] 14 actions running 2024-12-18T00:15:59.7447797Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T00:15:59.7448270Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2024-12-18T00:15:59.7448777Z Compiling torch_xla/csrc/ops/threshold.cpp; 28s local 2024-12-18T00:15:59.7449554Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local 2024-12-18T00:15:59.7450114Z Compiling torch_xla/csrc/ops/uniform.cpp; 21s local 2024-12-18T00:15:59.7450670Z Compiling torch_xla/csrc/ops/unselect.cpp; 20s local 2024-12-18T00:15:59.7451184Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 20s local 2024-12-18T00:15:59.7451748Z Compiling torch_xla/csrc/ops/update_slice.cpp; 19s local ... 2024-12-18T00:16:00.1447831Z 2024-12-18T00:16:00.1448502Z  2024-12-18T00:16:00.1448815Z  2024-12-18T00:16:00.1449074Z  2024-12-18T00:16:00.1449533Z  2024-12-18T00:16:00.1449801Z  2024-12-18T00:16:00.1450041Z  2024-12-18T00:16:00.1450266Z  2024-12-18T00:16:00.1450497Z  2024-12-18T00:16:00.1450841Z [15,174 / 15,187] 12 actions running 2024-12-18T00:16:00.1451268Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2024-12-18T00:16:00.1451746Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local 2024-12-18T00:16:00.1452219Z Compiling torch_xla/csrc/ops/uniform.cpp; 22s local 2024-12-18T00:16:00.1452662Z Compiling torch_xla/csrc/ops/unselect.cpp; 21s local 2024-12-18T00:16:00.1453122Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 20s local 2024-12-18T00:16:00.1453587Z Compiling torch_xla/csrc/ops/update_slice.cpp; 20s local 2024-12-18T00:16:00.1454095Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 17s local 2024-12-18T00:16:00.1454656Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 15s local ... 2024-12-18T00:16:00.5450723Z 2024-12-18T00:16:00.5451542Z  2024-12-18T00:16:00.5451968Z  2024-12-18T00:16:00.5452344Z  2024-12-18T00:16:00.5452715Z  2024-12-18T00:16:00.5453087Z  2024-12-18T00:16:00.5453436Z  2024-12-18T00:16:00.5453782Z  2024-12-18T00:16:00.5454143Z  2024-12-18T00:16:00.5454681Z [15,175 / 15,187] 11 actions running 2024-12-18T00:16:00.5455407Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 24s local 2024-12-18T00:16:00.5456207Z Compiling torch_xla/csrc/ops/uniform.cpp; 22s local 2024-12-18T00:16:00.5456972Z Compiling torch_xla/csrc/ops/unselect.cpp; 21s local 2024-12-18T00:16:00.5457676Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 21s local 2024-12-18T00:16:00.5458418Z Compiling torch_xla/csrc/ops/update_slice.cpp; 20s local 2024-12-18T00:16:00.5459217Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 18s local 2024-12-18T00:16:00.5460156Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 15s local 2024-12-18T00:16:00.5461107Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 15s local ... 2024-12-18T00:16:01.5459138Z 2024-12-18T00:16:01.5459812Z  2024-12-18T00:16:01.5460122Z  2024-12-18T00:16:01.5460367Z  2024-12-18T00:16:01.5460608Z  2024-12-18T00:16:01.5460850Z  2024-12-18T00:16:01.5461326Z  2024-12-18T00:16:01.5461562Z  2024-12-18T00:16:01.5461800Z  2024-12-18T00:16:01.5462148Z [15,175 / 15,187] 11 actions running 2024-12-18T00:16:01.5462620Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 25s local 2024-12-18T00:16:01.5463102Z Compiling torch_xla/csrc/ops/uniform.cpp; 23s local 2024-12-18T00:16:01.5463544Z Compiling torch_xla/csrc/ops/unselect.cpp; 22s local 2024-12-18T00:16:01.5463993Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 22s local 2024-12-18T00:16:01.5464468Z Compiling torch_xla/csrc/ops/update_slice.cpp; 21s local 2024-12-18T00:16:01.5464980Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 19s local 2024-12-18T00:16:01.5465548Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 16s local 2024-12-18T00:16:01.5466143Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 16s local ... 2024-12-18T00:16:02.3464094Z 2024-12-18T00:16:02.3464752Z  2024-12-18T00:16:02.3465065Z  2024-12-18T00:16:02.3465307Z  2024-12-18T00:16:02.3465564Z  2024-12-18T00:16:02.3465798Z  2024-12-18T00:16:02.3466232Z  2024-12-18T00:16:02.3466500Z  2024-12-18T00:16:02.3466740Z  2024-12-18T00:16:02.3467081Z [15,176 / 15,187] 10 actions running 2024-12-18T00:16:02.3468487Z Compiling torch_xla/csrc/ops/uniform.cpp; 24s local 2024-12-18T00:16:02.3468942Z Compiling torch_xla/csrc/ops/unselect.cpp; 23s local 2024-12-18T00:16:02.3469386Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 22s local 2024-12-18T00:16:02.3469856Z Compiling torch_xla/csrc/ops/update_slice.cpp; 22s local 2024-12-18T00:16:02.3470431Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 19s local 2024-12-18T00:16:02.3471014Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 17s local 2024-12-18T00:16:02.3471590Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 16s local 2024-12-18T00:16:02.3472143Z Compiling .../csrc/ops/upsample_nearest2d_backward.cpp; 16s local ... 2024-12-18T00:16:03.3471738Z 2024-12-18T00:16:03.3472377Z  2024-12-18T00:16:03.3472776Z  2024-12-18T00:16:03.3473061Z  2024-12-18T00:16:03.3473306Z  2024-12-18T00:16:03.3473546Z  2024-12-18T00:16:03.3473783Z  2024-12-18T00:16:03.3474020Z  2024-12-18T00:16:03.3474258Z  2024-12-18T00:16:03.3474607Z [15,176 / 15,187] 10 actions running 2024-12-18T00:16:03.3475048Z Compiling torch_xla/csrc/ops/uniform.cpp; 25s local 2024-12-18T00:16:03.3475484Z Compiling torch_xla/csrc/ops/unselect.cpp; 24s local 2024-12-18T00:16:03.3475947Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 23s local 2024-12-18T00:16:03.3476423Z Compiling torch_xla/csrc/ops/update_slice.cpp; 23s local 2024-12-18T00:16:03.3476939Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 20s local 2024-12-18T00:16:03.3477522Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 18s local 2024-12-18T00:16:03.3478108Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 17s local 2024-12-18T00:16:03.3478655Z Compiling .../csrc/ops/upsample_nearest2d_backward.cpp; 17s local ... 2024-12-18T00:16:04.3479591Z 2024-12-18T00:16:04.3480250Z  2024-12-18T00:16:04.3480558Z  2024-12-18T00:16:04.3480808Z  2024-12-18T00:16:04.3481049Z  2024-12-18T00:16:04.3481299Z  2024-12-18T00:16:04.3481535Z  2024-12-18T00:16:04.3481764Z  2024-12-18T00:16:04.3481982Z  2024-12-18T00:16:04.3482328Z [15,176 / 15,187] 10 actions running 2024-12-18T00:16:04.3482764Z Compiling torch_xla/csrc/ops/uniform.cpp; 26s local 2024-12-18T00:16:04.3483225Z Compiling torch_xla/csrc/ops/unselect.cpp; 25s local 2024-12-18T00:16:04.3483682Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 24s local 2024-12-18T00:16:04.3484134Z Compiling torch_xla/csrc/ops/update_slice.cpp; 24s local 2024-12-18T00:16:04.3484642Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 21s local 2024-12-18T00:16:04.3485520Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 19s local 2024-12-18T00:16:04.3486103Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 18s local 2024-12-18T00:16:04.3486654Z Compiling .../csrc/ops/upsample_nearest2d_backward.cpp; 18s local ... 2024-12-18T00:16:04.7484068Z 2024-12-18T00:16:04.7484741Z  2024-12-18T00:16:04.7485030Z  2024-12-18T00:16:04.7485273Z  2024-12-18T00:16:04.7485509Z  2024-12-18T00:16:04.7485742Z  2024-12-18T00:16:04.7485973Z  2024-12-18T00:16:04.7486190Z  2024-12-18T00:16:04.7486421Z  2024-12-18T00:16:04.7486770Z [15,177 / 15,187] 9 actions running 2024-12-18T00:16:04.7487202Z Compiling torch_xla/csrc/ops/uniform.cpp; 26s local 2024-12-18T00:16:04.7487640Z Compiling torch_xla/csrc/ops/unselect.cpp; 25s local 2024-12-18T00:16:04.7488108Z Compiling torch_xla/csrc/ops/update_slice.cpp; 24s local 2024-12-18T00:16:04.7488625Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 22s local 2024-12-18T00:16:04.7489219Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 19s local 2024-12-18T00:16:04.7490004Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 19s local 2024-12-18T00:16:04.7490663Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 18s local 2024-12-18T00:16:04.7491231Z Compiling torch_xla/csrc/ops/user_computation.cpp; 17s local ... 2024-12-18T00:16:05.3490771Z 2024-12-18T00:16:05.3491424Z  2024-12-18T00:16:05.3491779Z  2024-12-18T00:16:05.3492052Z  2024-12-18T00:16:05.3492294Z  2024-12-18T00:16:05.3492543Z  2024-12-18T00:16:05.3492794Z  2024-12-18T00:16:05.3493253Z  2024-12-18T00:16:05.3493500Z  2024-12-18T00:16:05.3493822Z [15,178 / 15,187] 8 actions running 2024-12-18T00:16:05.3494255Z Compiling torch_xla/csrc/ops/uniform.cpp; 27s local 2024-12-18T00:16:05.3494703Z Compiling torch_xla/csrc/ops/unselect.cpp; 26s local 2024-12-18T00:16:05.3495184Z Compiling torch_xla/csrc/ops/update_slice.cpp; 25s local 2024-12-18T00:16:05.3495739Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 20s local 2024-12-18T00:16:05.3496304Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 19s local 2024-12-18T00:16:05.3497003Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 19s local 2024-12-18T00:16:05.3497565Z Compiling torch_xla/csrc/ops/user_computation.cpp; 18s local 2024-12-18T00:16:05.3498027Z Compiling torch_xla/csrc/ops/var.cpp; 18s local 2024-12-18T00:16:06.3499676Z 2024-12-18T00:16:06.3500331Z  2024-12-18T00:16:06.3500655Z  2024-12-18T00:16:06.3500905Z  2024-12-18T00:16:06.3501158Z  2024-12-18T00:16:06.3501395Z  2024-12-18T00:16:06.3501629Z  2024-12-18T00:16:06.3501864Z  2024-12-18T00:16:06.3502091Z  2024-12-18T00:16:06.3502432Z [15,178 / 15,187] 8 actions running 2024-12-18T00:16:06.3502876Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2024-12-18T00:16:06.3503341Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local 2024-12-18T00:16:06.3503819Z Compiling torch_xla/csrc/ops/update_slice.cpp; 26s local 2024-12-18T00:16:06.3504360Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 21s local 2024-12-18T00:16:06.3504946Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 20s local 2024-12-18T00:16:06.3505511Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 20s local 2024-12-18T00:16:06.3506073Z Compiling torch_xla/csrc/ops/user_computation.cpp; 19s local 2024-12-18T00:16:06.3506536Z Compiling torch_xla/csrc/ops/var.cpp; 19s local 2024-12-18T00:16:06.7502628Z 2024-12-18T00:16:06.7503316Z  2024-12-18T00:16:06.7503630Z  2024-12-18T00:16:06.7503889Z  2024-12-18T00:16:06.7504150Z  2024-12-18T00:16:06.7504396Z  2024-12-18T00:16:06.7504640Z  2024-12-18T00:16:06.7504868Z  2024-12-18T00:16:06.7505106Z  2024-12-18T00:16:06.7505651Z [15,179 / 15,187] 7 actions running 2024-12-18T00:16:06.7506099Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2024-12-18T00:16:06.7506540Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local 2024-12-18T00:16:06.7507023Z Compiling torch_xla/csrc/ops/update_slice.cpp; 26s local 2024-12-18T00:16:06.7507582Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 21s local 2024-12-18T00:16:06.7508203Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 20s local 2024-12-18T00:16:06.7508772Z Compiling torch_xla/csrc/ops/user_computation.cpp; 19s local 2024-12-18T00:16:06.7509247Z Compiling torch_xla/csrc/ops/var.cpp; 19s local 2024-12-18T00:16:07.1505309Z 2024-12-18T00:16:07.1505961Z  2024-12-18T00:16:07.1506264Z  2024-12-18T00:16:07.1506491Z  2024-12-18T00:16:07.1506732Z  2024-12-18T00:16:07.1506969Z  2024-12-18T00:16:07.1507211Z  2024-12-18T00:16:07.1507438Z  2024-12-18T00:16:07.1507801Z [15,180 / 15,187] 6 actions running 2024-12-18T00:16:07.1508428Z Compiling torch_xla/csrc/ops/unselect.cpp; 28s local 2024-12-18T00:16:07.1508936Z Compiling torch_xla/csrc/ops/update_slice.cpp; 27s local 2024-12-18T00:16:07.1509555Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 22s local 2024-12-18T00:16:07.1510157Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 21s local 2024-12-18T00:16:07.1510723Z Compiling torch_xla/csrc/ops/user_computation.cpp; 19s local 2024-12-18T00:16:07.1511184Z Compiling torch_xla/csrc/ops/var.cpp; 19s local 2024-12-18T00:16:07.7510470Z 2024-12-18T00:16:07.7511385Z  2024-12-18T00:16:07.7511728Z  2024-12-18T00:16:07.7511974Z  2024-12-18T00:16:07.7512218Z  2024-12-18T00:16:07.7512459Z  2024-12-18T00:16:07.7512677Z  2024-12-18T00:16:07.7513009Z [15,181 / 15,187] 5 actions running 2024-12-18T00:16:07.7513467Z Compiling torch_xla/csrc/ops/update_slice.cpp; 27s local 2024-12-18T00:16:07.7514036Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 22s local 2024-12-18T00:16:07.7514652Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 21s local 2024-12-18T00:16:07.7515224Z Compiling torch_xla/csrc/ops/user_computation.cpp; 20s local 2024-12-18T00:16:07.7515672Z Compiling torch_xla/csrc/ops/var.cpp; 20s local 2024-12-18T00:16:08.1516089Z 2024-12-18T00:16:08.1516834Z  2024-12-18T00:16:08.1517136Z  2024-12-18T00:16:08.1517385Z  2024-12-18T00:16:08.1517627Z  2024-12-18T00:16:08.1517848Z  2024-12-18T00:16:08.1518198Z [15,184 / 15,187] 2 actions running 2024-12-18T00:16:08.1518681Z Compiling torch_xla/csrc/ops/user_computation.cpp; 20s local 2024-12-18T00:16:08.1519156Z Compiling torch_xla/csrc/ops/var.cpp; 20s local 2024-12-18T00:16:09.1522194Z 2024-12-18T00:16:09.1522880Z  2024-12-18T00:16:09.1523188Z  2024-12-18T00:16:09.1523537Z [15,184 / 15,187] 2 actions running 2024-12-18T00:16:09.1524012Z Compiling torch_xla/csrc/ops/user_computation.cpp; 21s local 2024-12-18T00:16:09.1524492Z Compiling torch_xla/csrc/ops/var.cpp; 21s local 2024-12-18T00:16:09.5530120Z 2024-12-18T00:16:09.5530968Z  2024-12-18T00:16:09.5531300Z  2024-12-18T00:16:09.5531777Z [15,185 / 15,187] Compiling torch_xla/csrc/ops/var.cpp; 22s local 2024-12-18T00:16:10.5537811Z 2024-12-18T00:16:10.5538656Z [15,185 / 15,187] Compiling torch_xla/csrc/ops/var.cpp; 23s local 2024-12-18T00:16:11.1248674Z 2024-12-18T00:16:11.1249470Z [15,186 / 15,187] [Prepa] Linking _XLAC.so 2024-12-18T00:16:11.3541236Z 2024-12-18T00:16:11.3541898Z [15,186 / 15,187] Linking _XLAC.so; 0s local 2024-12-18T00:16:12.3548068Z 2024-12-18T00:16:12.3548670Z [15,186 / 15,187] Linking _XLAC.so; 1s local 2024-12-18T00:16:13.5557415Z 2024-12-18T00:16:13.5558189Z [15,186 / 15,187] Linking _XLAC.so; 2s local 2024-12-18T00:16:14.5566854Z 2024-12-18T00:16:14.5567685Z [15,186 / 15,187] Linking _XLAC.so; 3s local 2024-12-18T00:16:15.5575260Z 2024-12-18T00:16:15.5576023Z [15,186 / 15,187] Linking _XLAC.so; 4s local 2024-12-18T00:16:16.5580973Z 2024-12-18T00:16:16.5581896Z [15,186 / 15,187] Linking _XLAC.so; 5s local 2024-12-18T00:16:17.5585072Z 2024-12-18T00:16:17.5585848Z [15,186 / 15,187] Linking _XLAC.so; 6s local 2024-12-18T00:16:18.7594514Z 2024-12-18T00:16:18.7595287Z [15,186 / 15,187] Linking _XLAC.so; 7s local 2024-12-18T00:16:19.7600930Z 2024-12-18T00:16:19.7601840Z [15,186 / 15,187] Linking _XLAC.so; 8s local 2024-12-18T00:16:20.9610271Z 2024-12-18T00:16:20.9611062Z [15,186 / 15,187] Linking _XLAC.so; 9s local 2024-12-18T00:16:22.1618868Z 2024-12-18T00:16:22.1619675Z [15,186 / 15,187] Linking _XLAC.so; 11s local 2024-12-18T00:16:22.5620522Z 2024-12-18T00:16:22.5621295Z [15,186 / 15,187] Linking _XLAC.so; 11s local 2024-12-18T00:16:23.5625333Z 2024-12-18T00:16:23.5626239Z [15,186 / 15,187] Linking _XLAC.so; 12s local 2024-12-18T00:16:24.4864080Z 2024-12-18T00:16:24.4864956Z Target //:_XLAC.so up-to-date: 2024-12-18T00:16:24.4865449Z [15,187 / 15,187] checking cached actions 2024-12-18T00:16:24.4866039Z 2024-12-18T00:16:24.4866434Z  build/temp.linux-x86_64-cpython-310/bazel-bin/_XLAC.so 2024-12-18T00:16:24.4866947Z [15,187 / 15,187] checking cached actions 2024-12-18T00:16:24.5864110Z 2024-12-18T00:16:24.5865124Z INFO: Elapsed time: 878.473s, Critical Path: 215.19s 2024-12-18T00:16:24.5865717Z [15,187 / 15,187] checking cached actions 2024-12-18T00:16:24.5865964Z 2024-12-18T00:16:24.5866216Z INFO: 15187 processes: 9038 internal, 6149 local. 2024-12-18T00:16:24.5866710Z [15,187 / 15,187] checking cached actions 2024-12-18T00:16:24.5866983Z 2024-12-18T00:16:24.5867259Z INFO: Build completed successfully, 15187 total actions 2024-12-18T00:16:24.7509924Z bazel build //:_XLAC_cuda_functions.so --symlink_prefix=build/temp.linux-x86_64-cpython-310/bazel- --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=1 --remote_default_exec_properties=cache-silo-key=dev 2024-12-18T00:16:24.7870127Z INFO: Options provided by the client: 2024-12-18T00:16:24.7870620Z Inherited 'common' options: --isatty=1 --terminal_columns=0 2024-12-18T00:16:24.7872472Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2024-12-18T00:16:24.7873114Z Inherited 'common' options: --experimental_repo_remote_exec 2024-12-18T00:16:24.7873803Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2024-12-18T00:16:24.7877544Z 'build' options: --announce_rc --nocheck_visibility --enable_platform_specific_config --experimental_cc_shared_library --define=no_aws_support=true --define=no_hdfs_support=true --define=no_hdfs_support=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true -c opt --config=short_logs --action_env=CC=gcc --action_env=CXX=g++ --spawn_strategy=standalone --incompatible_strict_action_env --noremote_upload_local_results --java_runtime_version=remotejdk_11 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --define framework_shared_object=false --define tsl_protobuf_header_only=false --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --define=with_xla_support=true --noincompatible_remove_legacy_whole_archive --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility 2024-12-18T00:16:24.7881778Z INFO: Found applicable config definition build:short_logs in file /var/lib/jenkins/workspace/xla/.bazelrc: --output_filter=DONT_MATCH_ANYTHING 2024-12-18T00:16:24.7885737Z INFO: Found applicable config definition build:linux in file /var/lib/jenkins/workspace/xla/.bazelrc: --config=posix --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --define=build_with_onednn_v2=true --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable 2024-12-18T00:16:24.7889606Z INFO: Found applicable config definition build:posix in file /var/lib/jenkins/workspace/xla/.bazelrc: --copt=-Wno-sign-compare --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 2024-12-18T00:16:24.7891283Z INFO: Found applicable config definition build:dynamic_kernels in file /var/lib/jenkins/workspace/xla/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS 2024-12-18T00:16:25.1105743Z Loading: 2024-12-18T00:16:25.7594357Z 2024-12-18T00:16:25.7595420Z Loading: 2024-12-18T00:16:25.7595993Z Fetching repository @torch; starting 2024-12-18T00:16:25.7723568Z 2024-12-18T00:16:25.7724231Z  2024-12-18T00:16:25.7725426Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:154:14: 2024-12-18T00:16:25.7726380Z HERMETIC_PYTHON_VERSION variable was not set correctly, using default version. 2024-12-18T00:16:25.7726877Z Python 3.10 will be used. 2024-12-18T00:16:25.7727376Z To select Python version, either set HERMETIC_PYTHON_VERSION env variable in 2024-12-18T00:16:25.7727832Z your shell: 2024-12-18T00:16:25.7728095Z export HERMETIC_PYTHON_VERSION=3.12 2024-12-18T00:16:25.7728548Z OR pass it as an argument to bazel command directly or inside your .bazelrc 2024-12-18T00:16:25.7729087Z file: 2024-12-18T00:16:25.7729422Z --repo_env=HERMETIC_PYTHON_VERSION=3.12 2024-12-18T00:16:25.7730126Z Loading: 2024-12-18T00:16:25.7730471Z Fetching repository @python_version_repo; starting 2024-12-18T00:16:25.7730786Z 2024-12-18T00:16:25.7730903Z  2024-12-18T00:16:25.7731724Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:87:10: 2024-12-18T00:16:25.7732501Z ============================= 2024-12-18T00:16:25.7732792Z Hermetic Python configuration: 2024-12-18T00:16:25.7733094Z Version: "3.10" 2024-12-18T00:16:25.7733336Z Kind: "" 2024-12-18T00:16:25.7733617Z Interpreter: "default" (provided by rules_python) 2024-12-18T00:16:25.7734144Z Requirements_lock label: "@python_version_repo//:requirements_lock_3_10.txt" 2024-12-18T00:16:25.7734605Z ===================================== 2024-12-18T00:16:25.7734944Z Loading: 2024-12-18T00:16:25.7735258Z Fetching repository @python_version_repo; starting 2024-12-18T00:16:25.8007645Z 2024-12-18T00:16:25.8008387Z  2024-12-18T00:16:25.8008965Z Loading: 2024-12-18T00:16:25.8009287Z 2024-12-18T00:16:25.8009634Z Loading: 0 packages loaded 2024-12-18T00:16:25.8159011Z 2024-12-18T00:16:25.8159869Z Analyzing: target //:_XLAC_cuda_functions.so (0 packages loaded, 0 targets con\ 2024-12-18T00:16:25.8160420Z figured) 2024-12-18T00:16:26.1116780Z 2024-12-18T00:16:26.1117460Z  2024-12-18T00:16:26.1118527Z Analyzing: target //:_XLAC_cuda_functions.so (1 packages loaded, 8625 targets \ 2024-12-18T00:16:26.1119062Z configured) 2024-12-18T00:16:26.1832958Z 2024-12-18T00:16:26.1833661Z  2024-12-18T00:16:26.1834402Z INFO: Analyzed target //:_XLAC_cuda_functions.so (1 packages loaded, 8628 targets configured). 2024-12-18T00:16:26.1835048Z  checking cached actions 2024-12-18T00:16:26.1835248Z 2024-12-18T00:16:26.1835411Z INFO: Found 1 target... 2024-12-18T00:16:26.1835783Z  checking cached actions 2024-12-18T00:16:26.5128697Z 2024-12-18T00:16:26.5130441Z  checking cached actions 2024-12-18T00:16:26.7800638Z 2024-12-18T00:16:26.7801540Z [0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2024-12-18T00:16:27.1130359Z 2024-12-18T00:16:27.1131607Z [7,946 / 8,790] checking cached actions 2024-12-18T00:16:27.3132236Z 2024-12-18T00:16:27.3133325Z [8,788 / 8,790] Compiling torch_xla/csrc/aten_cuda_functions.cpp; 0s local 2024-12-18T00:16:28.3139678Z 2024-12-18T00:16:28.3140675Z [8,788 / 8,790] Compiling torch_xla/csrc/aten_cuda_functions.cpp; 1s local 2024-12-18T00:16:29.5145864Z 2024-12-18T00:16:29.5146941Z [8,788 / 8,790] Compiling torch_xla/csrc/aten_cuda_functions.cpp; 2s local 2024-12-18T00:16:30.1761775Z 2024-12-18T00:16:30.1762604Z [8,789 / 8,790] [Prepa] Linking _XLAC_cuda_functions.so 2024-12-18T00:16:30.2145351Z 2024-12-18T00:16:30.2148288Z Target //:_XLAC_cuda_functions.so up-to-date: 2024-12-18T00:16:30.2148814Z [8,790 / 8,790] checking cached actions 2024-12-18T00:16:30.2149170Z 2024-12-18T00:16:30.2149664Z  build/temp.linux-x86_64-cpython-310/bazel-bin/_XLAC_cuda_functions.so 2024-12-18T00:16:30.2150246Z [8,790 / 8,790] checking cached actions 2024-12-18T00:16:30.3265683Z 2024-12-18T00:16:30.3266700Z INFO: Elapsed time: 5.560s, Critical Path: 3.02s 2024-12-18T00:16:30.3267252Z [8,790 / 8,790] checking cached actions 2024-12-18T00:16:30.3267501Z 2024-12-18T00:16:30.3267732Z INFO: 6 processes: 4 internal, 2 local. 2024-12-18T00:16:30.3268364Z [8,790 / 8,790] checking cached actions 2024-12-18T00:16:30.3275270Z 2024-12-18T00:16:30.3275676Z INFO: Build completed successfully, 6 total actions 2024-12-18T00:16:30.4236126Z creating build/bdist.linux-x86_64 2024-12-18T00:16:30.4236971Z creating build/bdist.linux-x86_64/egg 2024-12-18T00:16:30.4237418Z creating build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4238122Z copying build/lib.linux-x86_64-cpython-310/torch_xla/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4250498Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_patched_functions.py -> build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4254350Z copying build/lib.linux-x86_64-cpython-310/torch_xla/runtime.py -> build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4258767Z copying build/lib.linux-x86_64-cpython-310/torch_xla/stablehlo.py -> build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4264045Z copying build/lib.linux-x86_64-cpython-310/torch_xla/tf_saved_model_integration.py -> build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4268146Z copying build/lib.linux-x86_64-cpython-310/torch_xla/torch_xla.py -> build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4272661Z copying build/lib.linux-x86_64-cpython-310/torch_xla/version.py -> build/bdist.linux-x86_64/egg/torch_xla 2024-12-18T00:16:30.4276988Z creating build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2024-12-18T00:16:30.4277976Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2024-12-18T00:16:30.4282820Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo/config.py -> build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2024-12-18T00:16:30.4305858Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo/dynamo_bridge.py -> build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2024-12-18T00:16:30.4314772Z creating build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4315889Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4316950Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/c10d_registration.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4321871Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/custom_kernel.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4331085Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/decomp_registration.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4335257Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/gpu.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4343346Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/neuron.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4375253Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/neuron_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4384442Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/pjrt.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4395981Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/rendezvous.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4399115Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/tpu.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4418371Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/utils.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4425334Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/xpu.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2024-12-18T00:16:30.4433286Z creating build/bdist.linux-x86_64/egg/torch_xla/amp 2024-12-18T00:16:30.4436017Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/amp 2024-12-18T00:16:30.4442614Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/autocast_mode.py -> build/bdist.linux-x86_64/egg/torch_xla/amp 2024-12-18T00:16:30.4446798Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/grad_scaler.py -> build/bdist.linux-x86_64/egg/torch_xla/amp 2024-12-18T00:16:30.4450946Z creating build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2024-12-18T00:16:30.4451956Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2024-12-18T00:16:30.4455828Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/_functional.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2024-12-18T00:16:30.4460353Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/adam.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2024-12-18T00:16:30.4468010Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/adamw.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2024-12-18T00:16:30.4471771Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/sgd.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2024-12-18T00:16:30.4476396Z creating build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4477426Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4478539Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/dynamo_bridge.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4482947Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/functions.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4487758Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_builder.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4497069Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_env_vars.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4503537Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_model.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4529521Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_op_registry.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2024-12-18T00:16:30.4530300Z creating build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4531145Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4532149Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/frame_parser_util.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4536180Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/graph_saver.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4541720Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/metrics.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4546834Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/metrics_compare_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4551948Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/metrics_saver.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4560804Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/model_comparator.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4564717Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/profiler.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2024-12-18T00:16:30.4570028Z creating build/bdist.linux-x86_64/egg/torch_xla/distributed 2024-12-18T00:16:30.4570998Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2024-12-18T00:16:30.4572357Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/data_parallel.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2024-12-18T00:16:30.4576699Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/parallel_loader.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2024-12-18T00:16:30.4581562Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/xla_backend.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2024-12-18T00:16:30.4586302Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/xla_multiprocessing.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2024-12-18T00:16:30.4594863Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/zero_redundancy_optimizer.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2024-12-18T00:16:30.4600574Z creating build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4601541Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4606689Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/_init_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4611587Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/consolidate_sharded_ckpts.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4615808Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/state_dict_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4620275Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/utils.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4624840Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/wrap.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4631079Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/xla_flatten_params_wrapper.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4658701Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/xla_fully_sharded_data_parallel.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2024-12-18T00:16:30.4675893Z creating build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2024-12-18T00:16:30.4676882Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2024-12-18T00:16:30.4695341Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/api.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2024-12-18T00:16:30.4696661Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/debugging.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2024-12-18T00:16:30.4701545Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/xla_sharded_tensor.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2024-12-18T00:16:30.4705773Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/xla_sharding.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2024-12-18T00:16:30.4717480Z creating build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4720193Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4724852Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/callback.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4729766Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/custom_kernel.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4739627Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/deprecation.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4743866Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/dynamo_mark_sharding.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4749336Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/dynamo_set_buffer_donor.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4753214Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/eager.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4757471Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/fori_loop.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4762871Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/mark_pattern_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4767237Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pjrt_backend.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4774937Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/plugins.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4780414Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pytreeify.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4784713Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/quantized.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4789319Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/scan.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4798359Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/scan_layers.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4827237Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/spmd_fully_sharded_data_parallel.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4844528Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/stablehlo_custom_call.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4845702Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/triton.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4850176Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/unbounded_dynamism_export.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4859667Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_dynamic_reshape_ops.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4862845Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_marker.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4866738Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_mlir_debuginfo.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4870490Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_quantized_matmul.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2024-12-18T00:16:30.4892735Z creating build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:16:30.4893915Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:16:30.4897807Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/_helpers.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:16:30.4902698Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/manager.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:16:30.4907727Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/planners.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:16:30.4912342Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/util.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2024-12-18T00:16:30.4935613Z creating build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels 2024-12-18T00:16:30.4936775Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels 2024-12-18T00:16:30.4938267Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels/multi_queries_paged_attention_kernel.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels 2024-12-18T00:16:30.4946934Z creating build/bdist.linux-x86_64/egg/torch_xla/test 2024-12-18T00:16:30.4949334Z copying build/lib.linux-x86_64-cpython-310/torch_xla/test/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/test 2024-12-18T00:16:30.4950401Z copying build/lib.linux-x86_64-cpython-310/torch_xla/test/test_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/test 2024-12-18T00:16:30.4957650Z creating build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.4958596Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.4959634Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/checkpoint.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.4965450Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/checkpoint_tagger.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.4969345Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/closures.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.4995997Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/dlpack.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.4997281Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/keyd_queue.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.5001517Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/serialization.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.5008532Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/stablehlo_test_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.5024834Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/utils.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2024-12-18T00:16:30.5035648Z copying build/lib.linux-x86_64-cpython-310/_XLAC.cpython-310-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/egg 2024-12-18T00:16:30.7379560Z copying build/lib.linux-x86_64-cpython-310/_XLAC_cuda_functions.cpython-310-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/egg 2024-12-18T00:16:30.7381999Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7402900Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_patched_functions.py to _patched_functions.cpython-310.pyc 2024-12-18T00:16:30.7405171Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/runtime.py to runtime.cpython-310.pyc 2024-12-18T00:16:30.7417405Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/stablehlo.py to stablehlo.cpython-310.pyc 2024-12-18T00:16:30.7454238Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/tf_saved_model_integration.py to tf_saved_model_integration.cpython-310.pyc 2024-12-18T00:16:30.7463875Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/torch_xla.py to torch_xla.cpython-310.pyc 2024-12-18T00:16:30.7472044Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/version.py to version.cpython-310.pyc 2024-12-18T00:16:30.7474296Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_dynamo/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7475949Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_dynamo/config.py to config.cpython-310.pyc 2024-12-18T00:16:30.7477773Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_dynamo/dynamo_bridge.py to dynamo_bridge.cpython-310.pyc 2024-12-18T00:16:30.7519169Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7520297Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/c10d_registration.py to c10d_registration.cpython-310.pyc 2024-12-18T00:16:30.7521301Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/custom_kernel.py to custom_kernel.cpython-310.pyc 2024-12-18T00:16:30.7524935Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/decomp_registration.py to decomp_registration.cpython-310.pyc 2024-12-18T00:16:30.7527028Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/gpu.py to gpu.cpython-310.pyc 2024-12-18T00:16:30.7529777Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/neuron.py to neuron.cpython-310.pyc 2024-12-18T00:16:30.7538275Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/neuron_utils.py to neuron_utils.cpython-310.pyc 2024-12-18T00:16:30.7543119Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/pjrt.py to pjrt.cpython-310.pyc 2024-12-18T00:16:30.7554516Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/rendezvous.py to rendezvous.cpython-310.pyc 2024-12-18T00:16:30.7559573Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/tpu.py to tpu.cpython-310.pyc 2024-12-18T00:16:30.7578994Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/utils.py to utils.cpython-310.pyc 2024-12-18T00:16:30.7579811Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/xpu.py to xpu.cpython-310.pyc 2024-12-18T00:16:30.7581176Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7583140Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/autocast_mode.py to autocast_mode.cpython-310.pyc 2024-12-18T00:16:30.7589202Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/grad_scaler.py to grad_scaler.cpython-310.pyc 2024-12-18T00:16:30.7594762Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7596880Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/_functional.py to _functional.cpython-310.pyc 2024-12-18T00:16:30.7601419Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/adam.py to adam.cpython-310.pyc 2024-12-18T00:16:30.7606913Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/adamw.py to adamw.cpython-310.pyc 2024-12-18T00:16:30.7612792Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/sgd.py to sgd.cpython-310.pyc 2024-12-18T00:16:30.7618232Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7620094Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/dynamo_bridge.py to dynamo_bridge.cpython-310.pyc 2024-12-18T00:16:30.7621827Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/functions.py to functions.cpython-310.pyc 2024-12-18T00:16:30.7632646Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_builder.py to xla_builder.cpython-310.pyc 2024-12-18T00:16:30.7676501Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_env_vars.py to xla_env_vars.cpython-310.pyc 2024-12-18T00:16:30.7677424Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_model.py to xla_model.cpython-310.pyc 2024-12-18T00:16:30.7739103Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_op_registry.py to xla_op_registry.cpython-310.pyc 2024-12-18T00:16:30.7740274Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7742299Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/frame_parser_util.py to frame_parser_util.cpython-310.pyc 2024-12-18T00:16:30.7747856Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/graph_saver.py to graph_saver.cpython-310.pyc 2024-12-18T00:16:30.7751379Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/metrics.py to metrics.cpython-310.pyc 2024-12-18T00:16:30.7755500Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/metrics_compare_utils.py to metrics_compare_utils.cpython-310.pyc 2024-12-18T00:16:30.7764767Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/metrics_saver.py to metrics_saver.cpython-310.pyc 2024-12-18T00:16:30.7769457Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/model_comparator.py to model_comparator.cpython-310.pyc 2024-12-18T00:16:30.7781083Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/profiler.py to profiler.cpython-310.pyc 2024-12-18T00:16:30.7788122Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7790277Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/data_parallel.py to data_parallel.cpython-310.pyc 2024-12-18T00:16:30.7799222Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/parallel_loader.py to parallel_loader.cpython-310.pyc 2024-12-18T00:16:30.7816862Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/xla_backend.py to xla_backend.cpython-310.pyc 2024-12-18T00:16:30.7836703Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/xla_multiprocessing.py to xla_multiprocessing.cpython-310.pyc 2024-12-18T00:16:30.7837907Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/zero_redundancy_optimizer.py to zero_redundancy_optimizer.cpython-310.pyc 2024-12-18T00:16:30.7862138Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7864183Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/_init_utils.py to _init_utils.cpython-310.pyc 2024-12-18T00:16:30.7869892Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/consolidate_sharded_ckpts.py to consolidate_sharded_ckpts.cpython-310.pyc 2024-12-18T00:16:30.7872941Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/state_dict_utils.py to state_dict_utils.cpython-310.pyc 2024-12-18T00:16:30.7882933Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/utils.py to utils.cpython-310.pyc 2024-12-18T00:16:30.7898377Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/wrap.py to wrap.cpython-310.pyc 2024-12-18T00:16:30.7903432Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/xla_flatten_params_wrapper.py to xla_flatten_params_wrapper.cpython-310.pyc 2024-12-18T00:16:30.7934660Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/xla_fully_sharded_data_parallel.py to xla_fully_sharded_data_parallel.cpython-310.pyc 2024-12-18T00:16:30.7991452Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.7992401Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/api.py to api.cpython-310.pyc 2024-12-18T00:16:30.8002048Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/debugging.py to debugging.cpython-310.pyc 2024-12-18T00:16:30.8012048Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/xla_sharded_tensor.py to xla_sharded_tensor.cpython-310.pyc 2024-12-18T00:16:30.8021372Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/xla_sharding.py to xla_sharding.cpython-310.pyc 2024-12-18T00:16:30.8054340Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.8056118Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/callback.py to callback.cpython-310.pyc 2024-12-18T00:16:30.8059307Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/custom_kernel.py to custom_kernel.cpython-310.pyc 2024-12-18T00:16:30.8103921Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/deprecation.py to deprecation.cpython-310.pyc 2024-12-18T00:16:30.8107944Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/dynamo_mark_sharding.py to dynamo_mark_sharding.cpython-310.pyc 2024-12-18T00:16:30.8110206Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/dynamo_set_buffer_donor.py to dynamo_set_buffer_donor.cpython-310.pyc 2024-12-18T00:16:30.8111988Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/eager.py to eager.cpython-310.pyc 2024-12-18T00:16:30.8115215Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/fori_loop.py to fori_loop.cpython-310.pyc 2024-12-18T00:16:30.8123731Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/mark_pattern_utils.py to mark_pattern_utils.cpython-310.pyc 2024-12-18T00:16:30.8128523Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pjrt_backend.py to pjrt_backend.cpython-310.pyc 2024-12-18T00:16:30.8131115Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/plugins.py to plugins.cpython-310.pyc 2024-12-18T00:16:30.8136569Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pytreeify.py to pytreeify.cpython-310.pyc 2024-12-18T00:16:30.8141222Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/quantized.py to quantized.cpython-310.pyc 2024-12-18T00:16:30.8148860Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/scan.py to scan.cpython-310.pyc 2024-12-18T00:16:30.8178381Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/scan_layers.py to scan_layers.cpython-310.pyc 2024-12-18T00:16:30.8182272Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/spmd_fully_sharded_data_parallel.py to spmd_fully_sharded_data_parallel.cpython-310.pyc 2024-12-18T00:16:30.8191399Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/stablehlo_custom_call.py to stablehlo_custom_call.cpython-310.pyc 2024-12-18T00:16:30.8197220Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/triton.py to triton.cpython-310.pyc 2024-12-18T00:16:30.8208009Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/unbounded_dynamism_export.py to unbounded_dynamism_export.cpython-310.pyc 2024-12-18T00:16:30.8233973Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_dynamic_reshape_ops.py to xla_dynamic_reshape_ops.cpython-310.pyc 2024-12-18T00:16:30.8235106Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_marker.py to xla_marker.cpython-310.pyc 2024-12-18T00:16:30.8241776Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_mlir_debuginfo.py to xla_mlir_debuginfo.cpython-310.pyc 2024-12-18T00:16:30.8245456Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_quantized_matmul.py to xla_quantized_matmul.cpython-310.pyc 2024-12-18T00:16:30.8258748Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.8260840Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/_helpers.py to _helpers.cpython-310.pyc 2024-12-18T00:16:30.8279143Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/manager.py to manager.cpython-310.pyc 2024-12-18T00:16:30.8288367Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/planners.py to planners.cpython-310.pyc 2024-12-18T00:16:30.8306361Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/util.py to util.cpython-310.pyc 2024-12-18T00:16:30.8309745Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.8311943Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels/multi_queries_paged_attention_kernel.py to multi_queries_paged_attention_kernel.cpython-310.pyc 2024-12-18T00:16:30.8339048Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/test/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.8340237Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/test/test_utils.py to test_utils.cpython-310.pyc 2024-12-18T00:16:30.8348035Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/__init__.py to __init__.cpython-310.pyc 2024-12-18T00:16:30.8349513Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/checkpoint.py to checkpoint.cpython-310.pyc 2024-12-18T00:16:30.8362943Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/checkpoint_tagger.py to checkpoint_tagger.cpython-310.pyc 2024-12-18T00:16:30.8365226Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/closures.py to closures.cpython-310.pyc 2024-12-18T00:16:30.8370829Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/dlpack.py to dlpack.cpython-310.pyc 2024-12-18T00:16:30.8375653Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/keyd_queue.py to keyd_queue.cpython-310.pyc 2024-12-18T00:16:30.8382573Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/serialization.py to serialization.cpython-310.pyc 2024-12-18T00:16:30.8388379Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/stablehlo_test_utils.py to stablehlo_test_utils.cpython-310.pyc 2024-12-18T00:16:30.8393967Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/utils.py to utils.cpython-310.pyc 2024-12-18T00:16:30.8419252Z creating stub loader for _XLAC.cpython-310-x86_64-linux-gnu.so 2024-12-18T00:16:30.8419885Z creating stub loader for _XLAC_cuda_functions.cpython-310-x86_64-linux-gnu.so 2024-12-18T00:16:30.8421001Z byte-compiling build/bdist.linux-x86_64/egg/_XLAC.py to _XLAC.cpython-310.pyc 2024-12-18T00:16:30.8424186Z byte-compiling build/bdist.linux-x86_64/egg/_XLAC_cuda_functions.py to _XLAC_cuda_functions.cpython-310.pyc 2024-12-18T00:16:30.8426625Z creating build/bdist.linux-x86_64/egg/EGG-INFO 2024-12-18T00:16:30.8427911Z copying torch_xla.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO 2024-12-18T00:16:30.8438354Z copying torch_xla.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2024-12-18T00:16:30.8442488Z copying torch_xla.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2024-12-18T00:16:30.8447365Z copying torch_xla.egg-info/entry_points.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2024-12-18T00:16:30.8448429Z copying torch_xla.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2024-12-18T00:16:30.8455713Z copying torch_xla.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2024-12-18T00:16:30.8460345Z writing build/bdist.linux-x86_64/egg/EGG-INFO/native_libs.txt 2024-12-18T00:16:30.8461237Z zip_safe flag not set; analyzing archive contents... 2024-12-18T00:16:30.8462760Z __pycache__._XLAC.cpython-310: module references __file__ 2024-12-18T00:16:30.8463432Z __pycache__._XLAC_cuda_functions.cpython-310: module references __file__ 2024-12-18T00:16:30.8467457Z torch_xla.__pycache__.__init__.cpython-310: module references __file__ 2024-12-18T00:16:30.8469296Z torch_xla.__pycache__._patched_functions.cpython-310: module MAY be using inspect.stack 2024-12-18T00:16:30.8521768Z torch_xla.amp.__pycache__.grad_scaler.cpython-310: module MAY be using inspect.stack 2024-12-18T00:16:30.8574091Z torch_xla.debug.__pycache__.model_comparator.cpython-310: module references __file__ 2024-12-18T00:16:30.8733073Z creating dist 2024-12-18T00:16:30.8734152Z creating 'dist/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg' and adding 'build/bdist.linux-x86_64/egg' to it 2024-12-18T00:16:43.3339463Z removing 'build/bdist.linux-x86_64/egg' (and everything under it) 2024-12-18T00:16:43.3736309Z Processing torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg 2024-12-18T00:16:43.3767231Z creating /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg 2024-12-18T00:16:43.3768142Z Extracting torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg to /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.1885798Z Adding torch-xla 2.6.0+gitcfe54bf to easy-install.pth file 2024-12-18T00:16:45.1888872Z Installing stablehlo-to-saved-model script to /opt/conda/bin 2024-12-18T00:16:45.1890081Z 2024-12-18T00:16:45.1890480Z Installed /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg 2024-12-18T00:16:45.1894350Z Processing dependencies for torch-xla==2.6.0+gitcfe54bf 2024-12-18T00:16:45.1999581Z Searching for requests==2.32.3 2024-12-18T00:16:45.1999925Z Best match: requests 2.32.3 2024-12-18T00:16:45.2000272Z Adding requests 2.32.3 to easy-install.pth file 2024-12-18T00:16:45.2000775Z detected new path './torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg' 2024-12-18T00:16:45.2019079Z 2024-12-18T00:16:45.2019322Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2020744Z Searching for PyYAML==6.0.2 2024-12-18T00:16:45.2021719Z Best match: PyYAML 6.0.2 2024-12-18T00:16:45.2022709Z Adding PyYAML 6.0.2 to easy-install.pth file 2024-12-18T00:16:45.2028427Z 2024-12-18T00:16:45.2028572Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2031950Z Searching for numpy==2.0.2 2024-12-18T00:16:45.2032671Z Best match: numpy 2.0.2 2024-12-18T00:16:45.2033436Z Adding numpy 2.0.2 to easy-install.pth file 2024-12-18T00:16:45.2040139Z Installing f2py script to /opt/conda/bin 2024-12-18T00:16:45.2042283Z Installing numpy-config script to /opt/conda/bin 2024-12-18T00:16:45.2043565Z 2024-12-18T00:16:45.2043706Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2047289Z Searching for absl-py==2.1.0 2024-12-18T00:16:45.2048072Z Best match: absl-py 2.1.0 2024-12-18T00:16:45.2048739Z Adding absl-py 2.1.0 to easy-install.pth file 2024-12-18T00:16:45.2054441Z 2024-12-18T00:16:45.2054608Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2057898Z Searching for certifi==2024.12.14 2024-12-18T00:16:45.2058670Z Best match: certifi 2024.12.14 2024-12-18T00:16:45.2059331Z Adding certifi 2024.12.14 to easy-install.pth file 2024-12-18T00:16:45.2064821Z 2024-12-18T00:16:45.2064968Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2068031Z Searching for urllib3==1.26.20 2024-12-18T00:16:45.2068943Z Best match: urllib3 1.26.20 2024-12-18T00:16:45.2069785Z Adding urllib3 1.26.20 to easy-install.pth file 2024-12-18T00:16:45.2075038Z 2024-12-18T00:16:45.2075203Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2078175Z Searching for idna==3.7 2024-12-18T00:16:45.2078991Z Best match: idna 3.7 2024-12-18T00:16:45.2079620Z Adding idna 3.7 to easy-install.pth file 2024-12-18T00:16:45.2085091Z 2024-12-18T00:16:45.2085243Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2088316Z Searching for charset-normalizer==3.3.2 2024-12-18T00:16:45.2089147Z Best match: charset-normalizer 3.3.2 2024-12-18T00:16:45.2089816Z Adding charset-normalizer 3.3.2 to easy-install.pth file 2024-12-18T00:16:45.2095919Z Installing normalizer script to /opt/conda/bin 2024-12-18T00:16:45.2097731Z 2024-12-18T00:16:45.2097883Z Using /opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.2099118Z Finished processing dependencies for torch-xla==2.6.0+gitcfe54bf 2024-12-18T00:16:45.4733805Z + popd 2024-12-18T00:16:45.4734120Z /var/lib/jenkins/workspace 2024-12-18T00:16:45.4734473Z + assert_git_not_dirty 2024-12-18T00:16:45.4734826Z + [[ linux-focal-py3.9-clang9-xla != *rocm* ]] 2024-12-18T00:16:45.4735233Z + [[ linux-focal-py3.9-clang9-xla != *xla* ]] 2024-12-18T00:16:45.4735594Z + test_xla 2024-12-18T00:16:45.4736729Z ++ dirname .ci/pytorch/test.sh 2024-12-18T00:16:45.4772641Z + source .ci/pytorch/common-build.sh 2024-12-18T00:16:45.4773145Z ++ [[ linux-focal-py3.9-clang9-xla != *win-* ]] 2024-12-18T00:16:45.4777863Z ++++ dirname .ci/pytorch/common-build.sh 2024-12-18T00:16:45.4787381Z +++ cd .ci/pytorch 2024-12-18T00:16:45.4788161Z +++ pwd -P 2024-12-18T00:16:45.4790230Z ++ script_dir=/var/lib/jenkins/workspace/.ci/pytorch 2024-12-18T00:16:45.4790746Z ++ [[ linux-focal-py3.9-clang9-xla == *-pch* ]] 2024-12-18T00:16:45.4791102Z ++ which sccache 2024-12-18T00:16:45.4808222Z ++ sccache --stop-server 2024-12-18T00:16:45.4915628Z ++ rm -f /home/jenkins/sccache_error.log 2024-12-18T00:16:45.4938849Z ++ trap_add sccache_epilogue EXIT 2024-12-18T00:16:45.4939214Z ++ trap_add_cmd=sccache_epilogue 2024-12-18T00:16:45.4939519Z ++ shift 2024-12-18T00:16:45.4939931Z ++ for trap_add_name in "$@" 2024-12-18T00:16:45.4947067Z ++++ trap -p EXIT 2024-12-18T00:16:45.4949918Z +++ eval 'extract_trap_cmd trap -- '\'' 2024-12-18T00:16:45.4950249Z cleanup_workspace 2024-12-18T00:16:45.4950510Z sccache_epilogue 2024-12-18T00:16:45.4950772Z ccache_epilogue'\'' EXIT' 2024-12-18T00:16:45.4951067Z ++++ extract_trap_cmd trap -- ' 2024-12-18T00:16:45.4951378Z cleanup_workspace 2024-12-18T00:16:45.4951617Z sccache_epilogue 2024-12-18T00:16:45.4951875Z ccache_epilogue' EXIT 2024-12-18T00:16:45.4952148Z ++++ printf '%s\n' ' 2024-12-18T00:16:45.4952411Z cleanup_workspace 2024-12-18T00:16:45.4952705Z sccache_epilogue 2024-12-18T00:16:45.4952942Z ccache_epilogue' 2024-12-18T00:16:45.4953208Z +++ printf '%s\n' sccache_epilogue 2024-12-18T00:16:45.4953523Z ++ trap -- ' 2024-12-18T00:16:45.4953762Z cleanup_workspace 2024-12-18T00:16:45.4954022Z sccache_epilogue 2024-12-18T00:16:45.4954274Z ccache_epilogue 2024-12-18T00:16:45.4954517Z sccache_epilogue' EXIT 2024-12-18T00:16:45.4954792Z ++ [[ -n 1 ]] 2024-12-18T00:16:45.4955209Z ++ echo 'Skipping sccache server initialization, setting environment variables' 2024-12-18T00:16:45.4955837Z Skipping sccache server initialization, setting environment variables 2024-12-18T00:16:45.4956315Z ++ export SCCACHE_IDLE_TIMEOUT=0 2024-12-18T00:16:45.4956619Z ++ SCCACHE_IDLE_TIMEOUT=0 2024-12-18T00:16:45.4956985Z ++ export SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2024-12-18T00:16:45.4957446Z ++ SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2024-12-18T00:16:45.4957877Z ++ export RUST_LOG=sccache::server=error 2024-12-18T00:16:45.4958227Z ++ RUST_LOG=sccache::server=error 2024-12-18T00:16:45.4958534Z ++ sccache --zero-stats 2024-12-18T00:16:45.5151516Z Compile requests 0 2024-12-18T00:16:45.5151933Z Compile requests executed 0 2024-12-18T00:16:45.5152277Z Cache hits 0 2024-12-18T00:16:45.5152604Z Cache misses 0 2024-12-18T00:16:45.5152936Z Cache timeouts 0 2024-12-18T00:16:45.5153266Z Cache read errors 0 2024-12-18T00:16:45.5153597Z Forced recaches 0 2024-12-18T00:16:45.5153930Z Cache write errors 0 2024-12-18T00:16:45.5154269Z Compilation failures 0 2024-12-18T00:16:45.5154599Z Cache errors 0 2024-12-18T00:16:45.5155071Z Non-cacheable compilations 0 2024-12-18T00:16:45.5155424Z Non-cacheable calls 0 2024-12-18T00:16:45.5155763Z Non-compilation calls 0 2024-12-18T00:16:45.5156107Z Unsupported compiler calls 0 2024-12-18T00:16:45.5156457Z Average cache write 0.000 s 2024-12-18T00:16:45.5156792Z Average cache read miss 0.000 s 2024-12-18T00:16:45.5157136Z Average cache read hit 0.000 s 2024-12-18T00:16:45.5157489Z Failed distributed compilations 0 2024-12-18T00:16:45.5158304Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2024-12-18T00:16:45.5159079Z ++ which ccache 2024-12-18T00:16:45.5163791Z ++ ccache --zero-stats 2024-12-18T00:16:45.7262139Z Statistics zeroed 2024-12-18T00:16:45.7264180Z ++ ccache --show-stats 2024-12-18T00:16:45.7316286Z cache directory /home/jenkins/.cache/ccache 2024-12-18T00:16:45.7316838Z primary config /home/jenkins/.config/ccache/ccache.conf 2024-12-18T00:16:45.7317529Z secondary config (readonly) /etc/ccache.conf 2024-12-18T00:16:45.7317977Z stats updated Wed Dec 18 00:16:45 2024 2024-12-18T00:16:45.7318475Z stats zeroed Wed Dec 18 00:16:45 2024 2024-12-18T00:16:45.7318868Z cache hit (direct) 0 2024-12-18T00:16:45.7319201Z cache hit (preprocessed) 0 2024-12-18T00:16:45.7319542Z cache miss 0 2024-12-18T00:16:45.7319876Z cache hit rate 0.00 % 2024-12-18T00:16:45.7320273Z cleanups performed 0 2024-12-18T00:16:45.7320609Z files in cache 0 2024-12-18T00:16:45.7320930Z cache size 0.0 kB 2024-12-18T00:16:45.7321271Z max cache size 5.0 GB 2024-12-18T00:16:45.7321615Z ++ trap_add ccache_epilogue EXIT 2024-12-18T00:16:45.7321936Z ++ trap_add_cmd=ccache_epilogue 2024-12-18T00:16:45.7322225Z ++ shift 2024-12-18T00:16:45.7322454Z ++ for trap_add_name in "$@" 2024-12-18T00:16:45.7322753Z ++++ trap -p EXIT 2024-12-18T00:16:45.7324333Z +++ eval 'extract_trap_cmd trap -- '\'' 2024-12-18T00:16:45.7324671Z cleanup_workspace 2024-12-18T00:16:45.7324932Z sccache_epilogue 2024-12-18T00:16:45.7325171Z ccache_epilogue 2024-12-18T00:16:45.7325427Z sccache_epilogue'\'' EXIT' 2024-12-18T00:16:45.7325737Z ++++ extract_trap_cmd trap -- ' 2024-12-18T00:16:45.7326037Z cleanup_workspace 2024-12-18T00:16:45.7326291Z sccache_epilogue 2024-12-18T00:16:45.7326525Z ccache_epilogue 2024-12-18T00:16:45.7326782Z sccache_epilogue' EXIT 2024-12-18T00:16:45.7327051Z ++++ printf '%s\n' ' 2024-12-18T00:16:45.7327310Z cleanup_workspace 2024-12-18T00:16:45.7327561Z sccache_epilogue 2024-12-18T00:16:45.7327796Z ccache_epilogue 2024-12-18T00:16:45.7328039Z sccache_epilogue' 2024-12-18T00:16:45.7328304Z +++ printf '%s\n' ccache_epilogue 2024-12-18T00:16:45.7328616Z ++ trap -- ' 2024-12-18T00:16:45.7328852Z cleanup_workspace 2024-12-18T00:16:45.7329093Z sccache_epilogue 2024-12-18T00:16:45.7329347Z ccache_epilogue 2024-12-18T00:16:45.7329593Z sccache_epilogue 2024-12-18T00:16:45.7329847Z ccache_epilogue' EXIT 2024-12-18T00:16:45.7330118Z + clone_pytorch_xla 2024-12-18T00:16:45.7330356Z + [[ ! -d ./xla ]] 2024-12-18T00:16:45.7330620Z + source ./xla/.circleci/common.sh 2024-12-18T00:16:45.7330930Z ++ set -ex 2024-12-18T00:16:45.7331169Z ++ CONTINUE_ON_ERROR=false 2024-12-18T00:16:45.7331433Z ++ [[ false == \1 ]] 2024-12-18T00:16:45.7331728Z ++ export CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2024-12-18T00:16:45.7332104Z ++ CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2024-12-18T00:16:45.7333342Z +++ python3-config --prefix 2024-12-18T00:16:45.7531471Z ++ export LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2024-12-18T00:16:45.7532594Z ++ LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2024-12-18T00:16:45.7533738Z ++ echo /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2024-12-18T00:16:45.7534669Z /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2024-12-18T00:16:45.7535485Z ++ python -c 'from distutils.sysconfig import get_python_lib; print(get_python_lib())' 2024-12-18T00:16:45.8718517Z + SITE_PACKAGES=/opt/conda/lib/python3.10/site-packages 2024-12-18T00:16:45.8719535Z + export LD_LIBRARY_PATH=/opt/conda/lib/:/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2024-12-18T00:16:45.8720749Z + LD_LIBRARY_PATH=/opt/conda/lib/:/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2024-12-18T00:16:45.8721494Z ++ pwd 2024-12-18T00:16:45.8723217Z ++ pwd 2024-12-18T00:16:45.8725728Z + CMAKE_PREFIX_PATH=/opt/conda/lib/python3.10/site-packages/torch:/opt/conda/bin/../ 2024-12-18T00:16:45.8726389Z + XLA_SKIP_MP_OP_TESTS=1 2024-12-18T00:16:45.8726832Z + run_torch_xla_tests /var/lib/jenkins/workspace /var/lib/jenkins/workspace/xla 2024-12-18T00:16:45.8727400Z + PYTORCH_DIR=/var/lib/jenkins/workspace 2024-12-18T00:16:45.8727754Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2024-12-18T00:16:45.8728082Z + USE_COVERAGE=0 2024-12-18T00:16:45.8728312Z + RUN_CPP= 2024-12-18T00:16:45.8728538Z + RUN_PYTHON= 2024-12-18T00:16:45.8730289Z ++ command -v nvidia-smi 2024-12-18T00:16:45.8733502Z + '[' -x '' ']' 2024-12-18T00:16:45.8735035Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=xla 2024-12-18T00:16:45.8735485Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=xla 2024-12-18T00:16:45.8738941Z ++ python -c 'import torch;print(int(torch._C._GLIBCXX_USE_CXX11_ABI))' 2024-12-18T00:16:45.9461876Z Traceback (most recent call last): 2024-12-18T00:16:45.9462238Z File "", line 1, in 2024-12-18T00:16:45.9462737Z File "/var/lib/jenkins/workspace/torch/__init__.py", line 77, in 2024-12-18T00:16:45.9463306Z from torch.torch_version import __version__ as __version__ 2024-12-18T00:16:45.9463888Z File "/var/lib/jenkins/workspace/torch/torch_version.py", line 4, in 2024-12-18T00:16:45.9464474Z from torch.version import __version__ as internal_version 2024-12-18T00:16:45.9464936Z ModuleNotFoundError: No module named 'torch.version' 2024-12-18T00:16:45.9536961Z + export CXX_ABI= 2024-12-18T00:16:45.9537312Z + CXX_ABI= 2024-12-18T00:16:45.9537630Z + [[ -z '' ]] 2024-12-18T00:16:45.9537877Z + [[ -z '' ]] 2024-12-18T00:16:45.9538118Z + [[ -z '' ]] 2024-12-18T00:16:45.9538339Z + [[ -z '' ]] 2024-12-18T00:16:45.9538784Z + run_torch_xla_python_tests /var/lib/jenkins/workspace /var/lib/jenkins/workspace/xla 0 2024-12-18T00:16:45.9539335Z + PYTORCH_DIR=/var/lib/jenkins/workspace 2024-12-18T00:16:45.9539700Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2024-12-18T00:16:45.9540033Z + USE_COVERAGE=0 2024-12-18T00:16:45.9540298Z + pushd /var/lib/jenkins/workspace/xla 2024-12-18T00:16:45.9540723Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2024-12-18T00:16:45.9541141Z + echo 'Running Python Tests' 2024-12-18T00:16:45.9541447Z Running Python Tests 2024-12-18T00:16:45.9541710Z + '[' 0 '!=' 0 ']' 2024-12-18T00:16:45.9541944Z + ./test/run_tests.sh 2024-12-18T00:16:45.9588347Z /bin/bash: /opt/conda/lib/libtinfo.so.6: no version information available (required by /bin/bash) 2024-12-18T00:16:45.9601477Z +++ dirname ./test/run_tests.sh 2024-12-18T00:16:45.9605910Z ++ cd ./test 2024-12-18T00:16:45.9606378Z ++ pwd -P 2024-12-18T00:16:45.9608067Z + CDIR=/var/lib/jenkins/workspace/xla/test 2024-12-18T00:16:45.9608454Z + LOGFILE=/tmp/pytorch_py_test.log 2024-12-18T00:16:45.9608774Z + MAX_GRAPH_SIZE=500 2024-12-18T00:16:45.9609108Z + GRAPH_CHECK_FREQUENCY=100 2024-12-18T00:16:45.9609402Z + VERBOSITY=2 2024-12-18T00:16:45.9609772Z + source /var/lib/jenkins/workspace/xla/test/utils/run_tests_utils.sh 2024-12-18T00:16:45.9616359Z ++ set -exo pipefail 2024-12-18T00:16:45.9617730Z + CONTINUE_ON_ERROR=0 2024-12-18T00:16:45.9617997Z + [[ 0 == \1 ]] 2024-12-18T00:16:45.9618258Z + getopts LM:C:V: OPTION 2024-12-18T00:16:45.9618534Z + shift 0 2024-12-18T00:16:45.9618764Z + export TRIM_GRAPH_SIZE=500 2024-12-18T00:16:45.9619058Z + TRIM_GRAPH_SIZE=500 2024-12-18T00:16:45.9619358Z + export TRIM_GRAPH_CHECK_FREQUENCY=100 2024-12-18T00:16:45.9619706Z + TRIM_GRAPH_CHECK_FREQUENCY=100 2024-12-18T00:16:45.9620210Z + export TORCH_TEST_DEVICES=/var/lib/jenkins/workspace/xla/test/pytorch_test_base.py 2024-12-18T00:16:45.9620874Z + TORCH_TEST_DEVICES=/var/lib/jenkins/workspace/xla/test/pytorch_test_base.py 2024-12-18T00:16:45.9621372Z + export PYTORCH_TEST_WITH_SLOW=1 2024-12-18T00:16:45.9621695Z + PYTORCH_TEST_WITH_SLOW=1 2024-12-18T00:16:45.9621991Z + export XLA_DUMP_FATAL_STACK=1 2024-12-18T00:16:45.9622294Z + XLA_DUMP_FATAL_STACK=1 2024-12-18T00:16:45.9622567Z + export CPU_NUM_DEVICES=4 2024-12-18T00:16:45.9622852Z + CPU_NUM_DEVICES=4 2024-12-18T00:16:45.9623104Z ++ cd /home/jenkins 2024-12-18T00:16:45.9625553Z +++ python -c 'import torch_xla; print(torch_xla.__file__)' 2024-12-18T00:16:50.3388719Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2024-12-18T00:16:50.8885056Z ++ dirname /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/__init__.py 2024-12-18T00:16:50.8890294Z + TORCH_XLA_DIR=/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla 2024-12-18T00:16:50.8891057Z + COVERAGE_FILE=/var/lib/jenkins/workspace/xla/test/../.coverage 2024-12-18T00:16:50.8897866Z + '[' /tmp/pytorch_py_test.log '!=' '' ']' 2024-12-18T00:16:50.8900355Z + run_tests 2024-12-18T00:16:50.8901410Z + tee /tmp/pytorch_py_test.log 2024-12-18T00:16:50.8929769Z + [[ '' == \x\l\a\_\o\p\1 ]] 2024-12-18T00:16:50.8930173Z + [[ '' == \x\l\a\_\o\p\2 ]] 2024-12-18T00:16:50.8930476Z + [[ '' == \x\l\a\_\o\p\3 ]] 2024-12-18T00:16:50.8930771Z + [[ '' == \t\o\r\c\h\_\m\p\_\o\p ]] 2024-12-18T00:16:50.8931091Z + [[ '' != \1 ]] 2024-12-18T00:16:50.8931322Z + run_xla_op_tests1 2024-12-18T00:16:50.8931807Z + run_dynamic /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:16:50.8932622Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2024-12-18T00:16:50.8933500Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:16:50.8934169Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:16:50.8934756Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:16:50.8935502Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2024-12-18T00:16:50.8936316Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:16:50.8936991Z ++ command -v nvidia-smi 2024-12-18T00:16:50.8937288Z + '[' -x '' ']' 2024-12-18T00:16:50.8937538Z + PJRT_DEVICE=CPU 2024-12-18T00:16:50.8937780Z + CPU_NUM_DEVICES=1 2024-12-18T00:16:50.8938243Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:16:50.8938757Z + '[' 0 '!=' 0 ']' 2024-12-18T00:16:50.8939192Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:16:54.4677340Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2024-12-18T00:16:54.4679826Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2024-12-18T00:16:54.4868440Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:788.) 2024-12-18T00:16:54.4870335Z "dtype": torch.get_autocast_gpu_dtype(), 2024-12-18T00:16:54.4872079Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:664.) 2024-12-18T00:16:54.4873656Z "enabled": torch.is_autocast_cpu_enabled(), 2024-12-18T00:16:54.4875212Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:797.) 2024-12-18T00:16:54.4876763Z "dtype": torch.get_autocast_cpu_dtype(), 2024-12-18T00:16:54.5226707Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2024-12-18T00:16:54.5228019Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2024-12-18T00:16:54.5229270Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2024-12-18T00:16:54.5230584Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2024-12-18T00:16:54.8773953Z ok 2024-12-18T00:16:54.8816734Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2024-12-18T00:16:54.8818890Z test (__main__.TestAtenTensorTo) ... ok 2024-12-18T00:16:54.9974556Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.0735894Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.1448047Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.3161209Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.3746189Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.4242312Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.4654882Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.5131279Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.5592470Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.6058499Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.6538683Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.7005126Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.7614214Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.8055368Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.8539499Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.9025050Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:55.9515204Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.0008634Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.0013573Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:795.) 2024-12-18T00:16:56.0015519Z expected[nan_mask] = 0 2024-12-18T00:16:56.0017252Z /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:1994.) 2024-12-18T00:16:56.0019094Z expected[nan_mask] = 0 2024-12-18T00:16:56.0020710Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:795.) 2024-12-18T00:16:56.0022354Z expected[inf_mask] = 0 2024-12-18T00:16:56.0023948Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:1994.) 2024-12-18T00:16:56.0025639Z expected[inf_mask] = 0 2024-12-18T00:16:56.0025909Z ok 2024-12-18T00:16:56.0536214Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.1259087Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.1731893Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.3777216Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.4219356Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.4227196Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.6140203Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.6545291Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.7201928Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.8028739Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.8434975Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:56.9610435Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.0979882Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.1472582Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.2044430Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.2640615Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.3306429Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.4360786Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.4551924Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.6495877Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:823: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2024-12-18T00:16:57.6498983Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2024-12-18T00:16:57.6583715Z ok 2024-12-18T00:16:57.7835999Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.8001734Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:57.8003196Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2024-12-18T00:16:57.8529888Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.1774440Z test_flip (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.2840375Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.2840916Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.3714461Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.4618621Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.4626996Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.5122686Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.5577027Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.8952409Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.8958929Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:58.9556747Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.0684597Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.1158195Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.2194399Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.4119828Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.6121453Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.6582501Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.7041732Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.7527847Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.8164841Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2024-12-18T00:16:59.8167658Z self.assertIsNone(a.grad) 2024-12-18T00:16:59.8167955Z ok 2024-12-18T00:16:59.8648147Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.9218391Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:16:59.9692123Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.0267105Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.0498555Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.0995219Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.1495009Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.2501905Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.3465192Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.4164151Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.4875657Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.7238329Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.7699027Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:00.8700536Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.1739608Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.2242138Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.2254594Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.4208787Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.4691603Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.5156095Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.5162981Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.5202111Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.5785409Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.7972400Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:01.9809267Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:02.1211062Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:02.2136898Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:02.2140577Z test_pow_constant (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:02.4903804Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:02.6316131Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:02.6805781Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:02.8397553Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.0891460Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.0896934Z test_print (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.3109253Z test_print_executation (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.3116628Z test_rand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.3123501Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.3130088Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.3136101Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.3142828Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.6334090Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.6824373Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.7660373Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.8658454Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.8662232Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.9629749Z test_save (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:03.9695811Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.0648848Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.0669314Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.0670181Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is not disabled. Reason: views do not exist.' 2024-12-18T00:17:04.1246703Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.1812689Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.1903508Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.1904017Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2024-12-18T00:17:04.2866712Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.4440231Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.4904465Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:04.5454624Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:06.6430214Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:06.6823262Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:06.7294283Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:06.7760411Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:06.7764191Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:06.8169731Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:07.5420732Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:07.6783278Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:07.7288747Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:07.7778764Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:07.8673124Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:17.6048436Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:17.6058498Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:17.6065830Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:17.7584722Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:17.7591186Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2024-12-18T00:17:17.7593349Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2024-12-18T00:17:17.8945898Z ok 2024-12-18T00:17:18.0029711Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.2923339Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.3718225Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.3738138Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.3751623Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.3771753Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.3783768Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.3906403Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.4805047Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.5262680Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:18.6584182Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2024-12-18T00:17:18.6584943Z test_dlpack_non_default_layout (__main__.TestDLPack) 2024-12-18T00:17:18.6585580Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6586171Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2024-12-18T00:17:18.6586752Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6587412Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:17:18.6588156Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6588813Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2024-12-18T00:17:18.6589353Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6589894Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2024-12-18T00:17:18.6590297Z TestDLPack.test_dlpack_roundtrip_scalar 2024-12-18T00:17:18.6590879Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6591497Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2024-12-18T00:17:18.6591892Z TestDLPack.test_dlpack_roundtrip_tensor 2024-12-18T00:17:18.6592469Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6593086Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2024-12-18T00:17:18.6593694Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6594399Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:17:18.6595130Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:18.6595792Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2024-12-18T00:17:18.6980011Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... ok 2024-12-18T00:17:18.7930530Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:17:18.9124805Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2024-12-18T00:17:19.0071605Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:17:19.0928826Z test_as_strided_input_larger (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.0929522Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:19.0930268Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:17:19.0931256Z test_data_wrapper (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.0935119Z test_git_revisons (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.0939564Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.0945615Z test_send_to_device_single (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.1332981Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.1334239Z test_util_foreach_api (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.1338180Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.1342350Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2024-12-18T00:17:19.2689782Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2024-12-18T00:17:19.4001748Z test_repeat_special (__main__.TestHelperFunction) ... ok 2024-12-18T00:17:19.5294755Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2024-12-18T00:17:19.6262971Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2024-12-18T00:17:20.0924191Z test (__main__.TestLongGraphChain) ... ok 2024-12-18T00:17:20.0949331Z test_api (__main__.TestLoweringContext) ... ok 2024-12-18T00:17:20.0949820Z test_get_parameters_scalar (__main__.TestLoweringContext) 2024-12-18T00:17:20.0981210Z Scalar tensors parameters may be shared in the HLO graph if their ... ok 2024-12-18T00:17:20.3913741Z test (__main__.TestModelComparator) ... ok 2024-12-18T00:17:20.6601737Z test_legacy (__main__.TestNMS) ... ok 2024-12-18T00:17:20.7133872Z test_nms_input_errors (__main__.TestNMS) ... ok 2024-12-18T00:17:21.2457172Z test_nms_ref (__main__.TestNMS) ... ok 2024-12-18T00:17:21.3007326Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:17:21.3024681Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:17:21.3484411Z test_add (__main__.TestOpBuilder) ... ok 2024-12-18T00:17:21.4434321Z test_conditional (__main__.TestOpBuilder) ... ok 2024-12-18T00:17:21.4889383Z test_mul (__main__.TestOpBuilder) ... ok 2024-12-18T00:17:21.4911892Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2024-12-18T00:17:21.4914673Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2024-12-18T00:17:21.4915736Z X = torch.triangular_solve(B, A).solution 2024-12-18T00:17:21.4916300Z should be replaced with 2024-12-18T00:17:21.4917541Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2259.) 2024-12-18T00:17:21.4918894Z return torch.triangular_solve( 2024-12-18T00:17:21.5488910Z ok 2024-12-18T00:17:21.5999874Z test_while (__main__.TestOpBuilder) ... ok 2024-12-18T00:17:21.6005551Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2024-12-18T00:17:21.6032261Z test (__main__.TestParallelLoader) ... ok 2024-12-18T00:17:21.9904381Z test (__main__.TestParallelTensorMNIST) ... ok 2024-12-18T00:17:22.8916559Z test_random_from_to_bool (__main__.TestRandom) ... ok 2024-12-18T00:17:23.0405895Z test_get_xla_tensor (__main__.TestSelect) ... ok 2024-12-18T00:17:23.1860038Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2024-12-18T00:17:23.1864294Z test (__main__.TestToXlaTensorArena) ... ok 2024-12-18T00:17:24.9321533Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2024-12-18T00:17:24.9485014Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2024-12-18T00:17:24.9636420Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2024-12-18T00:17:24.9636746Z 2024-12-18T00:17:24.9638568Z ---------------------------------------------------------------------- 2024-12-18T00:17:24.9638983Z Ran 205 tests in 30.528s 2024-12-18T00:17:24.9639181Z 2024-12-18T00:17:24.9639286Z OK (skipped=13) 2024-12-18T00:17:25.0218029Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:17:25.0218575Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:17:25.0219033Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:17:25.0219487Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:17:25.0219937Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:17:25.0220392Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:17:25.0220783Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:17:25.0221144Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:17:25.0221499Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:17:25.8643375Z + run_dynamic /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2024-12-18T00:17:25.8644500Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py' 2024-12-18T00:17:25.8645422Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2024-12-18T00:17:25.8646199Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:17:25.8646763Z + run_test /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2024-12-18T00:17:25.8647451Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py' 2024-12-18T00:17:25.8648248Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2024-12-18T00:17:25.8648784Z ++ command -v nvidia-smi 2024-12-18T00:17:25.8649063Z + '[' -x '' ']' 2024-12-18T00:17:25.8649313Z + PJRT_DEVICE=CPU 2024-12-18T00:17:25.8649568Z + CPU_NUM_DEVICES=1 2024-12-18T00:17:25.8649974Z + run_coverage /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2024-12-18T00:17:25.8650451Z + '[' 0 '!=' 0 ']' 2024-12-18T00:17:25.8650845Z + python3 /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2024-12-18T00:17:31.1033935Z .................................. 2024-12-18T00:17:31.1034475Z ---------------------------------------------------------------------- 2024-12-18T00:17:31.1034885Z Ran 34 tests in 2.226s 2024-12-18T00:17:31.1035054Z 2024-12-18T00:17:31.1035159Z OK 2024-12-18T00:17:31.6708283Z + run_dynamic /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2024-12-18T00:17:31.6709277Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py' --verbosity=2 2024-12-18T00:17:31.6710266Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2024-12-18T00:17:31.6710998Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:17:31.6711621Z + run_test /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2024-12-18T00:17:31.6712514Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py' --verbosity=2 2024-12-18T00:17:31.6713447Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2024-12-18T00:17:31.6714075Z ++ command -v nvidia-smi 2024-12-18T00:17:31.6714358Z + '[' -x '' ']' 2024-12-18T00:17:31.6714605Z + PJRT_DEVICE=CPU 2024-12-18T00:17:31.6714846Z + CPU_NUM_DEVICES=1 2024-12-18T00:17:31.6715362Z + run_coverage /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2024-12-18T00:17:31.6715934Z + '[' 0 '!=' 0 ']' 2024-12-18T00:17:31.6716416Z + python3 /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2024-12-18T00:17:34.6738995Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:99: UserWarning: `devkind` argument is deprecated and will be removed in a future release. 2024-12-18T00:17:34.6740515Z warnings.warn("`devkind` argument is deprecated and will be removed in a " 2024-12-18T00:17:34.6748959Z test_backward_pass_with_dynamic_input (__main__.TestDynamicShapeModels) ... skipped 'The tests fail on CPU. See https://github.com/pytorch/xla/issues/4298 for more detail.' 2024-12-18T00:17:34.6750357Z test_forward_pass_dynamic_input_compile_once (__main__.TestDynamicShapeModels) ... skipped 'The tests fail on CPU. See https://github.com/pytorch/xla/issues/4298 for more detail.' 2024-12-18T00:17:34.6751791Z test_forward_pass_dynamic_input_correctness (__main__.TestDynamicShapeModels) ... skipped 'The tests fail on CPU. See https://github.com/pytorch/xla/issues/4298 for more detail.' 2024-12-18T00:17:34.6752566Z 2024-12-18T00:17:34.6752733Z ---------------------------------------------------------------------- 2024-12-18T00:17:34.6753130Z Ran 3 tests in 0.000s 2024-12-18T00:17:34.6753293Z 2024-12-18T00:17:34.6753409Z OK (skipped=3) 2024-12-18T00:17:35.2284589Z + run_eager_debug /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:17:35.2285642Z + echo 'Running in Eager Debug mode: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2024-12-18T00:17:35.2286551Z Running in Eager Debug mode: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:17:35.2287134Z + XLA_USE_EAGER_DEBUG_MODE=1 2024-12-18T00:17:35.2287604Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:17:35.2288362Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2024-12-18T00:17:35.2289225Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:17:35.2289774Z ++ command -v nvidia-smi 2024-12-18T00:17:35.2290055Z + '[' -x '' ']' 2024-12-18T00:17:35.2290299Z + PJRT_DEVICE=CPU 2024-12-18T00:17:35.2290552Z + CPU_NUM_DEVICES=1 2024-12-18T00:17:35.2291006Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:17:35.2291500Z + '[' 0 '!=' 0 ']' 2024-12-18T00:17:35.2291927Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:17:38.7645597Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2024-12-18T00:17:38.7649505Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2024-12-18T00:17:38.9221733Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:788.) 2024-12-18T00:17:38.9223634Z "dtype": torch.get_autocast_gpu_dtype(), 2024-12-18T00:17:38.9225218Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:664.) 2024-12-18T00:17:38.9226799Z "enabled": torch.is_autocast_cpu_enabled(), 2024-12-18T00:17:38.9228365Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:797.) 2024-12-18T00:17:38.9229929Z "dtype": torch.get_autocast_cpu_dtype(), 2024-12-18T00:17:39.6139174Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2024-12-18T00:17:39.6141000Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2024-12-18T00:17:39.6142462Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2024-12-18T00:17:39.6143911Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2024-12-18T00:17:39.7762903Z ok 2024-12-18T00:17:39.7795522Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2024-12-18T00:17:39.8276857Z test (__main__.TestAtenTensorTo) ... ok 2024-12-18T00:17:39.9923359Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.1447243Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.3743102Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.5086733Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.6087675Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.6819594Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.7779549Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.8794656Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:40.9740004Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:41.0271024Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:41.1283162Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:41.1814753Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:41.8385352Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:41.9339644Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:42.0939820Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:42.1882358Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:42.2855888Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:42.3847107Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:42.3855462Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:795.) 2024-12-18T00:17:42.3857522Z expected[nan_mask] = 0 2024-12-18T00:17:42.3859137Z /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:1994.) 2024-12-18T00:17:42.3860793Z expected[nan_mask] = 0 2024-12-18T00:17:42.3862417Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:795.) 2024-12-18T00:17:42.3864066Z expected[inf_mask] = 0 2024-12-18T00:17:42.3865677Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:1994.) 2024-12-18T00:17:42.3867529Z expected[inf_mask] = 0 2024-12-18T00:17:42.3867813Z ok 2024-12-18T00:17:42.5779679Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:42.8249364Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:42.8733543Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:43.0588562Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:43.1875237Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:43.2767145Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:43.3640471Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:43.4510628Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:43.5438006Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:44.2380163Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:44.2386246Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:44.5263245Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:44.7083171Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:44.7991655Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:45.0787801Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:45.1801082Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:45.5162984Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:45.6146557Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:46.0551952Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:46.4699907Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:823: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2024-12-18T00:17:46.4703087Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2024-12-18T00:17:46.4716499Z ok 2024-12-18T00:17:46.9039097Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:47.0433632Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:47.0434519Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2024-12-18T00:17:47.1320294Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:47.5303995Z test_flip (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:47.5447602Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:47.5448120Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:47.7962080Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:47.8859386Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:48.3064913Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:48.3081080Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:48.3483861Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:48.4036233Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:48.4041458Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:48.7605406Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:49.1264473Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:49.2080616Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:49.5293691Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:50.2750419Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:51.2373482Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:51.3724057Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:51.7134620Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:52.0567991Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:52.3300195Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2024-12-18T00:17:52.3302972Z self.assertIsNone(a.grad) 2024-12-18T00:17:52.3303272Z ok 2024-12-18T00:17:52.4264125Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:52.8805125Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:52.9756661Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:53.1550690Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:53.5021449Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:54.1347306Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:54.1373186Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:54.1407195Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:54.2880146Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:54.4220065Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:54.6007585Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:55.3047077Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:55.3936188Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:55.4922636Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:55.7985399Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:55.8480545Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:55.8497986Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:56.3155364Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:56.3622478Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:56.6064119Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:56.7057080Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:56.7063103Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:56.8577149Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:57.1644506Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:57.4539662Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:57.7466048Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:57.9002156Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:57.9002865Z test_pow_constant (__main__.TestAtenXlaTensor) ... skipped 'skip on eager debug mode' 2024-12-18T00:17:58.3580373Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:58.5458692Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:58.9448076Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:17:59.5293511Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:00.0263781Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:00.0270923Z test_print (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:00.0272187Z test_print_executation (__main__.TestAtenXlaTensor) ... skipped 'skip on eager debug mode' 2024-12-18T00:18:00.1736318Z test_rand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:00.3094796Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:00.4322359Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:00.5260454Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:00.5854929Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:01.0537384Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:01.1508351Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:01.2437657Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:01.4307388Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:01.7644094Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:01.7673978Z test_save (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.0096874Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.1554739Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.1576313Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.1577456Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is not disabled. Reason: views do not exist.' 2024-12-18T00:18:02.3063131Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.4569744Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.4671630Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.4672146Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2024-12-18T00:18:02.5998202Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:02.9091355Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:03.3647341Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:03.6745675Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:08.8529567Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:09.0419429Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:09.3262947Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:09.4768816Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:09.8148370Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:09.8990212Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:11.3534443Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:11.4904169Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:11.5388109Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:12.2063431Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:12.3029057Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:12.8461131Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:12.8468533Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:12.8475927Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:15.3693611Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:15.4232435Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2024-12-18T00:18:15.4234674Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2024-12-18T00:18:15.5443340Z ok 2024-12-18T00:18:16.3905880Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:16.8992754Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:17.0884112Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:17.2340833Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:17.4095424Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:17.6020495Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:17.8029078Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:17.8046625Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:17.9342650Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:18.0274229Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:18.0740975Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2024-12-18T00:18:18.0741569Z test_dlpack_non_default_layout (__main__.TestDLPack) 2024-12-18T00:18:18.0742142Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.0742723Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2024-12-18T00:18:18.0743294Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.0744347Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:18:18.0745098Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.0745831Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2024-12-18T00:18:18.0746386Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.0746939Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2024-12-18T00:18:18.0747339Z TestDLPack.test_dlpack_roundtrip_scalar 2024-12-18T00:18:18.0747977Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.0748588Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2024-12-18T00:18:18.0748986Z TestDLPack.test_dlpack_roundtrip_tensor 2024-12-18T00:18:18.0749569Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.0750209Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2024-12-18T00:18:18.0750779Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.0751428Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:18:18.0752147Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.1668887Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2024-12-18T00:18:18.1669651Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... skipped 'skip on eager debug mode' 2024-12-18T00:18:18.3041015Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:18:18.6402889Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2024-12-18T00:18:18.7383222Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:18:18.9316208Z test_as_strided_input_larger (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9316904Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.9317657Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:18.9318481Z test_data_wrapper (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9322211Z test_git_revisons (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9326108Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9332008Z test_send_to_device_single (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9781329Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9785443Z test_util_foreach_api (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9789158Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2024-12-18T00:18:18.9792972Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2024-12-18T00:18:20.3145275Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2024-12-18T00:18:21.2914194Z test_repeat_special (__main__.TestHelperFunction) ... ok 2024-12-18T00:18:21.8497381Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2024-12-18T00:18:21.8923777Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2024-12-18T00:18:22.0335108Z test (__main__.TestLongGraphChain) ... ok 2024-12-18T00:18:22.0336133Z test_api (__main__.TestLoweringContext) ... skipped 'Skipping test under XLA_USE_EAGER_DEBUG_MODE because `result` will not reference a graph due to eager evaluation.' 2024-12-18T00:18:22.0337263Z test_get_parameters_scalar (__main__.TestLoweringContext) 2024-12-18T00:18:22.0338278Z Scalar tensors parameters may be shared in the HLO graph if their ... skipped 'Skipping test under XLA_USE_EAGER_DEBUG_MODE because `result` will not reference a graph due to eager evaluation.' 2024-12-18T00:18:22.8261535Z test (__main__.TestModelComparator) ... ok 2024-12-18T00:18:22.8262084Z test_legacy (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:18:22.8262740Z test_nms_input_errors (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:18:22.8263536Z test_nms_ref (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:18:22.9266200Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:18:22.9291630Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:18:22.9777420Z test_add (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:23.0791799Z test_conditional (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:23.1278112Z test_mul (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:23.1283960Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2024-12-18T00:18:23.1286639Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2024-12-18T00:18:23.1287719Z X = torch.triangular_solve(B, A).solution 2024-12-18T00:18:23.1288285Z should be replaced with 2024-12-18T00:18:23.1289539Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2259.) 2024-12-18T00:18:23.1290918Z return torch.triangular_solve( 2024-12-18T00:18:23.1893227Z ok 2024-12-18T00:18:23.2441655Z test_while (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:23.2447783Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2024-12-18T00:18:23.2476046Z test (__main__.TestParallelLoader) ... ok 2024-12-18T00:18:25.4685385Z test (__main__.TestParallelTensorMNIST) ... ok 2024-12-18T00:18:26.0921923Z test_random_from_to_bool (__main__.TestRandom) ... ok 2024-12-18T00:18:26.3451216Z test_get_xla_tensor (__main__.TestSelect) ... ok 2024-12-18T00:18:26.5712247Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2024-12-18T00:18:26.5713628Z test (__main__.TestToXlaTensorArena) ... ok 2024-12-18T00:18:29.4718717Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2024-12-18T00:18:29.4847273Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2024-12-18T00:18:29.4974656Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2024-12-18T00:18:29.4975015Z 2024-12-18T00:18:29.4975193Z ---------------------------------------------------------------------- 2024-12-18T00:18:29.4975596Z Ran 205 tests in 50.763s 2024-12-18T00:18:29.4975768Z 2024-12-18T00:18:29.4975869Z OK (skipped=21) 2024-12-18T00:18:30.2755814Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:18:30.2756712Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2024-12-18T00:18:30.2757547Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:18:30.2758122Z ++ command -v nvidia-smi 2024-12-18T00:18:30.2760431Z + '[' -x '' ']' 2024-12-18T00:18:30.2760878Z + PJRT_DEVICE=CPU 2024-12-18T00:18:30.2761137Z + CPU_NUM_DEVICES=1 2024-12-18T00:18:30.2761597Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:18:30.2762114Z + '[' 0 '!=' 0 ']' 2024-12-18T00:18:30.2762537Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:18:33.7944103Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2024-12-18T00:18:33.7950498Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2024-12-18T00:18:33.7980338Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:788.) 2024-12-18T00:18:33.7982157Z "dtype": torch.get_autocast_gpu_dtype(), 2024-12-18T00:18:33.7983908Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:664.) 2024-12-18T00:18:33.7985609Z "enabled": torch.is_autocast_cpu_enabled(), 2024-12-18T00:18:33.7987223Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:797.) 2024-12-18T00:18:33.7988784Z "dtype": torch.get_autocast_cpu_dtype(), 2024-12-18T00:18:33.7998148Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2024-12-18T00:18:33.7999420Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2024-12-18T00:18:33.8000673Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2024-12-18T00:18:33.8001919Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2024-12-18T00:18:34.0843509Z ok 2024-12-18T00:18:34.0876817Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2024-12-18T00:18:34.0880699Z test (__main__.TestAtenTensorTo) ... ok 2024-12-18T00:18:34.2011118Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.2650177Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.3327222Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.4826446Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.5326178Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.5677147Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.6077254Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.6553724Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.7014173Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.7472268Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.7936151Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.8383225Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.8906596Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.9339918Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:34.9816677Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.0290979Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.0765914Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.1237618Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.1242492Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:795.) 2024-12-18T00:18:35.1244607Z expected[nan_mask] = 0 2024-12-18T00:18:35.1246381Z /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:1994.) 2024-12-18T00:18:35.1248042Z expected[nan_mask] = 0 2024-12-18T00:18:35.1249705Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:795.) 2024-12-18T00:18:35.1251391Z expected[inf_mask] = 0 2024-12-18T00:18:35.1252988Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:1994.) 2024-12-18T00:18:35.1254625Z expected[inf_mask] = 0 2024-12-18T00:18:35.1254898Z ok 2024-12-18T00:18:35.1739790Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.2211789Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.2679013Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.4520647Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.4954737Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.4959858Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.6522989Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.6921824Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.7381289Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.7951685Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.8347527Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:35.8771404Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.0127377Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.0613309Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.1175833Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.1766117Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.2420317Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.3391391Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.3412939Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.4043757Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:823: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2024-12-18T00:18:36.4047337Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2024-12-18T00:18:36.4062157Z ok 2024-12-18T00:18:36.5063007Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.5070036Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.5071530Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2024-12-18T00:18:36.5482199Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.8688191Z test_flip (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.8821304Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.8824661Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:36.9681267Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.0573626Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.0583002Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.1066136Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.1508774Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.2047213Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.2053989Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.2634254Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.3326990Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.3739130Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.4695455Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.6031299Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.7991903Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.8441500Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.8892028Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.9371371Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:37.9814307Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2024-12-18T00:18:37.9817208Z self.assertIsNone(a.grad) 2024-12-18T00:18:37.9817500Z ok 2024-12-18T00:18:38.0284628Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.0847198Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.1315455Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.1746639Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.1756042Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.2246651Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.2734079Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.3722943Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.4673732Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.5157367Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.5647191Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.8002219Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.8462412Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:38.9408814Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.2082538Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.2550247Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.2571580Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.4503798Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.4974590Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.5445967Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.5451751Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.5460097Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.6013110Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.8007300Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:39.9850266Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:40.1251167Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:40.2177838Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:40.2179984Z test_pow_constant (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:40.4899224Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:40.6315957Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:40.6784664Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:40.8203901Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.0614455Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.0619176Z test_print (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.2859898Z test_print_executation (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.2864956Z test_rand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.2870861Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.2876646Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.2881976Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.2889192Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.5968470Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.6463463Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.7299052Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.8176655Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.8179111Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.9138166Z test_save (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:41.9199849Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.0152831Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.0178153Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.0179040Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is not disabled. Reason: views do not exist.' 2024-12-18T00:18:42.0734454Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.1273965Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.1375505Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.1376014Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2024-12-18T00:18:42.2320349Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.3813982Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.4280425Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:42.4804530Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:44.5596292Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:44.5999892Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:44.6465891Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:44.6938284Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:44.6943255Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:44.7344874Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:45.4539759Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:45.5418288Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:45.5926536Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:45.6415420Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:45.7283195Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:55.4539169Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:55.4548064Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:55.4555561Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:55.5881373Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:55.5887920Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2024-12-18T00:18:55.5890323Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2024-12-18T00:18:55.7022663Z ok 2024-12-18T00:18:55.8064085Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.0940024Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.1738548Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.1751992Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.1773561Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.1785297Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.1805312Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.1812256Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.2712389Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.3179072Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:18:56.4472777Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2024-12-18T00:18:56.4473379Z test_dlpack_non_default_layout (__main__.TestDLPack) 2024-12-18T00:18:56.4473970Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4474553Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2024-12-18T00:18:56.4475124Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4475784Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:18:56.4476519Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4477158Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2024-12-18T00:18:56.4477696Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4478247Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2024-12-18T00:18:56.4478644Z TestDLPack.test_dlpack_roundtrip_scalar 2024-12-18T00:18:56.4479228Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4479848Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2024-12-18T00:18:56.4480229Z TestDLPack.test_dlpack_roundtrip_tensor 2024-12-18T00:18:56.4480997Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4481634Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2024-12-18T00:18:56.4482198Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4482848Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:18:56.4483562Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.4484224Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2024-12-18T00:18:56.4863853Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... ok 2024-12-18T00:18:56.5779455Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:18:56.6658393Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2024-12-18T00:18:56.7103892Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:18:56.7949043Z test_as_strided_input_larger (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.7949903Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.7950657Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:18:56.7955676Z test_data_wrapper (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.7959058Z test_git_revisons (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.7963257Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.7968685Z test_send_to_device_single (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.8353304Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.8355507Z test_util_foreach_api (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.8359213Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.8363230Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2024-12-18T00:18:56.9663337Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2024-12-18T00:18:57.0973636Z test_repeat_special (__main__.TestHelperFunction) ... ok 2024-12-18T00:18:57.2259660Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2024-12-18T00:18:57.2753888Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2024-12-18T00:18:57.7447621Z test (__main__.TestLongGraphChain) ... ok 2024-12-18T00:18:57.7482753Z test_api (__main__.TestLoweringContext) ... ok 2024-12-18T00:18:57.7483704Z test_get_parameters_scalar (__main__.TestLoweringContext) 2024-12-18T00:18:57.7514761Z Scalar tensors parameters may be shared in the HLO graph if their ... ok 2024-12-18T00:18:58.0046566Z test (__main__.TestModelComparator) ... ok 2024-12-18T00:18:58.0047167Z test_legacy (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:18:58.0047813Z test_nms_input_errors (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:18:58.0048445Z test_nms_ref (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:18:58.0582719Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:18:58.0607075Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:18:58.1058139Z test_add (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:58.2007334Z test_conditional (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:58.2458912Z test_mul (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:58.2464323Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2024-12-18T00:18:58.2466997Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2024-12-18T00:18:58.2468062Z X = torch.triangular_solve(B, A).solution 2024-12-18T00:18:58.2468623Z should be replaced with 2024-12-18T00:18:58.2469901Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2259.) 2024-12-18T00:18:58.2471510Z return torch.triangular_solve( 2024-12-18T00:18:58.3041661Z ok 2024-12-18T00:18:58.3551958Z test_while (__main__.TestOpBuilder) ... ok 2024-12-18T00:18:58.3558660Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2024-12-18T00:18:58.3587145Z test (__main__.TestParallelLoader) ... ok 2024-12-18T00:18:58.7660358Z test (__main__.TestParallelTensorMNIST) ... ok 2024-12-18T00:18:59.6813453Z test_random_from_to_bool (__main__.TestRandom) ... ok 2024-12-18T00:18:59.8259641Z test_get_xla_tensor (__main__.TestSelect) ... ok 2024-12-18T00:18:59.9676165Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2024-12-18T00:18:59.9677545Z test (__main__.TestToXlaTensorArena) ... ok 2024-12-18T00:19:01.7014379Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2024-12-18T00:19:01.7142289Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2024-12-18T00:19:01.7265269Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2024-12-18T00:19:01.7265617Z 2024-12-18T00:19:01.7265998Z ---------------------------------------------------------------------- 2024-12-18T00:19:01.7266414Z Ran 205 tests in 27.961s 2024-12-18T00:19:01.7266604Z 2024-12-18T00:19:01.7266801Z OK (skipped=16) 2024-12-18T00:19:01.7798899Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:19:01.7799445Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:19:01.7799917Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:19:01.7800370Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:19:01.7801025Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:19:01.7801475Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:19:01.7801879Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:19:01.7802235Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:19:01.7802588Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:19:02.5649700Z + run_test_without_functionalization /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:19:02.5650806Z + echo 'Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2024-12-18T00:19:02.5651812Z Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:19:02.5652483Z + XLA_DISABLE_FUNCTIONALIZATION=1 2024-12-18T00:19:02.5652963Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:19:02.5653727Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2024-12-18T00:19:02.5654537Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:19:02.5655105Z ++ command -v nvidia-smi 2024-12-18T00:19:02.5655384Z + '[' -x '' ']' 2024-12-18T00:19:02.5655635Z + PJRT_DEVICE=CPU 2024-12-18T00:19:02.5655874Z + CPU_NUM_DEVICES=1 2024-12-18T00:19:02.5656396Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:19:02.5656928Z + '[' 0 '!=' 0 ']' 2024-12-18T00:19:02.5657357Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2024-12-18T00:19:06.0645041Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2024-12-18T00:19:06.0648344Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2024-12-18T00:19:06.0681591Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:788.) 2024-12-18T00:19:06.0683527Z "dtype": torch.get_autocast_gpu_dtype(), 2024-12-18T00:19:06.0685281Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:664.) 2024-12-18T00:19:06.0686866Z "enabled": torch.is_autocast_cpu_enabled(), 2024-12-18T00:19:06.0688423Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:797.) 2024-12-18T00:19:06.0689972Z "dtype": torch.get_autocast_cpu_dtype(), 2024-12-18T00:19:06.0697747Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2024-12-18T00:19:06.0699097Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2024-12-18T00:19:06.0700343Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2024-12-18T00:19:06.0701628Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2024-12-18T00:19:06.3524920Z ok 2024-12-18T00:19:06.3554902Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2024-12-18T00:19:06.3561451Z test (__main__.TestAtenTensorTo) ... ok 2024-12-18T00:19:06.4744457Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.5374553Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.6044334Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.7549978Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.8063089Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.8347350Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.8738911Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.9212144Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:06.9661021Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.0108914Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.0572357Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.1019799Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.1541371Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.1542325Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2024-12-18T00:19:07.1543627Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2024-12-18T00:19:07.1545085Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2024-12-18T00:19:07.1546405Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2024-12-18T00:19:07.1547708Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2024-12-18T00:19:07.1556634Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2024-12-18T00:19:07.2027536Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.2488121Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.2942125Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.4751355Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.5185649Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.5188687Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.6728991Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.7125977Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.7580660Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.8140740Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.8537032Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:07.8943565Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.0936696Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.1418547Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.1971872Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.2549501Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.3214921Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.4250476Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.4259592Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.5800914Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:823: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2024-12-18T00:19:08.5804023Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2024-12-18T00:19:08.5817621Z ok 2024-12-18T00:19:08.7057597Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.7066295Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:08.7067777Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2024-12-18T00:19:08.7591084Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.0762963Z test_flip (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.0892377Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.0893297Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.1732749Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.2613836Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.2616802Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.3098710Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.3536820Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.4125182Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.4130110Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.4599980Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.5190857Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.5605631Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.6538536Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.7853031Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:09.9784685Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.0225027Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.0667610Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.1134715Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.1578211Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2024-12-18T00:19:10.1581003Z self.assertIsNone(a.grad) 2024-12-18T00:19:10.1581299Z ok 2024-12-18T00:19:10.2030146Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.2580264Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.3042822Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.3464225Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.3471910Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.3950318Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.4420789Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.5390631Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.6311320Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.6782554Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.7262078Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:10.9587171Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.0049050Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.0904580Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.2699301Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.3166813Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.3170409Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.5100893Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.5572788Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.6028033Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.6032305Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.6040203Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.6582983Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:11.8542201Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.0368128Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.1746811Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.2658378Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.2662164Z test_pow_constant (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.5338561Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.6724713Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.7190471Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:12.8600891Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.0976522Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.0979040Z test_print (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.2782962Z test_print_executation (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.2787075Z test_rand (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.2792597Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.2797913Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.2802690Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.2807553Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.5819223Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.6305729Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.6306605Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: metrics differ.' 2024-12-18T00:19:13.7762825Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.7766010Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.8716459Z test_save (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.8778715Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.9722973Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.9738094Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:13.9744347Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:376: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2024-12-18T00:19:13.9746601Z return t.storage().data_ptr(), 'torch' 2024-12-18T00:19:13.9746935Z ok 2024-12-18T00:19:14.0294422Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:14.0831241Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:14.0926212Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:14.0926799Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2024-12-18T00:19:14.1861210Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:14.3300762Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:14.3759882Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:14.4273583Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:16.4763753Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:16.5154817Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:16.5623555Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:16.6089181Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:16.6091630Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:16.6496951Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:17.3633700Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:17.4498960Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:17.5001881Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:17.5493439Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:17.6433850Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.0564712Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.0571680Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.0578734Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.1870006Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.1876270Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2024-12-18T00:19:27.1878666Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2024-12-18T00:19:27.3002682Z ok 2024-12-18T00:19:27.4025144Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.6884785Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.7665524Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.7666425Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2024-12-18T00:19:27.7667621Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2024-12-18T00:19:27.7668776Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2024-12-18T00:19:27.7669920Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2024-12-18T00:19:27.8004586Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.8890924Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:27.9339609Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2024-12-18T00:19:28.0616824Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2024-12-18T00:19:28.0617411Z test_dlpack_non_default_layout (__main__.TestDLPack) 2024-12-18T00:19:28.0617987Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0618760Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2024-12-18T00:19:28.0619314Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0619967Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:19:28.0620701Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0621355Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2024-12-18T00:19:28.0621896Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0622448Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2024-12-18T00:19:28.0622836Z TestDLPack.test_dlpack_roundtrip_scalar 2024-12-18T00:19:28.0623418Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0624036Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2024-12-18T00:19:28.0624431Z TestDLPack.test_dlpack_roundtrip_tensor 2024-12-18T00:19:28.0625023Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0625654Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2024-12-18T00:19:28.0626219Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0626864Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2024-12-18T00:19:28.0627598Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.0628249Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2024-12-18T00:19:28.1005419Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... ok 2024-12-18T00:19:28.1903762Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:19:28.2774561Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2024-12-18T00:19:28.3217119Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2024-12-18T00:19:28.3218176Z test_as_strided_input_larger (__main__.TestGeneric) ... skipped 'Works only when functionalization is disabled. Reason: https://github.com/pytorch/xla/pull/7864#issuecomment-2294034008.' 2024-12-18T00:19:28.3219291Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.3220037Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2024-12-18T00:19:28.3220816Z test_data_wrapper (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.3223219Z test_git_revisons (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.3227190Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.3232498Z test_send_to_device_single (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.3619016Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.3619826Z test_util_foreach_api (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.3623599Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.3627445Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2024-12-18T00:19:28.4982776Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2024-12-18T00:19:28.6283137Z test_repeat_special (__main__.TestHelperFunction) ... ok 2024-12-18T00:19:28.7558850Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2024-12-18T00:19:28.8045378Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2024-12-18T00:19:29.2665190Z test (__main__.TestLongGraphChain) ... ok 2024-12-18T00:19:29.2699350Z test_api (__main__.TestLoweringContext) ... ok 2024-12-18T00:19:29.2699847Z test_get_parameters_scalar (__main__.TestLoweringContext) 2024-12-18T00:19:29.2734201Z Scalar tensors parameters may be shared in the HLO graph if their ... ok 2024-12-18T00:19:29.5239237Z test (__main__.TestModelComparator) ... ok 2024-12-18T00:19:29.5240245Z test_legacy (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:19:29.5240895Z test_nms_input_errors (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:19:29.5241710Z test_nms_ref (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2024-12-18T00:19:29.5774437Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:19:29.5794440Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2024-12-18T00:19:29.6240158Z test_add (__main__.TestOpBuilder) ... ok 2024-12-18T00:19:29.7176670Z test_conditional (__main__.TestOpBuilder) ... ok 2024-12-18T00:19:29.7619280Z test_mul (__main__.TestOpBuilder) ... ok 2024-12-18T00:19:29.7627174Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2024-12-18T00:19:29.7629841Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2024-12-18T00:19:29.7630975Z X = torch.triangular_solve(B, A).solution 2024-12-18T00:19:29.7631551Z should be replaced with 2024-12-18T00:19:29.7632790Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2259.) 2024-12-18T00:19:29.7634127Z return torch.triangular_solve( 2024-12-18T00:19:29.8208338Z ok 2024-12-18T00:19:29.8711934Z test_while (__main__.TestOpBuilder) ... ok 2024-12-18T00:19:29.8717857Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2024-12-18T00:19:29.8746051Z test (__main__.TestParallelLoader) ... ok 2024-12-18T00:19:30.2675771Z test (__main__.TestParallelTensorMNIST) ... ok 2024-12-18T00:19:31.1687455Z test_random_from_to_bool (__main__.TestRandom) ... ok 2024-12-18T00:19:31.3115373Z test_get_xla_tensor (__main__.TestSelect) ... ok 2024-12-18T00:19:31.4508242Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2024-12-18T00:19:31.4514449Z test (__main__.TestToXlaTensorArena) ... ok 2024-12-18T00:19:33.1821897Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2024-12-18T00:19:33.1959031Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2024-12-18T00:19:33.2084888Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2024-12-18T00:19:33.2085232Z 2024-12-18T00:19:33.2085398Z ---------------------------------------------------------------------- 2024-12-18T00:19:33.2085806Z Ran 205 tests in 27.174s 2024-12-18T00:19:33.2086210Z 2024-12-18T00:19:33.2086309Z OK (skipped=27) 2024-12-18T00:19:33.2610513Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:19:33.2611069Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:19:33.2611541Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2024-12-18T00:19:33.2611982Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:19:33.2612435Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:19:33.2612876Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2024-12-18T00:19:33.2613281Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:19:33.2613634Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:19:33.2613983Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2024-12-18T00:19:34.0446866Z + run_pt_xla_debug /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:34.0447710Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2024-12-18T00:19:34.0448803Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:34.0449411Z + PT_XLA_DEBUG=1 2024-12-18T00:19:34.0449744Z + PT_XLA_DEBUG_FILE=/tmp/pt_xla_debug.txt 2024-12-18T00:19:34.0450248Z + run_test /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:34.0450985Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2024-12-18T00:19:34.0451833Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:34.0452421Z ++ command -v nvidia-smi 2024-12-18T00:19:34.0452703Z + '[' -x '' ']' 2024-12-18T00:19:34.0452936Z + PJRT_DEVICE=CPU 2024-12-18T00:19:34.0453192Z + CPU_NUM_DEVICES=1 2024-12-18T00:19:34.0453634Z + run_coverage /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:34.0454145Z + '[' 0 '!=' 0 ']' 2024-12-18T00:19:34.0454564Z + python3 /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:38.1577443Z ......... 2024-12-18T00:19:38.1578407Z ---------------------------------------------------------------------- 2024-12-18T00:19:38.1579573Z Ran 9 tests in 1.131s 2024-12-18T00:19:38.1580052Z 2024-12-18T00:19:38.1580301Z OK 2024-12-18T00:19:38.1581026Z tensor([[ 0.4598, -0.0306, 0.2234, 0.5544, -0.5113], 2024-12-18T00:19:38.1581927Z [ 1.0380, -0.1918, 0.9208, -0.0310, 0.1858], 2024-12-18T00:19:38.1582284Z [ 0.0072, -0.9023, -1.3529, 0.3710, 1.9000], 2024-12-18T00:19:38.1582649Z [ 0.1453, 0.4618, -0.8955, -0.9982, -0.8850], 2024-12-18T00:19:38.1583033Z [ 0.9407, -0.0761, -0.9988, 0.7131, -0.7537]], device='xla:0') 2024-12-18T00:19:38.7296010Z + run_pt_xla_debug_level1 /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:38.7297038Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2024-12-18T00:19:38.7297936Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:38.7298656Z + PT_XLA_DEBUG_LEVEL=1 2024-12-18T00:19:38.7299047Z + PT_XLA_DEBUG_FILE=/tmp/pt_xla_debug.txt 2024-12-18T00:19:38.7299554Z + run_test /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:38.7300298Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2024-12-18T00:19:38.7301090Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:38.7301646Z ++ command -v nvidia-smi 2024-12-18T00:19:38.7301939Z + '[' -x '' ']' 2024-12-18T00:19:38.7302184Z + PJRT_DEVICE=CPU 2024-12-18T00:19:38.7302438Z + CPU_NUM_DEVICES=1 2024-12-18T00:19:38.7302878Z + run_coverage /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:38.7303557Z + '[' 0 '!=' 0 ']' 2024-12-18T00:19:38.7303962Z + python3 /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2024-12-18T00:19:42.8501362Z ......... 2024-12-18T00:19:42.8501811Z ---------------------------------------------------------------------- 2024-12-18T00:19:42.8502259Z Ran 9 tests in 1.112s 2024-12-18T00:19:42.8502446Z 2024-12-18T00:19:42.8502540Z OK 2024-12-18T00:19:42.8502830Z tensor([[ 0.4598, -0.0306, 0.2234, 0.5544, -0.5113], 2024-12-18T00:19:42.8503227Z [ 1.0380, -0.1918, 0.9208, -0.0310, 0.1858], 2024-12-18T00:19:42.8503571Z [ 0.0072, -0.9023, -1.3529, 0.3710, 1.9000], 2024-12-18T00:19:42.8503936Z [ 0.1453, 0.4618, -0.8955, -0.9982, -0.8850], 2024-12-18T00:19:42.8504334Z [ 0.9407, -0.0761, -0.9988, 0.7131, -0.7537]], device='xla:0') 2024-12-18T00:19:43.4277312Z + run_test /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2024-12-18T00:19:43.4278053Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_async_closures.py' 2024-12-18T00:19:43.4278815Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2024-12-18T00:19:43.4279561Z ++ command -v nvidia-smi 2024-12-18T00:19:43.4279901Z + '[' -x '' ']' 2024-12-18T00:19:43.4280135Z + PJRT_DEVICE=CPU 2024-12-18T00:19:43.4280461Z + CPU_NUM_DEVICES=1 2024-12-18T00:19:43.4280868Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2024-12-18T00:19:43.4281331Z + '[' 0 '!=' 0 ']' 2024-12-18T00:19:43.4281708Z + python3 /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2024-12-18T00:19:48.4203888Z .... 2024-12-18T00:19:48.4204403Z ---------------------------------------------------------------------- 2024-12-18T00:19:48.4205158Z Ran 4 tests in 2.012s 2024-12-18T00:19:48.4205475Z 2024-12-18T00:19:48.4205578Z OK 2024-12-18T00:19:48.9791024Z + run_test /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2024-12-18T00:19:48.9791758Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py' 2024-12-18T00:19:48.9792509Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2024-12-18T00:19:48.9793046Z ++ command -v nvidia-smi 2024-12-18T00:19:48.9794550Z + '[' -x '' ']' 2024-12-18T00:19:48.9794792Z + PJRT_DEVICE=CPU 2024-12-18T00:19:48.9795065Z + CPU_NUM_DEVICES=1 2024-12-18T00:19:48.9795466Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2024-12-18T00:19:48.9795922Z + '[' 0 '!=' 0 ']' 2024-12-18T00:19:48.9796293Z + python3 /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2024-12-18T00:19:51.9852139Z /opt/conda/lib/python3.10/site-packages/torch/__init__.py:1210: UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/tensor/python_tensor.cpp:436.) 2024-12-18T00:19:51.9853705Z _C._set_default_tensor_type(t) 2024-12-18T00:19:52.1054001Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:65: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2024-12-18T00:19:52.1055051Z if isinstance(candidate, dict): 2024-12-18T00:19:52.1055977Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:82: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2024-12-18T00:19:52.1057047Z elif isinstance(candidate, (list, tuple)): 2024-12-18T00:19:52.1057973Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:93: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2024-12-18T00:19:52.1058909Z elif hasattr(candidate, "__class__"): 2024-12-18T00:19:52.1059826Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:99: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2024-12-18T00:19:52.1060747Z if hasattr(candidate, att): 2024-12-18T00:19:52.1061836Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:100: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2024-12-18T00:19:52.1062763Z v = getattr(candidate, att) 2024-12-18T00:19:54.3043128Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1329, 'stackFrameId': 16} 2024-12-18T00:19:54.3046535Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1329, 'stackFrameId': 16} 2024-12-18T00:19:54.3049630Z {'opType': 'aten__permute', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__permute', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3052681Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1329, 'stackFrameId': 16} 2024-12-18T00:19:54.3055598Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1329, 'stackFrameId': 16} 2024-12-18T00:19:54.3058562Z {'opType': 'aten__permute', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__permute', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3061290Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/xla__device_data', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3063865Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3066387Z {'opType': 'aten__mul', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__mul', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3069006Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3071453Z {'opType': 'aten__add', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__add', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3073957Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3076456Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3078966Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3081474Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3083973Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3086459Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3088938Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3091406Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3093890Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3096428Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3099129Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3101673Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3104266Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3106829Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3109497Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3111993Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3114513Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3116977Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3119451Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3121928Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3124404Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3126882Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2024-12-18T00:19:54.3129491Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3132278Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3135018Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3138068Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3140897Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3143767Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3146726Z {'opType': 'aten__relu', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/ReLU[1]/aten__relu', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/functional.py', 'sourceLine': 1704, 'stackFrameId': 26} 2024-12-18T00:19:54.3149467Z {'opType': 'aten__relu', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/ReLU[1]/aten__relu', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/functional.py', 'sourceLine': 1704, 'stackFrameId': 26} 2024-12-18T00:19:54.3152211Z {'opType': 'aten__relu', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/ReLU[1]/aten__relu', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/functional.py', 'sourceLine': 1704, 'stackFrameId': 26} 2024-12-18T00:19:54.3154985Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3157879Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3160483Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3163149Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3165757Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3168391Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2024-12-18T00:19:54.3169871Z . 2024-12-18T00:19:54.3170144Z ---------------------------------------------------------------------- 2024-12-18T00:19:54.3170514Z Ran 1 test in 2.321s 2024-12-18T00:19:54.3170664Z 2024-12-18T00:19:54.3170760Z OK 2024-12-18T00:19:54.3172142Z {'opType': 'aten__tanh', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Tanh[3]/aten__tanh', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/activation.py', 'sourceLine': 392, 'stackFrameId': 27} 2024-12-18T00:19:54.3173587Z {} 2024-12-18T00:19:54.3173818Z All required metadata symbols matched 2024-12-18T00:19:54.8581564Z + run_test /var/lib/jenkins/workspace/xla/test/test_profiler.py 2024-12-18T00:19:54.8582281Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_profiler.py' 2024-12-18T00:19:54.8582959Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_profiler.py 2024-12-18T00:19:54.8583897Z ++ command -v nvidia-smi 2024-12-18T00:19:54.8586595Z + '[' -x '' ']' 2024-12-18T00:19:54.8586853Z + PJRT_DEVICE=CPU 2024-12-18T00:19:54.8587113Z + CPU_NUM_DEVICES=1 2024-12-18T00:19:54.8587489Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_profiler.py 2024-12-18T00:19:54.8587909Z + '[' 0 '!=' 0 ']' 2024-12-18T00:19:54.8588265Z + python3 /var/lib/jenkins/workspace/xla/test/test_profiler.py 2024-12-18T00:20:01.2992914Z Epoch 1 train begin 00:20:01 2024-12-18T00:20:01.2993536Z | Training Device=xla:0/0 Step=0 Loss=nan Rate=76.14 GlobalRate=76.13 Time=00:20:01 2024-12-18T00:20:05.2597475Z Starting to trace for 5000 ms. Remaining attempt(s): 4 2024-12-18T00:20:05.6847627Z | Training Device=xla:0/0 Step=20 Loss=1.92684 Rate=74.24 GlobalRate=73.12 Time=00:20:05 2024-12-18T00:20:06.2007085Z | Training Device=xla:0/0 Step=40 Loss=1.52069 Rate=401.62 GlobalRate=128.34 Time=00:20:06 2024-12-18T00:20:06.8450936Z | Training Device=xla:0/0 Step=60 Loss=1.04478 Rate=458.43 GlobalRate=169.56 Time=00:20:06 2024-12-18T00:20:07.5237942Z | Training Device=xla:0/0 Step=80 Loss=0.40812 Rate=466.27 GlobalRate=201.40 Time=00:20:07 2024-12-18T00:20:08.1956761Z | Training Device=xla:0/0 Step=100 Loss=0.09718 Rate=472.26 GlobalRate=227.39 Time=00:20:08 2024-12-18T00:20:08.8850089Z | Training Device=xla:0/0 Step=120 Loss=0.03902 Rate=467.45 GlobalRate=248.33 Time=00:20:08 2024-12-18T00:20:09.5592633Z | Training Device=xla:0/0 Step=140 Loss=0.02194 Rate=471.72 GlobalRate=266.34 Time=00:20:09 2024-12-18T00:20:10.2508608Z | Training Device=xla:0/0 Step=160 Loss=0.01457 Rate=466.32 GlobalRate=281.16 Time=00:20:10 2024-12-18T00:20:10.9292806Z | Training Device=xla:0/0 Step=180 Loss=0.01063 Rate=469.53 GlobalRate=294.30 Time=00:20:10 2024-12-18T00:20:11.5281158Z | Training Device=xla:0/0 Step=200 Loss=0.00823 Rate=508.71 GlobalRate=308.08 Time=00:20:11 2024-12-18T00:20:12.0700327Z | Training Device=xla:0/0 Step=220 Loss=0.00665 Rate=557.62 GlobalRate=322.01 Time=00:20:12 2024-12-18T00:20:12.6051962Z | Training Device=xla:0/0 Step=240 Loss=0.00553 Rate=581.80 GlobalRate=334.84 Time=00:20:12 2024-12-18T00:20:13.1360357Z | Training Device=xla:0/0 Step=260 Loss=0.00471 Rate=594.44 GlobalRate=346.65 Time=00:20:13 2024-12-18T00:20:13.6758216Z | Training Device=xla:0/0 Step=280 Loss=0.00408 Rate=593.49 GlobalRate=357.20 Time=00:20:13 2024-12-18T00:20:14.2065828Z | Training Device=xla:0/0 Step=300 Loss=0.00359 Rate=598.97 GlobalRate=367.14 Time=00:20:14 2024-12-18T00:20:14.7479483Z | Training Device=xla:0/0 Step=320 Loss=0.00320 Rate=594.51 GlobalRate=376.03 Time=00:20:14 2024-12-18T00:20:15.2771021Z | Training Device=xla:0/0 Step=340 Loss=0.00287 Rate=600.59 GlobalRate=384.55 Time=00:20:15 2024-12-18T00:20:15.7940537Z | Training Device=xla:0/0 Step=360 Loss=0.00260 Rate=611.43 GlobalRate=392.79 Time=00:20:15 2024-12-18T00:20:16.3135688Z | Training Device=xla:0/0 Step=380 Loss=0.00238 Rate=614.40 GlobalRate=400.41 Time=00:20:16 2024-12-18T00:20:16.8337640Z | Training Device=xla:0/0 Step=400 Loss=0.00218 Rate=614.80 GlobalRate=407.51 Time=00:20:16 2024-12-18T00:20:17.3549728Z | Training Device=xla:0/0 Step=420 Loss=0.00202 Rate=614.07 GlobalRate=414.11 Time=00:20:17 2024-12-18T00:20:17.8732540Z | Training Device=xla:0/0 Step=440 Loss=0.00187 Rate=616.22 GlobalRate=420.40 Time=00:20:17 2024-12-18T00:20:18.3925188Z | Training Device=xla:0/0 Step=460 Loss=0.00174 Rate=616.32 GlobalRate=426.28 Time=00:20:18 2024-12-18T00:20:18.9102479Z | Training Device=xla:0/0 Step=480 Loss=0.00163 Rate=617.17 GlobalRate=431.84 Time=00:20:18 2024-12-18T00:20:19.4298134Z | Training Device=xla:0/0 Step=500 Loss=0.00153 Rate=616.72 GlobalRate=437.07 Time=00:20:19 2024-12-18T00:20:19.9498774Z | Training Device=xla:0/0 Step=520 Loss=0.00144 Rate=615.75 GlobalRate=441.98 Time=00:20:19 2024-12-18T00:20:20.4697264Z | Training Device=xla:0/0 Step=540 Loss=0.00136 Rate=615.74 GlobalRate=446.64 Time=00:20:20 2024-12-18T00:20:20.9901704Z | Training Device=xla:0/0 Step=560 Loss=0.00129 Rate=614.91 GlobalRate=451.03 Time=00:20:20 2024-12-18T00:20:21.5094859Z | Training Device=xla:0/0 Step=580 Loss=0.00122 Rate=615.89 GlobalRate=455.23 Time=00:20:21 2024-12-18T00:20:22.0246333Z | Training Device=xla:0/0 Step=600 Loss=0.00116 Rate=619.11 GlobalRate=459.32 Time=00:20:22 2024-12-18T00:20:22.5443346Z | Training Device=xla:0/0 Step=620 Loss=0.00111 Rate=616.97 GlobalRate=463.10 Time=00:20:22 2024-12-18T00:20:23.0589414Z | Training Device=xla:0/0 Step=640 Loss=0.00106 Rate=619.73 GlobalRate=466.82 Time=00:20:23 2024-12-18T00:20:23.5771669Z | Training Device=xla:0/0 Step=660 Loss=0.00101 Rate=618.63 GlobalRate=470.30 Time=00:20:23 2024-12-18T00:20:24.0933770Z | Training Device=xla:0/0 Step=680 Loss=0.00097 Rate=619.40 GlobalRate=473.65 Time=00:20:24 2024-12-18T00:20:24.6120698Z | Training Device=xla:0/0 Step=700 Loss=0.00093 Rate=617.93 GlobalRate=476.81 Time=00:20:24 2024-12-18T00:20:25.1288990Z | Training Device=xla:0/0 Step=720 Loss=0.00089 Rate=618.75 GlobalRate=479.88 Time=00:20:25 2024-12-18T00:20:25.6459164Z | Training Device=xla:0/0 Step=740 Loss=0.00086 Rate=618.50 GlobalRate=482.79 Time=00:20:25 2024-12-18T00:20:26.1648897Z | Training Device=xla:0/0 Step=760 Loss=0.00083 Rate=617.48 GlobalRate=485.57 Time=00:20:26 2024-12-18T00:20:26.6846678Z | Training Device=xla:0/0 Step=780 Loss=0.00080 Rate=616.55 GlobalRate=488.21 Time=00:20:26 2024-12-18T00:20:27.2022294Z | Training Device=xla:0/0 Step=800 Loss=0.00077 Rate=617.33 GlobalRate=490.78 Time=00:20:27 2024-12-18T00:20:27.7227627Z | Training Device=xla:0/0 Step=820 Loss=0.00074 Rate=615.81 GlobalRate=493.21 Time=00:20:27 2024-12-18T00:20:28.2450277Z | Training Device=xla:0/0 Step=840 Loss=0.00072 Rate=613.93 GlobalRate=495.51 Time=00:20:28 2024-12-18T00:20:28.7695339Z | Training Device=xla:0/0 Step=860 Loss=0.00070 Rate=611.88 GlobalRate=497.68 Time=00:20:28 2024-12-18T00:20:29.2928490Z | Training Device=xla:0/0 Step=880 Loss=0.00067 Rate=611.54 GlobalRate=499.79 Time=00:20:29 2024-12-18T00:20:29.8205006Z | Training Device=xla:0/0 Step=900 Loss=0.00065 Rate=608.59 GlobalRate=501.75 Time=00:20:29 2024-12-18T00:20:30.3420688Z | Training Device=xla:0/0 Step=920 Loss=0.00063 Rate=611.41 GlobalRate=503.74 Time=00:20:30 2024-12-18T00:20:30.8639001Z | Training Device=xla:0/0 Step=940 Loss=0.00062 Rate=612.60 GlobalRate=505.66 Time=00:20:30 2024-12-18T00:20:31.3854438Z | Training Device=xla:0/0 Step=960 Loss=0.00060 Rate=612.94 GlobalRate=507.52 Time=00:20:31 2024-12-18T00:20:31.9092722Z | Training Device=xla:0/0 Step=980 Loss=0.00058 Rate=611.90 GlobalRate=509.28 Time=00:20:31 2024-12-18T00:20:32.4319688Z | Training Device=xla:0/0 Step=1000 Loss=0.00057 Rate=612.02 GlobalRate=510.99 Time=00:20:32 2024-12-18T00:20:32.9541826Z | Training Device=xla:0/0 Step=1020 Loss=0.00055 Rate=612.39 GlobalRate=512.66 Time=00:20:32 2024-12-18T00:20:33.4776998Z | Training Device=xla:0/0 Step=1040 Loss=0.00054 Rate=611.88 GlobalRate=514.26 Time=00:20:33 2024-12-18T00:20:33.9990541Z | Training Device=xla:0/0 Step=1060 Loss=0.00052 Rate=612.89 GlobalRate=515.83 Time=00:20:33 2024-12-18T00:20:34.5219232Z | Training Device=xla:0/0 Step=1080 Loss=0.00051 Rate=612.53 GlobalRate=517.34 Time=00:20:34 2024-12-18T00:20:35.0462050Z | Training Device=xla:0/0 Step=1100 Loss=0.00050 Rate=610.97 GlobalRate=518.77 Time=00:20:35 2024-12-18T00:20:35.5681786Z | Training Device=xla:0/0 Step=1120 Loss=0.00049 Rate=612.50 GlobalRate=520.20 Time=00:20:35 2024-12-18T00:20:36.0898579Z | Training Device=xla:0/0 Step=1140 Loss=0.00047 Rate=613.07 GlobalRate=521.59 Time=00:20:36 2024-12-18T00:20:36.6126869Z | Training Device=xla:0/0 Step=1160 Loss=0.00046 Rate=612.40 GlobalRate=522.92 Time=00:20:36 2024-12-18T00:20:37.1385894Z | Training Device=xla:0/0 Step=1180 Loss=0.00045 Rate=609.81 GlobalRate=524.17 Time=00:20:37 2024-12-18T00:20:37.6640208Z | Training Device=xla:0/0 Step=1200 Loss=0.00044 Rate=609.62 GlobalRate=525.39 Time=00:20:37 2024-12-18T00:20:38.1887080Z | Training Device=xla:0/0 Step=1220 Loss=0.00043 Rate=609.77 GlobalRate=526.58 Time=00:20:38 2024-12-18T00:20:38.7154287Z | Training Device=xla:0/0 Step=1240 Loss=0.00042 Rate=608.19 GlobalRate=527.71 Time=00:20:38 2024-12-18T00:20:39.2341338Z | Training Device=xla:0/0 Step=1260 Loss=0.00042 Rate=613.42 GlobalRate=528.93 Time=00:20:39 2024-12-18T00:20:39.7567899Z | Training Device=xla:0/0 Step=1280 Loss=0.00041 Rate=612.85 GlobalRate=530.05 Time=00:20:39 2024-12-18T00:20:40.2754803Z | Training Device=xla:0/0 Step=1300 Loss=0.00040 Rate=615.24 GlobalRate=531.20 Time=00:20:40 2024-12-18T00:20:40.7983808Z | Training Device=xla:0/0 Step=1320 Loss=0.00039 Rate=613.21 GlobalRate=532.27 Time=00:20:40 2024-12-18T00:20:41.3216065Z | Training Device=xla:0/0 Step=1340 Loss=0.00038 Rate=612.42 GlobalRate=533.30 Time=00:20:41 2024-12-18T00:20:41.8421493Z | Training Device=xla:0/0 Step=1360 Loss=0.00038 Rate=613.63 GlobalRate=534.34 Time=00:20:41 2024-12-18T00:20:42.3660811Z | Training Device=xla:0/0 Step=1380 Loss=0.00037 Rate=611.91 GlobalRate=535.31 Time=00:20:42 2024-12-18T00:20:42.9027599Z | Training Device=xla:0/0 Step=1400 Loss=0.00036 Rate=602.51 GlobalRate=536.09 Time=00:20:42 2024-12-18T00:20:43.4262144Z | Training Device=xla:0/0 Step=1420 Loss=0.00036 Rate=607.81 GlobalRate=537.02 Time=00:20:43 2024-12-18T00:20:43.9475619Z | Training Device=xla:0/0 Step=1440 Loss=0.00035 Rate=611.65 GlobalRate=537.96 Time=00:20:43 2024-12-18T00:20:44.4706778Z | Training Device=xla:0/0 Step=1460 Loss=0.00034 Rate=611.45 GlobalRate=538.84 Time=00:20:44 2024-12-18T00:20:44.9925515Z | Training Device=xla:0/0 Step=1480 Loss=0.00034 Rate=612.75 GlobalRate=539.73 Time=00:20:44 2024-12-18T00:20:45.5120149Z | Training Device=xla:0/0 Step=1500 Loss=0.00033 Rate=614.70 GlobalRate=540.62 Time=00:20:45 2024-12-18T00:20:46.0358491Z | Training Device=xla:0/0 Step=1520 Loss=0.00033 Rate=612.20 GlobalRate=541.44 Time=00:20:46 2024-12-18T00:20:46.5571301Z | Training Device=xla:0/0 Step=1540 Loss=0.00032 Rate=613.38 GlobalRate=542.27 Time=00:20:46 2024-12-18T00:20:47.0768972Z | Training Device=xla:0/0 Step=1560 Loss=0.00031 Rate=614.75 GlobalRate=543.10 Time=00:20:47 2024-12-18T00:20:47.5970180Z | Training Device=xla:0/0 Step=1580 Loss=0.00031 Rate=615.09 GlobalRate=543.91 Time=00:20:47 2024-12-18T00:20:48.1206210Z | Training Device=xla:0/0 Step=1600 Loss=0.00030 Rate=612.69 GlobalRate=544.66 Time=00:20:48 2024-12-18T00:20:48.6443632Z | Training Device=xla:0/0 Step=1620 Loss=0.00030 Rate=611.62 GlobalRate=545.39 Time=00:20:48 2024-12-18T00:20:49.1910818Z | Training Device=xla:0/0 Step=1640 Loss=0.00029 Rate=595.73 GlobalRate=545.84 Time=00:20:49 2024-12-18T00:20:49.7371456Z | Training Device=xla:0/0 Step=1660 Loss=0.00029 Rate=590.08 GlobalRate=546.29 Time=00:20:49 2024-12-18T00:20:50.2806056Z | Training Device=xla:0/0 Step=1680 Loss=0.00029 Rate=589.30 GlobalRate=546.76 Time=00:20:50 2024-12-18T00:20:50.8305983Z | Training Device=xla:0/0 Step=1700 Loss=0.00028 Rate=584.61 GlobalRate=547.15 Time=00:20:50 2024-12-18T00:20:51.3731611Z | Training Device=xla:0/0 Step=1720 Loss=0.00028 Rate=587.86 GlobalRate=547.61 Time=00:20:51 2024-12-18T00:20:51.9279359Z | Training Device=xla:0/0 Step=1740 Loss=0.00027 Rate=581.37 GlobalRate=547.93 Time=00:20:51 2024-12-18T00:20:52.4807806Z | Training Device=xla:0/0 Step=1760 Loss=0.00027 Rate=579.82 GlobalRate=548.26 Time=00:20:52 2024-12-18T00:20:53.0343056Z | Training Device=xla:0/0 Step=1780 Loss=0.00027 Rate=578.54 GlobalRate=548.58 Time=00:20:53 2024-12-18T00:20:53.5851088Z | Training Device=xla:0/0 Step=1800 Loss=0.00026 Rate=580.10 GlobalRate=548.92 Time=00:20:53 2024-12-18T00:20:54.1393293Z | Training Device=xla:0/0 Step=1820 Loss=0.00026 Rate=578.50 GlobalRate=549.22 Time=00:20:54 2024-12-18T00:20:54.6926598Z | Training Device=xla:0/0 Step=1840 Loss=0.00025 Rate=578.41 GlobalRate=549.52 Time=00:20:54 2024-12-18T00:20:55.2409896Z | Training Device=xla:0/0 Step=1860 Loss=0.00025 Rate=581.63 GlobalRate=549.86 Time=00:20:55 2024-12-18T00:20:55.7755759Z | Training Device=xla:0/0 Step=1880 Loss=0.00025 Rate=591.62 GlobalRate=550.34 Time=00:20:55 2024-12-18T00:20:56.3099828Z | Training Device=xla:0/0 Step=1900 Loss=0.00024 Rate=596.04 GlobalRate=550.81 Time=00:20:56 2024-12-18T00:20:56.8467579Z | Training Device=xla:0/0 Step=1920 Loss=0.00024 Rate=595.90 GlobalRate=551.24 Time=00:20:56 2024-12-18T00:20:57.3796219Z | Training Device=xla:0/0 Step=1940 Loss=0.00024 Rate=598.90 GlobalRate=551.71 Time=00:20:57 2024-12-18T00:20:57.9174870Z | Training Device=xla:0/0 Step=1960 Loss=0.00023 Rate=596.61 GlobalRate=552.12 Time=00:20:57 2024-12-18T00:20:58.4502110Z | Training Device=xla:0/0 Step=1980 Loss=0.00023 Rate=598.77 GlobalRate=552.57 Time=00:20:58 2024-12-18T00:20:58.9857433Z | Training Device=xla:0/0 Step=2000 Loss=0.00023 Rate=598.07 GlobalRate=552.98 Time=00:20:58 2024-12-18T00:20:59.5201375Z | Training Device=xla:0/0 Step=2020 Loss=0.00023 Rate=598.72 GlobalRate=553.41 Time=00:20:59 2024-12-18T00:21:03.9960821Z INFO:root:PT_XLA_DEBUG_FILE Contents: 2024-12-18T00:21:03.9961152Z 2024-12-18T00:21:03.9961398Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:03.9961886Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:03.9962339Z Compilation Analysis: mark_step in parallel loader at step end 2024-12-18T00:21:03.9962800Z Compilation Analysis: Graph Info: 2024-12-18T00:21:03.9963230Z Compilation Analysis: Graph Hash: 8ecc55525bd7a19a2f2e43714e9164b6 2024-12-18T00:21:03.9963733Z Compilation Analysis: Number of Graph Inputs: 0 2024-12-18T00:21:03.9964167Z Compilation Analysis: Number of Graph Outputs: 2 2024-12-18T00:21:03.9964646Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:03.9965577Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:03.9966952Z Compilation Analysis: next (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:46) 2024-12-18T00:21:03.9968567Z Compilation Analysis: __next__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:34) 2024-12-18T00:21:03.9969725Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:162) 2024-12-18T00:21:03.9970598Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:03.9971429Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:03.9972177Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:03.9972927Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:03.9973497Z Compilation Analysis: .......... 2024-12-18T00:21:03.9973985Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:03.9974682Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:03.9975045Z 2024-12-18T00:21:03.9975360Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:03.9975913Z Post Compilation Analysis: Graph input size: 0.000000 GB 2024-12-18T00:21:03.9976481Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:03.9976971Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:03.9977530Z Post Compilation Analysis: Intermediate tensor size: 0.000000 GB 2024-12-18T00:21:03.9978066Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:03.9978689Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:03.9979978Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:03.9980345Z 2024-12-18T00:21:03.9980571Z Execution Analysis: ================================================================================ 2024-12-18T00:21:03.9981038Z Execution Analysis: Execution Cause 2024-12-18T00:21:03.9981456Z Execution Analysis: mark_step in parallel loader at step end 2024-12-18T00:21:03.9981908Z Execution Analysis: Graph Info: 2024-12-18T00:21:03.9982328Z Execution Analysis: Graph Hash: 8ecc55525bd7a19a2f2e43714e9164b6 2024-12-18T00:21:03.9982801Z Execution Analysis: Number of Graph Inputs: 0 2024-12-18T00:21:03.9983221Z Execution Analysis: Number of Graph Outputs: 2 2024-12-18T00:21:03.9983666Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:03.9984553Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:03.9985903Z Execution Analysis: next (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:46) 2024-12-18T00:21:03.9987287Z Execution Analysis: __next__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:34) 2024-12-18T00:21:03.9988410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:162) 2024-12-18T00:21:03.9989279Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:03.9990092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:03.9990820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:03.9991531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:03.9992095Z Execution Analysis: .......... 2024-12-18T00:21:03.9992613Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:03.9993219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:03.9993550Z 2024-12-18T00:21:03.9993789Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:03.9994275Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:03.9994813Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:03.9995370Z Compilation Analysis: Graph Info: 2024-12-18T00:21:03.9995820Z Compilation Analysis: Graph Hash: b83ec5bec80db4e3a5c18fe98a85800b 2024-12-18T00:21:03.9996326Z Compilation Analysis: Number of Graph Inputs: 14 2024-12-18T00:21:03.9996764Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:03.9997227Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:03.9997898Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:03.9998797Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:03.9999659Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0000405Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0001156Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0001938Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0002648Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0003232Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0003761Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0004387Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0004730Z 2024-12-18T00:21:04.0004992Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0005538Z Post Compilation Analysis: Graph input size: 0.000128 GB 2024-12-18T00:21:04.0006020Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0006496Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0007016Z Post Compilation Analysis: Intermediate tensor size: 0.000000 GB 2024-12-18T00:21:04.0007546Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0008168Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0008832Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0009195Z 2024-12-18T00:21:04.0009424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0009874Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0010398Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0010945Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0011366Z Execution Analysis: Graph Hash: b83ec5bec80db4e3a5c18fe98a85800b 2024-12-18T00:21:04.0011853Z Execution Analysis: Number of Graph Inputs: 14 2024-12-18T00:21:04.0012259Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0012702Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0013361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0014215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0015053Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0015781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0037807Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0038560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0039283Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0039857Z Execution Analysis: (:1) 2024-12-18T00:21:04.0040393Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0041009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0041344Z 2024-12-18T00:21:04.0041583Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0042150Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0042656Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0043192Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0043647Z Compilation Analysis: Graph Hash: efbdc6684444f2996e9835a39c4e0938 2024-12-18T00:21:04.0044334Z Compilation Analysis: Number of Graph Inputs: 17 2024-12-18T00:21:04.0044779Z Compilation Analysis: Number of Graph Outputs: 49 2024-12-18T00:21:04.0045281Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0046304Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0047644Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0048753Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0049630Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0050462Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0051212Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0051946Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0052689Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0053224Z Compilation Analysis: .......... 2024-12-18T00:21:04.0053720Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0054353Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0054697Z 2024-12-18T00:21:04.0054959Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0055498Z Post Compilation Analysis: Graph input size: 0.000128 GB 2024-12-18T00:21:04.0055978Z Post Compilation Analysis: Graph output size: 0.000307 GB 2024-12-18T00:21:04.0056564Z Post Compilation Analysis: Aliased Input size: 0.000082 GB 2024-12-18T00:21:04.0057090Z Post Compilation Analysis: Intermediate tensor size: 0.000060 GB 2024-12-18T00:21:04.0057626Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0058254Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0058907Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0059279Z 2024-12-18T00:21:04.0059493Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0060024Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0060489Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0060983Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0061420Z Execution Analysis: Graph Hash: efbdc6684444f2996e9835a39c4e0938 2024-12-18T00:21:04.0061890Z Execution Analysis: Number of Graph Inputs: 17 2024-12-18T00:21:04.0062314Z Execution Analysis: Number of Graph Outputs: 49 2024-12-18T00:21:04.0062764Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0063666Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0064968Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0066044Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0066946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0067775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0068505Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0069235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0069989Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0070509Z Execution Analysis: .......... 2024-12-18T00:21:04.0070979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0071571Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0071916Z 2024-12-18T00:21:04.0072141Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0072621Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0073169Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0073729Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0074176Z Compilation Analysis: Graph Hash: 39cf685c62e9d738835548b76225facb 2024-12-18T00:21:04.0074660Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0075098Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0075558Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0076237Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0077116Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0077949Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0078683Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0079433Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0080183Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0080908Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0081491Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0082023Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0082636Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0082996Z 2024-12-18T00:21:04.0083273Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0083823Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0084304Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0084791Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0085305Z Post Compilation Analysis: Intermediate tensor size: 0.000061 GB 2024-12-18T00:21:04.0085828Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0086424Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0087080Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0087454Z 2024-12-18T00:21:04.0087665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0088125Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0088679Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0089232Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0089627Z Execution Analysis: Graph Hash: 39cf685c62e9d738835548b76225facb 2024-12-18T00:21:04.0090125Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0090525Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0090950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0091583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0092443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0093227Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0093934Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0094645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0095338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0096023Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0096645Z Execution Analysis: (:1) 2024-12-18T00:21:04.0097127Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0097707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0098031Z 2024-12-18T00:21:04.0098246Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0098709Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0099166Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0099637Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0100056Z Compilation Analysis: Graph Hash: 2bd89355ed80ca5c8e4a4537c5b56de1 2024-12-18T00:21:04.0100535Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0100950Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0101392Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0102287Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0103586Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0104651Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0105493Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0106341Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0107070Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0107805Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0108526Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0109034Z Compilation Analysis: .......... 2024-12-18T00:21:04.0109501Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0110105Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0110454Z 2024-12-18T00:21:04.0110693Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0111229Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0111708Z Post Compilation Analysis: Graph output size: 0.000319 GB 2024-12-18T00:21:04.0112170Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0112684Z Post Compilation Analysis: Intermediate tensor size: 0.000103 GB 2024-12-18T00:21:04.0113198Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0113794Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0114478Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0114831Z 2024-12-18T00:21:04.0115048Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0115480Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0115920Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0116383Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0116787Z Execution Analysis: Graph Hash: 2bd89355ed80ca5c8e4a4537c5b56de1 2024-12-18T00:21:04.0117272Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0117697Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0118146Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0119025Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0120334Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0121408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0122262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0123073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0123800Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0124525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0125233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0125750Z Execution Analysis: .......... 2024-12-18T00:21:04.0126226Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0126833Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0127454Z pt-xla-profiler: TransferFromDeviceTime too frequent: 3 counts during 3 steps 2024-12-18T00:21:04.0127848Z 2024-12-18T00:21:04.0128082Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0128577Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0129128Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0129683Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0130130Z Compilation Analysis: Graph Hash: 8a19360deb1b6632ada9ed126549811e 2024-12-18T00:21:04.0130638Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0131068Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0131523Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0132202Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0133067Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0133894Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0134676Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0135424Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0136178Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0137010Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0137598Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0138166Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0138798Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0139142Z 2024-12-18T00:21:04.0139398Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0139954Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0140426Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0140913Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0141429Z Post Compilation Analysis: Intermediate tensor size: 0.000086 GB 2024-12-18T00:21:04.0141959Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0142565Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0143231Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0143590Z 2024-12-18T00:21:04.0143804Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0144395Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0144925Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0145507Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0145942Z Execution Analysis: Graph Hash: 8a19360deb1b6632ada9ed126549811e 2024-12-18T00:21:04.0146427Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0146832Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0147277Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0147934Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0148791Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0149592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0150321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0151033Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0151828Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0152534Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0153097Z Execution Analysis: (:1) 2024-12-18T00:21:04.0153614Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0154221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0154554Z 2024-12-18T00:21:04.0154780Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0155267Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0155757Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0156255Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0156702Z Compilation Analysis: Graph Hash: d9aa47f58a09f175eed51086074023be 2024-12-18T00:21:04.0157244Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0157668Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0158129Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0159083Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0160406Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0161980Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0162877Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0163705Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0164448Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0165192Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0165934Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0166463Z Compilation Analysis: .......... 2024-12-18T00:21:04.0166959Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0167586Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0167927Z 2024-12-18T00:21:04.0168167Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0168710Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0169199Z Post Compilation Analysis: Graph output size: 0.000331 GB 2024-12-18T00:21:04.0169688Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0170199Z Post Compilation Analysis: Intermediate tensor size: 0.000204 GB 2024-12-18T00:21:04.0170732Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0171332Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0172000Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0172377Z 2024-12-18T00:21:04.0172590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0173044Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0173500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0173981Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0174439Z Execution Analysis: Graph Hash: d9aa47f58a09f175eed51086074023be 2024-12-18T00:21:04.0174925Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0175353Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0175791Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0176778Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0178086Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0179161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0179986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0180781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0181537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0182249Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0182987Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0183484Z Execution Analysis: .......... 2024-12-18T00:21:04.0183935Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0184544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0185143Z pt-xla-profiler: TransferFromDeviceTime too frequent: 4 counts during 4 steps 2024-12-18T00:21:04.0185535Z 2024-12-18T00:21:04.0185749Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0186210Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0186741Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0187272Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0187698Z Compilation Analysis: Graph Hash: 34517147039b7b62bc9db1e4e9155299 2024-12-18T00:21:04.0188183Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0188597Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0189031Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0189682Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0190523Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0191329Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0192051Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0192777Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0193496Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0194203Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0194761Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0195263Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0195867Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0196204Z 2024-12-18T00:21:04.0196436Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0196968Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0197456Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0197920Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0198412Z Post Compilation Analysis: Intermediate tensor size: 0.000129 GB 2024-12-18T00:21:04.0198929Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0199517Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0200154Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0200508Z 2024-12-18T00:21:04.0200723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0201162Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0201658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0202175Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0202587Z Execution Analysis: Graph Hash: 34517147039b7b62bc9db1e4e9155299 2024-12-18T00:21:04.0203075Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0203476Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0203887Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0204559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0205397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0206209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0206914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0207614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0208309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0208996Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0209529Z Execution Analysis: (:1) 2024-12-18T00:21:04.0210014Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0210621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0210956Z 2024-12-18T00:21:04.0211196Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0211678Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0212158Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0212653Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0213099Z Compilation Analysis: Graph Hash: a2e2a7888f093b3355ec2d9fde261246 2024-12-18T00:21:04.0213601Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0214043Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0214511Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0215420Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0216838Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0217940Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0218814Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0219637Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0220385Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0221170Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0221896Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0222428Z Compilation Analysis: .......... 2024-12-18T00:21:04.0222919Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0223549Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0223891Z 2024-12-18T00:21:04.0224143Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0224700Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0225168Z Post Compilation Analysis: Graph output size: 0.000342 GB 2024-12-18T00:21:04.0225644Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0226164Z Post Compilation Analysis: Intermediate tensor size: 0.000402 GB 2024-12-18T00:21:04.0226711Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0227330Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0228017Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0228379Z 2024-12-18T00:21:04.0228591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0229082Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0229552Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0230036Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0230458Z Execution Analysis: Graph Hash: a2e2a7888f093b3355ec2d9fde261246 2024-12-18T00:21:04.0230945Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0231354Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0231799Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0232694Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0233994Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0235073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0235923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0236726Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0237443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0238174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0238894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0239411Z Execution Analysis: .......... 2024-12-18T00:21:04.0239881Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0240482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0241090Z pt-xla-profiler: TransferFromDeviceTime too frequent: 5 counts during 5 steps 2024-12-18T00:21:04.0241492Z 2024-12-18T00:21:04.0241713Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0242200Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0242752Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0243341Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0243784Z Compilation Analysis: Graph Hash: 59f895226d5edb2aafc922ad98ef0b 2024-12-18T00:21:04.0244397Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0244838Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0245306Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0245987Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0246874Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0247711Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0248452Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0249202Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0249998Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0250731Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0251344Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0251873Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0252484Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0252842Z 2024-12-18T00:21:04.0253126Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0253680Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0254154Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0254636Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0255152Z Post Compilation Analysis: Intermediate tensor size: 0.000172 GB 2024-12-18T00:21:04.0255684Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0256280Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0257052Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0257427Z 2024-12-18T00:21:04.0257640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0258106Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0258635Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0259186Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0259590Z Execution Analysis: Graph Hash: 59f895226d5edb2aafc922ad98ef0b 2024-12-18T00:21:04.0260062Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0260478Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0260921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0261580Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0262434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0263228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0263959Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0264686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0265403Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0266105Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0266719Z Execution Analysis: (:1) 2024-12-18T00:21:04.0267224Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0267834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0268179Z 2024-12-18T00:21:04.0268403Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0268879Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0269360Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0269862Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0270299Z Compilation Analysis: Graph Hash: 43c1fea2812cc3cbdebebecdf13a5436 2024-12-18T00:21:04.0270804Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0271247Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0271713Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0272661Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0274015Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0275110Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0275994Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0276823Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0277575Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0278320Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0279064Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0279596Z Compilation Analysis: .......... 2024-12-18T00:21:04.0280072Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0280694Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0281053Z 2024-12-18T00:21:04.0281297Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0281849Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0282325Z Post Compilation Analysis: Graph output size: 0.000354 GB 2024-12-18T00:21:04.0282809Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0283303Z Post Compilation Analysis: Intermediate tensor size: 0.000557 GB 2024-12-18T00:21:04.0283837Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0284454Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0285114Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0285477Z 2024-12-18T00:21:04.0285701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0286162Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0286621Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0287093Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0287528Z Execution Analysis: Graph Hash: 43c1fea2812cc3cbdebebecdf13a5436 2024-12-18T00:21:04.0288023Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0288438Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0288914Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0289800Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0291102Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0292176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0293032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0293837Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0294571Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0295295Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0296043Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0296661Z Execution Analysis: .......... 2024-12-18T00:21:04.0297137Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0297773Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0298396Z pt-xla-profiler: TransferFromDeviceTime too frequent: 6 counts during 6 steps 2024-12-18T00:21:04.0298793Z 2024-12-18T00:21:04.0299056Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0299534Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0372593Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0373154Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0373592Z Compilation Analysis: Graph Hash: 763cf412a6fecdf90b7446155096482 2024-12-18T00:21:04.0374075Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0374496Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0374937Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0375606Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0376548Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0377360Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0378090Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0378819Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0379531Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0380249Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0380809Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0381322Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0381937Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0382285Z 2024-12-18T00:21:04.0382519Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0383051Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0383507Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0383975Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0384464Z Post Compilation Analysis: Intermediate tensor size: 0.000215 GB 2024-12-18T00:21:04.0385088Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0385694Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0386333Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0386693Z 2024-12-18T00:21:04.0386899Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0387335Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0387843Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0388365Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0388763Z Execution Analysis: Graph Hash: 763cf412a6fecdf90b7446155096482 2024-12-18T00:21:04.0389223Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0389623Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0390040Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0390727Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0391557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0392382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0393110Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0393842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0394600Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0395308Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0395859Z Execution Analysis: (:1) 2024-12-18T00:21:04.0396378Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0396992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0397337Z 2024-12-18T00:21:04.0397564Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0398053Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0398543Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0399030Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0399480Z Compilation Analysis: Graph Hash: c8a558257ee6602c53ba9348ca9f6069 2024-12-18T00:21:04.0399986Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0400428Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0400900Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0401830Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0403170Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0404251Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0405122Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0405956Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0406707Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0407460Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0408200Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0408773Z Compilation Analysis: .......... 2024-12-18T00:21:04.0409262Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0409900Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0410261Z 2024-12-18T00:21:04.0410505Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0411060Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0411541Z Post Compilation Analysis: Graph output size: 0.000366 GB 2024-12-18T00:21:04.0412032Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0412536Z Post Compilation Analysis: Intermediate tensor size: 0.000695 GB 2024-12-18T00:21:04.0413074Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0413695Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0414385Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0414780Z 2024-12-18T00:21:04.0415012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0415476Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0415929Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0416501Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0416965Z Execution Analysis: Graph Hash: c8a558257ee6602c53ba9348ca9f6069 2024-12-18T00:21:04.0417437Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0417838Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0418262Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0419132Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0420413Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0421476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0422302Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0423091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0423794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0424501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0425193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0425686Z Execution Analysis: .......... 2024-12-18T00:21:04.0426148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0426729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0427326Z pt-xla-profiler: TransferFromDeviceTime too frequent: 7 counts during 7 steps 2024-12-18T00:21:04.0427711Z 2024-12-18T00:21:04.0427930Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0428388Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0428918Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0429454Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0429877Z Compilation Analysis: Graph Hash: b774a48bd64b34790a2f252a7aac4de8 2024-12-18T00:21:04.0430358Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0430804Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0431247Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0431915Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0432770Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0433578Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0434309Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0435032Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0435750Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0436527Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0437088Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0437632Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0438265Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0438599Z 2024-12-18T00:21:04.0438848Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0439377Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0439872Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0440341Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0440832Z Post Compilation Analysis: Intermediate tensor size: 0.000257 GB 2024-12-18T00:21:04.0441340Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0441936Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0442580Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0442931Z 2024-12-18T00:21:04.0443140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0443582Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0444085Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0444772Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0445176Z Execution Analysis: Graph Hash: b774a48bd64b34790a2f252a7aac4de8 2024-12-18T00:21:04.0445640Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0446032Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0446463Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0447106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0447943Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0448725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0449436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0450133Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0450833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0451521Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0452060Z Execution Analysis: (:1) 2024-12-18T00:21:04.0452551Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0453197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0453526Z 2024-12-18T00:21:04.0453743Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0454210Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0454686Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0455166Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0455598Z Compilation Analysis: Graph Hash: e7082fada3df93f0628f974bfd2bb0b0 2024-12-18T00:21:04.0456080Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0456569Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0457015Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0457914Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0459264Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0460339Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0461235Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0462045Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0462803Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0463539Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0464259Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0464765Z Compilation Analysis: .......... 2024-12-18T00:21:04.0465252Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0465864Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0466204Z 2024-12-18T00:21:04.0466445Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0466980Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0467443Z Post Compilation Analysis: Graph output size: 0.000377 GB 2024-12-18T00:21:04.0467907Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0468407Z Post Compilation Analysis: Intermediate tensor size: 0.000835 GB 2024-12-18T00:21:04.0468917Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0469506Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0470148Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0470511Z 2024-12-18T00:21:04.0470717Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0471157Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0471608Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0472066Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0472471Z Execution Analysis: Graph Hash: e7082fada3df93f0628f974bfd2bb0b0 2024-12-18T00:21:04.0472929Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0473329Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0473756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0474636Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0475958Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0477013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0477839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0478618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0479324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0480026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0480717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0481211Z Execution Analysis: .......... 2024-12-18T00:21:04.0481663Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0482277Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0482876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 8 counts during 8 steps 2024-12-18T00:21:04.0483298Z 2024-12-18T00:21:04.0483516Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0483979Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0484511Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0485072Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0485502Z Compilation Analysis: Graph Hash: 788bc2e45c2553e4f0954f6aad4ccc05 2024-12-18T00:21:04.0485984Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0486398Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0486839Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0487495Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0488338Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0489150Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0489886Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0490621Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0491338Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0492041Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0492595Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0493116Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0493720Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0494062Z 2024-12-18T00:21:04.0494299Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0494828Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0495280Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0495743Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0496228Z Post Compilation Analysis: Intermediate tensor size: 0.000300 GB 2024-12-18T00:21:04.0496824Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0497411Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0498085Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0498439Z 2024-12-18T00:21:04.0498648Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0499086Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0499582Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0500102Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0500503Z Execution Analysis: Graph Hash: 788bc2e45c2553e4f0954f6aad4ccc05 2024-12-18T00:21:04.0500964Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0501356Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0501779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0502404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0503235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0504043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0504751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0505478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0506176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0506853Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0507411Z Execution Analysis: (:1) 2024-12-18T00:21:04.0507900Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0508481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0508807Z 2024-12-18T00:21:04.0509030Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0509488Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0509949Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0510429Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0510851Z Compilation Analysis: Graph Hash: 390d590fe13ff503fdb247bd2f1207ba 2024-12-18T00:21:04.0511328Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0511747Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0512189Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0513077Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0514376Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0515449Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0516302Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0517112Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0517842Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0518569Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0519274Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0519783Z Compilation Analysis: .......... 2024-12-18T00:21:04.0520571Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0521293Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0521739Z 2024-12-18T00:21:04.0522051Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0522720Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0523328Z Post Compilation Analysis: Graph output size: 0.000389 GB 2024-12-18T00:21:04.0524009Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0524636Z Post Compilation Analysis: Intermediate tensor size: 0.000975 GB 2024-12-18T00:21:04.0525284Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0526045Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0526862Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0527334Z 2024-12-18T00:21:04.0527615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0528251Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0528847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0529455Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0529953Z Execution Analysis: Graph Hash: 390d590fe13ff503fdb247bd2f1207ba 2024-12-18T00:21:04.0530531Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0531091Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0531679Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0532727Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0534262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0535568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0536590Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0537524Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0538408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0539285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0540281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0540951Z Execution Analysis: .......... 2024-12-18T00:21:04.0541565Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0542233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0542986Z pt-xla-profiler: TransferFromDeviceTime too frequent: 9 counts during 9 steps 2024-12-18T00:21:04.0543439Z 2024-12-18T00:21:04.0543730Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0544434Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0545148Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0545853Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0546406Z Compilation Analysis: Graph Hash: 42277f01749c3444fbc7a4739d23129 2024-12-18T00:21:04.0546986Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0547524Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0548148Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0548930Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0550047Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0551002Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0551851Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0552653Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0553545Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0554401Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0555115Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0555752Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0556488Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0556903Z 2024-12-18T00:21:04.0557228Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0557906Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0558552Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0559149Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0559789Z Post Compilation Analysis: Intermediate tensor size: 0.000343 GB 2024-12-18T00:21:04.0560497Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0561183Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0562034Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0562483Z 2024-12-18T00:21:04.0562759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0563385Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0564046Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0564737Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0565252Z Execution Analysis: Graph Hash: 42277f01749c3444fbc7a4739d23129 2024-12-18T00:21:04.0565816Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0566320Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0566901Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0567710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0568773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0569704Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0570540Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0571352Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0572156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0572977Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0573632Z Execution Analysis: (:1) 2024-12-18T00:21:04.0574259Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0574998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0575362Z 2024-12-18T00:21:04.0575678Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0576261Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0576972Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0577636Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0578221Z Compilation Analysis: Graph Hash: 257471d2cd7202d84a0b3b4467ac3a4d 2024-12-18T00:21:04.0578845Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0579422Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0579980Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0581044Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0582510Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0583780Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0584796Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0585765Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0586796Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0587664Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0588582Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0589248Z Compilation Analysis: .......... 2024-12-18T00:21:04.0589861Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0590556Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0591061Z 2024-12-18T00:21:04.0591344Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0592021Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0592614Z Post Compilation Analysis: Graph output size: 0.000401 GB 2024-12-18T00:21:04.0593231Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0593835Z Post Compilation Analysis: Intermediate tensor size: 0.001114 GB 2024-12-18T00:21:04.0594518Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0595267Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0596119Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0596577Z 2024-12-18T00:21:04.0596843Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0597424Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0598020Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0598617Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0599093Z Execution Analysis: Graph Hash: 257471d2cd7202d84a0b3b4467ac3a4d 2024-12-18T00:21:04.0599692Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0600224Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0600764Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0601780Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0603237Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0604396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0605380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0606284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0607099Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0607961Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0608784Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0609405Z Execution Analysis: .......... 2024-12-18T00:21:04.0609946Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0610645Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0611374Z pt-xla-profiler: TransferFromDeviceTime too frequent: 10 counts during 10 steps 2024-12-18T00:21:04.0612365Z 2024-12-18T00:21:04.0612663Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0613270Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0613963Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0614680Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0615170Z Compilation Analysis: Graph Hash: 5630d62e6b2bd9d451334a51e03a5e24 2024-12-18T00:21:04.0615793Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0616460Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0617012Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0617845Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0618815Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0619669Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0620636Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0621478Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0622318Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0623153Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0623827Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0624424Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0625154Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0625570Z 2024-12-18T00:21:04.0625853Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0626513Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0627080Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0627718Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0628370Z Post Compilation Analysis: Intermediate tensor size: 0.000386 GB 2024-12-18T00:21:04.0628945Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0629643Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0630442Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0630876Z 2024-12-18T00:21:04.0631130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0631751Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0632392Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0632993Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0633515Z Execution Analysis: Graph Hash: 5630d62e6b2bd9d451334a51e03a5e24 2024-12-18T00:21:04.0634110Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0634687Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0635245Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0636010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0636906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0787746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0788507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0789487Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0790170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0790887Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0791412Z Execution Analysis: (:1) 2024-12-18T00:21:04.0791895Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0792515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0792839Z 2024-12-18T00:21:04.0793055Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0793494Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0793944Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0794405Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0794824Z Compilation Analysis: Graph Hash: 9aabbfbd80b08d784e7123e61bdf79c2 2024-12-18T00:21:04.0795294Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0795690Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0796122Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0796996Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0798268Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0799307Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0800213Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0800953Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0801616Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0802288Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0802948Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0803418Z Compilation Analysis: .......... 2024-12-18T00:21:04.0803854Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0804407Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0804715Z 2024-12-18T00:21:04.0804931Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0805469Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0805893Z Post Compilation Analysis: Graph output size: 0.000413 GB 2024-12-18T00:21:04.0806320Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0806777Z Post Compilation Analysis: Intermediate tensor size: 0.001253 GB 2024-12-18T00:21:04.0807248Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0807788Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0808375Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0808705Z 2024-12-18T00:21:04.0808891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0809302Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0809704Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0810145Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0810517Z Execution Analysis: Graph Hash: 9aabbfbd80b08d784e7123e61bdf79c2 2024-12-18T00:21:04.0810974Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0811337Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0811727Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0812528Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0813721Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0814682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0815444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0816165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0817079Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0817781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0818484Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0818971Z Execution Analysis: .......... 2024-12-18T00:21:04.0819425Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0819999Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0820542Z pt-xla-profiler: CompileTime too frequent: 21 counts during 11 steps 2024-12-18T00:21:04.0821150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 11 counts during 11 steps 2024-12-18T00:21:04.0821541Z 2024-12-18T00:21:04.0821763Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0822219Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0822743Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0823272Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0823699Z Compilation Analysis: Graph Hash: d4eede7a74e10a1d4f616f6d6de5a967 2024-12-18T00:21:04.0824182Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0824583Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0825023Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0825680Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0826524Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0827371Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0828095Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0828816Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0829619Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0830297Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0830842Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0831340Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0831926Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0832251Z 2024-12-18T00:21:04.0832512Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0833020Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0833489Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0833938Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0834418Z Post Compilation Analysis: Intermediate tensor size: 0.000429 GB 2024-12-18T00:21:04.0834905Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0835516Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0836138Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0836486Z 2024-12-18T00:21:04.0836682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0837109Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0837597Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0838103Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0838499Z Execution Analysis: Graph Hash: d4eede7a74e10a1d4f616f6d6de5a967 2024-12-18T00:21:04.0838948Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0839327Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0839733Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0840450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0841210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0841926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0842573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0843221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0843866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0844825Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0845360Z Execution Analysis: (:1) 2024-12-18T00:21:04.0845842Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0846421Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0846757Z 2024-12-18T00:21:04.0846972Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0847431Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0847955Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0848423Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0848841Z Compilation Analysis: Graph Hash: dfdc721239b94e09b6433eb7699158f1 2024-12-18T00:21:04.0849322Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0849743Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0850190Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0851081Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0852378Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0853437Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0854285Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0855130Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0855855Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0856715Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0857439Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0857936Z Compilation Analysis: .......... 2024-12-18T00:21:04.0858451Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0859060Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0859399Z 2024-12-18T00:21:04.0859629Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0860157Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0860609Z Post Compilation Analysis: Graph output size: 0.000424 GB 2024-12-18T00:21:04.0861073Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0861560Z Post Compilation Analysis: Intermediate tensor size: 0.001392 GB 2024-12-18T00:21:04.0861756Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0862045Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0862282Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0862288Z 2024-12-18T00:21:04.0862487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0862604Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0862837Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0862945Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0863159Z Execution Analysis: Graph Hash: dfdc721239b94e09b6433eb7699158f1 2024-12-18T00:21:04.0863303Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0863452Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0863619Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0864216Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0864793Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0865152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0865508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0865846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0866122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0866426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0866699Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0866801Z Execution Analysis: .......... 2024-12-18T00:21:04.0867063Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0867263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0867485Z pt-xla-profiler: CompileTime too frequent: 23 counts during 12 steps 2024-12-18T00:21:04.0867764Z pt-xla-profiler: TransferFromDeviceTime too frequent: 12 counts during 12 steps 2024-12-18T00:21:04.0867771Z 2024-12-18T00:21:04.0868015Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0868140Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0868581Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0868692Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0868888Z Compilation Analysis: Graph Hash: 9dd4c1b64f5f37376ad8f00b43da0395 2024-12-18T00:21:04.0869025Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0869194Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0869358Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0869703Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0870036Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0870343Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0870604Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0870904Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0871161Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0871438Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0871569Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0871817Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0872024Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0872030Z 2024-12-18T00:21:04.0872244Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0872411Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0872575Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0872737Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0872929Z Post Compilation Analysis: Intermediate tensor size: 0.000472 GB 2024-12-18T00:21:04.0873106Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0873377Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0873595Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0873599Z 2024-12-18T00:21:04.0873791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0873919Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0874196Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0874299Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0874495Z Execution Analysis: Graph Hash: 9dd4c1b64f5f37376ad8f00b43da0395 2024-12-18T00:21:04.0874631Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0874758Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0874919Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0875252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0875576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0875864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0876113Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0876428Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0876677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0876979Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0877097Z Execution Analysis: (:1) 2024-12-18T00:21:04.0877345Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0877555Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0877560Z 2024-12-18T00:21:04.0877761Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0877873Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0878092Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0878209Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0878406Z Compilation Analysis: Graph Hash: d8e83d58f8e29a62cc714a3323fb3403 2024-12-18T00:21:04.0878554Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0878694Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0878865Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0879426Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0879968Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0880318Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0880649Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0880961Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0881224Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0881529Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0881782Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0881884Z Compilation Analysis: .......... 2024-12-18T00:21:04.0882135Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0882328Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0882332Z 2024-12-18T00:21:04.0882552Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0882732Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0882901Z Post Compilation Analysis: Graph output size: 0.000436 GB 2024-12-18T00:21:04.0883061Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0883255Z Post Compilation Analysis: Intermediate tensor size: 0.001533 GB 2024-12-18T00:21:04.0883427Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0883690Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0883914Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0883918Z 2024-12-18T00:21:04.0884106Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0884216Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0884430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0884542Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0884752Z Execution Analysis: Graph Hash: d8e83d58f8e29a62cc714a3323fb3403 2024-12-18T00:21:04.0884889Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0885058Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0885210Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0885763Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0886317Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0886655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0886978Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0887274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0887524Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0887822Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0888066Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0888161Z Execution Analysis: .......... 2024-12-18T00:21:04.0888406Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0888591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0888805Z pt-xla-profiler: CompileTime too frequent: 25 counts during 13 steps 2024-12-18T00:21:04.0889055Z pt-xla-profiler: TransferFromDeviceTime too frequent: 13 counts during 13 steps 2024-12-18T00:21:04.0889062Z 2024-12-18T00:21:04.0889270Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0889382Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0889662Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0889775Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0889969Z Compilation Analysis: Graph Hash: 5aa412b2a1441a548c4643ee321f9f49 2024-12-18T00:21:04.0890111Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0890257Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0890429Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0890772Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0891103Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0891441Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0891706Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0892010Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0892263Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0892546Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0892672Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0892933Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0893130Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0893135Z 2024-12-18T00:21:04.0893358Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0893539Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0893707Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0893906Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0894093Z Post Compilation Analysis: Intermediate tensor size: 0.000515 GB 2024-12-18T00:21:04.0894274Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0894561Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0894783Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0894787Z 2024-12-18T00:21:04.0894978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0895085Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0895363Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0895466Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0895664Z Execution Analysis: Graph Hash: 5aa412b2a1441a548c4643ee321f9f49 2024-12-18T00:21:04.0895797Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0895934Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0896092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0896527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0897039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0897348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0897713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0898022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0898291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0898580Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0898700Z Execution Analysis: (:1) 2024-12-18T00:21:04.0898965Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0899170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0899175Z 2024-12-18T00:21:04.0899395Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0899515Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0899758Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0899904Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0900128Z Compilation Analysis: Graph Hash: bd244e798be1239ec3ee064ad436f47c 2024-12-18T00:21:04.0900277Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0900431Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0900611Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0901217Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0901805Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0902175Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0902540Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0902889Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0903179Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0903528Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0903802Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0903919Z Compilation Analysis: .......... 2024-12-18T00:21:04.0904210Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0904433Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0904439Z 2024-12-18T00:21:04.0904669Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0904851Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0905028Z Post Compilation Analysis: Graph output size: 0.000448 GB 2024-12-18T00:21:04.0905212Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0905415Z Post Compilation Analysis: Intermediate tensor size: 0.001744 GB 2024-12-18T00:21:04.0905608Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0905902Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0906134Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0906139Z 2024-12-18T00:21:04.0906345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0906455Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0906693Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0906803Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0907015Z Execution Analysis: Graph Hash: bd244e798be1239ec3ee064ad436f47c 2024-12-18T00:21:04.0907165Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0907314Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0907486Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0908072Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0908763Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0909091Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0909424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0910486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0910739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0911034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0911278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0911381Z Execution Analysis: .......... 2024-12-18T00:21:04.0911617Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0911815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0912018Z pt-xla-profiler: CompileTime too frequent: 27 counts during 14 steps 2024-12-18T00:21:04.0912269Z pt-xla-profiler: TransferFromDeviceTime too frequent: 14 counts during 14 steps 2024-12-18T00:21:04.0912287Z 2024-12-18T00:21:04.0912593Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0912704Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0913019Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0913127Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0913337Z Compilation Analysis: Graph Hash: 6c6a45c56a63dcc1181f6f524fedeab7 2024-12-18T00:21:04.0913477Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0913642Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0913822Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0914164Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0914515Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0914822Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0915093Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0915393Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0915660Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0915940Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0916066Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0916325Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0916525Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0916530Z 2024-12-18T00:21:04.0916760Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0916917Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0917085Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0917247Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0917611Z Post Compilation Analysis: Intermediate tensor size: 0.000558 GB 2024-12-18T00:21:04.0917795Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0918075Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0918311Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0918316Z 2024-12-18T00:21:04.0918511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0918655Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0918938Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0919051Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0919253Z Execution Analysis: Graph Hash: 6c6a45c56a63dcc1181f6f524fedeab7 2024-12-18T00:21:04.0919393Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0919539Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0919699Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0920057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0920396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0920707Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0920975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0921273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0921574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0921878Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0922006Z Execution Analysis: (:1) 2024-12-18T00:21:04.0922254Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0922482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0922487Z 2024-12-18T00:21:04.0922698Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0922824Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0923059Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0923170Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0923391Z Compilation Analysis: Graph Hash: ffda5fc4abbe2825fa5985c852d2002d 2024-12-18T00:21:04.0923536Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0923693Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0923867Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0924465Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0925031Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0925399Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0925752Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0926068Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0926350Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0926665Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0926943Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0927050Z Compilation Analysis: .......... 2024-12-18T00:21:04.0927318Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0927527Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0927532Z 2024-12-18T00:21:04.0927762Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0927950Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0928125Z Post Compilation Analysis: Graph output size: 0.000460 GB 2024-12-18T00:21:04.0928302Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0928498Z Post Compilation Analysis: Intermediate tensor size: 0.001951 GB 2024-12-18T00:21:04.0928690Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0928966Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0929196Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0929201Z 2024-12-18T00:21:04.0929401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0929616Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0929832Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0929935Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0930158Z Execution Analysis: Graph Hash: ffda5fc4abbe2825fa5985c852d2002d 2024-12-18T00:21:04.0930289Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0930455Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0930775Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0931347Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0931941Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0932294Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0932648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0932952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0933224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0933527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0933796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0933903Z Execution Analysis: .......... 2024-12-18T00:21:04.0934152Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0934360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0934578Z pt-xla-profiler: CompileTime too frequent: 29 counts during 15 steps 2024-12-18T00:21:04.0934857Z pt-xla-profiler: TransferFromDeviceTime too frequent: 15 counts during 15 steps 2024-12-18T00:21:04.0934864Z 2024-12-18T00:21:04.0935079Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0935202Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0935495Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0935621Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0935827Z Compilation Analysis: Graph Hash: 91343afed948361d9ed0d6af5a06e23d 2024-12-18T00:21:04.0935975Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0936130Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0936305Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0936747Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0937274Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0937695Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0937979Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0938303Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0938587Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0938896Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0939038Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0939311Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0939534Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0939539Z 2024-12-18T00:21:04.0939769Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0939975Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0940154Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0940362Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0940582Z Post Compilation Analysis: Intermediate tensor size: 0.000601 GB 2024-12-18T00:21:04.0940774Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0941071Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0941326Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0941331Z 2024-12-18T00:21:04.0941543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0941660Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0941951Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0942070Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0942272Z Execution Analysis: Graph Hash: 91343afed948361d9ed0d6af5a06e23d 2024-12-18T00:21:04.0942427Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0942564Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0942740Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0943095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0943444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0943757Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0944031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0944521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0944789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0945089Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0945212Z Execution Analysis: (:1) 2024-12-18T00:21:04.0945477Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0945677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0945684Z 2024-12-18T00:21:04.0945899Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0946028Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0946271Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0946459Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0946675Z Compilation Analysis: Graph Hash: a61db9549982d6d20bdf6c81553bef90 2024-12-18T00:21:04.0946833Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0946986Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0947167Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0947778Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0948367Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0948742Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0949106Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0949474Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0949759Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0950126Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0950402Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0950513Z Compilation Analysis: .......... 2024-12-18T00:21:04.0950826Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0951039Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0951044Z 2024-12-18T00:21:04.0951286Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0951458Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0951649Z Post Compilation Analysis: Graph output size: 0.000471 GB 2024-12-18T00:21:04.0951827Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0952034Z Post Compilation Analysis: Intermediate tensor size: 0.002101 GB 2024-12-18T00:21:04.0952228Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0952514Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0952749Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0952755Z 2024-12-18T00:21:04.0952960Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0953077Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0953307Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0953429Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0953636Z Execution Analysis: Graph Hash: a61db9549982d6d20bdf6c81553bef90 2024-12-18T00:21:04.0953782Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0953932Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0954105Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0954700Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0955274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0955641Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0956097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0956445Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0956702Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0956985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0957234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0957329Z Execution Analysis: .......... 2024-12-18T00:21:04.0957577Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0957763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0957975Z pt-xla-profiler: CompileTime too frequent: 31 counts during 16 steps 2024-12-18T00:21:04.0958228Z pt-xla-profiler: TransferFromDeviceTime too frequent: 16 counts during 16 steps 2024-12-18T00:21:04.0958234Z 2024-12-18T00:21:04.0958473Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0958586Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0958868Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0959013Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0959210Z Compilation Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.0959360Z Compilation Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0959497Z Compilation Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0959699Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0960041Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0960377Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0960685Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0960950Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0961257Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0961516Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0961798Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0961923Z Compilation Analysis: (:1) 2024-12-18T00:21:04.0962171Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0962375Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0962380Z 2024-12-18T00:21:04.0962595Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0962763Z Post Compilation Analysis: Graph input size: 0.000129 GB 2024-12-18T00:21:04.0962926Z Post Compilation Analysis: Graph output size: 0.000000 GB 2024-12-18T00:21:04.0963098Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2024-12-18T00:21:04.0963286Z Post Compilation Analysis: Intermediate tensor size: 0.000644 GB 2024-12-18T00:21:04.0963471Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0963741Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0963959Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0963963Z 2024-12-18T00:21:04.0964156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0964259Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0964561Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0964667Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0964864Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.0964999Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0965127Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0965293Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0965622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0965963Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0966247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0966504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0966789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0967063Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0967338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0967480Z Execution Analysis: (:1) 2024-12-18T00:21:04.0967728Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0967914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0967942Z 2024-12-18T00:21:04.0968146Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0968260Z Compilation Analysis: Compilation Cause 2024-12-18T00:21:04.0968488Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0968597Z Compilation Analysis: Graph Info: 2024-12-18T00:21:04.0968798Z Compilation Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.0968947Z Compilation Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0969088Z Compilation Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0969259Z Compilation Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0969816Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0970362Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0970704Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0971045Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0971344Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0971605Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0971910Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0972166Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0972273Z Compilation Analysis: .......... 2024-12-18T00:21:04.0972525Z Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0972735Z Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0972740Z 2024-12-18T00:21:04.0972953Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0973117Z Post Compilation Analysis: Graph input size: 0.000210 GB 2024-12-18T00:21:04.0973305Z Post Compilation Analysis: Graph output size: 0.000483 GB 2024-12-18T00:21:04.0973471Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2024-12-18T00:21:04.0973667Z Post Compilation Analysis: Intermediate tensor size: 0.002251 GB 2024-12-18T00:21:04.0973841Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2024-12-18T00:21:04.0974120Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0974332Z Post Compilation Analysis: ================================================================================ 2024-12-18T00:21:04.0974337Z 2024-12-18T00:21:04.0974535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0974645Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0974862Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0974970Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0975162Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.0975328Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0975469Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0975657Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0976201Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0977016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0977381Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0977734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0978052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0978328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0978644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0978912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0979028Z Execution Analysis: .......... 2024-12-18T00:21:04.0979289Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0979492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0979722Z pt-xla-profiler: CompileTime too frequent: 33 counts during 17 steps 2024-12-18T00:21:04.0979996Z pt-xla-profiler: TransferFromDeviceTime too frequent: 17 counts during 17 steps 2024-12-18T00:21:04.0980003Z 2024-12-18T00:21:04.0980217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0980330Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0980625Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0980737Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0980953Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.0981097Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0981237Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0981415Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0981773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0982129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0982439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0982753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0983060Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0983328Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0983630Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0983756Z Execution Analysis: (:1) 2024-12-18T00:21:04.0984023Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0984228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0984233Z 2024-12-18T00:21:04.0984441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0984556Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0984820Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0984935Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0985142Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.0985321Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0985464Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0985638Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0986267Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0986851Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0987210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0987565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0987884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0988158Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0988474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0988744Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0988859Z Execution Analysis: .......... 2024-12-18T00:21:04.0989214Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0989410Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0989614Z pt-xla-profiler: CompileTime too frequent: 33 counts during 18 steps 2024-12-18T00:21:04.0989868Z pt-xla-profiler: TransferFromDeviceTime too frequent: 18 counts during 18 steps 2024-12-18T00:21:04.0989873Z 2024-12-18T00:21:04.0990071Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0990176Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0990452Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0990553Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0990751Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.0990887Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.0991016Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.0991178Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0991507Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.0991864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0992157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0992419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0992699Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0992947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0993221Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.0993337Z Execution Analysis: (:1) 2024-12-18T00:21:04.0993579Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0993764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0993770Z 2024-12-18T00:21:04.0993992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0994097Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0994346Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.0994444Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0994636Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.0994781Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.0994913Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.0995104Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.0995651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.0996193Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.0996531Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.0996865Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.0997153Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.0997403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.0997700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.0997945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.0998054Z Execution Analysis: .......... 2024-12-18T00:21:04.0998294Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.0998492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0998697Z pt-xla-profiler: CompileTime too frequent: 33 counts during 19 steps 2024-12-18T00:21:04.0998956Z pt-xla-profiler: TransferFromDeviceTime too frequent: 19 counts during 19 steps 2024-12-18T00:21:04.0998961Z 2024-12-18T00:21:04.0999156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.0999262Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.0999537Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.0999643Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.0999842Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.0999972Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1000105Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1000291Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1000623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1000955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1001242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1001501Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1001783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1002039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1002310Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1002424Z Execution Analysis: (:1) 2024-12-18T00:21:04.1002673Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1002881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1002885Z 2024-12-18T00:21:04.1003106Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1003209Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1003433Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1003536Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1003748Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1003890Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1004027Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1004186Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1004729Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1005274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1005606Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1005940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1006228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1006479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1006770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1007014Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1007123Z Execution Analysis: .......... 2024-12-18T00:21:04.1007366Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1007559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1007766Z pt-xla-profiler: CompileTime too frequent: 33 counts during 20 steps 2024-12-18T00:21:04.1008016Z pt-xla-profiler: TransferFromDeviceTime too frequent: 20 counts during 20 steps 2024-12-18T00:21:04.1008028Z 2024-12-18T00:21:04.1008219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1008324Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1008603Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1008705Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1008902Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1009063Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1009192Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1009355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1009682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1010007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1010294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1010560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1010841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1011093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1011366Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1011503Z Execution Analysis: (:1) 2024-12-18T00:21:04.1011751Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1011964Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1011969Z 2024-12-18T00:21:04.1012163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1012270Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1012520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1012621Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1012813Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1012956Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1013089Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1013255Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1013803Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1014341Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1014670Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1015006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1015293Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1015546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1015841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1016089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1016200Z Execution Analysis: .......... 2024-12-18T00:21:04.1016516Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1016716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1017098Z pt-xla-profiler: CompileTime too frequent: 33 counts during 21 steps 2024-12-18T00:21:04.1017385Z pt-xla-profiler: TransferFromDeviceTime too frequent: 21 counts during 21 steps 2024-12-18T00:21:04.1017391Z 2024-12-18T00:21:04.1017592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1017794Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1018098Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1018244Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1018463Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1018612Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1018765Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1018933Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1019293Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1019651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1019965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1020246Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1020551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1020858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1021154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1021321Z Execution Analysis: (:1) 2024-12-18T00:21:04.1021592Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1021794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1021799Z 2024-12-18T00:21:04.1022034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1022154Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1022391Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1022505Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1022725Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1022869Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1023015Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1023187Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1023781Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1024368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1024727Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1025090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1025405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1025680Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1025999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1026272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1026392Z Execution Analysis: .......... 2024-12-18T00:21:04.1026650Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1026859Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1027081Z pt-xla-profiler: CompileTime too frequent: 33 counts during 22 steps 2024-12-18T00:21:04.1027365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 22 counts during 22 steps 2024-12-18T00:21:04.1027370Z 2024-12-18T00:21:04.1027576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1027717Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1028024Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1028142Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1028357Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1028498Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1028649Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1028817Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1029273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1029603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1029891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1030156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1030464Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1030746Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1031012Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1031134Z Execution Analysis: (:1) 2024-12-18T00:21:04.1031371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1031585Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1031590Z 2024-12-18T00:21:04.1031783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1031887Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1032109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1032213Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1032413Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1032548Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1032682Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1032846Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1033389Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1033927Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1034257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1034590Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1034878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1035142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1035427Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1035672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1035776Z Execution Analysis: .......... 2024-12-18T00:21:04.1036023Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1036222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1036425Z pt-xla-profiler: CompileTime too frequent: 33 counts during 23 steps 2024-12-18T00:21:04.1036715Z pt-xla-profiler: TransferFromDeviceTime too frequent: 24 counts during 23 steps 2024-12-18T00:21:04.1036720Z 2024-12-18T00:21:04.1036908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1037017Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1037294Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1037398Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1037594Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1037727Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1037870Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1038026Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1038356Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1038688Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1039000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1039261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1039572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1039830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1040271Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1040455Z Execution Analysis: (:1) 2024-12-18T00:21:04.1040713Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1040908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1040915Z 2024-12-18T00:21:04.1041127Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1041238Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1041472Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1041579Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1041791Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1041933Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1042074Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1042249Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1042822Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1043388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1043743Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1044090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1044707Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1044993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1045300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1045573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1045690Z Execution Analysis: .......... 2024-12-18T00:21:04.1045951Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1046164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1046459Z pt-xla-profiler: CompileTime too frequent: 33 counts during 24 steps 2024-12-18T00:21:04.1046747Z pt-xla-profiler: TransferFromDeviceTime too frequent: 25 counts during 24 steps 2024-12-18T00:21:04.1046754Z 2024-12-18T00:21:04.1046959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1047088Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1047379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1047494Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1047712Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1047855Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1048016Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1048185Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1048556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1048943Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1049295Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1049575Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1049882Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1050208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1050503Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1050635Z Execution Analysis: (:1) 2024-12-18T00:21:04.1050899Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1051104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1051122Z 2024-12-18T00:21:04.1051324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1051436Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1051676Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1051785Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1052002Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1052147Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1052297Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1052473Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1053064Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1053653Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1054018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1054379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1054689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1054972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1055284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1055552Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1055663Z Execution Analysis: .......... 2024-12-18T00:21:04.1056018Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1056234Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1056530Z pt-xla-profiler: CompileTime too frequent: 33 counts during 25 steps 2024-12-18T00:21:04.1056813Z pt-xla-profiler: TransferFromDeviceTime too frequent: 26 counts during 25 steps 2024-12-18T00:21:04.1056819Z 2024-12-18T00:21:04.1057021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1057149Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1057440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1057552Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1057765Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1057906Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1058059Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1058267Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1058639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1059017Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1059330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1059615Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1059944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1060220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1060510Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1060644Z Execution Analysis: (:1) 2024-12-18T00:21:04.1060910Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1061111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1061129Z 2024-12-18T00:21:04.1061329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1061441Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1061681Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1061791Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1062009Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1062160Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1062314Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1062485Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1063080Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1063664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1064020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1064383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1064697Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1064983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1065289Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1065593Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1065707Z Execution Analysis: .......... 2024-12-18T00:21:04.1065966Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1066179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1066400Z pt-xla-profiler: CompileTime too frequent: 33 counts during 26 steps 2024-12-18T00:21:04.1066686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 27 counts during 26 steps 2024-12-18T00:21:04.1066693Z 2024-12-18T00:21:04.1066896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1067021Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1067312Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1067426Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1067671Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1067819Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1067969Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1068161Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1068532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1068970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1069284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1069549Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1069837Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1070100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1070371Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1070499Z Execution Analysis: (:1) 2024-12-18T00:21:04.1070740Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1070940Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1070945Z 2024-12-18T00:21:04.1071137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1071241Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1071470Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1071575Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1071779Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1071915Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1072061Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1072217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1072767Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1073302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1073631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1073963Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1074248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1074537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1074822Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1075079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1075181Z Execution Analysis: .......... 2024-12-18T00:21:04.1075418Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1075617Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1075822Z pt-xla-profiler: CompileTime too frequent: 33 counts during 27 steps 2024-12-18T00:21:04.1076084Z pt-xla-profiler: TransferFromDeviceTime too frequent: 28 counts during 27 steps 2024-12-18T00:21:04.1076089Z 2024-12-18T00:21:04.1076279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1076398Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1076689Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1076803Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1077017Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1077149Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1077290Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1077448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1077813Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1078141Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1078440Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1078692Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1078980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1079242Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1079517Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1079645Z Execution Analysis: (:1) 2024-12-18T00:21:04.1079887Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1080091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1080096Z 2024-12-18T00:21:04.1080285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1080392Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1080616Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1080720Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1080929Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1081066Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1081214Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1081370Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1081913Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1082454Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1082787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1083128Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1083448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1083714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1084003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1084264Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1084367Z Execution Analysis: .......... 2024-12-18T00:21:04.1084609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1084811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1085018Z pt-xla-profiler: CompileTime too frequent: 33 counts during 28 steps 2024-12-18T00:21:04.1085287Z pt-xla-profiler: TransferFromDeviceTime too frequent: 29 counts during 28 steps 2024-12-18T00:21:04.1085294Z 2024-12-18T00:21:04.1085508Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1085628Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1085927Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1086043Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1086233Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1086368Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1086514Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1086696Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1087040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1087365Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1087666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1087920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1088206Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1088466Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1088738Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1088865Z Execution Analysis: (:1) 2024-12-18T00:21:04.1089107Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1089308Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1089312Z 2024-12-18T00:21:04.1089502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1089622Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1089838Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1089944Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1090151Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1090286Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1090436Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1090594Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1091153Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1091681Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1092055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1092398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1092690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1092957Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1093242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1093508Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1093608Z Execution Analysis: .......... 2024-12-18T00:21:04.1093849Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1094047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1094258Z pt-xla-profiler: CompileTime too frequent: 33 counts during 29 steps 2024-12-18T00:21:04.1094549Z pt-xla-profiler: TransferFromDeviceTime too frequent: 30 counts during 29 steps 2024-12-18T00:21:04.1094554Z 2024-12-18T00:21:04.1094769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1094890Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1095161Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1095277Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1095491Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1095629Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1095770Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1095929Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1096274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1096683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1097166Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1097442Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1097751Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1098033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1098327Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1098470Z Execution Analysis: (:1) 2024-12-18T00:21:04.1098731Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1098953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1098958Z 2024-12-18T00:21:04.1099165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1099294Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1099526Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1099635Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1099859Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1100005Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1100169Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1100340Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1100947Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1101559Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1101923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1102291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1102604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1102891Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1103202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1103478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1103879Z Execution Analysis: .......... 2024-12-18T00:21:04.1104177Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1104448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1104765Z pt-xla-profiler: CompileTime too frequent: 33 counts during 30 steps 2024-12-18T00:21:04.1105108Z pt-xla-profiler: TransferFromDeviceTime too frequent: 31 counts during 30 steps 2024-12-18T00:21:04.1105113Z 2024-12-18T00:21:04.1105422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1105589Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1105998Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1106145Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1106430Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1106608Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1106848Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1107123Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1107591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1108022Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1108370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1108731Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1109205Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1109490Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1109835Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1109984Z Execution Analysis: (:1) 2024-12-18T00:21:04.1110283Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1110528Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1110535Z 2024-12-18T00:21:04.1110818Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1110954Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1111240Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1111376Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1111582Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1111837Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1112006Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1112233Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1112842Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1113424Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1113823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1114299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1114622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1114909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1115269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1115541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1115753Z Execution Analysis: .......... 2024-12-18T00:21:04.1116050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1116338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1116582Z pt-xla-profiler: CompileTime too frequent: 33 counts during 31 steps 2024-12-18T00:21:04.1116890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 32 counts during 31 steps 2024-12-18T00:21:04.1116895Z 2024-12-18T00:21:04.1117164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1117320Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1117849Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1118001Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1118284Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1118440Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1118714Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1118914Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1119295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1119722Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1120060Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1120480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1120829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1121175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1121498Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1121696Z Execution Analysis: (:1) 2024-12-18T00:21:04.1121964Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1122285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1122290Z 2024-12-18T00:21:04.1122521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1122678Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1122982Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1123122Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1123406Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1123595Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1123852Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1124052Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1124664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1125282Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1125690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1126135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1126475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1126819Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1127256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1127601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1127790Z Execution Analysis: .......... 2024-12-18T00:21:04.1128076Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1128354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1128606Z pt-xla-profiler: CompileTime too frequent: 33 counts during 32 steps 2024-12-18T00:21:04.1128968Z pt-xla-profiler: TransferFromDeviceTime too frequent: 33 counts during 32 steps 2024-12-18T00:21:04.1128974Z 2024-12-18T00:21:04.1129233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1129545Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1129854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1130034Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1130265Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1130414Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1130657Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1130846Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1131255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1131614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1131964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1132273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1132648Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1132930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1133233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1133497Z Execution Analysis: (:1) 2024-12-18T00:21:04.1133753Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1134230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1134238Z 2024-12-18T00:21:04.1134469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1134658Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1134927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1135124Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1135394Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1135586Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1135806Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1136013Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1136756Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1137515Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1138004Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1138394Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1138796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1139138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1139484Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1139874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1140031Z Execution Analysis: .......... 2024-12-18T00:21:04.1140448Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1140716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1141021Z pt-xla-profiler: CompileTime too frequent: 33 counts during 33 steps 2024-12-18T00:21:04.1141310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 34 counts during 33 steps 2024-12-18T00:21:04.1141317Z 2024-12-18T00:21:04.1141654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1141806Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1142131Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1142321Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1142559Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1142791Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1142991Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1143237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1143630Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1144014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1144746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1145121Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1145528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1145832Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1146200Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1146360Z Execution Analysis: (:1) 2024-12-18T00:21:04.1146731Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1146986Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1146992Z 2024-12-18T00:21:04.1147339Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1147559Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1147829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1148007Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1148280Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1148521Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1148702Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1148948Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1149590Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1150177Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1150659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1151395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1151794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1152157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1152526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1152859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1153096Z Execution Analysis: .......... 2024-12-18T00:21:04.1153401Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1153640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1153938Z pt-xla-profiler: CompileTime too frequent: 33 counts during 34 steps 2024-12-18T00:21:04.1154234Z pt-xla-profiler: TransferFromDeviceTime too frequent: 35 counts during 34 steps 2024-12-18T00:21:04.1154239Z 2024-12-18T00:21:04.1154633Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1154786Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1155164Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1155313Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1155578Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1155783Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1155977Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1156232Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1156623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1157229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1157552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1157940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1158380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1158701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1159005Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1159152Z Execution Analysis: (:1) 2024-12-18T00:21:04.1159470Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1159713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1159749Z 2024-12-18T00:21:04.1160013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1160151Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1160500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1160617Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1160866Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1161096Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1161269Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1161500Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1162080Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1162727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1163136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1163562Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1163883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1164221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1164545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1164857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1165044Z Execution Analysis: .......... 2024-12-18T00:21:04.1165317Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1165588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1165828Z pt-xla-profiler: CompileTime too frequent: 33 counts during 35 steps 2024-12-18T00:21:04.1166178Z pt-xla-profiler: TransferFromDeviceTime too frequent: 36 counts during 35 steps 2024-12-18T00:21:04.1166183Z 2024-12-18T00:21:04.1166420Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1166599Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1166963Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1167108Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1167354Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1167552Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1167776Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1167968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1168385Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1168744Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1169046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1169418Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1169737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1170067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1170368Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1170537Z Execution Analysis: (:1) 2024-12-18T00:21:04.1170862Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1171142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1171147Z 2024-12-18T00:21:04.1171378Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1171517Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1171803Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1171919Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1172226Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1172401Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1172683Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1172872Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1173453Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1174103Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1174520Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1174919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1175242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1175590Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1175890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1176273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1176492Z Execution Analysis: .......... 2024-12-18T00:21:04.1176979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1177219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1177482Z pt-xla-profiler: CompileTime too frequent: 33 counts during 36 steps 2024-12-18T00:21:04.1177853Z pt-xla-profiler: TransferFromDeviceTime too frequent: 37 counts during 36 steps 2024-12-18T00:21:04.1177859Z 2024-12-18T00:21:04.1178115Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1178309Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1178634Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1178822Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1179049Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1179381Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1179562Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1179767Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1180209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1180602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1180999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1181325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1181711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1182014Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1182383Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1182569Z Execution Analysis: (:1) 2024-12-18T00:21:04.1182888Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1183189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1183193Z 2024-12-18T00:21:04.1183429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1183630Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1183896Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1184092Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1184351Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1184529Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1184761Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1184964Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1185644Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1186380Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1186834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1187256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1187646Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1187953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1188356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1188682Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1188832Z Execution Analysis: .......... 2024-12-18T00:21:04.1189271Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1189491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1189753Z pt-xla-profiler: CompileTime too frequent: 33 counts during 37 steps 2024-12-18T00:21:04.1190074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 38 counts during 37 steps 2024-12-18T00:21:04.1190079Z 2024-12-18T00:21:04.1190363Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1190501Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1190804Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1190982Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1191189Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1191449Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1191617Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1191845Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1192208Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1192655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1193004Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1193312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1193672Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1193987Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1194331Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1194464Z Execution Analysis: (:1) 2024-12-18T00:21:04.1194826Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1195046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1195051Z 2024-12-18T00:21:04.1195313Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1195452Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1195697Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1195903Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1196146Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1196377Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1196546Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1196782Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1197374Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1198026Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1198421Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1198780Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1199215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1199505Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1199871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1200170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1200347Z Execution Analysis: .......... 2024-12-18T00:21:04.1200628Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1200851Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1201113Z pt-xla-profiler: CompileTime too frequent: 33 counts during 38 steps 2024-12-18T00:21:04.1201421Z pt-xla-profiler: TransferFromDeviceTime too frequent: 39 counts during 38 steps 2024-12-18T00:21:04.1201427Z 2024-12-18T00:21:04.1201702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1201849Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1202193Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1202330Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1202593Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1202774Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1202939Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1203175Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1203541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1203922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1204263Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1204640Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1205021Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1205350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1205652Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1205782Z Execution Analysis: (:1) 2024-12-18T00:21:04.1206142Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1206365Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1206370Z 2024-12-18T00:21:04.1206631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1206769Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1207041Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1207227Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1207516Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1207707Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1207877Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1208104Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1208667Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1209343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1209711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1210112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1210437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1210753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1211098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1211457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1211630Z Execution Analysis: .......... 2024-12-18T00:21:04.1211907Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1212179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1287339Z pt-xla-profiler: CompileTime too frequent: 33 counts during 39 steps 2024-12-18T00:21:04.1287813Z pt-xla-profiler: TransferFromDeviceTime too frequent: 40 counts during 39 steps 2024-12-18T00:21:04.1287821Z 2024-12-18T00:21:04.1288049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1288177Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1288635Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1288759Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1288972Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1289135Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1289570Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1290004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1290662Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1291521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1292477Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1293199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1293941Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1294662Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1295354Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1295928Z Execution Analysis: (:1) 2024-12-18T00:21:04.1296617Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1297236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1297566Z 2024-12-18T00:21:04.1297781Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1298285Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1298727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1299258Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1299670Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1300147Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1300555Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1301035Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1301932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1303232Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1304300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1305143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1305940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1306657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1307374Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1308083Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1330064Z Execution Analysis: .......... 2024-12-18T00:21:04.1330559Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1331157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1331722Z pt-xla-profiler: CompileTime too frequent: 33 counts during 40 steps 2024-12-18T00:21:04.1332335Z pt-xla-profiler: TransferFromDeviceTime too frequent: 41 counts during 40 steps 2024-12-18T00:21:04.1332739Z 2024-12-18T00:21:04.1332959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1333394Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1333899Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1334426Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1334825Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1335281Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1335674Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1336089Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1336946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1337777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1338555Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1339258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1339963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1340658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1341330Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1341858Z Execution Analysis: (:1) 2024-12-18T00:21:04.1342351Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1342977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1343302Z 2024-12-18T00:21:04.1343510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1343975Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1345003Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1345465Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1345869Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1346401Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1346803Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1347220Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1348085Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1349362Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1350405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1351224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1351997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1352695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1353389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1354081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1354572Z Execution Analysis: .......... 2024-12-18T00:21:04.1355017Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1355593Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1356237Z pt-xla-profiler: CompileTime too frequent: 33 counts during 41 steps 2024-12-18T00:21:04.1377583Z pt-xla-profiler: TransferFromDeviceTime too frequent: 42 counts during 41 steps 2024-12-18T00:21:04.1378211Z 2024-12-18T00:21:04.1378429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1378881Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1379421Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1379947Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1380366Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1380836Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1381358Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1381790Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1382436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1383278Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1384068Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1384783Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1385482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1386188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1386877Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1387422Z Execution Analysis: (:1) 2024-12-18T00:21:04.1387980Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1388577Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1389056Z 2024-12-18T00:21:04.1389254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1389689Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1390123Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1390603Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1391011Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1391471Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1391856Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1392283Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1393225Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1394417Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1395391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1396161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1396878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1397542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1398196Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1398849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1399317Z Execution Analysis: .......... 2024-12-18T00:21:04.1399743Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1400276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1400788Z pt-xla-profiler: CompileTime too frequent: 33 counts during 42 steps 2024-12-18T00:21:04.1401361Z pt-xla-profiler: TransferFromDeviceTime too frequent: 43 counts during 42 steps 2024-12-18T00:21:04.1401734Z 2024-12-18T00:21:04.1401921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1402328Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1402796Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1403309Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1403687Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1404123Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1404493Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1404887Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1405481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1406427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1407190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1407887Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1408570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1409250Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1409944Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1410461Z Execution Analysis: (:1) 2024-12-18T00:21:04.1410993Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1411564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1411883Z 2024-12-18T00:21:04.1412114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1412548Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1412977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1413421Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1413824Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1414275Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1414667Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1415088Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1415930Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1417435Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1418484Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1419313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1420095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1420809Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1421516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1422209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1422707Z Execution Analysis: .......... 2024-12-18T00:21:04.1423161Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1423747Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1424294Z pt-xla-profiler: CompileTime too frequent: 33 counts during 43 steps 2024-12-18T00:21:04.1424907Z pt-xla-profiler: TransferFromDeviceTime too frequent: 45 counts during 43 steps 2024-12-18T00:21:04.1425297Z 2024-12-18T00:21:04.1425501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1425975Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1426477Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1427001Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1427405Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1427871Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1428259Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1428683Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1429401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1430166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1430889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1431538Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1432213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1432861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1433527Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1434024Z Execution Analysis: (:1) 2024-12-18T00:21:04.1434478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1435034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1435341Z 2024-12-18T00:21:04.1435526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1436098Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1436532Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1436981Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1437377Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1437817Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1438216Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1438634Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1439489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1440737Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1441762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1442559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1443329Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1444019Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1445046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1445746Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1446247Z Execution Analysis: .......... 2024-12-18T00:21:04.1446701Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1447291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1447841Z pt-xla-profiler: CompileTime too frequent: 33 counts during 44 steps 2024-12-18T00:21:04.1448453Z pt-xla-profiler: TransferFromDeviceTime too frequent: 46 counts during 44 steps 2024-12-18T00:21:04.1448904Z 2024-12-18T00:21:04.1449122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1449567Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1450067Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1450599Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1451007Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1451473Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1451868Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1452289Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1452919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1453754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1454544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1455288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1456034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1456816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1457495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1458033Z Execution Analysis: (:1) 2024-12-18T00:21:04.1458569Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1459170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1459495Z 2024-12-18T00:21:04.1459709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1460149Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1460601Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1461069Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1461486Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1461963Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1462372Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1462800Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1463685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1464965Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1466023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1466859Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1467656Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1468357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1469144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1469800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1470264Z Execution Analysis: .......... 2024-12-18T00:21:04.1470691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1471238Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1471775Z pt-xla-profiler: CompileTime too frequent: 33 counts during 45 steps 2024-12-18T00:21:04.1472350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 47 counts during 45 steps 2024-12-18T00:21:04.1472723Z 2024-12-18T00:21:04.1472916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1473324Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1473796Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1474282Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1474652Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1475084Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1475456Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1475853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1476443Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1477239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1477962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1478648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1479306Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1479960Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1480620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1481121Z Execution Analysis: (:1) 2024-12-18T00:21:04.1481567Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1482112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1482420Z 2024-12-18T00:21:04.1482609Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1483020Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1483436Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1483865Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1484235Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1484668Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1485044Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1485445Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1486258Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1487449Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1488413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1489187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1489917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1490575Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1491233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1491881Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1492337Z Execution Analysis: .......... 2024-12-18T00:21:04.1492766Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1493336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1493851Z pt-xla-profiler: CompileTime too frequent: 33 counts during 46 steps 2024-12-18T00:21:04.1494422Z pt-xla-profiler: TransferFromDeviceTime too frequent: 48 counts during 46 steps 2024-12-18T00:21:04.1494784Z 2024-12-18T00:21:04.1494978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1495385Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1495860Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1496434Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1496989Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1497452Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1497922Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1498351Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1499055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1499921Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1500711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1501423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1502149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1502856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1503546Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1504092Z Execution Analysis: (:1) 2024-12-18T00:21:04.1504593Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1505181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1505506Z 2024-12-18T00:21:04.1505721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1506150Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1506596Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1507060Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1507476Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1507944Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1508342Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1508773Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1509713Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1510900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1511878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1512656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1513386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1514038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1514697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1515390Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1515856Z Execution Analysis: .......... 2024-12-18T00:21:04.1516287Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1516819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1517333Z pt-xla-profiler: CompileTime too frequent: 33 counts during 47 steps 2024-12-18T00:21:04.1518103Z pt-xla-profiler: TransferFromDeviceTime too frequent: 49 counts during 47 steps 2024-12-18T00:21:04.1518496Z 2024-12-18T00:21:04.1518699Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1519133Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1519628Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1520134Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1520540Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1521025Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1521419Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1521863Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1522493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1523288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1524088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1524786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1525477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1526167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1526841Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1527365Z Execution Analysis: (:1) 2024-12-18T00:21:04.1527845Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1528416Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1528740Z 2024-12-18T00:21:04.1528940Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1529477Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1529894Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1530314Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1530695Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1531129Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1531509Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1531910Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1532709Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1533900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1534877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1535648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1536441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1537297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1538053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1538749Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1539256Z Execution Analysis: .......... 2024-12-18T00:21:04.1539714Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1540301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1540863Z pt-xla-profiler: CompileTime too frequent: 33 counts during 48 steps 2024-12-18T00:21:04.1541484Z pt-xla-profiler: TransferFromDeviceTime too frequent: 50 counts during 48 steps 2024-12-18T00:21:04.1541878Z 2024-12-18T00:21:04.1542084Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1542526Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1543039Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1543593Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1544009Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1544648Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1545042Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1545476Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1546123Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1547018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1547814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1548529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1549231Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1549943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1550629Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1551177Z Execution Analysis: (:1) 2024-12-18T00:21:04.1551674Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1552261Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1552587Z 2024-12-18T00:21:04.1552790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1553232Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1553681Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1554147Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1554559Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1555021Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1555431Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1555957Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1556773Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1557963Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1558936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1559706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1560468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1561136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1561797Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1562451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1562920Z Execution Analysis: .......... 2024-12-18T00:21:04.1563347Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1563881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1564395Z pt-xla-profiler: CompileTime too frequent: 33 counts during 49 steps 2024-12-18T00:21:04.1564962Z pt-xla-profiler: TransferFromDeviceTime too frequent: 51 counts during 49 steps 2024-12-18T00:21:04.1565327Z 2024-12-18T00:21:04.1565529Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1565977Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1566456Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1566980Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1567375Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1567819Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1568200Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1568629Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1569217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1569999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1570734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1571402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1572065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1572728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1573365Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1573876Z Execution Analysis: (:1) 2024-12-18T00:21:04.1574344Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1574891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1575195Z 2024-12-18T00:21:04.1575401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1575821Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1576230Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1576737Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1577319Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1577858Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1578273Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1578707Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1579578Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1580865Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1581916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1582812Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1583601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1584319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1585023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1585730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1586236Z Execution Analysis: .......... 2024-12-18T00:21:04.1586696Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1587283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1587844Z pt-xla-profiler: CompileTime too frequent: 33 counts during 50 steps 2024-12-18T00:21:04.1588482Z pt-xla-profiler: TransferFromDeviceTime too frequent: 52 counts during 50 steps 2024-12-18T00:21:04.1588891Z 2024-12-18T00:21:04.1589193Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1589635Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1590108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1590598Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1590981Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1591428Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1591808Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1592208Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1592806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1593583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1594321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1594973Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1595632Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1596286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1596928Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1597435Z Execution Analysis: (:1) 2024-12-18T00:21:04.1597901Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1598436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1598749Z 2024-12-18T00:21:04.1598940Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1599356Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1599774Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1600209Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1600596Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1601024Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1601404Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1601809Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1602623Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1603811Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1604898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1605666Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1606404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1607067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1607729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1608386Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1608854Z Execution Analysis: .......... 2024-12-18T00:21:04.1609272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1609821Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1610364Z pt-xla-profiler: CompileTime too frequent: 33 counts during 51 steps 2024-12-18T00:21:04.1610963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 53 counts during 51 steps 2024-12-18T00:21:04.1611331Z 2024-12-18T00:21:04.1611537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1611954Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1612421Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1612943Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1613331Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1613769Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1614147Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1614538Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1615138Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1615915Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1616717Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1617596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1618312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1619025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1619710Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1620261Z Execution Analysis: (:1) 2024-12-18T00:21:04.1620770Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1621366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1621692Z 2024-12-18T00:21:04.1621911Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1622363Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1622806Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1623277Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1623702Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1624179Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1624595Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1625025Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1625906Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1627231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1628306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1629256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1630033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1630736Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1631422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1632121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1632618Z Execution Analysis: .......... 2024-12-18T00:21:04.1633104Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1633683Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1634258Z pt-xla-profiler: CompileTime too frequent: 33 counts during 52 steps 2024-12-18T00:21:04.1634851Z pt-xla-profiler: TransferFromDeviceTime too frequent: 54 counts during 52 steps 2024-12-18T00:21:04.1634856Z 2024-12-18T00:21:04.1635088Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1650930Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1651250Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1651362Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1651583Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1651737Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1651884Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1652064Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1652431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1652797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1653109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1653399Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1653707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1653976Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1654285Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1654413Z Execution Analysis: (:1) 2024-12-18T00:21:04.1654691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1654900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1654906Z 2024-12-18T00:21:04.1655122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1655238Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1655484Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1655597Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1655806Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1655961Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1656108Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1656464Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1657065Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1657658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1658019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1658375Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1658703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1658979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1659304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1659619Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1659742Z Execution Analysis: .......... 2024-12-18T00:21:04.1660042Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1660263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1660489Z pt-xla-profiler: CompileTime too frequent: 33 counts during 53 steps 2024-12-18T00:21:04.1660805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 55 counts during 53 steps 2024-12-18T00:21:04.1660811Z 2024-12-18T00:21:04.1661030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1661149Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1661455Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1661569Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1661790Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1661935Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1662081Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1662264Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1662623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1662993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1663306Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1663593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1663902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1664192Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1664483Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1664612Z Execution Analysis: (:1) 2024-12-18T00:21:04.1664883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1665087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1665092Z 2024-12-18T00:21:04.1665312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1665425Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1665673Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1665784Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1666021Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1666179Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1666326Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1666506Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1667102Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1667691Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1668057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1668424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1668736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1669141Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1669440Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1669716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1669828Z Execution Analysis: .......... 2024-12-18T00:21:04.1670068Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1670294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1670669Z pt-xla-profiler: CompileTime too frequent: 33 counts during 54 steps 2024-12-18T00:21:04.1670938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 56 counts during 54 steps 2024-12-18T00:21:04.1670955Z 2024-12-18T00:21:04.1671154Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1671269Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1671565Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1671677Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1671888Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1672030Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1672169Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1672511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1672871Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1673236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1673550Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1673838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1674151Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1674431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1674723Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1674851Z Execution Analysis: (:1) 2024-12-18T00:21:04.1675120Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1675327Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1675332Z 2024-12-18T00:21:04.1675547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1675660Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1675934Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1676045Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1676254Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1676411Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1676557Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1676738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1677334Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1677925Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1678285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1678654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1678992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1679300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1679622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1679891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1680006Z Execution Analysis: .......... 2024-12-18T00:21:04.1680290Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1680506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1680730Z pt-xla-profiler: CompileTime too frequent: 33 counts during 55 steps 2024-12-18T00:21:04.1681019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 57 counts during 55 steps 2024-12-18T00:21:04.1681024Z 2024-12-18T00:21:04.1681230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1681358Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1681665Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1681781Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1682001Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1682149Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1682307Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1682478Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1682841Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1683209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1683631Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1683917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1684220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1684599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1684875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1684996Z Execution Analysis: (:1) 2024-12-18T00:21:04.1685257Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1685449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1685477Z 2024-12-18T00:21:04.1685682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1685794Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1686027Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1686135Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1686334Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1686486Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1686627Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1686803Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1687353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1687896Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1688272Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1688618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1688938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1689197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1689498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1689777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1689896Z Execution Analysis: .......... 2024-12-18T00:21:04.1690138Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1690341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1690554Z pt-xla-profiler: CompileTime too frequent: 33 counts during 56 steps 2024-12-18T00:21:04.1690826Z pt-xla-profiler: TransferFromDeviceTime too frequent: 58 counts during 56 steps 2024-12-18T00:21:04.1690833Z 2024-12-18T00:21:04.1691025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1691136Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1691423Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1691530Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1691737Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1691873Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1692025Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1692181Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1692513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1692853Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1693145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1693412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1693700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1693962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1694233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1694351Z Execution Analysis: (:1) 2024-12-18T00:21:04.1694603Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1694821Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1694826Z 2024-12-18T00:21:04.1695026Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1695134Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1695360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1695464Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1695670Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1695806Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1695942Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1696109Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1696735Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1697514Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1697903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1698269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1698582Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1698898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1699211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1699481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1699604Z Execution Analysis: .......... 2024-12-18T00:21:04.1699867Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1700091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1700315Z pt-xla-profiler: CompileTime too frequent: 33 counts during 57 steps 2024-12-18T00:21:04.1700603Z pt-xla-profiler: TransferFromDeviceTime too frequent: 59 counts during 57 steps 2024-12-18T00:21:04.1700608Z 2024-12-18T00:21:04.1700815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1700934Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1701241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1701355Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1701575Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1701721Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1701881Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1702053Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1702411Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1702778Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1703090Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1703381Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1703690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1703973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1704268Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1704435Z Execution Analysis: (:1) 2024-12-18T00:21:04.1704701Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1704908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1704915Z 2024-12-18T00:21:04.1705130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1705246Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1705491Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1705605Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1705831Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1705975Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1706123Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1706306Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1706929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1707959Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1708322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1708690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1709137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1709403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1709692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1709947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1710069Z Execution Analysis: .......... 2024-12-18T00:21:04.1710308Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1710514Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1710721Z pt-xla-profiler: CompileTime too frequent: 33 counts during 58 steps 2024-12-18T00:21:04.1710989Z pt-xla-profiler: TransferFromDeviceTime too frequent: 60 counts during 58 steps 2024-12-18T00:21:04.1710995Z 2024-12-18T00:21:04.1711187Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1711308Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1711580Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1711688Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1711892Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1712027Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1712173Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1712332Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1712664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1713003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1713297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1713565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1713851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1714138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1714413Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1714543Z Execution Analysis: (:1) 2024-12-18T00:21:04.1714784Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1714974Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1714979Z 2024-12-18T00:21:04.1715181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1715290Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1715515Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1715619Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1715824Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1715963Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1716124Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1716292Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1716939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1717653Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1718031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1718390Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1718695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1718978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1719282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1719546Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1719666Z Execution Analysis: .......... 2024-12-18T00:21:04.1719920Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1720134Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1720355Z pt-xla-profiler: CompileTime too frequent: 33 counts during 59 steps 2024-12-18T00:21:04.1720638Z pt-xla-profiler: TransferFromDeviceTime too frequent: 61 counts during 59 steps 2024-12-18T00:21:04.1720642Z 2024-12-18T00:21:04.1720847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1720974Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1721262Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1721373Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1721589Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1721732Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1721889Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1722054Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1722419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1722761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1723065Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1723345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1723688Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1723966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1724255Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1724390Z Execution Analysis: (:1) 2024-12-18T00:21:04.1724645Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1724850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1724866Z 2024-12-18T00:21:04.1725066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1725178Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1725418Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1725533Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1725779Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1725924Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1726094Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1726270Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1726851Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1727450Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1727806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1728164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1728475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1728761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1729065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1729331Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1729556Z Execution Analysis: .......... 2024-12-18T00:21:04.1729798Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1730004Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1730214Z pt-xla-profiler: CompileTime too frequent: 33 counts during 60 steps 2024-12-18T00:21:04.1730485Z pt-xla-profiler: TransferFromDeviceTime too frequent: 62 counts during 60 steps 2024-12-18T00:21:04.1730491Z 2024-12-18T00:21:04.1730684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1730808Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1731087Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1731194Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1731400Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1731538Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1731686Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1731848Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1732195Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1732523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1732841Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1733112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1733401Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1733667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1733939Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1734073Z Execution Analysis: (:1) 2024-12-18T00:21:04.1734319Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1734524Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1734528Z 2024-12-18T00:21:04.1734717Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1734827Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1735078Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1735183Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1735416Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1735553Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1735704Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1735863Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1736511Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1737244Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1737607Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1737977Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1738292Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1738579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1738887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1739174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1739283Z Execution Analysis: .......... 2024-12-18T00:21:04.1739543Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1739761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1739988Z pt-xla-profiler: CompileTime too frequent: 33 counts during 61 steps 2024-12-18T00:21:04.1740278Z pt-xla-profiler: TransferFromDeviceTime too frequent: 63 counts during 61 steps 2024-12-18T00:21:04.1740282Z 2024-12-18T00:21:04.1740491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1740620Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1740915Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1741027Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1741248Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1741394Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1741552Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1741722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1742097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1742481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1742796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1743085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1743391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1743674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1743971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1744114Z Execution Analysis: (:1) 2024-12-18T00:21:04.1744541Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1744760Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1744765Z 2024-12-18T00:21:04.1745023Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1745177Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1745421Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1745535Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1745758Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1745903Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1746094Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1746266Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1746861Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1747453Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1747816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1748181Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1748493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1748781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1749094Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1749381Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1749495Z Execution Analysis: .......... 2024-12-18T00:21:04.1749758Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1749986Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1750213Z pt-xla-profiler: CompileTime too frequent: 33 counts during 62 steps 2024-12-18T00:21:04.1750504Z pt-xla-profiler: TransferFromDeviceTime too frequent: 64 counts during 62 steps 2024-12-18T00:21:04.1750508Z 2024-12-18T00:21:04.1750716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1750844Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1751140Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1751266Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1751471Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1751617Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1751809Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1751981Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1752357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1752712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1753036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1753313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1753623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1753905Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1754198Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1754337Z Execution Analysis: (:1) 2024-12-18T00:21:04.1754627Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1754842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1754872Z 2024-12-18T00:21:04.1755076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1755192Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1755437Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1755550Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1755917Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1756053Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1756200Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1756358Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1756911Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1757454Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1757790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1758130Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1758423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1758691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1758978Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1759242Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1759343Z Execution Analysis: .......... 2024-12-18T00:21:04.1759585Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1759790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1760000Z pt-xla-profiler: CompileTime too frequent: 33 counts during 63 steps 2024-12-18T00:21:04.1760268Z pt-xla-profiler: TransferFromDeviceTime too frequent: 66 counts during 63 steps 2024-12-18T00:21:04.1760273Z 2024-12-18T00:21:04.1760465Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1760584Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1760855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1760971Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1761191Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1761326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1761471Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1761630Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1761978Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1762305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1762609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1762866Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1763152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1763414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1763713Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1763843Z Execution Analysis: (:1) 2024-12-18T00:21:04.1764089Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1764316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1764320Z 2024-12-18T00:21:04.1764510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1764652Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1764870Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1764973Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1765182Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1765318Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1765472Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1765632Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1766192Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1766727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1767062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1767405Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1767698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1767967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1768257Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1768518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1768621Z Execution Analysis: .......... 2024-12-18T00:21:04.1768875Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1769065Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1769272Z pt-xla-profiler: CompileTime too frequent: 33 counts during 64 steps 2024-12-18T00:21:04.1769539Z pt-xla-profiler: TransferFromDeviceTime too frequent: 67 counts during 64 steps 2024-12-18T00:21:04.1769544Z 2024-12-18T00:21:04.1769733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1769855Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1770152Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1770271Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1770462Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1770607Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1770753Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1770908Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1771254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1771583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1771892Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1772148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1772439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1772727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1773001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1773157Z Execution Analysis: (:1) 2024-12-18T00:21:04.1773401Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1773605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1773635Z 2024-12-18T00:21:04.1773827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1773945Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1774161Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1774268Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1774479Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1774617Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1774769Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1774932Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1775495Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1776030Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1776438Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1776944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1777263Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1777557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1777868Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1778155Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1778264Z Execution Analysis: .......... 2024-12-18T00:21:04.1778538Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1778746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1778972Z pt-xla-profiler: CompileTime too frequent: 33 counts during 65 steps 2024-12-18T00:21:04.1779264Z pt-xla-profiler: TransferFromDeviceTime too frequent: 68 counts during 65 steps 2024-12-18T00:21:04.1779298Z 2024-12-18T00:21:04.1779508Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1779640Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1779934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1780061Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1780268Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1780412Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1780567Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1780740Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1781113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1781467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1781795Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1782096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1782420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1782719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1783010Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1783149Z Execution Analysis: (:1) 2024-12-18T00:21:04.1783430Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1783646Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1783651Z 2024-12-18T00:21:04.1783854Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1783983Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1784216Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1784329Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1784551Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1784696Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1784854Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1785022Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1785630Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1786204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1786575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1786934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1787247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1787535Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1787844Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1788127Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1788238Z Execution Analysis: .......... 2024-12-18T00:21:04.1788509Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1788712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1797168Z pt-xla-profiler: TransferFromDeviceTime too frequent: 69 counts during 66 steps 2024-12-18T00:21:04.1797277Z 2024-12-18T00:21:04.1797510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1797627Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1797904Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1798015Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1798209Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1798343Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1798486Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1798642Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1798990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1799313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1799652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1799906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1800245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1800501Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1800768Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1800924Z Execution Analysis: (:1) 2024-12-18T00:21:04.1801168Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1801368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1801372Z 2024-12-18T00:21:04.1801560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1801675Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1801887Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1801988Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1802194Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1802325Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1802473Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1802625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1803181Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1803719Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1804054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1804387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1804678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1804941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1805226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1805480Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1805575Z Execution Analysis: .......... 2024-12-18T00:21:04.1805817Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1806010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1806299Z pt-xla-profiler: TransferFromDeviceTime too frequent: 70 counts during 67 steps 2024-12-18T00:21:04.1806304Z 2024-12-18T00:21:04.1806497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1806603Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1806882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1806983Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1807181Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1807312Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1807441Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1807601Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1807927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1808264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1808573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1808858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1809138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1809383Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1809680Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1809794Z Execution Analysis: (:1) 2024-12-18T00:21:04.1810042Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1810227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1810234Z 2024-12-18T00:21:04.1810432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1810534Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1810757Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1810856Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1811045Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1811188Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1811321Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1811480Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1812024Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1812557Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1812890Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1813212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1813507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1813758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1814051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1814296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1814400Z Execution Analysis: .......... 2024-12-18T00:21:04.1814633Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1814852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1815108Z pt-xla-profiler: TransferFromDeviceTime too frequent: 71 counts during 68 steps 2024-12-18T00:21:04.1815114Z 2024-12-18T00:21:04.1815301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1815415Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1815683Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1815794Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1815983Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1816124Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1816254Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1816519Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1817037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1817417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1817744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1818044Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1818363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1818658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1818959Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1819080Z Execution Analysis: (:1) 2024-12-18T00:21:04.1819337Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1819553Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1819560Z 2024-12-18T00:21:04.1819762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1819884Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1820114Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1820235Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1820441Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1820582Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1820736Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1820902Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1821500Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1822076Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1822442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1822793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1823108Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1823381Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1823688Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1823961Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1824064Z Execution Analysis: .......... 2024-12-18T00:21:04.1824360Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1824561Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1824845Z pt-xla-profiler: TransferFromDeviceTime too frequent: 72 counts during 69 steps 2024-12-18T00:21:04.1824852Z 2024-12-18T00:21:04.1825054Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1825168Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1825467Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1825577Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1825788Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1825930Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1826082Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1826247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1826629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1826987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1827323Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1827604Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1827907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1828205Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1828494Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1828628Z Execution Analysis: (:1) 2024-12-18T00:21:04.1828881Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1829194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1829198Z 2024-12-18T00:21:04.1829400Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1829507Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1829742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1829845Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1830057Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1830196Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1830339Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1830511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1831080Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1831650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1831996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1832348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1832650Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1832925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1833220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1833477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1833614Z Execution Analysis: .......... 2024-12-18T00:21:04.1833864Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1834068Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1834336Z pt-xla-profiler: TransferFromDeviceTime too frequent: 73 counts during 70 steps 2024-12-18T00:21:04.1834341Z 2024-12-18T00:21:04.1834548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1834656Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1834949Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1835053Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1835251Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1835398Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1835537Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1835750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1836096Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1836473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1836771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1837035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1837365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1837624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1837913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1838035Z Execution Analysis: (:1) 2024-12-18T00:21:04.1838298Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1838492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1838499Z 2024-12-18T00:21:04.1838704Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1838811Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1839032Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1839147Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1839347Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1839492Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1839631Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1839792Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1840378Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1840930Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1841289Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1841629Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1842040Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1842290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1842586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1842858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1842955Z Execution Analysis: .......... 2024-12-18T00:21:04.1843205Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1843394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1843660Z pt-xla-profiler: TransferFromDeviceTime too frequent: 74 counts during 71 steps 2024-12-18T00:21:04.1843664Z 2024-12-18T00:21:04.1843850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1843968Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1844381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1844663Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1844866Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1845012Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1845219Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1845383Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1845788Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1846136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1846456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1846766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1847074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1847348Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1847637Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1847775Z Execution Analysis: (:1) 2024-12-18T00:21:04.1848033Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1848254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1848259Z 2024-12-18T00:21:04.1848459Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1848582Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1848811Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1848919Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1849133Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1849276Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1849432Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1849598Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1850195Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1850765Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1851121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1851481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1851789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1852065Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1852371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1852681Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1852782Z Execution Analysis: .......... 2024-12-18T00:21:04.1853049Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1853248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1853523Z pt-xla-profiler: TransferFromDeviceTime too frequent: 75 counts during 72 steps 2024-12-18T00:21:04.1853528Z 2024-12-18T00:21:04.1853740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1853855Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1854156Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1854263Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1854479Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1854643Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1854785Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1854989Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1855344Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1855698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1856032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1856313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1856689Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1856965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1857258Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1857381Z Execution Analysis: (:1) 2024-12-18T00:21:04.1857648Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1857849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1857853Z 2024-12-18T00:21:04.1858061Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1858172Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1858410Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1858516Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1858721Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1858873Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1859018Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1859194Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1859784Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1860361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1860715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1861072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1861379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1861648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1861995Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1862261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1862379Z Execution Analysis: .......... 2024-12-18T00:21:04.1862635Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1862844Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1863120Z pt-xla-profiler: TransferFromDeviceTime too frequent: 76 counts during 73 steps 2024-12-18T00:21:04.1863125Z 2024-12-18T00:21:04.1863325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1863445Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1863732Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1863855Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1864083Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1864235Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1864405Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1864572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1864934Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1865309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1865630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1865898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1866214Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1866481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1866779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1866902Z Execution Analysis: (:1) 2024-12-18T00:21:04.1867158Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1867370Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1867375Z 2024-12-18T00:21:04.1867575Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1867701Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1867928Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1868050Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1868256Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1868397Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1868555Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1868722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1869417Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1869970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1870428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1870747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1871043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1871333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1871619Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1871873Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1871970Z Execution Analysis: .......... 2024-12-18T00:21:04.1872220Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1872406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1872670Z pt-xla-profiler: TransferFromDeviceTime too frequent: 77 counts during 74 steps 2024-12-18T00:21:04.1872675Z 2024-12-18T00:21:04.1872859Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1872968Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1873237Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1873444Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1873644Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1873801Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1873949Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1874100Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1874442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1874784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1875071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1875333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1875616Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1875875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1876145Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1876271Z Execution Analysis: (:1) 2024-12-18T00:21:04.1876506Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1876692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1876707Z 2024-12-18T00:21:04.1876893Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1876996Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1877220Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1877320Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1877524Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1877653Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1877786Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1877946Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1878491Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1879029Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1879360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1879692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1880002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1880270Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1880553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1880799Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1880905Z Execution Analysis: .......... 2024-12-18T00:21:04.1881139Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1881342Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1881597Z pt-xla-profiler: TransferFromDeviceTime too frequent: 78 counts during 75 steps 2024-12-18T00:21:04.1881602Z 2024-12-18T00:21:04.1881801Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1881905Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1882206Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1882308Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1882520Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1882660Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1882790Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1882955Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1883304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1883638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1883923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1884177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1884477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1884727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1885010Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1885126Z Execution Analysis: (:1) 2024-12-18T00:21:04.1885377Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1885567Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1885571Z 2024-12-18T00:21:04.1885771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1885877Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1886093Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1886213Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1886404Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1886553Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1886688Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1886853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1887401Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1887932Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1888277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1888624Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1888929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1889185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1889482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1889733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1889843Z Execution Analysis: .......... 2024-12-18T00:21:04.1890084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1890272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1890542Z pt-xla-profiler: TransferFromDeviceTime too frequent: 79 counts during 76 steps 2024-12-18T00:21:04.1890547Z 2024-12-18T00:21:04.1890737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1890877Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1891151Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1891285Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1891478Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1891610Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1891752Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1891934Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1892277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1892603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1892899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1893157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1893447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1893700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1893971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1894094Z Execution Analysis: (:1) 2024-12-18T00:21:04.1894336Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1894538Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1894542Z 2024-12-18T00:21:04.1894729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1894843Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1895059Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1895162Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1895359Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1895495Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1895637Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1895790Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1896424Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1897145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1897514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1897895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1898207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1898491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1898799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1899074Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1899182Z Execution Analysis: .......... 2024-12-18T00:21:04.1899446Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1899648Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1899926Z pt-xla-profiler: TransferFromDeviceTime too frequent: 80 counts during 77 steps 2024-12-18T00:21:04.1899941Z 2024-12-18T00:21:04.1900169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1900287Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1900616Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1900727Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1900947Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1901087Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1901269Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1901446Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1901804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1902161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1902476Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1902759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1903069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1903343Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1903633Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1903758Z Execution Analysis: (:1) 2024-12-18T00:21:04.1904029Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1904230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1904235Z 2024-12-18T00:21:04.1904447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1904561Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1904800Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1904912Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1905121Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1905278Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1905424Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1905602Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1906198Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1906781Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1907170Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1907529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1907843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1908114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1908429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1908701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1908816Z Execution Analysis: .......... 2024-12-18T00:21:04.1909179Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1909373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1909655Z pt-xla-profiler: TransferFromDeviceTime too frequent: 81 counts during 78 steps 2024-12-18T00:21:04.1909660Z 2024-12-18T00:21:04.1909857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1909992Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1910262Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1910375Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1910566Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1910731Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1910864Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1911027Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1911359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1911686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1911983Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1912239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1912531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1912781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1913060Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1913177Z Execution Analysis: (:1) 2024-12-18T00:21:04.1913416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1913612Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1913618Z 2024-12-18T00:21:04.1913809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1913922Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1914137Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1914249Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1914440Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1914583Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1914717Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1914874Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1915430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1915959Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1916327Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1916652Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1916950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1917201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1917650Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1917919Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1918021Z Execution Analysis: .......... 2024-12-18T00:21:04.1918281Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1918508Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1918791Z pt-xla-profiler: TransferFromDeviceTime too frequent: 82 counts during 79 steps 2024-12-18T00:21:04.1918821Z 2024-12-18T00:21:04.1919018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1919142Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1919428Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1919536Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1919770Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1919911Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1920062Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1920225Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1920588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1920930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1921236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1921516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1921816Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1922091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1922375Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1922507Z Execution Analysis: (:1) 2024-12-18T00:21:04.1922759Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1922967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1922974Z 2024-12-18T00:21:04.1923172Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1923283Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1923518Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1923626Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1923837Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1923979Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1924127Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1924290Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1924867Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1925467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1925817Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1926169Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1926475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1926754Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1927055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1927324Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1927428Z Execution Analysis: .......... 2024-12-18T00:21:04.1927683Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1927912Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1928209Z pt-xla-profiler: TransferFromDeviceTime too frequent: 83 counts during 80 steps 2024-12-18T00:21:04.1928214Z 2024-12-18T00:21:04.1928423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1928536Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1928829Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1928966Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1929168Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1929318Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1929563Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1929735Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1930068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1930405Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1930696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1930949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1931248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1931500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1931780Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1931896Z Execution Analysis: (:1) 2024-12-18T00:21:04.1932150Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1932339Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1932344Z 2024-12-18T00:21:04.1932544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1932649Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1932862Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1932976Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1933170Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1933319Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1933454Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1933622Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1934168Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1934728Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1935071Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1935397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1935699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1935955Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1936253Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1936578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1936692Z Execution Analysis: .......... 2024-12-18T00:21:04.1937140Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1937346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1937680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 84 counts during 81 steps 2024-12-18T00:21:04.1937685Z 2024-12-18T00:21:04.1937887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1938012Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1938328Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1938451Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1938657Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1938807Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1938953Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1939117Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1939487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1939838Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1940159Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1940428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1940741Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1941005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1941291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1941420Z Execution Analysis: (:1) 2024-12-18T00:21:04.1941675Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1941878Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1941885Z 2024-12-18T00:21:04.1942084Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1942201Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1942430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1942537Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1942756Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1942899Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1943058Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1943221Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1943852Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1944554Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1944926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1945278Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1945587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1945872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1946177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1946456Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1946613Z Execution Analysis: .......... 2024-12-18T00:21:04.1946883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1947122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1947412Z pt-xla-profiler: TransferFromDeviceTime too frequent: 85 counts during 82 steps 2024-12-18T00:21:04.1947417Z 2024-12-18T00:21:04.1947865Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1947981Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1948285Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1948394Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1948611Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1948757Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1948911Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1949080Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1949437Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1949800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1950110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1950397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1950704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1950983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1951276Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1951403Z Execution Analysis: (:1) 2024-12-18T00:21:04.1951670Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1951874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1951879Z 2024-12-18T00:21:04.1952093Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1952204Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1952448Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1952557Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1952774Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1952919Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1953066Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1953281Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1953874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1954462Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1954820Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1955183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1955495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1955768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1956089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1956382Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1956505Z Execution Analysis: .......... 2024-12-18T00:21:04.1956794Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1957008Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1957285Z pt-xla-profiler: TransferFromDeviceTime too frequent: 87 counts during 83 steps 2024-12-18T00:21:04.1957290Z 2024-12-18T00:21:04.1957527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1957644Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1957938Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1958060Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1958266Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1958421Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1958563Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1958746Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1959105Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1959455Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1959783Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1960056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1960372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1960638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1960944Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1961067Z Execution Analysis: (:1) 2024-12-18T00:21:04.1961339Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1961544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1961660Z 2024-12-18T00:21:04.1961855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1961980Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1962199Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1962319Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1962518Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1962703Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1962953Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1963110Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1963672Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1964204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1964549Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1964873Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1965179Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1965434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1965755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1966009Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1966131Z Execution Analysis: .......... 2024-12-18T00:21:04.1966381Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1966566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1966860Z pt-xla-profiler: TransferFromDeviceTime too frequent: 88 counts during 84 steps 2024-12-18T00:21:04.1966865Z 2024-12-18T00:21:04.1967053Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1967175Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1967443Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1967546Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1967750Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1967883Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1968031Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1968186Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1968523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1968849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1969137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1969400Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1969681Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1969943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1970211Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1970338Z Execution Analysis: (:1) 2024-12-18T00:21:04.1970574Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1970772Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1970776Z 2024-12-18T00:21:04.1970966Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1971071Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1971294Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1971397Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1971625Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1971757Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1971911Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1972067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1972614Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1973159Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1973497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1973839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1974133Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1974440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1974728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1975012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1975113Z Execution Analysis: .......... 2024-12-18T00:21:04.1975351Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1975578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1975840Z pt-xla-profiler: TransferFromDeviceTime too frequent: 89 counts during 85 steps 2024-12-18T00:21:04.1975844Z 2024-12-18T00:21:04.1976046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1976154Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1976512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1976621Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1976996Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1977150Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1977293Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1977481Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1977839Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1978208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1978523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1978814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1979127Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1979399Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1979710Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1979837Z Execution Analysis: (:1) 2024-12-18T00:21:04.1980107Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1980314Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1980319Z 2024-12-18T00:21:04.1980534Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1980652Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1980898Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1981043Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1981257Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1981419Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1981573Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1981756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1982351Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1982935Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1983296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1983647Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1983970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1984273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1984624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1984897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1985013Z Execution Analysis: .......... 2024-12-18T00:21:04.1985273Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1985526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1985806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 90 counts during 86 steps 2024-12-18T00:21:04.1985810Z 2024-12-18T00:21:04.1986013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1986142Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1986438Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1986560Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1986768Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1986922Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1987068Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1987237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1987611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1987962Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1988284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1988569Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1988890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1989257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1989533Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1989660Z Execution Analysis: (:1) 2024-12-18T00:21:04.1989901Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1990109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1990113Z 2024-12-18T00:21:04.1990300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1990418Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1990661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1990778Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1990970Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.1991106Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.1991255Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.1991413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1991973Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.1992500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.1992847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.1993176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1993489Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1993760Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1994075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1994337Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1994437Z Execution Analysis: .......... 2024-12-18T00:21:04.1994714Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1994906Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1995174Z pt-xla-profiler: TransferFromDeviceTime too frequent: 91 counts during 87 steps 2024-12-18T00:21:04.1995180Z 2024-12-18T00:21:04.1995372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1995484Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1995764Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.1995872Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.1996077Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.1996213Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.1996357Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.1996518Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.1996850Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.1997188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.1997477Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.1997744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.1998031Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.1998296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.1998568Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.1998696Z Execution Analysis: (:1) 2024-12-18T00:21:04.1998940Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.1999132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1999136Z 2024-12-18T00:21:04.1999332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.1999467Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.1999697Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.1999802Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2000007Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2000143Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2000283Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2000451Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2001000Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2001543Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2001877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2002242Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2002534Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2002825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2003114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2003365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2003500Z Execution Analysis: .......... 2024-12-18T00:21:04.2003741Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2003942Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2004203Z pt-xla-profiler: TransferFromDeviceTime too frequent: 92 counts during 88 steps 2024-12-18T00:21:04.2004207Z 2024-12-18T00:21:04.2004408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2004515Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2004789Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2004904Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2005097Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2005245Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2005380Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2005549Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2005879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2006205Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2006508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2006766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2007062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2007310Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2007592Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2007707Z Execution Analysis: (:1) 2024-12-18T00:21:04.2007960Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2008149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2008153Z 2024-12-18T00:21:04.2008384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2008504Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2008718Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2008836Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2009030Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2009175Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2009312Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2009470Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2010032Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2010565Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2010943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2011277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2011608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2011865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2012162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2012436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2012538Z Execution Analysis: .......... 2024-12-18T00:21:04.2012789Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2012979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2013248Z pt-xla-profiler: TransferFromDeviceTime too frequent: 93 counts during 89 steps 2024-12-18T00:21:04.2013253Z 2024-12-18T00:21:04.2013441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2013558Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2013829Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2013946Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2014314Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2014459Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2014614Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2014779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2015143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2015492Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2015806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2016079Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2016447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2016725Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2017185Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2017327Z Execution Analysis: (:1) 2024-12-18T00:21:04.2017589Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2017810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2017923Z 2024-12-18T00:21:04.2018136Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2018266Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2018503Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2018617Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2018841Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2018989Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2019155Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2019329Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2019939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2020515Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2020904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2021298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2021617Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2021908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2022250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2022536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2022646Z Execution Analysis: .......... 2024-12-18T00:21:04.2022907Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2023130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2023412Z pt-xla-profiler: TransferFromDeviceTime too frequent: 94 counts during 90 steps 2024-12-18T00:21:04.2023419Z 2024-12-18T00:21:04.2023637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2023755Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2024065Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2024178Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2024405Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2024549Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2024695Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2024880Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2025241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2025612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2025926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2026215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2026525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2026801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2027110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2027241Z Execution Analysis: (:1) 2024-12-18T00:21:04.2027514Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2027751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2027755Z 2024-12-18T00:21:04.2027972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2028088Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2028337Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2028449Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2028659Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2028819Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2029072Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2029239Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2029788Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2030361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2030697Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2031043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2031346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2031623Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2031924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2032174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2032286Z Execution Analysis: .......... 2024-12-18T00:21:04.2032534Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2032738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2032998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 95 counts during 91 steps 2024-12-18T00:21:04.2033002Z 2024-12-18T00:21:04.2033192Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2033311Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2033588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2033704Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2033894Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2034040Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2034172Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2034331Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2034676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2035004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2035302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2035557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2035853Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2036103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2036382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2036499Z Execution Analysis: (:1) 2024-12-18T00:21:04.2036768Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2036969Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2036976Z 2024-12-18T00:21:04.2037166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2037289Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2037503Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2037616Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2037810Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2037946Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2038092Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2038251Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2038812Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2039368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2039737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2040063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2040411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2040669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2040956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2041215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2041319Z Execution Analysis: .......... 2024-12-18T00:21:04.2041573Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2041763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2042034Z pt-xla-profiler: TransferFromDeviceTime too frequent: 96 counts during 92 steps 2024-12-18T00:21:04.2042039Z 2024-12-18T00:21:04.2042230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2042349Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2042624Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2042727Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2042934Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2043071Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2043219Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2043380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2043712Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2044052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2044638Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2044975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2045288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2045572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2045868Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2046066Z Execution Analysis: (:1) 2024-12-18T00:21:04.2046331Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2046536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2046542Z 2024-12-18T00:21:04.2046759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2046876Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2047124Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2047241Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2047463Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2047609Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2047756Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2047940Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2048570Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2049158Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2049554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2049920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2050269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2050557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2050867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2051137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2051256Z Execution Analysis: .......... 2024-12-18T00:21:04.2051519Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2051736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2052019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 97 counts during 93 steps 2024-12-18T00:21:04.2052024Z 2024-12-18T00:21:04.2052241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2052356Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2052661Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2052772Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2052983Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2053139Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2053285Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2053468Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2053832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2054197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2054517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2054795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2055119Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2055388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2055723Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2055852Z Execution Analysis: (:1) 2024-12-18T00:21:04.2056129Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2056393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2056400Z 2024-12-18T00:21:04.2056626Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2056741Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2056979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2057102Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2057313Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2057472Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2057622Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2057793Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2058445Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2059048Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2059420Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2059800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2060132Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2060412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2060738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2061010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2061120Z Execution Analysis: .......... 2024-12-18T00:21:04.2061394Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2061599Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2061897Z pt-xla-profiler: TransferFromDeviceTime too frequent: 98 counts during 94 steps 2024-12-18T00:21:04.2061902Z 2024-12-18T00:21:04.2062110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2062244Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2062540Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2062670Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2062879Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2063030Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2063185Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2063359Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2063733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2064082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2064414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2064690Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2065004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2065288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2065619Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2065765Z Execution Analysis: (:1) 2024-12-18T00:21:04.2066030Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2066250Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2066255Z 2024-12-18T00:21:04.2066464Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2066601Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2066837Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2066951Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2067178Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2067327Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2067493Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2067691Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2068307Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2069022Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2069384Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2069734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2070028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2070301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2070594Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2070860Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2070965Z Execution Analysis: .......... 2024-12-18T00:21:04.2071224Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2071417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2071681Z pt-xla-profiler: TransferFromDeviceTime too frequent: 99 counts during 95 steps 2024-12-18T00:21:04.2071686Z 2024-12-18T00:21:04.2071892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2072003Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2072295Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2072405Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2072614Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2072750Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2072886Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2073059Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2073390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2073730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2074022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2074288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2074574Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2074868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2075143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2075262Z Execution Analysis: (:1) 2024-12-18T00:21:04.2075518Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2075709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2075713Z 2024-12-18T00:21:04.2075920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2076027Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2076259Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2076363Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2076559Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2076731Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2076871Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2077043Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2077630Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2078175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2078536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2078878Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2079170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2079431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2079731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2079983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2080098Z Execution Analysis: .......... 2024-12-18T00:21:04.2080339Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2080544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2080811Z pt-xla-profiler: TransferFromDeviceTime too frequent: 100 counts during 96 steps 2024-12-18T00:21:04.2080815Z 2024-12-18T00:21:04.2081018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2081132Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2081406Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2081525Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2081716Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2081866Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2082002Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2082160Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2082504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2082834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2083139Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2083393Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2083724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2083973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2084258Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2084377Z Execution Analysis: (:1) 2024-12-18T00:21:04.2084619Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2084823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2084827Z 2024-12-18T00:21:04.2085018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2085139Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2085356Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2085478Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2085700Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2085839Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2086015Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2086172Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2086734Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2087293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2087638Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2087967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2088270Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2088527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2088817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2089079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2089183Z Execution Analysis: .......... 2024-12-18T00:21:04.2089436Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2089631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2089906Z pt-xla-profiler: TransferFromDeviceTime too frequent: 101 counts during 97 steps 2024-12-18T00:21:04.2089910Z 2024-12-18T00:21:04.2090101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2090223Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2090498Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2090605Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2090810Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2090945Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2091091Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2091249Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2091596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2091923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2092212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2092504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2092795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2093061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2093335Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2093468Z Execution Analysis: (:1) 2024-12-18T00:21:04.2093710Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2093904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2093919Z 2024-12-18T00:21:04.2094108Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2094216Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2094445Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2094575Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2094782Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2094943Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2095093Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2095250Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2095797Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2096462Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2096974Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2097346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2097663Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2097973Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2098282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2098566Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2098674Z Execution Analysis: .......... 2024-12-18T00:21:04.2098935Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2099154Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2099442Z pt-xla-profiler: TransferFromDeviceTime too frequent: 102 counts during 98 steps 2024-12-18T00:21:04.2099449Z 2024-12-18T00:21:04.2099672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2099790Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2100103Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2100219Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2100427Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2100584Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2100730Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2100914Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2101276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2101640Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2101981Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2102259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2102580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2102852Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2103159Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2103285Z Execution Analysis: (:1) 2024-12-18T00:21:04.2103560Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2103767Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2103772Z 2024-12-18T00:21:04.2103988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2104106Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2104368Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2104493Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2104732Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2104889Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2105039Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2105222Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2105848Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2106427Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2106805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2107166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2107498Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2107781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2108106Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2108381Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2108506Z Execution Analysis: .......... 2024-12-18T00:21:04.2108768Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2108976Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2109366Z pt-xla-profiler: TransferFromDeviceTime too frequent: 103 counts during 99 steps 2024-12-18T00:21:04.2109371Z 2024-12-18T00:21:04.2109564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2109694Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2109968Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2110089Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2110283Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2110420Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2110574Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2110732Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2111081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2111412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2111751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2112011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2112314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2112570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2112845Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2112981Z Execution Analysis: (:1) 2024-12-18T00:21:04.2113225Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2113431Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2113436Z 2024-12-18T00:21:04.2113627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2113795Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2114012Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2114145Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2114353Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2114492Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2114646Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2114831Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2115396Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2115932Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2116288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2116617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2116911Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2117181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2117635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2117918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2118023Z Execution Analysis: .......... 2024-12-18T00:21:04.2118291Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2118496Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2118778Z pt-xla-profiler: TransferFromDeviceTime too frequent: 104 counts during 100 steps 2024-12-18T00:21:04.2118799Z 2024-12-18T00:21:04.2118999Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2119116Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2119419Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2119529Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2119741Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2119888Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2120045Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2120211Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2120563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2120951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2121260Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2121543Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2121845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2122125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2122413Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2122539Z Execution Analysis: (:1) 2024-12-18T00:21:04.2122807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2123009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2123015Z 2024-12-18T00:21:04.2123256Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2123372Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2123641Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2123753Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2123956Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2124110Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2124281Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2124461Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2125041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2125611Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2125966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2126326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2126634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2126907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2127223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2127487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2127605Z Execution Analysis: .......... 2024-12-18T00:21:04.2127860Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2128075Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2128354Z pt-xla-profiler: TransferFromDeviceTime too frequent: 105 counts during 101 steps 2024-12-18T00:21:04.2128360Z 2024-12-18T00:21:04.2128573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2128687Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2128974Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2129097Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2129301Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2129565Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2129701Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2129871Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2130233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2130561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2130863Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2131120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2131421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2131673Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2131956Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2132077Z Execution Analysis: (:1) 2024-12-18T00:21:04.2132319Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2132555Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2132559Z 2024-12-18T00:21:04.2132749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2132924Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2133139Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2133258Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2133454Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2133630Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2133771Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2133937Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2134502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2135042Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2135392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2135719Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2136021Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2136278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2136669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2137100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2137211Z Execution Analysis: .......... 2024-12-18T00:21:04.2137487Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2137696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2137998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 106 counts during 102 steps 2024-12-18T00:21:04.2138004Z 2024-12-18T00:21:04.2138210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2138349Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2138645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2138759Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2138982Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2139128Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2139286Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2139486Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2139859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2140212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2140529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2140816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2141129Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2141410Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2141704Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2141845Z Execution Analysis: (:1) 2024-12-18T00:21:04.2142106Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2142351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2142382Z 2024-12-18T00:21:04.2142586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2142703Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2142948Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2143062Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2143311Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2143459Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2143620Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2143790Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2144868Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2145462Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2145827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2146197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2146514Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2146805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2147116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2147401Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2147515Z Execution Analysis: .......... 2024-12-18T00:21:04.2147779Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2148002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2148294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 108 counts during 103 steps 2024-12-18T00:21:04.2148299Z 2024-12-18T00:21:04.2148523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2148644Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2148950Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2149065Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2149272Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2149433Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2149672Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2149857Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2150224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2150594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2150909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2151207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2151527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2151799Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2152106Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2152237Z Execution Analysis: (:1) 2024-12-18T00:21:04.2152550Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2152760Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2152801Z 2024-12-18T00:21:04.2153021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2153140Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2153371Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2153531Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2153744Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2153905Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2154056Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2154240Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2154838Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2155430Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2155901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2156274Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2156598Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2156868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2157184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2157451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2157573Z Execution Analysis: .......... 2024-12-18T00:21:04.2157828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2158029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2158327Z pt-xla-profiler: TransferFromDeviceTime too frequent: 109 counts during 104 steps 2024-12-18T00:21:04.2158332Z 2024-12-18T00:21:04.2158538Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2158667Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2158954Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2159078Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2159282Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2159467Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2159612Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2159779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2160148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2160493Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2160816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2161087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2161403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2161671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2161959Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2162124Z Execution Analysis: (:1) 2024-12-18T00:21:04.2162383Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2162624Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2162628Z 2024-12-18T00:21:04.2162829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2162952Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2163288Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2163409Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2163614Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2163754Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2163912Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2164080Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2164668Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2165229Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2165594Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2165941Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2166245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2166527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2166833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2167107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2167213Z Execution Analysis: .......... 2024-12-18T00:21:04.2167481Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2167684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2168081Z pt-xla-profiler: TransferFromDeviceTime too frequent: 110 counts during 105 steps 2024-12-18T00:21:04.2168088Z 2024-12-18T00:21:04.2168279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2168388Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2168672Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2168805Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2169013Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2169155Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2169300Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2169462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2169797Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2170135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2170428Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2170698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2170986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2171249Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2171545Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2171666Z Execution Analysis: (:1) 2024-12-18T00:21:04.2171949Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2172140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2172145Z 2024-12-18T00:21:04.2172368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2172476Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2172708Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2172814Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2173023Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2173161Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2173305Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2173477Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2174030Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2174577Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2174913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2175257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2175553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2175823Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2176113Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2176436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2176559Z Execution Analysis: .......... 2024-12-18T00:21:04.2176970Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2177191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2177483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 111 counts during 106 steps 2024-12-18T00:21:04.2177488Z 2024-12-18T00:21:04.2177709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2177829Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2178159Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2178291Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2178498Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2178660Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2178806Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2178992Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2179351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2179707Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2180035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2180309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2180631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2180930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2181239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2181394Z Execution Analysis: (:1) 2024-12-18T00:21:04.2181670Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2181876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2181881Z 2024-12-18T00:21:04.2182125Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2182255Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2182495Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2182623Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2182836Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2182998Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2183148Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2183318Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2183925Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2184502Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2184878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2185232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2185561Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2185843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2186166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2186444Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2186554Z Execution Analysis: .......... 2024-12-18T00:21:04.2186827Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2187035Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2187337Z pt-xla-profiler: TransferFromDeviceTime too frequent: 112 counts during 107 steps 2024-12-18T00:21:04.2187342Z 2024-12-18T00:21:04.2187548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2187714Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2188010Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2188135Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2188346Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2188494Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2188653Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2188822Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2189291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2189617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2189923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2190177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2190490Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2190756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2191057Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2191195Z Execution Analysis: (:1) 2024-12-18T00:21:04.2191439Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2191671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2191676Z 2024-12-18T00:21:04.2191869Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2191991Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2192207Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2192315Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2192525Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2192662Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2192814Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2192972Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2193517Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2197774Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2198129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2198474Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2198774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2199039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2199332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2199588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2199689Z Execution Analysis: .......... 2024-12-18T00:21:04.2199937Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2200130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2200397Z pt-xla-profiler: TransferFromDeviceTime too frequent: 113 counts during 108 steps 2024-12-18T00:21:04.2200404Z 2024-12-18T00:21:04.2200664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2200777Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2201056Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2201165Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2201356Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2201499Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2201636Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2201802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2202140Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2202476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2202769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2203053Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2203348Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2203628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2203905Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2204023Z Execution Analysis: (:1) 2024-12-18T00:21:04.2204305Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2204498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2204502Z 2024-12-18T00:21:04.2204697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2204809Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2205022Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2205138Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2205333Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2205478Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2205617Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2205782Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2206332Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2206862Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2207206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2207535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2207829Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2208085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2208375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2208624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2208729Z Execution Analysis: .......... 2024-12-18T00:21:04.2208970Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2209159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2209431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 114 counts during 109 steps 2024-12-18T00:21:04.2209471Z 2024-12-18T00:21:04.2209661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2209774Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2210045Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2210157Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2210344Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2210476Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2210616Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2210774Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2211112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2211436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2211734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2212014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2212329Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2212576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2212845Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2212964Z Execution Analysis: (:1) 2024-12-18T00:21:04.2213229Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2213425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2213430Z 2024-12-18T00:21:04.2213619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2213734Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2213949Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2214050Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2214253Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2214386Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2214530Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2214685Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2215244Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2215774Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2216115Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2216555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2217021Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2217305Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2217614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2217893Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2218001Z Execution Analysis: .......... 2024-12-18T00:21:04.2218269Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2218473Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2218794Z pt-xla-profiler: TransferFromDeviceTime too frequent: 115 counts during 110 steps 2024-12-18T00:21:04.2218809Z 2024-12-18T00:21:04.2219011Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2219130Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2219433Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2219545Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2219755Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2219902Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2220051Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2220217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2220577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2220940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2221282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2221566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2221922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2222199Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2222491Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2222642Z Execution Analysis: (:1) 2024-12-18T00:21:04.2222908Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2223111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2223118Z 2024-12-18T00:21:04.2223331Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2223447Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2223690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2223804Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2224020Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2224164Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2224312Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2224489Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2225085Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2225665Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2226027Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2226383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2226698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2226968Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2227286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2227553Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2227669Z Execution Analysis: .......... 2024-12-18T00:21:04.2227928Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2228163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2228450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 116 counts during 111 steps 2024-12-18T00:21:04.2228455Z 2024-12-18T00:21:04.2228663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2228777Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2229169Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2229279Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2229470Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2229612Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2229746Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2229910Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2230241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2230588Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2230885Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2231163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2231451Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2231701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2232002Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2232124Z Execution Analysis: (:1) 2024-12-18T00:21:04.2232361Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2232555Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2232560Z 2024-12-18T00:21:04.2232748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2232864Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2233078Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2233188Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2233381Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2233521Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2233658Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2233812Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2234366Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2234900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2235239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2235567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2235864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2236117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2236409Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2236653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2236752Z Execution Analysis: .......... 2024-12-18T00:21:04.2236999Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2237218Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2237484Z pt-xla-profiler: TransferFromDeviceTime too frequent: 117 counts during 112 steps 2024-12-18T00:21:04.2237490Z 2024-12-18T00:21:04.2237680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2237789Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2238061Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2238165Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2238366Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2238501Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2238640Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2238795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2239156Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2239481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2239795Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2240057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2240342Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2240628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2240900Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2241021Z Execution Analysis: (:1) 2024-12-18T00:21:04.2241260Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2241458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2241462Z 2024-12-18T00:21:04.2241649Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2241757Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2241977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2242082Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2242283Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2242418Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2242561Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2242716Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2243260Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2243804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2244281Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2244797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2245110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2245393Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2245704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2245981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2246149Z Execution Analysis: .......... 2024-12-18T00:21:04.2246413Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2246626Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2246913Z pt-xla-profiler: TransferFromDeviceTime too frequent: 118 counts during 113 steps 2024-12-18T00:21:04.2246918Z 2024-12-18T00:21:04.2247129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2247244Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2247546Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2247658Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2247872Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2248017Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2248163Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2248343Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2248737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2249127Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2249437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2249717Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2250063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2250334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2250633Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2250759Z Execution Analysis: (:1) 2024-12-18T00:21:04.2251025Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2251225Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2251232Z 2024-12-18T00:21:04.2251438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2251548Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2251777Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2251893Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2252103Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2252253Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2252399Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2252572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2253167Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2253745Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2254103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2254450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2254770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2255043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2255357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2255653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2255765Z Execution Analysis: .......... 2024-12-18T00:21:04.2256022Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2256225Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2256601Z pt-xla-profiler: TransferFromDeviceTime too frequent: 119 counts during 114 steps 2024-12-18T00:21:04.2256607Z 2024-12-18T00:21:04.2256808Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2256931Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2257221Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2257336Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2257540Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2257695Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2257835Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2258048Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2258411Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2258793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2259120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2259419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2259735Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2260001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2260291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2260428Z Execution Analysis: (:1) 2024-12-18T00:21:04.2260692Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2260905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2260910Z 2024-12-18T00:21:04.2261112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2261234Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2261469Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2261582Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2261791Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2261932Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2262084Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2262254Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2262855Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2263435Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2263798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2264150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2273274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2273558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2273862Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2274142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2274248Z Execution Analysis: .......... 2024-12-18T00:21:04.2274514Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2274714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2274990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 120 counts during 115 steps 2024-12-18T00:21:04.2274995Z 2024-12-18T00:21:04.2275204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2275353Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2275646Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2275757Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2275954Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2276154Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2276296Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2276511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2276860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2277212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2277546Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2277810Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2278120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2278380Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2278671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2278793Z Execution Analysis: (:1) 2024-12-18T00:21:04.2279054Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2279258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2279263Z 2024-12-18T00:21:04.2279466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2279578Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2279799Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2279918Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2280119Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2280266Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2280410Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2280583Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2281165Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2281724Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2282081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2282424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2282793Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2283062Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2283366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2283628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2283848Z Execution Analysis: .......... 2024-12-18T00:21:04.2284085Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2284272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2284547Z pt-xla-profiler: TransferFromDeviceTime too frequent: 121 counts during 116 steps 2024-12-18T00:21:04.2284552Z 2024-12-18T00:21:04.2284740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2284851Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2285120Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2285231Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2285449Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2285581Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2285751Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2285905Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2286246Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2286569Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2286883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2287140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2287432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2287679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2287945Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2288065Z Execution Analysis: (:1) 2024-12-18T00:21:04.2288303Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2288498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2288503Z 2024-12-18T00:21:04.2288691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2288803Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2289017Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2289115Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2289318Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2289450Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2289595Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2289748Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2290305Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2290836Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2291177Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2291542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2291827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2292088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2292376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2292629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2292727Z Execution Analysis: .......... 2024-12-18T00:21:04.2292969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2293156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2293417Z pt-xla-profiler: TransferFromDeviceTime too frequent: 122 counts during 117 steps 2024-12-18T00:21:04.2293437Z 2024-12-18T00:21:04.2293628Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2293736Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2294014Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2294147Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2294348Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2294511Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2294653Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2294809Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2295140Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2295501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2295800Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2296063Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2296432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2296701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2297154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2297285Z Execution Analysis: (:1) 2024-12-18T00:21:04.2297556Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2297766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2297773Z 2024-12-18T00:21:04.2297984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2298101Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2298344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2298457Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2298678Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2298829Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2298980Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2299164Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2299759Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2300341Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2300755Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2301117Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2301432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2301709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2302028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2302303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2302417Z Execution Analysis: .......... 2024-12-18T00:21:04.2302675Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2302891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2303181Z pt-xla-profiler: TransferFromDeviceTime too frequent: 123 counts during 118 steps 2024-12-18T00:21:04.2303186Z 2024-12-18T00:21:04.2303404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2303520Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2303843Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2303968Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2304205Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2304356Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2304499Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2304677Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2305063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2305416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2305738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2306012Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2306333Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2306603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2306906Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2307036Z Execution Analysis: (:1) 2024-12-18T00:21:04.2307294Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2307509Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2307516Z 2024-12-18T00:21:04.2307720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2307840Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2308076Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2308197Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2308410Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2308565Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2308714Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2308883Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2309581Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2310141Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2310530Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2310876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2311193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2311463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2311936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2312204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2312313Z Execution Analysis: .......... 2024-12-18T00:21:04.2312578Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2312785Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2313080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 124 counts during 119 steps 2024-12-18T00:21:04.2313085Z 2024-12-18T00:21:04.2313290Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2313438Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2313732Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2313872Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2314084Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2314231Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2314384Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2314580Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2314950Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2315306Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2315619Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2315904Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2316212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2316593Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2316880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2317009Z Execution Analysis: (:1) 2024-12-18T00:21:04.2317264Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2317641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2317645Z 2024-12-18T00:21:04.2317851Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2317967Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2318211Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2318322Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2318540Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2318688Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2318849Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2319020Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2319615Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2320228Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2320588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2320949Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2321263Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2321545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2321853Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2322130Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2322242Z Execution Analysis: .......... 2024-12-18T00:21:04.2322502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2322716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2323002Z pt-xla-profiler: TransferFromDeviceTime too frequent: 125 counts during 120 steps 2024-12-18T00:21:04.2323007Z 2024-12-18T00:21:04.2323242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2323358Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2323767Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2323882Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2324098Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2324244Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2324411Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2324591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2324954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2325313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2325630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2325917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2326231Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2326502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2326801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2326930Z Execution Analysis: (:1) 2024-12-18T00:21:04.2327193Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2327401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2327405Z 2024-12-18T00:21:04.2327614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2327730Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2327963Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2328082Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2328293Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2328445Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2328597Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2328771Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2329367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2329980Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2330343Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2330696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2331018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2331294Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2331609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2331880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2331997Z Execution Analysis: .......... 2024-12-18T00:21:04.2332257Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2332462Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2332774Z pt-xla-profiler: TransferFromDeviceTime too frequent: 126 counts during 121 steps 2024-12-18T00:21:04.2332779Z 2024-12-18T00:21:04.2332985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2333134Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2333428Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2333548Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2333755Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2333944Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2334089Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2334256Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2334730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2335075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2335390Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2335657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2335960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2336222Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2336592Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2336728Z Execution Analysis: (:1) 2024-12-18T00:21:04.2337149Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2337362Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2337367Z 2024-12-18T00:21:04.2337574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2337698Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2337934Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2338057Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2338267Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2338415Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2338574Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2338742Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2339377Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2339953Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2340329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2340684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2341001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2341286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2341601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2341883Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2341993Z Execution Analysis: .......... 2024-12-18T00:21:04.2342264Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2342470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2342792Z pt-xla-profiler: TransferFromDeviceTime too frequent: 127 counts during 122 steps 2024-12-18T00:21:04.2342822Z 2024-12-18T00:21:04.2343026Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2343144Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2343445Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2343559Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2343799Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2343951Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2344106Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2344436Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2344799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2345166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2345481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2345767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2346077Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2346355Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2346649Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2346787Z Execution Analysis: (:1) 2024-12-18T00:21:04.2347049Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2347256Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2347263Z 2024-12-18T00:21:04.2347475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2347591Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2347828Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2347939Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2348157Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2348302Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2348455Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2348703Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2349301Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2349890Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2350252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2350618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2350934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2351221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2351530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2351803Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2351922Z Execution Analysis: .......... 2024-12-18T00:21:04.2352182Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2352433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2352757Z pt-xla-profiler: TransferFromDeviceTime too frequent: 129 counts during 123 steps 2024-12-18T00:21:04.2352762Z 2024-12-18T00:21:04.2352975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2353087Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2353378Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2353531Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2353741Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2353894Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2354035Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2354210Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2354572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2354925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2355248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2355524Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2355840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2356209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2356492Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2356610Z Execution Analysis: (:1) 2024-12-18T00:21:04.2356857Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2357048Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2357052Z 2024-12-18T00:21:04.2357244Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2357356Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2357570Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2357682Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2357879Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2358021Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2358189Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2358347Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2358905Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2359440Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2359783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2360109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2360409Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2360666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2360963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2361212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2361313Z Execution Analysis: .......... 2024-12-18T00:21:04.2361587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2361779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2362078Z pt-xla-profiler: TransferFromDeviceTime too frequent: 130 counts during 124 steps 2024-12-18T00:21:04.2362083Z 2024-12-18T00:21:04.2362273Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2362392Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2362686Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2362804Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2362996Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2363135Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2363277Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2363436Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2363778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2364105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2364402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2364657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2364947Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2365208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2365482Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2365609Z Execution Analysis: (:1) 2024-12-18T00:21:04.2365851Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2366049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2366056Z 2024-12-18T00:21:04.2366245Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2366364Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2366579Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2366687Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2366888Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2367050Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2367199Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2367356Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2367904Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2368443Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2368780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2369116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2369412Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2369675Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2369961Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2370223Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2370351Z Execution Analysis: .......... 2024-12-18T00:21:04.2370592Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2370828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2371095Z pt-xla-profiler: TransferFromDeviceTime too frequent: 131 counts during 125 steps 2024-12-18T00:21:04.2371099Z 2024-12-18T00:21:04.2371318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2371430Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2371711Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2371816Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2372019Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2372154Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2372290Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2372455Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2372791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2373122Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2373412Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2373678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2373967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2374217Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2374494Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2374613Z Execution Analysis: (:1) 2024-12-18T00:21:04.2374865Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2375058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2375062Z 2024-12-18T00:21:04.2375257Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2375366Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2375590Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2375730Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2375926Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2376071Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2376212Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2376452Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2377190Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2377777Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2378137Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2378495Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2378819Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2379096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2379416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2379719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2379840Z Execution Analysis: .......... 2024-12-18T00:21:04.2380131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2380344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2380629Z pt-xla-profiler: TransferFromDeviceTime too frequent: 132 counts during 126 steps 2024-12-18T00:21:04.2380634Z 2024-12-18T00:21:04.2380863Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2380993Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2381286Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2381406Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2381614Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2381771Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2381915Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2382087Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2382453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2382809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2383132Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2383410Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2383730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2383998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2384307Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2384436Z Execution Analysis: (:1) 2024-12-18T00:21:04.2384699Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2384921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2384926Z 2024-12-18T00:21:04.2385132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2385263Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2385528Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2385655Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2385867Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2386015Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2386179Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2386355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2386963Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2387541Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2387917Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2388271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2388602Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2388883Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2389319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2389583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2389712Z Execution Analysis: .......... 2024-12-18T00:21:04.2389966Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2390157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2390463Z pt-xla-profiler: TransferFromDeviceTime too frequent: 133 counts during 127 steps 2024-12-18T00:21:04.2390470Z 2024-12-18T00:21:04.2390661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2390783Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2391057Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2391165Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2391377Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2391516Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2391668Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2391825Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2392161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2392508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2392798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2393072Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2393360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2393628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2393904Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2394034Z Execution Analysis: (:1) 2024-12-18T00:21:04.2394277Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2394466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2394484Z 2024-12-18T00:21:04.2394673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2394809Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2395037Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2395141Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2395352Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2395490Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2395629Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2395796Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2396345Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2396889Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2397225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2397565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2397855Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2398151Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2398441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2398719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2398830Z Execution Analysis: .......... 2024-12-18T00:21:04.2399070Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2399299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2399565Z pt-xla-profiler: TransferFromDeviceTime too frequent: 134 counts during 128 steps 2024-12-18T00:21:04.2399571Z 2024-12-18T00:21:04.2399778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2399886Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2400174Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2400279Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2400471Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2400622Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2400757Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2400927Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2401261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2401600Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2401893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2402150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2402450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2402703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2402989Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2403107Z Execution Analysis: (:1) 2024-12-18T00:21:04.2403359Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2403551Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2403555Z 2024-12-18T00:21:04.2403792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2403900Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2404116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2404232Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2404428Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2404575Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2404714Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2404873Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2405437Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2406156Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2406523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2406869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2407190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2407503Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2407846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2408111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2408228Z Execution Analysis: .......... 2024-12-18T00:21:04.2408481Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2408707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2409001Z pt-xla-profiler: TransferFromDeviceTime too frequent: 135 counts during 129 steps 2024-12-18T00:21:04.2409006Z 2024-12-18T00:21:04.2409205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2409331Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2409621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2409748Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2409951Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2410096Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2410250Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2410416Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2410780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2411125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2411443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2411708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2412012Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2412290Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2412576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2412712Z Execution Analysis: (:1) 2024-12-18T00:21:04.2412965Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2413178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2413214Z 2024-12-18T00:21:04.2413412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2413537Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2413762Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2413874Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2414090Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2414232Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2414392Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2414558Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2415149Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2415711Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2416065Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2416491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2416998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2417316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2417625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2417911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2418020Z Execution Analysis: .......... 2024-12-18T00:21:04.2418318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2418527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2418812Z pt-xla-profiler: TransferFromDeviceTime too frequent: 136 counts during 130 steps 2024-12-18T00:21:04.2418817Z 2024-12-18T00:21:04.2419035Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2419151Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2419456Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2419573Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2419791Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2419938Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2420083Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2420266Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2420627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2420993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2421308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2421598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2421905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2422189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2422483Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2422612Z Execution Analysis: (:1) 2024-12-18T00:21:04.2422891Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2423128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2423132Z 2024-12-18T00:21:04.2423351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2423469Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2423719Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2423833Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2424045Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2424202Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2424352Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2424533Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2425130Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2425723Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2426087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2426482Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2426799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2427105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2427428Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2427700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2427850Z Execution Analysis: .......... 2024-12-18T00:21:04.2428117Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2428334Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2428621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 137 counts during 131 steps 2024-12-18T00:21:04.2428628Z 2024-12-18T00:21:04.2428851Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2429080Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2429471Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2429591Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2429785Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2429938Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2430077Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2430238Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2430583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2430913Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2431222Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2431479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2431781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2432033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2432322Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2432444Z Execution Analysis: (:1) 2024-12-18T00:21:04.2432733Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2432939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2432944Z 2024-12-18T00:21:04.2433134Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2433258Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2433478Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2433601Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2433794Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2433933Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2434093Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2434253Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2434819Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2435355Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2436026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2436358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2436692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2436950Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2437239Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2437532Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2437639Z Execution Analysis: .......... 2024-12-18T00:21:04.2437900Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2438094Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2438377Z pt-xla-profiler: TransferFromDeviceTime too frequent: 138 counts during 132 steps 2024-12-18T00:21:04.2438383Z 2024-12-18T00:21:04.2438575Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2438701Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2438979Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2439085Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2439292Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2439430Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2439583Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2439738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2440083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2440413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2440703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2440971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2441258Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2441518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2441792Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2441964Z Execution Analysis: (:1) 2024-12-18T00:21:04.2442206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2442398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2442413Z 2024-12-18T00:21:04.2442607Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2442714Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2442942Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2443046Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2443252Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2443387Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2443540Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2443696Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2444812Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2445405Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2445831Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2446236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2446553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2446846Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2447192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2447483Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2447597Z Execution Analysis: .......... 2024-12-18T00:21:04.2447859Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2448079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2448368Z pt-xla-profiler: TransferFromDeviceTime too frequent: 139 counts during 133 steps 2024-12-18T00:21:04.2448376Z 2024-12-18T00:21:04.2448597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2448714Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2449020Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2449133Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2449341Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2449504Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2449650Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2449835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2450194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2450561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2450878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2451153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2451474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2451749Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2452092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2452220Z Execution Analysis: (:1) 2024-12-18T00:21:04.2452491Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2452700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2452704Z 2024-12-18T00:21:04.2452923Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2453042Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2453274Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2453403Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2453614Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2453779Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2453933Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2454118Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2454715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2455328Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2455732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2456085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2456480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2456790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2457120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2457393Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2457517Z Execution Analysis: .......... 2024-12-18T00:21:04.2457781Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2457991Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2458295Z pt-xla-profiler: TransferFromDeviceTime too frequent: 140 counts during 134 steps 2024-12-18T00:21:04.2458300Z 2024-12-18T00:21:04.2458506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2458639Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2458935Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2459063Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2459273Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2459420Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2459576Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2459745Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2460118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2460473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2460801Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2461078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2461405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2461677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2462003Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2462142Z Execution Analysis: (:1) 2024-12-18T00:21:04.2462405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2462625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2462631Z 2024-12-18T00:21:04.2462835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2462963Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2463197Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2463310Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2463533Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2463682Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2463844Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2464014Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2464651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2465228Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2465630Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2465984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2466325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2466613Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2466928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2467211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2467320Z Execution Analysis: .......... 2024-12-18T00:21:04.2467598Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2467803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2468091Z pt-xla-profiler: TransferFromDeviceTime too frequent: 141 counts during 135 steps 2024-12-18T00:21:04.2468107Z 2024-12-18T00:21:04.2468312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2468430Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2468740Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2468962Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2469167Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2469304Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2469453Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2469614Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2469950Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2470292Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2470584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2470852Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2471138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2471431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2471706Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2471824Z Execution Analysis: (:1) 2024-12-18T00:21:04.2472079Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2472271Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2472277Z 2024-12-18T00:21:04.2472477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2472585Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2472813Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2472918Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2473127Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2473263Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2473402Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2473578Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2474242Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2474813Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2475151Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2475496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2475826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2476088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2476390Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2476644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2476764Z Execution Analysis: .......... 2024-12-18T00:21:04.2477008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2477217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2477482Z pt-xla-profiler: TransferFromDeviceTime too frequent: 142 counts during 136 steps 2024-12-18T00:21:04.2477487Z 2024-12-18T00:21:04.2477696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2477807Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2478083Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2478206Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2478399Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2478551Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2478689Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2478862Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2479200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2479527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2479834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2480090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2480424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2480678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2480967Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2481090Z Execution Analysis: (:1) 2024-12-18T00:21:04.2481335Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2481543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2481548Z 2024-12-18T00:21:04.2481739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2481863Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2482083Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2482207Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2482404Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2482554Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2482696Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2482880Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2483453Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2484015Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2484366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2484723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2485034Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2485294Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2485595Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2485846Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2485948Z Execution Analysis: .......... 2024-12-18T00:21:04.2486209Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2486399Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2486675Z pt-xla-profiler: TransferFromDeviceTime too frequent: 143 counts during 137 steps 2024-12-18T00:21:04.2486682Z 2024-12-18T00:21:04.2486871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2486993Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2487265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2487371Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2487575Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2487710Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2487859Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2488020Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2488365Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2488691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2488984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2489279Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2489565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2489827Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2490101Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2490234Z Execution Analysis: (:1) 2024-12-18T00:21:04.2490477Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2490684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2490688Z 2024-12-18T00:21:04.2490880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2490988Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2491219Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2491325Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2491536Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2491673Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2491850Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2492012Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2492586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2493132Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2493492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2493835Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2494126Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2494393Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2494681Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2494943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2495047Z Execution Analysis: .......... 2024-12-18T00:21:04.2495289Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2495491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2495759Z pt-xla-profiler: TransferFromDeviceTime too frequent: 144 counts during 138 steps 2024-12-18T00:21:04.2495765Z 2024-12-18T00:21:04.2495967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2496077Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2496434Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2496548Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2496922Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2497075Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2497224Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2497411Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2497773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2498145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2498495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2498787Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2499099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2499374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2499684Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2499815Z Execution Analysis: (:1) 2024-12-18T00:21:04.2500091Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2500298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2500303Z 2024-12-18T00:21:04.2500521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2500639Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2500871Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2500999Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2501213Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2501402Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2501552Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2501761Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2502359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2502978Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2503341Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2503698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2504028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2504307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2504635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2504911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2505035Z Execution Analysis: .......... 2024-12-18T00:21:04.2505296Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2505505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2505808Z pt-xla-profiler: TransferFromDeviceTime too frequent: 145 counts during 139 steps 2024-12-18T00:21:04.2505813Z 2024-12-18T00:21:04.2506018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2506148Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2506442Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2506569Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2506778Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2506936Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2507081Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2507252Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2507627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2507979Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2508339Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2508616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2508940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2509303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2509576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2509705Z Execution Analysis: (:1) 2024-12-18T00:21:04.2509946Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2510151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2510157Z 2024-12-18T00:21:04.2510347Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2510467Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2510687Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2510803Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2511024Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2511162Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2511353Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2511513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2512075Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2512634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2512985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2513314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2513610Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2513881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2514171Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2514436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2514540Z Execution Analysis: .......... 2024-12-18T00:21:04.2514794Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2514986Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2515262Z pt-xla-profiler: TransferFromDeviceTime too frequent: 146 counts during 140 steps 2024-12-18T00:21:04.2515266Z 2024-12-18T00:21:04.2515454Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2515565Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2515849Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2515955Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2516161Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2516297Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2516441Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2516599Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2516935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2517305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2517770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2518052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2518356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2518637Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2518924Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2519061Z Execution Analysis: (:1) 2024-12-18T00:21:04.2519318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2519521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2519527Z 2024-12-18T00:21:04.2519743Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2519859Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2520103Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2520241Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2520461Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2520635Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2520780Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2520962Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2521568Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2522153Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2522509Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2522876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2523187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2523473Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2523779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2524045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2524168Z Execution Analysis: .......... 2024-12-18T00:21:04.2524426Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2524644Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2524924Z pt-xla-profiler: TransferFromDeviceTime too frequent: 147 counts during 141 steps 2024-12-18T00:21:04.2524928Z 2024-12-18T00:21:04.2525145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2525260Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2525548Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2525675Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2525880Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2526040Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2526182Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2526365Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2526750Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2527100Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2527421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2527693Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2528009Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2528272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2528573Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2528700Z Execution Analysis: (:1) 2024-12-18T00:21:04.2528971Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2529176Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2529180Z 2024-12-18T00:21:04.2529380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2529509Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2529862Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2529984Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2530202Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2530352Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2530492Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2530649Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2531235Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2531770Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2532117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2532445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2532754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2533008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2533311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2533563Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2533664Z Execution Analysis: .......... 2024-12-18T00:21:04.2533920Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2534112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2534391Z pt-xla-profiler: TransferFromDeviceTime too frequent: 148 counts during 142 steps 2024-12-18T00:21:04.2534397Z 2024-12-18T00:21:04.2534587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2534713Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2534987Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2535105Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2535295Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2535433Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2535586Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2535771Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2536120Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2536531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2537005Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2537281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2537595Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2537877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2538173Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2538315Z Execution Analysis: (:1) 2024-12-18T00:21:04.2538578Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2538798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2538802Z 2024-12-18T00:21:04.2539037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2539169Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2539402Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2539543Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2539766Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2539912Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2540075Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2540270Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2540870Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2541460Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2541824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2542192Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2542509Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2542802Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2543118Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2543405Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2543517Z Execution Analysis: .......... 2024-12-18T00:21:04.2543778Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2544000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2544460Z pt-xla-profiler: TransferFromDeviceTime too frequent: 150 counts during 143 steps 2024-12-18T00:21:04.2544466Z 2024-12-18T00:21:04.2544690Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2544808Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2545117Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2545230Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2545456Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2545605Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2545814Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2545999Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2546359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2546732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2547048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2547345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2547655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2547926Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2548235Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2548363Z Execution Analysis: (:1) 2024-12-18T00:21:04.2548640Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2548847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2548851Z 2024-12-18T00:21:04.2549124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2549274Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2549519Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2549633Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2549844Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2550003Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2550192Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2550380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2550980Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2551571Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2551933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2552289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2552615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2552892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2553216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2553489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2553611Z Execution Analysis: .......... 2024-12-18T00:21:04.2553870Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2554089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2554382Z pt-xla-profiler: TransferFromDeviceTime too frequent: 151 counts during 144 steps 2024-12-18T00:21:04.2554389Z 2024-12-18T00:21:04.2554595Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2554723Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2555016Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2555142Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2555350Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2555537Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2555680Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2555850Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2556325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2556674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2556993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2557263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2557578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2557842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2558144Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2558270Z Execution Analysis: (:1) 2024-12-18T00:21:04.2558526Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2558770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2558775Z 2024-12-18T00:21:04.2558976Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2559132Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2559360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2559487Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2559696Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2559865Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2560028Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2560199Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2560786Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2561350Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2561718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2562064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2562382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2562761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2563051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2563315Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2563417Z Execution Analysis: .......... 2024-12-18T00:21:04.2563673Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2563865Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2564144Z pt-xla-profiler: TransferFromDeviceTime too frequent: 152 counts during 145 steps 2024-12-18T00:21:04.2564148Z 2024-12-18T00:21:04.2564345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2564468Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2564742Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2564878Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2565084Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2565220Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2565370Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2565529Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2565866Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2566209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2566501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2566772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2567064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2567332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2567606Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2567741Z Execution Analysis: (:1) 2024-12-18T00:21:04.2568009Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2568203Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2568245Z 2024-12-18T00:21:04.2568436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2568546Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2568778Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2568885Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2569122Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2569262Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2569402Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2569575Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2570129Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2570676Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2571014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2571356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2571652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2571925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2572214Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2572467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2572584Z Execution Analysis: .......... 2024-12-18T00:21:04.2572829Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2573037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2573303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 153 counts during 146 steps 2024-12-18T00:21:04.2573308Z 2024-12-18T00:21:04.2573516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2573625Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2573935Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2574043Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2574234Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2574382Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2574519Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2574692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2575025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2575362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2575653Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2575907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2576207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2576529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2576988Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2577116Z Execution Analysis: (:1) 2024-12-18T00:21:04.2577423Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2577657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2577662Z 2024-12-18T00:21:04.2577881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2577996Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2578254Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2578381Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2578592Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2578751Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2578899Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2579067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2579678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2580258Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2580631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2580988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2581318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2581598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2581922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2582194Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2582320Z Execution Analysis: .......... 2024-12-18T00:21:04.2582580Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2582787Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2583086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 154 counts during 147 steps 2024-12-18T00:21:04.2583090Z 2024-12-18T00:21:04.2583296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2583482Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2583775Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2583900Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2584107Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2584260Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2584418Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2584591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2584965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2585317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2585645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2585925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2586238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2586523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2586847Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2586990Z Execution Analysis: (:1) 2024-12-18T00:21:04.2587252Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2587498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2587503Z 2024-12-18T00:21:04.2587708Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2587863Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2588101Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2588215Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2588438Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2588585Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2588750Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2588924Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2589605Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2590141Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2590475Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2590818Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2591111Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2591377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2591666Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2591929Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2592033Z Execution Analysis: .......... 2024-12-18T00:21:04.2592290Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2592482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2592749Z pt-xla-profiler: TransferFromDeviceTime too frequent: 155 counts during 148 steps 2024-12-18T00:21:04.2592753Z 2024-12-18T00:21:04.2592984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2593092Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2593378Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2593485Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2593691Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2593828Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2593965Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2594132Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2594465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2594803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2595097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2595365Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2595650Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2595912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2596214Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2596356Z Execution Analysis: (:1) 2024-12-18T00:21:04.2596607Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2596799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2596803Z 2024-12-18T00:21:04.2597051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2597163Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2597390Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2597494Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2597688Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2597834Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2597974Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2598143Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2598692Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2599235Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2599574Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2599916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2600208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2600463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2600763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2601017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2601129Z Execution Analysis: .......... 2024-12-18T00:21:04.2601371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2601573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2601839Z pt-xla-profiler: TransferFromDeviceTime too frequent: 156 counts during 149 steps 2024-12-18T00:21:04.2601869Z 2024-12-18T00:21:04.2602073Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2602181Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2602453Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2602576Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2602769Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2602922Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2603058Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2603218Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2603563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2603893Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2604198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2604453Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2604748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2605020Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2605296Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2610531Z Execution Analysis: (:1) 2024-12-18T00:21:04.2610812Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2611019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2611111Z 2024-12-18T00:21:04.2611308Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2611427Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2611646Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2611759Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2611958Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2612098Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2612248Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2612408Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2612977Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2613514Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2613860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2614189Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2614478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2614748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2615038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2615302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2615404Z Execution Analysis: .......... 2024-12-18T00:21:04.2615654Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2615848Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2616156Z pt-xla-profiler: TransferFromDeviceTime too frequent: 157 counts during 150 steps 2024-12-18T00:21:04.2616161Z 2024-12-18T00:21:04.2616450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2616563Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2617020Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2617135Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2617355Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2617503Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2617654Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2617826Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2618187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2618555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2618870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2619155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2619499Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2619780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2620110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2620234Z Execution Analysis: (:1) 2024-12-18T00:21:04.2620504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2620762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2620770Z 2024-12-18T00:21:04.2620986Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2621103Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2621344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2621458Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2621679Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2621823Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2621972Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2622149Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2622742Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2623327Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2623690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2624049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2624364Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2624648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2624958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2625230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2625346Z Execution Analysis: .......... 2024-12-18T00:21:04.2625607Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2625939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2626225Z pt-xla-profiler: TransferFromDeviceTime too frequent: 158 counts during 151 steps 2024-12-18T00:21:04.2626230Z 2024-12-18T00:21:04.2626439Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2626558Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2626853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2626976Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2627183Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2627337Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2627482Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2627660Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2628020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2628370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2628695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2629102Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2629398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2629672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2629948Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2630065Z Execution Analysis: (:1) 2024-12-18T00:21:04.2630331Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2630525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2630529Z 2024-12-18T00:21:04.2630714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2630829Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2631045Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2631156Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2631352Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2631498Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2631636Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2631789Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2632349Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2632883Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2633226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2633555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2633853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2634111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2634403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2634655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2634755Z Execution Analysis: .......... 2024-12-18T00:21:04.2635002Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2635218Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2635490Z pt-xla-profiler: TransferFromDeviceTime too frequent: 159 counts during 152 steps 2024-12-18T00:21:04.2635495Z 2024-12-18T00:21:04.2635688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2635801Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2636072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2636181Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2636372Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2636506Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2636650Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2636805Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2637145Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2637470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2637786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2638041Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2638349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2638603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2638872Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2639019Z Execution Analysis: (:1) 2024-12-18T00:21:04.2639260Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2639460Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2639464Z 2024-12-18T00:21:04.2639653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2639767Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2639980Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2640084Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2640285Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2640417Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2640562Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2640717Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2641264Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2641808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2642141Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2642476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2642768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2643032Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2643319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2643578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2643702Z Execution Analysis: .......... 2024-12-18T00:21:04.2643940Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2644287Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2644735Z pt-xla-profiler: TransferFromDeviceTime too frequent: 160 counts during 153 steps 2024-12-18T00:21:04.2644740Z 2024-12-18T00:21:04.2644947Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2645064Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2645366Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2645479Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2645692Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2645840Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2645984Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2646161Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2646519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2646879Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2647265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2647586Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2647895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2648165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2648501Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2648632Z Execution Analysis: (:1) 2024-12-18T00:21:04.2648904Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2649108Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2649113Z 2024-12-18T00:21:04.2649325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2649438Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2649679Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2649792Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2649999Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2650154Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2650303Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2650481Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2651075Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2651654Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2652016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2652367Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2652687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2652961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2653282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2653589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2653704Z Execution Analysis: .......... 2024-12-18T00:21:04.2653964Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2654172Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2654461Z pt-xla-profiler: TransferFromDeviceTime too frequent: 161 counts during 154 steps 2024-12-18T00:21:04.2654468Z 2024-12-18T00:21:04.2654671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2654793Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2655085Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2655204Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2655413Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2655566Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2655712Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2655877Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2656248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2656713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2657039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2657363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2657681Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2657977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2658278Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2658407Z Execution Analysis: (:1) 2024-12-18T00:21:04.2658672Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2658890Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2658897Z 2024-12-18T00:21:04.2659101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2659225Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2659459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2659577Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2659788Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2659931Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2660093Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2660267Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2660871Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2661449Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2661816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2662176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2662495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2662772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2663083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2663387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2663495Z Execution Analysis: .......... 2024-12-18T00:21:04.2663758Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2663966Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2664259Z pt-xla-profiler: TransferFromDeviceTime too frequent: 162 counts during 155 steps 2024-12-18T00:21:04.2664264Z 2024-12-18T00:21:04.2664468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2664582Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2664882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2664997Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2665210Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2665355Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2665506Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2665671Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2666052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2666413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2666752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2667031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2667338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2667638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2667933Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2668062Z Execution Analysis: (:1) 2024-12-18T00:21:04.2668321Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2668523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2668527Z 2024-12-18T00:21:04.2668735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2668850Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2669184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2669287Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2669488Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2669622Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2669756Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2669924Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2670471Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2671009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2671345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2671676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2671967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2672231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2672541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2672786Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2672891Z Execution Analysis: .......... 2024-12-18T00:21:04.2673134Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2673328Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2673594Z pt-xla-profiler: TransferFromDeviceTime too frequent: 163 counts during 156 steps 2024-12-18T00:21:04.2673598Z 2024-12-18T00:21:04.2673793Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2673898Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2674176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2674282Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2674472Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2674610Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2674741Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2674947Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2675276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2675847Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2676135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2676385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2676702Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2676956Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2677234Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2677352Z Execution Analysis: (:1) 2024-12-18T00:21:04.2677602Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2677794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2677800Z 2024-12-18T00:21:04.2677994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2678101Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2678316Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2678430Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2678623Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2678767Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2678905Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2679058Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2679617Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2680145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2680484Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2680808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2681105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2681385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2681672Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2681921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2682019Z Execution Analysis: .......... 2024-12-18T00:21:04.2682265Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2682455Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2682726Z pt-xla-profiler: TransferFromDeviceTime too frequent: 164 counts during 157 steps 2024-12-18T00:21:04.2682731Z 2024-12-18T00:21:04.2682921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2683032Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2683303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2683411Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2683601Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2683733Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2683899Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2684056Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2684417Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2684741Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2685035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2685314Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2685601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2685855Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2686127Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2686253Z Execution Analysis: (:1) 2024-12-18T00:21:04.2686493Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2686689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2686693Z 2024-12-18T00:21:04.2686881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2686994Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2687207Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2687310Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2687516Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2687649Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2687793Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2687950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2688500Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2689032Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2689359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2689692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2690006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2690263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2690549Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2690806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2690908Z Execution Analysis: .......... 2024-12-18T00:21:04.2691153Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2691340Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2691600Z pt-xla-profiler: TransferFromDeviceTime too frequent: 165 counts during 158 steps 2024-12-18T00:21:04.2691605Z 2024-12-18T00:21:04.2691805Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2691914Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2692187Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2692288Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2692482Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2692654Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2692787Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2692973Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2693303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2693637Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2693952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2694218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2694501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2694755Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2695026Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2695141Z Execution Analysis: (:1) 2024-12-18T00:21:04.2695389Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2695576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2695580Z 2024-12-18T00:21:04.2695776Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2695884Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2696103Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2696205Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2696496Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2696642Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2696942Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2697121Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2697715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2698307Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2698670Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2699034Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2699380Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2699655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2699980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2700250Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2700374Z Execution Analysis: .......... 2024-12-18T00:21:04.2700635Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2700853Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2701142Z pt-xla-profiler: TransferFromDeviceTime too frequent: 166 counts during 159 steps 2024-12-18T00:21:04.2701149Z 2024-12-18T00:21:04.2701368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2701487Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2701781Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2701911Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2702146Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2702308Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2702480Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2702648Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2703023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2703402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2703728Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2704008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2704334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2704608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2704917Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2705050Z Execution Analysis: (:1) 2024-12-18T00:21:04.2705315Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2705534Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2705539Z 2024-12-18T00:21:04.2705744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2705875Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2706109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2706234Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2706447Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2706598Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2706762Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2706932Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2707539Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2708116Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2708489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2708874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2709301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2709561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2709849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2710113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2710212Z Execution Analysis: .......... 2024-12-18T00:21:04.2710467Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2710658Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2710934Z pt-xla-profiler: TransferFromDeviceTime too frequent: 167 counts during 160 steps 2024-12-18T00:21:04.2710940Z 2024-12-18T00:21:04.2711128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2711247Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2711546Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2711651Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2711857Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2712019Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2712164Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2712323Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2712663Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2713016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2713309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2713575Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2713859Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2714122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2714396Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2714527Z Execution Analysis: (:1) 2024-12-18T00:21:04.2714771Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2714962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2714978Z 2024-12-18T00:21:04.2715168Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2715276Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2715504Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2715609Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2715818Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2715953Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2716106Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2716263Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2716811Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2717354Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2717895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2718252Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2718556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2718836Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2719137Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2719411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2719515Z Execution Analysis: .......... 2024-12-18T00:21:04.2719768Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2719979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2720259Z pt-xla-profiler: TransferFromDeviceTime too frequent: 168 counts during 161 steps 2024-12-18T00:21:04.2720263Z 2024-12-18T00:21:04.2720474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2720587Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2720911Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2721052Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2721254Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2721408Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2721550Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2721726Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2722103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2722462Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2722768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2723039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2723349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2723613Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2723910Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2724035Z Execution Analysis: (:1) 2024-12-18T00:21:04.2724301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2724503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2724509Z 2024-12-18T00:21:04.2724720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2724832Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2725058Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2725179Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2725383Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2725538Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2725684Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2725861Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2726439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2729552Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2729979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2730306Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2730612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2730870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2731167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2731416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2731515Z Execution Analysis: .......... 2024-12-18T00:21:04.2731773Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2732003Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2732270Z pt-xla-profiler: TransferFromDeviceTime too frequent: 169 counts during 162 steps 2024-12-18T00:21:04.2732276Z 2024-12-18T00:21:04.2732476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2732585Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2732869Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2733003Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2733207Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2733344Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2733477Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2733669Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2734010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2734349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2734639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2734903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2735188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2735440Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2735723Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2735842Z Execution Analysis: (:1) 2024-12-18T00:21:04.2736097Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2736292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2736297Z 2024-12-18T00:21:04.2736605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2736715Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2737110Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2737238Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2737453Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2737614Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2737764Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2737950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2738548Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2739249Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2739612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2739965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2740290Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2740568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2740893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2741164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2741284Z Execution Analysis: .......... 2024-12-18T00:21:04.2741546Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2741752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2742056Z pt-xla-profiler: TransferFromDeviceTime too frequent: 171 counts during 163 steps 2024-12-18T00:21:04.2742061Z 2024-12-18T00:21:04.2742268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2742428Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2742724Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2742847Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2743053Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2743210Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2743380Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2743554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2743928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2744428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2744756Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2745030Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2745353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2745623Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2745915Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2746057Z Execution Analysis: (:1) 2024-12-18T00:21:04.2746320Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2746540Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2746545Z 2024-12-18T00:21:04.2746747Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2746871Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2747102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2747230Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2747441Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2747585Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2747747Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2747918Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2748600Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2749210Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2749582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2749938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2750252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2750539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2750848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2751133Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2751244Z Execution Analysis: .......... 2024-12-18T00:21:04.2751519Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2751726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2752023Z pt-xla-profiler: TransferFromDeviceTime too frequent: 172 counts during 164 steps 2024-12-18T00:21:04.2752028Z 2024-12-18T00:21:04.2752233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2752393Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2752701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2752815Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2753030Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2753210Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2753370Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2753541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2753900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2754262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2754574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2754865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2755174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2755455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2755854Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2755982Z Execution Analysis: (:1) 2024-12-18T00:21:04.2756224Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2756414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2756418Z 2024-12-18T00:21:04.2756621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2756730Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2756957Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2757062Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2757269Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2757405Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2757546Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2757714Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2758317Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2758862Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2759195Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2759536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2759825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2760092Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2760380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2760632Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2760746Z Execution Analysis: .......... 2024-12-18T00:21:04.2760989Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2761191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2761455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 173 counts during 165 steps 2024-12-18T00:21:04.2761484Z 2024-12-18T00:21:04.2761682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2761792Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2762064Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2762179Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2762410Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2762559Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2762695Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2762862Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2763194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2763523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2763826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2764081Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2764378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2764630Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2764915Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2765035Z Execution Analysis: (:1) 2024-12-18T00:21:04.2765286Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2765476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2765480Z 2024-12-18T00:21:04.2765668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2765789Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2766005Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2766120Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2766314Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2766461Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2766625Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2766807Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2767370Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2767903Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2768250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2768576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2768878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2769133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2769432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2769682Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2769782Z Execution Analysis: .......... 2024-12-18T00:21:04.2770031Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2770226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2770528Z pt-xla-profiler: TransferFromDeviceTime too frequent: 174 counts during 166 steps 2024-12-18T00:21:04.2770533Z 2024-12-18T00:21:04.2770722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2770839Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2771217Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2771336Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2771531Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2771663Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2771811Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2771970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2772312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2772639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2772945Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2773200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2773485Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2773747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2774022Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2774152Z Execution Analysis: (:1) 2024-12-18T00:21:04.2774393Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2774589Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2774595Z 2024-12-18T00:21:04.2774784Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2774899Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2775116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2775219Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2775429Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2775590Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2775762Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2775920Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2776547Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2777293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2777660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2778031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2778349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2778643Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2778961Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2779246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2779356Z Execution Analysis: .......... 2024-12-18T00:21:04.2779617Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2779836Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2780152Z pt-xla-profiler: TransferFromDeviceTime too frequent: 175 counts during 167 steps 2024-12-18T00:21:04.2780158Z 2024-12-18T00:21:04.2780372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2780514Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2780816Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2780935Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2781153Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2781300Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2781444Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2781626Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2781985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2782354Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2782668Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2782953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2783263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2783536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2783843Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2783967Z Execution Analysis: (:1) 2024-12-18T00:21:04.2784236Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2784442Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2784448Z 2024-12-18T00:21:04.2784661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2784776Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2785017Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2785131Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2785367Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2785553Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2785702Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2785880Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2786474Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2787060Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2787426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2787777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2788102Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2788380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2788701Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2788971Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2789190Z Execution Analysis: .......... 2024-12-18T00:21:04.2789429Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2789657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2789921Z pt-xla-profiler: TransferFromDeviceTime too frequent: 176 counts during 168 steps 2024-12-18T00:21:04.2789926Z 2024-12-18T00:21:04.2790156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2790268Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2790556Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2790663Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2790856Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2791007Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2791144Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2791315Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2791649Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2791990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2792280Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2792537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2792842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2793094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2793379Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2793500Z Execution Analysis: (:1) 2024-12-18T00:21:04.2793756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2793955Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2793959Z 2024-12-18T00:21:04.2794165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2794274Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2794492Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2794637Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2794861Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2795014Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2795153Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2795325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2795878Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2796415Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2796765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2797096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2797408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2797668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2797970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2798224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2798340Z Execution Analysis: .......... 2024-12-18T00:21:04.2798616Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2798809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2799090Z pt-xla-profiler: TransferFromDeviceTime too frequent: 177 counts during 169 steps 2024-12-18T00:21:04.2799120Z 2024-12-18T00:21:04.2799317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2799448Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2799721Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2799842Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2800035Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2800172Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2800323Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2800483Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2800829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2801154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2801457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2801714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2802011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2802262Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2802534Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2802661Z Execution Analysis: (:1) 2024-12-18T00:21:04.2802903Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2803105Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2803109Z 2024-12-18T00:21:04.2803299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2803419Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2803662Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2803791Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2803999Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2804135Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2804286Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2804444Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2805006Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2805537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2805888Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2806219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2806510Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2806780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2807069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2807337Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2807469Z Execution Analysis: .......... 2024-12-18T00:21:04.2807721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2807913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2808202Z pt-xla-profiler: TransferFromDeviceTime too frequent: 178 counts during 170 steps 2024-12-18T00:21:04.2808221Z 2024-12-18T00:21:04.2808414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2808522Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2808807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2808912Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2809119Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2809258Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2809407Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2809566Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2809899Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2810239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2810533Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2810801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2811087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2811351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2811625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2811745Z Execution Analysis: (:1) 2024-12-18T00:21:04.2811997Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2812191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2812195Z 2024-12-18T00:21:04.2812401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2812535Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2812789Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2812895Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2813103Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2813239Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2813378Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2813550Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2814100Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2814644Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2814978Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2815323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2815612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2815867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2816169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2816529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2816647Z Execution Analysis: .......... 2024-12-18T00:21:04.2817064Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2817316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2817607Z pt-xla-profiler: TransferFromDeviceTime too frequent: 179 counts during 171 steps 2024-12-18T00:21:04.2817614Z 2024-12-18T00:21:04.2817834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2817950Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2818245Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2818377Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2818588Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2818750Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2818894Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2819083Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2819447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2819799Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2820128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2820402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2820725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2820998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2821306Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2821433Z Execution Analysis: (:1) 2024-12-18T00:21:04.2821696Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2821916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2821948Z 2024-12-18T00:21:04.2822184Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2822313Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2822548Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2822672Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2822883Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2823041Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2823192Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2823361Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2823965Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2824541Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2824920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2825276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2825602Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2825879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2826228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2826499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2826610Z Execution Analysis: .......... 2024-12-18T00:21:04.2826907Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2827117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2827419Z pt-xla-profiler: TransferFromDeviceTime too frequent: 180 counts during 172 steps 2024-12-18T00:21:04.2827425Z 2024-12-18T00:21:04.2827629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2827761Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2828056Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2828172Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2828394Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2828544Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2828702Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2828875Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2829337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2829672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2829963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2830230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2830515Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2830777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2831046Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2831175Z Execution Analysis: (:1) 2024-12-18T00:21:04.2831417Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2831619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2831649Z 2024-12-18T00:21:04.2832050Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2832164Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2832401Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2832512Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2832728Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2832874Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2833033Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2833200Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2833783Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2834361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2834715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2835077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2835383Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2835694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2836001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2836281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2836389Z Execution Analysis: .......... 2024-12-18T00:21:04.2836667Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2836887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2837167Z pt-xla-profiler: TransferFromDeviceTime too frequent: 181 counts during 173 steps 2024-12-18T00:21:04.2837172Z 2024-12-18T00:21:04.2837386Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2837500Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2837802Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2837914Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2838130Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2838277Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2838420Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2838602Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2838960Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2839321Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2839628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2839914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2840221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2840486Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2840787Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2840913Z Execution Analysis: (:1) 2024-12-18T00:21:04.2841183Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2841439Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2841444Z 2024-12-18T00:21:04.2841657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2841771Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2842000Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2842126Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2842335Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2842492Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2842638Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2842820Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2843403Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2843983Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2844639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2844994Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2845387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2845666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2845991Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2846296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2846419Z Execution Analysis: .......... 2024-12-18T00:21:04.2846682Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2846887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2847186Z pt-xla-profiler: TransferFromDeviceTime too frequent: 182 counts during 174 steps 2024-12-18T00:21:04.2847191Z 2024-12-18T00:21:04.2847396Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2847525Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2847819Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2847943Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2848149Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2848310Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2848453Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2848624Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2849000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2849350Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2849671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2849948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2850271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2850543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2850838Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2850980Z Execution Analysis: (:1) 2024-12-18T00:21:04.2851311Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2851532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2851537Z 2024-12-18T00:21:04.2851741Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2851869Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2852100Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2852231Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2852443Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2852589Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2852752Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2852923Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2853535Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2854114Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2854491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2854844Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2855187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2855476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2855811Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2856094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2856204Z Execution Analysis: .......... 2024-12-18T00:21:04.2856547Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2856756Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2857061Z pt-xla-profiler: TransferFromDeviceTime too frequent: 183 counts during 175 steps 2024-12-18T00:21:04.2857066Z 2024-12-18T00:21:04.2857273Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2857392Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2857702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2857816Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2858039Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2858189Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2858360Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2858532Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2858894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2859267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2859584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2859877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2860188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2860471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2860766Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2860924Z Execution Analysis: (:1) 2024-12-18T00:21:04.2861224Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2861431Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2861436Z 2024-12-18T00:21:04.2861651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2861770Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2862014Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2862129Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2862352Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2862498Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2862649Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2862833Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2863428Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2864016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2864379Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2864773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2865087Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2865376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2865712Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2865988Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2866114Z Execution Analysis: .......... 2024-12-18T00:21:04.2866371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2866588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2866875Z pt-xla-profiler: TransferFromDeviceTime too frequent: 184 counts during 176 steps 2024-12-18T00:21:04.2866882Z 2024-12-18T00:21:04.2867099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2867216Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2867511Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2867638Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2867845Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2868007Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2868152Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2868333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2868693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2869140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2869443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2869697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2869994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2870247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2870598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2870717Z Execution Analysis: (:1) 2024-12-18T00:21:04.2870969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2871159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2871163Z 2024-12-18T00:21:04.2871352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2871472Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2871687Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2871803Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2871997Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2872147Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2872289Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2872448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2873007Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2873538Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2873908Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2874233Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2874538Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2874820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2875129Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2875381Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2875484Z Execution Analysis: .......... 2024-12-18T00:21:04.2875741Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2875932Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2876212Z pt-xla-profiler: TransferFromDeviceTime too frequent: 185 counts during 177 steps 2024-12-18T00:21:04.2876217Z 2024-12-18T00:21:04.2876408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2876528Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2876801Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2876920Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2877113Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2877250Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2877397Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2877554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2877898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2878225Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2878526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2878781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2879069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2879366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2879665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2879798Z Execution Analysis: (:1) 2024-12-18T00:21:04.2880040Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2880247Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2880253Z 2024-12-18T00:21:04.2880444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2880566Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2880783Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2880889Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2881101Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2881239Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2881395Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2881554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2882121Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2882654Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2883016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2883360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2883678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2883953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2884244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2884513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2884616Z Execution Analysis: .......... 2024-12-18T00:21:04.2884859Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2885068Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2885334Z pt-xla-profiler: TransferFromDeviceTime too frequent: 186 counts during 178 steps 2024-12-18T00:21:04.2885339Z 2024-12-18T00:21:04.2885544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2885655Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2885945Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2886057Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2886265Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2886404Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2886541Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2886715Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2887053Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2887397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2887692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2887964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2888298Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2888591Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2888879Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2889001Z Execution Analysis: (:1) 2024-12-18T00:21:04.2889258Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2889453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2889457Z 2024-12-18T00:21:04.2889660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2889769Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2890002Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2890106Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2890303Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2890452Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2890591Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2890764Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2891311Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2891882Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2892216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2892574Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2892881Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2893143Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2893440Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2893693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2893806Z Execution Analysis: .......... 2024-12-18T00:21:04.2894047Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2894249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2894513Z pt-xla-profiler: TransferFromDeviceTime too frequent: 187 counts during 179 steps 2024-12-18T00:21:04.2894518Z 2024-12-18T00:21:04.2894708Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2894829Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2895102Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2895225Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2895416Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2895565Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2895701Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2895861Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2896466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2896810Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2897300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2897577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2897964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2898235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2898540Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2898667Z Execution Analysis: (:1) 2024-12-18T00:21:04.2898928Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2899149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2899154Z 2024-12-18T00:21:04.2899357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2899487Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2899721Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2899849Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2900060Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2900208Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2900369Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2900540Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2901149Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2901754Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2902128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2902521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2902855Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2903132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2903445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2903728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2903840Z Execution Analysis: .......... 2024-12-18T00:21:04.2904115Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2904322Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2904621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 188 counts during 180 steps 2024-12-18T00:21:04.2904626Z 2024-12-18T00:21:04.2904834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2904969Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2905264Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2905378Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2905598Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2905743Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2905902Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2906071Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2906431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2906797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2907113Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2907453Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2907764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2908045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2908338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2908481Z Execution Analysis: (:1) 2024-12-18T00:21:04.2908740Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2908948Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2908965Z 2024-12-18T00:21:04.2909171Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2909288Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2909642Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2909756Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2909973Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2910115Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2910261Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2910439Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2911046Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2911620Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2912218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2912584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2912893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2913173Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2913476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2913739Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2913859Z Execution Analysis: .......... 2024-12-18T00:21:04.2914111Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2914324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2914604Z pt-xla-profiler: TransferFromDeviceTime too frequent: 189 counts during 181 steps 2024-12-18T00:21:04.2914610Z 2024-12-18T00:21:04.2914824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2914936Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2915232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2915340Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2915542Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2915699Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2915842Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2916019Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2916374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2916734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2917093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2917363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2917846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2918116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2918426Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2918556Z Execution Analysis: (:1) 2024-12-18T00:21:04.2918831Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2919147Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2919153Z 2024-12-18T00:21:04.2919371Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2919490Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2919719Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2919842Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2920047Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2920205Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2920352Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2920624Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2921215Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2921800Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2922173Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2922517Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2922836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2923104Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2923419Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2923685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2923804Z Execution Analysis: .......... 2024-12-18T00:21:04.2924057Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2924260Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2924558Z pt-xla-profiler: TransferFromDeviceTime too frequent: 190 counts during 182 steps 2024-12-18T00:21:04.2924563Z 2024-12-18T00:21:04.2924764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2924891Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2925180Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2925303Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2925508Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2925652Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2925808Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2925975Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2926341Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2926711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2927054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2927325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2927628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2927909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2928199Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2928340Z Execution Analysis: (:1) 2024-12-18T00:21:04.2928596Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2928814Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2928821Z 2024-12-18T00:21:04.2929024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2929152Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2929380Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2929598Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2929809Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2929946Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2930125Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2930283Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2930849Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2931406Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2931746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2932088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2932379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2932647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2932939Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2933208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2933314Z Execution Analysis: .......... 2024-12-18T00:21:04.2933572Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2933769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2934036Z pt-xla-profiler: TransferFromDeviceTime too frequent: 192 counts during 183 steps 2024-12-18T00:21:04.2934041Z 2024-12-18T00:21:04.2934249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2934359Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2934648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2934756Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2934964Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2935102Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2935239Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2935413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2935744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2936133Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2936496Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2936935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2937244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2937529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2937821Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2937948Z Execution Analysis: (:1) 2024-12-18T00:21:04.2938224Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2938431Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2938438Z 2024-12-18T00:21:04.2938659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2938774Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2939017Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2939128Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2939337Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2939543Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2939694Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2939878Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2940494Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2941087Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2941448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2941815Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2942132Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2942411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2942733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2943004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2943127Z Execution Analysis: .......... 2024-12-18T00:21:04.2943388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2943610Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2943896Z pt-xla-profiler: TransferFromDeviceTime too frequent: 193 counts during 184 steps 2024-12-18T00:21:04.2943901Z 2024-12-18T00:21:04.2944117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2944434Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2944731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2944856Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2945062Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2945222Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2945370Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2945539Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2946007Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2946363Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2946691Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2946967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2947294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2947567Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2947878Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2948009Z Execution Analysis: (:1) 2024-12-18T00:21:04.2948271Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2948495Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2948500Z 2024-12-18T00:21:04.2948706Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2948837Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2949069Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2949232Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2949443Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2949590Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2949753Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2949925Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2950567Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2951148Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2951523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2951877Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2952205Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2952481Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2952794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2953079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2953191Z Execution Analysis: .......... 2024-12-18T00:21:04.2953465Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2953671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2953969Z pt-xla-profiler: TransferFromDeviceTime too frequent: 194 counts during 185 steps 2024-12-18T00:21:04.2953974Z 2024-12-18T00:21:04.2954178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2954309Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2954602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2954714Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2954933Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2955081Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2955264Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2955458Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2955938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2956282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2956586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2956868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2957171Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2957445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2957733Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2957871Z Execution Analysis: (:1) 2024-12-18T00:21:04.2958126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2958326Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2958343Z 2024-12-18T00:21:04.2958541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2958654Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2958921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2959034Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2959249Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2959392Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2959549Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2959742Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2960327Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2960898Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2961251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2961608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2961915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2962197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2962503Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2962781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2962889Z Execution Analysis: .......... 2024-12-18T00:21:04.2963141Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2963353Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2963634Z pt-xla-profiler: TransferFromDeviceTime too frequent: 195 counts during 186 steps 2024-12-18T00:21:04.2963641Z 2024-12-18T00:21:04.2963856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2963970Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2964267Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2964378Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2964583Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2964768Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2964939Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2965121Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2965474Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2965831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2966141Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2966413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2966727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2966990Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2967290Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2967418Z Execution Analysis: (:1) 2024-12-18T00:21:04.2967684Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2967884Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2967889Z 2024-12-18T00:21:04.2968098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2968238Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2968467Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2968590Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2968795Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2968950Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2969121Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2969303Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2969893Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2970455Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2970818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2971265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2971571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2971830Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2972129Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2972384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2972500Z Execution Analysis: .......... 2024-12-18T00:21:04.2972740Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2972931Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2973210Z pt-xla-profiler: TransferFromDeviceTime too frequent: 196 counts during 187 steps 2024-12-18T00:21:04.2973214Z 2024-12-18T00:21:04.2973403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2973524Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2973796Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2973917Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2974133Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2974316Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2974464Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2974621Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2974967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2975299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2975602Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2975857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2976160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2976482Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2976924Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2977066Z Execution Analysis: (:1) 2024-12-18T00:21:04.2977327Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2977543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2977548Z 2024-12-18T00:21:04.2977787Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2977916Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2978151Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2978266Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2978514Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2978662Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2978827Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2978997Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2979603Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2980174Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2980549Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2980905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2981219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2981510Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2981825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2982107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2982215Z Execution Analysis: .......... 2024-12-18T00:21:04.2982484Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2982691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2982981Z pt-xla-profiler: TransferFromDeviceTime too frequent: 197 counts during 188 steps 2024-12-18T00:21:04.2982996Z 2024-12-18T00:21:04.2983198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2983313Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2983619Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2983757Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2983999Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2984146Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2984300Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2984468Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2984827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2985191Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2985503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2985787Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2986097Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2986381Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2986672Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2986798Z Execution Analysis: (:1) 2024-12-18T00:21:04.2987065Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2987272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2987303Z 2024-12-18T00:21:04.2987519Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2987637Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2987883Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2988022Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2988244Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2988394Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2988541Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2988719Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2989392Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2989932Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2990265Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2990598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2990888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2991148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2991446Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2991696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2991804Z Execution Analysis: .......... 2024-12-18T00:21:04.2992042Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2992241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2992506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 198 counts during 189 steps 2024-12-18T00:21:04.2992510Z 2024-12-18T00:21:04.2992710Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2992816Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2993138Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.2993254Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2993446Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.2993589Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.2993724Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.2993897Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2994233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.2994558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.2994857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.2995113Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.2995410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.2995662Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.2995943Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.2996061Z Execution Analysis: (:1) 2024-12-18T00:21:04.2996301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.2996525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2996530Z 2024-12-18T00:21:04.2996721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.2996834Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.2997075Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.2997192Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.2997387Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.2997533Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.2997670Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.2997825Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.2998381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.2999083Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.2999445Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.2999792Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3000106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3000378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3000691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3000953Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3001059Z Execution Analysis: .......... 2024-12-18T00:21:04.3001321Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3001519Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3001805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 199 counts during 190 steps 2024-12-18T00:21:04.3001810Z 2024-12-18T00:21:04.3002010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3002160Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3002471Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3002581Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3002791Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3002935Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3003083Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3003251Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3003614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3003954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3004261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3004539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3004842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3005114Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3005399Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3005533Z Execution Analysis: (:1) 2024-12-18T00:21:04.3005813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3006026Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3006030Z 2024-12-18T00:21:04.3006230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3006368Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3006604Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3006716Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3006932Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3007073Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3007229Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3007393Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3007972Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3008546Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3008900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3009254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3009561Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3009844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3010149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3010423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3010531Z Execution Analysis: .......... 2024-12-18T00:21:04.3010888Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3011087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3011353Z pt-xla-profiler: TransferFromDeviceTime too frequent: 200 counts during 191 steps 2024-12-18T00:21:04.3011394Z 2024-12-18T00:21:04.3011623Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3011730Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3015992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3016143Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3016429Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3016589Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3016736Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3017077Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3017450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3017815Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3018130Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3018411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3018725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3018994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3019295Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3019499Z Execution Analysis: (:1) 2024-12-18T00:21:04.3019767Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3019974Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3019981Z 2024-12-18T00:21:04.3020220Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3020344Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3020579Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3020700Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3020912Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3021066Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3021217Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3021389Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3021989Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3022562Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3022931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3023287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3023611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3023889Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3024205Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3024477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3024588Z Execution Analysis: .......... 2024-12-18T00:21:04.3024847Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3025052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3025348Z pt-xla-profiler: TransferFromDeviceTime too frequent: 201 counts during 192 steps 2024-12-18T00:21:04.3025385Z 2024-12-18T00:21:04.3025621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3025742Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3026033Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3026149Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3026354Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3026501Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3026647Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3026813Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3027174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3027526Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3027846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3028118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3028420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3028694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3029119Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3029241Z Execution Analysis: (:1) 2024-12-18T00:21:04.3029478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3029700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3029705Z 2024-12-18T00:21:04.3029894Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3030007Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3030219Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3030321Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3030520Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3030655Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3030799Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3030956Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3031514Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3032044Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3032376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3032709Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3032997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3033256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3033544Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3033796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3033894Z Execution Analysis: .......... 2024-12-18T00:21:04.3034137Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3034327Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3034640Z pt-xla-profiler: TransferFromDeviceTime too frequent: 202 counts during 193 steps 2024-12-18T00:21:04.3034651Z 2024-12-18T00:21:04.3034838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3034944Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3035216Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3035323Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3035522Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3035656Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3035786Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3035950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3036284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3036619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3036907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3037166Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3037450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3037732Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3038002Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3038120Z Execution Analysis: (:1) 2024-12-18T00:21:04.3038366Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3038579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3038585Z 2024-12-18T00:21:04.3038781Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3038888Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3039109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3039214Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3039404Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3039547Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3039686Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3039850Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3040400Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3040938Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3041275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3041604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3041893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3042147Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3042439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3042684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3042789Z Execution Analysis: .......... 2024-12-18T00:21:04.3043030Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3043281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3043548Z pt-xla-profiler: TransferFromDeviceTime too frequent: 203 counts during 194 steps 2024-12-18T00:21:04.3043553Z 2024-12-18T00:21:04.3043747Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3043854Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3044123Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3044382Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3044753Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3044910Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3045057Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3045236Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3045598Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3045951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3046272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3046548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3046861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3047195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3047492Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3047619Z Execution Analysis: (:1) 2024-12-18T00:21:04.3047927Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3048144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3048149Z 2024-12-18T00:21:04.3048351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3048469Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3048700Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3048817Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3049026Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3049166Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3049321Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3049487Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3050091Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3050672Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3051041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3051394Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3051713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3051988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3052301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3052581Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3052691Z Execution Analysis: .......... 2024-12-18T00:21:04.3052997Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3053236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3053530Z pt-xla-profiler: TransferFromDeviceTime too frequent: 204 counts during 195 steps 2024-12-18T00:21:04.3053536Z 2024-12-18T00:21:04.3053739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3053861Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3054152Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3054263Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3054474Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3054619Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3054773Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3054942Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3055306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3055659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3055969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3056251Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3056665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3056943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3057237Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3057395Z Execution Analysis: (:1) 2024-12-18T00:21:04.3057656Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3057859Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3057873Z 2024-12-18T00:21:04.3058076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3058188Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3058427Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3058539Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3058756Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3058899Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3059050Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3059219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3059812Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3060399Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3060760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3061118Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3061433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3061709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3062020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3062297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3062431Z Execution Analysis: .......... 2024-12-18T00:21:04.3062716Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3062929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3063218Z pt-xla-profiler: TransferFromDeviceTime too frequent: 205 counts during 196 steps 2024-12-18T00:21:04.3063223Z 2024-12-18T00:21:04.3063433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3063551Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3063850Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3063962Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3064167Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3064327Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3064475Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3064654Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3065013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3065369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3065683Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3065982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3066300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3066571Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3066899Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3067030Z Execution Analysis: (:1) 2024-12-18T00:21:04.3067297Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3067505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3067509Z 2024-12-18T00:21:04.3067719Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3067835Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3068070Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3068193Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3068403Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3068665Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3068808Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3068968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3069523Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3070049Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3070391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3070717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3071018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3071273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3071568Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3071838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3072044Z Execution Analysis: .......... 2024-12-18T00:21:04.3072282Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3072467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3072735Z pt-xla-profiler: TransferFromDeviceTime too frequent: 206 counts during 197 steps 2024-12-18T00:21:04.3072741Z 2024-12-18T00:21:04.3072928Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3073039Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3073307Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3073416Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3073608Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3073742Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3073883Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3074038Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3074377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3074698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3075018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3075272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3075565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3075838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3076111Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3076234Z Execution Analysis: (:1) 2024-12-18T00:21:04.3076474Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3076666Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3076671Z 2024-12-18T00:21:04.3076858Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3076971Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3077185Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3077286Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3077488Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3077624Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3077774Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3077931Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3078486Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3079016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3079354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3079680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3079968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3080229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3080540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3080819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3080920Z Execution Analysis: .......... 2024-12-18T00:21:04.3081163Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3081352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3081614Z pt-xla-profiler: TransferFromDeviceTime too frequent: 207 counts during 198 steps 2024-12-18T00:21:04.3081627Z 2024-12-18T00:21:04.3081814Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3081920Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3082199Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3082306Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3082501Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3082636Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3082774Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3082930Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3083263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3083597Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3083922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3084182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3084492Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3084748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3085022Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3085138Z Execution Analysis: (:1) 2024-12-18T00:21:04.3085382Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3085573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3085579Z 2024-12-18T00:21:04.3085779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3085886Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3086111Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3086214Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3086412Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3086548Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3086687Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3086854Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3087401Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3087938Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3088272Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3088604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3088894Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3089146Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3089491Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3089741Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3089848Z Execution Analysis: .......... 2024-12-18T00:21:04.3090086Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3090280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3090545Z pt-xla-profiler: TransferFromDeviceTime too frequent: 208 counts during 199 steps 2024-12-18T00:21:04.3090549Z 2024-12-18T00:21:04.3090741Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3090852Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3091120Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3091237Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3091427Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3091565Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3091698Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3091858Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3092187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3092532Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3092828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3093081Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3093398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3093652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3093923Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3094039Z Execution Analysis: (:1) 2024-12-18T00:21:04.3094275Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3094471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3094477Z 2024-12-18T00:21:04.3094663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3094778Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3094992Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3095101Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3095298Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3095437Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3095575Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3095728Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3096285Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3097066Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3097441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3097794Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3098114Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3098445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3098766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3099032Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3099138Z Execution Analysis: .......... 2024-12-18T00:21:04.3099405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3099611Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3099904Z pt-xla-profiler: TransferFromDeviceTime too frequent: 209 counts during 200 steps 2024-12-18T00:21:04.3099909Z 2024-12-18T00:21:04.3100114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3100237Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3100531Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3100643Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3100858Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3101004Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3101154Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3101325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3101714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3102070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3102382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3102690Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3103003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3103278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3103573Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3103709Z Execution Analysis: (:1) 2024-12-18T00:21:04.3103971Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3104187Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3104192Z 2024-12-18T00:21:04.3104395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3104512Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3104758Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3104874Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3105096Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3105242Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3105401Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3105568Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3106166Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3106754Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3107117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3107488Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3107854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3108145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3108455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3108738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3108845Z Execution Analysis: .......... 2024-12-18T00:21:04.3109215Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3109426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3109706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 210 counts during 201 steps 2024-12-18T00:21:04.3109713Z 2024-12-18T00:21:04.3109929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3110047Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3110349Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3110461Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3110674Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3110818Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3110962Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3111167Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3111516Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3111872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3112204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3112488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3112789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3113053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3113353Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3113478Z Execution Analysis: (:1) 2024-12-18T00:21:04.3113749Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3113949Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3113953Z 2024-12-18T00:21:04.3114166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3114279Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3114519Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3114631Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3114838Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3114991Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3115135Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3115313Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3115889Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3116453Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3116805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3117211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3117692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3117966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3118285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3118558Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3118674Z Execution Analysis: .......... 2024-12-18T00:21:04.3118932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3119136Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3119431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 211 counts during 202 steps 2024-12-18T00:21:04.3119438Z 2024-12-18T00:21:04.3119646Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3119773Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3120062Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3120184Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3120393Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3120574Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3120716Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3120886Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3121263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3121643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3121969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3122245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3122562Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3122833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3123124Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3123259Z Execution Analysis: (:1) 2024-12-18T00:21:04.3123522Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3123737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3123741Z 2024-12-18T00:21:04.3123945Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3124073Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3124309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3124431Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3124639Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3124785Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3124942Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3125112Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3125716Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3126293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3126664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3127071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3127385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3127669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3127982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3128267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3128376Z Execution Analysis: .......... 2024-12-18T00:21:04.3128647Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3128855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3129152Z pt-xla-profiler: TransferFromDeviceTime too frequent: 213 counts during 203 steps 2024-12-18T00:21:04.3129158Z 2024-12-18T00:21:04.3129361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3129477Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3129881Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3129992Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3130231Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3130373Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3130528Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3130694Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3131072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3131425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3131733Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3132010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3132313Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3132585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3132972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3133101Z Execution Analysis: (:1) 2024-12-18T00:21:04.3133339Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3133531Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3133537Z 2024-12-18T00:21:04.3133737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3133843Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3134070Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3134175Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3134379Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3134512Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3134652Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3134817Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3135366Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3135910Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3136291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3136715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3137190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3137478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3137788Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3138060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3138181Z Execution Analysis: .......... 2024-12-18T00:21:04.3138441Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3138659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3138949Z pt-xla-profiler: TransferFromDeviceTime too frequent: 214 counts during 204 steps 2024-12-18T00:21:04.3138954Z 2024-12-18T00:21:04.3139167Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3139286Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3139579Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3139731Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3139937Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3140092Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3140236Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3140417Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3140804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3141163Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3141486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3141761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3142077Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3142351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3142654Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3142780Z Execution Analysis: (:1) 2024-12-18T00:21:04.3143053Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3143259Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3143266Z 2024-12-18T00:21:04.3143472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3143597Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3143832Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3143954Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3144310Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3144466Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3144614Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3144783Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3145388Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3146061Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3146436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3146790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3147116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3147392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3147711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3147979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3148087Z Execution Analysis: .......... 2024-12-18T00:21:04.3148359Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3148570Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3148868Z pt-xla-profiler: TransferFromDeviceTime too frequent: 215 counts during 205 steps 2024-12-18T00:21:04.3148873Z 2024-12-18T00:21:04.3149078Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3149204Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3149532Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3149656Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3149859Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3150007Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3150160Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3150363Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3150743Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3151097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3151423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3151701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3152015Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3152292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3152591Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3152728Z Execution Analysis: (:1) 2024-12-18T00:21:04.3152992Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3153220Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3153225Z 2024-12-18T00:21:04.3153429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3153556Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3153790Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3153903Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3154129Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3154278Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3154438Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3154609Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3155215Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3156078Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3156414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3156752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3157046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3157315Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3157600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3157863Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3157966Z Execution Analysis: .......... 2024-12-18T00:21:04.3158213Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3158414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3158680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 216 counts during 206 steps 2024-12-18T00:21:04.3158684Z 2024-12-18T00:21:04.3158884Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3159019Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3159301Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3159408Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3159614Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3159773Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3159909Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3160079Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3160415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3160753Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3161042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3161308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3161597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3161846Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3162130Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3162248Z Execution Analysis: (:1) 2024-12-18T00:21:04.3162500Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3162689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3162693Z 2024-12-18T00:21:04.3162891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3162997Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3163222Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3163325Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3163519Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3163665Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3163803Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3163969Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3164571Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3165114Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3165446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3165775Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3166077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3166333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3166630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3166883Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3166993Z Execution Analysis: .......... 2024-12-18T00:21:04.3167233Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3167433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3167694Z pt-xla-profiler: TransferFromDeviceTime too frequent: 217 counts during 207 steps 2024-12-18T00:21:04.3167698Z 2024-12-18T00:21:04.3167913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3168031Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3168302Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3168416Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3168631Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3168780Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3168916Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3169074Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3169413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3169738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3170036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3170293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3170590Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3170839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3171119Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3171237Z Execution Analysis: (:1) 2024-12-18T00:21:04.3171481Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3171681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3171685Z 2024-12-18T00:21:04.3171874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3171993Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3172206Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3172320Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3172516Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3172651Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3172796Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3172979Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3173561Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3174093Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3174440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3174770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3175070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3175325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3175614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3175872Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3175972Z Execution Analysis: .......... 2024-12-18T00:21:04.3176224Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3176480Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3176925Z pt-xla-profiler: TransferFromDeviceTime too frequent: 218 counts during 208 steps 2024-12-18T00:21:04.3176959Z 2024-12-18T00:21:04.3177165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3177294Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3177590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3177731Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3177950Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3178101Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3178258Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3178425Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3178784Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3179147Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3179465Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3179748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3180055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3180336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3180631Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3180769Z Execution Analysis: (:1) 2024-12-18T00:21:04.3181028Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3181233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3181248Z 2024-12-18T00:21:04.3181450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3181566Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3181806Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3181920Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3182136Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3182283Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3182457Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3182657Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3183250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3183833Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3184196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3184558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3184873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3185159Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3185474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3185745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3185859Z Execution Analysis: .......... 2024-12-18T00:21:04.3186118Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3186330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3186642Z pt-xla-profiler: TransferFromDeviceTime too frequent: 219 counts during 209 steps 2024-12-18T00:21:04.3186647Z 2024-12-18T00:21:04.3186862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3186976Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3187314Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3187431Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3187641Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3187796Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3187941Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3188123Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3188481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3188847Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3189259Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3189514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3189811Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3190062Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3190347Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3190466Z Execution Analysis: (:1) 2024-12-18T00:21:04.3190715Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3190904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3190910Z 2024-12-18T00:21:04.3191108Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3191213Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3191428Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3191541Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3191737Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3191917Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3192085Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3192243Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3192801Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3193329Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3193684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3194012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3194319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3194578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3194880Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3195131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3195246Z Execution Analysis: .......... 2024-12-18T00:21:04.3195486Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3195703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3195984Z pt-xla-profiler: TransferFromDeviceTime too frequent: 220 counts during 210 steps 2024-12-18T00:21:04.3195988Z 2024-12-18T00:21:04.3196179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3196326Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3196603Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3196720Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3196914Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3197052Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3197201Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3197360Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3197708Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3198037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3198342Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3198601Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3198890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3199157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3199431Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3199562Z Execution Analysis: (:1) 2024-12-18T00:21:04.3199807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3200016Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3200020Z 2024-12-18T00:21:04.3200212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3200332Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3200550Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3200657Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3200895Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3201058Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3201212Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3201370Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3201932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3202467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3202804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3203148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3203439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3203713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3204001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3204268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3204371Z Execution Analysis: .......... 2024-12-18T00:21:04.3204624Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3204837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3205099Z pt-xla-profiler: TransferFromDeviceTime too frequent: 221 counts during 211 steps 2024-12-18T00:21:04.3205103Z 2024-12-18T00:21:04.3205342Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3205454Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3205738Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3205843Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3206046Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3206183Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3206318Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3206490Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3206821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3207159Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3207451Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3207715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3208003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3208265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3208539Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3208657Z Execution Analysis: (:1) 2024-12-18T00:21:04.3208911Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3209102Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3209106Z 2024-12-18T00:21:04.3209309Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3209419Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3209645Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3209781Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3210000Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3210151Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3210292Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3210462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3211011Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3211735Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3212087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3212443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3212752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3213020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3213331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3213597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3213746Z Execution Analysis: .......... 2024-12-18T00:21:04.3213996Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3214208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3214509Z pt-xla-profiler: TransferFromDeviceTime too frequent: 222 counts during 212 steps 2024-12-18T00:21:04.3214514Z 2024-12-18T00:21:04.3214731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3214845Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3215131Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3215254Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3215454Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3215609Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3215754Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3215919Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3216282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3216717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3217214Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3217496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3217822Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3218092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3218400Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3218531Z Execution Analysis: (:1) 2024-12-18T00:21:04.3218793Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3219016Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3219021Z 2024-12-18T00:21:04.3219228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3219466Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3219729Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3219858Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3220069Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3220216Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3220381Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3220551Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3221162Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3221738Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3222115Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3222469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3222796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3223071Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3223381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3223702Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3223811Z Execution Analysis: .......... 2024-12-18T00:21:04.3224085Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3224289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3224614Z pt-xla-profiler: TransferFromDeviceTime too frequent: 223 counts during 213 steps 2024-12-18T00:21:04.3224621Z 2024-12-18T00:21:04.3224827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3224952Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3225248Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3225360Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3225578Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3225725Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3225880Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3226049Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3226420Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3226775Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3227091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3227380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3227689Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3227968Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3228261Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3228402Z Execution Analysis: (:1) 2024-12-18T00:21:04.3228661Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3228867Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3228886Z 2024-12-18T00:21:04.3229189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3229345Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3229576Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3229681Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3229886Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3230021Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3230170Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3230328Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3230880Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3231422Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3231761Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3232100Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3232392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3232661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3232951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3233237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3233338Z Execution Analysis: .......... 2024-12-18T00:21:04.3233578Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3233806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3234077Z pt-xla-profiler: TransferFromDeviceTime too frequent: 224 counts during 214 steps 2024-12-18T00:21:04.3234082Z 2024-12-18T00:21:04.3234285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3234393Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3234674Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3234778Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3234968Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3235116Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3235250Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3235421Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3235753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3236092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3236386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3236640Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3236938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3237190Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3237474Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3237592Z Execution Analysis: (:1) 2024-12-18T00:21:04.3237846Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3238039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3238066Z 2024-12-18T00:21:04.3238292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3238400Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3238617Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3238736Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3238932Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3239081Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3239221Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3239391Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3239940Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3240474Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3240825Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3241157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3241463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3241720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3242047Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3242299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3242412Z Execution Analysis: .......... 2024-12-18T00:21:04.3242677Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3242872Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3243157Z pt-xla-profiler: TransferFromDeviceTime too frequent: 225 counts during 215 steps 2024-12-18T00:21:04.3243162Z 2024-12-18T00:21:04.3243351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3243475Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3243746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3243869Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3244063Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3244327Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3244644Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3244816Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3245193Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3245550Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3245875Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3246150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3246474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3246748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3247042Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3247183Z Execution Analysis: (:1) 2024-12-18T00:21:04.3247444Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3247714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3247751Z 2024-12-18T00:21:04.3247957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3248089Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3248323Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3248435Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3248659Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3248806Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3248970Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3249138Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3249747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3250322Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3250694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3251046Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3251359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3251681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3251991Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3252273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3252415Z Execution Analysis: .......... 2024-12-18T00:21:04.3252687Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3252895Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3253178Z pt-xla-profiler: TransferFromDeviceTime too frequent: 226 counts during 216 steps 2024-12-18T00:21:04.3253195Z 2024-12-18T00:21:04.3253399Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3253515Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3253822Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3253932Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3254154Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3254302Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3254460Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3254633Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3254997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3255364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3255677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3255970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3256284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3256641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3256935Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3257065Z Execution Analysis: (:1) 2024-12-18T00:21:04.3257341Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3257624Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3257629Z 2024-12-18T00:21:04.3257847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3257962Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3258208Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3258322Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3258543Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3258689Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3258837Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3259018Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3259615Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3260210Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3260571Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3260936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3261279Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3261555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3261878Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3262175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3262302Z Execution Analysis: .......... 2024-12-18T00:21:04.3262565Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3262782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3263068Z pt-xla-profiler: TransferFromDeviceTime too frequent: 227 counts during 217 steps 2024-12-18T00:21:04.3263072Z 2024-12-18T00:21:04.3263288Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3263406Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3263700Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3263825Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3264031Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3264192Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3264337Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3264519Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3264877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3265228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3265556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3265830Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3266154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3266426Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3266735Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3266888Z Execution Analysis: (:1) 2024-12-18T00:21:04.3267174Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3267392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3267397Z 2024-12-18T00:21:04.3267602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3267729Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3267964Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3268087Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3268293Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3268452Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3268705Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3268865Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3269429Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3269966Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3270312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3270666Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3270969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3271223Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3271544Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3271798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3271901Z Execution Analysis: .......... 2024-12-18T00:21:04.3272153Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3272343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3272617Z pt-xla-profiler: TransferFromDeviceTime too frequent: 228 counts during 218 steps 2024-12-18T00:21:04.3272623Z 2024-12-18T00:21:04.3272811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3272930Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3273202Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3273305Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3273514Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3273651Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3273797Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3273953Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3274297Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3274623Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3274913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3275182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3275468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3275731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3276004Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3276185Z Execution Analysis: (:1) 2024-12-18T00:21:04.3276427Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3276630Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3276634Z 2024-12-18T00:21:04.3276824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3276934Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3277160Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3277264Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3277471Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3277608Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3277761Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3277920Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3278471Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3279018Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3279353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3279717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3280007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3280295Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3280584Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3280851Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3280950Z Execution Analysis: .......... 2024-12-18T00:21:04.3281188Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3281389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3281655Z pt-xla-profiler: TransferFromDeviceTime too frequent: 229 counts during 219 steps 2024-12-18T00:21:04.3281660Z 2024-12-18T00:21:04.3281861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3281970Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3282253Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3282362Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3282570Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3282708Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3282845Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3283020Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3283354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3283695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3283992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3284262Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3284553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3284806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3285140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3285260Z Execution Analysis: (:1) 2024-12-18T00:21:04.3285520Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3285711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3285715Z 2024-12-18T00:21:04.3285923Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3286032Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3286249Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3286371Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3286570Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3286720Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3286865Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3287038Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3287590Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3288139Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3288495Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3288822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3289128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3289410Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3289717Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3289969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3290085Z Execution Analysis: .......... 2024-12-18T00:21:04.3290325Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3290516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3290795Z pt-xla-profiler: TransferFromDeviceTime too frequent: 230 counts during 220 steps 2024-12-18T00:21:04.3290799Z 2024-12-18T00:21:04.3290990Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3291113Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3291387Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3291511Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3291706Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3291858Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3291993Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3292151Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3292500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3292829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3293134Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3293389Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3293696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3294007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3294279Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3294408Z Execution Analysis: (:1) 2024-12-18T00:21:04.3294648Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3294850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3294857Z 2024-12-18T00:21:04.3295047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3295164Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3295379Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3295499Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3295692Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3295831Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3295983Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3296139Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3296971Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3297553Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3297956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3298310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3298650Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3298946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3299257Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3299541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3299651Z Execution Analysis: .......... 2024-12-18T00:21:04.3299923Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3300131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3300431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 231 counts during 221 steps 2024-12-18T00:21:04.3300436Z 2024-12-18T00:21:04.3300642Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3300757Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3301067Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3301179Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3301399Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3301545Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3301700Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3301869Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3302231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3302597Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3302914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3303205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3303540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3303846Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3304140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3304280Z Execution Analysis: (:1) 2024-12-18T00:21:04.3304539Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3304747Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3304752Z 2024-12-18T00:21:04.3304970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3305087Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3305334Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3305450Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3305676Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3305824Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3305975Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3306157Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3306750Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3307363Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3307722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3308116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3308435Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3308723Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3309139Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3309403Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3309520Z Execution Analysis: .......... 2024-12-18T00:21:04.3309772Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3309984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3310265Z pt-xla-profiler: TransferFromDeviceTime too frequent: 232 counts during 222 steps 2024-12-18T00:21:04.3310270Z 2024-12-18T00:21:04.3310483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3310600Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3310886Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3311005Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3311208Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3311364Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3311505Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3311685Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3312033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3312375Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3312857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3313160Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3313506Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3313777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3314085Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3314213Z Execution Analysis: (:1) 2024-12-18T00:21:04.3314487Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3314692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3314697Z 2024-12-18T00:21:04.3314900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3315032Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3315266Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3315392Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3315600Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3315758Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3315907Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3316075Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3316771Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3317361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3317922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3318277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3318604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3318882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3319204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3319474Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3319585Z Execution Analysis: .......... 2024-12-18T00:21:04.3319856Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3320061Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3320360Z pt-xla-profiler: TransferFromDeviceTime too frequent: 234 counts during 223 steps 2024-12-18T00:21:04.3320367Z 2024-12-18T00:21:04.3320573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3320705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3320999Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3321125Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3321331Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3321480Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3321646Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3321815Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3322186Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3322542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3322873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3323202Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3323514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3323796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3324092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3324234Z Execution Analysis: (:1) 2024-12-18T00:21:04.3324494Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3324714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3324719Z 2024-12-18T00:21:04.3324924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3325053Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3325288Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3325402Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3325624Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3325771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3325934Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3326103Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3326730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3327317Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3327717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3328090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3328406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3328697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3329010Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3329296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3329406Z Execution Analysis: .......... 2024-12-18T00:21:04.3329666Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3329886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3330172Z pt-xla-profiler: TransferFromDeviceTime too frequent: 235 counts during 224 steps 2024-12-18T00:21:04.3330179Z 2024-12-18T00:21:04.3330400Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3330517Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3330824Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3330941Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3331168Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3331321Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3331467Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3331653Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3332016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3332389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3332758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3333049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3333362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3333633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3333946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3334078Z Execution Analysis: (:1) 2024-12-18T00:21:04.3334357Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3334566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3334570Z 2024-12-18T00:21:04.3334793Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3334912Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3335160Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3335275Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3335492Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3335654Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3335830Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3336017Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3336705Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3337327Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3337697Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3338052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3338382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3338661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3338988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3339260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3339383Z Execution Analysis: .......... 2024-12-18T00:21:04.3339644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3339864Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3340153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 236 counts during 225 steps 2024-12-18T00:21:04.3340159Z 2024-12-18T00:21:04.3340362Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3340490Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3340789Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3340918Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3341123Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3341281Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3341425Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3341593Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3341965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3342402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3342728Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3343004Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3343325Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3343597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3343903Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3344032Z Execution Analysis: (:1) 2024-12-18T00:21:04.3344436Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3344658Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3344665Z 2024-12-18T00:21:04.3344876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3345004Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3345236Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3345362Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3345572Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3345775Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3345940Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3346110Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3346714Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3347328Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3347706Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3348060Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3348387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3348667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3348978Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3349258Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3349366Z Execution Analysis: .......... 2024-12-18T00:21:04.3349642Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3349852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3350156Z pt-xla-profiler: TransferFromDeviceTime too frequent: 237 counts during 226 steps 2024-12-18T00:21:04.3350161Z 2024-12-18T00:21:04.3350367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3350495Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3350789Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3350904Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3351125Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3351272Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3351429Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3351600Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3351997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3352399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3352713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3353002Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3353314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3353598Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3353891Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3354030Z Execution Analysis: (:1) 2024-12-18T00:21:04.3354291Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3354500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3354517Z 2024-12-18T00:21:04.3354720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3354835Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3355080Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3355191Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3355446Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3355592Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3355849Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3356129Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3356703Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3357251Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3357585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3357925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3358216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3358483Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3358775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3359025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3359140Z Execution Analysis: .......... 2024-12-18T00:21:04.3359380Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3359584Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3359849Z pt-xla-profiler: TransferFromDeviceTime too frequent: 238 counts during 227 steps 2024-12-18T00:21:04.3359853Z 2024-12-18T00:21:04.3360053Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3360162Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3360445Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3360550Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3360743Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3360889Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3361024Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3361220Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3361576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3361916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3362206Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3362460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3362758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3363007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3363290Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3363409Z Execution Analysis: (:1) 2024-12-18T00:21:04.3363662Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3363854Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3363858Z 2024-12-18T00:21:04.3364057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3364164Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3364381Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3364538Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3364730Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3364878Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3365018Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3365273Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3365836Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3366368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3366718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3367044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3367348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3367602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3367903Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3368154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3368273Z Execution Analysis: .......... 2024-12-18T00:21:04.3368519Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3368709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3368986Z pt-xla-profiler: TransferFromDeviceTime too frequent: 239 counts during 228 steps 2024-12-18T00:21:04.3368990Z 2024-12-18T00:21:04.3369182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3369306Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3369580Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3369698Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3369889Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3370028Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3370201Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3370381Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3370728Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3371053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3371356Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3371618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3371904Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3372164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3372438Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3372571Z Execution Analysis: (:1) 2024-12-18T00:21:04.3372820Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3373022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3373027Z 2024-12-18T00:21:04.3373215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3373340Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3373581Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3373686Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3373893Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3374028Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3374204Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3374364Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3374925Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3375458Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3375794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3376137Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3376523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3376961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3377274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3377562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3377671Z Execution Analysis: .......... 2024-12-18T00:21:04.3377946Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3378155Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3378441Z pt-xla-profiler: TransferFromDeviceTime too frequent: 240 counts during 229 steps 2024-12-18T00:21:04.3378448Z 2024-12-18T00:21:04.3378666Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3378784Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3379091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3379206Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3379427Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3379608Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3379781Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3379963Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3380324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3380693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3381011Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3381300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3381610Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3381896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3382192Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3382320Z Execution Analysis: (:1) 2024-12-18T00:21:04.3382596Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3382803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3382808Z 2024-12-18T00:21:04.3383026Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3383168Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3383416Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3383527Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3383738Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3383919Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3384071Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3384254Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3384846Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3385428Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3385789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3386152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3386465Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3386741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3387064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3387336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3387455Z Execution Analysis: .......... 2024-12-18T00:21:04.3387712Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3387929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3388218Z pt-xla-profiler: TransferFromDeviceTime too frequent: 241 counts during 230 steps 2024-12-18T00:21:04.3388223Z 2024-12-18T00:21:04.3388438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3388549Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3388946Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3389094Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3389324Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3389475Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3389614Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3389780Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3390141Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3390483Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3390806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3391074Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3391389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3391652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3391952Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3392075Z Execution Analysis: (:1) 2024-12-18T00:21:04.3392327Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3392536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3392565Z 2024-12-18T00:21:04.3392764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3392885Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3393114Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3393234Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3393461Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3393609Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3393767Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3393931Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3394518Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3395079Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3395441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3395784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3396103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3396370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3396677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3396950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3397056Z Execution Analysis: .......... 2024-12-18T00:21:04.3397321Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3397625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3397904Z pt-xla-profiler: TransferFromDeviceTime too frequent: 242 counts during 231 steps 2024-12-18T00:21:04.3397909Z 2024-12-18T00:21:04.3398098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3398220Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3398492Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3398660Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3398863Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3398998Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3399143Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3399298Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3399639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3399964Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3400255Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3400518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3400805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3401072Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3401345Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3401473Z Execution Analysis: (:1) 2024-12-18T00:21:04.3401715Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3401905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3401943Z 2024-12-18T00:21:04.3402131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3402240Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3402464Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3402592Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3402801Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3402938Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3403088Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3403244Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3403792Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3404335Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3404668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3405008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3405301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3405570Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3406034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3406307Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3406412Z Execution Analysis: .......... 2024-12-18T00:21:04.3406664Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3406875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3407153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 243 counts during 232 steps 2024-12-18T00:21:04.3407157Z 2024-12-18T00:21:04.3407369Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3407507Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3407832Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3407942Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3408142Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3408293Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3408433Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3408609Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3408959Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3409311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3409613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3409882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3410198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3410461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3410755Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3410879Z Execution Analysis: (:1) 2024-12-18T00:21:04.3411147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3411373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3411377Z 2024-12-18T00:21:04.3411586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3411702Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3411953Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3412078Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3412285Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3412436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3412581Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3412756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3413332Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3413891Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3414253Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3414598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3419114Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3419456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3419779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3420053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3420162Z Execution Analysis: .......... 2024-12-18T00:21:04.3420438Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3420647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3420947Z pt-xla-profiler: TransferFromDeviceTime too frequent: 244 counts during 233 steps 2024-12-18T00:21:04.3420955Z 2024-12-18T00:21:04.3421160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3421384Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3421681Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3421801Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3422011Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3422160Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3422310Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3422482Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3422855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3423212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3423536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3423814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3424124Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3424403Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3424698Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3424835Z Execution Analysis: (:1) 2024-12-18T00:21:04.3425127Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3425340Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3425346Z 2024-12-18T00:21:04.3425582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3425705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3425943Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3426058Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3426280Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3426425Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3426581Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3426750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3427360Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3427936Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3428299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3428660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3429078Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3429343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3429630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3429885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3429986Z Execution Analysis: .......... 2024-12-18T00:21:04.3430232Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3430421Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3430684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 245 counts during 234 steps 2024-12-18T00:21:04.3430716Z 2024-12-18T00:21:04.3430929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3431038Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3431313Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3431419Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3431615Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3431752Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3431884Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3432050Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3432383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3432711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3433002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3433263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3433547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3433793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3434068Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3434207Z Execution Analysis: (:1) 2024-12-18T00:21:04.3434453Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3434643Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3434648Z 2024-12-18T00:21:04.3434867Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3434975Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3435193Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3435296Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3435488Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3435626Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3435763Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3435924Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3436471Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3437008Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3437340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3437665Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3437962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3438214Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3438510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3438761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3438865Z Execution Analysis: .......... 2024-12-18T00:21:04.3439103Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3439299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3439603Z pt-xla-profiler: TransferFromDeviceTime too frequent: 246 counts during 235 steps 2024-12-18T00:21:04.3439633Z 2024-12-18T00:21:04.3439824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3439938Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3440208Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3440315Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3440509Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3440649Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3440783Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3440937Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3441285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3441612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3441917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3442172Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3442461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3442710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3443013Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3443129Z Execution Analysis: (:1) 2024-12-18T00:21:04.3443373Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3443594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3443601Z 2024-12-18T00:21:04.3443790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3443902Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3444115Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3444396Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3444771Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3444917Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3445076Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3445246Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3445852Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3446428Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3446801Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3447153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3447473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3447746Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3448056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3448334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3448441Z Execution Analysis: .......... 2024-12-18T00:21:04.3448706Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3448911Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3449294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 247 counts during 236 steps 2024-12-18T00:21:04.3449300Z 2024-12-18T00:21:04.3449505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3449628Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3449920Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3450034Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3450247Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3450393Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3450543Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3450710Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3451068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3451434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3451744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3452026Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3452331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3452644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3452934Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3453064Z Execution Analysis: (:1) 2024-12-18T00:21:04.3453355Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3453556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3453572Z 2024-12-18T00:21:04.3453777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3453891Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3454129Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3454240Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3454455Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3454603Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3454750Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3454927Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3455520Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3456105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3456543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3456903Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3457216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3457499Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3457806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3458076Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3458191Z Execution Analysis: .......... 2024-12-18T00:21:04.3458452Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3458718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3459007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 248 counts during 237 steps 2024-12-18T00:21:04.3459012Z 2024-12-18T00:21:04.3459223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3459339Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3459641Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3459753Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3459958Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3460110Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3460252Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3460432Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3460794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3461152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3461463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3461735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3462079Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3462350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3462649Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3462776Z Execution Analysis: (:1) 2024-12-18T00:21:04.3463066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3463276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3463281Z 2024-12-18T00:21:04.3463490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3463606Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3463836Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3463955Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3464170Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3464326Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3464476Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3464650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3465245Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3465819Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3466185Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3466538Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3466862Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3467138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3467453Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3467731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3467849Z Execution Analysis: .......... 2024-12-18T00:21:04.3468163Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3468374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3468668Z pt-xla-profiler: TransferFromDeviceTime too frequent: 249 counts during 238 steps 2024-12-18T00:21:04.3468672Z 2024-12-18T00:21:04.3468878Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3469004Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3469298Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3469414Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3469619Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3469768Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3469916Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3470087Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3470455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3470807Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3471231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3471500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3471828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3472096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3472382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3472551Z Execution Analysis: (:1) 2024-12-18T00:21:04.3472809Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3473014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3473018Z 2024-12-18T00:21:04.3473216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3473333Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3473558Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3473666Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3473872Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3474012Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3474161Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3474325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3474911Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3475470Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3475815Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3476162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3476465Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3476739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3477148Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3477402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3477529Z Execution Analysis: .......... 2024-12-18T00:21:04.3477797Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3477985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3478246Z pt-xla-profiler: TransferFromDeviceTime too frequent: 250 counts during 239 steps 2024-12-18T00:21:04.3478259Z 2024-12-18T00:21:04.3478451Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3478556Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3478835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3478939Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3479131Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3479264Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3479397Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3479559Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3479890Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3480222Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3480513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3480793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3481075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3481329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3481624Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3481744Z Execution Analysis: (:1) 2024-12-18T00:21:04.3481992Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3482182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3482187Z 2024-12-18T00:21:04.3482377Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3482484Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3482703Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3482807Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3482996Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3483137Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3483276Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3483441Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3483991Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3484526Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3484858Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3485188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3485474Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3485727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3486022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3486317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3486423Z Execution Analysis: .......... 2024-12-18T00:21:04.3486663Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3486860Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3487126Z pt-xla-profiler: TransferFromDeviceTime too frequent: 251 counts during 240 steps 2024-12-18T00:21:04.3487132Z 2024-12-18T00:21:04.3487327Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3487433Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3487704Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3487817Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3488009Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3488152Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3488285Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3488447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3488776Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3489099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3489420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3489672Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3489965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3490235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3490515Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3490631Z Execution Analysis: (:1) 2024-12-18T00:21:04.3490869Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3491063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3491067Z 2024-12-18T00:21:04.3491254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3491372Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3491584Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3491695Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3491889Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3492023Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3492171Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3492330Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3492883Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3493413Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3493754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3494079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3494376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3494632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3494989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3495251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3495350Z Execution Analysis: .......... 2024-12-18T00:21:04.3495596Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3495784Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3496059Z pt-xla-profiler: TransferFromDeviceTime too frequent: 252 counts during 241 steps 2024-12-18T00:21:04.3496064Z 2024-12-18T00:21:04.3496252Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3496434Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3496709Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3496981Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3497193Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3497338Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3497488Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3497655Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3498022Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3498403Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3498713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3498995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3499335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3499618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3499911Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3500043Z Execution Analysis: (:1) 2024-12-18T00:21:04.3500303Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3500502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3500516Z 2024-12-18T00:21:04.3500716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3500829Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3501067Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3501176Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3501389Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3501535Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3501691Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3501858Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3502447Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3503032Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3503392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3503749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3504064Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3504367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3504699Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3504973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3505078Z Execution Analysis: .......... 2024-12-18T00:21:04.3505335Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3505550Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3505834Z pt-xla-profiler: TransferFromDeviceTime too frequent: 253 counts during 242 steps 2024-12-18T00:21:04.3505838Z 2024-12-18T00:21:04.3506047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3506164Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3506458Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3506570Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3506772Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3506930Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3507074Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3507251Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3507609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3508014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3508330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3508634Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3509063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3509321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3509603Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3509720Z Execution Analysis: (:1) 2024-12-18T00:21:04.3509969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3510163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3510168Z 2024-12-18T00:21:04.3510365Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3510474Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3510691Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3510808Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3511005Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3511155Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3511296Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3511465Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3512013Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3512547Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3512891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3513219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3513521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3513824Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3514122Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3514374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3514482Z Execution Analysis: .......... 2024-12-18T00:21:04.3514721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3514915Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3515186Z pt-xla-profiler: TransferFromDeviceTime too frequent: 255 counts during 243 steps 2024-12-18T00:21:04.3515190Z 2024-12-18T00:21:04.3515381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3515501Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3515773Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3515887Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3516079Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3516222Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3516355Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3516614Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3516954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3517280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3517777Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3518047Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3518360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3518622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3518906Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3519038Z Execution Analysis: (:1) 2024-12-18T00:21:04.3519290Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3519500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3519504Z 2024-12-18T00:21:04.3519702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3519826Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3520051Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3520161Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3520375Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3520514Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3520670Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3520834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3521421Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3521984Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3522342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3522686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3523041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3523313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3523615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3523891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3523999Z Execution Analysis: .......... 2024-12-18T00:21:04.3524259Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3524456Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3524745Z pt-xla-profiler: TransferFromDeviceTime too frequent: 256 counts during 244 steps 2024-12-18T00:21:04.3524750Z 2024-12-18T00:21:04.3524951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3525069Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3525360Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3525469Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3525681Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3525822Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3525998Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3526160Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3526508Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3526855Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3527182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3527466Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3527766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3528038Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3528321Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3528448Z Execution Analysis: (:1) 2024-12-18T00:21:04.3528706Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3528905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3528909Z 2024-12-18T00:21:04.3529122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3529235Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3529582Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3529686Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3529888Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3530021Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3530161Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3530325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3530877Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3531414Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3531747Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3532131Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3532423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3532681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3532972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3533221Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3533331Z Execution Analysis: .......... 2024-12-18T00:21:04.3533570Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3533770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3534033Z pt-xla-profiler: TransferFromDeviceTime too frequent: 257 counts during 245 steps 2024-12-18T00:21:04.3534040Z 2024-12-18T00:21:04.3534239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3534344Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3534617Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3534731Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3534922Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3535091Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3535223Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3535390Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3535720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3536070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3536442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3536703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3537187Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3537457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3537758Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3537888Z Execution Analysis: (:1) 2024-12-18T00:21:04.3538161Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3538367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3538373Z 2024-12-18T00:21:04.3538578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3538708Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3538940Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3539060Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3539269Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3539423Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3539576Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3539746Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3540343Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3540919Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3541353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3541706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3542027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3542302Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3542620Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3542890Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3543000Z Execution Analysis: .......... 2024-12-18T00:21:04.3543265Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3543471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3543776Z pt-xla-profiler: TransferFromDeviceTime too frequent: 258 counts during 246 steps 2024-12-18T00:21:04.3543781Z 2024-12-18T00:21:04.3543985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3544110Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3544555Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3544667Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3544941Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3545085Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3545242Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3545411Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3545811Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3546166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3546480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3546767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3547078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3547356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3547652Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3547790Z Execution Analysis: (:1) 2024-12-18T00:21:04.3548051Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3548267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3548274Z 2024-12-18T00:21:04.3548477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3548591Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3548831Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3548943Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3549164Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3549308Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3549468Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3549639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3550232Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3550817Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3551246Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3551608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3551921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3552210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3552520Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3552801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3552910Z Execution Analysis: .......... 2024-12-18T00:21:04.3553174Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3553393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3553680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 259 counts during 247 steps 2024-12-18T00:21:04.3553685Z 2024-12-18T00:21:04.3553900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3554017Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3554326Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3554465Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3554680Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3554825Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3554971Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3555179Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3555542Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3556013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3556427Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3556691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3556977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3557232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3557512Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3557630Z Execution Analysis: (:1) 2024-12-18T00:21:04.3557884Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3558076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3558082Z 2024-12-18T00:21:04.3558281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3558389Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3558616Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3558716Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3558910Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3559060Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3559201Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3559368Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3559920Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3560692Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3561042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3561385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3561702Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3561974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3562288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3562554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3562673Z Execution Analysis: .......... 2024-12-18T00:21:04.3562929Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3563139Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3563416Z pt-xla-profiler: TransferFromDeviceTime too frequent: 260 counts during 248 steps 2024-12-18T00:21:04.3563421Z 2024-12-18T00:21:04.3563619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3563742Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3564056Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3564173Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3564373Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3564524Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3564688Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3564853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3565210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3565554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3565868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3566134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3566449Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3566708Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3566993Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3567126Z Execution Analysis: (:1) 2024-12-18T00:21:04.3567382Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3567591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3567596Z 2024-12-18T00:21:04.3567796Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3567922Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3568148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3568269Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3568471Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3568612Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3568764Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3568929Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3569519Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3570137Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3570502Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3570844Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3571151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3571425Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3571726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3571999Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3572106Z Execution Analysis: .......... 2024-12-18T00:21:04.3572470Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3572661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3572933Z pt-xla-profiler: TransferFromDeviceTime too frequent: 261 counts during 249 steps 2024-12-18T00:21:04.3572938Z 2024-12-18T00:21:04.3573125Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3573259Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3573539Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3573644Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3573843Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3574003Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3574149Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3574307Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3574640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3574971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3575261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3575528Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3575812Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3576073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3576415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3576556Z Execution Analysis: (:1) 2024-12-18T00:21:04.3576965Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3577175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3577179Z 2024-12-18T00:21:04.3577395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3577512Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3577759Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3577873Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3578092Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3578237Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3578388Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3578569Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3579229Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3579815Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3580177Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3580541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3580858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3581143Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3581455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3581728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3581853Z Execution Analysis: .......... 2024-12-18T00:21:04.3582112Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3582328Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3582612Z pt-xla-profiler: TransferFromDeviceTime too frequent: 262 counts during 250 steps 2024-12-18T00:21:04.3582643Z 2024-12-18T00:21:04.3582856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3582976Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3583281Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3583391Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3583621Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3583777Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3583926Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3584104Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3584465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3584817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3585137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3585414Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3585730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3585998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3586300Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3586429Z Execution Analysis: (:1) 2024-12-18T00:21:04.3586698Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3586903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3586908Z 2024-12-18T00:21:04.3587112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3587234Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3587465Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3587584Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3587795Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3587949Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3588098Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3588293Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3589024Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3589587Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3589948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3590293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3590605Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3590874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3591186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3591452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3591560Z Execution Analysis: .......... 2024-12-18T00:21:04.3591817Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3592017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3592334Z pt-xla-profiler: TransferFromDeviceTime too frequent: 263 counts during 251 steps 2024-12-18T00:21:04.3592339Z 2024-12-18T00:21:04.3592536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3592655Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3592942Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3593087Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3593291Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3593438Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3593584Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3593750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3594107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3594448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3594760Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3595025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3595327Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3595599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3595889Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3596021Z Execution Analysis: (:1) 2024-12-18T00:21:04.3596273Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3596484Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3596488Z 2024-12-18T00:21:04.3596693Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3596818Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3597043Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3597153Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3597376Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3597521Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3597711Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3597900Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3598492Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3599222Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3599587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3599959Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3600273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3600566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3600881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3601172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3601283Z Execution Analysis: .......... 2024-12-18T00:21:04.3601557Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3601763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3602080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 264 counts during 252 steps 2024-12-18T00:21:04.3602085Z 2024-12-18T00:21:04.3602305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3602421Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3602755Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3602873Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3603097Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3603248Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3603396Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3603578Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3603938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3604304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3604619Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3604907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3605218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3605496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3605806Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3605934Z Execution Analysis: (:1) 2024-12-18T00:21:04.3606209Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3606416Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3606422Z 2024-12-18T00:21:04.3606642Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3606759Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3607008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3607121Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3607330Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3607540Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3607692Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3607874Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3608567Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3609143Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3609494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3609851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3610157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3610431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3610746Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3611109Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3611221Z Execution Analysis: .......... 2024-12-18T00:21:04.3611461Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3611687Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3611950Z pt-xla-profiler: TransferFromDeviceTime too frequent: 265 counts during 253 steps 2024-12-18T00:21:04.3611955Z 2024-12-18T00:21:04.3612180Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3612302Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3612577Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3612692Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3612887Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3613037Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3613171Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3613327Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3613673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3614000Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3614304Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3614561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3614861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3615111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3615393Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3615508Z Execution Analysis: (:1) 2024-12-18T00:21:04.3615748Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3615953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3615957Z 2024-12-18T00:21:04.3616145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3616264Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3616551Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3616704Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3617101Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3617250Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3617413Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3617581Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3618188Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3618765Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3619138Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3619493Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3619826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3620106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3620415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3620697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3620804Z Execution Analysis: .......... 2024-12-18T00:21:04.3621108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3621314Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3621613Z pt-xla-profiler: TransferFromDeviceTime too frequent: 266 counts during 254 steps 2024-12-18T00:21:04.3621619Z 2024-12-18T00:21:04.3621849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3621982Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3622276Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3622389Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3622606Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3622753Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3622910Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3623083Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3623457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3623809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3624124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3624412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3624721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3625004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3625297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3625437Z Execution Analysis: (:1) 2024-12-18T00:21:04.3625695Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3625901Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3625918Z 2024-12-18T00:21:04.3626122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3626239Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3626512Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3626646Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3626868Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3627013Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3627161Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3627340Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3627932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3628519Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3628882Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3629338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3629631Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3629900Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3630190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3630441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3630931Z Execution Analysis: .......... 2024-12-18T00:21:04.3631171Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3631375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3631665Z pt-xla-profiler: TransferFromDeviceTime too frequent: 267 counts during 255 steps 2024-12-18T00:21:04.3631672Z 2024-12-18T00:21:04.3631876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3631981Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3632267Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3632370Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3632562Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3632708Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3632844Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3633012Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3633345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3633684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3633974Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3634234Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3634528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3634777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3635061Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3635179Z Execution Analysis: (:1) 2024-12-18T00:21:04.3635434Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3635625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3635629Z 2024-12-18T00:21:04.3635831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3635963Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3636203Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3636320Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3636514Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3636664Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3636802Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3636972Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3637521Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3638054Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3638404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3638732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3639033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3639286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3639586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3639863Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3639974Z Execution Analysis: .......... 2024-12-18T00:21:04.3640214Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3640430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3640708Z pt-xla-profiler: TransferFromDeviceTime too frequent: 268 counts during 256 steps 2024-12-18T00:21:04.3640714Z 2024-12-18T00:21:04.3640907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3641025Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3641296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3641412Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3641601Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3641740Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3641886Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3642042Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3642387Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3642715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3643023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3643278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3643566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3643831Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3644106Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3644365Z Execution Analysis: (:1) 2024-12-18T00:21:04.3644787Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3645012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3645016Z 2024-12-18T00:21:04.3645280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3645451Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3645687Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3645800Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3646025Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3646173Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3646339Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3646511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3647120Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3647696Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3648077Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3648431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3648744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3649040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3649403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3649693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3649806Z Execution Analysis: .......... 2024-12-18T00:21:04.3650080Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3650322Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3650613Z pt-xla-profiler: TransferFromDeviceTime too frequent: 269 counts during 257 steps 2024-12-18T00:21:04.3650632Z 2024-12-18T00:21:04.3650839Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3650956Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3651265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3651380Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3651604Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3651752Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3651900Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3652082Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3652444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3652818Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3653133Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3653422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3653733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3654015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3654307Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3654433Z Execution Analysis: (:1) 2024-12-18T00:21:04.3654702Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3654908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3654945Z 2024-12-18T00:21:04.3655185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3655301Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3655546Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3655656Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3655865Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3656026Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3656176Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3656420Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3657019Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3657607Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3657969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3658333Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3658646Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3658954Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3659279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3659549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3659671Z Execution Analysis: .......... 2024-12-18T00:21:04.3659957Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3660181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3660465Z pt-xla-profiler: TransferFromDeviceTime too frequent: 270 counts during 258 steps 2024-12-18T00:21:04.3660470Z 2024-12-18T00:21:04.3660688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3660805Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3661099Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3661225Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3661431Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3661591Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3661737Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3661921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3662283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3662638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3662963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3663238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3663558Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3663831Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3664136Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3664262Z Execution Analysis: (:1) 2024-12-18T00:21:04.3664525Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3664873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3664878Z 2024-12-18T00:21:04.3665082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3665215Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3665450Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3665578Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3665791Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3665937Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3666101Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3666273Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3666887Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3667465Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3667841Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3668196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3668526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3668924Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3669210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3669471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3669597Z Execution Analysis: .......... 2024-12-18T00:21:04.3669850Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3670042Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3670319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 271 counts during 259 steps 2024-12-18T00:21:04.3670323Z 2024-12-18T00:21:04.3670511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3670633Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3670903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3671009Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3671212Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3671347Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3671496Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3671654Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3672000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3672327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3672616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3673056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3673357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3673630Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3673917Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3674053Z Execution Analysis: (:1) 2024-12-18T00:21:04.3674330Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3674738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3674743Z 2024-12-18T00:21:04.3674988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3675108Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3675358Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3675501Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3675733Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3675898Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3676073Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3676244Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3676902Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3677485Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3677863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3678254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3678616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3678892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3679201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3679515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3679630Z Execution Analysis: .......... 2024-12-18T00:21:04.3679907Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3680114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3680411Z pt-xla-profiler: TransferFromDeviceTime too frequent: 272 counts during 260 steps 2024-12-18T00:21:04.3680416Z 2024-12-18T00:21:04.3680621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3680753Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3681050Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3681164Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3681383Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3681536Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3681693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3681866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3682244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3682596Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3682910Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3683197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3683506Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3683791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3684086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3684253Z Execution Analysis: (:1) 2024-12-18T00:21:04.3684558Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3684768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3684785Z 2024-12-18T00:21:04.3684989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3685104Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3685350Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3685463Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3685683Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3685828Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3685981Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3686171Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3686769Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3687359Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3687726Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3688122Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3688437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3688730Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3689068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3689345Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3689473Z Execution Analysis: .......... 2024-12-18T00:21:04.3689736Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3689962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3690250Z pt-xla-profiler: TransferFromDeviceTime too frequent: 273 counts during 261 steps 2024-12-18T00:21:04.3690256Z 2024-12-18T00:21:04.3690478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3690596Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3690906Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3691022Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3691234Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3691399Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3691548Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3691734Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3692203Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3692565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3692874Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3693145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3693563Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3693818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3694130Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3694275Z Execution Analysis: (:1) 2024-12-18T00:21:04.3694533Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3694898Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3694902Z 2024-12-18T00:21:04.3695118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3695236Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3695464Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3695592Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3695797Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3695962Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3696114Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3696297Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3697130Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3697710Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3698119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3698477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3698808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3699112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3699441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3699712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3699833Z Execution Analysis: .......... 2024-12-18T00:21:04.3700093Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3700300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3700600Z pt-xla-profiler: TransferFromDeviceTime too frequent: 274 counts during 262 steps 2024-12-18T00:21:04.3700606Z 2024-12-18T00:21:04.3700810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3700937Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3701234Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3701359Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3701567Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3701714Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3701869Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3702037Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3702412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3702764Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3703093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3703368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3703677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3703959Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3704304Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3704448Z Execution Analysis: (:1) 2024-12-18T00:21:04.3704711Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3704930Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3704936Z 2024-12-18T00:21:04.3705143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3705272Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3705507Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3705619Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3705843Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3705990Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3706154Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3706323Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3706929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3707505Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3707904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3708257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3708600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3708888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3709305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3709580Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3709688Z Execution Analysis: .......... 2024-12-18T00:21:04.3710055Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3710245Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3710513Z pt-xla-profiler: TransferFromDeviceTime too frequent: 276 counts during 263 steps 2024-12-18T00:21:04.3710530Z 2024-12-18T00:21:04.3710720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3710831Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3711117Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3711226Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3711433Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3711569Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3711705Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3711876Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3712210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3712720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3713029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3713310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3713614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3713945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3714231Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3714356Z Execution Analysis: (:1) 2024-12-18T00:21:04.3714793Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3714998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3715005Z 2024-12-18T00:21:04.3715223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3715341Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3715586Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3715700Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3715911Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3716076Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3716226Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3716411Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3717008Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3717628Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3717993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3718360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3718699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3718980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3719304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3719574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3719696Z Execution Analysis: .......... 2024-12-18T00:21:04.3719956Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3720175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3720464Z pt-xla-profiler: TransferFromDeviceTime too frequent: 277 counts during 264 steps 2024-12-18T00:21:04.3720470Z 2024-12-18T00:21:04.3720689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3720808Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3721104Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3721229Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3721435Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3721594Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3721740Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3721921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3722284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3722638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3722964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3723242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3723636Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3723909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3724215Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3724342Z Execution Analysis: (:1) 2024-12-18T00:21:04.3724604Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3724827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3724832Z 2024-12-18T00:21:04.3725036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3725164Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3725398Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3725528Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3725740Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3725900Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3726050Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3726219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3726826Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3727435Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3727809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3728190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3728527Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3728805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3729118Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3729555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3729662Z Execution Analysis: .......... 2024-12-18T00:21:04.3729934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3730242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3730517Z pt-xla-profiler: TransferFromDeviceTime too frequent: 278 counts during 265 steps 2024-12-18T00:21:04.3730523Z 2024-12-18T00:21:04.3730714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3730836Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3731108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3731213Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3731417Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3731556Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3731701Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3731861Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3732204Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3732531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3732821Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3733147Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3733439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3733701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3733973Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3734106Z Execution Analysis: (:1) 2024-12-18T00:21:04.3734354Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3734729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3734733Z 2024-12-18T00:21:04.3734935Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3735049Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3735293Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3735405Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3735626Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3735771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3735929Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3736095Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3736956Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3737550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3737947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3738323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3738639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3738930Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3739240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3739527Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3739641Z Execution Analysis: .......... 2024-12-18T00:21:04.3739905Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3740125Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3740420Z pt-xla-profiler: TransferFromDeviceTime too frequent: 279 counts during 266 steps 2024-12-18T00:21:04.3740427Z 2024-12-18T00:21:04.3740652Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3740768Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3741076Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3741191Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3741400Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3741565Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3741715Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3741898Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3742258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3742624Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3742977Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3743295Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3743606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3743878Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3744308Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3744439Z Execution Analysis: (:1) 2024-12-18T00:21:04.3744719Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3744926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3744931Z 2024-12-18T00:21:04.3745151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3745270Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3745506Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3745634Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3745844Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3746005Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3746154Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3746405Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3747000Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3747612Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3747990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3748351Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3748675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3748954Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3749277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3749549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3749671Z Execution Analysis: .......... 2024-12-18T00:21:04.3749931Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3750137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3750439Z pt-xla-profiler: TransferFromDeviceTime too frequent: 280 counts during 267 steps 2024-12-18T00:21:04.3750446Z 2024-12-18T00:21:04.3750652Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3750782Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3751081Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3751209Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3751418Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3751579Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3751726Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3751897Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3752270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3752625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3753030Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3753307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3753629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3753901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3754196Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3754337Z Execution Analysis: (:1) 2024-12-18T00:21:04.3754598Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3754823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3754829Z 2024-12-18T00:21:04.3755038Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3755169Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3755404Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3755519Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3755745Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3755893Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3756199Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3756367Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3756961Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3757568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3757941Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3758294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3758600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3758884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3759189Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3759466Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3759573Z Execution Analysis: .......... 2024-12-18T00:21:04.3759844Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3760047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3760349Z pt-xla-profiler: TransferFromDeviceTime too frequent: 281 counts during 268 steps 2024-12-18T00:21:04.3760354Z 2024-12-18T00:21:04.3760556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3760672Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3760973Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3761087Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3761302Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3761446Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3761602Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3761769Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3762126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3762539Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3762846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3763128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3763431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3763707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3763993Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3764117Z Execution Analysis: (:1) 2024-12-18T00:21:04.3764386Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3764587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3764594Z 2024-12-18T00:21:04.3764807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3764923Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3765161Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3765273Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3765493Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3765667Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3765814Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3766093Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3766669Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3767221Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3767557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3767894Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3768185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3768455Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3768742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3768991Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3769105Z Execution Analysis: .......... 2024-12-18T00:21:04.3769347Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3769554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3769820Z pt-xla-profiler: TransferFromDeviceTime too frequent: 282 counts during 269 steps 2024-12-18T00:21:04.3769824Z 2024-12-18T00:21:04.3770025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3770133Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3770408Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3770527Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3770719Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3770868Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3771004Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3771177Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3771568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3771899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3772202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3772457Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3772758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3773010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3773294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3773415Z Execution Analysis: (:1) 2024-12-18T00:21:04.3773673Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3773870Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3773874Z 2024-12-18T00:21:04.3774063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3774187Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3774404Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3774523Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3774749Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3774896Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3775035Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3775197Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3775783Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3776319Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3776738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3777256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3777588Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3777864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3778188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3778461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3778570Z Execution Analysis: .......... 2024-12-18T00:21:04.3778849Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3779058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3779362Z pt-xla-profiler: TransferFromDeviceTime too frequent: 283 counts during 270 steps 2024-12-18T00:21:04.3779366Z 2024-12-18T00:21:04.3779572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3779705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3780002Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3780116Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3780338Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3780489Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3780651Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3780860Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3781262Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3781620Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3781946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3782221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3782535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3782822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3783114Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3783260Z Execution Analysis: (:1) 2024-12-18T00:21:04.3783528Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3783751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3783756Z 2024-12-18T00:21:04.3783964Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3784081Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3784330Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3784478Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3784704Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3784854Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3785019Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3785219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3785822Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3786410Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3786771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3787138Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3787457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3787748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3788062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3788348Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3788466Z Execution Analysis: .......... 2024-12-18T00:21:04.3788732Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3788951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3789240Z pt-xla-profiler: TransferFromDeviceTime too frequent: 284 counts during 271 steps 2024-12-18T00:21:04.3789245Z 2024-12-18T00:21:04.3789469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3789589Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3789900Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3790015Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3790236Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3790382Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3790587Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3790772Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3791133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3791498Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3791811Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3792100Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3792412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3792682Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3792987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3793115Z Execution Analysis: (:1) 2024-12-18T00:21:04.3793395Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3793603Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3793607Z 2024-12-18T00:21:04.3793827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3793986Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3794233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3794347Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3794555Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3794714Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3794890Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3795080Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3795680Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3796276Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3796640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3796997Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3797325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3797602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3797932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3798207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3798329Z Execution Analysis: .......... 2024-12-18T00:21:04.3798590Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3798806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3799089Z pt-xla-profiler: TransferFromDeviceTime too frequent: 285 counts during 272 steps 2024-12-18T00:21:04.3799096Z 2024-12-18T00:21:04.3799301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3799428Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3799725Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3799852Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3800060Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3800283Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3800431Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3800602Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3800975Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3801328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3801661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3802044Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3802365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3802634Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3802922Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3803059Z Execution Analysis: (:1) 2024-12-18T00:21:04.3803314Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3803526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3803531Z 2024-12-18T00:21:04.3803730Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3803893Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3804122Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3804245Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3804451Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3804627Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3804788Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3804959Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3805549Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3806115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3806653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3807007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3807333Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3807612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3807924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3808207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3808315Z Execution Analysis: .......... 2024-12-18T00:21:04.3808586Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3808791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3809089Z pt-xla-profiler: TransferFromDeviceTime too frequent: 286 counts during 273 steps 2024-12-18T00:21:04.3809094Z 2024-12-18T00:21:04.3809298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3809415Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3809721Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3809866Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3810111Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3810261Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3810418Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3810586Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3810947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3811315Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3811634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3811922Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3812233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3812516Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3812814Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3812953Z Execution Analysis: (:1) 2024-12-18T00:21:04.3813216Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3813422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3813458Z 2024-12-18T00:21:04.3813672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3813787Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3814036Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3814148Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3814405Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3814556Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3814707Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3814889Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3815486Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3816075Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3816524Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3816895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3817218Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3817514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3817830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3818100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3818225Z Execution Analysis: .......... 2024-12-18T00:21:04.3818485Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3818705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3818994Z pt-xla-profiler: TransferFromDeviceTime too frequent: 287 counts during 274 steps 2024-12-18T00:21:04.3819000Z 2024-12-18T00:21:04.3819222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3819344Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3819763Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3819904Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3820114Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3820275Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3820421Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3820604Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3820965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3821323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3827288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3827596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3827931Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3828213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3828528Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3828656Z Execution Analysis: (:1) 2024-12-18T00:21:04.3828921Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3829335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3829341Z 2024-12-18T00:21:04.3829539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3829666Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3829925Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3830052Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3830261Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3830424Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3830571Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3830737Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3831336Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3831907Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3832276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3832627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3832944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3833218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3833529Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3833793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3833900Z Execution Analysis: .......... 2024-12-18T00:21:04.3834169Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3834373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3834666Z pt-xla-profiler: TransferFromDeviceTime too frequent: 288 counts during 275 steps 2024-12-18T00:21:04.3834672Z 2024-12-18T00:21:04.3834874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3835029Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3835364Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3835478Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3835693Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3835838Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3835992Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3836164Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3836525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3836870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3837175Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3837453Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3837758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3838027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3838314Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3838449Z Execution Analysis: (:1) 2024-12-18T00:21:04.3838703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3838937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3838942Z 2024-12-18T00:21:04.3839141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3839275Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3839514Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3839625Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3839846Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3839986Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3840140Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3840305Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3840886Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3841468Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3841819Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3842183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3842489Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3842767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3843067Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3843338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3843445Z Execution Analysis: .......... 2024-12-18T00:21:04.3843696Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3843908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3844351Z pt-xla-profiler: TransferFromDeviceTime too frequent: 289 counts during 276 steps 2024-12-18T00:21:04.3844357Z 2024-12-18T00:21:04.3844824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3844985Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3845294Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3845405Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3845624Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3845773Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3845920Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3846097Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3846456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3846819Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3847136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3847426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3847734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3848005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3848309Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3848475Z Execution Analysis: (:1) 2024-12-18T00:21:04.3848750Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3848957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3848962Z 2024-12-18T00:21:04.3849211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3849335Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3849589Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3849701Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3849913Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3850072Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3850220Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3850397Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3850995Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3851588Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3851952Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3852310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3852634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3852910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3853229Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3853505Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3853621Z Execution Analysis: .......... 2024-12-18T00:21:04.3853882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3854085Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3854383Z pt-xla-profiler: TransferFromDeviceTime too frequent: 290 counts during 277 steps 2024-12-18T00:21:04.3854417Z 2024-12-18T00:21:04.3854650Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3854775Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3855068Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3855188Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3855395Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3855552Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3855696Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3855865Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3856228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3856661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3856992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3857268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3857592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3857862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3858157Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3858328Z Execution Analysis: (:1) 2024-12-18T00:21:04.3858595Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3858810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3858843Z 2024-12-18T00:21:04.3859048Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3859177Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3859415Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3859537Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3859745Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3859898Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3860059Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3860230Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3860835Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3861416Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3861787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3862142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3862457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3862741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3863050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3863329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3863438Z Execution Analysis: .......... 2024-12-18T00:21:04.3863702Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3863913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3864262Z pt-xla-profiler: TransferFromDeviceTime too frequent: 291 counts during 278 steps 2024-12-18T00:21:04.3864268Z 2024-12-18T00:21:04.3864478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3864592Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3864901Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3865012Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3865235Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3865379Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3865535Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3865707Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3866067Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3866433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3866746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3867035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3867341Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3867623Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3867947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3868083Z Execution Analysis: (:1) 2024-12-18T00:21:04.3868343Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3868574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3868581Z 2024-12-18T00:21:04.3868798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3869019Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3869258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3869366Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3869584Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3869728Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3869880Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3870053Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3870633Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3871212Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3871565Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3871923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3872226Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3872511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3872813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3873078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3873194Z Execution Analysis: .......... 2024-12-18T00:21:04.3873452Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3873714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3874023Z pt-xla-profiler: TransferFromDeviceTime too frequent: 292 counts during 279 steps 2024-12-18T00:21:04.3874028Z 2024-12-18T00:21:04.3874240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3874353Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3874651Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3874767Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3874968Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3875122Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3875263Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3875442Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3875793Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3876154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3876458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3876725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3877035Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3877328Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3877620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3877744Z Execution Analysis: (:1) 2024-12-18T00:21:04.3878042Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3878248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3878254Z 2024-12-18T00:21:04.3878471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3878585Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3878810Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3878937Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3879142Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3879293Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3879439Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3879604Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3880199Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3880754Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3881114Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3881458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3881771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3882041Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3882357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3882618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3882723Z Execution Analysis: .......... 2024-12-18T00:21:04.3882985Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3883232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3883521Z pt-xla-profiler: TransferFromDeviceTime too frequent: 293 counts during 280 steps 2024-12-18T00:21:04.3883526Z 2024-12-18T00:21:04.3883726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3883853Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3884135Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3884254Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3884452Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3884593Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3884746Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3884908Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3885275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3885615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3885929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3886194Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3886519Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3886795Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3887080Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3887240Z Execution Analysis: (:1) 2024-12-18T00:21:04.3887498Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3887715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3887720Z 2024-12-18T00:21:04.3887916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3888040Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3888266Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3888377Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3888592Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3888733Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3888886Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3889049Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3889636Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3890195Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3890545Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3890900Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3891208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3891486Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3891792Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3892067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3892199Z Execution Analysis: .......... 2024-12-18T00:21:04.3892488Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3892691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3892971Z pt-xla-profiler: TransferFromDeviceTime too frequent: 294 counts during 281 steps 2024-12-18T00:21:04.3892975Z 2024-12-18T00:21:04.3893185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3893301Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3893594Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3893704Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3893915Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3894060Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3894199Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3894379Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3894728Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3895082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3895388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3895689Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3895988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3896260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3896689Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3896981Z Execution Analysis: (:1) 2024-12-18T00:21:04.3897259Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3897465Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3897470Z 2024-12-18T00:21:04.3897685Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3897803Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3898051Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3898164Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3898370Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3898531Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3898680Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3898866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3899461Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3900046Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3900403Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3900767Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3901078Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3901347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3901668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3901972Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3902114Z Execution Analysis: .......... 2024-12-18T00:21:04.3902372Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3902591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3902874Z pt-xla-profiler: TransferFromDeviceTime too frequent: 295 counts during 282 steps 2024-12-18T00:21:04.3902881Z 2024-12-18T00:21:04.3903098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3903213Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3903507Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3903627Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3903834Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3903995Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3904143Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3904312Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3904684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3905037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3905357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3905660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3905983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3906294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3906596Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3906728Z Execution Analysis: (:1) 2024-12-18T00:21:04.3906990Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3907209Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3907214Z 2024-12-18T00:21:04.3907418Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3907546Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3907781Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3907905Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3908116Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3908260Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3908424Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3908592Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3909303Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3909862Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3910224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3910570Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3910884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3911154Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3911453Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3911784Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3911887Z Execution Analysis: .......... 2024-12-18T00:21:04.3912150Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3912350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3912639Z pt-xla-profiler: TransferFromDeviceTime too frequent: 297 counts during 283 steps 2024-12-18T00:21:04.3912644Z 2024-12-18T00:21:04.3912842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3912966Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3913252Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3913365Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3913577Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3913720Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3913872Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3914034Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3914400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3914747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3915091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3915360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3915663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3915978Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3916272Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3916410Z Execution Analysis: (:1) 2024-12-18T00:21:04.3916666Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3916881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3916885Z 2024-12-18T00:21:04.3917088Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3917202Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3917447Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3917559Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3917782Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3917927Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3918093Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3918266Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3918844Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3919419Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3919774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3920134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3920440Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3920727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3921087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3921368Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3921476Z Execution Analysis: .......... 2024-12-18T00:21:04.3921730Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3921946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3922227Z pt-xla-profiler: TransferFromDeviceTime too frequent: 298 counts during 284 steps 2024-12-18T00:21:04.3922232Z 2024-12-18T00:21:04.3922452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3922568Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3922870Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3922984Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3923203Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3923349Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3923498Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3923678Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3924026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3924414Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3924725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3925010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3925335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3925605Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3925899Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3926022Z Execution Analysis: (:1) 2024-12-18T00:21:04.3926288Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3926491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3926498Z 2024-12-18T00:21:04.3926707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3926819Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3927057Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3927169Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3927373Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3927529Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3927673Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3927853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3928433Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3929006Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3929361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3929709Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3930027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3930348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3930665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3930928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3931045Z Execution Analysis: .......... 2024-12-18T00:21:04.3931301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3931516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3931800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 299 counts during 285 steps 2024-12-18T00:21:04.3931805Z 2024-12-18T00:21:04.3932003Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3932130Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3932419Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3932542Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3932743Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3932899Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3933041Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3933206Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3933596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3933939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3934259Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3934555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3934874Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3935141Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3935436Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3935560Z Execution Analysis: (:1) 2024-12-18T00:21:04.3935814Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3936027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3936032Z 2024-12-18T00:21:04.3936230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3936455Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3936691Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3936991Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3937205Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3937352Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3937519Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3937743Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3938353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3938930Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3939307Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3939662Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3940020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3940325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3940640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3940925Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3941037Z Execution Analysis: .......... 2024-12-18T00:21:04.3941310Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3941515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3941813Z pt-xla-profiler: TransferFromDeviceTime too frequent: 300 counts during 286 steps 2024-12-18T00:21:04.3941818Z 2024-12-18T00:21:04.3942023Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3942154Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3942448Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3942561Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3942780Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3942928Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3943085Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3943306Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3943668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3944031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3944581Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3944874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3945187Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3945470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3945766Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3945907Z Execution Analysis: (:1) 2024-12-18T00:21:04.3946172Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3946380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3946385Z 2024-12-18T00:21:04.3946604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3946721Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3946970Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3947087Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3947310Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3947455Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3947603Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3947783Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3948379Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3948967Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3949329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3949694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3950076Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3950365Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3950674Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3950945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3951069Z Execution Analysis: .......... 2024-12-18T00:21:04.3951328Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3951544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3951832Z pt-xla-profiler: TransferFromDeviceTime too frequent: 301 counts during 287 steps 2024-12-18T00:21:04.3951839Z 2024-12-18T00:21:04.3952058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3952178Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3952484Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3952597Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3952803Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3952965Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3953149Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3953333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3953691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3954086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3954403Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3954684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3955006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3955276Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3955581Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3955714Z Execution Analysis: (:1) 2024-12-18T00:21:04.3956095Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3956295Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3956299Z 2024-12-18T00:21:04.3956510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3956627Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3956855Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3956978Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3957183Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3957336Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3957483Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3957650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3958241Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3958802Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3959171Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3959602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3959921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3960191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3960505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3960776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3960897Z Execution Analysis: .......... 2024-12-18T00:21:04.3961151Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3961356Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3961650Z pt-xla-profiler: TransferFromDeviceTime too frequent: 302 counts during 288 steps 2024-12-18T00:21:04.3961657Z 2024-12-18T00:21:04.3961859Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3961987Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3962275Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3962402Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3962606Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3962777Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3962932Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3963099Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3963467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3963842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3964165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3964435Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3964737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3965016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3965304Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3965445Z Execution Analysis: (:1) 2024-12-18T00:21:04.3965703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3965921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3965926Z 2024-12-18T00:21:04.3966292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3966430Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3966666Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3966780Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3967005Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3967154Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3967319Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3967492Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3968100Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3968677Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3969098Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3969469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3969784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3970077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3970392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3970679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3970786Z Execution Analysis: .......... 2024-12-18T00:21:04.3971054Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3971261Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3971551Z pt-xla-profiler: TransferFromDeviceTime too frequent: 303 counts during 289 steps 2024-12-18T00:21:04.3971556Z 2024-12-18T00:21:04.3971768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3971884Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3972188Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3972333Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3972553Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3972706Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3972853Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3973034Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3973508Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3973881Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3974196Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3974484Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3974794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3975078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3975374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3975503Z Execution Analysis: (:1) 2024-12-18T00:21:04.3975778Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3975989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3975996Z 2024-12-18T00:21:04.3976215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3976330Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3976656Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3976774Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3976986Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3977146Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3977296Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3977480Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3978075Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3978667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3979104Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3979471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3979786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3980066Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3980389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3980659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3980782Z Execution Analysis: .......... 2024-12-18T00:21:04.3981044Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3981266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3981554Z pt-xla-profiler: TransferFromDeviceTime too frequent: 304 counts during 290 steps 2024-12-18T00:21:04.3981559Z 2024-12-18T00:21:04.3981780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3981901Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3982196Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3982347Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3982553Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3982712Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3982861Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3983071Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3983433Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3983791Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3984116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3984392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3984716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3984987Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3985292Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3985419Z Execution Analysis: (:1) 2024-12-18T00:21:04.3985681Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3985903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3985907Z 2024-12-18T00:21:04.3986110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3986237Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3986469Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3986595Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3986805Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3986952Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3987112Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3987279Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3987892Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3988524Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3989006Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3989351Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3989667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3989938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3990240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3990513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3990619Z Execution Analysis: .......... 2024-12-18T00:21:04.3990886Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3991087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3991376Z pt-xla-profiler: TransferFromDeviceTime too frequent: 305 counts during 291 steps 2024-12-18T00:21:04.3991381Z 2024-12-18T00:21:04.3991579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3991732Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3992016Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.3992127Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3992340Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.3992483Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.3992666Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.3992834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3993196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.3993542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3993847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3994125Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3994428Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.3994704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.3994991Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.3995129Z Execution Analysis: (:1) 2024-12-18T00:21:04.3995382Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.3995598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3995602Z 2024-12-18T00:21:04.3995803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.3995916Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.3996159Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.3996271Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.3996496Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.3996640Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.3996802Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.3996970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.3997584Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.3998187Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.3998541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.3998902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.3999212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.3999491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.3999793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4000071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4000178Z Execution Analysis: .......... 2024-12-18T00:21:04.4000433Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4000652Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4000931Z pt-xla-profiler: TransferFromDeviceTime too frequent: 306 counts during 292 steps 2024-12-18T00:21:04.4000935Z 2024-12-18T00:21:04.4001148Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4001290Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4001594Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4001702Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4001905Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4002083Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4002229Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4002409Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4002768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4003126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4003432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4003719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4004023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4004286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4004593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4004719Z Execution Analysis: (:1) 2024-12-18T00:21:04.4004990Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4005194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4005198Z 2024-12-18T00:21:04.4005410Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4005525Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4005758Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4005887Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4006093Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4006251Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4006399Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4006583Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4007219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4007797Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4008152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4008502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4008824Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4009096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4009418Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4009684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4009811Z Execution Analysis: .......... 2024-12-18T00:21:04.4010066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4010268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4010563Z pt-xla-profiler: TransferFromDeviceTime too frequent: 307 counts during 293 steps 2024-12-18T00:21:04.4010599Z 2024-12-18T00:21:04.4010803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4010935Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4011222Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4011349Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4011579Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4011742Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4011887Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4012054Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4012423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4012770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4013092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4013363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4013677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4013940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4014227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4014368Z Execution Analysis: (:1) 2024-12-18T00:21:04.4014619Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4014831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4014836Z 2024-12-18T00:21:04.4015034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4015158Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4015388Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4015512Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4015713Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4015857Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4016054Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4016244Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4017085Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4017659Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4018033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4018391Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4018718Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4018995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4019308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4019595Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4019705Z Execution Analysis: .......... 2024-12-18T00:21:04.4019982Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4020190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4020522Z pt-xla-profiler: TransferFromDeviceTime too frequent: 308 counts during 294 steps 2024-12-18T00:21:04.4020527Z 2024-12-18T00:21:04.4020733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4020854Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4021186Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4021304Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4021524Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4021671Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4021829Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4022000Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4022358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4022730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4023045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4023335Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4023652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4023934Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4024232Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4024374Z Execution Analysis: (:1) 2024-12-18T00:21:04.4024640Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4024847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4024854Z 2024-12-18T00:21:04.4025072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4025187Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4025435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4025550Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4025776Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4025952Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4026128Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4026311Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4026904Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4027492Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4027857Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4028224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4028542Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4028831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4029252Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4029520Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4029637Z Execution Analysis: .......... 2024-12-18T00:21:04.4029891Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4030103Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4030413Z pt-xla-profiler: TransferFromDeviceTime too frequent: 309 counts during 295 steps 2024-12-18T00:21:04.4030418Z 2024-12-18T00:21:04.4030631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4030771Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4031071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4031187Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4031392Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4031553Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4031694Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4031877Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4032229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4032591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4032896Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4033167Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4033482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4033749Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4034047Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4034171Z Execution Analysis: (:1) 2024-12-18T00:21:04.4034439Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4034641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4034648Z 2024-12-18T00:21:04.4034861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4034974Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4035201Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4035323Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4035554Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4035738Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4035887Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4036051Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4036641Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4037204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4037569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4037914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4038236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4038508Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4038825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4039092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4039210Z Execution Analysis: .......... 2024-12-18T00:21:04.4039466Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4039699Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4039991Z pt-xla-profiler: TransferFromDeviceTime too frequent: 310 counts during 296 steps 2024-12-18T00:21:04.4039996Z 2024-12-18T00:21:04.4040222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4040353Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4040644Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4040767Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4040970Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4041114Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4041268Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4041434Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4041798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4042143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4042457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4042730Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4043037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4043318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4043603Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4043739Z Execution Analysis: (:1) 2024-12-18T00:21:04.4043994Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4044345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4044350Z 2024-12-18T00:21:04.4044719Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4044852Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4045090Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4045265Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4045527Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4045679Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4045846Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4046020Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4046638Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4047216Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4047581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4047948Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4048268Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4048558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4048872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4049158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4049269Z Execution Analysis: .......... 2024-12-18T00:21:04.4049588Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4049797Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4050085Z pt-xla-profiler: TransferFromDeviceTime too frequent: 311 counts during 297 steps 2024-12-18T00:21:04.4050142Z 2024-12-18T00:21:04.4050364Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4050485Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4050795Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4050910Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4051134Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4051284Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4051430Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4051619Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4051982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4052355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4052675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4052972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4053285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4053572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4053869Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4053999Z Execution Analysis: (:1) 2024-12-18T00:21:04.4054279Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4054486Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4054491Z 2024-12-18T00:21:04.4054714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4054832Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4055112Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4055253Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4055466Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4055629Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4055781Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4055963Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4056637Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4057230Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4057592Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4057965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4058280Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4058556Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4058881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4059153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4059310Z Execution Analysis: .......... 2024-12-18T00:21:04.4059572Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4059788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4060107Z pt-xla-profiler: TransferFromDeviceTime too frequent: 312 counts during 298 steps 2024-12-18T00:21:04.4060114Z 2024-12-18T00:21:04.4060335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4060453Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4060746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4060873Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4061081Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4061243Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4061389Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4061573Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4061936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4062295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4062626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4062906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4063229Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4063500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4063808Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4063938Z Execution Analysis: (:1) 2024-12-18T00:21:04.4064201Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4064419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4064423Z 2024-12-18T00:21:04.4064629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4064789Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4065047Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4065174Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4065388Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4065535Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4065699Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4065874Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4066486Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4067062Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4067439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4067800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4068128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4068406Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4068719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4069138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4069245Z Execution Analysis: .......... 2024-12-18T00:21:04.4069512Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4069739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4070038Z pt-xla-profiler: TransferFromDeviceTime too frequent: 313 counts during 299 steps 2024-12-18T00:21:04.4070044Z 2024-12-18T00:21:04.4070243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4070371Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4070658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4070769Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4070985Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4071128Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4071283Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4071447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4071814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4072155Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4072468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4072749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4073052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4073329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4073617Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4073752Z Execution Analysis: (:1) 2024-12-18T00:21:04.4074008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4074223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4074257Z 2024-12-18T00:21:04.4074482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4074595Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4074833Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4074943Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4075159Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4075302Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4075462Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4075626Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4076204Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4076784Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4077139Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4077494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4077802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4078082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4078412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4078686Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4078793Z Execution Analysis: .......... 2024-12-18T00:21:04.4079075Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4079289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4079572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 314 counts during 300 steps 2024-12-18T00:21:04.4079577Z 2024-12-18T00:21:04.4079788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4079901Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4080202Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4080313Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4080518Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4080674Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4080815Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4080990Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4081341Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4081701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4082008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4082288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4082589Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4082855Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4083153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4083277Z Execution Analysis: (:1) 2024-12-18T00:21:04.4083547Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4083748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4083779Z 2024-12-18T00:21:04.4084017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4084132Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4084360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4084484Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4084692Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4084849Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4084995Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4085174Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4085755Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4086332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4086684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4087028Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4087346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4087656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4087971Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4088235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4088356Z Execution Analysis: .......... 2024-12-18T00:21:04.4088637Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4088841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4089133Z pt-xla-profiler: TransferFromDeviceTime too frequent: 315 counts during 301 steps 2024-12-18T00:21:04.4089138Z 2024-12-18T00:21:04.4089337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4089465Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4089753Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4089876Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4090081Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4090236Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4090384Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4090552Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4090919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4091267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4091590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4091859Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4092177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4092446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4092747Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4092873Z Execution Analysis: (:1) 2024-12-18T00:21:04.4093131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4093398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4093403Z 2024-12-18T00:21:04.4093604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4093731Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4093961Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4094087Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4094297Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4094441Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4094604Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4094773Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4095375Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4095943Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4096311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4096736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4097266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4097546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4097857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4098166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4098279Z Execution Analysis: .......... 2024-12-18T00:21:04.4098555Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4098765Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4099067Z pt-xla-profiler: TransferFromDeviceTime too frequent: 316 counts during 302 steps 2024-12-18T00:21:04.4099071Z 2024-12-18T00:21:04.4099280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4099401Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4099709Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4099825Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4100050Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4100200Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4100365Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4100539Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4100903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4101275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4101591Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4101876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4102190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4102473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4102768Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4102908Z Execution Analysis: (:1) 2024-12-18T00:21:04.4103221Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4103428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4103432Z 2024-12-18T00:21:04.4103648Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4103762Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4104010Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4104125Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4104347Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4104492Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4104639Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4104824Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4105423Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4106012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4106378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4106754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4107098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4107385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4107722Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4107997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4108121Z Execution Analysis: .......... 2024-12-18T00:21:04.4108387Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4108611Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4108898Z pt-xla-profiler: TransferFromDeviceTime too frequent: 318 counts during 303 steps 2024-12-18T00:21:04.4108903Z 2024-12-18T00:21:04.4109229Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4109344Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4109641Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4109750Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4109955Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4110109Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4110254Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4110433Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4110787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4111140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4111445Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4111715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4112029Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4112294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4112594Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4112766Z Execution Analysis: (:1) 2024-12-18T00:21:04.4113058Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4113261Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4113265Z 2024-12-18T00:21:04.4113478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4113592Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4113818Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4113943Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4114151Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4114310Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4114460Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4114630Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4115226Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4115786Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4116148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4116526Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4116844Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4117112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4117449Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4117716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4117834Z Execution Analysis: .......... 2024-12-18T00:21:04.4118085Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4118286Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4118581Z pt-xla-profiler: TransferFromDeviceTime too frequent: 319 counts during 304 steps 2024-12-18T00:21:04.4118588Z 2024-12-18T00:21:04.4118788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4118915Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4119200Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4119326Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4119527Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4119678Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4119831Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4119998Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4120361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4120704Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4121022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4121290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4121592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4121868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4122228Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4122365Z Execution Analysis: (:1) 2024-12-18T00:21:04.4122618Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4122831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4122835Z 2024-12-18T00:21:04.4123033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4123161Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4123389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4123498Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4123720Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4123863Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4124023Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4124191Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4124779Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4125341Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4125798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4126156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4126464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4126770Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4127078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4127355Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4127462Z Execution Analysis: .......... 2024-12-18T00:21:04.4127729Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4127929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4128211Z pt-xla-profiler: TransferFromDeviceTime too frequent: 320 counts during 305 steps 2024-12-18T00:21:04.4128215Z 2024-12-18T00:21:04.4128429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4128543Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4128845Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4128966Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4129185Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4129328Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4129470Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4129648Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4129999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4130356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4130661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4130938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4131241Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4131544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4131855Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4131983Z Execution Analysis: (:1) 2024-12-18T00:21:04.4132250Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4132453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4132460Z 2024-12-18T00:21:04.4132671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4132784Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4133024Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4133133Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4133341Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4133499Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4133650Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4133833Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4134412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4134983Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4135361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4135722Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4136058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4136330Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4136728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4137165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4137289Z Execution Analysis: .......... 2024-12-18T00:21:04.4137550Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4137773Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4138062Z pt-xla-profiler: TransferFromDeviceTime too frequent: 321 counts during 306 steps 2024-12-18T00:21:04.4138067Z 2024-12-18T00:21:04.4138289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4138411Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4138708Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4138842Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4139049Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4139215Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4139362Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4139533Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4139906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4140265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4140592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4140869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4141225Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4141524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4141835Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4141965Z Execution Analysis: (:1) 2024-12-18T00:21:04.4142226Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4142450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4142455Z 2024-12-18T00:21:04.4142662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4142791Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4143028Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4143155Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4143368Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4143516Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4143674Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4143843Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4144612Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4145246Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4145620Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4146006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4146334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4146612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4146924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4147208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4147315Z Execution Analysis: .......... 2024-12-18T00:21:04.4147592Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4147800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4148099Z pt-xla-profiler: TransferFromDeviceTime too frequent: 322 counts during 307 steps 2024-12-18T00:21:04.4148104Z 2024-12-18T00:21:04.4148312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4148445Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4148746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4148860Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4149079Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4149226Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4149384Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4149555Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4149929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4150281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4150597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4150886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4151260Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4151549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4151844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4151985Z Execution Analysis: (:1) 2024-12-18T00:21:04.4152246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4152467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4152472Z 2024-12-18T00:21:04.4152677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4152794Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4153039Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4153156Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4153385Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4153532Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4153694Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4153863Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4154456Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4155071Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4155432Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4155934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4156247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4156529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4156835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4157113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4157221Z Execution Analysis: .......... 2024-12-18T00:21:04.4157475Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4157688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4157970Z pt-xla-profiler: TransferFromDeviceTime too frequent: 323 counts during 308 steps 2024-12-18T00:21:04.4157975Z 2024-12-18T00:21:04.4158190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4158307Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4158604Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4158714Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4158918Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4159073Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4159216Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4159395Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4159744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4160102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4160413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4160749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4161067Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4161331Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4161631Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4161757Z Execution Analysis: (:1) 2024-12-18T00:21:04.4162022Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4162222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4162226Z 2024-12-18T00:21:04.4162439Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4162553Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4162782Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4162910Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4163115Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4163273Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4163420Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4163598Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4164205Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4164767Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4165155Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4165507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4165832Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4166102Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4166416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4166679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4166796Z Execution Analysis: .......... 2024-12-18T00:21:04.4167049Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4167249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4167543Z pt-xla-profiler: TransferFromDeviceTime too frequent: 324 counts during 309 steps 2024-12-18T00:21:04.4167549Z 2024-12-18T00:21:04.4167751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4167877Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4168162Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4168283Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4168484Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4168639Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4168781Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4168947Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4169310Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4169659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4170030Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4170301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4170617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4170880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4171165Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4171309Z Execution Analysis: (:1) 2024-12-18T00:21:04.4171564Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4171783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4171789Z 2024-12-18T00:21:04.4171989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4172120Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4172350Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4172471Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4172676Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4172818Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4172975Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4173169Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4173761Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4174347Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4174718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4175064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4175375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4175657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4175958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4176235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4176405Z Execution Analysis: .......... 2024-12-18T00:21:04.4176684Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4177057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4177365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 325 counts during 310 steps 2024-12-18T00:21:04.4177371Z 2024-12-18T00:21:04.4177578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4177731Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4178041Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4178156Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4178381Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4178528Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4178693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4178862Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4179225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4179623Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4179962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4180255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4180565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4180851Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4181148Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4181290Z Execution Analysis: (:1) 2024-12-18T00:21:04.4181553Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4181761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4181767Z 2024-12-18T00:21:04.4181988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4182103Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4182354Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4182469Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4182693Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4182841Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4183020Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4183204Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4183797Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4184416Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4184786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4185155Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4185472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4185763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4186078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4186350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4186475Z Execution Analysis: .......... 2024-12-18T00:21:04.4186737Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4186963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4187252Z pt-xla-profiler: TransferFromDeviceTime too frequent: 326 counts during 311 steps 2024-12-18T00:21:04.4187257Z 2024-12-18T00:21:04.4187477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4187594Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4187903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4188020Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4188230Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4188393Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4188540Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4188730Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4189199Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4189612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4189919Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4190186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4190499Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4190765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4191062Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4191185Z Execution Analysis: (:1) 2024-12-18T00:21:04.4191453Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4191656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4191662Z 2024-12-18T00:21:04.4191871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4191986Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4192210Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4192331Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4192538Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4192720Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4192866Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4193035Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4193658Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4194225Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4194587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4194933Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4195252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4195522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4195839Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4196103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4196213Z Execution Analysis: .......... 2024-12-18T00:21:04.4196480Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4196684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4196977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 327 counts during 312 steps 2024-12-18T00:21:04.4196982Z 2024-12-18T00:21:04.4197183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4197308Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4197596Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4197717Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4197917Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4198060Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4198213Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4198383Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4198796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4199142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4199459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4199727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4200033Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4200306Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4200593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4200734Z Execution Analysis: (:1) 2024-12-18T00:21:04.4200994Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4201212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4201217Z 2024-12-18T00:21:04.4201417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4201542Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4201769Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4201906Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4202126Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4202269Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4202426Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4202592Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4203209Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4203776Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4204129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4204487Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4204797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4205078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4205381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4205657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4205766Z Execution Analysis: .......... 2024-12-18T00:21:04.4206035Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4206236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4206516Z pt-xla-profiler: TransferFromDeviceTime too frequent: 328 counts during 313 steps 2024-12-18T00:21:04.4206521Z 2024-12-18T00:21:04.4206733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4206847Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4207147Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4207256Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4207471Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4207616Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4207785Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4207988Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4208340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4208696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4209000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4209280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4209583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4209860Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4210149Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4210276Z Execution Analysis: (:1) 2024-12-18T00:21:04.4210543Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4210743Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4210747Z 2024-12-18T00:21:04.4210955Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4211071Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4211342Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4211449Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4211653Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4211806Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4211954Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4212155Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4212738Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4213311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4213663Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4214021Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4214329Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4214599Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4214916Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4215182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4215304Z Execution Analysis: .......... 2024-12-18T00:21:04.4215558Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4215769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4216050Z pt-xla-profiler: TransferFromDeviceTime too frequent: 329 counts during 314 steps 2024-12-18T00:21:04.4216056Z 2024-12-18T00:21:04.4216267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4216458Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4216745Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4217038Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4217249Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4217445Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4217622Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4217794Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4218172Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4218524Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4218853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4219133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4219451Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4219724Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4226394Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4226630Z Execution Analysis: (:1) 2024-12-18T00:21:04.4226921Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4227139Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4227145Z 2024-12-18T00:21:04.4227349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4227562Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4227800Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4227922Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4228133Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4228279Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4228469Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4228642Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4229364Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4229934Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4230296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4230649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4230961Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4231234Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4231533Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4231812Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4231918Z Execution Analysis: .......... 2024-12-18T00:21:04.4232179Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4232376Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4232665Z pt-xla-profiler: TransferFromDeviceTime too frequent: 330 counts during 315 steps 2024-12-18T00:21:04.4232671Z 2024-12-18T00:21:04.4232868Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4232979Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4233272Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4233384Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4233626Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4233798Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4233947Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4234109Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4234457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4234806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4235109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4235379Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4235679Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4235946Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4236237Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4236362Z Execution Analysis: (:1) 2024-12-18T00:21:04.4236614Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4236813Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4236818Z 2024-12-18T00:21:04.4237067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4237177Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4237409Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4237517Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4237754Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4237892Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4238036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4238209Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4238787Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4239352Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4239703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4240053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4240354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4240629Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4240933Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4241192Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4241302Z Execution Analysis: .......... 2024-12-18T00:21:04.4241550Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4241754Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4242034Z pt-xla-profiler: TransferFromDeviceTime too frequent: 331 counts during 316 steps 2024-12-18T00:21:04.4242039Z 2024-12-18T00:21:04.4242242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4242351Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4242645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4242778Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4243002Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4243151Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4243289Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4243464Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4243809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4244326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4244808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4245083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4245402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4245675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4245972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4246097Z Execution Analysis: (:1) 2024-12-18T00:21:04.4246362Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4246565Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4246638Z 2024-12-18T00:21:04.4246851Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4246965Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4247195Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4247351Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4247564Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4247727Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4247881Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4248050Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4248651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4249223Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4249594Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4249946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4250272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4250551Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4250868Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4251139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4251252Z Execution Analysis: .......... 2024-12-18T00:21:04.4251505Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4251713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4252006Z pt-xla-profiler: TransferFromDeviceTime too frequent: 332 counts during 317 steps 2024-12-18T00:21:04.4252012Z 2024-12-18T00:21:04.4252217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4252340Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4252700Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4252821Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4253029Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4253175Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4253324Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4253490Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4253862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4254213Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4254530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4254804Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4255116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4255394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4255687Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4255818Z Execution Analysis: (:1) 2024-12-18T00:21:04.4256076Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4256317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4256322Z 2024-12-18T00:21:04.4256601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4256728Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4256988Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4257103Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4257320Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4257468Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4257624Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4257798Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4258400Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4258978Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4259334Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4259693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4260006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4260286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4260593Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4260871Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4260977Z Execution Analysis: .......... 2024-12-18T00:21:04.4261250Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4261452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4261736Z pt-xla-profiler: TransferFromDeviceTime too frequent: 333 counts during 318 steps 2024-12-18T00:21:04.4261741Z 2024-12-18T00:21:04.4261953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4262096Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4262421Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4262534Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4262746Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4262891Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4263033Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4263212Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4263570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4263928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4264238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4264520Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4264828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4265107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4265395Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4265521Z Execution Analysis: (:1) 2024-12-18T00:21:04.4265818Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4266022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4266027Z 2024-12-18T00:21:04.4266237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4266374Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4266616Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4266731Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4266937Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4267086Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4267232Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4267410Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4268002Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4268586Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4269054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4269406Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4269713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4269980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4270291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4270554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4270667Z Execution Analysis: .......... 2024-12-18T00:21:04.4270918Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4271126Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4271402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 334 counts during 319 steps 2024-12-18T00:21:04.4271433Z 2024-12-18T00:21:04.4271678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4271789Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4272072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4272189Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4272392Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4272539Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4272679Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4272850Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4273197Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4273541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4273852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4274123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4274430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4274690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4274984Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4275139Z Execution Analysis: (:1) 2024-12-18T00:21:04.4275391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4275598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4275602Z 2024-12-18T00:21:04.4275827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4275949Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4276173Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4276286Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4276487Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4276630Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4276781Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4276943Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4277527Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4278084Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4278444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4278788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4279100Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4279371Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4279669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4279941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4280046Z Execution Analysis: .......... 2024-12-18T00:21:04.4280301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4280496Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4280779Z pt-xla-profiler: TransferFromDeviceTime too frequent: 335 counts during 320 steps 2024-12-18T00:21:04.4280808Z 2024-12-18T00:21:04.4281113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4281245Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4281528Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4281632Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4281836Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4281977Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4282126Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4282289Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4282643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4282984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4283292Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4283563Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4283861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4284131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4284442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4284570Z Execution Analysis: (:1) 2024-12-18T00:21:04.4284820Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4285047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4285053Z 2024-12-18T00:21:04.4285252Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4285360Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4285595Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4285701Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4285914Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4286054Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4286205Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4286366Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4286943Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4287509Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4287865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4288214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4288517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4288791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4289090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4289358Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4289460Z Execution Analysis: .......... 2024-12-18T00:21:04.4289712Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4289921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4290247Z pt-xla-profiler: TransferFromDeviceTime too frequent: 336 counts during 321 steps 2024-12-18T00:21:04.4290253Z 2024-12-18T00:21:04.4290459Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4290576Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4290867Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4290978Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4291178Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4291325Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4291464Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4291639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4291990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4292347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4292650Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4292924Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4293223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4293509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4293803Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4293925Z Execution Analysis: (:1) 2024-12-18T00:21:04.4294184Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4294408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4294415Z 2024-12-18T00:21:04.4294621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4294731Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4294958Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4295070Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4295273Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4295423Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4295565Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4295735Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4296312Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4297145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4297507Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4297858Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4298180Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4298460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4298775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4299042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4299156Z Execution Analysis: .......... 2024-12-18T00:21:04.4299419Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4299672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4299967Z pt-xla-profiler: TransferFromDeviceTime too frequent: 337 counts during 322 steps 2024-12-18T00:21:04.4299972Z 2024-12-18T00:21:04.4300175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4300296Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4300588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4300709Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4300913Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4301063Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4301204Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4301372Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4301738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4302097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4302418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4302694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4303006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4303299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4303591Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4303723Z Execution Analysis: (:1) 2024-12-18T00:21:04.4304008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4304225Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4304230Z 2024-12-18T00:21:04.4304432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4304553Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4304782Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4304901Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4305105Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4305248Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4305407Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4305577Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4306184Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4306764Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4307135Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4307481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4307795Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4308078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4308386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4308664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4308773Z Execution Analysis: .......... 2024-12-18T00:21:04.4309081Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4309308Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4309603Z pt-xla-profiler: TransferFromDeviceTime too frequent: 339 counts during 323 steps 2024-12-18T00:21:04.4309608Z 2024-12-18T00:21:04.4309807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4309923Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4310225Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4310333Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4310546Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4310687Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4310844Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4311012Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4311380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4311735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4312045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4312328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4312663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4312950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4313245Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4313412Z Execution Analysis: (:1) 2024-12-18T00:21:04.4313674Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4313880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4313885Z 2024-12-18T00:21:04.4314103Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4314217Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4314465Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4314584Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4314812Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4314960Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4315112Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4315293Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4315890Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4316481Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4316847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4317214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4317528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4317816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4318124Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4318396Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4318547Z Execution Analysis: .......... 2024-12-18T00:21:04.4318834Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4319055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4319342Z pt-xla-profiler: TransferFromDeviceTime too frequent: 340 counts during 324 steps 2024-12-18T00:21:04.4319347Z 2024-12-18T00:21:04.4319566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4319685Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4319992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4320102Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4320308Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4320466Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4320617Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4320805Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4321165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4321531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4321843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4322147Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4322470Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4322739Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4323072Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4323205Z Execution Analysis: (:1) 2024-12-18T00:21:04.4323479Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4323686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4323691Z 2024-12-18T00:21:04.4323904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4324014Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4324246Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4324371Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4324581Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4324741Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4324890Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4325059Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4325666Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4326243Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4326615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4326967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4327292Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4327566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4327888Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4328184Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4328319Z Execution Analysis: .......... 2024-12-18T00:21:04.4328593Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4328794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4329093Z pt-xla-profiler: TransferFromDeviceTime too frequent: 341 counts during 325 steps 2024-12-18T00:21:04.4329100Z 2024-12-18T00:21:04.4329303Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4329432Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4329726Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4329853Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4330060Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4330208Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4330364Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4330533Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4330904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4331257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4331613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4331884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4332191Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4332498Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4332792Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4332931Z Execution Analysis: (:1) 2024-12-18T00:21:04.4333301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4333509Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4333513Z 2024-12-18T00:21:04.4333713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4333841Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4334064Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4334173Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4334388Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4334532Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4334695Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4334860Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4335454Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4336016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4336444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4336977Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4337287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4337579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4337924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4338235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4338345Z Execution Analysis: .......... 2024-12-18T00:21:04.4338617Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4338820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4339106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 342 counts during 326 steps 2024-12-18T00:21:04.4339111Z 2024-12-18T00:21:04.4339325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4339440Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4339745Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4339855Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4340075Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4340219Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4340363Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4340541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4340901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4341264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4341606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4341892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4342238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4342520Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4342819Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4342946Z Execution Analysis: (:1) 2024-12-18T00:21:04.4343215Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4343417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4343423Z 2024-12-18T00:21:04.4343637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4343753Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4343993Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4344103Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4344458Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4344620Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4344771Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4344955Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4345547Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4346132Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4346491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4346860Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4347176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4347455Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4347884Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4348157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4348278Z Execution Analysis: .......... 2024-12-18T00:21:04.4348536Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4348752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4349042Z pt-xla-profiler: TransferFromDeviceTime too frequent: 343 counts during 327 steps 2024-12-18T00:21:04.4349047Z 2024-12-18T00:21:04.4349261Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4349379Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4349672Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4349800Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4350005Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4350166Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4350310Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4350480Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4350856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4351243Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4351570Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4351843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4352198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4352475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4352782Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4352909Z Execution Analysis: (:1) 2024-12-18T00:21:04.4353168Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4353383Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4353389Z 2024-12-18T00:21:04.4353587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4353709Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4353940Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4354062Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4354275Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4354419Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4354581Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4354752Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4355351Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4355929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4356404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4356748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4357069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4357390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4357696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4357974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4358077Z Execution Analysis: .......... 2024-12-18T00:21:04.4358344Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4358545Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4358836Z pt-xla-profiler: TransferFromDeviceTime too frequent: 344 counts during 328 steps 2024-12-18T00:21:04.4358841Z 2024-12-18T00:21:04.4359041Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4359170Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4359456Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4359568Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4359781Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4359924Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4360076Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4360239Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4360629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4360971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4361277Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4361584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4361885Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4362160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4362449Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4362583Z Execution Analysis: (:1) 2024-12-18T00:21:04.4362837Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4363040Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4363217Z 2024-12-18T00:21:04.4363419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4363532Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4363783Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4363897Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4364118Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4364264Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4364424Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4364595Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4365184Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4365775Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4366136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4366501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4366871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4367159Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4367471Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4367751Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4367858Z Execution Analysis: .......... 2024-12-18T00:21:04.4368123Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4368337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4368622Z pt-xla-profiler: TransferFromDeviceTime too frequent: 345 counts during 329 steps 2024-12-18T00:21:04.4368629Z 2024-12-18T00:21:04.4368844Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4368966Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4369265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4369375Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4369581Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4369734Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4369877Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4370078Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4370434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4370796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4371131Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4371412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4371729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4371999Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4372302Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4372427Z Execution Analysis: (:1) 2024-12-18T00:21:04.4372698Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4372903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4372907Z 2024-12-18T00:21:04.4373121Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4373235Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4373468Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4373595Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4373806Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4373963Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4374112Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4374291Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4374990Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4375550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4375916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4376311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4376712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4377151Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4377471Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4377741Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4377866Z Execution Analysis: .......... 2024-12-18T00:21:04.4378127Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4378330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4378631Z pt-xla-profiler: TransferFromDeviceTime too frequent: 346 counts during 330 steps 2024-12-18T00:21:04.4378638Z 2024-12-18T00:21:04.4378847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4378973Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4379265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4379388Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4379597Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4379790Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4379949Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4380120Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4380489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4380870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4381201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4381480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4381804Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4382075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4382370Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4382509Z Execution Analysis: (:1) 2024-12-18T00:21:04.4382770Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4382987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4382992Z 2024-12-18T00:21:04.4383198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4383329Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4383562Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4383671Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4383891Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4384035Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4384201Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4384369Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4384975Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4385548Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4385924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4386341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4386662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4386950Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4387263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4387553Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4387660Z Execution Analysis: .......... 2024-12-18T00:21:04.4387932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4388142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4388433Z pt-xla-profiler: TransferFromDeviceTime too frequent: 347 counts during 331 steps 2024-12-18T00:21:04.4388450Z 2024-12-18T00:21:04.4388653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4388768Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4389071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4389182Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4389426Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4389573Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4389727Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4389895Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4390281Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4390643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4390958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4391241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4391549Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4391830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4392124Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4392248Z Execution Analysis: (:1) 2024-12-18T00:21:04.4392521Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4392723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4392729Z 2024-12-18T00:21:04.4392951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4393065Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4393309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4393421Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4393643Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4393789Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4393941Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4394118Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4394707Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4395295Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4395712Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4396080Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4396394Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4396671Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4396994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4397265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4397383Z Execution Analysis: .......... 2024-12-18T00:21:04.4397644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4397858Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4398147Z pt-xla-profiler: TransferFromDeviceTime too frequent: 348 counts during 332 steps 2024-12-18T00:21:04.4398152Z 2024-12-18T00:21:04.4398366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4398482Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4398774Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4398924Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4399131Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4399289Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4399432Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4399613Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4400102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4400451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4400769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4401038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4401443Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4401696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4401976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4402279Z Execution Analysis: (:1) 2024-12-18T00:21:04.4402535Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4402735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4402755Z 2024-12-18T00:21:04.4402959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4403073Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4403314Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4403425Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4403642Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4403789Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4403935Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4404116Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4404696Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4405326Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4405681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4406037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4406345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4406633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4406935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4407214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4407324Z Execution Analysis: .......... 2024-12-18T00:21:04.4407581Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4407799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4408079Z pt-xla-profiler: TransferFromDeviceTime too frequent: 349 counts during 333 steps 2024-12-18T00:21:04.4408084Z 2024-12-18T00:21:04.4408299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4408416Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4408743Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4408856Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4409060Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4409218Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4409361Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4409568Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4409925Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4410282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4410588Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4410859Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4411176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4411441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4411745Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4411872Z Execution Analysis: (:1) 2024-12-18T00:21:04.4412142Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4412345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4412349Z 2024-12-18T00:21:04.4412563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4412678Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4412906Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4413027Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4413230Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4413386Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4413530Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4413706Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4414285Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4414914Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4415280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4415625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4415946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4416213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4416609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4417045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4417166Z Execution Analysis: .......... 2024-12-18T00:21:04.4417429Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4417635Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4417935Z pt-xla-profiler: TransferFromDeviceTime too frequent: 350 counts during 334 steps 2024-12-18T00:21:04.4417940Z 2024-12-18T00:21:04.4418143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4418307Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4418601Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4418726Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4418935Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4419106Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4419265Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4419438Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4419812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4420166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4420491Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4420767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4421093Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4421362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4421655Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4421798Z Execution Analysis: (:1) 2024-12-18T00:21:04.4422062Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4422281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4422285Z 2024-12-18T00:21:04.4422489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4422616Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4422847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4422962Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4423185Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4423331Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4423492Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4423663Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4424321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4424900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4425276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4425630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4425944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4426235Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4426547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4426830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4426941Z Execution Analysis: .......... 2024-12-18T00:21:04.4427216Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4427421Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4427710Z pt-xla-profiler: TransferFromDeviceTime too frequent: 351 counts during 335 steps 2024-12-18T00:21:04.4427728Z 2024-12-18T00:21:04.4427970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4428086Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4428396Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4428509Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4428862Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4429005Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4429149Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4429429Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4429763Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4430106Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4430396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4430669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4430954Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4431215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4431490Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4431610Z Execution Analysis: (:1) 2024-12-18T00:21:04.4431867Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4432060Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4432064Z 2024-12-18T00:21:04.4432269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4432377Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4432604Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4432708Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4432901Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4433048Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4433187Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4433465Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4434035Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4434581Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4434917Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4435259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4435551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4435808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4436108Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4436364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4436478Z Execution Analysis: .......... 2024-12-18T00:21:04.4436719Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4436922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4437190Z pt-xla-profiler: TransferFromDeviceTime too frequent: 352 counts during 336 steps 2024-12-18T00:21:04.4437219Z 2024-12-18T00:21:04.4437419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4437527Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4437800Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4437955Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4438147Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4438298Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4438432Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4438601Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4438933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4439258Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4439560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4439815Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4440112Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4440364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4440653Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4440772Z Execution Analysis: (:1) 2024-12-18T00:21:04.4441012Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4441218Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4441223Z 2024-12-18T00:21:04.4441413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4441538Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4441754Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4441874Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4442067Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4442218Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4442386Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4442566Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4443128Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4443658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4444008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4444641Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4444971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4445250Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4445578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4445850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4445961Z Execution Analysis: .......... 2024-12-18T00:21:04.4446235Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4446440Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4446805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 353 counts during 337 steps 2024-12-18T00:21:04.4446810Z 2024-12-18T00:21:04.4447017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4447150Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4447482Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4447602Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4447828Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4447973Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4448134Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4448307Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4448682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4449038Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4449353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4449642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4449955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4450244Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4450541Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4450683Z Execution Analysis: (:1) 2024-12-18T00:21:04.4450946Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4451166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4451172Z 2024-12-18T00:21:04.4451379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4451496Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4451745Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4451858Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4452086Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4452283Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4452480Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4452651Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4453247Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4453840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4454204Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4454575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4454892Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4455185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4455498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4455782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4455893Z Execution Analysis: .......... 2024-12-18T00:21:04.4456154Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4456469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4456759Z pt-xla-profiler: TransferFromDeviceTime too frequent: 354 counts during 338 steps 2024-12-18T00:21:04.4456764Z 2024-12-18T00:21:04.4456985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4457131Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4457446Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4457564Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4457775Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4457938Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4458085Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4458270Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4458631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4459000Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4459313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4459600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4459910Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4460183Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4460487Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4460612Z Execution Analysis: (:1) 2024-12-18T00:21:04.4460881Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4461087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4461092Z 2024-12-18T00:21:04.4461305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4461418Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4461651Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4461777Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4462014Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4462203Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4462355Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4462538Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4463136Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4463728Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4464118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4464511Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4464837Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4465133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4465443Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4465715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4465838Z Execution Analysis: .......... 2024-12-18T00:21:04.4466157Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4466401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4466691Z pt-xla-profiler: TransferFromDeviceTime too frequent: 355 counts during 339 steps 2024-12-18T00:21:04.4466696Z 2024-12-18T00:21:04.4466937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4467056Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4467363Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4467476Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4467684Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4467842Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4467988Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4468174Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4468541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4468909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4469228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4469506Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4469835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4470111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4470425Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4470551Z Execution Analysis: (:1) 2024-12-18T00:21:04.4470824Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4471035Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4471040Z 2024-12-18T00:21:04.4471260Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4471376Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4471609Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4471763Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4471999Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4472159Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4472314Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4472496Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4473098Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4473677Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4474055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4474411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4474740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4475015Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4475337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4475609Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4475760Z Execution Analysis: .......... 2024-12-18T00:21:04.4476021Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4476226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4476548Z pt-xla-profiler: TransferFromDeviceTime too frequent: 356 counts during 340 steps 2024-12-18T00:21:04.4476554Z 2024-12-18T00:21:04.4476761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4476891Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4477182Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4477309Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4477516Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4477663Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4477820Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4477992Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4478364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4478718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4479046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4479326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4479674Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4479943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4480240Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4480378Z Execution Analysis: (:1) 2024-12-18T00:21:04.4480639Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4480856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4480861Z 2024-12-18T00:21:04.4481066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4481226Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4481483Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4481596Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4481815Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4481961Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4482121Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4482294Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4482903Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4483479Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4483853Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4484215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4484530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4484816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4485141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4485457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4485567Z Execution Analysis: .......... 2024-12-18T00:21:04.4485842Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4486050Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4486380Z pt-xla-profiler: TransferFromDeviceTime too frequent: 357 counts during 341 steps 2024-12-18T00:21:04.4486400Z 2024-12-18T00:21:04.4486717Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4486834Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4487134Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4487246Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4487459Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4487604Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4487758Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4487923Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4488274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4488633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4488943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4489221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4489525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4489799Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4490092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4490220Z Execution Analysis: (:1) 2024-12-18T00:21:04.4490487Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4490692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4490698Z 2024-12-18T00:21:04.4490913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4491084Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4491332Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4491551Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4491748Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4491899Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4492042Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4492219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4492770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4493322Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4493664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4494007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4494299Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4494557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4494861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4495139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4495259Z Execution Analysis: .......... 2024-12-18T00:21:04.4495502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4495734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4496008Z pt-xla-profiler: TransferFromDeviceTime too frequent: 358 counts during 342 steps 2024-12-18T00:21:04.4496013Z 2024-12-18T00:21:04.4496220Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4496331Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4496674Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4496962Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4497173Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4497337Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4497485Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4497670Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4498037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4498395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4498723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4499002Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4499329Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4499602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4499917Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4500047Z Execution Analysis: (:1) 2024-12-18T00:21:04.4500315Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4500541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4500575Z 2024-12-18T00:21:04.4500810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4500941Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4501179Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4501304Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4501514Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4501671Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4501821Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4501992Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4502599Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4503180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4503559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4503913Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4504239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4504515Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4504866Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4505139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4505247Z Execution Analysis: .......... 2024-12-18T00:21:04.4505547Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4505758Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4506060Z pt-xla-profiler: TransferFromDeviceTime too frequent: 360 counts during 343 steps 2024-12-18T00:21:04.4506066Z 2024-12-18T00:21:04.4506275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4506404Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4506698Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4506811Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4507029Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4507177Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4507338Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4507513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4507885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4508244Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4508565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4508853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4509257Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4509524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4509797Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4509929Z Execution Analysis: (:1) 2024-12-18T00:21:04.4510173Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4510405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4510434Z 2024-12-18T00:21:04.4510624Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4510732Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4510960Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4511067Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4511277Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4511414Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4511565Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4511723Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4512277Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4512827Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4513164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4513506Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4513796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4514090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4514384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4514649Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4514776Z Execution Analysis: .......... 2024-12-18T00:21:04.4515017Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4515227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4515495Z pt-xla-profiler: TransferFromDeviceTime too frequent: 361 counts during 344 steps 2024-12-18T00:21:04.4515499Z 2024-12-18T00:21:04.4515701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4515812Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4516097Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4516203Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4516396Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4516544Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4516681Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4516853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4517191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4517697Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4518001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4518283Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4518589Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4518853Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4519152Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4519280Z Execution Analysis: (:1) 2024-12-18T00:21:04.4519549Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4519799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4519804Z 2024-12-18T00:21:04.4520016Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4520130Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4520357Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4520480Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4520686Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4520839Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4520984Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4521162Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4521745Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4522321Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4522672Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4523016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4523375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4523644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4523958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4524251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4524374Z Execution Analysis: .......... 2024-12-18T00:21:04.4524629Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4524827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4525118Z pt-xla-profiler: TransferFromDeviceTime too frequent: 362 counts during 345 steps 2024-12-18T00:21:04.4525123Z 2024-12-18T00:21:04.4525323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4525449Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4525738Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4525861Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4526233Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4526392Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4526540Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4526712Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4527083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4527438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4527764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4528040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4528364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4528637Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4528933Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4529099Z Execution Analysis: (:1) 2024-12-18T00:21:04.4529388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4529719Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4529724Z 2024-12-18T00:21:04.4529924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4530053Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4530284Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4530410Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4530618Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4530762Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4530925Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4531092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4531687Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4532250Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4532615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4532988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4533297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4533578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4533902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4534181Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4534290Z Execution Analysis: .......... 2024-12-18T00:21:04.4534556Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4534756Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4535051Z pt-xla-profiler: TransferFromDeviceTime too frequent: 363 counts during 346 steps 2024-12-18T00:21:04.4535058Z 2024-12-18T00:21:04.4535258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4535375Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4535676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4535789Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4536008Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4536156Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4536318Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4536586Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4537109Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4537478Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4537791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4538088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4538399Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4538687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4538982Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4539168Z Execution Analysis: (:1) 2024-12-18T00:21:04.4539446Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4539655Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4539660Z 2024-12-18T00:21:04.4539880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4540000Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4540250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4540366Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4540596Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4540744Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4540896Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4541084Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4541686Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4542275Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4542638Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4543033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4543352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4543670Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4543985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4544412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4544538Z Execution Analysis: .......... 2024-12-18T00:21:04.4544799Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4545021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4545312Z pt-xla-profiler: TransferFromDeviceTime too frequent: 364 counts during 347 steps 2024-12-18T00:21:04.4545317Z 2024-12-18T00:21:04.4545540Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4545659Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4545957Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4546091Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4546304Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4546473Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4546621Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4546809Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4547170Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4547523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4547852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4548126Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4548453Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4548729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4549127Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4549257Z Execution Analysis: (:1) 2024-12-18T00:21:04.4549531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4549737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4549742Z 2024-12-18T00:21:04.4549951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4550080Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4550314Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4550438Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4550651Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4550811Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4550963Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4551133Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4551746Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4552323Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4552736Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4553090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4553420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4553733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4554068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4554342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4554451Z Execution Analysis: .......... 2024-12-18T00:21:04.4554726Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4554931Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4555235Z pt-xla-profiler: TransferFromDeviceTime too frequent: 365 counts during 348 steps 2024-12-18T00:21:04.4555241Z 2024-12-18T00:21:04.4555446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4555577Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4555877Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4556008Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4556219Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4556367Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4556523Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4556692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4557062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4557418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4557745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4558021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4558335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4558690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4558988Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4559128Z Execution Analysis: (:1) 2024-12-18T00:21:04.4559390Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4559609Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4559616Z 2024-12-18T00:21:04.4559822Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4559957Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4560191Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4560307Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4560532Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4560685Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4560850Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4561021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4561621Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4562211Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4562600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4562965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4563308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4563714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4564020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4564293Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4564398Z Execution Analysis: .......... 2024-12-18T00:21:04.4564652Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4564866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4565145Z pt-xla-profiler: TransferFromDeviceTime too frequent: 366 counts during 349 steps 2024-12-18T00:21:04.4565151Z 2024-12-18T00:21:04.4565367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4565482Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4565786Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4565899Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4566122Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4566268Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4566514Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4566684Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4567017Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4567356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4567646Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4567916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4568403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4568692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4569153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4569280Z Execution Analysis: (:1) 2024-12-18T00:21:04.4569552Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4569761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4569766Z 2024-12-18T00:21:04.4569982Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4570098Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4570348Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4570463Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4570675Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4570835Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4570986Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4571165Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4571758Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4572375Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4572737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4573116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4573448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4573726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4574047Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4574318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4574441Z Execution Analysis: .......... 2024-12-18T00:21:04.4574703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4574920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4575206Z pt-xla-profiler: TransferFromDeviceTime too frequent: 367 counts during 350 steps 2024-12-18T00:21:04.4575211Z 2024-12-18T00:21:04.4575418Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4575549Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4575848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4575977Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4576186Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4576415Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4576570Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4576743Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4577118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4577472Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4577807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4578116Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4578476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4578747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4579055Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4579181Z Execution Analysis: (:1) 2024-12-18T00:21:04.4579452Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4579677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4579682Z 2024-12-18T00:21:04.4579887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4580020Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4580255Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4580385Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4580597Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4580745Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4580909Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4581087Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4581698Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4582300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4582781Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4583136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4583471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4583749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4584064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4584353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4584465Z Execution Analysis: .......... 2024-12-18T00:21:04.4584740Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4584946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4585249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 368 counts during 351 steps 2024-12-18T00:21:04.4585256Z 2024-12-18T00:21:04.4585464Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4585596Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4585889Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4586003Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4586227Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4586375Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4586536Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4586707Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4587066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4587437Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4587749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4588093Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4588408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4588692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4589096Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4589240Z Execution Analysis: (:1) 2024-12-18T00:21:04.4589493Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4589697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4589715Z 2024-12-18T00:21:04.4589920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4590038Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4590282Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4590394Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4590615Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4590760Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4590906Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4591081Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4591692Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4592372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4592734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4593083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4593376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4593648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4593935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4594186Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4594300Z Execution Analysis: .......... 2024-12-18T00:21:04.4594541Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4594742Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4595008Z pt-xla-profiler: TransferFromDeviceTime too frequent: 369 counts during 352 steps 2024-12-18T00:21:04.4595015Z 2024-12-18T00:21:04.4595221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4595329Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4595610Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4595715Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4595909Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4596061Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4596195Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4596367Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4596699Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4597037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4597388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4597647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4597946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4598196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4598481Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4598601Z Execution Analysis: (:1) 2024-12-18T00:21:04.4598857Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4599050Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4599054Z 2024-12-18T00:21:04.4599258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4599368Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4599587Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4599708Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4599902Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4600048Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4600213Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4600369Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4600930Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4601483Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4601832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4602158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4602459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4602715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4603013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4603263Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4603377Z Execution Analysis: .......... 2024-12-18T00:21:04.4603615Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4603807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4604089Z pt-xla-profiler: TransferFromDeviceTime too frequent: 370 counts during 353 steps 2024-12-18T00:21:04.4604094Z 2024-12-18T00:21:04.4604285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4604406Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4604678Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4604797Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4604989Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4605128Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4605275Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4605433Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4605781Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4606153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4606458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4606713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4606998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4607262Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4607535Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4607665Z Execution Analysis: (:1) 2024-12-18T00:21:04.4607907Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4608110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4608116Z 2024-12-18T00:21:04.4608305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4608425Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4608640Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4608747Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4608955Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4609537Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4609691Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4609849Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4610414Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4610971Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4611309Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4611649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4611940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4612209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4612498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4612761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4612862Z Execution Analysis: .......... 2024-12-18T00:21:04.4613114Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4613307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4613572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 371 counts during 354 steps 2024-12-18T00:21:04.4613577Z 2024-12-18T00:21:04.4613778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4613889Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4614172Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4614278Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4614480Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4614616Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4614751Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4614921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4615280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4615642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4615935Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4616202Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4616562Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4616998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4617291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4617418Z Execution Analysis: (:1) 2024-12-18T00:21:04.4617750Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4617963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4617968Z 2024-12-18T00:21:04.4618189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4618304Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4618551Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4618662Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4618902Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4619062Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4619212Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4619396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4620013Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4620606Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4620972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4621344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4621662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4621946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4622271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4622543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4622663Z Execution Analysis: .......... 2024-12-18T00:21:04.4622926Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4623146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4623432Z pt-xla-profiler: TransferFromDeviceTime too frequent: 372 counts during 355 steps 2024-12-18T00:21:04.4623437Z 2024-12-18T00:21:04.4623651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4629711Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4630095Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4630220Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4630434Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4630590Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4630740Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4630995Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4631407Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4631766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4632092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4632372Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4632692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4632963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4633361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4633496Z Execution Analysis: (:1) 2024-12-18T00:21:04.4633758Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4633970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4633976Z 2024-12-18T00:21:04.4634176Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4634293Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4634520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4634677Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4634884Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4635029Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4635180Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4635402Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4635993Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4636554Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4636911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4637256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4637564Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4637840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4638143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4638411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4638519Z Execution Analysis: .......... 2024-12-18T00:21:04.4638781Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4638978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4639261Z pt-xla-profiler: TransferFromDeviceTime too frequent: 373 counts during 356 steps 2024-12-18T00:21:04.4639267Z 2024-12-18T00:21:04.4639466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4639582Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4639874Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4639984Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4640187Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4640329Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4640508Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4640701Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4641052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4641398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4641700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4641978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4642279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4642548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4642832Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4642964Z Execution Analysis: (:1) 2024-12-18T00:21:04.4643217Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4643414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4643419Z 2024-12-18T00:21:04.4643625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4643732Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4643992Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4644099Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4644638Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4644784Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4644991Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4645172Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4645770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4646352Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4646710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4647075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4647387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4647669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4647981Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4648248Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4648371Z Execution Analysis: .......... 2024-12-18T00:21:04.4648626Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4648838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4649123Z pt-xla-profiler: TransferFromDeviceTime too frequent: 374 counts during 357 steps 2024-12-18T00:21:04.4649131Z 2024-12-18T00:21:04.4649339Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4649456Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4649756Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4649867Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4650070Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4650260Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4650434Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4650615Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4650972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4651325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4651649Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4651924Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4652246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4652515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4652822Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4652949Z Execution Analysis: (:1) 2024-12-18T00:21:04.4653218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4653419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4653424Z 2024-12-18T00:21:04.4653624Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4653782Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4654011Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4654133Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4654341Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4654523Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4654672Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4654843Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4655440Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4656014Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4656460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4656811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4657140Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4657416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4657743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4658014Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4658120Z Execution Analysis: .......... 2024-12-18T00:21:04.4658388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4658590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4658890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 375 counts during 358 steps 2024-12-18T00:21:04.4658895Z 2024-12-18T00:21:04.4659093Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4659223Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4659514Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4659666Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4659892Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4660037Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4660195Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4660361Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4660726Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4661071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4661393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4661662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4661973Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4662247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4662541Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4662677Z Execution Analysis: (:1) 2024-12-18T00:21:04.4662934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4663144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4663175Z 2024-12-18T00:21:04.4663374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4663497Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4663727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4663838Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4664083Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4664228Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4664389Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4664557Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4665159Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4665725Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4666088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4666450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4666764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4667048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4667360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4667637Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4667743Z Execution Analysis: .......... 2024-12-18T00:21:04.4668009Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4668211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4668498Z pt-xla-profiler: TransferFromDeviceTime too frequent: 376 counts during 359 steps 2024-12-18T00:21:04.4668503Z 2024-12-18T00:21:04.4668714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4668829Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4669243Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4669400Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4669607Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4669745Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4669884Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4670055Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4670401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4670751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4671052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4671328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4671625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4671887Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4672176Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4672296Z Execution Analysis: (:1) 2024-12-18T00:21:04.4672557Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4672752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4672795Z 2024-12-18T00:21:04.4673002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4673110Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4673348Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4673481Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4673687Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4673841Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4673984Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4674155Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4674726Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4675291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4675644Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4675990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4676297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4676565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4676869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4677293Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4677409Z Execution Analysis: .......... 2024-12-18T00:21:04.4677666Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4677876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4678159Z pt-xla-profiler: TransferFromDeviceTime too frequent: 377 counts during 360 steps 2024-12-18T00:21:04.4678164Z 2024-12-18T00:21:04.4678367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4678521Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4678839Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4678963Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4679166Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4679319Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4679460Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4679627Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4679999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4680347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4680661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4680940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4681253Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4681518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4681816Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4681939Z Execution Analysis: (:1) 2024-12-18T00:21:04.4682192Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4682428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4682433Z 2024-12-18T00:21:04.4682631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4682746Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4683002Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4683121Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4683330Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4683471Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4683626Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4683790Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4684385Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4684958Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4685318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4685669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4685988Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4686263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4686566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4686835Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4686940Z Execution Analysis: .......... 2024-12-18T00:21:04.4687206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4687410Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4687698Z pt-xla-profiler: TransferFromDeviceTime too frequent: 378 counts during 361 steps 2024-12-18T00:21:04.4687705Z 2024-12-18T00:21:04.4687908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4688078Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4688370Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4688480Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4688694Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4688839Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4688988Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4689156Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4689517Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4689868Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4690182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4690467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4690772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4691048Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4691336Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4691464Z Execution Analysis: (:1) 2024-12-18T00:21:04.4691748Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4692051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4692070Z 2024-12-18T00:21:04.4692289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4692400Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4692637Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4692744Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4692957Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4693094Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4693235Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4693404Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4693979Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4694548Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4694898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4695251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4695553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4695829Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4696126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4696456Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4696574Z Execution Analysis: .......... 2024-12-18T00:21:04.4696992Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4697209Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4697495Z pt-xla-profiler: TransferFromDeviceTime too frequent: 379 counts during 362 steps 2024-12-18T00:21:04.4697530Z 2024-12-18T00:21:04.4697771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4697884Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4698180Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4698287Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4698489Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4698643Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4698784Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4698962Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4699316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4699682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4699992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4700265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4700582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4700850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4701150Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4701299Z Execution Analysis: (:1) 2024-12-18T00:21:04.4701563Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4701764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4701768Z 2024-12-18T00:21:04.4702008Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4702122Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4702355Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4702472Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4702678Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4702829Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4702976Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4703153Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4703742Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4704320Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4704686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4705039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4705357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4705628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4705948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4706219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4706335Z Execution Analysis: .......... 2024-12-18T00:21:04.4706588Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4706793Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4707112Z pt-xla-profiler: TransferFromDeviceTime too frequent: 381 counts during 363 steps 2024-12-18T00:21:04.4707156Z 2024-12-18T00:21:04.4707362Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4707482Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4707770Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4707890Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4708092Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4708235Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4708384Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4708549Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4709023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4709360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4709677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4709939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4710248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4710506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4710816Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4710944Z Execution Analysis: (:1) 2024-12-18T00:21:04.4711195Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4711429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4711435Z 2024-12-18T00:21:04.4711630Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4711751Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4711975Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4712083Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4712289Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4712428Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4712578Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4712737Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4713318Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4713871Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4714233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4714571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4714873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4715149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4715447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4715716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4715817Z Execution Analysis: .......... 2024-12-18T00:21:04.4716077Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4716273Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4716602Z pt-xla-profiler: TransferFromDeviceTime too frequent: 382 counts during 364 steps 2024-12-18T00:21:04.4716617Z 2024-12-18T00:21:04.4716813Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4716922Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4717226Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4717338Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4717547Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4717855Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4718002Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4718186Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4718550Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4718917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4719231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4719521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4719829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4720137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4720432Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4720561Z Execution Analysis: (:1) 2024-12-18T00:21:04.4720856Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4721064Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4721071Z 2024-12-18T00:21:04.4721291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4721409Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4721653Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4721768Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4721979Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4722136Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4722287Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4722469Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4723064Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4723654Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4724019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4724383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4724698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4724975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4725295Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4725566Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4725687Z Execution Analysis: .......... 2024-12-18T00:21:04.4725947Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4726214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4726499Z pt-xla-profiler: TransferFromDeviceTime too frequent: 383 counts during 365 steps 2024-12-18T00:21:04.4726505Z 2024-12-18T00:21:04.4726723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4726840Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4727137Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4727261Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4727469Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4727624Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4727770Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4727944Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4728317Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4728670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4728991Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4729265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4729614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4729883Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4730182Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4730308Z Execution Analysis: (:1) 2024-12-18T00:21:04.4730592Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4730809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4730814Z 2024-12-18T00:21:04.4731014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4731136Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4731370Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4731489Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4731804Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4731950Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4732102Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4732267Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4732862Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4733423Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4733785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4734129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4734446Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4734714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4735016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4735291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4735394Z Execution Analysis: .......... 2024-12-18T00:21:04.4735721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4735923Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4736211Z pt-xla-profiler: TransferFromDeviceTime too frequent: 384 counts during 366 steps 2024-12-18T00:21:04.4736216Z 2024-12-18T00:21:04.4736497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4736627Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4737082Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4737194Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4737412Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4737561Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4737717Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4737887Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4738259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4738611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4738923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4739211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4739633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4739914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4740210Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4740376Z Execution Analysis: (:1) 2024-12-18T00:21:04.4740643Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4740850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4740866Z 2024-12-18T00:21:04.4741072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4741190Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4741438Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4741554Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4741780Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4741927Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4742090Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4742261Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4742856Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4743444Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4743805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4744328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4744645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4744932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4745241Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4745523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4745702Z Execution Analysis: .......... 2024-12-18T00:21:04.4745995Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4746214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4746502Z pt-xla-profiler: TransferFromDeviceTime too frequent: 385 counts during 367 steps 2024-12-18T00:21:04.4746507Z 2024-12-18T00:21:04.4746727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4746843Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4747149Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4747259Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4747467Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4747626Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4747777Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4747956Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4748318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4748682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4748994Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4749307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4749627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4749895Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4750233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4750363Z Execution Analysis: (:1) 2024-12-18T00:21:04.4750631Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4750835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4750839Z 2024-12-18T00:21:04.4751052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4751167Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4751403Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4751527Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4751736Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4751892Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4752043Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4752222Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4752815Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4753389Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4753754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4754110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4754431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4754707Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4755025Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4755344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4755462Z Execution Analysis: .......... 2024-12-18T00:21:04.4755719Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4755924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4756222Z pt-xla-profiler: TransferFromDeviceTime too frequent: 386 counts during 368 steps 2024-12-18T00:21:04.4756231Z 2024-12-18T00:21:04.4756436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4756560Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4756856Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4756978Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4757185Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4757338Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4757495Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4757664Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4758037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4758389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4758748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4759027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4759347Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4759646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4759942Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4760077Z Execution Analysis: (:1) 2024-12-18T00:21:04.4760337Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4760550Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4760554Z 2024-12-18T00:21:04.4760757Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4760885Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4761117Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4761228Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4761447Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4761594Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4761757Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4761928Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4762535Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4763110Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4763480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4763832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4764146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4764436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4764800Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4765085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4765196Z Execution Analysis: .......... 2024-12-18T00:21:04.4765469Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4765679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4765969Z pt-xla-profiler: TransferFromDeviceTime too frequent: 387 counts during 369 steps 2024-12-18T00:21:04.4765987Z 2024-12-18T00:21:04.4766192Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4766309Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4766618Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4766735Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4766952Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4767100Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4767260Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4767430Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4767795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4768186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4768502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4768788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4769124Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4769409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4769707Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4769834Z Execution Analysis: (:1) 2024-12-18T00:21:04.4770108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4770317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4770324Z 2024-12-18T00:21:04.4770541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4770659Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4770904Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4771019Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4771240Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4771389Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4771542Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4771724Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4772317Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4772904Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4773267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4773632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4773952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4774258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4774605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4774877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4774997Z Execution Analysis: .......... 2024-12-18T00:21:04.4775253Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4775469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4775755Z pt-xla-profiler: TransferFromDeviceTime too frequent: 388 counts during 370 steps 2024-12-18T00:21:04.4775760Z 2024-12-18T00:21:04.4775973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4776091Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4776468Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4776595Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4776801Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4776961Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4777107Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4777288Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4777648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4778033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4778357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4778673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4778999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4779273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4779580Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4779707Z Execution Analysis: (:1) 2024-12-18T00:21:04.4779969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4780190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4780195Z 2024-12-18T00:21:04.4780397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4780522Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4780754Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4780880Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4781090Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4781249Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4781399Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4781569Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4782175Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4782756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4783129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4783484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4783807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4784138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4784461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4784731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4784842Z Execution Analysis: .......... 2024-12-18T00:21:04.4785112Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4785317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4785613Z pt-xla-profiler: TransferFromDeviceTime too frequent: 389 counts during 371 steps 2024-12-18T00:21:04.4785619Z 2024-12-18T00:21:04.4785826Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4785955Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4786252Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4786363Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4786580Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4786724Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4786882Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4787080Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4787449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4787803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4788145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4788429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4788742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4789023Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4789315Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4789452Z Execution Analysis: (:1) 2024-12-18T00:21:04.4789711Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4789929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4789934Z 2024-12-18T00:21:04.4790137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4790252Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4790493Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4790608Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4790830Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4790978Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4791139Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4791308Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4791899Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4792487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4792847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4793214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4793576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4793865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4794171Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4794454Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4794566Z Execution Analysis: .......... 2024-12-18T00:21:04.4794824Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4795038Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4795323Z pt-xla-profiler: TransferFromDeviceTime too frequent: 390 counts during 372 steps 2024-12-18T00:21:04.4795328Z 2024-12-18T00:21:04.4795543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4795657Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4795963Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4796075Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4796292Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4796436Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4796604Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4796784Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4797143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4797615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4797944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4798229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4798529Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4798793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4799089Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4799214Z Execution Analysis: (:1) 2024-12-18T00:21:04.4799478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4799678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4799682Z 2024-12-18T00:21:04.4799894Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4800005Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4800244Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4800352Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4800558Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4800715Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4800859Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4801039Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4801614Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4802185Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4802538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4802933Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4803252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4803521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4803838Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4804106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4804225Z Execution Analysis: .......... 2024-12-18T00:21:04.4804478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4804678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4804971Z pt-xla-profiler: TransferFromDeviceTime too frequent: 391 counts during 373 steps 2024-12-18T00:21:04.4804977Z 2024-12-18T00:21:04.4805179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4805303Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4805587Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4805709Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4805911Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4806093Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4806235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4806399Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4806761Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4807128Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4807451Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4807718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4808030Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4808291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4808586Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4808724Z Execution Analysis: (:1) 2024-12-18T00:21:04.4808977Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4809354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4809360Z 2024-12-18T00:21:04.4809567Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4809702Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4809935Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4810066Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4810278Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4810427Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4810592Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4810766Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4811374Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4811952Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4812380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4812738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4813054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4813347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4813664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4813952Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4814064Z Execution Analysis: .......... 2024-12-18T00:21:04.4814340Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4814549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4814855Z pt-xla-profiler: TransferFromDeviceTime too frequent: 392 counts during 374 steps 2024-12-18T00:21:04.4814860Z 2024-12-18T00:21:04.4815068Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4815188Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4815499Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4815616Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4815884Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4816031Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4816194Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4816436Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4816831Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4817201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4817516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4817805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4818118Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4818405Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4818703Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4818845Z Execution Analysis: (:1) 2024-12-18T00:21:04.4819109Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4819318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4819324Z 2024-12-18T00:21:04.4819544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4819661Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4819908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4820020Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4820238Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4820383Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4820531Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4820713Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4821307Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4821900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4822312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4822679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4822992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4823280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4823591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4823859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4823979Z Execution Analysis: .......... 2024-12-18T00:21:04.4824239Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4824458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4824747Z pt-xla-profiler: TransferFromDeviceTime too frequent: 393 counts during 375 steps 2024-12-18T00:21:04.4824752Z 2024-12-18T00:21:04.4824968Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4825085Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4825379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4825533Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4825742Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4825905Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4826051Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4826262Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4826624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4826981Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4827307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4827581Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4827900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4828171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4828478Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4828606Z Execution Analysis: (:1) 2024-12-18T00:21:04.4828881Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4829088Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4829095Z 2024-12-18T00:21:04.4829298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4829428Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4829660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4829785Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4829995Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4830155Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4830310Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4830478Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4831088Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4831720Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4832097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4832453Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4832780Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4833060Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4833491Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4833754Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4833863Z Execution Analysis: .......... 2024-12-18T00:21:04.4834129Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4834335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4834626Z pt-xla-profiler: TransferFromDeviceTime too frequent: 394 counts during 376 steps 2024-12-18T00:21:04.4834630Z 2024-12-18T00:21:04.4834832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4835121Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4835445Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4835572Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4835779Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4835927Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4836217Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4836387Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4836763Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4837116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4837443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4837717Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4838027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4838309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4838601Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4838742Z Execution Analysis: (:1) 2024-12-18T00:21:04.4839002Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4839222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4839227Z 2024-12-18T00:21:04.4839430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4839562Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4839795Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4839909Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4840127Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4840272Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4840432Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4840602Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4841209Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4841845Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4842207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4842572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4842887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4843175Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4843484Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4843767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4843876Z Execution Analysis: .......... 2024-12-18T00:21:04.4844287Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4844505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4844789Z pt-xla-profiler: TransferFromDeviceTime too frequent: 395 counts during 377 steps 2024-12-18T00:21:04.4844794Z 2024-12-18T00:21:04.4845012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4845190Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4845514Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4845627Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4845846Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4846029Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4846179Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4846364Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4846724Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4847090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4847405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4847698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4848007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4848277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4848581Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4848711Z Execution Analysis: (:1) 2024-12-18T00:21:04.4848987Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4849197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4849201Z 2024-12-18T00:21:04.4849419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4849535Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4849784Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4849896Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4850107Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4850269Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4850420Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4850605Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4851280Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4851867Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4852230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4852585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4852913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4853189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4853514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4853788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4853912Z Execution Analysis: .......... 2024-12-18T00:21:04.4854175Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4854394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4854681Z pt-xla-profiler: TransferFromDeviceTime too frequent: 396 counts during 378 steps 2024-12-18T00:21:04.4854712Z 2024-12-18T00:21:04.4854917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4855047Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4855342Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4855468Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4855708Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4855873Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4856019Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4856190Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4856642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4856999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4857332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4857612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4857936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4858209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4858520Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4858652Z Execution Analysis: (:1) 2024-12-18T00:21:04.4858912Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4859134Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4859139Z 2024-12-18T00:21:04.4859345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4859478Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4859713Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4859841Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4860053Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4860202Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4860370Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4860570Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4861204Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4861784Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4862159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4862515Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4862843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4863123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4863431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4863717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4863828Z Execution Analysis: .......... 2024-12-18T00:21:04.4864097Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4864301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4864630Z pt-xla-profiler: TransferFromDeviceTime too frequent: 397 counts during 379 steps 2024-12-18T00:21:04.4864635Z 2024-12-18T00:21:04.4864842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4864970Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4865261Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4865403Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4865628Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4865776Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4865935Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4866105Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4866479Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4866832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4867145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4867432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4867740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4868021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4868318Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4868454Z Execution Analysis: (:1) 2024-12-18T00:21:04.4868714Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4868919Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4868935Z 2024-12-18T00:21:04.4869142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4869256Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4869500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4869614Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4869837Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4869984Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4870163Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4870371Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4870968Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4871556Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4871927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4872298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4872613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4872909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4873226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4873606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4873725Z Execution Analysis: .......... 2024-12-18T00:21:04.4873979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4874191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4874497Z pt-xla-profiler: TransferFromDeviceTime too frequent: 398 counts during 380 steps 2024-12-18T00:21:04.4874502Z 2024-12-18T00:21:04.4874712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4874826Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4875149Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4875262Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4875634Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4875793Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4875937Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4876119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4876480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4876846Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4877159Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4877432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4877753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4878028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4878335Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4878463Z Execution Analysis: (:1) 2024-12-18T00:21:04.4878737Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4878944Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4878951Z 2024-12-18T00:21:04.4879169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4879287Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4879520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4879647Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4879857Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4880071Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4880220Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4880402Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4880994Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4881569Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4881946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4882299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4882627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4882908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4883234Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4883503Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4883628Z Execution Analysis: .......... 2024-12-18T00:21:04.4883890Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4884122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4884422Z pt-xla-profiler: TransferFromDeviceTime too frequent: 399 counts during 381 steps 2024-12-18T00:21:04.4884427Z 2024-12-18T00:21:04.4884656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4884784Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4885081Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4885205Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4885412Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4885559Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4885715Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4885885Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4886259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4886611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4886935Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4887213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4887525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4887808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4888103Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4888242Z Execution Analysis: (:1) 2024-12-18T00:21:04.4888504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4888723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4888727Z 2024-12-18T00:21:04.4888936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4889063Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4889295Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4889448Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4889766Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4889912Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4890077Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4890245Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4890851Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4891429Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4891803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4892156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4892472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4892762Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4893074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4893357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4893465Z Execution Analysis: .......... 2024-12-18T00:21:04.4893766Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4893972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4894256Z pt-xla-profiler: TransferFromDeviceTime too frequent: 400 counts during 382 steps 2024-12-18T00:21:04.4894270Z 2024-12-18T00:21:04.4894500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4894622Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4894928Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4895042Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4895260Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4895406Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4895551Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4895737Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4896097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4896544Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4896860Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4897150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4897462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4897750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4898048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4898175Z Execution Analysis: (:1) 2024-12-18T00:21:04.4898449Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4898655Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4898659Z 2024-12-18T00:21:04.4898875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4898996Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4899281Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4899422Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4899635Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4899796Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4899947Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4900131Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4900723Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4901314Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4901678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4902045Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4902366Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4902644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4902968Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4903265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4903413Z Execution Analysis: .......... 2024-12-18T00:21:04.4903676Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4903897Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4904213Z pt-xla-profiler: TransferFromDeviceTime too frequent: 402 counts during 383 steps 2024-12-18T00:21:04.4904221Z 2024-12-18T00:21:04.4904442Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4904563Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4904857Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4904987Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4905196Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4905358Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4905506Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4905677Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4906050Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4906407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4906738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4907019Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4907344Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4907615Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4907924Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4908056Z Execution Analysis: (:1) 2024-12-18T00:21:04.4908317Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4908538Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4908543Z 2024-12-18T00:21:04.4908749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4908907Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4909168Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4909301Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4909518Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4909667Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4909832Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4910004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4910618Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4911190Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4911569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4911928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4912256Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4912530Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4912841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4913150Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4913257Z Execution Analysis: .......... 2024-12-18T00:21:04.4913533Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4913764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4914063Z pt-xla-profiler: TransferFromDeviceTime too frequent: 403 counts during 384 steps 2024-12-18T00:21:04.4914070Z 2024-12-18T00:21:04.4914279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4914409Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4914703Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4914816Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4915036Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4915184Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4915339Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4915616Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4915979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4916326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4916636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4916917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4917219Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4917663Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4917959Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4918098Z Execution Analysis: (:1) 2024-12-18T00:21:04.4918358Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4918566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4918582Z 2024-12-18T00:21:04.4918814Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4918953Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4919200Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4919313Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4919534Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4919680Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4919844Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4920014Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4920606Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4921193Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4921560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4921928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4922242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4922530Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4922865Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4923148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4923257Z Execution Analysis: .......... 2024-12-18T00:21:04.4923518Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4923772Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4924065Z pt-xla-profiler: TransferFromDeviceTime too frequent: 404 counts during 385 steps 2024-12-18T00:21:04.4924070Z 2024-12-18T00:21:04.4924289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4924406Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4924711Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4924826Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4925036Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4925195Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4925339Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4925522Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4925884Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4926255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4926567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4926841Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4927163Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4927435Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4927742Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4927869Z Execution Analysis: (:1) 2024-12-18T00:21:04.4928142Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4928349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4928379Z 2024-12-18T00:21:04.4928621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4928739Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4928971Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4929096Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4929304Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4929465Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4929612Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4929794Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4930387Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4930960Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4931340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4931693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4932020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4932319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4932641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4932911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4933032Z Execution Analysis: .......... 2024-12-18T00:21:04.4933318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4933529Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4933825Z pt-xla-profiler: TransferFromDeviceTime too frequent: 405 counts during 386 steps 2024-12-18T00:21:04.4933830Z 2024-12-18T00:21:04.4934035Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4934164Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4934458Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4934585Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4934791Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4934939Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4935095Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4935268Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4935641Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4935996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4936319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4936687Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4937011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4937285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4937577Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4937719Z Execution Analysis: (:1) 2024-12-18T00:21:04.4937979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4938256Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4938261Z 2024-12-18T00:21:04.4938468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4938597Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4938832Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4938946Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4939171Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4939318Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4939482Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4939654Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4940262Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4940841Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4941217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4941572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4941889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4942204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4942521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4942805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4942942Z Execution Analysis: .......... 2024-12-18T00:21:04.4943221Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4943428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4943714Z pt-xla-profiler: TransferFromDeviceTime too frequent: 406 counts during 387 steps 2024-12-18T00:21:04.4943731Z 2024-12-18T00:21:04.4943937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4944057Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4944526Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4944640Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4944860Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4945008Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4945171Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4945345Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4945710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4946081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4946396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4946689Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4947002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4947288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4947584Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4947715Z Execution Analysis: (:1) 2024-12-18T00:21:04.4948057Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4948299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4948304Z 2024-12-18T00:21:04.4948523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4948640Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4948891Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4949007Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4949217Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4949380Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4949532Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4949721Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4950319Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4950914Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4951280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4951648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4952000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4952276Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4952601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4952906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4953034Z Execution Analysis: .......... 2024-12-18T00:21:04.4953299Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4953521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4953810Z pt-xla-profiler: TransferFromDeviceTime too frequent: 407 counts during 388 steps 2024-12-18T00:21:04.4953814Z 2024-12-18T00:21:04.4954034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4954153Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4954447Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4954577Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4954786Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4954956Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4955104Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4955292Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4955655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4956012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4956343Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4956626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4957055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4957321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4957626Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4957778Z Execution Analysis: (:1) 2024-12-18T00:21:04.4958058Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4958274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4958279Z 2024-12-18T00:21:04.4958476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4958600Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4958828Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4958955Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4959160Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4959316Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4959462Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4959627Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4960221Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4960783Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4961146Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4961530Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4961847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4962116Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4962456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4962723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4962832Z Execution Analysis: .......... 2024-12-18T00:21:04.4963101Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4963300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4963595Z pt-xla-profiler: TransferFromDeviceTime too frequent: 408 counts during 389 steps 2024-12-18T00:21:04.4963602Z 2024-12-18T00:21:04.4963806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4963938Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4964223Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4964336Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4964553Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4964700Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4964859Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4965025Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4965559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4965912Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4966229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4966516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4966825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4967111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4967433Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4967597Z Execution Analysis: (:1) 2024-12-18T00:21:04.4967860Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4968078Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4968083Z 2024-12-18T00:21:04.4968287Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4968404Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4968651Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4968766Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4968988Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4969137Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4969303Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4969477Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4970072Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4970663Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4971052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4971419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4971731Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4972048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4972363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4972648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4972756Z Execution Analysis: .......... 2024-12-18T00:21:04.4973016Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4973232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4973519Z pt-xla-profiler: TransferFromDeviceTime too frequent: 409 counts during 390 steps 2024-12-18T00:21:04.4973524Z 2024-12-18T00:21:04.4973741Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4973860Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4974166Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4974280Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4974489Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4974648Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4974792Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4974975Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4975335Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4975700Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4976015Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4976302Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4976690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4976963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4977329Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4977460Z Execution Analysis: (:1) 2024-12-18T00:21:04.4977733Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4977937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4977944Z 2024-12-18T00:21:04.4978160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4978276Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4978509Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4978633Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4978845Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4979004Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4979156Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4979337Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4979929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4980515Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4980905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4981255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4981603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4981881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4982206Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4982477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4982598Z Execution Analysis: .......... 2024-12-18T00:21:04.4982859Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4983064Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4983366Z pt-xla-profiler: TransferFromDeviceTime too frequent: 410 counts during 391 steps 2024-12-18T00:21:04.4983370Z 2024-12-18T00:21:04.4983574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4983706Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4984000Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4984132Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4984338Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4984496Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4984641Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4984810Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4985184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4985541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4985864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4986139Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4986464Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4986788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4987085Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4987228Z Execution Analysis: (:1) 2024-12-18T00:21:04.4987491Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4987712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4987718Z 2024-12-18T00:21:04.4987924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4988052Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4988287Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4988412Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4988626Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4988773Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4988935Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4989105Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4989711Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.4990312Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.4990685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.4991042Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4991382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4991678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4991989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4992277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4992386Z Execution Analysis: .......... 2024-12-18T00:21:04.4992656Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4992864Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4993163Z pt-xla-profiler: TransferFromDeviceTime too frequent: 411 counts during 392 steps 2024-12-18T00:21:04.4993168Z 2024-12-18T00:21:04.4993380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4993498Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4993807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.4993922Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4994146Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.4994295Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.4994454Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.4994625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4994983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.4995352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.4995664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.4995957Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.4996334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.4996618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.4996913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.4997149Z Execution Analysis: (:1) 2024-12-18T00:21:04.4997420Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.4997622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4997627Z 2024-12-18T00:21:04.4997839Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.4997951Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.4998197Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.4998309Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.4998531Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.4998676Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.4998821Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.4999167Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.4999759Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5000375Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5000738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5001133Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5001453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5001742Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5002056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5002330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5002457Z Execution Analysis: .......... 2024-12-18T00:21:04.5002720Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5002938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5003225Z pt-xla-profiler: TransferFromDeviceTime too frequent: 412 counts during 393 steps 2024-12-18T00:21:04.5003231Z 2024-12-18T00:21:04.5003450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5003572Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5003860Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5003982Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5004187Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5004344Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5004489Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5004670Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5005028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5005383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5005709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5006038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5006364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5006641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5006943Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5007070Z Execution Analysis: (:1) 2024-12-18T00:21:04.5007341Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5007546Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5007551Z 2024-12-18T00:21:04.5007757Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5007882Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5008116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5008242Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5008456Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5008616Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5008767Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5008938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5009570Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5010142Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5010541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5010899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5011224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5011502Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5011819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5012089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5012198Z Execution Analysis: .......... 2024-12-18T00:21:04.5012469Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5012673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5012970Z pt-xla-profiler: TransferFromDeviceTime too frequent: 413 counts during 394 steps 2024-12-18T00:21:04.5012977Z 2024-12-18T00:21:04.5013183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5013311Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5013603Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5013725Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5013932Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5014188Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5014340Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5014504Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5014866Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5015212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5015557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5015855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5016158Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5016515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5016968Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5017114Z Execution Analysis: (:1) 2024-12-18T00:21:04.5017377Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5017597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5017602Z 2024-12-18T00:21:04.5017810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5017944Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5018180Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5018295Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5018518Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5018664Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5018825Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5019024Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5019616Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5020232Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5020592Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5020959Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5021271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5021559Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5021868Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5022151Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5022259Z Execution Analysis: .......... 2024-12-18T00:21:04.5022519Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5022737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5023022Z pt-xla-profiler: TransferFromDeviceTime too frequent: 414 counts during 395 steps 2024-12-18T00:21:04.5023029Z 2024-12-18T00:21:04.5023244Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5023360Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5023663Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5023779Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5023997Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5024142Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5024285Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5024465Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5024825Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5025187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5025552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5025839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5026149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5026416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5026725Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5026850Z Execution Analysis: (:1) 2024-12-18T00:21:04.5027121Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5027329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5027335Z 2024-12-18T00:21:04.5027549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5027665Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5027907Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5028020Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5028228Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5028386Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5028565Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5028749Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5029344Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5029950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5030318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5030669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5030997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5031272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5031598Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5031868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5031988Z Execution Analysis: .......... 2024-12-18T00:21:04.5032251Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5032468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5032758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 415 counts during 396 steps 2024-12-18T00:21:04.5032763Z 2024-12-18T00:21:04.5032967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5033102Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5033396Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5033521Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5033727Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5033887Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5034032Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5034198Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5034570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5034989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5040207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5040741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5041068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5041354Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5041650Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5041786Z Execution Analysis: (:1) 2024-12-18T00:21:04.5042058Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5042277Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5042287Z 2024-12-18T00:21:04.5042499Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5042620Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5042854Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5042963Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5043186Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5043413Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5043572Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5043740Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5044647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5045233Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5045608Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5045962Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5046276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5046565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5046872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5047153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5047257Z Execution Analysis: .......... 2024-12-18T00:21:04.5047532Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5047741Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5048027Z pt-xla-profiler: TransferFromDeviceTime too frequent: 416 counts during 397 steps 2024-12-18T00:21:04.5048044Z 2024-12-18T00:21:04.5048250Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5048363Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5048668Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5048776Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5048994Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5049137Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5049289Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5049462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5049966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5050330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5050641Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5050929Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5051238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5051517Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5051809Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5051934Z Execution Analysis: (:1) 2024-12-18T00:21:04.5052205Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5052409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5052414Z 2024-12-18T00:21:04.5052627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5052737Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5052978Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5053083Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5053335Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5053479Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5053625Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5053803Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5054420Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5055010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5055367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5055727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5056041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5056311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5056714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5056987Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5057105Z Execution Analysis: .......... 2024-12-18T00:21:04.5057365Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5057576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5057859Z pt-xla-profiler: TransferFromDeviceTime too frequent: 417 counts during 398 steps 2024-12-18T00:21:04.5057865Z 2024-12-18T00:21:04.5058076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5058193Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5058484Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5058609Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5058812Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5058969Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5059109Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5059312Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5059693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5060048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5060372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5060641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5060962Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5061228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5061530Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5061654Z Execution Analysis: (:1) 2024-12-18T00:21:04.5061924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5062127Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5062132Z 2024-12-18T00:21:04.5062333Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5062458Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5062685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5062836Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5063043Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5063198Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5063344Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5063557Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5064168Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5064740Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5065111Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5065460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5065784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5066057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5066383Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5066652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5066760Z Execution Analysis: .......... 2024-12-18T00:21:04.5067037Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5067240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5067540Z pt-xla-profiler: TransferFromDeviceTime too frequent: 418 counts during 399 steps 2024-12-18T00:21:04.5067546Z 2024-12-18T00:21:04.5067749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5067878Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5068169Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5068278Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5068496Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5068746Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5068953Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5069115Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5069473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5069814Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5070116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5070394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5070692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5070964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5071246Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5071381Z Execution Analysis: (:1) 2024-12-18T00:21:04.5071631Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5071837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5071842Z 2024-12-18T00:21:04.5072037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5072171Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5072405Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5072510Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5072719Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5072857Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5073050Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5073214Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5073793Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5074362Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5074707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5075059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5075361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5075642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5075940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5076214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5076318Z Execution Analysis: .......... 2024-12-18T00:21:04.5076732Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5076944Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5077223Z pt-xla-profiler: TransferFromDeviceTime too frequent: 419 counts during 400 steps 2024-12-18T00:21:04.5077230Z 2024-12-18T00:21:04.5077439Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5077548Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5077850Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5077961Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5078175Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5078370Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5078509Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5078690Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5079044Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5079407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5079719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5080003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5080311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5080577Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5080882Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5081003Z Execution Analysis: (:1) 2024-12-18T00:21:04.5081377Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5081574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5081578Z 2024-12-18T00:21:04.5081788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5081923Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5082157Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5082265Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5082466Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5082644Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5082788Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5082965Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5083539Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5084103Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5084452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5084794Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5085106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5085371Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5085686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5085943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5086058Z Execution Analysis: .......... 2024-12-18T00:21:04.5086309Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5086518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5086796Z pt-xla-profiler: TransferFromDeviceTime too frequent: 420 counts during 401 steps 2024-12-18T00:21:04.5086801Z 2024-12-18T00:21:04.5086997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5087119Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5087401Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5087545Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5087768Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5087920Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5088057Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5088222Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5088577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5088919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5089233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5089496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5089812Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5090078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5090362Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5090501Z Execution Analysis: (:1) 2024-12-18T00:21:04.5090750Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5090963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5090992Z 2024-12-18T00:21:04.5091188Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5091314Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5091536Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5091653Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5091880Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5092023Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5092182Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5092344Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5092932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5093487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5093848Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5094190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5094495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5094775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5095075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5095348Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5095454Z Execution Analysis: .......... 2024-12-18T00:21:04.5095715Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5095914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5096197Z pt-xla-profiler: TransferFromDeviceTime too frequent: 421 counts during 402 steps 2024-12-18T00:21:04.5096202Z 2024-12-18T00:21:04.5096481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5096596Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5097092Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5097228Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5097446Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5097589Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5097788Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5097954Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5098308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5098672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5098979Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5099269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5099572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5099849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5100141Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5100275Z Execution Analysis: (:1) 2024-12-18T00:21:04.5100533Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5100759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5100763Z 2024-12-18T00:21:04.5100975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5101087Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5101353Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5101460Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5101679Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5101824Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5101968Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5102152Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5102739Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5103325Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5103682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5104045Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5104355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5104642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5104950Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5105216Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5105333Z Execution Analysis: .......... 2024-12-18T00:21:04.5105587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5105802Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5106083Z pt-xla-profiler: TransferFromDeviceTime too frequent: 423 counts during 403 steps 2024-12-18T00:21:04.5106088Z 2024-12-18T00:21:04.5106302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5106448Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5106773Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5106887Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5107086Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5107240Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5107382Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5107562Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5107915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5108267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5108595Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5108870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5109302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5109564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5109861Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5109983Z Execution Analysis: (:1) 2024-12-18T00:21:04.5110246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5110483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5110488Z 2024-12-18T00:21:04.5110684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5110834Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5111057Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5111184Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5111386Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5111537Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5111680Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5111839Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5112429Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5112986Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5113346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5113686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5114001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5114263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5114573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5114833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5114936Z Execution Analysis: .......... 2024-12-18T00:21:04.5115196Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5115389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5115681Z pt-xla-profiler: TransferFromDeviceTime too frequent: 424 counts during 404 steps 2024-12-18T00:21:04.5115686Z 2024-12-18T00:21:04.5115904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5116048Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5116331Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5116448Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5116651Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5116787Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5116936Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5117095Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5117453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5117792Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5118106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5118376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5118671Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5118940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5119218Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5119379Z Execution Analysis: (:1) 2024-12-18T00:21:04.5119626Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5119842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5119847Z 2024-12-18T00:21:04.5120065Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5120187Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5120413Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5120517Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5120732Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5120869Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5121022Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5121180Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5121767Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5122323Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5122670Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5123026Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5123326Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5123600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5123897Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5124171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5124274Z Execution Analysis: .......... 2024-12-18T00:21:04.5124520Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5124731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5125010Z pt-xla-profiler: TransferFromDeviceTime too frequent: 425 counts during 405 steps 2024-12-18T00:21:04.5125039Z 2024-12-18T00:21:04.5125275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5125384Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5125679Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5125784Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5125993Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5126137Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5126275Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5126452Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5126801Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5127154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5127458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5127731Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5128030Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5128289Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5128585Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5128727Z Execution Analysis: (:1) 2024-12-18T00:21:04.5128991Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5129186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5129215Z 2024-12-18T00:21:04.5129424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5129535Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5129769Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5129876Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5130086Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5130233Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5130380Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5130560Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5131139Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5131715Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5132069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5132427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5132734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5133005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5133318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5133586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5133703Z Execution Analysis: .......... 2024-12-18T00:21:04.5133957Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5134169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5134502Z pt-xla-profiler: TransferFromDeviceTime too frequent: 426 counts during 406 steps 2024-12-18T00:21:04.5134508Z 2024-12-18T00:21:04.5134709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5134832Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5135119Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5135244Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5135448Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5135603Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5135746Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5135914Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5136280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5136731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5137224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5137501Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5137826Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5138095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5138433Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5138558Z Execution Analysis: (:1) 2024-12-18T00:21:04.5138819Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5139067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5139074Z 2024-12-18T00:21:04.5139279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5139408Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5139641Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5139766Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5139972Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5140118Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5140280Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5140449Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5141055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5141629Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5142006Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5142356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5142681Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5142955Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5143265Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5143547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5143656Z Execution Analysis: .......... 2024-12-18T00:21:04.5143928Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5144317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5144686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 427 counts during 407 steps 2024-12-18T00:21:04.5144692Z 2024-12-18T00:21:04.5144896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5145020Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5145313Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5145429Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5145644Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5145790Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5145945Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5146115Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5146482Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5146838Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5147152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5147439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5147748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5148065Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5148359Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5148494Z Execution Analysis: (:1) 2024-12-18T00:21:04.5148788Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5148998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5149013Z 2024-12-18T00:21:04.5149215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5149330Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5149573Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5149685Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5149905Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5150052Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5150201Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5150375Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5150969Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5151555Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5151914Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5152277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5152591Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5152876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5153185Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5153454Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5153573Z Execution Analysis: .......... 2024-12-18T00:21:04.5153833Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5154108Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5154400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 428 counts during 408 steps 2024-12-18T00:21:04.5154405Z 2024-12-18T00:21:04.5154621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5154736Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5155043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5155154Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5155361Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5155516Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5155664Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5155845Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5156414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5156752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5157042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5157296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5157616Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5157868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5158144Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5158285Z Execution Analysis: (:1) 2024-12-18T00:21:04.5158535Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5158728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5158732Z 2024-12-18T00:21:04.5158930Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5159037Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5159252Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5159366Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5159560Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5159707Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5159845Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5160009Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5160558Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5161092Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5161434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5161760Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5162056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5162309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5162606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5162856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5162994Z Execution Analysis: .......... 2024-12-18T00:21:04.5163256Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5163447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5163722Z pt-xla-profiler: TransferFromDeviceTime too frequent: 429 counts during 409 steps 2024-12-18T00:21:04.5163727Z 2024-12-18T00:21:04.5163915Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5164034Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5164306Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5164419Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5164609Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5164746Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5164889Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5165046Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5165386Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5165715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5166017Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5166296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5166582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5166837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5167136Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5167266Z Execution Analysis: (:1) 2024-12-18T00:21:04.5167509Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5167707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5167712Z 2024-12-18T00:21:04.5167899Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5168018Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5168234Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5168341Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5168544Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5168680Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5168832Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5168991Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5169554Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5170086Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5170434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5170761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5171051Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5171319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5171608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5171892Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5172013Z Execution Analysis: .......... 2024-12-18T00:21:04.5172261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5172451Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5172717Z pt-xla-profiler: TransferFromDeviceTime too frequent: 430 counts during 410 steps 2024-12-18T00:21:04.5172735Z 2024-12-18T00:21:04.5172924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5173033Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5173313Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5173418Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5173620Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5173758Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5173892Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5174058Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5174389Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5174725Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5175016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5175307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5175594Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5175879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5176150Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5176274Z Execution Analysis: (:1) 2024-12-18T00:21:04.5176600Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5176964Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5176968Z 2024-12-18T00:21:04.5177187Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5177306Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5177554Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5177665Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5177875Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5178034Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5178187Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5178368Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5178966Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5179550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5179909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5180277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5180593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5180872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5181193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5181531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5181647Z Execution Analysis: .......... 2024-12-18T00:21:04.5181907Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5182124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5182416Z pt-xla-profiler: TransferFromDeviceTime too frequent: 431 counts during 411 steps 2024-12-18T00:21:04.5182421Z 2024-12-18T00:21:04.5182637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5182756Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5183052Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5183179Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5183389Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5183548Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5183698Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5183882Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5184244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5184598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5184957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5185230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5185548Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5185844Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5186153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5186279Z Execution Analysis: (:1) 2024-12-18T00:21:04.5186537Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5186750Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5186755Z 2024-12-18T00:21:04.5186958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5187085Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5187317Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5187441Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5187653Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5187797Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5187956Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5188126Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5188731Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5189388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5189735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5190062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5190370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5190631Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5190972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5191236Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5191333Z Execution Analysis: .......... 2024-12-18T00:21:04.5191590Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5191781Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5192059Z pt-xla-profiler: TransferFromDeviceTime too frequent: 432 counts during 412 steps 2024-12-18T00:21:04.5192064Z 2024-12-18T00:21:04.5192253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5192370Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5192643Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5192750Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5192953Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5193088Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5193237Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5193394Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5193735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5194086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5194373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5194639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5195023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5195290Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5195562Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5195694Z Execution Analysis: (:1) 2024-12-18T00:21:04.5195934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5196132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5196138Z 2024-12-18T00:21:04.5196327Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5196432Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5196660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5196768Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5196977Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5197120Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5197266Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5197425Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5197974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5198513Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5198852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5199194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5199488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5199822Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5200111Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5200371Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5200472Z Execution Analysis: .......... 2024-12-18T00:21:04.5200712Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5200916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5201179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 433 counts during 413 steps 2024-12-18T00:21:04.5201184Z 2024-12-18T00:21:04.5201385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5201494Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5201781Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5201887Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5202078Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5202224Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5202357Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5202525Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5202882Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5203218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5203507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5203778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5204076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5204325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5204604Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5204721Z Execution Analysis: (:1) 2024-12-18T00:21:04.5204967Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5205157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5205161Z 2024-12-18T00:21:04.5205358Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5205464Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5205681Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5205797Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5205993Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5206138Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5206276Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5206441Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5206988Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5207516Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5207861Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5208193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5208521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5208799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5209095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5209344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5209453Z Execution Analysis: .......... 2024-12-18T00:21:04.5209695Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5209882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5210153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 434 counts during 414 steps 2024-12-18T00:21:04.5210157Z 2024-12-18T00:21:04.5210348Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5210467Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5210739Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5210855Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5211049Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5211182Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5211324Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5211512Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5211853Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5212179Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5212513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5212771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5213067Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5213317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5213583Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5213712Z Execution Analysis: (:1) 2024-12-18T00:21:04.5213955Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5214156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5214160Z 2024-12-18T00:21:04.5214347Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5214467Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5214685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5214789Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5214994Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5215124Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5215271Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5215428Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5215984Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5216590Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5217118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5217473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5217841Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5218130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5218438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5218719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5218831Z Execution Analysis: .......... 2024-12-18T00:21:04.5219108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5219312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5219612Z pt-xla-profiler: TransferFromDeviceTime too frequent: 435 counts during 415 steps 2024-12-18T00:21:04.5219619Z 2024-12-18T00:21:04.5219825Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5219944Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5220250Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5220365Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5220587Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5220734Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5220919Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5221090Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5221449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5221840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5222158Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5222449Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5222761Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5223046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5223341Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5223473Z Execution Analysis: (:1) 2024-12-18T00:21:04.5223749Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5223955Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5223960Z 2024-12-18T00:21:04.5224180Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5224300Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5224553Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5224668Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5224893Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5225040Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5225194Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5225375Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5225970Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5226559Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5226923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5227338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5227655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5227948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5228259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5228536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5228662Z Execution Analysis: .......... 2024-12-18T00:21:04.5228923Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5229241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5229508Z pt-xla-profiler: TransferFromDeviceTime too frequent: 436 counts during 416 steps 2024-12-18T00:21:04.5229514Z 2024-12-18T00:21:04.5229718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5229830Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5230103Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5230218Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5230407Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5230585Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5230718Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5230884Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5231216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5231567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5231873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5232129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5232424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5232673Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5232956Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5233073Z Execution Analysis: (:1) 2024-12-18T00:21:04.5233323Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5233515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5233519Z 2024-12-18T00:21:04.5233710Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5233830Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5234046Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5234161Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5234356Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5234501Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5234640Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5234799Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5235359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5235894Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5236292Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5236622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5236924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5237180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5237483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5237732Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5237833Z Execution Analysis: .......... 2024-12-18T00:21:04.5238084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5238275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5238555Z pt-xla-profiler: TransferFromDeviceTime too frequent: 437 counts during 417 steps 2024-12-18T00:21:04.5238559Z 2024-12-18T00:21:04.5238749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5238872Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5239145Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5239279Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5239482Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5239619Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5239764Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5239923Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5240289Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5240620Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5240924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5241179Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5241465Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5241731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5242002Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5242135Z Execution Analysis: (:1) 2024-12-18T00:21:04.5242377Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5242583Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5242589Z 2024-12-18T00:21:04.5242782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5242889Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5243116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5243221Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5243429Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5243566Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5243717Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5243875Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5244739Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5245334Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5245785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5246154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5246469Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5246761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5247072Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5247357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5247466Z Execution Analysis: .......... 2024-12-18T00:21:04.5247727Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5247950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5248236Z pt-xla-profiler: TransferFromDeviceTime too frequent: 438 counts during 418 steps 2024-12-18T00:21:04.5248242Z 2024-12-18T00:21:04.5248458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5248574Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5248877Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5249044Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5249263Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5249409Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5249553Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5249768Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5250129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5250497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5250812Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5251099Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5251410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5251680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5251987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5252113Z Execution Analysis: (:1) 2024-12-18T00:21:04.5252386Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5252595Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5252599Z 2024-12-18T00:21:04.5252820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5252937Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5253180Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5253295Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5253506Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5253662Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5253811Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5253988Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5254584Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5255228Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5255590Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5255944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5256268Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5256628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5256953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5257225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5257347Z Execution Analysis: .......... 2024-12-18T00:21:04.5257610Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5257830Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5258118Z pt-xla-profiler: TransferFromDeviceTime too frequent: 439 counts during 419 steps 2024-12-18T00:21:04.5258123Z 2024-12-18T00:21:04.5258329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5258489Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5258783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5258914Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5259120Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5259280Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5259451Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5259625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5259996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5260347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5260671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5260947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5261269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5261538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5261830Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5261971Z Execution Analysis: (:1) 2024-12-18T00:21:04.5262233Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5262453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5262457Z 2024-12-18T00:21:04.5262662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5262791Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5263025Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5263152Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5263362Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5263509Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5263670Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5263839Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5264473Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5265077Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5265456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5265811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5266142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5266422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5266733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5267021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5267132Z Execution Analysis: .......... 2024-12-18T00:21:04.5267408Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5267615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5267916Z pt-xla-profiler: TransferFromDeviceTime too frequent: 440 counts during 420 steps 2024-12-18T00:21:04.5267921Z 2024-12-18T00:21:04.5268129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5268277Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5268586Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5268699Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5269028Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5269195Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5269349Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5269510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5269846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5270192Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5270484Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5270758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5271046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5271310Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5271590Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5271726Z Execution Analysis: (:1) 2024-12-18T00:21:04.5271970Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5272163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5272167Z 2024-12-18T00:21:04.5272371Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5272480Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5272719Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5272824Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5273042Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5273179Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5273321Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5273495Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5274090Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5274634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5274967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5275312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5275603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5275870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5276156Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5276405Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5276517Z Execution Analysis: .......... 2024-12-18T00:21:04.5276756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5276955Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5277220Z pt-xla-profiler: TransferFromDeviceTime too frequent: 441 counts during 421 steps 2024-12-18T00:21:04.5277251Z 2024-12-18T00:21:04.5277452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5277560Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5277841Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5277944Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5278158Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5278311Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5278446Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5278617Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5278949Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5279285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5279580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5279834Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5280133Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5280387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5280675Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5280794Z Execution Analysis: (:1) 2024-12-18T00:21:04.5281049Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5281241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5281245Z 2024-12-18T00:21:04.5281438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5281567Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5281783Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5281902Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5282095Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5282244Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5282409Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5282604Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5283167Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5283698Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5284048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5284376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5284678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5284936Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5285235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5285487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5285588Z Execution Analysis: .......... 2024-12-18T00:21:04.5285846Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5286039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5286348Z pt-xla-profiler: TransferFromDeviceTime too frequent: 442 counts during 422 steps 2024-12-18T00:21:04.5286352Z 2024-12-18T00:21:04.5286542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5286663Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5286957Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5287079Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5287271Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5287409Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5287556Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5287714Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5288057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5288383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5288688Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5288943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5289229Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5289491Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5289765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5289896Z Execution Analysis: (:1) 2024-12-18T00:21:04.5290134Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5290334Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5290339Z 2024-12-18T00:21:04.5290525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5290647Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5290862Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5290964Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5291172Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5291331Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5291507Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5291665Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5292225Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5292756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5293090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5293431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5293721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5293988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5294276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5294537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5294636Z Execution Analysis: .......... 2024-12-18T00:21:04.5294889Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5295078Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5295370Z pt-xla-profiler: TransferFromDeviceTime too frequent: 444 counts during 423 steps 2024-12-18T00:21:04.5295374Z 2024-12-18T00:21:04.5295572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5295704Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5295986Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5296098Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5296300Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5296504Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5296639Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5296975Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5297331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5297707Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5298019Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5298307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5298617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5298891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5299202Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5299328Z Execution Analysis: (:1) 2024-12-18T00:21:04.5299599Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5299805Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5299811Z 2024-12-18T00:21:04.5300027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5300143Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5300390Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5300502Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5300743Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5300923Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5301073Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5301254Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5301850Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5302439Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5302804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5303172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5303486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5303767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5304094Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5304366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5304486Z Execution Analysis: .......... 2024-12-18T00:21:04.5304748Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5304992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5305275Z pt-xla-profiler: TransferFromDeviceTime too frequent: 445 counts during 424 steps 2024-12-18T00:21:04.5305280Z 2024-12-18T00:21:04.5305512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5305643Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5305941Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5306065Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5306271Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5306430Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5306575Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5306745Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5307117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5307471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5307804Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5308082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5308409Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5308680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5309095Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5309221Z Execution Analysis: (:1) 2024-12-18T00:21:04.5309642Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5309863Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5309868Z 2024-12-18T00:21:04.5310074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5310206Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5310442Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5310596Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5310836Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5310986Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5311150Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5311322Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5311930Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5312513Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5312893Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5313250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5313585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5313864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5314176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5314460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5314573Z Execution Analysis: .......... 2024-12-18T00:21:04.5314877Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5315084Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5315384Z pt-xla-profiler: TransferFromDeviceTime too frequent: 446 counts during 425 steps 2024-12-18T00:21:04.5315415Z 2024-12-18T00:21:04.5315623Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5315759Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5316054Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5316171Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5316393Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5316543Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5316704Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5316880Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5317264Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5317619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5317936Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5318232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5318542Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5318828Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5319125Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5319265Z Execution Analysis: (:1) 2024-12-18T00:21:04.5319526Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5319730Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5319746Z 2024-12-18T00:21:04.5319950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5320066Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5320348Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5320488Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5320710Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5320855Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5321008Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5321190Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5321783Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5322368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5322731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5323101Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5323416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5323704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5324013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5324282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5324428Z Execution Analysis: .......... 2024-12-18T00:21:04.5324686Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5324903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5325216Z pt-xla-profiler: TransferFromDeviceTime too frequent: 447 counts during 426 steps 2024-12-18T00:21:04.5325224Z 2024-12-18T00:21:04.5325444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5325565Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5325872Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5325987Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5326195Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5326359Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5326505Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5326686Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5327048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5327415Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5327731Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5328015Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5328334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5328604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5328910Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5329042Z Execution Analysis: (:1) 2024-12-18T00:21:04.5329313Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5329520Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5329525Z 2024-12-18T00:21:04.5329744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5329889Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5330148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5330276Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5330488Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5330649Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5330799Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5330985Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5331580Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5332159Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5332633Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5332981Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5333301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5333572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5333888Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5334178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5334297Z Execution Analysis: .......... 2024-12-18T00:21:04.5334549Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5334775Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5335068Z pt-xla-profiler: TransferFromDeviceTime too frequent: 448 counts during 427 steps 2024-12-18T00:21:04.5335074Z 2024-12-18T00:21:04.5335275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5335401Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5335685Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5335806Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5336009Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5336151Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5336304Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5336545Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5337081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5337436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5337770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5338045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5338355Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5338642Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5338938Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5339082Z Execution Analysis: (:1) 2024-12-18T00:21:04.5339341Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5339563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5339597Z 2024-12-18T00:21:04.5340232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5340366Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5340600Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5340715Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5340941Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5341088Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5341255Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5341425Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5342034Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5342612Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5342991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5343342Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5343654Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5343941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5344508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5344794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5344902Z Execution Analysis: .......... 2024-12-18T00:21:04.5345233Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5345440Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5345733Z pt-xla-profiler: TransferFromDeviceTime too frequent: 449 counts during 428 steps 2024-12-18T00:21:04.5345751Z 2024-12-18T00:21:04.5345957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5346074Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5346383Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5346498Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5346719Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5346865Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5347011Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5347196Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5347556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5347927Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5348245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5348533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5348843Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5349130Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5349422Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5349550Z Execution Analysis: (:1) 2024-12-18T00:21:04.5349827Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5350033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5350081Z 2024-12-18T00:21:04.5350337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5350456Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5350703Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5350815Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5351024Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5351185Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5351333Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5351515Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5352109Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5352703Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5353066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5353431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5353744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5354057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5354378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5354650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5354773Z Execution Analysis: .......... 2024-12-18T00:21:04.5355075Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5355298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5355586Z pt-xla-profiler: TransferFromDeviceTime too frequent: 450 counts during 429 steps 2024-12-18T00:21:04.5355591Z 2024-12-18T00:21:04.5355808Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5355925Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5356322Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5356449Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5356653Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5356814Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5356957Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5357143Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5357498Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5357843Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5358163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5358433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5358751Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5359017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5359320Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5359446Z Execution Analysis: (:1) 2024-12-18T00:21:04.5359704Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5359966Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5359971Z 2024-12-18T00:21:04.5360166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5360282Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5360511Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5360636Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5360846Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5361004Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5361151Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5361318Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5361913Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5362478Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5362846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5363192Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5363543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5363814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5364120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5364423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5364637Z Execution Analysis: .......... 2024-12-18T00:21:04.5364899Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5365091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5365375Z pt-xla-profiler: TransferFromDeviceTime too frequent: 451 counts during 430 steps 2024-12-18T00:21:04.5365380Z 2024-12-18T00:21:04.5365570Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5365697Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5365970Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5366078Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5366282Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5366419Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5366566Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5366723Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5367069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5367393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5367682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5367948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5368237Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5368502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5368773Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5368907Z Execution Analysis: (:1) 2024-12-18T00:21:04.5369197Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5369402Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5369406Z 2024-12-18T00:21:04.5369596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5369704Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5369932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5370039Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5370248Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5370387Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5370538Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5370698Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5371250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5371799Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5372133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5372476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5372794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5373064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5373376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5373807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5373916Z Execution Analysis: .......... 2024-12-18T00:21:04.5374172Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5374384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5374662Z pt-xla-profiler: TransferFromDeviceTime too frequent: 452 counts during 431 steps 2024-12-18T00:21:04.5374667Z 2024-12-18T00:21:04.5374880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5374995Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5375455Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5375570Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5375855Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5376012Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5376160Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5376429Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5376798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5377168Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5377486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5377766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5378094Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5378367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5378680Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5378845Z Execution Analysis: (:1) 2024-12-18T00:21:04.5379148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5379357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5379362Z 2024-12-18T00:21:04.5379579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5379697Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5379930Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5380057Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5380268Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5380428Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5380579Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5380764Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5381359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5381933Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5382312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5382693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5383018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5383293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5383643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5383918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5384040Z Execution Analysis: .......... 2024-12-18T00:21:04.5384300Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5384503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5384801Z pt-xla-profiler: TransferFromDeviceTime too frequent: 453 counts during 432 steps 2024-12-18T00:21:04.5384808Z 2024-12-18T00:21:04.5385014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5385142Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5385434Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5385560Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5385766Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5385929Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5386076Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5386248Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5386622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5386974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5387300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5387576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5387902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5388175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5388521Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5388659Z Execution Analysis: (:1) 2024-12-18T00:21:04.5389026Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5389228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5389232Z 2024-12-18T00:21:04.5389421Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5389542Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5389757Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5389862Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5390067Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5390204Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5390357Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5390516Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5391074Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5391609Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5391995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5392323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5392613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5392902Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5393200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5393462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5393563Z Execution Analysis: .......... 2024-12-18T00:21:04.5393815Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5394006Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5394284Z pt-xla-profiler: TransferFromDeviceTime too frequent: 454 counts during 433 steps 2024-12-18T00:21:04.5394289Z 2024-12-18T00:21:04.5394480Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5394588Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5394878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5394986Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5395195Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5395332Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5395482Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5395640Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5395975Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5396314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5396604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5396870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5397159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5397446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5397741Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5397860Z Execution Analysis: (:1) 2024-12-18T00:21:04.5398116Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5398306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5398312Z 2024-12-18T00:21:04.5398512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5398619Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5398848Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5398953Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5399166Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5399303Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5399444Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5399613Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5400163Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5400713Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5401073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5401410Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5401727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5401997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5402287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5402540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5402654Z Execution Analysis: .......... 2024-12-18T00:21:04.5402896Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5403098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5403365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 455 counts during 434 steps 2024-12-18T00:21:04.5403369Z 2024-12-18T00:21:04.5403738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5403856Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5404144Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5404267Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5404467Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5404620Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5404762Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5404939Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5405288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5405638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5405958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5406233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5406579Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5406867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5407162Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5407286Z Execution Analysis: (:1) 2024-12-18T00:21:04.5407551Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5407754Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5407759Z 2024-12-18T00:21:04.5407958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5408081Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5408311Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5408432Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5408637Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5408794Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5408940Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5409106Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5409700Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5410295Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5410660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5411031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5411350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5411621Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5411931Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5412193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5412298Z Execution Analysis: .......... 2024-12-18T00:21:04.5412561Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5412766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5413054Z pt-xla-profiler: TransferFromDeviceTime too frequent: 456 counts during 435 steps 2024-12-18T00:21:04.5413059Z 2024-12-18T00:21:04.5413258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5413386Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5413672Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5413782Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5413991Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5414134Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5414284Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5414452Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5414810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5415152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5415639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5415919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5416282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5416635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5416935Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5417075Z Execution Analysis: (:1) 2024-12-18T00:21:04.5417336Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5417554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5417559Z 2024-12-18T00:21:04.5417762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5417882Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5418127Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5418241Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5418463Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5418608Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5418767Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5418938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5419532Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5420151Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5420512Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5420901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5421221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5421504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5421813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5422094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5422206Z Execution Analysis: .......... 2024-12-18T00:21:04.5422465Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5422681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5422971Z pt-xla-profiler: TransferFromDeviceTime too frequent: 457 counts during 436 steps 2024-12-18T00:21:04.5422976Z 2024-12-18T00:21:04.5423193Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5423314Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5423618Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5423731Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5423950Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5424097Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5424247Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5424426Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5424785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5425145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5425464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5425815Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5426126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5426394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5426696Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5426823Z Execution Analysis: (:1) 2024-12-18T00:21:04.5427093Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5427298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5427302Z 2024-12-18T00:21:04.5427516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5427634Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5427884Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5427996Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5428205Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5428368Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5428516Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5428695Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5429508Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5430050Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5430407Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5430737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5431037Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5431291Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5431586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5431836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5431947Z Execution Analysis: .......... 2024-12-18T00:21:04.5432184Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5432387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5432654Z pt-xla-profiler: TransferFromDeviceTime too frequent: 458 counts during 437 steps 2024-12-18T00:21:04.5432661Z 2024-12-18T00:21:04.5432852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5432969Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5433238Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5433352Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5433544Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5433691Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5433825Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5433981Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5434322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5434648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5435003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5435258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5435554Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5435802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5436075Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5436207Z Execution Analysis: (:1) 2024-12-18T00:21:04.5436446Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5436644Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5436650Z 2024-12-18T00:21:04.5436839Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5436961Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5437178Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5437293Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5437488Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5437629Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5437777Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5437961Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5438517Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5439074Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5439425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5439755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5440054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5440311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5440597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5440858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5440959Z Execution Analysis: .......... 2024-12-18T00:21:04.5441207Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5441396Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5446257Z pt-xla-profiler: TransferFromDeviceTime too frequent: 459 counts during 438 steps 2024-12-18T00:21:04.5446283Z 2024-12-18T00:21:04.5446553Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5446674Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5446977Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5447092Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5447314Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5447462Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5447605Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5447783Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5448151Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5448622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5448977Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5449261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5449572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5449847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5450140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5450266Z Execution Analysis: (:1) 2024-12-18T00:21:04.5450536Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5450745Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5450752Z 2024-12-18T00:21:04.5450967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5451084Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5451321Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5451433Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5451639Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5451789Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5451978Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5452155Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5452756Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5453381Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5453745Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5454104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5454416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5454694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5455012Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5455279Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5455391Z Execution Analysis: .......... 2024-12-18T00:21:04.5455654Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5455867Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5456157Z pt-xla-profiler: TransferFromDeviceTime too frequent: 460 counts during 439 steps 2024-12-18T00:21:04.5456162Z 2024-12-18T00:21:04.5456445Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5456564Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5456856Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5456978Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5457188Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5457338Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5457480Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5457659Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5458015Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5458423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5458747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5459023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5459335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5459606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5459900Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5460024Z Execution Analysis: (:1) 2024-12-18T00:21:04.5460284Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5460495Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5460502Z 2024-12-18T00:21:04.5460702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5460823Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5461053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5461172Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5461379Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5461556Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5461705Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5461873Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5462503Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5463083Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5463446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5463797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5464113Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5464389Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5464703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5464970Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5465078Z Execution Analysis: .......... 2024-12-18T00:21:04.5465346Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5465554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5465843Z pt-xla-profiler: TransferFromDeviceTime too frequent: 461 counts during 440 steps 2024-12-18T00:21:04.5465848Z 2024-12-18T00:21:04.5466055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5466173Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5466465Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5466576Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5466786Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5466931Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5467082Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5467250Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5467686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5468040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5468352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5468637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5469052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5469307Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5469580Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5469706Z Execution Analysis: (:1) 2024-12-18T00:21:04.5469948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5470148Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5470152Z 2024-12-18T00:21:04.5470341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5470448Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5470676Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5470808Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5471010Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5471145Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5471287Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5471442Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5472014Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5472560Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5472892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5473224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5473517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5473780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5474067Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5474324Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5474426Z Execution Analysis: .......... 2024-12-18T00:21:04.5474667Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5474862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5475123Z pt-xla-profiler: TransferFromDeviceTime too frequent: 462 counts during 441 steps 2024-12-18T00:21:04.5475127Z 2024-12-18T00:21:04.5475319Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5475424Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5475701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5475803Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5475990Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5476134Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5476293Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5476478Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5476990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5477334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5477641Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5477918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5478217Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5478477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5478769Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5478892Z Execution Analysis: (:1) 2024-12-18T00:21:04.5479148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5479346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5479350Z 2024-12-18T00:21:04.5479552Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5479663Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5479911Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5480024Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5480230Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5480375Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5480517Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5480707Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5481286Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5481842Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5482201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5482548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5482858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5483125Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5483439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5483703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5483811Z Execution Analysis: .......... 2024-12-18T00:21:04.5484061Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5484258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5484546Z pt-xla-profiler: TransferFromDeviceTime too frequent: 463 counts during 442 steps 2024-12-18T00:21:04.5484553Z 2024-12-18T00:21:04.5484751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5484868Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5485154Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5485265Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5485464Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5485637Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5485799Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5485965Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5486318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5486660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5486971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5487239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5487543Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5487806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5488089Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5488218Z Execution Analysis: (:1) 2024-12-18T00:21:04.5488471Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5488675Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5488680Z 2024-12-18T00:21:04.5488877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5489019Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5489243Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5489354Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5489558Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5489698Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5489872Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5490041Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5490628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5491189Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5491545Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5491889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5492193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5492469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5492773Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5493047Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5493154Z Execution Analysis: .......... 2024-12-18T00:21:04.5493411Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5493611Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5493897Z pt-xla-profiler: TransferFromDeviceTime too frequent: 465 counts during 443 steps 2024-12-18T00:21:04.5493902Z 2024-12-18T00:21:04.5494102Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5494216Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5494507Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5494619Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5494851Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5495100Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5495246Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5495412Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5495759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5496108Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5496486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5496761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5497231Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5497508Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5497807Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5497938Z Execution Analysis: (:1) 2024-12-18T00:21:04.5498206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5498412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5498416Z 2024-12-18T00:21:04.5498662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5498777Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5499015Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5499130Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5499378Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5499527Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5499679Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5499864Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5500456Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5501038Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5501400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5501761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5502075Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5502354Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5502665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5502934Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5503046Z Execution Analysis: .......... 2024-12-18T00:21:04.5503304Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5503512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5503796Z pt-xla-profiler: TransferFromDeviceTime too frequent: 466 counts during 444 steps 2024-12-18T00:21:04.5503801Z 2024-12-18T00:21:04.5504011Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5504125Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5504415Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5504561Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5504798Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5504947Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5505090Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5505263Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5505623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5505974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5506296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5506569Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5506883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5507158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5507456Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5507584Z Execution Analysis: (:1) 2024-12-18T00:21:04.5507847Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5508052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5508081Z 2024-12-18T00:21:04.5508284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5508406Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5508638Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5508782Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5509099Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5509248Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5509390Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5509551Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5510139Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5510696Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5511057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5511400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5511715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5511988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5512294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5512555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5512660Z Execution Analysis: .......... 2024-12-18T00:21:04.5512917Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5513119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5513402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 467 counts during 445 steps 2024-12-18T00:21:04.5513406Z 2024-12-18T00:21:04.5513606Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5513723Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5514054Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5514170Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5514371Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5514512Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5514658Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5514824Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5515183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5515529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5515843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5516113Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5516417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5516689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5516976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5517111Z Execution Analysis: (:1) 2024-12-18T00:21:04.5517364Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5517592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5517597Z 2024-12-18T00:21:04.5517795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5517904Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5518165Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5518278Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5518493Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5518635Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5518787Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5518953Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5519527Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5520096Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5520446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5520799Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5521108Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5521382Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5521684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5521949Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5522055Z Execution Analysis: .......... 2024-12-18T00:21:04.5522307Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5522515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5522791Z pt-xla-profiler: TransferFromDeviceTime too frequent: 468 counts during 446 steps 2024-12-18T00:21:04.5522796Z 2024-12-18T00:21:04.5523005Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5523145Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5523462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5523573Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5523781Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5523923Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5524063Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5524237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5524587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5524936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5525242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5525518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5525819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5526081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5526374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5526496Z Execution Analysis: (:1) 2024-12-18T00:21:04.5526778Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5526979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5526984Z 2024-12-18T00:21:04.5527186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5527325Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5527558Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5527670Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5527872Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5528024Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5528168Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5528341Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5528915Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5529481Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5529931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5530254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5530557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5530812Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5531111Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5531361Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5531468Z Execution Analysis: .......... 2024-12-18T00:21:04.5531707Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5531901Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5532165Z pt-xla-profiler: TransferFromDeviceTime too frequent: 469 counts during 447 steps 2024-12-18T00:21:04.5532194Z 2024-12-18T00:21:04.5532405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5532521Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5532792Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5532901Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5533092Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5533233Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5533371Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5533522Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5533862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5534362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5534676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5534946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5535261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5535524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5535810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5535983Z Execution Analysis: (:1) 2024-12-18T00:21:04.5536480Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5536700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5536705Z 2024-12-18T00:21:04.5536942Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5537073Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5537310Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5537434Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5537646Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5537792Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5537955Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5538126Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5538739Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5539316Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5539692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5540050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5540371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5540650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5540960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5541244Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5541355Z Execution Analysis: .......... 2024-12-18T00:21:04.5541628Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5541838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5542142Z pt-xla-profiler: TransferFromDeviceTime too frequent: 470 counts during 448 steps 2024-12-18T00:21:04.5542177Z 2024-12-18T00:21:04.5542436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5542558Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5542898Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5543040Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5543259Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5543431Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5543577Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5543749Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5544125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5544674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5545011Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5545296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5545619Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5545888Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5546264Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5546396Z Execution Analysis: (:1) 2024-12-18T00:21:04.5546674Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5546918Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5546924Z 2024-12-18T00:21:04.5547141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5547259Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5547496Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5547618Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5547827Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5547986Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5548139Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5548322Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5548919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5549500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5549883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5550239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5550566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5550841Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5551165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5551436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5551561Z Execution Analysis: .......... 2024-12-18T00:21:04.5551821Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5552030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5552400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 471 counts during 449 steps 2024-12-18T00:21:04.5552406Z 2024-12-18T00:21:04.5552614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5552741Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5553036Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5553162Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5553368Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5553514Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5553670Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5553839Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5554215Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5554576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5554899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5555170Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5555492Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5555792Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5556085Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5556223Z Execution Analysis: (:1) 2024-12-18T00:21:04.5556486Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5556731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5556738Z 2024-12-18T00:21:04.5556948Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5557075Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5557311Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5557424Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5557643Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5557792Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5557955Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5558125Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5558836Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5559400Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5559771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5560115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5560420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5560701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5561003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5561277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5561386Z Execution Analysis: .......... 2024-12-18T00:21:04.5561654Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5561911Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5562193Z pt-xla-profiler: TransferFromDeviceTime too frequent: 472 counts during 450 steps 2024-12-18T00:21:04.5562209Z 2024-12-18T00:21:04.5562407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5562523Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5562825Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5562941Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5563155Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5563306Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5563462Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5563628Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5563983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5564341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5564647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5564929Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5565233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5565538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5565825Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5565949Z Execution Analysis: (:1) 2024-12-18T00:21:04.5566245Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5566452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5566457Z 2024-12-18T00:21:04.5566668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5566784Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5567022Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5567132Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5567352Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5567493Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5567638Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5567814Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5568396Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5568971Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5569324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5569676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5569981Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5570251Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5570565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5570829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5570945Z Execution Analysis: .......... 2024-12-18T00:21:04.5571223Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5571470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5571753Z pt-xla-profiler: TransferFromDeviceTime too frequent: 473 counts during 451 steps 2024-12-18T00:21:04.5571758Z 2024-12-18T00:21:04.5571965Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5572079Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5572372Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5572495Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5572795Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5572942Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5573080Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5573249Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5573583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5573914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5574217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5574475Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5574806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5575057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5575345Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5575486Z Execution Analysis: (:1) 2024-12-18T00:21:04.5575733Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5575937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5575941Z 2024-12-18T00:21:04.5576130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5576245Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5576535Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5576655Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5577024Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5577184Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5577335Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5577507Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5578111Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5578691Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5579066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5579423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5579753Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5580030Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5580355Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5580628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5580772Z Execution Analysis: .......... 2024-12-18T00:21:04.5581074Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5581282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5581585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 474 counts during 452 steps 2024-12-18T00:21:04.5581590Z 2024-12-18T00:21:04.5581795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5581931Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5582228Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5582343Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5582564Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5582714Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5582876Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5583050Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5583422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5583777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5584091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5584418Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5584728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5585011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5585331Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5585474Z Execution Analysis: (:1) 2024-12-18T00:21:04.5585742Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5585966Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5585971Z 2024-12-18T00:21:04.5586178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5586296Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5586546Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5586662Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5586886Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5587035Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5587201Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5587374Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5587974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5588565Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5588929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5589385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5589677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5589945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5590235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5590526Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5590654Z Execution Analysis: .......... 2024-12-18T00:21:04.5590899Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5591101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5591371Z pt-xla-profiler: TransferFromDeviceTime too frequent: 475 counts during 453 steps 2024-12-18T00:21:04.5591379Z 2024-12-18T00:21:04.5591580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5591687Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5591973Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5592076Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5592277Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5592414Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5592548Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5592715Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5593049Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5593385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5593708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5593973Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5594259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5594533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5594821Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5594941Z Execution Analysis: (:1) 2024-12-18T00:21:04.5595193Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5595383Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5595388Z 2024-12-18T00:21:04.5595587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5595696Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5595925Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5596029Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5596226Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5596377Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5596518Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5596688Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5597238Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5597783Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5598122Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5598450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5598761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5599018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5599345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5599619Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5599730Z Execution Analysis: .......... 2024-12-18T00:21:04.5599969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5600159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5600442Z pt-xla-profiler: TransferFromDeviceTime too frequent: 476 counts during 454 steps 2024-12-18T00:21:04.5600446Z 2024-12-18T00:21:04.5600635Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5600756Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5601031Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5601150Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5601347Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5601493Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5601628Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5601786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5602132Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5602456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5602786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5603041Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5603367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5603618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5603898Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5604027Z Execution Analysis: (:1) 2024-12-18T00:21:04.5604270Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5604475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5604481Z 2024-12-18T00:21:04.5604670Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5604791Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5605005Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5605120Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5605315Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5605453Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5605607Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5605768Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5606331Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5606864Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5607213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5607541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5607831Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5608096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5608451Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5608714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5608815Z Execution Analysis: .......... 2024-12-18T00:21:04.5609068Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5609257Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5609532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 477 counts during 455 steps 2024-12-18T00:21:04.5609537Z 2024-12-18T00:21:04.5609726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5609838Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5610121Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5610231Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5610432Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5610568Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5610715Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5610872Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5611206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5611572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5611863Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5612129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5612444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5612708Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5612984Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5613112Z Execution Analysis: (:1) 2024-12-18T00:21:04.5613354Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5613548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5613554Z 2024-12-18T00:21:04.5613752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5613859Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5614086Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5614195Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5614402Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5614540Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5614679Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5614848Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5615398Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5615943Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5616279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5616693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5617171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5617527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5617838Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5618108Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5618229Z Execution Analysis: .......... 2024-12-18T00:21:04.5618490Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5618711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5619002Z pt-xla-profiler: TransferFromDeviceTime too frequent: 478 counts during 456 steps 2024-12-18T00:21:04.5619007Z 2024-12-18T00:21:04.5619227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5619346Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5619645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5619769Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5619977Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5620138Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5620284Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5620462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5620852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5621208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5621533Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5621832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5622158Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5622429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5622734Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5622861Z Execution Analysis: (:1) 2024-12-18T00:21:04.5623132Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5623340Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5623344Z 2024-12-18T00:21:04.5623549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5623688Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5623923Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5624053Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5624268Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5624430Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5624581Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5624755Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5625361Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5625941Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5626322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5626682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5627069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5627348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5627675Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5627948Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5628060Z Execution Analysis: .......... 2024-12-18T00:21:04.5628344Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5628552Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5628858Z pt-xla-profiler: TransferFromDeviceTime too frequent: 479 counts during 457 steps 2024-12-18T00:21:04.5628865Z 2024-12-18T00:21:04.5629178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5629311Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5629601Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5629727Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5629932Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5630077Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5630407Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5630615Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5630993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5631355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5631714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5631996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5632307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5632698Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5632989Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5633130Z Execution Analysis: (:1) 2024-12-18T00:21:04.5633388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5633605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5633609Z 2024-12-18T00:21:04.5633812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5633944Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5634178Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5634291Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5634515Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5634661Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5634826Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5634989Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5635586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5636145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5636499Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5636910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5637216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5637496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5637798Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5638072Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5638180Z Execution Analysis: .......... 2024-12-18T00:21:04.5638448Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5638648Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5638929Z pt-xla-profiler: TransferFromDeviceTime too frequent: 480 counts during 458 steps 2024-12-18T00:21:04.5638935Z 2024-12-18T00:21:04.5639148Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5639266Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5639563Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5639674Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5639886Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5640058Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5640199Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5640379Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5640730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5641134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5641444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5641733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5642141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5642392Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5642678Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5642800Z Execution Analysis: (:1) 2024-12-18T00:21:04.5643060Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5643253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5643257Z 2024-12-18T00:21:04.5643460Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5643568Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5643796Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5643900Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5644094Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5644370Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5644677Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5644865Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5645461Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5646055Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5646419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5646943Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5647276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5647555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5647883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5648162Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5648288Z Execution Analysis: .......... 2024-12-18T00:21:04.5648552Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5648778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5649068Z pt-xla-profiler: TransferFromDeviceTime too frequent: 481 counts during 459 steps 2024-12-18T00:21:04.5649076Z 2024-12-18T00:21:04.5649280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5649411Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5649705Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5649832Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5650079Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5650240Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5650386Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5650556Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5650964Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5651319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5651653Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5651930Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5652252Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5652521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5652830Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5652959Z Execution Analysis: (:1) 2024-12-18T00:21:04.5653219Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5653440Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5653447Z 2024-12-18T00:21:04.5653653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5653783Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5654016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5654142Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5654352Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5654499Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5654661Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5654833Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5655440Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5656018Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5656513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5656871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5657202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5657477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5657790Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5658075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5658185Z Execution Analysis: .......... 2024-12-18T00:21:04.5658462Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5658669Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5658971Z pt-xla-profiler: TransferFromDeviceTime too frequent: 482 counts during 460 steps 2024-12-18T00:21:04.5658976Z 2024-12-18T00:21:04.5659182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5659311Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5659605Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5659749Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5659967Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5660115Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5660271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5660443Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5660830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5661203Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5661518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5661805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5662115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5662398Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5662694Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5662833Z Execution Analysis: (:1) 2024-12-18T00:21:04.5663097Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5663304Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5663323Z 2024-12-18T00:21:04.5663530Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5663650Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5663897Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5664012Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5664242Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5664393Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5664544Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5664727Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5665324Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5665973Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5666336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5666705Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5667018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5667307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5667623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5667897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5668018Z Execution Analysis: .......... 2024-12-18T00:21:04.5668280Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5668503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5668790Z pt-xla-profiler: TransferFromDeviceTime too frequent: 483 counts during 461 steps 2024-12-18T00:21:04.5668795Z 2024-12-18T00:21:04.5669113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5669223Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5669537Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5669644Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5669837Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5669987Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5670123Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5670333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5670671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5671014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5671308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5671564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5671869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5672123Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5672412Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5672534Z Execution Analysis: (:1) 2024-12-18T00:21:04.5672797Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5672993Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5672997Z 2024-12-18T00:21:04.5673203Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5673313Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5673532Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5673655Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5673853Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5674003Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5674145Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5674322Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5674875Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5675467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5675817Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5676148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5676457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5676715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5677018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5677270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5677389Z Execution Analysis: .......... 2024-12-18T00:21:04.5677636Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5677828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5678109Z pt-xla-profiler: TransferFromDeviceTime too frequent: 484 counts during 462 steps 2024-12-18T00:21:04.5678114Z 2024-12-18T00:21:04.5678305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5678475Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5678751Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5678873Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5679067Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5679229Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5679381Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5679541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5679889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5680214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5680523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5680781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5681068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5681329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5681604Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5681740Z Execution Analysis: (:1) 2024-12-18T00:21:04.5681994Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5682201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5682205Z 2024-12-18T00:21:04.5682393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5682514Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5682731Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5682836Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5683045Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5683180Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5683332Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5683491Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5684104Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5684645Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5684981Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5685319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5685611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5685879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5686168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5686432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5686534Z Execution Analysis: .......... 2024-12-18T00:21:04.5686789Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5686980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5687248Z pt-xla-profiler: TransferFromDeviceTime too frequent: 486 counts during 463 steps 2024-12-18T00:21:04.5687265Z 2024-12-18T00:21:04.5687480Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5687591Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5687880Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5687985Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5688212Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5688349Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5688489Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5688659Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5688993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5689330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5689622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5689894Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5690181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5690442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5690717Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5690837Z Execution Analysis: (:1) 2024-12-18T00:21:04.5691093Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5691284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5691289Z 2024-12-18T00:21:04.5691492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5691602Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5691834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5691939Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5692134Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5692283Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5692425Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5692628Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5693203Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5693751Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5694087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5694430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5694722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5694980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5695283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5695538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5695652Z Execution Analysis: .......... 2024-12-18T00:21:04.5695892Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5696096Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5696436Z pt-xla-profiler: TransferFromDeviceTime too frequent: 487 counts during 464 steps 2024-12-18T00:21:04.5696470Z 2024-12-18T00:21:04.5696676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5696951Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5697248Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5697407Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5697617Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5697782Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5697932Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5698114Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5698478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5698832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5699159Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5699434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5699755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5700025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5700332Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5700459Z Execution Analysis: (:1) 2024-12-18T00:21:04.5700718Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5700936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5700940Z 2024-12-18T00:21:04.5701144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5701274Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5701505Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5701630Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5701839Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5701990Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5702176Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5702370Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5702974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5703549Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5703924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5704277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5704604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5704882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5705196Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5705476Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5705586Z Execution Analysis: .......... 2024-12-18T00:21:04.5705858Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5706063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5706392Z pt-xla-profiler: TransferFromDeviceTime too frequent: 488 counts during 465 steps 2024-12-18T00:21:04.5706397Z 2024-12-18T00:21:04.5706601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5706729Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5707048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5707165Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5707389Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5707536Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5707693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5707862Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5708236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5708595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5708911Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5709297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5709585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5709852Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5710126Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5710258Z Execution Analysis: (:1) 2024-12-18T00:21:04.5710500Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5710690Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5710709Z 2024-12-18T00:21:04.5710899Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5711006Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5711234Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5711338Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5711545Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5711710Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5711894Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5712052Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5712602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5713146Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5713482Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5713824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5714116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5714390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5714680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5714944Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5715047Z Execution Analysis: .......... 2024-12-18T00:21:04.5715291Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5715527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5715795Z pt-xla-profiler: TransferFromDeviceTime too frequent: 489 counts during 466 steps 2024-12-18T00:21:04.5715800Z 2024-12-18T00:21:04.5716007Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5716141Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5716433Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5716543Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5716736Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5716886Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5717023Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5717196Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5717702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5718067Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5718375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5718647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5718966Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5719234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5719538Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5719663Z Execution Analysis: (:1) 2024-12-18T00:21:04.5719932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5720135Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5720139Z 2024-12-18T00:21:04.5720360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5720476Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5720706Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5720831Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5721063Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5721244Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5721395Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5721576Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5722161Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5722727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5723099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5723454Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5723779Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5724056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5724377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5724640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5724762Z Execution Analysis: .......... 2024-12-18T00:21:04.5725018Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5725253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5725548Z pt-xla-profiler: TransferFromDeviceTime too frequent: 490 counts during 467 steps 2024-12-18T00:21:04.5725553Z 2024-12-18T00:21:04.5725778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5725909Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5726199Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5726327Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5726529Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5726673Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5726826Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5726992Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5727357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5727703Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5728020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5728289Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5728606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5728870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5729160Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5729299Z Execution Analysis: (:1) 2024-12-18T00:21:04.5729551Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5729763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5729768Z 2024-12-18T00:21:04.5729965Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5730093Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5730323Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5730464Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5730710Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5730856Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5731017Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5731184Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5731778Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5732341Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5732704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5733051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5733361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5733642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5734041Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5734303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5734429Z Execution Analysis: .......... 2024-12-18T00:21:04.5734681Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5734872Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5735164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 491 counts during 468 steps 2024-12-18T00:21:04.5735183Z 2024-12-18T00:21:04.5735375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5735486Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5735770Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5735877Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5736080Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5736217Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5736457Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5736619Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5737133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5737504Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5737822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5738118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5738433Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5738718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5739015Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5739148Z Execution Analysis: (:1) 2024-12-18T00:21:04.5739426Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5739634Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5739639Z 2024-12-18T00:21:04.5739862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5740014Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5740290Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5740405Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5740628Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5740774Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5740923Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5741106Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5741703Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5742289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5742654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5743024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5743338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5743615Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5743937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5744387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5744511Z Execution Analysis: .......... 2024-12-18T00:21:04.5744772Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5744992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5745349Z pt-xla-profiler: TransferFromDeviceTime too frequent: 492 counts during 469 steps 2024-12-18T00:21:04.5745356Z 2024-12-18T00:21:04.5745577Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5745695Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5745990Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5746117Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5746325Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5746488Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5746633Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5746818Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5747179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5747532Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5747861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5748135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5748459Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5748728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5749037Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5749167Z Execution Analysis: (:1) 2024-12-18T00:21:04.5749430Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5749647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5749653Z 2024-12-18T00:21:04.5749857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5750073Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5750307Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5750435Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5750642Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5750800Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5750951Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5751124Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5751731Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5752309Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5752688Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5753046Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5753373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5753648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5753971Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5754287Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5754397Z Execution Analysis: .......... 2024-12-18T00:21:04.5754672Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5754903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5755214Z pt-xla-profiler: TransferFromDeviceTime too frequent: 493 counts during 470 steps 2024-12-18T00:21:04.5755219Z 2024-12-18T00:21:04.5755425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5755557Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5755853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5756074Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5756396Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5756532Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5756679Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5756834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5757183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5757511Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5757804Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5758073Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5758358Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5758620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5758897Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5759027Z Execution Analysis: (:1) 2024-12-18T00:21:04.5759270Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5759474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5759505Z 2024-12-18T00:21:04.5759723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5759832Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5760060Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5760167Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5760375Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5760514Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5760671Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5760829Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5761380Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5761932Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5762271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5762615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5762910Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5763181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5763495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5763763Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5763867Z Execution Analysis: .......... 2024-12-18T00:21:04.5764131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5764344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5764615Z pt-xla-profiler: TransferFromDeviceTime too frequent: 494 counts during 471 steps 2024-12-18T00:21:04.5764619Z 2024-12-18T00:21:04.5764831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5764942Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5765232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5765341Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5765548Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5765687Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5765824Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5765998Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5766331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5766678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5766969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5767236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5767527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5767781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5768069Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5768188Z Execution Analysis: (:1) 2024-12-18T00:21:04.5768446Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5768665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5768693Z 2024-12-18T00:21:04.5768900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5769009Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5769240Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5769348Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5769543Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5769693Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5769834Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5770004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5770551Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5771101Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5771436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5771765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5772069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5772349Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5772650Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5772902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5773045Z Execution Analysis: .......... 2024-12-18T00:21:04.5773287Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5773481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5773759Z pt-xla-profiler: TransferFromDeviceTime too frequent: 495 counts during 472 steps 2024-12-18T00:21:04.5773764Z 2024-12-18T00:21:04.5773951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5774071Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5774347Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5774464Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5774654Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5774805Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5774944Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5775102Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5775458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5775783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5776087Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5776402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5776716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5777147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5777442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5777585Z Execution Analysis: (:1) 2024-12-18T00:21:04.5777846Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5778121Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5778126Z 2024-12-18T00:21:04.5778332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5778462Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5778696Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5778826Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5779037Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5779182Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5779341Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5779509Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5780117Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5780700Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5781075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5781428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5781772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5782059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5782375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5782697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5782812Z Execution Analysis: .......... 2024-12-18T00:21:04.5783088Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5783294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5783595Z pt-xla-profiler: TransferFromDeviceTime too frequent: 496 counts during 473 steps 2024-12-18T00:21:04.5783600Z 2024-12-18T00:21:04.5783804Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5783925Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5784234Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5784348Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5784572Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5784721Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5784882Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5785054Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5785413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5785779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5786094Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5786384Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5786694Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5786974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5787269Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5787442Z Execution Analysis: (:1) 2024-12-18T00:21:04.5787725Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5787931Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5787935Z 2024-12-18T00:21:04.5788151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5788268Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5788515Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5788630Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5788850Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5789103Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5789241Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5789413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5789967Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5790513Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5790847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5791213Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5791503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5791771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5792162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5792416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5792535Z Execution Analysis: .......... 2024-12-18T00:21:04.5792777Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5792980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5793245Z pt-xla-profiler: TransferFromDeviceTime too frequent: 497 counts during 474 steps 2024-12-18T00:21:04.5793251Z 2024-12-18T00:21:04.5793455Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5793564Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5793835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5793957Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5794151Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5794301Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5794438Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5794610Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5794946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5795276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5795578Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5795836Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5796135Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5796390Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5796674Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5796840Z Execution Analysis: (:1) 2024-12-18T00:21:04.5797097Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5797291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5797295Z 2024-12-18T00:21:04.5797486Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5797609Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5797990Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5798113Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5798319Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5798480Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5798632Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5798799Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5799393Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5800114Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5800510Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5800899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5801237Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5801578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5801926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5802209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5802330Z Execution Analysis: .......... 2024-12-18T00:21:04.5802598Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5802820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5803110Z pt-xla-profiler: TransferFromDeviceTime too frequent: 498 counts during 475 steps 2024-12-18T00:21:04.5803115Z 2024-12-18T00:21:04.5803321Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5803454Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5803748Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5803884Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5804102Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5804263Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5804410Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5804583Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5804957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5805311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5805647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5805925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5806258Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5806537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5806927Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5807059Z Execution Analysis: (:1) 2024-12-18T00:21:04.5807325Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5807550Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5807555Z 2024-12-18T00:21:04.5807762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5807897Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5808133Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5808266Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5808482Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5808632Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5808803Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5808975Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5809589Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5810168Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5810580Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5810939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5811269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5811579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5811904Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5812191Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5812304Z Execution Analysis: .......... 2024-12-18T00:21:04.5812579Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5812793Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5813096Z pt-xla-profiler: TransferFromDeviceTime too frequent: 499 counts during 476 steps 2024-12-18T00:21:04.5813101Z 2024-12-18T00:21:04.5813307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5813435Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5813731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5813846Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5814069Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5814218Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5814382Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5814552Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5814914Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5815293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5815615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5815906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5816224Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5816671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5816979Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5817125Z Execution Analysis: (:1) 2024-12-18T00:21:04.5817386Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5817593Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5817613Z 2024-12-18T00:21:04.5817818Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5817932Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5818176Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5818289Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5818515Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5818665Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5818815Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5818998Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5819595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5820188Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5820602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5820967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5821664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5821958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5822269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5822544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5822669Z Execution Analysis: .......... 2024-12-18T00:21:04.5822930Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5823152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5823440Z pt-xla-profiler: TransferFromDeviceTime too frequent: 500 counts during 477 steps 2024-12-18T00:21:04.5823445Z 2024-12-18T00:21:04.5823666Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5823786Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5824097Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5824212Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5824419Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5824580Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5824726Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5824911Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5825274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5825643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5825958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5826236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5826587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5826884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5827196Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5827326Z Execution Analysis: (:1) 2024-12-18T00:21:04.5827602Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5827836Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5827841Z 2024-12-18T00:21:04.5828065Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5828181Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5828420Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5828547Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5828759Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5828920Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5829176Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5829351Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5829928Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5830695Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5831070Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5831448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5831782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5832058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5832379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5832649Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5832771Z Execution Analysis: .......... 2024-12-18T00:21:04.5833035Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5833241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5833540Z pt-xla-profiler: TransferFromDeviceTime too frequent: 501 counts during 478 steps 2024-12-18T00:21:04.5833545Z 2024-12-18T00:21:04.5833753Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5833887Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5834183Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5834309Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5834516Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5834662Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5834819Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5834991Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5835364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5835716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5836044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5836345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5836680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5836963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5837255Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5837393Z Execution Analysis: (:1) 2024-12-18T00:21:04.5837656Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5837874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5837878Z 2024-12-18T00:21:04.5838084Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5838213Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5838447Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5838561Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5838783Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5838935Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5839097Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5839267Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5839875Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5840478Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5840881Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5841236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5841555Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5841854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5842165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5842450Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5842564Z Execution Analysis: .......... 2024-12-18T00:21:04.5842840Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5843047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5843337Z pt-xla-profiler: TransferFromDeviceTime too frequent: 502 counts during 479 steps 2024-12-18T00:21:04.5843356Z 2024-12-18T00:21:04.5843563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5843680Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5843990Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5844104Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5844483Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5844630Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5844777Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5850256Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5850693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5851090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5851408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5851851Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5852167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5852442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5852745Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5852879Z Execution Analysis: (:1) 2024-12-18T00:21:04.5853160Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5853370Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5853376Z 2024-12-18T00:21:04.5853591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5853711Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5853962Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5854078Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5854292Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5854454Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5854604Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5854782Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5855427Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5856019Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5856514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5856881Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5857207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5857532Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5857853Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5858127Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5858247Z Execution Analysis: .......... 2024-12-18T00:21:04.5858511Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5858731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5859020Z pt-xla-profiler: TransferFromDeviceTime too frequent: 503 counts during 480 steps 2024-12-18T00:21:04.5859027Z 2024-12-18T00:21:04.5859237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5859362Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5859658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5859778Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5859986Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5860140Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5860287Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5860459Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5860826Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5861179Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5861577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5861854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5862174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5862442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5862733Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5862866Z Execution Analysis: (:1) 2024-12-18T00:21:04.5863126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5863339Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5863345Z 2024-12-18T00:21:04.5863549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5863676Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5863908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5864027Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5864240Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5864382Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5864566Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5864738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5865343Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5865945Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5866319Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5866671Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5866994Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5867269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5867582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5867856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5867965Z Execution Analysis: .......... 2024-12-18T00:21:04.5868236Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5868445Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5868740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 504 counts during 481 steps 2024-12-18T00:21:04.5868746Z 2024-12-18T00:21:04.5868952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5869065Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5869371Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5869481Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5869701Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5869848Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5870000Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5870169Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5870524Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5870941Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5871253Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5871537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5871842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5872123Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5872417Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5872555Z Execution Analysis: (:1) 2024-12-18T00:21:04.5872814Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5873020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5873027Z 2024-12-18T00:21:04.5873244Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5873357Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5873599Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5873709Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5873925Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5874098Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5874248Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5874427Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5875023Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5875632Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5875996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5876361Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5876671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5876957Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5877267Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5877530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5877649Z Execution Analysis: .......... 2024-12-18T00:21:04.5877905Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5878125Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5878412Z pt-xla-profiler: TransferFromDeviceTime too frequent: 505 counts during 482 steps 2024-12-18T00:21:04.5878418Z 2024-12-18T00:21:04.5878631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5878746Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5879047Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5879160Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5879361Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5879520Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5879660Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5879840Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5880224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5880609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5880924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5881304Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5881612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5881870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5882163Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5882286Z Execution Analysis: (:1) 2024-12-18T00:21:04.5882553Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5882758Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5882763Z 2024-12-18T00:21:04.5882971Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5883084Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5883307Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5883425Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5883651Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5883804Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5884112Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5884279Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5884910Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5885488Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5885862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5886211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5886535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5886812Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5887130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5887398Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5887505Z Execution Analysis: .......... 2024-12-18T00:21:04.5887778Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5887983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5888280Z pt-xla-profiler: TransferFromDeviceTime too frequent: 507 counts during 483 steps 2024-12-18T00:21:04.5888286Z 2024-12-18T00:21:04.5888486Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5888614Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5888905Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5889027Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5889234Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5889378Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5889535Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5889726Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5890121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5890474Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5890794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5891067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5891376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5891655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5891948Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5892092Z Execution Analysis: (:1) 2024-12-18T00:21:04.5892350Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5892566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5892571Z 2024-12-18T00:21:04.5892775Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5892898Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5893130Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5893265Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5893483Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5893627Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5893786Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5893978Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5894586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5895164Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5895523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5895887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5896199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5896560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5896870Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5897159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5897270Z Execution Analysis: .......... 2024-12-18T00:21:04.5897542Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5897749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5898033Z pt-xla-profiler: TransferFromDeviceTime too frequent: 508 counts during 484 steps 2024-12-18T00:21:04.5898038Z 2024-12-18T00:21:04.5898255Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5898372Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5898679Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5898790Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5899006Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5899153Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5899337Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5899547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5899905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5900267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5900577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5900864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5901171Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5901451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5901747Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5901875Z Execution Analysis: (:1) 2024-12-18T00:21:04.5902151Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5902351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5902356Z 2024-12-18T00:21:04.5902572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5902689Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5902957Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5903072Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5903279Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5903438Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5903609Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5903794Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5904389Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5904971Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5905336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5905700Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5906015Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5906284Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5906612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5906881Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5907001Z Execution Analysis: .......... 2024-12-18T00:21:04.5907261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5907474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5907761Z pt-xla-profiler: TransferFromDeviceTime too frequent: 509 counts during 485 steps 2024-12-18T00:21:04.5907768Z 2024-12-18T00:21:04.5907978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5908092Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5908381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5908503Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5908707Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5908888Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5909059Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5909226Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5909595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5909942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5910268Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5910540Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5910864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5911134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5911437Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5911566Z Execution Analysis: (:1) 2024-12-18T00:21:04.5911823Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5912036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5912041Z 2024-12-18T00:21:04.5912239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5912391Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5912621Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5912744Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5912954Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5913120Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5913279Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5913447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5914050Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5914623Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5914995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5915345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5915669Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5915945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5916254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5916537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5916643Z Execution Analysis: .......... 2024-12-18T00:21:04.5916911Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5917114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5917410Z pt-xla-profiler: TransferFromDeviceTime too frequent: 510 counts during 486 steps 2024-12-18T00:21:04.5917415Z 2024-12-18T00:21:04.5917620Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5917744Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5918043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5918179Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5918424Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5918569Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5918724Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5918892Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5919261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5919613Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5919926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5920213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5920523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5920805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5921099Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5921238Z Execution Analysis: (:1) 2024-12-18T00:21:04.5921499Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5921703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5921745Z 2024-12-18T00:21:04.5921951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5922065Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5922308Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5922419Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5922663Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5922812Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5922960Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5923141Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5923730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5924314Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5924673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5925039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5925350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5925637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5925950Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5926229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5926336Z Execution Analysis: .......... 2024-12-18T00:21:04.5926592Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5926811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5927096Z pt-xla-profiler: TransferFromDeviceTime too frequent: 511 counts during 487 steps 2024-12-18T00:21:04.5927100Z 2024-12-18T00:21:04.5927318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5927435Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5927738Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5927901Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5928103Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5928262Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5928405Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5928586Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5928942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5929309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5929620Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5929889Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5930211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5930480Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5930781Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5930903Z Execution Analysis: (:1) 2024-12-18T00:21:04.5931178Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5931379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5931410Z 2024-12-18T00:21:04.5931620Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5931736Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5931962Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5932125Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5932334Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5932495Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5932642Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5932821Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5933417Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5933993Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5934367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5934713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5935040Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5935315Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5935636Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5935906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5936022Z Execution Analysis: .......... 2024-12-18T00:21:04.5936283Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5936565Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5936865Z pt-xla-profiler: TransferFromDeviceTime too frequent: 512 counts during 488 steps 2024-12-18T00:21:04.5936870Z 2024-12-18T00:21:04.5937074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5937233Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5937550Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5937674Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5937880Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5938022Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5938177Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5938345Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5938711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5939063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5939386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5939656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5939980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5940246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5940539Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5940674Z Execution Analysis: (:1) 2024-12-18T00:21:04.5940930Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5941173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5941178Z 2024-12-18T00:21:04.5941381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5941521Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5941780Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5941897Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5942125Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5942274Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5942437Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5942609Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5943214Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5943795Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5944350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5944708Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5945028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5945318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5945633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5945918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5946030Z Execution Analysis: .......... 2024-12-18T00:21:04.5946307Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5946515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5946806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 513 counts during 489 steps 2024-12-18T00:21:04.5946827Z 2024-12-18T00:21:04.5947033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5947243Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5947553Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5947669Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5947892Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5948041Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5948200Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5948373Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5948735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5949098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5949411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5949703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5950014Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5950299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5950591Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5950720Z Execution Analysis: (:1) 2024-12-18T00:21:04.5951103Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5951308Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5951313Z 2024-12-18T00:21:04.5951566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5951686Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5951933Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5952047Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5952257Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5952414Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5952563Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5952743Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5953340Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5953926Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5954288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5954654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5954967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5955241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5955565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5955834Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5955955Z Execution Analysis: .......... 2024-12-18T00:21:04.5956214Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5956435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5956725Z pt-xla-profiler: TransferFromDeviceTime too frequent: 514 counts during 490 steps 2024-12-18T00:21:04.5956755Z 2024-12-18T00:21:04.5956998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5957119Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5957411Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5957537Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5957744Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5957906Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5958051Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5958235Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5958597Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5958953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5959277Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5959556Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5959879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5960148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5960451Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5960714Z Execution Analysis: (:1) 2024-12-18T00:21:04.5960969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5961181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5961186Z 2024-12-18T00:21:04.5961409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5961539Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5961769Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5961889Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5962093Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5962247Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5962392Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5962560Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5963150Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5963714Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5964080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5964430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5964750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5965020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5965336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5965603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5965710Z Execution Analysis: .......... 2024-12-18T00:21:04.5965977Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5966181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5966528Z pt-xla-profiler: TransferFromDeviceTime too frequent: 515 counts during 491 steps 2024-12-18T00:21:04.5966561Z 2024-12-18T00:21:04.5966763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5966889Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5967175Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5967287Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5967504Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5967646Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5967802Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5967968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5968333Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5968677Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5968988Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5969272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5969575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5969847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5970173Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5970309Z Execution Analysis: (:1) 2024-12-18T00:21:04.5970562Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5970959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5970967Z 2024-12-18T00:21:04.5971173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5971288Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5971534Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5971648Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5971869Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5972014Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5972177Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5972347Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5972941Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5973526Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5973889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5974253Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5974565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5974852Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5975164Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5975442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5975551Z Execution Analysis: .......... 2024-12-18T00:21:04.5975813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5976026Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5976443Z pt-xla-profiler: TransferFromDeviceTime too frequent: 516 counts during 492 steps 2024-12-18T00:21:04.5976450Z 2024-12-18T00:21:04.5976669Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5976786Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5977091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5977206Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5977412Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5977573Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5977717Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5977896Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5978258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5978624Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5978937Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5979224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5979535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5979833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5980138Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5980267Z Execution Analysis: (:1) 2024-12-18T00:21:04.5980565Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5980774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5980781Z 2024-12-18T00:21:04.5981000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5981116Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5981351Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5981476Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5981687Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5981849Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5982000Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5982183Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5982780Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5983370Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5983736Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5984091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5984416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5984691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5985011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5985282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5985403Z Execution Analysis: .......... 2024-12-18T00:21:04.5985667Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5985924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5986228Z pt-xla-profiler: TransferFromDeviceTime too frequent: 517 counts during 493 steps 2024-12-18T00:21:04.5986232Z 2024-12-18T00:21:04.5986438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5986569Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5986870Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5986997Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5987205Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5987364Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5987512Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5987686Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5988063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5988418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5988750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5989025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5989376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5989649Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5989943Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5990086Z Execution Analysis: (:1) 2024-12-18T00:21:04.5990374Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5990597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5990601Z 2024-12-18T00:21:04.5990806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5990935Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5991170Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.5991294Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5991507Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.5991654Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.5991817Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.5991989Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5992596Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.5993176Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.5993549Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.5994006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5994313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5994594Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5994897Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5995175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5995281Z Execution Analysis: .......... 2024-12-18T00:21:04.5995595Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.5995800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5996094Z pt-xla-profiler: TransferFromDeviceTime too frequent: 518 counts during 494 steps 2024-12-18T00:21:04.5996099Z 2024-12-18T00:21:04.5996300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.5996416Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.5996716Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.5996829Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.5997045Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.5997189Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.5997342Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.5997511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.5997863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.5998217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.5998521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.5998803Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.5999128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.5999399Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.5999686Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.5999833Z Execution Analysis: (:1) 2024-12-18T00:21:04.6000101Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6000301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6000305Z 2024-12-18T00:21:04.6000515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6000629Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6000865Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6000977Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6001191Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6001332Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6001477Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6001656Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6002237Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6002808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6003159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6003514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6003824Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6004105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6004408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6004672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6004819Z Execution Analysis: .......... 2024-12-18T00:21:04.6005113Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6005325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6005609Z pt-xla-profiler: TransferFromDeviceTime too frequent: 519 counts during 495 steps 2024-12-18T00:21:04.6005614Z 2024-12-18T00:21:04.6005830Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6005944Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6006230Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6006352Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6006555Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6006710Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6006855Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6007032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6007382Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6007727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6008046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6008342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6008657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6008919Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6009242Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6009372Z Execution Analysis: (:1) 2024-12-18T00:21:04.6009638Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6009840Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6009845Z 2024-12-18T00:21:04.6010044Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6010170Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6010396Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6010520Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6010725Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6010882Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6011031Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6011199Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6011793Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6012358Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6012718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6013066Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6013385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6013654Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6013969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6014284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6014392Z Execution Analysis: .......... 2024-12-18T00:21:04.6014657Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6014857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6015145Z pt-xla-profiler: TransferFromDeviceTime too frequent: 520 counts during 496 steps 2024-12-18T00:21:04.6015152Z 2024-12-18T00:21:04.6015352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6015479Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6015765Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6015890Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6016092Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6016239Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6016461Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6016632Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6017164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6017516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6017883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6018158Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6018468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6018777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6019077Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6019215Z Execution Analysis: (:1) 2024-12-18T00:21:04.6019480Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6019698Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6019702Z 2024-12-18T00:21:04.6019906Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6020036Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6020267Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6020379Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6020602Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6020750Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6020912Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6021081Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6021676Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6022262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6022624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6022989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6023303Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6023592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6023959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6024247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6024355Z Execution Analysis: .......... 2024-12-18T00:21:04.6024616Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6024832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6025120Z pt-xla-profiler: TransferFromDeviceTime too frequent: 521 counts during 497 steps 2024-12-18T00:21:04.6025125Z 2024-12-18T00:21:04.6025342Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6025458Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6025763Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6025878Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6026097Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6026243Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6026388Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6026572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6026936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6027331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6027643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6027935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6028272Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6028546Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6028854Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6029092Z Execution Analysis: (:1) 2024-12-18T00:21:04.6029359Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6029560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6029566Z 2024-12-18T00:21:04.6029777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6029889Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6030128Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6030237Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6030445Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6030611Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6030758Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6030938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6031517Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6032091Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6032449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6032794Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6033116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6033412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6033755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6034019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6034142Z Execution Analysis: .......... 2024-12-18T00:21:04.6034397Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6034619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6034901Z pt-xla-profiler: TransferFromDeviceTime too frequent: 522 counts during 498 steps 2024-12-18T00:21:04.6034906Z 2024-12-18T00:21:04.6035108Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6035242Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6035531Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6035663Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6035866Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6036027Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6036170Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6036339Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6036710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6037082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6037404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6037698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6038016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6038283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6038572Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6038713Z Execution Analysis: (:1) 2024-12-18T00:21:04.6038968Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6039189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6039194Z 2024-12-18T00:21:04.6039395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6039523Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6039754Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6039880Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6040088Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6040234Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6040402Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6040570Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6041161Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6041725Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6042090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6042435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6042754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6043094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6043396Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6043672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6043777Z Execution Analysis: .......... 2024-12-18T00:21:04.6044044Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6044385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6044848Z pt-xla-profiler: TransferFromDeviceTime too frequent: 523 counts during 499 steps 2024-12-18T00:21:04.6044853Z 2024-12-18T00:21:04.6045061Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6045192Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6045501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6045616Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6045835Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6045981Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6046137Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6046367Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6046728Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6047094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6047446Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6047741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6048056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6048339Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6048633Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6048773Z Execution Analysis: (:1) 2024-12-18T00:21:04.6049034Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6049243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6049247Z 2024-12-18T00:21:04.6049467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6049585Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6049830Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6049943Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6050168Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6050315Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6050464Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6050646Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6051242Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6051833Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6052195Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6052563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6052950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6053240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6053550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6053821Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6053944Z Execution Analysis: .......... 2024-12-18T00:21:04.6054205Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6054424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6054716Z pt-xla-profiler: TransferFromDeviceTime too frequent: 524 counts during 500 steps 2024-12-18T00:21:04.6054721Z 2024-12-18T00:21:04.6054939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6055058Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6055365Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6055479Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6055687Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6055847Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6056020Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6056205Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6056647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6057023Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6057367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6057649Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6057975Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6058246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6058555Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6058685Z Execution Analysis: (:1) 2024-12-18T00:21:04.6058963Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6059173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6059178Z 2024-12-18T00:21:04.6059386Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6059517Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6059751Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6059876Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6060087Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6060245Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6060394Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6060564Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6061172Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6061746Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6062121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6062525Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6062852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6063129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6063452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6063724Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6063835Z Execution Analysis: .......... 2024-12-18T00:21:04.6064109Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6064315Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6064616Z pt-xla-profiler: TransferFromDeviceTime too frequent: 525 counts during 501 steps 2024-12-18T00:21:04.6064623Z 2024-12-18T00:21:04.6064829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6064960Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6065252Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6065377Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6065584Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6065759Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6065916Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6066086Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6066454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6066832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6067163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6067440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6067751Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6068034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6068330Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6068472Z Execution Analysis: (:1) 2024-12-18T00:21:04.6068829Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6069031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6069036Z 2024-12-18T00:21:04.6069226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6069351Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6069565Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6069672Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6069881Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6070016Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6070170Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6070330Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6070897Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6071434Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6072212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6072555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6072849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6073120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6073410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6073676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6073778Z Execution Analysis: .......... 2024-12-18T00:21:04.6074034Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6074227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6074497Z pt-xla-profiler: TransferFromDeviceTime too frequent: 526 counts during 502 steps 2024-12-18T00:21:04.6074502Z 2024-12-18T00:21:04.6074703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6074812Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6075099Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6075205Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6075437Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6075572Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6075708Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6075881Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6076255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6076597Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6076888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6077156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6077443Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6077693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6077981Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6078100Z Execution Analysis: (:1) 2024-12-18T00:21:04.6078356Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6078548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6078555Z 2024-12-18T00:21:04.6078935Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6079050Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6079293Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6079406Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6079613Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6079769Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6079918Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6080104Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6080685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6081263Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6081668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6082032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6082341Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6082614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6082936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6083202Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6083328Z Execution Analysis: .......... 2024-12-18T00:21:04.6083587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6083807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6084091Z pt-xla-profiler: TransferFromDeviceTime too frequent: 528 counts during 503 steps 2024-12-18T00:21:04.6084096Z 2024-12-18T00:21:04.6084300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6084430Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6084715Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6084866Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6085069Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6085227Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6085371Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6085564Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6085932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6086282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6086605Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6086875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6087195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6087460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6087762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6087889Z Execution Analysis: (:1) 2024-12-18T00:21:04.6088147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6088363Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6088369Z 2024-12-18T00:21:04.6088567Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6088701Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6088926Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6089049Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6089252Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6089394Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6089550Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6089713Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6090308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6091008Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6091357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6091685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6091990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6092247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6092534Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6092796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6092899Z Execution Analysis: .......... 2024-12-18T00:21:04.6093150Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6093344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6093623Z pt-xla-profiler: TransferFromDeviceTime too frequent: 529 counts during 504 steps 2024-12-18T00:21:04.6093627Z 2024-12-18T00:21:04.6093818Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6093942Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6094241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6094348Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6094554Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6094693Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6094869Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6095029Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6095367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6095706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6095995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6096262Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6096624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6097063Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6097357Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6097500Z Execution Analysis: (:1) 2024-12-18T00:21:04.6097760Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6097973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6097990Z 2024-12-18T00:21:04.6098197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6098312Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6098559Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6098676Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6098898Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6099044Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6099194Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6099378Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6099975Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6100688Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6101053Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6101423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6101741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6102032Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6102344Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6102617Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6102745Z Execution Analysis: .......... 2024-12-18T00:21:04.6103011Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6103234Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6103522Z pt-xla-profiler: TransferFromDeviceTime too frequent: 530 counts during 505 steps 2024-12-18T00:21:04.6103527Z 2024-12-18T00:21:04.6103746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6103890Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6104196Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6104310Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6104517Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6104700Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6104848Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6105033Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6105396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6105763Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6106077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6106355Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6106677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6106946Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6107255Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6107386Z Execution Analysis: (:1) 2024-12-18T00:21:04.6107660Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6107866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6107871Z 2024-12-18T00:21:04.6108089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6108207Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6108443Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6108569Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6108778Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6108935Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6109189Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6109359Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6109955Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6110490Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6110834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6111164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6111467Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6111723Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6112026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6112276Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6112390Z Execution Analysis: .......... 2024-12-18T00:21:04.6112633Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6112824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6113103Z pt-xla-profiler: TransferFromDeviceTime too frequent: 531 counts during 506 steps 2024-12-18T00:21:04.6113147Z 2024-12-18T00:21:04.6113338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6113458Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6113731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6113849Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6114064Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6114204Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6114352Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6114510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6114854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6115181Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6115486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6115743Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6116030Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6116297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6116572Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6116712Z Execution Analysis: (:1) 2024-12-18T00:21:04.6116954Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6117161Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6117165Z 2024-12-18T00:21:04.6117355Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6117644Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6117872Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6117982Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6118201Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6118343Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6118504Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6118699Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6119315Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6119879Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6120243Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6120591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6120897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6121181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6121484Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6121765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6121871Z Execution Analysis: .......... 2024-12-18T00:21:04.6122147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6122348Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6122656Z pt-xla-profiler: TransferFromDeviceTime too frequent: 532 counts during 507 steps 2024-12-18T00:21:04.6122675Z 2024-12-18T00:21:04.6122876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6122993Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6123296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6123432Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6123651Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6123797Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6123941Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6124122Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6124472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6124833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6125144Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6125428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6125732Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6126013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6126305Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6126432Z Execution Analysis: (:1) 2024-12-18T00:21:04.6126703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6126905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6126910Z 2024-12-18T00:21:04.6127129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6127246Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6127490Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6127601Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6127811Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6127969Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6128141Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6128346Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6128929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6129615Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6129951Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6130295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6130587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6130848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6131159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6131408Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6131527Z Execution Analysis: .......... 2024-12-18T00:21:04.6131767Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6131974Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6132268Z pt-xla-profiler: TransferFromDeviceTime too frequent: 533 counts during 508 steps 2024-12-18T00:21:04.6132272Z 2024-12-18T00:21:04.6132481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6132592Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6132888Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6133011Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6133206Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6133358Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6133493Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6133663Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6133996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6134325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6134626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6134882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6135186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6135439Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6135730Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6135848Z Execution Analysis: (:1) 2024-12-18T00:21:04.6136089Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6136291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6136297Z 2024-12-18T00:21:04.6136572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6136693Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6137086Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6137213Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6137423Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6137633Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6137797Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6137967Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6138581Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6139162Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6139543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6139897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6140229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6140509Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6140820Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6141103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6141214Z Execution Analysis: .......... 2024-12-18T00:21:04.6141486Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6141719Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6142023Z pt-xla-profiler: TransferFromDeviceTime too frequent: 534 counts during 509 steps 2024-12-18T00:21:04.6142028Z 2024-12-18T00:21:04.6142264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6142398Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6142694Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6142807Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6143028Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6143176Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6143335Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6143505Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6143880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6144422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6144739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6145035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6145351Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6145639Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6145939Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6146085Z Execution Analysis: (:1) 2024-12-18T00:21:04.6146349Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6146573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6146578Z 2024-12-18T00:21:04.6146784Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6146903Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6147153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6147344Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6147618Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6147769Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6147936Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6148106Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6148704Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6149298Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6149660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6150027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6150344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6150634Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6150944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6151230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6151339Z Execution Analysis: .......... 2024-12-18T00:21:04.6151638Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6151856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6152142Z pt-xla-profiler: TransferFromDeviceTime too frequent: 535 counts during 510 steps 2024-12-18T00:21:04.6152147Z 2024-12-18T00:21:04.6152403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6152523Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6152829Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6152942Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6153152Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6153312Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6153457Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6153642Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6154007Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6154369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6154686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6154963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6155286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6155559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6155863Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6155991Z Execution Analysis: (:1) 2024-12-18T00:21:04.6156373Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6156573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6156577Z 2024-12-18T00:21:04.6156786Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6156901Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6157161Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6157308Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6157516Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6157668Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6157813Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6157990Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6158566Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6159128Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6159494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6159840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6160162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6160434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6160749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6161015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6161162Z Execution Analysis: .......... 2024-12-18T00:21:04.6161523Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6161714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6162019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 536 counts during 511 steps 2024-12-18T00:21:04.6162026Z 2024-12-18T00:21:04.6162219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6162342Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6162620Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6162741Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6162935Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6163071Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6163389Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6163554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6163919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6164266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6164584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6164855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6165169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6165432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6165716Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6165854Z Execution Analysis: (:1) 2024-12-18T00:21:04.6166108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6166320Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6166324Z 2024-12-18T00:21:04.6166524Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6166676Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6166930Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6167043Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6167262Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6167406Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6167565Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6167730Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6168326Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6168890Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6169263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6169613Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6169921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6170210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6170515Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6170818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6170926Z Execution Analysis: .......... 2024-12-18T00:21:04.6171194Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6171423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6171710Z pt-xla-profiler: TransferFromDeviceTime too frequent: 537 counts during 512 steps 2024-12-18T00:21:04.6171729Z 2024-12-18T00:21:04.6171932Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6172047Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6172351Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6172465Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6172681Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6172828Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6172985Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6173152Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6173505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6173871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6174183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6174467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6174770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6175043Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6175333Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6175459Z Execution Analysis: (:1) 2024-12-18T00:21:04.6175730Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6175936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6175941Z 2024-12-18T00:21:04.6176186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6176324Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6176646Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6176760Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6177153Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6177301Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6177454Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6177640Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6178235Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6178832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6179201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6179571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6179886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6180161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6180514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6180787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6180906Z Execution Analysis: .......... 2024-12-18T00:21:04.6181166Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6181408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6181702Z pt-xla-profiler: TransferFromDeviceTime too frequent: 538 counts during 513 steps 2024-12-18T00:21:04.6181707Z 2024-12-18T00:21:04.6181923Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6182040Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6182338Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6182464Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6182670Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6182829Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6182975Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6183156Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6183518Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6183874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6184203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6184479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6184805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6185078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6185386Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6185517Z Execution Analysis: (:1) 2024-12-18T00:21:04.6185797Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6186004Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6186053Z 2024-12-18T00:21:04.6186288Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6186419Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6186654Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6186778Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6186990Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6187150Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6187301Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6187470Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6188077Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6188656Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6189136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6189464Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6189766Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6190051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6190350Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6190601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6190705Z Execution Analysis: .......... 2024-12-18T00:21:04.6190982Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6191178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6191455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 539 counts during 514 steps 2024-12-18T00:21:04.6191460Z 2024-12-18T00:21:04.6191651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6191773Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6192047Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6192155Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6192359Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6192497Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6192645Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6192804Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6193150Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6193481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6193771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6194038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6194324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6194589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6194860Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6194993Z Execution Analysis: (:1) 2024-12-18T00:21:04.6195239Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6195493Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6195498Z 2024-12-18T00:21:04.6195688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6195796Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6196027Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6196132Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6196340Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6196479Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6196632Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6196790Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6197344Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6197892Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6198228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6198569Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6198861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6199156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6199446Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6199710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6199837Z Execution Analysis: .......... 2024-12-18T00:21:04.6200083Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6200288Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6200555Z pt-xla-profiler: TransferFromDeviceTime too frequent: 540 counts during 515 steps 2024-12-18T00:21:04.6200560Z 2024-12-18T00:21:04.6200761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6200873Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6201159Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6201263Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6201468Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6201604Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6201741Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6201911Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6202245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6202585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6202875Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6203141Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6203429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6203679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6203962Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6204083Z Execution Analysis: (:1) 2024-12-18T00:21:04.6204363Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6204578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6204583Z 2024-12-18T00:21:04.6204786Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6204893Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6205122Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6205230Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6205427Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6205576Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6205714Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6205887Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6206439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6206990Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6207326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6207655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6207985Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6208245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6208545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6208821Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6208937Z Execution Analysis: .......... 2024-12-18T00:21:04.6209179Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6209385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6209648Z pt-xla-profiler: TransferFromDeviceTime too frequent: 541 counts during 516 steps 2024-12-18T00:21:04.6209652Z 2024-12-18T00:21:04.6209842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6209963Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6210236Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6210355Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6210547Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6210697Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6210838Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6210997Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6211343Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6211671Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6211982Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6212238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6212537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6212788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6213064Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6213223Z Execution Analysis: (:1) 2024-12-18T00:21:04.6213488Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6213695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6213699Z 2024-12-18T00:21:04.6213892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6214013Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6214233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6214351Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6214546Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6214683Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6214839Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6214999Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6215565Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6216098Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6216519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6217054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6217383Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6217660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6218011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6218302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6218414Z Execution Analysis: .......... 2024-12-18T00:21:04.6218691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6218898Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6219198Z pt-xla-profiler: TransferFromDeviceTime too frequent: 542 counts during 517 steps 2024-12-18T00:21:04.6219205Z 2024-12-18T00:21:04.6219412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6219530Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6219835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6219951Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6220171Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6220321Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6220482Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6220653Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6221014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6221377Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6221696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6221987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6222297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6222583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6222898Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6223062Z Execution Analysis: (:1) 2024-12-18T00:21:04.6223326Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6223530Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6223534Z 2024-12-18T00:21:04.6223751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6223873Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6224118Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6224230Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6224452Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6224597Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6224750Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6224932Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6225524Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6226113Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6226502Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6226864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6227178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6227491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6227806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6228079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6228198Z Execution Analysis: .......... 2024-12-18T00:21:04.6228457Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6228673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6229068Z pt-xla-profiler: TransferFromDeviceTime too frequent: 543 counts during 518 steps 2024-12-18T00:21:04.6229074Z 2024-12-18T00:21:04.6229390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6229501Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6229788Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6229897Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6230089Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6230239Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6230376Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6230544Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6230874Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6231204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6231508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6231759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6232057Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6232306Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6232645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6232765Z Execution Analysis: (:1) 2024-12-18T00:21:04.6233017Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6233209Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6233215Z 2024-12-18T00:21:04.6233404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6233527Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6233741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6233859Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6234056Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6234206Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6234346Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6234505Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6235066Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6235597Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6235972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6236299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6236628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6236884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6237190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6237442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6237542Z Execution Analysis: .......... 2024-12-18T00:21:04.6237795Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6237984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6238265Z pt-xla-profiler: TransferFromDeviceTime too frequent: 544 counts during 519 steps 2024-12-18T00:21:04.6238270Z 2024-12-18T00:21:04.6238457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6238579Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6238854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6238970Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6239161Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6239294Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6239438Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6239596Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6239937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6240265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6240569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6240823Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6241111Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6241424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6241697Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6241826Z Execution Analysis: (:1) 2024-12-18T00:21:04.6242066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6242268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6242274Z 2024-12-18T00:21:04.6242462Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6242582Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6242798Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6242905Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6243112Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6243246Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6243395Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6243551Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6244114Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6245006Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6245366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6245732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6246103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6246396Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6246706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6246985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6247093Z Execution Analysis: .......... 2024-12-18T00:21:04.6247364Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6247570Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6247853Z pt-xla-profiler: TransferFromDeviceTime too frequent: 545 counts during 520 steps 2024-12-18T00:21:04.6247858Z 2024-12-18T00:21:04.6248076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6248193Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6248502Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6248615Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6248833Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6248981Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6249125Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6249304Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6249666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6250033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6250346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6250633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6251082Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6251352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6251660Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6251787Z Execution Analysis: (:1) 2024-12-18T00:21:04.6252066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6252276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6252281Z 2024-12-18T00:21:04.6252498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6252614Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6252859Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6252975Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6253187Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6253343Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6253491Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6258488Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6259174Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6259903Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6260282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6260672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6261003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6261283Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6261601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6261872Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6261988Z Execution Analysis: .......... 2024-12-18T00:21:04.6262253Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6262458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6262754Z pt-xla-profiler: TransferFromDeviceTime too frequent: 546 counts during 521 steps 2024-12-18T00:21:04.6262763Z 2024-12-18T00:21:04.6262969Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6263098Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6263391Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6263511Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6263719Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6263870Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6264014Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6264186Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6264552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6264906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6265228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6265564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6265879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6266150Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6266444Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6266576Z Execution Analysis: (:1) 2024-12-18T00:21:04.6266839Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6267053Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6267058Z 2024-12-18T00:21:04.6267263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6267386Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6267620Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6267729Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6267949Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6268093Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6268252Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6268424Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6269149Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6269681Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6270046Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6270378Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6270666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6270933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6271217Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6271474Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6271575Z Execution Analysis: .......... 2024-12-18T00:21:04.6271820Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6272009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6272279Z pt-xla-profiler: TransferFromDeviceTime too frequent: 547 counts during 522 steps 2024-12-18T00:21:04.6272286Z 2024-12-18T00:21:04.6272475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6272583Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6272858Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6272961Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6273157Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6273291Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6273427Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6273584Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6273912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6274243Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6274556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6274839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6275130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6275385Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6275651Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6275769Z Execution Analysis: (:1) 2024-12-18T00:21:04.6276183Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6276379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6276383Z 2024-12-18T00:21:04.6276590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6276703Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6276936Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6277046Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6277252Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6277391Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6277532Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6277900Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6278814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6280127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6281173Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6282010Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6282798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6283511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6284223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6284975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6285488Z Execution Analysis: .......... 2024-12-18T00:21:04.6285990Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6286592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6287202Z pt-xla-profiler: TransferFromDeviceTime too frequent: 549 counts during 523 steps 2024-12-18T00:21:04.6287617Z 2024-12-18T00:21:04.6287822Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6288266Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6288777Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6289304Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6289717Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6290176Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6290577Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6291004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6291644Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6292476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6293315Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6294021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6294733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6295433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6296119Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6296753Z Execution Analysis: (:1) 2024-12-18T00:21:04.6297248Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6297827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6298166Z 2024-12-18T00:21:04.6298372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6298821Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6299269Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6299738Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6300150Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6300609Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6301051Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6301482Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6302358Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6303681Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6304744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6305568Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6306350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6307063Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6307771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6308478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6308979Z Execution Analysis: .......... 2024-12-18T00:21:04.6309434Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6310016Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6310635Z pt-xla-profiler: TransferFromDeviceTime too frequent: 550 counts during 524 steps 2024-12-18T00:21:04.6311044Z 2024-12-18T00:21:04.6311248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6311692Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6312198Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6312716Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6313121Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6313586Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6313990Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6314414Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6315056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6315944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6316737Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6317445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6318149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6318852Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6319536Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6320068Z Execution Analysis: (:1) 2024-12-18T00:21:04.6320562Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6321144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6321478Z 2024-12-18T00:21:04.6321681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6322122Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6322566Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6323017Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6323427Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6323922Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6324331Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6324759Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6325652Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6326948Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6327996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6328829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6329612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6330329Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6331036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6331730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6332232Z Execution Analysis: .......... 2024-12-18T00:21:04.6332688Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6333279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6333893Z pt-xla-profiler: TransferFromDeviceTime too frequent: 551 counts during 525 steps 2024-12-18T00:21:04.6334298Z 2024-12-18T00:21:04.6334511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6334947Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6335458Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6335987Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6336491Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6336965Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6337364Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6337787Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6338493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6339330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6340118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6340831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6341532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6342229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6342912Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6343456Z Execution Analysis: (:1) 2024-12-18T00:21:04.6343953Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6344688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6345012Z 2024-12-18T00:21:04.6345226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6345654Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6346103Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6346566Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6347033Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6347503Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6347898Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6348324Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6349236Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6350526Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6351579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6352412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6353204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6353903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6354612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6355327Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6355945Z Execution Analysis: .......... 2024-12-18T00:21:04.6356405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6356972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6357575Z pt-xla-profiler: TransferFromDeviceTime too frequent: 552 counts during 526 steps 2024-12-18T00:21:04.6357983Z 2024-12-18T00:21:04.6358185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6358628Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6359130Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6359651Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6360049Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6360513Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6360914Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6361371Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6362500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6363310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6364079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6364777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6365477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6366173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6366846Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6367374Z Execution Analysis: (:1) 2024-12-18T00:21:04.6367862Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6368436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6368764Z 2024-12-18T00:21:04.6368957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6369383Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6369822Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6370297Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6370699Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6371160Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6371560Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6372008Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6372871Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6374110Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6375130Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6375945Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6376989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6377757Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6378473Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6379180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6379682Z Execution Analysis: .......... 2024-12-18T00:21:04.6380147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6380733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6381351Z pt-xla-profiler: TransferFromDeviceTime too frequent: 553 counts during 527 steps 2024-12-18T00:21:04.6381754Z 2024-12-18T00:21:04.6381970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6382414Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6382917Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6383449Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6383865Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6384341Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6384806Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6385230Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6385876Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6386705Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6387503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6388221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6388932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6389720Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6390396Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6390932Z Execution Analysis: (:1) 2024-12-18T00:21:04.6391419Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6391992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6392308Z 2024-12-18T00:21:04.6392515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6392967Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6393401Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6393858Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6394259Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6394720Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6395146Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6395565Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6396428Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6397680Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6398779Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6399559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6400288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6400942Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6401599Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6402259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6402728Z Execution Analysis: .......... 2024-12-18T00:21:04.6403157Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6403701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6404267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 554 counts during 528 steps 2024-12-18T00:21:04.6404652Z 2024-12-18T00:21:04.6404842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6405256Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6405898Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6406412Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6406811Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6407332Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6407733Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6408154Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6408786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6409609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6410385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6411069Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6411767Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6412461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6413139Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6413678Z Execution Analysis: (:1) 2024-12-18T00:21:04.6414170Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6414735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6415063Z 2024-12-18T00:21:04.6415263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6415729Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6416171Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6416701Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6417283Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6417806Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6418222Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6418666Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6419552Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6420838Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6421904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6422739Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6423537Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6424258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6424974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6425681Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6426181Z Execution Analysis: .......... 2024-12-18T00:21:04.6426634Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6427225Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6427845Z pt-xla-profiler: TransferFromDeviceTime too frequent: 555 counts during 529 steps 2024-12-18T00:21:04.6428258Z 2024-12-18T00:21:04.6428465Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6428915Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6429495Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6430005Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6430420Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6430859Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6431235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6431635Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6432220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6432992Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6433723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6434385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6435044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6435696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6436338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6436834Z Execution Analysis: (:1) 2024-12-18T00:21:04.6437299Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6437843Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6438174Z 2024-12-18T00:21:04.6438372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6438785Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6439202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6439625Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6440036Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6440477Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6440856Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6441259Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6442063Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6443262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6444380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6445446Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6446243Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6446962Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6447676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6448372Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6448877Z Execution Analysis: .......... 2024-12-18T00:21:04.6449339Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6449926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6450546Z pt-xla-profiler: TransferFromDeviceTime too frequent: 556 counts during 530 steps 2024-12-18T00:21:04.6450950Z 2024-12-18T00:21:04.6451165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6451602Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6452166Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6452731Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6453146Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6453624Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6454018Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6454448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6455092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6455931Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6456796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6457512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6458218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6458933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6459627Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6460173Z Execution Analysis: (:1) 2024-12-18T00:21:04.6460674Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6461311Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6461638Z 2024-12-18T00:21:04.6461853Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6462293Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6462772Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6463244Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6463666Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6464154Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6464559Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6465000Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6465893Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6467190Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6468259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6469201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6469931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6470606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6471271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6471936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6472416Z Execution Analysis: .......... 2024-12-18T00:21:04.6472849Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6473390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6473973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 557 counts during 531 steps 2024-12-18T00:21:04.6474363Z 2024-12-18T00:21:04.6474557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6475003Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6475511Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6476177Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6476579Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6477041Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6477442Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6477873Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6478504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6479317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6480080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6480779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6481480Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6482174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6482842Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6483381Z Execution Analysis: (:1) 2024-12-18T00:21:04.6483859Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6484465Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6484792Z 2024-12-18T00:21:04.6484992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6485475Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6485920Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6486386Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6486787Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6487255Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6487828Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6488266Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6489149Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6490438Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6491487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6492328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6493128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6493851Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6494571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6495284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6495789Z Execution Analysis: .......... 2024-12-18T00:21:04.6496257Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6496931Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6497559Z pt-xla-profiler: TransferFromDeviceTime too frequent: 558 counts during 532 steps 2024-12-18T00:21:04.6497963Z 2024-12-18T00:21:04.6498215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6498692Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6499194Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6499735Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6500154Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6500626Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6501037Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6501472Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6502107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6502940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6503737Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6504460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6505176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6505884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6506564Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6507142Z Execution Analysis: (:1) 2024-12-18T00:21:04.6507640Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6508231Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6508559Z 2024-12-18T00:21:04.6508798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6509344Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6509759Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6510195Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6510580Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6511023Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6511407Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6511802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6512628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6513829Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6514815Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6515605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6516348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6517010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6517835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6518528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6519021Z Execution Analysis: .......... 2024-12-18T00:21:04.6519476Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6520049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6520661Z pt-xla-profiler: TransferFromDeviceTime too frequent: 559 counts during 533 steps 2024-12-18T00:21:04.6521086Z 2024-12-18T00:21:04.6521314Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6521759Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6522265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6522791Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6523203Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6523673Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6524067Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6524497Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6525134Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6525961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6526742Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6527437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6528138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6528839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6529516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6530178Z Execution Analysis: (:1) 2024-12-18T00:21:04.6530645Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6531193Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6531538Z 2024-12-18T00:21:04.6531734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6532159Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6532585Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6533027Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6533422Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6533850Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6534232Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6534634Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6535452Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6536733Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6537964Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6538796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6539597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6540317Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6541037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6541753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6542270Z Execution Analysis: .......... 2024-12-18T00:21:04.6542721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6543320Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6544014Z pt-xla-profiler: TransferFromDeviceTime too frequent: 560 counts during 534 steps 2024-12-18T00:21:04.6544613Z 2024-12-18T00:21:04.6544822Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6545272Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6545786Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6546325Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6546732Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6547209Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6547619Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6548050Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6548702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6549537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6550336Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6551057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6551774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6552485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6553239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6553782Z Execution Analysis: (:1) 2024-12-18T00:21:04.6554290Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6554925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6555266Z 2024-12-18T00:21:04.6555472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6556030Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6556565Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6556992Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6557384Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6557824Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6558209Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6558612Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6559427Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6560609Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6561591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6562368Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6563100Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6563764Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6564427Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6565069Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6565540Z Execution Analysis: .......... 2024-12-18T00:21:04.6565973Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6566557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6567170Z pt-xla-profiler: TransferFromDeviceTime too frequent: 561 counts during 535 steps 2024-12-18T00:21:04.6567548Z 2024-12-18T00:21:04.6567751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6568159Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6568639Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6569139Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6569527Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6569968Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6570348Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6570743Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6571343Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6572125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6572857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6573522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6574181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6574876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6575526Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6576045Z Execution Analysis: (:1) 2024-12-18T00:21:04.6576693Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6577456Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6577786Z 2024-12-18T00:21:04.6578008Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6578450Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6578913Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6579393Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6579819Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6580307Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6580713Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6581157Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6582049Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6583348Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6584415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6585262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6586067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6586780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6587505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6587793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6587908Z Execution Analysis: .......... 2024-12-18T00:21:04.6588177Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6588433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6588726Z pt-xla-profiler: TransferFromDeviceTime too frequent: 562 counts during 536 steps 2024-12-18T00:21:04.6588731Z 2024-12-18T00:21:04.6588956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6589182Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6589484Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6589598Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6589812Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6589957Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6590100Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6590280Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6590632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6590990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6591298Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6591579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6591910Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6592184Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6592472Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6592621Z Execution Analysis: (:1) 2024-12-18T00:21:04.6592889Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6593094Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6593099Z 2024-12-18T00:21:04.6593307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6593422Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6593664Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6593777Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6593983Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6594141Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6594290Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6594471Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6595053Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6595726Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6596061Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6596407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6596703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6596961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6597258Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6597510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6597648Z Execution Analysis: .......... 2024-12-18T00:21:04.6597910Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6598114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6598381Z pt-xla-profiler: TransferFromDeviceTime too frequent: 563 counts during 537 steps 2024-12-18T00:21:04.6598385Z 2024-12-18T00:21:04.6598587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6598699Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6598971Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6599093Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6599284Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6599434Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6599570Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6599730Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6600078Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6600405Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6600709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6600990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6601293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6601544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6601853Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6601976Z Execution Analysis: (:1) 2024-12-18T00:21:04.6602218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6602422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6602426Z 2024-12-18T00:21:04.6602615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6602738Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6602956Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6603075Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6603269Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6603405Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6603562Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6603721Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6604289Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6604822Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6605167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6605496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6605800Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6606054Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6606345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6606636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6606795Z Execution Analysis: .......... 2024-12-18T00:21:04.6607050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6607242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6607521Z pt-xla-profiler: TransferFromDeviceTime too frequent: 564 counts during 538 steps 2024-12-18T00:21:04.6607528Z 2024-12-18T00:21:04.6607720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6607842Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6608115Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6608222Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6608432Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6608570Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6608720Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6608877Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6609222Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6609549Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6609838Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6610130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6610419Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6610707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6610980Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6611113Z Execution Analysis: (:1) 2024-12-18T00:21:04.6611354Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6611544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6611559Z 2024-12-18T00:21:04.6611749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6611858Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6612084Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6612187Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6612391Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6612527Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6612678Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6612836Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6613390Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6613933Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6614268Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6614611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6614903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6615181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6615469Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6615794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6615899Z Execution Analysis: .......... 2024-12-18T00:21:04.6616141Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6616412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6616687Z pt-xla-profiler: TransferFromDeviceTime too frequent: 565 counts during 539 steps 2024-12-18T00:21:04.6616691Z 2024-12-18T00:21:04.6617072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6617191Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6617498Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6617614Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6617825Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6617988Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6618135Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6618320Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6618678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6619046Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6619400Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6619676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6619999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6620294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6620606Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6620734Z Execution Analysis: (:1) 2024-12-18T00:21:04.6621005Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6621209Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6621213Z 2024-12-18T00:21:04.6621433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6621552Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6621788Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6621919Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6622133Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6622293Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6622446Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6622634Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6623233Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6623811Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6624190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6624547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6624877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6625159Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6625536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6625808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6625930Z Execution Analysis: .......... 2024-12-18T00:21:04.6626191Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6626398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6626705Z pt-xla-profiler: TransferFromDeviceTime too frequent: 566 counts during 540 steps 2024-12-18T00:21:04.6626710Z 2024-12-18T00:21:04.6626917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6627051Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6627348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6627482Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6627694Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6627842Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6628006Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6628180Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6628556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6628940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6629355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6629614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6629939Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6630197Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6630474Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6630608Z Execution Analysis: (:1) 2024-12-18T00:21:04.6630850Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6631056Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6631062Z 2024-12-18T00:21:04.6631250Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6631374Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6631592Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6631701Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6631910Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6632054Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6632208Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6632368Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6632933Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6633467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6633818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6634144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6634434Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6634750Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6635037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6635297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6635398Z Execution Analysis: .......... 2024-12-18T00:21:04.6635651Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6635843Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6636109Z pt-xla-profiler: TransferFromDeviceTime too frequent: 567 counts during 541 steps 2024-12-18T00:21:04.6636125Z 2024-12-18T00:21:04.6636314Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6636424Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6636710Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6636817Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6637021Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6637156Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6637304Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6637463Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6637821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6638160Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6638450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6638745Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6639034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6639298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6639575Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6639696Z Execution Analysis: (:1) 2024-12-18T00:21:04.6639951Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6640144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6640148Z 2024-12-18T00:21:04.6640352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6640462Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6640690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6640799Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6640996Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6641145Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6641285Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6641457Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6642005Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6642553Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6642886Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6643228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6643547Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6643825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6644124Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6644687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6644813Z Execution Analysis: .......... 2024-12-18T00:21:04.6645078Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6645299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6645586Z pt-xla-profiler: TransferFromDeviceTime too frequent: 568 counts during 542 steps 2024-12-18T00:21:04.6645591Z 2024-12-18T00:21:04.6645814Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6645937Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6646235Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6646366Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6646574Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6646736Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6646881Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6647121Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6647481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6647834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6648197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6648477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6648807Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6649077Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6649385Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6649512Z Execution Analysis: (:1) 2024-12-18T00:21:04.6649771Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6649987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6649993Z 2024-12-18T00:21:04.6650200Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6650333Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6650567Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6650696Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6650906Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6651064Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6651212Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6651381Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6651987Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6652567Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6652943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6653299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6653705Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6653982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6654305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6654575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6654687Z Execution Analysis: .......... 2024-12-18T00:21:04.6654959Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6655165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6655466Z pt-xla-profiler: TransferFromDeviceTime too frequent: 570 counts during 543 steps 2024-12-18T00:21:04.6655473Z 2024-12-18T00:21:04.6655682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6655815Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6656109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6656223Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6656517Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6656665Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6656858Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6657028Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6657400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6657783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6658099Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6658389Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6658697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6658981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6659277Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6659420Z Execution Analysis: (:1) 2024-12-18T00:21:04.6659682Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6659902Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6659907Z 2024-12-18T00:21:04.6660113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6660234Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6660488Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6660600Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6660826Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6660974Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6661140Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6661311Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6661909Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6662500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6662865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6663288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6663607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6663895Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6664206Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6664490Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6664601Z Execution Analysis: .......... 2024-12-18T00:21:04.6664859Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6665077Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6665363Z pt-xla-profiler: TransferFromDeviceTime too frequent: 571 counts during 544 steps 2024-12-18T00:21:04.6665370Z 2024-12-18T00:21:04.6665589Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6665707Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6666016Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6666130Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6666340Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6666533Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6666679Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6666866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6667226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6667612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6667930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6668213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6668521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6668886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6669172Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6669293Z Execution Analysis: (:1) 2024-12-18T00:21:04.6669548Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6669742Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6669746Z 2024-12-18T00:21:04.6669949Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6670059Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6670278Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6670394Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6670590Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6670736Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6670877Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6671045Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6671596Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6672137Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6672522Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6672850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6673149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6673404Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6673705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6673958Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6674073Z Execution Analysis: .......... 2024-12-18T00:21:04.6674314Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6674509Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6674788Z pt-xla-profiler: TransferFromDeviceTime too frequent: 572 counts during 545 steps 2024-12-18T00:21:04.6674792Z 2024-12-18T00:21:04.6674986Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6675106Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6675380Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6675525Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6675718Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6675865Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6675998Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6676157Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6676522Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6676855Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6677155Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6677410Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6677703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6677956Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6678228Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6678350Z Execution Analysis: (:1) 2024-12-18T00:21:04.6678588Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6678789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6678794Z 2024-12-18T00:21:04.6678982Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6679100Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6679310Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6679426Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6679616Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6679750Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6679896Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6680052Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6680608Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6681142Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6681534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6681862Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6682152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6682417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6682706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6682963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6683065Z Execution Analysis: .......... 2024-12-18T00:21:04.6683319Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6683511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6683788Z pt-xla-profiler: TransferFromDeviceTime too frequent: 573 counts during 546 steps 2024-12-18T00:21:04.6683793Z 2024-12-18T00:21:04.6683985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6684095Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6684376Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6684507Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6684709Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6684845Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6684986Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6685175Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6685508Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6685842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6686134Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6686399Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6686684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6686942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6687214Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6687334Z Execution Analysis: (:1) 2024-12-18T00:21:04.6687584Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6687777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6687781Z 2024-12-18T00:21:04.6687979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6688086Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6688310Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6688413Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6688620Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6688755Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6688894Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6689058Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6689611Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6690200Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6690536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6690871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6691163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6691428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6691712Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6691961Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6692072Z Execution Analysis: .......... 2024-12-18T00:21:04.6692314Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6692517Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6692781Z pt-xla-profiler: TransferFromDeviceTime too frequent: 574 counts during 547 steps 2024-12-18T00:21:04.6692785Z 2024-12-18T00:21:04.6692980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6693111Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6693383Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6693495Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6693684Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6693829Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6693985Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6694153Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6694483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6694809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6695105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6695358Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6695654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6695904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6696183Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6696303Z Execution Analysis: (:1) 2024-12-18T00:21:04.6696628Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6696991Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6696996Z 2024-12-18T00:21:04.6697198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6697324Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6697554Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6697679Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6697891Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6698048Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6698197Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6698367Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6698992Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6699591Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6699960Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6700313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6700633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6700909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6701226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6701496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6701608Z Execution Analysis: .......... 2024-12-18T00:21:04.6701877Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6702083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6702381Z pt-xla-profiler: TransferFromDeviceTime too frequent: 575 counts during 548 steps 2024-12-18T00:21:04.6702386Z 2024-12-18T00:21:04.6702590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6702747Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6703040Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6703162Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6703367Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6703544Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6703700Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6703876Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6704248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6704598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6704918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6705196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6705507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6705790Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6706087Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6706227Z Execution Analysis: (:1) 2024-12-18T00:21:04.6706488Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6706702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6706706Z 2024-12-18T00:21:04.6706906Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6707031Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6707265Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6707378Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6713861Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6714051Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6714200Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6714370Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6715054Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6715600Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6715933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6716270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6716559Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6716821Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6717108Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6717358Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6717465Z Execution Analysis: .......... 2024-12-18T00:21:04.6717883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6718089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6718366Z pt-xla-profiler: TransferFromDeviceTime too frequent: 576 counts during 549 steps 2024-12-18T00:21:04.6718405Z 2024-12-18T00:21:04.6718612Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6718722Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6719016Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6719125Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6719353Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6719507Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6719647Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6719816Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6720165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6720514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6720821Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6721082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6721389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6721649Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6721942Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6722065Z Execution Analysis: (:1) 2024-12-18T00:21:04.6722320Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6722521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6722525Z 2024-12-18T00:21:04.6722729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6722842Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6723065Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6723179Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6723383Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6723533Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6723701Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6723893Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6724474Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6725030Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6725387Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6725729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6726041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6726309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6726615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6726877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6726985Z Execution Analysis: .......... 2024-12-18T00:21:04.6727236Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6727431Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6727755Z pt-xla-profiler: TransferFromDeviceTime too frequent: 577 counts during 550 steps 2024-12-18T00:21:04.6727760Z 2024-12-18T00:21:04.6727956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6728074Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6728381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6728497Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6728696Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6728835Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6728977Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6729141Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6729493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6729925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6730219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6730471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6730763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6731011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6731282Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6731402Z Execution Analysis: (:1) 2024-12-18T00:21:04.6731641Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6731832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6731838Z 2024-12-18T00:21:04.6732024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6732133Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6732344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6732444Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6732644Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6732801Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6732962Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6733118Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6733674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6734201Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6734541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6734867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6735157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6735416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6735703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6735953Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6736052Z Execution Analysis: .......... 2024-12-18T00:21:04.6736300Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6736608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6737164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 578 counts during 551 steps 2024-12-18T00:21:04.6737177Z 2024-12-18T00:21:04.6737381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6737525Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6737830Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6737947Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6738160Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6738303Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6738447Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6738623Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6738980Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6739340Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6739650Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6739930Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6740238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6740513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6740803Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6740928Z Execution Analysis: (:1) 2024-12-18T00:21:04.6741192Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6741395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6741401Z 2024-12-18T00:21:04.6741609Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6741723Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6741960Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6742073Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6742305Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6742482Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6742634Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6742813Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6743402Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6743980Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6744477Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6744835Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6745147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6745422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6745736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6746003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6746114Z Execution Analysis: .......... 2024-12-18T00:21:04.6746371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6746654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6746938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 579 counts during 552 steps 2024-12-18T00:21:04.6746943Z 2024-12-18T00:21:04.6747186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6747304Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6747598Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6747717Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6747923Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6748075Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6748215Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6748387Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6748748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6749101Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6749420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6749696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6750013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6750280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6750578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6750703Z Execution Analysis: (:1) 2024-12-18T00:21:04.6750959Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6751175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6751179Z 2024-12-18T00:21:04.6751380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6751502Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6751734Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6751886Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6752123Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6752274Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6752420Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6752587Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6753184Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6753758Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6754125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6754475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6754794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6755067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6755379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6755648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6755862Z Execution Analysis: .......... 2024-12-18T00:21:04.6756147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6756443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6756706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 580 counts during 553 steps 2024-12-18T00:21:04.6756736Z 2024-12-18T00:21:04.6756924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6757041Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6757315Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6757418Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6757616Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6757749Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6757890Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6758048Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6758383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6758712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6759000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6759261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6759547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6759802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6760073Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6760193Z Execution Analysis: (:1) 2024-12-18T00:21:04.6760434Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6760627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6760631Z 2024-12-18T00:21:04.6760820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6760926Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6761197Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6761335Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6761532Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6761664Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6761808Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6761965Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6762513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6763056Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6763392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6763731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6764023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6764282Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6764567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6764820Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6764946Z Execution Analysis: .......... 2024-12-18T00:21:04.6765186Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6765380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6765669Z pt-xla-profiler: TransferFromDeviceTime too frequent: 581 counts during 554 steps 2024-12-18T00:21:04.6765675Z 2024-12-18T00:21:04.6765875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6765984Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6766258Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6766362Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6766550Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6766690Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6766822Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6766984Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6767318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6767649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6767938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6768199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6768482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6768730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6769006Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6769126Z Execution Analysis: (:1) 2024-12-18T00:21:04.6769371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6769557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6769562Z 2024-12-18T00:21:04.6769754Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6769884Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6770120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6770228Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6770419Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6770556Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6770695Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6770856Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6771401Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6771929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6772268Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6772595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6772888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6773142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6773432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6773704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6773812Z Execution Analysis: .......... 2024-12-18T00:21:04.6774307Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6774612Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6775077Z pt-xla-profiler: TransferFromDeviceTime too frequent: 582 counts during 555 steps 2024-12-18T00:21:04.6775085Z 2024-12-18T00:21:04.6775291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6775410Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6775702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6775819Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6776025Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6776176Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6776319Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6776566Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6776939Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6777293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6777617Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6777890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6778204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6778471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6778766Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6778901Z Execution Analysis: (:1) 2024-12-18T00:21:04.6779160Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6779373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6779407Z 2024-12-18T00:21:04.6779636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6779756Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6779988Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6780097Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6780312Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6780454Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6780607Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6780773Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6781374Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6781950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6782324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6782678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6782991Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6783270Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6783607Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6783886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6783996Z Execution Analysis: .......... 2024-12-18T00:21:04.6784288Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6784512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6784951Z pt-xla-profiler: TransferFromDeviceTime too frequent: 583 counts during 556 steps 2024-12-18T00:21:04.6784962Z 2024-12-18T00:21:04.6785235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6785361Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6785660Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6785773Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6785992Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6786137Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6786289Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6786457Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6786815Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6787177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6787492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6787770Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6788078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6788353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6788644Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6788768Z Execution Analysis: (:1) 2024-12-18T00:21:04.6789034Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6789240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6789280Z 2024-12-18T00:21:04.6789509Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6789624Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6789857Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6789966Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6790180Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6790329Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6790477Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6790655Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6791248Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6791833Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6792196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6792551Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6792864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6793170Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6793475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6793740Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6793853Z Execution Analysis: .......... 2024-12-18T00:21:04.6794136Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6794351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6794637Z pt-xla-profiler: TransferFromDeviceTime too frequent: 584 counts during 557 steps 2024-12-18T00:21:04.6794642Z 2024-12-18T00:21:04.6794848Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6794960Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6795254Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6795374Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6795578Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6795729Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6795871Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6796044Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6796408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6796755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6797084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6797353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6797774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6798035Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6798323Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6798448Z Execution Analysis: (:1) 2024-12-18T00:21:04.6798708Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6798977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6798982Z 2024-12-18T00:21:04.6799178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6799296Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6799521Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6799639Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6799844Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6799991Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6800133Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6800292Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6800879Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6801439Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6801799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6802143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6802480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6802745Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6803049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6803335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6803441Z Execution Analysis: .......... 2024-12-18T00:21:04.6803714Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6803913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6804201Z pt-xla-profiler: TransferFromDeviceTime too frequent: 585 counts during 558 steps 2024-12-18T00:21:04.6804206Z 2024-12-18T00:21:04.6804407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6804537Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6804821Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6804943Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6805144Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6805291Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6805442Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6805609Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6805973Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6806315Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6806633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6806898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6807202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6807475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6807757Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6807893Z Execution Analysis: (:1) 2024-12-18T00:21:04.6808193Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6808405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6808409Z 2024-12-18T00:21:04.6808607Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6808722Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6808963Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6809073Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6809289Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6809430Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6809586Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6809754Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6810332Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6810906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6811256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6811611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6811938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6812216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6812545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6812818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6812926Z Execution Analysis: .......... 2024-12-18T00:21:04.6813180Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6813392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6813672Z pt-xla-profiler: TransferFromDeviceTime too frequent: 586 counts during 559 steps 2024-12-18T00:21:04.6813676Z 2024-12-18T00:21:04.6813889Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6814003Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6814295Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6814403Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6814617Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6814758Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6814900Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6815072Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6815424Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6815775Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6816082Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6816429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6816732Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6817164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6817470Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6817629Z Execution Analysis: (:1) 2024-12-18T00:21:04.6817923Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6818127Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6818131Z 2024-12-18T00:21:04.6818343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6818459Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6818698Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6818807Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6819017Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6819171Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6819322Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6819505Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6820096Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6820684Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6821041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6821421Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6821743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6822018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6822360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6822632Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6822755Z Execution Analysis: .......... 2024-12-18T00:21:04.6823011Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6823225Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6823506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 587 counts during 560 steps 2024-12-18T00:21:04.6823513Z 2024-12-18T00:21:04.6823714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6823839Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6824129Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6824253Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6824462Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6824620Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6824762Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6824929Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6825298Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6825650Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6825976Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6826248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6826567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6826838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6827183Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6827324Z Execution Analysis: (:1) 2024-12-18T00:21:04.6827581Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6827799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6827803Z 2024-12-18T00:21:04.6828002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6828128Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6828361Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6828480Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6828688Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6828832Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6828992Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6829161Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6829858Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6830417Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6830799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6831142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6831456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6831761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6832070Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6832339Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6832449Z Execution Analysis: .......... 2024-12-18T00:21:04.6832709Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6832908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6833202Z pt-xla-profiler: TransferFromDeviceTime too frequent: 588 counts during 561 steps 2024-12-18T00:21:04.6833207Z 2024-12-18T00:21:04.6833403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6833515Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6833808Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6833920Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6834127Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6834271Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6834423Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6834589Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6834936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6835291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6835597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6835873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6836177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6836474Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6836783Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6836916Z Execution Analysis: (:1) 2024-12-18T00:21:04.6837169Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6837370Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6837376Z 2024-12-18T00:21:04.6837581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6837694Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6837928Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6838037Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6838252Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6838391Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6838537Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6838707Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6839287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6839860Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6840407Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6840772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6841109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6841397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6841705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6841973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6842096Z Execution Analysis: .......... 2024-12-18T00:21:04.6842354Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6842573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6842856Z pt-xla-profiler: TransferFromDeviceTime too frequent: 589 counts during 562 steps 2024-12-18T00:21:04.6842860Z 2024-12-18T00:21:04.6843077Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6843195Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6843501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6843614Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6843818Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6843975Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6844115Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6844467Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6844827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6845194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6845507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6845783Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6846166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6846470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6846774Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6846901Z Execution Analysis: (:1) 2024-12-18T00:21:04.6847173Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6847381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6847386Z 2024-12-18T00:21:04.6847599Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6847714Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6847950Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6848072Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6848284Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6848439Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6848590Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6848755Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6849360Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6849976Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6850350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6850740Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6851069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6851354Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6851672Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6851943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6852052Z Execution Analysis: .......... 2024-12-18T00:21:04.6852322Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6852530Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6852827Z pt-xla-profiler: TransferFromDeviceTime too frequent: 591 counts during 563 steps 2024-12-18T00:21:04.6852832Z 2024-12-18T00:21:04.6853039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6853166Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6853463Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6853587Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6853792Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6853939Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6854094Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6854265Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6854633Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6854985Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6855312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6855588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6855952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6856228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6856608Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6856749Z Execution Analysis: (:1) 2024-12-18T00:21:04.6857008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6857227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6857232Z 2024-12-18T00:21:04.6857432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6857563Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6857791Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6857904Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6858129Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6858272Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6858432Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6858600Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6859205Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6859808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6860168Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6860553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6860867Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6861152Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6861461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6861743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6861848Z Execution Analysis: .......... 2024-12-18T00:21:04.6862113Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6862315Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6862598Z pt-xla-profiler: TransferFromDeviceTime too frequent: 592 counts during 564 steps 2024-12-18T00:21:04.6862603Z 2024-12-18T00:21:04.6862815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6862931Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6863233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6863345Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6863559Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6863707Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6863847Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6864020Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6864377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6864737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6865051Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6865386Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6865699Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6865970Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6866273Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6866401Z Execution Analysis: (:1) 2024-12-18T00:21:04.6866666Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6866871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6866876Z 2024-12-18T00:21:04.6867088Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6867205Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6867445Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6867554Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6867766Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6867921Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6868068Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6868243Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6868974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6869707Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6870095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6870459Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6870771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6871046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6871366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6871638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6871764Z Execution Analysis: .......... 2024-12-18T00:21:04.6872025Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6872246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6872534Z pt-xla-profiler: TransferFromDeviceTime too frequent: 593 counts during 565 steps 2024-12-18T00:21:04.6872540Z 2024-12-18T00:21:04.6872746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6872869Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6873162Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6873283Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6873490Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6873652Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6873795Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6873964Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6874330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6874682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6875055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6875429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6875740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6876001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6876297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6876420Z Execution Analysis: (:1) 2024-12-18T00:21:04.6876669Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6876879Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6876885Z 2024-12-18T00:21:04.6877079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6877206Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6877430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6877549Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6877750Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6877889Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6878043Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6878230Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6878816Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6879397Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6879760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6880103Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6880418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6880684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6880984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6881256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6881363Z Execution Analysis: .......... 2024-12-18T00:21:04.6881620Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6881920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6882190Z pt-xla-profiler: TransferFromDeviceTime too frequent: 594 counts during 566 steps 2024-12-18T00:21:04.6882194Z 2024-12-18T00:21:04.6882379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6882492Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6882760Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6882865Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6883069Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6883203Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6883346Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6883501Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6883842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6884192Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6884554Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6884816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6885102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6885359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6885632Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6885761Z Execution Analysis: (:1) 2024-12-18T00:21:04.6885999Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6886190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6886204Z 2024-12-18T00:21:04.6886391Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6886499Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6886726Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6886829Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6887034Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6887168Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6887336Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6887499Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6888050Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6888618Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6888957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6889293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6889581Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6889845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6890132Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6890382Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6890489Z Execution Analysis: .......... 2024-12-18T00:21:04.6890728Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6890927Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6891191Z pt-xla-profiler: TransferFromDeviceTime too frequent: 595 counts during 567 steps 2024-12-18T00:21:04.6891196Z 2024-12-18T00:21:04.6891394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6891500Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6891780Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6891883Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6892076Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6892223Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6892356Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6892522Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6892848Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6893236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6893526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6893779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6894081Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6894334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6894620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6894738Z Execution Analysis: (:1) 2024-12-18T00:21:04.6894995Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6895189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6895195Z 2024-12-18T00:21:04.6895398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6895506Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6895724Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6895841Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6896036Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6896210Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6896418Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6896592Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6897364Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6897943Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6898322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6898673Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6899000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6899281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6899607Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6899878Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6900004Z Execution Analysis: .......... 2024-12-18T00:21:04.6900266Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6900475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6900776Z pt-xla-profiler: TransferFromDeviceTime too frequent: 596 counts during 568 steps 2024-12-18T00:21:04.6900781Z 2024-12-18T00:21:04.6900987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6901116Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6901413Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6901538Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6901747Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6901892Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6902051Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6902221Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6902657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6903009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6903337Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6903614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6903941Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6904214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6904507Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6904649Z Execution Analysis: (:1) 2024-12-18T00:21:04.6904909Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6905129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6905133Z 2024-12-18T00:21:04.6905336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6905461Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6905693Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6905834Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6906049Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6906195Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6906354Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6906525Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6907148Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6907729Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6908098Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6908452Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6908768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6909161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6909446Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6909707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6909806Z Execution Analysis: .......... 2024-12-18T00:21:04.6910059Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6910247Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6910511Z pt-xla-profiler: TransferFromDeviceTime too frequent: 597 counts during 569 steps 2024-12-18T00:21:04.6910527Z 2024-12-18T00:21:04.6910713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6910823Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6911105Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6911212Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6911415Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6911552Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6911717Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6911907Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6912240Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6912576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6912864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6913131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6913414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6913675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6913948Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6914067Z Execution Analysis: (:1) 2024-12-18T00:21:04.6914322Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6914516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6914520Z 2024-12-18T00:21:04.6914717Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6914827Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6915081Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6915184Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6915378Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6915523Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6915660Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6915853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6916407Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6916955Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6917289Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6917627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6918098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6918366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6918684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6918945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6919065Z Execution Analysis: .......... 2024-12-18T00:21:04.6919317Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6919526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6919804Z pt-xla-profiler: TransferFromDeviceTime too frequent: 598 counts during 570 steps 2024-12-18T00:21:04.6919810Z 2024-12-18T00:21:04.6920019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6920133Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6920417Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6920538Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6920741Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6920921Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6921089Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6921266Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6921615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6921956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6922276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6922546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6922857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6923120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6923421Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6923548Z Execution Analysis: (:1) 2024-12-18T00:21:04.6923800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6924008Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6924013Z 2024-12-18T00:21:04.6924211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6924358Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6924586Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6924704Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6924907Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6925059Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6925230Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6925396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6925982Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6926539Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6926896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6927241Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6927554Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6927825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6928143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6928409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6928514Z Execution Analysis: .......... 2024-12-18T00:21:04.6928780Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6928978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6929274Z pt-xla-profiler: TransferFromDeviceTime too frequent: 599 counts during 571 steps 2024-12-18T00:21:04.6929279Z 2024-12-18T00:21:04.6929478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6929603Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6929988Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6930094Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6930319Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6930479Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6930624Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6930780Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6931123Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6931446Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6931738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6932003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6932289Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6932556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6932834Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6932963Z Execution Analysis: (:1) 2024-12-18T00:21:04.6933204Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6933403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6933407Z 2024-12-18T00:21:04.6933621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6933728Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6933956Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6934057Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6934292Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6934427Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6934577Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6934737Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6935285Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6935828Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6936162Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6936592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6937060Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6937347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6937663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6937946Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6938057Z Execution Analysis: .......... 2024-12-18T00:21:04.6938318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6938537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6938826Z pt-xla-profiler: TransferFromDeviceTime too frequent: 600 counts during 572 steps 2024-12-18T00:21:04.6938830Z 2024-12-18T00:21:04.6939045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6939165Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6939469Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6939629Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6939865Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6940027Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6940172Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6940355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6940715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6941080Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6941393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6941686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6941997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6942274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6942582Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6942711Z Execution Analysis: (:1) 2024-12-18T00:21:04.6942985Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6943193Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6943223Z 2024-12-18T00:21:04.6943440Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6943555Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6943790Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6943940Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6944303Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6944490Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6944642Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6944826Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6945420Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6946010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6946374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6946729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6947057Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6947337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6947660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6947933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6948056Z Execution Analysis: .......... 2024-12-18T00:21:04.6948318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6948531Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6948832Z pt-xla-profiler: TransferFromDeviceTime too frequent: 601 counts during 573 steps 2024-12-18T00:21:04.6948837Z 2024-12-18T00:21:04.6949043Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6949178Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6949564Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6949693Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6949898Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6950058Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6950201Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6950370Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6950743Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6951093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6951419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6951694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6952022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6952294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6952584Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6952726Z Execution Analysis: (:1) 2024-12-18T00:21:04.6952986Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6953239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6953244Z 2024-12-18T00:21:04.6953448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6953570Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6953835Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6953962Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6954176Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6954320Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6954482Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6954652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6955257Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6955835Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6956312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6956640Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6956932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6957201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6957493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6957756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6957857Z Execution Analysis: .......... 2024-12-18T00:21:04.6958111Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6958300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6958576Z pt-xla-profiler: TransferFromDeviceTime too frequent: 602 counts during 574 steps 2024-12-18T00:21:04.6958580Z 2024-12-18T00:21:04.6958770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6958908Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6959213Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6959320Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6959525Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6959660Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6959805Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6959964Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6960295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6960634Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6960927Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6961197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6961486Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6961747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6962017Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6962136Z Execution Analysis: (:1) 2024-12-18T00:21:04.6962415Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6962604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6962608Z 2024-12-18T00:21:04.6962806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6962939Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6963167Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6963273Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6963479Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6963615Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6963754Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6963922Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6964631Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6965207Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6965557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6965909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6966218Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6966497Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6966795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6967058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6967177Z Execution Analysis: .......... 2024-12-18T00:21:04.6967426Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6967637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6967917Z pt-xla-profiler: TransferFromDeviceTime too frequent: 603 counts during 575 steps 2024-12-18T00:21:04.6967948Z 2024-12-18T00:21:04.6968183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6968297Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6968581Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6968704Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6968903Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6969056Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6969198Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6969373Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6969721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6970069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6970386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6970654Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6970964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6971225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6971522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6971672Z Execution Analysis: (:1) 2024-12-18T00:21:04.6971936Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6972136Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6972140Z 2024-12-18T00:21:04.6973627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6973790Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6974023Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6974145Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6974349Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6974501Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6974646Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6974812Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6975402Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6975968Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6976332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6976759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6977249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6977521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6977842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6978114Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6978224Z Execution Analysis: .......... 2024-12-18T00:21:04.6978495Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6978703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6979000Z pt-xla-profiler: TransferFromDeviceTime too frequent: 604 counts during 576 steps 2024-12-18T00:21:04.6979043Z 2024-12-18T00:21:04.6979271Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6979405Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6979698Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6979825Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6980029Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6980181Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6980341Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6980510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6980880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6981233Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6981562Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6981836Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6982146Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6982428Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6982749Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6982889Z Execution Analysis: (:1) 2024-12-18T00:21:04.6983147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6983390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6983395Z 2024-12-18T00:21:04.6983601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6983718Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6983965Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6984078Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6984311Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6984457Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6984622Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6984795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6985387Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6985977Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6986345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6986714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6987030Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6987321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6987634Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6987918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6988028Z Execution Analysis: .......... 2024-12-18T00:21:04.6988291Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6988516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6988854Z pt-xla-profiler: TransferFromDeviceTime too frequent: 605 counts during 577 steps 2024-12-18T00:21:04.6988859Z 2024-12-18T00:21:04.6989183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6989298Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6989600Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6989716Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6989933Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.6990078Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.6990221Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.6990402Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6990752Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.6991115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6991420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6991869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6992181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6992482Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6992790Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.6992916Z Execution Analysis: (:1) 2024-12-18T00:21:04.6993194Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6993425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6993432Z 2024-12-18T00:21:04.6993650Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6993768Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6994012Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.6994125Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6994337Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.6994502Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.6994654Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.6994841Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.6995437Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.6996025Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.6996392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.6996746Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.6997072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.6997348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.6997668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.6997937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.6998057Z Execution Analysis: .......... 2024-12-18T00:21:04.6998314Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.6998583Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6998874Z pt-xla-profiler: TransferFromDeviceTime too frequent: 606 counts during 578 steps 2024-12-18T00:21:04.6998879Z 2024-12-18T00:21:04.6999085Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.6999316Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.6999602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.6999724Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.6999926Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7000080Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7000220Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7000392Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7000752Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7001093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7001411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7001678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7001997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7002291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7002579Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7002716Z Execution Analysis: (:1) 2024-12-18T00:21:04.7002994Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7003213Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7003218Z 2024-12-18T00:21:04.7003415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7003541Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7003875Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7003990Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7004182Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7004316Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7004465Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7004622Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7005178Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7005712Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7006061Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7006387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7006686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7006943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7007230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7007493Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7007597Z Execution Analysis: .......... 2024-12-18T00:21:04.7007876Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7008091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7008370Z pt-xla-profiler: TransferFromDeviceTime too frequent: 607 counts during 579 steps 2024-12-18T00:21:04.7008374Z 2024-12-18T00:21:04.7008563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7008674Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7008960Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7009065Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7009270Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7009407Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7009562Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7009722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7010056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7010392Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7010684Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7010950Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7011273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7011535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7011810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7011965Z Execution Analysis: (:1) 2024-12-18T00:21:04.7012208Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7012401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7012405Z 2024-12-18T00:21:04.7012602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7012710Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7012937Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7013044Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7013250Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7013385Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7013525Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7013865Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7014446Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7015022Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7015376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7015889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7016206Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7016577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7016891Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7017163Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7017316Z Execution Analysis: .......... 2024-12-18T00:21:04.7017601Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7017820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7018105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 608 counts during 580 steps 2024-12-18T00:21:04.7018110Z 2024-12-18T00:21:04.7018328Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7018448Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7018750Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7018865Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7019071Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7019233Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7019380Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7019562Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7019923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7020286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7020600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7020902Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7021226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7021498Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7021830Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7021961Z Execution Analysis: (:1) 2024-12-18T00:21:04.7022234Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7022441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7022446Z 2024-12-18T00:21:04.7022663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7022781Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7023016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7023140Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7023352Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7023509Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7023661Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7023834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7024442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7025019Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7025396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7025751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7026080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7026357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7026680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7026977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7027110Z Execution Analysis: .......... 2024-12-18T00:21:04.7027385Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7027590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7027886Z pt-xla-profiler: TransferFromDeviceTime too frequent: 609 counts during 581 steps 2024-12-18T00:21:04.7027893Z 2024-12-18T00:21:04.7028097Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7028227Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7028521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7028646Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7028855Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7029003Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7029162Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7029333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7029705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7030059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7030410Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7030684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7030998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7031307Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7031608Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7031753Z Execution Analysis: (:1) 2024-12-18T00:21:04.7032015Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7032235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7032240Z 2024-12-18T00:21:04.7032449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7032583Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7032819Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7032931Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7033161Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7033310Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7033475Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7033649Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7034258Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7034839Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7035205Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7035575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7035889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7036184Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7036575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7036889Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7037000Z Execution Analysis: .......... 2024-12-18T00:21:04.7037272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7037484Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7037773Z pt-xla-profiler: TransferFromDeviceTime too frequent: 610 counts during 582 steps 2024-12-18T00:21:04.7037778Z 2024-12-18T00:21:04.7037998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7038117Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7038431Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7038547Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7038767Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7038915Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7039063Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7039245Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7039605Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7039971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7040316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7040602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7040938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7041223Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7041526Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7041657Z Execution Analysis: (:1) 2024-12-18T00:21:04.7041932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7042137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7042143Z 2024-12-18T00:21:04.7042357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7042473Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7042720Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7042832Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7043043Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7043201Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7043356Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7043536Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7044129Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7044888Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7045254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7045620Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7045937Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7046214Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7046648Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7046921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7047049Z Execution Analysis: .......... 2024-12-18T00:21:04.7047308Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7047524Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7047817Z pt-xla-profiler: TransferFromDeviceTime too frequent: 612 counts during 583 steps 2024-12-18T00:21:04.7047821Z 2024-12-18T00:21:04.7048039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7048159Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7048455Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7048586Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7048795Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7048956Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7049100Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7049270Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7049644Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7050032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7050355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7050635Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7050989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7051266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7051571Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7051699Z Execution Analysis: (:1) 2024-12-18T00:21:04.7051960Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7052178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7052184Z 2024-12-18T00:21:04.7052388Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7052516Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7052749Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7052874Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7053086Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7053234Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7053397Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7053566Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7054170Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7054748Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7055120Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7055476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7055802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7056128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7056517Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7056807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7056918Z Execution Analysis: .......... 2024-12-18T00:21:04.7057193Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7057403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7057705Z pt-xla-profiler: TransferFromDeviceTime too frequent: 613 counts during 584 steps 2024-12-18T00:21:04.7057710Z 2024-12-18T00:21:04.7057918Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7058052Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7058350Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7058464Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7058683Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7058831Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7058989Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7059159Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7059556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7059908Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7060221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7060534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7060848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7061131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7061425Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7061563Z Execution Analysis: (:1) 2024-12-18T00:21:04.7061824Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7062033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7062050Z 2024-12-18T00:21:04.7062254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7062371Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7062618Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7062733Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7062956Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7063106Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7063255Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7063436Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7064028Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7064621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7064983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7065351Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7065717Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7066005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7066316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7066597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7066706Z Execution Analysis: .......... 2024-12-18T00:21:04.7066966Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7067182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7067469Z pt-xla-profiler: TransferFromDeviceTime too frequent: 614 counts during 585 steps 2024-12-18T00:21:04.7067475Z 2024-12-18T00:21:04.7067694Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7067816Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7068129Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7068243Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7068450Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7068609Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7068752Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7068962Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7069322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7069689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7070027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7070309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7070632Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7070902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7071213Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7071343Z Execution Analysis: (:1) 2024-12-18T00:21:04.7071618Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7071824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7071829Z 2024-12-18T00:21:04.7072051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7072168Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7072404Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7072534Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7072744Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7072902Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7073053Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7073235Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7073829Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7074405Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7074781Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7075186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7075515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7075795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7076221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7076485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7076609Z Execution Analysis: .......... 2024-12-18T00:21:04.7076863Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7077064Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7077352Z pt-xla-profiler: TransferFromDeviceTime too frequent: 615 counts during 586 steps 2024-12-18T00:21:04.7077358Z 2024-12-18T00:21:04.7077565Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7077690Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7077977Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7078100Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7078303Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7078474Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7078629Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7078795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7079159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7079544Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7079860Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7080132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7080445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7080711Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7081000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7081139Z Execution Analysis: (:1) 2024-12-18T00:21:04.7081392Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7081602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7081606Z 2024-12-18T00:21:04.7081807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7081936Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7082164Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7082274Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7082491Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7082635Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7082793Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7082962Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7083548Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7084111Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7084473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7084883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7085191Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7085471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7085776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7086050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7086155Z Execution Analysis: .......... 2024-12-18T00:21:04.7086418Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7086618Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7086898Z pt-xla-profiler: TransferFromDeviceTime too frequent: 616 counts during 587 steps 2024-12-18T00:21:04.7086916Z 2024-12-18T00:21:04.7087114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7087229Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7087529Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7087639Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7087877Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7088020Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7088172Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7088336Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7088879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7089241Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7089559Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7089842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7090152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7090432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7090727Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7090854Z Execution Analysis: (:1) 2024-12-18T00:21:04.7091123Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7091329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7091335Z 2024-12-18T00:21:04.7091549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7091665Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7091907Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7092017Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7092227Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7092383Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7092534Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7092715Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7093311Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7093902Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7094316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7094681Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7094996Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7095274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7095596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7095869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7095988Z Execution Analysis: .......... 2024-12-18T00:21:04.7096250Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7096539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7096833Z pt-xla-profiler: TransferFromDeviceTime too frequent: 617 counts during 588 steps 2024-12-18T00:21:04.7096839Z 2024-12-18T00:21:04.7097058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7097179Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7097472Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7097628Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7097838Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7097993Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7098139Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7098316Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7098698Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7099057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7099380Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7099656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7099977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7100250Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7100556Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7100684Z Execution Analysis: (:1) 2024-12-18T00:21:04.7100948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7101165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7101171Z 2024-12-18T00:21:04.7101379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7101504Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7101738Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7101859Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7102069Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7102227Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7102375Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7102547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7103154Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7103775Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7104147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7104502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7104823Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7105103Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7105423Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7105693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7105801Z Execution Analysis: .......... 2024-12-18T00:21:04.7106070Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7106279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7106578Z pt-xla-profiler: TransferFromDeviceTime too frequent: 618 counts during 589 steps 2024-12-18T00:21:04.7106583Z 2024-12-18T00:21:04.7106787Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7106912Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7107233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7107347Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7107563Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7107710Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7107862Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7108056Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7108430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7108782Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7109186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7109449Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7109739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7109994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7110264Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7110389Z Execution Analysis: (:1) 2024-12-18T00:21:04.7110630Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7110831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7110836Z 2024-12-18T00:21:04.7111024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7111133Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7111355Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7111458Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7111665Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7111800Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7111948Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7112105Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7112657Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7113249Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7113751Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7114105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7114415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7114691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7114994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7115268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7115375Z Execution Analysis: .......... 2024-12-18T00:21:04.7115635Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7115844Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7116122Z pt-xla-profiler: TransferFromDeviceTime too frequent: 619 counts during 590 steps 2024-12-18T00:21:04.7116127Z 2024-12-18T00:21:04.7116337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7116476Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7116773Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7116884Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7117083Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7117273Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7117414Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7117595Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7117947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7118297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7118601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7123558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7123940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7124215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7124522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7124649Z Execution Analysis: (:1) 2024-12-18T00:21:04.7124937Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7125144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7125151Z 2024-12-18T00:21:04.7125364Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7125588Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7125813Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7125936Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7126141Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7126294Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7126436Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7126600Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7127287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7127846Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7128208Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7128551Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7128872Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7129140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7129450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7129709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7129824Z Execution Analysis: .......... 2024-12-18T00:21:04.7130083Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7130278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7130569Z pt-xla-profiler: TransferFromDeviceTime too frequent: 620 counts during 591 steps 2024-12-18T00:21:04.7130574Z 2024-12-18T00:21:04.7130800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7130923Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7131207Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7131329Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7131559Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7131700Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7131851Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7132013Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7132372Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7132711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7133020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7133288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7133588Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7133854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7134134Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7134269Z Execution Analysis: (:1) 2024-12-18T00:21:04.7134518Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7134725Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7134731Z 2024-12-18T00:21:04.7134926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7135046Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7135269Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7135373Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7135584Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7135720Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7135871Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7136057Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7136948Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7137525Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7137881Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7138244Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7138551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7138839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7139148Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7139428Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7139532Z Execution Analysis: .......... 2024-12-18T00:21:04.7139798Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7140000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7140283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 621 counts during 592 steps 2024-12-18T00:21:04.7140315Z 2024-12-18T00:21:04.7140527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7140637Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7140934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7141067Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7141282Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7141430Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7141572Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7141750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7142103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7142463Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7142775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7143051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7143356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7143633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7143926Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7144047Z Execution Analysis: (:1) 2024-12-18T00:21:04.7144513Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7144718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7144723Z 2024-12-18T00:21:04.7144936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7145049Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7145288Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7145399Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7145608Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7145766Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7145979Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7146194Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7146789Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7147373Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7147736Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7148099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7148413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7148689Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7149012Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7149275Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7149390Z Execution Analysis: .......... 2024-12-18T00:21:04.7149647Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7149855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7150174Z pt-xla-profiler: TransferFromDeviceTime too frequent: 622 counts during 593 steps 2024-12-18T00:21:04.7150179Z 2024-12-18T00:21:04.7150387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7150502Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7150828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7150952Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7151158Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7151314Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7151457Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7151623Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7151987Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7152338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7152660Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7152932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7153251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7153518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7153821Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7153945Z Execution Analysis: (:1) 2024-12-18T00:21:04.7154200Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7154409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7154416Z 2024-12-18T00:21:04.7154615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7154735Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7154960Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7155082Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7155289Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7155458Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7155637Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7155801Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7156491Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7157022Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7157366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7157687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7157987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7158241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7158527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7158778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7158876Z Execution Analysis: .......... 2024-12-18T00:21:04.7159122Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7159347Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7159615Z pt-xla-profiler: TransferFromDeviceTime too frequent: 623 counts during 594 steps 2024-12-18T00:21:04.7159619Z 2024-12-18T00:21:04.7159806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7159940Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7160212Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7160318Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7160512Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7160645Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7160787Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7160941Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7161274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7161598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7161885Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7162146Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7162433Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7162689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7162958Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7163078Z Execution Analysis: (:1) 2024-12-18T00:21:04.7163315Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7163500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7163512Z 2024-12-18T00:21:04.7163698Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7163803Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7164023Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7164125Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7164349Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7164505Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7164645Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7164802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7165348Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7165885Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7166389Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7166740Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7167040Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7167315Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7167611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7167876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7167980Z Execution Analysis: .......... 2024-12-18T00:21:04.7168233Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7168461Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7168739Z pt-xla-profiler: TransferFromDeviceTime too frequent: 624 counts during 595 steps 2024-12-18T00:21:04.7168744Z 2024-12-18T00:21:04.7168968Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7169083Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7169371Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7169478Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7169677Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7169825Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7169965Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7170138Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7170488Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7170835Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7171141Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7171405Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7171715Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7171972Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7172262Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7172382Z Execution Analysis: (:1) 2024-12-18T00:21:04.7172642Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7172840Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7172845Z 2024-12-18T00:21:04.7173046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7173156Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7173378Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7173514Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7173741Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7173886Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7174027Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7174195Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7174770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7175328Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7175684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7176025Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7176407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7176677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7177150Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7177417Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7177564Z Execution Analysis: .......... 2024-12-18T00:21:04.7177821Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7178022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7178338Z pt-xla-profiler: TransferFromDeviceTime too frequent: 625 counts during 596 steps 2024-12-18T00:21:04.7178344Z 2024-12-18T00:21:04.7178550Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7178674Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7178963Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7179080Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7179284Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7179427Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7179577Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7179742Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7180106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7180455Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7180770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7181045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7181358Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7181625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7181913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7182045Z Execution Analysis: (:1) 2024-12-18T00:21:04.7182299Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7182502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7182507Z 2024-12-18T00:21:04.7182706Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7182849Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7183102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7183210Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7183419Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7183557Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7183705Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7183870Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7184468Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7185043Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7185410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7185764Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7186076Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7186354Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7186659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7186958Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7187061Z Execution Analysis: .......... 2024-12-18T00:21:04.7187319Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7187521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7187885Z pt-xla-profiler: TransferFromDeviceTime too frequent: 626 counts during 597 steps 2024-12-18T00:21:04.7187901Z 2024-12-18T00:21:04.7188109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7188223Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7188521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7188632Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7188842Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7189093Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7189230Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7189384Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7189715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7190046Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7190337Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7190595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7190877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7191131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7191397Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7191515Z Execution Analysis: (:1) 2024-12-18T00:21:04.7191761Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7191951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7191956Z 2024-12-18T00:21:04.7192151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7192318Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7192541Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7192641Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7192830Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7192967Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7193102Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7193264Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7193809Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7194346Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7194678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7195004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7195291Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7195543Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7195832Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7196104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7196213Z Execution Analysis: .......... 2024-12-18T00:21:04.7196449Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7196664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7196933Z pt-xla-profiler: TransferFromDeviceTime too frequent: 627 counts during 598 steps 2024-12-18T00:21:04.7196937Z 2024-12-18T00:21:04.7197125Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7197227Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7197493Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7197603Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7197795Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7197935Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7198066Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7198228Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7198557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7198880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7199174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7199426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7199718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7199964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7200235Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7200351Z Execution Analysis: (:1) 2024-12-18T00:21:04.7200586Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7200783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7200811Z 2024-12-18T00:21:04.7201019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7201130Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7201341Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7201448Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7201638Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7201774Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7201911Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7202066Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7202618Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7203145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7203484Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7203810Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7204100Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7204350Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7204664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7204909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7205007Z Execution Analysis: .......... 2024-12-18T00:21:04.7205278Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7205468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7205736Z pt-xla-profiler: TransferFromDeviceTime too frequent: 628 counts during 599 steps 2024-12-18T00:21:04.7205741Z 2024-12-18T00:21:04.7205927Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7206037Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7206302Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7206405Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7206602Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7206734Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7206871Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7207027Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7207360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7207686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7207971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7208230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7208511Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7208766Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7209033Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7209151Z Execution Analysis: (:1) 2024-12-18T00:21:04.7209388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7209604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7209632Z 2024-12-18T00:21:04.7209822Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7209926Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7210145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7210244Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7210444Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7210577Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7210726Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7210883Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7211431Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7211974Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7212309Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7212644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7212935Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7213225Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7213514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7213776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7213905Z Execution Analysis: .......... 2024-12-18T00:21:04.7214144Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7214347Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7214615Z pt-xla-profiler: TransferFromDeviceTime too frequent: 629 counts during 600 steps 2024-12-18T00:21:04.7214619Z 2024-12-18T00:21:04.7214815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7214926Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7215206Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7215309Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7215505Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7215641Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7215775Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7215947Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7216285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7216699Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7217175Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7217459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7217775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7218042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7218347Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7218475Z Execution Analysis: (:1) 2024-12-18T00:21:04.7218744Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7219683Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7219688Z 2024-12-18T00:21:04.7219898Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7220014Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7220247Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7220371Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7220581Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7220734Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7220884Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7221064Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7221660Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7222249Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7222612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7222965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7223318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7223591Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7223907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7224202Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7224321Z Execution Analysis: .......... 2024-12-18T00:21:04.7224582Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7224781Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7225075Z pt-xla-profiler: TransferFromDeviceTime too frequent: 630 counts during 601 steps 2024-12-18T00:21:04.7225080Z 2024-12-18T00:21:04.7225283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7225410Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7225702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7225823Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7226032Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7226183Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7226328Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7226494Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7226861Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7227214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7227531Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7227808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7228126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7228394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7228685Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7228863Z Execution Analysis: (:1) 2024-12-18T00:21:04.7229244Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7229446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7229450Z 2024-12-18T00:21:04.7229639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7229753Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7229969Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7230079Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7230273Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7230407Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7230554Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7230714Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7231273Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7231804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7232141Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7232503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7232790Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7233054Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7233362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7233624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7233726Z Execution Analysis: .......... 2024-12-18T00:21:04.7233972Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7234163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7234432Z pt-xla-profiler: TransferFromDeviceTime too frequent: 631 counts during 602 steps 2024-12-18T00:21:04.7234438Z 2024-12-18T00:21:04.7234626Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7234736Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7235017Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7235124Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7235329Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7235466Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7235610Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7235767Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7236094Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7236429Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7236719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7236985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7237270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7237528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7237797Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7237971Z Execution Analysis: (:1) 2024-12-18T00:21:04.7238211Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7238398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7238402Z 2024-12-18T00:21:04.7238597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7238705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7238926Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7239029Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7239231Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7239367Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7239503Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7239670Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7240221Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7240758Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7241093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7241449Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7241740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7242026Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7242315Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7242564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7242674Z Execution Analysis: .......... 2024-12-18T00:21:04.7242914Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7243107Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7243374Z pt-xla-profiler: TransferFromDeviceTime too frequent: 633 counts during 603 steps 2024-12-18T00:21:04.7243378Z 2024-12-18T00:21:04.7243573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7243679Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7243948Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7244060Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7244461Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7244817Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7244963Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7245140Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7245498Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7245846Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7246175Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7246445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7246762Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7247033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7247433Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7247560Z Execution Analysis: (:1) 2024-12-18T00:21:04.7247827Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7248029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7248033Z 2024-12-18T00:21:04.7248237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7248362Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7248595Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7248715Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7248925Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7249075Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7249228Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7249396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7249998Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7250570Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7250976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7251330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7251652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7251959Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7252279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7252549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7252654Z Execution Analysis: .......... 2024-12-18T00:21:04.7252924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7253128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7253421Z pt-xla-profiler: TransferFromDeviceTime too frequent: 634 counts during 604 steps 2024-12-18T00:21:04.7253426Z 2024-12-18T00:21:04.7253629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7253748Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7254043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7254164Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7254370Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7254510Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7254665Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7254834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7255200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7255556Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7255877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7256155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7256535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7256881Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7257178Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7257316Z Execution Analysis: (:1) 2024-12-18T00:21:04.7257576Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7257789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7257796Z 2024-12-18T00:21:04.7258000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7258125Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7258360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7258474Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7258696Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7258847Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7259008Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7259177Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7259769Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7260353Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7260738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7261099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7261449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7261735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7262045Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7262323Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7262432Z Execution Analysis: .......... 2024-12-18T00:21:04.7262689Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7262901Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7263187Z pt-xla-profiler: TransferFromDeviceTime too frequent: 635 counts during 605 steps 2024-12-18T00:21:04.7263192Z 2024-12-18T00:21:04.7263407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7263524Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7263826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7263941Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7264158Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7264305Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7264450Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7264634Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7264994Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7265356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7265669Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7265949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7266285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7266578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7266884Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7267010Z Execution Analysis: (:1) 2024-12-18T00:21:04.7267277Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7267483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7267487Z 2024-12-18T00:21:04.7267695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7267808Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7268044Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7268155Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7268467Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7268609Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7268745Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7268908Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7269452Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7270013Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7270345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7270689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7270989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7271244Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7271538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7271790Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7271895Z Execution Analysis: .......... 2024-12-18T00:21:04.7272135Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7272329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7272592Z pt-xla-profiler: TransferFromDeviceTime too frequent: 636 counts during 606 steps 2024-12-18T00:21:04.7272596Z 2024-12-18T00:21:04.7272781Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7272900Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7273173Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7273287Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7273477Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7273617Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7273750Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7273906Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7274252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7274577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7274877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7275158Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7275475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7275726Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7275998Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7276115Z Execution Analysis: (:1) 2024-12-18T00:21:04.7276353Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7276548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7276552Z 2024-12-18T00:21:04.7276739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7276856Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7277071Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7277182Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7277376Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7277506Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7277654Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7277811Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7278367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7278925Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7279286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7279615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7279915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7280170Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7280456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7280715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7280818Z Execution Analysis: .......... 2024-12-18T00:21:04.7281066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7281254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7281527Z pt-xla-profiler: TransferFromDeviceTime too frequent: 637 counts during 607 steps 2024-12-18T00:21:04.7281533Z 2024-12-18T00:21:04.7281723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7281836Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7282106Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7282211Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7282408Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7282542Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7282685Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7282839Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7283167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7283499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7283787Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7284101Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7284388Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7284646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7284918Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7285041Z Execution Analysis: (:1) 2024-12-18T00:21:04.7285281Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7285467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7285471Z 2024-12-18T00:21:04.7285672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7285780Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7286001Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7286102Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7286302Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7286438Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7286570Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7286733Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7287305Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7287843Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7288202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7288540Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7288827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7289089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7289374Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7289618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7289724Z Execution Analysis: .......... 2024-12-18T00:21:04.7289964Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7290161Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7290424Z pt-xla-profiler: TransferFromDeviceTime too frequent: 638 counts during 608 steps 2024-12-18T00:21:04.7290430Z 2024-12-18T00:21:04.7290628Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7290735Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7291011Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7291116Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7291304Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7291448Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7291580Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7291745Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7292074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7292407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7292748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7293001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7293293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7293540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7293820Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7293940Z Execution Analysis: (:1) 2024-12-18T00:21:04.7294186Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7294381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7294385Z 2024-12-18T00:21:04.7294580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7294686Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7294901Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7295008Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7295202Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7295340Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7295513Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7295666Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7296227Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7297028Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7297402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7297754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7298073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7298349Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7298667Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7298936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7299050Z Execution Analysis: .......... 2024-12-18T00:21:04.7299309Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7299516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7299821Z pt-xla-profiler: TransferFromDeviceTime too frequent: 639 counts during 609 steps 2024-12-18T00:21:04.7299826Z 2024-12-18T00:21:04.7300028Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7300158Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7300452Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7300578Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7300784Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7300932Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7301085Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7301255Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7301626Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7302033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7302358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7302638Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7302949Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7303229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7303525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7303664Z Execution Analysis: (:1) 2024-12-18T00:21:04.7303924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7304142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7304148Z 2024-12-18T00:21:04.7304356Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7304482Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7304717Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7304832Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7305054Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7305227Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7305390Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7305561Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7306164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7306768Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7307136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7307503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7307822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7308110Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7308420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7308702Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7308810Z Execution Analysis: .......... 2024-12-18T00:21:04.7309188Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7309388Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7309667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 640 counts during 610 steps 2024-12-18T00:21:04.7309672Z 2024-12-18T00:21:04.7309879Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7309991Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7310291Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7310405Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7310618Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7310757Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7310897Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7311068Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7311443Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7311819Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7312128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7312404Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7312703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7312974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7313259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7313383Z Execution Analysis: (:1) 2024-12-18T00:21:04.7313645Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7314020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7314024Z 2024-12-18T00:21:04.7314235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7314349Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7314590Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7314702Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7314936Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7315090Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7315238Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7315420Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7316036Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7316720Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7317070Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7317428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7317902Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7318181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7318498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7318768Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7318885Z Execution Analysis: .......... 2024-12-18T00:21:04.7319148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7319360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7319643Z pt-xla-profiler: TransferFromDeviceTime too frequent: 641 counts during 611 steps 2024-12-18T00:21:04.7319647Z 2024-12-18T00:21:04.7319861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7319977Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7320271Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7320388Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7320593Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7320749Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7320895Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7321090Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7321478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7321831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7322154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7322431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7322756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7323025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7323326Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7323454Z Execution Analysis: (:1) 2024-12-18T00:21:04.7323714Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7323931Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7323935Z 2024-12-18T00:21:04.7324141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7324269Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7324502Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7324652Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7324861Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7325006Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7325165Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7325362Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7325967Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7326544Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7326913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7327267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7327591Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7327865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7328173Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7328453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7328563Z Execution Analysis: .......... 2024-12-18T00:21:04.7328832Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7329036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7329333Z pt-xla-profiler: TransferFromDeviceTime too frequent: 642 counts during 612 steps 2024-12-18T00:21:04.7329338Z 2024-12-18T00:21:04.7329541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7329669Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7329962Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7330076Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7330287Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7330435Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7330615Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7330821Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7331192Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7331542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7331854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7332140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7332448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7332726Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7333022Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7333158Z Execution Analysis: (:1) 2024-12-18T00:21:04.7333417Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7333622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7333634Z 2024-12-18T00:21:04.7333837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7333952Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7334266Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7334379Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7334597Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7334742Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7334923Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7335091Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7335688Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7336275Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7336722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7337090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7337403Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7337691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7338001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7338280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7338389Z Execution Analysis: .......... 2024-12-18T00:21:04.7338649Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7338866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7339153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 643 counts during 613 steps 2024-12-18T00:21:04.7339160Z 2024-12-18T00:21:04.7339373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7339488Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7339792Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7339904Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7340111Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7340298Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7340468Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7340648Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7341006Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7341369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7341683Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7341958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7342276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7342548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7342850Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7342979Z Execution Analysis: (:1) 2024-12-18T00:21:04.7343246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7343448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7343452Z 2024-12-18T00:21:04.7343662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7343804Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7344037Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7344325Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7344544Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7344771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7344926Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7345111Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7345705Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7346284Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7346661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7347013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7347339Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7347618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7347945Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7348220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7348337Z Execution Analysis: .......... 2024-12-18T00:21:04.7348596Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7348804Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7349099Z pt-xla-profiler: TransferFromDeviceTime too frequent: 644 counts during 614 steps 2024-12-18T00:21:04.7349104Z 2024-12-18T00:21:04.7349309Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7349434Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7349728Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7349890Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7350128Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7350279Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7350437Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7350609Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7350976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7351326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7351651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7351925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7352250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7352521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7352819Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7352954Z Execution Analysis: (:1) 2024-12-18T00:21:04.7353215Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7353432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7353472Z 2024-12-18T00:21:04.7353676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7353801Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7354033Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7354151Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7354395Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7354546Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7354704Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7354872Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7355479Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7356056Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7356522Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7356850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7357142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7357402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7357691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7357945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7358045Z Execution Analysis: .......... 2024-12-18T00:21:04.7358295Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7358481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7358747Z pt-xla-profiler: TransferFromDeviceTime too frequent: 645 counts during 615 steps 2024-12-18T00:21:04.7358758Z 2024-12-18T00:21:04.7358946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7359055Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7359332Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7359485Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7359685Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7359825Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7359967Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7360126Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7360459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7360793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7361083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7361347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7361633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7361893Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7362164Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7362282Z Execution Analysis: (:1) 2024-12-18T00:21:04.7362532Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7362722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7362750Z 2024-12-18T00:21:04.7362946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7363053Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7363280Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7363407Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7363613Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7363750Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7363887Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7364053Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7364602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7365139Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7365472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7365806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7366098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7366356Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7366649Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7366899Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7367008Z Execution Analysis: .......... 2024-12-18T00:21:04.7367249Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7367448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7367713Z pt-xla-profiler: TransferFromDeviceTime too frequent: 646 counts during 616 steps 2024-12-18T00:21:04.7367717Z 2024-12-18T00:21:04.7367919Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7368074Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7368370Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7368485Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7368679Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7368831Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7368967Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7369139Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7369475Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7369802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7370104Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7370360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7370661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7370911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7371189Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7371308Z Execution Analysis: (:1) 2024-12-18T00:21:04.7371550Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7371771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7371775Z 2024-12-18T00:21:04.7371963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7372080Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7372317Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7372431Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7372626Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7372773Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7372911Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7373069Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7373623Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7374154Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7374498Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7374825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7375123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7375380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7375673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7375924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7376026Z Execution Analysis: .......... 2024-12-18T00:21:04.7376272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7376554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7377001Z pt-xla-profiler: TransferFromDeviceTime too frequent: 647 counts during 617 steps 2024-12-18T00:21:04.7377007Z 2024-12-18T00:21:04.7377210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7377390Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7377684Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7377808Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7378026Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7378172Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7378329Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7378500Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7378868Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7379220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7379533Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7379814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7380121Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7380396Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7380694Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7380830Z Execution Analysis: (:1) 2024-12-18T00:21:04.7381117Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7381332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7381337Z 2024-12-18T00:21:04.7381567Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7381685Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7381925Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7382042Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7382263Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7382409Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7382567Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7382738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7383331Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7383911Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7384276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7384642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7384954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7385239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7385547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7385825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7385933Z Execution Analysis: .......... 2024-12-18T00:21:04.7386191Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7386405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7386691Z pt-xla-profiler: TransferFromDeviceTime too frequent: 648 counts during 618 steps 2024-12-18T00:21:04.7386720Z 2024-12-18T00:21:04.7386959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7387077Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7387379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7387490Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7387702Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7387847Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7387991Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7388167Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7388527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7388889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7389293Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7389566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7389852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7390100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7390386Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7390532Z Execution Analysis: (:1) 2024-12-18T00:21:04.7390788Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7390985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7390989Z 2024-12-18T00:21:04.7391217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7391327Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7391560Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7391665Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7391863Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7392014Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7392154Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7392328Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7392879Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7393426Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7393763Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7394096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7394401Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7394657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7394960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7395212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7395328Z Execution Analysis: .......... 2024-12-18T00:21:04.7395569Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7395761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7396069Z pt-xla-profiler: TransferFromDeviceTime too frequent: 649 counts during 619 steps 2024-12-18T00:21:04.7396097Z 2024-12-18T00:21:04.7396287Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7396408Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7396683Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7396800Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7396996Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7397146Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7397279Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7397440Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7397789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7398119Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7398429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7398686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7398989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7399240Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7399539Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7399668Z Execution Analysis: (:1) 2024-12-18T00:21:04.7399908Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7400142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7400148Z 2024-12-18T00:21:04.7400339Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7400460Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7400676Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7400793Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7400988Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7401124Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7401273Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7401428Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7401988Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7402519Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7402871Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7403197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7403486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7403752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7404039Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7404300Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7406877Z Execution Analysis: .......... 2024-12-18T00:21:04.7407153Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7407354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7407679Z pt-xla-profiler: TransferFromDeviceTime too frequent: 650 counts during 620 steps 2024-12-18T00:21:04.7407685Z 2024-12-18T00:21:04.7407899Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7408011Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7408310Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7408425Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7408641Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7408786Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7408927Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7409124Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7409488Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7409834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7410153Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7410423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7410724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7411033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7411319Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7411455Z Execution Analysis: (:1) 2024-12-18T00:21:04.7411739Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7411952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7411957Z 2024-12-18T00:21:04.7412159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7412283Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7412513Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7412625Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7412844Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7412989Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7413145Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7413311Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7413906Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7414468Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7414820Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7415178Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7415485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7415767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7416071Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7416441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7416626Z Execution Analysis: .......... 2024-12-18T00:21:04.7417066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7417302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7417594Z pt-xla-profiler: TransferFromDeviceTime too frequent: 651 counts during 621 steps 2024-12-18T00:21:04.7417599Z 2024-12-18T00:21:04.7417818Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7417937Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7418247Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7418361Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7418581Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7418730Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7418875Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7419058Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7419419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7419783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7420096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7420379Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7420715Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7420998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7421290Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7421420Z Execution Analysis: (:1) 2024-12-18T00:21:04.7421716Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7421925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7421930Z 2024-12-18T00:21:04.7422143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7422260Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7422504Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7422616Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7422826Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7422981Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7423129Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7423311Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7423910Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7424501Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7424862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7425228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7425543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7425819Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7426141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7426457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7426576Z Execution Analysis: .......... 2024-12-18T00:21:04.7426864Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7427080Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7427365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 652 counts during 622 steps 2024-12-18T00:21:04.7427370Z 2024-12-18T00:21:04.7427588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7427705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7427998Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7428123Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7428330Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7428496Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7428640Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7428914Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7429373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7429700Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7430001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7430255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7430578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7430829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7431115Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7431256Z Execution Analysis: (:1) 2024-12-18T00:21:04.7431502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7431703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7431707Z 2024-12-18T00:21:04.7431897Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7432017Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7432233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7432351Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7432546Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7432683Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7432837Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7432998Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7433562Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7434094Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7434443Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7434770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7435074Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7435328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7435646Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7435907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7436007Z Execution Analysis: .......... 2024-12-18T00:21:04.7436285Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7436475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7436751Z pt-xla-profiler: TransferFromDeviceTime too frequent: 654 counts during 623 steps 2024-12-18T00:21:04.7436756Z 2024-12-18T00:21:04.7436947Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7437068Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7437342Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7437451Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7437656Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7437792Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7437940Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7438097Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7438442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7438769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7439061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7439371Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7439658Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7439922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7440219Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7440354Z Execution Analysis: (:1) 2024-12-18T00:21:04.7440596Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7440788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7440803Z 2024-12-18T00:21:04.7440995Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7441106Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7441338Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7441445Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7441652Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7441789Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7441942Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7442102Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7442651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7443194Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7443531Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7443870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7444312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7444832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7445146Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7445463Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7445573Z Execution Analysis: .......... 2024-12-18T00:21:04.7445836Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7446053Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7446340Z pt-xla-profiler: TransferFromDeviceTime too frequent: 655 counts during 624 steps 2024-12-18T00:21:04.7446348Z 2024-12-18T00:21:04.7446564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7446684Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7446992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7447107Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7447315Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7447472Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7447615Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7447796Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7448158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7448523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7448877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7449152Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7449476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7449779Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7450085Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7450215Z Execution Analysis: (:1) 2024-12-18T00:21:04.7450483Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7450687Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7450691Z 2024-12-18T00:21:04.7450905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7451022Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7451253Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7451373Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7451585Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7451746Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7451895Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7452076Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7452674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7453249Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7453626Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7453979Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7454334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7454612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7455240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7455515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7455640Z Execution Analysis: .......... 2024-12-18T00:21:04.7455902Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7456106Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7456485Z pt-xla-profiler: TransferFromDeviceTime too frequent: 656 counts during 625 steps 2024-12-18T00:21:04.7456491Z 2024-12-18T00:21:04.7456697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7456824Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7457121Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7457246Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7457456Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7457603Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7457766Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7457936Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7458308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7458694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7459018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7459294Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7459644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7459914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7460210Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7460350Z Execution Analysis: (:1) 2024-12-18T00:21:04.7460609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7460830Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7460836Z 2024-12-18T00:21:04.7461040Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7461173Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7461408Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7461522Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7461746Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7461891Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7462057Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7462226Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7462830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7463406Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7463781Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7464134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7464481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7464767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7465104Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7465388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7465498Z Execution Analysis: .......... 2024-12-18T00:21:04.7465770Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7465976Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7466266Z pt-xla-profiler: TransferFromDeviceTime too frequent: 657 counts during 626 steps 2024-12-18T00:21:04.7466281Z 2024-12-18T00:21:04.7466487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7466606Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7466910Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7467026Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7467242Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7467389Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7467545Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7467715Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7468074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7468563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7468855Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7469148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7469435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7469696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7469970Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7470090Z Execution Analysis: (:1) 2024-12-18T00:21:04.7470342Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7470533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7470538Z 2024-12-18T00:21:04.7470735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7470843Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7471069Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7471171Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7471364Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7471511Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7471647Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7471815Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7472366Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7472911Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7473242Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7473608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7473899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7474191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7474488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7474738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7474848Z Execution Analysis: .......... 2024-12-18T00:21:04.7475089Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7475288Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7475551Z pt-xla-profiler: TransferFromDeviceTime too frequent: 658 counts during 627 steps 2024-12-18T00:21:04.7475557Z 2024-12-18T00:21:04.7475759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7475868Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7476141Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7476262Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7476453Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7476599Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7476736Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7476933Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7477263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7477588Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7477919Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7478176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7478477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7478726Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7479013Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7479131Z Execution Analysis: (:1) 2024-12-18T00:21:04.7479370Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7479573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7479577Z 2024-12-18T00:21:04.7479767Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7479887Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7480102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7480217Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7480423Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7480555Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7480692Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7480853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7481403Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7481939Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7482299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7482636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7483002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7483268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7483553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7483805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7483919Z Execution Analysis: .......... 2024-12-18T00:21:04.7484160Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7484358Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7484627Z pt-xla-profiler: TransferFromDeviceTime too frequent: 659 counts during 628 steps 2024-12-18T00:21:04.7484631Z 2024-12-18T00:21:04.7484828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7484935Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7485218Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7485321Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7485511Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7485822Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7485990Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7486158Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7486504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7486860Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7487187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7487457Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7487765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7488028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7488321Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7488447Z Execution Analysis: (:1) 2024-12-18T00:21:04.7488705Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7488903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7488910Z 2024-12-18T00:21:04.7489110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7489233Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7489461Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7489583Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7489788Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7489935Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7490080Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7490242Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7490827Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7491383Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7491771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7492136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7492446Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7492712Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7493020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7493282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7493388Z Execution Analysis: .......... 2024-12-18T00:21:04.7493641Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7493841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7494128Z pt-xla-profiler: TransferFromDeviceTime too frequent: 660 counts during 629 steps 2024-12-18T00:21:04.7494133Z 2024-12-18T00:21:04.7494330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7494450Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7494733Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7494848Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7495046Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7495210Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7495354Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7495517Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7495869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7496235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7496639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7497078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7497387Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7497730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7498023Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7498162Z Execution Analysis: (:1) 2024-12-18T00:21:04.7498419Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7498633Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7498640Z 2024-12-18T00:21:04.7498841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7498965Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7499198Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7499311Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7499527Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7499672Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7499826Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7499992Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7500596Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7501209Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7501591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7501951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7502264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7502543Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7502851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7503125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7503231Z Execution Analysis: .......... 2024-12-18T00:21:04.7503496Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7503701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7503990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 661 counts during 630 steps 2024-12-18T00:21:04.7503994Z 2024-12-18T00:21:04.7504205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7504322Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7504626Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7504739Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7504983Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7505127Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7505271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7505447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7505827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7506192Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7506504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7506785Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7507088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7507356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7507660Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7507785Z Execution Analysis: (:1) 2024-12-18T00:21:04.7508051Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7508262Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7508266Z 2024-12-18T00:21:04.7508477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7508595Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7508834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7509052Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7509244Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7509387Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7509524Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7509687Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7510237Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7510818Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7511175Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7511507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7511794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7512050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7512343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7512589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7512697Z Execution Analysis: .......... 2024-12-18T00:21:04.7512941Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7513135Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7513398Z pt-xla-profiler: TransferFromDeviceTime too frequent: 662 counts during 631 steps 2024-12-18T00:21:04.7513402Z 2024-12-18T00:21:04.7513591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7513699Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7513969Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7514104Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7514293Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7514434Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7514571Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7514758Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7515097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7515424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7515723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7515974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7516264Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7516512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7516792Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7516909Z Execution Analysis: (:1) 2024-12-18T00:21:04.7517149Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7517343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7517349Z 2024-12-18T00:21:04.7517701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7517817Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7518043Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7518156Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7518358Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7518501Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7518654Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7518819Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7519438Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7520017Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7520374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7520717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7521029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7521297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7521595Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7521869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7521974Z Execution Analysis: .......... 2024-12-18T00:21:04.7522231Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7522431Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7530984Z pt-xla-profiler: TransferFromDeviceTime too frequent: 663 counts during 632 steps 2024-12-18T00:21:04.7531001Z 2024-12-18T00:21:04.7531431Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7531581Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7531970Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7532084Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7532297Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7532446Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7532628Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7532796Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7533157Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7533511Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7533820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7534096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7534401Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7534671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7534954Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7535078Z Execution Analysis: (:1) 2024-12-18T00:21:04.7535342Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7535541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7535546Z 2024-12-18T00:21:04.7535751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7535862Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7536095Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7536203Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7536539Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7536685Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7536991Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7537214Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7537814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7538431Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7538795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7539159Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7539473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7539751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7540063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7540334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7540449Z Execution Analysis: .......... 2024-12-18T00:21:04.7540713Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7540923Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7541209Z pt-xla-profiler: TransferFromDeviceTime too frequent: 664 counts during 633 steps 2024-12-18T00:21:04.7541214Z 2024-12-18T00:21:04.7541420Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7541560Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7541852Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7541974Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7542182Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7542356Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7542500Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7542674Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7543030Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7543377Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7543696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7543969Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7544449Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7544716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7545017Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7545138Z Execution Analysis: (:1) 2024-12-18T00:21:04.7545404Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7545603Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7545608Z 2024-12-18T00:21:04.7545805Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7545924Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7546158Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7546272Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7546476Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7546626Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7546833Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7547001Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7547633Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7548209Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7548579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7548931Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7549247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7549519Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7549834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7550099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7550205Z Execution Analysis: .......... 2024-12-18T00:21:04.7550472Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7550672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7550964Z pt-xla-profiler: TransferFromDeviceTime too frequent: 665 counts during 634 steps 2024-12-18T00:21:04.7551003Z 2024-12-18T00:21:04.7551206Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7551323Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7551611Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7551722Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7551967Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7552111Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7552260Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7552426Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7552785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7553134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7553449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7553724Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7554030Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7554309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7554598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7554735Z Execution Analysis: (:1) 2024-12-18T00:21:04.7554993Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7555205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7555209Z 2024-12-18T00:21:04.7555411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7555527Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7555765Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7555876Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7556094Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7556368Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7556512Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7556664Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7557233Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7557772Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7558101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7558435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7558722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7558985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7559269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7559526Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7559623Z Execution Analysis: .......... 2024-12-18T00:21:04.7559860Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7560056Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7560345Z pt-xla-profiler: TransferFromDeviceTime too frequent: 666 counts during 635 steps 2024-12-18T00:21:04.7560349Z 2024-12-18T00:21:04.7560541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7560645Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7560924Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7561048Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7561248Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7561381Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7561511Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7561675Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7562002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7562331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7562622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7562884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7563170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7563418Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7563696Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7563811Z Execution Analysis: (:1) 2024-12-18T00:21:04.7564060Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7564246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7564250Z 2024-12-18T00:21:04.7564443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7564546Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7564764Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7564890Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7565086Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7565228Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7565362Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7565545Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7566095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7566634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7566968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7567292Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7567585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7567840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7568133Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7568378Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7568480Z Execution Analysis: .......... 2024-12-18T00:21:04.7568716Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7568911Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7569209Z pt-xla-profiler: TransferFromDeviceTime too frequent: 667 counts during 636 steps 2024-12-18T00:21:04.7569214Z 2024-12-18T00:21:04.7569399Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7569517Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7569810Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7569920Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7570110Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7570252Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7570382Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7570534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7570878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7571203Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7571496Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7571748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7572039Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7572291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7572557Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7572679Z Execution Analysis: (:1) 2024-12-18T00:21:04.7572915Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7573112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7573118Z 2024-12-18T00:21:04.7573303Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7573416Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7573664Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7573771Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7573961Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7574115Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7574256Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7574408Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7574965Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7575496Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7575837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7576164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7576538Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7576957Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7577265Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7577542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7577645Z Execution Analysis: .......... 2024-12-18T00:21:04.7577912Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7578142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7578430Z pt-xla-profiler: TransferFromDeviceTime too frequent: 668 counts during 637 steps 2024-12-18T00:21:04.7578438Z 2024-12-18T00:21:04.7578663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7578778Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7579077Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7579188Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7579399Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7579541Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7579692Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7579856Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7580213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7580567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7580876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7581162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7581466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7581741Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7582029Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7582163Z Execution Analysis: (:1) 2024-12-18T00:21:04.7582419Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7582621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7582625Z 2024-12-18T00:21:04.7582834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7582969Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7583203Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7583310Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7583544Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7583688Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7583833Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7584004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7584594Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7585180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7585536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7585899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7586206Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7586488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7586794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7587060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7587169Z Execution Analysis: .......... 2024-12-18T00:21:04.7587450Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7587656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7587941Z pt-xla-profiler: TransferFromDeviceTime too frequent: 669 counts during 638 steps 2024-12-18T00:21:04.7587946Z 2024-12-18T00:21:04.7588177Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7588289Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7588587Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7588696Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7588900Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7589152Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7589281Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7589445Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7589775Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7590104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7590396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7590648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7590937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7591182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7591458Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7591573Z Execution Analysis: (:1) 2024-12-18T00:21:04.7591816Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7592001Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7592005Z 2024-12-18T00:21:04.7592282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7592396Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7592605Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7592736Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7592925Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7593063Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7593194Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7593508Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7594087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7594645Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7595003Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7595342Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7595651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7595916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7596219Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7596477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7596601Z Execution Analysis: .......... 2024-12-18T00:21:04.7596855Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7597048Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7597359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 670 counts during 639 steps 2024-12-18T00:21:04.7597364Z 2024-12-18T00:21:04.7597563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7597677Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7597960Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7598074Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7598272Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7598412Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7598560Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7598723Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7599074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7599417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7599727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7599993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7600290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7600556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7600836Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7600965Z Execution Analysis: (:1) 2024-12-18T00:21:04.7601215Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7601418Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7601447Z 2024-12-18T00:21:04.7601647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7601763Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7602022Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7602130Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7602339Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7602475Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7602624Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7602786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7603370Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7603929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7604280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7604629Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7604932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7605205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7605601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7605880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7605976Z Execution Analysis: .......... 2024-12-18T00:21:04.7606218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7606430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7606694Z pt-xla-profiler: TransferFromDeviceTime too frequent: 671 counts during 640 steps 2024-12-18T00:21:04.7606698Z 2024-12-18T00:21:04.7606891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7606993Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7607270Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7607371Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7607568Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7607700Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7607831Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7607992Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7608324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7608656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7608943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7609200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7609480Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7609726Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7610008Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7610122Z Execution Analysis: (:1) 2024-12-18T00:21:04.7610371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7610584Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7610588Z 2024-12-18T00:21:04.7610778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7610904Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7611123Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7611224Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7611414Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7611555Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7611690Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7611851Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7612397Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7612939Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7613273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7613603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7613885Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7614137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7614452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7614700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7614806Z Execution Analysis: .......... 2024-12-18T00:21:04.7615044Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7615259Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7615525Z pt-xla-profiler: TransferFromDeviceTime too frequent: 672 counts during 641 steps 2024-12-18T00:21:04.7615529Z 2024-12-18T00:21:04.7615713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7615821Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7616089Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7616199Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7616457Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7616598Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7616728Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7617054Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7617419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7617770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7618090Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7618363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7618683Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7618951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7619253Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7619379Z Execution Analysis: (:1) 2024-12-18T00:21:04.7619670Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7619882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7619887Z 2024-12-18T00:21:04.7620116Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7620237Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7620469Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7620583Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7620790Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7620939Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7621095Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7621268Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7621867Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7622446Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7622816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7623167Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7623487Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7623787Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7624096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7624374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7624486Z Execution Analysis: .......... 2024-12-18T00:21:04.7624777Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7624983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7625275Z pt-xla-profiler: TransferFromDeviceTime too frequent: 673 counts during 642 steps 2024-12-18T00:21:04.7625280Z 2024-12-18T00:21:04.7625482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7625607Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7625898Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7626012Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7626225Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7626371Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7626520Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7626692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7627058Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7627412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7627723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7628002Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7628309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7628585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7628876Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7629147Z Execution Analysis: (:1) 2024-12-18T00:21:04.7629386Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7629593Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7629606Z 2024-12-18T00:21:04.7629791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7629894Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7630109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7630212Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7630409Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7630539Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7630675Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7630836Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7631387Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7631926Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7632260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7632591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7632879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7633162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7633448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7633698Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7633826Z Execution Analysis: .......... 2024-12-18T00:21:04.7634064Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7634260Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7634528Z pt-xla-profiler: TransferFromDeviceTime too frequent: 675 counts during 643 steps 2024-12-18T00:21:04.7634532Z 2024-12-18T00:21:04.7634725Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7634832Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7635107Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7635209Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7635400Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7635544Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7635678Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7635835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7636162Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7636491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7636775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7637028Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7637317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7637560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7637868Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7637987Z Execution Analysis: (:1) 2024-12-18T00:21:04.7638230Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7638438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7638442Z 2024-12-18T00:21:04.7638636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7638740Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7638955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7639064Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7639255Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7639394Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7639534Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7639700Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7640252Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7640784Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7641121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7641444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7641769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7642024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7642319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7642589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7642699Z Execution Analysis: .......... 2024-12-18T00:21:04.7642939Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7643129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7643396Z pt-xla-profiler: TransferFromDeviceTime too frequent: 676 counts during 644 steps 2024-12-18T00:21:04.7643400Z 2024-12-18T00:21:04.7643589Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7643705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7643974Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7644086Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7644413Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7644552Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7644865Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7645035Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7645404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7645757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7646079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7646355Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7646665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7647000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7647295Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7647431Z Execution Analysis: (:1) 2024-12-18T00:21:04.7647721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7647938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7647943Z 2024-12-18T00:21:04.7648144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7648265Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7648498Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7648609Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7648822Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7648969Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7649124Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7649295Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7649897Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7650478Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7650845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7651229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7651540Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7651818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7652159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7652435Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7652542Z Execution Analysis: .......... 2024-12-18T00:21:04.7652808Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7653010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7653294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 677 counts during 645 steps 2024-12-18T00:21:04.7653306Z 2024-12-18T00:21:04.7653506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7653620Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7653916Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7654030Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7654247Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7654391Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7654538Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7654711Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7655069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7655424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7655737Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7656018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7656327Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7656701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7656995Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7657151Z Execution Analysis: (:1) 2024-12-18T00:21:04.7657418Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7657619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7657623Z 2024-12-18T00:21:04.7657829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7657944Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7658184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7658295Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7658503Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7658653Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7658801Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7658977Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7659571Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7660149Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7660534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7660894Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7661202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7661508Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7661825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7662100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7662210Z Execution Analysis: .......... 2024-12-18T00:21:04.7662468Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7662680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7662966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 678 counts during 646 steps 2024-12-18T00:21:04.7662970Z 2024-12-18T00:21:04.7663178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7663293Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7663587Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7663705Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7663914Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7664066Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7664204Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7664384Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7664742Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7665094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7665413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7665686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7666026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7666298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7666623Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7666750Z Execution Analysis: (:1) 2024-12-18T00:21:04.7667006Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7667217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7667224Z 2024-12-18T00:21:04.7667426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7667546Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7667779Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7667899Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7668108Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7668253Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7668506Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7668664Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7669219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7669752Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7670113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7670436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7670771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7671026Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7671314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7671570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7671669Z Execution Analysis: .......... 2024-12-18T00:21:04.7671911Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7672101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7672378Z pt-xla-profiler: TransferFromDeviceTime too frequent: 679 counts during 647 steps 2024-12-18T00:21:04.7672383Z 2024-12-18T00:21:04.7672572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7672690Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7672959Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7673064Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7673259Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7673394Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7673530Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7673685Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7674021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7674346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7674634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7674914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7675200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7675480Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7675751Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7675868Z Execution Analysis: (:1) 2024-12-18T00:21:04.7676103Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7676295Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7676301Z 2024-12-18T00:21:04.7676490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7676595Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7676816Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7676925Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7677124Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7677260Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7677404Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7677557Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7678110Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7678674Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7679005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7679337Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7679648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7679911Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7680199Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7680454Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7680551Z Execution Analysis: .......... 2024-12-18T00:21:04.7680787Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7680980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7681246Z pt-xla-profiler: TransferFromDeviceTime too frequent: 680 counts during 648 steps 2024-12-18T00:21:04.7681251Z 2024-12-18T00:21:04.7681446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7681553Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7681826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7681927Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7682120Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7682257Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7682387Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7682547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7682879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7683208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7683521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7683778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7684093Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7684344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7684614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7684731Z Execution Analysis: (:1) 2024-12-18T00:21:04.7684973Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7685163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7685167Z 2024-12-18T00:21:04.7685362Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7685467Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7685684Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7685792Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7685985Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7686123Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7686260Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7686419Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7686967Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7687524Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7687864Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7688223Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7688521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7688775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7689068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7689317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7689422Z Execution Analysis: .......... 2024-12-18T00:21:04.7689665Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7689853Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7690126Z pt-xla-profiler: TransferFromDeviceTime too frequent: 681 counts during 649 steps 2024-12-18T00:21:04.7690132Z 2024-12-18T00:21:04.7690320Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7690431Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7690703Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7690815Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7691006Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7691148Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7691282Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7691439Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7691772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7692095Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7692419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7692696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7692992Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7693241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7693513Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7693634Z Execution Analysis: (:1) 2024-12-18T00:21:04.7693873Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7694065Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7694071Z 2024-12-18T00:21:04.7694260Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7694369Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7694584Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7694687Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7694885Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7695021Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7695160Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7695313Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7696419Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7697140Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7697543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7697901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7698219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7698500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7698809Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7699081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7699188Z Execution Analysis: .......... 2024-12-18T00:21:04.7699453Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7699657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7699959Z pt-xla-profiler: TransferFromDeviceTime too frequent: 682 counts during 650 steps 2024-12-18T00:21:04.7699964Z 2024-12-18T00:21:04.7700168Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7700284Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7700579Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7700689Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7700896Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7701041Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7701188Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7701355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7701711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7702092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7702402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7702704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7703013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7703287Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7703580Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7703708Z Execution Analysis: (:1) 2024-12-18T00:21:04.7703973Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7704177Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7704184Z 2024-12-18T00:21:04.7704391Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7704503Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7704743Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7704856Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7705069Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7705210Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7705357Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7705580Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7706171Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7706784Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7707146Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7707514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7707827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7708103Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7708424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7708697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7708814Z Execution Analysis: .......... 2024-12-18T00:21:04.7709175Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7709374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7709640Z pt-xla-profiler: TransferFromDeviceTime too frequent: 683 counts during 651 steps 2024-12-18T00:21:04.7709646Z 2024-12-18T00:21:04.7709845Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7709949Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7710221Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7710332Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7710523Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7710668Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7710799Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7710965Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7711325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7711648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7711970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7712228Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7712521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7712773Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7713057Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7713175Z Execution Analysis: (:1) 2024-12-18T00:21:04.7713430Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7713622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7713626Z 2024-12-18T00:21:04.7713815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7713933Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7714145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7714258Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7714449Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7714592Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7714754Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7714911Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7715472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7716025Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7716364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7716687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7716982Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7717232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7717693Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7717952Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7718055Z Execution Analysis: .......... 2024-12-18T00:21:04.7718318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7718515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7718803Z pt-xla-profiler: TransferFromDeviceTime too frequent: 684 counts during 652 steps 2024-12-18T00:21:04.7718807Z 2024-12-18T00:21:04.7719003Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7719130Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7719412Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7719521Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7719728Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7719868Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7720015Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7720210Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7720570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7720939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7721254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7721518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7721816Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7722089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7722372Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7722500Z Execution Analysis: (:1) 2024-12-18T00:21:04.7722755Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7722963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7722967Z 2024-12-18T00:21:04.7723163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7723273Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7723508Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7723615Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7723823Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7723988Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7724142Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7724306Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7724913Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7725487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7725840Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7726187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7726489Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7726765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7727066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7727335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7727440Z Execution Analysis: .......... 2024-12-18T00:21:04.7727694Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7727903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7728182Z pt-xla-profiler: TransferFromDeviceTime too frequent: 685 counts during 653 steps 2024-12-18T00:21:04.7728186Z 2024-12-18T00:21:04.7728394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7728504Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7728796Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7728904Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7729112Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7729281Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7729421Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7729699Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7730056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7730391Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7730676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7730938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7731224Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7731473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7731753Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7731868Z Execution Analysis: (:1) 2024-12-18T00:21:04.7732115Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7732303Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7732308Z 2024-12-18T00:21:04.7732500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7732605Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7732827Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7732929Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7733146Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7733285Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7733420Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7733586Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7734216Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7734764Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7735092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7735419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7735719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7735974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7736269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7736612Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7736724Z Execution Analysis: .......... 2024-12-18T00:21:04.7737144Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7737361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7737649Z pt-xla-profiler: TransferFromDeviceTime too frequent: 686 counts during 654 steps 2024-12-18T00:21:04.7737653Z 2024-12-18T00:21:04.7737855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7737984Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7738276Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7738397Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7738630Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7738786Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7738930Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7739103Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7739506Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7739860Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7740182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7740460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7740779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7741043Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7741341Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7741476Z Execution Analysis: (:1) 2024-12-18T00:21:04.7741738Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7741950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7741955Z 2024-12-18T00:21:04.7742155Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7742277Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7742508Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7742654Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7742863Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7743008Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7743167Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7743362Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7743970Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7744727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7745097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7745448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7745774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7746048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7746356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7746632Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7746741Z Execution Analysis: .......... 2024-12-18T00:21:04.7747010Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7747211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7747508Z pt-xla-profiler: TransferFromDeviceTime too frequent: 687 counts during 655 steps 2024-12-18T00:21:04.7747513Z 2024-12-18T00:21:04.7747718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7747832Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7748128Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7748289Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7748504Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7748646Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7748831Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7748999Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7749358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7749720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7750034Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7750324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7750631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7750911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7751204Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7751343Z Execution Analysis: (:1) 2024-12-18T00:21:04.7751605Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7751812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7751816Z 2024-12-18T00:21:04.7752031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7752179Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7752422Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7752533Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7752752Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7752899Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7753081Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7753256Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7753851Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7754434Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7754794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7755162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7755473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7755757Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7756069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7756446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7756563Z Execution Analysis: .......... 2024-12-18T00:21:04.7756916Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7757114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7757379Z pt-xla-profiler: TransferFromDeviceTime too frequent: 688 counts during 656 steps 2024-12-18T00:21:04.7757385Z 2024-12-18T00:21:04.7757583Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7757687Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7757994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7758097Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7758287Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7758455Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7758591Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7758756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7759091Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7759427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7759714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7759969Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7760263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7760511Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7760795Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7760912Z Execution Analysis: (:1) 2024-12-18T00:21:04.7761159Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7761345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7761349Z 2024-12-18T00:21:04.7761536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7761676Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7761889Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7762001Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7762192Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7762357Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7762493Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7762649Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7763200Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7763733Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7764073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7764396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7764694Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7764947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7765245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7765493Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7765593Z Execution Analysis: .......... 2024-12-18T00:21:04.7765838Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7766026Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7766303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 689 counts during 657 steps 2024-12-18T00:21:04.7766307Z 2024-12-18T00:21:04.7766494Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7766634Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7766905Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7767015Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7767224Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7767359Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7767498Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7767651Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7767993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7768322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7768620Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7768871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7769159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7769417Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7769689Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7769811Z Execution Analysis: (:1) 2024-12-18T00:21:04.7770050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7770246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7770274Z 2024-12-18T00:21:04.7770460Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7770576Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7770788Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7770891Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7771113Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7771245Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7771391Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7771547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7772107Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7772634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7772970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7773301Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7773592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7773857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7774146Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7774403Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7774500Z Execution Analysis: .......... 2024-12-18T00:21:04.7774749Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7774937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7775205Z pt-xla-profiler: TransferFromDeviceTime too frequent: 690 counts during 658 steps 2024-12-18T00:21:04.7775209Z 2024-12-18T00:21:04.7775446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7775556Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7775834Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7775959Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7776159Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7776292Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7776498Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7776668Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7777182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7777550Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7777860Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7778149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7778455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7778729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7779032Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7779162Z Execution Analysis: (:1) 2024-12-18T00:21:04.7779430Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7779665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7779670Z 2024-12-18T00:21:04.7779880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7779998Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7780262Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7780372Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7780582Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7780737Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7780886Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7781061Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7781653Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7782239Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7782597Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7782966Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7783273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7783552Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7783867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7784134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7784250Z Execution Analysis: .......... 2024-12-18T00:21:04.7784505Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7784721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7785008Z pt-xla-profiler: TransferFromDeviceTime too frequent: 691 counts during 659 steps 2024-12-18T00:21:04.7785040Z 2024-12-18T00:21:04.7785247Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7785368Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7785685Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7785805Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7786011Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7786161Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7786305Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7786479Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7786842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7787195Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7787517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7787791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7788108Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7788376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7788673Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7788799Z Execution Analysis: (:1) 2024-12-18T00:21:04.7789057Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7789293Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7789297Z 2024-12-18T00:21:04.7789503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7789649Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7789881Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7790000Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7790212Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7790358Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7790511Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7790682Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7791278Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7791855Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7792221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7792576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7792895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7793170Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7793479Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7793760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7793868Z Execution Analysis: .......... 2024-12-18T00:21:04.7794133Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7794338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7794664Z pt-xla-profiler: TransferFromDeviceTime too frequent: 692 counts during 660 steps 2024-12-18T00:21:04.7794668Z 2024-12-18T00:21:04.7794871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7795025Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7795316Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7795426Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7795643Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7795788Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7795948Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7796117Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7796487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7796839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7797154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7797440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7797753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7798035Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7798327Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7798489Z Execution Analysis: (:1) 2024-12-18T00:21:04.7798854Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7799054Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7799072Z 2024-12-18T00:21:04.7799296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7799413Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7799754Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7799857Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7800057Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7800189Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7800326Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7800488Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7801040Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7801589Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7801926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7802263Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7802553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7802820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7803106Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7803359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7803471Z Execution Analysis: .......... 2024-12-18T00:21:04.7803712Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7803934Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7804202Z pt-xla-profiler: TransferFromDeviceTime too frequent: 693 counts during 661 steps 2024-12-18T00:21:04.7804206Z 2024-12-18T00:21:04.7804430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7804534Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7804821Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7804926Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7805115Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7805259Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7805391Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7805561Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7805895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7806232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7806520Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7806774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7807070Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7807318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7807597Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7807736Z Execution Analysis: (:1) 2024-12-18T00:21:04.7807984Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7808170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7808210Z 2024-12-18T00:21:04.7808408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7808517Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7808729Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7808842Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7809035Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7809180Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7809319Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7809485Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7810033Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7810567Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7810911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7811236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7811535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7811787Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7812081Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7812332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7812442Z Execution Analysis: .......... 2024-12-18T00:21:04.7812679Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7812893Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7813188Z pt-xla-profiler: TransferFromDeviceTime too frequent: 694 counts during 662 steps 2024-12-18T00:21:04.7813192Z 2024-12-18T00:21:04.7813384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7813500Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7813766Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7813879Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7814070Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7814205Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7814344Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7814503Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7814847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7815177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7815480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7815735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7816020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7816281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7816654Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7816953Z Execution Analysis: (:1) 2024-12-18T00:21:04.7817212Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7817460Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7817465Z 2024-12-18T00:21:04.7817671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7817803Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7818040Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7818152Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7818370Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7818518Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7818675Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7818843Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7819447Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7820021Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7820393Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7820743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7821055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7821340Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7821653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7821933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7822064Z Execution Analysis: .......... 2024-12-18T00:21:04.7822333Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7822535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7822866Z pt-xla-profiler: TransferFromDeviceTime too frequent: 696 counts during 663 steps 2024-12-18T00:21:04.7822885Z 2024-12-18T00:21:04.7823086Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7823202Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7823504Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7823614Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7823826Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7823971Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7824116Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7824300Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7824659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7825027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7825338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7825624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7825936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7826248Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7826541Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7826668Z Execution Analysis: (:1) 2024-12-18T00:21:04.7826963Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7827171Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7827178Z 2024-12-18T00:21:04.7827390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7827501Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7827742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7827851Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7828062Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7828216Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7828367Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7828547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7829247Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7829790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7830126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7830462Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7830748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7831004Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7831302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7831578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7831693Z Execution Analysis: .......... 2024-12-18T00:21:04.7831932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7832159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7832426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 697 counts during 664 steps 2024-12-18T00:21:04.7832430Z 2024-12-18T00:21:04.7832629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7832731Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7833005Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7833117Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7833309Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7833458Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7833593Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7833757Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7834091Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7834418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7834714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7834967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7835292Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7835540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7835818Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7835961Z Execution Analysis: (:1) 2024-12-18T00:21:04.7836204Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7836403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7836407Z 2024-12-18T00:21:04.7836593Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7836705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7836921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7837034Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7837226Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7837368Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7837506Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7837666Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7838228Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7838763Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7839105Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7839434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7839732Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7839987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7840286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7840562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7840664Z Execution Analysis: .......... 2024-12-18T00:21:04.7840938Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7841128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7841405Z pt-xla-profiler: TransferFromDeviceTime too frequent: 698 counts during 665 steps 2024-12-18T00:21:04.7841409Z 2024-12-18T00:21:04.7841598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7841722Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7841994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7842265Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7842479Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7842622Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7842774Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7842943Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7843302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7843645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7843953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7844401Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7844871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7845151Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7845504Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7845644Z Execution Analysis: (:1) 2024-12-18T00:21:04.7845910Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7846131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7846136Z 2024-12-18T00:21:04.7846338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7846454Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7846695Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7846807Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7847029Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7847176Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7847339Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7847512Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7848110Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7848702Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7849064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7849434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7849747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7850035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7850397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7850677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7850814Z Execution Analysis: .......... 2024-12-18T00:21:04.7851076Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7851289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7851575Z pt-xla-profiler: TransferFromDeviceTime too frequent: 699 counts during 666 steps 2024-12-18T00:21:04.7851582Z 2024-12-18T00:21:04.7851796Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7851910Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7852214Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7852327Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7852535Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7852691Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7852837Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7853016Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7853375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7853739Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7854050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7854379Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7854690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7854988Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7855293Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7855427Z Execution Analysis: (:1) 2024-12-18T00:21:04.7855695Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7855897Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7855901Z 2024-12-18T00:21:04.7856111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7856227Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7856551Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7856673Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7856883Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7857038Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7857188Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7857363Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7857959Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7858536Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7858904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7859260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7859587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7861990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7862337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7862610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7862718Z Execution Analysis: .......... 2024-12-18T00:21:04.7862998Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7863206Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7863509Z pt-xla-profiler: TransferFromDeviceTime too frequent: 700 counts during 667 steps 2024-12-18T00:21:04.7863515Z 2024-12-18T00:21:04.7863718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7863846Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7864139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7864281Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7864500Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7864646Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7864798Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7864965Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7865336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7865692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7866047Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7866332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7866645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7866962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7867254Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7867394Z Execution Analysis: (:1) 2024-12-18T00:21:04.7867657Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7867862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7867878Z 2024-12-18T00:21:04.7868079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7868195Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7868535Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7868640Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7868845Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7868981Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7869118Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7869284Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7869838Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7870379Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7870714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7871048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7871373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7871697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7871985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7872237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7872346Z Execution Analysis: .......... 2024-12-18T00:21:04.7872587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7872790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7873059Z pt-xla-profiler: TransferFromDeviceTime too frequent: 701 counts during 668 steps 2024-12-18T00:21:04.7873064Z 2024-12-18T00:21:04.7873263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7873372Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7873652Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7873757Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7873949Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7874096Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7874227Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7874396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7874732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7875096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7875385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7875644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7875965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7876217Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7876499Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7876616Z Execution Analysis: (:1) 2024-12-18T00:21:04.7876861Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7877050Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7877056Z 2024-12-18T00:21:04.7877254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7877357Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7877576Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7877696Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7877893Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7878036Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7878174Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7878344Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7878892Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7879425Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7879772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7880128Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7880479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7880736Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7881037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7881288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7881399Z Execution Analysis: .......... 2024-12-18T00:21:04.7881639Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7881831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7882103Z pt-xla-profiler: TransferFromDeviceTime too frequent: 702 counts during 669 steps 2024-12-18T00:21:04.7882109Z 2024-12-18T00:21:04.7882300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7882420Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7882693Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7882806Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7882998Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7883133Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7883274Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7883430Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7883880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7884209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7884515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7884796Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7885088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7885340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7885615Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7885744Z Execution Analysis: (:1) 2024-12-18T00:21:04.7885984Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7886185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7886189Z 2024-12-18T00:21:04.7886379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7886498Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7886718Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7886823Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7887027Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7887166Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7887310Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7887472Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7888030Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7888565Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7888905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7889287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7889578Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7889840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7890128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7890385Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7890487Z Execution Analysis: .......... 2024-12-18T00:21:04.7890737Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7890927Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7891192Z pt-xla-profiler: TransferFromDeviceTime too frequent: 703 counts during 670 steps 2024-12-18T00:21:04.7891206Z 2024-12-18T00:21:04.7891397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7891504Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7891784Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7891889Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7892086Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7892223Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7892356Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7892550Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7892880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7893212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7893530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7893794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7894081Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7894337Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7894609Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7894725Z Execution Analysis: (:1) 2024-12-18T00:21:04.7894976Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7895164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7895168Z 2024-12-18T00:21:04.7895361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7895469Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7895691Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7895795Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7895983Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7896124Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7896259Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7896520Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7897257Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7897844Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7898267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7898628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7898940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7899214Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7899531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7899800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7899919Z Execution Analysis: .......... 2024-12-18T00:21:04.7900180Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7900389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7900680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 704 counts during 671 steps 2024-12-18T00:21:04.7900685Z 2024-12-18T00:21:04.7900896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7901014Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7901305Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7901426Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7901632Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7901787Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7901959Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7902134Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7902494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7902872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7903193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7903465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7903781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7904050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7904350Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7904478Z Execution Analysis: (:1) 2024-12-18T00:21:04.7904736Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7904951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7904958Z 2024-12-18T00:21:04.7905160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7905283Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7905512Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7905628Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7905837Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7905987Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7906136Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7906302Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7906912Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7907488Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7907915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7908269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7908590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7908867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7909284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7909548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7909651Z Execution Analysis: .......... 2024-12-18T00:21:04.7909908Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7910114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7910406Z pt-xla-profiler: TransferFromDeviceTime too frequent: 705 counts during 672 steps 2024-12-18T00:21:04.7910410Z 2024-12-18T00:21:04.7910607Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7910725Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7911009Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7911116Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7911325Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7911495Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7911645Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7911806Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7912164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7912529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7912830Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7913105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7913407Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7913676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7913967Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7914099Z Execution Analysis: (:1) 2024-12-18T00:21:04.7914351Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7914561Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7914565Z 2024-12-18T00:21:04.7914763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7914873Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7915105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7915214Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7915426Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7915566Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7915718Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7915882Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7916455Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7917092Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7917442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7917968Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7918281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7918563Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7918877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7919154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7919261Z Execution Analysis: .......... 2024-12-18T00:21:04.7919520Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7919736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7920019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 706 counts during 673 steps 2024-12-18T00:21:04.7920024Z 2024-12-18T00:21:04.7920236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7920351Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7920654Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7920793Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7920993Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7921148Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7921288Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7921469Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7921859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7922220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7922534Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7922814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7923122Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7923391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7923693Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7923820Z Execution Analysis: (:1) 2024-12-18T00:21:04.7924092Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7924306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7924310Z 2024-12-18T00:21:04.7924519Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7924633Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7924863Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7924983Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7925191Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7925346Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7929326Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7929533Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7930246Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7931015Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7931363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7931691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7931990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7932249Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7932540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7932787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7932885Z Execution Analysis: .......... 2024-12-18T00:21:04.7933138Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7933326Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7933600Z pt-xla-profiler: TransferFromDeviceTime too frequent: 707 counts during 674 steps 2024-12-18T00:21:04.7933606Z 2024-12-18T00:21:04.7933795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7933907Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7934175Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7934315Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7934507Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7934639Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7934784Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7935511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7935859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7936185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7936595Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7937024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7937330Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7937612Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7937900Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7938033Z Execution Analysis: (:1) 2024-12-18T00:21:04.7938297Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7938507Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7938512Z 2024-12-18T00:21:04.7938714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7938834Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7939065Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7939173Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7939391Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7939535Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7939688Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7939853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7940520Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7941099Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7941454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7941814Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7942123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7942407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7942717Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7942995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7943104Z Execution Analysis: .......... 2024-12-18T00:21:04.7943367Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7943569Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7943852Z pt-xla-profiler: TransferFromDeviceTime too frequent: 708 counts during 675 steps 2024-12-18T00:21:04.7943857Z 2024-12-18T00:21:04.7944070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7944346Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7944643Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7944753Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7944961Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7945105Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7945309Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7945485Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7945842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7946199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7946512Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7946793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7947099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7947370Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7947664Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7947792Z Execution Analysis: (:1) 2024-12-18T00:21:04.7948054Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7948256Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7948261Z 2024-12-18T00:21:04.7948466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7948576Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7948810Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7948919Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7949125Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7949274Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7949455Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7949630Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7950266Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7950850Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7951208Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7951567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7951880Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7952150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7952463Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7952733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7952848Z Execution Analysis: .......... 2024-12-18T00:21:04.7953106Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7953317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7953604Z pt-xla-profiler: TransferFromDeviceTime too frequent: 709 counts during 676 steps 2024-12-18T00:21:04.7953609Z 2024-12-18T00:21:04.7953817Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7953968Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7954259Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7954377Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7954581Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7954772Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7954917Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7955079Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7955441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7955787Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7956213Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7956468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7956755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7957007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7957283Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7957399Z Execution Analysis: (:1) 2024-12-18T00:21:04.7957635Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7957835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7957839Z 2024-12-18T00:21:04.7958022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7958135Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7958348Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7958460Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7958650Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7958805Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7958976Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7959129Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7959685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7960217Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7960552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7960875Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7961166Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7961422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7961709Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7961967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7962063Z Execution Analysis: .......... 2024-12-18T00:21:04.7962305Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7962492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7962758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 710 counts during 677 steps 2024-12-18T00:21:04.7962786Z 2024-12-18T00:21:04.7962980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7963089Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7963355Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7963456Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7963676Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7963808Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7963944Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7964098Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7964434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7964757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7965042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7965301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7965587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7965847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7966117Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7966237Z Execution Analysis: (:1) 2024-12-18T00:21:04.7966476Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7966658Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7966667Z 2024-12-18T00:21:04.7966852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7966955Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7967174Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7967274Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7967498Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7967658Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7967790Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7967952Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7968502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7969039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7969374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7969703Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7969990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7970254Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7970536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7970789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7970888Z Execution Analysis: .......... 2024-12-18T00:21:04.7971124Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7971316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7971604Z pt-xla-profiler: TransferFromDeviceTime too frequent: 711 counts during 678 steps 2024-12-18T00:21:04.7971609Z 2024-12-18T00:21:04.7971800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7971906Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7972204Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7972306Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7972492Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7972630Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7972760Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7972920Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7973249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7973578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7973868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7974119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7974415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7974661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7974938Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7975054Z Execution Analysis: (:1) 2024-12-18T00:21:04.7975296Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7975484Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7975490Z 2024-12-18T00:21:04.7975681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7975786Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7975995Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7976130Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7976413Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7976562Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7976699Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7977033Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7977629Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7978202Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7978572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7978922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7979244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7979522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7979836Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7980102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7980214Z Execution Analysis: .......... 2024-12-18T00:21:04.7980472Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7980671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7980991Z pt-xla-profiler: TransferFromDeviceTime too frequent: 712 counts during 679 steps 2024-12-18T00:21:04.7980996Z 2024-12-18T00:21:04.7981197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7981343Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7981636Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7981749Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7981951Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7982091Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7982240Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7982404Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7982768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7983121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7983436Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7983713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7984025Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7984291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7984578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7984704Z Execution Analysis: (:1) 2024-12-18T00:21:04.7984958Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7985167Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7985173Z 2024-12-18T00:21:04.7985375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7985490Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7985746Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7985879Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7986092Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7986232Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7986381Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7986547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7987139Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7987711Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7988073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7988427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7988740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7989123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7989421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7989684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7989787Z Execution Analysis: .......... 2024-12-18T00:21:04.7990039Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7990277Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7990549Z pt-xla-profiler: TransferFromDeviceTime too frequent: 713 counts during 680 steps 2024-12-18T00:21:04.7990561Z 2024-12-18T00:21:04.7990783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7990895Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7991184Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.7991292Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7991495Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.7991635Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.7991769Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.7991937Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7992286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.7992628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7992933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7993204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7993500Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7993764Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7994043Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.7994160Z Execution Analysis: (:1) 2024-12-18T00:21:04.7994417Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7994614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7994619Z 2024-12-18T00:21:04.7994820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7994954Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.7995209Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.7995313Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.7995514Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.7995659Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.7995801Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.7995969Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.7996540Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.7997107Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.7997455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.7997805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.7998103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.7998368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.7998673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.7998931Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.7999039Z Execution Analysis: .......... 2024-12-18T00:21:04.7999315Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.7999518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.7999796Z pt-xla-profiler: TransferFromDeviceTime too frequent: 714 counts during 681 steps 2024-12-18T00:21:04.7999826Z 2024-12-18T00:21:04.8000031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8000142Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8000423Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8000537Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8000734Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8000878Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8001017Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8001184Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8001528Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8001869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8002184Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8002445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8002747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8003005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8003294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8003413Z Execution Analysis: (:1) 2024-12-18T00:21:04.8003665Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8003865Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8003895Z 2024-12-18T00:21:04.8004119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8004235Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8004459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8004567Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8004769Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8004917Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8005058Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8005219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8005806Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8006366Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8006730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8007070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8007372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8007635Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8007938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8008195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8008324Z Execution Analysis: .......... 2024-12-18T00:21:04.8008577Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8008772Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8009079Z pt-xla-profiler: TransferFromDeviceTime too frequent: 715 counts during 682 steps 2024-12-18T00:21:04.8009084Z 2024-12-18T00:21:04.8009281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8009394Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8009677Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8009781Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8009988Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8010128Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8010268Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8010427Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8010777Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8011120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8011422Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8011693Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8011990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8012254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8012534Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8012661Z Execution Analysis: (:1) 2024-12-18T00:21:04.8013017Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8013208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8013237Z 2024-12-18T00:21:04.8013451Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8013555Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8013770Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8013871Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8014066Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8014196Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8014332Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8014488Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8015033Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8015572Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8015901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8016228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8016589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8017022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8017330Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8017633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8017735Z Execution Analysis: .......... 2024-12-18T00:21:04.8017992Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8018235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8018527Z pt-xla-profiler: TransferFromDeviceTime too frequent: 717 counts during 683 steps 2024-12-18T00:21:04.8018531Z 2024-12-18T00:21:04.8018741Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8018856Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8019158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8019270Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8019474Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8019628Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8019768Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8019947Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8020311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8020673Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8020987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8021272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8021582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8021849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8022153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8022276Z Execution Analysis: (:1) 2024-12-18T00:21:04.8022544Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8022847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8022852Z 2024-12-18T00:21:04.8023062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8023180Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8023406Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8023527Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8023735Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8023889Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8024042Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8024217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8024817Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8025407Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8025773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8026124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8026448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8026720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8027067Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8027336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8027449Z Execution Analysis: .......... 2024-12-18T00:21:04.8027741Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8027941Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8028236Z pt-xla-profiler: TransferFromDeviceTime too frequent: 718 counts during 684 steps 2024-12-18T00:21:04.8028240Z 2024-12-18T00:21:04.8028444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8028565Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8028855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8029081Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8029270Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8029410Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8029543Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8029696Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8030039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8030361Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8030656Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8030907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8031195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8031446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8031710Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8031836Z Execution Analysis: (:1) 2024-12-18T00:21:04.8032190Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8032392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8032396Z 2024-12-18T00:21:04.8032581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8032693Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8032905Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8033014Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8033208Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8033340Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8033484Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8033638Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8034201Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8034729Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8035069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8035396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8035682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8035972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8036255Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8036511Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8036610Z Execution Analysis: .......... 2024-12-18T00:21:04.8036879Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8037069Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8037339Z pt-xla-profiler: TransferFromDeviceTime too frequent: 719 counts during 685 steps 2024-12-18T00:21:04.8037344Z 2024-12-18T00:21:04.8037532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8037635Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8037914Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8038012Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8038208Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8038343Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8038485Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8038643Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8038974Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8039311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8039595Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8039856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8040141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8040397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8040667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8040807Z Execution Analysis: (:1) 2024-12-18T00:21:04.8041081Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8041268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8041272Z 2024-12-18T00:21:04.8041467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8041574Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8041796Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8041900Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8042100Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8042234Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8042367Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8042534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8043083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8043623Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8043956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8044436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8044966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8045249Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8045560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8045867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8045987Z Execution Analysis: .......... 2024-12-18T00:21:04.8046245Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8046457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8046744Z pt-xla-profiler: TransferFromDeviceTime too frequent: 720 counts during 686 steps 2024-12-18T00:21:04.8046749Z 2024-12-18T00:21:04.8046961Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8047081Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8047373Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8047490Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8047698Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8047857Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8048000Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8048176Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8048537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8048887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8049209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8049480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8049800Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8050066Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8050399Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8050561Z Execution Analysis: (:1) 2024-12-18T00:21:04.8050826Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8051029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8051033Z 2024-12-18T00:21:04.8051231Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8051356Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8051586Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8051711Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8051919Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8052069Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8052219Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8052389Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8052994Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8053567Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8053932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8054285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8054629Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8054904Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8055248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8055525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8055627Z Execution Analysis: .......... 2024-12-18T00:21:04.8055896Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8056099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8056467Z pt-xla-profiler: TransferFromDeviceTime too frequent: 721 counts during 687 steps 2024-12-18T00:21:04.8056473Z 2024-12-18T00:21:04.8056680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8056805Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8057099Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8057218Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8057430Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8057570Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8057721Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8057885Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8058251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8058605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8058921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8059197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8059501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8059826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8060141Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8060273Z Execution Analysis: (:1) 2024-12-18T00:21:04.8060532Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8060742Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8060746Z 2024-12-18T00:21:04.8060950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8061070Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8061302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8061411Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8061631Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8061779Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8061942Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8062113Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8062707Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8063289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8063648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8064035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8064343Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8064629Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8064966Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8065246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8065353Z Execution Analysis: .......... 2024-12-18T00:21:04.8065609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8065824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8066108Z pt-xla-profiler: TransferFromDeviceTime too frequent: 722 counts during 688 steps 2024-12-18T00:21:04.8066114Z 2024-12-18T00:21:04.8066329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8066445Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8066746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8066862Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8067076Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8067222Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8067362Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8067537Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8067896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8068256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8068573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8068954Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8069273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8069548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8069834Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8069949Z Execution Analysis: (:1) 2024-12-18T00:21:04.8070198Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8070386Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8070391Z 2024-12-18T00:21:04.8070586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8070696Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8070915Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8071018Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8071208Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8071355Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8071490Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8071651Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8072201Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8072744Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8073100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8073422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8073722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8074001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8074300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8074547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8074654Z Execution Analysis: .......... 2024-12-18T00:21:04.8074890Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8075080Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8075345Z pt-xla-profiler: TransferFromDeviceTime too frequent: 723 counts during 689 steps 2024-12-18T00:21:04.8075350Z 2024-12-18T00:21:04.8075533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8075647Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8076094Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8076210Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8076411Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8076721Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8076863Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8077026Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8077390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8077741Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8078067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8078342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8078711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8078981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8079281Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8079407Z Execution Analysis: (:1) 2024-12-18T00:21:04.8079663Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8079874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8079882Z 2024-12-18T00:21:04.8080080Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8080199Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8080430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8080551Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8080765Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8080905Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8081187Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8081350Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8081953Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8082527Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8082922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8083272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8083619Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8083894Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8084200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8084477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8084580Z Execution Analysis: .......... 2024-12-18T00:21:04.8084845Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8085051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8085345Z pt-xla-profiler: TransferFromDeviceTime too frequent: 724 counts during 690 steps 2024-12-18T00:21:04.8085350Z 2024-12-18T00:21:04.8085556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8085672Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8085971Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8086081Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8086291Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8086436Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8086587Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8086756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8087112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8087476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8087784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8088123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8088431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8088707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8089000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8089132Z Execution Analysis: (:1) 2024-12-18T00:21:04.8089391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8089592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8089596Z 2024-12-18T00:21:04.8089810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8089923Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8090166Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8090274Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8090492Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8090637Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8090778Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8090955Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8091547Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8092164Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8092526Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8092928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8093240Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8093522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8093832Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8094095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8094212Z Execution Analysis: .......... 2024-12-18T00:21:04.8094466Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8094746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8095380Z pt-xla-profiler: TransferFromDeviceTime too frequent: 725 counts during 691 steps 2024-12-18T00:21:04.8095394Z 2024-12-18T00:21:04.8095884Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8096124Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8096906Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8097150Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8097621Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8097961Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8098274Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8098676Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8099537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8100395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8101240Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8101885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8102622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8103256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8103963Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8104241Z Execution Analysis: (:1) 2024-12-18T00:21:04.8104856Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8105331Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8105343Z 2024-12-18T00:21:04.8105829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8106089Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8106627Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8106887Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8107365Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8107703Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8108036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8108423Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8109872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8111304Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8112178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8113075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8113828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8114471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8115216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8115857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8116095Z Execution Analysis: .......... 2024-12-18T00:21:04.8116716Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8117193Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8117884Z pt-xla-profiler: TransferFromDeviceTime too frequent: 726 counts during 692 steps 2024-12-18T00:21:04.8117898Z 2024-12-18T00:21:04.8118368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8118638Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8119327Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8119592Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8120062Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8120388Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8120728Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8121114Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8121981Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8122871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8123678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8124318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8125059Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8125712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8126406Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8126702Z Execution Analysis: (:1) 2024-12-18T00:21:04.8127308Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8127791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8127807Z 2024-12-18T00:21:04.8128287Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8128559Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8129102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8129350Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8129851Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8130177Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8130527Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8130908Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8132412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8133808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8134720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8135572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8136310Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8137072Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8137810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8138465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8138700Z Execution Analysis: .......... 2024-12-18T00:21:04.8139325Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8139800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8140480Z pt-xla-profiler: TransferFromDeviceTime too frequent: 727 counts during 693 steps 2024-12-18T00:21:04.8140492Z 2024-12-18T00:21:04.8140978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8141237Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8141937Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8142184Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8142670Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8143000Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8143326Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8143732Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8144741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8145777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8146525Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8147191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8147922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8148573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8149271Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8149558Z Execution Analysis: (:1) 2024-12-18T00:21:04.8150172Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8150647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8150665Z 2024-12-18T00:21:04.8151146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8151402Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8151950Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8152192Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8152671Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8153007Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8153342Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8153806Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8155240Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8156703Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8157563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8158414Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8159162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8159814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8160557Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8161201Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8161455Z Execution Analysis: .......... 2024-12-18T00:21:04.8162058Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8162557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8163230Z pt-xla-profiler: TransferFromDeviceTime too frequent: 728 counts during 694 steps 2024-12-18T00:21:04.8163240Z 2024-12-18T00:21:04.8163726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8163980Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8164676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8164937Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8165420Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8165758Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8166080Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8166513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8167424Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8168274Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8169025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8169673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8170413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8171055Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8171768Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8172049Z Execution Analysis: (:1) 2024-12-18T00:21:04.8172651Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8173152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8173164Z 2024-12-18T00:21:04.8173640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8173909Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8174463Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8174722Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8175203Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8175533Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8175949Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8176332Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8177838Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8179294Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8180173Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8181023Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8181788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8182434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8183165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8183810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8184054Z Execution Analysis: .......... 2024-12-18T00:21:04.8184671Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8185145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8185830Z pt-xla-profiler: TransferFromDeviceTime too frequent: 729 counts during 695 steps 2024-12-18T00:21:04.8185841Z 2024-12-18T00:21:04.8186314Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8186587Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8187289Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8187543Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8188034Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8188364Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8188746Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8189188Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8190062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8190904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8191649Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8192310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8193046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8193700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8194394Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8194698Z Execution Analysis: (:1) 2024-12-18T00:21:04.8195316Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8195787Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8195814Z 2024-12-18T00:21:04.8196286Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8196545Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8197093Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8197344Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8197845Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8198222Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8198555Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8198946Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8200442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8201841Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8202695Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8203552Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8204297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8204953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8205687Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8206336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8206577Z Execution Analysis: .......... 2024-12-18T00:21:04.8207186Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8207671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8208344Z pt-xla-profiler: TransferFromDeviceTime too frequent: 730 counts during 696 steps 2024-12-18T00:21:04.8208353Z 2024-12-18T00:21:04.8208832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8209089Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8209798Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8210044Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8210518Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8210896Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8211271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8211680Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8212544Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8213396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8214146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8214795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8215547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8216177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8216942Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8217233Z Execution Analysis: (:1) 2024-12-18T00:21:04.8217855Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8218331Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8218341Z 2024-12-18T00:21:04.8218833Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8219086Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8219633Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8219947Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8220427Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8220763Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8221094Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8221483Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8222969Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8224351Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8225221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8226062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8226831Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8227487Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8228230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8228880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8229129Z Execution Analysis: .......... 2024-12-18T00:21:04.8229730Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8230198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8230883Z pt-xla-profiler: TransferFromDeviceTime too frequent: 731 counts during 697 steps 2024-12-18T00:21:04.8230892Z 2024-12-18T00:21:04.8231364Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8231636Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8232335Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8232600Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8233117Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8233497Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8233833Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8234218Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8235091Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8235934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8236692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8237344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8238098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8238734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8239432Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8239725Z Execution Analysis: (:1) 2024-12-18T00:21:04.8240336Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8240829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8240840Z 2024-12-18T00:21:04.8241313Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8241572Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8242160Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8242406Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8242896Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8243222Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8243570Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8244008Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8245602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8246979Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8247854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8248705Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8249444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8250097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8250839Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8251490Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8251722Z Execution Analysis: .......... 2024-12-18T00:21:04.8252340Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8252811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8253485Z pt-xla-profiler: TransferFromDeviceTime too frequent: 732 counts during 698 steps 2024-12-18T00:21:04.8253513Z 2024-12-18T00:21:04.8253978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8254240Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8254942Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8255283Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8255849Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8256178Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8256549Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8256940Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8257790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8258648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8259383Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8260045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8260768Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8261415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8262109Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8262384Z Execution Analysis: (:1) 2024-12-18T00:21:04.8262992Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8263467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8263476Z 2024-12-18T00:21:04.8263960Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8264286Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8264832Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8265072Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8265544Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8265882Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8266285Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8266687Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8268125Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8269520Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8270376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8271248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8271993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8272636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8273380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8274019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8274265Z Execution Analysis: .......... 2024-12-18T00:21:04.8274870Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8275359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8276040Z pt-xla-profiler: TransferFromDeviceTime too frequent: 733 counts during 699 steps 2024-12-18T00:21:04.8276051Z 2024-12-18T00:21:04.8276533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8276781Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8279593Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8279917Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8280399Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8280739Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8281058Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8281453Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8282315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8283157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8283917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8284561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8285308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8285944Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8286648Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8286926Z Execution Analysis: (:1) 2024-12-18T00:21:04.8287533Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8288020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8288031Z 2024-12-18T00:21:04.8288563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8288833Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8289377Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8289643Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8290181Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8290522Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8290856Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8291240Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8292675Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8294063Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8294937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8295784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8296610Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8297271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8298023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8298655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8298891Z Execution Analysis: .......... 2024-12-18T00:21:04.8299512Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8299983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8300678Z pt-xla-profiler: TransferFromDeviceTime too frequent: 734 counts during 700 steps 2024-12-18T00:21:04.8300688Z 2024-12-18T00:21:04.8301169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8301594Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8302341Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8302595Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8303094Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8303417Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8303757Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8304149Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8305021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8305875Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8306618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8307281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8308012Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8308665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8309362Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8309657Z Execution Analysis: (:1) 2024-12-18T00:21:04.8310263Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8310759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8310812Z 2024-12-18T00:21:04.8311285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8311540Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8312101Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8312398Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8312894Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8313217Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8313559Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8313938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8315363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8316765Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8317628Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8318494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8319244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8319906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8320631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8321274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8321508Z Execution Analysis: .......... 2024-12-18T00:21:04.8322112Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8322607Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8323275Z pt-xla-profiler: TransferFromDeviceTime too frequent: 735 counts during 701 steps 2024-12-18T00:21:04.8323336Z 2024-12-18T00:21:04.8323820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8324124Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8324836Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8325081Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8325549Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8325887Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8326210Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8326612Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8327473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8328327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8329072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8329746Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8330481Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8331123Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8331834Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8332110Z Execution Analysis: (:1) 2024-12-18T00:21:04.8332735Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8333259Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8333268Z 2024-12-18T00:21:04.8333746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8334002Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8334594Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8334864Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8335341Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8335680Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8336014Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8336492Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8337919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8339321Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8340182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8341049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8341815Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8342460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8343213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8343843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8344095Z Execution Analysis: .......... 2024-12-18T00:21:04.8344864Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8345340Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8346167Z pt-xla-profiler: TransferFromDeviceTime too frequent: 736 counts during 702 steps 2024-12-18T00:21:04.8346176Z 2024-12-18T00:21:04.8346728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8347005Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8347694Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8347953Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8348428Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8348773Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8349097Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8349488Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8350359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8351205Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8351977Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8352621Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8353368Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8354008Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8354700Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8354992Z Execution Analysis: (:1) 2024-12-18T00:21:04.8355668Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8356157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8356166Z 2024-12-18T00:21:04.8356642Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8356975Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8357516Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8357783Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8358266Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8358595Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8358938Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8359317Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8360761Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8362162Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8363049Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8363892Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8364636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8365303Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8366040Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8366694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8366934Z Execution Analysis: .......... 2024-12-18T00:21:04.8367555Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8368030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8368812Z pt-xla-profiler: TransferFromDeviceTime too frequent: 738 counts during 703 steps 2024-12-18T00:21:04.8368823Z 2024-12-18T00:21:04.8369295Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8369554Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8370263Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8370512Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8371004Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8371328Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8371674Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8372062Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8372927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8373802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8374544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8375221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8375951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8376667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8377362Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8377696Z Execution Analysis: (:1) 2024-12-18T00:21:04.8378323Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8378799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8378813Z 2024-12-18T00:21:04.8379348Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8379607Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8380156Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8380398Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8380898Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8381224Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8381560Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8381959Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8383396Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8384802Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8385679Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8386545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8387296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8387963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8388690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8389325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8389569Z Execution Analysis: .......... 2024-12-18T00:21:04.8390169Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8390750Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8391425Z pt-xla-profiler: TransferFromDeviceTime too frequent: 739 counts during 704 steps 2024-12-18T00:21:04.8391434Z 2024-12-18T00:21:04.8391924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8392182Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8392882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8393145Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8393623Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8393981Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8394310Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8394704Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8395557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8396408Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8397172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8397818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8398561Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8399187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8399947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8400231Z Execution Analysis: (:1) 2024-12-18T00:21:04.8400859Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8401397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8401407Z 2024-12-18T00:21:04.8401888Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8402162Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8402701Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8402957Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8403441Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8403782Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8404125Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8404510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8405957Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8407349Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8408220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8409070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8409832Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8410477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8411223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8411865Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8412103Z Execution Analysis: .......... 2024-12-18T00:21:04.8412777Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8413298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8413987Z pt-xla-profiler: TransferFromDeviceTime too frequent: 740 counts during 705 steps 2024-12-18T00:21:04.8413997Z 2024-12-18T00:21:04.8414464Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8414735Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8415427Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8415695Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8416162Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8416550Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8416887Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8417277Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8418165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8419012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8419774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8420420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8421148Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8421843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8422535Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8422831Z Execution Analysis: (:1) 2024-12-18T00:21:04.8423440Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8424009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8424019Z 2024-12-18T00:21:04.8424487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8424746Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8425300Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8425548Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8426048Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8426374Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8426721Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8427109Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8428533Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8429947Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8430810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8431680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8432426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8433088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8433812Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8434470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8434755Z Execution Analysis: .......... 2024-12-18T00:21:04.8435412Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8435902Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8436579Z pt-xla-profiler: TransferFromDeviceTime too frequent: 741 counts during 706 steps 2024-12-18T00:21:04.8436591Z 2024-12-18T00:21:04.8437081Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8437331Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8438038Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8438286Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8438773Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8439103Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8439437Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8439857Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8440718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8441575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8442317Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8442988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8443719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8444535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8445220Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8445500Z Execution Analysis: (:1) 2024-12-18T00:21:04.8446222Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8446700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8446711Z 2024-12-18T00:21:04.8447203Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8447456Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8448017Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8448265Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8448759Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8449109Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8449443Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8449851Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8451287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8452694Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8453540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8454380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8455140Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8455797Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8456631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8457345Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8457668Z Execution Analysis: .......... 2024-12-18T00:21:04.8458275Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8458763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8459440Z pt-xla-profiler: TransferFromDeviceTime too frequent: 742 counts during 707 steps 2024-12-18T00:21:04.8459449Z 2024-12-18T00:21:04.8459915Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8460187Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8460878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8461147Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8461618Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8461965Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8462292Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8462670Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8463535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8464388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8465139Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8465788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8466596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8467229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8467930Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8468272Z Execution Analysis: (:1) 2024-12-18T00:21:04.8468871Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8469353Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8469362Z 2024-12-18T00:21:04.8469832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8470101Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8470644Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8470906Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8471387Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8471707Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8472063Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8472453Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8473899Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8475292Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8476173Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8477023Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8477786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8478429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8479211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8479907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8480137Z Execution Analysis: .......... 2024-12-18T00:21:04.8480753Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8481232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8481918Z pt-xla-profiler: TransferFromDeviceTime too frequent: 743 counts during 708 steps 2024-12-18T00:21:04.8481929Z 2024-12-18T00:21:04.8482403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8482671Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8483377Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8483628Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8484110Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8484441Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8484778Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8485162Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8486021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8486877Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8487620Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8488339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8489066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8489731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8490470Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8490765Z Execution Analysis: (:1) 2024-12-18T00:21:04.8491364Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8491838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8491847Z 2024-12-18T00:21:04.8492341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8492592Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8493155Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8493397Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8493896Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8494229Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8494574Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8494986Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8496494Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8497911Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8498764Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8499638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8500381Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8501101Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8501886Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8502523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8502776Z Execution Analysis: .......... 2024-12-18T00:21:04.8503381Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8503872Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8504549Z pt-xla-profiler: TransferFromDeviceTime too frequent: 744 counts during 709 steps 2024-12-18T00:21:04.8504563Z 2024-12-18T00:21:04.8505047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8505305Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8506020Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8506270Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8506749Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8507087Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8507413Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8507815Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8508680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8509537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8510362Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8511015Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8511767Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8512459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8513160Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8513448Z Execution Analysis: (:1) 2024-12-18T00:21:04.8514078Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8514551Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8514559Z 2024-12-18T00:21:04.8515052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8515313Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8515852Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8516114Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8516597Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8516941Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8517272Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8517662Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8519108Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8520495Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8521373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8522211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8522972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8523715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8524467Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8525099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8525330Z Execution Analysis: .......... 2024-12-18T00:21:04.8525956Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8526432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8527128Z pt-xla-profiler: TransferFromDeviceTime too frequent: 745 counts during 710 steps 2024-12-18T00:21:04.8527136Z 2024-12-18T00:21:04.8527605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8527887Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8528577Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8528840Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8529308Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8529638Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8529980Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8530364Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8531243Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8532091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8532906Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8533553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8534341Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8535000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8535692Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8535996Z Execution Analysis: (:1) 2024-12-18T00:21:04.8536667Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8537164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8537177Z 2024-12-18T00:21:04.8537646Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8537916Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8538452Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8538699Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8539209Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8539535Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8539888Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8540273Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8541722Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8543110Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8543976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8544968Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8545873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8546537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8547266Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8547917Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8548156Z Execution Analysis: .......... 2024-12-18T00:21:04.8548780Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8549248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8549932Z pt-xla-profiler: TransferFromDeviceTime too frequent: 746 counts during 711 steps 2024-12-18T00:21:04.8549941Z 2024-12-18T00:21:04.8550429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8550686Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8551385Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8551630Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8552107Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8552431Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8552755Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8553145Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8554009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8554927Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8555662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8556313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8557128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8557783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8558468Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8558752Z Execution Analysis: (:1) 2024-12-18T00:21:04.8559371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8559841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8559855Z 2024-12-18T00:21:04.8560331Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8560584Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8561134Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8561379Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8561861Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8562194Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8562528Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8562917Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8564348Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8565736Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8566588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8567500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8568287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8568935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8569669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8570303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8570547Z Execution Analysis: .......... 2024-12-18T00:21:04.8571145Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8571631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8572306Z pt-xla-profiler: TransferFromDeviceTime too frequent: 747 counts during 712 steps 2024-12-18T00:21:04.8572319Z 2024-12-18T00:21:04.8572804Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8573046Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8573742Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8573996Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8574460Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8574797Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8575118Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8575501Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8576444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8577288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8578048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8578740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8579485Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8580120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8580822Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8581095Z Execution Analysis: (:1) 2024-12-18T00:21:04.8581693Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8582183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8582192Z 2024-12-18T00:21:04.8582656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8582925Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8583463Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8583719Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8584197Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8584525Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8584863Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8585247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8586693Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8588068Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8588984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8589909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8590666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8591316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8592039Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8592684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8592912Z Execution Analysis: .......... 2024-12-18T00:21:04.8593530Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8594002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8594689Z pt-xla-profiler: TransferFromDeviceTime too frequent: 748 counts during 713 steps 2024-12-18T00:21:04.8594703Z 2024-12-18T00:21:04.8595177Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8595443Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8596124Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8596368Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8596853Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8597176Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8597514Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8597942Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8598811Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8599655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8600456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8601130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8601857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8602499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8603190Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8603484Z Execution Analysis: (:1) 2024-12-18T00:21:04.8604088Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8604562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8604590Z 2024-12-18T00:21:04.8605062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8605313Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8605868Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8606111Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8606610Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8606930Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8607268Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8607660Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8609097Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8610497Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8611457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8612313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8613059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8613726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8614448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8615108Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8615343Z Execution Analysis: .......... 2024-12-18T00:21:04.8615942Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8616482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8617162Z pt-xla-profiler: TransferFromDeviceTime too frequent: 749 counts during 714 steps 2024-12-18T00:21:04.8617173Z 2024-12-18T00:21:04.8617656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8617906Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8618611Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8618858Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8619334Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8619731Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8620053Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8620442Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8621302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8622217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8622965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8623618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8624369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8625011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8625707Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8625989Z Execution Analysis: (:1) 2024-12-18T00:21:04.8626602Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8627063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8627077Z 2024-12-18T00:21:04.8627562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8627806Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8628344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8628601Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8629085Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8629426Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8629759Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8630157Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8631579Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8633079Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8633957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8634800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8635563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8636207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8636944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8637582Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8637828Z Execution Analysis: .......... 2024-12-18T00:21:04.8638430Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8638910Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8639597Z pt-xla-profiler: TransferFromDeviceTime too frequent: 750 counts during 715 steps 2024-12-18T00:21:04.8639606Z 2024-12-18T00:21:04.8640074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8640336Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8641027Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8641301Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8641811Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8642141Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8642480Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8642866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8643901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8644852Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8645615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8646255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8647019Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8647648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8654913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8655241Z Execution Analysis: (:1) 2024-12-18T00:21:04.8655857Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8656426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8656440Z 2024-12-18T00:21:04.8656915Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8657176Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8657732Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8657970Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8658467Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8658793Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8659141Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8659524Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8660966Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8662587Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8663446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8664299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8665047Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8665700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8666434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8667079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8667309Z Execution Analysis: .......... 2024-12-18T00:21:04.8667929Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8668419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8669094Z pt-xla-profiler: TransferFromDeviceTime too frequent: 751 counts during 716 steps 2024-12-18T00:21:04.8669106Z 2024-12-18T00:21:04.8669591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8669845Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8670540Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8670859Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8671333Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8671657Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8671982Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8672371Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8673302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8674153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8674888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8675539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8676262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8676894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8677593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8677872Z Execution Analysis: (:1) 2024-12-18T00:21:04.8678504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8678970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8678981Z 2024-12-18T00:21:04.8679457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8679716Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8680259Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8680495Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8680970Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8681302Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8681631Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8682032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8683602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8684999Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8685853Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8686691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8687452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8688098Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8688832Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8689460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8689708Z Execution Analysis: .......... 2024-12-18T00:21:04.8690317Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8690794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8691466Z pt-xla-profiler: TransferFromDeviceTime too frequent: 752 counts during 717 steps 2024-12-18T00:21:04.8691477Z 2024-12-18T00:21:04.8691952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8692213Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8692944Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8693190Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8693654Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8693989Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8694308Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8694739Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8695608Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8696502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8697257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8697908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8698640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8699270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8699973Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8700258Z Execution Analysis: (:1) 2024-12-18T00:21:04.8700866Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8701338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8701347Z 2024-12-18T00:21:04.8701801Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8702059Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8702596Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8702845Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8703331Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8703652Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8703987Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8704419Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8705908Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8707298Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8708164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8708998Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8709755Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8710406Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8711130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8711785Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8712010Z Execution Analysis: .......... 2024-12-18T00:21:04.8712618Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8713087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8713762Z pt-xla-profiler: TransferFromDeviceTime too frequent: 753 counts during 718 steps 2024-12-18T00:21:04.8713773Z 2024-12-18T00:21:04.8714241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8714544Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8715242Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8715485Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8715962Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8716327Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8716661Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8717044Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8717896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8718734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8719470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8720122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8720854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8721490Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8722181Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8722469Z Execution Analysis: (:1) 2024-12-18T00:21:04.8723069Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8723539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8723549Z 2024-12-18T00:21:04.8724023Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8724280Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8724820Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8725061Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8725551Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8725871Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8726242Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8726681Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8728108Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8729502Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8730357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8731201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8731945Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8732601Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8733327Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8733956Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8734195Z Execution Analysis: .......... 2024-12-18T00:21:04.8734792Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8735262Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8735935Z pt-xla-profiler: TransferFromDeviceTime too frequent: 754 counts during 719 steps 2024-12-18T00:21:04.8735944Z 2024-12-18T00:21:04.8736586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8736831Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8737532Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8737779Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8738301Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8738632Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8738954Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8739335Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8740190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8741049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8741784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8742429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8743152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8743782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8744671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8744945Z Execution Analysis: (:1) 2024-12-18T00:21:04.8745548Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8746021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8746031Z 2024-12-18T00:21:04.8746508Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8746760Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8747297Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8747546Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8748027Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8748449Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8748841Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8749216Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8750675Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8752062Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8752935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8753784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8754535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8755183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8755917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8756547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8756773Z Execution Analysis: .......... 2024-12-18T00:21:04.8757386Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8757856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8758535Z pt-xla-profiler: TransferFromDeviceTime too frequent: 755 counts during 720 steps 2024-12-18T00:21:04.8758611Z 2024-12-18T00:21:04.8759072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8759329Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8760014Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8760358Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8760825Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8761147Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8761476Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8761856Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8762718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8763554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8764305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8764950Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8765679Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8766341Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8767027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8767310Z Execution Analysis: (:1) 2024-12-18T00:21:04.8767904Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8768378Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8768387Z 2024-12-18T00:21:04.8768853Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8769111Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8769648Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8769885Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8770420Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8770790Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8771130Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8771514Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8772948Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8774320Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8775176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8776018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8776814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8777471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8778204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8778842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8779076Z Execution Analysis: .......... 2024-12-18T00:21:04.8779684Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8780152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8780869Z pt-xla-profiler: TransferFromDeviceTime too frequent: 756 counts during 721 steps 2024-12-18T00:21:04.8780880Z 2024-12-18T00:21:04.8781360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8781617Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8782363Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8782609Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8783087Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8783407Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8783727Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8784123Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8784979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8785834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8786572Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8787222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8787960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8788597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8789282Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8789555Z Execution Analysis: (:1) 2024-12-18T00:21:04.8790163Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8790636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8790650Z 2024-12-18T00:21:04.8791122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8791372Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8791915Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8792203Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8792730Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8793060Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8793388Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8793777Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8795213Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8796616Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8797482Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8798325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8799081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8799724Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8800465Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8801102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8801346Z Execution Analysis: .......... 2024-12-18T00:21:04.8801958Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8802488Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8803157Z pt-xla-profiler: TransferFromDeviceTime too frequent: 757 counts during 722 steps 2024-12-18T00:21:04.8803168Z 2024-12-18T00:21:04.8803656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8803951Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8804638Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8804888Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8805359Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8805683Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8806012Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8806393Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8807246Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8808084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8808843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8809496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8810229Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8810861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8811568Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8811835Z Execution Analysis: (:1) 2024-12-18T00:21:04.8812432Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8812913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8812924Z 2024-12-18T00:21:04.8813389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8813691Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8814274Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8814527Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8815010Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8815330Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8815665Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8816046Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8817560Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8818945Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8819812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8820661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8821414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8822058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8822784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8823424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8823652Z Execution Analysis: .......... 2024-12-18T00:21:04.8824261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8824780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8825452Z pt-xla-profiler: TransferFromDeviceTime too frequent: 759 counts during 723 steps 2024-12-18T00:21:04.8825468Z 2024-12-18T00:21:04.8825977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8826239Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8826926Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8827168Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8827646Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8827963Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8828291Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8828671Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8829536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8830378Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8831125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8831776Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8832501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8833135Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8833831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8834107Z Execution Analysis: (:1) 2024-12-18T00:21:04.8834708Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8835181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8835203Z 2024-12-18T00:21:04.8835676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8837630Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8838226Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8838468Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8838955Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8839281Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8839604Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8839998Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8841420Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8842816Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8843676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8844688Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8845429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8846082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8846812Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8847451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8847825Z Execution Analysis: .......... 2024-12-18T00:21:04.8848429Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8848907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8849646Z pt-xla-profiler: TransferFromDeviceTime too frequent: 760 counts during 724 steps 2024-12-18T00:21:04.8849662Z 2024-12-18T00:21:04.8850142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8850393Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8851091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8851336Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8851809Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8852139Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8852460Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8852840Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8853689Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8854536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8855278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8855920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8856725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8857352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8858059Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8858337Z Execution Analysis: (:1) 2024-12-18T00:21:04.8858947Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8859413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8859488Z 2024-12-18T00:21:04.8860029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8860280Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8860817Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8861070Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8861545Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8861869Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8862197Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8862588Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8864026Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8865424Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8866301Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8867142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8867889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8868533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8869269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8869953Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8870196Z Execution Analysis: .......... 2024-12-18T00:21:04.8870798Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8871270Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8871999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 761 counts during 725 steps 2024-12-18T00:21:04.8872010Z 2024-12-18T00:21:04.8872482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8872745Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8873430Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8873680Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8874148Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8874472Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8874800Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8875184Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8876047Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8876899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8877644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8878299Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8879046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8879674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8880364Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8880649Z Execution Analysis: (:1) 2024-12-18T00:21:04.8881244Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8881768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8881827Z 2024-12-18T00:21:04.8882290Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8882541Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8883084Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8883324Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8883812Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8884133Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8884482Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8884865Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8886300Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8887687Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8888547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8889384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8890125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8890782Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8891512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8892192Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8892424Z Execution Analysis: .......... 2024-12-18T00:21:04.8893027Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8893544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8894217Z pt-xla-profiler: TransferFromDeviceTime too frequent: 762 counts during 726 steps 2024-12-18T00:21:04.8894235Z 2024-12-18T00:21:04.8894702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8894955Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8895653Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8895895Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8896455Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8896780Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8897101Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8897494Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8898356Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8899201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8899938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8900593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8901316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8901955Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8902653Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8902925Z Execution Analysis: (:1) 2024-12-18T00:21:04.8903539Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8904104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8904117Z 2024-12-18T00:21:04.8904589Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8904836Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8905379Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8905616Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8906096Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8906427Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8906765Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8907156Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8908590Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8909988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8910851Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8911710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8912444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8913086Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8913882Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8914517Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8914757Z Execution Analysis: .......... 2024-12-18T00:21:04.8915406Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8915891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8916567Z pt-xla-profiler: TransferFromDeviceTime too frequent: 763 counts during 727 steps 2024-12-18T00:21:04.8916576Z 2024-12-18T00:21:04.8917055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8917305Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8917990Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8918240Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8918715Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8919047Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8919376Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8919774Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8920622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8921458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8922204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8922848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8923566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8924204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8924909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8925227Z Execution Analysis: (:1) 2024-12-18T00:21:04.8925885Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8926370Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8926381Z 2024-12-18T00:21:04.8926849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8927109Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8927648Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8927898Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8928377Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8928719Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8929054Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8929437Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8930886Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8932285Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8933158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8933996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8934747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8935440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8936186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8936886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8937174Z Execution Analysis: .......... 2024-12-18T00:21:04.8937779Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8938247Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8938918Z pt-xla-profiler: TransferFromDeviceTime too frequent: 764 counts during 728 steps 2024-12-18T00:21:04.8938928Z 2024-12-18T00:21:04.8939398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8939661Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8940354Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8940594Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8941071Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8941394Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8941738Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8942123Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8942978Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8943826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8944730Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8945385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8946121Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8946761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8947446Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8947828Z Execution Analysis: (:1) 2024-12-18T00:21:04.8948502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8948980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8948990Z 2024-12-18T00:21:04.8949457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8949708Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8950253Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8950500Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8950990Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8951313Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8951655Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8952042Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8953485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8954876Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8955741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8956592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8957396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8958047Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8958770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8959482Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8959715Z Execution Analysis: .......... 2024-12-18T00:21:04.8960325Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8960800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8961470Z pt-xla-profiler: TransferFromDeviceTime too frequent: 765 counts during 729 steps 2024-12-18T00:21:04.8961481Z 2024-12-18T00:21:04.8961958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8962215Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8962906Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8963146Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8963630Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8963967Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8964294Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8964681Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8965538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8966389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8967130Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8967788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8968512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8969139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8969932Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8970210Z Execution Analysis: (:1) 2024-12-18T00:21:04.8970818Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8971290Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8971299Z 2024-12-18T00:21:04.8971773Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8972023Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8972570Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8972823Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8973301Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8973637Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8973971Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8974369Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8975795Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8977266Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8978118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8979002Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8979744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8980382Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8981175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8981804Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8982043Z Execution Analysis: .......... 2024-12-18T00:21:04.8982643Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8983104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8983769Z pt-xla-profiler: TransferFromDeviceTime too frequent: 766 counts during 730 steps 2024-12-18T00:21:04.8983782Z 2024-12-18T00:21:04.8984240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8984501Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8985179Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8985431Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8985900Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8986227Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8986546Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8986919Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8987767Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8988590Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8989327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8989794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8990106Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8990415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8990743Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.8990875Z Execution Analysis: (:1) 2024-12-18T00:21:04.8991134Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8991342Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8991346Z 2024-12-18T00:21:04.8991548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8991667Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8991899Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.8992014Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8992218Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.8992361Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.8992513Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.8992677Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8993270Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.8993840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.8994204Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.8994654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8994963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8995269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8995579Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.8995854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.8995958Z Execution Analysis: .......... 2024-12-18T00:21:04.8996221Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.8996422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8996717Z pt-xla-profiler: TransferFromDeviceTime too frequent: 767 counts during 731 steps 2024-12-18T00:21:04.8996722Z 2024-12-18T00:21:04.8996924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.8997038Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.8997337Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.8997450Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.8997660Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.8997802Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.8997951Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.8998116Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.8998470Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.8998825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.8999135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.8999412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.8999762Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9000061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9000352Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9000478Z Execution Analysis: (:1) 2024-12-18T00:21:04.9000738Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9000938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9000942Z 2024-12-18T00:21:04.9001148Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9001260Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9001494Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9001605Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9001826Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9001969Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9002113Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9002282Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9002874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9003454Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9003839Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9004197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9004513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9004817Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9005125Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9005394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9005503Z Execution Analysis: .......... 2024-12-18T00:21:04.9005761Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9005970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9006255Z pt-xla-profiler: TransferFromDeviceTime too frequent: 768 counts during 732 steps 2024-12-18T00:21:04.9006259Z 2024-12-18T00:21:04.9006469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9006585Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9006880Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9006995Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9007196Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9007344Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9007486Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9007658Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9008014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9008367Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9008684Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9008981Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9009322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9009588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9009886Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9010011Z Execution Analysis: (:1) 2024-12-18T00:21:04.9010273Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9010474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9010481Z 2024-12-18T00:21:04.9010680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9010798Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9011031Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9011151Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9011360Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9011506Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9011652Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9011818Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9012417Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9012988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9013377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9013729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9014070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9014343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9014656Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9014927Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9015033Z Execution Analysis: .......... 2024-12-18T00:21:04.9015296Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9015498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9015790Z pt-xla-profiler: TransferFromDeviceTime too frequent: 769 counts during 733 steps 2024-12-18T00:21:04.9015796Z 2024-12-18T00:21:04.9015998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9016116Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9016478Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9016597Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9016801Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9016944Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9017091Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9017256Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9017621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9017971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9018285Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9018615Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9018924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9019197Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9019488Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9019616Z Execution Analysis: (:1) 2024-12-18T00:21:04.9019873Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9020086Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9020090Z 2024-12-18T00:21:04.9020293Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9020408Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9020647Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9020757Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9020973Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9021115Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9021266Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9021432Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9022024Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9022630Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9022988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9023373Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9023686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9023966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9024274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9024545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9024651Z Execution Analysis: .......... 2024-12-18T00:21:04.9024910Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9025118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9025408Z pt-xla-profiler: TransferFromDeviceTime too frequent: 770 counts during 734 steps 2024-12-18T00:21:04.9025412Z 2024-12-18T00:21:04.9025622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9025737Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9026043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9026153Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9026367Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9026513Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9026657Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9026835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9027191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9027554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9027918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9028203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9028510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9028780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9029184Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9029306Z Execution Analysis: (:1) 2024-12-18T00:21:04.9029566Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9029765Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9029769Z 2024-12-18T00:21:04.9029981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9030093Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9030334Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9030441Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9030645Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9030796Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9030938Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9031115Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9031698Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9032294Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9032681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9033026Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9033341Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9033608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9033918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9034179Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9034298Z Execution Analysis: .......... 2024-12-18T00:21:04.9034546Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9034757Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9035040Z pt-xla-profiler: TransferFromDeviceTime too frequent: 771 counts during 735 steps 2024-12-18T00:21:04.9035044Z 2024-12-18T00:21:04.9035240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9035360Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9035644Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9035760Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9035959Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9036109Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9036248Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9036412Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9036770Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9037161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9037478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9037742Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9038051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9038310Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9038590Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9038718Z Execution Analysis: (:1) 2024-12-18T00:21:04.9038969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9039177Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9039184Z 2024-12-18T00:21:04.9039379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9039501Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9039722Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9039840Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9040040Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9040182Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9040333Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9040497Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9041113Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9041673Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9042059Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9042398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9042708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9042972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9043274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9043546Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9043649Z Execution Analysis: .......... 2024-12-18T00:21:04.9043903Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9044104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9044561Z pt-xla-profiler: TransferFromDeviceTime too frequent: 772 counts during 736 steps 2024-12-18T00:21:04.9044567Z 2024-12-18T00:21:04.9044933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9045049Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9045348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9045459Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9045671Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9045820Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9045972Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9046139Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9046557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9046946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9047258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9047541Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9047849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9048129Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9048424Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9048559Z Execution Analysis: (:1) 2024-12-18T00:21:04.9048815Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9049024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9049028Z 2024-12-18T00:21:04.9049239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9049355Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9049598Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9049708Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9049932Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9050075Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9050258Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9050433Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9051027Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9051647Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9052005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9052366Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9052675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9052960Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9053267Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9053533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9053646Z Execution Analysis: .......... 2024-12-18T00:21:04.9053904Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9054119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9054403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 773 counts during 737 steps 2024-12-18T00:21:04.9054408Z 2024-12-18T00:21:04.9054621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9054733Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9055035Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9055143Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9055348Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9055496Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9055640Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9055845Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9056228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9056663Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9056976Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9057252Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9057569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9057838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9058140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9058267Z Execution Analysis: (:1) 2024-12-18T00:21:04.9058541Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9058746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9058751Z 2024-12-18T00:21:04.9058965Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9059075Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9059306Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9059422Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9059631Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9059815Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9059962Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9060130Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9060733Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9061334Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9061703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9062055Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9062376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9062649Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9062968Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9063234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9063341Z Execution Analysis: .......... 2024-12-18T00:21:04.9063607Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9063811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9064108Z pt-xla-profiler: TransferFromDeviceTime too frequent: 774 counts during 738 steps 2024-12-18T00:21:04.9064113Z 2024-12-18T00:21:04.9064312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9064430Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9064720Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9064844Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9065047Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9065191Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9065371Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9065567Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9065938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9066286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9066607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9066880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9067187Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9067466Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9067758Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9067892Z Execution Analysis: (:1) 2024-12-18T00:21:04.9068150Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9068468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9068472Z 2024-12-18T00:21:04.9068665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9068783Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9069006Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9069114Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9069364Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9069503Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9069654Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9069816Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9070436Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9070996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9071346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9071694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9071996Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9072277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9072581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9072858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9072966Z Execution Analysis: .......... 2024-12-18T00:21:04.9073230Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9073430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9073707Z pt-xla-profiler: TransferFromDeviceTime too frequent: 775 counts during 739 steps 2024-12-18T00:21:04.9073712Z 2024-12-18T00:21:04.9073920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9074034Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9074325Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9074433Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9074648Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9074812Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9074983Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9075156Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9075505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9075856Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9076160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9076438Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9076740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9077014Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9077300Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9077424Z Execution Analysis: (:1) 2024-12-18T00:21:04.9077681Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9077881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9077885Z 2024-12-18T00:21:04.9078092Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9078204Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9078437Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9078575Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9078779Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9078930Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9079076Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9079268Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9079847Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9080418Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9080765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9081116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9081524Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9081778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9082074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9082325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9082433Z Execution Analysis: .......... 2024-12-18T00:21:04.9082667Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9082861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9083119Z pt-xla-profiler: TransferFromDeviceTime too frequent: 776 counts during 740 steps 2024-12-18T00:21:04.9083123Z 2024-12-18T00:21:04.9083321Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9083425Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9083694Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9083825Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9084013Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9084172Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9084303Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9084456Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9084794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9085116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9085413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9085665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9085957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9086207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9086488Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9086601Z Execution Analysis: (:1) 2024-12-18T00:21:04.9086840Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9087032Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9087036Z 2024-12-18T00:21:04.9087221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9087331Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9087573Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9087682Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9087873Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9088010Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9088179Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9088334Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9088890Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9089423Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9089766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9090090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9090387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9090639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9090927Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9091179Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9091276Z Execution Analysis: .......... 2024-12-18T00:21:04.9091522Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9091708Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9091980Z pt-xla-profiler: TransferFromDeviceTime too frequent: 777 counts during 741 steps 2024-12-18T00:21:04.9091986Z 2024-12-18T00:21:04.9092172Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9092284Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9092551Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9092680Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9092902Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9093034Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9093173Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9093328Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9093669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9093990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9094282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9094540Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9094823Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9095082Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9095350Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9095475Z Execution Analysis: (:1) 2024-12-18T00:21:04.9095714Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9095901Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9095918Z 2024-12-18T00:21:04.9096101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9096230Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9096524Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9096629Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9097004Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9097178Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9097325Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9097545Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9098142Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9098731Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9099093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9099453Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9099764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9100049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9100351Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9100629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9100734Z Execution Analysis: .......... 2024-12-18T00:21:04.9100993Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9101202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9101488Z pt-xla-profiler: TransferFromDeviceTime too frequent: 778 counts during 742 steps 2024-12-18T00:21:04.9101494Z 2024-12-18T00:21:04.9101698Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9101836Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9102176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9102284Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9102490Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9102639Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9102783Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9102957Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9103315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9103674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9103985Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9104256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9104578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9104846Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9105143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9105268Z Execution Analysis: (:1) 2024-12-18T00:21:04.9105531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9105733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9105764Z 2024-12-18T00:21:04.9105971Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9106082Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9106312Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9106429Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9106660Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9106809Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9106957Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9107130Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9107718Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9108293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9108657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9109005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9109428Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9109695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9110004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9110265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9110376Z Execution Analysis: .......... 2024-12-18T00:21:04.9110623Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9110819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9111105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 780 counts during 743 steps 2024-12-18T00:21:04.9111110Z 2024-12-18T00:21:04.9111305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9111449Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9111754Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9111872Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9112070Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9112210Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9112354Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9112516Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9112867Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9113212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9113518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9113783Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9114092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9114350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9114635Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9114776Z Execution Analysis: (:1) 2024-12-18T00:21:04.9115027Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9115238Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9115267Z 2024-12-18T00:21:04.9115468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9115589Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9115819Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9115952Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9116169Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9116309Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9116463Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9116624Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9117219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9117785Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9118152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9118499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9118803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9119084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9119386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9119661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9119765Z Execution Analysis: .......... 2024-12-18T00:21:04.9120031Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9120232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9120509Z pt-xla-profiler: TransferFromDeviceTime too frequent: 781 counts during 744 steps 2024-12-18T00:21:04.9120548Z 2024-12-18T00:21:04.9120771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9120881Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9121183Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9121291Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9121506Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9121648Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9121789Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9121968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9122317Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9122676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9122980Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9123264Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9123565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9123835Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9124119Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9124241Z Execution Analysis: (:1) 2024-12-18T00:21:04.9124503Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9124724Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9124728Z 2024-12-18T00:21:04.9124937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9125046Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9125302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9125409Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9125616Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9125770Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9125912Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9126085Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9126663Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9127235Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9127587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9127942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9128246Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9128511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9128825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9129086Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9129204Z Execution Analysis: .......... 2024-12-18T00:21:04.9129566Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9129766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9130057Z pt-xla-profiler: TransferFromDeviceTime too frequent: 782 counts during 745 steps 2024-12-18T00:21:04.9130064Z 2024-12-18T00:21:04.9130284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9130392Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9130661Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9130775Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9130960Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9131104Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9131235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9131405Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9131737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9132061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9132367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9132618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9132914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9133160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9133438Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9133555Z Execution Analysis: (:1) 2024-12-18T00:21:04.9133820Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9134021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9134027Z 2024-12-18T00:21:04.9134236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9134351Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9134564Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9134679Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9134869Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9135013Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9135153Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9135310Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9135872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9136478Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9137006Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9137359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9137686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9137961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9138279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9138552Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9138663Z Execution Analysis: .......... 2024-12-18T00:21:04.9138936Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9139146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9139605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 783 counts during 746 steps 2024-12-18T00:21:04.9139611Z 2024-12-18T00:21:04.9139813Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9139941Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9140235Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9140348Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9140569Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9140717Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9140872Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9141039Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9141417Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9141772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9142089Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9142377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9142686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9142969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9143261Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9143428Z Execution Analysis: (:1) 2024-12-18T00:21:04.9143687Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9143899Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9143906Z 2024-12-18T00:21:04.9144273Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9144400Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9144646Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9144754Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9144976Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9145120Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9145280Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9145450Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9146041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9146636Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9146995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9147362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9147672Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9147957Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9148263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9148542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9148648Z Execution Analysis: .......... 2024-12-18T00:21:04.9148906Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9149208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9149495Z pt-xla-profiler: TransferFromDeviceTime too frequent: 784 counts during 747 steps 2024-12-18T00:21:04.9149500Z 2024-12-18T00:21:04.9149716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9149827Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9150134Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9150245Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9150455Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9150609Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9150751Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9150931Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9151293Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9151654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9151966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9152257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9152569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9152835Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9153174Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9153299Z Execution Analysis: (:1) 2024-12-18T00:21:04.9153565Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9153803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9153808Z 2024-12-18T00:21:04.9154022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9154134Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9154363Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9154485Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9154694Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9154850Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9154997Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9155178Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9155769Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9156457Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9156788Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9157112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9157410Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9157660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9157959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9158208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9158315Z Execution Analysis: .......... 2024-12-18T00:21:04.9158606Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9158795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9159074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 785 counts during 748 steps 2024-12-18T00:21:04.9159078Z 2024-12-18T00:21:04.9159264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9159382Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9159648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9159766Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9159957Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9160100Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9160235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9160396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9160745Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9161068Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9161371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9161627Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9161924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9163012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9163284Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9163416Z Execution Analysis: (:1) 2024-12-18T00:21:04.9163686Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9163889Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9163893Z 2024-12-18T00:21:04.9164079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9164197Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9164410Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9164526Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9164724Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9164862Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9165009Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9165161Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9165728Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9166260Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9166606Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9166929Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9167218Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9167488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9167774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9168039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9168169Z Execution Analysis: .......... 2024-12-18T00:21:04.9168447Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9168640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9168919Z pt-xla-profiler: TransferFromDeviceTime too frequent: 786 counts during 749 steps 2024-12-18T00:21:04.9168924Z 2024-12-18T00:21:04.9169114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9169220Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9169504Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9169610Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9169812Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9169946Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9170087Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9170247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9170578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9170911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9171195Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9171457Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9171765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9172022Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9172292Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9172405Z Execution Analysis: (:1) 2024-12-18T00:21:04.9172693Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9172879Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9172883Z 2024-12-18T00:21:04.9173077Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9173185Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9173411Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9173511Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9173717Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9173853Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9173986Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9174155Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9174705Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9175248Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9175577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9175911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9176199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9176541Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9177002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9177326Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9177496Z Execution Analysis: .......... 2024-12-18T00:21:04.9177756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9177975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9178257Z pt-xla-profiler: TransferFromDeviceTime too frequent: 787 counts during 750 steps 2024-12-18T00:21:04.9178262Z 2024-12-18T00:21:04.9178474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9178592Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9178880Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9179002Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9179208Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9179366Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9179506Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9179686Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9180045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9180395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9180717Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9180990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9181334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9181599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9181905Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9182059Z Execution Analysis: (:1) 2024-12-18T00:21:04.9182327Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9182532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9182536Z 2024-12-18T00:21:04.9182736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9182858Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9183086Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9183208Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9183415Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9183566Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9183716Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9183885Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9184498Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9185074Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9185442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9185793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9186117Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9186388Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9186736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9187033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9187140Z Execution Analysis: .......... 2024-12-18T00:21:04.9187407Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9187608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9187905Z pt-xla-profiler: TransferFromDeviceTime too frequent: 788 counts during 751 steps 2024-12-18T00:21:04.9187910Z 2024-12-18T00:21:04.9188112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9188243Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9188535Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9188657Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9188867Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9189116Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9189258Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9189410Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9189754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9190081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9190380Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9190664Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9190948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9191213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9191504Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9191630Z Execution Analysis: (:1) 2024-12-18T00:21:04.9191873Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9192067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9192071Z 2024-12-18T00:21:04.9192258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9192364Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9192586Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9192688Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9192894Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9193025Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9193175Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9193328Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9193876Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9194419Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9194748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9195086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9195376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9195667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9195974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9196235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9196336Z Execution Analysis: .......... 2024-12-18T00:21:04.9196572Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9196768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9197028Z pt-xla-profiler: TransferFromDeviceTime too frequent: 789 counts during 752 steps 2024-12-18T00:21:04.9197034Z 2024-12-18T00:21:04.9197232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9197333Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9197616Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9197720Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9197920Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9198056Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9198185Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9198354Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9198682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9199016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9199328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9199597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9199888Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9200160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9200442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9200556Z Execution Analysis: (:1) 2024-12-18T00:21:04.9200803Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9200987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9200991Z 2024-12-18T00:21:04.9201187Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9201293Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9201516Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9201621Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9201818Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9201964Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9202096Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9202262Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9202811Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9203352Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9203685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9204009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9204332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9204610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9204906Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9205154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9205260Z Execution Analysis: .......... 2024-12-18T00:21:04.9205497Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9205696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9205958Z pt-xla-profiler: TransferFromDeviceTime too frequent: 790 counts during 753 steps 2024-12-18T00:21:04.9205962Z 2024-12-18T00:21:04.9206150Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9206265Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9206536Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9206646Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9206837Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9206977Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9207106Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9207260Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9207596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9207957Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9208253Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9208506Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9208824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9209071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9209346Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9209459Z Execution Analysis: (:1) 2024-12-18T00:21:04.9209698Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9209892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9209898Z 2024-12-18T00:21:04.9210083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9210195Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9210408Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9210519Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9210712Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9210846Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9210989Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9211143Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9211693Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9212222Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9212558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9212880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9213225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9213476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9213758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9214010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9214105Z Execution Analysis: .......... 2024-12-18T00:21:04.9214345Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9214533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9214803Z pt-xla-profiler: TransferFromDeviceTime too frequent: 791 counts during 754 steps 2024-12-18T00:21:04.9214807Z 2024-12-18T00:21:04.9214993Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9215099Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9215371Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9215472Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9215665Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9215796Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9215937Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9216087Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9216490Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9217022Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9217331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9217647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9217957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9218229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9218516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9218647Z Execution Analysis: (:1) 2024-12-18T00:21:04.9218903Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9219107Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9219111Z 2024-12-18T00:21:04.9219318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9219434Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9219673Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9219784Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9219995Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9220135Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9220281Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9220456Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9221048Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9221631Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9221990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9222400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9222712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9222993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9223299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9223562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9223673Z Execution Analysis: .......... 2024-12-18T00:21:04.9223926Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9224137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9224423Z pt-xla-profiler: TransferFromDeviceTime too frequent: 792 counts during 755 steps 2024-12-18T00:21:04.9224429Z 2024-12-18T00:21:04.9224639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9224749Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9225048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9225155Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9225358Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9225508Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9225648Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9225847Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9226202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9226559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9226898Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9227173Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9227485Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9227753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9228048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9228169Z Execution Analysis: (:1) 2024-12-18T00:21:04.9228431Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9228634Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9228639Z 2024-12-18T00:21:04.9228848Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9228965Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9229284Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9229392Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9229584Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9229721Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9229856Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9230009Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9230561Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9231093Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9231453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9231801Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9232097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9232350Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9232642Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9232888Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9232988Z Execution Analysis: .......... 2024-12-18T00:21:04.9233232Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9233419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9233690Z pt-xla-profiler: TransferFromDeviceTime too frequent: 793 counts during 756 steps 2024-12-18T00:21:04.9233696Z 2024-12-18T00:21:04.9233883Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9233992Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9234257Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9234367Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9234555Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9234689Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9234850Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9235004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9235340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9235663Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9235986Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9236237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9236518Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9236776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9237048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9237169Z Execution Analysis: (:1) 2024-12-18T00:21:04.9237404Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9237597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9237603Z 2024-12-18T00:21:04.9237789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9237903Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9238111Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9238213Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9238413Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9238543Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9238681Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9238836Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9239393Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9239922Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9240316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9240647Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9240934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9241193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9241477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9241733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9241831Z Execution Analysis: .......... 2024-12-18T00:21:04.9242078Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9242267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9242531Z pt-xla-profiler: TransferFromDeviceTime too frequent: 794 counts during 757 steps 2024-12-18T00:21:04.9242535Z 2024-12-18T00:21:04.9242729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9242831Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9243105Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9243207Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9247114Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9247431Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9247577Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9247755Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9248118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9248523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9248835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9249113Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9249422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9249689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9249982Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9250110Z Execution Analysis: (:1) 2024-12-18T00:21:04.9250379Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9250586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9250597Z 2024-12-18T00:21:04.9250803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9250913Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9251141Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9251255Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9251462Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9251610Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9251759Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9251932Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9252533Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9253187Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9253549Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9253896Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9254213Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9254485Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9254799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9255067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9255179Z Execution Analysis: .......... 2024-12-18T00:21:04.9255435Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9255644Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9255934Z pt-xla-profiler: TransferFromDeviceTime too frequent: 795 counts during 758 steps 2024-12-18T00:21:04.9255940Z 2024-12-18T00:21:04.9256139Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9256256Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9256629Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9256742Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9256979Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9257127Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9257266Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9257433Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9257821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9258175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9258491Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9258763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9259076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9259338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9259627Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9259754Z Execution Analysis: (:1) 2024-12-18T00:21:04.9260008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9260222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9260226Z 2024-12-18T00:21:04.9260424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9260539Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9260764Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9260876Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9261079Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9261219Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9261371Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9261534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9262132Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9262761Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9263124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9263477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9263786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9264060Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9264368Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9264639Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9264744Z Execution Analysis: .......... 2024-12-18T00:21:04.9265006Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9265205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9265491Z pt-xla-profiler: TransferFromDeviceTime too frequent: 796 counts during 759 steps 2024-12-18T00:21:04.9265496Z 2024-12-18T00:21:04.9265696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9265807Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9266097Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9266230Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9266438Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9266579Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9266727Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9266918Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9267272Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9267626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9267932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9268204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9268599Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9268851Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9269121Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9269235Z Execution Analysis: (:1) 2024-12-18T00:21:04.9269480Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9269665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9269669Z 2024-12-18T00:21:04.9269857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9269959Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9270173Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9270271Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9270464Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9270596Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9270731Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9270889Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9271485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9272019Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9272353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9272678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9272963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9273220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9273503Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9273752Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9273856Z Execution Analysis: .......... 2024-12-18T00:21:04.9274096Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9274287Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9274550Z pt-xla-profiler: TransferFromDeviceTime too frequent: 797 counts during 760 steps 2024-12-18T00:21:04.9274554Z 2024-12-18T00:21:04.9274744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9274848Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9275139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9275244Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9275431Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9275571Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9275723Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9275884Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9276213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9276533Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9276827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9277080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9277367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9277611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9277884Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9278000Z Execution Analysis: (:1) 2024-12-18T00:21:04.9278242Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9278426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9278430Z 2024-12-18T00:21:04.9278614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9278721Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9278932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9279038Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9279230Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9279368Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9279499Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9279684Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9280262Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9280794Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9281128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9281449Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9281743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9281993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9282278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9282528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9282622Z Execution Analysis: .......... 2024-12-18T00:21:04.9282861Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9283046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9283312Z pt-xla-profiler: TransferFromDeviceTime too frequent: 798 counts during 761 steps 2024-12-18T00:21:04.9283316Z 2024-12-18T00:21:04.9283501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9283638Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9283903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9284009Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9284198Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9284352Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9284490Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9284643Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9284974Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9285296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9285586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9285838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9286121Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9286372Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9286644Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9286762Z Execution Analysis: (:1) 2024-12-18T00:21:04.9286998Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9287188Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9287192Z 2024-12-18T00:21:04.9287376Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9287481Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9287690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9287791Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9287984Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9288114Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9288353Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9288537Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9289083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9289624Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9289955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9290290Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9290577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9290836Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9291129Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9291378Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9291478Z Execution Analysis: .......... 2024-12-18T00:21:04.9291715Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9291904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9292164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 799 counts during 762 steps 2024-12-18T00:21:04.9292192Z 2024-12-18T00:21:04.9292382Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9292486Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9292760Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9292860Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9293076Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9293207Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9293336Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9293494Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9293823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9294153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9294438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9294695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9294978Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9295230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9295501Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9295614Z Execution Analysis: (:1) 2024-12-18T00:21:04.9295855Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9296040Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9296044Z 2024-12-18T00:21:04.9296233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9296398Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9296625Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9296726Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9297093Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9297270Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9297440Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9297613Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9298207Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9298786Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9299143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9299493Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9299809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9300085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9300398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9300666Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9300778Z Execution Analysis: .......... 2024-12-18T00:21:04.9301033Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9301241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9301550Z pt-xla-profiler: TransferFromDeviceTime too frequent: 801 counts during 763 steps 2024-12-18T00:21:04.9301555Z 2024-12-18T00:21:04.9301754Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9301870Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9302163Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9302303Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9302504Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9302650Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9302788Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9302950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9303313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9303659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9303975Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9304248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9304559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9304829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9305125Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9305244Z Execution Analysis: (:1) 2024-12-18T00:21:04.9305498Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9305702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9305706Z 2024-12-18T00:21:04.9305905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9306019Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9306246Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9306383Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9306610Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9306752Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9306900Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9307066Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9307660Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9308229Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9308593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9308942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9309357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9309627Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9309926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9310189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9310452Z Execution Analysis: .......... 2024-12-18T00:21:04.9310713Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9310912Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9311227Z pt-xla-profiler: TransferFromDeviceTime too frequent: 802 counts during 764 steps 2024-12-18T00:21:04.9311232Z 2024-12-18T00:21:04.9311430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9311545Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9311875Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9311983Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9312191Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9312333Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9312480Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9312644Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9312998Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9313354Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9313662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9313941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9314251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9314524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9314813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9314943Z Execution Analysis: (:1) 2024-12-18T00:21:04.9315200Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9315402Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9315408Z 2024-12-18T00:21:04.9315615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9315726Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9315984Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9316121Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9316444Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9316583Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9316723Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9316892Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9317469Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9318213Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9318570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9318932Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9319242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9319517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9319825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9320092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9320204Z Execution Analysis: .......... 2024-12-18T00:21:04.9320461Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9320698Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9320979Z pt-xla-profiler: TransferFromDeviceTime too frequent: 803 counts during 765 steps 2024-12-18T00:21:04.9320986Z 2024-12-18T00:21:04.9321212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9321325Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9321621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9321730Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9321933Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9322083Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9322223Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9322394Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9322749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9323105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9323413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9323689Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9324000Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9324264Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9324556Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9324679Z Execution Analysis: (:1) 2024-12-18T00:21:04.9324940Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9325138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9325143Z 2024-12-18T00:21:04.9325345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9325481Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9325740Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9325856Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9326062Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9326206Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9326350Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9326513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9327107Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9327679Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9328042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9328396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9328711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9328982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9329294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9329561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9329664Z Execution Analysis: .......... 2024-12-18T00:21:04.9329948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9330147Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9330434Z pt-xla-profiler: TransferFromDeviceTime too frequent: 804 counts during 766 steps 2024-12-18T00:21:04.9330439Z 2024-12-18T00:21:04.9330664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9330782Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9331067Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9331179Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9331379Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9331519Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9331662Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9331829Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9332188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9332540Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9332965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9333231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9333627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9333877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9334145Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9334264Z Execution Analysis: (:1) 2024-12-18T00:21:04.9334502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9334701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9334705Z 2024-12-18T00:21:04.9334914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9335049Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9335262Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9335361Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9335558Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9335688Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9335830Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9335983Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9336644Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9337379Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9337742Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9338099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9338410Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9338688Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9338998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9339274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9339414Z Execution Analysis: .......... 2024-12-18T00:21:04.9339677Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9339877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9340191Z pt-xla-profiler: TransferFromDeviceTime too frequent: 805 counts during 767 steps 2024-12-18T00:21:04.9340197Z 2024-12-18T00:21:04.9340406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9340519Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9340817Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9340926Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9341140Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9341282Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9341427Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9341597Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9341952Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9342314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9342624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9342906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9343210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9343484Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9343772Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9343898Z Execution Analysis: (:1) 2024-12-18T00:21:04.9344324Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9344529Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9344592Z 2024-12-18T00:21:04.9344834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9344946Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9345184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9345293Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9345499Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9345646Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9345796Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9345968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9346562Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9347144Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9347505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9347860Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9348169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9348443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9348755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9349069Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9349184Z Execution Analysis: .......... 2024-12-18T00:21:04.9349438Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9349679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9349963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 806 counts during 768 steps 2024-12-18T00:21:04.9349968Z 2024-12-18T00:21:04.9350173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9350283Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9350574Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9350686Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9350888Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9351038Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9351177Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9351346Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9351708Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9352062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9352377Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9352646Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9352959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9353225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9353521Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9353642Z Execution Analysis: (:1) 2024-12-18T00:21:04.9353900Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9354158Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9354164Z 2024-12-18T00:21:04.9354366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9354483Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9354710Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9354822Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9355027Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9355169Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9355321Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9355485Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9356084Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9356866Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9357200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9357523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9357817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9358066Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9358375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9358628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9358724Z Execution Analysis: .......... 2024-12-18T00:21:04.9358971Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9359184Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9359453Z pt-xla-profiler: TransferFromDeviceTime too frequent: 807 counts during 769 steps 2024-12-18T00:21:04.9359457Z 2024-12-18T00:21:04.9359642Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9359751Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9360018Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9360120Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9360315Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9360448Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9360584Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9360738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9361078Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9361404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9361690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9361947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9362399Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9362667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9362954Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9363080Z Execution Analysis: (:1) 2024-12-18T00:21:04.9363355Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9363579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9363589Z 2024-12-18T00:21:04.9363786Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9363899Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9364126Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9364233Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9364439Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9364576Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9364726Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9364884Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9365463Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9366032Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9366380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9366732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9367031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9367332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9367633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9367896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9367999Z Execution Analysis: .......... 2024-12-18T00:21:04.9368274Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9368476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9368753Z pt-xla-profiler: TransferFromDeviceTime too frequent: 808 counts during 770 steps 2024-12-18T00:21:04.9368758Z 2024-12-18T00:21:04.9368960Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9369070Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9369359Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9369468Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9369663Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9369806Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9369944Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9370116Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9370460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9370808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9371105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9371368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9371668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9371930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9372220Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9372364Z Execution Analysis: (:1) 2024-12-18T00:21:04.9372643Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9372838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9372843Z 2024-12-18T00:21:04.9373044Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9373150Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9373372Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9373483Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9373686Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9373832Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9373972Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9374138Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9374715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9375274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9375629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9375972Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9376278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9376638Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9377118Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9377388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9377530Z Execution Analysis: .......... 2024-12-18T00:21:04.9377785Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9377987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9378279Z pt-xla-profiler: TransferFromDeviceTime too frequent: 809 counts during 771 steps 2024-12-18T00:21:04.9378284Z 2024-12-18T00:21:04.9378483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9378601Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9378888Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9379002Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9379205Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9379348Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9379495Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9379658Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9380022Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9380370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9380692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9380963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9381277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9381544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9381859Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9382026Z Execution Analysis: (:1) 2024-12-18T00:21:04.9382285Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9382491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9382496Z 2024-12-18T00:21:04.9382696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9382815Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9383044Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9383156Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9383368Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9383509Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9383664Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9383832Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9384436Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9385008Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9385370Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9385718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9386056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9386332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9386643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9386947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9387052Z Execution Analysis: .......... 2024-12-18T00:21:04.9387311Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9387512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9387795Z pt-xla-profiler: TransferFromDeviceTime too frequent: 810 counts during 772 steps 2024-12-18T00:21:04.9387807Z 2024-12-18T00:21:04.9388005Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9388122Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9388416Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9388528Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9388735Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9388881Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9389134Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9389296Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9389642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9389986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9390285Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9390554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9390854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9391147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9391453Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9391574Z Execution Analysis: (:1) 2024-12-18T00:21:04.9391828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9392025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9392029Z 2024-12-18T00:21:04.9392227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9392338Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9392569Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9392673Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9392872Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9393014Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9393158Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9393324Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9393896Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9394457Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9394805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9395175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9395474Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9395739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9396242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9396506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9396615Z Execution Analysis: .......... 2024-12-18T00:21:04.9396863Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9397065Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9397339Z pt-xla-profiler: TransferFromDeviceTime too frequent: 811 counts during 773 steps 2024-12-18T00:21:04.9397345Z 2024-12-18T00:21:04.9397549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9397656Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9397936Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9398051Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9398250Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9398396Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9398531Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9398698Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9399135Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9399457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9399750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9400002Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9400288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9400586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9400862Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9400974Z Execution Analysis: (:1) 2024-12-18T00:21:04.9401210Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9401401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9401405Z 2024-12-18T00:21:04.9401591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9401702Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9401916Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9402024Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9402214Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9402357Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9402489Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9402646Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9403198Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9403726Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9404090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9404411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9404703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9404991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9405282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9405531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9405792Z Execution Analysis: .......... 2024-12-18T00:21:04.9406044Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9406239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9406523Z pt-xla-profiler: TransferFromDeviceTime too frequent: 812 counts during 774 steps 2024-12-18T00:21:04.9406527Z 2024-12-18T00:21:04.9406721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9406841Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9407124Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9407231Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9407434Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9407574Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9407722Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9407888Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9408239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9408580Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9408884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9409157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9409512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9409781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9410062Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9410188Z Execution Analysis: (:1) 2024-12-18T00:21:04.9410434Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9410637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9410643Z 2024-12-18T00:21:04.9410836Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9410945Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9411170Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9411277Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9411489Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9411630Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9411777Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9411940Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9412515Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9413076Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9413451Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9413797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9414129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9414401Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9414697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9414959Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9415063Z Execution Analysis: .......... 2024-12-18T00:21:04.9415311Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9415515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9415791Z pt-xla-profiler: TransferFromDeviceTime too frequent: 813 counts during 775 steps 2024-12-18T00:21:04.9415796Z 2024-12-18T00:21:04.9415996Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9416107Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9416467Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9416574Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9416772Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9417081Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9417220Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9417390Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9417746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9418103Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9418413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9418734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9419064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9419332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9419625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9419748Z Execution Analysis: (:1) 2024-12-18T00:21:04.9420011Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9420210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9420217Z 2024-12-18T00:21:04.9420424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9420535Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9420766Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9420884Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9421089Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9421235Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9421382Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9421554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9422143Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9422748Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9423106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9423456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9423807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9424081Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9424397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9424664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9424775Z Execution Analysis: .......... 2024-12-18T00:21:04.9425030Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9425233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9425526Z pt-xla-profiler: TransferFromDeviceTime too frequent: 814 counts during 776 steps 2024-12-18T00:21:04.9425532Z 2024-12-18T00:21:04.9425737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9425855Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9426145Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9426263Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9426466Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9426618Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9426758Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9426925Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9427293Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9427642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9427988Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9428285Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9428600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9428867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9429254Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9429377Z Execution Analysis: (:1) 2024-12-18T00:21:04.9429616Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9429812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9429816Z 2024-12-18T00:21:04.9430001Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9430115Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9430328Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9430437Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9430628Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9430759Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9430902Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9431056Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9431613Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9432171Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9432513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9432933Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9433220Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9433481Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9433765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9434018Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9434116Z Execution Analysis: .......... 2024-12-18T00:21:04.9434361Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9434544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9434818Z pt-xla-profiler: TransferFromDeviceTime too frequent: 815 counts during 777 steps 2024-12-18T00:21:04.9434824Z 2024-12-18T00:21:04.9435012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9435115Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9435388Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9435492Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9435684Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9435814Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9435952Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9436106Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9436436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9436766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9437105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9437367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9437647Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9437901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9438167Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9438279Z Execution Analysis: (:1) 2024-12-18T00:21:04.9438524Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9438711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9438717Z 2024-12-18T00:21:04.9438912Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9439014Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9439232Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9439331Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9439529Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9439659Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9439792Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9439949Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9440519Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9441053Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9441409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9441742Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9442025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9442284Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9442566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9442810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9442914Z Execution Analysis: .......... 2024-12-18T00:21:04.9443148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9443341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9443610Z pt-xla-profiler: TransferFromDeviceTime too frequent: 816 counts during 778 steps 2024-12-18T00:21:04.9443614Z 2024-12-18T00:21:04.9443806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9443910Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9444328Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9444441Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9444801Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9444960Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9445103Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9445280Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9445639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9446081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9446399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9446677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9446996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9447266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9447570Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9447698Z Execution Analysis: (:1) 2024-12-18T00:21:04.9447963Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9448162Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9448169Z 2024-12-18T00:21:04.9448373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9448492Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9448717Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9448833Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9449037Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9449187Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9449329Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9449532Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9450127Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9450755Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9451124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9451475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9451794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9452067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9452382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9452651Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9452757Z Execution Analysis: .......... 2024-12-18T00:21:04.9453020Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9453228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9453520Z pt-xla-profiler: TransferFromDeviceTime too frequent: 817 counts during 779 steps 2024-12-18T00:21:04.9453525Z 2024-12-18T00:21:04.9453726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9453848Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9454136Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9454250Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9454453Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9454594Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9454738Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9454906Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9455326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9455678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9455994Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9456265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9456644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9456920Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9457213Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9457347Z Execution Analysis: (:1) 2024-12-18T00:21:04.9457603Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9457819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9457824Z 2024-12-18T00:21:04.9458021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9458141Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9458369Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9458476Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9458692Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9458832Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9459016Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9459181Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9459774Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9460383Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9460743Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9461099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9461407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9461688Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9461998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9462278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9462380Z Execution Analysis: .......... 2024-12-18T00:21:04.9462644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9462857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9463139Z pt-xla-profiler: TransferFromDeviceTime too frequent: 818 counts during 780 steps 2024-12-18T00:21:04.9463144Z 2024-12-18T00:21:04.9463352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9463463Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9463760Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9463869Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9464078Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9464218Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9464359Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9464555Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9464936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9465291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9465599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9465877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9466182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9466452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9466747Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9466869Z Execution Analysis: (:1) 2024-12-18T00:21:04.9467137Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9467337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9467341Z 2024-12-18T00:21:04.9467552Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9467663Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9467901Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9468012Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9468220Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9468499Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9468634Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9468799Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9469375Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9469918Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9470254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9470578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9470873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9471132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9471423Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9471670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9471782Z Execution Analysis: .......... 2024-12-18T00:21:04.9472021Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9472219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9472480Z pt-xla-profiler: TransferFromDeviceTime too frequent: 819 counts during 781 steps 2024-12-18T00:21:04.9472485Z 2024-12-18T00:21:04.9472674Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9472787Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9473056Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9473165Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9473353Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9473522Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9473652Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9473832Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9474170Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9474491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9474782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9475033Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9475328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9475576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9475854Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9475967Z Execution Analysis: (:1) 2024-12-18T00:21:04.9476208Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9476409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9476413Z 2024-12-18T00:21:04.9476598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9476710Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9476918Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9477031Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9477245Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9477378Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9477520Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9477677Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9478264Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9478790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9479128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9479447Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9479738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9479989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9480274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9480531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9480627Z Execution Analysis: .......... 2024-12-18T00:21:04.9480870Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9481057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9481331Z pt-xla-profiler: TransferFromDeviceTime too frequent: 820 counts during 782 steps 2024-12-18T00:21:04.9481335Z 2024-12-18T00:21:04.9481520Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9481626Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9481903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9482003Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9482224Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9482381Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9482524Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9482679Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9483008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9483339Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9483625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9483884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9484168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9484430Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9484700Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9484825Z Execution Analysis: (:1) 2024-12-18T00:21:04.9485059Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9485246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9485250Z 2024-12-18T00:21:04.9485441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9485544Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9485763Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9485902Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9486105Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9486235Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9486374Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9486558Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9487105Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9487643Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9487974Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9488309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9488596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9488861Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9489147Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9489398Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9489502Z Execution Analysis: .......... 2024-12-18T00:21:04.9489739Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9489935Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9490196Z pt-xla-profiler: TransferFromDeviceTime too frequent: 822 counts during 783 steps 2024-12-18T00:21:04.9490200Z 2024-12-18T00:21:04.9490401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9490506Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9490780Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9490906Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9491121Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9491261Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9491391Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9491554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9491883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9492215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9492502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9492755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9493045Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9493294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9493572Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9493684Z Execution Analysis: (:1) 2024-12-18T00:21:04.9493934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9494119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9494123Z 2024-12-18T00:21:04.9494316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9494447Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9494661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9494771Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9494964Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9495106Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9495264Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9495419Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9495969Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9496572Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9497097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9497451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9497774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9498046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9498365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9498629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9498735Z Execution Analysis: .......... 2024-12-18T00:21:04.9498998Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9499204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9499495Z pt-xla-profiler: TransferFromDeviceTime too frequent: 823 counts during 784 steps 2024-12-18T00:21:04.9499501Z 2024-12-18T00:21:04.9499701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9499823Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9500142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9500289Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9500491Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9500633Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9500781Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9500944Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9501310Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9501661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9501986Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9502255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9502565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9502845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9503134Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9503268Z Execution Analysis: (:1) 2024-12-18T00:21:04.9503524Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9503740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9503744Z 2024-12-18T00:21:04.9503943Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9504092Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9504319Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9504428Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9504647Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9504818Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9504973Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9505138Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9505734Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9506305Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9506663Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9507019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9507331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9507612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9507921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9508199Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9508301Z Execution Analysis: .......... 2024-12-18T00:21:04.9508565Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9508764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9509155Z pt-xla-profiler: TransferFromDeviceTime too frequent: 824 counts during 785 steps 2024-12-18T00:21:04.9509160Z 2024-12-18T00:21:04.9509366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9509504Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9509819Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9509926Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9510136Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9510278Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9510417Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9510588Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9510934Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9511288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9511589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9511867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9512174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9512446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9512731Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9512852Z Execution Analysis: (:1) 2024-12-18T00:21:04.9513114Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9513312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9513341Z 2024-12-18T00:21:04.9513545Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9513659Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9513895Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9514005Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9514233Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9514384Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9514527Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9514703Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9515454Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9516038Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9516399Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9516761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9517081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9517352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9517673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9517942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9518060Z Execution Analysis: .......... 2024-12-18T00:21:04.9518317Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9518530Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9518815Z pt-xla-profiler: TransferFromDeviceTime too frequent: 825 counts during 786 steps 2024-12-18T00:21:04.9518820Z 2024-12-18T00:21:04.9519059Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9519210Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9519501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9519625Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9519828Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9519984Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9520130Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9520295Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9520664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9521019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9521338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9521612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9521930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9522199Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9522497Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9522620Z Execution Analysis: (:1) 2024-12-18T00:21:04.9522875Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9523117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9523122Z 2024-12-18T00:21:04.9523321Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9523447Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9523708Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9523828Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9524033Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9524174Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9524328Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9524494Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9525101Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9525674Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9526044Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9526496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9526809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9527073Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9527373Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9527644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9527747Z Execution Analysis: .......... 2024-12-18T00:21:04.9528005Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9528203Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9528488Z pt-xla-profiler: TransferFromDeviceTime too frequent: 826 counts during 787 steps 2024-12-18T00:21:04.9528518Z 2024-12-18T00:21:04.9528740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9528862Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9529142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9529251Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9529460Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9529699Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9529839Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9529996Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9530333Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9530659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9530952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9531212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9531494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9531753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9532024Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9532147Z Execution Analysis: (:1) 2024-12-18T00:21:04.9532386Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9532601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9532613Z 2024-12-18T00:21:04.9532797Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9532928Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9533152Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9533253Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9533454Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9533587Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9533732Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9533885Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9534435Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9534982Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9535318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9535653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9535941Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9536205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9536574Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9537002Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9537113Z Execution Analysis: .......... 2024-12-18T00:21:04.9537369Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9537581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9537898Z pt-xla-profiler: TransferFromDeviceTime too frequent: 827 counts during 788 steps 2024-12-18T00:21:04.9537928Z 2024-12-18T00:21:04.9538144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9538257Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9538563Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9538671Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9538873Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9539026Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9539169Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9539345Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9539703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9540064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9540378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9540652Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9540965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9541233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9541531Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9541683Z Execution Analysis: (:1) 2024-12-18T00:21:04.9541949Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9542149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9542156Z 2024-12-18T00:21:04.9542394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9542507Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9542737Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9542860Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9543067Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9543214Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9543357Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9543529Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9544122Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9544848Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9545218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9545569Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9545888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9546161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9546474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9546743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9546858Z Execution Analysis: .......... 2024-12-18T00:21:04.9547114Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9547365Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9547703Z pt-xla-profiler: TransferFromDeviceTime too frequent: 828 counts during 789 steps 2024-12-18T00:21:04.9547708Z 2024-12-18T00:21:04.9547907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9548029Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9548318Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9548437Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9548642Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9548787Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9548941Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9549109Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9549480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9549842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9550159Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9550429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9550746Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9551017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9551305Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9551481Z Execution Analysis: (:1) 2024-12-18T00:21:04.9551738Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9551951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9551991Z 2024-12-18T00:21:04.9552194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9552315Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9552544Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9552653Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9552873Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9553015Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9553176Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9553344Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9553945Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9554526Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9554894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9555245Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9555557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9555949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9556345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9556603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9556699Z Execution Analysis: .......... 2024-12-18T00:21:04.9556945Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9557199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9557463Z pt-xla-profiler: TransferFromDeviceTime too frequent: 829 counts during 790 steps 2024-12-18T00:21:04.9557476Z 2024-12-18T00:21:04.9557663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9557769Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9558046Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9558147Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9558347Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9558477Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9558618Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9558773Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9559103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9559441Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9559729Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9559993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9560277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9560534Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9560831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9560945Z Execution Analysis: (:1) 2024-12-18T00:21:04.9561194Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9561410Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9561414Z 2024-12-18T00:21:04.9561608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9561714Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9561941Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9562043Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9562235Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9562379Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9562519Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9562687Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9563233Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9563778Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9564108Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9564442Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9564731Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9564982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9565280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9565529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9565668Z Execution Analysis: .......... 2024-12-18T00:21:04.9565932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9566131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9566392Z pt-xla-profiler: TransferFromDeviceTime too frequent: 830 counts during 791 steps 2024-12-18T00:21:04.9566396Z 2024-12-18T00:21:04.9566589Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9566693Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9566957Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9567067Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9567254Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9567398Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9567528Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9567692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9568021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9568343Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9568636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9568890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9569180Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9569452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9569731Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9569849Z Execution Analysis: (:1) 2024-12-18T00:21:04.9570115Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9570310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9570314Z 2024-12-18T00:21:04.9570499Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9570610Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9570823Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9570933Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9571125Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9571271Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9571405Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9571559Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9572123Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9572654Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9572998Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9573322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9573620Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9573873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9574165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9574439Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9574558Z Execution Analysis: .......... 2024-12-18T00:21:04.9574808Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9574993Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9575265Z pt-xla-profiler: TransferFromDeviceTime too frequent: 831 counts during 792 steps 2024-12-18T00:21:04.9575269Z 2024-12-18T00:21:04.9575454Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9575573Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9575847Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9575949Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9576146Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9576280Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9576492Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9576650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9577174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9577527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9577843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9578130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9578541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9578825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9579115Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9579280Z Execution Analysis: (:1) 2024-12-18T00:21:04.9579542Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9579760Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9579764Z 2024-12-18T00:21:04.9579967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9580078Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9580321Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9580432Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9580652Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9580794Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9580950Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9581122Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9581718Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9582302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9582659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9583016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9583329Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9583618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9583922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9584265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9584376Z Execution Analysis: .......... 2024-12-18T00:21:04.9584630Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9584843Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9585127Z pt-xla-profiler: TransferFromDeviceTime too frequent: 832 counts during 793 steps 2024-12-18T00:21:04.9585132Z 2024-12-18T00:21:04.9585343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9585459Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9585756Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9585867Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9586070Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9586226Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9586366Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9586542Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9586899Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9587257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9587566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9587879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9588190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9588457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9588802Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9588926Z Execution Analysis: (:1) 2024-12-18T00:21:04.9589285Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9589472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9589476Z 2024-12-18T00:21:04.9589671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9589774Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9589990Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9590102Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9590297Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9590439Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9590580Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9590746Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9591291Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9591833Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9592164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9592489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9592782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9593037Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9593379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9593627Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9593734Z Execution Analysis: .......... 2024-12-18T00:21:04.9593970Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9594157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9594425Z pt-xla-profiler: TransferFromDeviceTime too frequent: 833 counts during 794 steps 2024-12-18T00:21:04.9594432Z 2024-12-18T00:21:04.9594617Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9594732Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9595003Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9595119Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9595314Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9595455Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9595586Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9595738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9596078Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9596402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9596700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9596976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9597273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9597547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9597821Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9597946Z Execution Analysis: (:1) 2024-12-18T00:21:04.9598182Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9598379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9598383Z 2024-12-18T00:21:04.9598566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9598676Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9598888Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9598995Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9599185Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9599317Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9599460Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9599614Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9600166Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9600696Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9601039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9601363Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9601652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9601940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9602244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9602501Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9602599Z Execution Analysis: .......... 2024-12-18T00:21:04.9602845Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9603030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9603303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 834 counts during 795 steps 2024-12-18T00:21:04.9603308Z 2024-12-18T00:21:04.9603490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9603596Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9603873Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9603977Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9604173Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9604304Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9604445Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9604598Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9604929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9605260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9605576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9605834Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9606120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9606402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9606670Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9606786Z Execution Analysis: (:1) 2024-12-18T00:21:04.9607031Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9607215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9607219Z 2024-12-18T00:21:04.9607411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9607514Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9607733Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9607834Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9608034Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9608163Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9608297Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9608454Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9609000Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9609537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9609869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9610376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9610704Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9611003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9611300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9611559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9611666Z Execution Analysis: .......... 2024-12-18T00:21:04.9611913Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9612116Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9612394Z pt-xla-profiler: TransferFromDeviceTime too frequent: 835 counts during 796 steps 2024-12-18T00:21:04.9612398Z 2024-12-18T00:21:04.9612598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9612705Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9612991Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9613104Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9613301Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9613450Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9613586Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9613753Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9614098Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9614466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9614776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9615046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9615378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9615640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9615929Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9616047Z Execution Analysis: (:1) 2024-12-18T00:21:04.9616305Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9616578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9616585Z 2024-12-18T00:21:04.9616944Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9617064Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9617294Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9617413Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9617620Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9617771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9617916Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9618080Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9618681Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9619255Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9619621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9619999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9620344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9620616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9620932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9621199Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9621304Z Execution Analysis: .......... 2024-12-18T00:21:04.9621568Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9621773Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9622064Z pt-xla-profiler: TransferFromDeviceTime too frequent: 836 counts during 797 steps 2024-12-18T00:21:04.9622071Z 2024-12-18T00:21:04.9622270Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9622396Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9622683Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9622805Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9623007Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9623146Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9623295Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9623463Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9623869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9624220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9624536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9624835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9625145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9625420Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9625713Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9625841Z Execution Analysis: (:1) 2024-12-18T00:21:04.9626099Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9626310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9626314Z 2024-12-18T00:21:04.9626512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9626637Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9626866Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9626977Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9627189Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9627333Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9627487Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9627652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9628246Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9628826Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9629287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9629837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9630141Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9630417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9630716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9630984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9631085Z Execution Analysis: .......... 2024-12-18T00:21:04.9631334Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9631534Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9631810Z pt-xla-profiler: TransferFromDeviceTime too frequent: 837 counts during 798 steps 2024-12-18T00:21:04.9631814Z 2024-12-18T00:21:04.9632017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9632128Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9632421Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9632526Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9632734Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9632869Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9633005Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9633201Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9633548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9633897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9634228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9634502Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9634799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9635061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9635347Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9635466Z Execution Analysis: (:1) 2024-12-18T00:21:04.9635720Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9635914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9635918Z 2024-12-18T00:21:04.9636122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9636232Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9636463Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9636567Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9636768Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9636919Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9637062Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9637234Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9637810Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9638374Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9638774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9639115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9639423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9639786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9643170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9643448Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9643556Z Execution Analysis: .......... 2024-12-18T00:21:04.9643800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9643989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9644425Z pt-xla-profiler: TransferFromDeviceTime too frequent: 838 counts during 799 steps 2024-12-18T00:21:04.9644431Z 2024-12-18T00:21:04.9644793Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9644912Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9645201Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9645316Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9645522Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9645663Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9645902Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9646066Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9646433Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9646824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9647142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9647414Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9647724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9647991Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9648282Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9648414Z Execution Analysis: (:1) 2024-12-18T00:21:04.9648673Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9648881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9648888Z 2024-12-18T00:21:04.9649091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9649207Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9649435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9649544Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9649757Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9649898Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9650049Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9650215Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9650819Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9651391Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9651823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9652178Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9652487Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9652765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9653072Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9653347Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9653448Z Execution Analysis: .......... 2024-12-18T00:21:04.9653706Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9653910Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9654194Z pt-xla-profiler: TransferFromDeviceTime too frequent: 839 counts during 800 steps 2024-12-18T00:21:04.9654205Z 2024-12-18T00:21:04.9654402Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9654514Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9654808Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9654914Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9655121Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9655289Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9655435Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9655598Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9655955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9656392Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9656720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9656998Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9657301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9657574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9657864Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9657986Z Execution Analysis: (:1) 2024-12-18T00:21:04.9658246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9658450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9658455Z 2024-12-18T00:21:04.9658657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9658767Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9658997Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9659104Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9659314Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9659456Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9659600Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9659772Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9660363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9661014Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9661373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9661724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9662034Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9662304Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9662617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9662882Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9662988Z Execution Analysis: .......... 2024-12-18T00:21:04.9663243Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9663449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9663732Z pt-xla-profiler: TransferFromDeviceTime too frequent: 840 counts during 801 steps 2024-12-18T00:21:04.9663737Z 2024-12-18T00:21:04.9663941Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9664052Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9664343Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9664485Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9664686Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9664833Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9664973Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9665147Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9665529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9665880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9666193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9666465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9666776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9667044Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9667338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9667463Z Execution Analysis: (:1) 2024-12-18T00:21:04.9667718Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9667930Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9667935Z 2024-12-18T00:21:04.9668134Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9668248Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9668479Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9668697Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9668897Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9669044Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9669351Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9669516Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9670112Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9670734Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9671100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9671450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9671766Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9672040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9672351Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9672618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9672725Z Execution Analysis: .......... 2024-12-18T00:21:04.9672988Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9673189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9673473Z pt-xla-profiler: TransferFromDeviceTime too frequent: 841 counts during 802 steps 2024-12-18T00:21:04.9673478Z 2024-12-18T00:21:04.9673676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9673789Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9674077Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9674211Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9674415Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9674557Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9674708Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9674900Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9675256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9675606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9675914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9676188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9676492Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9676767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9677055Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9677186Z Execution Analysis: (:1) 2024-12-18T00:21:04.9677443Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9677646Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9677651Z 2024-12-18T00:21:04.9677849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9677958Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9678188Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9678294Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9678502Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9678640Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9678787Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9678953Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9679596Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9680171Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9680526Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9680876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9681186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9681463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9681769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9682147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9682249Z Execution Analysis: .......... 2024-12-18T00:21:04.9682496Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9682695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9682968Z pt-xla-profiler: TransferFromDeviceTime too frequent: 843 counts during 803 steps 2024-12-18T00:21:04.9682972Z 2024-12-18T00:21:04.9683170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9683304Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9683591Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9683695Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9683895Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9684033Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9684196Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9684360Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9684704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9685044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9685344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9685611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9685909Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9686165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9686452Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9686573Z Execution Analysis: (:1) 2024-12-18T00:21:04.9686825Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9687019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9687023Z 2024-12-18T00:21:04.9687221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9687327Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9687548Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9687661Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9687856Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9687997Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9688166Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9688332Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9688930Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9689494Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9689840Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9690177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9690485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9690749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9691051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9691313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9691418Z Execution Analysis: .......... 2024-12-18T00:21:04.9691664Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9691860Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9692143Z pt-xla-profiler: TransferFromDeviceTime too frequent: 844 counts during 804 steps 2024-12-18T00:21:04.9692148Z 2024-12-18T00:21:04.9692341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9692481Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9692761Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9692872Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9693068Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9693239Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9693377Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9693536Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9693888Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9694225Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9694532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9694799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9695099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9695359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9695646Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9695768Z Execution Analysis: (:1) 2024-12-18T00:21:04.9696014Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9696211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9696216Z 2024-12-18T00:21:04.9696479Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9696595Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9696982Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9697095Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9697300Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9697484Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9697660Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9697823Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9698420Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9698991Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9699350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9699701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9700007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9700282Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9700591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9700862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9700965Z Execution Analysis: .......... 2024-12-18T00:21:04.9701222Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9701419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9701706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 845 counts during 805 steps 2024-12-18T00:21:04.9701738Z 2024-12-18T00:21:04.9701939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9702049Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9702344Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9702453Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9702690Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9702833Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9702977Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9703142Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9703494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9703844Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9704156Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9704434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9704740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9705015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9705302Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9705424Z Execution Analysis: (:1) 2024-12-18T00:21:04.9705684Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9705885Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9705889Z 2024-12-18T00:21:04.9706091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9706204Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9706435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9706541Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9706776Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9706943Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9707090Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9707259Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9707849Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9708432Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9708789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9709234Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9709518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9709779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9710060Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9710303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9710402Z Execution Analysis: .......... 2024-12-18T00:21:04.9710636Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9710826Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9711111Z pt-xla-profiler: TransferFromDeviceTime too frequent: 846 counts during 806 steps 2024-12-18T00:21:04.9711115Z 2024-12-18T00:21:04.9711304Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9711408Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9711701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9711806Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9711994Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9712129Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9712257Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9712417Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9712742Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9713061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9713352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9713603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9713895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9714143Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9714415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9714529Z Execution Analysis: (:1) 2024-12-18T00:21:04.9714768Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9714953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9714959Z 2024-12-18T00:21:04.9715143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9715251Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9715459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9715589Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9715805Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9715938Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9716070Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9716221Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9716773Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9717302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9717807Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9718149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9718461Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9718723Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9719023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9719283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9719382Z Execution Analysis: .......... 2024-12-18T00:21:04.9719637Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9719830Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9720138Z pt-xla-profiler: TransferFromDeviceTime too frequent: 847 counts during 807 steps 2024-12-18T00:21:04.9720142Z 2024-12-18T00:21:04.9720337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9720480Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9720766Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9720877Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9721073Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9721209Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9721351Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9721509Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9721858Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9722199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9722506Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9722771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9723073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9723335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9723615Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9723735Z Execution Analysis: (:1) 2024-12-18T00:21:04.9723982Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9724181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9724187Z 2024-12-18T00:21:04.9724382Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9724492Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9724740Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9724940Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9725144Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9725281Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9725425Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9725585Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9726159Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9726724Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9727071Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9727416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9727721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9727991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9728290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9728553Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9728653Z Execution Analysis: .......... 2024-12-18T00:21:04.9728901Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9729124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9729402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 848 counts during 808 steps 2024-12-18T00:21:04.9729409Z 2024-12-18T00:21:04.9729744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9729848Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9730120Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9730218Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9730407Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9730536Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9730665Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9730829Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9731160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9731489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9731780Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9732038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9732321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9732570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9732842Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9732956Z Execution Analysis: (:1) 2024-12-18T00:21:04.9733195Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9733383Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9733387Z 2024-12-18T00:21:04.9733578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9733719Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9733963Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9734063Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9734252Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9734392Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9734523Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9734684Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9735230Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9735767Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9736098Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9736508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9736968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9737243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9737558Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9737827Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9737937Z Execution Analysis: .......... 2024-12-18T00:21:04.9738222Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9738432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9738718Z pt-xla-profiler: TransferFromDeviceTime too frequent: 849 counts during 809 steps 2024-12-18T00:21:04.9738748Z 2024-12-18T00:21:04.9738953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9739071Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9739361Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9739475Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9739676Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9739826Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9739965Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9740131Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9740490Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9740837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9741160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9741433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9741740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9742005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9742299Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9742418Z Execution Analysis: (:1) 2024-12-18T00:21:04.9742675Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9742878Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9742907Z 2024-12-18T00:21:04.9743134Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9743249Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9743477Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9743590Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9743794Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9743936Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9744086Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9744386Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9744988Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9745560Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9745927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9746278Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9746590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9746858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9747162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9747432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9747591Z Execution Analysis: .......... 2024-12-18T00:21:04.9747854Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9748053Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9748378Z pt-xla-profiler: TransferFromDeviceTime too frequent: 850 counts during 810 steps 2024-12-18T00:21:04.9748384Z 2024-12-18T00:21:04.9748582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9748701Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9748988Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9749096Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9749303Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9749444Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9749590Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9749754Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9750110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9750468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9750777Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9751050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9751354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9751624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9751913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9752047Z Execution Analysis: (:1) 2024-12-18T00:21:04.9752302Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9752501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9752542Z 2024-12-18T00:21:04.9752773Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9752889Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9753125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9753232Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9753443Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9753584Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9753729Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9753900Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9754494Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9755082Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9755440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9755794Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9756211Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9756575Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9756859Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9757138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9757238Z Execution Analysis: .......... 2024-12-18T00:21:04.9757473Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9757691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9757955Z pt-xla-profiler: TransferFromDeviceTime too frequent: 851 counts during 811 steps 2024-12-18T00:21:04.9757959Z 2024-12-18T00:21:04.9758149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9758250Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9758520Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9758620Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9758812Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9758948Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9759076Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9759235Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9759570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9759901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9760184Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9760433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9760721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9760967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9761243Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9761356Z Execution Analysis: (:1) 2024-12-18T00:21:04.9761599Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9761835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9761839Z 2024-12-18T00:21:04.9762029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9762131Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9762343Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9762448Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9762640Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9762775Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9762911Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9763063Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9763611Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9764145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9764480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9764799Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9765091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9765344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9765671Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9765918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9766020Z Execution Analysis: .......... 2024-12-18T00:21:04.9766283Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9766472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9766739Z pt-xla-profiler: TransferFromDeviceTime too frequent: 852 counts during 812 steps 2024-12-18T00:21:04.9766743Z 2024-12-18T00:21:04.9766925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9767037Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9767303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9767409Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9767593Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9767725Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9767858Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9768012Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9768350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9768670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9768963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9769211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9769496Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9769748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9770015Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9770134Z Execution Analysis: (:1) 2024-12-18T00:21:04.9770418Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9770611Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9770615Z 2024-12-18T00:21:04.9770797Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9770906Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9771113Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9771215Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9771407Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9771539Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9771678Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9771828Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9772383Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9772910Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9773241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9773565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9773849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9774130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9774412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9774665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9774765Z Execution Analysis: .......... 2024-12-18T00:21:04.9775037Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9775222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9775483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 853 counts during 813 steps 2024-12-18T00:21:04.9775487Z 2024-12-18T00:21:04.9775677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9775781Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9776059Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9776158Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9776421Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9776560Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9776688Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9777021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9777377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9777731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9778039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9778320Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9778628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9778901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9779195Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9779348Z Execution Analysis: (:1) 2024-12-18T00:21:04.9779637Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9779838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9779842Z 2024-12-18T00:21:04.9780046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9780156Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9780391Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9780498Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9780706Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9780853Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9780998Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9781169Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9781763Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9782344Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9782698Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9783054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9783391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9783662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9783978Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9784274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9784384Z Execution Analysis: .......... 2024-12-18T00:21:04.9784635Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9784838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9785120Z pt-xla-profiler: TransferFromDeviceTime too frequent: 854 counts during 814 steps 2024-12-18T00:21:04.9785125Z 2024-12-18T00:21:04.9785332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9785442Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9785731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9785846Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9786048Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9786201Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9786339Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9786503Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9786862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9787210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9787523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9787792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9788104Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9788370Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9788694Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9788844Z Execution Analysis: (:1) 2024-12-18T00:21:04.9789199Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9789388Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9789392Z 2024-12-18T00:21:04.9789574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9789685Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9789896Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9790005Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9790194Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9790324Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9790463Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9790616Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9791164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9791693Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9792028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9792349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9792664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9792913Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9793218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9793470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9793565Z Execution Analysis: .......... 2024-12-18T00:21:04.9793804Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9793988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9794255Z pt-xla-profiler: TransferFromDeviceTime too frequent: 855 counts during 815 steps 2024-12-18T00:21:04.9794259Z 2024-12-18T00:21:04.9794444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9794553Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9794821Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9794921Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9795114Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9795244Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9795381Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9795532Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9795865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9796185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9796473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9796734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9797017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9797297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9797600Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9797723Z Execution Analysis: (:1) 2024-12-18T00:21:04.9797958Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9798144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9798153Z 2024-12-18T00:21:04.9798336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9798444Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9798659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9798758Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9798952Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9799084Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9799226Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9799381Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9799927Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9800463Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9800791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9801146Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9801435Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9801691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9801998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9802254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9802349Z Execution Analysis: .......... 2024-12-18T00:21:04.9802586Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9802777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9803036Z pt-xla-profiler: TransferFromDeviceTime too frequent: 856 counts during 816 steps 2024-12-18T00:21:04.9803042Z 2024-12-18T00:21:04.9803231Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9803334Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9803609Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9803711Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9803896Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9804032Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9804162Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9804320Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9804648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9804974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9805263Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9805512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9805824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9806096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9806369Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9806482Z Execution Analysis: (:1) 2024-12-18T00:21:04.9806722Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9806907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9806911Z 2024-12-18T00:21:04.9807099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9807202Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9807411Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9807517Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9807708Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9807846Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9807980Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9808140Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9808686Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9809216Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9809575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9809894Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9810189Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9810467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9810757Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9811002Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9811104Z Execution Analysis: .......... 2024-12-18T00:21:04.9811336Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9811520Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9811786Z pt-xla-profiler: TransferFromDeviceTime too frequent: 857 counts during 817 steps 2024-12-18T00:21:04.9811791Z 2024-12-18T00:21:04.9811976Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9812085Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9812352Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9812457Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9812642Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9812772Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9812906Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9813055Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9813388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9813713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9814005Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9814255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9814591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9814836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9815106Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9815223Z Execution Analysis: (:1) 2024-12-18T00:21:04.9815461Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9815649Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9815656Z 2024-12-18T00:21:04.9815836Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9815952Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9816161Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9816263Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9816535Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9816670Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9816978Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9817141Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9817750Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9818321Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9818723Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9819070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9819410Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9819694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9820003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9820282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9820386Z Execution Analysis: .......... 2024-12-18T00:21:04.9820653Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9820855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9821141Z pt-xla-profiler: TransferFromDeviceTime too frequent: 858 counts during 818 steps 2024-12-18T00:21:04.9821159Z 2024-12-18T00:21:04.9821361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9821475Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9821777Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9821884Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9822097Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9822239Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9822392Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9822556Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9822912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9823271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9823585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9823916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9824220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9824496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9824786Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9824912Z Execution Analysis: (:1) 2024-12-18T00:21:04.9825177Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9825379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9825383Z 2024-12-18T00:21:04.9825590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9825702Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9825946Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9826053Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9826267Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9826406Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9826551Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9826728Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9827321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9827929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9828284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9828669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9829086Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9829336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9829625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9829869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9829974Z Execution Analysis: .......... 2024-12-18T00:21:04.9830208Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9830404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9830665Z pt-xla-profiler: TransferFromDeviceTime too frequent: 859 counts during 819 steps 2024-12-18T00:21:04.9830671Z 2024-12-18T00:21:04.9830865Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9830965Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9831233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9831339Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9831524Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9831661Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9831788Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9831954Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9832280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9832603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9832958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9833210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9833505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9833750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9834023Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9834135Z Execution Analysis: (:1) 2024-12-18T00:21:04.9834372Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9834566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9834570Z 2024-12-18T00:21:04.9834753Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9834870Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9835081Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9835191Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9835378Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9835517Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9835650Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9835802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9836358Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9836914Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9837256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9837603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9837897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9838149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9838441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9838686Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9838782Z Execution Analysis: .......... 2024-12-18T00:21:04.9839023Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9839210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9839487Z pt-xla-profiler: TransferFromDeviceTime too frequent: 860 counts during 820 steps 2024-12-18T00:21:04.9839492Z 2024-12-18T00:21:04.9839677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9839789Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9840055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9840155Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9840347Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9840479Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9840620Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9840773Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9841112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9841460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9841772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9842030Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9842315Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9842568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9842834Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9842959Z Execution Analysis: (:1) 2024-12-18T00:21:04.9843194Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9843392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9843398Z 2024-12-18T00:21:04.9843584Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9843687Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9843904Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9844005Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9844333Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9844633Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9844791Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9844957Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9845605Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9846188Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9846584Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9846944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9847254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9847536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9847841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9848121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9848223Z Execution Analysis: .......... 2024-12-18T00:21:04.9848475Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9848685Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9848974Z pt-xla-profiler: TransferFromDeviceTime too frequent: 861 counts during 821 steps 2024-12-18T00:21:04.9848979Z 2024-12-18T00:21:04.9849187Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9849298Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9849597Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9849703Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9849919Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9850060Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9850203Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9850376Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9850731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9851155Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9851464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9851746Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9852050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9852315Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9852609Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9852734Z Execution Analysis: (:1) 2024-12-18T00:21:04.9852997Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9853199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9853208Z 2024-12-18T00:21:04.9853415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9853523Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9853752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9853868Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9854073Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9854222Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9854367Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9854570Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9855159Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9855768Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9856125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9856554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9856877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9857149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9857464Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9857730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9857839Z Execution Analysis: .......... 2024-12-18T00:21:04.9858094Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9858300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9858591Z pt-xla-profiler: TransferFromDeviceTime too frequent: 862 counts during 822 steps 2024-12-18T00:21:04.9858596Z 2024-12-18T00:21:04.9858795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9858916Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9859205Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9859323Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9859526Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9859673Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9859813Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9860005Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9860527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9860878Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9861197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9861471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9861785Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9862052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9862344Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9862475Z Execution Analysis: (:1) 2024-12-18T00:21:04.9862732Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9862948Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9862953Z 2024-12-18T00:21:04.9863154Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9863280Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9863514Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9863635Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9863840Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9863980Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9864160Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9864325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9864925Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9865546Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9865921Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9866272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9866583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9866864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9867174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9867447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9867553Z Execution Analysis: .......... 2024-12-18T00:21:04.9867825Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9868027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9868322Z pt-xla-profiler: TransferFromDeviceTime too frequent: 864 counts during 823 steps 2024-12-18T00:21:04.9868327Z 2024-12-18T00:21:04.9868526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9868645Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9869045Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9869147Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9869340Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9869471Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9869710Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9869887Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9870216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9870546Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9870831Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9871092Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9871374Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9871628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9871895Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9872017Z Execution Analysis: (:1) 2024-12-18T00:21:04.9872255Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9872438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9872442Z 2024-12-18T00:21:04.9872632Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9872732Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9872947Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9873046Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9873245Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9873398Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9873532Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9873692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9874260Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9874802Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9875132Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9875465Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9875750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9876011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9876293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9876544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9876650Z Execution Analysis: .......... 2024-12-18T00:21:04.9876886Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9877080Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9877341Z pt-xla-profiler: TransferFromDeviceTime too frequent: 865 counts during 824 steps 2024-12-18T00:21:04.9877346Z 2024-12-18T00:21:04.9877543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9877646Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9877913Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9878021Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9878209Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9878372Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9878527Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9878691Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9879019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9879342Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9879630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9879877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9880167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9880412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9880692Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9880808Z Execution Analysis: (:1) 2024-12-18T00:21:04.9881053Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9881239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9881243Z 2024-12-18T00:21:04.9881426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9881536Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9881747Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9881881Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9882070Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9882213Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9882346Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9882501Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9883080Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9883609Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9883950Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9884274Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9884569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9884819Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9885115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9885365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9885464Z Execution Analysis: .......... 2024-12-18T00:21:04.9885708Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9885892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9886161Z pt-xla-profiler: TransferFromDeviceTime too frequent: 866 counts during 825 steps 2024-12-18T00:21:04.9886166Z 2024-12-18T00:21:04.9886350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9886467Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9886732Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9886843Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9887054Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9887211Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9887349Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9887502Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9887844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9888166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9888459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9888711Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9888993Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9889245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9889517Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9889639Z Execution Analysis: (:1) 2024-12-18T00:21:04.9889877Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9890069Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9890073Z 2024-12-18T00:21:04.9890256Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9890366Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9890603Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9890701Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9890898Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9891028Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9891174Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9891350Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9891898Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9892435Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9892767Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9893097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9893380Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9893638Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9893927Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9894182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9894276Z Execution Analysis: .......... 2024-12-18T00:21:04.9894512Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9894712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9894973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 867 counts during 826 steps 2024-12-18T00:21:04.9894979Z 2024-12-18T00:21:04.9895169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9895272Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9895545Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9895670Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9895884Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9896016Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9896146Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9896307Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9896707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9897223Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9897530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9897816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9898121Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9898393Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9898689Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9898810Z Execution Analysis: (:1) 2024-12-18T00:21:04.9899077Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9899277Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9899281Z 2024-12-18T00:21:04.9899494Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9899643Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9899879Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9899987Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9900194Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9900348Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9900519Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9900696Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9901287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9901869Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9902224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9902576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9902893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9903170Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9903493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9903758Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9903874Z Execution Analysis: .......... 2024-12-18T00:21:04.9904132Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9904341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9904629Z pt-xla-profiler: TransferFromDeviceTime too frequent: 868 counts during 827 steps 2024-12-18T00:21:04.9904634Z 2024-12-18T00:21:04.9904833Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9904955Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9905270Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9905415Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9905617Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9905770Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9905912Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9906078Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9906449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9906799Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9907124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9907394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9907713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9907984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9908290Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9908418Z Execution Analysis: (:1) 2024-12-18T00:21:04.9908671Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9908882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9908886Z 2024-12-18T00:21:04.9909210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9909323Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9909532Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9909645Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9909865Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9910001Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9910144Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9910298Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9910852Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9911382Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9911729Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9912054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9912348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9912604Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9912885Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9913146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9913244Z Execution Analysis: .......... 2024-12-18T00:21:04.9913489Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9913675Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9913948Z pt-xla-profiler: TransferFromDeviceTime too frequent: 869 counts during 828 steps 2024-12-18T00:21:04.9913952Z 2024-12-18T00:21:04.9914142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9914278Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9914570Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9914672Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9914870Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9915000Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9915136Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9915288Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9915618Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9915952Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9916237Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9916497Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9916782Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9917037Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9917305Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9917427Z Execution Analysis: (:1) 2024-12-18T00:21:04.9917834Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9918029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9918061Z 2024-12-18T00:21:04.9918266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9918372Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9918607Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9918737Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9918947Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9919084Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9919223Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9919398Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9919973Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9920540Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9920888Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9921238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9921543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9921814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9922114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9922373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9922488Z Execution Analysis: .......... 2024-12-18T00:21:04.9922735Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9922939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9923212Z pt-xla-profiler: TransferFromDeviceTime too frequent: 870 counts during 829 steps 2024-12-18T00:21:04.9923242Z 2024-12-18T00:21:04.9923452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9923584Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9923870Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9923978Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9924175Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9924326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9924463Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9924633Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9924982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9925330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9925634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9925902Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9926211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9926468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9926763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9926882Z Execution Analysis: (:1) 2024-12-18T00:21:04.9927139Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9927366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9927371Z 2024-12-18T00:21:04.9927578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9927691Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9927942Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9928059Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9928257Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9928408Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9928548Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9928711Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9929298Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9929950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9930292Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9930619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9930915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9931164Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9931459Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9931706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9931811Z Execution Analysis: .......... 2024-12-18T00:21:04.9932050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9932238Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9932532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 871 counts during 830 steps 2024-12-18T00:21:04.9932537Z 2024-12-18T00:21:04.9932755Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9932870Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9933137Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9933249Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9933440Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9933571Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9933714Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9933868Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9934210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9934528Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9934834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9935087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9935368Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9935626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9935891Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9936013Z Execution Analysis: (:1) 2024-12-18T00:21:04.9936273Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9936556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9936561Z 2024-12-18T00:21:04.9936748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9937060Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9937293Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9937401Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9937620Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9937758Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9937914Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9938077Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9938675Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9939248Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9939614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9939975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9940286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9940572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9940878Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9941154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9941261Z Execution Analysis: .......... 2024-12-18T00:21:04.9941525Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9941727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9942064Z pt-xla-profiler: TransferFromDeviceTime too frequent: 872 counts during 831 steps 2024-12-18T00:21:04.9942069Z 2024-12-18T00:21:04.9942278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9942388Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9942689Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9942796Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9943009Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9943153Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9943294Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9943468Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9943822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9944344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9944654Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9944935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9945242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9945518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9945813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9945992Z Execution Analysis: (:1) 2024-12-18T00:21:04.9946258Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9946456Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9946463Z 2024-12-18T00:21:04.9946714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9946827Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9947069Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9947180Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9947389Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9947542Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9947687Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9947866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9948459Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9949049Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9949410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9949773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9950083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9950356Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9950676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9950948Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9951063Z Execution Analysis: .......... 2024-12-18T00:21:04.9951318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9951592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9951880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 873 counts during 832 steps 2024-12-18T00:21:04.9951884Z 2024-12-18T00:21:04.9952090Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9952207Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9952498Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9952619Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9952821Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9952976Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9953120Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9953285Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9953657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9954008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9954328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9954599Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9954919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9955188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9955516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9955643Z Execution Analysis: (:1) 2024-12-18T00:21:04.9956004Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9956354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9956359Z 2024-12-18T00:21:04.9956543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9956659Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9956872Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9956986Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9957177Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9957309Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9957458Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9957616Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9958177Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9958713Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9959052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9959374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9959670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9959921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9960204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9960464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9960558Z Execution Analysis: .......... 2024-12-18T00:21:04.9960830Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9961038Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9961310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 874 counts during 833 steps 2024-12-18T00:21:04.9961314Z 2024-12-18T00:21:04.9961499Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9961613Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9961885Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9961983Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9962179Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9962309Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9962446Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9962599Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9962941Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9963266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9963551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9963811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9964091Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9964370Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9964638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9964762Z Execution Analysis: (:1) 2024-12-18T00:21:04.9965003Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9965212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9965226Z 2024-12-18T00:21:04.9965412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9965515Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9965732Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9965831Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9966031Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9966164Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9966309Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9966464Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9967007Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9967551Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9967880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9968212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9968497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9968760Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9969046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9969298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9969435Z Execution Analysis: .......... 2024-12-18T00:21:04.9969695Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9969893Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9970154Z pt-xla-profiler: TransferFromDeviceTime too frequent: 875 counts during 834 steps 2024-12-18T00:21:04.9970158Z 2024-12-18T00:21:04.9970352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9970456Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9970731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9970834Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9971023Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9971164Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9971300Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9971469Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9971797Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9972129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9972416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9972665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9972960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9973230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9973514Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9973627Z Execution Analysis: (:1) 2024-12-18T00:21:04.9973899Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9974086Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9974091Z 2024-12-18T00:21:04.9974283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9974388Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9974599Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9974708Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9974897Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9975042Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9975175Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9975344Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9975894Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9976497Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9977013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9977364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9977685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9977958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9978275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9978575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9978716Z Execution Analysis: .......... 2024-12-18T00:21:04.9978972Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9979174Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9979472Z pt-xla-profiler: TransferFromDeviceTime too frequent: 876 counts during 835 steps 2024-12-18T00:21:04.9979477Z 2024-12-18T00:21:04.9979674Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9979802Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9980091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9980206Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9980411Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9980553Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9980710Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9980874Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9981237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9981583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9981903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9982176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9982519Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9982789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9983077Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9983242Z Execution Analysis: (:1) 2024-12-18T00:21:04.9983495Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9983704Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9983709Z 2024-12-18T00:21:04.9983911Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9984032Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9984260Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9984368Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9984586Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9984725Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9984886Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9985052Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9985656Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9986229Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9986592Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9986943Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9987254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9987534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9987872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9988177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9988280Z Execution Analysis: .......... 2024-12-18T00:21:04.9988548Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9988750Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9989137Z pt-xla-profiler: TransferFromDeviceTime too frequent: 877 counts during 836 steps 2024-12-18T00:21:04.9989149Z 2024-12-18T00:21:04.9989336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9989441Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9989720Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9989819Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9990017Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9990152Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9990292Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9990448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9990775Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9991100Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9991386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9991668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9991951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9992205Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9992504Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:04.9992620Z Execution Analysis: (:1) 2024-12-18T00:21:04.9992862Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9993049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9993053Z 2024-12-18T00:21:04.9993246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9993347Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9993564Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:04.9993665Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9993863Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:04.9993993Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:04.9994130Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:04.9994291Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9994837Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:04.9995370Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:04.9995701Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:04.9996030Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:04.9996314Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:04.9996592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:04.9996909Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:04.9997157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:04.9997265Z Execution Analysis: .......... 2024-12-18T00:21:04.9997500Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:04.9997691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9997950Z pt-xla-profiler: TransferFromDeviceTime too frequent: 878 counts during 837 steps 2024-12-18T00:21:04.9997957Z 2024-12-18T00:21:04.9998152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:04.9998254Z Execution Analysis: Execution Cause 2024-12-18T00:21:04.9998525Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:04.9998636Z Execution Analysis: Graph Info: 2024-12-18T00:21:04.9998826Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:04.9998965Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:04.9999094Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:04.9999252Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:04.9999580Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:04.9999902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0000224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0000474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0000762Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0001051Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0001327Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0001437Z Execution Analysis: (:1) 2024-12-18T00:21:05.0001673Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0001863Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0001867Z 2024-12-18T00:21:05.0002047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0002157Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0002367Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0002471Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0002661Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0002800Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0002932Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0003085Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0003637Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0004167Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0004504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0004825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0005120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0005419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0005886Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0006142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0006243Z Execution Analysis: .......... 2024-12-18T00:21:05.0006498Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0006691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0006977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 879 counts during 838 steps 2024-12-18T00:21:05.0006982Z 2024-12-18T00:21:05.0007175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0007294Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0007576Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0007682Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0007885Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0008023Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0008168Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0008326Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0008677Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0009013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0009339Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0009607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0010002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0010271Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0010549Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0010672Z Execution Analysis: (:1) 2024-12-18T00:21:05.0010919Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0011123Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0011129Z 2024-12-18T00:21:05.0011322Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0011430Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0011660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0011768Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0011978Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0012117Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0012270Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0012430Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0013006Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0013573Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0013924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0014274Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0014624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0014898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0015194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0015458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0015558Z Execution Analysis: .......... 2024-12-18T00:21:05.0015808Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0016009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0016287Z pt-xla-profiler: TransferFromDeviceTime too frequent: 880 counts during 839 steps 2024-12-18T00:21:05.0016292Z 2024-12-18T00:21:05.0016564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0016677Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0017139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0017250Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0017460Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0017602Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0017744Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0017918Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0018275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0018663Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0018973Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0019258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0019591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0019859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0020154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0020278Z Execution Analysis: (:1) 2024-12-18T00:21:05.0020546Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0020744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0020751Z 2024-12-18T00:21:05.0020957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0021065Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0021297Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0021412Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0021620Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0021768Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0021912Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0022083Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0022673Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0023254Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0023611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0023986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0024324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0024599Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0024912Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0025178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0025290Z Execution Analysis: .......... 2024-12-18T00:21:05.0025543Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0025747Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0026040Z pt-xla-profiler: TransferFromDeviceTime too frequent: 881 counts during 840 steps 2024-12-18T00:21:05.0026047Z 2024-12-18T00:21:05.0026249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0026363Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0026649Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0026760Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0026960Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0027111Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0027250Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0027413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0027799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0028147Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0028465Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0028760Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0029183Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0029537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0029809Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0029929Z Execution Analysis: (:1) 2024-12-18T00:21:05.0030164Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0030355Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0030359Z 2024-12-18T00:21:05.0030541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0030651Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0030864Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0030965Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0034405Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0034550Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0034693Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0034848Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0035414Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0035953Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0036340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0036701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0036991Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0037248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0037530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0037787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0037883Z Execution Analysis: .......... 2024-12-18T00:21:05.0038128Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0038314Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0038578Z pt-xla-profiler: TransferFromDeviceTime too frequent: 882 counts during 841 steps 2024-12-18T00:21:05.0038592Z 2024-12-18T00:21:05.0038779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0038883Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0039155Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0039255Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0039454Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0039584Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0039711Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0039897Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0040225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0040550Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0040865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0041124Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0041408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0041661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0041926Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0042038Z Execution Analysis: (:1) 2024-12-18T00:21:05.0042282Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0042466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0042473Z 2024-12-18T00:21:05.0042668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0042770Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0042983Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0043082Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0043271Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0043405Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0043538Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0043695Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0044389Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0045127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0045581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0045936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0046245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0046517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0046825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0047089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0047202Z Execution Analysis: .......... 2024-12-18T00:21:05.0047456Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0047659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0047946Z pt-xla-profiler: TransferFromDeviceTime too frequent: 883 counts during 842 steps 2024-12-18T00:21:05.0047951Z 2024-12-18T00:21:05.0048155Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0048264Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0048551Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0048663Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0048862Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0049042Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0049180Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0049346Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0049698Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0050087Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0050402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0050673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0050982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0051246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0051540Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0051664Z Execution Analysis: (:1) 2024-12-18T00:21:05.0051920Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0052122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0052129Z 2024-12-18T00:21:05.0052331Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0052445Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0052672Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0052787Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0052991Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0053131Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0053280Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0053445Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0054045Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0054666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0055027Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0055374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0055687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0055958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0056263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0056611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0056716Z Execution Analysis: .......... 2024-12-18T00:21:05.0056980Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0057185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0057475Z pt-xla-profiler: TransferFromDeviceTime too frequent: 885 counts during 843 steps 2024-12-18T00:21:05.0057480Z 2024-12-18T00:21:05.0057682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0057798Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0058086Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0058192Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0058434Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0058575Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0058719Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0058886Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0059278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0059626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0059933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0060205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0060508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0060782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0061070Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0061200Z Execution Analysis: (:1) 2024-12-18T00:21:05.0061456Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0061661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0061672Z 2024-12-18T00:21:05.0061872Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0061982Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0062212Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0062318Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0062531Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0062672Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0062821Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0062986Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0063577Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0064207Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0064564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0064916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0065223Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0065499Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0065805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0066074Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0066179Z Execution Analysis: .......... 2024-12-18T00:21:05.0066438Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0066640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0066922Z pt-xla-profiler: TransferFromDeviceTime too frequent: 886 counts during 844 steps 2024-12-18T00:21:05.0066926Z 2024-12-18T00:21:05.0067132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0067243Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0067536Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0067682Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0067883Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0068025Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0068164Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0068335Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0068715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0069158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0069443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0069694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0069977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0070222Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0070493Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0070604Z Execution Analysis: (:1) 2024-12-18T00:21:05.0070848Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0071031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0071035Z 2024-12-18T00:21:05.0071220Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0071320Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0071531Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0071633Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0071821Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0071958Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0072088Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0072248Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0072839Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0073368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0073702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0074024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0074484Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0074750Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0075052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0075309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0075416Z Execution Analysis: .......... 2024-12-18T00:21:05.0075663Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0075855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0076132Z pt-xla-profiler: TransferFromDeviceTime too frequent: 887 counts during 845 steps 2024-12-18T00:21:05.0076136Z 2024-12-18T00:21:05.0076329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0076439Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0076748Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0076855Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0077050Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0077188Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0077327Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0077512Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0077866Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0078205Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0078510Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0078771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0079073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0079330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0079612Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0079741Z Execution Analysis: (:1) 2024-12-18T00:21:05.0079991Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0080189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0080193Z 2024-12-18T00:21:05.0080385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0080496Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0080717Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0080818Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0081026Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0081162Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0081304Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0081490Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0082094Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0082650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0083000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0083340Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0083644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0083909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0084204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0084475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0084574Z Execution Analysis: .......... 2024-12-18T00:21:05.0084826Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0085019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0085294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 888 counts during 846 steps 2024-12-18T00:21:05.0085304Z 2024-12-18T00:21:05.0085498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0085632Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0085918Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0086126Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0086319Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0086474Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0086608Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0086759Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0087086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0087411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0087697Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0087951Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0088232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0088479Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0088748Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0088863Z Execution Analysis: (:1) 2024-12-18T00:21:05.0089099Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0089284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0089288Z 2024-12-18T00:21:05.0089473Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0089574Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0089787Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0089888Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0090080Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0090207Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0090363Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0090543Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0091087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0091619Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0091946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0092268Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0092555Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0092801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0093090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0093336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0093433Z Execution Analysis: .......... 2024-12-18T00:21:05.0093668Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0093855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0094113Z pt-xla-profiler: TransferFromDeviceTime too frequent: 889 counts during 847 steps 2024-12-18T00:21:05.0094117Z 2024-12-18T00:21:05.0094443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0094543Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0094807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0094912Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0095123Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0095260Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0095387Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0095543Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0095871Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0096190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0096557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0096979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0097286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0097551Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0097846Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0097966Z Execution Analysis: (:1) 2024-12-18T00:21:05.0098221Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0098425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0098430Z 2024-12-18T00:21:05.0098628Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0098747Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0098974Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0099085Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0099289Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0099462Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0099644Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0099810Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0100406Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0100976Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0101337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0101685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0101999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0102273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0102587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0102856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0102960Z Execution Analysis: .......... 2024-12-18T00:21:05.0103218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0103417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0103704Z pt-xla-profiler: TransferFromDeviceTime too frequent: 890 counts during 848 steps 2024-12-18T00:21:05.0103734Z 2024-12-18T00:21:05.0103932Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0104046Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0104335Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0104471Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0104680Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0104818Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0104960Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0105124Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0105489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0105840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0106154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0106431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0106735Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0107006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0107290Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0107415Z Execution Analysis: (:1) 2024-12-18T00:21:05.0107666Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0107869Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0107873Z 2024-12-18T00:21:05.0108074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0108184Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0108417Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0108522Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0108756Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0108923Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0109173Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0109325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0109868Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0110403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0110733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0111061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0111346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0111603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0111884Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0112134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0112228Z Execution Analysis: .......... 2024-12-18T00:21:05.0112462Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0112648Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0112931Z pt-xla-profiler: TransferFromDeviceTime too frequent: 891 counts during 849 steps 2024-12-18T00:21:05.0112935Z 2024-12-18T00:21:05.0113128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0113232Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0113527Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0113626Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0113815Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0113943Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0114071Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0114228Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0114554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0114880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0115165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0115419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0115705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0115947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0116220Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0116331Z Execution Analysis: (:1) 2024-12-18T00:21:05.0116572Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0116755Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0116760Z 2024-12-18T00:21:05.0117110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0117215Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0117438Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0117567Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0117790Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0117931Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0118069Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0118231Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0118803Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0119363Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0119712Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0120049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0120357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0120617Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0120919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0121177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0121285Z Execution Analysis: .......... 2024-12-18T00:21:05.0121532Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0121756Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0122030Z pt-xla-profiler: TransferFromDeviceTime too frequent: 892 counts during 850 steps 2024-12-18T00:21:05.0122035Z 2024-12-18T00:21:05.0122232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0122370Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0122651Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0122760Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0122954Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0123093Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0123230Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0123394Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0123744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0124086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0124393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0124661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0124964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0125226Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0125508Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0125632Z Execution Analysis: (:1) 2024-12-18T00:21:05.0125880Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0126082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0126086Z 2024-12-18T00:21:05.0126279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0126418Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0126663Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0126776Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0126974Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0127110Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0127254Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0127415Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0128000Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0128560Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0128912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0129259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0129663Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0129918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0130198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0130445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0130539Z Execution Analysis: .......... 2024-12-18T00:21:05.0130779Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0130989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0131256Z pt-xla-profiler: TransferFromDeviceTime too frequent: 893 counts during 851 steps 2024-12-18T00:21:05.0131262Z 2024-12-18T00:21:05.0131469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0131574Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0131843Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0131943Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0132136Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0132265Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0132395Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0132548Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0132875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0133198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0133488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0133742Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0134022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0134270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0134536Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0134652Z Execution Analysis: (:1) 2024-12-18T00:21:05.0134885Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0135070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0135074Z 2024-12-18T00:21:05.0135260Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0135420Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0135634Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0135732Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0135926Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0136055Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0136187Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0136407Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0137140Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0137727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0138085Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0138441Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0138747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0139021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0139326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0139592Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0139744Z Execution Analysis: .......... 2024-12-18T00:21:05.0139998Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0140204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0140513Z pt-xla-profiler: TransferFromDeviceTime too frequent: 894 counts during 852 steps 2024-12-18T00:21:05.0140521Z 2024-12-18T00:21:05.0140726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0140837Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0141132Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0141238Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0141440Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0141586Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0141726Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0141893Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0142248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0142598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0142913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0143182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0143492Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0143757Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0144053Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0144324Z Execution Analysis: (:1) 2024-12-18T00:21:05.0144590Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0144790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0144846Z 2024-12-18T00:21:05.0145086Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0145202Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0145432Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0145549Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0145755Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0145903Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0146048Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0146214Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0146812Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0147385Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0147757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0148104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0148423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0148695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0149013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0149318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0149419Z Execution Analysis: .......... 2024-12-18T00:21:05.0149681Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0149882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0150203Z pt-xla-profiler: TransferFromDeviceTime too frequent: 895 counts during 853 steps 2024-12-18T00:21:05.0150208Z 2024-12-18T00:21:05.0150408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0150525Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0150812Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0150923Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0151123Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0151266Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0151411Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0151576Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0151936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0152292Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0152609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0152882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0153186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0153455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0153743Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0153871Z Execution Analysis: (:1) 2024-12-18T00:21:05.0154126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0154358Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0154389Z 2024-12-18T00:21:05.0154590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0154706Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0154933Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0155042Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0155253Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0155391Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0155535Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0155811Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0156477Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0157007Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0157337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0157660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0157947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0158206Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0158488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0158830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0158924Z Execution Analysis: .......... 2024-12-18T00:21:05.0159159Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0159377Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0159639Z pt-xla-profiler: TransferFromDeviceTime too frequent: 896 counts during 854 steps 2024-12-18T00:21:05.0159643Z 2024-12-18T00:21:05.0159833Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0159935Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0160211Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0160309Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0160501Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0160630Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0160757Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0160917Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0161248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0161573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0161857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0162111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0162392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0162637Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0162911Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0163023Z Execution Analysis: (:1) 2024-12-18T00:21:05.0163262Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0163494Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0163499Z 2024-12-18T00:21:05.0163688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0163790Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0164006Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0164107Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0164298Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0164433Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0164569Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0164725Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0165268Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0165809Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0166138Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0166461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0166752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0167005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0167319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0167564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0167668Z Execution Analysis: .......... 2024-12-18T00:21:05.0167939Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0168131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0168390Z pt-xla-profiler: TransferFromDeviceTime too frequent: 897 counts during 855 steps 2024-12-18T00:21:05.0168394Z 2024-12-18T00:21:05.0168578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0168687Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0168952Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0169061Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0169250Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0169392Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0169525Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0169680Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0170014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0170336Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0170628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0170877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0171168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0171415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0171692Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0171831Z Execution Analysis: (:1) 2024-12-18T00:21:05.0172097Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0172289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0172293Z 2024-12-18T00:21:05.0172477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0172585Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0172797Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0172901Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0173089Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0173222Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0173359Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0173513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0174073Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0174601Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0174937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0175257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0175548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0175821Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0176102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0176431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0176557Z Execution Analysis: .......... 2024-12-18T00:21:05.0176961Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0177158Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0177448Z pt-xla-profiler: TransferFromDeviceTime too frequent: 898 counts during 856 steps 2024-12-18T00:21:05.0177453Z 2024-12-18T00:21:05.0177651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0177770Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0178058Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0178163Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0178370Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0178511Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0178660Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0178823Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0179178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0179529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0179835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0180110Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0180420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0180688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0180976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0181134Z Execution Analysis: (:1) 2024-12-18T00:21:05.0181412Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0181613Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0181623Z 2024-12-18T00:21:05.0181820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0181929Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0182162Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0182271Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0182484Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0182625Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0182770Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0182941Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0183534Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0184109Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0184464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0184818Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0185152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0185427Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0185734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0186027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0186137Z Execution Analysis: .......... 2024-12-18T00:21:05.0186393Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0186601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0186882Z pt-xla-profiler: TransferFromDeviceTime too frequent: 899 counts during 857 steps 2024-12-18T00:21:05.0186886Z 2024-12-18T00:21:05.0187091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0187202Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0187496Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0187603Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0187807Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0187959Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0188100Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0188271Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0188626Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0189086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0189371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0189622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0189907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0190154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0190474Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0190588Z Execution Analysis: (:1) 2024-12-18T00:21:05.0190831Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0191019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0191023Z 2024-12-18T00:21:05.0191212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0191314Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0191525Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0191630Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0191819Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0191958Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0192097Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0192259Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0192803Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0193336Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0193670Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0194018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0194311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0194562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0194877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0195125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0195224Z Execution Analysis: .......... 2024-12-18T00:21:05.0195458Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0195641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0195907Z pt-xla-profiler: TransferFromDeviceTime too frequent: 900 counts during 858 steps 2024-12-18T00:21:05.0195914Z 2024-12-18T00:21:05.0196098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0196208Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0196473Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0196579Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0196766Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0196897Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0197029Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0197178Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0197513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0197832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0198124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0198375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0198657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0198933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0199231Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0199350Z Execution Analysis: (:1) 2024-12-18T00:21:05.0199584Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0199774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0199778Z 2024-12-18T00:21:05.0199961Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0200068Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0200280Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0200380Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0200575Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0200705Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0200844Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0200996Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0201548Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0202077Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0202408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0202771Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0203057Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0203338Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0203624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0203876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0203969Z Execution Analysis: .......... 2024-12-18T00:21:05.0204207Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0204390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0204652Z pt-xla-profiler: TransferFromDeviceTime too frequent: 901 counts during 859 steps 2024-12-18T00:21:05.0204662Z 2024-12-18T00:21:05.0204848Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0204951Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0205227Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0205329Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0205520Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0205649Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0205777Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0205935Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0206261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0206595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0206879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0207138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0207445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0207723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0207992Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0208104Z Execution Analysis: (:1) 2024-12-18T00:21:05.0208348Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0208535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0208539Z 2024-12-18T00:21:05.0208733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0208836Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0209056Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0209158Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0209356Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0209496Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0209628Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0209788Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0210335Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0210876Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0211229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0211563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0211850Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0212128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0212422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0212673Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0212777Z Execution Analysis: .......... 2024-12-18T00:21:05.0213011Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0213208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0213471Z pt-xla-profiler: TransferFromDeviceTime too frequent: 902 counts during 860 steps 2024-12-18T00:21:05.0213475Z 2024-12-18T00:21:05.0213666Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0213770Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0214042Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0214151Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0214339Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0214475Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0214603Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0214766Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0215094Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0215419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0215710Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0215983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0216297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0216620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0217071Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0217192Z Execution Analysis: (:1) 2024-12-18T00:21:05.0217448Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0217659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0217666Z 2024-12-18T00:21:05.0217862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0217978Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0218204Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0218324Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0218527Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0218668Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0218822Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0218987Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0219593Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0220163Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0220558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0220906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0221253Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0221524Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0221831Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0222102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0222206Z Execution Analysis: .......... 2024-12-18T00:21:05.0222468Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0222671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0222963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 903 counts during 861 steps 2024-12-18T00:21:05.0222970Z 2024-12-18T00:21:05.0223170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0223291Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0223578Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0223685Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0223893Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0224033Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0224178Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0224340Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0224704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0225050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0225356Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0225683Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0225988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0226261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0226551Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0226680Z Execution Analysis: (:1) 2024-12-18T00:21:05.0226933Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0227145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0227150Z 2024-12-18T00:21:05.0227346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0227457Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0227695Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0227802Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0228017Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0228158Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0228311Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0228476Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0229169Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0229841Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0230170Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0230530Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0230820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0231082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0231364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0231620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0231714Z Execution Analysis: .......... 2024-12-18T00:21:05.0231950Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0232142Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0232403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 904 counts during 862 steps 2024-12-18T00:21:05.0232407Z 2024-12-18T00:21:05.0232604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0232705Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0232982Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0233082Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0233267Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0233402Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0233531Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0233697Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0234025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0234355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0234701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0234953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0235245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0235489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0235765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0235877Z Execution Analysis: (:1) 2024-12-18T00:21:05.0236126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0236307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0236311Z 2024-12-18T00:21:05.0236505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0236608Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0236820Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0236924Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0237115Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0237253Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0237384Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0237545Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0238095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0238649Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0239015Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0239337Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0239629Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0239878Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0240170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0240415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0240523Z Execution Analysis: .......... 2024-12-18T00:21:05.0240756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0240941Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0241216Z pt-xla-profiler: TransferFromDeviceTime too frequent: 906 counts during 863 steps 2024-12-18T00:21:05.0241220Z 2024-12-18T00:21:05.0241406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0241522Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0241786Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0241894Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0242079Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0242207Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0242345Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0242495Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0242832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0243204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0243502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0243751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0244044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0244596Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0244886Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0245025Z Execution Analysis: (:1) 2024-12-18T00:21:05.0245282Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0245490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0245497Z 2024-12-18T00:21:05.0245699Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0245822Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0246051Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0246160Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0246372Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0246511Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0246664Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0246830Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0247483Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0248054Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0248459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0248806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0249116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0249398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0249705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0249978Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0250083Z Execution Analysis: .......... 2024-12-18T00:21:05.0250350Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0250556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0250842Z pt-xla-profiler: TransferFromDeviceTime too frequent: 907 counts during 864 steps 2024-12-18T00:21:05.0250856Z 2024-12-18T00:21:05.0251055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0251169Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0251465Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0251574Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0251786Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0251930Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0252083Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0252248Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0252640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0253029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0253341Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0253623Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0253927Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0254206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0254500Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0254625Z Execution Analysis: (:1) 2024-12-18T00:21:05.0254887Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0255093Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0255098Z 2024-12-18T00:21:05.0255311Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0255420Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0255656Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0255766Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0255982Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0256121Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0256293Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0256544Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0257138Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0257754Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0258112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0258473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0258786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0259057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0259372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0259639Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0259752Z Execution Analysis: .......... 2024-12-18T00:21:05.0260008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0260219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0260498Z pt-xla-profiler: TransferFromDeviceTime too frequent: 908 counts during 865 steps 2024-12-18T00:21:05.0260503Z 2024-12-18T00:21:05.0260712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0260825Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0261115Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0261231Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0261430Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0261577Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0261714Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0261909Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0262290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0262636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0262950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0263221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0263533Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0263801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0264097Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0264217Z Execution Analysis: (:1) 2024-12-18T00:21:05.0264482Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0264683Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0264687Z 2024-12-18T00:21:05.0264885Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0265003Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0265229Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0265342Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0265546Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0265725Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0265867Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0266030Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0266626Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0267231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0267593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0267941Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0268262Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0268536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0268850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0269204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0269300Z Execution Analysis: .......... 2024-12-18T00:21:05.0269544Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0269728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0269994Z pt-xla-profiler: TransferFromDeviceTime too frequent: 909 counts during 866 steps 2024-12-18T00:21:05.0269999Z 2024-12-18T00:21:05.0270182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0270295Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0270561Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0270663Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0270859Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0270991Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0271162Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0271343Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0271680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0272001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0272289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0272547Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0272829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0273085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0273353Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0273483Z Execution Analysis: (:1) 2024-12-18T00:21:05.0273722Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0273917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0273921Z 2024-12-18T00:21:05.0274105Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0274207Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0274424Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0274524Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0274748Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0274879Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0275020Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0275172Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0275747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0276284Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0276611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0276942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0277229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0277494Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0277776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0278037Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0278135Z Execution Analysis: .......... 2024-12-18T00:21:05.0278373Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0278564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0278824Z pt-xla-profiler: TransferFromDeviceTime too frequent: 910 counts during 867 steps 2024-12-18T00:21:05.0278828Z 2024-12-18T00:21:05.0279021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0279127Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0279401Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0279501Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0279702Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0279856Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0280010Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0280173Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0280500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0280831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0281119Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0281378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0281660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0281906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0282184Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0282300Z Execution Analysis: (:1) 2024-12-18T00:21:05.0282548Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0282732Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0282736Z 2024-12-18T00:21:05.0282929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0283031Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0283250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0283374Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0283562Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0283702Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0283836Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0284021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0284568Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0285112Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0285439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0285762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0286058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0286307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0286600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0286847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0286953Z Execution Analysis: .......... 2024-12-18T00:21:05.0287187Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0287384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0287643Z pt-xla-profiler: TransferFromDeviceTime too frequent: 911 counts during 868 steps 2024-12-18T00:21:05.0287647Z 2024-12-18T00:21:05.0287831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0287942Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0288210Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0288344Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0288529Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0288698Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0288828Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0288980Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0289315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0289635Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0289927Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0290181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0290474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0290723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0290994Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0291112Z Execution Analysis: (:1) 2024-12-18T00:21:05.0291344Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0291537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0291541Z 2024-12-18T00:21:05.0291723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0291836Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0292071Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0292178Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0292378Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0292511Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0292680Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0292834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0293393Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0293920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0294261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0294587Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0294887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0295145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0295437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0295697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0295793Z Execution Analysis: .......... 2024-12-18T00:21:05.0296037Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0296223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0296565Z pt-xla-profiler: TransferFromDeviceTime too frequent: 912 counts during 869 steps 2024-12-18T00:21:05.0296571Z 2024-12-18T00:21:05.0296921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0297033Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0297337Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0297476Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0297790Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0297932Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0298080Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0298250Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0298607Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0298968Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0299281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0299565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0299871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0300154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0300448Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0300581Z Execution Analysis: (:1) 2024-12-18T00:21:05.0300840Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0301042Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0301046Z 2024-12-18T00:21:05.0301263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0301401Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0301643Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0301753Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0301971Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0302156Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0302302Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0302482Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0303076Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0303658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0304018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0304376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0304682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0304966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0305276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0305539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0305656Z Execution Analysis: .......... 2024-12-18T00:21:05.0305909Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0306117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0306399Z pt-xla-profiler: TransferFromDeviceTime too frequent: 913 counts during 870 steps 2024-12-18T00:21:05.0306403Z 2024-12-18T00:21:05.0306610Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0306750Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0307068Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0307181Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0307381Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0307535Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0307674Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0307848Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0308204Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0308563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0308879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0309253Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0309736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0310000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0310302Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0310422Z Execution Analysis: (:1) 2024-12-18T00:21:05.0310690Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0310890Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0310919Z 2024-12-18T00:21:05.0311117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0311240Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0311466Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0311588Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0311820Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0311973Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0312116Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0312282Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0312884Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0313457Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0313829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0314180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0314505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0314775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0315087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0315357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0315461Z Execution Analysis: .......... 2024-12-18T00:21:05.0315726Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0315925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0316222Z pt-xla-profiler: TransferFromDeviceTime too frequent: 914 counts during 871 steps 2024-12-18T00:21:05.0316226Z 2024-12-18T00:21:05.0316527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0316689Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0316995Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0317111Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0317309Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0317447Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0317766Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0317931Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0318299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0318648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0318969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0319246Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0319552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0319830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0320118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0320249Z Execution Analysis: (:1) 2024-12-18T00:21:05.0320503Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0320712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0320741Z 2024-12-18T00:21:05.0320942Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0321064Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0321297Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0321554Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0321773Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0321915Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0322068Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0322237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0322847Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0323427Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0323782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0324146Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0324458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0324744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0325048Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0325324Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0325432Z Execution Analysis: .......... 2024-12-18T00:21:05.0325697Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0325900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0326180Z pt-xla-profiler: TransferFromDeviceTime too frequent: 915 counts during 872 steps 2024-12-18T00:21:05.0326211Z 2024-12-18T00:21:05.0326455Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0326569Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0326864Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0326971Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0327180Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0327325Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0327463Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0327635Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0327990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0328346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0328657Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0328939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0329249Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0329516Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0329816Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0329935Z Execution Analysis: (:1) 2024-12-18T00:21:05.0330201Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0330428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0330432Z 2024-12-18T00:21:05.0330639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0330750Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0331015Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0331127Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0331333Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0331486Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0331629Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0331804Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0332497Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0333158Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0333492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0333827Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0334116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0334367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0334657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0334901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0335009Z Execution Analysis: .......... 2024-12-18T00:21:05.0335248Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0335441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0335729Z pt-xla-profiler: TransferFromDeviceTime too frequent: 916 counts during 873 steps 2024-12-18T00:21:05.0335735Z 2024-12-18T00:21:05.0335946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0336061Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0336325Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0336517Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0336705Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0337015Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0337156Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0337325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0337692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0338043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0338367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0338642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0338957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0339225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0339526Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0339653Z Execution Analysis: (:1) 2024-12-18T00:21:05.0339953Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0340160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0340168Z 2024-12-18T00:21:05.0340395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0340518Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0340745Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0340863Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0341071Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0341213Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0341371Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0341537Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0342141Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0342717Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0343092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0343441Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0343760Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0344035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0344482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0344760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0344865Z Execution Analysis: .......... 2024-12-18T00:21:05.0345131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0345330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0345710Z pt-xla-profiler: TransferFromDeviceTime too frequent: 917 counts during 874 steps 2024-12-18T00:21:05.0345715Z 2024-12-18T00:21:05.0345920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0346046Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0346339Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0346447Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0346664Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0346806Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0346955Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0347119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0347476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0347842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0348151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0348434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0348739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0349020Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0349310Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0349474Z Execution Analysis: (:1) 2024-12-18T00:21:05.0349731Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0349929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0349943Z 2024-12-18T00:21:05.0350179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0350290Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0350526Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0350632Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0350851Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0350991Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0351134Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0351309Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0351903Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0352490Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0352846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0353207Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0353516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0353796Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0354107Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0354374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0354487Z Execution Analysis: .......... 2024-12-18T00:21:05.0354739Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0355002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0355283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 918 counts during 875 steps 2024-12-18T00:21:05.0355288Z 2024-12-18T00:21:05.0355495Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0355608Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0355906Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0356122Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0356317Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0356465Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0356605Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0356779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0357128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0357573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0357861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0358114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0358407Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0358651Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0358957Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0359072Z Execution Analysis: (:1) 2024-12-18T00:21:05.0359319Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0359533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0359538Z 2024-12-18T00:21:05.0359734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0359839Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0360052Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0360164Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0360353Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0360498Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0360632Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0360795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0361348Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0361884Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0362227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0362551Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0362848Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0363101Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0363401Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0363648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0363752Z Execution Analysis: .......... 2024-12-18T00:21:05.0364044Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0364230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0364500Z pt-xla-profiler: TransferFromDeviceTime too frequent: 919 counts during 876 steps 2024-12-18T00:21:05.0364504Z 2024-12-18T00:21:05.0364686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0364798Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0365065Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0365178Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0365366Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0365497Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0365637Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0365790Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0366134Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0366456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0366757Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0367010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0367293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0367578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0367844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0367967Z Execution Analysis: (:1) 2024-12-18T00:21:05.0368228Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0368428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0368433Z 2024-12-18T00:21:05.0368616Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0368726Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0368938Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0369038Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0369240Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0369371Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0369516Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0369667Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0370230Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0370929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0371275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0371627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0371930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0372211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0372676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0372953Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0373087Z Execution Analysis: .......... 2024-12-18T00:21:05.0373393Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0373594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0373879Z pt-xla-profiler: TransferFromDeviceTime too frequent: 920 counts during 877 steps 2024-12-18T00:21:05.0373891Z 2024-12-18T00:21:05.0374090Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0374203Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0374504Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0374615Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0374832Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0374977Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0375116Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0375298Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0375654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0376011Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0376325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0376682Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0377020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0377296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0377584Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0377711Z Execution Analysis: (:1) 2024-12-18T00:21:05.0378003Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0378205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0378210Z 2024-12-18T00:21:05.0378417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0378529Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0378771Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0378879Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0379086Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0379234Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0379379Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0379554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0380148Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0380727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0381088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0381450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0381761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0382034Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0382351Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0382675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0382795Z Execution Analysis: .......... 2024-12-18T00:21:05.0383050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0383254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0383537Z pt-xla-profiler: TransferFromDeviceTime too frequent: 921 counts during 878 steps 2024-12-18T00:21:05.0383541Z 2024-12-18T00:21:05.0383748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0383863Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0384151Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0384268Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0384474Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0384623Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0384763Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0384936Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0385290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0385639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0385955Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0386229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0386569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0386836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0387140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0387289Z Execution Analysis: (:1) 2024-12-18T00:21:05.0387548Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0387757Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0387762Z 2024-12-18T00:21:05.0387961Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0388079Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0388309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0388429Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0388739Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0388877Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0389013Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0389170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0389723Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0390254Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0390588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0390911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0391209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0391461Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0391781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0392057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0392159Z Execution Analysis: .......... 2024-12-18T00:21:05.0392396Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0392580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0392848Z pt-xla-profiler: TransferFromDeviceTime too frequent: 922 counts during 879 steps 2024-12-18T00:21:05.0392853Z 2024-12-18T00:21:05.0393038Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0393146Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0393414Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0393515Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0393708Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0393839Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0393975Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0394127Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0394459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0394779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0395070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0395351Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0395635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0395886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0396181Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0396300Z Execution Analysis: (:1) 2024-12-18T00:21:05.0396533Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0396722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0396726Z 2024-12-18T00:21:05.0396908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0397014Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0397229Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0397329Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0397524Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0397655Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0397797Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0397950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0398495Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0399027Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0399357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0399685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0399975Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0400259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0400567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0400822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0400918Z Execution Analysis: .......... 2024-12-18T00:21:05.0401155Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0401344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0401605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 923 counts during 880 steps 2024-12-18T00:21:05.0401612Z 2024-12-18T00:21:05.0401800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0401903Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0402179Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0402283Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0402470Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0402607Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0402738Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0402893Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0403224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0403554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0403868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0404122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0404415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0404688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0404966Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0405084Z Execution Analysis: (:1) 2024-12-18T00:21:05.0405324Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0405511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0405515Z 2024-12-18T00:21:05.0405876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0405986Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0406209Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0406321Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0406522Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0406668Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0406809Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0406973Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0407550Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0408104Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0408463Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0408805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0409157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0409450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0409760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0410020Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0410130Z Execution Analysis: .......... 2024-12-18T00:21:05.0410379Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0410575Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0410857Z pt-xla-profiler: TransferFromDeviceTime too frequent: 924 counts during 881 steps 2024-12-18T00:21:05.0410861Z 2024-12-18T00:21:05.0411057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0411177Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0411464Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0411572Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0411770Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0411919Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0412057Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0412217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0412573Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0412939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0413245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0413513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0413846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0414106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0414387Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0414508Z Execution Analysis: (:1) 2024-12-18T00:21:05.0414756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0414958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0414964Z 2024-12-18T00:21:05.0415158Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0415272Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0415495Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0415606Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0415815Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0415952Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0416098Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0416264Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0417084Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0417661Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0418025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0418372Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0418744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0419022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0419330Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0419599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0419705Z Execution Analysis: .......... 2024-12-18T00:21:05.0419970Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0420170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0420460Z pt-xla-profiler: TransferFromDeviceTime too frequent: 925 counts during 882 steps 2024-12-18T00:21:05.0420465Z 2024-12-18T00:21:05.0420666Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0420783Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0421080Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0421191Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0421401Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0421543Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0421689Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0421855Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0422213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0422592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0422900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0426657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0427003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0427273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0427573Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0427695Z Execution Analysis: (:1) 2024-12-18T00:21:05.0427961Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0428165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0428172Z 2024-12-18T00:21:05.0428382Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0428494Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0428732Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0428840Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0429048Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0429196Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0429340Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0429510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0430111Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0430802Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0431152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0431554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0431858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0432122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0432429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0432687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0432796Z Execution Analysis: .......... 2024-12-18T00:21:05.0433045Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0433248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0433524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 927 counts during 883 steps 2024-12-18T00:21:05.0433532Z 2024-12-18T00:21:05.0433730Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0433846Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0434129Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0434241Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0434536Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0434671Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0434803Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0434987Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0435320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0435644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0435963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0436211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0436498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0436744Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0437020Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0437132Z Execution Analysis: (:1) 2024-12-18T00:21:05.0437365Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0437557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0437561Z 2024-12-18T00:21:05.0437745Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0437857Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0438064Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0438169Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0438357Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0438486Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0438624Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0438775Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0439330Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0439860Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0440221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0440567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0440861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0441112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0441394Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0441642Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0441738Z Execution Analysis: .......... 2024-12-18T00:21:05.0441981Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0442163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0442431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 928 counts during 884 steps 2024-12-18T00:21:05.0442437Z 2024-12-18T00:21:05.0442622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0442727Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0442994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0443093Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0443283Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0443412Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0443571Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0443724Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0444055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0444700Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0445085Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0445364Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0445669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0445939Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0446225Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0446356Z Execution Analysis: (:1) 2024-12-18T00:21:05.0446611Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0446810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0446823Z 2024-12-18T00:21:05.0447024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0447137Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0447369Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0447474Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0447687Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0447828Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0447971Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0448141Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0448734Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0449313Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0449809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0450170Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0450480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0450759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0451066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0451335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0451446Z Execution Analysis: .......... 2024-12-18T00:21:05.0451701Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0451909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0452195Z pt-xla-profiler: TransferFromDeviceTime too frequent: 929 counts during 885 steps 2024-12-18T00:21:05.0452200Z 2024-12-18T00:21:05.0452408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0452518Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0452813Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0452919Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0453119Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0453304Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0453442Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0453611Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0453966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0454347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0454655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0454926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0455235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0455499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0455794Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0455919Z Execution Analysis: (:1) 2024-12-18T00:21:05.0456181Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0456467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0456476Z 2024-12-18T00:21:05.0456682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0456791Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0457018Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0457131Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0457335Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0457483Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0457628Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0457801Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0458393Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0459021Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0459387Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0459736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0460055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0460325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0460637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0460904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0461013Z Execution Analysis: .......... 2024-12-18T00:21:05.0461267Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0461472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0461758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 930 counts during 886 steps 2024-12-18T00:21:05.0461763Z 2024-12-18T00:21:05.0461963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0462080Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0462368Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0462482Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0462708Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0462847Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0462990Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0463156Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0463540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0463885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0464199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0464470Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0464776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0465047Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0465335Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0465465Z Execution Analysis: (:1) 2024-12-18T00:21:05.0465717Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0465928Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0465933Z 2024-12-18T00:21:05.0466129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0466244Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0466471Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0466576Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0466786Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0466925Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0467074Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0467236Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0467834Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0468460Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0468822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0469250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0469534Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0469789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0470074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0470323Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0470420Z Execution Analysis: .......... 2024-12-18T00:21:05.0470659Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0470844Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0471103Z pt-xla-profiler: TransferFromDeviceTime too frequent: 931 counts during 887 steps 2024-12-18T00:21:05.0471112Z 2024-12-18T00:21:05.0471294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0471395Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0471662Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0471785Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0471975Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0472105Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0472235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0472418Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0472745Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0473073Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0473361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0473614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0473893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0474146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0474411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0474525Z Execution Analysis: (:1) 2024-12-18T00:21:05.0474769Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0474952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0474957Z 2024-12-18T00:21:05.0475143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0475245Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0475461Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0475560Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0475749Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0475887Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0476020Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0476176Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0476775Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0477312Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0477639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0477966Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0478252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0478503Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0478789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0479034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0479136Z Execution Analysis: .......... 2024-12-18T00:21:05.0479370Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0479558Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0479818Z pt-xla-profiler: TransferFromDeviceTime too frequent: 932 counts during 888 steps 2024-12-18T00:21:05.0479823Z 2024-12-18T00:21:05.0480017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0480119Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0480422Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0480528Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0480712Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0480850Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0481000Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0481159Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0481483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0481803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0482093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0482343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0482631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0482874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0483147Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0483262Z Execution Analysis: (:1) 2024-12-18T00:21:05.0483496Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0483685Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0483689Z 2024-12-18T00:21:05.0483870Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0483978Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0484186Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0484290Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0484478Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0484612Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0484743Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0484917Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0485492Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0486022Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0486354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0486676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0486966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0487214Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0487496Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0487751Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0487846Z Execution Analysis: .......... 2024-12-18T00:21:05.0488086Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0488272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0488539Z pt-xla-profiler: TransferFromDeviceTime too frequent: 933 counts during 889 steps 2024-12-18T00:21:05.0488543Z 2024-12-18T00:21:05.0488727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0488860Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0489124Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0489223Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0489418Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0489573Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0489709Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0489862Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0490196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0490517Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0490798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0491053Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0491336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0491585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0491858Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0491978Z Execution Analysis: (:1) 2024-12-18T00:21:05.0492214Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0492404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0492408Z 2024-12-18T00:21:05.0492591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0492693Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0492914Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0493013Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0493208Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0493337Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0493502Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0493677Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0494222Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0494755Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0495084Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0495417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0495705Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0495967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0496254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0496581Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0496679Z Execution Analysis: .......... 2024-12-18T00:21:05.0497089Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0497297Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0497578Z pt-xla-profiler: TransferFromDeviceTime too frequent: 934 counts during 890 steps 2024-12-18T00:21:05.0497613Z 2024-12-18T00:21:05.0497820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0497929Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0498223Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0498332Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0498560Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0498709Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0498845Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0499016Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0499368Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0499723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0500032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0500311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0500615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0500884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0501178Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0501300Z Execution Analysis: (:1) 2024-12-18T00:21:05.0501561Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0501762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0501767Z 2024-12-18T00:21:05.0501971Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0502081Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0502308Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0502419Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0502622Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0502798Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0502966Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0503136Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0503729Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0504297Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0504655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0505002Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0505317Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0505591Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0505901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0506164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0506270Z Execution Analysis: .......... 2024-12-18T00:21:05.0506523Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0506722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0507037Z pt-xla-profiler: TransferFromDeviceTime too frequent: 935 counts during 891 steps 2024-12-18T00:21:05.0507041Z 2024-12-18T00:21:05.0507239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0507353Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0507642Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0507781Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0507983Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0508127Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0508265Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0508431Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0508789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0509230Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0509520Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0509773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0510061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0510308Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0510572Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0510687Z Execution Analysis: (:1) 2024-12-18T00:21:05.0510922Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0511110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0511114Z 2024-12-18T00:21:05.0511299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0511405Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0511615Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0511744Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0511976Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0512107Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0512252Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0512407Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0512959Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0513658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0514011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0514349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0514651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0514928Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0515230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0515494Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0515595Z Execution Analysis: .......... 2024-12-18T00:21:05.0515851Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0516047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0516355Z pt-xla-profiler: TransferFromDeviceTime too frequent: 936 counts during 892 steps 2024-12-18T00:21:05.0516360Z 2024-12-18T00:21:05.0516554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0516665Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0516980Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0517086Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0517289Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0517428Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0517571Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0517732Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0518079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0518426Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0518727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0519000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0519301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0519564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0519846Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0519963Z Execution Analysis: (:1) 2024-12-18T00:21:05.0520385Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0520585Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0520591Z 2024-12-18T00:21:05.0520795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0520907Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0521167Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0521301Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0521514Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0521655Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0521798Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0521968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0522556Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0523131Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0523492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0523846Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0524157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0524433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0524736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0524999Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0525108Z Execution Analysis: .......... 2024-12-18T00:21:05.0525362Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0525593Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0525876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 937 counts during 893 steps 2024-12-18T00:21:05.0525883Z 2024-12-18T00:21:05.0526111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0526224Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0526512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0526623Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0526824Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0526973Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0527112Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0527282Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0527639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0527987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0528302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0528576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0528888Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0529153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0529449Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0529571Z Execution Analysis: (:1) 2024-12-18T00:21:05.0529828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0530030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0530035Z 2024-12-18T00:21:05.0530230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0530374Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0530630Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0530742Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0530947Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0531092Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0531235Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0531400Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0532099Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0532658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0533011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0533355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0533656Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0533924Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0534227Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0534487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0534587Z Execution Analysis: .......... 2024-12-18T00:21:05.0534868Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0535066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0535350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 938 counts during 894 steps 2024-12-18T00:21:05.0535356Z 2024-12-18T00:21:05.0535577Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0535692Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0535972Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0536082Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0536282Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0536512Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0536658Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0536984Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0537346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0537698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0538022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0538293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0538597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0538872Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0539164Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0539294Z Execution Analysis: (:1) 2024-12-18T00:21:05.0539552Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0539759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0539763Z 2024-12-18T00:21:05.0539993Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0540128Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0540364Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0540473Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0540684Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0540827Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0540980Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0541146Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0541741Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0542323Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0542686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0543044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0543358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0543633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0543940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0544363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0544525Z Execution Analysis: .......... 2024-12-18T00:21:05.0544779Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0544985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0545306Z pt-xla-profiler: TransferFromDeviceTime too frequent: 939 counts during 895 steps 2024-12-18T00:21:05.0545311Z 2024-12-18T00:21:05.0545522Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0545636Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0545931Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0546037Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0546244Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0546384Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0546525Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0546694Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0547048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0547409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0547718Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0547991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0548296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0548564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0548859Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0548983Z Execution Analysis: (:1) 2024-12-18T00:21:05.0549248Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0549448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0549496Z 2024-12-18T00:21:05.0549735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0549846Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0550077Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0550184Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0550391Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0550540Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0550684Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0550857Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0551449Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0552026Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0552389Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0552737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0553055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0553328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0553642Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0553939Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0554052Z Execution Analysis: .......... 2024-12-18T00:21:05.0554305Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0554541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0554823Z pt-xla-profiler: TransferFromDeviceTime too frequent: 940 counts during 896 steps 2024-12-18T00:21:05.0554828Z 2024-12-18T00:21:05.0555031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0555145Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0555437Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0555548Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0555855Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0555999Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0556134Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0556397Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0556731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0557055Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0557344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0557595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0557882Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0558130Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0558398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0558519Z Execution Analysis: (:1) 2024-12-18T00:21:05.0558754Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0559168Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0559173Z 2024-12-18T00:21:05.0559357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0559467Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0559682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0559788Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0559978Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0560108Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0560250Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0560405Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0560957Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0561492Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0561828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0562152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0562442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0562695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0563004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0563258Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0563355Z Execution Analysis: .......... 2024-12-18T00:21:05.0563599Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0563808Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0564075Z pt-xla-profiler: TransferFromDeviceTime too frequent: 941 counts during 897 steps 2024-12-18T00:21:05.0564079Z 2024-12-18T00:21:05.0564264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0564372Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0564645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0564748Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0564938Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0565070Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0565205Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0565361Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0565692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0566021Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0566305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0566565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0566848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0567099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0567365Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0567485Z Execution Analysis: (:1) 2024-12-18T00:21:05.0567751Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0567961Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0567965Z 2024-12-18T00:21:05.0568153Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0568255Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0568470Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0568569Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0568761Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0568890Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0569021Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0569179Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0569724Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0570262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0570591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0570918Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0571203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0571482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0571764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0572010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0572113Z Execution Analysis: .......... 2024-12-18T00:21:05.0572374Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0572564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0572825Z pt-xla-profiler: TransferFromDeviceTime too frequent: 942 counts during 898 steps 2024-12-18T00:21:05.0572830Z 2024-12-18T00:21:05.0573018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0573122Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0573389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0573489Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0573675Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0573811Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0573943Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0574105Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0574436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0574762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0575045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0575292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0575580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0575826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0576099Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0576238Z Execution Analysis: (:1) 2024-12-18T00:21:05.0576587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0576939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0576943Z 2024-12-18T00:21:05.0577147Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0577260Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0577486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0577599Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0577809Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0577955Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0578101Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0578266Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0578873Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0579447Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0579811Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0580158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0580475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0580775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0581088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0581357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0581514Z Execution Analysis: .......... 2024-12-18T00:21:05.0581778Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0581981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0582272Z pt-xla-profiler: TransferFromDeviceTime too frequent: 943 counts during 899 steps 2024-12-18T00:21:05.0582277Z 2024-12-18T00:21:05.0582477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0582599Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0582889Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0583005Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0583211Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0583355Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0583507Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0583672Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0584033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0584386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0584700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0584971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0585278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0585552Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0585868Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0586023Z Execution Analysis: (:1) 2024-12-18T00:21:05.0586281Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0586487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0586492Z 2024-12-18T00:21:05.0586690Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0586805Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0587034Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0587143Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0587356Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0587497Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0587650Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0587817Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0588416Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0589096Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0589423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0589754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0590067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0590324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0590608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0590955Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0591053Z Execution Analysis: .......... 2024-12-18T00:21:05.0591294Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0591478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0591739Z pt-xla-profiler: TransferFromDeviceTime too frequent: 944 counts during 900 steps 2024-12-18T00:21:05.0591743Z 2024-12-18T00:21:05.0591933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0592040Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0592316Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0592420Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0592610Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0592746Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0592875Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0593031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0593358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0593683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0593970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0594228Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0594510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0594776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0595074Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0595187Z Execution Analysis: (:1) 2024-12-18T00:21:05.0595428Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0595616Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0595620Z 2024-12-18T00:21:05.0595807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0595907Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0596123Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0596222Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0596410Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0596545Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0596680Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0596837Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0597385Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0597916Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0598245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0598599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0598884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0599135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0599447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0599696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0599796Z Execution Analysis: .......... 2024-12-18T00:21:05.0600031Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0600223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0600485Z pt-xla-profiler: TransferFromDeviceTime too frequent: 945 counts during 901 steps 2024-12-18T00:21:05.0600491Z 2024-12-18T00:21:05.0600674Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0600785Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0601054Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0601164Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0601354Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0601495Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0601625Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0601779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0602119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0602441Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0602737Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0602992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0603284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0603582Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0603859Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0603974Z Execution Analysis: (:1) 2024-12-18T00:21:05.0604213Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0604408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0604412Z 2024-12-18T00:21:05.0604598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0604712Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0604925Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0605037Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0605231Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0605367Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0605508Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0605664Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0606216Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0606746Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0607107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0607431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0607726Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0608004Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0608291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0608546Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0608642Z Execution Analysis: .......... 2024-12-18T00:21:05.0608886Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0609072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0609343Z pt-xla-profiler: TransferFromDeviceTime too frequent: 946 counts during 902 steps 2024-12-18T00:21:05.0609347Z 2024-12-18T00:21:05.0609533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0609646Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0609916Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0610018Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0610211Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0610342Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0610479Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0610632Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0610967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0611287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0611574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0611827Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0612160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0612414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0612680Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0612799Z Execution Analysis: (:1) 2024-12-18T00:21:05.0613036Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0613222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0613233Z 2024-12-18T00:21:05.0613418Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0613524Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0613735Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0613835Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0614035Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0614169Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0614303Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0614464Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0615011Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0615545Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0615915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0616248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0616644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0617080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0617386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0617655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0617766Z Execution Analysis: .......... 2024-12-18T00:21:05.0618021Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0618235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0618524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 948 counts during 903 steps 2024-12-18T00:21:05.0618529Z 2024-12-18T00:21:05.0618738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0618856Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0619154Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0619263Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0619468Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0619616Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0619756Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0619929Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0620283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0620639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0620947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0621248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0621585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0621854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0622152Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0622273Z Execution Analysis: (:1) 2024-12-18T00:21:05.0622538Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0622740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0622747Z 2024-12-18T00:21:05.0622957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0623069Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0623298Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0623415Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0623623Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0623776Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0623926Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0624101Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0624694Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0625295Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0625656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0626009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0626352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0626629Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0626943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0627208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0627320Z Execution Analysis: .......... 2024-12-18T00:21:05.0627578Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0627782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0628071Z pt-xla-profiler: TransferFromDeviceTime too frequent: 949 counts during 904 steps 2024-12-18T00:21:05.0628077Z 2024-12-18T00:21:05.0628281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0628401Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0628692Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0628810Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0629014Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0629154Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0629409Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0629573Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0629928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0630266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0630606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0630896Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0631207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0631464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0631748Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0631878Z Execution Analysis: (:1) 2024-12-18T00:21:05.0632129Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0632335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0632339Z 2024-12-18T00:21:05.0632533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0632652Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0632879Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0632988Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0633192Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0633332Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0633477Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0633638Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0634223Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0634806Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0635163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0635533Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0635836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0636269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0636576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0636850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0636959Z Execution Analysis: .......... 2024-12-18T00:21:05.0637219Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0637418Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0637706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 950 counts during 905 steps 2024-12-18T00:21:05.0637719Z 2024-12-18T00:21:05.0637921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0638034Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0638328Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0638439Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0638652Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0638795Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0638934Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0639104Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0639464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0639823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0640186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0640467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0640771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0641040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0641331Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0641454Z Execution Analysis: (:1) 2024-12-18T00:21:05.0641715Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0641915Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0641921Z 2024-12-18T00:21:05.0642133Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0642245Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0642481Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0642590Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0642796Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0642943Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0643091Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0643260Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0643878Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0644615Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0645036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0645393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0645706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0645983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0646300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0646569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0646683Z Execution Analysis: .......... 2024-12-18T00:21:05.0646944Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0647156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0647445Z pt-xla-profiler: TransferFromDeviceTime too frequent: 951 counts during 906 steps 2024-12-18T00:21:05.0647450Z 2024-12-18T00:21:05.0647657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0647769Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0648059Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0648177Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0648385Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0648538Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0648680Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0648857Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0649214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0649647Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0649964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0650239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0650552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0650820Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0651120Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0651247Z Execution Analysis: (:1) 2024-12-18T00:21:05.0651505Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0651712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0651718Z 2024-12-18T00:21:05.0651925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0652047Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0652277Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0652394Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0652602Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0652750Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0652895Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0653100Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0653698Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0654302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0654669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0655018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0655334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0655605Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0655920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0656186Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0656289Z Execution Analysis: .......... 2024-12-18T00:21:05.0656634Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0656841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0657129Z pt-xla-profiler: TransferFromDeviceTime too frequent: 952 counts during 907 steps 2024-12-18T00:21:05.0657134Z 2024-12-18T00:21:05.0657335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0657454Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0657740Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0657851Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0658060Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0658199Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0658343Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0658511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0658930Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0659281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0659593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0659871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0660177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0660449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0660744Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0660871Z Execution Analysis: (:1) 2024-12-18T00:21:05.0661126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0661338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0661342Z 2024-12-18T00:21:05.0661540Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0661650Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0661884Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0661993Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0662201Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0662341Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0662519Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0662685Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0663279Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0663887Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0664244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0664599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0664907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0665186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0665494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0665767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0665871Z Execution Analysis: .......... 2024-12-18T00:21:05.0666133Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0666341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0666625Z pt-xla-profiler: TransferFromDeviceTime too frequent: 953 counts during 908 steps 2024-12-18T00:21:05.0666630Z 2024-12-18T00:21:05.0666838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0666950Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0667248Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0667358Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0667561Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0667713Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0667853Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0668055Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0668444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0668802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0669204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0669463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0669747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0669998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0670271Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0670386Z Execution Analysis: (:1) 2024-12-18T00:21:05.0670632Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0670821Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0670825Z 2024-12-18T00:21:05.0671019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0671123Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0671335Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0671443Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0671634Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0671798Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0671934Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0672096Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0672669Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0673205Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0673541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0673866Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0674157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0674413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0674702Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0674949Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0675050Z Execution Analysis: .......... 2024-12-18T00:21:05.0675291Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0675476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0675743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 954 counts during 909 steps 2024-12-18T00:21:05.0675747Z 2024-12-18T00:21:05.0675933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0676043Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0676315Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0676424Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0676613Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0676780Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0676909Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0677092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0677426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0677749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0678041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0678291Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0678583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0678830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0679102Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0679226Z Execution Analysis: (:1) 2024-12-18T00:21:05.0679465Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0679657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0679662Z 2024-12-18T00:21:05.0679845Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0679958Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0680169Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0680270Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0680491Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0680624Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0680762Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0680918Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0681493Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0682024Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0682366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0682688Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0682978Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0683233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0683520Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0683781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0683878Z Execution Analysis: .......... 2024-12-18T00:21:05.0684124Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0684310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0684580Z pt-xla-profiler: TransferFromDeviceTime too frequent: 955 counts during 910 steps 2024-12-18T00:21:05.0684584Z 2024-12-18T00:21:05.0684769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0684877Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0685151Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0685253Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0685487Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0685644Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0685784Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0685936Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0686267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0686591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0686878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0687137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0687422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0687681Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0687951Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0688071Z Execution Analysis: (:1) 2024-12-18T00:21:05.0688318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0688506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0688509Z 2024-12-18T00:21:05.0688704Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0688808Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0689029Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0689154Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0689358Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0689491Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0689630Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0689816Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0690366Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0690906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0691237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0691568Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0691857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0692128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0692417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0692668Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0692774Z Execution Analysis: .......... 2024-12-18T00:21:05.0693012Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0693209Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0693473Z pt-xla-profiler: TransferFromDeviceTime too frequent: 956 counts during 911 steps 2024-12-18T00:21:05.0693477Z 2024-12-18T00:21:05.0693679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0693784Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0694057Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0694196Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0694407Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0694551Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0694684Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0694851Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0695181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0695508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0695802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0696056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0696423Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0696676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0697140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0697270Z Execution Analysis: (:1) 2024-12-18T00:21:05.0697537Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0697737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0697741Z 2024-12-18T00:21:05.0697942Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0698097Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0698326Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0698445Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0698649Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0698804Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0698976Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0699146Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0699744Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0700317Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0700680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0701032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0701351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0701628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0701948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0702212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0702317Z Execution Analysis: .......... 2024-12-18T00:21:05.0702583Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0702783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0703074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 957 counts during 912 steps 2024-12-18T00:21:05.0703081Z 2024-12-18T00:21:05.0703280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0703403Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0703723Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0703858Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0704078Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0704221Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0704370Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0704537Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0704904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0705258Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0705580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0705852Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0706163Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0706443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0706734Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0706866Z Execution Analysis: (:1) 2024-12-18T00:21:05.0707121Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0707334Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0707339Z 2024-12-18T00:21:05.0707536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0707675Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0707915Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0708024Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0708244Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0708418Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0708577Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0708744Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0709415Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0709955Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0710288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0710621Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0710913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0711175Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0711460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0711719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0711817Z Execution Analysis: .......... 2024-12-18T00:21:05.0712057Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0712253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0712516Z pt-xla-profiler: TransferFromDeviceTime too frequent: 958 counts during 913 steps 2024-12-18T00:21:05.0712520Z 2024-12-18T00:21:05.0712713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0712840Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0713147Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0713247Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0713448Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0713581Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0713713Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0713873Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0714206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0714541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0714825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0715089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0715378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0715626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0715905Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0716022Z Execution Analysis: (:1) 2024-12-18T00:21:05.0716264Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0716450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0716479Z 2024-12-18T00:21:05.0716671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0716776Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0717003Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0717105Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0717334Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0717476Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0717781Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0717952Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0718524Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0719095Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0719448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0719788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0720104Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0720370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0720678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0720942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0721059Z Execution Analysis: .......... 2024-12-18T00:21:05.0721309Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0721518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0721792Z pt-xla-profiler: TransferFromDeviceTime too frequent: 959 counts during 914 steps 2024-12-18T00:21:05.0721797Z 2024-12-18T00:21:05.0722021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0722164Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0722445Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0722562Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0722760Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0722911Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0723050Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0723212Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0723570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0723915Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0724230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0724500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0724814Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0725078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0725361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0725492Z Execution Analysis: (:1) 2024-12-18T00:21:05.0725742Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0725991Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0725996Z 2024-12-18T00:21:05.0726194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0726317Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0726566Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0726687Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0726886Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0727027Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0727175Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0727336Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0727915Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0728475Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0728836Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0729183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0729497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0729857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0730143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0730402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0730501Z Execution Analysis: .......... 2024-12-18T00:21:05.0730749Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0730938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0731214Z pt-xla-profiler: TransferFromDeviceTime too frequent: 960 counts during 915 steps 2024-12-18T00:21:05.0731242Z 2024-12-18T00:21:05.0731452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0731561Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0731836Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0731938Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0732137Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0732271Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0732414Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0732572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0732905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0733238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0733531Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0733795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0734083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0734340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0734779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0734910Z Execution Analysis: (:1) 2024-12-18T00:21:05.0735158Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0735453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0735457Z 2024-12-18T00:21:05.0735660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0735799Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0736032Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0736139Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0736423Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0736567Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0736710Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0737050Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0737650Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0738235Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0738600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0738966Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0739279Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0739562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0739867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0740131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0740247Z Execution Analysis: .......... 2024-12-18T00:21:05.0740504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0740712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0741028Z pt-xla-profiler: TransferFromDeviceTime too frequent: 961 counts during 916 steps 2024-12-18T00:21:05.0741056Z 2024-12-18T00:21:05.0741274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0741389Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0741691Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0741800Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0742006Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0742164Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0742305Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0742476Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0742832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0743195Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0743507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0743780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0744095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0744523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0744825Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0745001Z Execution Analysis: (:1) 2024-12-18T00:21:05.0745272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0745474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0745481Z 2024-12-18T00:21:05.0745733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0745847Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0746075Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0746196Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0746403Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0746557Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0746701Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0746870Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0747477Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0748052Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0748428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0748781Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0749104Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0749378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0749700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0749973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0750078Z Execution Analysis: .......... 2024-12-18T00:21:05.0750346Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0750583Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0750902Z pt-xla-profiler: TransferFromDeviceTime too frequent: 962 counts during 917 steps 2024-12-18T00:21:05.0750907Z 2024-12-18T00:21:05.0751110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0751235Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0751526Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0751651Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0751856Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0752002Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0752152Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0752319Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0752683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0753038Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0753361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0753634Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0753943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0754215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0754507Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0754685Z Execution Analysis: (:1) 2024-12-18T00:21:05.0754940Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0755157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0755187Z 2024-12-18T00:21:05.0755388Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0755513Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0755740Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0755853Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0756176Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0756321Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0756476Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0756640Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0757328Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0757863Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0758199Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0758527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0758814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0759081Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0759366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0759628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0759724Z Execution Analysis: .......... 2024-12-18T00:21:05.0759971Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0760211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0760480Z pt-xla-profiler: TransferFromDeviceTime too frequent: 963 counts during 918 steps 2024-12-18T00:21:05.0760485Z 2024-12-18T00:21:05.0760681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0760788Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0761069Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0761170Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0761373Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0761505Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0761638Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0761806Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0762141Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0762482Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0762769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0763033Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0763317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0763566Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0763872Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0763988Z Execution Analysis: (:1) 2024-12-18T00:21:05.0764237Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0764453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0764457Z 2024-12-18T00:21:05.0764655Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0764759Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0764977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0765080Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0765272Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0765412Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0765550Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0765711Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0766254Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0766801Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0767132Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0767468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0767757Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0768011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0768304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0768548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0768685Z Execution Analysis: .......... 2024-12-18T00:21:05.0768947Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0769145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0769406Z pt-xla-profiler: TransferFromDeviceTime too frequent: 964 counts during 919 steps 2024-12-18T00:21:05.0769410Z 2024-12-18T00:21:05.0769597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0769715Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0769984Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0770100Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0770288Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0770434Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0770565Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0770723Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0771063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0771388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0771680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0771936Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0772230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0772504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0772783Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0772899Z Execution Analysis: (:1) 2024-12-18T00:21:05.0773165Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0773366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0773370Z 2024-12-18T00:21:05.0773555Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0773668Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0773884Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0773997Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0774188Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0774325Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0774474Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0774629Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0775185Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0775715Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0776052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0776445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0776744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0777178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0777487Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0777794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0777929Z Execution Analysis: .......... 2024-12-18T00:21:05.0778197Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0778397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0778690Z pt-xla-profiler: TransferFromDeviceTime too frequent: 965 counts during 920 steps 2024-12-18T00:21:05.0778694Z 2024-12-18T00:21:05.0778895Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0779017Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0779309Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0779418Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0779631Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0779772Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0779925Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0780091Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0780459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0780806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0781116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0781403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0781738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0782012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0782303Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0782463Z Execution Analysis: (:1) 2024-12-18T00:21:05.0782722Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0782925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0782939Z 2024-12-18T00:21:05.0783138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0783249Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0783487Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0783597Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0783812Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0783951Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0784099Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0784271Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0784863Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0785447Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0785804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0786160Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0786471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0786753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0787061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0787504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0787616Z Execution Analysis: .......... 2024-12-18T00:21:05.0787873Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0788083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0788364Z pt-xla-profiler: TransferFromDeviceTime too frequent: 966 counts during 921 steps 2024-12-18T00:21:05.0788369Z 2024-12-18T00:21:05.0788577Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0788689Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0789093Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0789191Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0789381Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0789521Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0789649Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0789807Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0790133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0790464Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0790747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0791028Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0791314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0791558Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0791862Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0791978Z Execution Analysis: (:1) 2024-12-18T00:21:05.0792220Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0792404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0792408Z 2024-12-18T00:21:05.0792600Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0792702Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0792916Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0793020Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0793210Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0793346Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0793481Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0793643Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0794189Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0794718Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0795056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0795381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0795675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0795924Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0796264Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0796513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0796620Z Execution Analysis: .......... 2024-12-18T00:21:05.0796854Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0797040Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0797308Z pt-xla-profiler: TransferFromDeviceTime too frequent: 967 counts during 922 steps 2024-12-18T00:21:05.0797314Z 2024-12-18T00:21:05.0797499Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0797610Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0797879Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0797990Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0798183Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0798317Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0798456Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0798610Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0798947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0799269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0799564Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0799844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0800127Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0800407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0800680Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0800800Z Execution Analysis: (:1) 2024-12-18T00:21:05.0801039Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0801228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0801232Z 2024-12-18T00:21:05.0801417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0801530Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0801744Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0801845Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0802043Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0802174Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0802317Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0802471Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0803021Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0803547Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0803887Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0804209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0804493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0804777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0805086Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0805343Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0805440Z Execution Analysis: .......... 2024-12-18T00:21:05.0805682Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0805865Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0806132Z pt-xla-profiler: TransferFromDeviceTime too frequent: 969 counts during 923 steps 2024-12-18T00:21:05.0806144Z 2024-12-18T00:21:05.0806327Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0806435Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0806712Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0806817Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0807011Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0807143Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0807273Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0807431Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0807760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0808092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0808402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0808661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0808945Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0809222Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0809491Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0809606Z Execution Analysis: (:1) 2024-12-18T00:21:05.0809852Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0810037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0810041Z 2024-12-18T00:21:05.0810233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0810335Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0810550Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0810649Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0810845Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0810981Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0811117Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0811280Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0811822Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0812360Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0812693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0813021Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0813332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0813612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0813907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0814156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0814259Z Execution Analysis: .......... 2024-12-18T00:21:05.0814494Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0814685Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0814947Z pt-xla-profiler: TransferFromDeviceTime too frequent: 970 counts during 924 steps 2024-12-18T00:21:05.0814951Z 2024-12-18T00:21:05.0815138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0818616Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0818932Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0819046Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0819251Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0819398Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0819543Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0819709Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0820080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0820499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0820816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0821091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0821439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0821707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0822001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0822125Z Execution Analysis: (:1) 2024-12-18T00:21:05.0822384Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0822592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0822601Z 2024-12-18T00:21:05.0822800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0822915Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0823147Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0823265Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0823476Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0823619Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0823768Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0823936Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0824540Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0825121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0825487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0825880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0826224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0826500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0826808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0827080Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0827184Z Execution Analysis: .......... 2024-12-18T00:21:05.0827449Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0827652Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0827940Z pt-xla-profiler: TransferFromDeviceTime too frequent: 971 counts during 925 steps 2024-12-18T00:21:05.0827947Z 2024-12-18T00:21:05.0828149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0828263Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0828556Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0828666Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0828873Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0829117Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0829248Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0829399Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0829753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0830079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0830365Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0830650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0830940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0831191Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0831457Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0831576Z Execution Analysis: (:1) 2024-12-18T00:21:05.0831812Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0831997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0832001Z 2024-12-18T00:21:05.0832190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0832293Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0832511Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0832612Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0832805Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0832934Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0833065Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0833220Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0833770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0834303Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0834630Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0835008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0835296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0835552Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0835833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0836079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0836178Z Execution Analysis: .......... 2024-12-18T00:21:05.0836416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0836605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0836872Z pt-xla-profiler: TransferFromDeviceTime too frequent: 972 counts during 926 steps 2024-12-18T00:21:05.0836877Z 2024-12-18T00:21:05.0837069Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0837173Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0837444Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0837542Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0837728Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0837860Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0837989Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0838172Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0838498Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0838823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0839138Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0839394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0839682Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0839927Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0840198Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0840312Z Execution Analysis: (:1) 2024-12-18T00:21:05.0840555Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0840742Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0840746Z 2024-12-18T00:21:05.0840937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0841044Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0841257Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0841361Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0841553Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0841691Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0841824Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0841977Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0842532Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0843062Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0843446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0843772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0844063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0844629Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0844944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0845214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0845322Z Execution Analysis: .......... 2024-12-18T00:21:05.0845582Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0845783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0846083Z pt-xla-profiler: TransferFromDeviceTime too frequent: 973 counts during 927 steps 2024-12-18T00:21:05.0846088Z 2024-12-18T00:21:05.0846291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0846412Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0846703Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0846814Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0847018Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0847160Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0847371Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0847536Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0847898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0848285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0848602Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0848873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0849182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0849455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0849746Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0849873Z Execution Analysis: (:1) 2024-12-18T00:21:05.0850131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0850336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0850343Z 2024-12-18T00:21:05.0850545Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0850664Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0850894Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0851002Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0851216Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0851361Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0851513Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0851679Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0852276Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0852846Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0853271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0853626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0853932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0854207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0854511Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0854782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0854886Z Execution Analysis: .......... 2024-12-18T00:21:05.0855144Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0855350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0855636Z pt-xla-profiler: TransferFromDeviceTime too frequent: 974 counts during 928 steps 2024-12-18T00:21:05.0855641Z 2024-12-18T00:21:05.0855849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0855959Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0856255Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0856430Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0856640Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0856813Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0856954Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0857125Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0857483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0857877Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0858187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0858463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0858768Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0859035Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0859326Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0859447Z Execution Analysis: (:1) 2024-12-18T00:21:05.0859705Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0859910Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0859915Z 2024-12-18T00:21:05.0860117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0860228Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0860458Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0860564Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0860769Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0860917Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0861066Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0861238Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0861829Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0862461Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0862820Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0863172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0863479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0863752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0864066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0864333Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0864442Z Execution Analysis: .......... 2024-12-18T00:21:05.0864700Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0864907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0865191Z pt-xla-profiler: TransferFromDeviceTime too frequent: 975 counts during 929 steps 2024-12-18T00:21:05.0865196Z 2024-12-18T00:21:05.0865404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0865516Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0865806Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0865944Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0866146Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0866291Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0866433Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0866599Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0866985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0867338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0867650Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0867919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0868230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0868498Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0868792Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0868914Z Execution Analysis: (:1) 2024-12-18T00:21:05.0869171Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0869378Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0869383Z 2024-12-18T00:21:05.0869582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0869699Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0869927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0870043Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0870247Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0870390Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0870539Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0870704Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0871307Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0871938Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0872401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0872740Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0873045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0873311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0873608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0873869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0873970Z Execution Analysis: .......... 2024-12-18T00:21:05.0874225Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0874421Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0874699Z pt-xla-profiler: TransferFromDeviceTime too frequent: 976 counts during 930 steps 2024-12-18T00:21:05.0874704Z 2024-12-18T00:21:05.0874896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0875009Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0875288Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0875418Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0875619Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0875759Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0875904Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0876089Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0876440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0876776Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0877075Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0877342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0877637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0877902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0878181Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0878305Z Execution Analysis: (:1) 2024-12-18T00:21:05.0878557Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0878750Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0878760Z 2024-12-18T00:21:05.0878952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0879058Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0879283Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0879389Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0879595Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0879733Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0879873Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0880037Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0880729Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0881294Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0881645Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0881991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0882298Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0882575Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0882871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0883137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0883241Z Execution Analysis: .......... 2024-12-18T00:21:05.0883492Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0883692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0883967Z pt-xla-profiler: TransferFromDeviceTime too frequent: 977 counts during 931 steps 2024-12-18T00:21:05.0883972Z 2024-12-18T00:21:05.0884169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0884303Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0884586Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0884691Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0884890Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0885035Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0885198Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0885367Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0885711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0886055Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0886357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0886619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0886923Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0887184Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0887471Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0887594Z Execution Analysis: (:1) 2024-12-18T00:21:05.0887851Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0888047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0888052Z 2024-12-18T00:21:05.0888248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0888355Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0888577Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0888692Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0888892Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0889034Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0889197Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0889364Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0889963Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0890522Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0890874Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0891214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0891525Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0891789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0892092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0892353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0892457Z Execution Analysis: .......... 2024-12-18T00:21:05.0892703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0892898Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0893178Z pt-xla-profiler: TransferFromDeviceTime too frequent: 978 counts during 932 steps 2024-12-18T00:21:05.0893183Z 2024-12-18T00:21:05.0893374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0893523Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0893804Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0893915Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0894112Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0894278Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0894418Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0894579Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0894937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0895276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0895583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0895849Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0896150Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0896487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0896937Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0897062Z Execution Analysis: (:1) 2024-12-18T00:21:05.0897317Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0897522Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0897526Z 2024-12-18T00:21:05.0897728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0897841Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0898071Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0898177Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0898386Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0898555Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0898730Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0898895Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0899489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0900065Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0900425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0900777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0901086Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0901363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0901671Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0901942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0902043Z Execution Analysis: .......... 2024-12-18T00:21:05.0902301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0902501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0902782Z pt-xla-profiler: TransferFromDeviceTime too frequent: 979 counts during 933 steps 2024-12-18T00:21:05.0902817Z 2024-12-18T00:21:05.0903018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0903130Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0903421Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0903528Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0903759Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0903900Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0904040Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0904209Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0904563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0904915Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0905227Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0905502Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0905810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0906088Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0906376Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0906503Z Execution Analysis: (:1) 2024-12-18T00:21:05.0906764Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0906967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0906972Z 2024-12-18T00:21:05.0907176Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0907290Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0907526Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0907634Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0907875Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0908047Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0908195Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0908366Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0908960Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0909633Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0909983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0910332Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0910634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0910906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0911211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0911470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0911579Z Execution Analysis: .......... 2024-12-18T00:21:05.0911828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0912033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0912338Z pt-xla-profiler: TransferFromDeviceTime too frequent: 980 counts during 934 steps 2024-12-18T00:21:05.0912342Z 2024-12-18T00:21:05.0912546Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0912656Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0912964Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0913079Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0913279Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0913426Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0913564Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0913730Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0914079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0914419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0914728Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0914992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0915299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0915556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0915841Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0915966Z Execution Analysis: (:1) 2024-12-18T00:21:05.0916214Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0916415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0916421Z 2024-12-18T00:21:05.0916615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0916729Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0916951Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0917087Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0917314Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0917456Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0917597Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0917756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0918331Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0918886Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0919244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0919581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0919891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0920155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0920460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0920718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0920819Z Execution Analysis: .......... 2024-12-18T00:21:05.0921076Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0921272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0921579Z pt-xla-profiler: TransferFromDeviceTime too frequent: 981 counts during 935 steps 2024-12-18T00:21:05.0921584Z 2024-12-18T00:21:05.0921778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0921918Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0922200Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0922305Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0922505Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0922645Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0922791Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0922950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0923303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0923642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0923945Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0924217Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0924521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0924788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0925070Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0925198Z Execution Analysis: (:1) 2024-12-18T00:21:05.0925445Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0925646Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0925652Z 2024-12-18T00:21:05.0925845Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0925956Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0926209Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0926354Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0926563Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0926701Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0926847Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0927008Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0927585Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0928149Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0928497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0928846Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0929152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0929426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0929726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0929994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0930095Z Execution Analysis: .......... 2024-12-18T00:21:05.0930344Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0930569Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0930845Z pt-xla-profiler: TransferFromDeviceTime too frequent: 982 counts during 936 steps 2024-12-18T00:21:05.0930852Z 2024-12-18T00:21:05.0931082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0931193Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0931482Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0931589Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0931787Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0931932Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0932073Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0932237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0932587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0932932Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0933235Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0933510Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0933807Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0934066Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0934355Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0934474Z Execution Analysis: (:1) 2024-12-18T00:21:05.0934728Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0934926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0934931Z 2024-12-18T00:21:05.0935132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0935268Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0935516Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0935630Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0935832Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0935977Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0936121Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0936291Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0937130Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0937733Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0938093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0938448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0938765Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0939043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0939355Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0939625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0939737Z Execution Analysis: .......... 2024-12-18T00:21:05.0940025Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0940230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0940518Z pt-xla-profiler: TransferFromDeviceTime too frequent: 983 counts during 937 steps 2024-12-18T00:21:05.0940548Z 2024-12-18T00:21:05.0940754Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0940873Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0941161Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0941276Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0941478Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0941629Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0941768Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0941936Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0942294Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0942646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0942970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0943245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0943553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0943816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0944107Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0944369Z Execution Analysis: (:1) 2024-12-18T00:21:05.0944630Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0944834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0944889Z 2024-12-18T00:21:05.0945128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0945249Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0945480Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0945595Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0945799Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0945942Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0946095Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0946259Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0946856Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0947427Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0947794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0948143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0948453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0948730Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0949036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0949310Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0949451Z Execution Analysis: .......... 2024-12-18T00:21:05.0949712Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0949913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0950239Z pt-xla-profiler: TransferFromDeviceTime too frequent: 984 counts during 938 steps 2024-12-18T00:21:05.0950244Z 2024-12-18T00:21:05.0950446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0950560Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0950854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0950963Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0951175Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0951318Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0951464Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0951630Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0951989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0952348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0952661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0952938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0953246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0953519Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0953807Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0953934Z Execution Analysis: (:1) 2024-12-18T00:21:05.0954197Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0954397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0954431Z 2024-12-18T00:21:05.0954664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0954778Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0955012Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0955125Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0955339Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0955480Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0955626Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0955801Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0956493Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0957063Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0957412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0957762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0958063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0958338Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0958639Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0958926Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0959034Z Execution Analysis: .......... 2024-12-18T00:21:05.0959284Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0959514Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0959792Z pt-xla-profiler: TransferFromDeviceTime too frequent: 985 counts during 939 steps 2024-12-18T00:21:05.0959796Z 2024-12-18T00:21:05.0959998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0960105Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0960390Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0960499Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0960700Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0960846Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0960982Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0961152Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0961506Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0961845Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0962149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0962412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0962716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0963139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0963440Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0963562Z Execution Analysis: (:1) 2024-12-18T00:21:05.0963823Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0964089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0964094Z 2024-12-18T00:21:05.0964296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0964412Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0964638Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0964758Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0964965Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0965111Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0965256Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0965424Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0966020Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0966595Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0966961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0967311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0967625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0967897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0968236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0968502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0968605Z Execution Analysis: .......... 2024-12-18T00:21:05.0969000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0969200Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0969480Z pt-xla-profiler: TransferFromDeviceTime too frequent: 986 counts during 940 steps 2024-12-18T00:21:05.0969485Z 2024-12-18T00:21:05.0969677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0969792Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0970076Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0970190Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0970388Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0970526Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0970669Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0970832Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0971190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0971530Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0971835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0972101Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0972397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0972663Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0972944Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0973072Z Execution Analysis: (:1) 2024-12-18T00:21:05.0973373Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0973581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0973586Z 2024-12-18T00:21:05.0973783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0973894Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0974124Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0974228Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0974441Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0974583Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0974729Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0974891Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0975472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0976034Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0976452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0976970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0977283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0977597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0977905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0978187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0978294Z Execution Analysis: .......... 2024-12-18T00:21:05.0978580Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0978794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0979077Z pt-xla-profiler: TransferFromDeviceTime too frequent: 987 counts during 941 steps 2024-12-18T00:21:05.0979082Z 2024-12-18T00:21:05.0979290Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0979405Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0979705Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0979814Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0980025Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0980169Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0980312Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0980486Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0980843Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0981196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0981504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0981781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0982091Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0982359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0982652Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0982801Z Execution Analysis: (:1) 2024-12-18T00:21:05.0983091Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0983295Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0983300Z 2024-12-18T00:21:05.0983505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0983615Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0983853Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0983960Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0984171Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0984316Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0984460Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0984635Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0985229Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0985810Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0986167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0986518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0986860Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0987133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0987448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0987743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0987855Z Execution Analysis: .......... 2024-12-18T00:21:05.0988109Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0988320Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0988603Z pt-xla-profiler: TransferFromDeviceTime too frequent: 988 counts during 942 steps 2024-12-18T00:21:05.0988608Z 2024-12-18T00:21:05.0988809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0988932Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0989306Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0989415Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0989602Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0989746Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0989876Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0990031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0990362Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0990686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0990978Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0991229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0991526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0991771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0992065Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.0992209Z Execution Analysis: (:1) 2024-12-18T00:21:05.0992449Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0992641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0992645Z 2024-12-18T00:21:05.0992830Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0992941Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0993153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.0993262Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0993453Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.0993586Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.0993723Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.0993879Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0994440Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.0994969Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.0995311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.0995638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0995964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.0996215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.0996531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.0996795Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.0996894Z Execution Analysis: .......... 2024-12-18T00:21:05.0997144Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.0997331Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0997605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 990 counts during 943 steps 2024-12-18T00:21:05.0997609Z 2024-12-18T00:21:05.0997798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.0997903Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.0998179Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.0998285Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.0998488Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.0998621Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.0998764Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.0998919Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.0999249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.0999580Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.0999870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1000135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1000418Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1000703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1000999Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1001127Z Execution Analysis: (:1) 2024-12-18T00:21:05.1001365Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1001553Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1001557Z 2024-12-18T00:21:05.1001753Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1001861Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1002081Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1002186Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1002391Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1002524Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1002664Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1002829Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1003378Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1003921Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1004251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1004614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1004901Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1005168Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1005475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1005722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1005826Z Execution Analysis: .......... 2024-12-18T00:21:05.1006060Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1006253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1006515Z pt-xla-profiler: TransferFromDeviceTime too frequent: 991 counts during 944 steps 2024-12-18T00:21:05.1006521Z 2024-12-18T00:21:05.1006718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1006818Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1007098Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1007200Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1007388Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1007530Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1007660Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1007823Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1008147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1008477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1008763Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1009014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1009331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1009605Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1009883Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1009998Z Execution Analysis: (:1) 2024-12-18T00:21:05.1010247Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1010435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1010439Z 2024-12-18T00:21:05.1010635Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1010737Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1010948Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1011056Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1011247Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1011389Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1011523Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1011675Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1012229Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1012759Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1013123Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1013446Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1013743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1014018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1014316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1014561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1014658Z Execution Analysis: .......... 2024-12-18T00:21:05.1014900Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1015088Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1015358Z pt-xla-profiler: TransferFromDeviceTime too frequent: 992 counts during 945 steps 2024-12-18T00:21:05.1015363Z 2024-12-18T00:21:05.1015548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1015667Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1015937Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1016050Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1016237Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1016440Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1016582Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1016738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1017269Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1017619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1017941Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1018215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1018586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1018864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1019154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1019288Z Execution Analysis: (:1) 2024-12-18T00:21:05.1019546Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1019757Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1019764Z 2024-12-18T00:21:05.1019962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1020086Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1020313Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1020423Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1020643Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1020785Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1020945Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1021109Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1021715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1022287Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1022911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1023277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1023617Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1023901Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1024213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1024495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1024598Z Execution Analysis: .......... 2024-12-18T00:21:05.1024865Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1025066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1025350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 993 counts during 946 steps 2024-12-18T00:21:05.1025355Z 2024-12-18T00:21:05.1025563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1025679Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1025979Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1026088Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1026306Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1026449Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1026592Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1026767Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1027122Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1027484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1027795Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1028203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1028512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1028794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1029082Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1029207Z Execution Analysis: (:1) 2024-12-18T00:21:05.1029476Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1029680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1029685Z 2024-12-18T00:21:05.1029901Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1030013Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1030261Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1030366Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1030576Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1030726Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1030870Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1031048Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1031639Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1032267Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1032622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1033015Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1033326Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1033600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1033920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1034189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1034303Z Execution Analysis: .......... 2024-12-18T00:21:05.1034559Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1034778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1035060Z pt-xla-profiler: TransferFromDeviceTime too frequent: 994 counts during 947 steps 2024-12-18T00:21:05.1035066Z 2024-12-18T00:21:05.1035278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1035387Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1035674Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1035794Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1035999Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1036153Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1036292Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1036460Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1036933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1037275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1037635Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1037903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1038210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1038470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1038765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1038888Z Execution Analysis: (:1) 2024-12-18T00:21:05.1039138Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1039345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1039349Z 2024-12-18T00:21:05.1039548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1039671Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1040005Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1040120Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1040314Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1040448Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1040596Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1040752Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1041308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1041861Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1042207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1042556Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1042858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1043114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1043399Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1043660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1043759Z Execution Analysis: .......... 2024-12-18T00:21:05.1044007Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1044345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1044800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 995 counts during 948 steps 2024-12-18T00:21:05.1044807Z 2024-12-18T00:21:05.1045009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1045133Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1045425Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1045534Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1045745Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1045887Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1046043Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1046209Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1046581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1046984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1047331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1047618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1047926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1048203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1048495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1048634Z Execution Analysis: (:1) 2024-12-18T00:21:05.1048892Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1049093Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1049113Z 2024-12-18T00:21:05.1049318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1049430Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1049668Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1049774Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1049992Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1050132Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1050277Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1050448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1051077Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1051656Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1052050Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1052413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1052724Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1053007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1053311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1053589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1053690Z Execution Analysis: .......... 2024-12-18T00:21:05.1053946Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1054158Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1054449Z pt-xla-profiler: TransferFromDeviceTime too frequent: 996 counts during 949 steps 2024-12-18T00:21:05.1054454Z 2024-12-18T00:21:05.1054668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1054779Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1055081Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1055188Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1055391Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1055542Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1055683Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1055858Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1056213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1056715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1057033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1057308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1057622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1057888Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1058185Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1058309Z Execution Analysis: (:1) 2024-12-18T00:21:05.1058575Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1058777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1058785Z 2024-12-18T00:21:05.1058996Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1059107Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1059338Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1059459Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1059664Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1059817Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1059965Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1060170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1060763Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1061370Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1061739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1062086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1062407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1062680Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1063002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1063271Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1063387Z Execution Analysis: .......... 2024-12-18T00:21:05.1063642Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1063849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1064141Z pt-xla-profiler: TransferFromDeviceTime too frequent: 997 counts during 950 steps 2024-12-18T00:21:05.1064146Z 2024-12-18T00:21:05.1064347Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1064471Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1064761Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1064880Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1065087Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1065234Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1065385Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1065582Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1065989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1066339Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1066665Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1066938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1067254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1067521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1067813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1067944Z Execution Analysis: (:1) 2024-12-18T00:21:05.1068202Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1068423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1068428Z 2024-12-18T00:21:05.1068734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1068855Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1069077Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1069186Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1069397Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1069634Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1069806Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1069961Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1070519Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1071082Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1071420Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1071744Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1072032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1072298Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1072582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1072841Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1072938Z Execution Analysis: .......... 2024-12-18T00:21:05.1073191Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1073376Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1073640Z pt-xla-profiler: TransferFromDeviceTime too frequent: 998 counts during 951 steps 2024-12-18T00:21:05.1073655Z 2024-12-18T00:21:05.1073840Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1073944Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1074226Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1074326Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1074528Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1074660Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1074819Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1075011Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1075346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1075681Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1075967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1076233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1076516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1076775Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1077040Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1077158Z Execution Analysis: (:1) 2024-12-18T00:21:05.1077405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1077592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1077596Z 2024-12-18T00:21:05.1077788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1077893Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1078115Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1078217Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1078407Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1078574Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1078710Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1078874Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1079447Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1079988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1080317Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1080652Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1080939Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1081193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1081483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1081730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1081841Z Execution Analysis: .......... 2024-12-18T00:21:05.1082076Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1082274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1082536Z pt-xla-profiler: TransferFromDeviceTime too frequent: 999 counts during 952 steps 2024-12-18T00:21:05.1082540Z 2024-12-18T00:21:05.1082736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1082845Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1083115Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1083229Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1083417Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1083587Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1083747Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1083914Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1084246Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1084571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1084876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1085131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1085430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1085681Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1085961Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1086082Z Execution Analysis: (:1) 2024-12-18T00:21:05.1086322Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1086526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1086530Z 2024-12-18T00:21:05.1086716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1086838Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1087052Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1087189Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1087382Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1087526Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1087665Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1087822Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1088410Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1088945Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1089290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1089614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1089917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1090171Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1090470Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1090728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1090828Z Execution Analysis: .......... 2024-12-18T00:21:05.1091082Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1091269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1091545Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1000 counts during 953 steps 2024-12-18T00:21:05.1091549Z 2024-12-18T00:21:05.1091738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1091857Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1092130Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1092236Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1092469Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1092630Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1092774Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1092929Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1093267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1093589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1093879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1094144Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1094426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1094683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1094956Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1095083Z Execution Analysis: (:1) 2024-12-18T00:21:05.1095321Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1095518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1095522Z 2024-12-18T00:21:05.1095709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1095814Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1096059Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1096159Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1096430Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1096565Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1096715Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1097075Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1097671Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1098262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1098617Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1098986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1099297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1099583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1099897Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1100180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1100288Z Execution Analysis: .......... 2024-12-18T00:21:05.1100544Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1100759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1101048Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1001 counts during 954 steps 2024-12-18T00:21:05.1101055Z 2024-12-18T00:21:05.1101266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1101381Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1101681Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1101832Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1102069Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1102225Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1102369Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1102549Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1102903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1103264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1103574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1103860Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1104169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1104445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1104755Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1104877Z Execution Analysis: (:1) 2024-12-18T00:21:05.1105148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1105349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1105354Z 2024-12-18T00:21:05.1105566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1105712Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1105944Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1106068Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1106274Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1106460Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1106609Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1106788Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1107381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1107970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1108332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1108684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1109111Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1109370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1109666Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1109914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1110022Z Execution Analysis: .......... 2024-12-18T00:21:05.1110262Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1110450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1110730Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1002 counts during 955 steps 2024-12-18T00:21:05.1110735Z 2024-12-18T00:21:05.1110918Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1111032Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1111328Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1111467Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1111657Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1111803Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1111936Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1112089Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1112431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1112751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1113050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1113301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1113598Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1113850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1114118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1114247Z Execution Analysis: (:1) 2024-12-18T00:21:05.1114481Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1114679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1114683Z 2024-12-18T00:21:05.1114896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1115012Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1115227Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1115341Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1115561Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1115695Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1115842Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1115994Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1116550Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1117077Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1117415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1117914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1118217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1118500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1118801Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1119073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1119175Z Execution Analysis: .......... 2024-12-18T00:21:05.1119434Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1119632Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1119921Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1003 counts during 956 steps 2024-12-18T00:21:05.1119926Z 2024-12-18T00:21:05.1120123Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1120258Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1120577Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1120685Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1120895Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1121037Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1121184Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1121347Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1121695Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1122051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1122353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1122632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1122935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1123208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1123494Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1123617Z Execution Analysis: (:1) 2024-12-18T00:21:05.1123881Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1124076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1124105Z 2024-12-18T00:21:05.1124313Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1124421Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1124660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1124790Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1125007Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1125148Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1125290Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1125466Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1126041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1126612Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1126964Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1127318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1127625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1127905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1128209Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1128470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1128587Z Execution Analysis: .......... 2024-12-18T00:21:05.1128840Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1129047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1129329Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1004 counts during 957 steps 2024-12-18T00:21:05.1129357Z 2024-12-18T00:21:05.1129594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1129708Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1129989Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1130109Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1130308Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1130461Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1130601Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1130777Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1131128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1131469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1131785Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1132057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1132372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1132633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1132927Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1133050Z Execution Analysis: (:1) 2024-12-18T00:21:05.1133314Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1133542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1133547Z 2024-12-18T00:21:05.1133745Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1133872Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1134135Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1134257Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1134458Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1134609Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1134752Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1134915Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1135506Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1136068Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1136521Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1137039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1137364Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1137638Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1137958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1138229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1138333Z Execution Analysis: .......... 2024-12-18T00:21:05.1138603Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1138804Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1139131Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1005 counts during 958 steps 2024-12-18T00:21:05.1139136Z 2024-12-18T00:21:05.1139360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1139489Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1139783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1139898Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1140102Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1140247Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1140399Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1140568Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1140933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1141284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1141611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1141887Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1142191Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1142471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1142759Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1142895Z Execution Analysis: (:1) 2024-12-18T00:21:05.1143181Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1143393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1143398Z 2024-12-18T00:21:05.1143602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1143761Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1143992Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1144102Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1144454Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1144598Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1144754Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1144925Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1145519Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1146108Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1146472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1146834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1147141Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1147426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1147734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1148012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1148123Z Execution Analysis: .......... 2024-12-18T00:21:05.1148381Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1148596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1148977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1006 counts during 959 steps 2024-12-18T00:21:05.1148982Z 2024-12-18T00:21:05.1149195Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1149309Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1149611Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1149724Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1149942Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1150090Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1150234Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1150415Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1150778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1151150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1151463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1151752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1152064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1152330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1152635Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1152795Z Execution Analysis: (:1) 2024-12-18T00:21:05.1153066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1153267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1153275Z 2024-12-18T00:21:05.1153520Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1153636Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1153876Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1153987Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1154196Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1154352Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1154502Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1154685Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1155280Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1155867Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1156439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1156766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1157068Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1157320Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1157618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1157867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1157982Z Execution Analysis: .......... 2024-12-18T00:21:05.1158220Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1158471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1158739Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1007 counts during 960 steps 2024-12-18T00:21:05.1158743Z 2024-12-18T00:21:05.1158930Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1159050Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1159321Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1159431Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1159619Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1159769Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1159901Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1160056Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1160399Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1160727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1161022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1161274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1161567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1161817Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1162126Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1162242Z Execution Analysis: (:1) 2024-12-18T00:21:05.1162478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1162711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1162715Z 2024-12-18T00:21:05.1162904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1163023Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1163236Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1163351Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1163546Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1163676Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1163827Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1163979Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1164536Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1165066Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1165410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1165736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1166036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1166293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1166577Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1166838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1166936Z Execution Analysis: .......... 2024-12-18T00:21:05.1167209Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1167422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1167701Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1008 counts during 961 steps 2024-12-18T00:21:05.1167706Z 2024-12-18T00:21:05.1167895Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1168000Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1168282Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1168385Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1168582Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1168713Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1168854Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1169011Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1169346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1169683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1169972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1170239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1170523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1170822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1171095Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1171219Z Execution Analysis: (:1) 2024-12-18T00:21:05.1171456Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1171752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1171756Z 2024-12-18T00:21:05.1171954Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1172060Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1172286Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1172387Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1172589Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1172722Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1172860Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1173026Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1173574Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1174121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1174454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1174788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1175077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1175342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1175628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1175880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1176014Z Execution Analysis: .......... 2024-12-18T00:21:05.1176277Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1176550Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1176985Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1009 counts during 962 steps 2024-12-18T00:21:05.1176989Z 2024-12-18T00:21:05.1177198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1177313Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1177616Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1177729Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1177936Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1178088Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1178232Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1178413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1178770Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1179131Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1179441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1179714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1180031Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1180329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1180625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1180747Z Execution Analysis: (:1) 2024-12-18T00:21:05.1181037Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1181244Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1181248Z 2024-12-18T00:21:05.1181459Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1181570Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1181802Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1181921Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1182127Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1182281Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1182425Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1182596Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1183197Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1183771Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1184140Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1184491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1184809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1185082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1185396Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1185690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1185819Z Execution Analysis: .......... 2024-12-18T00:21:05.1186084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1186285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1186581Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1011 counts during 963 steps 2024-12-18T00:21:05.1186586Z 2024-12-18T00:21:05.1186785Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1186907Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1187195Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1187315Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1187519Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1187666Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1187816Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1187984Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1188348Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1188698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1189121Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1189371Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1189682Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1189935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1190205Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1190352Z Execution Analysis: (:1) 2024-12-18T00:21:05.1190588Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1190784Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1190788Z 2024-12-18T00:21:05.1190974Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1191085Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1191300Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1191406Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1191603Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1191736Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1191881Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1192039Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1192594Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1193123Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1193453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1193783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1194073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1194336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1194645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1194929Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1195028Z Execution Analysis: .......... 2024-12-18T00:21:05.1195275Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1195459Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1195724Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1012 counts during 964 steps 2024-12-18T00:21:05.1195728Z 2024-12-18T00:21:05.1195921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1196028Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1196304Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1196406Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1196604Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1196738Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1196874Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1197031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1197356Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1197689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1197977Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1198261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1198546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1198806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1199098Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1199214Z Execution Analysis: (:1) 2024-12-18T00:21:05.1199457Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1199646Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1199650Z 2024-12-18T00:21:05.1199848Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1199954Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1200172Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1200273Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1200464Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1200607Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1200747Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1200909Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1201458Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1201993Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1202323Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1202659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1202946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1203231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1203557Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1203806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1203911Z Execution Analysis: .......... 2024-12-18T00:21:05.1204145Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1204344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1204611Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1013 counts during 965 steps 2024-12-18T00:21:05.1204618Z 2024-12-18T00:21:05.1204818Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1204923Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1205190Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1205303Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1205492Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1205633Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1205764Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1205918Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1206255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1206581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1206899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1207149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1207441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1207716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1207996Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1208110Z Execution Analysis: (:1) 2024-12-18T00:21:05.1208345Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1208542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1208546Z 2024-12-18T00:21:05.1208731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1208846Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1209057Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1209169Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1209362Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1209500Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1209641Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1209796Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1210347Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1210876Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1214364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1214727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1215017Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1215370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1215657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1215910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1216006Z Execution Analysis: .......... 2024-12-18T00:21:05.1216255Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1216551Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1216998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1014 counts during 966 steps 2024-12-18T00:21:05.1217006Z 2024-12-18T00:21:05.1217208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1217323Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1217623Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1217734Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1217942Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1218085Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1218231Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1218398Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1218756Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1219148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1219459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1219738Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1220078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1220355Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1220647Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1220775Z Execution Analysis: (:1) 2024-12-18T00:21:05.1221036Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1221237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1221245Z 2024-12-18T00:21:05.1221451Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1221564Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1221797Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1221910Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1222125Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1222267Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1222413Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1222585Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1223184Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1223769Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1224128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1224484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1224855Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1225136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1225441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1225708Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1225816Z Execution Analysis: .......... 2024-12-18T00:21:05.1226069Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1226276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1226564Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1015 counts during 967 steps 2024-12-18T00:21:05.1226569Z 2024-12-18T00:21:05.1226774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1226890Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1227176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1227288Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1227491Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1227641Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1227779Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1227950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1228305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1228680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1229099Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1229496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1229781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1230027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1230299Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1230411Z Execution Analysis: (:1) 2024-12-18T00:21:05.1230653Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1230839Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1230843Z 2024-12-18T00:21:05.1231028Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1231138Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1231350Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1231459Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1231649Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1231787Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1231920Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1232072Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1232628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1233160Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1233497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1233873Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1234164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1234418Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1234706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1234954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1235053Z Execution Analysis: .......... 2024-12-18T00:21:05.1235297Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1235485Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1235756Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1016 counts during 968 steps 2024-12-18T00:21:05.1235762Z 2024-12-18T00:21:05.1235950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1236057Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1236325Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1236431Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1236618Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1236750Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1236889Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1237041Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1237401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1237723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1238016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1238293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1238578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1238832Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1239101Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1239221Z Execution Analysis: (:1) 2024-12-18T00:21:05.1239460Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1239655Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1239659Z 2024-12-18T00:21:05.1239845Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1239955Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1240173Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1240273Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1240468Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1240597Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1240738Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1240892Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1241439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1241977Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1242345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1242700Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1242987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1243249Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1243532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1243783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1243884Z Execution Analysis: .......... 2024-12-18T00:21:05.1244119Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1244647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1244940Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1017 counts during 969 steps 2024-12-18T00:21:05.1244949Z 2024-12-18T00:21:05.1245157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1245268Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1245567Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1245677Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1245887Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1246028Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1246229Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1246401Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1246755Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1247112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1247457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1247734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1248043Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1248308Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1248601Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1248725Z Execution Analysis: (:1) 2024-12-18T00:21:05.1248984Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1249186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1249192Z 2024-12-18T00:21:05.1249397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1249508Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1249743Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1249851Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1250054Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1250202Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1250348Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1250520Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1251116Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1251690Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1252118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1252466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1252781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1253054Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1253368Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1253638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1253750Z Execution Analysis: .......... 2024-12-18T00:21:05.1254003Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1254211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1254502Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1018 counts during 970 steps 2024-12-18T00:21:05.1254507Z 2024-12-18T00:21:05.1254707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1254824Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1255114Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1255229Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1255432Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1255607Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1255744Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1255909Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1256270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1256892Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1257212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1257489Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1257799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1258067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1258363Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1258488Z Execution Analysis: (:1) 2024-12-18T00:21:05.1258746Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1258963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1258968Z 2024-12-18T00:21:05.1259173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1259291Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1259519Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1259634Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1259840Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1259981Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1260133Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1260301Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1260903Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1261530Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1261894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1262248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1262563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1262836Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1263142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1263418Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1263522Z Execution Analysis: .......... 2024-12-18T00:21:05.1263783Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1263991Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1264282Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1019 counts during 971 steps 2024-12-18T00:21:05.1264286Z 2024-12-18T00:21:05.1264490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1264609Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1264900Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1265009Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1265245Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1265388Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1265538Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1265705Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1266086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1266444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1266758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1267035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1267345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1267615Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1267906Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1268033Z Execution Analysis: (:1) 2024-12-18T00:21:05.1268290Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1268495Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1268505Z 2024-12-18T00:21:05.1268703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1268816Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1269142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1269244Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1269442Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1269572Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1269705Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1269868Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1270412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1270998Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1271328Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1271660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1271945Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1272371Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1272674Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1272932Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1273039Z Execution Analysis: .......... 2024-12-18T00:21:05.1273293Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1273493Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1273933Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1020 counts during 972 steps 2024-12-18T00:21:05.1274376Z 2024-12-18T00:21:05.1274576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1275021Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1275525Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1276079Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1276476Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1276941Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1277337Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1277762Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1278442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1279277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1280065Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1280815Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1281516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1282213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1282898Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1283434Z Execution Analysis: (:1) 2024-12-18T00:21:05.1283918Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1284504Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1284835Z 2024-12-18T00:21:05.1285035Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1285474Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1285916Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1286479Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1286867Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1287324Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1287715Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1288127Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1289522Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1290808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1291846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1292686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1293560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1294246Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1294933Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1295614Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1296094Z Execution Analysis: .......... 2024-12-18T00:21:05.1296613Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1297352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1297965Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1021 counts during 973 steps 2024-12-18T00:21:05.1298370Z 2024-12-18T00:21:05.1298578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1299014Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1299543Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1300080Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1300476Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1300941Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1301373Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1301808Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1302446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1303278Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1304055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1304770Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1305479Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1306181Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1306871Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1307415Z Execution Analysis: (:1) 2024-12-18T00:21:05.1307905Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1308488Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1308816Z 2024-12-18T00:21:05.1309019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1309457Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1309900Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1310362Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1310767Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1311240Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1311640Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1312091Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1312992Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1314281Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1315320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1316154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1316941Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1317652Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1318361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1319067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1319555Z Execution Analysis: .......... 2024-12-18T00:21:05.1320010Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1320594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1321205Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1022 counts during 974 steps 2024-12-18T00:21:05.1321610Z 2024-12-18T00:21:05.1321820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1322292Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1322783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1323308Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1323712Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1324207Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1324605Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1325026Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1325654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1326486Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1327281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1327998Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1328702Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1329418Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1330104Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1330645Z Execution Analysis: (:1) 2024-12-18T00:21:05.1331139Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1331718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1332044Z 2024-12-18T00:21:05.1332253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1332801Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1333338Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1333773Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1334160Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1334593Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1334993Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1335410Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1336227Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1337727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1338783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1339619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1340408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1341120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1341823Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1342530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1343027Z Execution Analysis: .......... 2024-12-18T00:21:05.1343484Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1344070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1344848Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1023 counts during 975 steps 2024-12-18T00:21:05.1345326Z 2024-12-18T00:21:05.1345530Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1345971Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1346473Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1347004Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1347458Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1347923Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1348321Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1348755Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1349404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1350239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1351022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1351728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1352437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1353145Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1353843Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1354385Z Execution Analysis: (:1) 2024-12-18T00:21:05.1354883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1355460Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1355901Z 2024-12-18T00:21:05.1356096Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1356531Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1356969Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1357421Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1357819Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1358301Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1358735Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1359153Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1360076Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1361273Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1362247Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1363011Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1363747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1364415Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1365076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1365731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1366196Z Execution Analysis: .......... 2024-12-18T00:21:05.1366612Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1367154Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1367730Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1024 counts during 976 steps 2024-12-18T00:21:05.1368161Z 2024-12-18T00:21:05.1368350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1368936Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1369431Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1369966Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1370351Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1370802Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1371191Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1371599Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1372222Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1373027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1373791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1374483Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1375176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1375857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1376610Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1377302Z Execution Analysis: (:1) 2024-12-18T00:21:05.1377798Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1378380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1378711Z 2024-12-18T00:21:05.1378917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1379358Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1379802Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1380288Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1380724Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1381194Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1381598Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1382034Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1382924Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1384203Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1385261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1386089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1386883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1387603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1388312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1389110Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1389580Z Execution Analysis: .......... 2024-12-18T00:21:05.1390000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1390542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1391225Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1025 counts during 977 steps 2024-12-18T00:21:05.1391602Z 2024-12-18T00:21:05.1391803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1392212Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1392713Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1393206Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1393586Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1394018Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1394386Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1394769Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1395363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1396135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1396859Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1397517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1398176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1398816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1399453Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1399959Z Execution Analysis: (:1) 2024-12-18T00:21:05.1400414Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1400958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1401256Z 2024-12-18T00:21:05.1401452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1401848Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1402284Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1402740Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1403119Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1403552Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1403913Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1404308Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1405121Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1406500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1407530Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1408341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1409110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1409800Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1410494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1411184Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1411677Z Execution Analysis: .......... 2024-12-18T00:21:05.1412127Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1412729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1413326Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1026 counts during 978 steps 2024-12-18T00:21:05.1413733Z 2024-12-18T00:21:05.1413934Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1414397Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1414894Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1415414Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1415824Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1416278Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1416747Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1417339Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1417991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1418828Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1419609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1420328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1421041Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1421756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1422445Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1422987Z Execution Analysis: (:1) 2024-12-18T00:21:05.1423470Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1424060Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1424396Z 2024-12-18T00:21:05.1424596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1425069Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1425545Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1426014Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1426413Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1426885Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1427293Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1427726Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1428607Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1430064Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1431041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1431811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1432545Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1433211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1433876Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1434529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1435001Z Execution Analysis: .......... 2024-12-18T00:21:05.1435449Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1435994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1436742Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1027 counts during 979 steps 2024-12-18T00:21:05.1437148Z 2024-12-18T00:21:05.1437560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1438009Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1438516Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1439040Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1439452Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1439920Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1440327Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1440756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1441397Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1442233Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1443028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1443747Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1444596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1445303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1445990Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1446537Z Execution Analysis: (:1) 2024-12-18T00:21:05.1447041Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1447639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1447964Z 2024-12-18T00:21:05.1448240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1448744Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1449181Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1449647Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1450065Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1450535Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1450953Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1451383Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1452250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1454235Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1456276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1457927Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1459432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1460785Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1462115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1463444Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1464445Z Execution Analysis: .......... 2024-12-18T00:21:05.1465288Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1466387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1467605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1028 counts during 980 steps 2024-12-18T00:21:05.1468392Z 2024-12-18T00:21:05.1468776Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1469581Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1470519Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1471515Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1472259Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1473120Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1473845Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1474625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1475838Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1477455Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1478964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1480314Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1481645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1482981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1484281Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1485299Z Execution Analysis: (:1) 2024-12-18T00:21:05.1486214Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1487323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1487975Z 2024-12-18T00:21:05.1488396Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1489221Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1490039Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1490910Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1491660Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1492533Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1493267Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1494068Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1495747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1498285Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1500322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1501930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1503431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1504784Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1506122Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1507488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1508424Z Execution Analysis: .......... 2024-12-18T00:21:05.1509261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1510397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1511558Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1029 counts during 981 steps 2024-12-18T00:21:05.1512345Z 2024-12-18T00:21:05.1512720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1513544Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1514481Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1515465Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1516197Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1517063Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1517797Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1518578Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1519784Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1521383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1522878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1524239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1525590Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1526924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1528241Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1529259Z Execution Analysis: (:1) 2024-12-18T00:21:05.1530167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1531343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1531980Z 2024-12-18T00:21:05.1532352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1533168Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1533985Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1534845Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1535589Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1536507Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1537258Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1538049Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1539729Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1542232Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1544528Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1546125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1547634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1548990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1550403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1551734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1552651Z Execution Analysis: .......... 2024-12-18T00:21:05.1553495Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1554647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1555815Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1030 counts during 982 steps 2024-12-18T00:21:05.1556595Z 2024-12-18T00:21:05.1556980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1557791Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1558727Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1559714Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1560457Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1561318Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1562052Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1562817Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1564019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1565620Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1567137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1568485Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1569830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1571154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1572465Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1573479Z Execution Analysis: (:1) 2024-12-18T00:21:05.1574437Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1575585Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1576205Z 2024-12-18T00:21:05.1576659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1577476Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1578286Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1579155Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1579908Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1580791Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1581540Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1582325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1584003Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1586513Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1588553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1590151Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1591667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1593039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1594402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1595740Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1596681Z Execution Analysis: .......... 2024-12-18T00:21:05.1597566Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1598672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1599820Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1032 counts during 983 steps 2024-12-18T00:21:05.1600616Z 2024-12-18T00:21:05.1600992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1601825Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1602774Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1603767Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1604519Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1605372Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1606114Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1606902Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1608108Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1609711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1611214Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1612561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1613901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1615231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1616618Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1617699Z Execution Analysis: (:1) 2024-12-18T00:21:05.1618658Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1619750Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1620387Z 2024-12-18T00:21:05.1620764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1621587Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1622408Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1623274Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1624033Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1624895Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1625641Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1626427Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1628109Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1630595Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1632628Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1634219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1635730Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1637132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1638477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1639825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1640798Z Execution Analysis: .......... 2024-12-18T00:21:05.1641629Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1642733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1643902Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1033 counts during 984 steps 2024-12-18T00:21:05.1644835Z 2024-12-18T00:21:05.1645214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1646040Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1646992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1647977Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1648724Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1649599Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1650336Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1651117Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1652322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1653914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1655417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1656831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1658173Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1659514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1660885Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1661940Z Execution Analysis: (:1) 2024-12-18T00:21:05.1662853Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1663954Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1664584Z 2024-12-18T00:21:05.1664964Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1665777Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1666589Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1667446Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1668195Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1669064Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1669812Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1670608Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1672290Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1674783Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1676824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1678427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1679989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1681347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1682692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1684060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1685004Z Execution Analysis: .......... 2024-12-18T00:21:05.1685847Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1686954Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1688122Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1034 counts during 985 steps 2024-12-18T00:21:05.1688903Z 2024-12-18T00:21:05.1689294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1690101Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1691054Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1692052Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1692797Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1693670Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1694407Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1694714Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1695395Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1696085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1696718Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1697252Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1697832Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1698393Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1698983Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1699205Z Execution Analysis: (:1) 2024-12-18T00:21:05.1699696Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1700076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1700083Z 2024-12-18T00:21:05.1700472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1700668Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1701116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1701305Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1701684Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1701958Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1702225Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1702541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1703689Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1704808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1705494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1706211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1706803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1707329Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1707962Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1708464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1708660Z Execution Analysis: .......... 2024-12-18T00:21:05.1709139Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1709525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1710061Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1035 counts during 986 steps 2024-12-18T00:21:05.1710071Z 2024-12-18T00:21:05.1710457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1710657Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1711204Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1711410Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1711790Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1712058Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1712312Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1712623Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1713304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1713971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1714578Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1715094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1715691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1716259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1716826Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1717044Z Execution Analysis: (:1) 2024-12-18T00:21:05.1717528Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1717920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1717927Z 2024-12-18T00:21:05.1718301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1718516Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1718947Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1719157Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1719541Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1719817Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1720077Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1720378Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1721532Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1722638Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1723375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1724051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1724656Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1725221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1725818Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1726322Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1726506Z Execution Analysis: .......... 2024-12-18T00:21:05.1726996Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1727370Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1727927Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1036 counts during 987 steps 2024-12-18T00:21:05.1727934Z 2024-12-18T00:21:05.1728306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1728521Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1729083Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1729276Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1729665Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1729919Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1730186Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1730487Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1731181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1731850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1732448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1732974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1733626Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1734144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1734695Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1734927Z Execution Analysis: (:1) 2024-12-18T00:21:05.1735409Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1735799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1735809Z 2024-12-18T00:21:05.1736182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1736461Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1736905Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1737100Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1737503Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1737758Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1738034Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1738335Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1739484Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1740613Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1741339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1742029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1742666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1743191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1743773Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1744427Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1744606Z Execution Analysis: .......... 2024-12-18T00:21:05.1745086Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1745481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1746019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1037 counts during 988 steps 2024-12-18T00:21:05.1746027Z 2024-12-18T00:21:05.1746418Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1746621Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1747186Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1747375Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1747747Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1748017Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1748271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1748586Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1749269Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1749957Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1750550Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1751142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1751760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1752269Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1752830Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1753046Z Execution Analysis: (:1) 2024-12-18T00:21:05.1753535Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1753910Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1753921Z 2024-12-18T00:21:05.1754302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1754502Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1754930Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1755139Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1755516Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1755783Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1756044Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1756359Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1757499Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1758663Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1759345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1760063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1760670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1761182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1761776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1762283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1762485Z Execution Analysis: .......... 2024-12-18T00:21:05.1762958Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1763337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1763894Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1038 counts during 989 steps 2024-12-18T00:21:05.1763904Z 2024-12-18T00:21:05.1764282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1764492Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1765041Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1765249Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1765622Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1765889Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1766142Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1766445Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1767141Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1767815Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1768459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1769008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1769600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1770106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1770648Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1770867Z Execution Analysis: (:1) 2024-12-18T00:21:05.1771346Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1771735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1771743Z 2024-12-18T00:21:05.1772118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1772327Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1772757Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1772955Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1773337Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1773594Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1773865Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1774169Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1775322Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1776495Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1777194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1777906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1778500Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1779020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1779601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1780111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1780299Z Execution Analysis: .......... 2024-12-18T00:21:05.1780787Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1781161Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1781715Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1039 counts during 990 steps 2024-12-18T00:21:05.1781725Z 2024-12-18T00:21:05.1782099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1782300Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1782862Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1783054Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1783435Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1783692Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1783958Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1784261Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1784943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1785661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1786290Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1786810Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1787389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1787900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1788450Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1788666Z Execution Analysis: (:1) 2024-12-18T00:21:05.1789154Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1789532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1789542Z 2024-12-18T00:21:05.1789933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1790130Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1790559Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1790748Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1791133Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1791383Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1791640Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1791944Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1793137Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1794256Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1794969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1795649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1796238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1796759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1797337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1797838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1798033Z Execution Analysis: .......... 2024-12-18T00:21:05.1798512Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1798899Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1799443Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1040 counts during 991 steps 2024-12-18T00:21:05.1799451Z 2024-12-18T00:21:05.1799835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1800027Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1800574Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1800769Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1801142Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1801404Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1801657Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1801964Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1802646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1803381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1803987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1804496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1805080Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1805585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1806146Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1806366Z Execution Analysis: (:1) 2024-12-18T00:21:05.1806855Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1807226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1807236Z 2024-12-18T00:21:05.1807610Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1807816Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1808244Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1808445Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1808822Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1809087Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1809343Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1809680Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1810830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1811969Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1812660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1813331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1813929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1814441Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1815036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1815542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1815721Z Execution Analysis: .......... 2024-12-18T00:21:05.1816206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1816649Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1817193Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1041 counts during 992 steps 2024-12-18T00:21:05.1817201Z 2024-12-18T00:21:05.1817576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1817782Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1818335Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1818536Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1818911Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1819164Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1819422Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1819723Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1820557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1821229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1821833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1822346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1822926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1823433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1823987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1824210Z Execution Analysis: (:1) 2024-12-18T00:21:05.1824691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1825089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1825097Z 2024-12-18T00:21:05.1825472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1825683Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1826107Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1826299Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1826685Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1826940Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1827245Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1827543Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1828687Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1829838Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1830519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1831198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1831789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1832308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1832889Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1833400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1833584Z Execution Analysis: .......... 2024-12-18T00:21:05.1834067Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1834453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1834992Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1042 counts during 993 steps 2024-12-18T00:21:05.1835000Z 2024-12-18T00:21:05.1835383Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1835580Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1836132Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1836321Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1836704Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1836960Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1837212Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1837547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1838262Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1838948Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1839537Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1840055Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1840628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1841135Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1841698Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1841915Z Execution Analysis: (:1) 2024-12-18T00:21:05.1842411Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1842787Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1842794Z 2024-12-18T00:21:05.1843177Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1843374Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1843809Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1843999Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1844513Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1844837Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1845096Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1845404Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1846599Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1847711Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1855339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1856032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1856705Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1857233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1857820Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1858321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1858505Z Execution Analysis: .......... 2024-12-18T00:21:05.1859003Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1859374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1859920Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1043 counts during 994 steps 2024-12-18T00:21:05.1859929Z 2024-12-18T00:21:05.1860300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1860507Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1861062Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1861259Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1861631Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1861990Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1862248Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1862615Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1863306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1863974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1864566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1865079Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1865660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1866169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1866721Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1866946Z Execution Analysis: (:1) 2024-12-18T00:21:05.1867431Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1867813Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1867821Z 2024-12-18T00:21:05.1868195Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1868394Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1868821Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1869046Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1869433Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1869684Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1869954Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1870254Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1871440Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1872547Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1873232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1873913Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1874501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1875023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1875599Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1876115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1876292Z Execution Analysis: .......... 2024-12-18T00:21:05.1876780Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1877149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1877691Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1044 counts during 995 steps 2024-12-18T00:21:05.1877698Z 2024-12-18T00:21:05.1878076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1878271Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1878826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1879016Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1880745Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1881038Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1881285Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1881592Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1882283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1882960Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1883552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1884068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1884644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1885152Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1885701Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1885918Z Execution Analysis: (:1) 2024-12-18T00:21:05.1886405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1886772Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1886780Z 2024-12-18T00:21:05.1887152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1887341Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1887804Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1887990Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1888367Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1888622Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1888885Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1889229Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1890370Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1891484Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1892165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1892839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1893432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1893943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1894537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1895038Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1895225Z Execution Analysis: .......... 2024-12-18T00:21:05.1895699Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1896079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1896684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1045 counts during 996 steps 2024-12-18T00:21:05.1896693Z 2024-12-18T00:21:05.1897077Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1897273Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1897823Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1898090Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1898497Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1898760Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1899009Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1899310Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1899998Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1900664Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1901258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1901772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1902360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1902864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1903424Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1903634Z Execution Analysis: (:1) 2024-12-18T00:21:05.1904108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1904484Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1904492Z 2024-12-18T00:21:05.1904861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1905101Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1905528Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1905725Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1906101Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1906355Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1906656Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1906955Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1908112Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1909218Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1909906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1910575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1911172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1911682Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1912263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1912772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1912955Z Execution Analysis: .......... 2024-12-18T00:21:05.1913439Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1913810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1914344Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1046 counts during 997 steps 2024-12-18T00:21:05.1914354Z 2024-12-18T00:21:05.1914730Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1914932Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1915515Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1915736Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1916111Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1916363Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1916624Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1916920Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1917609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1918280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1918872Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1919390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1919965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1920472Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1921014Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1921230Z Execution Analysis: (:1) 2024-12-18T00:21:05.1921701Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1922074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1922088Z 2024-12-18T00:21:05.1922492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1922688Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1923125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1923312Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1923695Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1923977Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1924241Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1924539Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1925688Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1926799Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1927480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1928156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1928743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1929266Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1929842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1930357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1930530Z Execution Analysis: .......... 2024-12-18T00:21:05.1931004Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1931380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1931919Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1047 counts during 998 steps 2024-12-18T00:21:05.1931926Z 2024-12-18T00:21:05.1932306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1932554Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1933142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1933329Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1933699Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1933955Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1934205Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1934512Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1935194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1935873Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1936494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1937002Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1937596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1938096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1938653Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1938864Z Execution Analysis: (:1) 2024-12-18T00:21:05.1939351Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1939722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1939762Z 2024-12-18T00:21:05.1940138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1940333Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1940764Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1940960Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1941371Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1941628Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1941886Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1942188Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1943328Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1944603Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1945299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1945964Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1946574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1947087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1947671Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1948175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1948360Z Execution Analysis: .......... 2024-12-18T00:21:05.1948838Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1949215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1949759Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1048 counts during 999 steps 2024-12-18T00:21:05.1949767Z 2024-12-18T00:21:05.1950201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1950454Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1951003Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1951194Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1951565Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1951816Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1952073Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1952368Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1953059Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1953726Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1954326Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1954843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1955425Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1955923Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1956464Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1956686Z Execution Analysis: (:1) 2024-12-18T00:21:05.1957167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1957591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1957599Z 2024-12-18T00:21:05.1957969Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1958167Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1958640Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1958828Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1959209Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1959461Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1959728Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1960032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1961186Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1962291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1962978Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1963654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1964244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1964760Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1965339Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1965847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1966023Z Execution Analysis: .......... 2024-12-18T00:21:05.1966508Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1966882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1967428Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1049 counts during 1000 steps 2024-12-18T00:21:05.1967479Z 2024-12-18T00:21:05.1967887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1968083Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1968638Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1968828Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1969204Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1969455Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1969711Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1970010Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1970692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1971364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1971955Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1972477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1973051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1973564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1974110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1974319Z Execution Analysis: (:1) 2024-12-18T00:21:05.1974835Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1975208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1975215Z 2024-12-18T00:21:05.1975593Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1975825Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1976256Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1976512Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1976884Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1977142Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1977399Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1977705Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1978853Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1979976Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1980665Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1981338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1981932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1982437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1983021Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1983523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1983713Z Execution Analysis: .......... 2024-12-18T00:21:05.1984190Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1984562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1985174Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1050 counts during 1001 steps 2024-12-18T00:21:05.1985182Z 2024-12-18T00:21:05.1985558Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1985754Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1986301Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.1986498Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1986866Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.1987123Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.1987375Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.1987676Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1988353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.1989033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1989631Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.1990136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.1990717Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.1991219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.1991769Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.1992016Z Execution Analysis: (:1) 2024-12-18T00:21:05.1992494Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.1992875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1992885Z 2024-12-18T00:21:05.1993307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.1993506Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.1993933Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.1994125Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.1994496Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.1994751Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.1995008Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.1995303Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.1996458Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.1997561Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.1998256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.1998918Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.1999515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2000024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2000606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2001107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2001281Z Execution Analysis: .......... 2024-12-18T00:21:05.2001771Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2002177Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2002756Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1051 counts during 1002 steps 2024-12-18T00:21:05.2002764Z 2024-12-18T00:21:05.2003132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2003329Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2003878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2004060Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2004433Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2004685Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2004942Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2005238Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2005923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2006594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2007183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2007695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2008274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2008779Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2009358Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2009576Z Execution Analysis: (:1) 2024-12-18T00:21:05.2010046Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2010461Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2010472Z 2024-12-18T00:21:05.2010841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2011034Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2011465Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2011652Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2012035Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2012289Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2012557Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2012856Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2013999Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2015121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2015795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2016529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2017117Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2017641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2018218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2018725Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2018905Z Execution Analysis: .......... 2024-12-18T00:21:05.2019419Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2019824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2020366Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1053 counts during 1003 steps 2024-12-18T00:21:05.2020373Z 2024-12-18T00:21:05.2020747Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2020947Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2021502Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2021694Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2022065Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2022326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2022583Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2022891Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2023575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2024251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2024839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2025359Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2025937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2026434Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2027018Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2027238Z Execution Analysis: (:1) 2024-12-18T00:21:05.2027720Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2028130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2028138Z 2024-12-18T00:21:05.2028515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2028710Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2029140Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2029345Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2029725Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2029993Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2030250Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2030557Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2031703Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2032834Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2033516Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2034187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2034779Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2035295Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2035884Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2036385Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2036608Z Execution Analysis: .......... 2024-12-18T00:21:05.2037123Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2037493Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2038047Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1054 counts during 1004 steps 2024-12-18T00:21:05.2038055Z 2024-12-18T00:21:05.2038428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2038631Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2039175Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2039388Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2039755Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2040015Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2040268Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2040573Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2041265Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2041933Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2042531Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2043036Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2043629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2044297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2044844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2045071Z Execution Analysis: (:1) 2024-12-18T00:21:05.2045611Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2045988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2045996Z 2024-12-18T00:21:05.2046368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2046568Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2046993Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2047188Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2047568Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2047818Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2048082Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2048380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2049535Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2050638Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2051327Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2051999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2052589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2053114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2053695Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2054247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2054470Z Execution Analysis: .......... 2024-12-18T00:21:05.2054951Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2055324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2055875Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1055 counts during 1005 steps 2024-12-18T00:21:05.2055883Z 2024-12-18T00:21:05.2056257Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2056490Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2057049Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2057241Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2057619Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2057875Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2058137Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2058436Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2059111Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2059788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2060379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2060899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2061547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2062053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2062605Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2062853Z Execution Analysis: (:1) 2024-12-18T00:21:05.2063329Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2063701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2063709Z 2024-12-18T00:21:05.2064089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2064287Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2064724Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2064917Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2065305Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2065557Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2065819Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2066126Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2067273Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2068387Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2069072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2069755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2070351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2070871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2071478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2072014Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2072206Z Execution Analysis: .......... 2024-12-18T00:21:05.2072681Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2073063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2073605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1056 counts during 1006 steps 2024-12-18T00:21:05.2073612Z 2024-12-18T00:21:05.2073997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2074196Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2074739Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2074951Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2075320Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2075591Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2075840Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2076151Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2076836Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2077501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2078099Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2078638Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2079223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2079725Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2080313Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2080533Z Execution Analysis: (:1) 2024-12-18T00:21:05.2081018Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2081392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2081400Z 2024-12-18T00:21:05.2081772Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2081975Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2082406Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2082600Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2082975Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2083235Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2083499Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2083796Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2084949Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2086063Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2086752Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2087421Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2088018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2088531Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2089184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2089687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2089867Z Execution Analysis: .......... 2024-12-18T00:21:05.2090352Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2090721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2091268Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1057 counts during 1007 steps 2024-12-18T00:21:05.2091279Z 2024-12-18T00:21:05.2091650Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2091853Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2092397Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2092600Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2092981Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2093233Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2093488Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2093786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2094477Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2095144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2095776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2096288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2096934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2097485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2098033Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2098257Z Execution Analysis: (:1) 2024-12-18T00:21:05.2098731Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2099112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2099119Z 2024-12-18T00:21:05.2099487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2099698Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2100124Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2100320Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2100710Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2100969Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2101237Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2101536Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2102676Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2103796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2104480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2105158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2105747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2106416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2106997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2107509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2107691Z Execution Analysis: .......... 2024-12-18T00:21:05.2108167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2108552Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2109100Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1058 counts during 1008 steps 2024-12-18T00:21:05.2109108Z 2024-12-18T00:21:05.2109491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2109692Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2110257Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2110448Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2110831Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2111086Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2111335Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2111649Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2112331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2113005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2113627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2114139Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2114756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2115254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2115812Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2116035Z Execution Analysis: (:1) 2024-12-18T00:21:05.2116517Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2116888Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2116898Z 2024-12-18T00:21:05.2117283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2117478Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2117908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2118106Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2118492Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2118751Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2119008Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2119316Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2120459Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2121578Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2122260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2122929Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2123601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2124117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2124700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2125201Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2125395Z Execution Analysis: .......... 2024-12-18T00:21:05.2125874Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2126251Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2126796Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1059 counts during 1009 steps 2024-12-18T00:21:05.2126804Z 2024-12-18T00:21:05.2127174Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2127384Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2127930Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2128124Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2128492Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2128754Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2129005Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2129303Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2129985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2130686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2131283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2131826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2132416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2132914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2133465Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2133678Z Execution Analysis: (:1) 2024-12-18T00:21:05.2134148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2134528Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2134538Z 2024-12-18T00:21:05.2134909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2135113Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2135542Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2135744Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2136122Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2136416Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2136685Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2136986Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2138133Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2139242Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2139923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2140626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2141258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2141772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2142350Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2142862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2143041Z Execution Analysis: .......... 2024-12-18T00:21:05.2143525Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2143896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2144596Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1060 counts during 1010 steps 2024-12-18T00:21:05.2144607Z 2024-12-18T00:21:05.2144987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2145181Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2145746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2145936Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2146315Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2146566Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2146823Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2147120Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2147862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2148542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2149134Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2149696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2150279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2150786Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2151337Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2151555Z Execution Analysis: (:1) 2024-12-18T00:21:05.2152030Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2152402Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2152409Z 2024-12-18T00:21:05.2152789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2152984Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2153422Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2153610Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2153994Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2154246Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2154504Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2154812Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2155955Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2157067Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2157787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2158505Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2159092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2159611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2160190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2160691Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2160878Z Execution Analysis: .......... 2024-12-18T00:21:05.2161346Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2161729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2162271Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1061 counts during 1011 steps 2024-12-18T00:21:05.2162284Z 2024-12-18T00:21:05.2162659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2162852Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2163405Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2163591Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2163960Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2164217Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2164463Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2164802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2165483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2166161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2166786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2167297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2167879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2168380Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2168939Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2169148Z Execution Analysis: (:1) 2024-12-18T00:21:05.2169634Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2170005Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2170015Z 2024-12-18T00:21:05.2170397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2170592Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2171016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2171217Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2171589Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2171853Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2172111Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2172409Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2173568Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2174670Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2175431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2176101Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2176761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2177277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2177863Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2178362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2178546Z Execution Analysis: .......... 2024-12-18T00:21:05.2179029Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2179402Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2179958Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1062 counts during 1012 steps 2024-12-18T00:21:05.2179966Z 2024-12-18T00:21:05.2180336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2180541Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2181091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2181290Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2181659Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2181946Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2182202Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2182502Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2183183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2183889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2184488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2185001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2185577Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2186081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2186627Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2186857Z Execution Analysis: (:1) 2024-12-18T00:21:05.2187342Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2187724Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2187733Z 2024-12-18T00:21:05.2188110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2188309Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2188739Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2188932Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2189319Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2189573Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2189836Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2190140Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2191293Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2192492Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2193174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2193855Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2194442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2194963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2195542Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2196059Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2196239Z Execution Analysis: .......... 2024-12-18T00:21:05.2196726Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2197099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2197642Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1063 counts during 1013 steps 2024-12-18T00:21:05.2197650Z 2024-12-18T00:21:05.2198030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2198224Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2198781Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2198971Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2199389Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2199641Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2199893Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2200208Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2200927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2201606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2202200Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2202719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2203295Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2203810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2204358Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2204572Z Execution Analysis: (:1) 2024-12-18T00:21:05.2205061Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2205447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2205454Z 2024-12-18T00:21:05.2205839Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2206032Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2206470Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2206662Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2207034Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2207297Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2207552Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2207863Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2209002Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2210187Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2210868Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2211543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2212132Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2212639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2213234Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2213727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2213921Z Execution Analysis: .......... 2024-12-18T00:21:05.2214395Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2214774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2215319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1064 counts during 1014 steps 2024-12-18T00:21:05.2215326Z 2024-12-18T00:21:05.2215700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2215897Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2216486Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2216717Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2217088Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2217353Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2217609Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2217906Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2218634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2219299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2219896Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2220408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2220993Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2221497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2222049Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2222265Z Execution Analysis: (:1) 2024-12-18T00:21:05.2222748Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2223127Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2223134Z 2024-12-18T00:21:05.2223504Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2223705Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2224130Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2224326Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2224697Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2224953Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2225218Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2225516Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2226729Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2227842Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2228532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2229204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2229799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2230314Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2230896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2231409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2231593Z Execution Analysis: .......... 2024-12-18T00:21:05.2232087Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2232461Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2233010Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1065 counts during 1015 steps 2024-12-18T00:21:05.2233017Z 2024-12-18T00:21:05.2233388Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2233598Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2234176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2234366Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2234747Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2235004Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2235296Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2235597Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2236286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2236960Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2237549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2238070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2238651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2239166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2239710Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2239944Z Execution Analysis: (:1) 2024-12-18T00:21:05.2240428Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2240799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2240820Z 2024-12-18T00:21:05.2241197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2241392Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2241831Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2242020Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2242407Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2242659Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2242924Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2243258Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2244600Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2245722Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2246403Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2247082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2247678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2248198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2248779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2249298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2249476Z Execution Analysis: .......... 2024-12-18T00:21:05.2249945Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2250330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2250876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1066 counts during 1016 steps 2024-12-18T00:21:05.2250884Z 2024-12-18T00:21:05.2251261Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2251503Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2252061Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2252248Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2252621Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2252947Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2253203Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2253509Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2254188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2254864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2255449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2255964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2256575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2257074Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2257639Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2257855Z Execution Analysis: (:1) 2024-12-18T00:21:05.2258346Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2258718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2258726Z 2024-12-18T00:21:05.2259109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2259305Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2259731Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2259933Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2260313Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2260568Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2260873Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2261217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2262370Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2263482Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2264168Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2264838Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2265438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2265950Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2266547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2267045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2267234Z Execution Analysis: .......... 2024-12-18T00:21:05.2267713Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2268085Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2268639Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1067 counts during 1017 steps 2024-12-18T00:21:05.2268678Z 2024-12-18T00:21:05.2269051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2269260Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2269809Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2270014Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2270419Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2270672Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2270933Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2271236Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2271930Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2272601Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2273199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2273716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2274308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2274816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2275368Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2275590Z Execution Analysis: (:1) 2024-12-18T00:21:05.2276065Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2276447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2276455Z 2024-12-18T00:21:05.2276832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2277037Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2277468Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2277654Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2278040Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2278327Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2278629Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2278932Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2280083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2281193Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2281879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2282561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2283149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2283670Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2284251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2284757Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2284937Z Execution Analysis: .......... 2024-12-18T00:21:05.2285421Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2285794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2286343Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1068 counts during 1018 steps 2024-12-18T00:21:05.2286392Z 2024-12-18T00:21:05.2286766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2286962Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2287520Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2287745Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2288124Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2288373Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2288631Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2288932Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2289614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2290291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2290884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2291408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2291987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2292499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2293050Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2293261Z Execution Analysis: (:1) 2024-12-18T00:21:05.2293738Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2294110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2294118Z 2024-12-18T00:21:05.2294508Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2294704Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2295142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2295366Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2295750Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2296040Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2296301Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2296683Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2297825Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2298939Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2299614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2300287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2300876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2301392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2301984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2302488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2302680Z Execution Analysis: .......... 2024-12-18T00:21:05.2303149Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2303532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2304108Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1069 counts during 1019 steps 2024-12-18T00:21:05.2304116Z 2024-12-18T00:21:05.2304497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2304700Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2305280Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2305485Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2305848Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2306111Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2306361Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2306668Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2307350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2308021Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2308618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2309132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2309721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2310222Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2310776Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2310991Z Execution Analysis: (:1) 2024-12-18T00:21:05.2311465Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2311849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2311859Z 2024-12-18T00:21:05.2312232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2312433Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2312892Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2313093Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2314613Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2314907Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2315165Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2315467Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2316619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2317725Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2318420Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2319090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2319695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2320207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2320803Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2321306Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2321489Z Execution Analysis: .......... 2024-12-18T00:21:05.2321975Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2322402Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2322958Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1070 counts during 1020 steps 2024-12-18T00:21:05.2322969Z 2024-12-18T00:21:05.2323345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2323586Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2324137Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2324329Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2324713Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2324969Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2325230Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2325531Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2326222Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2326888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2327476Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2328005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2328585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2329091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2329638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2329858Z Execution Analysis: (:1) 2024-12-18T00:21:05.2330335Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2330721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2330728Z 2024-12-18T00:21:05.2331101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2331331Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2331802Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2331990Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2332378Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2332627Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2332894Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2333189Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2334334Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2335452Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2336127Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2336897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2337479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2337997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2338570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2339078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2339254Z Execution Analysis: .......... 2024-12-18T00:21:05.2339763Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2340148Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2340693Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1071 counts during 1021 steps 2024-12-18T00:21:05.2340703Z 2024-12-18T00:21:05.2341124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2341322Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2341878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2342069Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2342437Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2342703Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2342953Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2343267Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2343952Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2344767Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2345363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2345884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2346460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2346964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2347522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2347737Z Execution Analysis: (:1) 2024-12-18T00:21:05.2348046Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2348252Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2348257Z 2024-12-18T00:21:05.2348524Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2348673Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2348905Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2349022Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2349230Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2349382Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2349528Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2349706Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2350301Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2350889Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2351255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2351609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2351931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2352207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2352530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2352800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2352958Z Execution Analysis: .......... 2024-12-18T00:21:05.2353218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2353426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2353766Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1072 counts during 1022 steps 2024-12-18T00:21:05.2353771Z 2024-12-18T00:21:05.2353978Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2354104Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2354395Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2354522Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2354726Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2354884Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2355033Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2355203Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2355583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2355942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2356273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2356551Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2356877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2357147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2357442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2357580Z Execution Analysis: (:1) 2024-12-18T00:21:05.2357840Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2358057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2358090Z 2024-12-18T00:21:05.2358327Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2358456Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2358794Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2358918Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2359122Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2359266Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2359423Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2359586Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2360180Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2360741Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2361110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2361456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2361763Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2362042Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2362345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2362648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2362750Z Execution Analysis: .......... 2024-12-18T00:21:05.2363017Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2363318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2363616Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1074 counts during 1023 steps 2024-12-18T00:21:05.2363621Z 2024-12-18T00:21:05.2363817Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2363928Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2364226Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2364336Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2364547Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2364690Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2364840Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2365000Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2365352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2365712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2366013Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2366292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2366594Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2366868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2367155Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2367281Z Execution Analysis: (:1) 2024-12-18T00:21:05.2367545Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2367804Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2367809Z 2024-12-18T00:21:05.2368017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2368130Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2368370Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2368475Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2368689Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2368827Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2368973Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2369151Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2369730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2370303Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2370653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2371003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2371305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2371584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2371908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2372172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2372285Z Execution Analysis: .......... 2024-12-18T00:21:05.2372540Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2372786Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2373070Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1075 counts during 1024 steps 2024-12-18T00:21:05.2373074Z 2024-12-18T00:21:05.2373283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2373395Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2373680Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2373804Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2374004Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2374160Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2374299Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2374483Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2374835Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2375179Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2375502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2375771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2376087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2376433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2376735Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2377023Z Execution Analysis: (:1) 2024-12-18T00:21:05.2377328Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2377561Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2377566Z 2024-12-18T00:21:05.2377771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2377898Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2378131Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2378255Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2378465Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2378624Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2378773Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2378943Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2379549Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2380127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2380499Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2380849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2381172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2381473Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2381800Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2382066Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2382180Z Execution Analysis: .......... 2024-12-18T00:21:05.2382473Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2382681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2382984Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1076 counts during 1025 steps 2024-12-18T00:21:05.2382989Z 2024-12-18T00:21:05.2383190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2383321Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2383613Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2383742Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2383944Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2384087Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2384247Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2384421Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2384791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2385139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2385463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2385736Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2386045Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2386323Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2386617Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2386780Z Execution Analysis: (:1) 2024-12-18T00:21:05.2387066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2387280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2387285Z 2024-12-18T00:21:05.2387490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2387616Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2387846Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2387959Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2388179Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2388326Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2388485Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2388652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2389353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2389924Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2390275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2390628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2390936Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2391242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2391545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2391823Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2391954Z Execution Analysis: .......... 2024-12-18T00:21:05.2392206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2392415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2392700Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1077 counts during 1026 steps 2024-12-18T00:21:05.2392704Z 2024-12-18T00:21:05.2392910Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2393024Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2393319Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2393427Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2393638Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2393782Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2393925Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2394097Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2394445Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2394797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2395101Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2395381Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2395681Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2395944Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2396263Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2396412Z Execution Analysis: (:1) 2024-12-18T00:21:05.2396678Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2396877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2396881Z 2024-12-18T00:21:05.2397089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2397199Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2397439Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2397551Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2397756Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2397911Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2398057Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2398234Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2398815Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2399391Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2399739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2400082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2400425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2400694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2401007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2401296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2401419Z Execution Analysis: .......... 2024-12-18T00:21:05.2401667Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2401879Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2402161Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1078 counts during 1027 steps 2024-12-18T00:21:05.2402166Z 2024-12-18T00:21:05.2402366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2402494Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2402780Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2402906Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2403109Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2403267Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2403406Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2403572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2403938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2404283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2404601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2404869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2405179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2405479Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2405801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2405926Z Execution Analysis: (:1) 2024-12-18T00:21:05.2406178Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2406387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2406391Z 2024-12-18T00:21:05.2406592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2406719Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2406948Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2407070Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2407275Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2407415Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2407574Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2407736Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2408321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2408880Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2409240Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2409609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2409923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2410191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2410518Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2410791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2410891Z Execution Analysis: .......... 2024-12-18T00:21:05.2411152Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2411349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2411639Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1079 counts during 1028 steps 2024-12-18T00:21:05.2411645Z 2024-12-18T00:21:05.2411840Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2411954Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2412248Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2412359Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2412573Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2412715Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2412870Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2413037Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2413389Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2413747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2414052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2414330Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2414630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2414953Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2415241Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2415373Z Execution Analysis: (:1) 2024-12-18T00:21:05.2415626Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2415826Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2415831Z 2024-12-18T00:21:05.2416036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2416149Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2416465Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2416576Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2416957Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2417106Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2417254Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2417481Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2418077Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2418667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2419059Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2419425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2419739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2420058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2420373Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2420645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2420766Z Execution Analysis: .......... 2024-12-18T00:21:05.2421026Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2421242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2421537Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1080 counts during 1029 steps 2024-12-18T00:21:05.2421542Z 2024-12-18T00:21:05.2421752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2421869Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2422175Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2422288Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2422493Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2422650Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2422794Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2422974Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2423333Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2423696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2424010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2424288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2424662Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2424936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2425240Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2425370Z Execution Analysis: (:1) 2024-12-18T00:21:05.2425640Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2425846Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2425852Z 2024-12-18T00:21:05.2426067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2426182Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2426411Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2426534Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2426744Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2426901Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2427049Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2427219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2427821Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2428398Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2428794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2429250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2429593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2429861Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2430170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2430431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2430539Z Execution Analysis: .......... 2024-12-18T00:21:05.2430807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2431007Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2431303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1081 counts during 1030 steps 2024-12-18T00:21:05.2431307Z 2024-12-18T00:21:05.2431506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2431634Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2431918Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2432035Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2432236Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2432374Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2432522Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2432684Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2433041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2433386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2433701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2434023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2434324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2434596Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2434883Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2435015Z Execution Analysis: (:1) 2024-12-18T00:21:05.2435266Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2435475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2435480Z 2024-12-18T00:21:05.2435681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2435807Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2436033Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2436145Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2436358Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2436499Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2436652Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2436816Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2437403Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2437994Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2438347Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2438743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2439049Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2439327Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2439629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2439905Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2440010Z Execution Analysis: .......... 2024-12-18T00:21:05.2440273Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2440471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2440755Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1082 counts during 1031 steps 2024-12-18T00:21:05.2440762Z 2024-12-18T00:21:05.2440971Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2441084Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2441375Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2441487Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2441691Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2441827Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2441963Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2442134Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2442487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2442841Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2443173Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2443476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2443778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2444049Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2444511Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2444800Z Execution Analysis: (:1) 2024-12-18T00:21:05.2445064Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2445270Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2445274Z 2024-12-18T00:21:05.2445483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2445597Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2445841Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2445952Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2446164Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2446321Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2446474Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2446651Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2447243Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2447890Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2448254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2448651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2448967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2449243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2449560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2449830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2449950Z Execution Analysis: .......... 2024-12-18T00:21:05.2450209Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2450423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2450716Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1083 counts during 1032 steps 2024-12-18T00:21:05.2450724Z 2024-12-18T00:21:05.2450936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2451049Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2451340Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2451467Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2451676Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2451824Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2451965Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2452135Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2452497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2452887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2453237Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2453507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2453819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2454085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2454384Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2454505Z Execution Analysis: (:1) 2024-12-18T00:21:05.2454766Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2454976Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2454982Z 2024-12-18T00:21:05.2455187Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2455307Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2455536Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2455656Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2455865Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2456010Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2456166Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2456332Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2457041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2457614Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2458010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2458358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2458676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2458947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2459259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2459534Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2459642Z Execution Analysis: .......... 2024-12-18T00:21:05.2459907Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2460111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2460412Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1084 counts during 1033 steps 2024-12-18T00:21:05.2460418Z 2024-12-18T00:21:05.2460618Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2460742Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2461031Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2461140Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2461353Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2461499Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2461646Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2461814Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2462177Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2462583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2462899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2463179Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2463487Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2463763Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2464050Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2464182Z Execution Analysis: (:1) 2024-12-18T00:21:05.2464438Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2464640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2464652Z 2024-12-18T00:21:05.2464855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2464969Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2465209Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2465321Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2465536Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2465679Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2465833Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2466024Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2466618Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2467228Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2467589Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2467953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2468265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2468649Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2468949Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2469220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2469322Z Execution Analysis: .......... 2024-12-18T00:21:05.2469570Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2469780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2470067Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1085 counts during 1034 steps 2024-12-18T00:21:05.2470071Z 2024-12-18T00:21:05.2470276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2470391Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2470680Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2470785Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2470987Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2471133Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2471270Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2471444Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2471845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2472191Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2472494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2472761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2473068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2473329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2473622Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2473745Z Execution Analysis: (:1) 2024-12-18T00:21:05.2473999Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2474200Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2474204Z 2024-12-18T00:21:05.2474408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2474515Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2474740Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2474853Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2475056Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2475203Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2475383Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2475553Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2476131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2476720Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2477077Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2477419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2477731Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2478000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2478312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2478575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2478689Z Execution Analysis: .......... 2024-12-18T00:21:05.2478940Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2479137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2479426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1086 counts during 1035 steps 2024-12-18T00:21:05.2479430Z 2024-12-18T00:21:05.2479624Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2479744Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2480027Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2480145Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2480339Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2480481Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2480657Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2480824Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2481207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2481549Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2481861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2482126Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2482434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2482697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2482983Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2483112Z Execution Analysis: (:1) 2024-12-18T00:21:05.2483366Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2487009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2487019Z 2024-12-18T00:21:05.2487251Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2487370Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2487600Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2487709Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2487919Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2488122Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2488271Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2488436Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2489058Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2489627Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2489981Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2490328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2490633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2490907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2491210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2491478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2491583Z Execution Analysis: .......... 2024-12-18T00:21:05.2491838Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2492043Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2492326Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1087 counts during 1036 steps 2024-12-18T00:21:05.2492331Z 2024-12-18T00:21:05.2492533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2492644Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2492934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2493042Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2493246Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2493414Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2493580Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2493754Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2494102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2494448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2494748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2495018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2495317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2495578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2495864Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2495989Z Execution Analysis: (:1) 2024-12-18T00:21:05.2496249Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2496546Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2496551Z 2024-12-18T00:21:05.2496750Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2497024Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2497258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2497400Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2497608Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2497758Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2497903Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2498076Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2498701Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2499281Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2499637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2499984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2500302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2500577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2500890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2501161Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2501267Z Execution Analysis: .......... 2024-12-18T00:21:05.2501523Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2501726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2502014Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1088 counts during 1037 steps 2024-12-18T00:21:05.2502019Z 2024-12-18T00:21:05.2502220Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2502339Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2502627Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2502745Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2502972Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2503145Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2503287Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2503452Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2503813Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2504164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2504478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2504751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2505058Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2505323Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2505624Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2505745Z Execution Analysis: (:1) 2024-12-18T00:21:05.2506002Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2506208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2506213Z 2024-12-18T00:21:05.2506412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2506528Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2506784Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2506896Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2507104Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2507246Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2507403Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2507596Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2508195Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2508767Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2509234Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2509578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2509887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2510157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2510462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2510728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2510833Z Execution Analysis: .......... 2024-12-18T00:21:05.2511089Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2511285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2511573Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1089 counts during 1038 steps 2024-12-18T00:21:05.2511579Z 2024-12-18T00:21:05.2511774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2511891Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2512171Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2512305Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2512542Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2512682Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2512827Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2512988Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2513332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2513681Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2513985Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2514256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2514553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2514822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2515105Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2515231Z Execution Analysis: (:1) 2024-12-18T00:21:05.2515480Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2515677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2515682Z 2024-12-18T00:21:05.2515886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2516101Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2516329Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2516435Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2516642Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2516785Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2516951Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2517122Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2517696Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2518262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2518611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2518963Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2519266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2519542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2519843Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2520107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2520218Z Execution Analysis: .......... 2024-12-18T00:21:05.2520467Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2520667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2520949Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1090 counts during 1039 steps 2024-12-18T00:21:05.2520956Z 2024-12-18T00:21:05.2521163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2521269Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2521579Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2521709Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2521909Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2522053Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2522190Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2522358Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2522705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2523047Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2523348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2523612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2523916Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2524178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2524463Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2524584Z Execution Analysis: (:1) 2024-12-18T00:21:05.2524836Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2525030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2525034Z 2024-12-18T00:21:05.2525268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2525376Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2525599Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2525713Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2525938Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2526082Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2526221Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2526380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2526965Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2527519Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2527875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2528215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2528689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2528965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2529278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2529541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2529754Z Execution Analysis: .......... 2024-12-18T00:21:05.2530002Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2530199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2530486Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1091 counts during 1040 steps 2024-12-18T00:21:05.2530490Z 2024-12-18T00:21:05.2530686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2530826Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2531134Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2531245Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2531441Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2531580Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2531721Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2531881Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2532232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2532576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2532882Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2533149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2533450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2533717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2534000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2534127Z Execution Analysis: (:1) 2024-12-18T00:21:05.2534379Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2534582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2534611Z 2024-12-18T00:21:05.2534807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2534921Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2535148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2535280Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2535486Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2535627Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2535773Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2535937Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2536766Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2537345Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2537707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2538064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2538378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2538655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2538963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2539233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2539337Z Execution Analysis: .......... 2024-12-18T00:21:05.2539599Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2539803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2540093Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1092 counts during 1041 steps 2024-12-18T00:21:05.2540127Z 2024-12-18T00:21:05.2540336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2540473Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2540767Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2540875Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2541079Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2541221Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2541361Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2541532Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2541892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2542248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2542560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2542839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2543143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2543413Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2543701Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2543822Z Execution Analysis: (:1) 2024-12-18T00:21:05.2544082Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2544473Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2544480Z 2024-12-18T00:21:05.2544683Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2544796Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2545094Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2545207Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2545413Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2545559Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2545703Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2545876Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2546468Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2547048Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2547406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2547765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2548075Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2548347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2548659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2548928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2549040Z Execution Analysis: .......... 2024-12-18T00:21:05.2549296Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2549502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2549844Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1093 counts during 1042 steps 2024-12-18T00:21:05.2549848Z 2024-12-18T00:21:05.2550088Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2550200Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2550492Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2550606Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2550808Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2550955Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2551096Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2551263Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2551623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2551972Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2552288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2552557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2552867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2553134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2553428Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2553552Z Execution Analysis: (:1) 2024-12-18T00:21:05.2553840Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2554045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2554050Z 2024-12-18T00:21:05.2554252Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2554396Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2554627Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2554749Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2554956Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2555097Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2555250Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2555418Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2556023Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2556672Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2557016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2557340Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2557637Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2557888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2558172Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2558425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2558526Z Execution Analysis: .......... 2024-12-18T00:21:05.2558771Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2558957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2559302Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1095 counts during 1043 steps 2024-12-18T00:21:05.2559307Z 2024-12-18T00:21:05.2559496Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2559603Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2559873Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2559976Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2560172Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2560305Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2560450Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2560608Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2560943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2561270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2561560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2561821Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2562105Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2562360Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2562630Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2562772Z Execution Analysis: (:1) 2024-12-18T00:21:05.2563008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2563191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2563205Z 2024-12-18T00:21:05.2563419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2563521Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2563741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2563843Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2564037Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2564167Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2564307Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2564463Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2565008Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2565544Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2565881Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2566212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2566501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2566757Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2567040Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2567297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2567395Z Execution Analysis: .......... 2024-12-18T00:21:05.2567628Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2567866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2568138Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1096 counts during 1044 steps 2024-12-18T00:21:05.2568143Z 2024-12-18T00:21:05.2568332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2568434Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2568707Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2568807Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2568994Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2569131Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2569261Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2569422Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2569753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2570082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2570370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2570620Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2570911Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2571157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2572382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2572497Z Execution Analysis: (:1) 2024-12-18T00:21:05.2572738Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2572957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2572962Z 2024-12-18T00:21:05.2573153Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2573255Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2573467Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2573574Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2573766Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2573903Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2574042Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2574202Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2574753Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2575288Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2575627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2575951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2576249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2576589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2577064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2577333Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2577447Z Execution Analysis: .......... 2024-12-18T00:21:05.2577738Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2577972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2578271Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1097 counts during 1045 steps 2024-12-18T00:21:05.2578276Z 2024-12-18T00:21:05.2578479Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2578603Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2578893Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2579013Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2579217Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2579361Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2579509Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2579678Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2580048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2580400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2580719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2580991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2581305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2581601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2581895Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2582025Z Execution Analysis: (:1) 2024-12-18T00:21:05.2582286Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2582536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2582541Z 2024-12-18T00:21:05.2582745Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2582870Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2583098Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2583211Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2583424Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2583575Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2583727Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2583894Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2584501Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2585079Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2585447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2585798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2586110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2586392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2586700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2586977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2587112Z Execution Analysis: .......... 2024-12-18T00:21:05.2587400Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2587601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2587890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1098 counts during 1046 steps 2024-12-18T00:21:05.2587901Z 2024-12-18T00:21:05.2588101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2588213Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2588510Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2588622Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2588833Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2588974Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2589222Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2589379Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2589707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2590039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2590324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2590583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2590866Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2591147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2591416Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2591533Z Execution Analysis: (:1) 2024-12-18T00:21:05.2591800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2591989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2591993Z 2024-12-18T00:21:05.2592185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2592292Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2592510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2592612Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2592809Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2592946Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2593081Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2593245Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2593795Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2594330Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2594661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2594989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2595275Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2595531Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2595819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2596094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2596220Z Execution Analysis: .......... 2024-12-18T00:21:05.2596457Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2596647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2596915Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1099 counts during 1047 steps 2024-12-18T00:21:05.2596920Z 2024-12-18T00:21:05.2597113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2597217Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2597485Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2597592Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2597779Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2597922Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2598056Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2598217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2598546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2598870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2599164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2599419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2599741Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2599989Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2600266Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2600412Z Execution Analysis: (:1) 2024-12-18T00:21:05.2600652Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2600849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2600853Z 2024-12-18T00:21:05.2601041Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2601149Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2601361Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2601471Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2601661Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2601801Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2601937Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2602094Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2602648Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2603186Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2603528Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2603854Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2604152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2604406Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2604727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2605004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2605104Z Execution Analysis: .......... 2024-12-18T00:21:05.2605349Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2605534Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2605809Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1100 counts during 1048 steps 2024-12-18T00:21:05.2605814Z 2024-12-18T00:21:05.2605998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2606110Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2606379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2606483Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2606679Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2606815Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2606954Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2607111Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2607447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2607770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2608055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2608339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2608620Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2608875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2609173Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2609295Z Execution Analysis: (:1) 2024-12-18T00:21:05.2609532Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2609723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2609727Z 2024-12-18T00:21:05.2609913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2610020Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2610244Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2610349Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2610550Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2610682Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2610829Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2610983Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2611534Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2612069Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2612402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2612733Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2613021Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2613306Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2613615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2613875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2613971Z Execution Analysis: .......... 2024-12-18T00:21:05.2614212Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2614407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2614677Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1101 counts during 1049 steps 2024-12-18T00:21:05.2614683Z 2024-12-18T00:21:05.2614877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2614982Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2615257Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2615361Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2615550Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2615686Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2615815Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2615977Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2616305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2616727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2617247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2617525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2617829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2618129Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2618426Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2618550Z Execution Analysis: (:1) 2024-12-18T00:21:05.2618815Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2619018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2619023Z 2024-12-18T00:21:05.2619235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2619350Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2619580Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2619697Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2619908Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2620065Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2620212Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2620391Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2620986Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2621568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2621928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2622280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2622599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2622927Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2623246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2623517Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2623630Z Execution Analysis: .......... 2024-12-18T00:21:05.2623894Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2624099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2624396Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1102 counts during 1050 steps 2024-12-18T00:21:05.2624401Z 2024-12-18T00:21:05.2624604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2624729Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2625023Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2625142Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2625347Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2625498Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2625640Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2625808Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2626172Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2626549Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2626870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2627144Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2627491Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2627759Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2628051Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2628181Z Execution Analysis: (:1) 2024-12-18T00:21:05.2628439Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2628646Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2628653Z 2024-12-18T00:21:05.2628855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2629084Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2629412Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2629527Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2629724Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2629856Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2629999Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2630151Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2630702Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2631231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2631567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2631887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2632222Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2632478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2632763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2633016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2633110Z Execution Analysis: .......... 2024-12-18T00:21:05.2633353Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2633543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2633816Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1103 counts during 1051 steps 2024-12-18T00:21:05.2633820Z 2024-12-18T00:21:05.2634007Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2634116Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2634391Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2634492Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2634687Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2634820Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2634960Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2635114Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2635445Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2635800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2636088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2636375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2636662Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2636919Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2637188Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2637303Z Execution Analysis: (:1) 2024-12-18T00:21:05.2637717Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2637917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2637921Z 2024-12-18T00:21:05.2638123Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2638232Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2638466Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2638573Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2638781Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2638921Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2639060Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2639228Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2639804Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2640369Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2640718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2641118Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2641422Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2641696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2641996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2642260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2642368Z Execution Analysis: .......... 2024-12-18T00:21:05.2642619Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2642829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2643110Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1104 counts during 1052 steps 2024-12-18T00:21:05.2643116Z 2024-12-18T00:21:05.2643322Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2643433Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2643717Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2643828Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2644028Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2644337Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2644481Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2644821Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2645242Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2645599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2645957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2646237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2646550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2646818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2647117Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2647245Z Execution Analysis: (:1) 2024-12-18T00:21:05.2647510Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2647720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2647725Z 2024-12-18T00:21:05.2647927Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2648047Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2648282Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2648403Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2648611Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2648764Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2648909Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2649081Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2649680Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2650255Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2650658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2651057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2651378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2651652Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2651967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2652234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2652344Z Execution Analysis: .......... 2024-12-18T00:21:05.2652609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2652812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2653115Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1105 counts during 1053 steps 2024-12-18T00:21:05.2653123Z 2024-12-18T00:21:05.2653325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2653445Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2653735Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2653853Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2654056Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2654198Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2654372Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2654535Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2654898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2655252Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2655597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2655867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2656173Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2656518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2656812Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2656945Z Execution Analysis: (:1) 2024-12-18T00:21:05.2657199Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2657409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2657416Z 2024-12-18T00:21:05.2657621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2657740Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2657970Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2658079Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2658291Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2658434Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2658589Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2658757Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2659352Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2659930Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2660414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2660772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2661081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2661360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2661671Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2661951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2662054Z Execution Analysis: .......... 2024-12-18T00:21:05.2662311Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2662521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2662815Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1106 counts during 1054 steps 2024-12-18T00:21:05.2662820Z 2024-12-18T00:21:05.2663031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2663144Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2663446Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2663555Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2663763Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2663937Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2664084Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2664259Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2664617Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2665009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2665326Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2665609Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2665917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2666185Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2666487Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2666612Z Execution Analysis: (:1) 2024-12-18T00:21:05.2666881Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2667083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2667090Z 2024-12-18T00:21:05.2667309Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2667419Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2667665Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2667775Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2667985Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2668142Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2668397Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2668568Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2669118Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2669711Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2670045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2670369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2670673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2670925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2671218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2671469Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2671581Z Execution Analysis: .......... 2024-12-18T00:21:05.2671818Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2672022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2672290Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1107 counts during 1055 steps 2024-12-18T00:21:05.2672294Z 2024-12-18T00:21:05.2672481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2672594Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2672864Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2672977Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2673191Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2673336Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2673472Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2673628Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2673992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2674311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2674612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2674865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2675155Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2675401Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2675683Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2675794Z Execution Analysis: (:1) 2024-12-18T00:21:05.2676030Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2676232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2676237Z 2024-12-18T00:21:05.2676424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2676541Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2676751Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2676864Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2677054Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2677186Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2677332Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2677486Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2678042Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2678624Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2678969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2679291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2679589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2679843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2680134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2680390Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2680488Z Execution Analysis: .......... 2024-12-18T00:21:05.2680743Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2680932Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2681214Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1108 counts during 1056 steps 2024-12-18T00:21:05.2681218Z 2024-12-18T00:21:05.2681404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2681520Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2681784Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2681911Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2682107Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2682240Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2682385Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2682567Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2682899Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2683233Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2683521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2683784Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2684068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2684327Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2684597Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2684726Z Execution Analysis: (:1) 2024-12-18T00:21:05.2684964Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2685151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2685155Z 2024-12-18T00:21:05.2685351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2685454Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2685675Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2685777Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2685983Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2686117Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2686254Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2686418Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2687027Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2687570Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2687903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2688237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2688525Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2688792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2689076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2689329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2689440Z Execution Analysis: .......... 2024-12-18T00:21:05.2689679Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2689878Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2690147Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1109 counts during 1057 steps 2024-12-18T00:21:05.2690152Z 2024-12-18T00:21:05.2690350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2690457Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2690762Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2690864Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2691052Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2691197Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2691359Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2691526Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2691855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2692193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2692479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2692734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2693026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2693272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2693555Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2693675Z Execution Analysis: (:1) 2024-12-18T00:21:05.2693926Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2694117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2694121Z 2024-12-18T00:21:05.2694315Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2694419Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2694630Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2694738Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2694930Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2695074Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2695210Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2695389Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2695974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2696599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2697124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2697475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2697797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2698069Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2698387Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2698660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2698778Z Execution Analysis: .......... 2024-12-18T00:21:05.2699035Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2699237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2699534Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1110 counts during 1058 steps 2024-12-18T00:21:05.2699539Z 2024-12-18T00:21:05.2699740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2699896Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2700184Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2700309Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2700516Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2700685Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2700837Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2701003Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2701373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2701724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2702050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2702325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2702633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2702908Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2703203Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2703340Z Execution Analysis: (:1) 2024-12-18T00:21:05.2703596Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2703809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2703814Z 2024-12-18T00:21:05.2704017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2704139Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2704370Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2704479Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2704698Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2704879Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2705036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2705228Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2705832Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2706404Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2706763Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2707128Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2707443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2707725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2708038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2708316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2708425Z Execution Analysis: .......... 2024-12-18T00:21:05.2708694Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2708895Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2709282Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1111 counts during 1059 steps 2024-12-18T00:21:05.2709312Z 2024-12-18T00:21:05.2709506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2709611Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2709889Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2709996Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2710229Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2710364Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2710496Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2710667Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2711000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2711339Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2711631Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2711898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2712179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2712444Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2712714Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2712827Z Execution Analysis: (:1) 2024-12-18T00:21:05.2713078Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2713266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2713270Z 2024-12-18T00:21:05.2713471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2713578Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2713806Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2713910Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2714129Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2714273Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2714436Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2714608Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2715157Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2715704Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2716035Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2716379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2716667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2716930Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2717228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2717476Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2717745Z Execution Analysis: .......... 2024-12-18T00:21:05.2717991Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2718204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2718514Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1112 counts during 1060 steps 2024-12-18T00:21:05.2718518Z 2024-12-18T00:21:05.2718724Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2718831Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2719152Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2719273Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2719470Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2719620Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2719755Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2719917Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2720276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2720617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2720928Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2721192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2721500Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2721764Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2722057Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2722176Z Execution Analysis: (:1) 2024-12-18T00:21:05.2722424Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2722631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2722638Z 2024-12-18T00:21:05.2722833Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2722949Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2723173Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2723323Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2723552Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2723694Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2723845Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2724006Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2724593Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2725150Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2725511Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2725851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2726168Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2726432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2726732Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2727002Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2727104Z Execution Analysis: .......... 2024-12-18T00:21:05.2727362Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2727560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2727880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1113 counts during 1061 steps 2024-12-18T00:21:05.2727885Z 2024-12-18T00:21:05.2728079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2728203Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2728510Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2728620Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2728827Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2728967Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2729119Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2729281Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2729741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2730070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2730358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2730622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2730912Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2731174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2731440Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2731569Z Execution Analysis: (:1) 2024-12-18T00:21:05.2731808Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2731997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2732014Z 2024-12-18T00:21:05.2732198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2732302Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2732550Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2732678Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2732883Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2733013Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2733159Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2733313Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2733862Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2734403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2734740Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2735075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2735365Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2735631Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2735915Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2736174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2736273Z Execution Analysis: .......... 2024-12-18T00:21:05.2736582Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2736979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2737267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1114 counts during 1062 steps 2024-12-18T00:21:05.2737274Z 2024-12-18T00:21:05.2737518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2737632Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2737933Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2738042Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2738250Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2738403Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2738544Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2738722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2739082Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2739443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2739755Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2740032Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2740349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2740617Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2740921Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2741044Z Execution Analysis: (:1) 2024-12-18T00:21:05.2741313Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2741516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2741520Z 2024-12-18T00:21:05.2741733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2741869Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2742125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2742244Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2742450Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2742605Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2742749Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2742931Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2743517Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2744094Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2744628Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2744989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2745310Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2745583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2745903Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2746169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2746289Z Execution Analysis: .......... 2024-12-18T00:21:05.2746611Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2746815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2747118Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1116 counts during 1063 steps 2024-12-18T00:21:05.2747122Z 2024-12-18T00:21:05.2747360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2747488Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2747779Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2747903Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2748106Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2748250Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2748405Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2748575Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2748940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2749293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2749624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2749897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2750218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2750483Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2750776Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2750906Z Execution Analysis: (:1) 2024-12-18T00:21:05.2751163Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2751375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2751411Z 2024-12-18T00:21:05.2751616Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2751775Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2752009Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2752122Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2752348Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2752492Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2752656Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2752829Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2753437Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2754014Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2754393Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2754749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2755061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2755351Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2755657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2755940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2756086Z Execution Analysis: .......... 2024-12-18T00:21:05.2756459Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2756661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2756974Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1117 counts during 1064 steps 2024-12-18T00:21:05.2756992Z 2024-12-18T00:21:05.2757192Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2757309Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2757606Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2757714Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2757929Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2758070Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2758222Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2758390Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2758740Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2759104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2759410Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2759691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2759990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2760264Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2760553Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2760679Z Execution Analysis: (:1) 2024-12-18T00:21:05.2760942Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2761138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2761168Z 2024-12-18T00:21:05.2761402Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2761515Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2761750Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2761859Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2762074Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2762215Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2762359Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2762541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2763118Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2763693Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2764045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2764397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2764698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2764964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2765277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2765561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2765675Z Execution Analysis: .......... 2024-12-18T00:21:05.2765925Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2766163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2766450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1118 counts during 1065 steps 2024-12-18T00:21:05.2766455Z 2024-12-18T00:21:05.2766663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2766772Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2767057Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2767180Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2767379Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2767532Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2767668Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2767836Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2768190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2768534Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2768852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2769120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2769431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2769693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2769990Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2770112Z Execution Analysis: (:1) 2024-12-18T00:21:05.2770363Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2770625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2770629Z 2024-12-18T00:21:05.2770826Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2770949Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2771174Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2771294Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2771495Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2771643Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2771788Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2771952Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2772537Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2773102Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2773467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2773807Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2774125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2774393Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2774730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2774996Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2775099Z Execution Analysis: .......... 2024-12-18T00:21:05.2775388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2775587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2775886Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1119 counts during 1066 steps 2024-12-18T00:21:05.2775890Z 2024-12-18T00:21:05.2776089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2776213Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2776587Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2776701Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2777088Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2777231Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2777387Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2777559Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2777935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2778287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2778597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2778883Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2779192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2779474Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2779765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2779900Z Execution Analysis: (:1) 2024-12-18T00:21:05.2780189Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2780430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2780434Z 2024-12-18T00:21:05.2780638Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2780752Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2780994Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2781102Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2781324Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2781470Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2781632Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2781800Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2782398Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2782991Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2783350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2783713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2784025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2784337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2784645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2784924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2785034Z Execution Analysis: .......... 2024-12-18T00:21:05.2785320Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2785534Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2785825Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1120 counts during 1067 steps 2024-12-18T00:21:05.2785829Z 2024-12-18T00:21:05.2786043Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2786154Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2786462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2786576Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2786791Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2786939Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2787083Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2787268Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2787625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2787986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2788300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2788584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2788894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2789253Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2789535Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2789674Z Execution Analysis: (:1) 2024-12-18T00:21:05.2789962Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2790152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2790156Z 2024-12-18T00:21:05.2790355Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2790461Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2790672Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2790788Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2790984Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2791129Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2791268Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2791438Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2791992Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2792534Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2792868Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2793194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2793493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2793769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2794065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2794341Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2794453Z Execution Analysis: .......... 2024-12-18T00:21:05.2794694Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2794885Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2795164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1121 counts during 1068 steps 2024-12-18T00:21:05.2795168Z 2024-12-18T00:21:05.2795354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2795473Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2795740Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2795854Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2796045Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2796193Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2796329Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2796485Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2796830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2797153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2797457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2797709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2798011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2798261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2798555Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2798710Z Execution Analysis: (:1) 2024-12-18T00:21:05.2798949Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2799154Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2799158Z 2024-12-18T00:21:05.2799346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2799468Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2799686Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2799805Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2799997Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2800127Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2800280Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2800441Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2801007Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2801537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2801881Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2802209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2802523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2802794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2803083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2803497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2803599Z Execution Analysis: .......... 2024-12-18T00:21:05.2803853Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2804043Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2804328Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1122 counts during 1069 steps 2024-12-18T00:21:05.2804332Z 2024-12-18T00:21:05.2804523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2804634Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2804920Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2805027Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2805231Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2805368Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2805512Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2805668Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2806001Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2806341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2806627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2806895Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2807182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2807536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2807832Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2807964Z Execution Analysis: (:1) 2024-12-18T00:21:05.2808206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2808393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2808397Z 2024-12-18T00:21:05.2808596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2808703Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2808927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2809026Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2809230Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2809367Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2809508Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2809678Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2810226Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2810769Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2811102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2811460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2811749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2812014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2812326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2812576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2812690Z Execution Analysis: .......... 2024-12-18T00:21:05.2812929Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2813128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2813399Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1123 counts during 1070 steps 2024-12-18T00:21:05.2813405Z 2024-12-18T00:21:05.2813603Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2813710Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2813984Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2814100Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2814290Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2814432Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2814560Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2814726Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2815059Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2815385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2815687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2815941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2816261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2816617Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2817077Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2817204Z Execution Analysis: (:1) 2024-12-18T00:21:05.2817474Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2817685Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2817689Z 2024-12-18T00:21:05.2817894Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2818023Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2818258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2818390Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2818604Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2818764Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2818911Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2819081Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2819689Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2820265Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2820663Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2821015Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2821343Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2821641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2821963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2822235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2822342Z Execution Analysis: .......... 2024-12-18T00:21:05.2822611Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2822812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2823115Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1124 counts during 1071 steps 2024-12-18T00:21:05.2823119Z 2024-12-18T00:21:05.2823324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2823450Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2823746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2823864Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2824070Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2824212Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2824369Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2824534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2824902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2825255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2825580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2825855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2826229Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2826515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2826809Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2826944Z Execution Analysis: (:1) 2024-12-18T00:21:05.2827204Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2827414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2827421Z 2024-12-18T00:21:05.2827623Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2827749Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2827982Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2828093Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2828319Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2828464Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2828623Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2828792Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2829576Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2830119Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2830475Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2830811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2831123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2831392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2831679Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2831940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2832041Z Execution Analysis: .......... 2024-12-18T00:21:05.2832275Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2832476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2832743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1125 counts during 1072 steps 2024-12-18T00:21:05.2832747Z 2024-12-18T00:21:05.2832946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2833054Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2833333Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2833438Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2833638Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2833774Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2833905Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2834073Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2834403Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2834745Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2835033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2835343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2835633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2835879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2836160Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2836278Z Execution Analysis: (:1) 2024-12-18T00:21:05.2836525Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2836713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2836717Z 2024-12-18T00:21:05.2836914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2837018Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2837244Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2837350Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2837544Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2837688Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2837825Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2837996Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2838542Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2839110Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2839442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2839798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2840102Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2840361Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2840652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2840896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2841000Z Execution Analysis: .......... 2024-12-18T00:21:05.2841237Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2841442Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2841710Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1126 counts during 1073 steps 2024-12-18T00:21:05.2841716Z 2024-12-18T00:21:05.2841908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2842025Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2842295Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2842410Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2842600Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2842744Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2842871Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2843031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2843378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2843702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2844052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2844464Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2844943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2845211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2845516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2845641Z Execution Analysis: (:1) 2024-12-18T00:21:05.2845896Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2846113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2846119Z 2024-12-18T00:21:05.2846322Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2846450Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2846683Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2846800Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2847013Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2847160Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2847321Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2847490Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2848097Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2848733Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2849106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2849494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2849822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2850094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2850408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2850683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2850794Z Execution Analysis: .......... 2024-12-18T00:21:05.2851058Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2851259Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2851568Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1127 counts during 1074 steps 2024-12-18T00:21:05.2851573Z 2024-12-18T00:21:05.2851771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2851891Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2852179Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2852291Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2852499Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2852640Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2852792Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2852958Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2853316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2853711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2854055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2854337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2854643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2854918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2855210Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2855348Z Execution Analysis: (:1) 2024-12-18T00:21:05.2855606Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2855807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2855813Z 2024-12-18T00:21:05.2856025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2856135Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2856451Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2856561Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2856780Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2856922Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2857070Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2857247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2857876Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2858458Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2858860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2859223Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2859532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2859813Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2860119Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2860390Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2860503Z Execution Analysis: .......... 2024-12-18T00:21:05.2860764Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2860975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2861271Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1128 counts during 1075 steps 2024-12-18T00:21:05.2861276Z 2024-12-18T00:21:05.2861486Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2861598Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2861902Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2862010Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2862212Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2862365Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2862506Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2862680Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2863036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2863458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2863770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2864046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2864364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2864634Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2864935Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2865064Z Execution Analysis: (:1) 2024-12-18T00:21:05.2865329Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2865532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2865540Z 2024-12-18T00:21:05.2865749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2865860Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2866090Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2866207Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2866414Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2866565Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2866709Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2866905Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2867504Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2868112Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2868580Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2868910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2869209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2869463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2869757Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2870011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2870122Z Execution Analysis: .......... 2024-12-18T00:21:05.2870360Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2870551Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2870829Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1129 counts during 1076 steps 2024-12-18T00:21:05.2870833Z 2024-12-18T00:21:05.2871020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2871137Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2871405Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2871517Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2871705Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2871843Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2871979Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2872163Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2872525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2872849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2873142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2873395Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2873681Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2873935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2874205Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2874328Z Execution Analysis: (:1) 2024-12-18T00:21:05.2874566Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2874768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2874773Z 2024-12-18T00:21:05.2874962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2875077Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2875288Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2875391Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2875592Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2875754Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2875898Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2876050Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2876603Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2877159Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2877493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2877825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2878111Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2878376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2878661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2878923Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2879022Z Execution Analysis: .......... 2024-12-18T00:21:05.2879277Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2879465Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2879731Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1130 counts during 1077 steps 2024-12-18T00:21:05.2879736Z 2024-12-18T00:21:05.2879933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2880042Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2880322Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2880424Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2880621Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2880753Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2880914Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2885752Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2886161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2886502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2886796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2887059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2887344Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2887597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2887874Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2887994Z Execution Analysis: (:1) 2024-12-18T00:21:05.2888243Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2888435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2888442Z 2024-12-18T00:21:05.2888634Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2888744Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2888965Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2889069Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2889296Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2889436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2889573Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2889737Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2890323Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2890865Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2891200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2891525Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2891822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2892078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2892371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2892622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2892734Z Execution Analysis: .......... 2024-12-18T00:21:05.2892979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2893174Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2893445Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1131 counts during 1078 steps 2024-12-18T00:21:05.2893451Z 2024-12-18T00:21:05.2893639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2893754Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2894024Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2894136Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2894329Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2894498Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2894670Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2894826Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2895160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2895486Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2895782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2896034Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2896323Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2896660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2897112Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2897249Z Execution Analysis: (:1) 2024-12-18T00:21:05.2897508Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2897715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2897720Z 2024-12-18T00:21:05.2897922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2898042Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2898271Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2898423Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2898628Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2898769Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2898922Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2899092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2899723Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2900300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2900666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2901017Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2901331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2901612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2901924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2902201Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2902306Z Execution Analysis: .......... 2024-12-18T00:21:05.2902567Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2902770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2903067Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1132 counts during 1079 steps 2024-12-18T00:21:05.2903072Z 2024-12-18T00:21:05.2903276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2903391Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2903689Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2903799Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2904037Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2904209Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2904355Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2904519Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2904877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2905239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2905550Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2905829Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2906136Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2906407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2906704Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2906832Z Execution Analysis: (:1) 2024-12-18T00:21:05.2907088Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2907290Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2907294Z 2024-12-18T00:21:05.2907501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2907617Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2907883Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2907994Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2908205Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2908352Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2908498Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2908697Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2909382Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2909920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2910253Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2910589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2910878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2911137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2911427Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2911674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2911783Z Execution Analysis: .......... 2024-12-18T00:21:05.2912021Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2912213Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2912478Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1133 counts during 1080 steps 2024-12-18T00:21:05.2912485Z 2024-12-18T00:21:05.2912681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2912785Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2913064Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2913194Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2913407Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2913547Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2913678Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2913837Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2914165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2914484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2914786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2915040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2915328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2915583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2915857Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2915974Z Execution Analysis: (:1) 2024-12-18T00:21:05.2916219Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2916405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2916410Z 2024-12-18T00:21:05.2916596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2916738Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2916951Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2917058Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2917251Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2917487Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2917789Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2917949Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2918539Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2919096Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2919451Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2919793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2920102Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2920373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2920679Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2920941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2921044Z Execution Analysis: .......... 2024-12-18T00:21:05.2921299Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2921497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2921787Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1134 counts during 1081 steps 2024-12-18T00:21:05.2921792Z 2024-12-18T00:21:05.2921989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2922133Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2922440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2922553Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2922752Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2922893Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2923038Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2923199Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2923721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2924072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2924396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2924672Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2924984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2925259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2925548Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2925676Z Execution Analysis: (:1) 2024-12-18T00:21:05.2925931Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2926140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2926170Z 2024-12-18T00:21:05.2926375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2926492Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2926722Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2926834Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2927072Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2927216Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2927367Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2927534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2928132Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2928702Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2929058Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2929416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2929840Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2930116Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2930421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2930688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2930790Z Execution Analysis: .......... 2024-12-18T00:21:05.2931040Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2931243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2931528Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1135 counts during 1082 steps 2024-12-18T00:21:05.2931532Z 2024-12-18T00:21:05.2931737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2931885Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2932368Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2932479Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2932688Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2932832Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2932974Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2933150Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2933511Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2933873Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2934187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2934465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2934773Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2935041Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2935342Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2935467Z Execution Analysis: (:1) 2024-12-18T00:21:05.2935732Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2935935Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2935965Z 2024-12-18T00:21:05.2936173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2936287Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2936620Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2936761Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2936971Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2937122Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2937270Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2937446Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2938044Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2938626Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2938988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2939338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2939661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2939938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2940256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2940523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2940635Z Execution Analysis: .......... 2024-12-18T00:21:05.2940892Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2941101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2941388Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1137 counts during 1083 steps 2024-12-18T00:21:05.2941420Z 2024-12-18T00:21:05.2941651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2941772Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2942066Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2942180Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2942384Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2942532Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2942674Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2942838Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2943208Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2943558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2943878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2944292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2944608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2944877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2945175Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2945299Z Execution Analysis: (:1) 2024-12-18T00:21:05.2945555Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2945827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2945832Z 2024-12-18T00:21:05.2946031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2946153Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2946419Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2946536Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2946745Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2946888Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2947047Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2947216Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2947815Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2948390Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2948756Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2949114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2949428Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2949701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2950010Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2950284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2950390Z Execution Analysis: .......... 2024-12-18T00:21:05.2950655Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2950857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2951182Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1138 counts during 1084 steps 2024-12-18T00:21:05.2951187Z 2024-12-18T00:21:05.2951423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2951547Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2951835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2951945Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2952151Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2952293Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2952439Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2952610Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2952966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2953327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2953645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2953927Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2954235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2954510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2954805Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2954941Z Execution Analysis: (:1) 2024-12-18T00:21:05.2955223Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2955425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2955439Z 2024-12-18T00:21:05.2955663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2955780Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2956015Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2956125Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2956441Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2956575Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2956707Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2956870Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2957421Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2957961Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2958299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2958629Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2958916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2959173Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2959457Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2959703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2959811Z Execution Analysis: .......... 2024-12-18T00:21:05.2960048Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2960240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2960566Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1139 counts during 1085 steps 2024-12-18T00:21:05.2960571Z 2024-12-18T00:21:05.2960765Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2960871Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2961143Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2961246Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2961434Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2961578Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2961709Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2961868Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2962195Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2962533Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2962821Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2963070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2963362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2963608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2963888Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2964028Z Execution Analysis: (:1) 2024-12-18T00:21:05.2964270Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2964459Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2964465Z 2024-12-18T00:21:05.2964692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2964796Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2965008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2965119Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2965310Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2965451Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2965584Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2965748Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2966296Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2966829Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2967172Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2967494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2967791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2968043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2968333Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2968584Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2968689Z Execution Analysis: .......... 2024-12-18T00:21:05.2968925Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2969161Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2969439Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1140 counts during 1086 steps 2024-12-18T00:21:05.2969443Z 2024-12-18T00:21:05.2969627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2969739Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2970007Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2970119Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2970312Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2970442Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2970581Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2970735Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2971073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2971397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2971689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2971941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2972222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2972477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2972775Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2972894Z Execution Analysis: (:1) 2024-12-18T00:21:05.2973129Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2973361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2973366Z 2024-12-18T00:21:05.2973555Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2973665Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2973882Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2973988Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2974192Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2974326Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2974478Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2974633Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2975190Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2975732Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2976068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2976470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2976925Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2977209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2977521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2977801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2977906Z Execution Analysis: .......... 2024-12-18T00:21:05.2978232Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2978436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2978729Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1141 counts during 1087 steps 2024-12-18T00:21:05.2978744Z 2024-12-18T00:21:05.2978945Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2979062Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2979364Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2979478Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2979690Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2979835Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2979978Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2980161Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2980522Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2980885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2981201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2981485Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2981794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2982103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2982393Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2982518Z Execution Analysis: (:1) 2024-12-18T00:21:05.2982807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2983013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2983018Z 2024-12-18T00:21:05.2983229Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2983345Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2983587Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2983698Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2983906Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2984058Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2984204Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2984379Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2984979Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2985564Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2985922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2986279Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2986591Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2986870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2987181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2987448Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2987590Z Execution Analysis: .......... 2024-12-18T00:21:05.2987871Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2988083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2988373Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1142 counts during 1088 steps 2024-12-18T00:21:05.2988378Z 2024-12-18T00:21:05.2988590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2988699Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2988994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2989211Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2989400Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2989546Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2989674Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2989839Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2990169Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2990496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2990785Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2991038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2991357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2991604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2991884Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.2992001Z Execution Analysis: (:1) 2024-12-18T00:21:05.2992263Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2992455Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2992459Z 2024-12-18T00:21:05.2992645Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2992754Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2992971Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.2993082Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2993276Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.2993409Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.2993551Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.2993708Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2994265Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.2994795Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.2995135Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.2995458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2995755Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2996006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.2996292Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.2996602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.2996702Z Execution Analysis: .......... 2024-12-18T00:21:05.2996948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.2997137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2997417Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1143 counts during 1089 steps 2024-12-18T00:21:05.2997421Z 2024-12-18T00:21:05.2997608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.2997724Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.2997992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.2998097Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.2998295Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.2998430Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.2998571Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.2998725Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.2999062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.2999386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.2999674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.2999934Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3000266Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3000522Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3000817Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3000946Z Execution Analysis: (:1) 2024-12-18T00:21:05.3001185Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3001374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3001387Z 2024-12-18T00:21:05.3001573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3001678Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3001901Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3002007Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3002212Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3002346Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3002491Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3002651Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3003203Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3003738Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3004072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3004404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3004697Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3004960Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3005271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3005543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3005641Z Execution Analysis: .......... 2024-12-18T00:21:05.3005879Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3006074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3006346Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1144 counts during 1090 steps 2024-12-18T00:21:05.3006350Z 2024-12-18T00:21:05.3006544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3006648Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3006931Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3007034Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3007226Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3007367Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3007500Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3007661Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3007995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3008326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3008614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3008894Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3009186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3009437Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3009743Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3009861Z Execution Analysis: (:1) 2024-12-18T00:21:05.3010108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3010294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3010298Z 2024-12-18T00:21:05.3010493Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3010600Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3010808Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3010915Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3011109Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3011254Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3011392Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3011559Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3012105Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3012634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3012972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3013297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3013594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3013875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3014194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3014443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3014549Z Execution Analysis: .......... 2024-12-18T00:21:05.3014786Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3014976Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3015249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1145 counts during 1091 steps 2024-12-18T00:21:05.3015255Z 2024-12-18T00:21:05.3015443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3015559Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3015825Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3015936Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3016125Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3016259Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3016488Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3016651Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3017173Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3017525Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3017875Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3018149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3018472Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3018768Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3019063Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3019195Z Execution Analysis: (:1) 2024-12-18T00:21:05.3019458Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3019670Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3019674Z 2024-12-18T00:21:05.3019876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3020002Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3020234Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3020347Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3020566Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3020716Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3020874Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3021042Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3021647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3022223Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3022591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3022943Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3023286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3023592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3023901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3024183Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3024289Z Execution Analysis: .......... 2024-12-18T00:21:05.3024556Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3024762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3025058Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1146 counts during 1092 steps 2024-12-18T00:21:05.3025071Z 2024-12-18T00:21:05.3025273Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3025392Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3025700Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3025813Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3026029Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3026173Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3026325Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3026494Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3026856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3027249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3027561Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3027847Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3028182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3028461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3028752Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3028876Z Execution Analysis: (:1) 2024-12-18T00:21:05.3029245Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3029444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3029450Z 2024-12-18T00:21:05.3029652Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3029763Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3029996Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3030101Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3030310Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3030447Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3030590Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3030760Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3031336Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3031904Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3032257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3032607Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3032974Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3033241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3033547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3033808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3033914Z Execution Analysis: .......... 2024-12-18T00:21:05.3034166Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3034379Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3034658Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1147 counts during 1093 steps 2024-12-18T00:21:05.3034662Z 2024-12-18T00:21:05.3034870Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3034981Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3035263Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3035379Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3035577Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3035726Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3035864Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3036034Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3036408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3036750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3037059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3037353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3037661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3037921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3038213Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3038333Z Execution Analysis: (:1) 2024-12-18T00:21:05.3038585Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3038790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3038795Z 2024-12-18T00:21:05.3038992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3039108Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3039336Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3039454Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3039654Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3039804Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3039946Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3040111Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3040695Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3041262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3041622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3042194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3042511Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3042779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3043094Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3043356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3043461Z Execution Analysis: .......... 2024-12-18T00:21:05.3043722Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3043917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3044350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1148 counts during 1094 steps 2024-12-18T00:21:05.3044357Z 2024-12-18T00:21:05.3044725Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3044851Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3045144Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3045256Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3045469Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3045617Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3045769Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3045993Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3046363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3046717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3047067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3047355Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3047661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3047935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3048227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3048359Z Execution Analysis: (:1) 2024-12-18T00:21:05.3048621Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3048831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3048835Z 2024-12-18T00:21:05.3049038Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3049156Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3049394Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3049505Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3049724Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3049870Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3050025Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3050193Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3050787Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3051372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3051765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3052154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3052468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3052749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3053056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3053332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3053440Z Execution Analysis: .......... 2024-12-18T00:21:05.3053698Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3053908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3054203Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1149 counts during 1095 steps 2024-12-18T00:21:05.3054208Z 2024-12-18T00:21:05.3054418Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3054529Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3054828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3054935Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3055149Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3055293Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3055465Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3055639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3055997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3056446Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3056763Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3057051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3057361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3057629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3057932Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3058057Z Execution Analysis: (:1) 2024-12-18T00:21:05.3058325Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3058527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3058534Z 2024-12-18T00:21:05.3058748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3058860Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3059098Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3059210Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3059419Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3059573Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3059719Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3059895Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3060488Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3061071Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3061480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3061832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3062151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3062424Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3062740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3063016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3063133Z Execution Analysis: .......... 2024-12-18T00:21:05.3063391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3063614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3063908Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1150 counts during 1096 steps 2024-12-18T00:21:05.3063912Z 2024-12-18T00:21:05.3064115Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3064242Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3064537Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3064661Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3064867Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3065126Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3065269Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3065439Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3065809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3066187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3066515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3066792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3067109Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3067377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3067671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3067808Z Execution Analysis: (:1) 2024-12-18T00:21:05.3068066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3068289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3068297Z 2024-12-18T00:21:05.3068498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3068627Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3068964Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3069082Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3069276Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3069411Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3069560Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3069720Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3070285Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3070877Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3071228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3071555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3071846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3072111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3072402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3072665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3072764Z Execution Analysis: .......... 2024-12-18T00:21:05.3073013Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3073202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3073484Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1151 counts during 1097 steps 2024-12-18T00:21:05.3073488Z 2024-12-18T00:21:05.3073673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3073779Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3074056Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3074155Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3074376Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3074510Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3074651Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3074809Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3075161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3075498Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3075785Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3076048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3076334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3076589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3076862Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3076986Z Execution Analysis: (:1) 2024-12-18T00:21:05.3077222Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3077416Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3077420Z 2024-12-18T00:21:05.3077619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3077721Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3077948Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3078049Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3078252Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3078387Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3078527Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3078694Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3079243Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3079835Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3080168Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3080502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3080788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3081051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3081336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3081583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3081692Z Execution Analysis: .......... 2024-12-18T00:21:05.3081934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3082131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3082400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1152 counts during 1098 steps 2024-12-18T00:21:05.3082404Z 2024-12-18T00:21:05.3082598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3082702Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3082983Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3083110Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3083299Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3083442Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3083577Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3083770Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3084101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3084427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3084724Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3084980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3085273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3085523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3085805Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3085924Z Execution Analysis: (:1) 2024-12-18T00:21:05.3086175Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3086363Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3086367Z 2024-12-18T00:21:05.3086554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3086669Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3086883Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3086999Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3087190Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3087335Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3087471Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3087626Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3088234Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3088768Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3089112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3089439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3089740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3089996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3090297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3090547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3090650Z Execution Analysis: .......... 2024-12-18T00:21:05.3090902Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3091089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3091367Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1153 counts during 1099 steps 2024-12-18T00:21:05.3091371Z 2024-12-18T00:21:05.3091560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3091702Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3091971Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3092085Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3092272Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3092411Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3092576Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3092732Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3093076Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3093400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3093701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3093953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3094238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3094495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3094767Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3094893Z Execution Analysis: (:1) 2024-12-18T00:21:05.3095132Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3095329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3095333Z 2024-12-18T00:21:05.3095518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3095636Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3095849Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3095955Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3096160Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3096295Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3096552Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3096711Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3097506Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3098085Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3098444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3098804Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3099120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3099407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3099718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3100006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3100111Z Execution Analysis: .......... 2024-12-18T00:21:05.3100367Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3100586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3100876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1154 counts during 1100 steps 2024-12-18T00:21:05.3100881Z 2024-12-18T00:21:05.3101095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3101237Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3101540Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3101652Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3101871Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3102057Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3102202Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3102380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3102735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3103095Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3103407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3103695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3104001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3104269Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3104576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3104700Z Execution Analysis: (:1) 2024-12-18T00:21:05.3104972Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3105176Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3105180Z 2024-12-18T00:21:05.3105394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3105508Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3105752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3105866Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3106077Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3106256Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3106407Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3106614Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3107209Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3107796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3108157Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3108514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3108839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3109214Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3109516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3109763Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3109876Z Execution Analysis: .......... 2024-12-18T00:21:05.3110115Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3110319Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3110590Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1155 counts during 1101 steps 2024-12-18T00:21:05.3110618Z 2024-12-18T00:21:05.3110810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3110930Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3111197Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3111317Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3111531Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3111676Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3111808Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3111967Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3112313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3112643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3112951Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3113204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3113500Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3113756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3114042Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3114156Z Execution Analysis: (:1) 2024-12-18T00:21:05.3114394Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3114592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3114596Z 2024-12-18T00:21:05.3114785Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3114900Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3115116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3115233Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3115450Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3115612Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3115761Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3115917Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3116480Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3117011Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3117356Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3117849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3118166Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3118436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3118737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3119006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3119107Z Execution Analysis: .......... 2024-12-18T00:21:05.3119367Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3119562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3119903Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1156 counts during 1102 steps 2024-12-18T00:21:05.3119908Z 2024-12-18T00:21:05.3120104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3120228Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3120538Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3120646Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3120857Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3120999Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3121151Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3121315Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3121662Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3122014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3122322Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3122600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3122905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3123177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3123460Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3123591Z Execution Analysis: (:1) 2024-12-18T00:21:05.3123840Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3124039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3124061Z 2024-12-18T00:21:05.3124256Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3124365Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3124600Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3124736Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3124973Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3125113Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3125256Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3125431Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3126007Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3126574Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3126924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3127272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3127578Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3127857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3128159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3128421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3128534Z Execution Analysis: .......... 2024-12-18T00:21:05.3128786Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3129000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3129310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1158 counts during 1103 steps 2024-12-18T00:21:05.3129315Z 2024-12-18T00:21:05.3129525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3129765Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3130048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3130149Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3130341Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3130483Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3130614Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3130783Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3131112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3131450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3131736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3131989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3132287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3132538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3132822Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3132937Z Execution Analysis: (:1) 2024-12-18T00:21:05.3133188Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3133374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3133379Z 2024-12-18T00:21:05.3133584Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3133690Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3133930Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3134070Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3134261Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3134405Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3134539Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3134706Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3135421Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3135984Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3136411Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3136923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3137254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3137532Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3137850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3138119Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3138241Z Execution Analysis: .......... 2024-12-18T00:21:05.3138499Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3138748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3139048Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1159 counts during 1104 steps 2024-12-18T00:21:05.3139055Z 2024-12-18T00:21:05.3139281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3139410Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3139701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3139821Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3140023Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3140166Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3140322Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3140491Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3140858Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3141210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3141530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3141805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3142116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3142398Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3142688Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3142824Z Execution Analysis: (:1) 2024-12-18T00:21:05.3143082Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3143298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3143302Z 2024-12-18T00:21:05.3143504Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3143656Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3143911Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3144024Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3144421Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3144568Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3144734Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3144901Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3145510Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3146087Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3146448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3146814Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3147128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3147409Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3147716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3147994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3148099Z Execution Analysis: .......... 2024-12-18T00:21:05.3148424Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3148628Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3148921Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1160 counts during 1105 steps 2024-12-18T00:21:05.3148981Z 2024-12-18T00:21:05.3149189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3149304Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3149606Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3149718Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3149938Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3150082Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3150227Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3150408Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3150769Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3151132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3151448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3151737Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3152049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3152330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3152625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3152750Z Execution Analysis: (:1) 2024-12-18T00:21:05.3153024Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3153228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3153265Z 2024-12-18T00:21:05.3153522Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3153639Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3153885Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3153998Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3154208Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3154370Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3154520Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3154701Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3155298Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3155892Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3156367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3156722Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3157031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3157300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3157617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3157877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3158020Z Execution Analysis: .......... 2024-12-18T00:21:05.3158378Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3158584Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3158883Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1161 counts during 1106 steps 2024-12-18T00:21:05.3158888Z 2024-12-18T00:21:05.3159092Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3159202Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3159474Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3159590Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3159780Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3159928Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3160064Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3160228Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3160560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3160891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3161194Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3161452Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3161753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3162005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3162290Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3162411Z Execution Analysis: (:1) 2024-12-18T00:21:05.3162650Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3162850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3162878Z 2024-12-18T00:21:05.3163090Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3163210Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3163426Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3163541Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3163733Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3163865Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3164016Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3164170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3164735Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3165273Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3165616Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3165938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3166240Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3166496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3166784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3167072Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3167172Z Execution Analysis: .......... 2024-12-18T00:21:05.3167422Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3167638Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3167922Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1162 counts during 1107 steps 2024-12-18T00:21:05.3167926Z 2024-12-18T00:21:05.3168116Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3168232Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3168504Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3168605Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3168807Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3168943Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3169086Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3169240Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3169587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3169913Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3170199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3170466Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3170749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3171011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3171284Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3171413Z Execution Analysis: (:1) 2024-12-18T00:21:05.3171655Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3171909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3171922Z 2024-12-18T00:21:05.3172111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3172219Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3172445Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3172550Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3172757Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3172894Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3173044Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3173200Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3173748Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3174298Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3174633Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3174974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3175269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3175539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3175851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3176115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3176217Z Execution Analysis: .......... 2024-12-18T00:21:05.3176563Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3176926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3177217Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1163 counts during 1108 steps 2024-12-18T00:21:05.3177222Z 2024-12-18T00:21:05.3177441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3177558Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3177861Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3177978Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3178187Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3178347Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3178493Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3178674Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3179039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3179401Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3179714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3179989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3180311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3180583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3180890Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3181016Z Execution Analysis: (:1) 2024-12-18T00:21:05.3181344Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3181549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3181554Z 2024-12-18T00:21:05.3181768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3181884Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3182115Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3182239Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3182447Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3182605Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3182748Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3182931Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3183529Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3184105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3184483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3184836Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3185160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3185459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3185778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3186047Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3186169Z Execution Analysis: .......... 2024-12-18T00:21:05.3186454Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3186660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3186963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1164 counts during 1109 steps 2024-12-18T00:21:05.3186967Z 2024-12-18T00:21:05.3187171Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3187301Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3187592Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3187715Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3187921Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3188068Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3188225Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3188398Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3188770Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3189218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3189520Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3189775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3190075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3190324Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3190595Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3190749Z Execution Analysis: (:1) 2024-12-18T00:21:05.3191011Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3191217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3191221Z 2024-12-18T00:21:05.3191410Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3191527Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3191742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3191845Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3192054Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3192189Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3192338Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3192497Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3193060Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3193592Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3193939Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3194266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3194581Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3194847Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3195130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3195421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3195521Z Execution Analysis: .......... 2024-12-18T00:21:05.3195773Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3195962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3196233Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1165 counts during 1110 steps 2024-12-18T00:21:05.3196247Z 2024-12-18T00:21:05.3196437Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3196547Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3196831Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3196937Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3197145Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3197283Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3197432Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3197590Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3197924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3198265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3198556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3198826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3199112Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3199378Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3199702Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3199820Z Execution Analysis: (:1) 2024-12-18T00:21:05.3200072Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3200261Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3200265Z 2024-12-18T00:21:05.3200470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3200578Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3200810Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3200913Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3201119Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3201257Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3201397Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3201569Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3202126Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3202676Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3203011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3203346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3203667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3203923Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3204245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3204495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3204605Z Execution Analysis: .......... 2024-12-18T00:21:05.3204845Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3205051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3205321Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1166 counts during 1111 steps 2024-12-18T00:21:05.3205325Z 2024-12-18T00:21:05.3205533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3205642Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3205912Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3206029Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3206221Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3206366Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3206498Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3206664Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3206996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3207322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3207621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3207872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3208173Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3208458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3208843Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3208962Z Execution Analysis: (:1) 2024-12-18T00:21:05.3209202Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3209403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3209407Z 2024-12-18T00:21:05.3209595Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3209723Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3209938Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3210052Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3210245Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3210392Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3210533Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3210692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3211258Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3211790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3212133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3212484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3212789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3213046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3213373Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3213624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3213723Z Execution Analysis: .......... 2024-12-18T00:21:05.3213973Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3214161Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3214438Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1167 counts during 1112 steps 2024-12-18T00:21:05.3214444Z 2024-12-18T00:21:05.3214633Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3214752Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3215025Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3215132Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3215333Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3215465Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3215611Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3215763Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3216104Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3216503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3216962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3217254Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3217596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3217911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3218208Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3218351Z Execution Analysis: (:1) 2024-12-18T00:21:05.3218612Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3218828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3218832Z 2024-12-18T00:21:05.3219035Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3219148Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3219394Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3219507Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3219731Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3219874Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3220036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3220202Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3220797Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3221383Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3221774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3222139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3222454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3222767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3223078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3223362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3223469Z Execution Analysis: .......... 2024-12-18T00:21:05.3223727Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3223945Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3224236Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1168 counts during 1113 steps 2024-12-18T00:21:05.3224241Z 2024-12-18T00:21:05.3224457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3224575Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3224878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3224991Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3225206Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3225353Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3225493Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3225672Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3226029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3226394Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3226708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3227017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3227352Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3227624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3227930Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3228055Z Execution Analysis: (:1) 2024-12-18T00:21:05.3228325Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3228526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3228533Z 2024-12-18T00:21:05.3228746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3228860Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3229198Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3229428Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3229621Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3229767Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3229903Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3230069Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3230617Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3231158Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3231517Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3231843Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3232174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3232431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3232732Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3232980Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3233091Z Execution Analysis: .......... 2024-12-18T00:21:05.3233329Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3233520Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3233806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1169 counts during 1114 steps 2024-12-18T00:21:05.3233812Z 2024-12-18T00:21:05.3233997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3234119Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3234388Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3234503Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3234694Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3234841Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3234977Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3235133Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3235478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3235802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3236101Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3236406Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3236706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3236957Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3237225Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3237355Z Execution Analysis: (:1) 2024-12-18T00:21:05.3237596Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3237801Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3237805Z 2024-12-18T00:21:05.3237992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3238113Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3238332Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3238451Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3238641Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3238774Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3238919Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3239078Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3239636Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3240194Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3240535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3240904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3241198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3241469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3241763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3242025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3242124Z Execution Analysis: .......... 2024-12-18T00:21:05.3242533Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3242734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3243026Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1170 counts during 1115 steps 2024-12-18T00:21:05.3243032Z 2024-12-18T00:21:05.3243234Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3243347Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3243646Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3243756Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3243967Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3244108Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3244381Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3244714Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3245075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3245438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3245837Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3246127Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3246433Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3246714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3247006Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3247145Z Execution Analysis: (:1) 2024-12-18T00:21:05.3247407Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3247618Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3247623Z 2024-12-18T00:21:05.3247840Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3247959Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3248201Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3248314Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3248537Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3248680Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3248832Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3249010Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3249608Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3250232Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3250629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3250987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3251298Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3251584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3251890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3252158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3252274Z Execution Analysis: .......... 2024-12-18T00:21:05.3252531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3252744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3253042Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1171 counts during 1116 steps 2024-12-18T00:21:05.3253047Z 2024-12-18T00:21:05.3253264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3253374Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3253666Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3253788Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3253993Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3254144Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3254289Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3254465Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3254823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3255224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3255548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3255819Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3256142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3256482Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3256786Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3256912Z Execution Analysis: (:1) 2024-12-18T00:21:05.3257183Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3257386Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3257392Z 2024-12-18T00:21:05.3257600Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3257725Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3257955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3258072Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3258280Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3258433Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3258581Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3258751Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3259386Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3259960Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3260360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3260710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3261031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3261306Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3261622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3261892Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3261999Z Execution Analysis: .......... 2024-12-18T00:21:05.3262262Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3262472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3262773Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1172 counts during 1117 steps 2024-12-18T00:21:05.3262778Z 2024-12-18T00:21:05.3262980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3263105Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3263397Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3263520Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3263724Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3263869Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3264019Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3264188Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3264582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3264961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3265281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3265556Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3265865Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3266140Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3266433Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3266565Z Execution Analysis: (:1) 2024-12-18T00:21:05.3266818Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3267037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3267043Z 2024-12-18T00:21:05.3267242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3267367Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3267598Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3267710Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3267924Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3268071Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3268254Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3268424Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3269105Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3269668Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3270005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3270344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3270634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3270897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3271184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3271442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3271537Z Execution Analysis: .......... 2024-12-18T00:21:05.3271779Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3271979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3272249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1173 counts during 1118 steps 2024-12-18T00:21:05.3272254Z 2024-12-18T00:21:05.3272445Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3272551Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3272826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3272927Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3273124Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3273255Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3273386Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3273576Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3274101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3274436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3274723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3274990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3275278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3275528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3275809Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3275922Z Execution Analysis: (:1) 2024-12-18T00:21:05.3276170Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3276361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3276365Z 2024-12-18T00:21:05.3276559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3276664Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3276888Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3276993Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3277184Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3277364Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3277503Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3277672Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3278224Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3278792Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3279127Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3279455Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3279752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3280005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3280302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3280550Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3280661Z Execution Analysis: .......... 2024-12-18T00:21:05.3284014Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3284239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3284524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1174 counts during 1119 steps 2024-12-18T00:21:05.3284531Z 2024-12-18T00:21:05.3284721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3284835Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3285105Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3285215Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3285406Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3285547Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3285727Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3285911Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3286255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3286582Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3286879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3287130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3287421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3287670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3287940Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3288064Z Execution Analysis: (:1) 2024-12-18T00:21:05.3288309Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3288503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3288508Z 2024-12-18T00:21:05.3288695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3288802Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3289016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3289115Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3289343Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3289474Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3289617Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3289775Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3290369Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3290906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3291245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3291572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3291860Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3292122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3292406Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3292663Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3292767Z Execution Analysis: .......... 2024-12-18T00:21:05.3293011Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3293202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3293476Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1175 counts during 1120 steps 2024-12-18T00:21:05.3293481Z 2024-12-18T00:21:05.3293668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3293773Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3294049Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3294153Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3294348Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3294505Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3294668Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3294824Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3295152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3295484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3295770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3296025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3296311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3296655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3297103Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3297231Z Execution Analysis: (:1) 2024-12-18T00:21:05.3297491Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3297691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3297696Z 2024-12-18T00:21:05.3297902Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3298013Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3298247Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3298390Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3298600Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3298740Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3298887Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3299085Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3299684Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3300264Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3300621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3300974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3301287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3301560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3301877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3302148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3302256Z Execution Analysis: .......... 2024-12-18T00:21:05.3302510Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3302716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3303005Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1176 counts during 1121 steps 2024-12-18T00:21:05.3303010Z 2024-12-18T00:21:05.3303216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3303330Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3303621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3303773Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3303976Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3304150Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3304293Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3304465Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3304824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3305176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3305494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3305772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3306089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3306360Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3306662Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3306786Z Execution Analysis: (:1) 2024-12-18T00:21:05.3307051Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3307252Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3307256Z 2024-12-18T00:21:05.3307456Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3307575Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3307831Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3307943Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3308148Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3308300Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3308475Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3308639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3309242Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3309817Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3310180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3310533Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3310847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3311121Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3311438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3311709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3311813Z Execution Analysis: .......... 2024-12-18T00:21:05.3312076Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3312275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3312570Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1177 counts during 1122 steps 2024-12-18T00:21:05.3312577Z 2024-12-18T00:21:05.3312775Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3312894Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3313187Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3313326Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3313569Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3313713Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3313855Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3314021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3314385Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3314734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3315046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3315331Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3315636Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3315914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3316208Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3316440Z Execution Analysis: (:1) 2024-12-18T00:21:05.3316689Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3316887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3316891Z 2024-12-18T00:21:05.3317085Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3317222Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3317447Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3317558Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3317934Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3318104Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3318254Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3318422Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3319013Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3319594Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3319955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3320312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3320625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3320906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3321213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3321492Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3321597Z Execution Analysis: .......... 2024-12-18T00:21:05.3321851Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3322059Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3322350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1179 counts during 1123 steps 2024-12-18T00:21:05.3322354Z 2024-12-18T00:21:05.3322560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3322701Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3323023Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3323134Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3323344Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3323486Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3323626Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3323799Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3324153Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3324511Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3324822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3325098Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3325410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3325676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3325975Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3326098Z Execution Analysis: (:1) 2024-12-18T00:21:05.3326360Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3326562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3326591Z 2024-12-18T00:21:05.3326798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3326909Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3327142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3327251Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3327486Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3327635Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3327785Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3327955Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3328547Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3329125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3329482Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3329832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3330155Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3330538Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3330840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3331209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3331311Z Execution Analysis: .......... 2024-12-18T00:21:05.3331546Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3331739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3332007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1180 counts during 1124 steps 2024-12-18T00:21:05.3332011Z 2024-12-18T00:21:05.3332196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3332359Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3332633Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3332737Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3332924Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3333060Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3333190Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3333343Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3333682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3334008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3334301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3334557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3334846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3335093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3335359Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3335481Z Execution Analysis: (:1) 2024-12-18T00:21:05.3335718Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3335909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3335938Z 2024-12-18T00:21:05.3336122Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3336231Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3336516Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3336652Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3337014Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3337154Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3337307Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3337473Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3338074Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3338651Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3339012Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3339366Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3339674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3339951Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3340259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3340531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3348292Z Execution Analysis: .......... 2024-12-18T00:21:05.3348559Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3350332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3350624Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1181 counts during 1125 steps 2024-12-18T00:21:05.3350631Z 2024-12-18T00:21:05.3350892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3351004Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3351303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3351412Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3351617Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3351766Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3351906Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3352104Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3352472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3352837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3353146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3353428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3353734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3354008Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3354300Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3354432Z Execution Analysis: (:1) 2024-12-18T00:21:05.3354694Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3354901Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3354909Z 2024-12-18T00:21:05.3355108Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3355220Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3355500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3355609Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3355824Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3355965Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3356123Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3356288Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3356889Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3357474Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3357830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3358193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3358505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3358786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3359092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3359363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3359548Z Execution Analysis: .......... 2024-12-18T00:21:05.3359927Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3360172Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3360454Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1182 counts during 1126 steps 2024-12-18T00:21:05.3360488Z 2024-12-18T00:21:05.3360691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3360799Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3361091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3361193Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3361391Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3361538Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3361677Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3361849Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3362198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3362545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3362848Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3363225Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3363507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3363753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3364030Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3364144Z Execution Analysis: (:1) 2024-12-18T00:21:05.3364387Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3364573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3364577Z 2024-12-18T00:21:05.3364792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3364896Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3365109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3365216Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3365405Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3365540Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3365673Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3365835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3366379Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3366920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3367252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3367576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3367869Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3368120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3368413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3368768Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3368900Z Execution Analysis: .......... 2024-12-18T00:21:05.3369137Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3369323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3369623Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1183 counts during 1127 steps 2024-12-18T00:21:05.3369628Z 2024-12-18T00:21:05.3369815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3369930Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3370198Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3370308Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3370497Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3370636Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3370766Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3370921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3371259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3371587Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3371881Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3372133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3372421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3372667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3372936Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3373057Z Execution Analysis: (:1) 2024-12-18T00:21:05.3373293Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3373489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3373493Z 2024-12-18T00:21:05.3373703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3373816Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3374027Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3374133Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3374324Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3374454Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3374601Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3374754Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3375307Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3375840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3376181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3376615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3377079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3377362Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3377701Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3377975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3378107Z Execution Analysis: .......... 2024-12-18T00:21:05.3378371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3378599Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3378895Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1184 counts during 1128 steps 2024-12-18T00:21:05.3378901Z 2024-12-18T00:21:05.3379101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3379213Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3379513Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3379624Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3379835Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3379979Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3380134Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3380301Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3380668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3381020Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3381336Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3381611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3381920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3382203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3382496Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3382628Z Execution Analysis: (:1) 2024-12-18T00:21:05.3382887Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3383124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3383129Z 2024-12-18T00:21:05.3383334Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3383452Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3383682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3383795Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3384013Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3384158Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3384309Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3384482Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3385083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3385667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3386027Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3386386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3386699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3387008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3387320Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3387620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3387727Z Execution Analysis: .......... 2024-12-18T00:21:05.3388025Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3388229Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3388520Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1185 counts during 1129 steps 2024-12-18T00:21:05.3388525Z 2024-12-18T00:21:05.3388731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3388848Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3389242Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3389347Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3389544Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3389678Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3389809Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3389970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3390305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3390636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3390926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3391183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3391469Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3391715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3391994Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3392106Z Execution Analysis: (:1) 2024-12-18T00:21:05.3392391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3392580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3392584Z 2024-12-18T00:21:05.3392778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3392883Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3393101Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3393204Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3393394Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3393536Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3393672Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3393832Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3394384Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3394917Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3395248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3395578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3395893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3396145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3396463Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3396713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3396817Z Execution Analysis: .......... 2024-12-18T00:21:05.3397084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3397280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3397550Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1186 counts during 1130 steps 2024-12-18T00:21:05.3397554Z 2024-12-18T00:21:05.3397739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3397853Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3398124Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3398231Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3398421Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3398557Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3398693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3398846Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3399182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3399507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3399800Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3400051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3400340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3400589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3400866Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3400979Z Execution Analysis: (:1) 2024-12-18T00:21:05.3401245Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3401441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3401445Z 2024-12-18T00:21:05.3401632Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3401745Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3401962Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3402069Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3402261Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3402395Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3402540Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3402697Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3403256Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3403787Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3404122Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3404447Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3404766Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3405047Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3405333Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3405784Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3405889Z Execution Analysis: .......... 2024-12-18T00:21:05.3406146Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3406343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3406631Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1187 counts during 1131 steps 2024-12-18T00:21:05.3406635Z 2024-12-18T00:21:05.3406836Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3406951Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3407237Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3407345Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3407553Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3407695Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3407838Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3408001Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3408355Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3408695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3408998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3409272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3409574Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3409842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3410152Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3410280Z Execution Analysis: (:1) 2024-12-18T00:21:05.3410531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3410727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3410737Z 2024-12-18T00:21:05.3410933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3411045Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3411272Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3411381Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3411588Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3411731Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3411869Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3412041Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3412616Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3413181Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3413695Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3414081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3414423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3414705Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3415042Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3415311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3415423Z Execution Analysis: .......... 2024-12-18T00:21:05.3415683Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3415894Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3416182Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1188 counts during 1132 steps 2024-12-18T00:21:05.3416189Z 2024-12-18T00:21:05.3416468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3416587Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3416884Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3416994Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3417201Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3417355Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3417497Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3417672Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3418031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3418388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3418700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3418975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3419292Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3419587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3419887Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3420013Z Execution Analysis: (:1) 2024-12-18T00:21:05.3420275Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3420480Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3420484Z 2024-12-18T00:21:05.3420691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3420802Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3421033Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3421151Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3421359Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3421509Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3421658Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3421832Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3422426Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3423000Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3423396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3423746Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3424095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3424375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3424727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3425001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3425114Z Execution Analysis: .......... 2024-12-18T00:21:05.3425373Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3425579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3425876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1189 counts during 1133 steps 2024-12-18T00:21:05.3425883Z 2024-12-18T00:21:05.3426087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3426208Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3426502Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3426622Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3426826Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3426969Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3427120Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3427291Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3427656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3428012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3428327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3428605Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3429079Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3429469Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3429744Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3429871Z Execution Analysis: (:1) 2024-12-18T00:21:05.3430108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3430307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3430312Z 2024-12-18T00:21:05.3430500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3430617Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3430833Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3430939Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3431143Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3431276Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3431419Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3431577Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3432132Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3432664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3433025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3433375Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3433664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3433950Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3434236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3434488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3434586Z Execution Analysis: .......... 2024-12-18T00:21:05.3434831Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3435023Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3435291Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1190 counts during 1134 steps 2024-12-18T00:21:05.3435304Z 2024-12-18T00:21:05.3435493Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3435599Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3435877Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3435978Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3436168Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3436301Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3436431Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3436591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3436924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3437253Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3437541Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3437799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3438114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3438367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3438639Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3438757Z Execution Analysis: (:1) 2024-12-18T00:21:05.3438999Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3439187Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3439191Z 2024-12-18T00:21:05.3439385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3439491Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3439711Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3439817Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3440007Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3440146Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3440281Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3440438Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3440987Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3441548Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3441906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3442235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3442550Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3442805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3443095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3443342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3443444Z Execution Analysis: .......... 2024-12-18T00:21:05.3443683Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3443874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3444298Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1191 counts during 1135 steps 2024-12-18T00:21:05.3444303Z 2024-12-18T00:21:05.3444664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3444779Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3445071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3445184Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3445391Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3445544Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3445685Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3445865Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3446226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3446581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3446900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3447236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3447556Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3447825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3448122Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3448251Z Execution Analysis: (:1) 2024-12-18T00:21:05.3448508Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3448718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3448725Z 2024-12-18T00:21:05.3448928Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3449052Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3449290Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3449408Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3449615Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3449759Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3449918Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3450088Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3450689Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3451302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3451705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3452090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3452411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3452685Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3452995Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3453268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3453377Z Execution Analysis: .......... 2024-12-18T00:21:05.3453644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3453850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3454147Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1192 counts during 1136 steps 2024-12-18T00:21:05.3454152Z 2024-12-18T00:21:05.3454357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3454481Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3454771Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3454880Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3455091Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3455234Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3455382Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3455549Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3455913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3456262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3456686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3456973Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3457281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3457555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3457848Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3457982Z Execution Analysis: (:1) 2024-12-18T00:21:05.3458239Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3458449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3458454Z 2024-12-18T00:21:05.3458654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3458771Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3459010Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3459119Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3459331Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3459476Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3459633Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3459799Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3460420Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3461046Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3461436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3461796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3462110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3462387Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3462696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3462969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3463075Z Execution Analysis: .......... 2024-12-18T00:21:05.3463335Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3463543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3463839Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1193 counts during 1137 steps 2024-12-18T00:21:05.3463844Z 2024-12-18T00:21:05.3464052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3464167Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3464463Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3464572Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3464773Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3464925Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3465067Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3465240Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3465599Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3465987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3466302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3466569Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3466885Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3467153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3467456Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3467582Z Execution Analysis: (:1) 2024-12-18T00:21:05.3467852Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3468057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3468062Z 2024-12-18T00:21:05.3468269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3468386Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3468621Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3468838Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3469034Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3469179Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3469344Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3469509Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3470057Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3470623Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3470991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3471322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3471618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3471872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3472172Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3472422Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3472533Z Execution Analysis: .......... 2024-12-18T00:21:05.3472769Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3472962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3473238Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1194 counts during 1138 steps 2024-12-18T00:21:05.3473243Z 2024-12-18T00:21:05.3473432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3473551Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3473821Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3473936Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3474126Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3474270Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3474407Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3474563Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3474902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3475253Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3475553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3475806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3476102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3476351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3476625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3476749Z Execution Analysis: (:1) 2024-12-18T00:21:05.3476990Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3477188Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3477193Z 2024-12-18T00:21:05.3477380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3477495Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3477711Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3477816Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3478013Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3478171Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3478315Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3478470Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3479052Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3479609Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3479952Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3480277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3480566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3480826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3481114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3481376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3481475Z Execution Analysis: .......... 2024-12-18T00:21:05.3481721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3481914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3482191Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1195 counts during 1139 steps 2024-12-18T00:21:05.3482196Z 2024-12-18T00:21:05.3482383Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3482492Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3482766Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3482870Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3483073Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3483209Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3483349Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3483505Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3483865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3484198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3484486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3484752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3485036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3485295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3485566Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3485683Z Execution Analysis: (:1) 2024-12-18T00:21:05.3485924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3486117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3486121Z 2024-12-18T00:21:05.3486311Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3486417Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3486639Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3486742Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3486968Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3487099Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3487261Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3487424Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3487979Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3488544Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3488878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3489211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3489502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3489758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3490054Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3490303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3490408Z Execution Analysis: .......... 2024-12-18T00:21:05.3490651Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3490849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3491118Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1196 counts during 1140 steps 2024-12-18T00:21:05.3491122Z 2024-12-18T00:21:05.3491317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3491427Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3491699Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3491809Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3491997Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3492139Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3492271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3492462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3492794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3493121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3493415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3493670Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3493965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3494214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3494495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3494610Z Execution Analysis: (:1) 2024-12-18T00:21:05.3494862Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3495050Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3495054Z 2024-12-18T00:21:05.3495242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3495355Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3495571Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3495723Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3495916Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3496085Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3496222Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3496446Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3497215Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3497794Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3498165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3498516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3498842Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3499121Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3499437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3499710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3499820Z Execution Analysis: .......... 2024-12-18T00:21:05.3500084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3500288Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3500583Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1197 counts during 1141 steps 2024-12-18T00:21:05.3500588Z 2024-12-18T00:21:05.3500789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3500916Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3501207Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3501322Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3501536Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3501681Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3501859Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3502031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3502399Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3502750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3503067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3503344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3503652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3503925Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3504219Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3504358Z Execution Analysis: (:1) 2024-12-18T00:21:05.3504614Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3504827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3504832Z 2024-12-18T00:21:05.3505031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3505145Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3505428Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3505539Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3505797Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3505941Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3506101Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3506295Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3506892Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3507474Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3507837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3508200Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3508516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3508801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3509213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3509470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3509567Z Execution Analysis: .......... 2024-12-18T00:21:05.3509806Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3510001Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3510271Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1198 counts during 1142 steps 2024-12-18T00:21:05.3510277Z 2024-12-18T00:21:05.3510473Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3510581Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3510856Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3510959Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3511248Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3511385Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3511522Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3511686Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3512018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3512347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3512643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3512909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3513195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3513446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3513731Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3513849Z Execution Analysis: (:1) 2024-12-18T00:21:05.3514094Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3514283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3514287Z 2024-12-18T00:21:05.3514487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3514618Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3515005Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3515138Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3515342Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3515495Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3515975Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3516150Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3516732Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3517300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3517655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3517999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3518312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3518578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3518893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3519156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3519268Z Execution Analysis: .......... 2024-12-18T00:21:05.3519520Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3519728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3520015Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1200 counts during 1143 steps 2024-12-18T00:21:05.3520020Z 2024-12-18T00:21:05.3520221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3520354Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3520638Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3520783Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3520989Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3521140Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3521280Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3521446Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3521803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3522149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3522462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3522732Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3523040Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3523307Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3523591Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3523717Z Execution Analysis: (:1) 2024-12-18T00:21:05.3523969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3524172Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3524201Z 2024-12-18T00:21:05.3524398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3524513Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3524761Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3524876Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3525077Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3525247Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3525398Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3525562Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3526143Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3526703Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3527063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3527406Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3527715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3527985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3528284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3528550Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3528655Z Execution Analysis: .......... 2024-12-18T00:21:05.3528923Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3529121Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3529415Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1201 counts during 1144 steps 2024-12-18T00:21:05.3529421Z 2024-12-18T00:21:05.3529614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3529829Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3530149Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3530254Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3530454Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3530588Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3530732Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3530885Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3531216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3531545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3531835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3532096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3532384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3532641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3532908Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3533029Z Execution Analysis: (:1) 2024-12-18T00:21:05.3533269Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3533458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3533487Z 2024-12-18T00:21:05.3533682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3533815Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3534041Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3534144Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3534372Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3534507Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3534642Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3534804Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3535357Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3535900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3536235Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3536670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3537143Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3537430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3537743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3538012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3538131Z Execution Analysis: .......... 2024-12-18T00:21:05.3538390Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3538603Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3538898Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1202 counts during 1145 steps 2024-12-18T00:21:05.3538903Z 2024-12-18T00:21:05.3539116Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3539267Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3539569Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3539679Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3539883Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3540036Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3540179Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3540355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3540715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3541077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3541393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3541670Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3541990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3542259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3542563Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3542690Z Execution Analysis: (:1) 2024-12-18T00:21:05.3542954Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3543183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3543214Z 2024-12-18T00:21:05.3543421Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3543540Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3543775Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3543919Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3544290Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3544446Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3544593Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3544763Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3545364Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3545944Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3546313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3546669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3546989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3547260Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3547578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3547849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3547958Z Execution Analysis: .......... 2024-12-18T00:21:05.3548225Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3548430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3548733Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1203 counts during 1146 steps 2024-12-18T00:21:05.3548738Z 2024-12-18T00:21:05.3548999Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3549127Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3549417Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3549536Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3549739Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3549882Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3550036Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3550203Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3550568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3550917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3551241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3551517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3551828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3552104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3552397Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3552532Z Execution Analysis: (:1) 2024-12-18T00:21:05.3552833Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3553083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3553088Z 2024-12-18T00:21:05.3553291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3553417Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3553677Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3553791Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3554006Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3554151Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3554310Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3554475Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3555084Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3555661Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3556022Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3556381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3556795Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3557069Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3557378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3557654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3557759Z Execution Analysis: .......... 2024-12-18T00:21:05.3558026Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3558224Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3558506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1204 counts during 1147 steps 2024-12-18T00:21:05.3558537Z 2024-12-18T00:21:05.3558749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3558860Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3559158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3559263Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3559477Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3559621Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3559762Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3559938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3560290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3560648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3560954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3561237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3561538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3561805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3562210Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3562355Z Execution Analysis: (:1) 2024-12-18T00:21:05.3562605Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3562819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3562823Z 2024-12-18T00:21:05.3563062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3563168Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3563394Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3563500Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3563699Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3563846Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3563984Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3564155Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3564706Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3565256Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3565596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3565934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3566224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3566476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3566773Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3567025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3567138Z Execution Analysis: .......... 2024-12-18T00:21:05.3567381Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3567581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3567875Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1205 counts during 1148 steps 2024-12-18T00:21:05.3567880Z 2024-12-18T00:21:05.3568068Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3568186Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3568457Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3568573Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3568762Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3568909Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3569045Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3569199Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3569541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3569870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3570173Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3570427Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3570721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3570968Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3571278Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3571392Z Execution Analysis: (:1) 2024-12-18T00:21:05.3571656Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3571857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3571863Z 2024-12-18T00:21:05.3572074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3572192Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3572405Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3572520Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3572711Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3572843Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3572992Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3573149Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3573708Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3574242Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3574586Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3574916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3575221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3575473Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3575760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3576018Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3576120Z Execution Analysis: .......... 2024-12-18T00:21:05.3576433Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3576668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3577129Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1206 counts during 1149 steps 2024-12-18T00:21:05.3577134Z 2024-12-18T00:21:05.3577332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3577460Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3577749Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3577861Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3578078Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3578226Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3578387Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3578556Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3578919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3579286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3579599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3579883Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3580192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3580504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3580797Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3580963Z Execution Analysis: (:1) 2024-12-18T00:21:05.3581223Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3581452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3581469Z 2024-12-18T00:21:05.3581672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3581784Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3582024Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3582137Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3582357Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3582502Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3582651Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3582833Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3583427Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3584016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3584377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3584738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3585051Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3585339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3585646Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3585916Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3586032Z Execution Analysis: .......... 2024-12-18T00:21:05.3586316Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3586528Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3586819Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1207 counts during 1150 steps 2024-12-18T00:21:05.3586823Z 2024-12-18T00:21:05.3587039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3587152Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3587459Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3587569Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3587776Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3587929Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3588070Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3588249Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3588609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3589076Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3589361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3589616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3589937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3590185Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3590488Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3590604Z Execution Analysis: (:1) 2024-12-18T00:21:05.3590880Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3591069Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3591073Z 2024-12-18T00:21:05.3591268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3591375Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3591592Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3591708Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3591902Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3592048Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3592188Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3592355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3592908Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3593441Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3593787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3594113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3594418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3594675Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3594976Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3595224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3595363Z Execution Analysis: .......... 2024-12-18T00:21:05.3595605Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3595792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3596072Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1208 counts during 1151 steps 2024-12-18T00:21:05.3596077Z 2024-12-18T00:21:05.3596267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3596393Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3596661Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3596781Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3596971Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3597107Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3597253Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3597408Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3597748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3598071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3598370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3598650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3598937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3599231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3599502Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3599630Z Execution Analysis: (:1) 2024-12-18T00:21:05.3599892Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3600095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3600099Z 2024-12-18T00:21:05.3600287Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3600408Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3600624Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3600726Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3600930Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3601065Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3601216Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3601373Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3601939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3602468Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3602802Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3603137Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3603430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3603696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3603983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3604274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3604376Z Execution Analysis: .......... 2024-12-18T00:21:05.3604632Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3604819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3605087Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1209 counts during 1152 steps 2024-12-18T00:21:05.3605105Z 2024-12-18T00:21:05.3605292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3605404Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3605693Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3605796Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3605997Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3606135Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3606271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3606444Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3606776Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3607115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3607406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3607703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3608014Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3608274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3608572Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3608693Z Execution Analysis: (:1) 2024-12-18T00:21:05.3608952Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3609141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3609145Z 2024-12-18T00:21:05.3609345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3609456Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3609688Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3609791Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3609984Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3610133Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3610268Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3610440Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3610989Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3611531Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3611863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3612202Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3612493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3612747Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3613066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3613317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3613422Z Execution Analysis: .......... 2024-12-18T00:21:05.3613661Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3613858Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3614128Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1210 counts during 1153 steps 2024-12-18T00:21:05.3614134Z 2024-12-18T00:21:05.3614333Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3614438Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3614705Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3614816Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3615008Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3615156Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3615287Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3615454Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3615786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3616113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3616511Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3616965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3617287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3617583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3617890Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3618014Z Execution Analysis: (:1) 2024-12-18T00:21:05.3618272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3618483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3618487Z 2024-12-18T00:21:05.3618694Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3618819Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3619051Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3619176Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3619383Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3619528Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3619687Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3619857Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3620465Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3621040Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3621413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3621766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3622089Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3622393Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3622704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3622981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3623089Z Execution Analysis: .......... 2024-12-18T00:21:05.3623357Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3623560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3623868Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1211 counts during 1154 steps 2024-12-18T00:21:05.3623875Z 2024-12-18T00:21:05.3624075Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3624204Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3624497Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3624609Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3624823Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3624966Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3625121Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3625290Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3625661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3626038Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3626353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3626664Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3626972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3627280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3627574Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3627712Z Execution Analysis: (:1) 2024-12-18T00:21:05.3627968Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3628185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3628191Z 2024-12-18T00:21:05.3628391Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3628505Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3628746Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3628853Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3629183Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3629428Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3629581Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3629736Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3630285Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3630832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3631166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3631504Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3631795Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3632087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3632371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3632633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3632732Z Execution Analysis: .......... 2024-12-18T00:21:05.3632971Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3633169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3633438Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1212 counts during 1155 steps 2024-12-18T00:21:05.3633444Z 2024-12-18T00:21:05.3633641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3633747Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3634031Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3634133Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3634328Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3634470Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3634604Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3634770Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3635142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3635476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3635789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3636042Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3636367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3636617Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3636896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3637015Z Execution Analysis: (:1) 2024-12-18T00:21:05.3637260Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3637452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3637456Z 2024-12-18T00:21:05.3637661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3637765Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3637979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3638097Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3638290Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3638436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3638572Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3638738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3639286Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3639820Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3640167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3640497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3640821Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3641080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3641376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3641625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3641734Z Execution Analysis: .......... 2024-12-18T00:21:05.3641974Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3642163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3642445Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1213 counts during 1156 steps 2024-12-18T00:21:05.3642449Z 2024-12-18T00:21:05.3642641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3642757Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3643025Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3643141Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3643327Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3643461Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3643603Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3643789Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3644125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3644798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3645118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3645445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3645765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3646032Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3646326Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3646459Z Execution Analysis: (:1) 2024-12-18T00:21:05.3646724Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3646939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3646946Z 2024-12-18T00:21:05.3647149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3647273Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3647510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3647621Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3647838Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3647982Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3648137Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3648305Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3648908Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3649487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3649857Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3650244Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3650559Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3650838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3651154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3651432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3651541Z Execution Analysis: .......... 2024-12-18T00:21:05.3651807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3652012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3652311Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1214 counts during 1157 steps 2024-12-18T00:21:05.3652316Z 2024-12-18T00:21:05.3652522Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3652637Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3652936Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3653047Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3653258Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3653403Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3653597Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3653764Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3654158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3654519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3654928Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3655209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3655516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3655799Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3656090Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3656214Z Execution Analysis: (:1) 2024-12-18T00:21:05.3656554Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3656761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3656766Z 2024-12-18T00:21:05.3656973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3657088Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3657327Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3657438Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3657653Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3657797Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3657945Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3658122Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3658722Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3659307Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3659699Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3660058Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3660369Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3660643Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3660955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3661224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3661335Z Execution Analysis: .......... 2024-12-18T00:21:05.3661593Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3661805Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3662099Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1215 counts during 1158 steps 2024-12-18T00:21:05.3662104Z 2024-12-18T00:21:05.3662312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3662424Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3662716Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3662829Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3663033Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3663209Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3663350Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3663549Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3663907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3664286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3664603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3664879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3665193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3665462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3665762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3665885Z Execution Analysis: (:1) 2024-12-18T00:21:05.3666152Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3666353Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3666357Z 2024-12-18T00:21:05.3666559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3666680Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3666913Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3667027Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3667235Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3667387Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3667536Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3667705Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3668306Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3669012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3669353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3669677Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3669969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3670223Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3670517Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3670765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3670865Z Execution Analysis: .......... 2024-12-18T00:21:05.3671108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3671298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3671571Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1216 counts during 1159 steps 2024-12-18T00:21:05.3671575Z 2024-12-18T00:21:05.3671764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3671881Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3672151Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3672281Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3672481Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3672614Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3672776Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3672931Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3673268Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3673617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3673915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3674167Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3674451Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3674705Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3674978Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3675104Z Execution Analysis: (:1) 2024-12-18T00:21:05.3675342Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3675538Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3675542Z 2024-12-18T00:21:05.3675727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3675833Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3676051Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3676156Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3676354Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3676490Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3676627Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3676786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3677334Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3677901Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3678232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3678561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3678850Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3679114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3679401Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3679661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3679759Z Execution Analysis: .......... 2024-12-18T00:21:05.3680001Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3680199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3680470Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1217 counts during 1160 steps 2024-12-18T00:21:05.3680474Z 2024-12-18T00:21:05.3680670Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3680774Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3681048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3681175Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3681370Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3681529Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3681661Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3681825Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3682178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3682516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3682807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3683070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3683355Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3683603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3683885Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3684002Z Execution Analysis: (:1) 2024-12-18T00:21:05.3684246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3684440Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3684444Z 2024-12-18T00:21:05.3684636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3684740Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3684959Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3688449Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3688688Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3688832Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3688972Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3689133Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3689755Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3690289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3690629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3690955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3691249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3691504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3691798Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3692047Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3692150Z Execution Analysis: .......... 2024-12-18T00:21:05.3692396Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3692584Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3692857Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1218 counts during 1161 steps 2024-12-18T00:21:05.3692864Z 2024-12-18T00:21:05.3693051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3693192Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3693462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3693598Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3693786Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3693921Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3694058Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3694243Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3694577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3694898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3695191Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3695442Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3695728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3695985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3696254Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3696476Z Execution Analysis: (:1) 2024-12-18T00:21:05.3696721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3697086Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3697091Z 2024-12-18T00:21:05.3697292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3697409Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3697637Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3697747Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3697955Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3698097Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3698247Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3698411Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3699044Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3699620Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3699987Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3700339Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3700649Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3700926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3701232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3701506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3701609Z Execution Analysis: .......... 2024-12-18T00:21:05.3701873Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3702075Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3702363Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1219 counts during 1162 steps 2024-12-18T00:21:05.3702372Z 2024-12-18T00:21:05.3702572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3702713Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3703008Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3703145Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3703354Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3703495Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3703678Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3703851Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3704206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3704559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3704867Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3705142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3705445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3705718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3706008Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3706134Z Execution Analysis: (:1) 2024-12-18T00:21:05.3706395Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3706596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3706601Z 2024-12-18T00:21:05.3706805Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3706917Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3707149Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3707256Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3707463Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3707613Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3707760Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3707957Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3708552Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3709223Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3709552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3709880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3710170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3710420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3710710Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3710959Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3711061Z Execution Analysis: .......... 2024-12-18T00:21:05.3711298Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3711486Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3711753Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1221 counts during 1163 steps 2024-12-18T00:21:05.3711781Z 2024-12-18T00:21:05.3711970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3712098Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3712367Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3712475Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3712690Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3712830Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3712960Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3713119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3713446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3713767Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3714063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3714314Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3714605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3714851Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3715129Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3715244Z Execution Analysis: (:1) 2024-12-18T00:21:05.3715482Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3715672Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3715676Z 2024-12-18T00:21:05.3715860Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3715969Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3716181Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3716291Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3716482Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3716620Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3716780Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3716939Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3717489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3718203Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3718558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3718903Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3719217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3719480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3719782Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3720046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3720148Z Execution Analysis: .......... 2024-12-18T00:21:05.3720405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3720602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3720913Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1222 counts during 1164 steps 2024-12-18T00:21:05.3720918Z 2024-12-18T00:21:05.3721113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3721253Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3721537Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3721669Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3721872Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3722009Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3722150Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3722312Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3722664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3723007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3723307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3723580Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3723875Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3724148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3724427Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3724552Z Execution Analysis: (:1) 2024-12-18T00:21:05.3724800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3725002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3725008Z 2024-12-18T00:21:05.3725202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3725312Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3725538Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3725643Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3725847Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3726012Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3726159Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3726321Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3726896Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3727458Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3727806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3728152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3728452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3728726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3729024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3729288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3729387Z Execution Analysis: .......... 2024-12-18T00:21:05.3729740Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3729956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3730223Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1223 counts during 1165 steps 2024-12-18T00:21:05.3730252Z 2024-12-18T00:21:05.3730441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3730545Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3730840Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3730941Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3731127Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3731263Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3731393Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3731553Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3731884Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3732214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3732503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3732757Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3733042Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3733286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3733559Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3733672Z Execution Analysis: (:1) 2024-12-18T00:21:05.3733912Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3734099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3734103Z 2024-12-18T00:21:05.3734293Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3734397Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3734607Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3734713Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3734930Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3735065Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3735200Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3735360Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3735908Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3736517Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3737029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3737379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3737700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3737972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3738283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3738548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3738658Z Execution Analysis: .......... 2024-12-18T00:21:05.3738912Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3739145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3739476Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1224 counts during 1166 steps 2024-12-18T00:21:05.3739482Z 2024-12-18T00:21:05.3739684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3739831Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3740125Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3740236Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3740441Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3740591Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3740732Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3740898Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3741260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3741612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3741927Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3742203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3742509Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3742775Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3743069Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3743196Z Execution Analysis: (:1) 2024-12-18T00:21:05.3743451Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3743657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3743663Z 2024-12-18T00:21:05.3743862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3743980Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3744409Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3744519Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3744730Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3744869Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3745021Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3745188Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3745787Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3746363Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3746727Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3747079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3747391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3747666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3747974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3748245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3748387Z Execution Analysis: .......... 2024-12-18T00:21:05.3748650Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3748886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3749180Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1225 counts during 1167 steps 2024-12-18T00:21:05.3749185Z 2024-12-18T00:21:05.3749417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3749532Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3749823Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3749930Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3750136Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3750278Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3750424Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3750588Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3750943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3751299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3751614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3751891Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3752196Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3752467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3752759Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3752883Z Execution Analysis: (:1) 2024-12-18T00:21:05.3753147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3753351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3753355Z 2024-12-18T00:21:05.3753559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3753848Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3754089Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3754197Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3754410Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3754553Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3754701Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3754883Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3755479Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3756169Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3756613Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3756950Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3757234Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3757492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3757772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3758044Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3758144Z Execution Analysis: .......... 2024-12-18T00:21:05.3758384Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3758602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3758871Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1226 counts during 1168 steps 2024-12-18T00:21:05.3758911Z 2024-12-18T00:21:05.3759103Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3759207Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3759474Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3759581Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3759770Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3759909Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3760039Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3760199Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3760532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3760854Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3761151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3761400Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3761691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3761938Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3762215Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3762329Z Execution Analysis: (:1) 2024-12-18T00:21:05.3762572Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3762760Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3762765Z 2024-12-18T00:21:05.3762977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3763085Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3763294Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3763397Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3763585Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3763724Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3763858Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3764011Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3764569Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3765097Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3765438Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3765763Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3766056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3766306Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3766596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3766865Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3766990Z Execution Analysis: .......... 2024-12-18T00:21:05.3767231Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3767416Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3767714Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1227 counts during 1169 steps 2024-12-18T00:21:05.3767718Z 2024-12-18T00:21:05.3767904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3768011Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3768277Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3768376Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3768569Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3768698Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3768834Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3768986Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3769322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3769648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3769938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3770186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3770468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3770720Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3770993Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3771112Z Execution Analysis: (:1) 2024-12-18T00:21:05.3771350Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3771542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3771573Z 2024-12-18T00:21:05.3771759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3771860Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3772074Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3772177Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3772371Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3772501Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3772643Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3772795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3773339Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3773880Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3774212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3774537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3774822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3775077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3775398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3775671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3775770Z Execution Analysis: .......... 2024-12-18T00:21:05.3776007Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3776222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3776568Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1228 counts during 1170 steps 2024-12-18T00:21:05.3776574Z 2024-12-18T00:21:05.3776935Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3777048Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3777346Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3777457Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3777666Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3777809Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3777953Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3778126Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3778488Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3778849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3779158Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3779440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3779746Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3780017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3780312Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3780439Z Execution Analysis: (:1) 2024-12-18T00:21:05.3780705Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3780939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3780944Z 2024-12-18T00:21:05.3781151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3781263Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3781499Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3781614Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3781821Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3781972Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3782116Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3782292Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3782886Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3783474Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3783831Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3784184Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3784501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3784801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3785115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3785407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3785516Z Execution Analysis: .......... 2024-12-18T00:21:05.3785801Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3786012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3786299Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1229 counts during 1171 steps 2024-12-18T00:21:05.3786303Z 2024-12-18T00:21:05.3786507Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3786628Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3786920Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3787036Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3787239Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3787383Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3787521Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3787692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3788050Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3788400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3788714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3789089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3789376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3789622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3789890Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3790009Z Execution Analysis: (:1) 2024-12-18T00:21:05.3790271Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3790462Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3790467Z 2024-12-18T00:21:05.3790651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3790760Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3790968Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3791075Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3791266Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3791397Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3791537Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3791691Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3792247Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3792779Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3793113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3795126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3795472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3795740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3797389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3797654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3797760Z Execution Analysis: .......... 2024-12-18T00:21:05.3798002Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3798197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3798467Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1230 counts during 1172 steps 2024-12-18T00:21:05.3798472Z 2024-12-18T00:21:05.3798695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3798799Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3799068Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3799179Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3799381Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3799512Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3799648Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3799801Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3800138Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3800462Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3800745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3801007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3801289Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3801547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3801824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3801943Z Execution Analysis: (:1) 2024-12-18T00:21:05.3802181Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3802373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3802377Z 2024-12-18T00:21:05.3802562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3802664Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3802892Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3802991Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3803195Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3803330Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3803473Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3803625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3804175Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3804712Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3805043Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3805539Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3805826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3806117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3806450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3806706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3806803Z Execution Analysis: .......... 2024-12-18T00:21:05.3807039Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3807231Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3807495Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1231 counts during 1173 steps 2024-12-18T00:21:05.3807503Z 2024-12-18T00:21:05.3807698Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3807801Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3808080Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3808183Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3808370Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3808511Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3808641Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3808803Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3809131Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3809462Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3809749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3810008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3810297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3810546Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3810824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3810939Z Execution Analysis: (:1) 2024-12-18T00:21:05.3811184Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3811369Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3811374Z 2024-12-18T00:21:05.3811568Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3811673Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3811885Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3811994Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3812183Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3812323Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3812455Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3812617Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3813163Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3813695Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3814062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3814414Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3814728Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3815006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3815299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3815548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3815653Z Execution Analysis: .......... 2024-12-18T00:21:05.3815890Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3816075Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3816436Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1232 counts during 1174 steps 2024-12-18T00:21:05.3816443Z 2024-12-18T00:21:05.3816632Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3816746Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3817204Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3817323Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3817526Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3817677Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3817819Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3817985Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3818351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3818704Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3819025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3819299Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3819615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3819883Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3820171Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3820303Z Execution Analysis: (:1) 2024-12-18T00:21:05.3820556Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3820770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3820774Z 2024-12-18T00:21:05.3820979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3821095Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3821324Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3821437Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3821645Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3821785Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3821939Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3822102Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3822704Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3823306Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3823696Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3824072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3824407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3824687Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3824995Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3825272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3825377Z Execution Analysis: .......... 2024-12-18T00:21:05.3825640Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3825844Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3826141Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1233 counts during 1175 steps 2024-12-18T00:21:05.3826148Z 2024-12-18T00:21:05.3826349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3826463Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3826757Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3826864Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3827076Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3827219Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3827364Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3827527Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3827883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3828236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3828546Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3828829Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3829241Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3829604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3829872Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3829982Z Execution Analysis: (:1) 2024-12-18T00:21:05.3830227Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3830414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3830420Z 2024-12-18T00:21:05.3830612Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3830716Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3830939Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3831040Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3831236Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3831368Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3831502Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3831662Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3832209Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3832771Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3833126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3833505Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3833792Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3834051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3834338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3834583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3834687Z Execution Analysis: .......... 2024-12-18T00:21:05.3834925Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3835124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3835392Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1234 counts during 1176 steps 2024-12-18T00:21:05.3835396Z 2024-12-18T00:21:05.3835588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3835693Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3835959Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3836068Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3836256Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3836394Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3836523Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3836686Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3837022Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3837343Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3837641Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3837890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3838178Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3838423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3838700Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3838816Z Execution Analysis: (:1) 2024-12-18T00:21:05.3839060Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3839249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3839255Z 2024-12-18T00:21:05.3839441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3839556Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3839768Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3839873Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3840064Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3840206Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3840345Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3840497Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3841080Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3841634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3842037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3842358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3842655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3842911Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3843201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3843452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3843547Z Execution Analysis: .......... 2024-12-18T00:21:05.3843797Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3843982Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3844394Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1235 counts during 1177 steps 2024-12-18T00:21:05.3844561Z 2024-12-18T00:21:05.3844926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3845048Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3845340Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3845452Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3845655Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3845795Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3845945Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3846110Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3846472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3846827Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3847146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3847418Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3847725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3848000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3848289Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3848423Z Execution Analysis: (:1) 2024-12-18T00:21:05.3848683Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3848891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3848897Z 2024-12-18T00:21:05.3849098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3849208Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3849444Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3849550Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3849761Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3849901Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3850055Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3850219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3850874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3851491Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3851917Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3852276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3852586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3852864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3853174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3853451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3853557Z Execution Analysis: .......... 2024-12-18T00:21:05.3853813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3854023Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3854315Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1236 counts during 1178 steps 2024-12-18T00:21:05.3854320Z 2024-12-18T00:21:05.3854529Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3854642Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3854940Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3855049Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3855258Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3855404Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3855545Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3855719Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3856076Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3856507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3856819Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3857103Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3857411Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3857678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3857976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3858101Z Execution Analysis: (:1) 2024-12-18T00:21:05.3858369Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3858573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3858580Z 2024-12-18T00:21:05.3858791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3858904Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3859139Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3859248Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3859455Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3859606Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3859752Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3859988Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3860584Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3861215Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3861576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3861927Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3862245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3862518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3862840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3863108Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3863223Z Execution Analysis: .......... 2024-12-18T00:21:05.3863482Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3863696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3863988Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1237 counts during 1179 steps 2024-12-18T00:21:05.3863992Z 2024-12-18T00:21:05.3864192Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3864314Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3864602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3864718Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3864922Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3865076Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3865217Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3865390Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3865750Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3866109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3866419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3866695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3867013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3867280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3867584Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3867708Z Execution Analysis: (:1) 2024-12-18T00:21:05.3867974Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3868180Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3868185Z 2024-12-18T00:21:05.3868392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3868507Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3868837Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3868948Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3869139Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3869276Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3869462Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3869625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3870175Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3870758Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3871097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3871423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3871720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3871977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3872276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3872524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3872632Z Execution Analysis: .......... 2024-12-18T00:21:05.3872870Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3873061Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3873336Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1238 counts during 1180 steps 2024-12-18T00:21:05.3873340Z 2024-12-18T00:21:05.3873530Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3873647Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3873916Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3874034Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3874223Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3874354Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3874492Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3874650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3874989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3875313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3875606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3875859Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3876151Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3876402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3876670Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3876792Z Execution Analysis: (:1) 2024-12-18T00:21:05.3877032Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3877225Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3877229Z 2024-12-18T00:21:05.3877416Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3877529Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3877741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3877843Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3878069Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3878235Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3878377Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3878555Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3879128Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3879660Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3879997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3880321Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3880609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3880872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3881159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3881418Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3881517Z Execution Analysis: .......... 2024-12-18T00:21:05.3881764Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3881953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3882219Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1239 counts during 1181 steps 2024-12-18T00:21:05.3882230Z 2024-12-18T00:21:05.3882415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3882520Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3882793Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3882895Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3883088Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3883222Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3883355Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3883512Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3883842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3884172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3884462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3884719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3885006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3885263Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3885534Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3885651Z Execution Analysis: (:1) 2024-12-18T00:21:05.3885892Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3886079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3886083Z 2024-12-18T00:21:05.3886278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3886383Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3886605Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3886732Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3886950Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3887091Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3887252Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3887414Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3887987Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3888525Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3888857Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3889190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3889479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3889735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3890028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3890280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3890387Z Execution Analysis: .......... 2024-12-18T00:21:05.3890622Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3890815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3891083Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1240 counts during 1182 steps 2024-12-18T00:21:05.3891087Z 2024-12-18T00:21:05.3891276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3891388Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3891658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3891775Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3891963Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3892106Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3892238Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3892402Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3892730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3893056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3893351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3893605Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3893901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3894151Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3894424Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3894542Z Execution Analysis: (:1) 2024-12-18T00:21:05.3894782Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3894974Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3894978Z 2024-12-18T00:21:05.3895165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3895274Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3895514Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3895648Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3895841Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3896006Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3896165Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3896319Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3897125Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3897699Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3898063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3898417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3898736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3899012Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3899336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3899604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3899712Z Execution Analysis: .......... 2024-12-18T00:21:05.3899980Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3900181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3900479Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1242 counts during 1183 steps 2024-12-18T00:21:05.3900483Z 2024-12-18T00:21:05.3900689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3900811Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3901103Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3901213Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3901425Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3901568Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3901719Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3901885Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3902249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3902599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3902913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3903195Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3903502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3903779Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3904071Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3904200Z Execution Analysis: (:1) 2024-12-18T00:21:05.3904459Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3904667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3904671Z 2024-12-18T00:21:05.3904869Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3905046Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3905287Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3905397Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3905638Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3905806Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3905959Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3906124Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3906716Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3907296Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3907658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3908018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3908331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3908616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3908930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3909301Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3909400Z Execution Analysis: .......... 2024-12-18T00:21:05.3909642Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3909834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3910107Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1243 counts during 1184 steps 2024-12-18T00:21:05.3910113Z 2024-12-18T00:21:05.3910308Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3910419Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3910702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3910804Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3910996Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3911136Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3911270Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3911434Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3911764Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3912096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3912387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3912645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3912929Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3913178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3913458Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3913574Z Execution Analysis: (:1) 2024-12-18T00:21:05.3913820Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3914009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3914013Z 2024-12-18T00:21:05.3914243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3914375Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3914589Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3914724Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3914939Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3915080Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3915218Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3915382Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3915932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3916471Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3916806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3917133Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3917429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3917850Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3918167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3918433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3918544Z Execution Analysis: .......... 2024-12-18T00:21:05.3918795Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3918994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3919286Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1244 counts during 1185 steps 2024-12-18T00:21:05.3919291Z 2024-12-18T00:21:05.3919487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3919603Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3919885Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3919994Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3920189Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3920334Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3920469Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3920633Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3920991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3921335Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3921643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3921908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3922215Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3922478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3922763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3922889Z Execution Analysis: (:1) 2024-12-18T00:21:05.3923137Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3923365Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3923396Z 2024-12-18T00:21:05.3923593Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3923734Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3923959Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3924100Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3924301Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3924443Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3924592Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3924754Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3925336Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3925895Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3926255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3926597Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3926903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3927175Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3927474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3927743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3927843Z Execution Analysis: .......... 2024-12-18T00:21:05.3928099Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3928299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3928589Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1245 counts during 1186 steps 2024-12-18T00:21:05.3928596Z 2024-12-18T00:21:05.3928792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3928904Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3929189Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3929299Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3929503Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3929746Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3929886Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3930044Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3930377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3930706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3930995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3931260Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3931544Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3931801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3932070Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3932188Z Execution Analysis: (:1) 2024-12-18T00:21:05.3932428Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3932667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3932672Z 2024-12-18T00:21:05.3932867Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3932996Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3933243Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3933346Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3933547Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3933682Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3933819Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3933980Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3934527Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3935068Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3935403Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3935736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3936025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3936285Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3936646Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3937071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3937187Z Execution Analysis: .......... 2024-12-18T00:21:05.3937448Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3937662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3937952Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1246 counts during 1187 steps 2024-12-18T00:21:05.3937959Z 2024-12-18T00:21:05.3938174Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3938288Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3938576Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3938697Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3938902Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3939056Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3939198Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3939377Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3939734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3940088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3940407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3940681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3940997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3941267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3941564Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3941690Z Execution Analysis: (:1) 2024-12-18T00:21:05.3941982Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3942211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3942239Z 2024-12-18T00:21:05.3942475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3942599Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3942826Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3942939Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3943147Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3943301Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3943445Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3943615Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3944373Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3944950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3945323Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3945675Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3945993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3946265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3946578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3946844Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3946954Z Execution Analysis: .......... 2024-12-18T00:21:05.3947216Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3947423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3947722Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1247 counts during 1188 steps 2024-12-18T00:21:05.3947727Z 2024-12-18T00:21:05.3947928Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3948047Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3948335Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3948449Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3948654Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3948796Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3948946Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3949115Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3949478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3949832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3950150Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3950422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3950729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3951003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3951294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3951621Z Execution Analysis: (:1) 2024-12-18T00:21:05.3951881Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3952130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3952135Z 2024-12-18T00:21:05.3952380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3952501Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3952742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3952857Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3953078Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3953224Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3953382Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3953553Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3954151Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3954737Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3955100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3955466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3955781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3956067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3956605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3956871Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3956974Z Execution Analysis: .......... 2024-12-18T00:21:05.3957216Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3957425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3957696Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1248 counts during 1189 steps 2024-12-18T00:21:05.3957700Z 2024-12-18T00:21:05.3957900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3958007Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3958291Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3958394Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3958595Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3958730Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3958866Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3959032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3959365Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3959703Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3959993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3960255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3960540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3960789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3961087Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3961226Z Execution Analysis: (:1) 2024-12-18T00:21:05.3961476Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3961715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3961719Z 2024-12-18T00:21:05.3961914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3962020Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3962245Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3962347Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3962545Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3962689Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3962827Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3962994Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3963545Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3964088Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3964423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3964747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3965039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3965290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3965584Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3965834Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3965942Z Execution Analysis: .......... 2024-12-18T00:21:05.3966180Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3966374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3966641Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1249 counts during 1190 steps 2024-12-18T00:21:05.3966645Z 2024-12-18T00:21:05.3966834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3966948Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3967216Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3967327Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3967519Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3967658Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3967793Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3967946Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3968283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3968608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3968907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3969162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3969456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3969729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3970027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3970174Z Execution Analysis: (:1) 2024-12-18T00:21:05.3970436Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3970632Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3970636Z 2024-12-18T00:21:05.3970824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3970939Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3971153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3971262Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3971453Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3971595Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3971738Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3971894Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3972456Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3972988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3973329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3973655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3973954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3974209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3974500Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3974762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3974865Z Execution Analysis: .......... 2024-12-18T00:21:05.3975116Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3975304Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3975584Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1250 counts during 1191 steps 2024-12-18T00:21:05.3975588Z 2024-12-18T00:21:05.3975775Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3975883Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3976163Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3976270Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3976553Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3976693Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3977002Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3977174Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3977534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3977898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3978213Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3978495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3978837Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3979142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3979436Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3979612Z Execution Analysis: (:1) 2024-12-18T00:21:05.3979896Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3980103Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3980107Z 2024-12-18T00:21:05.3980317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3980432Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3980671Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3980782Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3981007Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3981149Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3981299Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3981472Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3982069Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3982656Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3983015Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3983379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3983694Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3983980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3984288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3984561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3984672Z Execution Analysis: .......... 2024-12-18T00:21:05.3984930Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3985140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3985429Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1251 counts during 1192 steps 2024-12-18T00:21:05.3985433Z 2024-12-18T00:21:05.3985643Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3985757Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3986060Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3986170Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3986374Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3986526Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3986671Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3986845Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3987202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3987559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3987870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3988268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3988611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3988884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3989331Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3989448Z Execution Analysis: (:1) 2024-12-18T00:21:05.3989698Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3989892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3989896Z 2024-12-18T00:21:05.3990095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3990200Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3990418Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3990534Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3990728Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3990871Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3991009Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.3991168Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3991722Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.3992254Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.3992594Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.3992921Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3993223Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3993478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3993775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3994022Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3994121Z Execution Analysis: .......... 2024-12-18T00:21:05.3994366Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3994555Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3994830Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1252 counts during 1193 steps 2024-12-18T00:21:05.3994834Z 2024-12-18T00:21:05.3995020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3995139Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3995406Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.3995519Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3995709Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.3995845Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.3995986Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.3996142Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.3996477Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.3996802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.3997101Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.3997404Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.3997694Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.3997974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.3998270Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.3998398Z Execution Analysis: (:1) 2024-12-18T00:21:05.3998641Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.3998837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3998841Z 2024-12-18T00:21:05.3999033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.3999148Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.3999368Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.3999473Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.3999674Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.3999810Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.3999957Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4000112Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4000668Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4001203Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4001540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4001880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4002169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4002435Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4002724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4002981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4003080Z Execution Analysis: .......... 2024-12-18T00:21:05.4003329Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4003518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4003788Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1253 counts during 1194 steps 2024-12-18T00:21:05.4003796Z 2024-12-18T00:21:05.4003996Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4004102Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4004383Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4004488Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4004685Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4004818Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4004950Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4005112Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4005445Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4005785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4006121Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4006385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4006695Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4006967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4007246Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4007362Z Execution Analysis: (:1) 2024-12-18T00:21:05.4007605Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4007793Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4007797Z 2024-12-18T00:21:05.4007997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4008105Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4008322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4008423Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4008617Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4008766Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4008899Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4009063Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4009615Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4010156Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4010489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4010822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4011110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4011365Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4011657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4011902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4012011Z Execution Analysis: .......... 2024-12-18T00:21:05.4012250Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4012447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4012720Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1254 counts during 1195 steps 2024-12-18T00:21:05.4012725Z 2024-12-18T00:21:05.4012920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4013028Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4013300Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4013414Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4013603Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4013748Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4013877Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4014032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4014371Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4014714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4015050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4015328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4015644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4015892Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4016169Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4016283Z Execution Analysis: (:1) 2024-12-18T00:21:05.4016605Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4016972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4016980Z 2024-12-18T00:21:05.4017183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4017309Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4017541Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4017668Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4017879Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4018023Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4018182Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4018350Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4018960Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4019538Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4019907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4020261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4020587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4020863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4021170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4021449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4021554Z Execution Analysis: .......... 2024-12-18T00:21:05.4021821Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4022025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4022328Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1255 counts during 1196 steps 2024-12-18T00:21:05.4022335Z 2024-12-18T00:21:05.4022535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4022661Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4022954Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4023064Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4023276Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4023417Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4023571Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4023739Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4024135Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4024512Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4024849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4025163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4025473Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4025750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4026039Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4026173Z Execution Analysis: (:1) 2024-12-18T00:21:05.4026427Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4026632Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4026648Z 2024-12-18T00:21:05.4026849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4026965Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4027207Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4027316Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4027536Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4027676Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4027822Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4027997Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4028595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4029289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4029733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4030074Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4030363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4030630Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4030917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4031173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4031269Z Execution Analysis: .......... 2024-12-18T00:21:05.4031507Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4031707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4031975Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1256 counts during 1197 steps 2024-12-18T00:21:05.4031979Z 2024-12-18T00:21:05.4032179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4032284Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4032559Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4032663Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4032851Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4032997Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4033127Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4033316Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4033669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4034005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4034347Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4034601Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4034896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4035143Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4035425Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4035539Z Execution Analysis: (:1) 2024-12-18T00:21:05.4035791Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4035984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4035990Z 2024-12-18T00:21:05.4036186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4036293Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4036507Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4036618Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4036810Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4036954Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4037087Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4037254Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4037806Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4038341Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4038687Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4039011Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4039308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4039568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4039857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4040106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4040211Z Execution Analysis: .......... 2024-12-18T00:21:05.4040449Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4040640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4040919Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1257 counts during 1198 steps 2024-12-18T00:21:05.4040923Z 2024-12-18T00:21:05.4041273Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4041388Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4041670Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4041789Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4041990Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4042132Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4042305Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4042496Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4042850Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4043240Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4043549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4043816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4044123Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4044713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4045007Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4045137Z Execution Analysis: (:1) 2024-12-18T00:21:05.4045397Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4045605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4045611Z 2024-12-18T00:21:05.4045819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4045943Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4046176Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4046287Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4046501Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4046644Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4046798Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4046968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4047576Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4048148Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4048519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4048872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4049183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4049461Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4049769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4050045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4050149Z Execution Analysis: .......... 2024-12-18T00:21:05.4050410Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4050615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4050908Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1258 counts during 1199 steps 2024-12-18T00:21:05.4050919Z 2024-12-18T00:21:05.4051116Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4051226Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4051523Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4051631Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4051837Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4052055Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4052229Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4052404Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4052794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4053182Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4053497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4053773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4054080Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4054351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4054645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4054771Z Execution Analysis: (:1) 2024-12-18T00:21:05.4055034Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4055239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4055244Z 2024-12-18T00:21:05.4055449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4055559Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4055794Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4055901Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4056108Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4056259Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4056477Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4056659Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4057252Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4057838Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4058196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4058557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4058867Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4059141Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4059456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4059727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4059835Z Execution Analysis: .......... 2024-12-18T00:21:05.4060097Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4060305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4060596Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1259 counts during 1200 steps 2024-12-18T00:21:05.4060601Z 2024-12-18T00:21:05.4060807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4060919Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4061209Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4061323Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4061554Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4061727Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4061871Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4062070Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4062452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4062806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4063125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4063398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4063714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4063985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4064284Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4064408Z Execution Analysis: (:1) 2024-12-18T00:21:05.4064664Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4064877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4064882Z 2024-12-18T00:21:05.4065083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4065201Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4065430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4065544Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4065751Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4065900Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4066048Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4066218Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4066817Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4067396Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4067761Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4068112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4068429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4068706Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4069117Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4069365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4069465Z Execution Analysis: .......... 2024-12-18T00:21:05.4069713Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4069900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4070171Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1260 counts during 1201 steps 2024-12-18T00:21:05.4070175Z 2024-12-18T00:21:05.4070363Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4070474Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4070741Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4070889Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4071084Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4071243Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4071375Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4071555Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4071896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4072222Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4072508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4072766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4073049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4073304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4073573Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4073693Z Execution Analysis: (:1) 2024-12-18T00:21:05.4073933Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4074130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4074134Z 2024-12-18T00:21:05.4074320Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4074425Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4074643Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4074746Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4074949Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4075085Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4075229Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4075382Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4075932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4076467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4076800Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4077126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4077413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4077676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4077959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4078215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4078314Z Execution Analysis: .......... 2024-12-18T00:21:05.4078551Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4078745Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4079013Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1261 counts during 1202 steps 2024-12-18T00:21:05.4079017Z 2024-12-18T00:21:05.4079213Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4079319Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4079641Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4079744Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4079959Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4080099Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4080263Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4083786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4084167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4084502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4084792Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4085050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4085346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4085594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4085870Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4085986Z Execution Analysis: (:1) 2024-12-18T00:21:05.4086231Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4086419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4086425Z 2024-12-18T00:21:05.4086614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4086718Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4086929Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4087037Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4087233Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4087370Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4087506Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4087657Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4088221Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4088755Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4089092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4089419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4089718Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4089974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4090263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4090514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4090609Z Execution Analysis: .......... 2024-12-18T00:21:05.4090856Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4091043Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4091484Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1263 counts during 1203 steps 2024-12-18T00:21:05.4091490Z 2024-12-18T00:21:05.4091752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4091897Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4092178Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4092320Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4092516Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4092754Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4092899Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4093059Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4093414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4093757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4094064Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4094331Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4094629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4094894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4095177Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4095303Z Execution Analysis: (:1) 2024-12-18T00:21:05.4095553Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4095753Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4095757Z 2024-12-18T00:21:05.4095950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4096063Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4096285Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4096474Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4096683Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4096986Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4097139Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4097304Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4097902Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4098473Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4098827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4099184Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4099495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4099776Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4100083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4100353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4100453Z Execution Analysis: .......... 2024-12-18T00:21:05.4100713Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4100911Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4101203Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1264 counts during 1204 steps 2024-12-18T00:21:05.4101207Z 2024-12-18T00:21:05.4101478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4101592Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4101911Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4102018Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4102249Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4102391Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4102529Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4102700Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4103055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4103408Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4103719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4103995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4104306Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4104579Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4104871Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4104995Z Execution Analysis: (:1) 2024-12-18T00:21:05.4105257Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4105458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4105462Z 2024-12-18T00:21:05.4105669Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4105785Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4106020Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4106129Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4106337Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4106487Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4106637Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4106808Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4107405Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4107985Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4108346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4108701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4109120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4109386Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4109692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4109953Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4110059Z Execution Analysis: .......... 2024-12-18T00:21:05.4110307Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4110506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4110816Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1265 counts during 1205 steps 2024-12-18T00:21:05.4110844Z 2024-12-18T00:21:05.4111046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4111181Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4111484Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4111596Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4111794Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4111939Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4112076Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4112236Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4112588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4112929Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4113240Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4113508Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4113813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4114072Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4114360Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4114582Z Execution Analysis: (:1) 2024-12-18T00:21:05.4114817Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4115010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4115015Z 2024-12-18T00:21:05.4115203Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4115312Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4115526Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4115631Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4115824Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4115954Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4116092Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4116246Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4116797Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4117327Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4117828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4118171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4118484Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4118750Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4119046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4119313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4119414Z Execution Analysis: .......... 2024-12-18T00:21:05.4119666Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4119884Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4120191Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1266 counts during 1206 steps 2024-12-18T00:21:05.4120195Z 2024-12-18T00:21:05.4120432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4120573Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4120853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4120957Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4121158Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4121298Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4121439Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4121599Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4121949Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4122291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4122590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4122865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4123161Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4123424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4123706Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4123833Z Execution Analysis: (:1) 2024-12-18T00:21:05.4124081Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4124276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4124289Z 2024-12-18T00:21:05.4124483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4124591Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4124816Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4124922Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4125128Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4125265Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4125404Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4125572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4126147Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4126712Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4127061Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4127409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4127713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4127980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4128279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4128543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4128645Z Execution Analysis: .......... 2024-12-18T00:21:05.4128891Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4129144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4129427Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1267 counts during 1207 steps 2024-12-18T00:21:05.4129457Z 2024-12-18T00:21:05.4129784Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4129888Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4130161Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4130262Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4130450Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4130588Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4130718Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4130878Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4131206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4131537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4131827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4132078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4132373Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4132621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4132893Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4133007Z Execution Analysis: (:1) 2024-12-18T00:21:05.4133246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4133438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4133442Z 2024-12-18T00:21:05.4133635Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4133740Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4133955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4134061Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4134251Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4134388Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4134524Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4134684Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4135231Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4135763Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4136099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4136518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4136980Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4137252Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4137565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4137833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4137941Z Execution Analysis: .......... 2024-12-18T00:21:05.4138252Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4138455Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4138779Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1268 counts during 1208 steps 2024-12-18T00:21:05.4138808Z 2024-12-18T00:21:05.4139011Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4139128Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4139415Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4139530Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4139734Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4139874Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4140017Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4140188Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4140548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4140895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4141210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4141482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4141795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4142057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4142346Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4142474Z Execution Analysis: (:1) 2024-12-18T00:21:05.4142732Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4142937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4142943Z 2024-12-18T00:21:05.4143144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4143256Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4143485Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4143590Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4143798Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4143939Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4144090Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4144413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4145016Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4145591Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4145958Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4146311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4146621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4146898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4147206Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4147535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4147671Z Execution Analysis: .......... 2024-12-18T00:21:05.4147932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4148165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4148486Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1269 counts during 1209 steps 2024-12-18T00:21:05.4148499Z 2024-12-18T00:21:05.4148698Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4148809Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4149104Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4149212Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4149421Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4149564Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4149708Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4149879Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4150237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4150599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4150908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4151184Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4151489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4151761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4152048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4152174Z Execution Analysis: (:1) 2024-12-18T00:21:05.4152433Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4152635Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4152640Z 2024-12-18T00:21:05.4152846Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4152958Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4153191Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4153298Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4153502Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4153654Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4153799Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4153971Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4154568Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4155152Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4155512Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4155862Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4156171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4156545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4156849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4157175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4157284Z Execution Analysis: .......... 2024-12-18T00:21:05.4157555Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4157779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4158059Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1270 counts during 1210 steps 2024-12-18T00:21:05.4158064Z 2024-12-18T00:21:05.4158264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4158375Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4158654Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4158766Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4158966Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4159109Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4159246Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4159413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4159759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4160096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4160403Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4160669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4160972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4161231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4161520Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4161641Z Execution Analysis: (:1) 2024-12-18T00:21:05.4161890Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4162094Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4162098Z 2024-12-18T00:21:05.4162292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4162404Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4162631Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4162741Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4162939Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4163083Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4163228Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4163389Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4164069Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4164603Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4164938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4165260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4165552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4165803Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4166139Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4166384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4166503Z Execution Analysis: .......... 2024-12-18T00:21:05.4166764Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4166950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4167220Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1271 counts during 1211 steps 2024-12-18T00:21:05.4167224Z 2024-12-18T00:21:05.4167411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4167517Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4167783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4167886Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4168082Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4168213Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4168348Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4168499Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4168833Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4169153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4169439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4169698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4169982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4170232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4170501Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4170621Z Execution Analysis: (:1) 2024-12-18T00:21:05.4170858Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4171048Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4171051Z 2024-12-18T00:21:05.4171235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4171335Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4171555Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4171654Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4171849Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4171983Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4172122Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4172273Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4172823Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4173362Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4173694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4174024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4174312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4174595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4174904Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4175177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4175273Z Execution Analysis: .......... 2024-12-18T00:21:05.4175534Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4175726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4175994Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1272 counts during 1212 steps 2024-12-18T00:21:05.4175998Z 2024-12-18T00:21:05.4176188Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4176289Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4176631Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4176736Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4177102Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4177256Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4177399Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4177572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4177931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4178288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4178598Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4178880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4179188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4179461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4179757Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4179882Z Execution Analysis: (:1) 2024-12-18T00:21:05.4180152Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4180353Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4180357Z 2024-12-18T00:21:05.4180560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4180672Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4180902Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4181013Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4181224Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4181374Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4181518Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4181688Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4182280Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4182858Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4183212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4183561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4183904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4184203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4184541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4184830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4184943Z Execution Analysis: .......... 2024-12-18T00:21:05.4185197Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4185397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4185688Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1273 counts during 1213 steps 2024-12-18T00:21:05.4185692Z 2024-12-18T00:21:05.4185890Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4186014Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4186303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4186417Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4186620Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4186767Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4186908Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4187074Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4187436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4187787Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4188105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4188381Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4188698Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4188967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4189344Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4189461Z Execution Analysis: (:1) 2024-12-18T00:21:05.4189698Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4189885Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4189890Z 2024-12-18T00:21:05.4190072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4190182Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4190393Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4190498Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4190687Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4190820Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4190957Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4191111Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4191663Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4192192Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4192530Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4193064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4193395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4193665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4194013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4194285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4194387Z Execution Analysis: .......... 2024-12-18T00:21:05.4194644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4194838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4195124Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1274 counts during 1214 steps 2024-12-18T00:21:05.4195128Z 2024-12-18T00:21:05.4195324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4195437Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4195730Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4195835Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4196040Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4196177Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4196320Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4196483Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4196830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4197176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4197480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4197755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4198053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4198320Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4198608Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4198728Z Execution Analysis: (:1) 2024-12-18T00:21:05.4198981Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4199178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4199182Z 2024-12-18T00:21:05.4199383Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4199493Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4199727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4199831Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4200038Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4200176Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4200320Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4200486Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4201062Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4201629Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4201975Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4202376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4202679Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4202979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4203300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4203563Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4203672Z Execution Analysis: .......... 2024-12-18T00:21:05.4203922Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4204127Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4204412Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1275 counts during 1215 steps 2024-12-18T00:21:05.4204421Z 2024-12-18T00:21:05.4204722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4204828Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4205095Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4205204Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4205391Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4205526Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4205653Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4205812Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4206143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4206467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4206767Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4207022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4207316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4207564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4207837Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4207952Z Execution Analysis: (:1) 2024-12-18T00:21:05.4208197Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4208381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4208385Z 2024-12-18T00:21:05.4208572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4208682Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4208897Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4209008Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4209200Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4209339Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4209475Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4209630Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4210186Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4210715Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4211073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4211422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4211739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4212013Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4212303Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4212547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4212643Z Execution Analysis: .......... 2024-12-18T00:21:05.4212887Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4213072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4213349Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1276 counts during 1216 steps 2024-12-18T00:21:05.4213353Z 2024-12-18T00:21:05.4213537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4213647Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4213914Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4214023Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4214209Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4214341Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4214476Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4214632Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4214968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4215292Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4215589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4215843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4216132Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4216468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4216740Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4217034Z Execution Analysis: (:1) 2024-12-18T00:21:05.4217292Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4217508Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4217516Z 2024-12-18T00:21:05.4217714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4217827Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4218066Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4218179Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4218396Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4218539Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4218691Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4218858Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4219452Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4220057Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4220654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4221040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4221391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4221676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4221984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4222259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4222363Z Execution Analysis: .......... 2024-12-18T00:21:05.4222620Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4222828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4223118Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1277 counts during 1217 steps 2024-12-18T00:21:05.4223125Z 2024-12-18T00:21:05.4223332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4223447Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4223745Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4223854Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4224067Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4224208Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4224351Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4224520Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4224878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4225235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4225547Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4225823Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4226128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4226395Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4226690Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4226811Z Execution Analysis: (:1) 2024-12-18T00:21:05.4227072Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4227272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4227278Z 2024-12-18T00:21:05.4227480Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4227592Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4227828Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4227934Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4228140Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4228290Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4228433Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4228602Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4229402Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4229988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4230319Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4230693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4230984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4231233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4231521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4231767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4231871Z Execution Analysis: .......... 2024-12-18T00:21:05.4232109Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4232302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4232568Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1278 counts during 1218 steps 2024-12-18T00:21:05.4232572Z 2024-12-18T00:21:05.4232759Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4232867Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4233136Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4233242Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4233428Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4233566Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4233693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4233847Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4234181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4234503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4234798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4235048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4235336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4235580Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4235851Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4235971Z Execution Analysis: (:1) 2024-12-18T00:21:05.4236210Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4236399Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4236404Z 2024-12-18T00:21:05.4236588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4236698Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4236908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4237015Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4237206Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4237339Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4237479Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4237634Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4238213Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4238767Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4239226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4239555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4239848Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4240099Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4240387Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4240644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4240743Z Execution Analysis: .......... 2024-12-18T00:21:05.4240988Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4241174Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4241456Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1279 counts during 1219 steps 2024-12-18T00:21:05.4241460Z 2024-12-18T00:21:05.4241647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4241753Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4242028Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4242129Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4242323Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4242456Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4242599Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4242759Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4243092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4243425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4243713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4243971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4244388Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4244822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4245112Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4245248Z Execution Analysis: (:1) 2024-12-18T00:21:05.4245506Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4245709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4245716Z 2024-12-18T00:21:05.4245927Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4246042Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4246278Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4246389Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4246604Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4246747Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4246895Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4247067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4247756Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4248372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4248762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4249120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4249427Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4249709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4250016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4250282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4250394Z Execution Analysis: .......... 2024-12-18T00:21:05.4250649Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4250861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4251150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1280 counts during 1220 steps 2024-12-18T00:21:05.4251155Z 2024-12-18T00:21:05.4251366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4251478Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4251773Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4251880Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4252082Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4252235Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4252373Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4252547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4252908Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4253266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4253574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4253847Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4254157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4254424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4254721Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4254847Z Execution Analysis: (:1) 2024-12-18T00:21:05.4255108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4255312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4255317Z 2024-12-18T00:21:05.4255521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4255633Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4255861Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4255973Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4256179Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4256329Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4256545Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4256769Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4257372Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4258011Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4258378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4258727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4259049Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4259320Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4259633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4259907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4260014Z Execution Analysis: .......... 2024-12-18T00:21:05.4260278Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4260484Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4260784Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1281 counts during 1221 steps 2024-12-18T00:21:05.4260789Z 2024-12-18T00:21:05.4260993Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4261114Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4261407Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4261523Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4261734Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4261880Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4262033Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4262201Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4262568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4262914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4263233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4263503Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4263812Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4264088Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4264381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4264519Z Execution Analysis: (:1) 2024-12-18T00:21:05.4264780Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4264994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4264999Z 2024-12-18T00:21:05.4265202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4265324Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4265557Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4265665Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4265880Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4266051Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4266239Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4266405Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4267033Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4267630Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4267994Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4268353Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4268769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4269028Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4269316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4269573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4269672Z Execution Analysis: .......... 2024-12-18T00:21:05.4269918Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4270104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4270371Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1282 counts during 1222 steps 2024-12-18T00:21:05.4270376Z 2024-12-18T00:21:05.4270572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4270677Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4270950Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4271052Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4271249Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4271381Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4271513Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4271674Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4272005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4272335Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4272622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4272880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4273166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4273422Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4273691Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4273805Z Execution Analysis: (:1) 2024-12-18T00:21:05.4274047Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4274235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4274240Z 2024-12-18T00:21:05.4274435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4274538Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4274757Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4274860Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4275079Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4275240Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4275375Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4275561Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4276140Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4276683Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4277013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4277343Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4277630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4277885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4278176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4278427Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4278535Z Execution Analysis: .......... 2024-12-18T00:21:05.4278769Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4278966Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4279231Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1284 counts during 1223 steps 2024-12-18T00:21:05.4279236Z 2024-12-18T00:21:05.4279432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4279537Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4279805Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4279916Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4280109Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4280246Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4280378Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4280530Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4280868Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4281188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4281482Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4281732Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4282030Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4282277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4282559Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4282674Z Execution Analysis: (:1) 2024-12-18T00:21:05.4282913Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4283109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4283113Z 2024-12-18T00:21:05.4283298Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4283410Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4283620Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4283780Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4283969Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4284102Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4284271Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4284447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4285007Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4285536Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4285877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4286201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4286500Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4286753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4287039Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4287299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4287398Z Execution Analysis: .......... 2024-12-18T00:21:05.4287643Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4287829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4288105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1285 counts during 1224 steps 2024-12-18T00:21:05.4288109Z 2024-12-18T00:21:05.4288297Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4288414Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4288680Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4288784Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4288987Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4289121Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4289265Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4289421Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4289759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4290086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4290372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4290633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4290919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4291176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4291448Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4291569Z Execution Analysis: (:1) 2024-12-18T00:21:05.4291807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4291995Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4292009Z 2024-12-18T00:21:05.4292195Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4292300Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4292581Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4292685Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4292885Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4293042Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4293199Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4293364Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4293914Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4294451Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4294780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4295117Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4295402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4295665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4295951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4296203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4296300Z Execution Analysis: .......... 2024-12-18T00:21:05.4296611Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4296975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4297263Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1286 counts during 1225 steps 2024-12-18T00:21:05.4297267Z 2024-12-18T00:21:05.4297483Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4297596Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4297894Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4298003Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4298207Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4298362Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4298503Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4298677Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4299034Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4299388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4299700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4299974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4300293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4300565Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4300863Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4300984Z Execution Analysis: (:1) 2024-12-18T00:21:05.4301250Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4301450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4301454Z 2024-12-18T00:21:05.4301660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4301828Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4302061Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4302202Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4302408Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4302582Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4302730Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4302905Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4303497Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4304071Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4304440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4304790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4305110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4305384Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4305703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4305970Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4306083Z Execution Analysis: .......... 2024-12-18T00:21:05.4306342Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4306545Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4306846Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1287 counts during 1226 steps 2024-12-18T00:21:05.4306852Z 2024-12-18T00:21:05.4307055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4307179Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4307471Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4307589Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4307792Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4307934Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4308087Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4308251Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4308619Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4309078Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4309393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4309659Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4309965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4310225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4310509Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4310645Z Execution Analysis: (:1) 2024-12-18T00:21:05.4310896Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4311102Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4311107Z 2024-12-18T00:21:05.4311351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4311473Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4311720Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4311828Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4312064Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4312205Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4312358Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4312520Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4313107Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4313668Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4314028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4314539Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4314853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4315138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4315444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4315722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4315824Z Execution Analysis: .......... 2024-12-18T00:21:05.4316088Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4316394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4316673Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1288 counts during 1227 steps 2024-12-18T00:21:05.4316689Z 2024-12-18T00:21:05.4316885Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4316995Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4317287Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4317394Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4317600Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4317903Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4318044Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4318223Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4318581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4318937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4319249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4319535Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4319839Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4320117Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4320405Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4320526Z Execution Analysis: (:1) 2024-12-18T00:21:05.4320792Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4321023Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4321051Z 2024-12-18T00:21:05.4321263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4321401Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4321664Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4321771Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4321978Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4322133Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4322277Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4322454Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4323047Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4323631Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4323990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4324350Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4324663Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4324936Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4325253Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4325521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4325640Z Execution Analysis: .......... 2024-12-18T00:21:05.4325897Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4326109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4326400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1289 counts during 1228 steps 2024-12-18T00:21:05.4326406Z 2024-12-18T00:21:05.4326616Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4326731Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4327022Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4327142Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4327343Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4327497Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4327638Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4327813Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4328174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4328523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4328845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4329118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4329432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4329696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4330002Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4330124Z Execution Analysis: (:1) 2024-12-18T00:21:05.4330381Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4330655Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4330660Z 2024-12-18T00:21:05.4330890Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4331010Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4331268Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4331389Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4331595Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4331749Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4331897Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4332061Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4332670Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4333246Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4333620Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4333975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4334298Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4334568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4334888Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4335157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4335261Z Execution Analysis: .......... 2024-12-18T00:21:05.4335531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4335731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4336035Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1290 counts during 1229 steps 2024-12-18T00:21:05.4336041Z 2024-12-18T00:21:05.4336241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4336447Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4336740Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4336849Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4337064Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4337206Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4337358Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4337527Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4337892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4338244Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4338558Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4338844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4339149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4339429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4339721Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4339859Z Execution Analysis: (:1) 2024-12-18T00:21:05.4340172Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4340384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4340414Z 2024-12-18T00:21:05.4340642Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4340756Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4340993Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4341103Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4341317Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4341456Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4341615Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4341782Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4342380Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4342970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4343332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4343692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4344000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4344434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4344745Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4345022Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4345129Z Execution Analysis: .......... 2024-12-18T00:21:05.4345387Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4345601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4345893Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1291 counts during 1230 steps 2024-12-18T00:21:05.4345897Z 2024-12-18T00:21:05.4346110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4346222Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4346524Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4346631Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4346832Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4346985Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4347130Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4347305Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4347673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4348035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4348348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4348639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4348943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4349213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4349514Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4349732Z Execution Analysis: (:1) 2024-12-18T00:21:05.4350008Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4350245Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4350249Z 2024-12-18T00:21:05.4350495Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4350610Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4350845Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4350967Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4351175Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4351330Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4351478Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4351661Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4352257Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4352847Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4353215Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4353568Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4353890Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4354165Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4354488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4354760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4354877Z Execution Analysis: .......... 2024-12-18T00:21:05.4355139Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4355346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4355654Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1292 counts during 1231 steps 2024-12-18T00:21:05.4355658Z 2024-12-18T00:21:05.4355863Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4356159Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4356440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4356562Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4356765Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4356921Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4357057Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4357227Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4357585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4357928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4358242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4358507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4358823Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4359084Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4359422Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4359556Z Execution Analysis: (:1) 2024-12-18T00:21:05.4359831Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4360076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4360081Z 2024-12-18T00:21:05.4360278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4360401Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4360625Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4360744Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4360945Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4361085Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4361244Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4361409Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4361994Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4362559Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4362924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4363266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4363570Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4363847Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4364155Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4364429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4364530Z Execution Analysis: .......... 2024-12-18T00:21:05.4364793Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4365094Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4365369Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1293 counts during 1232 steps 2024-12-18T00:21:05.4365373Z 2024-12-18T00:21:05.4365559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4365667Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4365942Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4366048Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4366250Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4366384Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4366529Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4366683Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4367013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4367345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4367635Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4367897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4368177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4368457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4368751Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4368890Z Execution Analysis: (:1) 2024-12-18T00:21:05.4369157Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4369344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4369349Z 2024-12-18T00:21:05.4369547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4369654Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4369878Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4369981Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4370184Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4370322Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4370459Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4370620Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4371171Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4371712Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4372045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4372384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4372673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4372940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4373228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4373478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4373588Z Execution Analysis: .......... 2024-12-18T00:21:05.4373827Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4374025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4374294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1294 counts during 1233 steps 2024-12-18T00:21:05.4374298Z 2024-12-18T00:21:05.4374496Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4374600Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4374871Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4374987Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4375174Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4375319Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4375451Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4375616Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4375946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4376506Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4376989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4377267Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4377614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4377911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4378245Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4378395Z Execution Analysis: (:1) 2024-12-18T00:21:05.4378671Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4378876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4378881Z 2024-12-18T00:21:05.4379083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4379205Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4379441Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4379560Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4379772Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4379923Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4380068Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4380236Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4380839Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4381414Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4381780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4382129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4382456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4382730Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4383051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4383321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4383430Z Execution Analysis: .......... 2024-12-18T00:21:05.4383699Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4383902Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4384207Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1295 counts during 1234 steps 2024-12-18T00:21:05.4384212Z 2024-12-18T00:21:05.4384414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4384542Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4384832Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4384959Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4385163Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4385307Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4385458Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4385629Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4386000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4386348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4386669Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4386968Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4387376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4387656Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4387999Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4388137Z Execution Analysis: (:1) 2024-12-18T00:21:05.4388394Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4388611Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4388615Z 2024-12-18T00:21:05.4388816Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4388929Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4389275Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4389383Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4389591Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4389733Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4389887Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4390050Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4390627Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4391191Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4391541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4391898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4392203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4392481Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4392787Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4393058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4393162Z Execution Analysis: .......... 2024-12-18T00:21:05.4393416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4393623Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4393903Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1296 counts during 1235 steps 2024-12-18T00:21:05.4393907Z 2024-12-18T00:21:05.4394121Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4394233Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4394528Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4394636Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4394847Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4394988Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4395127Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4395298Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4395646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4396004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4396357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4396666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4396963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4397295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4397589Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4397716Z Execution Analysis: (:1) 2024-12-18T00:21:05.4397984Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4398183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4398187Z 2024-12-18T00:21:05.4398395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4398508Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4398751Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4398859Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4399064Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4399317Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4399459Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4399629Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4400176Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4400718Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4401049Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4401380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4401683Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4401940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4402240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4402489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4402602Z Execution Analysis: .......... 2024-12-18T00:21:05.4402838Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4403036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4403307Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1297 counts during 1236 steps 2024-12-18T00:21:05.4403313Z 2024-12-18T00:21:05.4403499Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4403617Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4403886Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4404001Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4404193Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4404338Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4404467Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4404619Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4404956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4405282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4405789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4406059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4406395Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4406678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4406965Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4407094Z Execution Analysis: (:1) 2024-12-18T00:21:05.4407342Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4407549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4407553Z 2024-12-18T00:21:05.4407751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4407876Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4408102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4408220Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4408423Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4408564Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4408715Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4408879Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4409463Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4410020Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4410381Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4410723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4411036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4411307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4411606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4411874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4411975Z Execution Analysis: .......... 2024-12-18T00:21:05.4412236Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4412434Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4412730Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1298 counts during 1237 steps 2024-12-18T00:21:05.4412734Z 2024-12-18T00:21:05.4412931Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4413046Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4413340Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4413448Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4413657Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4413799Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4413949Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4414111Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4414463Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4414840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4415169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4415476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4415801Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4416079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4416432Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4416574Z Execution Analysis: (:1) 2024-12-18T00:21:05.4416988Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4417194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4417203Z 2024-12-18T00:21:05.4417415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4417529Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4417778Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4417890Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4418113Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4418258Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4418406Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4418582Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4419175Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4419764Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4420126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4420491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4420805Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4421095Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4421404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4421678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4421791Z Execution Analysis: .......... 2024-12-18T00:21:05.4422047Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4422267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4422560Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1299 counts during 1238 steps 2024-12-18T00:21:05.4422566Z 2024-12-18T00:21:05.4422784Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4422896Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4423199Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4423311Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4423516Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4423670Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4423814Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4423990Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4424375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4424767Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4425100Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4425399Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4425718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4425989Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4426291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4426414Z Execution Analysis: (:1) 2024-12-18T00:21:05.4426683Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4426886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4426893Z 2024-12-18T00:21:05.4427109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4427223Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4427457Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4427579Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4427789Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4427943Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4428092Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4428258Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4428861Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4429627Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4429968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4430298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4430595Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4430851Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4431152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4431400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4431500Z Execution Analysis: .......... 2024-12-18T00:21:05.4431748Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4431937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4432218Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1300 counts during 1239 steps 2024-12-18T00:21:05.4432222Z 2024-12-18T00:21:05.4432411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4432526Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4432797Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4432910Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4433101Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4433237Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4433379Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4433561Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4433936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4434284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4434605Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4434861Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4435145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4435400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4435673Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4435797Z Execution Analysis: (:1) 2024-12-18T00:21:05.4436034Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4436237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4436243Z 2024-12-18T00:21:05.4436428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4436549Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4436763Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4436871Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4437069Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4437199Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4437342Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4437498Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4438057Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4438589Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4438926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4439261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4439550Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4439813Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4440102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4440361Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4440461Z Execution Analysis: .......... 2024-12-18T00:21:05.4440709Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4440897Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4441167Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1301 counts during 1240 steps 2024-12-18T00:21:05.4441171Z 2024-12-18T00:21:05.4441366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4441473Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4441751Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4441855Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4442056Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4442185Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4442340Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4442527Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4442859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4443240Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4443531Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4443793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4444076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4444608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4444915Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4445042Z Execution Analysis: (:1) 2024-12-18T00:21:05.4445314Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4445518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4445525Z 2024-12-18T00:21:05.4445737Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4445850Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4446088Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4446197Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4446405Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4446555Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4446703Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4446876Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4447475Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4448057Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4448415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4448773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4449083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4449357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4449672Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4449940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4450055Z Execution Analysis: .......... 2024-12-18T00:21:05.4450312Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4450526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4450814Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1302 counts during 1241 steps 2024-12-18T00:21:05.4450819Z 2024-12-18T00:21:05.4451029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4451137Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4451427Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4451541Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4451745Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4451980Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4452122Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4452287Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4452830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4453211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4453529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4453801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4454115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4454382Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4454687Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4454812Z Execution Analysis: (:1) 2024-12-18T00:21:05.4455070Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4455283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4455287Z 2024-12-18T00:21:05.4455490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4455616Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4455847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4455962Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4456168Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4456312Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4456546Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4456720Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4457321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4457902Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4458264Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4458611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4458933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4459206Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4459514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4459790Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4459899Z Execution Analysis: .......... 2024-12-18T00:21:05.4460162Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4460365Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4460663Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1303 counts during 1242 steps 2024-12-18T00:21:05.4460667Z 2024-12-18T00:21:05.4460871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4460999Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4461287Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4461398Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4461666Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4461812Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4461985Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4462153Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4462543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4462893Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4463205Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4463486Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4463795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4464069Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4464362Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4464493Z Execution Analysis: (:1) 2024-12-18T00:21:05.4464750Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4464956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4464972Z 2024-12-18T00:21:05.4465170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4465283Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4465523Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4465631Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4465845Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4465994Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4466144Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4466321Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4466919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4467501Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4467860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4468217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4468528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4468904Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4469187Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4469443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4469539Z Execution Analysis: .......... 2024-12-18T00:21:05.4469777Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4469972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4470241Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1305 counts during 1243 steps 2024-12-18T00:21:05.4470245Z 2024-12-18T00:21:05.4470435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4470537Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4470854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4470980Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4471173Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4471333Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4471466Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4471653Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4471986Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4472319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4472608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4472865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4473161Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4473413Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4473693Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4473806Z Execution Analysis: (:1) 2024-12-18T00:21:05.4474050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4474235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4474239Z 2024-12-18T00:21:05.4474430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4474530Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4474740Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4474852Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4475042Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4475184Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4475320Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4475485Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4476033Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4476565Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4476910Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4477236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4477529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4477783Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4478074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4478325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4478431Z Execution Analysis: .......... 2024-12-18T00:21:05.4481748Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4481969Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4482249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1306 counts during 1244 steps 2024-12-18T00:21:05.4482256Z 2024-12-18T00:21:05.4482444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4482553Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4482922Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4483029Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4483248Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4483380Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4483540Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4483698Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4484036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4484362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4484655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4484908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4485197Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4485449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4485720Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4485840Z Execution Analysis: (:1) 2024-12-18T00:21:05.4486080Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4486274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4486278Z 2024-12-18T00:21:05.4486464Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4486572Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4486782Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4486886Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4487082Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4487212Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4487354Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4487513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4488061Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4488604Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4488937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4489266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4489556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4489813Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4490098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4490352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4490449Z Execution Analysis: .......... 2024-12-18T00:21:05.4490685Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4490873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4491140Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1307 counts during 1245 steps 2024-12-18T00:21:05.4491144Z 2024-12-18T00:21:05.4491359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4491485Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4491756Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4491881Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4492098Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4492231Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4492361Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4492522Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4492850Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4493175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4493460Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4493721Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4494002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4494247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4494521Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4494635Z Execution Analysis: (:1) 2024-12-18T00:21:05.4494874Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4495057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4495061Z 2024-12-18T00:21:05.4495250Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4495351Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4495569Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4495669Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4495858Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4495992Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4496128Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4496284Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4497098Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4497676Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4498033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4498381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4498696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4498967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4499282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4499548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4499653Z Execution Analysis: .......... 2024-12-18T00:21:05.4499909Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4500114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4500403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1308 counts during 1246 steps 2024-12-18T00:21:05.4500440Z 2024-12-18T00:21:05.4500669Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4500784Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4501099Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4501249Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4501455Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4501602Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4501740Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4501902Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4502265Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4502617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4502936Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4503211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4503523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4503793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4504086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4504207Z Execution Analysis: (:1) 2024-12-18T00:21:05.4504464Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4504669Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4504674Z 2024-12-18T00:21:05.4504876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4504996Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4505225Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4505339Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4505542Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4505686Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4505837Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4506001Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4506604Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4507180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4507546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4507900Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4508216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4508491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4508799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4509172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4509271Z Execution Analysis: .......... 2024-12-18T00:21:05.4509510Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4509695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4509989Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1309 counts during 1247 steps 2024-12-18T00:21:05.4510016Z 2024-12-18T00:21:05.4510201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4510330Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4510628Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4510731Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4510920Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4511050Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4511186Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4511340Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4511666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4511999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4512285Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4512545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4512828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4513078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4513346Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4513467Z Execution Analysis: (:1) 2024-12-18T00:21:05.4513703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4513888Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4513893Z 2024-12-18T00:21:05.4514085Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4514190Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4514408Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4514506Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4514699Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4514828Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4514960Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4515119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4515666Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4516207Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4516540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4516869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4517159Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4517415Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4517865Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4518125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4518230Z Execution Analysis: .......... 2024-12-18T00:21:05.4518478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4518706Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4519009Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1310 counts during 1248 steps 2024-12-18T00:21:05.4519039Z 2024-12-18T00:21:05.4519239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4519374Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4519662Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4519767Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4519960Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4520101Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4520235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4520400Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4520748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4521092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4521392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4521657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4521956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4522214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4522498Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4522619Z Execution Analysis: (:1) 2024-12-18T00:21:05.4522868Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4523063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4523069Z 2024-12-18T00:21:05.4523267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4523375Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4523601Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4523712Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4523914Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4524055Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4524195Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4524355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4524930Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4525488Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4525847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4526191Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4526497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4526759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4527061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4527318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4527420Z Execution Analysis: .......... 2024-12-18T00:21:05.4527694Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4527917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4528201Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1311 counts during 1249 steps 2024-12-18T00:21:05.4528229Z 2024-12-18T00:21:05.4528448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4528564Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4528842Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4528951Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4529150Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4529285Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4529425Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4529689Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4530028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4530351Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4530642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4530892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4531175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4531424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4531692Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4531810Z Execution Analysis: (:1) 2024-12-18T00:21:05.4532052Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4532241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4532245Z 2024-12-18T00:21:05.4532433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4532542Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4532754Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4532852Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4533048Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4533180Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4533319Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4533470Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4534022Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4534555Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4534886Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4535218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4535502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4535759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4536042Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4536291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4536452Z Execution Analysis: .......... 2024-12-18T00:21:05.4536989Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4537191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4537542Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1312 counts during 1250 steps 2024-12-18T00:21:05.4537547Z 2024-12-18T00:21:05.4537752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4537863Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4538159Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4538267Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4538477Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4538617Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4538757Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4538932Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4539286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4539641Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4539950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4540224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4540528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4540797Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4541087Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4541207Z Execution Analysis: (:1) 2024-12-18T00:21:05.4541469Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4541670Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4541676Z 2024-12-18T00:21:05.4541883Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4541993Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4542227Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4542331Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4542537Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4542679Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4542823Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4542997Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4543589Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4544319Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4544685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4545041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4545351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4545622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4545932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4546265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4546437Z Execution Analysis: .......... 2024-12-18T00:21:05.4546699Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4546946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4547270Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1313 counts during 1251 steps 2024-12-18T00:21:05.4547276Z 2024-12-18T00:21:05.4547487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4547603Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4547894Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4548007Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4548209Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4548361Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4548502Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4548665Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4549028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4549377Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4549692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4549966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4550274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4550539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4550838Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4550964Z Execution Analysis: (:1) 2024-12-18T00:21:05.4551218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4551423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4551430Z 2024-12-18T00:21:05.4551629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4551747Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4551976Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4552090Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4552297Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4552441Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4552592Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4552761Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4553366Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4553943Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4554305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4554655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4554969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4555240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4555570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4555867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4556078Z Execution Analysis: .......... 2024-12-18T00:21:05.4556356Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4556574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4556864Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1314 counts during 1252 steps 2024-12-18T00:21:05.4556869Z 2024-12-18T00:21:05.4557062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4557175Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4557458Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4557564Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4557771Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4557910Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4558053Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4558217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4558568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4558906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4559379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4559653Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4559959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4560231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4560525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4560654Z Execution Analysis: (:1) 2024-12-18T00:21:05.4560909Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4561109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4561120Z 2024-12-18T00:21:05.4561316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4561426Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4561658Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4561766Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4561976Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4562115Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4562262Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4562430Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4563018Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4563595Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4563950Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4564304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4564714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4564985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4565333Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4565596Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4565719Z Execution Analysis: .......... 2024-12-18T00:21:05.4565992Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4566191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4566476Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1315 counts during 1253 steps 2024-12-18T00:21:05.4566481Z 2024-12-18T00:21:05.4566680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4566788Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4567071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4567179Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4567376Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4567518Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4567654Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4567819Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4568165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4568510Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4568815Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4569081Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4569382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4569645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4569934Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4570057Z Execution Analysis: (:1) 2024-12-18T00:21:05.4570313Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4570513Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4570517Z 2024-12-18T00:21:05.4570717Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4570932Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4571147Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4571253Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4571446Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4571588Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4571720Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4571880Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4572430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4572963Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4573298Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4573623Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4573918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4574232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4574527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4574800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4574925Z Execution Analysis: .......... 2024-12-18T00:21:05.4575167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4575354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4575625Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1316 counts during 1254 steps 2024-12-18T00:21:05.4575629Z 2024-12-18T00:21:05.4575815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4575932Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4576202Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4576313Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4576587Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4576726Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4577034Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4577201Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4577559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4577905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4578220Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4578493Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4578805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4579073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4579364Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4579493Z Execution Analysis: (:1) 2024-12-18T00:21:05.4579751Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4579956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4579961Z 2024-12-18T00:21:05.4580159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4580274Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4580504Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4580614Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4580825Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4580966Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4581119Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4581282Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4581879Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4582450Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4582812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4583159Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4583495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4583795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4584126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4584424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4584529Z Execution Analysis: .......... 2024-12-18T00:21:05.4584790Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4584992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4585283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1317 counts during 1255 steps 2024-12-18T00:21:05.4585292Z 2024-12-18T00:21:05.4585491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4585607Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4585902Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4586014Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4586220Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4586366Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4586512Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4586676Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4587033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4587383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4587695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4587975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4588280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4588554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4588844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4589076Z Execution Analysis: (:1) 2024-12-18T00:21:05.4589316Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4589500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4589504Z 2024-12-18T00:21:05.4589694Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4589799Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4590015Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4590114Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4590305Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4590443Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4590576Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4590735Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4591279Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4591816Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4592146Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4592499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4592808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4593087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4593398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4593647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4593751Z Execution Analysis: .......... 2024-12-18T00:21:05.4593988Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4594178Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4594443Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1318 counts during 1256 steps 2024-12-18T00:21:05.4594448Z 2024-12-18T00:21:05.4594639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4594742Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4595009Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4595116Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4595306Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4595445Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4595575Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4595734Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4596063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4596385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4596680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4596933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4597223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4597472Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4597745Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4597860Z Execution Analysis: (:1) 2024-12-18T00:21:05.4598100Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4598289Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4598293Z 2024-12-18T00:21:05.4598479Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4598590Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4598801Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4598906Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4599100Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4599238Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4599375Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4599529Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4600081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4600611Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4600972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4601318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4601610Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4601909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4602200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4602446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4602543Z Execution Analysis: .......... 2024-12-18T00:21:05.4602785Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4602973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4603246Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1319 counts during 1257 steps 2024-12-18T00:21:05.4603252Z 2024-12-18T00:21:05.4603437Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4603547Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4603815Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4603914Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4604102Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4604231Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4604371Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4604523Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4604856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4605180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4605463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4605718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4606003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4606254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4606522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4606643Z Execution Analysis: (:1) 2024-12-18T00:21:05.4606880Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4607070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4607074Z 2024-12-18T00:21:05.4607259Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4607365Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4607582Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4607683Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4607879Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4608010Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4608149Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4608302Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4608850Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4609382Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4609775Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4610107Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4610443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4610703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4610984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4611235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4611333Z Execution Analysis: .......... 2024-12-18T00:21:05.4611573Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4611766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4612034Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1320 counts during 1258 steps 2024-12-18T00:21:05.4612038Z 2024-12-18T00:21:05.4612227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4612336Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4612610Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4612711Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4612900Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4613036Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4613166Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4613323Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4613650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4613982Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4614269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4614527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4614814Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4615062Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4615335Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4615451Z Execution Analysis: (:1) 2024-12-18T00:21:05.4615690Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4615877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4615885Z 2024-12-18T00:21:05.4616075Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4616180Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4616456Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4616568Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4616921Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4617073Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4617215Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4617388Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4617979Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4618585Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4618967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4619345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4619687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4619962Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4620276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4620542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4620656Z Execution Analysis: .......... 2024-12-18T00:21:05.4620909Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4621114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4621410Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1321 counts during 1259 steps 2024-12-18T00:21:05.4621416Z 2024-12-18T00:21:05.4621618Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4621738Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4622025Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4622140Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4622343Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4622491Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4622628Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4622794Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4623156Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4623509Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4623822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4624090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4624398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4624659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4624947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4625074Z Execution Analysis: (:1) 2024-12-18T00:21:05.4625330Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4625541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4625546Z 2024-12-18T00:21:05.4625746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4625864Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4626091Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4626206Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4626410Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4626549Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4626696Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4626861Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4627460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4628083Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4628471Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4628842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4629363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4629620Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4629902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4630152Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4630249Z Execution Analysis: .......... 2024-12-18T00:21:05.4630492Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4630679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4630956Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1322 counts during 1260 steps 2024-12-18T00:21:05.4630960Z 2024-12-18T00:21:05.4631146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4631250Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4631521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4631622Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4631814Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4631944Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4632078Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4632232Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4632560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4632888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4633178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4633440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4633722Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4633972Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4634240Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4634351Z Execution Analysis: (:1) 2024-12-18T00:21:05.4634594Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4634782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4634788Z 2024-12-18T00:21:05.4634979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4635081Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4635299Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4635399Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4635595Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4635726Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4635859Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4636017Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4636590Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4637146Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4637534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4637865Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4638148Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4638407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4638692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4638941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4639049Z Execution Analysis: .......... 2024-12-18T00:21:05.4639283Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4639475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4639743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1323 counts during 1261 steps 2024-12-18T00:21:05.4639747Z 2024-12-18T00:21:05.4639942Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4640045Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4640312Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4640419Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4640607Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4640747Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4640884Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4641040Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4641367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4641693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4641985Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4642240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4642527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4642772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4643046Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4643162Z Execution Analysis: (:1) 2024-12-18T00:21:05.4643405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4643594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4643598Z 2024-12-18T00:21:05.4643784Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4643892Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4644100Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4644348Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4644711Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4644857Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4645006Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4645171Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4645850Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4646485Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4646852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4647202Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4647519Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4647789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4648099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4648365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4648472Z Execution Analysis: .......... 2024-12-18T00:21:05.4648733Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4648937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4649233Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1324 counts during 1262 steps 2024-12-18T00:21:05.4649238Z 2024-12-18T00:21:05.4649435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4649553Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4649844Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4649958Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4650163Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4650306Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4650452Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4650616Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4650978Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4651327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4651640Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4651910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4652218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4652487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4652779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4652909Z Execution Analysis: (:1) 2024-12-18T00:21:05.4653164Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4653375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4653379Z 2024-12-18T00:21:05.4653576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4653687Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4653921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4654030Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4654239Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4654387Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4654566Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4654756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4655352Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4655985Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4656404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4656777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4657093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4657377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4657687Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4657966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4658071Z Execution Analysis: .......... 2024-12-18T00:21:05.4658332Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4658541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4658830Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1326 counts during 1263 steps 2024-12-18T00:21:05.4658835Z 2024-12-18T00:21:05.4659047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4659159Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4659457Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4659566Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4659781Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4659922Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4660066Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4660243Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4660603Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4660964Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4661276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4661561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4661867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4662136Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4662439Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4662565Z Execution Analysis: (:1) 2024-12-18T00:21:05.4662833Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4663034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4663039Z 2024-12-18T00:21:05.4663254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4663365Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4663604Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4663711Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4663916Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4664096Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4664268Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4664447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4665086Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4665674Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4666031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4666381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4666699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4666970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4667286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4667553Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4667663Z Execution Analysis: .......... 2024-12-18T00:21:05.4667920Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4668130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4668416Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1327 counts during 1264 steps 2024-12-18T00:21:05.4668421Z 2024-12-18T00:21:05.4668726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4668839Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4669108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4669219Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4669405Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4669547Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4669675Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4669830Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4670163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4670485Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4670782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4671031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4671328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4671575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4671855Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4671967Z Execution Analysis: (:1) 2024-12-18T00:21:05.4672206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4672401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4672406Z 2024-12-18T00:21:05.4672592Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4672703Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4672913Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4673021Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4673234Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4673389Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4673527Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4673713Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4674367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4674900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4675241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4675561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4675861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4676112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4676395Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4676653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4676750Z Execution Analysis: .......... 2024-12-18T00:21:05.4676996Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4677186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4677466Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1328 counts during 1265 steps 2024-12-18T00:21:05.4677470Z 2024-12-18T00:21:05.4677656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4677761Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4678037Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4678137Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4678335Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4678470Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4678609Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4678762Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4679093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4679427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4679714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4679974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4680259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4680516Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4680784Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4680909Z Execution Analysis: (:1) 2024-12-18T00:21:05.4681144Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4681330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4681334Z 2024-12-18T00:21:05.4681524Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4681629Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4681851Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4682000Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4682203Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4682335Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4682497Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4682807Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4683353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4683893Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4684226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4684565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4684855Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4685120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4685404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4685654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4685760Z Execution Analysis: .......... 2024-12-18T00:21:05.4685995Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4686194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4686461Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1329 counts during 1266 steps 2024-12-18T00:21:05.4686465Z 2024-12-18T00:21:05.4686663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4686767Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4687050Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4687153Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4687342Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4687479Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4687608Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4687772Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4688101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4688431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4688715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4688971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4689263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4689512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4689790Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4689905Z Execution Analysis: (:1) 2024-12-18T00:21:05.4690150Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4690335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4690339Z 2024-12-18T00:21:05.4690537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4690639Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4690903Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4691014Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4691203Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4691373Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4691532Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4691691Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4692248Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4692779Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4693119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4693448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4693744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4693997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4694294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4694541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4694638Z Execution Analysis: .......... 2024-12-18T00:21:05.4694883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4695067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4695337Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1330 counts during 1267 steps 2024-12-18T00:21:05.4695345Z 2024-12-18T00:21:05.4695531Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4695644Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4695911Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4696020Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4696205Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4696393Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4696549Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4696705Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4697226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4697576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4697904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4698181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4698494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4698774Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4699065Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4699202Z Execution Analysis: (:1) 2024-12-18T00:21:05.4699458Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4699673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4699677Z 2024-12-18T00:21:05.4699909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4700061Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4700291Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4700426Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4700643Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4700813Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4700974Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4701142Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4701747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4702321Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4702686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4703049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4703363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4703650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4703957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4704232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4704337Z Execution Analysis: .......... 2024-12-18T00:21:05.4704609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4704812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4705105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1331 counts during 1268 steps 2024-12-18T00:21:05.4705111Z 2024-12-18T00:21:05.4705320Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4705434Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4705733Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4705841Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4706056Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4706201Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4706344Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4706520Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4706875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4707232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4707543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4707822Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4708129Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4708404Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4708693Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4708816Z Execution Analysis: (:1) 2024-12-18T00:21:05.4709181Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4709367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4709371Z 2024-12-18T00:21:05.4709627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4709728Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4709976Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4710074Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4710289Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4710426Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4710559Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4710725Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4711272Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4711815Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4712144Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4712476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4712760Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4713012Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4713306Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4713553Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4713657Z Execution Analysis: .......... 2024-12-18T00:21:05.4713893Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4714091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4714358Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1332 counts during 1269 steps 2024-12-18T00:21:05.4714364Z 2024-12-18T00:21:05.4714557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4714661Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4714930Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4715041Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4715229Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4715370Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4715499Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4715654Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4715997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4716321Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4716616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4716871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4717162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4717405Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4717846Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4717964Z Execution Analysis: (:1) 2024-12-18T00:21:05.4718214Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4718443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4718471Z 2024-12-18T00:21:05.4718666Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4718812Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4719056Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4719175Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4719373Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4719511Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4719660Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4719822Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4720408Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4720967Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4721329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4721674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4721987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4722252Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4722552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4722818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4722921Z Execution Analysis: .......... 2024-12-18T00:21:05.4723182Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4723380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4723674Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1333 counts during 1270 steps 2024-12-18T00:21:05.4723679Z 2024-12-18T00:21:05.4723875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4723995Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4724275Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4724383Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4724589Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4724727Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4724873Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4725032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4725394Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4725731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4726039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4726310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4726606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4726877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4727159Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4727291Z Execution Analysis: (:1) 2024-12-18T00:21:05.4727559Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4727782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4727797Z 2024-12-18T00:21:05.4728014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4728146Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4728380Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4728486Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4728703Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4728839Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4728993Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4729153Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4729833Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4730376Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4730707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4731044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4731332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4731593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4731876Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4732134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4732232Z Execution Analysis: .......... 2024-12-18T00:21:05.4732470Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4732662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4732934Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1334 counts during 1271 steps 2024-12-18T00:21:05.4732938Z 2024-12-18T00:21:05.4733132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4733234Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4733512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4733611Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4733798Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4733939Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4734072Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4734234Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4734564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4734901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4735187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4735439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4735729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4735975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4736248Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4736452Z Execution Analysis: (:1) 2024-12-18T00:21:05.4736924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4737126Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4737156Z 2024-12-18T00:21:05.4737394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4737504Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4737733Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4737850Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4738057Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4738207Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4738353Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4738532Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4739123Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4739701Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4740074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4740420Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4740739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4741013Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4741331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4741600Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4741715Z Execution Analysis: .......... 2024-12-18T00:21:05.4741967Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4742174Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4742479Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1335 counts during 1272 steps 2024-12-18T00:21:05.4742484Z 2024-12-18T00:21:05.4742688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4742815Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4743110Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4743230Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4743435Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4743581Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4743738Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4743903Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4744406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4744954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4745282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4745557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4745879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4746151Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4746525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4746694Z Execution Analysis: (:1) 2024-12-18T00:21:05.4746957Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4747204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4747241Z 2024-12-18T00:21:05.4747444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4747565Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4747799Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4747910Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4748131Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4748272Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4748435Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4748607Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4749217Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4749796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4750168Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4750520Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4750834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4751122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4751433Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4751712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4751817Z Execution Analysis: .......... 2024-12-18T00:21:05.4752087Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4752292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4752581Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1336 counts during 1273 steps 2024-12-18T00:21:05.4752598Z 2024-12-18T00:21:05.4752802Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4752915Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4753215Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4753322Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4753538Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4753685Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4753835Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4754005Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4754363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4754728Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4755041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4755323Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4755629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4755910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4756259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4756382Z Execution Analysis: (:1) 2024-12-18T00:21:05.4756675Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4756996Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4757001Z 2024-12-18T00:21:05.4757196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4757300Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4757521Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4757622Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4757813Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4757955Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4758095Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4758263Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4758810Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4759353Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4759682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4760016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4760302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4760553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4760849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4761095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4761204Z Execution Analysis: .......... 2024-12-18T00:21:05.4761442Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4761637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4761907Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1337 counts during 1274 steps 2024-12-18T00:21:05.4761911Z 2024-12-18T00:21:05.4762105Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4762210Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4762472Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4762591Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4762778Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4762923Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4763057Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4763221Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4763551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4763874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4764174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4764423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4764719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4765021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4765305Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4765446Z Execution Analysis: (:1) 2024-12-18T00:21:05.4765707Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4765909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4765913Z 2024-12-18T00:21:05.4766098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4766216Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4766429Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4766539Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4766731Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4766876Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4767014Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4767170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4767730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4768261Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4768602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4768924Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4769221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4769475Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4769770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4770021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4770120Z Execution Analysis: .......... 2024-12-18T00:21:05.4770366Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4770552Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4770831Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1338 counts during 1275 steps 2024-12-18T00:21:05.4770835Z 2024-12-18T00:21:05.4771021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4771297Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4771585Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4771691Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4771896Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4772035Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4772186Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4772345Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4772699Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4773042Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4773345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4773622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4773945Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4774244Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4774554Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4774721Z Execution Analysis: (:1) 2024-12-18T00:21:05.4774971Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4775174Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4775178Z 2024-12-18T00:21:05.4775375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4775484Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4775719Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4775825Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4776040Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4776176Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4776332Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4776571Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4777326Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4777912Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4778273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4778637Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4778946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4779230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4779541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4779818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4779927Z Execution Analysis: .......... 2024-12-18T00:21:05.4780184Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4780401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4780688Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1339 counts during 1276 steps 2024-12-18T00:21:05.4780693Z 2024-12-18T00:21:05.4780910Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4781024Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4781332Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4781445Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4781648Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4781800Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4781941Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4782116Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4782474Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4782837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4783147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4783463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4783799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4784091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4784416Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4784542Z Execution Analysis: (:1) 2024-12-18T00:21:05.4784810Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4785013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4785017Z 2024-12-18T00:21:05.4785226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4785339Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4785571Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4785695Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4785900Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4786055Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4786198Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4786378Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4786970Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4787552Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4787913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4788265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4788588Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4788866Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4789284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4789531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4789639Z Execution Analysis: .......... 2024-12-18T00:21:05.4789882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4790070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4790352Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1340 counts during 1277 steps 2024-12-18T00:21:05.4790357Z 2024-12-18T00:21:05.4790550Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4790667Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4790934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4791053Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4791244Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4791386Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4791520Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4791674Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4792021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4792345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4792672Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4792951Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4793244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4793542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4793809Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4793941Z Execution Analysis: (:1) 2024-12-18T00:21:05.4794178Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4794376Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4794380Z 2024-12-18T00:21:05.4794570Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4794690Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4794902Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4795011Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4795206Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4795339Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4795485Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4795639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4796200Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4796734Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4797079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4797407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4797694Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4797963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4798248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4798504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4798599Z Execution Analysis: .......... 2024-12-18T00:21:05.4798847Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4799038Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4799319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1341 counts during 1278 steps 2024-12-18T00:21:05.4799325Z 2024-12-18T00:21:05.4799512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4799615Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4799896Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4799999Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4800197Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4800327Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4800469Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4800625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4800955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4801316Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4801627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4801887Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4802218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4802477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4802747Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4802861Z Execution Analysis: (:1) 2024-12-18T00:21:05.4803112Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4803300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4803304Z 2024-12-18T00:21:05.4803502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4803607Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4803832Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4803935Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4804140Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4804275Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4804409Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4804574Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4805123Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4805659Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4805992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4806326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4806618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4806881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4807167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4807413Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4807524Z Execution Analysis: .......... 2024-12-18T00:21:05.4807759Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4807957Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4808228Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1342 counts during 1279 steps 2024-12-18T00:21:05.4808232Z 2024-12-18T00:21:05.4808430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4808538Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4808811Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4808925Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4809115Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4809261Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4809391Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4809555Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4809882Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4810254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4810554Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4810840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4811160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4811412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4811695Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4811812Z Execution Analysis: (:1) 2024-12-18T00:21:05.4812059Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4812249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4812255Z 2024-12-18T00:21:05.4812439Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4812555Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4812765Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4812882Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4813073Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4813217Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4813353Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4813509Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4814068Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4814599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4814942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4815269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4815567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4815824Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4816116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4816437Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4816535Z Execution Analysis: .......... 2024-12-18T00:21:05.4816945Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4817150Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4817450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1343 counts during 1280 steps 2024-12-18T00:21:05.4817456Z 2024-12-18T00:21:05.4817662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4817786Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4818076Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4818193Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4818399Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4818541Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4818696Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4818860Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4819254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4819628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4820050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4820347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4820654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4820934Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4821222Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4821356Z Execution Analysis: (:1) 2024-12-18T00:21:05.4821618Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4821836Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4821840Z 2024-12-18T00:21:05.4822044Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4822174Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4822406Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4822517Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4822738Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4822881Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4823036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4823202Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4823793Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4824386Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4824746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4825111Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4825419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4825698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4826004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4826285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4826392Z Execution Analysis: .......... 2024-12-18T00:21:05.4826653Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4826869Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4827160Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1344 counts during 1281 steps 2024-12-18T00:21:05.4827165Z 2024-12-18T00:21:05.4827374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4827488Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4827792Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4827901Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4828118Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4828261Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4828406Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4828608Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4829096Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4829564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4829871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4830137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4830418Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4830664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4830939Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4831053Z Execution Analysis: (:1) 2024-12-18T00:21:05.4831301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4831490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4831496Z 2024-12-18T00:21:05.4831690Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4831793Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4832016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4832117Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4832312Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4832453Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4832586Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4832746Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4833293Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4833829Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4834164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4834485Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4834782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4835033Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4835328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4835572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4835682Z Execution Analysis: .......... 2024-12-18T00:21:05.4835920Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4836119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4836385Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1345 counts during 1282 steps 2024-12-18T00:21:05.4836389Z 2024-12-18T00:21:05.4836575Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4836689Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4836955Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4837066Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4837256Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4837397Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4837586Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4837741Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4838081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4838450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4838745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4838997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4839291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4839538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4839815Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4839931Z Execution Analysis: (:1) 2024-12-18T00:21:05.4840167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4840362Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4840366Z 2024-12-18T00:21:05.4840548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4840656Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4840867Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4840977Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4841167Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4841296Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4841438Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4841592Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4842146Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4842677Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4843012Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4843331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4843625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4843874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4844312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4844750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4844855Z Execution Analysis: .......... 2024-12-18T00:21:05.4845117Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4845323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4845618Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1347 counts during 1283 steps 2024-12-18T00:21:05.4845623Z 2024-12-18T00:21:05.4845821Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4845933Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4846230Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4846341Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4846550Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4846796Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4846945Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4847143Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4847535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4847895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4848204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4848480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4848783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4849054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4849346Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4849483Z Execution Analysis: (:1) 2024-12-18T00:21:05.4849739Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4849945Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4849950Z 2024-12-18T00:21:05.4850156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4850266Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4850504Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4850612Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4850821Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4850964Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4851114Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4851288Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4851880Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4852467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4852827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4853185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4853497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4853781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4854088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4854359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4854469Z Execution Analysis: .......... 2024-12-18T00:21:05.4854724Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4854932Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4855223Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1348 counts during 1284 steps 2024-12-18T00:21:05.4855228Z 2024-12-18T00:21:05.4855435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4855546Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4855847Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4855978Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4856206Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4856423Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4856597Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4856776Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4857160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4857519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4857828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4858099Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4858414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4858683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4858983Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4859110Z Execution Analysis: (:1) 2024-12-18T00:21:05.4859379Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4859580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4859585Z 2024-12-18T00:21:05.4859794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4859905Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4860135Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4860249Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4860458Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4860609Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4860754Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4860920Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4861522Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4862095Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4862458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4862810Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4863126Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4863401Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4863716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4863984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4864090Z Execution Analysis: .......... 2024-12-18T00:21:05.4864363Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4864563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4864861Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1349 counts during 1285 steps 2024-12-18T00:21:05.4864866Z 2024-12-18T00:21:05.4865069Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4865190Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4865505Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4865650Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4865850Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4866016Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4866160Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4866346Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4866709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4867056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4867373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4867642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4867947Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4868222Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4868601Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4868724Z Execution Analysis: (:1) 2024-12-18T00:21:05.4868962Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4869153Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4869157Z 2024-12-18T00:21:05.4869341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4869452Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4869661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4869762Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4869962Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4870094Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4870236Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4873380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4873966Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4874510Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4874845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4875176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4875466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4875724Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4876008Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4876265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4876361Z Execution Analysis: .......... 2024-12-18T00:21:05.4876598Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4876789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4877060Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1350 counts during 1286 steps 2024-12-18T00:21:05.4877066Z 2024-12-18T00:21:05.4877258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4877417Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4877718Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4877818Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4878042Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4878199Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4878332Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4878489Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4878820Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4879143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4879430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4879691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4879976Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4880223Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4880500Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4880614Z Execution Analysis: (:1) 2024-12-18T00:21:05.4880857Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4881045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4881049Z 2024-12-18T00:21:05.4881238Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4881341Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4881550Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4881658Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4881849Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4881990Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4882124Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4882281Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4882829Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4883364Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4883694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4884019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4884313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4884564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4884855Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4885099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4885200Z Execution Analysis: .......... 2024-12-18T00:21:05.4885433Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4885617Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4885888Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1351 counts during 1287 steps 2024-12-18T00:21:05.4885893Z 2024-12-18T00:21:05.4886118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4886250Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4886517Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4886645Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4886854Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4886994Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4887123Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4887272Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4887607Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4887931Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4888224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4888478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4888763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4889011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4889278Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4889396Z Execution Analysis: (:1) 2024-12-18T00:21:05.4889630Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4889819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4889824Z 2024-12-18T00:21:05.4890005Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4890111Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4890323Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4890428Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4890618Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4890747Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4890887Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4891040Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4891594Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4892120Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4892455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4892779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4893067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4893325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4893608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4893858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4893954Z Execution Analysis: .......... 2024-12-18T00:21:05.4894193Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4894380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4894654Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1352 counts during 1288 steps 2024-12-18T00:21:05.4894706Z 2024-12-18T00:21:05.4894892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4894995Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4895295Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4895419Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4895612Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4895743Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4895879Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4896030Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4896445Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4896944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4897259Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4897536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4897844Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4898120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4898411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4898540Z Execution Analysis: (:1) 2024-12-18T00:21:05.4898795Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4898995Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4899000Z 2024-12-18T00:21:05.4899203Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4899315Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4899549Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4899660Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4899871Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4900013Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4900161Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4900333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4900927Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4901503Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4901860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4902218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4902526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4902806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4903110Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4903376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4903483Z Execution Analysis: .......... 2024-12-18T00:21:05.4903739Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4903944Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4904288Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1353 counts during 1289 steps 2024-12-18T00:21:05.4904293Z 2024-12-18T00:21:05.4904500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4904638Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4904953Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4905069Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4905273Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4905418Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4905560Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4905734Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4906088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4906438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4906754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4907024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4907337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4907603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4907895Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4908019Z Execution Analysis: (:1) 2024-12-18T00:21:05.4908278Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4908476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4908483Z 2024-12-18T00:21:05.4908684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4908796Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4909127Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4909230Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4909419Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4909552Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4909684Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4909835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4910383Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4910912Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4911247Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4911572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4911868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4912123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4912409Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4912658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4912753Z Execution Analysis: .......... 2024-12-18T00:21:05.4912995Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4913204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4913496Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1354 counts during 1290 steps 2024-12-18T00:21:05.4913524Z 2024-12-18T00:21:05.4913709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4913850Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4914118Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4914222Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4914408Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4914540Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4914675Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4914828Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4915163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4915486Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4915774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4916025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4916308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4916557Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4916826Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4916941Z Execution Analysis: (:1) 2024-12-18T00:21:05.4917176Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4917371Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4917376Z 2024-12-18T00:21:05.4917559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4917832Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4918056Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4918161Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4918365Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4918500Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4918647Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4918808Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4919381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4919946Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4920296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4920640Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4920944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4921215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4921515Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4921777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4921877Z Execution Analysis: .......... 2024-12-18T00:21:05.4922287Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4922515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4922824Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1355 counts during 1291 steps 2024-12-18T00:21:05.4922829Z 2024-12-18T00:21:05.4923053Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4923163Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4923448Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4923553Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4923757Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4923894Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4924028Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4924194Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4924541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4924882Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4925186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4925455Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4925750Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4926008Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4926293Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4926410Z Execution Analysis: (:1) 2024-12-18T00:21:05.4926668Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4926866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4926872Z 2024-12-18T00:21:05.4927068Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4927176Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4927402Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4927506Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4927705Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4927844Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4927985Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4928150Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4928728Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4929291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4929744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4930064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4930353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4930603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4930887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4931134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4931257Z Execution Analysis: .......... 2024-12-18T00:21:05.4931516Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4931702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4932016Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1356 counts during 1292 steps 2024-12-18T00:21:05.4932021Z 2024-12-18T00:21:05.4932202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4932309Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4932575Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4932679Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4932865Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4933000Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4933130Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4933284Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4933618Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4933945Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4934235Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4934486Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4934769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4935012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4935282Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4935392Z Execution Analysis: (:1) 2024-12-18T00:21:05.4935629Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4935822Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4935827Z 2024-12-18T00:21:05.4936013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4936118Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4936328Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4936502Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4936692Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4936992Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4937142Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4937309Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4937910Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4938486Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4938856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4939209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4939523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4939797Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4940100Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4940399Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4940531Z Execution Analysis: .......... 2024-12-18T00:21:05.4940790Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4941043Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4941336Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1357 counts during 1293 steps 2024-12-18T00:21:05.4941341Z 2024-12-18T00:21:05.4941544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4941660Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4941948Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4942052Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4942259Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4942405Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4942552Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4942713Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4943071Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4943425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4943735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4944011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4944498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4944776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4945070Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4945203Z Execution Analysis: (:1) 2024-12-18T00:21:05.4945461Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4945664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4945671Z 2024-12-18T00:21:05.4945877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4945987Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4946219Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4946326Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4946533Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4946672Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4946817Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4946988Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4947579Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4948157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4948514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4948868Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4949178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4949455Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4949824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4950124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4950232Z Execution Analysis: .......... 2024-12-18T00:21:05.4950539Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4950774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4951062Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1358 counts during 1294 steps 2024-12-18T00:21:05.4951067Z 2024-12-18T00:21:05.4951270Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4951379Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4951671Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4951778Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4951980Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4952127Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4952264Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4952438Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4952796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4953150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4953458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4953729Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4954038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4954303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4954599Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4954719Z Execution Analysis: (:1) 2024-12-18T00:21:05.4954982Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4955185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4955190Z 2024-12-18T00:21:05.4955392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4955502Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4955728Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4955838Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4956043Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4956294Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4956433Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4956582Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4957137Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4957668Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4958002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4958323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4958613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4958886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4959198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4959442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4959564Z Execution Analysis: .......... 2024-12-18T00:21:05.4959824Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4960010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4960277Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1359 counts during 1295 steps 2024-12-18T00:21:05.4960282Z 2024-12-18T00:21:05.4960470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4960578Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4960842Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4960951Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4961136Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4961267Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4961403Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4961560Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4961895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4962214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4962505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4962753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4963039Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4963298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4963566Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4963687Z Execution Analysis: (:1) 2024-12-18T00:21:05.4963928Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4964118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4964122Z 2024-12-18T00:21:05.4964306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4964414Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4964626Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4964727Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4964926Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4965059Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4965199Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4965353Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4965913Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4966443Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4966774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4967103Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4967389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4967778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4968061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4968342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4968462Z Execution Analysis: .......... 2024-12-18T00:21:05.4968706Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4968888Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4969155Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1360 counts during 1296 steps 2024-12-18T00:21:05.4969159Z 2024-12-18T00:21:05.4969349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4969451Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4969729Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4969828Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4970023Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4970154Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4970283Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4970438Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4970763Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4971090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4971375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4971628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4971915Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4972170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4972436Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4972550Z Execution Analysis: (:1) 2024-12-18T00:21:05.4972788Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4972973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4972977Z 2024-12-18T00:21:05.4973166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4973269Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4973486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4973585Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4973776Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4973909Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4974042Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4974199Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4974742Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4975277Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4975607Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4975935Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4976266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4976597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4977091Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4977379Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4977489Z Execution Analysis: .......... 2024-12-18T00:21:05.4977743Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4977946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4978230Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1361 counts during 1297 steps 2024-12-18T00:21:05.4978235Z 2024-12-18T00:21:05.4978440Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4978552Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4978839Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4978955Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4979156Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4979306Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4979444Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4979605Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4979968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4980319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4980632Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4980905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4981220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4981488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4981788Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4981909Z Execution Analysis: (:1) 2024-12-18T00:21:05.4982165Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4982371Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4982375Z 2024-12-18T00:21:05.4982574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4982693Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4982922Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4983038Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4983242Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4983385Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4983537Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4983704Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4984303Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4984872Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4985234Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4985631Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4985986Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4986283Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4986621Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4986895Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4987000Z Execution Analysis: .......... 2024-12-18T00:21:05.4987271Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4987472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4987768Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1362 counts during 1298 steps 2024-12-18T00:21:05.4987773Z 2024-12-18T00:21:05.4987980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4988101Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4988389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4988499Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4988708Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4988850Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4989102Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4989254Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4989588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4989909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4990196Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4990458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4990740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4990996Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4991264Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.4991384Z Execution Analysis: (:1) 2024-12-18T00:21:05.4991620Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4991807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4991817Z 2024-12-18T00:21:05.4992000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4992105Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4992322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.4992423Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4992622Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.4992750Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.4992888Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.4993040Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4993588Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.4994122Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.4994479Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.4994831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4995143Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4995422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4995707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4995961Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.4996054Z Execution Analysis: .......... 2024-12-18T00:21:05.4996288Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.4996481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4996749Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1363 counts during 1299 steps 2024-12-18T00:21:05.4996755Z 2024-12-18T00:21:05.4996946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.4997049Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.4997325Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.4997423Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.4997614Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.4997749Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.4997879Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.4998036Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.4998366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.4998696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.4998982Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.4999233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.4999526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.4999770Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5000041Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5000153Z Execution Analysis: (:1) 2024-12-18T00:21:05.5000394Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5000577Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5000581Z 2024-12-18T00:21:05.5000770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5000874Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5001083Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5001190Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5001381Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5001521Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5001652Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5001811Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5002358Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5002891Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5003270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5003595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5003937Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5004189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5004477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5004723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5004831Z Execution Analysis: .......... 2024-12-18T00:21:05.5005066Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5005257Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5005532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1364 counts during 1300 steps 2024-12-18T00:21:05.5005536Z 2024-12-18T00:21:05.5005723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5005841Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5006108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5006216Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5006402Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5006535Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5006669Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5006818Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5007156Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5007481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5007770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5008023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5008319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5008568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5008838Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5008958Z Execution Analysis: (:1) 2024-12-18T00:21:05.5009196Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5009389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5009395Z 2024-12-18T00:21:05.5009580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5009693Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5009904Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5010006Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5010202Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5010336Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5010475Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5010628Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5011179Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5011731Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5012088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5012434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5012746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5013000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5013281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5013532Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5013625Z Execution Analysis: .......... 2024-12-18T00:21:05.5013865Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5014052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5014320Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1365 counts during 1301 steps 2024-12-18T00:21:05.5014331Z 2024-12-18T00:21:05.5014515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5014617Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5014889Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5014989Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5015178Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5015306Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5015439Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5015591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5015922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5016254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5016613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5017045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5017349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5017624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5017913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5018036Z Execution Analysis: (:1) 2024-12-18T00:21:05.5018293Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5018497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5018502Z 2024-12-18T00:21:05.5018705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5018815Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5019053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5019159Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5019364Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5019510Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5019653Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5019824Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5020460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5021062Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5021444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5021824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5022136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5022408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5022718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5022982Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5023092Z Execution Analysis: .......... 2024-12-18T00:21:05.5023347Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5023557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5023847Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1366 counts during 1302 steps 2024-12-18T00:21:05.5023853Z 2024-12-18T00:21:05.5024060Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5024169Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5024458Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5024576Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5024778Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5024929Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5025070Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5025249Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5025604Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5025956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5026271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5026542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5026857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5027124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5027418Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5027539Z Execution Analysis: (:1) 2024-12-18T00:21:05.5027795Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5028000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5028006Z 2024-12-18T00:21:05.5028207Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5028323Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5028553Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5028666Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5028870Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5029124Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5029373Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5029530Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5030108Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5030660Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5031048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5031372Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5031663Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5031912Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5032202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5032446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5032547Z Execution Analysis: .......... 2024-12-18T00:21:05.5032788Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5032975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5033249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1368 counts during 1303 steps 2024-12-18T00:21:05.5033254Z 2024-12-18T00:21:05.5033438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5033546Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5033812Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5033913Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5034103Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5034234Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5034371Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5034523Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5034857Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5035180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5035466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5035724Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5036005Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5036255Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5036523Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5036649Z Execution Analysis: (:1) 2024-12-18T00:21:05.5036883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5037077Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5037081Z 2024-12-18T00:21:05.5037267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5037367Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5037584Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5037686Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5037880Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5038012Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5038150Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5038325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5038901Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5039480Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5039814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5040141Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5040423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5040679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5040960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5041212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5041307Z Execution Analysis: .......... 2024-12-18T00:21:05.5041542Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5041732Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5041999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1369 counts during 1304 steps 2024-12-18T00:21:05.5042003Z 2024-12-18T00:21:05.5042193Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5042294Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5042569Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5042669Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5042864Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5042996Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5043125Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5043286Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5043618Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5043946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5044360Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5044793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5045099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5045369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5045667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5045792Z Execution Analysis: (:1) 2024-12-18T00:21:05.5046063Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5046266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5046271Z 2024-12-18T00:21:05.5046481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5046591Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5046820Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5046934Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5047144Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5047290Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5047483Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5047690Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5048283Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5048937Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5049295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5049644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5049959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5050232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5050552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5050823Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5050941Z Execution Analysis: .......... 2024-12-18T00:21:05.5051196Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5051398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5051699Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1370 counts during 1305 steps 2024-12-18T00:21:05.5051704Z 2024-12-18T00:21:05.5051906Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5052026Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5052315Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5052437Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5052641Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5052792Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5052932Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5053098Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5053464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5053813Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5054131Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5054400Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5054714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5054980Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5055272Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5055402Z Execution Analysis: (:1) 2024-12-18T00:21:05.5055662Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5055867Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5055872Z 2024-12-18T00:21:05.5056069Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5056188Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5056484Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5056607Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5056812Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5057014Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5057166Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5057329Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5057984Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5058556Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5058926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5059273Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5059582Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5059865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5060172Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5060446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5060549Z Execution Analysis: .......... 2024-12-18T00:21:05.5060813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5061014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5061310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1371 counts during 1306 steps 2024-12-18T00:21:05.5061315Z 2024-12-18T00:21:05.5061512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5061626Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5061927Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5062037Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5062245Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5062391Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5062544Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5062708Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5063063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5063416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5063723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5064001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5064307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5064586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5064875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5065008Z Execution Analysis: (:1) 2024-12-18T00:21:05.5065263Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5065462Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5065467Z 2024-12-18T00:21:05.5065674Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5065784Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5066023Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5066128Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5066393Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5066536Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5066679Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5066878Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5067494Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5068077Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5068431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5068789Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5069102Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5069392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5069699Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5069967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5070080Z Execution Analysis: .......... 2024-12-18T00:21:05.5070334Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5070542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5070935Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1372 counts during 1307 steps 2024-12-18T00:21:05.5070940Z 2024-12-18T00:21:05.5071144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5071252Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5071535Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5071647Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5071845Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5072098Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5072227Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5072385Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5072711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5073034Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5073325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5073579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5073868Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5074115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5074397Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5074512Z Execution Analysis: (:1) 2024-12-18T00:21:05.5074754Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5074937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5074941Z 2024-12-18T00:21:05.5075126Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5075238Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5075470Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5075603Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5075793Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5075959Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5076091Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5076273Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5076830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5077361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5077700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5078024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5078320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5078571Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5078866Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5079112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5079207Z Execution Analysis: .......... 2024-12-18T00:21:05.5079452Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5079637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5079915Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1373 counts during 1308 steps 2024-12-18T00:21:05.5079919Z 2024-12-18T00:21:05.5080104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5080219Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5080485Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5080597Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5080784Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5080916Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5081053Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5081204Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5081541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5081862Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5082156Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5082407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5082689Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5082937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5083207Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5083328Z Execution Analysis: (:1) 2024-12-18T00:21:05.5083564Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5083756Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5083760Z 2024-12-18T00:21:05.5083944Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5084081Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5084312Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5084412Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5084642Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5084774Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5084940Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5085092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5085639Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5086173Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5086501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5086836Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5087120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5087381Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5087665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5087918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5088011Z Execution Analysis: .......... 2024-12-18T00:21:05.5088245Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5088440Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5088707Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1374 counts during 1309 steps 2024-12-18T00:21:05.5088715Z 2024-12-18T00:21:05.5088913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5089018Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5089293Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5089393Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5089591Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5089721Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5089852Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5090013Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5090340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5090672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5090961Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5091223Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5091507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5091753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5092028Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5092146Z Execution Analysis: (:1) 2024-12-18T00:21:05.5092394Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5092584Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5092588Z 2024-12-18T00:21:05.5092811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5092936Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5093154Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5093280Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5093493Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5093633Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5093770Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5093933Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5094477Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5095012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5095347Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5095673Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5095968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5096219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5096580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5096998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5097113Z Execution Analysis: .......... 2024-12-18T00:21:05.5097369Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5097583Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5097873Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1375 counts during 1310 steps 2024-12-18T00:21:05.5097878Z 2024-12-18T00:21:05.5098076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5098199Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5098490Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5098610Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5098812Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5098965Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5099106Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5099271Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5099634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5099984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5100306Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5100582Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5100895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5101159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5101456Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5101576Z Execution Analysis: (:1) 2024-12-18T00:21:05.5101829Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5102033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5102090Z 2024-12-18T00:21:05.5102290Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5102408Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5102663Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5102806Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5103011Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5103151Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5103301Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5103468Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5104064Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5104637Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5105008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5105355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5105676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5105948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5106251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5106523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5106628Z Execution Analysis: .......... 2024-12-18T00:21:05.5106890Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5107089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5107391Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1376 counts during 1311 steps 2024-12-18T00:21:05.5107398Z 2024-12-18T00:21:05.5107598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5107721Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5108010Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5108120Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5108327Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5108467Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5108617Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5108781Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5109234Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5109562Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5109849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5110106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5110388Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5110644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5110914Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5111036Z Execution Analysis: (:1) 2024-12-18T00:21:05.5111271Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5111556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5111584Z 2024-12-18T00:21:05.5111774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5111905Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5112149Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5112258Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5112458Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5112590Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5112725Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5112886Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5113433Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5113974Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5114307Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5114639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5114924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5115183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5115465Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5115710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5115813Z Execution Analysis: .......... 2024-12-18T00:21:05.5116050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5116246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5116515Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1377 counts during 1312 steps 2024-12-18T00:21:05.5116519Z 2024-12-18T00:21:05.5116717Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5116818Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5117096Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5117197Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5117388Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5117523Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5117821Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5117994Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5118340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5118689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5118993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5119255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5119556Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5119813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5120102Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5120221Z Execution Analysis: (:1) 2024-12-18T00:21:05.5120507Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5120738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5120767Z 2024-12-18T00:21:05.5120967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5121098Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5121320Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5121435Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5121637Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5121779Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5121919Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5122079Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5122664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5123225Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5123585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5123926Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5124236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5124504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5124812Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5125071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5125182Z Execution Analysis: .......... 2024-12-18T00:21:05.5125431Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5125627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5125916Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1378 counts during 1313 steps 2024-12-18T00:21:05.5125921Z 2024-12-18T00:21:05.5126116Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5126231Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5126509Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5126620Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5126818Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5126957Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5127103Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5127265Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5127616Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5127961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5128271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5128536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5128834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5129099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5129382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5129530Z Execution Analysis: (:1) 2024-12-18T00:21:05.5129906Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5130100Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5130131Z 2024-12-18T00:21:05.5130337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5130450Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5130664Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5130764Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5130958Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5131091Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5131233Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5131385Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5131950Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5132483Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5132819Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5133157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5133442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5133703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5133988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5134248Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5134350Z Execution Analysis: .......... 2024-12-18T00:21:05.5134597Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5134788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5135056Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1379 counts during 1314 steps 2024-12-18T00:21:05.5135060Z 2024-12-18T00:21:05.5135257Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5135358Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5135636Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5135735Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5135933Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5136071Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5136209Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5136444Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5136947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5137309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5137616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5137899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5138209Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5138481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5138807Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5138962Z Execution Analysis: (:1) 2024-12-18T00:21:05.5139234Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5139485Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5139490Z 2024-12-18T00:21:05.5139703Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5139815Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5140053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5140163Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5140368Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5140525Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5140667Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5140848Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5141435Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5142020Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5142375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5142738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5143048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5143316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5143635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5143904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5144022Z Execution Analysis: .......... 2024-12-18T00:21:05.5144450Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5144662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5144951Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1380 counts during 1315 steps 2024-12-18T00:21:05.5144956Z 2024-12-18T00:21:05.5145164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5145278Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5145568Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5145685Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5145891Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5146044Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5146183Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5146350Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5146722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5147068Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5147391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5147661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5147977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5148299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5148762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5148885Z Execution Analysis: (:1) 2024-12-18T00:21:05.5149174Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5149415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5149420Z 2024-12-18T00:21:05.5149620Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5149747Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5149977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5150094Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5150302Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5150447Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5150604Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5150770Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5151373Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5151948Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5152317Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5152662Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5152974Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5153249Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5153555Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5153832Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5153936Z Execution Analysis: .......... 2024-12-18T00:21:05.5154202Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5154403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5154706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1381 counts during 1316 steps 2024-12-18T00:21:05.5154711Z 2024-12-18T00:21:05.5154912Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5155034Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5155328Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5155440Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5155651Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5155792Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5156048Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5156210Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5156658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5156984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5157271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5157534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5157817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5158133Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5158402Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5158552Z Execution Analysis: (:1) 2024-12-18T00:21:05.5158815Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5159001Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5159014Z 2024-12-18T00:21:05.5159202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5159305Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5159531Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5159632Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5159835Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5159967Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5160116Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5160440Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5161018Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5161585Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5161934Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5162292Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5162592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5162872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5163171Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5163442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5163549Z Execution Analysis: .......... 2024-12-18T00:21:05.5163800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5164006Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5164288Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1382 counts during 1317 steps 2024-12-18T00:21:05.5164292Z 2024-12-18T00:21:05.5164501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5164609Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5164902Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5165009Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5165206Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5165356Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5165492Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5165664Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5166009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5166362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5166663Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5166932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5167293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5167557Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5167878Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5168020Z Execution Analysis: (:1) 2024-12-18T00:21:05.5168280Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5168477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5168481Z 2024-12-18T00:21:05.5168688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5168797Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5169017Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5169140Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5169341Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5169491Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5169631Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5169803Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5170380Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5170936Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5171294Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5171636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5171951Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5172317Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5172612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5172861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5172966Z Execution Analysis: .......... 2024-12-18T00:21:05.5173204Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5173390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5173668Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1383 counts during 1318 steps 2024-12-18T00:21:05.5173672Z 2024-12-18T00:21:05.5173862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5173973Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5174241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5174352Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5174541Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5174676Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5174819Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5174970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5175310Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5175633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5175924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5176199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5176609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5177064Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5177381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5177518Z Execution Analysis: (:1) 2024-12-18T00:21:05.5177777Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5177988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5177992Z 2024-12-18T00:21:05.5178197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5178315Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5178552Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5178664Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5178883Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5179028Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5179187Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5179351Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5179955Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5180529Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5180893Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5181246Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5181557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5181842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5182149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5182430Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5182535Z Execution Analysis: .......... 2024-12-18T00:21:05.5182802Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5183005Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5183295Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1384 counts during 1319 steps 2024-12-18T00:21:05.5183308Z 2024-12-18T00:21:05.5183516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5183624Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5183927Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5184036Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5184252Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5184397Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5184551Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5184719Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5185074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5185435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5185776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5186083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5186417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5186731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5187027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5187151Z Execution Analysis: (:1) 2024-12-18T00:21:05.5187413Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5187613Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5187617Z 2024-12-18T00:21:05.5187823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5187935Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5188174Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5188283Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5188498Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5188642Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5188785Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5188959Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5189612Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5190148Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5190478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5190813Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5191100Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5191352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5191645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5191891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5191997Z Execution Analysis: .......... 2024-12-18T00:21:05.5192231Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5192427Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5192693Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1385 counts during 1320 steps 2024-12-18T00:21:05.5192699Z 2024-12-18T00:21:05.5192891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5192997Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5193263Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5193378Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5193567Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5193713Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5193842Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5194001Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5194330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5194679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5194997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5195247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5195586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5195832Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5196106Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5196223Z Execution Analysis: (:1) 2024-12-18T00:21:05.5196458Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5196651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5196655Z 2024-12-18T00:21:05.5196841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5196961Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5197174Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5197285Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5197476Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5197613Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5197750Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5197907Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5198466Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5198996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5199339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5199660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5199958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5200210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5200505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5200753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5200848Z Execution Analysis: .......... 2024-12-18T00:21:05.5201095Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5201281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5201560Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1386 counts during 1321 steps 2024-12-18T00:21:05.5201565Z 2024-12-18T00:21:05.5201752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5201866Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5202137Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5202237Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5202433Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5202562Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5202700Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5202853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5203193Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5203566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5203856Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5204163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5204445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5204701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5204967Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5205092Z Execution Analysis: (:1) 2024-12-18T00:21:05.5205329Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5205530Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5205535Z 2024-12-18T00:21:05.5205722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5205826Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5206049Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5206152Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5206355Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5206487Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5206629Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5206786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5207333Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5207872Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5208203Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5208541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5208827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5209092Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5209375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5209631Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5209729Z Execution Analysis: .......... 2024-12-18T00:21:05.5209965Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5210164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5210432Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1387 counts during 1322 steps 2024-12-18T00:21:05.5210438Z 2024-12-18T00:21:05.5210638Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5210739Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5211017Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5211117Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5211311Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5211443Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5211574Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5211735Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5212108Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5212441Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5212750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5213039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5213324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5213570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5213850Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5213963Z Execution Analysis: (:1) 2024-12-18T00:21:05.5214209Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5214400Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5214404Z 2024-12-18T00:21:05.5214600Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5214703Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5214918Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5215029Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5215218Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5215361Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5215494Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5215658Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5216206Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5216988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5217352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5217705Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5218028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5218299Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5218618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5218885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5218997Z Execution Analysis: .......... 2024-12-18T00:21:05.5219259Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5219460Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5219765Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1389 counts during 1323 steps 2024-12-18T00:21:05.5219771Z 2024-12-18T00:21:05.5219972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5220095Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5220381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5220494Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5220695Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5220847Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5220986Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5221208Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5221572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5221959Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5222307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5222583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5222900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5223167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5223460Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5223591Z Execution Analysis: (:1) 2024-12-18T00:21:05.5223852Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5224059Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5224065Z 2024-12-18T00:21:05.5224271Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5224386Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5224615Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5224731Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5224935Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5225076Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5225230Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5225395Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5226000Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5226576Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5226945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5227295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5227604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5227882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5228190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5228463Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5228574Z Execution Analysis: .......... 2024-12-18T00:21:05.5228941Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5229244Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5229522Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1390 counts during 1324 steps 2024-12-18T00:21:05.5229526Z 2024-12-18T00:21:05.5229709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5229810Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5230087Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5230188Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5230380Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5230509Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5230693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5230848Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5231198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5231546Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5231835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5232093Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5232372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5232622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5232889Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5233013Z Execution Analysis: (:1) 2024-12-18T00:21:05.5233247Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5233433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5233438Z 2024-12-18T00:21:05.5233629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5233730Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5233946Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5234045Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5234241Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5234373Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5234506Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5234664Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5235212Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5235747Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5236078Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5236404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5236691Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5236952Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5237236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5237485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5237589Z Execution Analysis: .......... 2024-12-18T00:21:05.5237828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5238020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5238288Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1391 counts during 1325 steps 2024-12-18T00:21:05.5238292Z 2024-12-18T00:21:05.5238481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5238582Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5238847Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5238952Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5239162Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5239326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5239454Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5239641Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5239990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5240314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5240607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5240857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5241144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5241391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5241670Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5241783Z Execution Analysis: (:1) 2024-12-18T00:21:05.5242031Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5242219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5242223Z 2024-12-18T00:21:05.5242410Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5242523Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5242735Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5242842Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5243035Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5243173Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5243309Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5243464Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5244015Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5244866Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5245233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5245584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5245906Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5246180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5246499Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5246767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5246876Z Execution Analysis: .......... 2024-12-18T00:21:05.5247144Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5247346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5247644Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1392 counts during 1326 steps 2024-12-18T00:21:05.5247648Z 2024-12-18T00:21:05.5247849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5247966Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5248254Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5248423Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5248659Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5248804Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5248984Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5249151Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5249621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5249972Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5250293Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5250565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5250871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5251147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5251438Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5251572Z Execution Analysis: (:1) 2024-12-18T00:21:05.5251829Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5252036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5252040Z 2024-12-18T00:21:05.5252239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5252357Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5252587Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5252698Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5252911Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5253057Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5253212Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5253381Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5253983Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5254555Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5254913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5255276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5255590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5255875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5256190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5256545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5256652Z Execution Analysis: .......... 2024-12-18T00:21:05.5256904Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5257109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5257397Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1393 counts during 1327 steps 2024-12-18T00:21:05.5257401Z 2024-12-18T00:21:05.5257608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5257720Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5258043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5258186Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5258397Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5258561Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5258725Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5258899Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5259255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5259610Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5259916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5260198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5260506Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5260774Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5261074Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5264270Z Execution Analysis: (:1) 2024-12-18T00:21:05.5264562Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5264771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5264776Z 2024-12-18T00:21:05.5264982Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5265092Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5265325Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5265437Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5265651Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5265798Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5265945Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5266114Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5266715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5267288Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5267654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5268004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5268325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5268708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5268999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5269249Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5269353Z Execution Analysis: .......... 2024-12-18T00:21:05.5269590Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5269779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5270049Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1394 counts during 1328 steps 2024-12-18T00:21:05.5270054Z 2024-12-18T00:21:05.5270236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5270425Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5270692Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5270826Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5271016Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5271181Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5271312Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5271464Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5271801Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5272122Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5272413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5272666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5272956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5273200Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5273469Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5273586Z Execution Analysis: (:1) 2024-12-18T00:21:05.5273821Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5274010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5274014Z 2024-12-18T00:21:05.5274199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5274306Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5274517Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5274617Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5274813Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5274946Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5275083Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5275235Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5275785Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5276313Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5276647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5276971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5277256Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5277507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5277793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5278043Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5278138Z Execution Analysis: .......... 2024-12-18T00:21:05.5278378Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5278561Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5278834Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1395 counts during 1329 steps 2024-12-18T00:21:05.5278838Z 2024-12-18T00:21:05.5279045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5279171Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5279442Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5279565Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5279778Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5279907Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5280039Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5280191Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5280518Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5280841Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5281127Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5281384Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5281665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5281915Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5282180Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5282292Z Execution Analysis: (:1) 2024-12-18T00:21:05.5282532Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5282715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5282719Z 2024-12-18T00:21:05.5282908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5283009Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5283226Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5283322Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5283518Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5283647Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5283780Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5283936Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5284482Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5285020Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5285348Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5285679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5285966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5286219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5286505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5286751Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5286850Z Execution Analysis: .......... 2024-12-18T00:21:05.5287084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5287274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5287563Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1396 counts during 1330 steps 2024-12-18T00:21:05.5287590Z 2024-12-18T00:21:05.5287780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5287907Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5288172Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5288300Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5288488Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5288626Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5288753Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5288912Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5289238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5289560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5289856Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5290106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5290393Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5290638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5290912Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5291023Z Execution Analysis: (:1) 2024-12-18T00:21:05.5291262Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5291449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5291453Z 2024-12-18T00:21:05.5291640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5291751Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5291959Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5292065Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5292256Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5292390Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5292521Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5292671Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5293221Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5293745Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5294080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5294400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5294692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5294943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5295232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5295479Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5295573Z Execution Analysis: .......... 2024-12-18T00:21:05.5295816Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5295999Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5296328Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1397 counts during 1331 steps 2024-12-18T00:21:05.5296333Z 2024-12-18T00:21:05.5296602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5296740Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5297213Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5297322Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5297530Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5297671Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5297815Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5297980Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5298339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5298689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5299001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5299280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5299584Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5299854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5300142Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5300266Z Execution Analysis: (:1) 2024-12-18T00:21:05.5300519Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5300722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5300731Z 2024-12-18T00:21:05.5300929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5301040Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5301279Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5301386Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5301596Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5301735Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5301890Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5302054Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5302643Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5303223Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5303582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5303937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5304249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5304525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5304830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5305100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5305201Z Execution Analysis: .......... 2024-12-18T00:21:05.5305455Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5305686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5305999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1398 counts during 1332 steps 2024-12-18T00:21:05.5306029Z 2024-12-18T00:21:05.5306258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5306370Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5306664Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5306771Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5306977Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5307117Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5307254Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5307425Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5307783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5308139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5308449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5308725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5309135Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5309391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5309677Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5309793Z Execution Analysis: (:1) 2024-12-18T00:21:05.5310047Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5310241Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5310247Z 2024-12-18T00:21:05.5310446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5310552Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5310780Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5310883Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5311086Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5311228Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5311368Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5311535Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5312278Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5312860Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5313217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5313567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5313881Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5314151Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5314463Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5314729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5314839Z Execution Analysis: .......... 2024-12-18T00:21:05.5315120Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5315350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5315668Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1399 counts during 1333 steps 2024-12-18T00:21:05.5315672Z 2024-12-18T00:21:05.5315900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5316019Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5316307Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5316417Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5316618Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5316765Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5316904Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5317072Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5317434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5317782Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5318098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5318367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5318677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5318942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5319229Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5319354Z Execution Analysis: (:1) 2024-12-18T00:21:05.5319610Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5319813Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5319820Z 2024-12-18T00:21:05.5320017Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5320133Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5320359Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5320471Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5320672Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5320811Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5320957Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5321119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5321714Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5322285Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5322649Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5322994Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5323303Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5323581Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5323887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5324156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5324309Z Execution Analysis: .......... 2024-12-18T00:21:05.5324568Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5324794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5325120Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1400 counts during 1334 steps 2024-12-18T00:21:05.5325125Z 2024-12-18T00:21:05.5325324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5325435Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5325725Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5325831Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5326039Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5326177Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5326322Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5326487Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5326842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5327199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5327506Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5327780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5328083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5328353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5328640Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5328770Z Execution Analysis: (:1) 2024-12-18T00:21:05.5329026Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5329226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5329233Z 2024-12-18T00:21:05.5329439Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5329551Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5329782Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5329888Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5330099Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5330238Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5330381Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5330549Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5331142Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5331723Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5332080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5332434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5332742Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5333015Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5333318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5333609Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5333744Z Execution Analysis: .......... 2024-12-18T00:21:05.5334002Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5334258Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5334553Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1401 counts during 1335 steps 2024-12-18T00:21:05.5334557Z 2024-12-18T00:21:05.5334763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5334875Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5335170Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5335277Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5335478Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5335628Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5335766Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5335934Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5336290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5336734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5337051Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5337323Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5337633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5337896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5338191Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5338313Z Execution Analysis: (:1) 2024-12-18T00:21:05.5338571Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5338775Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5338780Z 2024-12-18T00:21:05.5338977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5339091Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5339322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5339439Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5339642Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5339787Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5339929Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5340098Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5340696Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5341271Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5341633Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5341980Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5342295Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5342565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5342904Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5343198Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5343324Z Execution Analysis: .......... 2024-12-18T00:21:05.5343581Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5343803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5344094Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1402 counts during 1336 steps 2024-12-18T00:21:05.5344098Z 2024-12-18T00:21:05.5344468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5344583Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5344871Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5344983Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5345186Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5345328Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5345473Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5345639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5346002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5346352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5346662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5346932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5347236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5347507Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5347796Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5347922Z Execution Analysis: (:1) 2024-12-18T00:21:05.5348179Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5348385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5348389Z 2024-12-18T00:21:05.5348587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5348704Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5348930Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5349036Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5349251Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5349391Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5349539Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5349701Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5350300Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5350869Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5351230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5351580Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5351890Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5352227Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5352566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5352837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5352973Z Execution Analysis: .......... 2024-12-18T00:21:05.5353266Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5353468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5353760Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1403 counts during 1337 steps 2024-12-18T00:21:05.5353765Z 2024-12-18T00:21:05.5353973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5354083Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5354380Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5354489Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5354692Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5354837Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5354975Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5355145Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5355501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5355856Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5356165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5356443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5356750Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5357017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5357312Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5357439Z Execution Analysis: (:1) 2024-12-18T00:21:05.5357703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5357904Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5357908Z 2024-12-18T00:21:05.5358113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5358225Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5358460Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5358566Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5358775Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5358925Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5359068Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5359239Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5359829Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5360404Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5360760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5361111Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5361454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5361752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5362063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5362363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5362497Z Execution Analysis: .......... 2024-12-18T00:21:05.5362751Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5362954Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5363239Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1404 counts during 1338 steps 2024-12-18T00:21:05.5363244Z 2024-12-18T00:21:05.5363444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5363561Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5363852Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5363967Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5364170Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5364320Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5364459Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5364625Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5364983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5365333Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5365648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5365917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5366230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5366598Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5366885Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5367004Z Execution Analysis: (:1) 2024-12-18T00:21:05.5367256Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5367457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5367462Z 2024-12-18T00:21:05.5367657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5367872Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5368083Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5368193Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5368380Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5368512Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5368650Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5368802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5369355Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5369883Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5370216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5370538Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5370878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5371130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5371436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5371715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5371810Z Execution Analysis: .......... 2024-12-18T00:21:05.5372053Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5372236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5372508Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1405 counts during 1339 steps 2024-12-18T00:21:05.5372512Z 2024-12-18T00:21:05.5372697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5372807Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5373071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5373172Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5373365Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5373494Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5373627Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5373779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5374106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5374602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5374906Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5375183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5375482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5375750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5376036Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5376325Z Execution Analysis: (:1) 2024-12-18T00:21:05.5376673Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5376875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5376884Z 2024-12-18T00:21:05.5377083Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5377195Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5377437Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5377544Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5377753Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5377899Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5378044Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5378219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5378813Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5379395Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5379756Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5380142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5380479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5381003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5381335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5381604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5381711Z Execution Analysis: .......... 2024-12-18T00:21:05.5381966Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5382173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5382461Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1406 counts during 1340 steps 2024-12-18T00:21:05.5382469Z 2024-12-18T00:21:05.5382678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5382791Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5383087Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5383200Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5383399Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5383546Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5383687Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5383857Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5384214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5384566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5384877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5385148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5385461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5385731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5386025Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5386148Z Execution Analysis: (:1) 2024-12-18T00:21:05.5386406Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5386608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5386612Z 2024-12-18T00:21:05.5386815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5386930Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5387157Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5387271Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5387476Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5387628Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5387772Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5387944Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5388536Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5389106Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5389590Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5389955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5390287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5390577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5390881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5391144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5391247Z Execution Analysis: .......... 2024-12-18T00:21:05.5391494Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5391688Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5391978Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1407 counts during 1341 steps 2024-12-18T00:21:05.5391985Z 2024-12-18T00:21:05.5392181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5392294Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5392575Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5392684Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5392880Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5393017Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5393157Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5393317Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5393667Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5394006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5394310Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5394576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5394873Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5395138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5395419Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5395543Z Execution Analysis: (:1) 2024-12-18T00:21:05.5395789Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5395988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5395993Z 2024-12-18T00:21:05.5396191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5396303Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5396529Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5396633Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5396842Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5396977Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5397122Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5397283Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5397864Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5398446Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5398828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5399174Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5399603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5399878Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5400281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5400529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5400625Z Execution Analysis: .......... 2024-12-18T00:21:05.5400867Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5401056Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5401321Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1408 counts during 1342 steps 2024-12-18T00:21:05.5401332Z 2024-12-18T00:21:05.5401517Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5401623Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5401895Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5401995Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5402186Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5402318Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5402444Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5402601Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5402930Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5403263Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5403725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5403998Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5404296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5404564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5404844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5404961Z Execution Analysis: (:1) 2024-12-18T00:21:05.5405213Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5405411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5405417Z 2024-12-18T00:21:05.5405616Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5405726Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5405953Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5406058Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5406256Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5406398Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5406538Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5406702Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5407278Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5407861Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5408232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5408627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5408931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5409193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5409495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5409754Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5409860Z Execution Analysis: .......... 2024-12-18T00:21:05.5410112Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5410311Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5410591Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1410 counts during 1343 steps 2024-12-18T00:21:05.5410597Z 2024-12-18T00:21:05.5410796Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5410905Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5411184Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5411292Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5411490Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5411633Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5411770Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5411934Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5412282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5412618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5412929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5413193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5413494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5413755Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5414039Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5414159Z Execution Analysis: (:1) 2024-12-18T00:21:05.5414407Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5414608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5414612Z 2024-12-18T00:21:05.5414808Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5414922Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5415146Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5415257Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5415458Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5415594Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5415737Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5415896Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5416577Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5417337Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5417738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5418112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5418429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5418703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5419006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5419280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5419386Z Execution Analysis: .......... 2024-12-18T00:21:05.5419655Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5419854Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5420153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1411 counts during 1344 steps 2024-12-18T00:21:05.5420159Z 2024-12-18T00:21:05.5420359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5420475Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5420762Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5420870Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5421078Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5421219Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5421366Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5421536Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5421895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5422248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5422557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5422835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5423140Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5423413Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5423703Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5423831Z Execution Analysis: (:1) 2024-12-18T00:21:05.5424090Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5424299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5424305Z 2024-12-18T00:21:05.5424507Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5424615Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5424851Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5424960Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5425170Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5425312Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5425460Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5425623Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5426237Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5426843Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5427248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5427604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5427916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5428190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5428498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5428772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5428877Z Execution Analysis: .......... 2024-12-18T00:21:05.5429234Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5429437Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5429719Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1412 counts during 1345 steps 2024-12-18T00:21:05.5429723Z 2024-12-18T00:21:05.5429921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5430029Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5430314Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5430420Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5430614Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5430762Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5430897Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5431066Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5431414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5431759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5432059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5432322Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5432622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5432879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5433167Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5433290Z Execution Analysis: (:1) 2024-12-18T00:21:05.5433541Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5433735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5433741Z 2024-12-18T00:21:05.5433941Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5434051Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5434272Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5434382Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5434582Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5434724Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5434865Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5435068Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5435673Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5436282Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5436640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5436978Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5437283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5437548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5438023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5438292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5438400Z Execution Analysis: .......... 2024-12-18T00:21:05.5438656Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5438856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5439149Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1413 counts during 1346 steps 2024-12-18T00:21:05.5439154Z 2024-12-18T00:21:05.5439354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5439469Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5439761Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5439878Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5440083Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5440227Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5440372Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5440540Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5440904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5441257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5441576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5441844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5442157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5442425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5442718Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5442848Z Execution Analysis: (:1) 2024-12-18T00:21:05.5443106Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5443316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5443320Z 2024-12-18T00:21:05.5443521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5443639Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5443868Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5443977Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5444316Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5444462Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5444700Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5444870Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5445468Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5446106Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5446473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5446823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5447134Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5447412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5447721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5447995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5448099Z Execution Analysis: .......... 2024-12-18T00:21:05.5448369Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5448571Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5448863Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1414 counts during 1347 steps 2024-12-18T00:21:05.5448874Z 2024-12-18T00:21:05.5449073Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5449190Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5449484Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5449595Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5449808Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5449949Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5450097Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5450262Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5450618Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5450973Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5451282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5451558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5451863Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5452136Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5452427Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5452551Z Execution Analysis: (:1) 2024-12-18T00:21:05.5452814Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5453014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5453018Z 2024-12-18T00:21:05.5453222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5453334Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5453570Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5453677Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5453889Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5454080Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5454228Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5454396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5455040Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5455623Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5455979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5456396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5456721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5457001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5457313Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5457584Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5457696Z Execution Analysis: .......... 2024-12-18T00:21:05.5457951Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5458160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5458449Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1415 counts during 1348 steps 2024-12-18T00:21:05.5458454Z 2024-12-18T00:21:05.5458657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5458768Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5459058Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5459171Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5459375Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5459524Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5459665Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5459834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5460189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5460538Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5460852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5461125Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5461434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5461702Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5462002Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5462129Z Execution Analysis: (:1) 2024-12-18T00:21:05.5462392Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5462595Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5462599Z 2024-12-18T00:21:05.5462800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5462918Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5463145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5463262Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5463520Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5463670Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5463844Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5464011Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5464654Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5465229Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5465597Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5465946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5466269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5466542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5466855Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5467124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5467230Z Execution Analysis: .......... 2024-12-18T00:21:05.5467489Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5467692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5467991Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1416 counts during 1349 steps 2024-12-18T00:21:05.5467995Z 2024-12-18T00:21:05.5468196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5468318Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5468608Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5468718Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5469031Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5469162Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5469299Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5469454Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5469790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5470114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5470400Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5470657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5470942Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5471193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5471461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5471586Z Execution Analysis: (:1) 2024-12-18T00:21:05.5471822Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5472018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5472022Z 2024-12-18T00:21:05.5472207Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5472313Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5472554Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5472678Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5472874Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5473034Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5473175Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5473353Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5473898Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5474431Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5474762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5475098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5475383Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5475644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5475935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5476189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5476286Z Execution Analysis: .......... 2024-12-18T00:21:05.5476527Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5476716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5476985Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1417 counts during 1350 steps 2024-12-18T00:21:05.5476990Z 2024-12-18T00:21:05.5477181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5477286Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5477562Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5477664Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5477859Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5477992Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5478125Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5478283Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5478614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5479102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5479406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5479680Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5479975Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5480239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5480529Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5480647Z Execution Analysis: (:1) 2024-12-18T00:21:05.5480898Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5481095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5481099Z 2024-12-18T00:21:05.5481302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5481434Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5481684Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5481791Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5482019Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5482189Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5482332Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5482502Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5483077Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5483643Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5483999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5484344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5484652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5484925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5485238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5485497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5485608Z Execution Analysis: .......... 2024-12-18T00:21:05.5485858Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5486066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5486349Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1418 counts during 1351 steps 2024-12-18T00:21:05.5486355Z 2024-12-18T00:21:05.5486552Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5486669Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5486955Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5487072Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5487273Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5487420Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5487558Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5487722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5488072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5488409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5488723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5488988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5489293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5489556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5489839Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5489967Z Execution Analysis: (:1) 2024-12-18T00:21:05.5490217Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5490419Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5490423Z 2024-12-18T00:21:05.5490641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5490780Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5491006Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5491152Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5491378Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5491522Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5491671Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5491835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5492415Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5492972Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5493326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5493667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5493972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5494245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5494545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5494810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5494913Z Execution Analysis: .......... 2024-12-18T00:21:05.5495164Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5495361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5495649Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1419 counts during 1352 steps 2024-12-18T00:21:05.5495653Z 2024-12-18T00:21:05.5495845Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5495956Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5496241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5496404Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5496616Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5496755Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5497067Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5497232Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5497588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5497946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5498257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5498539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5498847Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5499120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5499412Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5499543Z Execution Analysis: (:1) 2024-12-18T00:21:05.5499801Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5500003Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5500059Z 2024-12-18T00:21:05.5500265Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5500416Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5500651Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5500784Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5500998Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5501142Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5501290Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5501463Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5502055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5502634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5502994Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5503351Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5503661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5503939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5504246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5504514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5504623Z Execution Analysis: .......... 2024-12-18T00:21:05.5504876Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5505086Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5505373Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1420 counts during 1353 steps 2024-12-18T00:21:05.5505379Z 2024-12-18T00:21:05.5505590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5505702Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5505996Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5506104Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5506312Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5506461Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5506599Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5506776Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5507136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5507487Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5507807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5508083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5508394Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5508659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5509063Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5509178Z Execution Analysis: (:1) 2024-12-18T00:21:05.5509419Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5509657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5509661Z 2024-12-18T00:21:05.5509847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5509978Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5510219Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5510327Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5510520Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5510659Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5510795Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5510950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5511502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5512039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5512376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5512701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5512996Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5513249Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5513538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5513783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5513883Z Execution Analysis: .......... 2024-12-18T00:21:05.5514126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5514310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5514585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1421 counts during 1354 steps 2024-12-18T00:21:05.5514589Z 2024-12-18T00:21:05.5514778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5514891Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5515161Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5515269Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5515460Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5515593Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5515731Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5515886Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5516226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5516551Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5516844Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5517095Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5517376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5517791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5518072Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5518196Z Execution Analysis: (:1) 2024-12-18T00:21:05.5518471Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5518696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5518727Z 2024-12-18T00:21:05.5518922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5519069Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5519298Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5519404Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5519613Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5519752Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5519899Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5520063Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5520645Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5521203Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5521554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5521902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5522203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5522474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5522772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5523037Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5523141Z Execution Analysis: .......... 2024-12-18T00:21:05.5523387Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5523588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5523869Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1422 counts during 1355 steps 2024-12-18T00:21:05.5523874Z 2024-12-18T00:21:05.5524074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5524184Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5524472Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5524579Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5524787Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5524926Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5525067Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5525233Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5525579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5525931Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5526234Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5526509Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5526805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5527068Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5527358Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5527509Z Execution Analysis: (:1) 2024-12-18T00:21:05.5527792Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5528013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5528018Z 2024-12-18T00:21:05.5528246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5528361Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5528592Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5528698Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5528900Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5529053Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5529197Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5529371Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5530043Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5530585Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5530916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5531249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5531539Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5531794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5532087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5532338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5532451Z Execution Analysis: .......... 2024-12-18T00:21:05.5532686Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5532884Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5533153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1423 counts during 1356 steps 2024-12-18T00:21:05.5533158Z 2024-12-18T00:21:05.5533346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5533459Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5533726Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5533836Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5534025Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5534342Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5534479Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5534643Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5535003Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5535349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5535662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5535927Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5536238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5536572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5537060Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5537221Z Execution Analysis: (:1) 2024-12-18T00:21:05.5537480Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5537744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5537749Z 2024-12-18T00:21:05.5537949Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5538071Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5538300Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5538418Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5538627Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5538771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5538927Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5539095Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5539695Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5540269Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5540634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5540983Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5541305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5541575Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5541883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5542159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5542268Z Execution Analysis: .......... 2024-12-18T00:21:05.5542535Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5542736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5543033Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1424 counts during 1357 steps 2024-12-18T00:21:05.5543038Z 2024-12-18T00:21:05.5543239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5543359Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5543645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5543753Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5543969Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5544113Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5544419Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5544588Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5544947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5545308Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5545621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5545900Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5546207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5546533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5546936Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5547072Z Execution Analysis: (:1) 2024-12-18T00:21:05.5547364Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5547597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5547612Z 2024-12-18T00:21:05.5547811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5547923Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5548163Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5548271Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5548490Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5548636Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5548783Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5548954Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5549547Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5550132Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5550490Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5550848Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5551161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5551446Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5551759Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5552027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5552146Z Execution Analysis: .......... 2024-12-18T00:21:05.5552406Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5552613Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5552906Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1425 counts during 1358 steps 2024-12-18T00:21:05.5552910Z 2024-12-18T00:21:05.5553121Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5553237Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5553540Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5553649Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5553855Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5554008Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5554148Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5554324Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5554681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5555041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5555350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5555627Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5555970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5556374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5556665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5556810Z Execution Analysis: (:1) 2024-12-18T00:21:05.5557093Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5557291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5557296Z 2024-12-18T00:21:05.5557501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5557611Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5557834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5557950Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5558152Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5558303Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5558443Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5558619Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5559198Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5559759Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5560117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5560622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5560942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5561218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5561536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5561805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5561917Z Execution Analysis: .......... 2024-12-18T00:21:05.5562170Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5562372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5562667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1426 counts during 1359 steps 2024-12-18T00:21:05.5562671Z 2024-12-18T00:21:05.5562871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5563000Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5563289Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5563412Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5563614Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5563759Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5563907Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5564076Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5564442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5564789Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5565109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5565380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5565734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5566012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5566333Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5566492Z Execution Analysis: (:1) 2024-12-18T00:21:05.5566749Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5566963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5566967Z 2024-12-18T00:21:05.5567171Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5567297Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5567525Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5567640Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5567851Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5567995Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5568154Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5568324Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5568925Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5569497Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5569854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5570213Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5570528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5570808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5571115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5571393Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5571498Z Execution Analysis: .......... 2024-12-18T00:21:05.5571763Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5571966Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5572254Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1427 counts during 1360 steps 2024-12-18T00:21:05.5572267Z 2024-12-18T00:21:05.5572470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5572583Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5572882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5572994Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5573207Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5573348Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5573489Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5573667Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5574025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5574387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5574701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5575056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5575362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5575669Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5575991Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5576119Z Execution Analysis: (:1) 2024-12-18T00:21:05.5576457Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5576667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5576671Z 2024-12-18T00:21:05.5576880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5576993Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5577241Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5577350Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5577556Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5577712Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5577861Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5578042Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5578633Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5579216Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5579575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5579938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5580250Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5580529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5580850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5581119Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5581234Z Execution Analysis: .......... 2024-12-18T00:21:05.5581491Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5581700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5581990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1428 counts during 1361 steps 2024-12-18T00:21:05.5581998Z 2024-12-18T00:21:05.5582208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5582321Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5582614Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5582735Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5582937Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5583092Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5583235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5583412Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5583766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5584116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5584462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5584762Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5585099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5585388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5585688Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5585812Z Execution Analysis: (:1) 2024-12-18T00:21:05.5586072Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5586277Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5586281Z 2024-12-18T00:21:05.5586482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5586603Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5586835Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5586955Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5587161Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5587307Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5587464Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5587633Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5588237Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5588811Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5589277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5589622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5589938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5590206Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5590506Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5590775Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5590877Z Execution Analysis: .......... 2024-12-18T00:21:05.5591133Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5591329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5591625Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1429 counts during 1362 steps 2024-12-18T00:21:05.5591632Z 2024-12-18T00:21:05.5591826Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5591951Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5592237Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5592344Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5592549Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5592687Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5592831Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5592994Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5593350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5593715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5594045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5594348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5594669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5594941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5595225Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5595359Z Execution Analysis: (:1) 2024-12-18T00:21:05.5595606Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5595815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5595819Z 2024-12-18T00:21:05.5596019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5596132Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5596366Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5596475Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5596689Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5596831Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5596987Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5597148Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5597726Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5598294Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5598646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5598998Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5599304Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5599579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5599880Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5600154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5600256Z Execution Analysis: .......... 2024-12-18T00:21:05.5600504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5600710Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5600996Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1431 counts during 1363 steps 2024-12-18T00:21:05.5601002Z 2024-12-18T00:21:05.5601206Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5601317Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5601612Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5601717Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5601920Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5602068Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5602204Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5602375Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5602748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5603120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5603421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5603749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5604059Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5604317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5604605Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5604726Z Execution Analysis: (:1) 2024-12-18T00:21:05.5604987Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5605190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5605196Z 2024-12-18T00:21:05.5605404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5605511Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5605739Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5605859Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5606060Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5606210Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5606350Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5606525Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5607099Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5607659Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5608019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5608364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5608678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5608944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5609256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5609515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5609629Z Execution Analysis: .......... 2024-12-18T00:21:05.5609882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5610082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5610373Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1432 counts during 1364 steps 2024-12-18T00:21:05.5610379Z 2024-12-18T00:21:05.5610579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5610699Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5610983Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5611102Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5611296Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5611436Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5611583Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5611745Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5612158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5612500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5613086Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5613353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5613663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5613924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5614210Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5614339Z Execution Analysis: (:1) 2024-12-18T00:21:05.5614592Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5614797Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5614801Z 2024-12-18T00:21:05.5614999Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5615123Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5615347Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5615451Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5615661Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5615803Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5615954Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5616115Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5616943Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5617524Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5617895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5618248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5618556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5618835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5619142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5619415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5619523Z Execution Analysis: .......... 2024-12-18T00:21:05.5619790Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5619992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5620285Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1433 counts during 1365 steps 2024-12-18T00:21:05.5620296Z 2024-12-18T00:21:05.5620500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5620615Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5620911Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5621022Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5621231Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5621375Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5621524Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5621749Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5622110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5622494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5622835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5623114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5623421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5623694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5623989Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5624116Z Execution Analysis: (:1) 2024-12-18T00:21:05.5624390Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5624591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5624598Z 2024-12-18T00:21:05.5624805Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5624916Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5625152Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5625261Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5625476Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5625622Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5625770Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5625942Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5626537Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5627120Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5627483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5627839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5628150Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5628422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5628735Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5629110Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5629220Z Execution Analysis: .......... 2024-12-18T00:21:05.5629471Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5629673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5629955Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1434 counts during 1366 steps 2024-12-18T00:21:05.5629959Z 2024-12-18T00:21:05.5630159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5630269Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5630550Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5630664Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5630861Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5631030Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5631190Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5631355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5631722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5632088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5632396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5632661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5632964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5633224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5633512Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5633635Z Execution Analysis: (:1) 2024-12-18T00:21:05.5633882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5634082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5634088Z 2024-12-18T00:21:05.5634279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5634399Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5634628Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5634741Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5634941Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5635085Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5635228Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5635391Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5635974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5636536Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5636890Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5637231Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5637536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5637799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5638107Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5638368Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5638472Z Execution Analysis: .......... 2024-12-18T00:21:05.5638730Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5638926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5639215Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1435 counts during 1367 steps 2024-12-18T00:21:05.5639220Z 2024-12-18T00:21:05.5639412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5639525Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5639806Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5639913Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5640140Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5640303Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5640448Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5640646Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5641022Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5641364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5641667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5641940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5642238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5642506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5642792Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5642914Z Execution Analysis: (:1) 2024-12-18T00:21:05.5643169Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5643372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5643376Z 2024-12-18T00:21:05.5643571Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5643680Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5643909Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5644015Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5644356Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5644665Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5644827Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5644994Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5645586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5646172Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5646529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5646890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5647202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5647482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5647797Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5648071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5648178Z Execution Analysis: .......... 2024-12-18T00:21:05.5648436Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5648642Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5648931Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1436 counts during 1368 steps 2024-12-18T00:21:05.5648936Z 2024-12-18T00:21:05.5649139Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5649253Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5649547Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5649738Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5649953Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5650097Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5650275Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5650476Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5650832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5651187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5651498Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5651773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5652076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5652349Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5652648Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5652774Z Execution Analysis: (:1) 2024-12-18T00:21:05.5653038Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5653242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5653247Z 2024-12-18T00:21:05.5653454Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5653567Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5653806Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5653914Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5654118Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5654266Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5654413Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5654583Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5655174Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5655753Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5656114Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5656535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5656855Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5657131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5657444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5657715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5657830Z Execution Analysis: .......... 2024-12-18T00:21:05.5658085Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5658287Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5658578Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1437 counts during 1369 steps 2024-12-18T00:21:05.5658583Z 2024-12-18T00:21:05.5658785Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5658902Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5659222Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5659366Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5662787Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5663010Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5663186Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5663359Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5663732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5664086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5664402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5664677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5664988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5665262Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5665555Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5665685Z Execution Analysis: (:1) 2024-12-18T00:21:05.5665948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5666155Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5666161Z 2024-12-18T00:21:05.5666362Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5666479Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5666709Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5666819Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5667035Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5667175Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5667328Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5667493Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5668095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5668673Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5669140Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5669481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5669785Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5670061Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5670362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5670626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5670729Z Execution Analysis: .......... 2024-12-18T00:21:05.5670984Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5671179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5671460Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1438 counts during 1370 steps 2024-12-18T00:21:05.5671470Z 2024-12-18T00:21:05.5671663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5671824Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5672116Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5672250Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5672450Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5672611Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5672748Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5672916Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5673264Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5673711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5673997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5674251Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5674535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5674785Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5675053Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5675167Z Execution Analysis: (:1) 2024-12-18T00:21:05.5675409Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5675595Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5675600Z 2024-12-18T00:21:05.5675789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5675890Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5676107Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5676205Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5676395Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5676529Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5676663Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5676825Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5677373Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5677906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5678239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5678565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5678851Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5679103Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5679390Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5679636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5679735Z Execution Analysis: .......... 2024-12-18T00:21:05.5679969Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5680156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5680422Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1439 counts during 1371 steps 2024-12-18T00:21:05.5680426Z 2024-12-18T00:21:05.5680638Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5680777Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5681045Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5681172Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5681383Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5681515Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5681642Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5681797Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5682125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5682448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5682742Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5682995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5683280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5683530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5683801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5683917Z Execution Analysis: (:1) 2024-12-18T00:21:05.5684154Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5684345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5684349Z 2024-12-18T00:21:05.5684533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5684645Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5684855Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5684961Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5685151Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5685290Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5685423Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5685575Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5686130Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5686659Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5686995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5687317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5687611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5687867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5688149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5688397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5688495Z Execution Analysis: .......... 2024-12-18T00:21:05.5688733Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5688918Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5689213Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1440 counts during 1372 steps 2024-12-18T00:21:05.5689240Z 2024-12-18T00:21:05.5689428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5689560Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5689848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5689950Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5690141Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5690273Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5690406Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5690556Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5690891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5691215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5691503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5691759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5692044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5692291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5692557Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5692674Z Execution Analysis: (:1) 2024-12-18T00:21:05.5692913Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5693102Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5693106Z 2024-12-18T00:21:05.5693291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5693394Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5693609Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5693712Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5693908Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5694037Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5694175Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5694328Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5694874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5695403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5695736Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5696064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5696439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5696702Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5697166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5697436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5697540Z Execution Analysis: .......... 2024-12-18T00:21:05.5697795Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5698102Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5698416Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1441 counts during 1373 steps 2024-12-18T00:21:05.5698421Z 2024-12-18T00:21:05.5698649Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5698759Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5699077Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5699187Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5699388Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5699538Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5699675Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5699842Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5700198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5700556Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5700864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5701135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5701448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5701713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5702006Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5702131Z Execution Analysis: (:1) 2024-12-18T00:21:05.5702392Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5702594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5702601Z 2024-12-18T00:21:05.5702803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5702916Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5703144Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5703257Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5703463Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5703609Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5703755Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5703924Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5704515Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5705083Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5705447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5705799Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5706114Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5706387Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5706695Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5706959Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5707068Z Execution Analysis: .......... 2024-12-18T00:21:05.5707324Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5707572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5707864Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1442 counts during 1374 steps 2024-12-18T00:21:05.5707892Z 2024-12-18T00:21:05.5708115Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5708232Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5708521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5708635Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5708836Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5709088Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5709216Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5709369Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5709703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5710029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5710322Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5710572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5710858Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5711105Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5711373Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5711491Z Execution Analysis: (:1) 2024-12-18T00:21:05.5711725Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5711918Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5711922Z 2024-12-18T00:21:05.5712104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5712213Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5712429Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5712528Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5712721Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5712852Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5712991Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5713142Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5713692Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5714224Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5714556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5714877Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5715161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5715414Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5715697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5715948Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5716043Z Execution Analysis: .......... 2024-12-18T00:21:05.5716318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5716526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5716820Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1443 counts during 1375 steps 2024-12-18T00:21:05.5716824Z 2024-12-18T00:21:05.5717029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5717130Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5717399Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5717499Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5717856Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5717994Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5718133Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5718294Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5718642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5718988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5719287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5719554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5719851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5720110Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5720388Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5720507Z Execution Analysis: (:1) 2024-12-18T00:21:05.5720762Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5720959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5720965Z 2024-12-18T00:21:05.5721164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5721270Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5721495Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5721598Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5721802Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5721935Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5722073Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5722236Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5722816Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5723378Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5723729Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5724073Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5724373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5724636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5724936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5725193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5725359Z Execution Analysis: .......... 2024-12-18T00:21:05.5725609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5725838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5726141Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1444 counts during 1376 steps 2024-12-18T00:21:05.5726145Z 2024-12-18T00:21:05.5726344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5726450Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5726735Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5726848Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5727045Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5727190Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5727335Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5727506Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5727854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5728198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5728504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5728769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5729075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5729332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5729725Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5729842Z Execution Analysis: (:1) 2024-12-18T00:21:05.5730081Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5730272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5730276Z 2024-12-18T00:21:05.5730461Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5730567Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5730776Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5730879Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5731069Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5731203Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5731336Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5731488Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5732044Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5732577Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5732912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5733236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5733530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5733778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5734064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5734359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5734456Z Execution Analysis: .......... 2024-12-18T00:21:05.5734693Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5734925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5735198Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1445 counts during 1377 steps 2024-12-18T00:21:05.5735202Z 2024-12-18T00:21:05.5735385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5735491Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5735755Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5735855Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5736045Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5736180Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5736315Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5736543Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5737051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5737401Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5737715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5737984Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5738287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5738555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5738845Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5738975Z Execution Analysis: (:1) 2024-12-18T00:21:05.5739229Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5739435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5739439Z 2024-12-18T00:21:05.5739636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5739745Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5739976Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5740084Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5740294Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5740435Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5740585Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5740749Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5741340Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5741920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5742279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5742634Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5742940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5743216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5743546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5743842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5743972Z Execution Analysis: .......... 2024-12-18T00:21:05.5744459Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5744667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5744954Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1446 counts during 1378 steps 2024-12-18T00:21:05.5744960Z 2024-12-18T00:21:05.5745162Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5745274Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5745566Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5745673Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5745887Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5746027Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5746167Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5746334Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5746692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5747045Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5747354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5747627Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5747930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5748195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5748489Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5748612Z Execution Analysis: (:1) 2024-12-18T00:21:05.5748873Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5749076Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5749080Z 2024-12-18T00:21:05.5749284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5749394Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5749628Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5749733Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5749939Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5750090Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5750242Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5750412Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5751008Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5751590Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5751945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5752296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5752614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5752931Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5753273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5753573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5753681Z Execution Analysis: .......... 2024-12-18T00:21:05.5753960Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5754167Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5754457Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1447 counts during 1379 steps 2024-12-18T00:21:05.5754462Z 2024-12-18T00:21:05.5754660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5754777Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5755069Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5755185Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5755386Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5755536Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5755784Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5756056Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5756391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5756713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5757007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5757260Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5757553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5757801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5758072Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5758190Z Execution Analysis: (:1) 2024-12-18T00:21:05.5758431Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5758622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5758626Z 2024-12-18T00:21:05.5758807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5758915Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5759125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5759232Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5759422Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5759557Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5759694Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5759846Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5760400Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5760928Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5761262Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5761583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5761897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5762172Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5762454Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5762752Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5762849Z Execution Analysis: .......... 2024-12-18T00:21:05.5763089Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5763276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5763548Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1448 counts during 1380 steps 2024-12-18T00:21:05.5763552Z 2024-12-18T00:21:05.5763734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5763839Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5764110Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5764209Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5764405Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5764536Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5764672Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5764823Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5765156Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5765481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5765767Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5766024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5766308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5766559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5766827Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5766944Z Execution Analysis: (:1) 2024-12-18T00:21:05.5767179Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5767364Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5767368Z 2024-12-18T00:21:05.5767553Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5767654Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5767870Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5767972Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5768166Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5768294Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5768428Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5768587Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5769130Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5769660Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5769990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5770340Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5770651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5770908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5771242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5771490Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5771591Z Execution Analysis: .......... 2024-12-18T00:21:05.5771826Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5772019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5772283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1449 counts during 1381 steps 2024-12-18T00:21:05.5772287Z 2024-12-18T00:21:05.5772477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5772582Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5772854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5772955Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5773143Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5773281Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5773408Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5773567Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5773896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5774224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5774509Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5774765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5775049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5775296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5775575Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5775692Z Execution Analysis: (:1) 2024-12-18T00:21:05.5775932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5776117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5776121Z 2024-12-18T00:21:05.5776305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5776493Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5776710Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5776982Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5777189Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5777342Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5777486Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5777652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5778247Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5778817Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5779178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5779584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5779906Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5780213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5780551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5780818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5780923Z Execution Analysis: .......... 2024-12-18T00:21:05.5781179Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5781381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5781674Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1450 counts during 1382 steps 2024-12-18T00:21:05.5781683Z 2024-12-18T00:21:05.5781882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5782000Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5782291Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5782405Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5782604Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5782746Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5782901Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5783063Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5783427Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5783776Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5784094Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5784363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5784673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5784943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5785234Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5785364Z Execution Analysis: (:1) 2024-12-18T00:21:05.5785618Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5785824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5785829Z 2024-12-18T00:21:05.5786029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5786149Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5786375Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5786486Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5786696Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5786839Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5786988Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5787153Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5787753Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5788323Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5788705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5789182Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5789494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5789775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5790061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5790312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5790405Z Execution Analysis: .......... 2024-12-18T00:21:05.5790643Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5790829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5791101Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1452 counts during 1383 steps 2024-12-18T00:21:05.5791105Z 2024-12-18T00:21:05.5791296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5791401Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5791676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5791775Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5791968Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5792099Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5792230Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5792388Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5792717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5793050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5793339Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5793597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5793880Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5794128Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5794400Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5794513Z Execution Analysis: (:1) 2024-12-18T00:21:05.5794755Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5794941Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5794945Z 2024-12-18T00:21:05.5795141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5795245Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5795462Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5795563Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5795756Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5795890Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5796022Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5796182Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5796730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5797288Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5797643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5797996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5798305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5798559Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5798847Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5799094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5799195Z Execution Analysis: .......... 2024-12-18T00:21:05.5799431Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5799626Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5799893Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1453 counts during 1384 steps 2024-12-18T00:21:05.5799899Z 2024-12-18T00:21:05.5800084Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5800194Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5800462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5800566Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5800751Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5800885Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5801014Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5801170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5801504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5801829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5802120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5802373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5802656Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5802900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5803170Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5803282Z Execution Analysis: (:1) 2024-12-18T00:21:05.5803517Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5803705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5803711Z 2024-12-18T00:21:05.5803892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5804005Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5804215Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5804317Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5804505Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5804634Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5804770Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5804921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5805472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5806023Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5806382Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5806748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5807043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5807293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5807576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5807823Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5807917Z Execution Analysis: .......... 2024-12-18T00:21:05.5808155Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5808342Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5808612Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1454 counts during 1385 steps 2024-12-18T00:21:05.5808616Z 2024-12-18T00:21:05.5808800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5808911Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5809176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5809275Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5809465Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5809597Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5809731Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5809881Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5810220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5810538Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5810828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5811082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5811363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5811616Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5811882Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5812002Z Execution Analysis: (:1) 2024-12-18T00:21:05.5812237Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5812425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5812437Z 2024-12-18T00:21:05.5812621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5812728Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5812946Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5813043Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5813241Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5813372Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5813507Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5813665Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5814236Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5814805Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5815188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5815519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5815806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5816062Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5816403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5816658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5816925Z Execution Analysis: .......... 2024-12-18T00:21:05.5817184Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5817392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5817692Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1455 counts during 1386 steps 2024-12-18T00:21:05.5817696Z 2024-12-18T00:21:05.5817903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5818015Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5818312Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5818421Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5818629Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5818778Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5818918Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5819091Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5819447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5819803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5820112Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5820382Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5820692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5820955Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5821248Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5821369Z Execution Analysis: (:1) 2024-12-18T00:21:05.5821635Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5821837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5821843Z 2024-12-18T00:21:05.5822047Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5822158Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5822385Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5822496Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5822701Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5822846Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5822989Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5823158Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5823778Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5824380Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5824791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5825138Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5825450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5825722Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5826037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5826304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5826413Z Execution Analysis: .......... 2024-12-18T00:21:05.5826669Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5826875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5827167Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1456 counts during 1387 steps 2024-12-18T00:21:05.5827171Z 2024-12-18T00:21:05.5827369Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5827485Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5827775Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5827886Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5828085Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5828230Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5828376Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5828539Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5828900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5829454Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5829745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5829995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5830276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5830524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5830790Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5830911Z Execution Analysis: (:1) 2024-12-18T00:21:05.5831146Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5831337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5831343Z 2024-12-18T00:21:05.5831526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5831631Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5831843Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5831942Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5832136Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5832265Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5832405Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5832606Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5833164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5833813Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5834148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5834473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5834763Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5835020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5835304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5835560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5835657Z Execution Analysis: .......... 2024-12-18T00:21:05.5835902Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5836090Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5836358Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1457 counts during 1388 steps 2024-12-18T00:21:05.5836367Z 2024-12-18T00:21:05.5836551Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5836657Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5836933Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5837034Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5837234Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5837371Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5837500Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5837661Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5837990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5838316Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5838603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5838865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5839149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5839404Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5839676Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5839793Z Execution Analysis: (:1) 2024-12-18T00:21:05.5840038Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5840230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5840234Z 2024-12-18T00:21:05.5840424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5840528Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5840749Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5840852Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5841044Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5841181Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5841371Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5841531Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5842082Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5842666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5842999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5843330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5843618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5843874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5844298Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5844723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5844834Z Execution Analysis: .......... 2024-12-18T00:21:05.5845093Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5845299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5845586Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1458 counts during 1389 steps 2024-12-18T00:21:05.5845591Z 2024-12-18T00:21:05.5845796Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5845906Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5846195Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5846312Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5846515Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5846667Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5846809Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5846982Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5847335Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5847685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5847998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5848274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5848587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5848858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5849152Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5849278Z Execution Analysis: (:1) 2024-12-18T00:21:05.5849535Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5849739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5849744Z 2024-12-18T00:21:05.5849945Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5850064Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5850295Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5850407Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5850815Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5850998Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5851141Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5851339Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5851964Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5852539Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5852902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5853254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5853569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5853845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5854156Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5854430Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5854536Z Execution Analysis: .......... 2024-12-18T00:21:05.5854798Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5855002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5855295Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1459 counts during 1390 steps 2024-12-18T00:21:05.5855300Z 2024-12-18T00:21:05.5855499Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5855617Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5855910Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5856017Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5856224Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5856440Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5856590Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5856755Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5857117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5857467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5857782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5858066Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5858376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5858654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5858950Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5859081Z Execution Analysis: (:1) 2024-12-18T00:21:05.5859343Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5859558Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5859563Z 2024-12-18T00:21:05.5859761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5859872Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5860106Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5860242Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5860483Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5860624Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5860804Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5860968Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5861587Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5862169Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5862525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5862883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5863197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5863482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5863793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5864067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5864169Z Execution Analysis: .......... 2024-12-18T00:21:05.5864423Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5864630Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5864917Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1460 counts during 1391 steps 2024-12-18T00:21:05.5864922Z 2024-12-18T00:21:05.5865131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5865248Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5865546Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5865655Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5865862Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5866011Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5866153Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5866323Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5866678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5867037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5867346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5867619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5867933Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5868200Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5868501Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5868624Z Execution Analysis: (:1) 2024-12-18T00:21:05.5868999Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5869195Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5869199Z 2024-12-18T00:21:05.5869397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5869504Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5869752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5869887Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5870090Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5870258Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5870421Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5870757Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5871350Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5871920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5872282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5872632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5872948Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5873222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5873536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5873803Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5873917Z Execution Analysis: .......... 2024-12-18T00:21:05.5874171Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5874372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5874664Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1461 counts during 1392 steps 2024-12-18T00:21:05.5874669Z 2024-12-18T00:21:05.5874871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5874986Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5875279Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5875394Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5875595Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5875745Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5875882Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5876044Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5876409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5876757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5877075Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5877348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5877661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5877927Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5878216Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5878345Z Execution Analysis: (:1) 2024-12-18T00:21:05.5878600Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5878810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5878814Z 2024-12-18T00:21:05.5879120Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5879286Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5879508Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5879614Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5879845Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5880020Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5880172Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5880332Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5880917Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5881473Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5881836Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5882180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5882589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5882848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5883133Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5883388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5883486Z Execution Analysis: .......... 2024-12-18T00:21:05.5883735Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5883918Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5884197Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1462 counts during 1393 steps 2024-12-18T00:21:05.5884203Z 2024-12-18T00:21:05.5884386Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5884493Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5884765Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5884868Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5885064Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5885196Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5885334Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5885485Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5885814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5886150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5886435Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5886699Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5886986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5887241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5887506Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5887622Z Execution Analysis: (:1) 2024-12-18T00:21:05.5887868Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5888056Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5888060Z 2024-12-18T00:21:05.5888278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5888404Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5888624Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5888747Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5888971Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5889103Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5889236Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5889397Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5889939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5890476Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5890809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5891136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5891423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5891673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5891964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5892206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5892306Z Execution Analysis: .......... 2024-12-18T00:21:05.5892541Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5892735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5893005Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1463 counts during 1394 steps 2024-12-18T00:21:05.5893009Z 2024-12-18T00:21:05.5893202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5893305Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5893568Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5893672Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5893860Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5893993Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5894120Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5894288Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5894615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5894940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5895234Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5895484Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5895772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5896018Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5896294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5896474Z Execution Analysis: (:1) 2024-12-18T00:21:05.5896721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5897112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5897142Z 2024-12-18T00:21:05.5897343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5897494Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5897723Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5897864Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5898071Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5898223Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5898367Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5898534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5899127Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5899699Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5900066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5900415Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5900739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5901014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5901325Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5901591Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5901697Z Execution Analysis: .......... 2024-12-18T00:21:05.5901958Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5902163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5902459Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1464 counts during 1395 steps 2024-12-18T00:21:05.5902465Z 2024-12-18T00:21:05.5902668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5902784Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5903072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5903181Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5903391Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5903532Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5903680Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5903845Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5904211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5904561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5904873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5905153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5905460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5905735Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5906026Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5906160Z Execution Analysis: (:1) 2024-12-18T00:21:05.5906416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5906680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5906685Z 2024-12-18T00:21:05.5906883Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5907023Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5907287Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5907398Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5907608Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5907749Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5907904Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5908067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5908667Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5909336Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5909665Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5909996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5910278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5910533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5910813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5911069Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5911164Z Execution Analysis: .......... 2024-12-18T00:21:05.5911403Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5911598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5911866Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1465 counts during 1396 steps 2024-12-18T00:21:05.5911871Z 2024-12-18T00:21:05.5912064Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5912167Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5912439Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5912540Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5912733Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5912865Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5912995Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5913159Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5913487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5913822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5914107Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5914368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5914650Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5914894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5915171Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5915284Z Execution Analysis: (:1) 2024-12-18T00:21:05.5915555Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5915764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5915802Z 2024-12-18T00:21:05.5916020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5916123Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5916341Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5916441Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5916634Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5916771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5916902Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5917061Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5917610Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5918344Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5918693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5919033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5919341Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5919607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5919911Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5920167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5920284Z Execution Analysis: .......... 2024-12-18T00:21:05.5920533Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5920740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5921025Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1466 counts during 1397 steps 2024-12-18T00:21:05.5921029Z 2024-12-18T00:21:05.5921224Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5921338Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5921617Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5921728Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5921923Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5922076Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5922216Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5922380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5922733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5923074Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5923387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5923650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5923958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5924218Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5924501Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5924681Z Execution Analysis: (:1) 2024-12-18T00:21:05.5924934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5925160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5925164Z 2024-12-18T00:21:05.5925382Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5925503Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5925724Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5925840Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5926042Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5926185Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5926340Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5926506Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5927095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5927654Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5928010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5928352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5928668Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5928935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5929239Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5929519Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5929729Z Execution Analysis: .......... 2024-12-18T00:21:05.5929979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5930170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5930447Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1467 counts during 1398 steps 2024-12-18T00:21:05.5930452Z 2024-12-18T00:21:05.5930637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5930742Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5931023Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5931121Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5931320Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5931453Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5931596Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5931750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5932084Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5932416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5932701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5932962Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5933246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5933504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5933795Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5933941Z Execution Analysis: (:1) 2024-12-18T00:21:05.5934181Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5934413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5934418Z 2024-12-18T00:21:05.5934613Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5934715Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5934934Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5935034Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5935233Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5935366Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5935504Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5935671Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5936219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5937024Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5937380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5937738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5938051Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5938338Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5938644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5938912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5939027Z Execution Analysis: .......... 2024-12-18T00:21:05.5939286Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5939497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5939785Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1468 counts during 1399 steps 2024-12-18T00:21:05.5939789Z 2024-12-18T00:21:05.5939997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5940109Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5940408Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5940516Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5940722Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5940870Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5941013Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5941190Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5941548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5941903Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5942212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5942482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5942795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5943092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5943416Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5943569Z Execution Analysis: (:1) 2024-12-18T00:21:05.5943861Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5944063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5944068Z 2024-12-18T00:21:05.5944395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5944520Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5944755Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5944875Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5945082Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5945237Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5945383Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5945553Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5946164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5946744Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5947110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5947458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5947778Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5948055Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5948377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5948648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5948752Z Execution Analysis: .......... 2024-12-18T00:21:05.5949020Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5949225Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5949524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1469 counts during 1400 steps 2024-12-18T00:21:05.5949528Z 2024-12-18T00:21:05.5949729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5949851Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5950139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5950259Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5950459Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5950604Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5950751Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5950920Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5951284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5951631Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5951953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5952222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5952574Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5952902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5953193Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5953359Z Execution Analysis: (:1) 2024-12-18T00:21:05.5953644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5953859Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5953863Z 2024-12-18T00:21:05.5954062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5954183Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5954411Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5954522Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5954742Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5954885Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5955036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5955205Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5955916Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5956558Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5956891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5957220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5957509Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5957774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5958060Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5958316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5958413Z Execution Analysis: .......... 2024-12-18T00:21:05.5958664Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5958850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5959117Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1470 counts during 1401 steps 2024-12-18T00:21:05.5959121Z 2024-12-18T00:21:05.5959315Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5959421Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5959698Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5959799Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5960001Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5960133Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5960263Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5960423Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5960753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5961087Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5961372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5961655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5961963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5962211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5962538Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5962653Z Execution Analysis: (:1) 2024-12-18T00:21:05.5962900Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5963089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5963093Z 2024-12-18T00:21:05.5963283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5963387Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5963609Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5963710Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5963902Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5964043Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5964176Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5964337Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5964885Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5965420Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5965749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5966086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5966375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5966625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5966918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5967166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5967268Z Execution Analysis: .......... 2024-12-18T00:21:05.5967507Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5967705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5967971Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1471 counts during 1402 steps 2024-12-18T00:21:05.5967975Z 2024-12-18T00:21:05.5968164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5968442Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5968728Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5968889Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5969087Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5969243Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5969383Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5969544Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5969901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5970238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5970548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5970863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5971174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5971458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5971773Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5971894Z Execution Analysis: (:1) 2024-12-18T00:21:05.5972145Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5972351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5972355Z 2024-12-18T00:21:05.5972547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5972663Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5972891Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5973009Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5973211Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5973354Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5973510Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5973671Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5974255Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5974816Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5975178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5975524Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5975839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5976107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5976535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5976974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5977077Z Execution Analysis: .......... 2024-12-18T00:21:05.5977344Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5977547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5977847Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1473 counts during 1403 steps 2024-12-18T00:21:05.5977856Z 2024-12-18T00:21:05.5978056Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5978178Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5978469Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5978579Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5978788Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5978927Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5979074Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5979237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5979601Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5979948Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5980313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5980595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5980999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5981298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5981590Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5981725Z Execution Analysis: (:1) 2024-12-18T00:21:05.5981981Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5982183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5982194Z 2024-12-18T00:21:05.5982394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5982506Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5982743Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5982855Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5983074Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5983214Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5983361Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5983533Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5984126Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5984708Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5985068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5985426Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5985736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5986017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5986324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5986591Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5986706Z Execution Analysis: .......... 2024-12-18T00:21:05.5986962Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5987173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5987465Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1474 counts during 1404 steps 2024-12-18T00:21:05.5987470Z 2024-12-18T00:21:05.5987681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5987794Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5988093Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5988203Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5988407Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5988557Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5988695Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5988868Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5989313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5989687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5989999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5990274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5990588Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5990835Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5991110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.5991225Z Execution Analysis: (:1) 2024-12-18T00:21:05.5991475Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5991661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5991668Z 2024-12-18T00:21:05.5991861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5991965Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5992182Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.5992297Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5992488Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.5992630Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.5992767Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.5992934Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5993480Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.5994016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.5994354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.5994681Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5994978Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5995231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5995524Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5995771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5995882Z Execution Analysis: .......... 2024-12-18T00:21:05.5996116Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.5996307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5996585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1475 counts during 1405 steps 2024-12-18T00:21:05.5996591Z 2024-12-18T00:21:05.5996776Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.5996891Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.5997157Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.5997271Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.5997459Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.5997594Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.5997733Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.5997891Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.5998249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.5998597Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.5998916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.5999190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.5999478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.5999732Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.5999998Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6000120Z Execution Analysis: (:1) 2024-12-18T00:21:05.6000358Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6000556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6000562Z 2024-12-18T00:21:05.6000745Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6000861Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6001073Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6001175Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6001371Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6001502Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6001642Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6001793Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6002350Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6002881Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6003227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6003553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6003839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6004102Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6004386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6004643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6004738Z Execution Analysis: .......... 2024-12-18T00:21:05.6004993Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6005179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6005450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1476 counts during 1406 steps 2024-12-18T00:21:05.6005463Z 2024-12-18T00:21:05.6005650Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6005755Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6006029Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6006128Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6006327Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6006461Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6006590Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6006774Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6007128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6007460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6007794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6008056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6008340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6008594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6008861Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6008976Z Execution Analysis: (:1) 2024-12-18T00:21:05.6009226Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6009413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6009418Z 2024-12-18T00:21:05.6009614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6009716Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6009927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6010026Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6010214Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6010350Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6010484Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6010643Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6011189Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6011727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6012064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6012395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6012682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6012933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6013223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6013470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6013573Z Execution Analysis: .......... 2024-12-18T00:21:05.6013813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6014004Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6014275Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1477 counts during 1407 steps 2024-12-18T00:21:05.6014279Z 2024-12-18T00:21:05.6014475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6014579Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6014845Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6014949Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6015137Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6015275Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6015432Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6015615Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6015941Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6016325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6016696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6017129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6017440Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6017707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6018007Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6018130Z Execution Analysis: (:1) 2024-12-18T00:21:05.6018389Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6018596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6018603Z 2024-12-18T00:21:05.6018803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6018919Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6019149Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6019261Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6019465Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6019613Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6019756Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6019920Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6020519Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6021092Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6021455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6021804Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6022120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6022391Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6022698Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6022969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6023074Z Execution Analysis: .......... 2024-12-18T00:21:05.6023334Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6023536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6023830Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1478 counts during 1408 steps 2024-12-18T00:21:05.6023835Z 2024-12-18T00:21:05.6024033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6024150Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6024436Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6024544Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6024747Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6024916Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6025086Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6025247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6025632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6026007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6026319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6026594Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6026900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6027173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6027467Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6027597Z Execution Analysis: (:1) 2024-12-18T00:21:05.6027853Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6028064Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6028069Z 2024-12-18T00:21:05.6028267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6028376Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6028608Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6028713Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6028923Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6029169Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6029422Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6029576Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6030122Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6030664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6030993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6031321Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6031607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6031862Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6032145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6032400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6032495Z Execution Analysis: .......... 2024-12-18T00:21:05.6032734Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6032928Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6033195Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1479 counts during 1409 steps 2024-12-18T00:21:05.6033200Z 2024-12-18T00:21:05.6033390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6033492Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6033763Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6033860Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6034095Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6034231Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6034362Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6034545Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6034895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6035227Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6035513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6035761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6036050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6036298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6036576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6036690Z Execution Analysis: (:1) 2024-12-18T00:21:05.6036934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6037120Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6037124Z 2024-12-18T00:21:05.6037312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6037413Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6037627Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6037731Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6037925Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6038060Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6038199Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6038356Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6038902Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6039434Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6039766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6040090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6040382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6040636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6040925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6041171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6041273Z Execution Analysis: .......... 2024-12-18T00:21:05.6041507Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6041694Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6041963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1480 counts during 1410 steps 2024-12-18T00:21:05.6041967Z 2024-12-18T00:21:05.6042151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6042257Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6042522Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6042680Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6042868Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6043033Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6043158Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6043334Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6043672Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6043995Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6044411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6044845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6045153Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6045422Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6045710Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6045840Z Execution Analysis: (:1) 2024-12-18T00:21:05.6046096Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6046301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6046306Z 2024-12-18T00:21:05.6046507Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6046623Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6046849Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6046956Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6047168Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6047312Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6047465Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6047631Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6048232Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6048804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6049168Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6049518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6049828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6050111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6053495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6053803Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6053913Z Execution Analysis: .......... 2024-12-18T00:21:05.6054181Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6054382Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6054674Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1481 counts during 1411 steps 2024-12-18T00:21:05.6054680Z 2024-12-18T00:21:05.6054885Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6054998Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6055420Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6055532Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6055792Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6055935Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6056109Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6056280Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6056741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6057099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6057411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6057688Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6058003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6058268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6058567Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6058691Z Execution Analysis: (:1) 2024-12-18T00:21:05.6058952Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6059153Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6059158Z 2024-12-18T00:21:05.6059362Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6059472Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6059704Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6059817Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6060028Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6060175Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6060323Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6060497Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6061090Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6061671Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6062026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6062380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6062692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6062963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6063277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6063545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6063651Z Execution Analysis: .......... 2024-12-18T00:21:05.6063909Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6064113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6064401Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1482 counts during 1412 steps 2024-12-18T00:21:05.6064406Z 2024-12-18T00:21:05.6064636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6064783Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6065074Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6065211Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6065411Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6065582Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6065720Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6065884Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6066244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6066591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6066903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6067176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6067486Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6067754Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6068051Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6068173Z Execution Analysis: (:1) 2024-12-18T00:21:05.6068428Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6068631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6068636Z 2024-12-18T00:21:05.6068833Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6068947Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6069175Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6069287Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6069492Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6069634Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6069782Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6069947Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6070545Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6071115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6071476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6071824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6072138Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6072410Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6072716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6072984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6073087Z Execution Analysis: .......... 2024-12-18T00:21:05.6073348Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6073545Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6073836Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1483 counts during 1413 steps 2024-12-18T00:21:05.6073841Z 2024-12-18T00:21:05.6074087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6074203Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6074620Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6074726Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6074950Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6075090Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6075229Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6075389Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6075745Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6076084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6076387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6076655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6076952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6077213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6077497Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6077619Z Execution Analysis: (:1) 2024-12-18T00:21:05.6077867Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6078063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6078073Z 2024-12-18T00:21:05.6078267Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6078379Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6078605Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6078817Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6079013Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6079143Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6079276Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6079433Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6079980Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6080515Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6080844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6081172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6081460Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6081716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6081998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6082242Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6082342Z Execution Analysis: .......... 2024-12-18T00:21:05.6082580Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6082770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6083061Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1484 counts during 1414 steps 2024-12-18T00:21:05.6083092Z 2024-12-18T00:21:05.6083283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6083410Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6083702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6083802Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6083991Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6084124Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6084253Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6084413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6084740Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6085069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6085356Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6085608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6085900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6086143Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6086413Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6086525Z Execution Analysis: (:1) 2024-12-18T00:21:05.6086769Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6086955Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6086960Z 2024-12-18T00:21:05.6087147Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6087250Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6087460Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6087565Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6087756Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6087890Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6088023Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6088179Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6088722Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6089252Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6089589Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6089909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6090202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6090452Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6090739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6090984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6091082Z Execution Analysis: .......... 2024-12-18T00:21:05.6091318Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6091527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6091833Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1485 counts during 1415 steps 2024-12-18T00:21:05.6091837Z 2024-12-18T00:21:05.6092045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6092174Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6092441Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6092546Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6092732Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6092862Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6092998Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6093151Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6093481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6093807Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6094096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6094348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6094636Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6094878Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6095143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6095260Z Execution Analysis: (:1) 2024-12-18T00:21:05.6095493Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6095682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6095688Z 2024-12-18T00:21:05.6095873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6095981Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6096189Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6096289Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6096557Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6096687Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6096992Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6097158Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6097753Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6098327Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6098690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6099044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6099353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6099628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6099935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6100206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6100307Z Execution Analysis: .......... 2024-12-18T00:21:05.6100566Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6100819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6101109Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1486 counts during 1416 steps 2024-12-18T00:21:05.6101144Z 2024-12-18T00:21:05.6101367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6101484Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6101774Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6101881Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6102085Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6102224Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6102361Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6102528Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6102882Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6103237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6103549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6103823Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6104127Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6104397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6104685Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6104807Z Execution Analysis: (:1) 2024-12-18T00:21:05.6105065Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6105269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6105273Z 2024-12-18T00:21:05.6105477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6105590Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6105822Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6105927Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6106134Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6106278Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6106420Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6106588Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6107178Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6107756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6108115Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6108469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6108776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6109150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6109436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6109681Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6109780Z Execution Analysis: .......... 2024-12-18T00:21:05.6110065Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6110254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6110549Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1487 counts during 1417 steps 2024-12-18T00:21:05.6110576Z 2024-12-18T00:21:05.6110766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6110867Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6111131Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6111233Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6111419Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6111551Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6111678Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6111835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6112161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6112483Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6112774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6113023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6113308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6113552Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6113821Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6113933Z Execution Analysis: (:1) 2024-12-18T00:21:05.6114170Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6114359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6114364Z 2024-12-18T00:21:05.6114549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6114653Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6114864Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6114967Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6115153Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6115286Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6115417Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6115569Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6116120Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6116649Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6116984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6117307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6117596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6118020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6118326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6118608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6118735Z Execution Analysis: .......... 2024-12-18T00:21:05.6118988Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6119209Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6119518Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1488 counts during 1418 steps 2024-12-18T00:21:05.6119523Z 2024-12-18T00:21:05.6119716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6119829Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6120108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6120211Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6120411Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6120549Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6120693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6120852Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6121206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6121546Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6121845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6122112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6122408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6122671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6122955Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6123082Z Execution Analysis: (:1) 2024-12-18T00:21:05.6123328Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6123528Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6123532Z 2024-12-18T00:21:05.6123724Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6123832Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6124056Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6124157Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6124363Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6124500Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6124642Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6124802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6125376Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6125941Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6126287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6126631Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6126930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6127196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6127495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6127884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6127986Z Execution Analysis: .......... 2024-12-18T00:21:05.6128259Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6128485Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6128767Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1489 counts during 1419 steps 2024-12-18T00:21:05.6128772Z 2024-12-18T00:21:05.6128968Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6129076Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6129361Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6129463Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6129768Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6129902Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6130031Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6130186Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6130513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6130838Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6131123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6131378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6131659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6131901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6132173Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6132286Z Execution Analysis: (:1) 2024-12-18T00:21:05.6132527Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6132713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6132717Z 2024-12-18T00:21:05.6132903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6133004Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6133215Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6133316Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6133504Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6133636Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6133773Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6133933Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6134479Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6135011Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6135342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6135665Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6135953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6136201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6136618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6137036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6137170Z Execution Analysis: .......... 2024-12-18T00:21:05.6137448Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6137650Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6137944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1490 counts during 1420 steps 2024-12-18T00:21:05.6137949Z 2024-12-18T00:21:05.6138150Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6138264Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6138549Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6138662Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6138865Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6139009Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6139149Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6139316Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6139676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6140024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6140338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6140607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6140918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6141183Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6141475Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6141600Z Execution Analysis: (:1) 2024-12-18T00:21:05.6141861Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6142068Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6142072Z 2024-12-18T00:21:05.6142272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6142391Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6142618Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6142728Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6142932Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6143079Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6143227Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6143392Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6143993Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6144709Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6145074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6145423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6145732Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6146057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6146398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6146701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6146835Z Execution Analysis: .......... 2024-12-18T00:21:05.6147098Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6147300Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6147593Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1491 counts during 1421 steps 2024-12-18T00:21:05.6147598Z 2024-12-18T00:21:05.6147796Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6147907Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6148207Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6148316Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6148523Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6148664Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6148809Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6148973Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6149331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6149681Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6149990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6150266Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6150572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6150844Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6151133Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6151253Z Execution Analysis: (:1) 2024-12-18T00:21:05.6151515Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6151715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6151719Z 2024-12-18T00:21:05.6151919Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6152027Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6152258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6152364Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6152579Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6152716Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6152861Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6153031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6153622Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6154199Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6154557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6154908Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6155245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6155545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6155970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6156257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6156357Z Execution Analysis: .......... 2024-12-18T00:21:05.6156594Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6156783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6157048Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1492 counts during 1422 steps 2024-12-18T00:21:05.6157052Z 2024-12-18T00:21:05.6157242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6157345Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6157612Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6157714Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6157901Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6158038Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6158167Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6158323Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6158650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6158974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6159264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6159514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6159804Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6160048Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6160323Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6160434Z Execution Analysis: (:1) 2024-12-18T00:21:05.6160675Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6160860Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6160864Z 2024-12-18T00:21:05.6161045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6161152Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6161362Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6161467Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6161655Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6161791Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6161923Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6162075Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6162627Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6163157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6163496Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6164027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6164361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6164625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6164984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6165242Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6165345Z Execution Analysis: .......... 2024-12-18T00:21:05.6165595Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6165790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6166076Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1494 counts during 1423 steps 2024-12-18T00:21:05.6166080Z 2024-12-18T00:21:05.6166275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6166391Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6166668Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6166780Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6166977Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6167116Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6167257Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6167416Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6167766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6168105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6168411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6168676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6168972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6169238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6169520Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6169645Z Execution Analysis: (:1) 2024-12-18T00:21:05.6169895Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6170098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6170102Z 2024-12-18T00:21:05.6170294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6170403Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6170631Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6170735Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6170939Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6171076Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6171225Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6171383Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6171957Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6172520Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6172865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6173257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6173563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6173858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6174178Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6174445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6174546Z Execution Analysis: .......... 2024-12-18T00:21:05.6174792Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6174990Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6175274Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1495 counts during 1424 steps 2024-12-18T00:21:05.6175281Z 2024-12-18T00:21:05.6175481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6175589Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6175874Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6175981Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6176180Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6176316Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6176524Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6176690Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6177201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6177553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6177865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6178140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6178447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6178715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6179008Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6179128Z Execution Analysis: (:1) 2024-12-18T00:21:05.6179388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6179591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6179595Z 2024-12-18T00:21:05.6179801Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6179911Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6180142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6180249Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6180455Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6180601Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6180745Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6180915Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6181503Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6182078Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6182460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6182832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6183173Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6183467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6183783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6184051Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6184157Z Execution Analysis: .......... 2024-12-18T00:21:05.6184410Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6184616Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6184908Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1496 counts during 1425 steps 2024-12-18T00:21:05.6184913Z 2024-12-18T00:21:05.6185111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6185230Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6185518Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6185630Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6185829Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6185976Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6186114Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6186278Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6186634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6186989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6187304Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6187577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6187891Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6188156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6188444Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6188570Z Execution Analysis: (:1) 2024-12-18T00:21:05.6188823Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6189130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6189137Z 2024-12-18T00:21:05.6189323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6189431Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6189642Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6189749Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6189940Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6190070Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6190211Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6190363Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6190917Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6191469Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6191829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6192185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6192497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6192752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6193037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6193287Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6193381Z Execution Analysis: .......... 2024-12-18T00:21:05.6193620Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6193806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6194079Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1497 counts during 1426 steps 2024-12-18T00:21:05.6194085Z 2024-12-18T00:21:05.6194274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6194376Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6194648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6194746Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6194938Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6195069Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6195201Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6195350Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6195676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6196001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6196286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6196540Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6196821Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6197073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6197339Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6197458Z Execution Analysis: (:1) 2024-12-18T00:21:05.6197691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6197877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6197882Z 2024-12-18T00:21:05.6198070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6198175Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6198389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6198485Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6198680Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6198809Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6198942Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6199099Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6199640Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6200219Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6200551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6200926Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6201213Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6201471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6201752Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6201995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6202094Z Execution Analysis: .......... 2024-12-18T00:21:05.6202332Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6202523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6202790Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1498 counts during 1427 steps 2024-12-18T00:21:05.6202794Z 2024-12-18T00:21:05.6202985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6203087Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6203358Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6203456Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6203641Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6203776Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6203904Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6204069Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6204400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6204726Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6205016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6205269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6205554Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6205800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6206072Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6206185Z Execution Analysis: (:1) 2024-12-18T00:21:05.6206425Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6206612Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6206618Z 2024-12-18T00:21:05.6206807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6206910Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6207119Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6207222Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6207411Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6207544Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6207676Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6207827Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6208398Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6208950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6209332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6209659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6209951Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6210200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6210485Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6210732Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6210829Z Execution Analysis: .......... 2024-12-18T00:21:05.6211069Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6211253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6211527Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1499 counts during 1428 steps 2024-12-18T00:21:05.6211531Z 2024-12-18T00:21:05.6211713Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6211819Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6212085Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6212191Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6212376Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6212506Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6212644Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6212796Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6213128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6213451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6213744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6213992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6214272Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6214521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6214786Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6214904Z Execution Analysis: (:1) 2024-12-18T00:21:05.6215140Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6215329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6215335Z 2024-12-18T00:21:05.6215519Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6215625Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6215836Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6215936Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6216131Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6216258Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6216486Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6216642Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6217451Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6218049Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6218431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6218786Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6219091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6219368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6219675Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6219947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6220050Z Execution Analysis: .......... 2024-12-18T00:21:05.6220307Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6220511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6220800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1500 counts during 1429 steps 2024-12-18T00:21:05.6220805Z 2024-12-18T00:21:05.6221009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6221119Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6221412Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6221519Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6221726Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6221870Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6222010Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6222177Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6222534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6222887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6223193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6223471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6223776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6224043Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6224340Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6224463Z Execution Analysis: (:1) 2024-12-18T00:21:05.6224722Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6224925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6224929Z 2024-12-18T00:21:05.6225134Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6225244Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6225481Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6225586Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6225789Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6225938Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6226080Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6226313Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6226903Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6227538Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6227896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6228249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6228558Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6228830Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6229358Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6229606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6229709Z Execution Analysis: .......... 2024-12-18T00:21:05.6229945Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6230140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6230403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1501 counts during 1430 steps 2024-12-18T00:21:05.6230408Z 2024-12-18T00:21:05.6230601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6230703Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6230969Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6231075Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6231269Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6231409Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6231538Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6231690Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6232025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6232348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6232641Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6232891Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6233184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6233432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6233711Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6233825Z Execution Analysis: (:1) 2024-12-18T00:21:05.6234063Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6234254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6234259Z 2024-12-18T00:21:05.6234441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6234549Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6234759Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6234863Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6235049Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6235201Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6235366Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6235515Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6236119Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6236647Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6236979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6237298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6237589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6237842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6238128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6238378Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6238474Z Execution Analysis: .......... 2024-12-18T00:21:05.6238714Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6238898Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6239169Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1502 counts during 1431 steps 2024-12-18T00:21:05.6239173Z 2024-12-18T00:21:05.6239357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6239467Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6239732Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6239831Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6240025Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6240155Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6240291Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6240443Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6240779Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6241099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6241385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6241644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6241928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6242182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6242447Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6242566Z Execution Analysis: (:1) 2024-12-18T00:21:05.6242801Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6242985Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6242995Z 2024-12-18T00:21:05.6243175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6243277Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6243491Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6243588Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6243808Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6243960Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6244093Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6244400Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6245202Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6245783Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6246138Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6246492Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6246803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6247085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6247390Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6247670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6247774Z Execution Analysis: .......... 2024-12-18T00:21:05.6248029Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6248238Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6248529Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1503 counts during 1432 steps 2024-12-18T00:21:05.6248533Z 2024-12-18T00:21:05.6248741Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6248851Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6249148Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6249253Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6249458Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6249605Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6249749Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6249921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6250275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6250633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6250940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6251213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6251525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6251792Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6252089Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6252210Z Execution Analysis: (:1) 2024-12-18T00:21:05.6252476Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6252678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6252683Z 2024-12-18T00:21:05.6252889Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6252997Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6253223Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6253402Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6253608Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6253756Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6253932Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6254132Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6254725Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6255296Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6255658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6256007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6256330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6256662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6256976Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6257245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6257356Z Execution Analysis: .......... 2024-12-18T00:21:05.6257611Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6257810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6258106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1504 counts during 1433 steps 2024-12-18T00:21:05.6258111Z 2024-12-18T00:21:05.6258312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6258434Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6258721Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6258838Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6259040Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6259179Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6259323Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6259487Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6259847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6260196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6260511Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6260785Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6261100Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6261366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6261655Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6261785Z Execution Analysis: (:1) 2024-12-18T00:21:05.6262038Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6262249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6262253Z 2024-12-18T00:21:05.6262452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6262570Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6262865Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6262972Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6263183Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6263349Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6263523Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6263689Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6264292Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6264862Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6265227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6265577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6265886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6266166Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6266473Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6266744Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6266845Z Execution Analysis: .......... 2024-12-18T00:21:05.6267108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6267307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6267593Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1505 counts during 1434 steps 2024-12-18T00:21:05.6267603Z 2024-12-18T00:21:05.6267804Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6267916Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6268214Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6268323Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6268532Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6268774Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6268902Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6269061Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6269391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6269720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6270008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6270269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6270551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6270807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6271072Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6271185Z Execution Analysis: (:1) 2024-12-18T00:21:05.6271426Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6271611Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6271615Z 2024-12-18T00:21:05.6271806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6272024Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6272247Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6272372Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6272562Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6272721Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6272856Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6273015Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6273562Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6274095Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6274427Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6274755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6275041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6275292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6275583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6275828Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6275932Z Execution Analysis: .......... 2024-12-18T00:21:05.6276166Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6276359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6276624Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1506 counts during 1435 steps 2024-12-18T00:21:05.6276630Z 2024-12-18T00:21:05.6276988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6277096Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6277378Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6277495Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6277691Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6277837Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6277972Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6278138Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6278651Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6279551Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6280381Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6281102Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6281843Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6282549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6283233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6283768Z Execution Analysis: (:1) 2024-12-18T00:21:05.6284261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6284871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6285200Z 2024-12-18T00:21:05.6285459Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6285897Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6286356Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6286800Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6287229Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6287693Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6288095Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6288520Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6289381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6290661Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6291708Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6292530Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6293310Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6294009Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6294711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6295399Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6295892Z Execution Analysis: .......... 2024-12-18T00:21:05.6296410Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6297002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6297621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1507 counts during 1436 steps 2024-12-18T00:21:05.6298030Z 2024-12-18T00:21:05.6298234Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6298668Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6299166Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6299683Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6300080Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6300534Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6300915Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6301333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6301968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6302788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6303565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6304265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6304954Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6305644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6306323Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6306855Z Execution Analysis: (:1) 2024-12-18T00:21:05.6307339Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6307950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6308298Z 2024-12-18T00:21:05.6308505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6308959Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6309445Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6309904Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6310308Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6310774Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6311164Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6311591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6312458Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6313741Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6314788Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6315624Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6316400Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6317105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6317806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6318497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6318993Z Execution Analysis: .......... 2024-12-18T00:21:05.6319451Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6320030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6320642Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1508 counts during 1437 steps 2024-12-18T00:21:05.6321064Z 2024-12-18T00:21:05.6321269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6321706Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6322205Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6322723Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6323117Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6323577Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6323970Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6324385Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6325019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6325842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6326613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6327318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6328014Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6328710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6329388Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6329921Z Execution Analysis: (:1) 2024-12-18T00:21:05.6330428Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6331129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6331447Z 2024-12-18T00:21:05.6331764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6332168Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6332599Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6333023Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6333390Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6333820Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6334189Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6334577Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6335387Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6336642Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6337837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6338677Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6339464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6340174Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6340876Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6341571Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6342062Z Execution Analysis: .......... 2024-12-18T00:21:05.6342518Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6343095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6343712Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1509 counts during 1438 steps 2024-12-18T00:21:05.6344121Z 2024-12-18T00:21:05.6344482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6344923Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6345422Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6345941Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6346346Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6346804Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6347197Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6347626Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6348253Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6349081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6349868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6350567Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6351271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6351966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6352637Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6353166Z Execution Analysis: (:1) 2024-12-18T00:21:05.6353768Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6354351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6354992Z 2024-12-18T00:21:05.6355236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6355671Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6356204Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6356651Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6357048Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6357500Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6357889Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6358301Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6359151Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6360398Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6361593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6362419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6363245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6363965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6364678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6365375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6365874Z Execution Analysis: .......... 2024-12-18T00:21:05.6366328Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6366916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6367534Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1510 counts during 1439 steps 2024-12-18T00:21:05.6367942Z 2024-12-18T00:21:05.6368154Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6368593Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6369093Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6369617Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6370021Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6370483Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6370881Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6371295Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6371933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6372761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6373553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6374255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6374952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6375638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6376321Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6377012Z Execution Analysis: (:1) 2024-12-18T00:21:05.6377502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6378114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6378466Z 2024-12-18T00:21:05.6378675Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6379103Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6379543Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6379995Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6380401Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6380865Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6381262Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6381681Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6382558Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6383843Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6384885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6385710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6386492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6387194Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6387896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6388609Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6389113Z Execution Analysis: .......... 2024-12-18T00:21:05.6389573Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6390261Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6390861Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1511 counts during 1440 steps 2024-12-18T00:21:05.6391269Z 2024-12-18T00:21:05.6391469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6391897Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6392386Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6392894Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6393292Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6393739Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6394128Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6394541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6395167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6395975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6396998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6397676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6398367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6399046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6399768Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6400295Z Execution Analysis: (:1) 2024-12-18T00:21:05.6400818Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6401399Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6401727Z 2024-12-18T00:21:05.6401921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6402351Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6402781Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6403226Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6403627Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6404071Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6404466Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6404882Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6405896Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6407180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6408228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6409041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6409916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6410603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6411292Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6412155Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6412660Z Execution Analysis: .......... 2024-12-18T00:21:05.6413109Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6413693Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6414311Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1512 counts during 1441 steps 2024-12-18T00:21:05.6414722Z 2024-12-18T00:21:05.6414924Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6415366Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6415870Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6416462Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6416866Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6417322Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6417722Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6418146Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6418774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6419599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6420381Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6421082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6421784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6422513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6423218Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6423776Z Execution Analysis: (:1) 2024-12-18T00:21:05.6424299Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6424880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6425204Z 2024-12-18T00:21:05.6425409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6425846Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6426294Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6426744Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6427151Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6427614Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6428011Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6428433Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6429406Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6430650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6431666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6432469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6433221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6433901Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6434587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6435258Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6435740Z Execution Analysis: .......... 2024-12-18T00:21:05.6436180Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6436746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6437342Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1513 counts during 1442 steps 2024-12-18T00:21:05.6437737Z 2024-12-18T00:21:05.6437937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6438356Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6438845Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6439527Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6439929Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6440390Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6440778Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6441201Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6441838Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6442656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6443437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6444308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6445068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6445815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6446545Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6447117Z Execution Analysis: (:1) 2024-12-18T00:21:05.6447609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6448192Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6448514Z 2024-12-18T00:21:05.6448721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6449151Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6449593Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6450049Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6450465Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6450929Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6451325Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6451750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6452624Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6453905Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6454947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6455775Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6456633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6457343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6458047Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6458744Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6459239Z Execution Analysis: .......... 2024-12-18T00:21:05.6459696Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6460265Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6460884Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1515 counts during 1443 steps 2024-12-18T00:21:05.6461305Z 2024-12-18T00:21:05.6461504Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6461944Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6462442Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6462961Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6463360Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6463822Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6464214Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6464640Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6465277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6466095Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6466870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6476345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6477190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6477929Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6478648Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6479181Z Execution Analysis: (:1) 2024-12-18T00:21:05.6479680Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6480263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6480596Z 2024-12-18T00:21:05.6480797Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6481234Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6481682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6482133Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6482541Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6483003Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6483404Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6483827Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6484706Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6485981Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6487028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6487853Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6488636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6489336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6490037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6490728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6491313Z Execution Analysis: .......... 2024-12-18T00:21:05.6491755Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6492318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6492914Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1516 counts during 1444 steps 2024-12-18T00:21:05.6493305Z 2024-12-18T00:21:05.6493679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6494109Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6494598Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6495118Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6495520Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6495973Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6496446Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6496861Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6497495Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6498314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6499130Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6499880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6500580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6501321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6502000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6502529Z Execution Analysis: (:1) 2024-12-18T00:21:05.6503012Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6503590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6503911Z 2024-12-18T00:21:05.6504119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6504548Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6504989Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6505444Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6505852Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6506313Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6506717Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6507131Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6508009Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6509289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6510332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6511255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6512012Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6512694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6513372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6514052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6514526Z Execution Analysis: .......... 2024-12-18T00:21:05.6515138Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6515719Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6516324Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1517 counts during 1445 steps 2024-12-18T00:21:05.6516736Z 2024-12-18T00:21:05.6516938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6517370Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6517865Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6518381Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6518779Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6519229Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6519618Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6520031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6520659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6521476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6522311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6523006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6523727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6524443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6525120Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6525651Z Execution Analysis: (:1) 2024-12-18T00:21:05.6526136Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6526704Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6527027Z 2024-12-18T00:21:05.6527230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6527661Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6528091Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6528543Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6528944Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6529397Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6529790Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6530209Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6531074Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6532430Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6533452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6534247Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6535003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6535688Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6536462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6537315Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6537816Z Execution Analysis: .......... 2024-12-18T00:21:05.6538261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6538837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6539455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1518 counts during 1446 steps 2024-12-18T00:21:05.6539864Z 2024-12-18T00:21:05.6540066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6540498Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6540994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6541505Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6541910Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6542369Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6542767Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6543190Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6543814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6544865Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6545687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6546429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6547164Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6547860Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6548543Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6549077Z Execution Analysis: (:1) 2024-12-18T00:21:05.6549569Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6550152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6550476Z 2024-12-18T00:21:05.6550687Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6551126Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6551568Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6552021Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6552431Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6552903Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6553307Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6553732Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6554595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6555980Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6557005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6557818Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6558587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6559282Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6559974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6560653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6561140Z Execution Analysis: .......... 2024-12-18T00:21:05.6561590Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6562160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6562761Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1519 counts during 1447 steps 2024-12-18T00:21:05.6563157Z 2024-12-18T00:21:05.6563367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6563785Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6564281Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6564790Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6565187Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6565638Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6566013Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6566426Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6567077Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6568086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6568905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6569641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6570337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6571041Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6571731Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6572272Z Execution Analysis: (:1) 2024-12-18T00:21:05.6572770Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6573354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6573679Z 2024-12-18T00:21:05.6573882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6574321Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6574767Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6575232Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6575643Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6576111Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6576577Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6577003Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6577873Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6579169Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6580231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6581063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6581840Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6582553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6583263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6583965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6584464Z Execution Analysis: .......... 2024-12-18T00:21:05.6584931Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6585505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6586130Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1520 counts during 1448 steps 2024-12-18T00:21:05.6586555Z 2024-12-18T00:21:05.6586763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6587217Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6587730Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6588261Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6588675Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6589251Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6589649Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6590129Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6590797Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6591640Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6592434Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6593138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6593835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6594527Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6595207Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6595741Z Execution Analysis: (:1) 2024-12-18T00:21:05.6595999Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6596204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6596223Z 2024-12-18T00:21:05.6596422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6596540Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6596780Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6596890Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6597109Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6597251Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6597397Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6597571Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6598155Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6598727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6599084Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6599440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6599750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6600025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6600323Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6600583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6600705Z Execution Analysis: .......... 2024-12-18T00:21:05.6600956Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6601172Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6601457Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1521 counts during 1449 steps 2024-12-18T00:21:05.6601462Z 2024-12-18T00:21:05.6601669Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6601780Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6602074Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6602184Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6602385Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6602535Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6602699Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6602899Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6603248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6603719Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6604024Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6604291Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6604606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6604869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6605169Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6605296Z Execution Analysis: (:1) 2024-12-18T00:21:05.6605564Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6605765Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6605770Z 2024-12-18T00:21:05.6605981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6606092Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6606314Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6606432Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6606632Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6606785Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6606930Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6607092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6607685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6608249Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6608611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6608953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6609266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6609535Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6609846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6610111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6610229Z Execution Analysis: .......... 2024-12-18T00:21:05.6610482Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6610684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6610980Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1522 counts during 1450 steps 2024-12-18T00:21:05.6610984Z 2024-12-18T00:21:05.6611180Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6611306Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6611594Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6611715Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6611918Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6612117Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6612275Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6612439Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6612824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6613187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6613502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6613771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6614071Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6614344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6614631Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6614768Z Execution Analysis: (:1) 2024-12-18T00:21:05.6615019Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6615234Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6615239Z 2024-12-18T00:21:05.6615435Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6615556Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6615783Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6615892Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6616107Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6616249Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6616477Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6616649Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6617418Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6617999Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6618357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6618726Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6619037Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6619327Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6619638Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6619924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6620036Z Execution Analysis: .......... 2024-12-18T00:21:05.6620306Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6620512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6620804Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1523 counts during 1451 steps 2024-12-18T00:21:05.6620809Z 2024-12-18T00:21:05.6621026Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6621143Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6621447Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6621560Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6621833Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6621979Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6622146Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6622325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6622724Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6623090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6623402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6623686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6623996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6624283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6624578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6624704Z Execution Analysis: (:1) 2024-12-18T00:21:05.6624983Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6625190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6625194Z 2024-12-18T00:21:05.6625409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6625523Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6625769Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6625882Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6626094Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6626256Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6626406Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6626590Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6627185Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6627774Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6628137Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6628503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6628819Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6629200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6629516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6629781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6629903Z Execution Analysis: .......... 2024-12-18T00:21:05.6630159Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6630368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6630653Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1524 counts during 1452 steps 2024-12-18T00:21:05.6630657Z 2024-12-18T00:21:05.6630864Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6630976Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6631294Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6631442Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6631643Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6631823Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6631963Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6632151Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6632513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6632857Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6633172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6633439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6633756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6634021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6634319Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6634448Z Execution Analysis: (:1) 2024-12-18T00:21:05.6634704Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6634917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6634922Z 2024-12-18T00:21:05.6635118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6635243Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6635471Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6635595Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6635802Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6635945Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6636104Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6636272Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6636868Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6637429Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6637790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6638135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6638454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6638729Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6639032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6639313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6639420Z Execution Analysis: .......... 2024-12-18T00:21:05.6639688Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6639888Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6640187Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1525 counts during 1453 steps 2024-12-18T00:21:05.6640191Z 2024-12-18T00:21:05.6640392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6640519Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6640861Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6640970Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6641213Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6641358Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6641535Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6641701Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6642060Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6642407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6642712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6642995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6643302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6643573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6643861Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6643991Z Execution Analysis: (:1) 2024-12-18T00:21:05.6644398Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6644768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6644785Z 2024-12-18T00:21:05.6644987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6645099Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6645343Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6645459Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6645679Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6645826Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6645984Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6646152Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6646746Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6647332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6647690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6648054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6648370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6648656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6648969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6649254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6649362Z Execution Analysis: .......... 2024-12-18T00:21:05.6649623Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6649842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6650132Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1526 counts during 1454 steps 2024-12-18T00:21:05.6650137Z 2024-12-18T00:21:05.6650410Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6650558Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6650867Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6651012Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6651250Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6651411Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6651553Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6651734Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6652095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6652457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6652769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6653049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6653369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6653640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6653947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6654073Z Execution Analysis: (:1) 2024-12-18T00:21:05.6654346Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6654554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6654558Z 2024-12-18T00:21:05.6654769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6654884Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6655121Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6655243Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6655454Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6655612Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6655764Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6655945Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6656621Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6657200Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6657574Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6657936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6658271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6658547Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6658871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6659145Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6659269Z Execution Analysis: .......... 2024-12-18T00:21:05.6659529Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6659736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6660041Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1527 counts during 1455 steps 2024-12-18T00:21:05.6660077Z 2024-12-18T00:21:05.6660306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6660434Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6660765Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6660913Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6661121Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6661267Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6661423Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6661591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6661961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6662314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6662640Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6662917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6663240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6663511Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6663803Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6663940Z Execution Analysis: (:1) 2024-12-18T00:21:05.6664198Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6664412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6664417Z 2024-12-18T00:21:05.6664623Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6664753Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6664983Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6665097Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6665316Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6665464Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6665621Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6665791Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6666397Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6666970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6667339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6667697Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6668012Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6668300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6668720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6668995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6669101Z Execution Analysis: .......... 2024-12-18T00:21:05.6669363Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6669565Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6669877Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1528 counts during 1456 steps 2024-12-18T00:21:05.6669915Z 2024-12-18T00:21:05.6670117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6670257Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6670577Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6670689Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6670901Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6671043Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6671195Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6671360Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6671711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6672072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6672377Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6672657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6672960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6673234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6673515Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6673640Z Execution Analysis: (:1) 2024-12-18T00:21:05.6673908Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6674110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6674114Z 2024-12-18T00:21:05.6674326Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6674437Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6674677Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6674785Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6675001Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6675141Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6675285Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6675459Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6676037Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6676607Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6676959Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6677312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6677621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6677888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6678201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6678464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6678582Z Execution Analysis: .......... 2024-12-18T00:21:05.6678832Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6679066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6679382Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1529 counts during 1457 steps 2024-12-18T00:21:05.6679411Z 2024-12-18T00:21:05.6679624Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6679763Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6680051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6680176Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6680479Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6680626Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6680761Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6680930Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6681265Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6681594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6681899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6682158Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6682461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6682712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6682996Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6683115Z Execution Analysis: (:1) 2024-12-18T00:21:05.6683361Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6683567Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6683573Z 2024-12-18T00:21:05.6683763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6683889Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6684108Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6684225Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6684420Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6684570Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6684711Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6684870Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6685430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6685964Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6686312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6686647Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6686946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6687204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6687505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6687757Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6687859Z Execution Analysis: .......... 2024-12-18T00:21:05.6688140Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6688356Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6688638Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1530 counts during 1458 steps 2024-12-18T00:21:05.6688666Z 2024-12-18T00:21:05.6688883Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6689003Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6689276Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6689383Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6689589Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6689726Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6689864Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6690019Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6690366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6690692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6690985Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6691247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6691533Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6691794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6692068Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6692196Z Execution Analysis: (:1) 2024-12-18T00:21:05.6692438Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6692641Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6692645Z 2024-12-18T00:21:05.6692836Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6692945Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6693174Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6693279Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6693484Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6693618Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6693766Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6693924Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6694474Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6695021Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6695357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6695857Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6696162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6696516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6696983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6697263Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6697373Z Execution Analysis: .......... 2024-12-18T00:21:05.6697705Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6697921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6698267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1531 counts during 1459 steps 2024-12-18T00:21:05.6698273Z 2024-12-18T00:21:05.6698488Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6698604Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6698909Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6699020Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6699239Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6699386Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6699530Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6699716Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6700075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6700439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6700752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6701037Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6701348Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6701618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6701923Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6702052Z Execution Analysis: (:1) 2024-12-18T00:21:05.6702324Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6702532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6702538Z 2024-12-18T00:21:05.6702754Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6702869Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6703104Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6703228Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6703438Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6703594Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6703742Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6703923Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6704518Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6705103Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6705469Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6705822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6706146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6706423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6706743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6707042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6707186Z Execution Analysis: .......... 2024-12-18T00:21:05.6707446Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6707678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6708007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1532 counts during 1460 steps 2024-12-18T00:21:05.6708012Z 2024-12-18T00:21:05.6708218Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6708345Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6708637Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6708759Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6708966Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6709230Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6709373Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6709543Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6709902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6710246Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6710563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6710833Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6711142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6711408Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6711695Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6711827Z Execution Analysis: (:1) 2024-12-18T00:21:05.6712081Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6712294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6712300Z 2024-12-18T00:21:05.6712498Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6712622Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6712848Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6712970Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6713174Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6713316Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6713472Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6713639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6714228Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6714790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6715148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6715493Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6715797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6716074Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6716402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6716704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6716809Z Execution Analysis: .......... 2024-12-18T00:21:05.6717102Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6717327Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6717626Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1533 counts during 1461 steps 2024-12-18T00:21:05.6717631Z 2024-12-18T00:21:05.6717831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6717946Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6718249Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6718360Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6718581Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6718726Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6718879Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6719045Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6719401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6719759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6720063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6720340Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6720641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6720912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6721203Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6721339Z Execution Analysis: (:1) 2024-12-18T00:21:05.6721595Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6721797Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6721802Z 2024-12-18T00:21:05.6722012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6722126Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6722360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6722472Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6722687Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6722830Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6722980Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6723154Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6723732Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6724302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6724657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6725011Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6725317Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6725596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6725951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6726220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6726361Z Execution Analysis: .......... 2024-12-18T00:21:05.6726638Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6726856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6727143Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1534 counts during 1462 steps 2024-12-18T00:21:05.6727148Z 2024-12-18T00:21:05.6727359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6727477Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6727767Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6727895Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6728099Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6728257Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6728406Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6728588Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6728940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6729281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6729598Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6729961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6730265Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6730521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6730806Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6730928Z Execution Analysis: (:1) 2024-12-18T00:21:05.6731184Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6731376Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6731380Z 2024-12-18T00:21:05.6731571Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6731694Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6731907Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6732027Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6732223Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6732372Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6732511Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6732669Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6733235Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6733769Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6734115Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6734440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6734738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6735061Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6735361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6735635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6735765Z Execution Analysis: .......... 2024-12-18T00:21:05.6736017Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6736206Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6736572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1536 counts during 1463 steps 2024-12-18T00:21:05.6736577Z 2024-12-18T00:21:05.6736930Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6737057Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6737352Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6737479Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6737686Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6737833Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6737992Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6738164Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6738534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6738890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6739216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6739490Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6739799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6740075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6740373Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6740515Z Execution Analysis: (:1) 2024-12-18T00:21:05.6740776Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6740994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6740998Z 2024-12-18T00:21:05.6741205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6741331Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6741564Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6741677Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6741901Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6742048Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6742211Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6742380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6742973Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6743560Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6743921Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6744463Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6744840Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6745160Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6745510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6745825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6745937Z Execution Analysis: .......... 2024-12-18T00:21:05.6746196Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6746411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6746703Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1537 counts during 1464 steps 2024-12-18T00:21:05.6746709Z 2024-12-18T00:21:05.6746925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6747046Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6747351Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6747469Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6747684Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6747835Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6747982Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6748165Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6748525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6748888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6749203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6749492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6749805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6750074Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6750381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6750508Z Execution Analysis: (:1) 2024-12-18T00:21:05.6750784Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6750990Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6750994Z 2024-12-18T00:21:05.6751206Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6751322Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6751567Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6751681Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6751893Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6752049Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6752198Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6752382Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6752977Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6753564Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6753925Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6754305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6754655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6755029Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6755377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6755652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6755879Z Execution Analysis: .......... 2024-12-18T00:21:05.6756232Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6756436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6756707Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1538 counts during 1465 steps 2024-12-18T00:21:05.6756711Z 2024-12-18T00:21:05.6756903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6757026Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6757298Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6757416Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6757608Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6757758Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6757891Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6758047Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6758387Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6758713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6759020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6759279Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6759576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6759829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6760110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6760228Z Execution Analysis: (:1) 2024-12-18T00:21:05.6760469Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6760671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6760676Z 2024-12-18T00:21:05.6760864Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6760986Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6761202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6761318Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6761515Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6761653Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6761802Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6761961Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6762519Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6763050Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6763425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6763777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6764081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6764397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6764683Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6764948Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6765052Z Execution Analysis: .......... 2024-12-18T00:21:05.6765306Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6765497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6765777Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1539 counts during 1466 steps 2024-12-18T00:21:05.6765783Z 2024-12-18T00:21:05.6765973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6766094Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6766368Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6766472Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6766674Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6766809Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6766955Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6767113Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6767445Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6767785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6768077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6768344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6768644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6768908Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6769183Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6769317Z Execution Analysis: (:1) 2024-12-18T00:21:05.6769560Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6769921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6769939Z 2024-12-18T00:21:05.6770141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6770258Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6770496Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6770606Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6770824Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6770968Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6771277Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6771456Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6772051Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6772640Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6773063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6773433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6773800Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6774092Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6774405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6774678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6774801Z Execution Analysis: .......... 2024-12-18T00:21:05.6775062Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6775285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6775583Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1540 counts during 1467 steps 2024-12-18T00:21:05.6775588Z 2024-12-18T00:21:05.6775808Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6775929Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6776241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6776473Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6776704Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6776856Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6777015Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6777209Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6777606Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6777972Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6778289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6778596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6778946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6779231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6779527Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6779669Z Execution Analysis: (:1) 2024-12-18T00:21:05.6779931Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6780146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6780154Z 2024-12-18T00:21:05.6780364Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6780492Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6780724Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6780848Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6781057Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6781202Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6781364Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6781531Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6782136Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6782742Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6783142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6783523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6783862Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6784154Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6784462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6784747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6784856Z Execution Analysis: .......... 2024-12-18T00:21:05.6785128Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6785336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6785640Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1541 counts during 1468 steps 2024-12-18T00:21:05.6785647Z 2024-12-18T00:21:05.6785853Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6785972Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6786280Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6786393Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6786611Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6786758Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6786914Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6787083Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6787451Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6787816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6788133Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6788424Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6788733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6789017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6789309Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6789437Z Execution Analysis: (:1) 2024-12-18T00:21:05.6789706Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6789915Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6789919Z 2024-12-18T00:21:05.6790139Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6790259Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6790506Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6790620Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6790842Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6790988Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6791135Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6791318Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6791914Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6792668Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6793047Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6793425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6793732Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6794012Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6794312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6794577Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6794695Z Execution Analysis: .......... 2024-12-18T00:21:05.6794948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6795163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6795454Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1542 counts during 1469 steps 2024-12-18T00:21:05.6795458Z 2024-12-18T00:21:05.6795673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6795787Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6796072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6796195Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6796396Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6796551Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6796691Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6796867Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6797218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6797562Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6797881Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6798146Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6798458Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6798722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6799019Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6799143Z Execution Analysis: (:1) 2024-12-18T00:21:05.6799409Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6799612Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6799618Z 2024-12-18T00:21:05.6799816Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6799942Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6800168Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6800451Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6800663Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6800819Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6800969Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6801136Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6801773Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6802376Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6802814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6803169Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6803492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6803764Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6804089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6804359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6804471Z Execution Analysis: .......... 2024-12-18T00:21:05.6804741Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6804949Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6805254Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1543 counts during 1470 steps 2024-12-18T00:21:05.6805259Z 2024-12-18T00:21:05.6805463Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6805590Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6805891Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6806122Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6806323Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6806469Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6806628Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6806793Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6807153Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6807500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6807820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6808088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6808391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6808665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6808953Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6809090Z Execution Analysis: (:1) 2024-12-18T00:21:05.6809345Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6809558Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6809563Z 2024-12-18T00:21:05.6809762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6809876Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6810113Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6810223Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6810439Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6810584Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6810740Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6810904Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6811534Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6812161Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6812608Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6812946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6813238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6813507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6813794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6814059Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6814161Z Execution Analysis: .......... 2024-12-18T00:21:05.6814403Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6814608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6814880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1544 counts during 1471 steps 2024-12-18T00:21:05.6814885Z 2024-12-18T00:21:05.6815087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6815197Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6815478Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6815582Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6815788Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6815928Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6816063Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6816236Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6816649Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6817172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6817487Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6817773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6818084Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6818354Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6818665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6818796Z Execution Analysis: (:1) 2024-12-18T00:21:05.6819070Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6819281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6819286Z 2024-12-18T00:21:05.6819506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6819625Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6819872Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6819984Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6820194Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6820355Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6820533Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6820742Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6821334Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6821975Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6822337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6822695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6823022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6823299Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6823625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6823900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6824023Z Execution Analysis: .......... 2024-12-18T00:21:05.6824282Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6824499Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6824793Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1545 counts during 1472 steps 2024-12-18T00:21:05.6824798Z 2024-12-18T00:21:05.6825001Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6825132Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6825425Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6825551Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6825763Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6825920Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6826065Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6826235Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6826604Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6826956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6827280Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6827554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6827874Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6828146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6828445Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6828586Z Execution Analysis: (:1) 2024-12-18T00:21:05.6828848Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6829175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6829179Z 2024-12-18T00:21:05.6829478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6829594Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6829812Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6829932Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6830127Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6830287Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6830459Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6830615Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6831218Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6831753Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6832102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6832429Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6832734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6832990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6833279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6833541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6833643Z Execution Analysis: .......... 2024-12-18T00:21:05.6833896Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6834087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6834371Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1546 counts during 1473 steps 2024-12-18T00:21:05.6834376Z 2024-12-18T00:21:05.6834566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6834675Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6834961Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6835069Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6835272Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6835410Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6835556Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6835715Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6836049Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6836388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6836679Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6836945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6837236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6837502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6837773Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6837906Z Execution Analysis: (:1) 2024-12-18T00:21:05.6838148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6838340Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6838344Z 2024-12-18T00:21:05.6838544Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6838651Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6838880Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6838985Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6839215Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6839386Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6839525Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6839720Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6840293Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6840839Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6841174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6841515Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6841808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6842077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6842366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6842622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6842739Z Execution Analysis: .......... 2024-12-18T00:21:05.6842979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6843182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6843454Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1547 counts during 1474 steps 2024-12-18T00:21:05.6843458Z 2024-12-18T00:21:05.6843658Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6843769Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6844052Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6844309Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6844676Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6844839Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6845051Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6845237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6845599Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6845963Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6846278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6846554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6846880Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6847151Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6847460Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6847589Z Execution Analysis: (:1) 2024-12-18T00:21:05.6847860Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6848065Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6848069Z 2024-12-18T00:21:05.6848284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6848398Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6848627Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6848842Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6849052Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6849210Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6849391Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6849589Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6850206Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6850784Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6851155Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6851506Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6851836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6852111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6852441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6852714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6852823Z Execution Analysis: .......... 2024-12-18T00:21:05.6853098Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6853304Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6853612Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1548 counts during 1475 steps 2024-12-18T00:21:05.6853617Z 2024-12-18T00:21:05.6853825Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6853958Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6854252Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6854378Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6854586Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6854731Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6854886Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6855051Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6855420Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6855773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6856096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6856450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6856760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6857046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6857341Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6857482Z Execution Analysis: (:1) 2024-12-18T00:21:05.6857743Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6857960Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6857964Z 2024-12-18T00:21:05.6858170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6858302Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6858596Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6858720Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6858930Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6859115Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6859290Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6859473Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6860071Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6860664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6861029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6861404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6861759Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6862045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6862373Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6862646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6862771Z Execution Analysis: .......... 2024-12-18T00:21:05.6863034Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6863255Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6863550Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1549 counts during 1476 steps 2024-12-18T00:21:05.6863558Z 2024-12-18T00:21:05.6863777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6863896Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6864193Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6864323Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6864528Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6864687Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6864832Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6865015Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6865379Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6865733Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6866063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6866343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6866672Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6866946Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6867256Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6867386Z Execution Analysis: (:1) 2024-12-18T00:21:05.6867650Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6867876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6867880Z 2024-12-18T00:21:05.6868110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6868261Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6868494Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6868645Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6868858Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6869041Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6869191Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6869356Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6869966Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6870543Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6870915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6871270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6871595Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6871873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6872193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6872462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6872572Z Execution Analysis: .......... 2024-12-18T00:21:05.6872845Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6873048Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6873359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1550 counts during 1477 steps 2024-12-18T00:21:05.6873364Z 2024-12-18T00:21:05.6873567Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6873698Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6873994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6874109Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6874326Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6874469Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6874623Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6874795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6875165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6875521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6875835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6876123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6876435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6876716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6877006Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6877146Z Execution Analysis: (:1) 2024-12-18T00:21:05.6877413Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6877626Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6877631Z 2024-12-18T00:21:05.6877934Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6878052Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6878322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6878437Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6878685Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6878834Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6878999Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6879170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6879767Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6880364Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6880728Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6881098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6881414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6881702Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6882011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6882295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6882404Z Execution Analysis: .......... 2024-12-18T00:21:05.6882663Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6882878Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6883171Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1551 counts during 1478 steps 2024-12-18T00:21:05.6883178Z 2024-12-18T00:21:05.6883395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6883512Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6883818Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6883929Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6884147Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6884293Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6884437Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6884617Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6884979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6885343Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6885657Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6885944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6886252Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6886522Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6886825Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6886950Z Execution Analysis: (:1) 2024-12-18T00:21:05.6887218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6887448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6887478Z 2024-12-18T00:21:05.6887694Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6887836Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6888106Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6888220Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6888430Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6888584Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6888731Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6888914Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6889510Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6890099Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6890461Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6890818Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6891143Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6891422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6891742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6892011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6892131Z Execution Analysis: .......... 2024-12-18T00:21:05.6892391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6892610Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6892905Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1552 counts during 1479 steps 2024-12-18T00:21:05.6892910Z 2024-12-18T00:21:05.6893113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6893242Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6893533Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6893656Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6893862Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6894018Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6894162Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6894330Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6894706Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6895058Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6895386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6895662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6895980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6896251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6896619Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6896762Z Execution Analysis: (:1) 2024-12-18T00:21:05.6897056Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6897302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6897306Z 2024-12-18T00:21:05.6897542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6897695Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6903148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6903315Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6903553Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6903704Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6903857Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6904025Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6904650Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6905231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6905606Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6905961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6906274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6906554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6906864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6907138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6907247Z Execution Analysis: .......... 2024-12-18T00:21:05.6907521Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6907727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6908026Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1553 counts during 1480 steps 2024-12-18T00:21:05.6908038Z 2024-12-18T00:21:05.6908240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6908358Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6908658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6908768Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6908980Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6909125Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6909271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6909450Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6909807Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6910170Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6910487Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6910766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6911073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6911351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6911638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6911762Z Execution Analysis: (:1) 2024-12-18T00:21:05.6912275Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6912482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6912515Z 2024-12-18T00:21:05.6912772Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6912888Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6913130Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6913237Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6913446Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6913604Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6913748Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6913925Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6914523Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6915108Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6915467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6915826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6916137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6916408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6916724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6916991Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6917107Z Execution Analysis: .......... 2024-12-18T00:21:05.6917363Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6917574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6917864Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1554 counts during 1481 steps 2024-12-18T00:21:05.6917869Z 2024-12-18T00:21:05.6918079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6918190Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6918478Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6918593Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6918796Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6918946Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6919089Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6919263Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6919619Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6919968Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6920287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6920555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6920869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6921135Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6921461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6921611Z Execution Analysis: (:1) 2024-12-18T00:21:05.6921871Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6922106Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6922135Z 2024-12-18T00:21:05.6922335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6922455Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6922683Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6922799Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6923007Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6923155Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6923301Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6923470Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6924072Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6924652Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6925018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6925366Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6925682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6925953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6926270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6926541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6926646Z Execution Analysis: .......... 2024-12-18T00:21:05.6926916Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6927119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6927416Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1555 counts during 1482 steps 2024-12-18T00:21:05.6927421Z 2024-12-18T00:21:05.6927622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6927745Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6928033Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6928142Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6928354Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6928499Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6928650Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6928817Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6929184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6929531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6929946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6930216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6930515Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6930788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6931123Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6931254Z Execution Analysis: (:1) 2024-12-18T00:21:05.6931700Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6931935Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6931940Z 2024-12-18T00:21:05.6932143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6932255Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6932494Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6932603Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6932818Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6932960Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6933121Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6933288Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6933880Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6934468Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6934823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6935180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6935490Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6935774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6936084Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6936465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6936575Z Execution Analysis: .......... 2024-12-18T00:21:05.6936835Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6937049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6937338Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1557 counts during 1483 steps 2024-12-18T00:21:05.6937343Z 2024-12-18T00:21:05.6937556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6937668Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6937970Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6938082Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6938284Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6938437Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6938577Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6938754Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6939110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6939469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6939778Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6940057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6940363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6940685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6940986Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6941134Z Execution Analysis: (:1) 2024-12-18T00:21:05.6941423Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6941627Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6941632Z 2024-12-18T00:21:05.6941840Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6941952Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6942182Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6942300Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6942508Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6942661Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6942807Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6942984Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6943576Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6944310Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6944682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6945033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6945357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6945632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6945946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6946215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6946330Z Execution Analysis: .......... 2024-12-18T00:21:05.6946592Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6946791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6947092Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1558 counts during 1484 steps 2024-12-18T00:21:05.6947097Z 2024-12-18T00:21:05.6947296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6947416Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6947706Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6947823Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6948026Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6948183Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6948328Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6948496Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6948861Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6949210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6949526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6949797Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6950169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6950475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6950810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6950979Z Execution Analysis: (:1) 2024-12-18T00:21:05.6951238Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6951449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6951453Z 2024-12-18T00:21:05.6951653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6951776Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6952006Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6952117Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6952335Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6952476Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6952632Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6952798Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6953398Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6953970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6954335Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6954683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6954993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6955277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6955585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6955866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6956078Z Execution Analysis: .......... 2024-12-18T00:21:05.6956341Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6956537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6956824Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1559 counts during 1485 steps 2024-12-18T00:21:05.6956829Z 2024-12-18T00:21:05.6957027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6957142Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6957431Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6957538Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6957743Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6957883Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6958030Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6958189Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6958534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6958880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6959182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6959497Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6959821Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6960117Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6960428Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6960548Z Execution Analysis: (:1) 2024-12-18T00:21:05.6960812Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6961007Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6961011Z 2024-12-18T00:21:05.6961216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6961324Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6961559Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6961667Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6961878Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6962020Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6962163Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6962333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6962907Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6963472Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6963819Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6964171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6964475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6964748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6965049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6965309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6965417Z Execution Analysis: .......... 2024-12-18T00:21:05.6965669Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6965873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6966155Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1560 counts during 1486 steps 2024-12-18T00:21:05.6966159Z 2024-12-18T00:21:05.6966365Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6966476Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6966757Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6966873Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6967072Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6967217Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6967352Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6967521Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6967866Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6968205Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6968540Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6968835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6969143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6969451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6969744Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6969864Z Execution Analysis: (:1) 2024-12-18T00:21:05.6970119Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6970316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6970320Z 2024-12-18T00:21:05.6970516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6970642Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6970866Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6970978Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6971180Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6971332Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6971473Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6971636Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6972225Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6972780Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6973136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6973479Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6973789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6974057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6974363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6974624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6974726Z Execution Analysis: .......... 2024-12-18T00:21:05.6974983Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6975179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6975471Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1561 counts during 1487 steps 2024-12-18T00:21:05.6975477Z 2024-12-18T00:21:05.6975671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6975791Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6976075Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6976191Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6976463Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6976603Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6976749Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6977078Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6977444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6977825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6978175Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6978446Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6978800Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6979073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6979364Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6979498Z Execution Analysis: (:1) 2024-12-18T00:21:05.6979753Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6979963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6979968Z 2024-12-18T00:21:05.6980170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6980283Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6980522Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6980633Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6980852Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6980993Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6981146Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6981310Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6981900Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6982485Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6982843Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6983201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6983513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6983794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6984100Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6984373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6984477Z Execution Analysis: .......... 2024-12-18T00:21:05.6984733Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6984944Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6985232Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1562 counts during 1488 steps 2024-12-18T00:21:05.6985237Z 2024-12-18T00:21:05.6985446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6985559Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6985859Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6985967Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6986179Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6986324Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6986462Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6986636Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6986989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6987762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6988075Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6988379Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6988710Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6988975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6989376Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6989497Z Execution Analysis: (:1) 2024-12-18T00:21:05.6989753Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6989951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6989958Z 2024-12-18T00:21:05.6990162Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6990273Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6990501Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.6990611Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6990812Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.6990960Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.6991101Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.6991268Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6991841Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.6992403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.6992753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.6993096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6993405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6993668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6993980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6994247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6994358Z Execution Analysis: .......... 2024-12-18T00:21:05.6994610Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6994820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6995102Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1563 counts during 1489 steps 2024-12-18T00:21:05.6995108Z 2024-12-18T00:21:05.6995307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6995429Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6995715Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.6995831Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.6996035Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.6996183Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.6996326Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.6996492Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.6996877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.6997248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.6997585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.6997881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.6998190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.6998455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.6998738Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.6998872Z Execution Analysis: (:1) 2024-12-18T00:21:05.6999126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.6999339Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6999344Z 2024-12-18T00:21:05.6999541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.6999662Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.6999891Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7000005Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7000208Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7000349Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7000501Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7000667Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7001256Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7001822Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7002183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7002528Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7002838Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7003105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7003406Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7003671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7003774Z Execution Analysis: .......... 2024-12-18T00:21:05.7004032Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7004232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7004526Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1564 counts during 1490 steps 2024-12-18T00:21:05.7004531Z 2024-12-18T00:21:05.7004730Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7004841Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7005132Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7005241Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7005448Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7005589Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7005737Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7005929Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7006300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7006674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7007002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7007273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7007572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7007838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7008121Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7008249Z Execution Analysis: (:1) 2024-12-18T00:21:05.7008504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7008702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7008708Z 2024-12-18T00:21:05.7008918Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7009029Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7009262Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7009372Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7009581Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7009723Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7009865Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7010039Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7010619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7011185Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7011538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7011885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7012189Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7012462Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7012763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7013023Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7013140Z Execution Analysis: .......... 2024-12-18T00:21:05.7013391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7013597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7013881Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1565 counts during 1491 steps 2024-12-18T00:21:05.7013886Z 2024-12-18T00:21:05.7014092Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7014202Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7014491Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7014599Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7014799Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7014948Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7015136Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7015309Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7015659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7016058Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7016445Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7016717Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7017198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7017472Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7017775Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7017907Z Execution Analysis: (:1) 2024-12-18T00:21:05.7018178Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7018384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7018389Z 2024-12-18T00:21:05.7018603Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7018719Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7018950Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7019070Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7019279Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7019430Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7019581Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7019750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7020355Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7020931Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7021298Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7021651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7021970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7022244Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7022560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7022833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7022937Z Execution Analysis: .......... 2024-12-18T00:21:05.7023206Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7023414Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7023711Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1566 counts during 1492 steps 2024-12-18T00:21:05.7023716Z 2024-12-18T00:21:05.7023921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7024039Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7024334Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7024454Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7024700Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7024871Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7025023Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7025217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7025604Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7025956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7026274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7026552Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7026860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7027144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7027440Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7027578Z Execution Analysis: (:1) 2024-12-18T00:21:05.7027838Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7028056Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7028061Z 2024-12-18T00:21:05.7028263Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7028384Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7028615Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7028725Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7029049Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7029189Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7029342Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7029506Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7030173Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7030705Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7031037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7031368Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7031657Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7031919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7032203Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7032459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7032564Z Execution Analysis: .......... 2024-12-18T00:21:05.7032813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7033001Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7033274Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1567 counts during 1493 steps 2024-12-18T00:21:05.7033278Z 2024-12-18T00:21:05.7033474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7033580Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7033855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7033984Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7034209Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7034344Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7034498Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7034660Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7035014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7035347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7035637Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7035896Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7036182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7036431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7036711Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7036827Z Execution Analysis: (:1) 2024-12-18T00:21:05.7037074Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7037264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7037269Z 2024-12-18T00:21:05.7037462Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7037570Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7037793Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7037895Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7038088Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7038231Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7038370Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7038537Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7039090Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7039628Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7039963Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7040298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7040588Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7040845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7041142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7041396Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7041503Z Execution Analysis: .......... 2024-12-18T00:21:05.7041746Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7041942Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7042212Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1568 counts during 1494 steps 2024-12-18T00:21:05.7042216Z 2024-12-18T00:21:05.7042404Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7042521Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7042817Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7042950Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7043140Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7043308Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7043441Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7043623Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7043963Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7044435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7044922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7045195Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7045513Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7045786Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7046088Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7046217Z Execution Analysis: (:1) 2024-12-18T00:21:05.7046479Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7046691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7046696Z 2024-12-18T00:21:05.7046900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7047024Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7047254Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7047372Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7047587Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7047731Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7047886Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7048058Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7048660Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7049234Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7049601Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7049953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7050271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7050546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7050853Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7051132Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7051238Z Execution Analysis: .......... 2024-12-18T00:21:05.7051504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7051711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7052007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1569 counts during 1495 steps 2024-12-18T00:21:05.7052012Z 2024-12-18T00:21:05.7052214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7052385Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7052715Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7052827Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7053075Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7053258Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7053413Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7053580Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7053942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7054295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7054606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7054890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7055202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7055477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7055773Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7055907Z Execution Analysis: (:1) 2024-12-18T00:21:05.7056166Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7056438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7056453Z 2024-12-18T00:21:05.7056657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7056770Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7057011Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7057127Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7057343Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7057488Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7057631Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7057809Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7058404Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7058988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7059350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7059711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7060027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7060303Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7060617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7060883Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7061001Z Execution Analysis: .......... 2024-12-18T00:21:05.7061261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7061476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7061764Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1570 counts during 1496 steps 2024-12-18T00:21:05.7061768Z 2024-12-18T00:21:05.7062071Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7062217Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7062521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7062661Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7062892Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7063051Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7063195Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7063373Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7063735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7064095Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7064407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7064686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7065000Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7065273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7065576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7065702Z Execution Analysis: (:1) 2024-12-18T00:21:05.7065967Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7066173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7066178Z 2024-12-18T00:21:05.7066387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7066502Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7066738Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7066854Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7067064Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7067218Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7067365Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7067534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7068129Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7068809Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7069167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7069513Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7069823Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7070093Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7070402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7070665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7070773Z Execution Analysis: .......... 2024-12-18T00:21:05.7071024Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7071223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7071517Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1571 counts during 1497 steps 2024-12-18T00:21:05.7071568Z 2024-12-18T00:21:05.7071769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7071890Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7072200Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7072336Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7072537Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7072678Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7072823Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7072986Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7073342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7073683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7073997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7074263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7074573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7074836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7075121Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7075254Z Execution Analysis: (:1) 2024-12-18T00:21:05.7075507Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7075711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7075877Z 2024-12-18T00:21:05.7076084Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7076206Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7076435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7076548Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7076763Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7076909Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7077062Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7077230Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7077826Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7078403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7078771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7079127Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7079443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7079728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7080036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7080311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7080418Z Execution Analysis: .......... 2024-12-18T00:21:05.7080683Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7080888Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7081226Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1572 counts during 1498 steps 2024-12-18T00:21:05.7081240Z 2024-12-18T00:21:05.7081443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7081584Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7081908Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7082022Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7082234Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7082378Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7082520Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7082703Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7083062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7083428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7083743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7084134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7084437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7084710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7084997Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7085122Z Execution Analysis: (:1) 2024-12-18T00:21:05.7085388Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7085589Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7085595Z 2024-12-18T00:21:05.7085806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7085920Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7086157Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7086267Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7086474Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7086629Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7086773Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7086952Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7087531Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7088209Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7088545Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7088885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7089180Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7089435Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7089734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7089985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7090099Z Execution Analysis: .......... 2024-12-18T00:21:05.7090339Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7090562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7090858Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1573 counts during 1499 steps 2024-12-18T00:21:05.7090895Z 2024-12-18T00:21:05.7091097Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7091227Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7091502Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7091617Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7091808Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7091957Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7092093Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7092260Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7092595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7092925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7093224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7093480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7093776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7094027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7094305Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7094420Z Execution Analysis: (:1) 2024-12-18T00:21:05.7094660Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7094860Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7094866Z 2024-12-18T00:21:05.7095053Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7095171Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7095385Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7095497Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7095689Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7095830Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7095967Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7096122Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7096753Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7097494Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7097864Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7098217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7098536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7098811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7099131Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7099397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7099506Z Execution Analysis: .......... 2024-12-18T00:21:05.7099806Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7100037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7100367Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1574 counts during 1500 steps 2024-12-18T00:21:05.7100371Z 2024-12-18T00:21:05.7100601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7100730Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7101022Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7101136Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7101350Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7101494Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7101648Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7101818Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7102187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7102537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7102852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7103134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7103441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7103718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7104010Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7104148Z Execution Analysis: (:1) 2024-12-18T00:21:05.7104407Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7104621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7104627Z 2024-12-18T00:21:05.7104831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7104949Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7105189Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7105301Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7105523Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7105667Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7105825Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7105990Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7106586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7107169Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7107534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7107896Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7108208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7108492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7108895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7109154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7109276Z Execution Analysis: .......... 2024-12-18T00:21:05.7109567Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7109766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7110089Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1575 counts during 1501 steps 2024-12-18T00:21:05.7110094Z 2024-12-18T00:21:05.7110291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7110398Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7110676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7110781Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7110972Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7111117Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7111253Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7111422Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7111752Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7112094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7112382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7112644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7112929Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7113180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7113460Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7113576Z Execution Analysis: (:1) 2024-12-18T00:21:05.7113827Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7114020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7114026Z 2024-12-18T00:21:05.7114223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7114329Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7114543Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7114655Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7114848Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7114994Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7115132Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7115293Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7115845Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7116382Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7116718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7117046Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7117344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7117597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7118066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7118351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7118494Z Execution Analysis: .......... 2024-12-18T00:21:05.7118746Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7118994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7119288Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1576 counts during 1502 steps 2024-12-18T00:21:05.7119293Z 2024-12-18T00:21:05.7119489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7119614Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7119900Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7120017Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7120219Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7120374Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7120513Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7120679Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7121041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7121382Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7121699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7121966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7122280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7122543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7122831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7122962Z Execution Analysis: (:1) 2024-12-18T00:21:05.7123218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7123433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7123437Z 2024-12-18T00:21:05.7123635Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7123754Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7123981Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7124097Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7124299Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7124440Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7124590Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7124757Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7125346Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7125909Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7126269Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7126611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7126915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7127189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7127518Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7127828Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7127936Z Execution Analysis: .......... 2024-12-18T00:21:05.7128224Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7128448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7128743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1578 counts during 1503 steps 2024-12-18T00:21:05.7128748Z 2024-12-18T00:21:05.7128947Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7129062Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7129361Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7129473Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7129793Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7129934Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7130082Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7130239Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7130579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7130915Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7131202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7131465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7131751Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7132009Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7132286Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7132405Z Execution Analysis: (:1) 2024-12-18T00:21:05.7132658Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7132850Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7132854Z 2024-12-18T00:21:05.7133054Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7133164Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7133391Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7133496Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7133702Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7133834Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7133976Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7134141Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7134692Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7135231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7135564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7135897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7136187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7136575Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7137061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7137328Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7137477Z Execution Analysis: .......... 2024-12-18T00:21:05.7137760Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7137975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7138267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1579 counts during 1504 steps 2024-12-18T00:21:05.7138271Z 2024-12-18T00:21:05.7138487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7138602Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7138892Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7139014Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7139219Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7139375Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7139519Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7139695Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7140051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7140402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7140720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7140993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7141309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7141581Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7141879Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7142006Z Execution Analysis: (:1) 2024-12-18T00:21:05.7142278Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7142481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7142485Z 2024-12-18T00:21:05.7142690Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7142811Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7143043Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7143164Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7143375Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7143528Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7143676Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7143846Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7144599Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7145175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7145546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7145899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7146219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7146580Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7146902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7147204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7147344Z Execution Analysis: .......... 2024-12-18T00:21:05.7147612Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7147815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7148117Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1580 counts during 1505 steps 2024-12-18T00:21:05.7148122Z 2024-12-18T00:21:05.7148325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7148447Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7148741Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7148860Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7149063Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7149207Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7149364Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7149533Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7149904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7150259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7150580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7150853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7151167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7151445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7151739Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7151878Z Execution Analysis: (:1) 2024-12-18T00:21:05.7152138Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7152353Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7152358Z 2024-12-18T00:21:05.7152559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7152674Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7152917Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7153031Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7153247Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7153390Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7153548Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7153718Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7154313Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7154894Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7155256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7155618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7156070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7156335Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7156651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7156933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7157032Z Execution Analysis: .......... 2024-12-18T00:21:05.7157274Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7157469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7157736Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1581 counts during 1506 steps 2024-12-18T00:21:05.7157740Z 2024-12-18T00:21:05.7157939Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7158046Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7158324Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7158429Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7158627Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7158763Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7158895Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7159059Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7159390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7159723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7160012Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7160274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7160558Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7160810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7161089Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7161206Z Execution Analysis: (:1) 2024-12-18T00:21:05.7161458Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7161647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7161650Z 2024-12-18T00:21:05.7161849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7161955Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7162177Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7162280Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7162475Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7162614Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7162753Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7162918Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7163464Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7164002Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7164334Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7164697Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7165020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7165301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7165619Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7165871Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7165982Z Execution Analysis: .......... 2024-12-18T00:21:05.7166218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7166420Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7166688Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1582 counts during 1507 steps 2024-12-18T00:21:05.7166692Z 2024-12-18T00:21:05.7166884Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7166999Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7167270Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7167381Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7167576Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7167718Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7167849Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7168006Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7168346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7168670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7168969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7169224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7169518Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7169767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7170037Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7170161Z Execution Analysis: (:1) 2024-12-18T00:21:05.7170401Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7170600Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7170604Z 2024-12-18T00:21:05.7170791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7170906Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7171125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7171244Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7171441Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7171579Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7171731Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7171890Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7172455Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7172991Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7173536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7173908Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7174252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7174545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7174851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7175128Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7175234Z Execution Analysis: .......... 2024-12-18T00:21:05.7175504Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7175705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7176007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1583 counts during 1508 steps 2024-12-18T00:21:05.7176014Z 2024-12-18T00:21:05.7176216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7176390Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7176704Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7176978Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7177199Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7177348Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7177511Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7177745Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7178106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7178477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7178797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7179087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7179402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7179692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7179987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7180130Z Execution Analysis: (:1) 2024-12-18T00:21:05.7180392Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7180601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7180605Z 2024-12-18T00:21:05.7180827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7180948Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7181196Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7181311Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7181536Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7181684Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7181834Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7182021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7182612Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7183208Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7183625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7183992Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7184359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7184646Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7184955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7185224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7185345Z Execution Analysis: .......... 2024-12-18T00:21:05.7185607Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7185825Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7186116Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1584 counts during 1509 steps 2024-12-18T00:21:05.7186121Z 2024-12-18T00:21:05.7186337Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7186454Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7186758Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7186869Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7187075Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7187232Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7187378Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7187557Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7187916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7188284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7188599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7188876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7189294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7189545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7189829Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7189946Z Execution Analysis: (:1) 2024-12-18T00:21:05.7190198Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7190390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7190396Z 2024-12-18T00:21:05.7190595Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7190707Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7190921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7191038Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7191232Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7191377Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7191514Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7191673Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7192234Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7192790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7193161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7193513Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7193849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7194107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7194407Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7194657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7194757Z Execution Analysis: .......... 2024-12-18T00:21:05.7195010Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7195204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7195487Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1585 counts during 1510 steps 2024-12-18T00:21:05.7195493Z 2024-12-18T00:21:05.7195685Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7195805Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7196083Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7196201Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7196391Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7196527Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7196674Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7196829Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7197176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7197503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7197804Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7198058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7198346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7198608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7198883Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7199012Z Execution Analysis: (:1) 2024-12-18T00:21:05.7199252Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7199458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7199462Z 2024-12-18T00:21:05.7199650Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7199771Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7199987Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7200093Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7200296Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7200430Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7200580Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7200739Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7201326Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7201885Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7202244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7202676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7202968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7203239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7203528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7203790Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7203894Z Execution Analysis: .......... 2024-12-18T00:21:05.7204323Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7204523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7204809Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1586 counts during 1511 steps 2024-12-18T00:21:05.7204815Z 2024-12-18T00:21:05.7205027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7205141Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7205439Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7205549Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7205760Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7206066Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7206211Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7206393Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7206750Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7207115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7207431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7207716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7208024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7208294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7208598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7208724Z Execution Analysis: (:1) 2024-12-18T00:21:05.7208998Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7209206Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7209213Z 2024-12-18T00:21:05.7209430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7209546Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7209793Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7209905Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7210115Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7210280Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7210459Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7210645Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7211296Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7211942Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7212361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7212769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7213091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7213385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7213693Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7213977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7214092Z Execution Analysis: .......... 2024-12-18T00:21:05.7214365Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7214571Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7214866Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1587 counts during 1512 steps 2024-12-18T00:21:05.7214871Z 2024-12-18T00:21:05.7215089Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7215206Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7215512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7215626Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7215845Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7215992Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7216140Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7216323Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7216760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7217134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7217449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7217741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7218051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7218320Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7218628Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7218761Z Execution Analysis: (:1) 2024-12-18T00:21:05.7219035Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7219245Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7219249Z 2024-12-18T00:21:05.7219469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7219587Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7219837Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7219952Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7220161Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7220321Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7220472Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7220687Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7221545Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7222185Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7222549Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7222917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7223236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7223511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7223836Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7224111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7224234Z Execution Analysis: .......... 2024-12-18T00:21:05.7224502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7224717Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7225012Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1588 counts during 1513 steps 2024-12-18T00:21:05.7225017Z 2024-12-18T00:21:05.7225224Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7225354Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7225650Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7225776Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7225983Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7226144Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7226290Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7226462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7226833Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7227190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7227516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7227792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7228111Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7228379Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7228686Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7228813Z Execution Analysis: (:1) 2024-12-18T00:21:05.7229197Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7229413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7229417Z 2024-12-18T00:21:05.7229615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7229739Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7229971Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7230095Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7230296Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7230436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7230615Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7230806Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7231398Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7232019Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7232385Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7232730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7233048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7233316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7233618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7233894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7234003Z Execution Analysis: .......... 2024-12-18T00:21:05.7234270Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7234469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7234764Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1589 counts during 1514 steps 2024-12-18T00:21:05.7234769Z 2024-12-18T00:21:05.7234968Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7235094Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7235382Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7235493Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7235707Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7235848Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7236002Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7236168Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7236518Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7236872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7237174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7237451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7237749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7238025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7238311Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7238449Z Execution Analysis: (:1) 2024-12-18T00:21:05.7238705Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7238903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7238918Z 2024-12-18T00:21:05.7239118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7239231Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7239467Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7239579Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7239794Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7239989Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7240134Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7240308Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7241026Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7241571Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7241906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7242244Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7242536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7242805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7243095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7243347Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7243460Z Execution Analysis: .......... 2024-12-18T00:21:05.7243703Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7243902Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7244320Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1590 counts during 1515 steps 2024-12-18T00:21:05.7244324Z 2024-12-18T00:21:05.7244695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7244812Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7245120Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7245233Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7245441Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7245602Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7245748Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7245930Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7246290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7246656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7246971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7247243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7247566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7247836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7248143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7248272Z Execution Analysis: (:1) 2024-12-18T00:21:05.7248542Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7248746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7248750Z 2024-12-18T00:21:05.7248964Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7249081Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7249311Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7249436Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7249732Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7249893Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7250038Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7250253Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7250874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7251449Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7251824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7252179Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7252507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7252781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7253102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7253373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7253493Z Execution Analysis: .......... 2024-12-18T00:21:05.7253753Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7253959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7254259Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1591 counts during 1516 steps 2024-12-18T00:21:05.7254263Z 2024-12-18T00:21:05.7254467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7254598Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7254891Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7255013Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7255219Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7255364Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7255520Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7255691Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7256062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7256493Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7256817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7257096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7257407Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7257688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7257986Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7258127Z Execution Analysis: (:1) 2024-12-18T00:21:05.7258389Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7258604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7258608Z 2024-12-18T00:21:05.7258814Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7258942Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7259205Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7259343Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7259563Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7259736Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7259896Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7260091Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7260697Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7261272Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7261646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7261997Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7262308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7262591Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7262902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7263181Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7263286Z Execution Analysis: .......... 2024-12-18T00:21:05.7263556Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7263756Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7264045Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1592 counts during 1517 steps 2024-12-18T00:21:05.7264058Z 2024-12-18T00:21:05.7264268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7264384Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7264685Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7264800Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7265011Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7265154Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7265298Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7265475Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7265834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7266195Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7266508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7266791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7267100Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7267376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7267671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7267797Z Execution Analysis: (:1) 2024-12-18T00:21:05.7268069Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7268276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7268280Z 2024-12-18T00:21:05.7268489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7268629Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7269019Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7269122Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7269340Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7269487Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7269648Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7269813Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7270360Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7270896Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7271229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7271564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7271851Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7272106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7272399Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7272641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7272753Z Execution Analysis: .......... 2024-12-18T00:21:05.7272990Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7273183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7273451Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1593 counts during 1518 steps 2024-12-18T00:21:05.7273459Z 2024-12-18T00:21:05.7273656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7273761Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7274028Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7274143Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7274329Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7274468Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7274599Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7274761Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7275089Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7275413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7275712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7275966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7276257Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7276504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7276780Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7276896Z Execution Analysis: (:1) 2024-12-18T00:21:05.7277131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7277325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7277329Z 2024-12-18T00:21:05.7277540Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7277679Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7277894Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7278030Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7278244Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7278386Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7278523Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7278678Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7279232Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7279763Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7280106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7280433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7280727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7280983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7281268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7281521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7281622Z Execution Analysis: .......... 2024-12-18T00:21:05.7281869Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7282057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7282334Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1594 counts during 1519 steps 2024-12-18T00:21:05.7282338Z 2024-12-18T00:21:05.7282524Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7282634Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7282903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7283007Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7283201Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7283335Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7283474Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7283630Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7283969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7284295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7284586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7284848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7285134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7285387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7285656Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7285778Z Execution Analysis: (:1) 2024-12-18T00:21:05.7286019Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7286215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7286268Z 2024-12-18T00:21:05.7286457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7286564Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7286805Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7286932Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7287132Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7287264Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7287409Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7287564Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7288111Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7288649Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7288983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7289316Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7289607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7289867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7290150Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7290404Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7290502Z Execution Analysis: .......... 2024-12-18T00:21:05.7290740Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7290934Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7291202Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1595 counts during 1520 steps 2024-12-18T00:21:05.7291208Z 2024-12-18T00:21:05.7291400Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7291508Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7291782Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7291883Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7292072Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7292213Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7292345Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7292504Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7292835Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7293170Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7293461Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7293717Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7294003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7294250Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7294525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7294641Z Execution Analysis: (:1) 2024-12-18T00:21:05.7294886Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7295100Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7295127Z 2024-12-18T00:21:05.7295322Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7295452Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7295690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7295802Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7295992Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7296133Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7296269Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7296525Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7297262Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7297840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7298210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7298564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7298887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7299161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7299476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7299743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7299860Z Execution Analysis: .......... 2024-12-18T00:21:05.7300119Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7300324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7300617Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1596 counts during 1521 steps 2024-12-18T00:21:05.7300622Z 2024-12-18T00:21:05.7300824Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7300945Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7301237Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7301353Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7305889Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7306066Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7306217Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7306396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7306775Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7307134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7307462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7307739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7308050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7308320Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7308610Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7308739Z Execution Analysis: (:1) 2024-12-18T00:21:05.7309092Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7309338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7309375Z 2024-12-18T00:21:05.7309579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7309730Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7309962Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7310070Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7310285Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7310428Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7310576Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7310742Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7311350Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7311929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7312292Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7312646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7312957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7313236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7313540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7313814Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7313921Z Execution Analysis: .......... 2024-12-18T00:21:05.7314189Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7314391Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7314684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1597 counts during 1522 steps 2024-12-18T00:21:05.7314689Z 2024-12-18T00:21:05.7314892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7315008Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7315300Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7315408Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7315615Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7315757Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7315902Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7316077Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7316539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7316888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7317194Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7317463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7317925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7318190Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7318482Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7318633Z Execution Analysis: (:1) 2024-12-18T00:21:05.7318924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7319123Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7319153Z 2024-12-18T00:21:05.7319387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7319501Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7319736Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7319844Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7320052Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7320198Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7320341Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7320513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7321115Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7321723Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7322106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7322467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7322776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7323054Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7323359Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7323624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7323736Z Execution Analysis: .......... 2024-12-18T00:21:05.7323993Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7324204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7324498Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1599 counts during 1523 steps 2024-12-18T00:21:05.7324503Z 2024-12-18T00:21:05.7324711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7324825Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7325121Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7325233Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7325439Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7325589Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7325728Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7325901Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7326259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7326618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7326930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7327203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7327516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7327782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7328107Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7328254Z Execution Analysis: (:1) 2024-12-18T00:21:05.7328519Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7328775Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7328780Z 2024-12-18T00:21:05.7328987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7329098Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7329327Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7329441Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7329649Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7329797Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7329941Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7330123Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7330719Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7331295Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7331658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7332004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7332321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7332593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7332907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7333175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7333287Z Execution Analysis: .......... 2024-12-18T00:21:05.7333544Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7333749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7334039Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1600 counts during 1524 steps 2024-12-18T00:21:05.7334044Z 2024-12-18T00:21:05.7334243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7334364Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7334654Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7334767Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7334973Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7335115Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7335259Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7335425Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7335789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7336136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7336567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7336839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7337142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7337443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7337760Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7337888Z Execution Analysis: (:1) 2024-12-18T00:21:05.7338173Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7338417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7338425Z 2024-12-18T00:21:05.7338626Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7338742Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7338972Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7339080Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7339292Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7339436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7339590Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7339757Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7340358Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7340931Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7341286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7341645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7341953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7342230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7342539Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7342811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7342917Z Execution Analysis: .......... 2024-12-18T00:21:05.7343180Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7343381Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7343666Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1601 counts during 1525 steps 2024-12-18T00:21:05.7343676Z 2024-12-18T00:21:05.7343876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7343988Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7344425Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7344534Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7344745Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7344887Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7345026Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7345200Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7345553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7345909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7346214Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7346490Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7346795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7347160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7347454Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7347613Z Execution Analysis: (:1) 2024-12-18T00:21:05.7347911Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7348114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7348119Z 2024-12-18T00:21:05.7348325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7348435Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7348666Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7348774Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7348980Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7349132Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7349277Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7349450Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7350042Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7350618Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7350975Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7351329Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7351640Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7351914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7352230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7352498Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7352613Z Execution Analysis: .......... 2024-12-18T00:21:05.7352870Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7353078Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7353367Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1602 counts during 1526 steps 2024-12-18T00:21:05.7353371Z 2024-12-18T00:21:05.7353575Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7353688Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7353978Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7354092Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7354294Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7354441Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7354583Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7354752Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7355108Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7355456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7355772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7356040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7356404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7356670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7357068Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7357215Z Execution Analysis: (:1) 2024-12-18T00:21:05.7357471Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7357678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7357683Z 2024-12-18T00:21:05.7357881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7358008Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7358238Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7358356Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7358564Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7358703Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7358858Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7359021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7359615Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7360182Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7360543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7360891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7361207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7361479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7361786Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7362060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7362163Z Execution Analysis: .......... 2024-12-18T00:21:05.7362425Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7362625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7362915Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1603 counts during 1527 steps 2024-12-18T00:21:05.7362919Z 2024-12-18T00:21:05.7363121Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7363237Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7363524Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7363633Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7363843Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7363982Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7364125Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7364289Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7364651Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7364999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7365305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7365608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7365936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7366233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7366546Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7366674Z Execution Analysis: (:1) 2024-12-18T00:21:05.7366931Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7367140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7367144Z 2024-12-18T00:21:05.7367342Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7367452Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7367692Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7367801Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7368015Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7368158Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7368310Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7368478Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7369066Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7369645Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7370000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7370360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7370670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7370948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7371256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7371530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7371635Z Execution Analysis: .......... 2024-12-18T00:21:05.7371888Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7372097Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7372383Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1604 counts during 1528 steps 2024-12-18T00:21:05.7372388Z 2024-12-18T00:21:05.7372602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7372714Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7373013Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7373122Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7373324Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7373478Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7373617Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7373789Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7374142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7374500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7374833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7375127Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7375476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7375767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7376061Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7376181Z Execution Analysis: (:1) 2024-12-18T00:21:05.7376518Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7376726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7376731Z 2024-12-18T00:21:05.7376936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7377053Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7377280Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7377399Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7377603Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7377756Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7377901Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7378076Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7378671Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7379239Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7379609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7379959Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7380281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7380552Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7380863Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7381128Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7381238Z Execution Analysis: .......... 2024-12-18T00:21:05.7381492Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7381692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7381987Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1605 counts during 1529 steps 2024-12-18T00:21:05.7381993Z 2024-12-18T00:21:05.7382191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7382308Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7382596Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7382713Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7382913Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7383054Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7383200Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7383362Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7383724Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7384102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7384441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7384734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7385073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7385339Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7385625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7385751Z Execution Analysis: (:1) 2024-12-18T00:21:05.7386004Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7386215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7386220Z 2024-12-18T00:21:05.7386423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7386542Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7386772Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7386880Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7387092Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7387231Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7387381Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7387547Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7388145Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7388823Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7389179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7389517Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7389818Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7390088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7390384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7390649Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7390748Z Execution Analysis: .......... 2024-12-18T00:21:05.7391003Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7391202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7391482Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1606 counts during 1530 steps 2024-12-18T00:21:05.7391491Z 2024-12-18T00:21:05.7391689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7391799Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7392092Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7392198Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7392400Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7392538Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7392680Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7392842Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7393214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7393586Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7393888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7394203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7394503Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7394772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7395055Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7395178Z Execution Analysis: (:1) 2024-12-18T00:21:05.7395440Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7395640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7395646Z 2024-12-18T00:21:05.7395849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7395961Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7396192Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7396305Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7396515Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7396656Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7396800Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7396971Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7397552Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7398116Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7398468Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7398823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7399123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7399388Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7399689Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7399951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7400059Z Execution Analysis: .......... 2024-12-18T00:21:05.7400315Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7400522Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7400802Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1607 counts during 1531 steps 2024-12-18T00:21:05.7400808Z 2024-12-18T00:21:05.7401013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7401125Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7401409Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7401520Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7401719Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7401862Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7402000Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7402168Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7402564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7402907Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7403236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7403520Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7403827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7404085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7404376Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7404497Z Execution Analysis: (:1) 2024-12-18T00:21:05.7404756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7404956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7404960Z 2024-12-18T00:21:05.7405158Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7405276Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7405499Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7405616Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7405980Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7406131Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7406276Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7406442Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7407037Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7407614Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7407976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7408330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7408645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7408918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7409232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7409497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7409604Z Execution Analysis: .......... 2024-12-18T00:21:05.7409872Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7410074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7410368Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1608 counts during 1532 steps 2024-12-18T00:21:05.7410375Z 2024-12-18T00:21:05.7410574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7410691Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7410982Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7411091Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7411298Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7411440Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7411585Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7411812Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7412178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7412555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7412891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7413172Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7413478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7413752Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7414040Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7414174Z Execution Analysis: (:1) 2024-12-18T00:21:05.7414439Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7414654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7414660Z 2024-12-18T00:21:05.7414861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7414976Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7415214Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7415325Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7415540Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7415682Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7415834Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7415998Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7416686Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7417272Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7417634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7417992Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7418303Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7418586Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7418894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7419170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7419278Z Execution Analysis: .......... 2024-12-18T00:21:05.7419535Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7419743Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7420036Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1609 counts during 1533 steps 2024-12-18T00:21:05.7420040Z 2024-12-18T00:21:05.7420249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7420361Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7420654Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7420763Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7420975Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7421147Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7421315Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7421489Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7421875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7422255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7422564Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7422842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7423145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7423417Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7423712Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7423840Z Execution Analysis: (:1) 2024-12-18T00:21:05.7424102Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7424310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7424315Z 2024-12-18T00:21:05.7424525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7424641Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7424874Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7424982Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7425186Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7425332Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7425480Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7425657Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7426250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7426837Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7427194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7427545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7427858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7428132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7428448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7428718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7428831Z Execution Analysis: .......... 2024-12-18T00:21:05.7429213Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7429417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7429697Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1610 counts during 1534 steps 2024-12-18T00:21:05.7429701Z 2024-12-18T00:21:05.7429893Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7430005Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7430288Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7430400Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7430622Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7430792Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7430931Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7431119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7431504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7431846Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7432154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7432419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7432721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7432981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7433268Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7433392Z Execution Analysis: (:1) 2024-12-18T00:21:05.7433643Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7433847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7433852Z 2024-12-18T00:21:05.7434046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7434164Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7434386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7434503Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7434703Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7434843Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7434988Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7435152Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7435734Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7436300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7436657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7436999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7437301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7437574Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7437877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7438141Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7438246Z Execution Analysis: .......... 2024-12-18T00:21:05.7438505Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7438704Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7438994Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1611 counts during 1535 steps 2024-12-18T00:21:05.7438998Z 2024-12-18T00:21:05.7439192Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7439303Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7439592Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7439732Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7439962Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7440102Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7440273Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7440461Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7440806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7441150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7441454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7441726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7442027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7442292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7442578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7442710Z Execution Analysis: (:1) 2024-12-18T00:21:05.7442963Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7443162Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7443166Z 2024-12-18T00:21:05.7443368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7443476Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7443702Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7443809Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7444017Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7444307Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7444613Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7444786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7445386Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7445970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7446329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7446687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7446997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7447275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7447586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7447858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7447977Z Execution Analysis: .......... 2024-12-18T00:21:05.7448236Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7448446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7448735Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1612 counts during 1536 steps 2024-12-18T00:21:05.7448739Z 2024-12-18T00:21:05.7448944Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7449055Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7449414Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7449559Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7449764Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7449947Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7450117Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7450291Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7450645Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7450995Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7451313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7451583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7451896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7452161Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7452459Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7452584Z Execution Analysis: (:1) 2024-12-18T00:21:05.7452846Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7453048Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7453052Z 2024-12-18T00:21:05.7453254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7453370Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7453597Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7453707Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7453917Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7454065Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7454214Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7454380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7454972Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7455542Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7455904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7456250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7456641Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7456916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7457235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7457506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7457611Z Execution Analysis: .......... 2024-12-18T00:21:05.7457872Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7458074Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7458365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1613 counts during 1537 steps 2024-12-18T00:21:05.7458370Z 2024-12-18T00:21:05.7458569Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7458741Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7459030Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7459176Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7459383Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7459552Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7459700Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7459866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7460231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7460584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7460902Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7461177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7461487Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7461760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7462058Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7462191Z Execution Analysis: (:1) 2024-12-18T00:21:05.7462452Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7462662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7462667Z 2024-12-18T00:21:05.7462863Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7462984Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7463217Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7463326Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7463540Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7463684Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7463835Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7464003Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7464601Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7465176Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7465532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7465884Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7466194Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7466473Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7466784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7467054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7467160Z Execution Analysis: .......... 2024-12-18T00:21:05.7467422Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7467636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7467927Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1614 counts during 1538 steps 2024-12-18T00:21:05.7467932Z 2024-12-18T00:21:05.7468161Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7468304Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7468603Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7468739Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7469073Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7469207Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7469337Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7469499Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7469828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7470153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7470442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7470700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7470983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7471232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7471507Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7471620Z Execution Analysis: (:1) 2024-12-18T00:21:05.7471866Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7472052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7472056Z 2024-12-18T00:21:05.7472248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7472355Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7472577Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7472678Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7472873Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7473010Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7473147Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7473306Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7473851Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7474388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7474722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7475052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7475343Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7475594Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7475879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7476126Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7476233Z Execution Analysis: .......... 2024-12-18T00:21:05.7476471Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7476665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7476955Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1615 counts during 1539 steps 2024-12-18T00:21:05.7476986Z 2024-12-18T00:21:05.7477173Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7477309Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7477579Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7477717Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7477907Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7478046Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7478175Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7478331Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7478664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7478988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7479282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7479534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7479827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7480077Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7480352Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7480469Z Execution Analysis: (:1) 2024-12-18T00:21:05.7480711Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7480903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7480908Z 2024-12-18T00:21:05.7481095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7481211Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7481424Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7481536Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7481727Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7481859Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7482004Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7482159Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7482710Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7483239Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7483583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7483904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7484204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7484456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7484742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7484995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7485095Z Execution Analysis: .......... 2024-12-18T00:21:05.7485340Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7485529Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7485850Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1616 counts during 1540 steps 2024-12-18T00:21:05.7485855Z 2024-12-18T00:21:05.7486043Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7486185Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7486478Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7486584Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7486778Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7486909Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7487049Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7487204Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7487535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7487868Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7488163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7488424Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7488708Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7488962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7489232Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7489351Z Execution Analysis: (:1) 2024-12-18T00:21:05.7489591Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7489780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7489797Z 2024-12-18T00:21:05.7489981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7490087Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7490309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7490410Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7490608Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7490739Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7490877Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7491035Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7491585Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7492121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7492454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7492783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7493072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7493329Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7493610Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7493857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7493962Z Execution Analysis: .......... 2024-12-18T00:21:05.7494198Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7494415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7494707Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1617 counts during 1541 steps 2024-12-18T00:21:05.7494736Z 2024-12-18T00:21:05.7494952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7495059Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7495333Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7495436Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7495627Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7495767Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7495897Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7496061Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7496465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7496965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7497276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7497548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7497860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7498125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7498422Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7498547Z Execution Analysis: (:1) 2024-12-18T00:21:05.7498813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7499018Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7499025Z 2024-12-18T00:21:05.7499235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7499347Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7499578Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7499697Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7499903Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7500052Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7500198Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7500372Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7500960Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7501537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7501905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7502256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7502573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7502842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7503155Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7503423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7503542Z Execution Analysis: .......... 2024-12-18T00:21:05.7503825Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7504128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7504457Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1618 counts during 1542 steps 2024-12-18T00:21:05.7504462Z 2024-12-18T00:21:05.7504689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7504813Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7505104Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7505225Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7505430Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7505575Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7505724Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7505894Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7506258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7506611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7506930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7507201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7507508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7507780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7508070Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7508199Z Execution Analysis: (:1) 2024-12-18T00:21:05.7508459Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7508671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7508677Z 2024-12-18T00:21:05.7508878Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7508999Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7509318Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7509422Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7509620Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7509754Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7509895Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7510048Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7510603Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7511129Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7511465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7511797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7512084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7512341Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7512627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7512880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7513023Z Execution Analysis: .......... 2024-12-18T00:21:05.7513270Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7513489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7513780Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1620 counts during 1543 steps 2024-12-18T00:21:05.7513795Z 2024-12-18T00:21:05.7513979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7514083Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7514364Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7514465Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7514658Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7514788Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7514921Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7515087Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7515418Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7515749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7516035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7516293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7516575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7516832Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7517099Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7517216Z Execution Analysis: (:1) 2024-12-18T00:21:05.7517460Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7517648Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7517653Z 2024-12-18T00:21:05.7518021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7518130Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7518365Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7518473Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7518672Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7518815Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7518955Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7519124Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7519700Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7520261Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7520612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7520960Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7521258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7521523Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7521831Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7522119Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7522252Z Execution Analysis: .......... 2024-12-18T00:21:05.7522501Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7522752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7523034Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1621 counts during 1544 steps 2024-12-18T00:21:05.7523038Z 2024-12-18T00:21:05.7523243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7523352Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7523640Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7523754Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7523953Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7524101Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7524240Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7524414Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7524764Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7525108Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7525419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7525683Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7525990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7526251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7526547Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7526671Z Execution Analysis: (:1) 2024-12-18T00:21:05.7526925Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7527135Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7527140Z 2024-12-18T00:21:05.7527336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7527455Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7527681Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7527795Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7527996Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7528136Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7528288Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7528454Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7529039Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7529599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7530048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7530373Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7530670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7530920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7531230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7531509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7531635Z Execution Analysis: .......... 2024-12-18T00:21:05.7531885Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7532096Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7532372Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1622 counts during 1545 steps 2024-12-18T00:21:05.7532377Z 2024-12-18T00:21:05.7532562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7532677Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7532944Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7533047Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7533244Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7533376Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7533514Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7533668Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7534009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7534330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7534616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7534874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7535157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7535414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7535682Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7535803Z Execution Analysis: (:1) 2024-12-18T00:21:05.7536042Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7536232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7536245Z 2024-12-18T00:21:05.7536504Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7536608Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7536997Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7537108Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7537320Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7537464Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7537619Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7537824Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7538417Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7539000Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7539359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7539714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7540026Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7540335Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7540664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7540940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7541071Z Execution Analysis: .......... 2024-12-18T00:21:05.7541354Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7541564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7541855Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1623 counts during 1546 steps 2024-12-18T00:21:05.7541860Z 2024-12-18T00:21:05.7542067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7542179Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7542481Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7542591Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7542795Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7542946Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7543086Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7543259Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7543615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7543974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7544438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7544709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7545024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7545295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7545594Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7545721Z Execution Analysis: (:1) 2024-12-18T00:21:05.7545993Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7546197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7546201Z 2024-12-18T00:21:05.7546413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7546528Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7546757Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7546875Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7547085Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7547238Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7547382Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7547554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7548150Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7548724Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7549088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7549439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7549811Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7550143Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7550461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7550763Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7550913Z Execution Analysis: .......... 2024-12-18T00:21:05.7551172Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7551377Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7551675Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1624 counts during 1547 steps 2024-12-18T00:21:05.7551679Z 2024-12-18T00:21:05.7551883Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7552006Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7552301Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7552421Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7552628Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7552772Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7552925Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7553092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7553456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7553808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7554124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7554397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7554718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7554981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7555273Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7555410Z Execution Analysis: (:1) 2024-12-18T00:21:05.7555668Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7555972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7555976Z 2024-12-18T00:21:05.7556164Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7556278Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7556489Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7556598Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7556800Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7556934Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7557076Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7557233Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7557784Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7558309Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7558648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7558971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7559328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7559589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7559899Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7560185Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7560283Z Execution Analysis: .......... 2024-12-18T00:21:05.7560531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7560718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7560985Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1625 counts during 1548 steps 2024-12-18T00:21:05.7560999Z 2024-12-18T00:21:05.7561184Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7561292Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7561570Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7561671Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7561868Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7561999Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7562140Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7562295Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7562625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7562956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7563242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7563500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7563781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7564037Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7564310Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7564427Z Execution Analysis: (:1) 2024-12-18T00:21:05.7564675Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7564865Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7564868Z 2024-12-18T00:21:05.7565060Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7565164Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7565388Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7565490Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7565690Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7565820Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7565957Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7566117Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7566665Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7567200Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7567536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7567898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7568210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7568491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7568808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7569058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7569164Z Execution Analysis: .......... 2024-12-18T00:21:05.7569404Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7569768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7570049Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1626 counts during 1549 steps 2024-12-18T00:21:05.7570057Z 2024-12-18T00:21:05.7570264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7570377Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7570664Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7570781Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7570981Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7571128Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7571267Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7571441Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7571786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7572132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7572449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7572717Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7573028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7573292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7573587Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7573709Z Execution Analysis: (:1) 2024-12-18T00:21:05.7573962Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7574169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7574174Z 2024-12-18T00:21:05.7574375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7574496Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7574727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7574845Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7575049Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7575201Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7575345Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7575513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7576092Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7576738Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7577302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7577681Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7578032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7578333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7578656Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7578922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7579028Z Execution Analysis: .......... 2024-12-18T00:21:05.7579300Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7579502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7579800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1627 counts during 1550 steps 2024-12-18T00:21:05.7579807Z 2024-12-18T00:21:05.7580008Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7580127Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7580416Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7580528Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7580742Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7580881Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7581034Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7581200Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7581564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7581914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7582225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7582508Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7582814Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7583091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7583383Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7583516Z Execution Analysis: (:1) 2024-12-18T00:21:05.7583771Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7583983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7583988Z 2024-12-18T00:21:05.7584191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7584306Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7584548Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7584658Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7584877Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7585015Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7585172Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7585334Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7585929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7586551Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7586934Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7587297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7587655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7587940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7588244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7588521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7588628Z Execution Analysis: .......... 2024-12-18T00:21:05.7588883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7589201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7589483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1628 counts during 1551 steps 2024-12-18T00:21:05.7589490Z 2024-12-18T00:21:05.7589699Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7589813Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7590109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7590218Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7590426Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7590566Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7590703Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7590877Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7591225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7591578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7591879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7592156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7592554Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7592802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7593079Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7593193Z Execution Analysis: (:1) 2024-12-18T00:21:05.7593442Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7593630Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7593635Z 2024-12-18T00:21:05.7593832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7593936Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7594159Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7594261Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7594453Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7594597Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7594729Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7594894Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7595439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7596006Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7596361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7596732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7597029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7597280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7597575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7597818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7597925Z Execution Analysis: .......... 2024-12-18T00:21:05.7598161Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7598353Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7598633Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1629 counts during 1552 steps 2024-12-18T00:21:05.7598639Z 2024-12-18T00:21:05.7598825Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7598942Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7599208Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7599327Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7599515Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7599657Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7599785Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7599940Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7600282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7600602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7600903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7601153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7601448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7601692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7601959Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7602080Z Execution Analysis: (:1) 2024-12-18T00:21:05.7602320Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7602521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7602525Z 2024-12-18T00:21:05.7602711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7602828Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7603041Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7603153Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7603343Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7603476Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7603622Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7603772Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7604350Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7604900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7605267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7605618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7605904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7606164Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7606450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7606706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7606803Z Execution Analysis: .......... 2024-12-18T00:21:05.7607056Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7607243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7607523Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1630 counts during 1553 steps 2024-12-18T00:21:05.7607529Z 2024-12-18T00:21:05.7607716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7607820Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7608100Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7608203Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7608402Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7608530Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7608671Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7608828Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7609159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7609491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7609779Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7610040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7610321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7610580Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7610849Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7610976Z Execution Analysis: (:1) 2024-12-18T00:21:05.7611218Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7611406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7611411Z 2024-12-18T00:21:05.7611610Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7611712Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7611935Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7612034Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7612235Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7612367Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7612500Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7612666Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7613236Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7613799Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7614188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7614524Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7614811Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7615070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7615355Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7615602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7615715Z Execution Analysis: .......... 2024-12-18T00:21:05.7615956Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7616157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7616496Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1631 counts during 1554 steps 2024-12-18T00:21:05.7616502Z 2024-12-18T00:21:05.7616700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7616969Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7617260Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7617383Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7617586Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7617743Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7617885Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7618065Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7618422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7618777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7619097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7619368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7619684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7619948Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7620252Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7620379Z Execution Analysis: (:1) 2024-12-18T00:21:05.7620646Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7620847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7620853Z 2024-12-18T00:21:05.7621052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7621175Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7621401Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7621523Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7621733Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7621887Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7622033Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7622226Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7622850Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7623471Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7623840Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7624189Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7624507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7624779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7625099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7625370Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7625474Z Execution Analysis: .......... 2024-12-18T00:21:05.7625742Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7625946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7626243Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1632 counts during 1555 steps 2024-12-18T00:21:05.7626248Z 2024-12-18T00:21:05.7626447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7626571Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7626862Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7626978Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7627183Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7627327Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7627479Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7627648Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7628016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7628368Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7628685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7628954Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7629462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7629719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7629989Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7630113Z Execution Analysis: (:1) 2024-12-18T00:21:05.7630349Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7630547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7630552Z 2024-12-18T00:21:05.7630735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7630849Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7631062Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7631164Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7631362Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7631492Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7631689Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7631840Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7632402Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7632979Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7633314Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7633646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7633932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7634193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7634482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7634738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7634838Z Execution Analysis: .......... 2024-12-18T00:21:05.7635078Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7635275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7635541Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1633 counts during 1556 steps 2024-12-18T00:21:05.7635545Z 2024-12-18T00:21:05.7635743Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7635848Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7636130Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7636232Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7636430Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7636562Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7636693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7636859Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7637186Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7637520Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7637809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7638070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7638352Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7638603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7638881Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7638995Z Execution Analysis: (:1) 2024-12-18T00:21:05.7639241Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7639426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7639430Z 2024-12-18T00:21:05.7639625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7639730Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7639954Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7640055Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7640245Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7640439Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7640575Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7640739Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7641332Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7641872Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7642200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7642526Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7642824Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7643076Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7643372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7643623Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7643732Z Execution Analysis: .......... 2024-12-18T00:21:05.7643967Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7644324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7644767Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1634 counts during 1557 steps 2024-12-18T00:21:05.7644772Z 2024-12-18T00:21:05.7644975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7645097Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7645391Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7645519Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7645721Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7645876Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7646019Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7646184Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7646548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7646895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7647215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7647484Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7647801Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7648067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7648371Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7648498Z Execution Analysis: (:1) 2024-12-18T00:21:05.7648756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7648970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7648975Z 2024-12-18T00:21:05.7649175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7649297Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7649526Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7649644Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7650028Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7650171Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7650372Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7650541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7651173Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7651744Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7652113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7652462Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7652781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7653055Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7653364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7653643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7653752Z Execution Analysis: .......... 2024-12-18T00:21:05.7654020Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7654221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7654517Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1635 counts during 1558 steps 2024-12-18T00:21:05.7654522Z 2024-12-18T00:21:05.7654720Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7654850Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7655142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7655260Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7655469Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7655612Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7655761Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7655927Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7656285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7656724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7657039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7657319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7657629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7657906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7658204Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7658336Z Execution Analysis: (:1) 2024-12-18T00:21:05.7658594Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7658798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7658809Z 2024-12-18T00:21:05.7659009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7659122Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7659387Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7659521Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7659732Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7659901Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7660046Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7660244Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7660834Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7661413Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7661774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7662135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7662452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7662735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7663043Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7663311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7663421Z Execution Analysis: .......... 2024-12-18T00:21:05.7663680Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7663891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7664180Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1636 counts during 1559 steps 2024-12-18T00:21:05.7664185Z 2024-12-18T00:21:05.7664399Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7664514Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7664812Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7664924Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7665131Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7665282Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7665423Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7665594Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7665946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7666303Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7666614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7666887Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7667198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7667468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7667763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7667884Z Execution Analysis: (:1) 2024-12-18T00:21:05.7668148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7668354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7668358Z 2024-12-18T00:21:05.7668565Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7668804Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7669041Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7669147Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7669363Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7669526Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7669665Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7669817Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7670371Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7670898Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7671238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7671563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7671860Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7672117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7672409Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7672658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7672761Z Execution Analysis: .......... 2024-12-18T00:21:05.7673000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7673186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7673460Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1637 counts during 1560 steps 2024-12-18T00:21:05.7673466Z 2024-12-18T00:21:05.7673654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7673768Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7674038Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7674146Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7674335Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7674466Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7674602Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7674759Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7675092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7675419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7675714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7675965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7676250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7676505Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7676771Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7676889Z Execution Analysis: (:1) 2024-12-18T00:21:05.7677128Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7677323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7677327Z 2024-12-18T00:21:05.7677537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7677673Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7678057Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7678190Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7678421Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7678562Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7678711Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7678876Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7679459Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7680018Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7680371Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7680720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7681024Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7681295Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7681597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7681859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7681959Z Execution Analysis: .......... 2024-12-18T00:21:05.7682217Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7682415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7682698Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1638 counts during 1561 steps 2024-12-18T00:21:05.7682702Z 2024-12-18T00:21:05.7682907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7683019Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7683309Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7683418Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7683623Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7683760Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7683898Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7684067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7684414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7684766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7685067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7685340Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7685640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7685904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7686186Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7686304Z Execution Analysis: (:1) 2024-12-18T00:21:05.7686560Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7686758Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7686823Z 2024-12-18T00:21:05.7687027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7687162Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7687390Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7687798Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7688004Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7688152Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7688296Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7688463Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7689041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7689611Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7690054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7690387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7690679Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7690933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7691223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7691473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7691577Z Execution Analysis: .......... 2024-12-18T00:21:05.7691812Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7692010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7692274Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1639 counts during 1562 steps 2024-12-18T00:21:05.7692280Z 2024-12-18T00:21:05.7692472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7692574Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7692839Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7692947Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7693135Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7693269Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7693399Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7693554Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7693891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7694215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7694513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7694768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7695053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7695297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7695572Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7695686Z Execution Analysis: (:1) 2024-12-18T00:21:05.7695922Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7702357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7702372Z 2024-12-18T00:21:05.7702637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7702786Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7703051Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7703169Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7703377Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7703521Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7703671Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7703838Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7704442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7705024Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7705390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7705746Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7706063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7706335Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7706640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7706913Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7707018Z Execution Analysis: .......... 2024-12-18T00:21:05.7707284Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7707489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7707785Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1641 counts during 1563 steps 2024-12-18T00:21:05.7707790Z 2024-12-18T00:21:05.7707992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7708103Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7708398Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7708508Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7708718Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7708860Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7709110Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7709265Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7709593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7709922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7710210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7710462Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7710744Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7710992Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7711262Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7711376Z Execution Analysis: (:1) 2024-12-18T00:21:05.7711638Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7711860Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7711890Z 2024-12-18T00:21:05.7712078Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7712206Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7712423Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7712524Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7712721Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7712851Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7712984Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7713141Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7713689Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7714218Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7714549Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7714872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7715159Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7715414Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7715692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7715938Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7716041Z Execution Analysis: .......... 2024-12-18T00:21:05.7716274Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7716464Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7716728Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1642 counts during 1564 steps 2024-12-18T00:21:05.7716733Z 2024-12-18T00:21:05.7716921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7717024Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7717296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7717396Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7717580Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7717879Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7718017Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7718182Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7718525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7718871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7719169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7719431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7719729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7719985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7720271Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7720415Z Execution Analysis: (:1) 2024-12-18T00:21:05.7720691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7720908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7720913Z 2024-12-18T00:21:05.7721128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7721242Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7721465Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7721573Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7721773Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7721917Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7722055Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7722213Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7722792Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7723348Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7723700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7724038Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7724344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7724608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7724910Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7725170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7725272Z Execution Analysis: .......... 2024-12-18T00:21:05.7725525Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7725724Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7726011Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1643 counts during 1565 steps 2024-12-18T00:21:05.7726016Z 2024-12-18T00:21:05.7726212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7726324Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7726604Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7726713Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7726910Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7727049Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7727189Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7727348Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7727703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7728044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7728350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7728612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7728908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7729169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7729473Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7729623Z Execution Analysis: (:1) 2024-12-18T00:21:05.7729967Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7730204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7730209Z 2024-12-18T00:21:05.7730392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7730500Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7730708Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7730808Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7731006Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7731136Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7731276Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7731429Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7731978Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7732507Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7732835Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7733163Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7733448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7733701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7733983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7734232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7734330Z Execution Analysis: .......... 2024-12-18T00:21:05.7734570Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7734755Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7735020Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1644 counts during 1566 steps 2024-12-18T00:21:05.7735024Z 2024-12-18T00:21:05.7735215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7735319Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7735593Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7735692Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7735885Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7736014Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7736144Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7736297Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7736734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7737251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7737559Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7737835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7738136Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7738443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7738835Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7738957Z Execution Analysis: (:1) 2024-12-18T00:21:05.7739243Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7739468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7739474Z 2024-12-18T00:21:05.7739679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7739788Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7740021Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7740129Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7740333Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7740482Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7740627Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7740795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7741386Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7741959Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7742316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7742669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7742976Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7743248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7743558Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7743824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7743934Z Execution Analysis: .......... 2024-12-18T00:21:05.7744328Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7744534Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7744820Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1645 counts during 1567 steps 2024-12-18T00:21:05.7744824Z 2024-12-18T00:21:05.7745024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7745142Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7745433Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7745551Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7745756Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7745906Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7746046Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7746212Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7746575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7746922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7747235Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7747504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7747869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7748166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7748463Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7748618Z Execution Analysis: (:1) 2024-12-18T00:21:05.7748905Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7749111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7749115Z 2024-12-18T00:21:05.7749315Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7749432Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7749660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7749771Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7749977Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7750119Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7750269Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7750435Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7751032Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7751600Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7751960Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7752307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7752622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7752892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7753194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7753466Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7753569Z Execution Analysis: .......... 2024-12-18T00:21:05.7753828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7754031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7754323Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1646 counts during 1568 steps 2024-12-18T00:21:05.7754328Z 2024-12-18T00:21:05.7754527Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7754645Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7754933Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7755039Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7755245Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7755386Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7755531Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7755695Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7756147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7756472Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7756756Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7757008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7757334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7757585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7757873Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7758013Z Execution Analysis: (:1) 2024-12-18T00:21:05.7758250Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7758434Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7758442Z 2024-12-18T00:21:05.7758624Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7758724Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7758938Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7759039Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7759234Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7759361Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7759494Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7759652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7760196Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7760727Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7761055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7761379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7761665Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7761920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7762201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7762448Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7762548Z Execution Analysis: .......... 2024-12-18T00:21:05.7762784Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7762973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7763235Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1647 counts during 1569 steps 2024-12-18T00:21:05.7763239Z 2024-12-18T00:21:05.7763429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7763534Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7763808Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7763906Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7764092Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7764225Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7764354Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7764510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7764838Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7765164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7765447Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7765743Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7766031Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7766300Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7766599Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7766712Z Execution Analysis: (:1) 2024-12-18T00:21:05.7766951Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7767136Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7767140Z 2024-12-18T00:21:05.7767326Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7767428Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7767642Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7767746Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7767939Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7768073Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7768209Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7768366Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7768909Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7769435Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7769772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7770098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7770389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7770641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7770930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7771173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7771274Z Execution Analysis: .......... 2024-12-18T00:21:05.7771507Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7771691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7771962Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1648 counts during 1570 steps 2024-12-18T00:21:05.7771970Z 2024-12-18T00:21:05.7772153Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7772262Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7772529Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7772636Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7772820Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7772951Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7773085Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7773235Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7773566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7773887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7774203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7774474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7774778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7775051Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7775318Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7775433Z Execution Analysis: (:1) 2024-12-18T00:21:05.7775668Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7775860Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7775864Z 2024-12-18T00:21:05.7776049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7776158Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7776434Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7776540Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7776734Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7777036Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7777191Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7777354Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7777946Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7778514Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7778875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7779225Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7779534Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7779811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7780116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7780387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7780494Z Execution Analysis: .......... 2024-12-18T00:21:05.7780752Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7780951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7781242Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1649 counts during 1571 steps 2024-12-18T00:21:05.7781255Z 2024-12-18T00:21:05.7781456Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7781587Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7781888Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7782004Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7782211Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7782361Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7782509Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7782679Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7783048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7783428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7783767Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7784061Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7784391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7784655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7784946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7785066Z Execution Analysis: (:1) 2024-12-18T00:21:05.7785321Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7785526Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7785530Z 2024-12-18T00:21:05.7785733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7785847Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7786075Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7786187Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7786392Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7786529Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7786689Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7786852Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7787447Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7788020Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7788385Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7788736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7789053Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7789324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7789631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7789903Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7790006Z Execution Analysis: .......... 2024-12-18T00:21:05.7790268Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7790472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7790764Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1650 counts during 1572 steps 2024-12-18T00:21:05.7790771Z 2024-12-18T00:21:05.7790972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7791092Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7791380Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7791486Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7791697Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7791836Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7791979Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7792144Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7792529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7792902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7793207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7793532Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7793837Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7794109Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7794399Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7794526Z Execution Analysis: (:1) 2024-12-18T00:21:05.7794784Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7794993Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7794999Z 2024-12-18T00:21:05.7795202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7795313Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7795545Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7795652Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7795863Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7796004Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7796152Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7796317Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7797023Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7797875Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7798224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7798741Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7799052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7799331Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7799635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7799903Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7800008Z Execution Analysis: .......... 2024-12-18T00:21:05.7800264Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7800472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7800759Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1651 counts during 1573 steps 2024-12-18T00:21:05.7800763Z 2024-12-18T00:21:05.7800967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7801076Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7801369Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7801477Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7801679Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7801824Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7801963Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7802131Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7802537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7802889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7803257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7803528Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7803845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7804106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7804398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7804523Z Execution Analysis: (:1) 2024-12-18T00:21:05.7804786Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7804992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7804996Z 2024-12-18T00:21:05.7805201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7805312Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7805537Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7805649Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7805853Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7806001Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7806145Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7806313Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7806906Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7807479Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7807844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7808193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7808508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7808780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7809091Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7809354Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7809460Z Execution Analysis: .......... 2024-12-18T00:21:05.7809720Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7810021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7810309Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1652 counts during 1574 steps 2024-12-18T00:21:05.7810313Z 2024-12-18T00:21:05.7810505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7810723Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7810990Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7811096Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7811284Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7811420Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7811577Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7811756Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7812092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7812440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7812754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7813007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7813293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7813540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7813806Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7813927Z Execution Analysis: (:1) 2024-12-18T00:21:05.7814167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7814357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7814363Z 2024-12-18T00:21:05.7814549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7814658Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7814868Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7814967Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7815169Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7815301Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7815443Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7815594Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7816146Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7816930Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7817303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7817655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7818000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7818280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7818590Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7818866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7818974Z Execution Analysis: .......... 2024-12-18T00:21:05.7819233Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7819437Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7819733Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1653 counts during 1575 steps 2024-12-18T00:21:05.7819738Z 2024-12-18T00:21:05.7819936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7820047Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7820344Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7820453Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7820661Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7820831Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7821001Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7821165Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7821541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7821919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7822229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7822504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7822810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7823081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7823373Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7823495Z Execution Analysis: (:1) 2024-12-18T00:21:05.7823756Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7823959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7823965Z 2024-12-18T00:21:05.7824172Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7824285Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7824519Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7824627Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7824835Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7824974Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7825115Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7825290Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7825877Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7826457Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7826816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7827171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7827481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7827748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7828060Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7828325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7828434Z Execution Analysis: .......... 2024-12-18T00:21:05.7828691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7828897Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7829392Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1654 counts during 1576 steps 2024-12-18T00:21:05.7829396Z 2024-12-18T00:21:05.7829583Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7829687Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7829955Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7830059Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7830270Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7830429Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7830557Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7830737Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7831087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7831411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7831706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7831956Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7832242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7832487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7832764Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7832877Z Execution Analysis: (:1) 2024-12-18T00:21:05.7833122Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7833312Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7833316Z 2024-12-18T00:21:05.7833500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7833609Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7833822Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7833929Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7834121Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7834256Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7834394Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7834545Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7835099Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7835629Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7835967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7836290Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7836581Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7836832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7837131Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7837377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7837475Z Execution Analysis: .......... 2024-12-18T00:21:05.7837721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7837909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7838182Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1655 counts during 1577 steps 2024-12-18T00:21:05.7838187Z 2024-12-18T00:21:05.7838371Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7838480Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7838746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7838905Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7839103Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7839239Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7839400Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7839575Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7839910Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7840236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7840520Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7840775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7841055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7841311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7841578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7841699Z Execution Analysis: (:1) 2024-12-18T00:21:05.7841937Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7842128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7842131Z 2024-12-18T00:21:05.7842317Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7842420Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7842638Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7842737Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7842936Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7843066Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7843200Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7843355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7843897Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7844745Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7845105Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7845460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7845769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7846051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7846363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7846634Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7846738Z Execution Analysis: .......... 2024-12-18T00:21:05.7846991Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7847198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7847483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1656 counts during 1578 steps 2024-12-18T00:21:05.7847488Z 2024-12-18T00:21:05.7847692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7847806Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7848150Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7848292Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7848497Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7848670Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7848838Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7849011Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7849364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7849714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7850024Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7850298Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7850608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7850875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7851172Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7851295Z Execution Analysis: (:1) 2024-12-18T00:21:05.7851557Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7851758Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7851762Z 2024-12-18T00:21:05.7851967Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7852077Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7852307Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7852417Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7852624Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7852771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7852920Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7853090Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7853681Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7854256Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7854613Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7854961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7855278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7855553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7855866Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7856134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7856243Z Execution Analysis: .......... 2024-12-18T00:21:05.7856569Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7856780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7857071Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1657 counts during 1579 steps 2024-12-18T00:21:05.7857076Z 2024-12-18T00:21:05.7857274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7857448Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7857740Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7857886Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7858090Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7858267Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7858405Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7858567Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7858932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7859278Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7859594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7859866Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7860176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7860445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7860737Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7860868Z Execution Analysis: (:1) 2024-12-18T00:21:05.7861122Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7861324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7861328Z 2024-12-18T00:21:05.7861529Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7861648Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7861880Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7861994Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7862201Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7862343Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7862493Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7862660Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7863256Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7863828Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7864190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7864540Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7864849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7865130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7865440Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7865707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7865810Z Execution Analysis: .......... 2024-12-18T00:21:05.7866074Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7866277Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7866567Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1658 counts during 1580 steps 2024-12-18T00:21:05.7866571Z 2024-12-18T00:21:05.7866795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7866930Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7867247Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7867358Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7867586Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7867728Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7867870Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7868034Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7868390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7868847Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7869147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7869419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7869714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7869979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7870262Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7870388Z Execution Analysis: (:1) 2024-12-18T00:21:05.7870636Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7870831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7870835Z 2024-12-18T00:21:05.7871035Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7871251Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7871469Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7871570Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7871768Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7871900Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7872033Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7872193Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7872922Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7873650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7874009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7874361Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7874673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7874953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7875259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7875521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7875635Z Execution Analysis: .......... 2024-12-18T00:21:05.7875887Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7876097Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7876423Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1659 counts during 1581 steps 2024-12-18T00:21:05.7876451Z 2024-12-18T00:21:05.7876658Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7876797Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7877118Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7877227Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7877430Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7877582Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7877721Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7877892Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7878248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7878609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7878921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7879193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7879510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7879778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7880077Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7880199Z Execution Analysis: (:1) 2024-12-18T00:21:05.7880464Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7880667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7880671Z 2024-12-18T00:21:05.7880874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7880992Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7881223Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7881342Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7881552Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7881700Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7881845Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7882010Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7882607Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7883180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7883547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7883900Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7884220Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7884495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7884809Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7885074Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7885180Z Execution Analysis: .......... 2024-12-18T00:21:05.7885443Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7885743Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7886063Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1660 counts during 1582 steps 2024-12-18T00:21:05.7886068Z 2024-12-18T00:21:05.7886296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7886416Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7886729Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7886849Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7887157Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7887293Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7887431Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7887590Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7887942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7888381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7888673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7888924Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7889209Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7889459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7889728Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7889845Z Execution Analysis: (:1) 2024-12-18T00:21:05.7890082Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7890282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7890288Z 2024-12-18T00:21:05.7890470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7890583Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7890795Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7890896Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7891090Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7891222Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7891359Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7891514Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7892069Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7892599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7892931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7893260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7893549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7893803Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7894086Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7894336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7894432Z Execution Analysis: .......... 2024-12-18T00:21:05.7894674Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7894906Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7895172Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1662 counts during 1583 steps 2024-12-18T00:21:05.7895198Z 2024-12-18T00:21:05.7895411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7895516Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7895790Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7895888Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7896081Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7896210Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7896408Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7896575Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7897080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7897439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7897751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7898035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7898343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7898610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7898907Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7899031Z Execution Analysis: (:1) 2024-12-18T00:21:05.7899295Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7899505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7899509Z 2024-12-18T00:21:05.7899722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7899838Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7900075Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7900183Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7900391Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7900541Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7900689Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7900860Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7901451Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7902036Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7902392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7902751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7903059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7903329Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7903642Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7903909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7904020Z Execution Analysis: .......... 2024-12-18T00:21:05.7904302Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7904537Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7904850Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1663 counts during 1584 steps 2024-12-18T00:21:05.7904855Z 2024-12-18T00:21:05.7905095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7905214Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7905507Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7905622Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7905825Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7905975Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7906115Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7906285Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7906649Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7907001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7907320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7907595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7907906Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7908172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7908470Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7908599Z Execution Analysis: (:1) 2024-12-18T00:21:05.7908857Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7909167Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7909173Z 2024-12-18T00:21:05.7909360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7909472Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7909686Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7909792Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7909983Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7910115Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7910253Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7910407Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7910963Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7911496Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7911839Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7912162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7912453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7912704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7912988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7913238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7913382Z Execution Analysis: .......... 2024-12-18T00:21:05.7913626Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7913835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7914131Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1664 counts during 1585 steps 2024-12-18T00:21:05.7914136Z 2024-12-18T00:21:05.7914321Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7914433Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7914701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7914801Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7914995Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7915128Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7915267Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7915422Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7915753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7916082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7916367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7916619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7916898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7917146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7917417Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7917539Z Execution Analysis: (:1) 2024-12-18T00:21:05.7917945Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7918140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7918151Z 2024-12-18T00:21:05.7918348Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7918460Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7918686Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7918792Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7918998Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7919137Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7919278Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7919454Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7920032Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7920596Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7920947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7921293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7921596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7921868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7922165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7922475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7922584Z Execution Analysis: .......... 2024-12-18T00:21:05.7922834Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7923087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7923369Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1665 counts during 1586 steps 2024-12-18T00:21:05.7923374Z 2024-12-18T00:21:05.7923574Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7923684Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7923974Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7924081Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7924280Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7924428Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7924569Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7924741Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7925091Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7925433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7925737Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7926003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7926310Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7926571Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7926862Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7926984Z Execution Analysis: (:1) 2024-12-18T00:21:05.7927238Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7927439Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7927444Z 2024-12-18T00:21:05.7927645Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7927755Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7927979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7928091Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7928292Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7928434Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7928579Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7928749Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7929323Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7929976Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7930311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7930635Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7930931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7931179Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7931664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7931946Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7932079Z Execution Analysis: .......... 2024-12-18T00:21:05.7932352Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7932549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7932835Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1666 counts during 1587 steps 2024-12-18T00:21:05.7932840Z 2024-12-18T00:21:05.7933036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7933155Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7933435Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7933548Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7933750Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7933888Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7934030Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7934193Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7934545Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7934886Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7935196Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7935463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7935758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7936020Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7936303Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7936519Z Execution Analysis: (:1) 2024-12-18T00:21:05.7936935Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7937141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7937145Z 2024-12-18T00:21:05.7937345Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7937463Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7937694Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7937805Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7938016Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7938161Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7938314Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7938479Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7939081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7939653Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7940017Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7940365Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7940677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7940980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7941316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7941625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7941731Z Execution Analysis: .......... 2024-12-18T00:21:05.7942014Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7942216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7942506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1667 counts during 1588 steps 2024-12-18T00:21:05.7942516Z 2024-12-18T00:21:05.7942718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7942832Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7943129Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7943240Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7943454Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7943599Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7943740Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7943916Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7944400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7944757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7945070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7945351Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7945659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7945936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7946227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7946356Z Execution Analysis: (:1) 2024-12-18T00:21:05.7946623Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7946825Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7946830Z 2024-12-18T00:21:05.7947038Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7947152Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7947387Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7947498Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7947707Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7947861Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7948006Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7948178Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7948768Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7949343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7949702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7950056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7950413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7950719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7951033Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7951369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7951485Z Execution Analysis: .......... 2024-12-18T00:21:05.7951742Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7951953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7952246Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1668 counts during 1589 steps 2024-12-18T00:21:05.7952251Z 2024-12-18T00:21:05.7952457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7952571Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7952860Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7952976Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7953180Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7953332Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7953474Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7953645Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7954000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7954349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7954663Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7954932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7955248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7955513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7955813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7955936Z Execution Analysis: (:1) 2024-12-18T00:21:05.7956285Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7956474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7956478Z 2024-12-18T00:21:05.7956662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7956772Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7956985Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7957099Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7957289Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7957422Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7957562Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7957718Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7958271Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7958797Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7959132Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7959484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7959801Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7960052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7960384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7960634Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7960728Z Execution Analysis: .......... 2024-12-18T00:21:05.7960970Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7961153Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7961425Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1669 counts during 1590 steps 2024-12-18T00:21:05.7961429Z 2024-12-18T00:21:05.7961619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7961731Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7962000Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7962107Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7962298Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7962429Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7962566Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7962722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7963060Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7963380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7963667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7963935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7964220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7964479Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7964752Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7964879Z Execution Analysis: (:1) 2024-12-18T00:21:05.7965119Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7965318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7965322Z 2024-12-18T00:21:05.7965510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7965616Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7965841Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7965947Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7966152Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7966287Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7966434Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7966591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7967137Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7967673Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7968005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7968384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7968674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7968958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7969270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7969529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7969628Z Execution Analysis: .......... 2024-12-18T00:21:05.7969865Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7970058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7970329Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1670 counts during 1591 steps 2024-12-18T00:21:05.7970336Z 2024-12-18T00:21:05.7970531Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7970638Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7970920Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7971025Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7971216Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7971362Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7971494Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7971650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7971982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7972311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7972603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7972854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7973148Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7973397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7973668Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7973784Z Execution Analysis: (:1) 2024-12-18T00:21:05.7974033Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7974222Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7974226Z 2024-12-18T00:21:05.7974426Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7974534Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7974749Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7974860Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7975050Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7975189Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7975323Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7975487Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7976028Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7976632Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7977180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7977570Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7977913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7978208Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7978526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7978790Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7978903Z Execution Analysis: .......... 2024-12-18T00:21:05.7979161Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7979360Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7979663Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1671 counts during 1592 steps 2024-12-18T00:21:05.7979668Z 2024-12-18T00:21:05.7979868Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7979989Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7980281Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7980400Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7980600Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7980750Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7980891Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7981056Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7981425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7981776Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7982095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7982369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7982683Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7982951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7983241Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7983373Z Execution Analysis: (:1) 2024-12-18T00:21:05.7983633Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7983843Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7983850Z 2024-12-18T00:21:05.7984050Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7984174Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7984403Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7984511Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7984730Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7984873Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7985024Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7985186Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7985791Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7986391Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7986787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7987167Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7987499Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7987782Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7988087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7988364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7988469Z Execution Analysis: .......... 2024-12-18T00:21:05.7988738Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7988943Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7989242Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1672 counts during 1593 steps 2024-12-18T00:21:05.7989248Z 2024-12-18T00:21:05.7989447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7989562Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7989859Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7989969Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7990181Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7990322Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.7990471Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.7990640Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7990999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.7991357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7991671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7991952Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7992259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7992535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7992823Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.7992948Z Execution Analysis: (:1) 2024-12-18T00:21:05.7993213Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7993417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7993423Z 2024-12-18T00:21:05.7993629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7993743Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7993977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.7994087Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7994304Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.7994451Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.7994597Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.7994770Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.7995355Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.7995966Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.7996350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.7996755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.7997068Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.7997337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.7997653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.7997918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.7998034Z Execution Analysis: .......... 2024-12-18T00:21:05.7998293Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.7998507Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7998904Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1673 counts during 1594 steps 2024-12-18T00:21:05.7998909Z 2024-12-18T00:21:05.7999115Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.7999226Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.7999505Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.7999624Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.7999819Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.7999966Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8000105Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8000274Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8000624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8000965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8001279Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8001546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8001852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8002115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8002408Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8002530Z Execution Analysis: (:1) 2024-12-18T00:21:05.8002790Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8002988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8002994Z 2024-12-18T00:21:05.8003186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8003304Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8003531Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8003644Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8003848Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8003993Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8004135Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8004299Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8004901Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8005483Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8005887Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8006232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8006545Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8006907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8007200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8007447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8007547Z Execution Analysis: .......... 2024-12-18T00:21:05.8007791Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8007981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8008257Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1674 counts during 1595 steps 2024-12-18T00:21:05.8008261Z 2024-12-18T00:21:05.8008446Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8008559Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8008826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8008932Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8009126Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8009258Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8009404Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8009561Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8009898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8010224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8010517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8010782Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8011065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8011321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8011591Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8011716Z Execution Analysis: (:1) 2024-12-18T00:21:05.8011961Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8012160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8012166Z 2024-12-18T00:21:05.8012357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8012462Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8012685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8012791Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8012991Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8013124Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8013264Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8013419Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8013998Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8014561Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8014947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8015280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8015568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8015825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8016107Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8016427Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8016529Z Execution Analysis: .......... 2024-12-18T00:21:05.8016929Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8017144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8017430Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1675 counts during 1596 steps 2024-12-18T00:21:05.8017436Z 2024-12-18T00:21:05.8017644Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8017762Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8018072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8018187Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8018396Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8018541Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8018686Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8018856Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8019213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8019570Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8019881Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8020158Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8020463Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8020729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8021028Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8021153Z Execution Analysis: (:1) 2024-12-18T00:21:05.8021421Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8021628Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8021634Z 2024-12-18T00:21:05.8021841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8021952Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8022187Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8022295Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8022502Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8022651Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8022799Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8023023Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8023614Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8024316Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8024678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8025033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8025349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8025623Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8025940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8026212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8026328Z Execution Analysis: .......... 2024-12-18T00:21:05.8026587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8026800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8027088Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1676 counts during 1597 steps 2024-12-18T00:21:05.8027092Z 2024-12-18T00:21:05.8027292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8027410Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8027701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8027819Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8028024Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8028176Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8028317Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8028483Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8028847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8029407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8029699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8029952Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8030241Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8030488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8030763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8030885Z Execution Analysis: (:1) 2024-12-18T00:21:05.8031126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8031326Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8031330Z 2024-12-18T00:21:05.8031516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8031629Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8031846Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8031954Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8032144Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8032278Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8032466Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8032621Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8033200Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8033752Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8034094Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8034419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8034711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8034963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8035248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8035500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8035600Z Execution Analysis: .......... 2024-12-18T00:21:05.8035845Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8036034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8036311Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1677 counts during 1598 steps 2024-12-18T00:21:05.8036315Z 2024-12-18T00:21:05.8036501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8036608Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8036883Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8036989Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8037185Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8037317Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8037458Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8037612Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8037941Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8038269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8038558Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8038816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8039267Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8039540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8039823Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8039954Z Execution Analysis: (:1) 2024-12-18T00:21:05.8040209Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8040408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8040412Z 2024-12-18T00:21:05.8040614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8040725Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8040953Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8041060Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8041291Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8041455Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8041597Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8041790Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8042407Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8042970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8043316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8043664Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8043968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8044398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8044869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8045138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8045257Z Execution Analysis: .......... 2024-12-18T00:21:05.8045514Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8045723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8046017Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1678 counts during 1599 steps 2024-12-18T00:21:05.8046022Z 2024-12-18T00:21:05.8046230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8046346Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8046650Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8046759Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8046968Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8047119Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8047263Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8047438Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8047794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8048145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8048464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8048735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8049047Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8049311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8049611Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8049736Z Execution Analysis: (:1) 2024-12-18T00:21:05.8050000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8050201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8050206Z 2024-12-18T00:21:05.8050408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8050529Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8050760Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8050926Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8051168Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8051324Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8051502Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8051668Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8052292Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8052868Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8053236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8053585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8053910Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8054184Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8054501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8054772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8054879Z Execution Analysis: .......... 2024-12-18T00:21:05.8055147Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8055346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8055647Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1679 counts during 1600 steps 2024-12-18T00:21:05.8055652Z 2024-12-18T00:21:05.8055853Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8055977Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8056265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8056463Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8056667Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8056810Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8056961Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8057125Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8057488Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8057834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8058154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8058428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8058737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8059015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8059305Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8059437Z Execution Analysis: (:1) 2024-12-18T00:21:05.8059691Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8059899Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8059904Z 2024-12-18T00:21:05.8060102Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8060226Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8060484Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8060619Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8060836Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8061002Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8061188Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8061352Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8061946Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8062516Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8062870Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8063231Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8063542Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8063826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8064130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8064402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8064506Z Execution Analysis: .......... 2024-12-18T00:21:05.8064765Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8064965Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8065251Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1680 counts during 1601 steps 2024-12-18T00:21:05.8065256Z 2024-12-18T00:21:05.8065468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8065577Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8065878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8065986Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8066195Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8066338Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8066474Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8066647Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8067000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8067357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8067666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8067946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8068253Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8068521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8068820Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8068943Z Execution Analysis: (:1) 2024-12-18T00:21:05.8069205Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8069405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8069409Z 2024-12-18T00:21:05.8069614Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8069777Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8070016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8070123Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8070355Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8070528Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8070675Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8070849Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8071441Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8072019Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8072380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8072737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8073047Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8073322Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8073635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8073902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8074013Z Execution Analysis: .......... 2024-12-18T00:21:05.8074271Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8074481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8074771Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1681 counts during 1602 steps 2024-12-18T00:21:05.8074778Z 2024-12-18T00:21:05.8074980Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8075101Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8075397Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8075511Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8075715Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8075867Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8076007Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8076172Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8076535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8076885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8077201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8077475Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8077785Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8078054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8078350Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8078473Z Execution Analysis: (:1) 2024-12-18T00:21:05.8078730Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8078938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8078942Z 2024-12-18T00:21:05.8079169Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8079313Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8079546Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8079697Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8080033Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8080176Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8080324Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8080491Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8081076Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8081633Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8081991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8082331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8082646Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8082913Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8083211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8083475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8083580Z Execution Analysis: .......... 2024-12-18T00:21:05.8083831Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8084029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8084318Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1683 counts during 1603 steps 2024-12-18T00:21:05.8084322Z 2024-12-18T00:21:05.8084686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8084806Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8085095Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8085203Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8085414Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8085556Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8085703Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8085869Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8086232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8086585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8086901Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8087180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8087489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8087762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8088055Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8088184Z Execution Analysis: (:1) 2024-12-18T00:21:05.8088438Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8088663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8088699Z 2024-12-18T00:21:05.8088895Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8089035Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8089265Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8089396Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8089613Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8089753Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8089899Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8090072Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8090662Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8091240Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8091601Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8091960Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8092274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8092549Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8092853Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8093119Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8093229Z Execution Analysis: .......... 2024-12-18T00:21:05.8093593Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8098411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8098765Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1684 counts during 1604 steps 2024-12-18T00:21:05.8098776Z 2024-12-18T00:21:05.8098994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8099109Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8099400Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8099518Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8099724Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8099873Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8100013Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8100184Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8100551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8100905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8101224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8101503Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8101814Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8102084Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8102378Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8102502Z Execution Analysis: (:1) 2024-12-18T00:21:05.8102765Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8103066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8103072Z 2024-12-18T00:21:05.8103274Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8103419Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8103677Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8103791Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8104000Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8104146Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8104292Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8104458Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8105063Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8105641Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8106011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8106363Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8106681Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8106953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8107261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8107527Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8107630Z Execution Analysis: .......... 2024-12-18T00:21:05.8107900Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8108104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8108399Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1685 counts during 1605 steps 2024-12-18T00:21:05.8108406Z 2024-12-18T00:21:05.8108608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8108725Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8109118Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8109231Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8109427Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8109563Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8109704Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8109869Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8110315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8110639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8110929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8111178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8111460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8111709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8111974Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8112090Z Execution Analysis: (:1) 2024-12-18T00:21:05.8112349Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8112563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8112591Z 2024-12-18T00:21:05.8112800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8112907Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8113121Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8113219Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8113412Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8113541Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8113680Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8113831Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8114377Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8114913Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8115246Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8115572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8115857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8116111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8116391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8116639Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8116737Z Execution Analysis: .......... 2024-12-18T00:21:05.8116973Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8117167Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8117431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1686 counts during 1606 steps 2024-12-18T00:21:05.8117436Z 2024-12-18T00:21:05.8117625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8117893Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8118180Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8118286Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8118487Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8118624Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8118764Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8118929Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8119271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8119621Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8119921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8120191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8120487Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8120747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8121032Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8121220Z Execution Analysis: (:1) 2024-12-18T00:21:05.8121476Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8121696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8121700Z 2024-12-18T00:21:05.8121922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8122032Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8122258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8122362Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8122563Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8122706Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8122846Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8123017Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8123591Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8124157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8124505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8124843Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8125149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8125413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8125713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8125977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8126081Z Execution Analysis: .......... 2024-12-18T00:21:05.8126334Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8126535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8126813Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1687 counts during 1607 steps 2024-12-18T00:21:05.8126818Z 2024-12-18T00:21:05.8127012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8127128Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8127410Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8127521Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8127721Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8127864Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8127999Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8128163Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8128511Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8128851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8129156Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8129420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8129827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8130069Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8130361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8130504Z Execution Analysis: (:1) 2024-12-18T00:21:05.8130743Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8130983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8130988Z 2024-12-18T00:21:05.8131336Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8131449Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8131673Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8131779Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8131977Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8132114Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8132261Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8132421Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8132999Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8133557Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8133911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8134250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8134554Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8134816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8135113Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8135377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8135478Z Execution Analysis: .......... 2024-12-18T00:21:05.8135730Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8135923Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8136210Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1688 counts during 1608 steps 2024-12-18T00:21:05.8136215Z 2024-12-18T00:21:05.8136512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8136623Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8137075Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8137187Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8137397Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8137537Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8137683Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8137846Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8138201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8138554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8138861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8139133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8139436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8139733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8140046Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8140199Z Execution Analysis: (:1) 2024-12-18T00:21:05.8140477Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8140680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8140684Z 2024-12-18T00:21:05.8140888Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8140999Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8141232Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8141339Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8141547Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8141693Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8141839Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8142008Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8142600Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8143175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8143532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8143884Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8144352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8144635Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8144943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8145210Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8145322Z Execution Analysis: .......... 2024-12-18T00:21:05.8145581Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8145788Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8146074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1689 counts during 1609 steps 2024-12-18T00:21:05.8146079Z 2024-12-18T00:21:05.8146284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8146396Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8146694Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8146808Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8147009Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8147157Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8147300Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8147471Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8147826Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8148179Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8148486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8148753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8149121Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8149428Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8149720Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8149876Z Execution Analysis: (:1) 2024-12-18T00:21:05.8150172Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8150373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8150378Z 2024-12-18T00:21:05.8150580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8150691Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8150918Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8151029Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8151236Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8151384Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8151528Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8151695Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8152287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8152856Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8153220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8153567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8153880Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8154151Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8154461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8154727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8154827Z Execution Analysis: .......... 2024-12-18T00:21:05.8155085Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8155285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8155577Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1690 counts during 1610 steps 2024-12-18T00:21:05.8155581Z 2024-12-18T00:21:05.8155778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8155898Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8156290Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8156400Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8156596Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8156736Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8156876Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8157033Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8157381Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8157717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8158021Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8158332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8158655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8158914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8159248Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8159376Z Execution Analysis: (:1) 2024-12-18T00:21:05.8159623Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8159819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8159824Z 2024-12-18T00:21:05.8160014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8160126Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8160347Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8160452Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8160655Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8160794Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8160939Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8161099Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8161670Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8162222Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8162570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8162916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8163216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8163483Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8163782Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8164042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8164144Z Execution Analysis: .......... 2024-12-18T00:21:05.8164395Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8164588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8164866Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1691 counts during 1611 steps 2024-12-18T00:21:05.8164871Z 2024-12-18T00:21:05.8165072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8165182Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8165470Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8165574Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8165778Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8165915Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8166051Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8166217Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8166561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8166999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8167282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8167886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8168168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8168441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8168737Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8168852Z Execution Analysis: (:1) 2024-12-18T00:21:05.8169096Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8169279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8169283Z 2024-12-18T00:21:05.8169471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8169575Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8169791Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8169893Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8170086Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8170223Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8170359Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8170516Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8171061Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8171590Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8171915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8172246Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8172531Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8172784Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8173070Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8173313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8173414Z Execution Analysis: .......... 2024-12-18T00:21:05.8173652Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8173842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8174105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1692 counts during 1612 steps 2024-12-18T00:21:05.8174112Z 2024-12-18T00:21:05.8174299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8174407Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8174673Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8174783Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8174971Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8175106Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8175234Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8175386Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8175714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8176034Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8176451Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8176711Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8177285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8177575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8177871Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8177991Z Execution Analysis: (:1) 2024-12-18T00:21:05.8178243Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8178452Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8178457Z 2024-12-18T00:21:05.8178658Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8178773Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8178998Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8179109Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8179317Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8179455Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8179602Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8179764Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8180355Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8180923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8181284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8181633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8181949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8182220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8182526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8182797Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8182898Z Execution Analysis: .......... 2024-12-18T00:21:05.8183159Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8183359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8183657Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1693 counts during 1613 steps 2024-12-18T00:21:05.8183662Z 2024-12-18T00:21:05.8183859Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8183977Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8184265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8184372Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8184579Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8184718Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8184860Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8185023Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8185383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8185751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8186084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8186390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8186730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8187003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8187291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8187418Z Execution Analysis: (:1) 2024-12-18T00:21:05.8187673Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8187873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8187888Z 2024-12-18T00:21:05.8188090Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8188200Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8188435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8188545Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8188755Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8188896Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8189149Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8189315Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8189887Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8190454Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8190802Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8191149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8191453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8191725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8192023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8192281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8192396Z Execution Analysis: .......... 2024-12-18T00:21:05.8192649Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8192852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8193132Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1694 counts during 1614 steps 2024-12-18T00:21:05.8193138Z 2024-12-18T00:21:05.8193338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8193451Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8193736Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8193839Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8194141Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8194277Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8194408Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8194570Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8194920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8195270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8195577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8195850Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8196136Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8196383Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8196658Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8196770Z Execution Analysis: (:1) 2024-12-18T00:21:05.8197011Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8197199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8197205Z 2024-12-18T00:21:05.8197393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8197495Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8197706Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8197812Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8197999Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8198136Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8198270Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8198432Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8198971Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8199499Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8199833Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8200157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8200454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8200704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8200992Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8201238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8201338Z Execution Analysis: .......... 2024-12-18T00:21:05.8201573Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8201760Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8202028Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1695 counts during 1615 steps 2024-12-18T00:21:05.8202032Z 2024-12-18T00:21:05.8202220Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8202328Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8202594Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8202700Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8202886Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8203015Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8203149Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8203323Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8203678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8204001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8204336Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8204585Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8204864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8205112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8205378Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8205494Z Execution Analysis: (:1) 2024-12-18T00:21:05.8205731Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8205925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8205930Z 2024-12-18T00:21:05.8206114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8206224Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8206431Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8206530Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8206725Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8206855Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8206996Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8207147Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8207699Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8208227Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8208565Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8208886Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8209172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8209432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8209713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8209962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8210059Z Execution Analysis: .......... 2024-12-18T00:21:05.8210302Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8210489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8210757Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1696 counts during 1616 steps 2024-12-18T00:21:05.8210769Z 2024-12-18T00:21:05.8210951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8211053Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8211327Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8211427Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8211617Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8211747Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8211900Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8212082Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8212412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8212786Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8213072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8213326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8213608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8213857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8214121Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8214238Z Execution Analysis: (:1) 2024-12-18T00:21:05.8214478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8214663Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8214669Z 2024-12-18T00:21:05.8214863Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8214963Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8215180Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8215277Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8215469Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8215605Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8215742Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8215901Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8216524Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8217251Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8217613Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8217967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8218276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8218546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8218856Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8219123Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8219234Z Execution Analysis: .......... 2024-12-18T00:21:05.8219489Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8219701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8219987Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1697 counts during 1617 steps 2024-12-18T00:21:05.8219992Z 2024-12-18T00:21:05.8220203Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8220313Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8220607Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8220726Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8220926Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8221128Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8221269Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8221439Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8221830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8222202Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8222520Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8222791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8223102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8223364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8223659Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8223783Z Execution Analysis: (:1) 2024-12-18T00:21:05.8224039Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8224250Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8224254Z 2024-12-18T00:21:05.8224454Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8224574Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8224803Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8224916Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8225121Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8225267Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8225409Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8225575Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8226172Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8226746Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8227106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8227453Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8227764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8228034Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8228342Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8228614Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8228717Z Execution Analysis: .......... 2024-12-18T00:21:05.8229086Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8229389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8229663Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1698 counts during 1618 steps 2024-12-18T00:21:05.8229667Z 2024-12-18T00:21:05.8229852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8229963Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8230231Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8230333Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8230575Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8230709Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8230844Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8231021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8231375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8231696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8231983Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8232238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8232521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8232778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8233047Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8233166Z Execution Analysis: (:1) 2024-12-18T00:21:05.8233405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8233599Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8233604Z 2024-12-18T00:21:05.8233786Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8233891Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8234116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8234219Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8234414Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8234545Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8234689Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8234842Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8235389Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8235927Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8236256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8236584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8236871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8237130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8237414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8237668Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8237765Z Execution Analysis: .......... 2024-12-18T00:21:05.8238001Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8238194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8238459Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1699 counts during 1619 steps 2024-12-18T00:21:05.8238464Z 2024-12-18T00:21:05.8238654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8238754Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8239053Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8239177Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8239366Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8239524Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8239652Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8239833Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8240160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8240486Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8240771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8241023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8241303Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8241555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8241831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8242109Z Execution Analysis: (:1) 2024-12-18T00:21:05.8242364Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8242558Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8242562Z 2024-12-18T00:21:05.8242762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8242869Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8243091Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8243201Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8243402Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8243715Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8243859Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8244037Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8244775Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8245382Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8245759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8246125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8246438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8246718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8247023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8247292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8247409Z Execution Analysis: .......... 2024-12-18T00:21:05.8247668Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8247951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8248249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1700 counts during 1620 steps 2024-12-18T00:21:05.8248254Z 2024-12-18T00:21:05.8248466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8248595Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8248982Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8249097Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8249339Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8249484Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8249663Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8249832Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8250197Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8250547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8250866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8251136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8251446Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8251719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8252009Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8252144Z Execution Analysis: (:1) 2024-12-18T00:21:05.8252397Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8252608Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8252612Z 2024-12-18T00:21:05.8252810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8252922Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8253157Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8253267Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8253481Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8253624Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8253781Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8253945Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8254532Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8255109Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8255467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8255826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8256136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8256476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8256794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8257067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8257170Z Execution Analysis: .......... 2024-12-18T00:21:05.8257430Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8257639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8257929Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1701 counts during 1621 steps 2024-12-18T00:21:05.8257934Z 2024-12-18T00:21:05.8258176Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8258327Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8258623Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8258760Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8258970Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8259135Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8259277Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8259448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8259805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8260160Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8260468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8260747Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8261053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8261318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8261614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8261736Z Execution Analysis: (:1) 2024-12-18T00:21:05.8261998Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8262198Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8262203Z 2024-12-18T00:21:05.8262406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8262517Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8262756Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8262864Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8263071Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8263219Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8263365Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8263534Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8264120Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8264698Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8265055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8265404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8265721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8265997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8266309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8266576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8266687Z Execution Analysis: .......... 2024-12-18T00:21:05.8266942Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8267148Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8267434Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1702 counts during 1622 steps 2024-12-18T00:21:05.8267438Z 2024-12-18T00:21:05.8267692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8267814Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8268127Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8268239Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8268465Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8268616Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8268864Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8269027Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8269376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8269814Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8270109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8270361Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8270653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8270900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8271168Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8271292Z Execution Analysis: (:1) 2024-12-18T00:21:05.8271529Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8271723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8271727Z 2024-12-18T00:21:05.8271913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8272032Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8272245Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8272356Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8272544Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8272677Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8272826Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8272980Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8273534Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8274062Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8274406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8274730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8275031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8275280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8275563Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8275817Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8275916Z Execution Analysis: .......... 2024-12-18T00:21:05.8276164Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8276350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8276646Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1704 counts during 1623 steps 2024-12-18T00:21:05.8276673Z 2024-12-18T00:21:05.8276861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8276988Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8277291Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8277391Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8277587Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8277719Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8277867Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8278021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8278351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8278684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8278976Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8279237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8279525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8279781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8280048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8280170Z Execution Analysis: (:1) 2024-12-18T00:21:05.8280408Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8280597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8280601Z 2024-12-18T00:21:05.8280799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8280901Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8281120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8281221Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8281422Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8281550Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8281683Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8281840Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8282385Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8282920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8283252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8283584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8283874Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8284133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8284414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8284661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8284766Z Execution Analysis: .......... 2024-12-18T00:21:05.8285000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8285223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8285511Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1705 counts during 1624 steps 2024-12-18T00:21:05.8285515Z 2024-12-18T00:21:05.8285735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8285859Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8286134Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8286235Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8286424Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8286564Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8286693Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8286859Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8287185Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8287523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8287805Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8288057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8288343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8288587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8288866Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8288980Z Execution Analysis: (:1) 2024-12-18T00:21:05.8289227Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8289416Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8289422Z 2024-12-18T00:21:05.8289615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8289716Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8289929Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8290041Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8290229Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8290368Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8290502Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8290652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8291200Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8291731Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8292069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8292396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8292692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8292942Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8293237Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8293485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8293583Z Execution Analysis: .......... 2024-12-18T00:21:05.8293868Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8294082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8294360Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1706 counts during 1625 steps 2024-12-18T00:21:05.8294388Z 2024-12-18T00:21:05.8294597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8294714Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8294982Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8295094Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8295280Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8295412Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8295550Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8295705Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8296222Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8296632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8297116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8297389Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8297692Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8297969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8298259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8298397Z Execution Analysis: (:1) 2024-12-18T00:21:05.8298655Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8298873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8298877Z 2024-12-18T00:21:05.8299080Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8299203Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8299435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8299548Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8299760Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8299903Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8300059Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8300223Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8300826Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8301396Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8301757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8302114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8302421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8302700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8303009Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8303285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8303386Z Execution Analysis: .......... 2024-12-18T00:21:05.8303723Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8303922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8304241Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1707 counts during 1626 steps 2024-12-18T00:21:05.8304272Z 2024-12-18T00:21:05.8304485Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8304596Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8304898Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8305010Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8305223Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8305363Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8305504Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8305682Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8306036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8306394Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8306702Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8306985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8307288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8307555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8307854Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8307974Z Execution Analysis: (:1) 2024-12-18T00:21:05.8308241Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8308443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8308449Z 2024-12-18T00:21:05.8308660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8308773Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8309013Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8309122Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8309327Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8309475Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8309619Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8309794Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8310386Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8310967Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8311328Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8311683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8311992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8312265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8312576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8312866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8313008Z Execution Analysis: .......... 2024-12-18T00:21:05.8313263Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8313501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8313814Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1708 counts during 1627 steps 2024-12-18T00:21:05.8313819Z 2024-12-18T00:21:05.8314022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8314143Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8314435Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8314552Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8314756Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8314906Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8315052Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8315220Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8315587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8315942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8316263Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8316536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8316855Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8317123Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8317426Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8317553Z Execution Analysis: (:1) 2024-12-18T00:21:05.8317808Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8318025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8318029Z 2024-12-18T00:21:05.8318231Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8318356Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8318586Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8318706Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8318911Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8319052Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8319205Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8319371Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8319974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8320550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8320919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8321269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8321590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8321862Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8322170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8322567Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8322676Z Execution Analysis: .......... 2024-12-18T00:21:05.8322977Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8323215Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8323516Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1709 counts during 1628 steps 2024-12-18T00:21:05.8323521Z 2024-12-18T00:21:05.8323723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8323849Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8324140Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8324250Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8324461Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8324604Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8324752Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8324923Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8325287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8325639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8325948Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8326228Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8326532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8326805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8327098Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8327230Z Execution Analysis: (:1) 2024-12-18T00:21:05.8327487Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8327693Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8327707Z 2024-12-18T00:21:05.8327905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8328014Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8328250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8328358Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8328573Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8328714Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8328863Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8329038Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8329628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8330209Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8330567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8330923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8331233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8331516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8331871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8332141Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8332289Z Execution Analysis: .......... 2024-12-18T00:21:05.8332570Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8332782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8333075Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1710 counts during 1629 steps 2024-12-18T00:21:05.8333079Z 2024-12-18T00:21:05.8333288Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8333400Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8333700Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8333916Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8334118Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8334268Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8334406Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8334574Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8334923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8335272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8335573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8335839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8336143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8336512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8336975Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8337103Z Execution Analysis: (:1) 2024-12-18T00:21:05.8337382Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8337587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8337592Z 2024-12-18T00:21:05.8337803Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8337917Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8338145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8338267Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8338476Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8338638Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8338782Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8338960Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8339550Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8340121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8340486Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8340834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8341152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8343391Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8343733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8344015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8344310Z Execution Analysis: .......... 2024-12-18T00:21:05.8344587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8344792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8345099Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1711 counts during 1630 steps 2024-12-18T00:21:05.8345105Z 2024-12-18T00:21:05.8345310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8345434Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8345728Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8345862Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8346076Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8346220Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8346373Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8346537Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8346898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8347259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8347571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8347849Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8348157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8348437Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8348727Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8348850Z Execution Analysis: (:1) 2024-12-18T00:21:05.8349118Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8349321Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8349325Z 2024-12-18T00:21:05.8349535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8349646Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8349884Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8349993Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8350209Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8350349Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8350493Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8350667Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8351261Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8351841Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8352199Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8352559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8352908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8353286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8353599Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8353899Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8354013Z Execution Analysis: .......... 2024-12-18T00:21:05.8354269Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8354478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8354769Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1712 counts during 1631 steps 2024-12-18T00:21:05.8354774Z 2024-12-18T00:21:05.8354981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8355099Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8355389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8355506Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8355820Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8356080Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8356211Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8356371Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8356696Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8357020Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8357316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8357569Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8357863Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8358110Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8358391Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8358504Z Execution Analysis: (:1) 2024-12-18T00:21:05.8358743Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8358940Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8358944Z 2024-12-18T00:21:05.8359132Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8359246Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8359461Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8359576Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8359766Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8359906Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8360040Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8360196Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8360935Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8361494Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8361855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8362220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8362614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8362882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8363216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8363478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8363582Z Execution Analysis: .......... 2024-12-18T00:21:05.8363847Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8364045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8364340Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1713 counts during 1632 steps 2024-12-18T00:21:05.8364345Z 2024-12-18T00:21:05.8364548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8364670Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8364954Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8365069Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8365271Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8365412Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8365562Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8365728Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8366089Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8366432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8366746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8367018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8367321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8367598Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8367881Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8368015Z Execution Analysis: (:1) 2024-12-18T00:21:05.8368268Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8368475Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8368480Z 2024-12-18T00:21:05.8368677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8368800Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8369028Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8369135Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8369347Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8369488Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8369641Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8369802Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8370386Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8370941Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8371292Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8371724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8372032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8372334Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8372738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8372998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8373099Z Execution Analysis: .......... 2024-12-18T00:21:05.8373337Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8373532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8373800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1714 counts during 1633 steps 2024-12-18T00:21:05.8373808Z 2024-12-18T00:21:05.8374000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8374103Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8374383Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8374484Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8374682Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8374814Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8374946Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8375108Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8375436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8375768Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8376062Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8376322Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8376693Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8377115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8377414Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8377560Z Execution Analysis: (:1) 2024-12-18T00:21:05.8377828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8378033Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8378038Z 2024-12-18T00:21:05.8378249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8378367Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8378607Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8378716Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8378926Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8379080Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8379226Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8379399Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8379992Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8380573Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8380996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8381374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8381694Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8381991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8382306Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8382574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8382684Z Execution Analysis: .......... 2024-12-18T00:21:05.8382940Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8383151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8383445Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1715 counts during 1634 steps 2024-12-18T00:21:05.8383450Z 2024-12-18T00:21:05.8383654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8383779Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8384075Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8384194Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8384401Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8384550Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8384692Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8384859Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8385227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8385582Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8385905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8386180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8386498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8386764Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8387063Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8387188Z Execution Analysis: (:1) 2024-12-18T00:21:05.8387447Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8387659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8387669Z 2024-12-18T00:21:05.8387869Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8387993Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8388223Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8388345Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8388559Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8388733Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8388894Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8389079Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8389704Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8390311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8390776Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8391133Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8391483Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8391758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8392075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8392342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8392451Z Execution Analysis: .......... 2024-12-18T00:21:05.8392715Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8392922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8393224Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1716 counts during 1635 steps 2024-12-18T00:21:05.8393228Z 2024-12-18T00:21:05.8393433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8393557Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8393845Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8393967Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8394170Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8394315Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8394465Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8394632Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8394997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8395351Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8395674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8395944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8396251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8396528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8396823Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8396957Z Execution Analysis: (:1) 2024-12-18T00:21:05.8397215Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8397430Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8397438Z 2024-12-18T00:21:05.8397639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8397765Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8397994Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8398104Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8398323Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8398466Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8398624Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8398793Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8399385Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8400428Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8400795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8401186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8401500Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8401786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8402095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8402372Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8402480Z Execution Analysis: .......... 2024-12-18T00:21:05.8402740Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8402953Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8403242Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1717 counts during 1636 steps 2024-12-18T00:21:05.8403247Z 2024-12-18T00:21:05.8403461Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8403577Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8403983Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8404091Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8404302Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8404442Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8404584Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8404760Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8405115Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8405466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8405771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8406048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8406516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8406789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8407092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8407217Z Execution Analysis: (:1) 2024-12-18T00:21:05.8407490Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8407699Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8407703Z 2024-12-18T00:21:05.8407912Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8408028Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8408267Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8408380Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8408590Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8408742Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8408891Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8409067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8409690Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8410328Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8410717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8411072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8411395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8411671Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8411994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8412265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8412388Z Execution Analysis: .......... 2024-12-18T00:21:05.8412648Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8412861Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8413152Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1718 counts during 1637 steps 2024-12-18T00:21:05.8413157Z 2024-12-18T00:21:05.8413363Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8413491Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8413785Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8413909Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8414113Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8414270Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8414416Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8414588Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8414956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8415311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8415636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8415910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8416226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8416569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8416876Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8417005Z Execution Analysis: (:1) 2024-12-18T00:21:05.8417266Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8417482Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8417486Z 2024-12-18T00:21:05.8417690Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8417817Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8418050Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8418171Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8418379Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8418519Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8418672Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8418838Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8419523Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8420098Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8420494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8420845Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8421164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8421437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8421745Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8422025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8422134Z Execution Analysis: .......... 2024-12-18T00:21:05.8422401Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8422606Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8422910Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1719 counts during 1638 steps 2024-12-18T00:21:05.8422915Z 2024-12-18T00:21:05.8423120Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8423238Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8423539Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8423649Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8423865Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8424014Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8424167Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8424333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8424690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8425048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8425359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8425647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8425952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8426228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8426522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8426661Z Execution Analysis: (:1) 2024-12-18T00:21:05.8426920Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8427128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8427133Z 2024-12-18T00:21:05.8427340Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8427454Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8427695Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8427809Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8428022Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8428166Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8428313Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8428568Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8429266Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8429856Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8430209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8430560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8430864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8431140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8431443Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8431711Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8431822Z Execution Analysis: .......... 2024-12-18T00:21:05.8432073Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8432285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8432568Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1720 counts during 1639 steps 2024-12-18T00:21:05.8432573Z 2024-12-18T00:21:05.8432778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8432890Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8433181Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8433290Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8433495Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8433644Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8433783Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8433955Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8434303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8434653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8434952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8435220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8435530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8435794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8436092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8436212Z Execution Analysis: (:1) 2024-12-18T00:21:05.8436473Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8436674Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8436678Z 2024-12-18T00:21:05.8436886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8436996Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8437221Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8437338Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8437541Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8437728Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8437928Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8438095Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8438709Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8439267Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8439629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8439971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8440285Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8440558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8440872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8441132Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8441237Z Execution Analysis: .......... 2024-12-18T00:21:05.8441496Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8441695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8441985Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1721 counts during 1640 steps 2024-12-18T00:21:05.8441990Z 2024-12-18T00:21:05.8442184Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8442303Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8442590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8442709Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8442909Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8443050Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8443199Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8443367Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8443724Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8444069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8444706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8444983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8445290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8445572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8445864Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8446003Z Execution Analysis: (:1) 2024-12-18T00:21:05.8446265Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8446478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8446483Z 2024-12-18T00:21:05.8446684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8446807Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8447040Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8447152Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8447426Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8447638Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8447795Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8447964Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8448600Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8449177Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8449536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8449899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8450215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8450504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8450815Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8451092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8451205Z Execution Analysis: .......... 2024-12-18T00:21:05.8451477Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8451676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8451964Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1722 counts during 1641 steps 2024-12-18T00:21:05.8451968Z 2024-12-18T00:21:05.8452181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8452295Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8452604Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8452715Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8452930Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8453073Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8453217Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8453399Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8453755Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8454117Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8454431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8454711Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8455021Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8455297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8455586Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8455710Z Execution Analysis: (:1) 2024-12-18T00:21:05.8455979Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8456181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8456185Z 2024-12-18T00:21:05.8456467Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8456583Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8456829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8457030Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8457237Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8457393Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8457540Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8457745Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8458339Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8458922Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8459279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8459642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8459959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8460232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8460576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8460842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8460964Z Execution Analysis: .......... 2024-12-18T00:21:05.8461221Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8461433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8461721Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1723 counts during 1642 steps 2024-12-18T00:21:05.8461726Z 2024-12-18T00:21:05.8461940Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8462054Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8462345Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8462464Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8462667Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8462819Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8462962Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8463129Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8463491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8463839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8464158Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8464432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8464749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8465015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8465316Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8465438Z Execution Analysis: (:1) 2024-12-18T00:21:05.8465695Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8465909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8465914Z 2024-12-18T00:21:05.8466113Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8466236Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8466540Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8466661Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8466869Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8467014Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8467205Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8467374Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8467973Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8468547Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8469015Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8469361Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8469677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8469943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8470249Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8470518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8470621Z Execution Analysis: .......... 2024-12-18T00:21:05.8470880Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8471078Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8471365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1725 counts during 1643 steps 2024-12-18T00:21:05.8471372Z 2024-12-18T00:21:05.8471573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8471692Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8471979Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8472087Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8472293Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8472433Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8472581Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8472743Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8473100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8473440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8473745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8474020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8474321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8474591Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8474877Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8475005Z Execution Analysis: (:1) 2024-12-18T00:21:05.8475421Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8475625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8475641Z 2024-12-18T00:21:05.8475846Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8476152Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8476407Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8476525Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8476746Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8476929Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8477073Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8477248Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8477847Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8478421Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8478791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8479145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8479464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8479741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8480062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8480332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8480452Z Execution Analysis: .......... 2024-12-18T00:21:05.8480713Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8480917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8481218Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1726 counts during 1644 steps 2024-12-18T00:21:05.8481226Z 2024-12-18T00:21:05.8481427Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8481554Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8481846Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8481965Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8482170Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8482313Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8482462Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8482629Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8482995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8483348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8483680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8483955Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8484273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8484542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8484832Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8484964Z Execution Analysis: (:1) 2024-12-18T00:21:05.8485217Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8485428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8485433Z 2024-12-18T00:21:05.8485714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8485841Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8486074Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8486185Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8486426Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8486565Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8486723Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8486888Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8487492Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8488070Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8488444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8488796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8489108Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8489392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8489699Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8489975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8490080Z Execution Analysis: .......... 2024-12-18T00:21:05.8495419Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8495700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8496010Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1727 counts during 1645 steps 2024-12-18T00:21:05.8496017Z 2024-12-18T00:21:05.8496230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8496426Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8496739Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8496849Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8497065Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8497209Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8497348Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8497525Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8497889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8498255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8498568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8498851Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8499158Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8499424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8499721Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8499845Z Execution Analysis: (:1) 2024-12-18T00:21:05.8500117Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8500395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8500476Z 2024-12-18T00:21:05.8500687Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8500797Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8501067Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8501178Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8501385Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8501538Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8501683Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8501861Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8502457Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8503049Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8503410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8503770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8504078Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8504348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8504665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8504932Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8505044Z Execution Analysis: .......... 2024-12-18T00:21:05.8505306Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8505517Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8505803Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1728 counts during 1646 steps 2024-12-18T00:21:05.8505809Z 2024-12-18T00:21:05.8506009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8506128Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8506421Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8506538Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8506741Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8506893Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8507032Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8507198Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8507562Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8507911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8508230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8508500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8508808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8509071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8509369Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8509492Z Execution Analysis: (:1) 2024-12-18T00:21:05.8509772Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8510072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8510076Z 2024-12-18T00:21:05.8510276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8510424Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8510656Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8510771Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8510980Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8511118Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8511269Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8511437Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8512041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8512620Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8512982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8513336Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8513659Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8513932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8514237Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8514509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8514612Z Execution Analysis: .......... 2024-12-18T00:21:05.8514882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8515081Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8515377Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1729 counts during 1647 steps 2024-12-18T00:21:05.8515384Z 2024-12-18T00:21:05.8515582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8515706Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8515997Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8516108Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8516319Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8516461Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8516610Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8516779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8517142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8517491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8517801Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8518079Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8518386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8518659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8518949Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8519079Z Execution Analysis: (:1) 2024-12-18T00:21:05.8519416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8519617Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8519631Z 2024-12-18T00:21:05.8519856Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8519968Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8520203Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8520313Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8520526Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8520667Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8520812Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8520986Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8521586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8522165Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8522527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8522883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8523195Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8523475Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8523779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8524048Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8524162Z Execution Analysis: .......... 2024-12-18T00:21:05.8524416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8524629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8524918Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1730 counts during 1648 steps 2024-12-18T00:21:05.8524923Z 2024-12-18T00:21:05.8525133Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8525240Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8525544Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8525649Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8525849Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8526000Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8526142Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8526318Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8526670Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8527027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8527333Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8527603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8527917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8528180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8528478Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8528675Z Execution Analysis: (:1) 2024-12-18T00:21:05.8528944Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8529144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8529175Z 2024-12-18T00:21:05.8529384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8529495Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8529723Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8529842Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8530045Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8530196Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8530337Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8530514Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8531106Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8531677Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8532043Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8532390Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8532707Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8532978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8533299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8533569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8533680Z Execution Analysis: .......... 2024-12-18T00:21:05.8533935Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8534137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8534433Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1731 counts during 1649 steps 2024-12-18T00:21:05.8534438Z 2024-12-18T00:21:05.8534637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8534761Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8535051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8535166Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8535366Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8535510Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8535658Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8535822Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8536189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8536627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8536949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8537219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8537535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8537807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8538180Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8538320Z Execution Analysis: (:1) 2024-12-18T00:21:05.8538574Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8538808Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8538812Z 2024-12-18T00:21:05.8539012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8539130Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8539360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8539469Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8539681Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8539821Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8539980Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8540144Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8540744Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8541316Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8541681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8542032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8542340Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8542624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8542932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8543204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8543305Z Execution Analysis: .......... 2024-12-18T00:21:05.8543569Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8543769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8544054Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1732 counts during 1650 steps 2024-12-18T00:21:05.8544067Z 2024-12-18T00:21:05.8544411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8544524Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8544822Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8544933Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8545143Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8545285Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8545424Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8545600Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8545956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8546316Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8546622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8546903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8547206Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8547588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8547908Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8548032Z Execution Analysis: (:1) 2024-12-18T00:21:05.8548333Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8548536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8548541Z 2024-12-18T00:21:05.8548748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8548856Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8549092Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8549199Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8549404Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8549562Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8549704Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8549880Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8550470Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8551047Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8551401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8551756Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8552063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8552334Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8552651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8552913Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8553031Z Execution Analysis: .......... 2024-12-18T00:21:05.8553282Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8553492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8553778Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1733 counts during 1651 steps 2024-12-18T00:21:05.8553782Z 2024-12-18T00:21:05.8553990Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8554101Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8554390Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8554507Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8554707Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8554855Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8554997Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8555174Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8555527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8555876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8556192Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8556564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8556896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8557206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8557495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8557637Z Execution Analysis: (:1) 2024-12-18T00:21:05.8557888Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8558093Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8558098Z 2024-12-18T00:21:05.8558293Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8558409Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8558630Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8558747Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8558951Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8559097Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8559236Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8559396Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8559982Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8560535Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8560895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8561231Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8561540Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8561803Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8562104Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8562365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8562466Z Execution Analysis: .......... 2024-12-18T00:21:05.8562726Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8562920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8563209Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1734 counts during 1652 steps 2024-12-18T00:21:05.8563214Z 2024-12-18T00:21:05.8563406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8563530Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8563813Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8563918Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8564126Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8564265Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8564412Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8564574Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8564928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8565267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8565567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8565863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8566212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8566481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8566784Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8566913Z Execution Analysis: (:1) 2024-12-18T00:21:05.8567161Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8567366Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8567371Z 2024-12-18T00:21:05.8567563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8567672Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8567909Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8568017Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8568227Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8568363Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8568513Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8568674Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8569250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8569814Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8570161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8570511Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8570813Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8571084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8571384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8571650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8571751Z Execution Analysis: .......... 2024-12-18T00:21:05.8572000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8572207Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8572649Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1735 counts during 1653 steps 2024-12-18T00:21:05.8572654Z 2024-12-18T00:21:05.8572869Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8572982Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8573281Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8573387Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8573588Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8573740Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8573879Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8574055Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8574406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8574762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8575093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8575426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8575729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8576021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8576322Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8576515Z Execution Analysis: (:1) 2024-12-18T00:21:05.8576784Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8576982Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8576987Z 2024-12-18T00:21:05.8577195Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8577310Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8577542Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8577658Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8577862Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8578017Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8578160Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8578333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8578921Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8579493Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8579860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8580210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8580530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8580802Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8581116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8581381Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8581492Z Execution Analysis: .......... 2024-12-18T00:21:05.8581745Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8581943Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8582241Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1736 counts during 1654 steps 2024-12-18T00:21:05.8582249Z 2024-12-18T00:21:05.8582447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8582567Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8582861Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8582992Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8583191Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8583332Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8583492Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8583658Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8584025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8584372Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8584788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8585064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8585381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8585679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8585974Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8586114Z Execution Analysis: (:1) 2024-12-18T00:21:05.8586372Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8586587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8586592Z 2024-12-18T00:21:05.8586795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8586922Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8587151Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8587261Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8587482Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8587625Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8587785Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8587951Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8588560Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8589141Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8589517Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8589868Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8590180Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8590469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8590779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8591059Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8591164Z Execution Analysis: .......... 2024-12-18T00:21:05.8591427Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8591631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8591922Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1737 counts during 1655 steps 2024-12-18T00:21:05.8591935Z 2024-12-18T00:21:05.8592136Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8592251Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8592559Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8592667Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8592883Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8593026Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8593177Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8593347Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8593705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8594140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8594448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8594727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8595055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8595334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8595624Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8595747Z Execution Analysis: (:1) 2024-12-18T00:21:05.8596012Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8596318Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8596328Z 2024-12-18T00:21:05.8596535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8596642Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8596875Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8596986Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8597193Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8597333Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8597476Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8597644Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8598219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8598784Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8599131Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8599482Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8599787Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8600053Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8600362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8600622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8600738Z Execution Analysis: .......... 2024-12-18T00:21:05.8600986Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8601196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8601473Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1738 counts during 1656 steps 2024-12-18T00:21:05.8601477Z 2024-12-18T00:21:05.8601689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8601800Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8602177Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8602290Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8602477Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8602615Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8602745Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8602906Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8603259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8603632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8603932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8604206Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8604500Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8604746Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8605022Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8605136Z Execution Analysis: (:1) 2024-12-18T00:21:05.8605372Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8605571Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8605577Z 2024-12-18T00:21:05.8605763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8605880Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8606092Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8606205Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8606396Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8606538Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8606675Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8606829Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8607383Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8607916Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8608259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8608583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8608883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8609135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8609429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8609678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8609774Z Execution Analysis: .......... 2024-12-18T00:21:05.8610024Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8610212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8610493Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1739 counts during 1657 steps 2024-12-18T00:21:05.8610497Z 2024-12-18T00:21:05.8610686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8610801Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8611071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8611172Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8611373Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8611506Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8611649Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8611824Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8612210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8612533Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8612851Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8613115Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8613397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8613655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8613921Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8614045Z Execution Analysis: (:1) 2024-12-18T00:21:05.8614282Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8614480Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8614483Z 2024-12-18T00:21:05.8614670Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8614773Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8614995Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8615097Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8615300Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8615429Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8615572Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8615726Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8616270Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8617061Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8617423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8617789Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8618099Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8618384Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8618688Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8618965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8619076Z Execution Analysis: .......... 2024-12-18T00:21:05.8619332Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8619543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8619831Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1740 counts during 1658 steps 2024-12-18T00:21:05.8619836Z 2024-12-18T00:21:05.8620049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8620161Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8620463Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8620568Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8620779Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8620923Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8621142Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8621318Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8621676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8622133Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8622443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8622725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8623035Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8623301Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8623602Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8623729Z Execution Analysis: (:1) 2024-12-18T00:21:05.8624000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8624200Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8624205Z 2024-12-18T00:21:05.8624420Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8624532Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8624770Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8624881Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8625088Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8625239Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8625383Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8625556Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8626151Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8626731Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8627090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8627442Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8627762Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8628031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8628350Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8628621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8628741Z Execution Analysis: .......... 2024-12-18T00:21:05.8629109Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8629413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8629692Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1741 counts during 1659 steps 2024-12-18T00:21:05.8629696Z 2024-12-18T00:21:05.8629881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8629997Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8630264Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8630377Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8630566Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8630779Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8630913Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8631069Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8631412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8631756Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8632059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8632312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8632607Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8632856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8633126Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8633258Z Execution Analysis: (:1) 2024-12-18T00:21:05.8633499Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8633702Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8633706Z 2024-12-18T00:21:05.8633895Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8634009Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8634222Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8634335Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8634528Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8634663Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8634814Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8634970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8635689Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8636251Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8636608Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8637114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8637424Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8637705Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8638011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8638297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8638402Z Execution Analysis: .......... 2024-12-18T00:21:05.8638674Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8638877Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8639172Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1742 counts during 1660 steps 2024-12-18T00:21:05.8639177Z 2024-12-18T00:21:05.8639378Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8639489Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8639793Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8639900Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8640195Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8640341Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8640492Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8640658Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8641341Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8641705Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8642014Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8642298Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8642602Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8642878Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8643173Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8643306Z Execution Analysis: (:1) 2024-12-18T00:21:05.8643562Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8643764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8643769Z 2024-12-18T00:21:05.8643983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8644094Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8644496Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8644602Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8644815Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8644961Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8645114Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8645294Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8645886Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8646470Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8646826Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8647190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8647501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8647784Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8648096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8648365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8648481Z Execution Analysis: .......... 2024-12-18T00:21:05.8648739Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8648954Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8649240Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1743 counts during 1661 steps 2024-12-18T00:21:05.8649245Z 2024-12-18T00:21:05.8649455Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8649567Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8649911Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8650126Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8650334Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8650490Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8650635Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8650847Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8651205Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8651559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8651887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8652162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8652490Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8652761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8653066Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8653188Z Execution Analysis: (:1) 2024-12-18T00:21:05.8653457Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8653660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8653664Z 2024-12-18T00:21:05.8653866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8653989Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8654220Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8654342Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8654553Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8654715Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8654859Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8655029Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8655634Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8656212Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8656669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8657023Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8657343Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8657624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8657939Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8658211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8658316Z Execution Analysis: .......... 2024-12-18T00:21:05.8658583Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8658790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8659088Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1744 counts during 1662 steps 2024-12-18T00:21:05.8659093Z 2024-12-18T00:21:05.8659295Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8659416Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8659796Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8659913Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8660119Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8660263Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8660439Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8660605Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8660967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8661319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8661640Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8661913Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8662221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8662496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8662785Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8662918Z Execution Analysis: (:1) 2024-12-18T00:21:05.8663178Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8663387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8663392Z 2024-12-18T00:21:05.8663594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8663716Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8663950Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8664062Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8664279Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8664422Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8664578Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8664749Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8665349Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8665922Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8666279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8666642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8666954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8667238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8667546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8667826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8667935Z Execution Analysis: .......... 2024-12-18T00:21:05.8668190Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8668401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8668686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1746 counts during 1663 steps 2024-12-18T00:21:05.8668690Z 2024-12-18T00:21:05.8668927Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8669093Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8669393Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8669505Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8669741Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8669889Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8670030Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8670206Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8670565Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8670923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8671236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8671521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8671828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8672093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8672397Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8672519Z Execution Analysis: (:1) 2024-12-18T00:21:05.8672794Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8672996Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8673001Z 2024-12-18T00:21:05.8673214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8673331Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8673576Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8673688Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8673895Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8674054Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8674207Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8674385Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8674983Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8675600Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8675963Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8676317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8676648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8676923Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8677243Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8677513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8677638Z Execution Analysis: .......... 2024-12-18T00:21:05.8677900Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8678116Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8678408Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1747 counts during 1664 steps 2024-12-18T00:21:05.8678463Z 2024-12-18T00:21:05.8678692Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8678819Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8679113Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8679263Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8679473Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8679629Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8679775Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8679944Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8680315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8680669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8681003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8681281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8681600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8681872Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8682179Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8682300Z Execution Analysis: (:1) 2024-12-18T00:21:05.8682559Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8682773Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8682778Z 2024-12-18T00:21:05.8682982Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8683112Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8683344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8683468Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8683673Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8683818Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8683977Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8684142Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8684746Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8685317Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8685687Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8686041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8686363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8686637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8686944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8687221Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8687333Z Execution Analysis: .......... 2024-12-18T00:21:05.8687609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8687812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8688175Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1748 counts during 1665 steps 2024-12-18T00:21:05.8688205Z 2024-12-18T00:21:05.8688406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8688533Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8688850Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8688962Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8689180Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8689326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8689483Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8689650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8690011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8690375Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8690693Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8690977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8691285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8691561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8691856Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8691993Z Execution Analysis: (:1) 2024-12-18T00:21:05.8692361Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8692562Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8692575Z 2024-12-18T00:21:05.8692777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8692887Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8693120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8693228Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8693445Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8693585Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8693729Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8693900Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8694476Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8695047Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8695400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8695757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8696067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8696412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8696721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8697154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8697277Z Execution Analysis: .......... 2024-12-18T00:21:05.8697540Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8697792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8698134Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1749 counts during 1666 steps 2024-12-18T00:21:05.8698139Z 2024-12-18T00:21:05.8698351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8698492Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8698795Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8698905Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8699110Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8699271Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8699416Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8699596Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8699955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8700319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8700630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8700906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8701228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8701496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8701801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8701929Z Execution Analysis: (:1) 2024-12-18T00:21:05.8702201Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8702407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8702415Z 2024-12-18T00:21:05.8702628Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8702743Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8702977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8703102Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8703308Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8703459Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8703608Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8703788Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8704379Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8704956Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8705330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8705683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8706008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8706284Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8706604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8706870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8706989Z Execution Analysis: .......... 2024-12-18T00:21:05.8707272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8707525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8707827Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1750 counts during 1667 steps 2024-12-18T00:21:05.8707832Z 2024-12-18T00:21:05.8708058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8708188Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8708480Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8708606Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8708811Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8708957Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8709111Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8709282Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8709657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8710010Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8710336Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8710607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8710914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8711194Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8711486Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8711622Z Execution Analysis: (:1) 2024-12-18T00:21:05.8711880Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8712099Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8712103Z 2024-12-18T00:21:05.8712306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8712437Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8712667Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8712778Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8713000Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8713145Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8713306Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8713473Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8714081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8714654Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8715016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8715379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8715692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8715978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8716288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8716567Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8716674Z Execution Analysis: .......... 2024-12-18T00:21:05.8717019Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8717226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8717541Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1751 counts during 1668 steps 2024-12-18T00:21:05.8717560Z 2024-12-18T00:21:05.8717764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8717878Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8718182Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8718295Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8718513Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8718660Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8718806Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8718994Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8719351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8719717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8720035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8720323Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8720628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8720911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8721201Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8721334Z Execution Analysis: (:1) 2024-12-18T00:21:05.8721614Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8721820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8721825Z 2024-12-18T00:21:05.8722046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8722158Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8722404Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8722517Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8722726Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8722884Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8723036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8723218Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8723814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8724407Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8724772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8725141Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8725453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8725727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8726049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8726366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8726538Z Execution Analysis: .......... 2024-12-18T00:21:05.8726798Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8727016Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8727334Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1752 counts during 1669 steps 2024-12-18T00:21:05.8727339Z 2024-12-18T00:21:05.8727557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8727675Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8727970Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8728098Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8728303Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8728462Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8728613Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8728800Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8729162Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8729514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8729840Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8730112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8730429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8730695Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8731001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8731127Z Execution Analysis: (:1) 2024-12-18T00:21:05.8731385Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8731602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8731608Z 2024-12-18T00:21:05.8731809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8731933Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8732164Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8732288Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8732493Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8732637Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8732798Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8732970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8733582Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8734160Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8734529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8734883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8735205Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8735481Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8735818Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8736151Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8736261Z Execution Analysis: .......... 2024-12-18T00:21:05.8736608Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8736844Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8737148Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1753 counts during 1670 steps 2024-12-18T00:21:05.8737153Z 2024-12-18T00:21:05.8737357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8737482Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8737776Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8737889Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8738109Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8738258Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8738413Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8738582Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8738953Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8739307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8739616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8739905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8740212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8740492Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8740786Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8740918Z Execution Analysis: (:1) 2024-12-18T00:21:05.8741177Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8741395Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8741399Z 2024-12-18T00:21:05.8741602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8741715Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8741955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8742068Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8742291Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8742437Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8742600Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8742770Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8743363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8743951Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8744488Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8744858Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8745171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8745460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8745893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8746177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8746287Z Execution Analysis: .......... 2024-12-18T00:21:05.8746580Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8746799Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8747092Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1754 counts during 1671 steps 2024-12-18T00:21:05.8747097Z 2024-12-18T00:21:05.8747310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8747427Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8747733Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8747851Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8748058Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8748212Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8748360Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8748541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8748899Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8749261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8749571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8749845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8750159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8750433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8750737Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8750861Z Execution Analysis: (:1) 2024-12-18T00:21:05.8751133Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8751338Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8751343Z 2024-12-18T00:21:05.8751556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8751670Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8751899Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8752023Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8752229Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8752393Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8752537Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8752715Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8753312Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8753883Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8754255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8754605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8754932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8755285Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8755611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8755882Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8756149Z Execution Analysis: .......... 2024-12-18T00:21:05.8756403Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8756606Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8756901Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1755 counts during 1672 steps 2024-12-18T00:21:05.8756905Z 2024-12-18T00:21:05.8757103Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8757227Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8757519Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8757640Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8757840Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8757982Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8758137Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8758299Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8758662Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8759006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8759322Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8759587Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8759902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8760166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8760451Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8760587Z Execution Analysis: (:1) 2024-12-18T00:21:05.8760837Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8761049Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8761054Z 2024-12-18T00:21:05.8761249Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8761376Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8761601Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8761709Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8761927Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8762068Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8762222Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8762387Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8762978Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8763701Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8764077Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8764433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8764796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8765134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8765448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8765764Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8765875Z Execution Analysis: .......... 2024-12-18T00:21:05.8766149Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8766357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8766661Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1756 counts during 1673 steps 2024-12-18T00:21:05.8766665Z 2024-12-18T00:21:05.8766871Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8766994Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8767302Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8767416Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8767641Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8767792Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8767954Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8768127Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8768487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8768858Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8769174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8769465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8769779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8770064Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8770361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8770489Z Execution Analysis: (:1) 2024-12-18T00:21:05.8770765Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8770974Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8770978Z 2024-12-18T00:21:05.8771199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8771316Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8771565Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8771683Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8771906Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8772053Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8772204Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8772393Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8772988Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8773580Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8773942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8774338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8774776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8775052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8775404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8775676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8775798Z Execution Analysis: .......... 2024-12-18T00:21:05.8776058Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8776276Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8776660Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1757 counts during 1674 steps 2024-12-18T00:21:05.8776665Z 2024-12-18T00:21:05.8776886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8777004Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8777295Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8777415Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8777624Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8777784Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8777929Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8778107Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8778464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8778813Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8779139Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8779416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8779738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8780009Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8780314Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8780445Z Execution Analysis: (:1) 2024-12-18T00:21:05.8780715Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8780921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8780925Z 2024-12-18T00:21:05.8781128Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8781261Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8781492Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8781616Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8781824Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8781984Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8782133Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8782302Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8782910Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8783483Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8783883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8784285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8784609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8784909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8785233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8785504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8785612Z Execution Analysis: .......... 2024-12-18T00:21:05.8785883Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8786087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8786392Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1758 counts during 1675 steps 2024-12-18T00:21:05.8786401Z 2024-12-18T00:21:05.8786606Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8786735Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8787031Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8787144Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8787366Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8787514Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8787673Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8787848Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8788219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8788577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8788908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8789188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8789499Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8789782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8790078Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8790217Z Execution Analysis: (:1) 2024-12-18T00:21:05.8790478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8790696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8790701Z 2024-12-18T00:21:05.8790907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8791028Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8791273Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8791383Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8791605Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8791750Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8791910Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8792080Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8792672Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8793256Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8793715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8794081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8794418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8794706Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8795018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8795306Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8795415Z Execution Analysis: .......... 2024-12-18T00:21:05.8795672Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8795892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8796185Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1759 counts during 1676 steps 2024-12-18T00:21:05.8796189Z 2024-12-18T00:21:05.8796407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8796525Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8796834Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8796950Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8797165Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8797309Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8797453Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8797635Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8797993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8798359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8798672Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8798957Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8799268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8799533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8799836Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8799960Z Execution Analysis: (:1) 2024-12-18T00:21:05.8800231Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8800438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8800446Z 2024-12-18T00:21:05.8800661Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8800776Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8801022Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8801139Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8801349Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8801508Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8801656Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8801839Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8802432Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8805106Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8805575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8805923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8806244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8806518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8806834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8807099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8807209Z Execution Analysis: .......... 2024-12-18T00:21:05.8807484Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8807725Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8808009Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1760 counts during 1677 steps 2024-12-18T00:21:05.8808015Z 2024-12-18T00:21:05.8808228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8808342Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8808638Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8808746Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8808956Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8809099Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8809240Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8809414Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8809768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8810131Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8810438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8810718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8811018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8811280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8811577Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8811701Z Execution Analysis: (:1) 2024-12-18T00:21:05.8811966Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8812175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8812180Z 2024-12-18T00:21:05.8812390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8812503Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8812730Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8812853Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8813060Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8813212Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8813359Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8813537Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8814118Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8814828Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8815182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8815529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8815849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8816118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8816521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8816951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8817075Z Execution Analysis: .......... 2024-12-18T00:21:05.8817338Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8817551Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8817859Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1761 counts during 1678 steps 2024-12-18T00:21:05.8817865Z 2024-12-18T00:21:05.8818072Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8818202Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8818500Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8818624Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8818832Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8818989Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8819135Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8819308Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8819683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8820035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8820361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8820635Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8820954Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8821223Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8821518Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8821658Z Execution Analysis: (:1) 2024-12-18T00:21:05.8821921Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8822146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8822150Z 2024-12-18T00:21:05.8822354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8822484Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8822714Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8822837Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8823047Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8823193Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8823354Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8823522Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8824200Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8824831Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8825202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8825555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8825870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8826155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8826467Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8826753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8826869Z Execution Analysis: .......... 2024-12-18T00:21:05.8827146Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8827350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8827652Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1762 counts during 1679 steps 2024-12-18T00:21:05.8827657Z 2024-12-18T00:21:05.8827859Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8827972Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8828280Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8828393Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8828610Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8828756Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8828921Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8829092Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8829450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8829825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8830169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8830459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8830770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8831050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8831341Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8831486Z Execution Analysis: (:1) 2024-12-18T00:21:05.8831747Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8831954Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8831959Z 2024-12-18T00:21:05.8832170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8832285Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8832531Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8832643Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8832864Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8833011Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8833161Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8833344Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8834062Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8834652Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8835012Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8835378Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8835692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8835978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8836290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8836568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8836689Z Execution Analysis: .......... 2024-12-18T00:21:05.8836951Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8837166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8837455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1763 counts during 1680 steps 2024-12-18T00:21:05.8837460Z 2024-12-18T00:21:05.8837676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8837790Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8838085Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8838209Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8838418Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8838583Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8838728Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8838911Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8839271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8839625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8839947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8840222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8840545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8840815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8841123Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8841257Z Execution Analysis: (:1) 2024-12-18T00:21:05.8841527Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8841733Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8841737Z 2024-12-18T00:21:05.8841940Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8842070Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8842304Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8842429Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8842638Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8842797Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8842972Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8843218Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8843825Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8844557Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8844945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8845299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8845627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8845904Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8846234Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8846509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8846617Z Execution Analysis: .......... 2024-12-18T00:21:05.8846891Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8847096Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8847404Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1764 counts during 1681 steps 2024-12-18T00:21:05.8847409Z 2024-12-18T00:21:05.8847615Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8847744Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8848037Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8848157Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8848367Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8848513Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8848669Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8848838Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8849212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8849565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8849890Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8850163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8850472Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8850756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8851053Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8851192Z Execution Analysis: (:1) 2024-12-18T00:21:05.8851451Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8851668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8851672Z 2024-12-18T00:21:05.8851875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8851998Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8852231Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8852345Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8852567Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8852800Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8853037Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8853208Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8853813Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8854390Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8854749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8855115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8855428Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8855719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8856032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8856313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8856507Z Execution Analysis: .......... 2024-12-18T00:21:05.8856768Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8856988Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8857292Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1765 counts during 1682 steps 2024-12-18T00:21:05.8857297Z 2024-12-18T00:21:05.8857502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8857621Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8857921Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8858046Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8858256Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8858402Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8858557Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8858726Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8859093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8859445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8859769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8860043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8860357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8860644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8860938Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8861073Z Execution Analysis: (:1) 2024-12-18T00:21:05.8861330Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8861541Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8861546Z 2024-12-18T00:21:05.8861749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8861863Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8862105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8862212Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8862492Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8862691Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8862850Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8863021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8863618Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8864204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8864567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8864927Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8865244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8865534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8865844Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8866122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8866233Z Execution Analysis: .......... 2024-12-18T00:21:05.8866489Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8866704Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8866997Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1767 counts during 1683 steps 2024-12-18T00:21:05.8867001Z 2024-12-18T00:21:05.8867213Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8867330Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8867632Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8867741Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8867951Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8868098Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8868241Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8868416Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8868873Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8869224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8869527Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8869804Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8870112Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8870371Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8870661Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8870785Z Execution Analysis: (:1) 2024-12-18T00:21:05.8871045Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8871243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8871247Z 2024-12-18T00:21:05.8871449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8871558Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8871790Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8871986Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8872217Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8872364Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8872508Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8872679Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8873358Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8873896Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8874229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8874556Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8874864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8875117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8875410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8875665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8875774Z Execution Analysis: .......... 2024-12-18T00:21:05.8876015Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8876210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8876477Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1768 counts during 1684 steps 2024-12-18T00:21:05.8876482Z 2024-12-18T00:21:05.8876670Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8876790Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8877059Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8877168Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8877359Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8877499Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8877633Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8877786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8878126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8878453Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8878749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8879010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8879301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8879549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8879815Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8879944Z Execution Analysis: (:1) 2024-12-18T00:21:05.8880183Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8880385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8880389Z 2024-12-18T00:21:05.8880578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8880693Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8881011Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8881123Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8881312Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8881450Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8881594Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8881747Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8882302Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8882832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8883174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8883502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8883801Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8884051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8884336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8884592Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8884693Z Execution Analysis: .......... 2024-12-18T00:21:05.8884939Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8885123Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8885400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1769 counts during 1685 steps 2024-12-18T00:21:05.8885409Z 2024-12-18T00:21:05.8885597Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8885702Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8885980Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8886084Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8886280Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8886414Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8886555Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8886709Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8887038Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8887369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8887660Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8887921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8888204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8888465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8888734Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8888859Z Execution Analysis: (:1) 2024-12-18T00:21:05.8889092Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8889283Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8889287Z 2024-12-18T00:21:05.8889811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8889996Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8890225Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8890325Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8890531Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8890664Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8890801Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8890967Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8891515Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8892054Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8892390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8892728Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8893015Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8893275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8893559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8893806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8893916Z Execution Analysis: .......... 2024-12-18T00:21:05.8894153Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8894347Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8894625Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1770 counts during 1686 steps 2024-12-18T00:21:05.8894629Z 2024-12-18T00:21:05.8894823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8894928Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8895207Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8895310Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8895501Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8895648Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8895782Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8895948Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8896276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8896685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8897159Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8897435Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8897771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8898037Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8902705Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8902866Z Execution Analysis: (:1) 2024-12-18T00:21:05.8903142Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8903357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8903440Z 2024-12-18T00:21:05.8903762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8903887Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8904120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8904236Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8904450Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8904599Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8904745Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8904915Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8905526Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8906105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8906480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8906831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8907148Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8907422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8907737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8908004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8908110Z Execution Analysis: .......... 2024-12-18T00:21:05.8908377Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8908581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8908886Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1771 counts during 1687 steps 2024-12-18T00:21:05.8908892Z 2024-12-18T00:21:05.8909191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8909301Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8909567Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8909670Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8909866Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8909999Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8910137Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8910293Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8910629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8910955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8911242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8911500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8911783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8912036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8912308Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8912427Z Execution Analysis: (:1) 2024-12-18T00:21:05.8912665Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8912879Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8912956Z 2024-12-18T00:21:05.8913140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8913245Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8913460Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8913558Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8913751Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8913880Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8914019Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8914174Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8914720Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8915256Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8915587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8915914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8916198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8916450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8916729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8916978Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8917074Z Execution Analysis: .......... 2024-12-18T00:21:05.8917311Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8917505Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8917938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1772 counts during 1688 steps 2024-12-18T00:21:05.8917943Z 2024-12-18T00:21:05.8918145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8918256Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8918546Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8918651Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8918847Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8918992Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8919129Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8919293Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8919646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8919991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8920289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8920557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8920852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8921111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8921399Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8921519Z Execution Analysis: (:1) 2024-12-18T00:21:05.8921800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8922084Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8922089Z 2024-12-18T00:21:05.8922293Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8922402Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8922626Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8922737Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8922940Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8923087Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8923229Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8923404Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8923985Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8924555Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8924905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8925249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8925561Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8925828Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8926135Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8926394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8926504Z Execution Analysis: .......... 2024-12-18T00:21:05.8926760Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8926956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8927242Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1773 counts during 1689 steps 2024-12-18T00:21:05.8927247Z 2024-12-18T00:21:05.8927444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8927559Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8927840Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8927953Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8928151Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8928295Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8928433Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8928598Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8928951Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8929291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8929600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8929958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8930250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8930493Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8930759Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8930879Z Execution Analysis: (:1) 2024-12-18T00:21:05.8931279Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8931478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8931482Z 2024-12-18T00:21:05.8931671Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8931781Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8931990Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8932095Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8932284Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8932413Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8932551Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8932703Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8933265Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8933792Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8934127Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8934454Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8934742Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8935000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8935287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8935545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8935648Z Execution Analysis: .......... 2024-12-18T00:21:05.8935888Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8936075Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8936442Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1774 counts during 1690 steps 2024-12-18T00:21:05.8936450Z 2024-12-18T00:21:05.8936640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8936745Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8937201Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8937312Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8937525Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8937668Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8937821Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8937990Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8938345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8938703Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8939010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8939286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8939593Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8939864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8940180Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8940389Z Execution Analysis: (:1) 2024-12-18T00:21:05.8940654Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8940855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8940859Z 2024-12-18T00:21:05.8941064Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8941173Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8941407Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8941511Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8941724Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8941865Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8942008Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8942188Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8942780Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8943358Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8943716Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8944070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8944519Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8944799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8945108Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8945376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8945490Z Execution Analysis: .......... 2024-12-18T00:21:05.8945746Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8945952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8946241Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1775 counts during 1691 steps 2024-12-18T00:21:05.8946246Z 2024-12-18T00:21:05.8946453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8946564Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8946852Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8946969Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8947172Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8947326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8947466Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8947639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8947993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8948340Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8948652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8948921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8949237Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8949501Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8949954Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8950081Z Execution Analysis: (:1) 2024-12-18T00:21:05.8950343Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8950547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8950552Z 2024-12-18T00:21:05.8950751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8950867Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8951092Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8951203Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8951407Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8951552Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8951702Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8951866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8952458Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8953025Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8953392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8953743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8954058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8954330Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8954649Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8954916Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8955020Z Execution Analysis: .......... 2024-12-18T00:21:05.8955284Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8955487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8955779Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1776 counts during 1692 steps 2024-12-18T00:21:05.8955784Z 2024-12-18T00:21:05.8956092Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8956199Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8956467Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8956575Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8956767Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8956896Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8957037Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8957187Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8957519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8957842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8958133Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8958384Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8958663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8959013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8959282Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8959405Z Execution Analysis: (:1) 2024-12-18T00:21:05.8959644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8959837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8959841Z 2024-12-18T00:21:05.8960025Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8960127Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8960343Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8960441Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8960637Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8960771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8960908Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8961059Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8961605Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8962137Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8962467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8962796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8963082Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8963345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8963629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8963880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8963976Z Execution Analysis: .......... 2024-12-18T00:21:05.8964211Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8964401Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8964667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1777 counts during 1693 steps 2024-12-18T00:21:05.8964671Z 2024-12-18T00:21:05.8964863Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8964967Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8965251Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8965350Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8965542Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8965673Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8965803Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8965962Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8966287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8966615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8966899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8967156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8967532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8967800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8968073Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8968187Z Execution Analysis: (:1) 2024-12-18T00:21:05.8968428Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8968613Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8968617Z 2024-12-18T00:21:05.8968806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8968908Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8969124Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8969226Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8969421Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8969558Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8969693Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8969857Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8970401Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8970939Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8971268Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8971588Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8971890Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8972140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8972431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8972679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8972785Z Execution Analysis: .......... 2024-12-18T00:21:05.8973020Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8973213Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8973476Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1778 counts during 1694 steps 2024-12-18T00:21:05.8973480Z 2024-12-18T00:21:05.8973665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8973783Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8974052Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8974161Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8974348Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8974487Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8974619Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8974771Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8975106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8975429Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8975721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8975995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8976438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8976690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8977135Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8977269Z Execution Analysis: (:1) 2024-12-18T00:21:05.8977525Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8977780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8977785Z 2024-12-18T00:21:05.8977981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8978101Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8978334Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8978456Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8978661Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8978801Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8978952Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8979118Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8979715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8980284Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8980646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8980998Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8981319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8981589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8981895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8982168Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8982272Z Execution Analysis: .......... 2024-12-18T00:21:05.8982534Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8982735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8983028Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1779 counts during 1695 steps 2024-12-18T00:21:05.8983033Z 2024-12-18T00:21:05.8983240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8983350Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8983645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8983753Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8983962Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8984104Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8984250Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8984417Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8984774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8985132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8985464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8985816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8986123Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8986394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8986684Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8986811Z Execution Analysis: (:1) 2024-12-18T00:21:05.8987069Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8987270Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8987274Z 2024-12-18T00:21:05.8987479Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8987595Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8987829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8987936Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8988145Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8988285Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8988429Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8988600Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8989279Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8989822Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8990153Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8990491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8990776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8991034Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8991317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8991563Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8991669Z Execution Analysis: .......... 2024-12-18T00:21:05.8991908Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8992103Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8992372Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1780 counts during 1696 steps 2024-12-18T00:21:05.8992379Z 2024-12-18T00:21:05.8992581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8992685Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8992962Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.8993065Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8993255Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.8993392Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.8993526Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.8993690Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8994019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.8994373Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8994730Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8994986Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.8995273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.8995521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.8995796Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.8995912Z Execution Analysis: (:1) 2024-12-18T00:21:05.8996159Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.8996350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8996354Z 2024-12-18T00:21:05.8996548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.8996660Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.8996872Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.8996982Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.8997173Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.8997315Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.8997449Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.8997603Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.8998154Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.8998681Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.8999025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.8999347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.8999647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.8999898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9000191Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9000435Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9000529Z Execution Analysis: .......... 2024-12-18T00:21:05.9000774Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9000961Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9001240Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1781 counts during 1697 steps 2024-12-18T00:21:05.9001244Z 2024-12-18T00:21:05.9001429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9001543Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9001807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9001916Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9002100Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9002231Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9002370Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9002523Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9002862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9003280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9003579Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9003827Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9004109Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9004362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9004628Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9004749Z Execution Analysis: (:1) 2024-12-18T00:21:05.9004986Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9005184Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9005192Z 2024-12-18T00:21:05.9005375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9005489Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9005698Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9005796Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9005998Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9006130Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9006272Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9006422Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9006971Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9007500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9007831Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9008158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9008442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9008701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9008983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9009240Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9009335Z Execution Analysis: .......... 2024-12-18T00:21:05.9009578Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9009768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9010035Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1782 counts during 1698 steps 2024-12-18T00:21:05.9010039Z 2024-12-18T00:21:05.9010236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9010340Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9010617Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9010718Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9010916Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9011046Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9011178Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9011341Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9011725Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9012099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9012382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9012645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9012928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9013184Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9013453Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9013568Z Execution Analysis: (:1) 2024-12-18T00:21:05.9013813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9014009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9014013Z 2024-12-18T00:21:05.9014208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9014312Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9014531Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9014630Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9014819Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9014963Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9015099Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9015260Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9015805Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9016433Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9016931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9017294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9017603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9017875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9018193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9018462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9018579Z Execution Analysis: .......... 2024-12-18T00:21:05.9018838Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9019052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9019338Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1783 counts during 1699 steps 2024-12-18T00:21:05.9019343Z 2024-12-18T00:21:05.9019556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9019668Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9019958Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9020077Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9020280Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9020430Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9020573Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9020820Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9021205Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9021554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9021869Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9022138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9022454Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9022721Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9023020Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9023142Z Execution Analysis: (:1) 2024-12-18T00:21:05.9023406Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9023620Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9023624Z 2024-12-18T00:21:05.9023829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9023954Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9024183Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9024303Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9024506Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9024647Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9024798Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9024962Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9025566Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9026140Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9026507Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9026854Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9027172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9027443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9027749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9028024Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9028131Z Execution Analysis: .......... 2024-12-18T00:21:05.9028401Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9028603Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9028897Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1784 counts during 1700 steps 2024-12-18T00:21:05.9028902Z 2024-12-18T00:21:05.9029205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9029428Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9029693Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9029794Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9029988Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9030119Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9030328Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9030507Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9030844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9031163Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9031448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9031706Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9031990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9032243Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9032512Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9032643Z Execution Analysis: (:1) 2024-12-18T00:21:05.9032882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9033070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9033084Z 2024-12-18T00:21:05.9033268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9033372Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9033593Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9033693Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9033892Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9034024Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9034156Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9034318Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9034864Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9035403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9035732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9036063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9036349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9036608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9036894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9037158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9037257Z Execution Analysis: .......... 2024-12-18T00:21:05.9037496Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9037695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9037960Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1785 counts during 1701 steps 2024-12-18T00:21:05.9037964Z 2024-12-18T00:21:05.9038158Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9038261Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9038538Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9038637Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9038849Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9039069Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9039200Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9039362Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9039690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9040023Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9040308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9040557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9040848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9041094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9041376Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9041490Z Execution Analysis: (:1) 2024-12-18T00:21:05.9041735Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9041920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9041924Z 2024-12-18T00:21:05.9042118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9042221Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9042431Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9042536Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9042724Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9042863Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9042997Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9043162Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9043703Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9044855Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9045224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9045575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9045895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9046165Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9046485Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9046753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9046865Z Execution Analysis: .......... 2024-12-18T00:21:05.9047120Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9047323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9047621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1786 counts during 1702 steps 2024-12-18T00:21:05.9047627Z 2024-12-18T00:21:05.9047826Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9047949Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9048236Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9048414Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9048714Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9048858Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9049005Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9049171Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9049534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9049880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9050201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9050471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9050782Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9051048Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9051338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9051471Z Execution Analysis: (:1) 2024-12-18T00:21:05.9051725Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9051934Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9051939Z 2024-12-18T00:21:05.9052136Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9052256Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9052482Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9052590Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9052801Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9052948Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9053106Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9053271Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9053865Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9054435Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9054804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9055151Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9055462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9055741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9056050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9056327Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9056506Z Execution Analysis: .......... 2024-12-18T00:21:05.9056778Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9056977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9057265Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1788 counts during 1703 steps 2024-12-18T00:21:05.9057280Z 2024-12-18T00:21:05.9057480Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9057594Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9057922Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9058104Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9058316Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9058456Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9058597Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9058772Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9059129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9059489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9059798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9060078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9060389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9060675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9060961Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9061084Z Execution Analysis: (:1) 2024-12-18T00:21:05.9061348Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9061548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9061553Z 2024-12-18T00:21:05.9061761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9061870Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9062108Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9062217Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9062430Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9062584Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9062728Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9062899Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9063489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9064067Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9064421Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9064780Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9065095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9065369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9065682Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9065950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9066062Z Execution Analysis: .......... 2024-12-18T00:21:05.9066316Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9066525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9066811Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1789 counts during 1704 steps 2024-12-18T00:21:05.9066816Z 2024-12-18T00:21:05.9067027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9067193Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9067532Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9067649Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9067849Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9067997Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9068137Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9068313Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9068771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9069093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9069385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9069638Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9069934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9070182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9070458Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9070571Z Execution Analysis: (:1) 2024-12-18T00:21:05.9070807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9070998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9071003Z 2024-12-18T00:21:05.9071186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9071298Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9071510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9071622Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9071813Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9071949Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9072081Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9072234Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9072787Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9073314Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9073649Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9073973Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9074270Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9074518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9074808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9075052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9075146Z Execution Analysis: .......... 2024-12-18T00:21:05.9075391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9075580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9075855Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1790 counts during 1705 steps 2024-12-18T00:21:05.9075859Z 2024-12-18T00:21:05.9076138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9076342Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9076614Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9076713Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9076916Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9077051Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9077192Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9077346Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9077685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9078004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9078292Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9078561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9078844Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9079102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9079370Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9079497Z Execution Analysis: (:1) 2024-12-18T00:21:05.9079736Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9079936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9079940Z 2024-12-18T00:21:05.9080127Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9080396Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9080642Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9080816Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9081030Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9081168Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9081321Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9081484Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9082060Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9082626Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9082974Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9083332Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9083635Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9083914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9084214Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9084481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9084585Z Execution Analysis: .......... 2024-12-18T00:21:05.9084834Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9085041Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9085323Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1791 counts during 1706 steps 2024-12-18T00:21:05.9085396Z 2024-12-18T00:21:05.9085630Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9085745Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9086038Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9086143Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9086343Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9086489Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9086627Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9086798Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9087143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9087490Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9087797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9088068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9088364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9088620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9088910Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9089030Z Execution Analysis: (:1) 2024-12-18T00:21:05.9089290Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9089487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9089491Z 2024-12-18T00:21:05.9089695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9089809Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9090033Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9090146Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9090347Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9090497Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9090634Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9090808Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9091379Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9092115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9092477Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9092830Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9093149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9093422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9093739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9094003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9094118Z Execution Analysis: .......... 2024-12-18T00:21:05.9094373Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9094573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9094968Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1792 counts during 1707 steps 2024-12-18T00:21:05.9094973Z 2024-12-18T00:21:05.9095175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9095298Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9095588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9095707Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9095909Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9096062Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9096203Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9096437Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9096804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9097155Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9097479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9097752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9098069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9098336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9098628Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9098765Z Execution Analysis: (:1) 2024-12-18T00:21:05.9099023Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9099240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9099248Z 2024-12-18T00:21:05.9099449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9099571Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9099800Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9099921Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9100128Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9100272Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9100427Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9100595Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9101191Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9101765Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9102135Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9102485Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9102796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9103077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9103385Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9103662Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9103767Z Execution Analysis: .......... 2024-12-18T00:21:05.9104035Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9104262Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9104633Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1793 counts during 1708 steps 2024-12-18T00:21:05.9104639Z 2024-12-18T00:21:05.9104839Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9104955Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9105252Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9105361Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9105575Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9105717Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9105870Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9106036Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9106391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9106758Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9107068Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9107346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9107652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9107935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9108228Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9108354Z Execution Analysis: (:1) 2024-12-18T00:21:05.9108620Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9108823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9108833Z 2024-12-18T00:21:05.9109146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9109423Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9109666Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9109772Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9109988Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9110133Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9110282Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9110455Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9111048Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9111634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9111992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9112353Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9112661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9112946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9113250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9113518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9113630Z Execution Analysis: .......... 2024-12-18T00:21:05.9113915Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9114227Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9114519Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1794 counts during 1709 steps 2024-12-18T00:21:05.9114523Z 2024-12-18T00:21:05.9114736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9114845Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9115135Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9115255Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9115459Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9115613Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9115755Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9115934Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9116295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9116643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9116969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9117243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9117557Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9117821Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9118123Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9118246Z Execution Analysis: (:1) 2024-12-18T00:21:05.9118515Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9118721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9118726Z 2024-12-18T00:21:05.9118927Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9119052Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9119280Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9119401Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9119608Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9119760Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9119903Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9120070Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9120671Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9121247Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9121615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9121964Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9122284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9122556Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9122879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9123149Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9123285Z Execution Analysis: .......... 2024-12-18T00:21:05.9123855Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9124062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9124361Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1795 counts during 1710 steps 2024-12-18T00:21:05.9124366Z 2024-12-18T00:21:05.9124569Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9124694Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9124985Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9125109Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9125312Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9125457Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9125613Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9125784Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9126150Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9126500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9126825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9127095Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9127402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9127680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9127972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9128111Z Execution Analysis: (:1) 2024-12-18T00:21:05.9128371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9128588Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9128592Z 2024-12-18T00:21:05.9128793Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9128907Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9129145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9129256Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9129473Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9129617Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9129774Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9129943Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9130543Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9131127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9131484Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9131840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9132154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9132433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9132740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9133046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9133227Z Execution Analysis: .......... 2024-12-18T00:21:05.9133489Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9133698Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9133986Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1796 counts during 1711 steps 2024-12-18T00:21:05.9133990Z 2024-12-18T00:21:05.9134201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9134311Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9134611Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9134718Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9134937Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9135083Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9135228Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9135400Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9135758Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9136119Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9136502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9136790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9137094Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9137362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9137663Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9137791Z Execution Analysis: (:1) 2024-12-18T00:21:05.9138056Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9138262Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9138266Z 2024-12-18T00:21:05.9138478Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9138590Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9138831Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9138937Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9139142Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9139297Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9139443Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9139624Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9140217Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9140805Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9141163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9141512Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9141833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9142105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9142448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9142788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9142907Z Execution Analysis: .......... 2024-12-18T00:21:05.9143162Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9143373Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9143661Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1797 counts during 1712 steps 2024-12-18T00:21:05.9143666Z 2024-12-18T00:21:05.9143868Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9143989Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9144421Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9144549Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9144759Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9144923Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9145064Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9145234Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9145604Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9145955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9146278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9146548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9146867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9147137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9147432Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9147564Z Execution Analysis: (:1) 2024-12-18T00:21:05.9147822Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9148036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9148040Z 2024-12-18T00:21:05.9148242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9148366Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9148593Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9148715Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9148919Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9149064Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9149227Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9149393Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9149996Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9150566Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9150937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9151283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9151608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9151946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9152352Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9152630Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9152736Z Execution Analysis: .......... 2024-12-18T00:21:05.9153004Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9153207Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9153507Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1798 counts during 1713 steps 2024-12-18T00:21:05.9153511Z 2024-12-18T00:21:05.9153711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9153825Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9154126Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9154241Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9154457Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9154598Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9154752Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9154916Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9155274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9155633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9155943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9156324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9156622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9156898Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9157177Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9157307Z Execution Analysis: (:1) 2024-12-18T00:21:05.9157556Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9157752Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9157757Z 2024-12-18T00:21:05.9157959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9158069Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9158301Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9158407Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9158624Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9158765Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9158905Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9159075Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9159651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9160215Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9160563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9160912Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9161215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9161592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9161894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9162153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9162262Z Execution Analysis: .......... 2024-12-18T00:21:05.9162513Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9162719Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9162998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1799 counts during 1714 steps 2024-12-18T00:21:05.9163003Z 2024-12-18T00:21:05.9163212Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9163323Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9163620Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9163724Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9163922Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9164069Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9164208Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9164380Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9164725Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9165076Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9165373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9165639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9165954Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9166216Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9166520Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9166640Z Execution Analysis: (:1) 2024-12-18T00:21:05.9166902Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9167100Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9167104Z 2024-12-18T00:21:05.9167311Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9167425Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9167652Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9167780Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9167987Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9168143Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9168286Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9168451Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9169039Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9169596Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9169959Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9170302Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9170714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9170979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9171291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9171555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9171663Z Execution Analysis: .......... 2024-12-18T00:21:05.9171930Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9172129Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9172424Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1800 counts during 1715 steps 2024-12-18T00:21:05.9172429Z 2024-12-18T00:21:05.9172629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9172759Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9173043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9173164Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9173367Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9173510Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9173665Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9173827Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9174188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9174529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9174846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9175117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9175422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9175694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9175982Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9176113Z Execution Analysis: (:1) 2024-12-18T00:21:05.9176437Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9176647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9176652Z 2024-12-18T00:21:05.9177020Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9177145Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9177380Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9177498Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9177778Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9177921Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9178081Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9178248Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9178847Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9179422Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9179781Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9180172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9180569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9180853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9181159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9181433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9181541Z Execution Analysis: .......... 2024-12-18T00:21:05.9181806Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9182012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9182300Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1801 counts during 1716 steps 2024-12-18T00:21:05.9182305Z 2024-12-18T00:21:05.9182521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9182637Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9182934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9183039Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9183245Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9183389Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9183531Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9183709Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9184068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9184429Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9184741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9185031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9185338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9185616Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9185908Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9186031Z Execution Analysis: (:1) 2024-12-18T00:21:05.9186299Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9186502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9186506Z 2024-12-18T00:21:05.9186715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9186833Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9187073Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9187184Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9187391Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9187545Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9187688Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9187869Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9188462Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9189149Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9189512Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9189918Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9190209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9190463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9190759Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9191005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9191116Z Execution Analysis: .......... 2024-12-18T00:21:05.9191353Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9191553Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9191998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1802 counts during 1717 steps 2024-12-18T00:21:05.9192005Z 2024-12-18T00:21:05.9192217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9192328Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9192609Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9192733Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9192931Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9193081Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9193220Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9193382Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9193743Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9194089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9194408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9194673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9194986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9195247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9195548Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9195672Z Execution Analysis: (:1) 2024-12-18T00:21:05.9195923Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9196134Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9196138Z 2024-12-18T00:21:05.9196341Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9196463Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9196687Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9196806Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9197009Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9197150Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9197306Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9197473Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9198061Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9198619Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9199081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9199422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9199738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9200008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9200306Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9200579Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9200681Z Execution Analysis: .......... 2024-12-18T00:21:05.9200945Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9201148Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9201444Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1803 counts during 1718 steps 2024-12-18T00:21:05.9201448Z 2024-12-18T00:21:05.9201647Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9201768Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9202051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9202157Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9202369Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9202506Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9202660Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9202822Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9203183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9203636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9203926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9204192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9204478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9204740Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9205010Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9205139Z Execution Analysis: (:1) 2024-12-18T00:21:05.9205382Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9205572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9205589Z 2024-12-18T00:21:05.9205780Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9205884Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9206108Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9206211Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9206418Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9206554Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9206691Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9206860Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9207411Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9208003Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9208381Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9208716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9209003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9209263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9209549Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9209808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9209907Z Execution Analysis: .......... 2024-12-18T00:21:05.9210143Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9210350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9210617Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1804 counts during 1719 steps 2024-12-18T00:21:05.9210621Z 2024-12-18T00:21:05.9210821Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9210929Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9211215Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9211317Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9211508Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9211653Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9211784Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9211952Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9212287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9212627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9212916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9213169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9213466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9213715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9213999Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9214118Z Execution Analysis: (:1) 2024-12-18T00:21:05.9214371Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9214568Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9214572Z 2024-12-18T00:21:05.9214768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9214876Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9215092Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9215207Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9215399Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9215547Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9215682Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9215852Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9216500Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9217393Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9217773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9218125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9218454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9218726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9219051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9219320Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9219440Z Execution Analysis: .......... 2024-12-18T00:21:05.9219708Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9219913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9220221Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1805 counts during 1720 steps 2024-12-18T00:21:05.9220227Z 2024-12-18T00:21:05.9220428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9220556Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9220846Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9220971Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9221178Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9221323Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9221476Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9221650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9222028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9222379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9222704Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9222976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9223295Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9223561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9223851Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9223989Z Execution Analysis: (:1) 2024-12-18T00:21:05.9224249Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9224463Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9224467Z 2024-12-18T00:21:05.9224668Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9224792Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9225025Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9225133Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9225351Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9225492Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9225652Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9225822Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9226473Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9227091Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9227458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9227812Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9228124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9228417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9228727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9229115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9229222Z Execution Analysis: .......... 2024-12-18T00:21:05.9229583Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9229775Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9230039Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1806 counts during 1721 steps 2024-12-18T00:21:05.9230055Z 2024-12-18T00:21:05.9230244Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9230352Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9230631Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9230732Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9230933Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9231066Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9231204Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9231375Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9231705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9232039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9232327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9232589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9232871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9233129Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9233402Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9233523Z Execution Analysis: (:1) 2024-12-18T00:21:05.9233776Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9233963Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9233967Z 2024-12-18T00:21:05.9234167Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9234270Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9234496Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9234600Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9234792Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9234937Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9235075Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9235266Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9235886Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9236428Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9236760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9237098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9237387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9237640Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9237936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9238188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9238302Z Execution Analysis: .......... 2024-12-18T00:21:05.9238543Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9238746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9239016Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1807 counts during 1722 steps 2024-12-18T00:21:05.9239020Z 2024-12-18T00:21:05.9239216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9239323Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9239595Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9239706Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9239896Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9240046Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9240178Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9240345Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9240678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9241003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9241302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9241555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9241849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9242096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9242391Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9242509Z Execution Analysis: (:1) 2024-12-18T00:21:05.9242749Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9242952Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9242957Z 2024-12-18T00:21:05.9243144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9243265Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9243476Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9243590Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9243782Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9243927Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9244113Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9244665Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9245278Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9245851Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9246221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9246572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9246897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9247169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9247496Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9247767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9247872Z Execution Analysis: .......... 2024-12-18T00:21:05.9248143Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9248346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9248647Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1809 counts during 1723 steps 2024-12-18T00:21:05.9248651Z 2024-12-18T00:21:05.9248857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9248983Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9249276Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9249390Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9249615Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9249758Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9249914Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9250085Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9250457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9250810Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9251120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9251407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9251713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9251997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9252291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9252430Z Execution Analysis: (:1) 2024-12-18T00:21:05.9252685Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9252900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9252904Z 2024-12-18T00:21:05.9253109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9253223Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9253466Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9253575Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9253797Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9254051Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9254235Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9254405Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9255001Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9255588Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9255948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9256305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9256693Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9256979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9257290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9257567Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9257674Z Execution Analysis: .......... 2024-12-18T00:21:05.9257934Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9258147Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9258436Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1810 counts during 1724 steps 2024-12-18T00:21:05.9258441Z 2024-12-18T00:21:05.9258655Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9258768Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9259069Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9259184Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9259389Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9259544Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9259686Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9259859Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9260216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9260574Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9260883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9261162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9261474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9261747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9262048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9262173Z Execution Analysis: (:1) 2024-12-18T00:21:05.9262443Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9262645Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9262649Z 2024-12-18T00:21:05.9262857Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9262969Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9263202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9263322Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9263615Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9263795Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9263944Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9264119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9264707Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9265286Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9265642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9265991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9266312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9266588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9266902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9267168Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9267281Z Execution Analysis: .......... 2024-12-18T00:21:05.9267538Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9267739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9268034Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1811 counts during 1725 steps 2024-12-18T00:21:05.9268039Z 2024-12-18T00:21:05.9268240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9268370Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9268660Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9268778Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9269075Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9269218Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9269349Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9269503Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9269838Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9270163Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9270456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9270706Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9271003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9271246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9271516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9271640Z Execution Analysis: (:1) 2024-12-18T00:21:05.9271879Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9272073Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9272077Z 2024-12-18T00:21:05.9272262Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9272375Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9272612Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9272773Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9272989Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9273124Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9273266Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9273420Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9273974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9274499Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9274836Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9275163Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9275457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9275717Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9276002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9276256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9276353Z Execution Analysis: .......... 2024-12-18T00:21:05.9276593Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9276781Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9277056Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1812 counts during 1726 steps 2024-12-18T00:21:05.9277060Z 2024-12-18T00:21:05.9277246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9277357Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9277633Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9277735Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9277931Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9278065Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9278207Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9278361Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9278693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9279024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9279314Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9279576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9279859Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9280113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9280382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9280496Z Execution Analysis: (:1) 2024-12-18T00:21:05.9280742Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9280930Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9280934Z 2024-12-18T00:21:05.9281127Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9281255Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9281541Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9281640Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9281841Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9281972Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9282108Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9282268Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9282811Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9283347Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9283680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9284019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9284308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9284570Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9284850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9285096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9285199Z Execution Analysis: .......... 2024-12-18T00:21:05.9285436Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9285629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9285893Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1813 counts during 1727 steps 2024-12-18T00:21:05.9285902Z 2024-12-18T00:21:05.9286095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9286200Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9286468Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9286578Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9286768Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9286906Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9287038Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9287196Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9287525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9287847Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9288149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9288401Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9288694Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9288942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9289222Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9289340Z Execution Analysis: (:1) 2024-12-18T00:21:05.9289589Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9289776Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9289780Z 2024-12-18T00:21:05.9290005Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9290189Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9290405Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9290513Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9290703Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9290845Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9290978Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9291131Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9291686Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9292220Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9292563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9292890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9293187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9293439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9293731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9293976Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9294077Z Execution Analysis: .......... 2024-12-18T00:21:05.9294324Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9294511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9294790Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1814 counts during 1728 steps 2024-12-18T00:21:05.9294795Z 2024-12-18T00:21:05.9294981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9295093Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9295362Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9295468Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9299631Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9299801Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9299953Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9300122Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9300494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9300865Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9301187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9301465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9301775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9302047Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9302335Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9302465Z Execution Analysis: (:1) 2024-12-18T00:21:05.9302727Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9302930Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9303071Z 2024-12-18T00:21:05.9303306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9303423Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9303656Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9303765Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9303982Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9304126Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9304271Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9304445Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9305042Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9305630Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9305996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9306352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9306661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9306939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9307250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9307523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9307628Z Execution Analysis: .......... 2024-12-18T00:21:05.9307888Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9308106Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9308396Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1815 counts during 1729 steps 2024-12-18T00:21:05.9308402Z 2024-12-18T00:21:05.9308609Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9308722Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9309125Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9309233Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9309430Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9309571Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9309707Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9309874Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9310221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9310570Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9310871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9311132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9311434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9311689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9311977Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9312095Z Execution Analysis: (:1) 2024-12-18T00:21:05.9312349Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9312573Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9312650Z 2024-12-18T00:21:05.9312852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9312961Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9313180Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9313292Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9313494Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9313638Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9313779Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9314108Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9314698Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9315277Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9315638Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9315986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9316404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9316665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9316965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9317225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9317335Z Execution Analysis: .......... 2024-12-18T00:21:05.9317587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9317949Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9318245Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1816 counts during 1730 steps 2024-12-18T00:21:05.9318250Z 2024-12-18T00:21:05.9318453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9318572Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9318861Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9318972Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9319174Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9319316Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9319465Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9319631Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9320000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9320346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9320662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9320930Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9321243Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9321510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9321802Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9321930Z Execution Analysis: (:1) 2024-12-18T00:21:05.9322213Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9322508Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9322513Z 2024-12-18T00:21:05.9322718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9322835Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9323065Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9323175Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9323384Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9323525Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9323676Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9323843Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9324443Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9325021Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9325387Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9325735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9326046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9326321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9326625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9326894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9327002Z Execution Analysis: .......... 2024-12-18T00:21:05.9327266Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9327471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9327758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1817 counts during 1731 steps 2024-12-18T00:21:05.9327769Z 2024-12-18T00:21:05.9327972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9328085Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9328381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9328490Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9328698Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9328838Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9328976Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9329158Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9329510Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9329867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9330174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9330454Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9330759Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9331034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9331325Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9331475Z Execution Analysis: (:1) 2024-12-18T00:21:05.9331813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9332021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9332026Z 2024-12-18T00:21:05.9332229Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9332341Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9332574Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9332682Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9332888Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9333038Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9333184Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9333357Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9333956Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9334532Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9334886Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9335243Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9335552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9335825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9336139Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9336498Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9336618Z Execution Analysis: .......... 2024-12-18T00:21:05.9336874Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9337081Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9337370Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1818 counts during 1732 steps 2024-12-18T00:21:05.9337376Z 2024-12-18T00:21:05.9337581Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9337693Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9337981Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9338095Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9338301Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9338454Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9338594Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9338765Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9339116Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9339465Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9339778Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9340046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9340357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9340620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9340949Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9341153Z Execution Analysis: (:1) 2024-12-18T00:21:05.9341411Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9341618Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9341623Z 2024-12-18T00:21:05.9341823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9341941Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9342168Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9342283Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9342492Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9342644Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9342788Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9342961Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9343558Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9344125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9344654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9345008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9345325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9345598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9345910Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9346179Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9346286Z Execution Analysis: .......... 2024-12-18T00:21:05.9346545Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9346747Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9347042Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1819 counts during 1733 steps 2024-12-18T00:21:05.9347046Z 2024-12-18T00:21:05.9347248Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9347367Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9347660Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9347770Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9347990Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9348134Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9348282Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9348447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9348808Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9349158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9349467Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9349741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9350049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9350376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9350765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9350897Z Execution Analysis: (:1) 2024-12-18T00:21:05.9351152Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9351361Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9351365Z 2024-12-18T00:21:05.9351564Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9351676Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9351912Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9352019Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9352232Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9352377Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9352532Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9352696Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9353286Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9353861Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9354219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9354574Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9354883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9355162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9355471Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9355742Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9355847Z Execution Analysis: .......... 2024-12-18T00:21:05.9356210Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9356411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9356689Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1820 counts during 1734 steps 2024-12-18T00:21:05.9356694Z 2024-12-18T00:21:05.9356892Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9357000Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9357291Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9357400Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9357599Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9357744Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9357879Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9358046Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9358388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9358735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9359034Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9359300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9359596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9360204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9360492Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9360611Z Execution Analysis: (:1) 2024-12-18T00:21:05.9360867Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9361062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9361066Z 2024-12-18T00:21:05.9361266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9361375Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9361595Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9361709Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9361909Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9362059Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9362201Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9362367Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9362941Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9363502Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9363848Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9364188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9364493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9364764Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9365066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9365325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9365432Z Execution Analysis: .......... 2024-12-18T00:21:05.9365680Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9365876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9366159Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1821 counts during 1735 steps 2024-12-18T00:21:05.9366163Z 2024-12-18T00:21:05.9366357Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9366468Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9366754Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9366863Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9367061Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9367206Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9367342Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9367505Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9367855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9368193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9368502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9368764Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9369257Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9369519Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9369801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9369927Z Execution Analysis: (:1) 2024-12-18T00:21:05.9370182Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9370383Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9370387Z 2024-12-18T00:21:05.9370585Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9370705Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9370928Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9371047Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9371249Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9371388Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9371539Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9371699Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9372275Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9372829Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9373182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9373524Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9373830Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9374102Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9374402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9374672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9374773Z Execution Analysis: .......... 2024-12-18T00:21:05.9375038Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9375234Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9375524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1822 counts during 1736 steps 2024-12-18T00:21:05.9375528Z 2024-12-18T00:21:05.9375727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9375839Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9376125Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9376232Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9376529Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9376669Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9376980Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9377144Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9377500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9377854Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9378161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9378499Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9378854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9379125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9379413Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9379537Z Execution Analysis: (:1) 2024-12-18T00:21:05.9379800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9380001Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9380005Z 2024-12-18T00:21:05.9380208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9380319Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9380559Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9380667Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9380878Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9381017Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9381162Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9381331Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9381919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9382497Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9382851Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9383210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9383529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9383806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9384109Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9384375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9384484Z Execution Analysis: .......... 2024-12-18T00:21:05.9384739Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9384946Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9385233Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1823 counts during 1737 steps 2024-12-18T00:21:05.9385239Z 2024-12-18T00:21:05.9385450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9385561Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9385848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9385964Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9386169Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9386314Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9386454Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9386624Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9386979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9387329Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9387667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9388014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9388323Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9388590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9388880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9389002Z Execution Analysis: (:1) 2024-12-18T00:21:05.9389268Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9389468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9389472Z 2024-12-18T00:21:05.9389676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9389801Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9390041Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9390161Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9390369Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9390519Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9390667Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9390834Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9391431Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9392010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9392378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9392736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9393055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9393328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9393645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9393912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9394021Z Execution Analysis: .......... 2024-12-18T00:21:05.9394286Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9394489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9394788Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1824 counts during 1738 steps 2024-12-18T00:21:05.9394798Z 2024-12-18T00:21:05.9395000Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9395120Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9395410Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9395528Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9395731Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9395873Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9396023Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9396190Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9396553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9396933Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9397335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9397614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9397922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9398193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9398480Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9398608Z Execution Analysis: (:1) 2024-12-18T00:21:05.9398869Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9399079Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9399084Z 2024-12-18T00:21:05.9399296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9399418Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9399643Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9399753Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9399973Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9400119Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9400273Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9400438Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9401028Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9401605Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9401965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9402318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9402629Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9402908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9403215Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9403488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9403593Z Execution Analysis: .......... 2024-12-18T00:21:05.9403848Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9404057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9404349Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1825 counts during 1739 steps 2024-12-18T00:21:05.9404354Z 2024-12-18T00:21:05.9404559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9404670Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9404972Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9405080Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9405291Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9405432Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9405572Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9405740Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9406126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9406558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9406868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9407148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9407452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9407716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9408010Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9408135Z Execution Analysis: (:1) 2024-12-18T00:21:05.9408400Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9408605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9408613Z 2024-12-18T00:21:05.9408822Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9408932Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9409167Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9409275Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9409481Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9409630Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9409777Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9409949Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9410540Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9411125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9411486Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9411837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9412153Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9412426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9412739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9413006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9413119Z Execution Analysis: .......... 2024-12-18T00:21:05.9413378Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9413596Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9413885Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1826 counts during 1740 steps 2024-12-18T00:21:05.9413890Z 2024-12-18T00:21:05.9414092Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9414214Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9414507Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9414626Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9414829Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9414977Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9415120Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9415288Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9415773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9416125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9416537Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9416816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9417131Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9417403Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9417703Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9417827Z Execution Analysis: (:1) 2024-12-18T00:21:05.9418086Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9418303Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9418308Z 2024-12-18T00:21:05.9418509Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9418631Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9418866Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9418985Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9419193Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9419336Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9419490Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9419661Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9420265Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9420841Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9421205Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9421558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9421877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9422148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9422459Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9422729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9422835Z Execution Analysis: .......... 2024-12-18T00:21:05.9423107Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9423310Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9423609Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1827 counts during 1741 steps 2024-12-18T00:21:05.9423614Z 2024-12-18T00:21:05.9423815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9423927Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9424225Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9424336Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9424552Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9424694Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9424847Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9425096Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9425478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9425832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9426142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9426417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9426724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9426998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9427289Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9427423Z Execution Analysis: (:1) 2024-12-18T00:21:05.9427687Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9427891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9427895Z 2024-12-18T00:21:05.9428108Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9428221Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9428459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9428571Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9428784Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9429036Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9429180Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9429450Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9430002Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9430543Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9430872Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9431199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9431485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9431740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9432023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9432270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9432381Z Execution Analysis: .......... 2024-12-18T00:21:05.9432621Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9432816Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9433082Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1828 counts during 1742 steps 2024-12-18T00:21:05.9433086Z 2024-12-18T00:21:05.9433280Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9433384Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9433657Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9433759Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9433950Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9434125Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9434332Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9434495Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9434822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9435154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9435442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9435696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9435982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9436231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9436511Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9436633Z Execution Analysis: (:1) 2024-12-18T00:21:05.9436879Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9437067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9437071Z 2024-12-18T00:21:05.9437265Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9437369Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9437583Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9437692Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9437886Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9438025Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9438161Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9438319Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9438874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9439402Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9439740Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9440063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9440362Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9440613Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9440907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9441161Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9441263Z Execution Analysis: .......... 2024-12-18T00:21:05.9441511Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9441700Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9441975Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1830 counts during 1743 steps 2024-12-18T00:21:05.9441980Z 2024-12-18T00:21:05.9442165Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9442276Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9442544Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9442658Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9442869Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9443071Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9443211Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9443369Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9443705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9444031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9444639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9444915Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9445223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9445496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9445794Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9445925Z Execution Analysis: (:1) 2024-12-18T00:21:05.9446180Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9446389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9446394Z 2024-12-18T00:21:05.9446594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9446716Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9446944Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9447054Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9447271Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9447415Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9447577Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9447745Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9448341Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9448910Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9449272Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9449630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9449939Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9450218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9450532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9450808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9450913Z Execution Analysis: .......... 2024-12-18T00:21:05.9451176Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9451378Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9451668Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1831 counts during 1744 steps 2024-12-18T00:21:05.9451673Z 2024-12-18T00:21:05.9451881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9451996Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9452292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9452518Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9452763Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9452906Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9453048Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9453219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9453574Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9453931Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9454240Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9454521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9454823Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9455102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9455397Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9455523Z Execution Analysis: (:1) 2024-12-18T00:21:05.9455789Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9455992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9455997Z 2024-12-18T00:21:05.9456211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9456324Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9456637Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9456749Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9456960Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9457118Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9457267Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9457447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9458039Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9458622Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9458983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9459344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9459655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9459932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9460250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9460518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9460633Z Execution Analysis: .......... 2024-12-18T00:21:05.9460890Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9461098Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9461387Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1832 counts during 1745 steps 2024-12-18T00:21:05.9461392Z 2024-12-18T00:21:05.9461601Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9461715Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9462034Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9462243Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9462447Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9462598Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9462741Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9462910Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9463269Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9463621Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9463938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9464213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9464536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9464812Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9465113Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9465238Z Execution Analysis: (:1) 2024-12-18T00:21:05.9465497Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9465705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9465710Z 2024-12-18T00:21:05.9465914Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9466033Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9466263Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9466382Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9466595Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9466742Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9466892Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9467059Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9467655Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9468224Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9468695Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9469037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9469347Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9469613Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9469913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9470178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9470283Z Execution Analysis: .......... 2024-12-18T00:21:05.9470544Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9470742Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9471029Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1833 counts during 1746 steps 2024-12-18T00:21:05.9471033Z 2024-12-18T00:21:05.9471230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9471420Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9471729Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9471838Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9472042Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9472184Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9472328Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9472489Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9472848Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9473188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9473491Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9473767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9474073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9474338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9474620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9474751Z Execution Analysis: (:1) 2024-12-18T00:21:05.9475000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9475197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9475208Z 2024-12-18T00:21:05.9475400Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9475512Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9475742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9475853Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9476064Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9476199Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9476347Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9476509Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9477087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9477650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9477999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9478357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9478665Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9479043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9479330Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9479590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9479687Z Execution Analysis: .......... 2024-12-18T00:21:05.9479924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9480124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9480396Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1834 counts during 1747 steps 2024-12-18T00:21:05.9480400Z 2024-12-18T00:21:05.9480625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9480797Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9481079Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9481180Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9481371Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9481512Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9481647Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9481814Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9482143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9482482Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9482771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9483031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9483326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9483577Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9483858Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9483976Z Execution Analysis: (:1) 2024-12-18T00:21:05.9484228Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9484415Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9484419Z 2024-12-18T00:21:05.9484621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9484729Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9484947Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9485059Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9485258Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9485404Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9485542Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9485707Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9486254Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9486785Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9487129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9487461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9487760Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9488013Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9488313Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9488561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9488672Z Execution Analysis: .......... 2024-12-18T00:21:05.9488910Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9489096Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9489395Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1835 counts during 1748 steps 2024-12-18T00:21:05.9489444Z 2024-12-18T00:21:05.9489653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9489771Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9490037Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9490155Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9490342Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9490475Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9490618Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9490773Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9491114Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9491437Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9491745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9491995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9492288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9492535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9492800Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9492927Z Execution Analysis: (:1) 2024-12-18T00:21:05.9493167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9493363Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9493367Z 2024-12-18T00:21:05.9493558Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9493678Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9493888Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9493991Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9494192Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9494324Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9494469Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9494626Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9495353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9495910Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9496274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9496698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9497172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9497453Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9497758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9498033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9498138Z Execution Analysis: .......... 2024-12-18T00:21:05.9498407Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9498609Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9499014Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1836 counts during 1749 steps 2024-12-18T00:21:05.9499031Z 2024-12-18T00:21:05.9499231Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9499344Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9499645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9499755Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9499976Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9500122Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9500279Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9500447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9500804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9501178Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9501492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9501779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9502085Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9502363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9502652Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9502777Z Execution Analysis: (:1) 2024-12-18T00:21:05.9503047Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9503251Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9503260Z 2024-12-18T00:21:05.9503474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9503589Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9503833Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9503943Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9504152Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9504305Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9504454Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9504631Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9505219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9505804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9506166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9506528Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9506836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9507110Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9507426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9507697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9507813Z Execution Analysis: .......... 2024-12-18T00:21:05.9508071Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9508389Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9508679Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1837 counts during 1750 steps 2024-12-18T00:21:05.9508684Z 2024-12-18T00:21:05.9508897Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9509116Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9509385Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9509496Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9509687Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9509829Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9509960Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9510130Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9510460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9510787Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9511088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9511338Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9511631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9511877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9512157Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9512270Z Execution Analysis: (:1) 2024-12-18T00:21:05.9512513Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9512714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9512720Z 2024-12-18T00:21:05.9512906Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9513021Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9513235Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9513353Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9513545Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9513691Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9513826Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9513981Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9514540Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9515078Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9515424Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9515751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9516053Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9516307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9516605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9516850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9516948Z Execution Analysis: .......... 2024-12-18T00:21:05.9517223Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9517565Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9518018Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1838 counts during 1751 steps 2024-12-18T00:21:05.9518023Z 2024-12-18T00:21:05.9518221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9518344Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9518627Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9518737Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9518946Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9519086Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9519238Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9519404Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9519770Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9520110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9520412Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9520687Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9520990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9521260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9521543Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9521676Z Execution Analysis: (:1) 2024-12-18T00:21:05.9521930Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9522146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9522150Z 2024-12-18T00:21:05.9522346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9522458Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9522692Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9522801Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9523013Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9523155Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9523308Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9523470Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9524052Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9524628Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9524977Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9525332Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9525636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9525915Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9526216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9526489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9526666Z Execution Analysis: .......... 2024-12-18T00:21:05.9526940Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9527149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9527436Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1839 counts during 1752 steps 2024-12-18T00:21:05.9527441Z 2024-12-18T00:21:05.9527652Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9527765Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9528057Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9528164Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9528366Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9528521Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9528667Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9528842Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9529190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9529546Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9529948Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9530216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9530499Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9530747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9531028Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9531147Z Execution Analysis: (:1) 2024-12-18T00:21:05.9531405Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9531594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9531599Z 2024-12-18T00:21:05.9531802Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9531908Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9532120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9532238Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9532431Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9532575Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9532708Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9532875Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9533430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9533972Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9534303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9534625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9534924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9535174Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9535467Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9535773Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9535933Z Execution Analysis: .......... 2024-12-18T00:21:05.9536170Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9536458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9536741Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1840 counts during 1753 steps 2024-12-18T00:21:05.9536745Z 2024-12-18T00:21:05.9537109Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9537236Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9537527Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9537650Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9537854Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9538017Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9538162Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9538329Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9538696Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9539047Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9539372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9539645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9539967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9540233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9540527Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9540665Z Execution Analysis: (:1) 2024-12-18T00:21:05.9540925Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9541141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9541145Z 2024-12-18T00:21:05.9541344Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9541470Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9541698Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9541824Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9542034Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9542176Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9542333Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9542505Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9543108Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9543680Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9544045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9544519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9544833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9545119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9545481Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9545858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9545967Z Execution Analysis: .......... 2024-12-18T00:21:05.9546243Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9546448Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9546756Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1841 counts during 1754 steps 2024-12-18T00:21:05.9546760Z 2024-12-18T00:21:05.9546964Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9547080Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9547386Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9547499Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9547724Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9547869Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9548028Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9548194Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9548555Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9548920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9549229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9549514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9549821Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9550104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9550401Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9550525Z Execution Analysis: (:1) 2024-12-18T00:21:05.9550796Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9550999Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9551003Z 2024-12-18T00:21:05.9551214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9551326Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9551567Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9551674Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9551891Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9552036Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9552187Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9552361Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9552953Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9553537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9553895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9554259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9554572Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9554886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9555265Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9555535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9555655Z Execution Analysis: .......... 2024-12-18T00:21:05.9555913Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9556332Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9556601Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1842 counts during 1755 steps 2024-12-18T00:21:05.9556605Z 2024-12-18T00:21:05.9556802Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9556903Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9557176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9557293Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9557486Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9557631Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9557760Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9557926Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9558252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9558577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9558873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9559124Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9559425Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9559675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9559956Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9560073Z Execution Analysis: (:1) 2024-12-18T00:21:05.9560325Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9560513Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9560518Z 2024-12-18T00:21:05.9560707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9560823Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9561037Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9561151Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9561346Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9561498Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9561636Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9561791Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9562345Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9562870Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9563212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9563539Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9563861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9564204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9564500Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9564748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9564848Z Execution Analysis: .......... 2024-12-18T00:21:05.9565096Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9565282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9565565Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1843 counts during 1756 steps 2024-12-18T00:21:05.9565569Z 2024-12-18T00:21:05.9565757Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9565877Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9566154Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9566266Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9566469Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9566601Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9566750Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9566906Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9567251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9567576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9567879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9568137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9568430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9568692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9568964Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9569097Z Execution Analysis: (:1) 2024-12-18T00:21:05.9569337Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9569539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9569543Z 2024-12-18T00:21:05.9569732Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9569851Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9570066Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9570174Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9570385Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9570519Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9570669Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9570826Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9571372Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9571918Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9572249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9572588Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9572984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9573253Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9573540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9573802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9573905Z Execution Analysis: .......... 2024-12-18T00:21:05.9574148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9574356Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9574621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1844 counts during 1757 steps 2024-12-18T00:21:05.9574625Z 2024-12-18T00:21:05.9574829Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9574938Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9575220Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9575325Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9575530Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9575667Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9575801Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9575971Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9576303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9576714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9577186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9577480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9577789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9578058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9578363Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9578489Z Execution Analysis: (:1) 2024-12-18T00:21:05.9578761Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9578962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9578967Z 2024-12-18T00:21:05.9579182Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9579298Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9579543Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9579655Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9579860Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9580018Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9580166Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9580351Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9580938Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9581518Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9581876Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9582303Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9582653Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9582922Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9583241Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9583509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9583628Z Execution Analysis: .......... 2024-12-18T00:21:05.9583885Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9584097Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9584388Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1845 counts during 1758 steps 2024-12-18T00:21:05.9584396Z 2024-12-18T00:21:05.9584602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9584735Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9585022Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9585142Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9585347Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9585502Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9585648Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9585815Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9586182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9586536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9586865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9587146Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9587465Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9587734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9588038Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9588165Z Execution Analysis: (:1) 2024-12-18T00:21:05.9588424Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9588642Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9588646Z 2024-12-18T00:21:05.9588849Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9588981Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9589315Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9589436Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9589643Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9589785Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9589943Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9590105Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9590696Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9591254Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9591648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9592317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9592639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9592911Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9593211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9593487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9593593Z Execution Analysis: .......... 2024-12-18T00:21:05.9593858Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9594055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9594357Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1846 counts during 1759 steps 2024-12-18T00:21:05.9594365Z 2024-12-18T00:21:05.9594565Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9594676Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9594974Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9595080Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9595289Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9595431Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9595578Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9595741Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9596090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9596449Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9596759Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9597035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9597335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9597611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9597895Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9598031Z Execution Analysis: (:1) 2024-12-18T00:21:05.9598448Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9598649Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9598654Z 2024-12-18T00:21:05.9598876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9598987Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9599232Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9599346Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9599565Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9599706Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9599853Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9600031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9600619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9601231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9601680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9602047Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9602359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9602642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9602950Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9603218Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9603338Z Execution Analysis: .......... 2024-12-18T00:21:05.9603597Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9603814Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9604109Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1847 counts during 1760 steps 2024-12-18T00:21:05.9604113Z 2024-12-18T00:21:05.9604434Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9604547Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9604842Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9604950Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9605152Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9605307Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9605453Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9605631Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9605982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9606341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9606647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9606914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9607226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9607489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9607953Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9608078Z Execution Analysis: (:1) 2024-12-18T00:21:05.9608349Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9608556Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9608564Z 2024-12-18T00:21:05.9608778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9608893Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9609120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9609243Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9609554Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9609706Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9609848Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9610012Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9610604Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9611211Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9611625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9611969Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9612286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9612553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9612863Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9613126Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9613230Z Execution Analysis: .......... 2024-12-18T00:21:05.9613497Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9613701Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9613997Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1848 counts during 1761 steps 2024-12-18T00:21:05.9614001Z 2024-12-18T00:21:05.9614200Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9614324Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9614613Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9614737Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9614938Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9615081Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9615237Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9615400Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9615766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9616110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9616494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9616929Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9617238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9617526Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9617820Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9617960Z Execution Analysis: (:1) 2024-12-18T00:21:05.9618221Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9618444Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9618448Z 2024-12-18T00:21:05.9618654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9618783Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9619017Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9619129Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9619353Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9619498Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9619658Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9619825Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9620456Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9621103Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9621461Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9621824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9622135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9622422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9622729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9623012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9623123Z Execution Analysis: .......... 2024-12-18T00:21:05.9623400Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9623604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9623891Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1849 counts during 1762 steps 2024-12-18T00:21:05.9623896Z 2024-12-18T00:21:05.9624110Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9624223Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9624527Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9624637Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9624852Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9624998Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9625138Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9625326Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9625684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9626050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9626362Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9626648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9626957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9627236Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9627531Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9627654Z Execution Analysis: (:1) 2024-12-18T00:21:05.9627931Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9628136Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9628141Z 2024-12-18T00:21:05.9628359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9628473Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9628718Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9628828Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9629139Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9629397Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9629534Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9629704Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9630298Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9630885Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9631220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9631559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9631849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9632103Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9632399Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9632646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9632763Z Execution Analysis: .......... 2024-12-18T00:21:05.9633004Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9633201Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9633474Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1851 counts during 1763 steps 2024-12-18T00:21:05.9633478Z 2024-12-18T00:21:05.9633675Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9633781Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9634053Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9634168Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9634360Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9634508Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9634650Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9634803Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9635147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9635471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9635774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9636027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9636325Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9636575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9636859Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9636979Z Execution Analysis: (:1) 2024-12-18T00:21:05.9637220Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9637421Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9637425Z 2024-12-18T00:21:05.9637613Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9637731Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9637942Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9638055Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9638248Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9638380Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9638530Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9638739Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9639363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9639896Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9640238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9640565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9640863Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9641119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9641405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9641672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9641771Z Execution Analysis: .......... 2024-12-18T00:21:05.9642023Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9642211Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9642492Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1852 counts during 1764 steps 2024-12-18T00:21:05.9642496Z 2024-12-18T00:21:05.9642686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9642802Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9643073Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9643176Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9643381Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9643520Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9643664Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9643819Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9644299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9644809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9645123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9645411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9645725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9646007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9646306Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9646443Z Execution Analysis: (:1) 2024-12-18T00:21:05.9646705Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9646907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9646924Z 2024-12-18T00:21:05.9647125Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9647238Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9647481Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9647589Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9647806Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9647949Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9648238Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9648437Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9649031Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9649685Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9650046Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9650416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9650724Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9651010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9651326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9651607Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9651716Z Execution Analysis: .......... 2024-12-18T00:21:05.9651974Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9652196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9652486Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1853 counts during 1765 steps 2024-12-18T00:21:05.9652490Z 2024-12-18T00:21:05.9652706Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9652819Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9653121Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9653240Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9653449Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9653604Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9653748Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9653927Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9654283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9654647Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9654959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9655232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9655553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9655828Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9656133Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9656262Z Execution Analysis: (:1) 2024-12-18T00:21:05.9656599Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9656811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9656815Z 2024-12-18T00:21:05.9657030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9657145Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9657377Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9657497Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9657705Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9657948Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9658122Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9658299Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9658892Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9659465Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9659834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9660186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9660507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9660786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9661104Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9661368Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9661488Z Execution Analysis: .......... 2024-12-18T00:21:05.9661744Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9661947Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9662243Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1854 counts during 1766 steps 2024-12-18T00:21:05.9662248Z 2024-12-18T00:21:05.9662450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9662569Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9662863Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9662990Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9663199Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9663343Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9663497Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9663665Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9664031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9664383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9664704Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9664977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9665299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9665570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9665863Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9665996Z Execution Analysis: (:1) 2024-12-18T00:21:05.9666255Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9666462Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9666466Z 2024-12-18T00:21:05.9666666Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9666785Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9667016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9667125Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9667519Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9667669Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9667826Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9667991Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9668594Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9669248Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9669587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9669910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9670200Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9670464Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9670744Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9671001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9671097Z Execution Analysis: .......... 2024-12-18T00:21:05.9671343Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9671531Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9671798Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1855 counts during 1767 steps 2024-12-18T00:21:05.9671813Z 2024-12-18T00:21:05.9671998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9672108Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9672387Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9672484Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9672679Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9672809Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9672950Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9673101Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9673429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9673765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9674052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9674318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9674604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9674860Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9675129Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9675245Z Execution Analysis: (:1) 2024-12-18T00:21:05.9675490Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9675676Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9675680Z 2024-12-18T00:21:05.9675874Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9675979Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9676224Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9676413Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9676609Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9676750Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9676886Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9677047Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9677594Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9678131Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9678462Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9678795Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9679086Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9679340Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9679638Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9679891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9680004Z Execution Analysis: .......... 2024-12-18T00:21:05.9680247Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9680445Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9680710Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1856 counts during 1768 steps 2024-12-18T00:21:05.9680714Z 2024-12-18T00:21:05.9680916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9681024Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9681292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9681402Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9681590Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9681731Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9681862Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9682023Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9682351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9682676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9682968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9683224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9683519Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9683767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9684044Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9684158Z Execution Analysis: (:1) 2024-12-18T00:21:05.9684400Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9684594Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9684598Z 2024-12-18T00:21:05.9684787Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9684969Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9685211Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9685325Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9685517Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9685659Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9685795Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9685951Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9686506Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9687036Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9687378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9687708Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9688004Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9688257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9688553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9688797Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9688898Z Execution Analysis: .......... 2024-12-18T00:21:05.9689142Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9689328Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9689603Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1857 counts during 1769 steps 2024-12-18T00:21:05.9689610Z 2024-12-18T00:21:05.9689798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9689915Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9690182Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9690286Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9690487Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9690618Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9690758Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9690911Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9691252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9691581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9691873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9692133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9692417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9692668Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9692934Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9693058Z Execution Analysis: (:1) 2024-12-18T00:21:05.9693296Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9693660Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9693664Z 2024-12-18T00:21:05.9693886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9694067Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9694303Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9694412Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9694626Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9694764Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9694917Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9695079Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9695655Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9696221Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9696648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9697167Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9697478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9701645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9702011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9702285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9702401Z Execution Analysis: .......... 2024-12-18T00:21:05.9702663Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9702880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9703179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1858 counts during 1770 steps 2024-12-18T00:21:05.9703186Z 2024-12-18T00:21:05.9703397Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9703509Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9703808Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9703919Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9704127Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9704278Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9704419Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9704591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9704949Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9705313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9705626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9705899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9706215Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9706481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9706779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9706904Z Execution Analysis: (:1) 2024-12-18T00:21:05.9707166Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9707369Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9707493Z 2024-12-18T00:21:05.9707729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9707845Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9708076Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9708193Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9708403Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9708551Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9708697Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9708860Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9709528Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9710059Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9710399Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9710723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9711017Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9711269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9711563Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9711811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9711914Z Execution Analysis: .......... 2024-12-18T00:21:05.9712152Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9712348Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9712619Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1859 counts during 1771 steps 2024-12-18T00:21:05.9712624Z 2024-12-18T00:21:05.9712809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9712918Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9713184Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9713289Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9713478Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9713611Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9713747Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9713900Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9714236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9714562Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9714849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9715097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9715379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9715627Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9715894Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9716011Z Execution Analysis: (:1) 2024-12-18T00:21:05.9716246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9716545Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9716550Z 2024-12-18T00:21:05.9716734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9716842Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9717051Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9717153Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9717347Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9717479Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9717619Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9717939Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9718522Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9719088Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9719437Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9719781Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9720081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9720348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9720645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9720912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9721014Z Execution Analysis: .......... 2024-12-18T00:21:05.9721270Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9721472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9721750Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1860 counts during 1772 steps 2024-12-18T00:21:05.9721755Z 2024-12-18T00:21:05.9721959Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9722068Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9722356Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9722461Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9722663Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9722804Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9722942Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9723110Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9723463Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9723808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9724109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9724381Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9724678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9724945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9725226Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9725347Z Execution Analysis: (:1) 2024-12-18T00:21:05.9725627Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9725896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9725901Z 2024-12-18T00:21:05.9726101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9726210Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9726440Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9726547Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9726745Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9726890Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9727030Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9727196Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9727774Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9728343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9728689Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9729039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9729342Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9729608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9730011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9730256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9730365Z Execution Analysis: .......... 2024-12-18T00:21:05.9730600Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9730791Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9731056Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1861 counts during 1773 steps 2024-12-18T00:21:05.9731060Z 2024-12-18T00:21:05.9731251Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9731354Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9731621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9731727Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9731915Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9732055Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9732192Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9732346Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9732680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9732998Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9733294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9733545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9733832Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9734073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9734350Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9734517Z Execution Analysis: (:1) 2024-12-18T00:21:05.9734813Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9735008Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9735012Z 2024-12-18T00:21:05.9735199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9735307Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9735518Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9735625Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9735814Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9735943Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9736083Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9736237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9737075Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9737649Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9738010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9738358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9738673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9738944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9739252Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9739531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9739637Z Execution Analysis: .......... 2024-12-18T00:21:05.9739901Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9740104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9740400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1862 counts during 1774 steps 2024-12-18T00:21:05.9740404Z 2024-12-18T00:21:05.9740604Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9740722Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9741011Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9741122Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9741329Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9741477Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9741624Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9741789Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9742147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9742495Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9742804Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9743080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9743386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9743655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9743975Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9744348Z Execution Analysis: (:1) 2024-12-18T00:21:05.9744607Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9744807Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9744820Z 2024-12-18T00:21:05.9745021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9745133Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9745370Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9745480Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9745692Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9745835Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9745991Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9746161Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9746751Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9747333Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9747691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9748051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9748362Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9748639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9748946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9749224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9749329Z Execution Analysis: .......... 2024-12-18T00:21:05.9749585Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9749795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9750082Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1863 counts during 1775 steps 2024-12-18T00:21:05.9750087Z 2024-12-18T00:21:05.9750293Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9750405Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9750697Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9750806Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9751016Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9751166Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9751305Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9751474Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9751831Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9752187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9752497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9752769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9753082Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9753381Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9753774Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9753898Z Execution Analysis: (:1) 2024-12-18T00:21:05.9754154Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9754354Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9754358Z 2024-12-18T00:21:05.9754561Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9754671Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9754902Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9755015Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9755221Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9755374Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9755524Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9755693Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9756359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9756886Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9757221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9757543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9757833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9758084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9758376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9758621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9758725Z Execution Analysis: .......... 2024-12-18T00:21:05.9758959Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9759145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9759415Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1864 counts during 1776 steps 2024-12-18T00:21:05.9759420Z 2024-12-18T00:21:05.9759607Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9759715Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9759984Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9760099Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9760286Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9760418Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9760553Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9760704Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9761036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9761361Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9761652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9761900Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9762213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9762527Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9762796Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9762915Z Execution Analysis: (:1) 2024-12-18T00:21:05.9763150Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9763343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9763347Z 2024-12-18T00:21:05.9763533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9763641Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9763852Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9763951Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9764150Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9764282Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9764423Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9764576Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9765127Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9765658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9765994Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9766319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9766607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9766866Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9767151Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9767404Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9767499Z Execution Analysis: .......... 2024-12-18T00:21:05.9767741Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9767929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9768196Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1865 counts during 1777 steps 2024-12-18T00:21:05.9768207Z 2024-12-18T00:21:05.9768394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9768497Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9768777Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9768878Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9769072Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9769202Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9769336Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9769489Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9769817Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9770144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9770429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9770687Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9771078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9771331Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9771597Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9771712Z Execution Analysis: (:1) 2024-12-18T00:21:05.9771959Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9772143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9772147Z 2024-12-18T00:21:05.9772340Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9772444Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9772666Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9772770Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9772968Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9773098Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9773230Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9773390Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9773931Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9774465Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9774795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9775119Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9775411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9775662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9775948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9776196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9776299Z Execution Analysis: .......... 2024-12-18T00:21:05.9776610Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9776969Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9777260Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1866 counts during 1778 steps 2024-12-18T00:21:05.9777265Z 2024-12-18T00:21:05.9777472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9777591Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9777877Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9777992Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9778194Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9778340Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9778479Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9778651Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9779003Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9779350Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9779667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9780039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9780354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9780621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9780911Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9781032Z Execution Analysis: (:1) 2024-12-18T00:21:05.9781287Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9781495Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9781499Z 2024-12-18T00:21:05.9781696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9781810Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9782045Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9782160Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9782364Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9782510Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9782655Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9782822Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9783420Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9783989Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9784351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9784709Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9785022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9785294Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9785605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9785870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9785973Z Execution Analysis: .......... 2024-12-18T00:21:05.9786234Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9786436Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9786727Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1867 counts during 1779 steps 2024-12-18T00:21:05.9786737Z 2024-12-18T00:21:05.9786938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9787054Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9787343Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9787451Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9787661Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9787800Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9787950Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9788116Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9788479Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9788829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9789316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9789598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9789882Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9790141Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9790411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9790534Z Execution Analysis: (:1) 2024-12-18T00:21:05.9790771Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9790970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9790974Z 2024-12-18T00:21:05.9791163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9791275Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9791493Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9791596Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9791795Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9791927Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9792070Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9792225Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9792770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9793303Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9793637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9793976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9794264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9794525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9794809Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9795064Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9795162Z Execution Analysis: .......... 2024-12-18T00:21:05.9795400Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9795591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9795868Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1868 counts during 1780 steps 2024-12-18T00:21:05.9795875Z 2024-12-18T00:21:05.9796070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9796177Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9796457Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9796559Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9796752Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9796885Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9797016Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9797176Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9797503Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9797859Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9798218Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9798479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9798758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9799005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9799276Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9799388Z Execution Analysis: (:1) 2024-12-18T00:21:05.9799632Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9799820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9799827Z 2024-12-18T00:21:05.9800024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9800127Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9800340Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9800449Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9800639Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9800779Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9800913Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9801079Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9801626Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9802164Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9802497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9802820Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9803113Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9803364Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9803653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9803899Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9804004Z Execution Analysis: .......... 2024-12-18T00:21:05.9804241Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9804431Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9804705Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1869 counts during 1781 steps 2024-12-18T00:21:05.9804709Z 2024-12-18T00:21:05.9804896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9805008Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9805277Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9805386Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9805573Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9805711Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9805838Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9805993Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9806361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9806824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9807123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9807373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9807662Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9807907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9808177Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9808302Z Execution Analysis: (:1) 2024-12-18T00:21:05.9808539Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9808738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9808747Z 2024-12-18T00:21:05.9808933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9809050Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9809267Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9809377Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9809568Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9809700Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9809843Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9809999Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9810553Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9811083Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9811422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9811745Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9812037Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9812292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9812577Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9812830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9812929Z Execution Analysis: .......... 2024-12-18T00:21:05.9813177Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9813368Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9813645Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1870 counts during 1782 steps 2024-12-18T00:21:05.9813649Z 2024-12-18T00:21:05.9813835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9813939Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9814211Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9814313Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9814507Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9814642Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9814782Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9814935Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9815354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9815686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9815978Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9816237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9816595Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9817022Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9817314Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9817447Z Execution Analysis: (:1) 2024-12-18T00:21:05.9817709Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9817920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9817925Z 2024-12-18T00:21:05.9818133Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9818247Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9818486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9818599Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9818815Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9818957Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9819104Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9819277Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9819870Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9820459Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9820818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9821175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9821482Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9821764Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9822069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9822335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9822448Z Execution Analysis: .......... 2024-12-18T00:21:05.9822711Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9822922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9823210Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1872 counts during 1783 steps 2024-12-18T00:21:05.9823215Z 2024-12-18T00:21:05.9823422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9823536Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9823828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9823944Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9824148Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9824302Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9824476Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9824729Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9825086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9825437Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9825754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9826027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9826343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9826609Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9826909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9827037Z Execution Analysis: (:1) 2024-12-18T00:21:05.9827307Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9827510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9827514Z 2024-12-18T00:21:05.9827716Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9827834Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9828063Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9828181Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9828390Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9828538Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9828683Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9828850Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9829640Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9830172Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9830512Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9830836Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9831130Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9831385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9831676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9831928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9832033Z Execution Analysis: .......... 2024-12-18T00:21:05.9832276Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9832464Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9832740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1873 counts during 1784 steps 2024-12-18T00:21:05.9832744Z 2024-12-18T00:21:05.9832933Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9833046Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9833312Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9833424Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9833610Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9833966Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9834193Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9834352Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9834690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9835016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9835309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9835562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9835849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9836100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9836373Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9836505Z Execution Analysis: (:1) 2024-12-18T00:21:05.9836745Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9836940Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9836945Z 2024-12-18T00:21:05.9837131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9837243Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9837456Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9837559Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9837759Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9837891Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9838035Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9838193Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9838740Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9839273Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9839605Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9839937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9840228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9840488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9840774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9841036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9841133Z Execution Analysis: .......... 2024-12-18T00:21:05.9841372Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9841566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9841832Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1874 counts during 1785 steps 2024-12-18T00:21:05.9841836Z 2024-12-18T00:21:05.9842029Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9842134Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9842407Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9842508Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9842724Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9842922Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9843055Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9843213Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9843540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9843871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9844572Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9844856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9845160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9845425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9845731Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9845857Z Execution Analysis: (:1) 2024-12-18T00:21:05.9846125Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9846325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9846331Z 2024-12-18T00:21:05.9846540Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9846652Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9846891Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9847000Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9847209Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9847358Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9847511Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9847686Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9848281Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9848867Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9849222Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9849573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9849887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9850159Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9850482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9850751Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9850865Z Execution Analysis: .......... 2024-12-18T00:21:05.9851120Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9851330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9851617Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1875 counts during 1786 steps 2024-12-18T00:21:05.9851622Z 2024-12-18T00:21:05.9851823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9851943Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9852231Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9852472Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9852710Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9852863Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9853003Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9853173Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9853537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9853890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9854210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9854484Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9854804Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9855077Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9855378Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9855504Z Execution Analysis: (:1) 2024-12-18T00:21:05.9855762Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9855972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9855976Z 2024-12-18T00:21:05.9856180Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9856300Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9856609Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9856732Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9856942Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9857092Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9857246Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9857415Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9858017Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9858592Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9858959Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9859310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9859629Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9859911Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9860221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9860504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9860611Z Execution Analysis: .......... 2024-12-18T00:21:05.9860877Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9861081Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9861376Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1876 counts during 1787 steps 2024-12-18T00:21:05.9861380Z 2024-12-18T00:21:05.9861580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9861701Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9862074Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9862213Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9862426Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9862571Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9862722Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9862890Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9863251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9863604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9863915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9864193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9864510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9864788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9865077Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9865209Z Execution Analysis: (:1) 2024-12-18T00:21:05.9865464Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9865667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9865680Z 2024-12-18T00:21:05.9865876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9865987Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9866222Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9866331Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9866550Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9866695Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9866844Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9867016Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9867610Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9868187Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9868543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9869009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9869317Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9869594Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9869894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9870160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9870269Z Execution Analysis: .......... 2024-12-18T00:21:05.9870520Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9870725Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9871007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1877 counts during 1788 steps 2024-12-18T00:21:05.9871011Z 2024-12-18T00:21:05.9871214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9871414Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9871730Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9871838Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9872035Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9872181Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9872318Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9872483Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9872827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9873173Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9873475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9873744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9874050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9874311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9874603Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9874726Z Execution Analysis: (:1) 2024-12-18T00:21:05.9874986Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9875183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9875187Z 2024-12-18T00:21:05.9875489Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9875597Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9875814Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9875930Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9876126Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9876274Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9876412Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9876565Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9877125Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9877656Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9877996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9878322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9878803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9879068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9879381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9879640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9879758Z Execution Analysis: .......... 2024-12-18T00:21:05.9880006Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9880205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9880499Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1878 counts during 1789 steps 2024-12-18T00:21:05.9880504Z 2024-12-18T00:21:05.9880798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9880919Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9881202Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9881322Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9881520Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9881664Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9881819Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9881984Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9882344Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9882684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9883005Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9883275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9883574Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9883846Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9884129Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9884264Z Execution Analysis: (:1) 2024-12-18T00:21:05.9884512Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9884721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9884726Z 2024-12-18T00:21:05.9884919Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9885048Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9885270Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9885377Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9885586Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9885722Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9885875Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9886039Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9886626Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9887185Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9887538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9887888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9888190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9888464Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9888764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9889034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9889136Z Execution Analysis: .......... 2024-12-18T00:21:05.9889394Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9889590Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9889897Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1879 counts during 1790 steps 2024-12-18T00:21:05.9889949Z 2024-12-18T00:21:05.9890177Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9890288Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9890681Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9890783Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9890986Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9891118Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9891249Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9891578Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9891927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9892275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9892580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9892856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9893152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9893424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9893704Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9893825Z Execution Analysis: (:1) 2024-12-18T00:21:05.9894084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9894282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9894286Z 2024-12-18T00:21:05.9894494Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9894607Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9894842Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9894948Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9895150Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9895297Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9895439Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9895610Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9896182Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9897001Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9897367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9897730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9898043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9898319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9898641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9898910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9899028Z Execution Analysis: .......... 2024-12-18T00:21:05.9899288Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9899535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9899897Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1880 counts during 1791 steps 2024-12-18T00:21:05.9899903Z 2024-12-18T00:21:05.9900118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9900230Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9900520Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9900641Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9900843Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9900999Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9901140Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9901308Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9901678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9902035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9902360Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9902637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9902953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9903220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9903525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9903648Z Execution Analysis: (:1) 2024-12-18T00:21:05.9903906Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9904120Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9904128Z 2024-12-18T00:21:05.9904331Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9904453Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9904682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9904803Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9905008Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9905151Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9905307Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9905473Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9906072Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9906652Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9907026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9907376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9907701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9907975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9908281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9908559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9908771Z Execution Analysis: .......... 2024-12-18T00:21:05.9909028Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9909343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9909639Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1881 counts during 1792 steps 2024-12-18T00:21:05.9909643Z 2024-12-18T00:21:05.9909838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9909962Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9910243Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9910351Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9910560Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9910699Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9910847Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9911008Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9911372Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9911714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9912015Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9912288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9912587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9912856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9913137Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9913272Z Execution Analysis: (:1) 2024-12-18T00:21:05.9913524Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9913729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9913745Z 2024-12-18T00:21:05.9913936Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9914043Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9914278Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9914386Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9914598Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9914737Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9914894Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9915055Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9915630Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9916204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9916557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9916912Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9917215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9917492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9917955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9918229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9918333Z Execution Analysis: .......... 2024-12-18T00:21:05.9918766Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9919002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9919284Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1882 counts during 1793 steps 2024-12-18T00:21:05.9919289Z 2024-12-18T00:21:05.9919494Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9919603Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9919895Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9920002Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9920203Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9920353Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9920493Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9920669Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9921020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9921370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9921674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9921941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9922251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9922515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9922810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9922934Z Execution Analysis: (:1) 2024-12-18T00:21:05.9923202Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9923405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9923410Z 2024-12-18T00:21:05.9923620Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9923726Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9923954Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9924076Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9924280Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9924436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9924583Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9924761Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9925340Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9925906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9926268Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9926609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9926924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9927190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9927502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9927760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9927951Z Execution Analysis: .......... 2024-12-18T00:21:05.9928226Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9928424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9928716Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1883 counts during 1794 steps 2024-12-18T00:21:05.9928720Z 2024-12-18T00:21:05.9928920Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9929049Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9929333Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9929456Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9929655Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9929901Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9930052Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9930208Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9930549Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9930875Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9931177Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9931431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9931728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9931974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9932243Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9932371Z Execution Analysis: (:1) 2024-12-18T00:21:05.9932612Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9932808Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9932812Z 2024-12-18T00:21:05.9932997Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9933114Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9933322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9933424Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9933624Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9933757Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9933904Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9934059Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9934620Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9935146Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9935489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9935809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9936097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9936428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9936715Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9937261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9937369Z Execution Analysis: .......... 2024-12-18T00:21:05.9937642Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9937841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9938130Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1884 counts during 1795 steps 2024-12-18T00:21:05.9938146Z 2024-12-18T00:21:05.9938346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9938459Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9938762Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9938873Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9939088Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9939237Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9939390Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9939553Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9939908Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9940273Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9940584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9940869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9941175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9941453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9941743Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9941872Z Execution Analysis: (:1) 2024-12-18T00:21:05.9942140Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9942343Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9942347Z 2024-12-18T00:21:05.9942559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9942674Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9942917Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9943026Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9943246Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9943389Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9943538Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9943722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9944461Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9945056Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9945415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9945783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9946096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9946371Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9946761Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9947128Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9947249Z Execution Analysis: .......... 2024-12-18T00:21:05.9947506Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9947722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9948015Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1885 counts during 1796 steps 2024-12-18T00:21:05.9948019Z 2024-12-18T00:21:05.9948237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9948354Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9948648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9948774Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9948982Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9949135Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9949277Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9949455Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9949810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9950164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9950482Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9950751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9951069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9951338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9951645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9951766Z Execution Analysis: (:1) 2024-12-18T00:21:05.9952023Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9952233Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9952238Z 2024-12-18T00:21:05.9952441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9952563Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9952794Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9952913Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9953118Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9953277Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9953428Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9953594Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9954195Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9954763Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9955131Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9955478Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9955904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9956287Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9956727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9956975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9957074Z Execution Analysis: .......... 2024-12-18T00:21:05.9957323Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9957510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9957789Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1886 counts during 1797 steps 2024-12-18T00:21:05.9957794Z 2024-12-18T00:21:05.9957983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9958102Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9958370Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9958476Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9958673Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9958807Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9958947Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9959099Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9959440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9959762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9960050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9960314Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9960601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9960862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9961137Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9961267Z Execution Analysis: (:1) 2024-12-18T00:21:05.9961506Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9961705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9961709Z 2024-12-18T00:21:05.9961894Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9961999Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9962221Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9962322Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9962527Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9962663Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9962810Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9962966Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9963511Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9964051Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9964382Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9964718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9965040Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9965380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9965675Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9965935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9966041Z Execution Analysis: .......... 2024-12-18T00:21:05.9966281Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9966487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9966757Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1887 counts during 1798 steps 2024-12-18T00:21:05.9966761Z 2024-12-18T00:21:05.9966965Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9967075Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9967367Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9967472Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9967673Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9967811Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9967943Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9968112Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9968442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9968777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9969065Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9969333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9969626Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9969875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9970162Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9970280Z Execution Analysis: (:1) 2024-12-18T00:21:05.9970532Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9970722Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9970726Z 2024-12-18T00:21:05.9970928Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9971037Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9971250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9971372Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9971571Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9971721Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9971858Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9972028Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9972572Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9973115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9973451Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9973802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9974180Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9974434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9974736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9974984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9975096Z Execution Analysis: .......... 2024-12-18T00:21:05.9975338Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9975535Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9975816Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1888 counts during 1799 steps 2024-12-18T00:21:05.9975820Z 2024-12-18T00:21:05.9976010Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9976136Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9976489Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9976609Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9976964Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9977121Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9977264Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9977427Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9977795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9978144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9978468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9978744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9979062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9979331Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9979624Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9979766Z Execution Analysis: (:1) 2024-12-18T00:21:05.9980024Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9980242Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9980246Z 2024-12-18T00:21:05.9980449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9980573Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9980810Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9980931Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9981143Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9981286Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9981446Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9981618Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9982222Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9982796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9983167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9983624Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9983938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9984221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9984529Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9984809Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9984915Z Execution Analysis: .......... 2024-12-18T00:21:05.9985188Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9985391Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9985692Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1889 counts during 1800 steps 2024-12-18T00:21:05.9985702Z 2024-12-18T00:21:05.9985907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9986019Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9986318Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9986430Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9986650Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9986795Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9986949Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9987119Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9987475Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9987840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9988161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9988447Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9988750Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9989133Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9989405Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9989534Z Execution Analysis: (:1) 2024-12-18T00:21:05.9989773Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9989962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9989966Z 2024-12-18T00:21:05.9990168Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9990277Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9990501Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9990604Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9990808Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9990942Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:05.9991077Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:05.9991247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9991793Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:05.9992336Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:05.9992694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:05.9993104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9993395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9993658Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9993944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9994193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9994303Z Execution Analysis: .......... 2024-12-18T00:21:05.9994540Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9994741Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9995015Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1890 counts during 1801 steps 2024-12-18T00:21:05.9995020Z 2024-12-18T00:21:05.9995221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9995328Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9995597Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:05.9995713Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9995901Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:05.9996046Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:05.9996178Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:05.9996343Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:05.9996673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:05.9996999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:05.9997300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:05.9997555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:05.9997848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:05.9998095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:05.9998379Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:05.9998496Z Execution Analysis: (:1) 2024-12-18T00:21:05.9998748Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:05.9998938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9998945Z 2024-12-18T00:21:05.9999133Z Execution Analysis: ================================================================================ 2024-12-18T00:21:05.9999253Z Execution Analysis: Execution Cause 2024-12-18T00:21:05.9999466Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:05.9999580Z Execution Analysis: Graph Info: 2024-12-18T00:21:05.9999770Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:05.9999912Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0000051Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0000208Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0000765Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0001320Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0001741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0002067Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0002367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0002624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0002921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0003171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0003269Z Execution Analysis: .......... 2024-12-18T00:21:06.0003522Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0003711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0003999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1891 counts during 1802 steps 2024-12-18T00:21:06.0004004Z 2024-12-18T00:21:06.0004195Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0004315Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0004588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0004702Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0004892Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0005023Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0005166Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0005318Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0005660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0005986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0006288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0006542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0006825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0007086Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0007358Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0007488Z Execution Analysis: (:1) 2024-12-18T00:21:06.0007726Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0007926Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0007935Z 2024-12-18T00:21:06.0008124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0008243Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0008458Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0008562Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0008769Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0008902Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0009054Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0009212Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0009764Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0010411Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0010773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0011116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0011408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0011678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0011965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0012228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0012332Z Execution Analysis: .......... 2024-12-18T00:21:06.0012576Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0012787Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0013055Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1893 counts during 1803 steps 2024-12-18T00:21:06.0013059Z 2024-12-18T00:21:06.0013265Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0013373Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0013656Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0013760Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0013962Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0014101Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0014235Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0014407Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0014741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0015079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0015366Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0015634Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0015920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0016171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0016528Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0016644Z Execution Analysis: (:1) 2024-12-18T00:21:06.0017072Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0017282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0017286Z 2024-12-18T00:21:06.0017504Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0017618Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0017861Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0017973Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0018183Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0018340Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0018486Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0018670Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0019301Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0019957Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0020316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0020671Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0020994Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0021267Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0021585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0021852Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0021970Z Execution Analysis: .......... 2024-12-18T00:21:06.0022234Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0022450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0022742Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1894 counts during 1804 steps 2024-12-18T00:21:06.0022747Z 2024-12-18T00:21:06.0022949Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0023075Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0023368Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0023493Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0023697Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0023857Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0024004Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0024176Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0024544Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0024897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0025225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0025499Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0025819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0026089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0026394Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0026521Z Execution Analysis: (:1) 2024-12-18T00:21:06.0026787Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0027002Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0027006Z 2024-12-18T00:21:06.0027207Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0027333Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0027561Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0027683Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0027891Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0028036Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0028198Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0028368Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0029168Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0029829Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0030171Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0030495Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0030794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0031049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0031338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0031606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0031710Z Execution Analysis: .......... 2024-12-18T00:21:06.0031962Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0032151Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0032430Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1895 counts during 1805 steps 2024-12-18T00:21:06.0032434Z 2024-12-18T00:21:06.0032625Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0032742Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0033012Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0033116Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0033318Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0033454Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0033603Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0033759Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0034089Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0034425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0034712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0034979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0035263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0035519Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0035793Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0035925Z Execution Analysis: (:1) 2024-12-18T00:21:06.0036164Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0036351Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0036356Z 2024-12-18T00:21:06.0036555Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0036663Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0036887Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0036988Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0037193Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0037328Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0037464Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0037706Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0038275Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0038820Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0039154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0039492Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0039783Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0040049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0040336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0040590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0040704Z Execution Analysis: .......... 2024-12-18T00:21:06.0040941Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0041144Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0041414Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1896 counts during 1806 steps 2024-12-18T00:21:06.0041418Z 2024-12-18T00:21:06.0041617Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0041725Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0042003Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0042107Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0042303Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0042449Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0042581Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0042748Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0043075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0043410Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0043700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0043949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0044381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0044811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0045125Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0045250Z Execution Analysis: (:1) 2024-12-18T00:21:06.0045522Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0045728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0045733Z 2024-12-18T00:21:06.0045948Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0046064Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0046294Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0046418Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0046628Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0046784Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0047079Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0047282Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0047892Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0048465Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0048836Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0049189Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0049517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0049789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0050113Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0050382Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0050501Z Execution Analysis: .......... 2024-12-18T00:21:06.0050758Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0050958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0051261Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1897 counts during 1807 steps 2024-12-18T00:21:06.0051266Z 2024-12-18T00:21:06.0051469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0051598Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0051890Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0052019Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0052225Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0052372Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0052529Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0052705Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0053070Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0053423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0053747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0054020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0054326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0054610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0054903Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0055036Z Execution Analysis: (:1) 2024-12-18T00:21:06.0055292Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0055503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0055507Z 2024-12-18T00:21:06.0055709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0055835Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0056064Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0056176Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0056498Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0056724Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0056886Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0057052Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0057651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0058222Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0058581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0058940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0059251Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0059539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0059848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0060125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0060232Z Execution Analysis: .......... 2024-12-18T00:21:06.0060502Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0060707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0060994Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1898 counts during 1808 steps 2024-12-18T00:21:06.0060999Z 2024-12-18T00:21:06.0061209Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0061323Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0061631Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0061743Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0061957Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0062100Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0062238Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0062414Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0062771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0063125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0063439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0063720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0064031Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0064312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0064598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0064722Z Execution Analysis: (:1) 2024-12-18T00:21:06.0064991Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0065195Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0065199Z 2024-12-18T00:21:06.0065407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0065518Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0065756Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0066052Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0066312Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0066468Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0066615Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0066788Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0067381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0067963Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0068320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0068682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0069096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0069346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0069641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0069886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0069990Z Execution Analysis: .......... 2024-12-18T00:21:06.0070226Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0070424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0070690Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1899 counts during 1809 steps 2024-12-18T00:21:06.0070694Z 2024-12-18T00:21:06.0070896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0071003Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0071273Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0071383Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0071571Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0071714Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0071843Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0071996Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0072332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0072656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0072950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0073206Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0073501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0073748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0074027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0074140Z Execution Analysis: (:1) 2024-12-18T00:21:06.0074546Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0074753Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0074757Z 2024-12-18T00:21:06.0074950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0075068Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0075320Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0075508Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0075712Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0075856Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0076007Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0076172Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0076758Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0077314Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0077671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0078016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0078332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0078597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0078897Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0079169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0079271Z Execution Analysis: .......... 2024-12-18T00:21:06.0079531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0079728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0080017Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1900 counts during 1810 steps 2024-12-18T00:21:06.0080021Z 2024-12-18T00:21:06.0080221Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0080341Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0080621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0080729Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0080935Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0081074Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0081220Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0081381Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0081737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0082076Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0082381Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0082664Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0082962Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0083229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0083510Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0083645Z Execution Analysis: (:1) 2024-12-18T00:21:06.0083894Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0084090Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0084106Z 2024-12-18T00:21:06.0084296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0084490Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0084746Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0084857Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0085067Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0085206Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0085359Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0085517Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0086193Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0086729Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0087063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0087399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0087688Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0087951Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0088236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0088501Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0088597Z Execution Analysis: .......... 2024-12-18T00:21:06.0089004Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0089210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0089493Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1901 counts during 1811 steps 2024-12-18T00:21:06.0089501Z 2024-12-18T00:21:06.0089706Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0089815Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0090107Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0090211Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0090409Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0090557Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0090692Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0090864Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0091207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0091558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0091864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0092131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0092436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0092694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0092988Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0093109Z Execution Analysis: (:1) 2024-12-18T00:21:06.0093367Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0093563Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0093567Z 2024-12-18T00:21:06.0093822Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0093979Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0094204Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0098453Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0098718Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0098871Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0099017Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0099185Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0099799Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0100374Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0100760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0101114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0101432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0101703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0102018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0102286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0102391Z Execution Analysis: .......... 2024-12-18T00:21:06.0102658Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0102862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0103164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1902 counts during 1812 steps 2024-12-18T00:21:06.0103171Z 2024-12-18T00:21:06.0103374Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0103492Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0103785Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0103901Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0104107Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0104249Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0104397Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0104563Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0104926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0105285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0105603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0105872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0106178Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0106450Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0106743Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0106871Z Execution Analysis: (:1) 2024-12-18T00:21:06.0107131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0107405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0107539Z 2024-12-18T00:21:06.0107768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0107892Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0108123Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0108233Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0108443Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0108586Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0108734Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0108899Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0109499Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0110180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0110531Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0110875Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0111178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0111447Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0111743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0112104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0112199Z Execution Analysis: .......... 2024-12-18T00:21:06.0112434Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0112633Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0112897Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1903 counts during 1813 steps 2024-12-18T00:21:06.0112901Z 2024-12-18T00:21:06.0113091Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0113193Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0113463Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0113562Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0113752Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0113881Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0114010Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0114170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0114502Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0114829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0115115Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0115369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0115650Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0115894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0116167Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0116282Z Execution Analysis: (:1) 2024-12-18T00:21:06.0116524Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0116831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0116835Z 2024-12-18T00:21:06.0117024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0117128Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0117343Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0117442Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0117632Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0117938Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0118080Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0118247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0118822Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0119390Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0119736Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0120075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0120382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0120647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0120954Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0121211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0121319Z Execution Analysis: .......... 2024-12-18T00:21:06.0121574Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0121779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0122063Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1904 counts during 1814 steps 2024-12-18T00:21:06.0122068Z 2024-12-18T00:21:06.0122264Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0122376Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0122658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0122770Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0122966Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0123109Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0123247Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0123413Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0123768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0124106Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0124415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0124678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0124979Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0125237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0125526Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0125646Z Execution Analysis: (:1) 2024-12-18T00:21:06.0125970Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0126194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0126198Z 2024-12-18T00:21:06.0126394Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0126507Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0126727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0126841Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0127042Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0127181Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0127333Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0127501Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0128083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0128640Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0128996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0129338Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0129752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0130006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0130289Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0130540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0130642Z Execution Analysis: .......... 2024-12-18T00:21:06.0130886Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0131071Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0131338Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1905 counts during 1815 steps 2024-12-18T00:21:06.0131342Z 2024-12-18T00:21:06.0131528Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0131639Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0131903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0132004Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0132200Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0132331Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0132470Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0132623Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0132948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0133277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0133563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0133820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0134100Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0134353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0134620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0134816Z Execution Analysis: (:1) 2024-12-18T00:21:06.0135078Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0135266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0135275Z 2024-12-18T00:21:06.0135465Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0135570Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0135786Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0135887Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0136085Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0136218Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0136446Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0136613Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0137357Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0137938Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0138295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0138652Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0138963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0139242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0139546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0139818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0139929Z Execution Analysis: .......... 2024-12-18T00:21:06.0140186Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0140390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0140678Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1906 counts during 1816 steps 2024-12-18T00:21:06.0140683Z 2024-12-18T00:21:06.0140889Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0141002Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0141296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0141405Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0141610Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0141763Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0141905Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0142074Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0142428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0142784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0143094Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0143366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0143675Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0143939Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0144496Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0144653Z Execution Analysis: (:1) 2024-12-18T00:21:06.0144916Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0145118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0145123Z 2024-12-18T00:21:06.0145330Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0145441Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0145672Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0145788Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0145993Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0146139Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0146286Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0146462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0147054Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0147624Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0147992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0148341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0148662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0148932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0149247Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0149515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0149624Z Execution Analysis: .......... 2024-12-18T00:21:06.0149880Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0150081Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0150375Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1907 counts during 1817 steps 2024-12-18T00:21:06.0150380Z 2024-12-18T00:21:06.0150580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0150702Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0150993Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0151108Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0151317Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0151458Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0151606Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0151774Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0152134Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0152482Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0152796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0153067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0153369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0153663Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0154048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0154177Z Execution Analysis: (:1) 2024-12-18T00:21:06.0154432Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0154636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0154640Z 2024-12-18T00:21:06.0154838Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0154956Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0155184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0155291Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0155506Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0155652Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0155804Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0156072Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0156622Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0157153Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0157481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0157811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0158096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0158353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0158642Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0158897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0158992Z Execution Analysis: .......... 2024-12-18T00:21:06.0159232Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0159417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0159682Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1908 counts during 1818 steps 2024-12-18T00:21:06.0159693Z 2024-12-18T00:21:06.0159876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0159983Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0160257Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0160362Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0160554Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0160685Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0160814Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0160971Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0161300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0161628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0161913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0162171Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0162478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0162805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0163074Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0163189Z Execution Analysis: (:1) 2024-12-18T00:21:06.0163431Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0163617Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0163622Z 2024-12-18T00:21:06.0163811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0163915Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0164133Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0164235Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0164433Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0164577Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0164712Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0164878Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0165422Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0165955Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0166284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0166613Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0166899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0167157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0167443Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0167689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0167791Z Execution Analysis: .......... 2024-12-18T00:21:06.0168027Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0168223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0168488Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1909 counts during 1819 steps 2024-12-18T00:21:06.0168492Z 2024-12-18T00:21:06.0168682Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0168789Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0169061Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0169169Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0169356Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0169491Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0169620Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0169779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0170107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0170431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0170721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0170997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0171354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0171597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0171871Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0171986Z Execution Analysis: (:1) 2024-12-18T00:21:06.0172223Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0172420Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0172425Z 2024-12-18T00:21:06.0172611Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0172721Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0172933Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0173041Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0173235Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0173370Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0173508Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0173661Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0174215Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0174743Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0175082Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0175405Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0175699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0175953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0176235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0176560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0176657Z Execution Analysis: .......... 2024-12-18T00:21:06.0177076Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0177279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0177574Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1910 counts during 1820 steps 2024-12-18T00:21:06.0177579Z 2024-12-18T00:21:06.0177778Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0177902Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0178188Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0178296Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0178502Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0178641Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0178785Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0178950Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0179311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0179657Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0179992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0180340Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0180645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0180914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0181206Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0181333Z Execution Analysis: (:1) 2024-12-18T00:21:06.0181588Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0181786Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0181800Z 2024-12-18T00:21:06.0181998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0182111Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0182349Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0182457Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0182671Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0182815Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0182963Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0183128Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0183714Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0184291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0184646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0185008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0185319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0185592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0185899Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0186173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0186282Z Execution Analysis: .......... 2024-12-18T00:21:06.0186542Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0186750Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0187039Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1911 counts during 1821 steps 2024-12-18T00:21:06.0187049Z 2024-12-18T00:21:06.0187262Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0187373Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0187669Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0187776Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0187981Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0188130Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0188272Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0188448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0188802Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0189261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0189653Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0189905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0190196Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0190446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0190720Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0190837Z Execution Analysis: (:1) 2024-12-18T00:21:06.0191082Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0191269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0191273Z 2024-12-18T00:21:06.0191468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0191579Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0191791Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0191903Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0192094Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0192235Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0192372Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0192535Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0193079Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0193606Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0193944Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0194272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0194565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0194818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0195111Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0195358Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0195462Z Execution Analysis: .......... 2024-12-18T00:21:06.0195698Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0195887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0196166Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1912 counts during 1822 steps 2024-12-18T00:21:06.0196171Z 2024-12-18T00:21:06.0196356Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0196473Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0196742Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0196852Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0197038Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0197172Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0197305Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0197459Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0197793Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0198139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0198504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0198756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0199040Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0199286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0199726Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0199849Z Execution Analysis: (:1) 2024-12-18T00:21:06.0200101Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0200304Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0200313Z 2024-12-18T00:21:06.0200510Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0200625Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0200845Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0200949Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0201156Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0201296Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0201445Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0201607Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0202188Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0202746Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0203104Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0203443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0203743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0204011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0204307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0204572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0204674Z Execution Analysis: .......... 2024-12-18T00:21:06.0204932Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0205133Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0205415Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1914 counts during 1823 steps 2024-12-18T00:21:06.0205427Z 2024-12-18T00:21:06.0205618Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0205729Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0206017Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0206122Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0206326Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0206465Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0206608Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0206768Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0207141Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0207557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0207862Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0208132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0208429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0208695Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0208978Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0209098Z Execution Analysis: (:1) 2024-12-18T00:21:06.0209355Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0209554Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0209563Z 2024-12-18T00:21:06.0209764Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0209873Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0210106Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0210211Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0210419Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0210555Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0210699Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0210868Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0211544Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0212084Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0212415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0212746Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0213034Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0213286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0213577Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0213824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0213928Z Execution Analysis: .......... 2024-12-18T00:21:06.0214168Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0214365Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0214632Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1915 counts during 1824 steps 2024-12-18T00:21:06.0214636Z 2024-12-18T00:21:06.0214828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0214932Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0215203Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0215308Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0215495Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0215636Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0215769Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0215952Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0216410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0216744Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0217221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0217495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0217813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0218083Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0218383Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0218507Z Execution Analysis: (:1) 2024-12-18T00:21:06.0218777Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0218983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0218988Z 2024-12-18T00:21:06.0219191Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0219316Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0219546Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0219665Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0219869Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0220020Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0220165Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0220330Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0220927Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0221505Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0221870Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0222220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0222538Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0222811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0223131Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0223394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0223501Z Execution Analysis: .......... 2024-12-18T00:21:06.0223768Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0223972Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0224269Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1916 counts during 1825 steps 2024-12-18T00:21:06.0224274Z 2024-12-18T00:21:06.0224474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0224597Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0224885Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0224993Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0225201Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0225344Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0225540Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0225779Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0226142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0226488Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0226797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0227073Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0227378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0227654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0227941Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0228075Z Execution Analysis: (:1) 2024-12-18T00:21:06.0228336Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0228546Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0228551Z 2024-12-18T00:21:06.0228749Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0228863Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0229200Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0229413Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0229612Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0229744Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0229888Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0230042Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0230595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0231129Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0231461Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0231794Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0232084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0232346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0232630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0232887Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0232988Z Execution Analysis: .......... 2024-12-18T00:21:06.0233228Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0233423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0233691Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1917 counts during 1826 steps 2024-12-18T00:21:06.0233695Z 2024-12-18T00:21:06.0233890Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0233995Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0234273Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0234375Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0234571Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0234775Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0234932Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0235093Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0235423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0235756Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0236043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0236304Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0236586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0236833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0237110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0237229Z Execution Analysis: (:1) 2024-12-18T00:21:06.0237478Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0237665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0237669Z 2024-12-18T00:21:06.0237864Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0237969Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0238191Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0238292Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0238484Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0238624Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0238761Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0238928Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0239475Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0240009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0240336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0240659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0240949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0241199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0241493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0241745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0241849Z Execution Analysis: .......... 2024-12-18T00:21:06.0242084Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0242277Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0242539Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1918 counts during 1827 steps 2024-12-18T00:21:06.0242544Z 2024-12-18T00:21:06.0242728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0242841Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0243107Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0243212Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0243467Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0243630Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0243761Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0243917Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0244679Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0245029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0245344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0245617Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0245932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0246199Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0246493Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0246621Z Execution Analysis: (:1) 2024-12-18T00:21:06.0246879Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0247087Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0247092Z 2024-12-18T00:21:06.0247292Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0247412Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0247640Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0247756Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0247962Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0248107Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0248265Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0248431Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0249027Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0249599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0249964Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0250313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0250624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0250899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0251210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0251484Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0251590Z Execution Analysis: .......... 2024-12-18T00:21:06.0251857Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0252058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0252355Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1919 counts during 1828 steps 2024-12-18T00:21:06.0252359Z 2024-12-18T00:21:06.0252560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0252673Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0253101Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0253278Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0253536Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0253682Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0253837Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0254004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0254362Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0254717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0255029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0255310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0255619Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0255903Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0256195Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0256332Z Execution Analysis: (:1) 2024-12-18T00:21:06.0256660Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0256866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0256871Z 2024-12-18T00:21:06.0257080Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0257194Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0257436Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0257546Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0257766Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0257913Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0258062Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0258238Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0258830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0259413Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0259770Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0260124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0260434Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0260720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0261026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0261291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0261400Z Execution Analysis: .......... 2024-12-18T00:21:06.0261656Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0261864Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0262154Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1920 counts during 1829 steps 2024-12-18T00:21:06.0262159Z 2024-12-18T00:21:06.0262367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0262482Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0262883Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0262995Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0263195Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0263343Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0263484Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0263658Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0264013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0264362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0264676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0264947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0265264Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0265528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0265828Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0265952Z Execution Analysis: (:1) 2024-12-18T00:21:06.0266216Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0266417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0266422Z 2024-12-18T00:21:06.0266622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0266738Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0266967Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0267089Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0267295Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0267444Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0267588Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0267753Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0268351Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0269025Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0269366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0269690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0269992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0270240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0270528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0270774Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0270871Z Execution Analysis: .......... 2024-12-18T00:21:06.0271117Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0271304Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0271578Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1921 counts during 1830 steps 2024-12-18T00:21:06.0271582Z 2024-12-18T00:21:06.0271792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0271978Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0272247Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0272356Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0272546Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0272679Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0272816Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0272970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0273305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0273634Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0273933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0274188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0274477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0274731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0275000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0275129Z Execution Analysis: (:1) 2024-12-18T00:21:06.0275369Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0275576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0275580Z 2024-12-18T00:21:06.0275766Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0275886Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0276102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0276207Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0276410Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0276543Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0276695Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0276849Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0277406Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0277934Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0278266Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0278604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0278894Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0279163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0279449Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0279710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0279808Z Execution Analysis: .......... 2024-12-18T00:21:06.0280059Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0280247Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0280518Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1922 counts during 1831 steps 2024-12-18T00:21:06.0280546Z 2024-12-18T00:21:06.0280814Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0280923Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0281206Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0281308Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0281512Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0281644Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0281776Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0281938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0282265Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0282602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0282892Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0283164Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0283445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0283695Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0283974Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0284087Z Execution Analysis: (:1) 2024-12-18T00:21:06.0284337Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0284522Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0284526Z 2024-12-18T00:21:06.0284723Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0284833Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0285056Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0285157Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0285348Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0285489Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0285625Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0285794Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0286341Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0286881Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0287214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0287552Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0287839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0288088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0288382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0288627Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0288740Z Execution Analysis: .......... 2024-12-18T00:21:06.0288976Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0289175Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0289465Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1923 counts during 1832 steps 2024-12-18T00:21:06.0289548Z 2024-12-18T00:21:06.0289738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0289854Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0290122Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0290235Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0290423Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0290570Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0290701Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0290853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0291191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0291514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0291814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0292065Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0292359Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0292603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0292879Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0292993Z Execution Analysis: (:1) 2024-12-18T00:21:06.0293233Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0293429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0293433Z 2024-12-18T00:21:06.0293621Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0293740Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0293952Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0294067Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0294257Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0294392Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0294536Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0294692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0295248Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0295777Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0296124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0296522Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0296993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0297266Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0297575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0297857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0297967Z Execution Analysis: .......... 2024-12-18T00:21:06.0298237Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0298466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0298851Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1924 counts during 1833 steps 2024-12-18T00:21:06.0298856Z 2024-12-18T00:21:06.0299059Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0299182Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0299470Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0299580Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0299793Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0299937Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0300093Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0300256Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0300612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0300981Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0301294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0301586Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0301893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0302172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0302460Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0302598Z Execution Analysis: (:1) 2024-12-18T00:21:06.0302852Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0303057Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0303073Z 2024-12-18T00:21:06.0303275Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0303387Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0303625Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0303734Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0303953Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0304097Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0304245Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0304422Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0305013Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0305602Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0305962Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0306323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0306632Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0306913Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0307220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0307486Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0307602Z Execution Analysis: .......... 2024-12-18T00:21:06.0307882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0308170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0308459Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1925 counts during 1834 steps 2024-12-18T00:21:06.0308464Z 2024-12-18T00:21:06.0308675Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0308792Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0309093Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0309203Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0309407Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0309561Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0309703Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0309883Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0310242Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0310606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0310914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0311186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0311502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0311770Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0312076Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0312201Z Execution Analysis: (:1) 2024-12-18T00:21:06.0312470Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0312680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0312684Z 2024-12-18T00:21:06.0312897Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0313009Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0313239Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0313357Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0313563Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0313718Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0313863Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0314039Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0314630Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0315206Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0315572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0315920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0316241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0316513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0316833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0317099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0317217Z Execution Analysis: .......... 2024-12-18T00:21:06.0317573Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0317779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0318076Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1926 counts during 1835 steps 2024-12-18T00:21:06.0318081Z 2024-12-18T00:21:06.0318282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0318409Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0318700Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0318823Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0319028Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0319170Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0319326Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0319499Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0319867Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0320217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0320544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0320815Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0321121Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0321403Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0321697Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0321832Z Execution Analysis: (:1) 2024-12-18T00:21:06.0322096Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0322316Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0322320Z 2024-12-18T00:21:06.0322523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0322649Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0322878Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0322994Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0323215Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0323360Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0323519Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0323689Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0324298Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0324874Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0325245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0325592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0325907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0326192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0326501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0326807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0326973Z Execution Analysis: .......... 2024-12-18T00:21:06.0327267Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0327471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0327763Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1927 counts during 1836 steps 2024-12-18T00:21:06.0327778Z 2024-12-18T00:21:06.0327981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0328098Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0328401Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0328510Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0328729Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0328869Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0329019Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0329195Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0329550Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0329909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0330219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0330498Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0330801Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0331074Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0331363Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0331493Z Execution Analysis: (:1) 2024-12-18T00:21:06.0331757Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0331962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0331966Z 2024-12-18T00:21:06.0332179Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0332294Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0332535Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0332644Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0332851Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0333004Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0333150Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0333332Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0333928Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0334613Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0334961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0335312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0335615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0335879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0336188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0336642Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0336922Z Execution Analysis: .......... 2024-12-18T00:21:06.0337179Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0337393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0337688Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1928 counts during 1837 steps 2024-12-18T00:21:06.0337693Z 2024-12-18T00:21:06.0337906Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0338016Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0338307Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0338429Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0338637Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0338797Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0338937Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0339117Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0339470Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0339818Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0340136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0340408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0340726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0340990Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0341303Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0341427Z Execution Analysis: (:1) 2024-12-18T00:21:06.0341683Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0341896Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0341900Z 2024-12-18T00:21:06.0342102Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0342226Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0342455Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0342578Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0342783Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0342927Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0343084Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0343257Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0343857Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0344757Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0345135Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0345489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0345816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0346089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0346564Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0346846Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0346953Z Execution Analysis: .......... 2024-12-18T00:21:06.0347225Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0347425Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0347734Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1929 counts during 1838 steps 2024-12-18T00:21:06.0347739Z 2024-12-18T00:21:06.0347941Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0348069Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0348356Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0348472Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0348692Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0348832Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0348989Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0349156Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0349527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0349873Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0350185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0350465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0350770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0351056Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0351351Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0351489Z Execution Analysis: (:1) 2024-12-18T00:21:06.0351751Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0351962Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0351967Z 2024-12-18T00:21:06.0352166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0352280Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0352516Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0352628Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0352846Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0352995Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0353152Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0353321Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0353913Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0354493Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0354854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0355212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0355523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0355862Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0356221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0356502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0356608Z Execution Analysis: .......... 2024-12-18T00:21:06.0356869Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0357082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0357371Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1930 counts during 1839 steps 2024-12-18T00:21:06.0357376Z 2024-12-18T00:21:06.0357587Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0357704Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0358006Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0358122Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0358328Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0358479Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0358622Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0358796Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0359154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0359514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0359825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0360099Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0360414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0360687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0360984Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0361109Z Execution Analysis: (:1) 2024-12-18T00:21:06.0361376Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0361583Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0361587Z 2024-12-18T00:21:06.0361798Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0361913Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0362143Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0362263Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0362479Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0362636Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0362783Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0362964Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0363652Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0364303Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0364818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0365165Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0365521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0365864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0366177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0366440Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0366559Z Execution Analysis: .......... 2024-12-18T00:21:06.0366812Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0367013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0367310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1931 counts during 1840 steps 2024-12-18T00:21:06.0367315Z 2024-12-18T00:21:06.0367514Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0367647Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0367935Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0368057Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0368258Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0368414Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0368552Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0368720Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0369080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0369424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0369743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0370013Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0370336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0370599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0370885Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0371022Z Execution Analysis: (:1) 2024-12-18T00:21:06.0371273Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0371486Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0371491Z 2024-12-18T00:21:06.0371689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0371816Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0372042Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0372157Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0372371Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0372511Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0372665Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0372828Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0373419Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0373980Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0374342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0374710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0375088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0375365Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0375665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0375937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0376038Z Execution Analysis: .......... 2024-12-18T00:21:06.0376301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0376576Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0377040Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1932 counts during 1841 steps 2024-12-18T00:21:06.0377045Z 2024-12-18T00:21:06.0377245Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0377366Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0377667Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0377779Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0377996Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0378138Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0378294Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0378462Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0378818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0379181Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0379493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0379786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0380091Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0380375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0380667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0380794Z Execution Analysis: (:1) 2024-12-18T00:21:06.0381064Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0381270Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0381274Z 2024-12-18T00:21:06.0381487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0381603Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0381846Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0381957Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0382177Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0382324Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0382473Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0382652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0383245Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0383832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0384192Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0384658Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0384973Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0385245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0385564Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0385833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0385954Z Execution Analysis: .......... 2024-12-18T00:21:06.0386211Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0386433Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0386723Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1933 counts during 1842 steps 2024-12-18T00:21:06.0386731Z 2024-12-18T00:21:06.0386951Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0387068Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0387362Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0387488Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0387693Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0387850Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0387992Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0388176Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0388535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0388892Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0389309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0389561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0389855Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0390102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0390384Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0390498Z Execution Analysis: (:1) 2024-12-18T00:21:06.0390750Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0390938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0390942Z 2024-12-18T00:21:06.0391131Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0391253Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0391468Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0391581Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0391774Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0391921Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0392058Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0392213Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0392773Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0393306Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0393719Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0394150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0394454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0394708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0395008Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0395257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0395359Z Execution Analysis: .......... 2024-12-18T00:21:06.0395609Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0395795Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0396080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1935 counts during 1843 steps 2024-12-18T00:21:06.0396084Z 2024-12-18T00:21:06.0396272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0396391Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0396662Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0396766Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0396969Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0397100Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0397238Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0397392Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0397736Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0398065Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0398354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0398618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0398905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0399162Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0399433Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0399562Z Execution Analysis: (:1) 2024-12-18T00:21:06.0399804Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0400007Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0400016Z 2024-12-18T00:21:06.0400204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0400311Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0400533Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0400638Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0400841Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0400976Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0401128Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0401285Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0401836Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0402401Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0402799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0403140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0403431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0403694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0403981Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0404241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0404340Z Execution Analysis: .......... 2024-12-18T00:21:06.0404578Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0404782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0405051Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1936 counts during 1844 steps 2024-12-18T00:21:06.0405055Z 2024-12-18T00:21:06.0405254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0405360Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0405643Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0405907Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0406120Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0406257Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0406397Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0406572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0406922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0407278Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0407585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0407865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0408165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0408428Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0408726Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0408848Z Execution Analysis: (:1) 2024-12-18T00:21:06.0409113Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0409319Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0409325Z 2024-12-18T00:21:06.0409539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0409650Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0409888Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0409996Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0410200Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0410353Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0410498Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0410673Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0411253Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0411923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0412275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0412619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0412938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0413205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0413519Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0413782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0413901Z Execution Analysis: .......... 2024-12-18T00:21:06.0414157Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0414378Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0414662Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1937 counts during 1845 steps 2024-12-18T00:21:06.0414667Z 2024-12-18T00:21:06.0414866Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0414994Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0415279Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0415399Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0415598Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0415754Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0415891Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0416058Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0416503Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0417012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0417340Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0417614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0417933Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0418206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0418500Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0418642Z Execution Analysis: (:1) 2024-12-18T00:21:06.0418902Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0419124Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0419129Z 2024-12-18T00:21:06.0419329Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0419451Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0419680Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0419802Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0420007Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0420155Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0420311Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0420481Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0421112Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0421757Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0422127Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0422479Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0422802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0423074Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0423383Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0423661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0423774Z Execution Analysis: .......... 2024-12-18T00:21:06.0424048Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0424255Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0424560Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1938 counts during 1846 steps 2024-12-18T00:21:06.0424565Z 2024-12-18T00:21:06.0424768Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0424883Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0425186Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0425295Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0425516Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0425664Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0425822Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0425995Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0426354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0426716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0427027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0427308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0427613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0427892Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0428185Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0428325Z Execution Analysis: (:1) 2024-12-18T00:21:06.0428587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0428792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0428797Z 2024-12-18T00:21:06.0429150Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0429366Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0429590Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0429693Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0429901Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0430034Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0430172Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0430341Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0431006Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0431550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0431884Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0432222Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0432687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0432966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0433268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0433531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0433656Z Execution Analysis: .......... 2024-12-18T00:21:06.0433910Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0434123Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0434407Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1939 counts during 1847 steps 2024-12-18T00:21:06.0434412Z 2024-12-18T00:21:06.0434622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0434733Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0435027Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0435293Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0435499Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0435660Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0435807Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0435988Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0436343Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0436696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0437019Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0437291Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0437611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0437877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0438184Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0438313Z Execution Analysis: (:1) 2024-12-18T00:21:06.0438581Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0438782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0438787Z 2024-12-18T00:21:06.0438991Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0439113Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0439345Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0439468Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0439677Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0439832Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0439981Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0440250Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0440848Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0441426Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0441798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0442151Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0442474Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0442749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0443070Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0443344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0443455Z Execution Analysis: .......... 2024-12-18T00:21:06.0443721Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0443925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0444359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1940 counts during 1848 steps 2024-12-18T00:21:06.0444364Z 2024-12-18T00:21:06.0444566Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0444695Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0444986Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0445111Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0445320Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0445466Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0445621Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0445792Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0446160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0446510Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0446839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0447114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0447424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0447703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0448000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0448139Z Execution Analysis: (:1) 2024-12-18T00:21:06.0448399Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0448616Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0448620Z 2024-12-18T00:21:06.0448823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0448951Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0449183Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0449296Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0449515Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0449710Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0449963Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0450133Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0450741Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0451313Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0451674Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0452041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0452352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0452641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0452956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0453238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0453351Z Execution Analysis: .......... 2024-12-18T00:21:06.0453616Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0453819Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0454110Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1941 counts during 1849 steps 2024-12-18T00:21:06.0454115Z 2024-12-18T00:21:06.0454324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0454436Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0454734Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0454851Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0455068Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0455214Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0455355Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0455533Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0455892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0456251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0456649Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0456931Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0457240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0457515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0457814Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0457939Z Execution Analysis: (:1) 2024-12-18T00:21:06.0458205Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0458411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0458415Z 2024-12-18T00:21:06.0458623Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0458736Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0458976Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0459089Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0459329Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0459559Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0459708Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0459882Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0460472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0461051Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0461412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0461775Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0462089Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0462369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0462686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0462955Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0463069Z Execution Analysis: .......... 2024-12-18T00:21:06.0463326Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0463533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0463824Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1942 counts during 1850 steps 2024-12-18T00:21:06.0463830Z 2024-12-18T00:21:06.0464030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0464149Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0464447Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0464568Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0464770Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0464922Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0465062Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0465228Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0465591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0465943Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0466261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0466534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0466857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0467128Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0467426Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0467552Z Execution Analysis: (:1) 2024-12-18T00:21:06.0467812Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0468022Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0468026Z 2024-12-18T00:21:06.0468230Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0468350Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0468686Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0468883Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0469099Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0469234Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0469373Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0469528Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0470083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0470619Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0470957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0471284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0471585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0471837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0472124Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0472377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0472475Z Execution Analysis: .......... 2024-12-18T00:21:06.0472717Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0472905Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0473179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1943 counts during 1851 steps 2024-12-18T00:21:06.0473184Z 2024-12-18T00:21:06.0473372Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0473488Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0473757Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0473861Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0474057Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0474191Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0474329Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0474482Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0474820Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0475146Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0475434Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0475700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0475988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0476241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0476512Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0476638Z Execution Analysis: (:1) 2024-12-18T00:21:06.0476878Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0477067Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0477080Z 2024-12-18T00:21:06.0477266Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0477371Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0477661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0477787Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0477987Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0478121Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0478258Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0478420Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0478969Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0479506Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0479841Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0480177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0480470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0480730Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0481017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0481267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0481373Z Execution Analysis: .......... 2024-12-18T00:21:06.0481612Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0481809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0482080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1944 counts during 1852 steps 2024-12-18T00:21:06.0482087Z 2024-12-18T00:21:06.0482285Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0482391Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0482667Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0482772Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0482964Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0483105Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0483237Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0483397Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0483726Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0484057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0484348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0484604Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0484893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0485142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0485415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0485533Z Execution Analysis: (:1) 2024-12-18T00:21:06.0485782Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0485970Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0485973Z 2024-12-18T00:21:06.0486194Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0486346Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0486585Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0486698Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0486890Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0487029Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0487166Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0487333Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0487883Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0488414Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0488757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0489086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0489380Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0489633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0489925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0490173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0490282Z Execution Analysis: .......... 2024-12-18T00:21:06.0490516Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0490705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0490978Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1945 counts during 1853 steps 2024-12-18T00:21:06.0490987Z 2024-12-18T00:21:06.0491176Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0491291Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0491565Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0491677Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0491867Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0491999Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0492138Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0492292Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0492628Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0492954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0493248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0497671Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0497988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0498268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0498562Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0498692Z Execution Analysis: (:1) 2024-12-18T00:21:06.0498954Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0499170Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0499176Z 2024-12-18T00:21:06.0499539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0499654Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0499892Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0500004Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0500220Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0500366Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0500518Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0500686Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0501285Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0501872Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0502238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0502594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0502904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0503184Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0503489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0503760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0503866Z Execution Analysis: .......... 2024-12-18T00:21:06.0504124Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0504335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0504634Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1946 counts during 1854 steps 2024-12-18T00:21:06.0504640Z 2024-12-18T00:21:06.0504848Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0504963Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0505259Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0505369Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0505577Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0505718Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0505860Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0506032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0506388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0506749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0507058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0507332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0507640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0507906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0508202Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0508326Z Execution Analysis: (:1) 2024-12-18T00:21:06.0508587Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0508835Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0508887Z 2024-12-18T00:21:06.0509226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0509338Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0509569Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0509675Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0509876Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0510018Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0510160Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0510330Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0510995Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0511527Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0511860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0512180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0512470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0512722Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0513007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0513251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0513352Z Execution Analysis: .......... 2024-12-18T00:21:06.0513590Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0513779Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0514051Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1947 counts during 1855 steps 2024-12-18T00:21:06.0514055Z 2024-12-18T00:21:06.0514240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0514349Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0514619Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0514724Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0514911Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0515050Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0515178Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0515329Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0515668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0515989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0516278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0516527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0516815Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0517061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0517328Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0517450Z Execution Analysis: (:1) 2024-12-18T00:21:06.0517874Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0518150Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0518155Z 2024-12-18T00:21:06.0518353Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0518466Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0518687Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0518800Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0519001Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0519140Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0519289Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0519455Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0520038Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0520596Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0520948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0521288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0521587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0521855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0522153Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0522415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0522519Z Execution Analysis: .......... 2024-12-18T00:21:06.0522781Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0522977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0523267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1948 counts during 1856 steps 2024-12-18T00:21:06.0523272Z 2024-12-18T00:21:06.0523464Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0523579Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0523866Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0523974Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0524180Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0524319Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0524462Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0524626Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0524972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0525316Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0525617Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0525888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0526187Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0526452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0526735Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0526861Z Execution Analysis: (:1) 2024-12-18T00:21:06.0527210Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0527405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0527409Z 2024-12-18T00:21:06.0527607Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0527717Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0527949Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0528054Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0528260Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0528397Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0528536Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0528700Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0529276Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0529948Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0530278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0530606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0530888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0531145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0531426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0531673Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0531778Z Execution Analysis: .......... 2024-12-18T00:21:06.0532016Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0532204Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0532472Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1949 counts during 1857 steps 2024-12-18T00:21:06.0532476Z 2024-12-18T00:21:06.0532669Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0532771Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0533037Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0533146Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0533334Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0533477Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0533615Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0533772Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0534098Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0534419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0534710Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0534961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0535246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0535488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0535763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0535952Z Execution Analysis: (:1) 2024-12-18T00:21:06.0536239Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0536506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0536511Z 2024-12-18T00:21:06.0536696Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0536973Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0537200Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0537313Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0537518Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0537666Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0537809Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0537974Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0538572Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0539141Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0539506Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0539856Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0540170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0540440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0540756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0541026Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0541132Z Execution Analysis: .......... 2024-12-18T00:21:06.0541394Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0541598Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0541890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1950 counts during 1858 steps 2024-12-18T00:21:06.0541895Z 2024-12-18T00:21:06.0542097Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0542213Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0542501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0542614Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0542817Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0542964Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0543111Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0543281Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0543643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0543993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0544469Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0544740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0545047Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0545318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0545838Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0545968Z Execution Analysis: (:1) 2024-12-18T00:21:06.0546227Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0546432Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0546437Z 2024-12-18T00:21:06.0546640Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0546756Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0546988Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0547100Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0547311Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0547452Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0547608Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0547777Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0548369Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0548942Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0549300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0549656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0549965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0550241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0550553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0550822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0550925Z Execution Analysis: .......... 2024-12-18T00:21:06.0551177Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0551386Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0551672Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1951 counts during 1859 steps 2024-12-18T00:21:06.0551677Z 2024-12-18T00:21:06.0551882Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0551990Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0552282Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0552394Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0552601Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0552740Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0552878Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0553047Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0553402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0553752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0554064Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0554339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0554645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0554990Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0555311Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0555437Z Execution Analysis: (:1) 2024-12-18T00:21:06.0555700Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0555903Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0555908Z 2024-12-18T00:21:06.0556210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0556313Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0556528Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0556627Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0556818Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0556958Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0557093Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0557250Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0557794Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0558325Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0558654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0558974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0559265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0559521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0559808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0560053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0560153Z Execution Analysis: .......... 2024-12-18T00:21:06.0560391Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0560580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0560848Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1952 counts during 1860 steps 2024-12-18T00:21:06.0560852Z 2024-12-18T00:21:06.0561037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0561146Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0561413Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0561525Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0561710Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0561845Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0561972Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0562123Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0562456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0562776Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0563066Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0563318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0563640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0563952Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0564227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0564343Z Execution Analysis: (:1) 2024-12-18T00:21:06.0564581Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0564777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0564782Z 2024-12-18T00:21:06.0564969Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0565082Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0565297Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0565409Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0565607Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0565739Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0565881Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0566034Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0566586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0567115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0567450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0567778Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0568072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0568328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0568611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0568867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0568963Z Execution Analysis: .......... 2024-12-18T00:21:06.0569205Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0569392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0569665Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1953 counts during 1861 steps 2024-12-18T00:21:06.0569670Z 2024-12-18T00:21:06.0569852Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0569971Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0570237Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0570340Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0570535Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0570667Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0570802Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0570956Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0571284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0571612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0571898Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0572173Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0572540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0572790Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0573061Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0573183Z Execution Analysis: (:1) 2024-12-18T00:21:06.0573421Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0573605Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0573615Z 2024-12-18T00:21:06.0573801Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0573904Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0574125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0574232Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0574430Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0574561Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0574693Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0574853Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0575394Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0575927Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0576256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0576672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0577145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0577417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0577726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0577990Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0578101Z Execution Analysis: .......... 2024-12-18T00:21:06.0578356Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0578560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0578847Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1954 counts during 1862 steps 2024-12-18T00:21:06.0578852Z 2024-12-18T00:21:06.0579062Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0579178Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0579474Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0579584Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0579786Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0579935Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0580075Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0580247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0580605Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0580961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0581302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0581646Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0581958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0582221Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0582513Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0582634Z Execution Analysis: (:1) 2024-12-18T00:21:06.0582895Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0583095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0583100Z 2024-12-18T00:21:06.0583305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0583420Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0583651Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0583762Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0583968Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0584121Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0584266Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0584431Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0585029Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0585599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0585969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0586325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0586646Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0586921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0587234Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0587505Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0587617Z Execution Analysis: .......... 2024-12-18T00:21:06.0587875Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0588077Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0588377Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1956 counts during 1863 steps 2024-12-18T00:21:06.0588385Z 2024-12-18T00:21:06.0588589Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0588708Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0589105Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0589214Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0589405Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0589534Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0589675Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0589832Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0590174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0590500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0590885Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0591140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0591419Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0591677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0591946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0592070Z Execution Analysis: (:1) 2024-12-18T00:21:06.0592309Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0592502Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0592506Z 2024-12-18T00:21:06.0592697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0592813Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0593026Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0593126Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0593327Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0593461Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0593600Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0593754Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0594310Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0594840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0595176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0595503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0595789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0596218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0596517Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0596780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0596881Z Execution Analysis: .......... 2024-12-18T00:21:06.0597137Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0597335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0597620Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1957 counts during 1864 steps 2024-12-18T00:21:06.0597625Z 2024-12-18T00:21:06.0597827Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0597938Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0598228Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0598334Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0598540Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0598679Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0598813Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0598982Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0599330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0599772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0600077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0600348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0600645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0600910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0601195Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0601313Z Execution Analysis: (:1) 2024-12-18T00:21:06.0601574Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0601771Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0601781Z 2024-12-18T00:21:06.0601984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0602095Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0602325Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0602432Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0602628Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0602770Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0602911Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0603077Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0603653Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0604220Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0604573Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0604918Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0605222Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0605486Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0605789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0606049Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0606159Z Execution Analysis: .......... 2024-12-18T00:21:06.0606409Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0606622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0606907Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1958 counts during 1865 steps 2024-12-18T00:21:06.0606911Z 2024-12-18T00:21:06.0607114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0607384Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0607674Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0607791Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0607996Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0608143Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0608287Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0608451Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0608843Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0609281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0609599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0609873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0610184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0610453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0610752Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0610878Z Execution Analysis: (:1) 2024-12-18T00:21:06.0611135Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0611356Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0611360Z 2024-12-18T00:21:06.0611560Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0611680Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0611912Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0612026Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0612233Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0612373Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0612525Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0612795Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0613383Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0613948Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0614303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0614646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0614952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0615217Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0615513Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0615782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0615886Z Execution Analysis: .......... 2024-12-18T00:21:06.0616140Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0616408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0616705Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1959 counts during 1866 steps 2024-12-18T00:21:06.0616710Z 2024-12-18T00:21:06.0617075Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0617199Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0617489Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0617599Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0617813Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0617956Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0618106Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0618304Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0618742Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0619091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0619401Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0619686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0619991Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0620265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0620555Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0620690Z Execution Analysis: (:1) 2024-12-18T00:21:06.0620950Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0621156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0621170Z 2024-12-18T00:21:06.0621375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0621486Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0621723Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0621831Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0622046Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0622191Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0622345Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0622510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0623102Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0623682Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0624040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0624399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0624711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0624989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0625297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0625568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0625680Z Execution Analysis: .......... 2024-12-18T00:21:06.0625938Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0626145Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0626434Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1960 counts during 1867 steps 2024-12-18T00:21:06.0626438Z 2024-12-18T00:21:06.0626645Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0626758Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0627050Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0627159Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0627359Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0627510Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0627728Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0627928Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0628286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0628749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0629054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0629416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0629707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0629952Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0630232Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0630354Z Execution Analysis: (:1) 2024-12-18T00:21:06.0630603Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0630792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0630796Z 2024-12-18T00:21:06.0630989Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0631094Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0631305Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0631414Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0631604Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0631742Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0631882Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0632042Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0632596Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0633122Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0633463Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0633786Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0634080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0634336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0634629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0634882Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0634988Z Execution Analysis: .......... 2024-12-18T00:21:06.0635226Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0635411Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0635687Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1961 counts during 1868 steps 2024-12-18T00:21:06.0635692Z 2024-12-18T00:21:06.0635878Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0635991Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0636260Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0636367Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0636556Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0636755Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0636918Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0637071Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0637409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0637732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0638024Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0638277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0638564Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0638811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0639079Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0639207Z Execution Analysis: (:1) 2024-12-18T00:21:06.0639448Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0639644Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0639648Z 2024-12-18T00:21:06.0639834Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0639945Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0640157Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0640255Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0640449Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0640580Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0640723Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0640883Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0641437Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0641964Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0642298Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0642622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0642906Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0643163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0643447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0643707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0643807Z Execution Analysis: .......... 2024-12-18T00:21:06.0644048Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0644390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0644838Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1962 counts during 1869 steps 2024-12-18T00:21:06.0644853Z 2024-12-18T00:21:06.0645055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0645170Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0645463Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0645572Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0645946Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0646092Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0646240Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0646406Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0646760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0647114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0647423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0647702Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0648007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0648280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0648575Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0648696Z Execution Analysis: (:1) 2024-12-18T00:21:06.0648962Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0649163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0649167Z 2024-12-18T00:21:06.0649376Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0649488Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0649721Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0649831Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0650043Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0650187Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0650338Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0650512Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0651107Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0651683Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0652040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0652399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0652710Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0652982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0653303Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0653569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0653683Z Execution Analysis: .......... 2024-12-18T00:21:06.0653943Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0654152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0654440Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1963 counts during 1870 steps 2024-12-18T00:21:06.0654445Z 2024-12-18T00:21:06.0654651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0654764Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0655081Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0655270Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0655475Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0655628Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0655771Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0655943Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0656304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0656735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0657059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0657334Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0657654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0657927Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0658228Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0658355Z Execution Analysis: (:1) 2024-12-18T00:21:06.0658610Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0658821Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0658826Z 2024-12-18T00:21:06.0659024Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0659148Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0659378Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0659493Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0659704Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0659857Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0660007Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0660170Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0660773Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0661345Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0661709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0662062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0662385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0662662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0662976Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0663244Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0663350Z Execution Analysis: .......... 2024-12-18T00:21:06.0663612Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0663813Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0664106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1964 counts during 1871 steps 2024-12-18T00:21:06.0664111Z 2024-12-18T00:21:06.0664309Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0664457Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0664820Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0664935Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0665144Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0665288Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0665436Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0665600Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0665963Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0666314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0666626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0666903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0667219Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0667490Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0667779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0667910Z Execution Analysis: (:1) 2024-12-18T00:21:06.0668170Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0668380Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0668384Z 2024-12-18T00:21:06.0668585Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0668698Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0669036Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0669148Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0669356Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0669495Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0669640Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0669800Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0670380Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0671045Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0671378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0671706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0671998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0672257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0672540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0672793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0672890Z Execution Analysis: .......... 2024-12-18T00:21:06.0673128Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0673326Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0673597Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1965 counts during 1872 steps 2024-12-18T00:21:06.0673601Z 2024-12-18T00:21:06.0673817Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0674005Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0674287Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0674390Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0674587Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0674719Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0674852Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0675013Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0675346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0675684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0675970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0676239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0676522Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0676772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0677048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0677166Z Execution Analysis: (:1) 2024-12-18T00:21:06.0677416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0677606Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0677610Z 2024-12-18T00:21:06.0677809Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0677915Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0678142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0678245Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0678440Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0678586Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0678724Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0678888Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0679433Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0679975Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0680308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0680637Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0680932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0681186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0681480Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0681730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0681839Z Execution Analysis: .......... 2024-12-18T00:21:06.0682079Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0682268Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0682544Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1966 counts during 1873 steps 2024-12-18T00:21:06.0682615Z 2024-12-18T00:21:06.0682828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0682942Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0683210Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0683322Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0683511Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0683650Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0683782Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0683938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0684271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0684595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0684890Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0685150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0685442Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0685690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0685958Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0686081Z Execution Analysis: (:1) 2024-12-18T00:21:06.0686320Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0686512Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0686516Z 2024-12-18T00:21:06.0686707Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0686824Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0687038Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0687150Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0687342Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0687475Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0687617Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0687773Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0688326Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0688856Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0689198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0689527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0689816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0690070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0690354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0690604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0690703Z Execution Analysis: .......... 2024-12-18T00:21:06.0690949Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0691137Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0691528Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1967 counts during 1874 steps 2024-12-18T00:21:06.0691580Z 2024-12-18T00:21:06.0691769Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0691874Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0692148Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0692252Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0692449Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0692582Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0692723Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0692877Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0693209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0693540Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0693834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0694096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0694381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0694633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0694902Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0695023Z Execution Analysis: (:1) 2024-12-18T00:21:06.0695260Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0695449Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0695453Z 2024-12-18T00:21:06.0695653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0695761Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0695979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0696084Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0696283Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0696491Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0696631Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0696959Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0697551Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0698133Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0698500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0698864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0699177Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0699463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0699770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0700039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0700154Z Execution Analysis: .......... 2024-12-18T00:21:06.0700412Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0700650Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0701014Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1968 counts during 1875 steps 2024-12-18T00:21:06.0701019Z 2024-12-18T00:21:06.0701228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0701342Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0701635Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0701753Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0701962Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0702112Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0702257Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0702436Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0702796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0703153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0703471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0703744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0704054Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0704321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0704619Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0704744Z Execution Analysis: (:1) 2024-12-18T00:21:06.0705013Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0705217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0705227Z 2024-12-18T00:21:06.0705429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0705549Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0705781Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0705898Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0706108Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0706260Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0706405Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0706572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0707173Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0707748Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0708118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0708468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0708785Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0709166Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0709475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0709736Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0709847Z Execution Analysis: .......... 2024-12-18T00:21:06.0710132Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0710422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0710715Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1969 counts during 1876 steps 2024-12-18T00:21:06.0710720Z 2024-12-18T00:21:06.0710917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0711039Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0711321Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0711443Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0711642Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0711783Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0711930Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0712093Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0712457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0712797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0713109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0713472Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0713757Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0714006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0714278Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0714403Z Execution Analysis: (:1) 2024-12-18T00:21:06.0714644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0714846Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0714850Z 2024-12-18T00:21:06.0715036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0715148Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0715359Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0715464Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0715661Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0715797Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0715939Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0716095Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0716648Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0717183Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0717517Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0718027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0718331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0718606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0718907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0719176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0719281Z Execution Analysis: .......... 2024-12-18T00:21:06.0719630Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0719832Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0720113Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1970 counts during 1877 steps 2024-12-18T00:21:06.0720117Z 2024-12-18T00:21:06.0720325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0720438Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0720728Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0720836Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0721049Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0721191Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0721332Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0721510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0721859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0722210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0722514Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0722789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0723090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0723350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0723642Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0723766Z Execution Analysis: (:1) 2024-12-18T00:21:06.0724029Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0724226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0724230Z 2024-12-18T00:21:06.0724441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0724552Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0724786Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0724896Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0725100Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0725250Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0725396Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0725570Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0726150Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0726721Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0727073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0727417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0727723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0727990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0728297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0728584Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0728772Z Execution Analysis: .......... 2024-12-18T00:21:06.0729024Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0729226Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0729506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1971 counts during 1878 steps 2024-12-18T00:21:06.0729510Z 2024-12-18T00:21:06.0729812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0729924Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0730191Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0730299Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0730487Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0730627Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0730762Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0730919Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0731253Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0731578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0731873Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0732125Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0732415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0732663Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0732944Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0733063Z Execution Analysis: (:1) 2024-12-18T00:21:06.0733301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0733495Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0733499Z 2024-12-18T00:21:06.0733686Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0733798Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0734013Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0734122Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0734312Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0734444Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0734584Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0734741Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0735298Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0735828Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0736166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0736577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0737047Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0737321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0737743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0738091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0738200Z Execution Analysis: .......... 2024-12-18T00:21:06.0738469Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0738673Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0738973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1972 counts during 1879 steps 2024-12-18T00:21:06.0738977Z 2024-12-18T00:21:06.0739181Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0739302Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0739593Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0739707Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0739926Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0740079Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0740233Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0740400Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0740759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0741118Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0741430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0741708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0742017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0742293Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0742593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0742728Z Execution Analysis: (:1) 2024-12-18T00:21:06.0742988Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0743192Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0743205Z 2024-12-18T00:21:06.0743405Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0743520Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0743760Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0743872Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0744088Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0744363Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0744517Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0744694Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0745287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0745872Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0746233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0746595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0746905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0747189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0747657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0747930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0748042Z Execution Analysis: .......... 2024-12-18T00:21:06.0748302Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0748515Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0748806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1973 counts during 1880 steps 2024-12-18T00:21:06.0748811Z 2024-12-18T00:21:06.0749130Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0749241Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0749534Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0749650Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0749855Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0750009Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0750149Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0750319Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0750665Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0751016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0751318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0751584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0751886Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0752152Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0752441Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0752564Z Execution Analysis: (:1) 2024-12-18T00:21:06.0752825Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0753023Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0753027Z 2024-12-18T00:21:06.0753232Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0753343Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0753567Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0753679Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0753883Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0754036Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0754178Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0754345Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0754927Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0755487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0755942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0756267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0756564Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0756918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0757213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0757464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0757573Z Execution Analysis: .......... 2024-12-18T00:21:06.0757811Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0757999Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0758274Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1974 counts during 1881 steps 2024-12-18T00:21:06.0758279Z 2024-12-18T00:21:06.0758466Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0758580Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0758856Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0758972Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0759160Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0759293Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0759434Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0759590Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0759928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0760254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0760549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0760809Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0761098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0761365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0761638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0761766Z Execution Analysis: (:1) 2024-12-18T00:21:06.0762006Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0762207Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0762211Z 2024-12-18T00:21:06.0762398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0762518Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0762734Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0762840Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0763050Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0763186Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0763342Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0763499Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0764060Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0764590Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0764922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0765259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0765575Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0765913Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0766200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0766456Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0766555Z Execution Analysis: .......... 2024-12-18T00:21:06.0766808Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0766998Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0767269Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1975 counts during 1882 steps 2024-12-18T00:21:06.0767274Z 2024-12-18T00:21:06.0767474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0767589Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0767876Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0767981Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0768185Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0768318Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0768453Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0768617Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0768952Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0769288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0769579Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0769847Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0770138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0770406Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0770848Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0770973Z Execution Analysis: (:1) 2024-12-18T00:21:06.0771231Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0771428Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0771432Z 2024-12-18T00:21:06.0771639Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0771749Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0771985Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0772097Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0772299Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0772447Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0772590Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0772766Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0773342Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0773908Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0774255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0774950Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0775331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0775603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0775913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0776174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0776290Z Execution Analysis: .......... 2024-12-18T00:21:06.0776616Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0776991Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0777279Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1977 counts during 1883 steps 2024-12-18T00:21:06.0777283Z 2024-12-18T00:21:06.0777504Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0777623Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0777919Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0778041Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0778249Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0778406Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0778547Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0778714Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0779083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0779436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0779758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0780035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0780354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0780622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0780927Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0781048Z Execution Analysis: (:1) 2024-12-18T00:21:06.0781309Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0781523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0781528Z 2024-12-18T00:21:06.0781729Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0781858Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0782092Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0782215Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0782424Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0782570Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0782730Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0782898Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0783504Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0784077Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0784486Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0784916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0785241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0785516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0785826Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0786107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0786218Z Execution Analysis: .......... 2024-12-18T00:21:06.0786493Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0786697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0787001Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1978 counts during 1884 steps 2024-12-18T00:21:06.0787009Z 2024-12-18T00:21:06.0787216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0787345Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0787636Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0787749Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0787963Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0788109Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0788262Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0788427Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0788903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0789249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0789556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0789831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0790132Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0790404Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0790689Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0790820Z Execution Analysis: (:1) 2024-12-18T00:21:06.0791071Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0791272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0791287Z 2024-12-18T00:21:06.0791484Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0791601Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0791837Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0791944Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0792157Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0792296Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0792452Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0792615Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0793193Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0793863Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0794292Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0794626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0794913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0795176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0795460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0795723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0795821Z Execution Analysis: .......... 2024-12-18T00:21:06.0796060Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0796259Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0796531Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1979 counts during 1885 steps 2024-12-18T00:21:06.0796536Z 2024-12-18T00:21:06.0796734Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0796840Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0797117Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0797222Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0797412Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0797554Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0797684Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0797849Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0798180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0798523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0798813Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0799066Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0799362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0799610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0799893Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0800008Z Execution Analysis: (:1) 2024-12-18T00:21:06.0800261Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0800453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0800460Z 2024-12-18T00:21:06.0800664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0800769Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0800982Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0801097Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0801289Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0801433Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0801570Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0801735Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0802281Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0802859Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0803248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0803575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0803870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0804122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0804420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0804667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0804779Z Execution Analysis: .......... 2024-12-18T00:21:06.0805021Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0805217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0805496Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1980 counts during 1886 steps 2024-12-18T00:21:06.0805500Z 2024-12-18T00:21:06.0805689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0805807Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0806075Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0806192Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0806381Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0806517Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0806665Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0806821Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0807167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0807495Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0807799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0808054Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0808355Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0808604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0808876Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0809005Z Execution Analysis: (:1) 2024-12-18T00:21:06.0809245Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0809453Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0809457Z 2024-12-18T00:21:06.0809651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0809772Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0809988Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0810094Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0810300Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0810435Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0810584Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0810738Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0811298Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0811938Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0812290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0812618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0812909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0813174Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0813459Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0813719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0813822Z Execution Analysis: .......... 2024-12-18T00:21:06.0814077Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0814269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0814536Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1981 counts during 1887 steps 2024-12-18T00:21:06.0814552Z 2024-12-18T00:21:06.0814738Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0814848Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0815126Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0815226Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0815428Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0815564Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0815706Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0815861Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0816195Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0816602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0817069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0817354Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0817661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0817942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0818233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0818361Z Execution Analysis: (:1) 2024-12-18T00:21:06.0818632Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0818842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0818846Z 2024-12-18T00:21:06.0819058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0819172Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0819413Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0819521Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0819744Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0819889Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0820036Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0820212Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0820861Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0821493Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0821855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0822219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0822532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0822804Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0823125Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0823396Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0823518Z Execution Analysis: .......... 2024-12-18T00:21:06.0823776Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0823990Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0824280Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1982 counts during 1888 steps 2024-12-18T00:21:06.0824285Z 2024-12-18T00:21:06.0824500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0824614Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0824904Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0825025Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0825229Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0825380Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0825527Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0825709Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0826065Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0826417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0826739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0827014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0827334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0827604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0827909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0828039Z Execution Analysis: (:1) 2024-12-18T00:21:06.0828300Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0828511Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0828515Z 2024-12-18T00:21:06.0828718Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0828843Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0829179Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0829400Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0829593Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0829739Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0829876Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0830032Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0830678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0831212Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0831553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0831880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0832176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0832430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0832726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0832979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0833078Z Execution Analysis: .......... 2024-12-18T00:21:06.0833330Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0833518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0833795Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1983 counts during 1889 steps 2024-12-18T00:21:06.0833799Z 2024-12-18T00:21:06.0833983Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0834105Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0834375Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0834478Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0834679Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0834817Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0834959Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0835117Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0835455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0835777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0836063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0836322Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0836609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0836866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0837140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0837274Z Execution Analysis: (:1) 2024-12-18T00:21:06.0837512Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0837709Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0837714Z 2024-12-18T00:21:06.0837900Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0838008Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0838227Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0838331Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0838533Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0838666Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0838930Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0839157Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0839704Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0840245Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0840576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0840913Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0841201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0841461Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0841751Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0842018Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0842117Z Execution Analysis: .......... 2024-12-18T00:21:06.0842361Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0842559Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0842829Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1984 counts during 1890 steps 2024-12-18T00:21:06.0842833Z 2024-12-18T00:21:06.0843031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0843136Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0843415Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0843517Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0843725Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0843860Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0843990Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0844281Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0844795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0845157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0845467Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0845756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0846061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0846330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0846636Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0846760Z Execution Analysis: (:1) 2024-12-18T00:21:06.0847026Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0847231Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0847236Z 2024-12-18T00:21:06.0847450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0847562Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0847795Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0847915Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0848125Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0848370Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0848595Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0848771Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0849361Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0849940Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0850300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0850651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0850971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0851250Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0851576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0851845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0851964Z Execution Analysis: .......... 2024-12-18T00:21:06.0852225Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0852429Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0852726Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1985 counts during 1891 steps 2024-12-18T00:21:06.0852731Z 2024-12-18T00:21:06.0852934Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0853058Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0853347Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0853473Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0853675Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0853828Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0853970Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0854137Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0854503Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0854851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0855167Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0855440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0855763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0856035Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0856327Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0856538Z Execution Analysis: (:1) 2024-12-18T00:21:06.0856797Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0857011Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0857016Z 2024-12-18T00:21:06.0857219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0857344Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0857573Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0857693Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0857961Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0858154Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0858309Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0858474Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0859069Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0859641Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0860006Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0860354Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0860667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0860949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0861253Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0861530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0861637Z Execution Analysis: .......... 2024-12-18T00:21:06.0861899Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0862100Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0862396Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1986 counts during 1892 steps 2024-12-18T00:21:06.0862401Z 2024-12-18T00:21:06.0862603Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0862717Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0863015Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0863123Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0863334Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0863475Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0863623Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0863788Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0864146Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0864500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0864807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0865086Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0865394Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0865670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0865957Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0866092Z Execution Analysis: (:1) 2024-12-18T00:21:06.0866347Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0866549Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0866554Z 2024-12-18T00:21:06.0866762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0866874Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0867111Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0867294Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0867535Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0867680Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0867824Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0867996Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0868694Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0869255Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0869603Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0869952Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0870258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0870534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0870830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0871089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0871201Z Execution Analysis: .......... 2024-12-18T00:21:06.0871451Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0871654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0871938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1987 counts during 1893 steps 2024-12-18T00:21:06.0871942Z 2024-12-18T00:21:06.0872146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0872261Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0872546Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0872662Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0872864Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0873013Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0873151Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0873319Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0873666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0874009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0874316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0874589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0874891Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0875155Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0875445Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0875563Z Execution Analysis: (:1) 2024-12-18T00:21:06.0875818Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0876012Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0876017Z 2024-12-18T00:21:06.0876214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0876329Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0876656Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0876773Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0876976Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0877121Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0877262Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0877425Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0878004Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0878561Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0878918Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0879267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0879577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0879842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0880152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0880412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0880514Z Execution Analysis: .......... 2024-12-18T00:21:06.0880771Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0880966Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0881251Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1988 counts during 1894 steps 2024-12-18T00:21:06.0881261Z 2024-12-18T00:21:06.0881459Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0881578Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0881859Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0881976Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0882172Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0882310Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0882457Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0882617Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0882970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0883309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0883629Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0883895Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0884195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0884462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0884746Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0884874Z Execution Analysis: (:1) 2024-12-18T00:21:06.0885126Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0885333Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0885338Z 2024-12-18T00:21:06.0885557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0885761Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0885987Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0886092Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0886299Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0886436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0886588Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0886748Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0887328Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0887989Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0888326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0888661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0888949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0889214Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0889498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0889750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0889847Z Execution Analysis: .......... 2024-12-18T00:21:06.0890086Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0890279Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0890551Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1989 counts during 1895 steps 2024-12-18T00:21:06.0890556Z 2024-12-18T00:21:06.0894260Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0894399Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0894688Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0894792Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0894988Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0895131Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0895266Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0895425Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0895761Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0896097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0896485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0896740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0897214Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0897481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0897778Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0897903Z Execution Analysis: (:1) 2024-12-18T00:21:06.0898171Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0898375Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0898445Z 2024-12-18T00:21:06.0898736Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0898851Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0899082Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0899200Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0899410Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0899556Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0899701Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0899872Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0900468Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0901046Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0901417Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0901768Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0902083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0902359Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0902669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0902935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0903047Z Execution Analysis: .......... 2024-12-18T00:21:06.0903306Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0903509Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0903806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1990 counts during 1896 steps 2024-12-18T00:21:06.0903811Z 2024-12-18T00:21:06.0904015Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0904132Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0904423Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0904536Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0904739Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0904891Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0905031Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0905195Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0905559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0905911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0906226Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0906494Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0906803Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0907067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0907357Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0907484Z Execution Analysis: (:1) 2024-12-18T00:21:06.0907741Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0907973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0908052Z 2024-12-18T00:21:06.0908254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0908368Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0908595Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0908703Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0908911Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0909155Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0909291Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0909441Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0909994Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0910525Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0910863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0911186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0911471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0911726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0912006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0912254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0912349Z Execution Analysis: .......... 2024-12-18T00:21:06.0912590Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0912782Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0913053Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1991 counts during 1897 steps 2024-12-18T00:21:06.0913058Z 2024-12-18T00:21:06.0913246Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0913352Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0913628Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0913730Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0913923Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0914052Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0914187Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0914339Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0914673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0915002Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0915288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0915547Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0915829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0916080Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0916345Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0916459Z Execution Analysis: (:1) 2024-12-18T00:21:06.0916726Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0916981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0916986Z 2024-12-18T00:21:06.0917176Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0917282Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0917500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0917599Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0917961Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0918098Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0918238Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0918405Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0918983Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0919555Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0919904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0920247Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0920546Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0920808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0921115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0921374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0921481Z Execution Analysis: .......... 2024-12-18T00:21:06.0921737Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0921938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0922217Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1992 counts during 1898 steps 2024-12-18T00:21:06.0922222Z 2024-12-18T00:21:06.0922422Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0922532Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0922811Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0922924Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0923124Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0923266Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0923407Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0923578Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0923921Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0924261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0924567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0924834Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0925134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0925393Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0925681Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0925798Z Execution Analysis: (:1) 2024-12-18T00:21:06.0926170Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0926369Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0926373Z 2024-12-18T00:21:06.0926570Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0926686Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0926908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0927022Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0927223Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0927366Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0927509Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0927670Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0928254Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0928812Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0929166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0929504Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0929918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0930172Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0930462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0930708Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0930808Z Execution Analysis: .......... 2024-12-18T00:21:06.0931049Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0931236Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0931507Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1993 counts during 1899 steps 2024-12-18T00:21:06.0931512Z 2024-12-18T00:21:06.0931695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0931802Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0932067Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0932168Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0932360Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0932496Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0932633Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0932787Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0933117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0933438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0933723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0933977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0934261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0934510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0934799Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0934987Z Execution Analysis: (:1) 2024-12-18T00:21:06.0935230Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0935420Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0935424Z 2024-12-18T00:21:06.0935609Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0935712Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0935927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0936028Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0936224Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0936428Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0936574Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0936735Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0937490Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0938074Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0938433Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0938788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0939097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0939377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0939684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0939964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0940068Z Execution Analysis: .......... 2024-12-18T00:21:06.0940327Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0940534Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0940823Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1994 counts during 1900 steps 2024-12-18T00:21:06.0940828Z 2024-12-18T00:21:06.0941034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0941148Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0941440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0941547Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0941759Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0941905Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0942047Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0942219Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0942572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0942924Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0943233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0943506Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0943810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0944076Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0944798Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0944925Z Execution Analysis: (:1) 2024-12-18T00:21:06.0945185Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0945391Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0945395Z 2024-12-18T00:21:06.0945602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0945714Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0945947Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0946056Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0946265Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0946412Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0946564Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0946733Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0947324Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0947900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0948252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0948599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0948912Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0949183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0949502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0949765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0949872Z Execution Analysis: .......... 2024-12-18T00:21:06.0950131Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0950335Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0950621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1995 counts during 1901 steps 2024-12-18T00:21:06.0950625Z 2024-12-18T00:21:06.0950825Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0950941Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0951227Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0951345Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0951548Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0951694Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0951834Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0952001Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0952363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0952711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0953023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0953294Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0953602Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0954003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0954293Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0954421Z Execution Analysis: (:1) 2024-12-18T00:21:06.0954677Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0954883Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0954888Z 2024-12-18T00:21:06.0955088Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0955206Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0955430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0955544Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0955754Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0955898Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0956046Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0956314Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0957050Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0957605Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0957957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0958296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0958597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0958877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0959176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0959438Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0959539Z Execution Analysis: .......... 2024-12-18T00:21:06.0959788Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0959984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0960271Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1996 counts during 1902 steps 2024-12-18T00:21:06.0960276Z 2024-12-18T00:21:06.0960472Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0960583Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0960879Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0960985Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0961187Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0961326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0961465Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0961627Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0961974Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0962320Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0962622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0962890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0963266Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0963557Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0963840Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0963964Z Execution Analysis: (:1) 2024-12-18T00:21:06.0964216Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0964412Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0964416Z 2024-12-18T00:21:06.0964619Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0964725Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0964955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0965063Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0965273Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0965410Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0965549Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0965719Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0966297Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0966860Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0967212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0967558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0967865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0968136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0968430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0968688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0968798Z Execution Analysis: .......... 2024-12-18T00:21:06.0969050Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0969253Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0969532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1998 counts during 1903 steps 2024-12-18T00:21:06.0969537Z 2024-12-18T00:21:06.0969735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0969849Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0970139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0970242Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0970540Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0970676Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0970803Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0970963Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0971291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0971609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0971902Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0972177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0972532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0972778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0973049Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0973161Z Execution Analysis: (:1) 2024-12-18T00:21:06.0973400Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0973582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0973587Z 2024-12-18T00:21:06.0973770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0973875Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0974085Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0974193Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0974381Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0974514Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0974645Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0974798Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0975347Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0975876Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0976207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0976609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0977081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0977352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0977664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0977928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0978031Z Execution Analysis: .......... 2024-12-18T00:21:06.0978291Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0978492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0978781Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1999 counts during 1904 steps 2024-12-18T00:21:06.0978786Z 2024-12-18T00:21:06.0978992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0979107Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0979395Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0979507Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0979709Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0979851Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0979997Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0980164Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0980524Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0980874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0981221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0981644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0981952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0982231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0982522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0982653Z Execution Analysis: (:1) 2024-12-18T00:21:06.0982909Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0983119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0983124Z 2024-12-18T00:21:06.0983324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0983448Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0983675Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0983786Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0983996Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0984139Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0984291Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0984454Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0985055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0985628Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0985988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0986349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0986661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0986941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0987251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0987525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0987629Z Execution Analysis: .......... 2024-12-18T00:21:06.0987893Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0988095Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0988387Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2000 counts during 1905 steps 2024-12-18T00:21:06.0988395Z 2024-12-18T00:21:06.0988606Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0988720Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0989123Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0989225Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0989421Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0989553Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0989684Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0989842Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0990172Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0990525Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0990891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0991149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0991430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0991674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0991946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.0992063Z Execution Analysis: (:1) 2024-12-18T00:21:06.0992309Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0992496Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0992500Z 2024-12-18T00:21:06.0992697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0992807Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0993027Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.0993126Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0993317Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.0993453Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.0993587Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.0993746Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0994288Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.0994819Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.0995154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.0995481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0995767Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0996018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.0996309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.0996556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.0996662Z Execution Analysis: .......... 2024-12-18T00:21:06.0996899Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.0997094Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0997361Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2001 counts during 1906 steps 2024-12-18T00:21:06.0997366Z 2024-12-18T00:21:06.0997551Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.0997659Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.0997929Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.0998041Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.0998227Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.0998365Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.0998497Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.0998652Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.0998985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.0999396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.0999688Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.0999939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1000229Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1000477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1000753Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1000868Z Execution Analysis: (:1) 2024-12-18T00:21:06.1001105Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1001294Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1001302Z 2024-12-18T00:21:06.1001490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1001600Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1001810Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1001918Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1002106Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1002237Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1002375Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1002529Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1003083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1003615Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1003953Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1004275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1004568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1004818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1005103Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1005355Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1005454Z Execution Analysis: .......... 2024-12-18T00:21:06.1005696Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1005891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1006164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2002 counts during 1907 steps 2024-12-18T00:21:06.1006328Z 2024-12-18T00:21:06.1006524Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1006640Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1006920Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1007026Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1007231Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1007373Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1007516Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1007677Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1008108Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1008471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1008772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1009043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1009342Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1009608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1009893Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1010021Z Execution Analysis: (:1) 2024-12-18T00:21:06.1010272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1010476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1010486Z 2024-12-18T00:21:06.1010681Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1010792Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1011022Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1011129Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1011336Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1011478Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1011620Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1011786Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1012363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1012929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1013277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1013625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1013927Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1014195Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1014491Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1014749Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1014859Z Execution Analysis: .......... 2024-12-18T00:21:06.1015116Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1015322Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1015599Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2003 counts during 1908 steps 2024-12-18T00:21:06.1015604Z 2024-12-18T00:21:06.1015806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1015912Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1016201Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1016308Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1016579Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1016722Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1017024Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1017275Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1017656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1018012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1018324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1018600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1018908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1019172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1019467Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1019589Z Execution Analysis: (:1) 2024-12-18T00:21:06.1019857Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1020063Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1020067Z 2024-12-18T00:21:06.1020278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1020389Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1020620Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1020732Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1020941Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1021090Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1021238Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1021414Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1022009Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1022586Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1022944Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1023293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1023608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1023881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1024192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1024456Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1024572Z Execution Analysis: .......... 2024-12-18T00:21:06.1024830Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1025034Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1025326Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2004 counts during 1909 steps 2024-12-18T00:21:06.1025330Z 2024-12-18T00:21:06.1025533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1025652Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1025941Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1026053Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1026258Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1026400Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1026643Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1026837Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1027201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1027554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1027871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1028143Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1028454Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1028834Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1029118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1029357Z Execution Analysis: (:1) 2024-12-18T00:21:06.1029597Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1029790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1029794Z 2024-12-18T00:21:06.1029979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1030090Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1030302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1030404Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1030600Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1030733Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1030877Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1031031Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1031595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1032126Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1032461Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1032785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1033073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1033332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1033617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1033879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1033977Z Execution Analysis: .......... 2024-12-18T00:21:06.1034220Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1034409Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1034678Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2005 counts during 1910 steps 2024-12-18T00:21:06.1034688Z 2024-12-18T00:21:06.1034873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1034978Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1035253Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1035353Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1035575Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1035774Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1035908Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1036064Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1036395Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1036724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1037012Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1037271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1037554Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1037804Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1038075Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1038194Z Execution Analysis: (:1) 2024-12-18T00:21:06.1038436Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1038623Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1038627Z 2024-12-18T00:21:06.1038820Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1038924Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1039138Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1039235Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1039428Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1039565Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1039702Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1039870Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1040414Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1040949Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1041279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1041610Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1041897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1042147Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1042437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1042684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1042787Z Execution Analysis: .......... 2024-12-18T00:21:06.1043023Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1043218Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1043483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2006 counts during 1911 steps 2024-12-18T00:21:06.1043487Z 2024-12-18T00:21:06.1043680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1043783Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1044051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1044344Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1044796Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1044944Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1045083Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1045250Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1045595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1045936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1046240Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1046504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1046810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1047072Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1047374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1047495Z Execution Analysis: (:1) 2024-12-18T00:21:06.1047746Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1047950Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1047955Z 2024-12-18T00:21:06.1048149Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1048268Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1048490Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1048603Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1048804Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1048950Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1049101Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1049265Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1049842Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1050400Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1050753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1051092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1051400Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1051665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1051969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1052235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1052337Z Execution Analysis: .......... 2024-12-18T00:21:06.1052595Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1052794Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1053080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2007 counts during 1912 steps 2024-12-18T00:21:06.1053084Z 2024-12-18T00:21:06.1053281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1053397Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1053702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1053884Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1054090Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1054230Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1054377Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1054540Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1054891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1055229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1055532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1055802Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1056102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1056449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1056733Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1057026Z Execution Analysis: (:1) 2024-12-18T00:21:06.1057283Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1057494Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1057499Z 2024-12-18T00:21:06.1057699Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1057815Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1058047Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1058155Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1058371Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1058514Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1058665Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1058830Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1059418Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1059993Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1060347Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1060702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1061013Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1061298Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1061606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1061876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1061981Z Execution Analysis: .......... 2024-12-18T00:21:06.1062237Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1062441Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1062728Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2008 counts during 1913 steps 2024-12-18T00:21:06.1062732Z 2024-12-18T00:21:06.1062938Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1063117Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1063459Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1063569Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1063772Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1063924Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1064063Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1064237Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1064596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1064953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1065260Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1065534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1065852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1066122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1066418Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1066539Z Execution Analysis: (:1) 2024-12-18T00:21:06.1066802Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1067003Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1067008Z 2024-12-18T00:21:06.1067216Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1067327Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1067557Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1067675Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1067884Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1068033Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1068181Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1068353Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1069051Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1069605Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1069961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1070307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1070624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1070888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1071194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1071455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1071573Z Execution Analysis: .......... 2024-12-18T00:21:06.1071820Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1072019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1072310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2009 counts during 1914 steps 2024-12-18T00:21:06.1072314Z 2024-12-18T00:21:06.1072539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1072729Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1073013Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1073130Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1073330Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1073479Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1073615Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1073780Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1074136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1074475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1074791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1075066Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1075377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1075636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1076019Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1076143Z Execution Analysis: (:1) 2024-12-18T00:21:06.1076381Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1076577Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1076581Z 2024-12-18T00:21:06.1076767Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1076884Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1077102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1077207Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1077410Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1077542Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1077686Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1077840Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1078392Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1078920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1079264Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1079591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1079878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1080140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1080422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1080678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1080772Z Execution Analysis: .......... 2024-12-18T00:21:06.1081015Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1081199Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1081477Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2010 counts during 1915 steps 2024-12-18T00:21:06.1081552Z 2024-12-18T00:21:06.1081762Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1081867Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1082142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1082242Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1082441Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1082573Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1082716Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1082871Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1083200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1083530Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1083823Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1084084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1084365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1084621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1084884Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1085001Z Execution Analysis: (:1) 2024-12-18T00:21:06.1085249Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1085438Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1085442Z 2024-12-18T00:21:06.1085638Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1085746Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1085967Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1086068Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1086264Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1086395Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1086529Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1086691Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1087232Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1087767Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1088100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1088433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1088719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1088982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1089262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1089510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1089614Z Execution Analysis: .......... 2024-12-18T00:21:06.1089851Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1090045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1090414Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2011 counts during 1916 steps 2024-12-18T00:21:06.1090419Z 2024-12-18T00:21:06.1090617Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1090722Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1090992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1091100Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1091289Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1091432Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1091563Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1091731Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1092062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1092388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1092690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1092943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1093237Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1093485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1093765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1093879Z Execution Analysis: (:1) 2024-12-18T00:21:06.1094127Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1094313Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1094320Z 2024-12-18T00:21:06.1094506Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1094618Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1094829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1094938Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1095128Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1095277Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1095411Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1095564Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1096113Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1096720Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1097258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1097611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1097939Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1098214Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1098536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1098802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1098910Z Execution Analysis: .......... 2024-12-18T00:21:06.1099174Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1099406Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1099779Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2012 counts during 1917 steps 2024-12-18T00:21:06.1099784Z 2024-12-18T00:21:06.1099984Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1100105Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1100393Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1100507Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1100722Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1100870Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1101022Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1101189Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1101557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1101909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1102231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1102500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1102805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1103083Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1103370Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1103507Z Execution Analysis: (:1) 2024-12-18T00:21:06.1103761Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1103973Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1103983Z 2024-12-18T00:21:06.1104184Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1104297Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1104533Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1104642Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1104857Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1104999Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1105162Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1105328Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1105922Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1106512Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1106869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1107229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1107540Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1107825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1108134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1108414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1108518Z Execution Analysis: .......... 2024-12-18T00:21:06.1108800Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1109193Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1109477Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2013 counts during 1918 steps 2024-12-18T00:21:06.1109481Z 2024-12-18T00:21:06.1109684Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1109792Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1110083Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1110191Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1110401Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1110537Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1110671Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1111008Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1111367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1111731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1112038Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1112319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1112622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1112891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1113190Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1113313Z Execution Analysis: (:1) 2024-12-18T00:21:06.1113581Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1113789Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1113794Z 2024-12-18T00:21:06.1114007Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1114119Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1114360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1114467Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1114674Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1114827Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1114974Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1115148Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1115740Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1116329Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1116685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1117034Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1117352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1117625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1117943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1118206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1118351Z Execution Analysis: .......... 2024-12-18T00:21:06.1118682Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1118895Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1119183Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2014 counts during 1919 steps 2024-12-18T00:21:06.1119188Z 2024-12-18T00:21:06.1119390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1119514Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1119804Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1119923Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1120127Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1120280Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1120424Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1120594Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1120961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1121312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1121633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1121907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1122220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1122485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1122880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1123013Z Execution Analysis: (:1) 2024-12-18T00:21:06.1123268Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1123474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1123479Z 2024-12-18T00:21:06.1123675Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1123799Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1124022Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1124138Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1124338Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1124477Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1124627Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1124787Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1125374Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1125929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1126285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1126622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1126932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1127195Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1127493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1127787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1128051Z Execution Analysis: .......... 2024-12-18T00:21:06.1128312Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1128507Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1128800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2015 counts during 1920 steps 2024-12-18T00:21:06.1128804Z 2024-12-18T00:21:06.1128995Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1129106Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1129397Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1129501Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1129815Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1129952Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1130098Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1130248Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1130578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1130910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1131197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1131455Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1131735Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1131991Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1132259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1132388Z Execution Analysis: (:1) 2024-12-18T00:21:06.1132625Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1132810Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1132814Z 2024-12-18T00:21:06.1133009Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1133113Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1133334Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1133434Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1133635Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1133765Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1133902Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1134067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1134613Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1135151Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1135481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1135814Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1136103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1136436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1136752Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1137254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1137374Z Execution Analysis: .......... 2024-12-18T00:21:06.1137633Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1137848Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1138138Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2016 counts during 1921 steps 2024-12-18T00:21:06.1138143Z 2024-12-18T00:21:06.1138359Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1138475Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1138779Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1138888Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1139101Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1139255Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1139397Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1139585Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1139940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1140300Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1140608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1140882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1141198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1141468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1141776Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1141898Z Execution Analysis: (:1) 2024-12-18T00:21:06.1142168Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1142367Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1142371Z 2024-12-18T00:21:06.1142572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1142693Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1142920Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1143035Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1143239Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1143393Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1143545Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1143713Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1144461Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1145033Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1145397Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1145745Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1146066Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1146391Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1146804Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1147072Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1147180Z Execution Analysis: .......... 2024-12-18T00:21:06.1147450Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1147653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1147953Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2017 counts during 1922 steps 2024-12-18T00:21:06.1147958Z 2024-12-18T00:21:06.1148156Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1148280Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1148571Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1148700Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1148903Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1149047Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1149201Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1149365Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1149731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1150079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1150399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1150672Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1150981Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1151264Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1151553Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1151692Z Execution Analysis: (:1) 2024-12-18T00:21:06.1151948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1152159Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1152164Z 2024-12-18T00:21:06.1152363Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1152490Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1152720Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1152828Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1153044Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1153191Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1153346Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1153511Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1154114Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1154680Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1155039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1155400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1155710Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1156195Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1156478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1156736Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1156835Z Execution Analysis: .......... 2024-12-18T00:21:06.1157085Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1157271Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1157538Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2019 counts during 1923 steps 2024-12-18T00:21:06.1157542Z 2024-12-18T00:21:06.1157740Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1157847Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1158136Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1158239Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1158440Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1158575Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1158705Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1158870Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1159200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1159539Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1159827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1160094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1160386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1160637Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1160920Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1161034Z Execution Analysis: (:1) 2024-12-18T00:21:06.1161287Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1161474Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1161478Z 2024-12-18T00:21:06.1161679Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1161784Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1162012Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1162120Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1162319Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1162467Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1162602Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1162769Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1163312Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1163851Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1164185Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1164519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1164909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1165164Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1165466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1165712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1165823Z Execution Analysis: .......... 2024-12-18T00:21:06.1166062Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1166262Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1166532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2020 counts during 1924 steps 2024-12-18T00:21:06.1166536Z 2024-12-18T00:21:06.1166727Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1166854Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1167123Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1167239Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1167428Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1167575Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1167710Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1167866Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1168208Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1168533Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1168833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1169088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1169386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1169634Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1169913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1170031Z Execution Analysis: (:1) 2024-12-18T00:21:06.1170265Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1170469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1170474Z 2024-12-18T00:21:06.1170656Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1170770Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1170985Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1171100Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1171291Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1171421Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1171567Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1171722Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1172278Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1172808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1173148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1173497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1173871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1174125Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1174406Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1174666Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1174761Z Execution Analysis: .......... 2024-12-18T00:21:06.1175007Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1175196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1175469Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2021 counts during 1925 steps 2024-12-18T00:21:06.1175474Z 2024-12-18T00:21:06.1175667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1175782Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1176053Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1176154Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1176421Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1176565Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1176710Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1177039Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1177405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1177759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1178071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1178362Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1178670Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1178952Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1179243Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1179382Z Execution Analysis: (:1) 2024-12-18T00:21:06.1179645Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1179846Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1179862Z 2024-12-18T00:21:06.1180066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1180182Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1180425Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1180534Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1180753Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1180894Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1181039Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1181222Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1181811Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1182396Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1182784Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1183219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1183530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1183811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1184119Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1184383Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1184502Z Execution Analysis: .......... 2024-12-18T00:21:06.1184760Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1184974Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1185265Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2022 counts during 1926 steps 2024-12-18T00:21:06.1185273Z 2024-12-18T00:21:06.1185487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1185599Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1185900Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1186012Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1186213Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1186368Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1186506Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1186685Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1187039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1187402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1187719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1187988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1188310Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1188574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1188880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1189108Z Execution Analysis: (:1) 2024-12-18T00:21:06.1189358Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1189546Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1189550Z 2024-12-18T00:21:06.1189751Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1189857Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1190067Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1190181Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1190375Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1190515Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1190648Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1190811Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1191359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1191887Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1192324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1192649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1192949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1193200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1193497Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1193745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1193855Z Execution Analysis: .......... 2024-12-18T00:21:06.1194094Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1194281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1194565Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2023 counts during 1927 steps 2024-12-18T00:21:06.1194569Z 2024-12-18T00:21:06.1194756Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1194872Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1195139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1195252Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1195444Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1195581Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1195726Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1195877Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1196219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1196548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1196847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1197097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1197381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1197640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1197907Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1198035Z Execution Analysis: (:1) 2024-12-18T00:21:06.1198269Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1198468Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1198476Z 2024-12-18T00:21:06.1198662Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1198778Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1198992Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1199092Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1199298Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1199428Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1199572Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1199724Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1200286Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1200878Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1201271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1201599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1201886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1202154Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1202438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1202695Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1202794Z Execution Analysis: .......... 2024-12-18T00:21:06.1203045Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1203240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1203509Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2024 counts during 1928 steps 2024-12-18T00:21:06.1203524Z 2024-12-18T00:21:06.1203714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1203817Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1204100Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1204204Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1204405Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1204540Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1204674Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1204844Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1205180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1205521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1205811Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1206080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1206366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1206626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1206898Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1207015Z Execution Analysis: (:1) 2024-12-18T00:21:06.1207268Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1207463Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1207466Z 2024-12-18T00:21:06.1207667Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1207773Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1208000Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1208102Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1208294Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1208600Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1208741Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1208913Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1209516Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1210156Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1210505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1210856Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1211163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1211430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1211741Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1212004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1212118Z Execution Analysis: .......... 2024-12-18T00:21:06.1212374Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1212580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1212860Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2025 counts during 1929 steps 2024-12-18T00:21:06.1212864Z 2024-12-18T00:21:06.1213070Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1213183Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1213462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1213582Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1213777Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1213925Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1214064Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1214242Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1214588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1214928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1215241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1215502Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1215810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1216067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1216424Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1216551Z Execution Analysis: (:1) 2024-12-18T00:21:06.1216971Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1217189Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1217193Z 2024-12-18T00:21:06.1217393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1217520Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1217748Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1217866Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1218073Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1218226Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1218373Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1218542Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1219202Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1219823Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1220196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1220543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1220862Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1221137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1221443Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1221722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1221831Z Execution Analysis: .......... 2024-12-18T00:21:06.1222101Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1222302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1222605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2026 counts during 1930 steps 2024-12-18T00:21:06.1222610Z 2024-12-18T00:21:06.1222815Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1222942Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1223233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1223342Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1223559Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1223703Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1223864Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1224033Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1224403Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1224755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1225067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1225353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1225663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1225941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1226231Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1226372Z Execution Analysis: (:1) 2024-12-18T00:21:06.1226635Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1226847Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1226851Z 2024-12-18T00:21:06.1227052Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1227164Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1227402Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1227513Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1227730Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1227873Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1228029Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1228221Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1228894Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1229690Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1230022Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1230361Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1230647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1230906Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1231189Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1231455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1231557Z Execution Analysis: .......... 2024-12-18T00:21:06.1231793Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1231994Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1232257Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2027 counts during 1931 steps 2024-12-18T00:21:06.1232261Z 2024-12-18T00:21:06.1232461Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1232563Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1232838Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1232941Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1233129Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1233280Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1233411Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1233581Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1233907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1234242Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1234530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1234781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1235076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1235319Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1235611Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1235727Z Execution Analysis: (:1) 2024-12-18T00:21:06.1235975Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1236160Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1236164Z 2024-12-18T00:21:06.1236356Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1236461Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1236670Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1236784Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1236977Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1237123Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1237309Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1237528Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1238075Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1238599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1238945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1239271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1239574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1239825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1240130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1240380Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1240490Z Execution Analysis: .......... 2024-12-18T00:21:06.1240730Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1240916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1241195Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2028 counts during 1932 steps 2024-12-18T00:21:06.1241199Z 2024-12-18T00:21:06.1241386Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1241502Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1241771Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1241885Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1242078Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1242221Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1242356Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1242508Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1242855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1243181Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1243480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1243735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1244027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1244576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1244880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1245014Z Execution Analysis: (:1) 2024-12-18T00:21:06.1245276Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1245487Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1245491Z 2024-12-18T00:21:06.1245695Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1245816Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1246047Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1246158Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1246378Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1246643Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1246834Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1247004Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1247607Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1248179Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1248547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1248897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1249207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1249491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1249806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1250081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1250188Z Execution Analysis: .......... 2024-12-18T00:21:06.1250450Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1250651Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1250947Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2029 counts during 1933 steps 2024-12-18T00:21:06.1250952Z 2024-12-18T00:21:06.1251152Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1251267Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1251570Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1251685Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1251898Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1252038Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1252190Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1252355Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1252714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1253078Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1253396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1253675Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1253982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1254266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1254977Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1255527Z Execution Analysis: (:1) 2024-12-18T00:21:06.1256022Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1256697Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1257032Z 2024-12-18T00:21:06.1257245Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1257690Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1258134Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1258598Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1259101Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1259600Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1260012Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1260448Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1261382Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1262660Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1263709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1264541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1265327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1266042Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1266748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1267448Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1267940Z Execution Analysis: .......... 2024-12-18T00:21:06.1268395Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1268977Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1269712Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2030 counts during 1934 steps 2024-12-18T00:21:06.1270279Z 2024-12-18T00:21:06.1270492Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1270939Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1271434Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1271957Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1272364Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1272825Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1273224Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1273750Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1274364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1275170Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1275933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1276625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1277314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1277992Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1278645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1279175Z Execution Analysis: (:1) 2024-12-18T00:21:06.1279654Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1280223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1280539Z 2024-12-18T00:21:06.1280748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1281174Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1281629Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1282150Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1286897Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1287410Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1287810Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1288225Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1289083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1290332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1291352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1292158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1292932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1293620Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1294303Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1294982Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1295466Z Execution Analysis: .......... 2024-12-18T00:21:06.1295908Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1296586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1297367Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2031 counts during 1935 steps 2024-12-18T00:21:06.1297776Z 2024-12-18T00:21:06.1297987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1298422Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1298922Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1299439Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1299841Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1300297Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1300685Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1301101Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1301733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1302557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1303336Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1304041Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1304730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1305422Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1306098Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1306628Z Execution Analysis: (:1) 2024-12-18T00:21:06.1307115Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1307691Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1308009Z 2024-12-18T00:21:06.1308210Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1308791Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1309378Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1309822Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1310213Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1310662Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1311045Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1311456Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1312299Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1313719Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1314765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1315595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1316470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1317154Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1318002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1318695Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1319189Z Execution Analysis: .......... 2024-12-18T00:21:06.1319644Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1320218Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1320834Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2032 counts during 1936 steps 2024-12-18T00:21:06.1321250Z 2024-12-18T00:21:06.1321457Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1321892Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1322397Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1322919Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1323315Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1323781Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1324173Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1324591Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1325219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1326043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1326828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1327529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1328228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1328921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1329600Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1330132Z Execution Analysis: (:1) 2024-12-18T00:21:06.1330611Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1331186Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1331510Z 2024-12-18T00:21:06.1331739Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1332243Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1332685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1333141Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1333538Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1334000Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1334396Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1334819Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1335687Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1337049Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1338158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1338982Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1339763Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1340469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1341165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1341862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1342349Z Execution Analysis: .......... 2024-12-18T00:21:06.1342801Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1343376Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1343991Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2033 counts during 1937 steps 2024-12-18T00:21:06.1344554Z 2024-12-18T00:21:06.1344763Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1345202Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1345692Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1346212Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1346616Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1347077Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1347472Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1347889Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1348521Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1349355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1350137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1350840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1351538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1352224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1352908Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1353440Z Execution Analysis: (:1) 2024-12-18T00:21:06.1353924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1354501Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1354955Z 2024-12-18T00:21:06.1355196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1355630Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1356163Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1356584Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1356957Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1357380Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1357748Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1358133Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1358933Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1360113Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1361082Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1361838Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1362554Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1363196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1363842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1364483Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1364937Z Execution Analysis: .......... 2024-12-18T00:21:06.1365350Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1365891Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1366449Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2034 counts during 1938 steps 2024-12-18T00:21:06.1367006Z 2024-12-18T00:21:06.1367202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1367627Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1368109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1368616Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1369004Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1369441Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1369821Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1370230Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1370846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1371658Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1372418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1373097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1373776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1374453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1375111Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1375635Z Execution Analysis: (:1) 2024-12-18T00:21:06.1376108Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1376975Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1377376Z 2024-12-18T00:21:06.1377578Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1378020Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1378457Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1378915Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1379320Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1379771Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1380170Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1380593Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1381460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1382748Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1383789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1384609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1385386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1386088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1386786Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1387478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1387969Z Execution Analysis: .......... 2024-12-18T00:21:06.1388413Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1388992Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1389695Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2035 counts during 1939 steps 2024-12-18T00:21:06.1390096Z 2024-12-18T00:21:06.1390291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1390715Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1391201Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1391698Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1392087Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1392533Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1392920Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1393324Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1393942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1394736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1395494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1396182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1396861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1397536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1398201Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1398715Z Execution Analysis: (:1) 2024-12-18T00:21:06.1399234Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1399875Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1400201Z 2024-12-18T00:21:06.1400399Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1400827Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1401260Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1401801Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1402191Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1402623Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1402998Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1403393Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1404188Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1405378Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1406553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1407363Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1408125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1408812Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1409498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1410167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1410651Z Execution Analysis: .......... 2024-12-18T00:21:06.1411091Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1411653Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1412247Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2036 counts during 1940 steps 2024-12-18T00:21:06.1412642Z 2024-12-18T00:21:06.1412846Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1413261Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1413753Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1414267Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1414665Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1415115Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1415504Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1415911Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1416610Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1417599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1418382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1419084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1419776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1420473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1421155Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1421727Z Execution Analysis: (:1) 2024-12-18T00:21:06.1422301Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1422886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1423207Z 2024-12-18T00:21:06.1423417Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1423849Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1424304Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1424765Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1425180Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1425651Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1426042Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1426470Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1427357Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1428649Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1429887Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1430659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1431392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1432040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1432687Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1433341Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1433810Z Execution Analysis: .......... 2024-12-18T00:21:06.1434235Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1434777Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1435339Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2037 counts during 1941 steps 2024-12-18T00:21:06.1435721Z 2024-12-18T00:21:06.1435908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1436315Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1436785Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1437271Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1437642Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1438081Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1438453Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1438843Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1439438Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1440201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1440915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1441573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1442222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1442871Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1443533Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1444099Z Execution Analysis: (:1) 2024-12-18T00:21:06.1444884Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1445470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1445803Z 2024-12-18T00:21:06.1446006Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1446445Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1446885Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1447344Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1447743Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1448211Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1448614Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1449047Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1449924Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1451208Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1452248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1453080Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1453870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1454588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1455294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1456003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1456554Z Execution Analysis: .......... 2024-12-18T00:21:06.1457012Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1457595Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1458219Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2038 counts during 1942 steps 2024-12-18T00:21:06.1458628Z 2024-12-18T00:21:06.1458837Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1459282Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1459779Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1460303Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1460719Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1461187Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1461588Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1462007Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1462637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1463471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1464267Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1464975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1465673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1466453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1467221Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1467763Z Execution Analysis: (:1) 2024-12-18T00:21:06.1468253Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1468922Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1469218Z 2024-12-18T00:21:06.1469413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1469821Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1470219Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1470645Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1471025Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1471456Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1471834Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1472222Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1473025Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1474204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1475174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1475938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1476664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1477319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1477967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1478612Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1479074Z Execution Analysis: .......... 2024-12-18T00:21:06.1479496Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1480039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1480614Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2040 counts during 1943 steps 2024-12-18T00:21:06.1480994Z 2024-12-18T00:21:06.1481183Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1481595Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1482066Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1482552Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1482930Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1483359Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1483718Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1484110Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1484707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1485480Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1486204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1486853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1487523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1488252Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1488887Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1489387Z Execution Analysis: (:1) 2024-12-18T00:21:06.1489845Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1490382Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1490678Z 2024-12-18T00:21:06.1490867Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1491271Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1491685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1492110Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1492489Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1492923Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1493297Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1493692Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1494503Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1495691Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1496747Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1497737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1498519Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1499232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1499934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1500636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1501132Z Execution Analysis: .......... 2024-12-18T00:21:06.1501586Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1502162Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1502775Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2041 counts during 1944 steps 2024-12-18T00:21:06.1503191Z 2024-12-18T00:21:06.1503398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1503843Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1504356Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1504886Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1505291Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1505760Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1506159Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1506590Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1507238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1508065Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1508853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1509631Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1510399Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1511049Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1511686Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1512184Z Execution Analysis: (:1) 2024-12-18T00:21:06.1512646Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1513196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1513508Z 2024-12-18T00:21:06.1513693Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1514109Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1514525Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1514951Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1515339Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1515776Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1516155Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1516553Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1517357Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1518736Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1519761Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1520571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1521345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1522037Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1522731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1523419Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1523902Z Execution Analysis: .......... 2024-12-18T00:21:06.1524348Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1524917Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1525527Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2042 counts during 1945 steps 2024-12-18T00:21:06.1525927Z 2024-12-18T00:21:06.1526133Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1526569Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1527057Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1527570Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1527971Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1528428Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1528818Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1529223Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1529845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1530661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1531430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1532330Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1532987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1533628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1534271Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1534782Z Execution Analysis: (:1) 2024-12-18T00:21:06.1535242Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1535783Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1536083Z 2024-12-18T00:21:06.1536282Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1536763Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1537381Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1537850Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1538270Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1538746Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1539153Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1539579Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1540466Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1541753Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1542806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1543640Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1544565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1545272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1545986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1546690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1547193Z Execution Analysis: .......... 2024-12-18T00:21:06.1547656Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1548239Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1548850Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2043 counts during 1946 steps 2024-12-18T00:21:06.1549272Z 2024-12-18T00:21:06.1549484Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1549927Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1550439Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1550962Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1551377Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1551835Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1552239Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1552666Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1553310Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1554145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1554995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1555907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1556675Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1557329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1557966Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1558472Z Execution Analysis: (:1) 2024-12-18T00:21:06.1558936Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1559477Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1559789Z 2024-12-18T00:21:06.1559981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1560401Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1560822Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1560928Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1561133Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1561267Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1561416Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1561572Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1562123Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1562668Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1563002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1563346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1563637Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1563902Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1564190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1564446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1564546Z Execution Analysis: .......... 2024-12-18T00:21:06.1564787Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1564990Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1565261Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2044 counts during 1947 steps 2024-12-18T00:21:06.1565271Z 2024-12-18T00:21:06.1565469Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1565580Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1565865Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1565969Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1566171Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1566305Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1566439Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1566610Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1566940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1567307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1567668Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1567933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1568217Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1568467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1568750Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1568870Z Execution Analysis: (:1) 2024-12-18T00:21:06.1569118Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1569307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1569311Z 2024-12-18T00:21:06.1569516Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1569619Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1569844Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1569943Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1570137Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1570280Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1570417Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1570579Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1571124Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1571667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1572002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1572327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1572622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1572875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1573168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1573414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1573521Z Execution Analysis: .......... 2024-12-18T00:21:06.1573759Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1573961Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1574232Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2045 counts during 1948 steps 2024-12-18T00:21:06.1574236Z 2024-12-18T00:21:06.1574424Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1574540Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1574812Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1574921Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1575110Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1575254Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1575385Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1575541Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1575902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1576300Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1576669Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1577098Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1577414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1577680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1577972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1578103Z Execution Analysis: (:1) 2024-12-18T00:21:06.1578363Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1578585Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1578593Z 2024-12-18T00:21:06.1578797Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1578924Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1579156Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1579276Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1579484Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1579630Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1579788Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1579958Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1580564Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1581140Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1581513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1581865Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1582178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1582460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1582772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1583050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1583156Z Execution Analysis: .......... 2024-12-18T00:21:06.1583428Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1583636Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1583936Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2046 counts during 1949 steps 2024-12-18T00:21:06.1583941Z 2024-12-18T00:21:06.1584143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1584258Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1584561Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1584670Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1584880Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1585022Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1585177Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1585343Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1585821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1586183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1586496Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1586779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1587087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1587368Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1587661Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1587799Z Execution Analysis: (:1) 2024-12-18T00:21:06.1588064Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1588272Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1588277Z 2024-12-18T00:21:06.1588491Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1588604Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1588847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1588959Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1589270Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1589404Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1589542Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1589704Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1590252Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1590794Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1591127Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1591461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1591749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1592011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1592299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1592549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1592659Z Execution Analysis: .......... 2024-12-18T00:21:06.1592904Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1593101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1593370Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2047 counts during 1950 steps 2024-12-18T00:21:06.1593374Z 2024-12-18T00:21:06.1593572Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1593679Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1593956Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1594059Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1594248Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1594391Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1594523Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1594758Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1595112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1595440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1595734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1595987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1596280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1596529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1596805Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1596920Z Execution Analysis: (:1) 2024-12-18T00:21:06.1597176Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1597369Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1597373Z 2024-12-18T00:21:06.1597561Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1597680Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1597896Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1598012Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1598207Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1598353Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1598490Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1598650Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1599210Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1599744Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1600086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1600411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1600711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1600967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1601262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1601512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1601615Z Execution Analysis: .......... 2024-12-18T00:21:06.1601865Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1602056Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1602334Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2048 counts during 1951 steps 2024-12-18T00:21:06.1602338Z 2024-12-18T00:21:06.1602532Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1602652Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1602923Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1603042Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1603231Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1603466Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1603684Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1603841Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1604188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1604514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1604818Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1605243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1605546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1605826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1606112Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1606257Z Execution Analysis: (:1) 2024-12-18T00:21:06.1606510Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1606724Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1606728Z 2024-12-18T00:21:06.1606925Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1607053Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1607284Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1607395Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1607614Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1607756Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1607916Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1608082Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1608679Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1609240Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1609593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1609947Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1610253Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1610536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1610834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1611118Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1611224Z Execution Analysis: .......... 2024-12-18T00:21:06.1611489Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1611685Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1611968Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2049 counts during 1952 steps 2024-12-18T00:21:06.1611973Z 2024-12-18T00:21:06.1612185Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1612299Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1612599Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1612711Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1612951Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1613160Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1613300Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1613474Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1613823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1614178Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1614480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1614758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1615057Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1615315Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1615616Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1615736Z Execution Analysis: (:1) 2024-12-18T00:21:06.1616000Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1616197Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1616202Z 2024-12-18T00:21:06.1616644Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1616762Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1617008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1617115Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1617322Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1617478Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1617631Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1617812Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1618406Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1618991Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1619352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1619713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1620023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1620296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1620625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1620894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1621015Z Execution Analysis: .......... 2024-12-18T00:21:06.1621272Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1621485Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1621774Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2050 counts during 1953 steps 2024-12-18T00:21:06.1621778Z 2024-12-18T00:21:06.1621981Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1622107Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1622399Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1622611Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1622842Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1623002Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1623142Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1623309Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1623675Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1624026Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1624352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1624628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1624954Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1625231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1625540Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1625667Z Execution Analysis: (:1) 2024-12-18T00:21:06.1625928Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1626141Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1626145Z 2024-12-18T00:21:06.1626348Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1626475Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1626705Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1626832Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1627040Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1627190Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1627352Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1627519Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1628125Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1628696Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1629172Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1629609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1629908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1630163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1630452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1630713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1630811Z Execution Analysis: .......... 2024-12-18T00:21:06.1631064Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1631254Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1631534Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2051 counts during 1954 steps 2024-12-18T00:21:06.1631538Z 2024-12-18T00:21:06.1631726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1631844Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1632137Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1632314Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1632516Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1632650Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1632796Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1632949Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1633280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1633614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1633903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1634165Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1634457Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1634721Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1634989Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1635116Z Execution Analysis: (:1) 2024-12-18T00:21:06.1635355Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1635547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1635562Z 2024-12-18T00:21:06.1635748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1635853Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1636079Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1636183Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1636395Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1636528Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1636666Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1636833Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1637381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1637920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1638249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1638584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1638877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1639146Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1639428Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1639678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1639789Z Execution Analysis: .......... 2024-12-18T00:21:06.1640030Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1640237Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1640510Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2052 counts during 1955 steps 2024-12-18T00:21:06.1640514Z 2024-12-18T00:21:06.1640715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1640891Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1641200Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1641306Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1641498Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1641646Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1641780Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1641951Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1642280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1642617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1642905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1643161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1643461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1643708Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1643992Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1644107Z Execution Analysis: (:1) 2024-12-18T00:21:06.1644667Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1644876Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1644880Z 2024-12-18T00:21:06.1645097Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1645209Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1645442Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1645571Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1645780Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1645938Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1646089Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1646272Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1646865Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1647439Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1647807Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1648161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1648494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1648769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1649097Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1649367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1649492Z Execution Analysis: .......... 2024-12-18T00:21:06.1649752Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1649956Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1650260Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2053 counts during 1956 steps 2024-12-18T00:21:06.1650265Z 2024-12-18T00:21:06.1650525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1651173Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1651469Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1651596Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1651800Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1651945Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1652104Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1652277Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1652650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1653000Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1653331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1653611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1653919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1654200Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1654489Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1654632Z Execution Analysis: (:1) 2024-12-18T00:21:06.1654891Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1655114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1655119Z 2024-12-18T00:21:06.1655324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1655460Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1655694Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1655807Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1656030Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1656177Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1656394Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1656571Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1657176Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1657751Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1658112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1658479Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1658791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1659081Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1659388Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1659670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1659778Z Execution Analysis: .......... 2024-12-18T00:21:06.1660049Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1660255Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1660591Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2054 counts during 1957 steps 2024-12-18T00:21:06.1660655Z 2024-12-18T00:21:06.1660884Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1661000Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1661303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1661413Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1661632Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1661779Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1661922Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1662105Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1662465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1662826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1663146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1663432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1663740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1664020Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1664311Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1664437Z Execution Analysis: (:1) 2024-12-18T00:21:06.1664710Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1664916Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1664921Z 2024-12-18T00:21:06.1665138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1665258Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1665500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1665610Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1665822Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1665977Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1666125Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1666307Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1666900Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1667487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1667854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1668216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1668530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1668899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1669195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1669442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1669551Z Execution Analysis: .......... 2024-12-18T00:21:06.1669790Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1669990Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1670350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2055 counts during 1958 steps 2024-12-18T00:21:06.1670355Z 2024-12-18T00:21:06.1670557Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1670663Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1670934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1671049Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1671240Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1671387Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1671518Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1671688Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1672017Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1672348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1672647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1672901Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1673199Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1673446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1673727Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1673844Z Execution Analysis: (:1) 2024-12-18T00:21:06.1674083Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1674281Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1674290Z 2024-12-18T00:21:06.1674479Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1674594Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1674808Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1674925Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1675116Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1675249Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1675395Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1675551Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1676109Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1676638Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1676990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1677315Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1677614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1677868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1678151Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1678408Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1678508Z Execution Analysis: .......... 2024-12-18T00:21:06.1678762Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1679046Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1679328Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2056 counts during 1959 steps 2024-12-18T00:21:06.1679332Z 2024-12-18T00:21:06.1679518Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1679637Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1679902Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1680004Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1680206Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1680341Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1680484Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1680639Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1680985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1681310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1681602Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1681866Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1682152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1682415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1682684Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1682813Z Execution Analysis: (:1) 2024-12-18T00:21:06.1683053Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1683255Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1683261Z 2024-12-18T00:21:06.1683447Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1683552Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1683778Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1683881Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1684087Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1684220Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1684373Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1684528Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1685078Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1685626Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1685958Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1686298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1686589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1686858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1687146Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1687406Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1687507Z Execution Analysis: .......... 2024-12-18T00:21:06.1687772Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1688051Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1688320Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2057 counts during 1960 steps 2024-12-18T00:21:06.1688324Z 2024-12-18T00:21:06.1688525Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1688630Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1688912Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1689015Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1689206Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1689352Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1689487Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1689661Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1689996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1690334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1690622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1690877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1691170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1691427Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1691707Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1691824Z Execution Analysis: (:1) 2024-12-18T00:21:06.1692075Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1692269Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1692275Z 2024-12-18T00:21:06.1692473Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1692579Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1692794Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1692903Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1693102Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1693248Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1693388Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1693559Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1694111Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1694652Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1694993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1695319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1695621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1695872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1696169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1696485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1696672Z Execution Analysis: .......... 2024-12-18T00:21:06.1697114Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1697319Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1697615Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2058 counts during 1961 steps 2024-12-18T00:21:06.1697620Z 2024-12-18T00:21:06.1697823Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1697949Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1698243Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1698366Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1698572Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1698723Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1698871Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1699042Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1699410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1699762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1700085Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1700360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1700668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1700937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1701222Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1701357Z Execution Analysis: (:1) 2024-12-18T00:21:06.1701620Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1701830Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1701834Z 2024-12-18T00:21:06.1702039Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1702166Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1702396Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1702504Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1702720Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1702863Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1703016Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1703183Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1703795Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1704369Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1704735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1705084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1705393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1705672Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1705981Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1706305Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1706463Z Execution Analysis: .......... 2024-12-18T00:21:06.1706734Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1706937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1707237Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2059 counts during 1962 steps 2024-12-18T00:21:06.1707242Z 2024-12-18T00:21:06.1707445Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1707557Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1707853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1707965Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1708182Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1708335Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1708493Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1708663Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1709123Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1709459Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1709746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1710007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1710289Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1710545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1710816Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1710939Z Execution Analysis: (:1) 2024-12-18T00:21:06.1711192Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1711385Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1711389Z 2024-12-18T00:21:06.1711586Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1711692Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1711918Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1712022Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1712223Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1712357Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1712494Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1712828Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1713404Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1713975Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1714324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1714680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1714991Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1715259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1715593Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1715928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1716041Z Execution Analysis: .......... 2024-12-18T00:21:06.1716293Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1716497Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1716778Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2061 counts during 1963 steps 2024-12-18T00:21:06.1716783Z 2024-12-18T00:21:06.1716987Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1717098Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1717381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1717494Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1717701Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1717847Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1717984Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1718153Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1718497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1718839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1719147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1719413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1719720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1719981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1720277Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1720398Z Execution Analysis: (:1) 2024-12-18T00:21:06.1720661Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1720855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1720859Z 2024-12-18T00:21:06.1721055Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1721174Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1721398Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1721516Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1721717Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1721872Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1722018Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1722181Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1722765Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1723324Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1723683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1724019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1724331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1724620Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1725011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1725274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1725375Z Execution Analysis: .......... 2024-12-18T00:21:06.1725636Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1725831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1726124Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2062 counts during 1964 steps 2024-12-18T00:21:06.1726129Z 2024-12-18T00:21:06.1726324Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1726449Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1726734Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1726846Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1727057Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1727197Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1727347Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1727510Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1727865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1728204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1728514Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1728780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1729077Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1729352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1729741Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1729863Z Execution Analysis: (:1) 2024-12-18T00:21:06.1730104Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1730299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1730303Z 2024-12-18T00:21:06.1730490Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1730596Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1730819Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1730923Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1731121Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1731261Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1731402Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1731561Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1732106Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1737487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1737924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1738293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1738692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1739064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1739376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1739644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1739754Z Execution Analysis: .......... 2024-12-18T00:21:06.1740017Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1740223Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1740513Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2063 counts during 1965 steps 2024-12-18T00:21:06.1740520Z 2024-12-18T00:21:06.1740726Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1740840Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1741144Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1741253Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1741458Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1741607Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1741747Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1741919Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1742276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1742631Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1742942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1743212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1743529Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1743793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1744090Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1744388Z Execution Analysis: (:1) 2024-12-18T00:21:06.1744651Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1744853Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1744858Z 2024-12-18T00:21:06.1745066Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1745177Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1745408Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1745529Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1745739Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1745886Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1746035Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1746209Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1746803Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1747376Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1747742Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1748092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1748642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1748917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1749227Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1749489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1749600Z Execution Analysis: .......... 2024-12-18T00:21:06.1749858Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1750058Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1750354Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2064 counts during 1966 steps 2024-12-18T00:21:06.1750359Z 2024-12-18T00:21:06.1750561Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1750683Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1750973Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1751086Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1751286Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1751429Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1751571Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1751734Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1752092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1752437Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1752751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1753027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1753329Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1753596Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1753881Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1754006Z Execution Analysis: (:1) 2024-12-18T00:21:06.1754263Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1754471Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1754475Z 2024-12-18T00:21:06.1754678Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1754794Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1755027Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1755136Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1755345Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1755487Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1755636Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1756012Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1756563Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1757088Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1757422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1757816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1758128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1758380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1758662Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1758912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1759008Z Execution Analysis: .......... 2024-12-18T00:21:06.1759251Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1759437Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1759702Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2065 counts during 1967 steps 2024-12-18T00:21:06.1759717Z 2024-12-18T00:21:06.1759902Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1760005Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1760279Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1760378Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1760571Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1760701Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1760832Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1760989Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1761318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1761646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1761934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1762193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1762476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1762727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1762992Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1763109Z Execution Analysis: (:1) 2024-12-18T00:21:06.1763353Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1763539Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1763544Z 2024-12-18T00:21:06.1763735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1763843Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1764061Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1764163Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1764353Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1764490Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1764626Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1764785Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1765332Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1765866Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1766216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1766626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1766919Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1767171Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1767460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1767705Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1767805Z Execution Analysis: .......... 2024-12-18T00:21:06.1768043Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1768235Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1768501Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2066 counts during 1968 steps 2024-12-18T00:21:06.1768509Z 2024-12-18T00:21:06.1768705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1768806Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1769076Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1769186Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1769376Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1769514Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1769647Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1769808Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1770133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1770458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1770753Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1771004Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1771290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1771536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1771810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1771925Z Execution Analysis: (:1) 2024-12-18T00:21:06.1772162Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1772350Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1772355Z 2024-12-18T00:21:06.1772546Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1772658Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1772867Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1772972Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1773158Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1773294Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1773427Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1773581Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1774136Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1774684Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1775087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1775412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1775702Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1775954Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1776236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1776576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1776674Z Execution Analysis: .......... 2024-12-18T00:21:06.1777090Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1777295Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1777594Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2067 counts during 1969 steps 2024-12-18T00:21:06.1777600Z 2024-12-18T00:21:06.1777800Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1777916Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1778204Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1778312Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1778520Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1778660Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1778806Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1778970Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1779329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1779679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1779985Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1780256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1780559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1780827Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1781115Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1781242Z Execution Analysis: (:1) 2024-12-18T00:21:06.1781498Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1781705Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1781713Z 2024-12-18T00:21:06.1781913Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1782024Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1782259Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1782367Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1782577Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1782720Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1782872Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1783037Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1783628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1784256Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1784663Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1785019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1785328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1785600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1785901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1786173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1786278Z Execution Analysis: .......... 2024-12-18T00:21:06.1786535Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1786746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1787032Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2068 counts during 1970 steps 2024-12-18T00:21:06.1787037Z 2024-12-18T00:21:06.1787243Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1787353Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1787648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1787754Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1787958Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1788105Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1788245Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1788417Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1788780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1789232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1789515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1789772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1790052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1790298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1790568Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1790679Z Execution Analysis: (:1) 2024-12-18T00:21:06.1790922Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1791111Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1791116Z 2024-12-18T00:21:06.1791302Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1791405Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1791616Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1791722Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1791909Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1792047Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1792178Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1792335Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1792905Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1793498Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1793832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1794153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1794440Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1794687Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1794972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1795215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1795315Z Execution Analysis: .......... 2024-12-18T00:21:06.1795557Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1795744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1796011Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2069 counts during 1971 steps 2024-12-18T00:21:06.1796016Z 2024-12-18T00:21:06.1796202Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1796311Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1796578Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1796684Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1796870Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1797008Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1797137Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1797297Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1797630Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1797952Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1798243Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1798492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1798779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1799023Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1799288Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1799407Z Execution Analysis: (:1) 2024-12-18T00:21:06.1799652Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1799842Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1799846Z 2024-12-18T00:21:06.1800030Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1800138Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1800349Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1800448Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1800643Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1800773Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1800912Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1801067Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1801675Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1802250Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1802589Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1802912Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1803203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1803464Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1803748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1804000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1804102Z Execution Analysis: .......... 2024-12-18T00:21:06.1804346Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1804533Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1804804Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2070 counts during 1972 steps 2024-12-18T00:21:06.1804808Z 2024-12-18T00:21:06.1804993Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1805099Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1805373Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1805474Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1805667Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1805802Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1805942Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1806095Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1806423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1806752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1807035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1807290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1807569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1807819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1808088Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1808206Z Execution Analysis: (:1) 2024-12-18T00:21:06.1808446Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1808637Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1808641Z 2024-12-18T00:21:06.1808831Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1808935Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1809153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1809252Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1809447Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1809575Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1809712Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1809918Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1810508Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1811038Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1811367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1811693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1811978Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1812235Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1812522Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1812773Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1812877Z Execution Analysis: .......... 2024-12-18T00:21:06.1813112Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1813304Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1813568Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2071 counts during 1973 steps 2024-12-18T00:21:06.1813573Z 2024-12-18T00:21:06.1813761Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1813862Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1814132Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1814236Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1814426Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1814570Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1814697Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1814856Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1815180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1815502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1815792Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1816042Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1816328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1816646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1817099Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1817221Z Execution Analysis: (:1) 2024-12-18T00:21:06.1817481Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1817680Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1817685Z 2024-12-18T00:21:06.1817886Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1818004Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1818233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1818346Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1818548Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1818697Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1818921Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1819112Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1819709Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1820280Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1820641Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1820990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1821301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1821571Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1821889Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1822156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1822260Z Execution Analysis: .......... 2024-12-18T00:21:06.1822520Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1822721Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1823012Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2072 counts during 1974 steps 2024-12-18T00:21:06.1823017Z 2024-12-18T00:21:06.1823219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1823336Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1823631Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1823746Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1823958Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1824101Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1824250Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1824415Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1824778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1825125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1825439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1825710Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1826014Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1826294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1826582Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1826721Z Execution Analysis: (:1) 2024-12-18T00:21:06.1826976Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1827190Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1827194Z 2024-12-18T00:21:06.1827393Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1827505Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1827741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1827847Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1828059Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1828276Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1828463Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1828631Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1829431Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1829970Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1830301Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1830632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1830924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1831190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1831474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1831723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1831820Z Execution Analysis: .......... 2024-12-18T00:21:06.1832058Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1832251Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1832517Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2073 counts during 1975 steps 2024-12-18T00:21:06.1832522Z 2024-12-18T00:21:06.1832712Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1832816Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1833095Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1833198Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1833393Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1833526Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1833656Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1833815Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1834142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1834471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1834754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1835007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1835290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1835541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1835813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1835927Z Execution Analysis: (:1) 2024-12-18T00:21:06.1836167Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1836352Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1836356Z 2024-12-18T00:21:06.1836547Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1836649Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1836865Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1836962Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1837244Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1837385Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1837524Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1837682Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1838226Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1838757Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1839085Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1839409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1839702Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1839954Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1840243Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1840491Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1840594Z Execution Analysis: .......... 2024-12-18T00:21:06.1840828Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1841021Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1841283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2074 counts during 1976 steps 2024-12-18T00:21:06.1841287Z 2024-12-18T00:21:06.1841470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1841588Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1841858Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1841967Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1842152Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1842293Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1842422Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1842573Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1842908Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1843229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1843521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1843772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1844063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1844625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1844920Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1845053Z Execution Analysis: (:1) 2024-12-18T00:21:06.1845312Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1845521Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1845525Z 2024-12-18T00:21:06.1845728Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1845847Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1846129Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1846342Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1846553Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1846695Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1846853Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1847021Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1847623Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1848193Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1848558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1848909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1849231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1849504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1849813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1850088Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1850193Z Execution Analysis: .......... 2024-12-18T00:21:06.1850454Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1850657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1850953Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2075 counts during 1977 steps 2024-12-18T00:21:06.1850958Z 2024-12-18T00:21:06.1851166Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1851280Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1851575Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1851685Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1851896Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1852037Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1852184Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1852348Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1852706Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1853059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1853376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1853660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1853967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1854240Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1854533Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1854663Z Execution Analysis: (:1) 2024-12-18T00:21:06.1854918Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1855118Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1855123Z 2024-12-18T00:21:06.1855325Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1855513Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1855772Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1855879Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1856094Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1856234Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1856441Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1856618Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1857204Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1857787Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1858146Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1858507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1858813Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1859096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1859399Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1859664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1859775Z Execution Analysis: .......... 2024-12-18T00:21:06.1860029Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1860240Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1860526Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2076 counts during 1978 steps 2024-12-18T00:21:06.1860535Z 2024-12-18T00:21:06.1860744Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1860853Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1861146Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1861255Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1861456Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1861608Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1861748Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1861921Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1862277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1862630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1862942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1863210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1863521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1863785Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1864078Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1864201Z Execution Analysis: (:1) 2024-12-18T00:21:06.1864458Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1864657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1864661Z 2024-12-18T00:21:06.1864887Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1865092Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1865324Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1865436Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1865639Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1865787Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1865931Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1866096Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1866692Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1867268Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1867640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1867990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1868305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1868579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1869002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1869259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1869364Z Execution Analysis: .......... 2024-12-18T00:21:06.1869619Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1869818Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1870109Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2077 counts during 1979 steps 2024-12-18T00:21:06.1870113Z 2024-12-18T00:21:06.1870307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1870422Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1870700Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1870816Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1871017Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1871158Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1871302Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1871463Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1871816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1872161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1872469Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1872733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1873031Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1873297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1873579Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1873708Z Execution Analysis: (:1) 2024-12-18T00:21:06.1873959Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1874163Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1874241Z 2024-12-18T00:21:06.1874461Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1874576Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1874797Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1874904Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1875115Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1875254Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1875400Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1875559Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1876138Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1876692Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1877043Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1877388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1877690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1877962Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1878258Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1878523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1878625Z Execution Analysis: .......... 2024-12-18T00:21:06.1878880Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1879080Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1879359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2078 counts during 1980 steps 2024-12-18T00:21:06.1879363Z 2024-12-18T00:21:06.1879659Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1879764Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1880036Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1880136Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1880327Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1880457Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1880585Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1880743Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1881072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1881408Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1881695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1881951Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1882233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1882478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1882747Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1882860Z Execution Analysis: (:1) 2024-12-18T00:21:06.1883102Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1883384Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1883388Z 2024-12-18T00:21:06.1883582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1883683Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1883901Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1884000Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1884188Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1884324Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1884458Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1884614Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1885158Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1885697Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1886026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1886356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1886641Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1886891Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1887181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1887425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1887533Z Execution Analysis: .......... 2024-12-18T00:21:06.1887769Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1888123Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1888403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2079 counts during 1981 steps 2024-12-18T00:21:06.1888407Z 2024-12-18T00:21:06.1888602Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1888717Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1888999Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1889115Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1889311Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1889456Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1889594Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1889760Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1890114Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1890452Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1890757Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1891020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1891323Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1891582Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1891872Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1891991Z Execution Analysis: (:1) 2024-12-18T00:21:06.1892469Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1892826Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1892831Z 2024-12-18T00:21:06.1893027Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1893147Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1893371Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1893488Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1893688Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1893829Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1893981Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1894143Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1894727Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1895291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1895645Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1895983Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1896288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1896628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1897096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1897367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1897477Z Execution Analysis: .......... 2024-12-18T00:21:06.1897745Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1897945Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1898240Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2080 counts during 1982 steps 2024-12-18T00:21:06.1898244Z 2024-12-18T00:21:06.1898443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1898563Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1898853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1898960Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1899170Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1899315Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1899470Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1899638Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1900000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1900349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1900655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1900933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1901238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1901509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1901797Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1901994Z Execution Analysis: (:1) 2024-12-18T00:21:06.1902299Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1902503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1902513Z 2024-12-18T00:21:06.1902714Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1902823Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1903061Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1903168Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1903379Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1903518Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1903663Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1903835Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1904430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1905009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1905363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1905720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1906029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1906307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1906613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1906883Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1906995Z Execution Analysis: .......... 2024-12-18T00:21:06.1907252Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1907458Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1907743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2082 counts during 1983 steps 2024-12-18T00:21:06.1907747Z 2024-12-18T00:21:06.1907955Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1908067Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1908366Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1908471Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1908673Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1908826Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1908965Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1909245Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1909590Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1909936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1910236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1910499Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1910799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1911165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1911461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1911648Z Execution Analysis: (:1) 2024-12-18T00:21:06.1911896Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1912082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1912086Z 2024-12-18T00:21:06.1912284Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1912388Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1912602Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1912714Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1912906Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1913051Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1913192Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1913366Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1913911Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1914442Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1914788Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1915110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1915414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1915666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1915963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1916213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1916323Z Execution Analysis: .......... 2024-12-18T00:21:06.1916563Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1916748Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1917028Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2083 counts during 1984 steps 2024-12-18T00:21:06.1917032Z 2024-12-18T00:21:06.1917219Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1917336Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1917606Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1917717Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1918088Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1918226Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1918375Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1918536Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1918895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1919238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1919552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1919820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1920114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1920407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1920762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1920894Z Execution Analysis: (:1) 2024-12-18T00:21:06.1921146Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1921346Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1921350Z 2024-12-18T00:21:06.1921548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1921665Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1921890Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1921996Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1922204Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1922346Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1922497Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1922660Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1923246Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1923803Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1924158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1924501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1924803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1925074Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1925377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1925648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1925752Z Execution Analysis: .......... 2024-12-18T00:21:06.1926009Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1926206Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1926488Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2084 counts during 1985 steps 2024-12-18T00:21:06.1926501Z 2024-12-18T00:21:06.1926694Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1926804Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1927097Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1927206Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1927413Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1927551Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1927689Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1927862Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1928207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1928554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1928854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1929126Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1929456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1929900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1930168Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1930282Z Execution Analysis: (:1) 2024-12-18T00:21:06.1930524Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1930710Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1930714Z 2024-12-18T00:21:06.1930909Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1931011Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1931233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1931332Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1931525Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1931674Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1931808Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1931971Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1932513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1933050Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1933382Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1933716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1934007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1934263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1934558Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1934801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1934908Z Execution Analysis: .......... 2024-12-18T00:21:06.1935148Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1935342Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1935609Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2085 counts during 1986 steps 2024-12-18T00:21:06.1935613Z 2024-12-18T00:21:06.1935806Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1935914Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1936188Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1936299Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1936576Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1936721Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1937024Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1937201Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1937559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1937911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1938228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1938501Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1938938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1939205Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1939502Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1939625Z Execution Analysis: (:1) 2024-12-18T00:21:06.1939885Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1940101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1940105Z 2024-12-18T00:21:06.1940307Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1940427Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1940660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1940788Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1940999Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1941150Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1941294Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1941464Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1942060Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1942632Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1942995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1943344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1943670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1943945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1944378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1944655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1944761Z Execution Analysis: .......... 2024-12-18T00:21:06.1945026Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1945228Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1945526Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2086 counts during 1987 steps 2024-12-18T00:21:06.1945531Z 2024-12-18T00:21:06.1945731Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1945859Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1946147Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1946258Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1946477Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1946619Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1946774Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1946942Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1947306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1947653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1947965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1948398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1948708Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1948988Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1949275Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1949411Z Execution Analysis: (:1) 2024-12-18T00:21:06.1949669Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1949883Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1949887Z 2024-12-18T00:21:06.1950090Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1950203Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1950451Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1950558Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1950776Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1950920Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1951074Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1951242Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1951830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1952415Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1952771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1953134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1953447Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1953725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1954034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1954304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1954411Z Execution Analysis: .......... 2024-12-18T00:21:06.1954668Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1954880Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1955169Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2087 counts during 1988 steps 2024-12-18T00:21:06.1955179Z 2024-12-18T00:21:06.1955387Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1955501Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1955801Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1955910Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1956211Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1956352Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1956486Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1956653Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1956984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1957315Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1957674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1957961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1958243Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1958491Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1958767Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1958883Z Execution Analysis: (:1) 2024-12-18T00:21:06.1959134Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1959323Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1959327Z 2024-12-18T00:21:06.1959523Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1959632Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1959847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1959958Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1960150Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1960295Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1960430Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1960590Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1961138Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1961669Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1962014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1962345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1962642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1962895Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1963188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1963437Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1963548Z Execution Analysis: .......... 2024-12-18T00:21:06.1963783Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1963971Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1964255Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2088 counts during 1989 steps 2024-12-18T00:21:06.1964260Z 2024-12-18T00:21:06.1964443Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1964563Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1964828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1964940Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1965124Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1965264Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1965396Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1965548Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1965888Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1966233Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1966604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1966855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1967143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1967388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1967654Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1967776Z Execution Analysis: (:1) 2024-12-18T00:21:06.1968009Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1968205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1968211Z 2024-12-18T00:21:06.1968403Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1968511Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1968724Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1968822Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1969021Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1969152Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1969298Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1969453Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1970001Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1970530Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1970869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1971193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1971477Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1971734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1972017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1972267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1972363Z Execution Analysis: .......... 2024-12-18T00:21:06.1972606Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1972792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1973071Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2089 counts during 1990 steps 2024-12-18T00:21:06.1973076Z 2024-12-18T00:21:06.1973259Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1973364Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1973638Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1973739Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1973932Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1974064Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1974199Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1974351Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1974704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1975118Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1975405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1975667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1975948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1976199Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1976534Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1976651Z Execution Analysis: (:1) 2024-12-18T00:21:06.1977072Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1977278Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1977288Z 2024-12-18T00:21:06.1977500Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1977613Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1977855Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1977965Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1978183Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1978325Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1978473Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1978648Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1979238Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1979832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1980194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1980553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1980862Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1981142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1981448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1981713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1981830Z Execution Analysis: .......... 2024-12-18T00:21:06.1982086Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1982301Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1982588Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2090 counts during 1991 steps 2024-12-18T00:21:06.1982592Z 2024-12-18T00:21:06.1982805Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1982917Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1983209Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1983328Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1983528Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1983679Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1983821Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1983994Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1984455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1984803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1985122Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1985390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1985707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1985973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1986273Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1986395Z Execution Analysis: (:1) 2024-12-18T00:21:06.1986663Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1986872Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1986877Z 2024-12-18T00:21:06.1987078Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1987196Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1987425Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1987542Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1987749Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1987895Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1988040Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1988207Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1988804Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1989457Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1989794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1990120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1990413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1990663Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1990958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1991206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1991304Z Execution Analysis: .......... 2024-12-18T00:21:06.1991556Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1991745Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1992017Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2091 counts during 1992 steps 2024-12-18T00:21:06.1992021Z 2024-12-18T00:21:06.1992208Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1992321Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1992588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.1992690Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1992885Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.1993018Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.1993185Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.1993406Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1993743Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.1994068Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1994363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1994610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.1994893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.1995144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.1995413Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.1995539Z Execution Analysis: (:1) 2024-12-18T00:21:06.1995780Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.1995976Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1995980Z 2024-12-18T00:21:06.1996162Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.1996266Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.1996486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.1996583Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.1996779Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.1996911Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.1997057Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.1997209Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.1997754Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.1998470Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.1998824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.1999175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.1999477Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.1999754Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2000055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2000334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2000444Z Execution Analysis: .......... 2024-12-18T00:21:06.2000697Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2000908Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2001191Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2092 counts during 1993 steps 2024-12-18T00:21:06.2001196Z 2024-12-18T00:21:06.2001408Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2001521Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2001820Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2001931Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2002142Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2002307Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2002531Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2002707Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2003056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2003410Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2003712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2003990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2004297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2004559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2004857Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2004981Z Execution Analysis: (:1) 2024-12-18T00:21:06.2005246Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2005442Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2005447Z 2024-12-18T00:21:06.2005657Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2005770Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2006008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2006123Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2006321Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2006475Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2006617Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2006798Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2007374Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2007946Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2008296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2008638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2008953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2009219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2009532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2009798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2009911Z Execution Analysis: .......... 2024-12-18T00:21:06.2010258Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2010456Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2010722Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2093 counts during 1994 steps 2024-12-18T00:21:06.2010726Z 2024-12-18T00:21:06.2010912Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2011025Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2011294Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2011410Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2011626Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2011843Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2011973Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2012127Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2012464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2012787Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2013087Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2013339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2013628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2013876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2014155Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2014280Z Execution Analysis: (:1) 2024-12-18T00:21:06.2014521Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2014715Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2014719Z 2024-12-18T00:21:06.2014907Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2015024Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2015239Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2015354Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2015545Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2015681Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2015835Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2015990Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2016618Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2017342Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2017711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2018061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2018385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2018659Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2018970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2019251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2019356Z Execution Analysis: .......... 2024-12-18T00:21:06.2019625Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2019828Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2020126Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2094 counts during 1995 steps 2024-12-18T00:21:06.2020131Z 2024-12-18T00:21:06.2020333Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2020449Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2020751Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2020935Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2021181Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2021326Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2021483Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2021653Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2022009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2022370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2022680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2022965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2023274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2023562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2023855Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2023990Z Execution Analysis: (:1) 2024-12-18T00:21:06.2024250Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2024450Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2024454Z 2024-12-18T00:21:06.2024664Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2024778Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2025017Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2025128Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2025344Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2025493Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2025641Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2025818Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2026413Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2026995Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2027354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2027718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2028028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2028319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2028631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2028901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2029149Z Execution Analysis: .......... 2024-12-18T00:21:06.2029398Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2029606Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2029890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2095 counts during 1996 steps 2024-12-18T00:21:06.2029894Z 2024-12-18T00:21:06.2030101Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2030213Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2030708Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2030813Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2031002Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2031147Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2031281Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2031447Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2031774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2032110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2032396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2032648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2032940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2033189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2033467Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2033580Z Execution Analysis: (:1) 2024-12-18T00:21:06.2033831Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2034013Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2034018Z 2024-12-18T00:21:06.2034205Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2034319Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2034536Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2034653Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2034847Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2034989Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2035124Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2035276Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2035834Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2036361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2036704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2037027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2037330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2037586Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2037883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2038133Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2038233Z Execution Analysis: .......... 2024-12-18T00:21:06.2038484Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2038674Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2038954Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2096 counts during 1997 steps 2024-12-18T00:21:06.2038959Z 2024-12-18T00:21:06.2039143Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2039418Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2039715Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2039830Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2040020Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2040151Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2040296Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2040452Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2040793Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2041120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2041413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2041671Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2041957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2042214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2042484Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2042609Z Execution Analysis: (:1) 2024-12-18T00:21:06.2042849Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2043045Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2043050Z 2024-12-18T00:21:06.2043238Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2043349Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2043566Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2043676Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2043877Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2044013Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2044296Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2044618Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2045222Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2045796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2046158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2046520Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2046840Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2047123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2047431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2047715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2047823Z Execution Analysis: .......... 2024-12-18T00:21:06.2048094Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2048299Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2048588Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2097 counts during 1998 steps 2024-12-18T00:21:06.2048593Z 2024-12-18T00:21:06.2048958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2049078Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2049381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2049494Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2049710Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2049853Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2049995Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2050173Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2050530Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2050895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2051208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2051500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2051807Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2052077Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2052381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2052505Z Execution Analysis: (:1) 2024-12-18T00:21:06.2052778Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2052979Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2052984Z 2024-12-18T00:21:06.2053196Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2053316Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2053559Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2053669Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2053878Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2054033Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2054177Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2054349Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2054941Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2055522Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2055885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2056247Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2056634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2056905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2057225Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2057495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2057611Z Execution Analysis: .......... 2024-12-18T00:21:06.2057869Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2058081Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2058400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2098 counts during 1999 steps 2024-12-18T00:21:06.2058454Z 2024-12-18T00:21:06.2058683Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2058808Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2059097Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2059213Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2059419Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2059571Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2059715Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2059881Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2060245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2060596Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2060920Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2061195Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2061508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2061775Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2062075Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2062199Z Execution Analysis: (:1) 2024-12-18T00:21:06.2062457Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2062665Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2062670Z 2024-12-18T00:21:06.2062873Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2062994Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2063226Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2063342Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2063549Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2063694Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2063849Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2064017Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2064622Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2065196Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2065571Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2065926Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2066249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2066521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2066831Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2067106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2067213Z Execution Analysis: .......... 2024-12-18T00:21:06.2067484Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2067711Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2068086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2099 counts during 2000 steps 2024-12-18T00:21:06.2068091Z 2024-12-18T00:21:06.2068296Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2068421Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2068809Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2068913Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2069112Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2069247Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2069387Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2069542Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2069883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2070213Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2070501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2070766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2071050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2071310Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2071578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2071709Z Execution Analysis: (:1) 2024-12-18T00:21:06.2071947Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2072138Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2072155Z 2024-12-18T00:21:06.2072348Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2072452Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2072676Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2072781Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2072981Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2073117Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2073251Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2073416Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2073958Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2074502Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2074839Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2075170Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2075460Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2075721Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2076006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2076255Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2076362Z Execution Analysis: .......... 2024-12-18T00:21:06.2076600Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2076937Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2077207Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2100 counts during 2001 steps 2024-12-18T00:21:06.2077212Z 2024-12-18T00:21:06.2077413Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2077518Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2077798Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2077901Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2078090Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2078232Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2078365Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2078528Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2078861Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2079199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2079485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2079738Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2080024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2080273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2080557Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2080673Z Execution Analysis: (:1) 2024-12-18T00:21:06.2080919Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2081112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2081116Z 2024-12-18T00:21:06.2081313Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2081419Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2081633Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2081743Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2081935Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2082078Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2082212Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2082378Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2082922Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2083458Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2083801Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2084125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2084422Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2084671Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2084965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2085212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2085321Z Execution Analysis: .......... 2024-12-18T00:21:06.2085630Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2085845Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2086124Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2101 counts during 2002 steps 2024-12-18T00:21:06.2086128Z 2024-12-18T00:21:06.2086314Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2086431Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2086697Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2086813Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2086999Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2087132Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2087271Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2087430Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2087773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2088096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2088391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2088641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2088924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2089180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2089452Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2089575Z Execution Analysis: (:1) 2024-12-18T00:21:06.2089811Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2090011Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2090015Z 2024-12-18T00:21:06.2090200Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2090313Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2090524Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2090624Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2090821Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2090953Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2091094Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2091247Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2091801Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2092332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2092671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2092993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2093280Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2093537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2093817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2094070Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2094239Z Execution Analysis: .......... 2024-12-18T00:21:06.2094509Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2094699Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2095139Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2103 counts during 2003 steps 2024-12-18T00:21:06.2095153Z 2024-12-18T00:21:06.2095349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2095460Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2095745Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2095849Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2096050Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2096186Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2096327Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2096566Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2097079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2097438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2097748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2098027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2098332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2098603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2098889Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2099015Z Execution Analysis: (:1) 2024-12-18T00:21:06.2099279Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2099481Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2099485Z 2024-12-18T00:21:06.2099689Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2099800Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2100032Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2100138Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2100345Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2100494Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2100639Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2100814Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2101406Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2101980Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2102338Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2102692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2102999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2103269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2103583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2103967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2104080Z Execution Analysis: .......... 2024-12-18T00:21:06.2104335Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2104542Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2104827Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2104 counts during 2004 steps 2024-12-18T00:21:06.2104832Z 2024-12-18T00:21:06.2105041Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2105152Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2105439Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2105553Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2105755Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2105913Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2106055Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2106229Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2106582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2106932Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2107248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2107520Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2107840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2108104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2108400Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2108526Z Execution Analysis: (:1) 2024-12-18T00:21:06.2108784Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2109104Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2109108Z 2024-12-18T00:21:06.2109303Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2109423Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2109647Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2109763Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2109964Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2110109Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2110250Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2110417Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2110997Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2111549Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2111902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2112245Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2112551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2112814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2113138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2113476Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2113578Z Execution Analysis: .......... 2024-12-18T00:21:06.2113838Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2114031Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2114319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2105 counts during 2005 steps 2024-12-18T00:21:06.2114323Z 2024-12-18T00:21:06.2114517Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2114634Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2114914Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2115021Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2115231Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2115369Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2115513Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2115675Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2116030Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2116365Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2116662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2116934Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2117231Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2117499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2117949Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2118077Z Execution Analysis: (:1) 2024-12-18T00:21:06.2118332Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2118543Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2118548Z 2024-12-18T00:21:06.2118746Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2118855Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2119090Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2119195Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2119404Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2119547Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2119699Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2119860Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2120452Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2121039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2121393Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2121750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2122058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2122360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2122952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2123231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2123333Z Execution Analysis: .......... 2024-12-18T00:21:06.2123585Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2123792Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2124080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2106 counts during 2006 steps 2024-12-18T00:21:06.2124084Z 2024-12-18T00:21:06.2124293Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2124405Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2124707Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2124820Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2125020Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2125166Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2125307Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2125478Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2125835Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2126190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2126500Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2126772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2127082Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2127353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2127647Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2127770Z Execution Analysis: (:1) 2024-12-18T00:21:06.2128032Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2131881Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2131890Z 2024-12-18T00:21:06.2132121Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2132233Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2132461Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2132572Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2132786Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2132930Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2133177Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2133332Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2133887Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2134417Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2134757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2135086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2135433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2135769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2136059Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2136581Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2136688Z Execution Analysis: .......... 2024-12-18T00:21:06.2136948Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2137146Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2137603Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2107 counts during 2007 steps 2024-12-18T00:21:06.2137609Z 2024-12-18T00:21:06.2137811Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2137934Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2138229Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2138345Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2138547Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2138688Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2138832Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2139000Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2139363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2139710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2140026Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2140296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2140605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2140874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2141161Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2141290Z Execution Analysis: (:1) 2024-12-18T00:21:06.2141547Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2141753Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2141758Z 2024-12-18T00:21:06.2141958Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2142078Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2142309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2142424Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2142637Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2142776Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2142928Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2143093Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2143685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2144398Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2144753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2145171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2145596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2145877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2146183Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2146452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2146553Z Execution Analysis: .......... 2024-12-18T00:21:06.2146812Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2147014Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2147300Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2108 counts during 2008 steps 2024-12-18T00:21:06.2147305Z 2024-12-18T00:21:06.2147509Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2147626Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2147922Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2148029Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2148235Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2148380Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2148520Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2148687Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2149038Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2149392Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2149699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2149984Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2150286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2150550Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2150843Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2150963Z Execution Analysis: (:1) 2024-12-18T00:21:06.2151221Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2151423Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2151427Z 2024-12-18T00:21:06.2151629Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2151739Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2151977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2152083Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2152291Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2152439Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2152583Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2152752Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2153342Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2153918Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2154278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2154729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2155040Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2155314Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2155624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2155993Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2156203Z Execution Analysis: .......... 2024-12-18T00:21:06.2156439Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2156631Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2156897Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2109 counts during 2009 steps 2024-12-18T00:21:06.2156907Z 2024-12-18T00:21:06.2157092Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2157202Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2157469Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2157576Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2157761Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2157902Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2158031Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2158182Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2158514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2158835Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2159131Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2159380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2159665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2159911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2160187Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2160301Z Execution Analysis: (:1) 2024-12-18T00:21:06.2160537Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2160730Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2160734Z 2024-12-18T00:21:06.2160921Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2161032Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2161245Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2161350Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2161539Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2161669Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2161808Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2161960Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2162508Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2163034Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2163396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2163795Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2164084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2164336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2164618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2164867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2164967Z Execution Analysis: .......... 2024-12-18T00:21:06.2165209Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2165392Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2165672Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2110 counts during 2010 steps 2024-12-18T00:21:06.2165677Z 2024-12-18T00:21:06.2165862Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2165968Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2166235Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2166335Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2166527Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2166655Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2166789Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2166943Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2167276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2167599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2167890Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2168142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2168425Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2168675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2168939Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2169059Z Execution Analysis: (:1) 2024-12-18T00:21:06.2169292Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2169476Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2169491Z 2024-12-18T00:21:06.2169677Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2169779Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2169995Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2170096Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2170292Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2170422Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2170553Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2170710Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2171252Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2171807Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2172206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2172531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2172815Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2173068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2173346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2173589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2173688Z Execution Analysis: .......... 2024-12-18T00:21:06.2173924Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2174117Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2174386Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2111 counts during 2011 steps 2024-12-18T00:21:06.2174390Z 2024-12-18T00:21:06.2174580Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2174682Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2174952Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2175050Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2175238Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2175376Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2175505Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2175665Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2175993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2176327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2176690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2177117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2177429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2177693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2177992Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2178113Z Execution Analysis: (:1) 2024-12-18T00:21:06.2178376Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2178577Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2178586Z 2024-12-18T00:21:06.2178790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2178901Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2179131Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2179244Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2179448Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2179595Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2179737Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2179905Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2180495Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2181157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2181540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2181887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2182200Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2182469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2182781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2183046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2183156Z Execution Analysis: .......... 2024-12-18T00:21:06.2183416Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2183622Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2183914Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2112 counts during 2012 steps 2024-12-18T00:21:06.2183919Z 2024-12-18T00:21:06.2184119Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2184232Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2184518Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2184630Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2184828Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2184968Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2185112Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2185277Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2185644Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2185987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2186298Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2186566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2186874Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2187137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2187424Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2187551Z Execution Analysis: (:1) 2024-12-18T00:21:06.2187807Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2188019Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2188023Z 2024-12-18T00:21:06.2188220Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2188334Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2188559Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2188665Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2188874Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2189013Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2189161Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2189325Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2190210Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2190802Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2191136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2191461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2191744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2191996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2192275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2192524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2192622Z Execution Analysis: .......... 2024-12-18T00:21:06.2192867Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2193050Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2193313Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2113 counts during 2013 steps 2024-12-18T00:21:06.2193322Z 2024-12-18T00:21:06.2193503Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2193606Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2193877Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2193977Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2194166Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2194295Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2194423Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2194583Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2194909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2195236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2195522Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2195772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2196051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2196301Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2196565Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2196680Z Execution Analysis: (:1) 2024-12-18T00:21:06.2196927Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2197112Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2197116Z 2024-12-18T00:21:06.2197306Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2197407Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2197621Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2197722Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2197910Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2198045Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2198183Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2198341Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2198977Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2199509Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2199838Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2200164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2200451Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2200700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2200988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2201233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2201337Z Execution Analysis: .......... 2024-12-18T00:21:06.2201572Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2201760Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2202024Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2114 counts during 2014 steps 2024-12-18T00:21:06.2202028Z 2024-12-18T00:21:06.2202217Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2202321Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2202587Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2202690Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2202878Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2203019Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2203154Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2203311Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2203635Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2203954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2204249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2204497Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2204779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2205022Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2205297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2205415Z Execution Analysis: (:1) 2024-12-18T00:21:06.2205650Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2205841Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2205846Z 2024-12-18T00:21:06.2206028Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2206133Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2206342Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2206446Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2206634Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2206770Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2206904Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2207125Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2207695Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2208222Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2208556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2208877Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2209168Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2209415Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2209701Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2209949Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2210043Z Execution Analysis: .......... 2024-12-18T00:21:06.2210284Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2210470Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2210740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2115 counts during 2015 steps 2024-12-18T00:21:06.2210744Z 2024-12-18T00:21:06.2210929Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2211033Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2211300Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2211400Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2211593Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2211725Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2211858Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2212007Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2212337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2212658Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2212944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2213199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2213479Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2213731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2214001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2214117Z Execution Analysis: (:1) 2024-12-18T00:21:06.2214356Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2214548Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2214552Z 2024-12-18T00:21:06.2214735Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2214836Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2215049Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2215148Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2215342Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2215471Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2215687Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2215864Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2216490Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2217209Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2217565Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2217919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2218231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2218509Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2218819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2219090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2219191Z Execution Analysis: .......... 2024-12-18T00:21:06.2219447Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2219654Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2219946Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2116 counts during 2016 steps 2024-12-18T00:21:06.2219950Z 2024-12-18T00:21:06.2220157Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2220268Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2220562Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2220674Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2220879Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2221028Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2221168Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2221339Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2221692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2222045Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2222351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2222626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2222929Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2223201Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2223498Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2223622Z Execution Analysis: (:1) 2024-12-18T00:21:06.2223882Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2224082Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2224087Z 2024-12-18T00:21:06.2224291Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2224402Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2224631Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2224744Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2224975Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2225194Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2225340Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2225513Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2226099Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2226667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2227027Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2227378Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2227689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2227964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2228274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2228539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2228654Z Execution Analysis: .......... 2024-12-18T00:21:06.2228910Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2229214Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2229603Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2117 counts during 2017 steps 2024-12-18T00:21:06.2229607Z 2024-12-18T00:21:06.2229790Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2229897Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2230170Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2230276Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2230462Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2230598Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2230726Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2230877Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2231209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2231531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2231819Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2232071Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2232360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2232603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2232867Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2232982Z Execution Analysis: (:1) 2024-12-18T00:21:06.2233217Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2233407Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2233411Z 2024-12-18T00:21:06.2233591Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2233701Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2233910Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2234060Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2234304Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2234436Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2234574Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2234725Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2235273Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2235798Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2236131Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2236450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2236741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2236992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2237270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2237520Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2237613Z Execution Analysis: .......... 2024-12-18T00:21:06.2237853Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2238036Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2238305Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2118 counts during 2018 steps 2024-12-18T00:21:06.2238310Z 2024-12-18T00:21:06.2238494Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2238597Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2238871Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2238969Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2239162Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2239294Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2239427Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2239578Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2239904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2240231Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2240518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2240775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2241058Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2241309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2241576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2241687Z Execution Analysis: (:1) 2024-12-18T00:21:06.2241930Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2242114Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2242118Z 2024-12-18T00:21:06.2242308Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2242409Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2242676Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2242833Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2243027Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2243157Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2243291Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2243446Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2243989Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2244849Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2245206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2245561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2245877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2246153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2246458Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2246723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2246835Z Execution Analysis: .......... 2024-12-18T00:21:06.2247093Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2247305Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2247591Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2119 counts during 2019 steps 2024-12-18T00:21:06.2247597Z 2024-12-18T00:21:06.2247812Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2247921Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2248212Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2248327Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2248528Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2248675Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2248814Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2248990Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2249345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2249695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2250010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2250287Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2250595Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2250859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2251153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2251274Z Execution Analysis: (:1) 2024-12-18T00:21:06.2251531Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2251730Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2251734Z 2024-12-18T00:21:06.2251932Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2252166Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2252425Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2252543Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2252749Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2252894Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2253038Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2253204Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2253793Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2254359Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2254722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2255077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2255392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2255660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2255968Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2256233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2256409Z Execution Analysis: .......... 2024-12-18T00:21:06.2256684Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2256885Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2257179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2120 counts during 2020 steps 2024-12-18T00:21:06.2257187Z 2024-12-18T00:21:06.2257390Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2257509Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2257795Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2257908Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2258107Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2258247Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2258393Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2258557Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2258914Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2259262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2259578Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2259850Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2260153Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2260423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2260710Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2260839Z Execution Analysis: (:1) 2024-12-18T00:21:06.2261095Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2261303Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2261308Z 2024-12-18T00:21:06.2261582Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2261720Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2261952Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2262061Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2262276Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2262417Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2262568Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2262732Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2263321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2263899Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2264260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2264611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2264921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2265200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2265504Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2265775Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2265879Z Execution Analysis: .......... 2024-12-18T00:21:06.2266140Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2266349Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2266640Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2121 counts during 2021 steps 2024-12-18T00:21:06.2266644Z 2024-12-18T00:21:06.2266855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2266967Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2267264Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2267371Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2267580Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2267721Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2267862Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2268033Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2268387Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2268753Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2269155Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2269409Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2269690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2269936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2270210Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2270324Z Execution Analysis: (:1) 2024-12-18T00:21:06.2270565Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2270774Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2270822Z 2024-12-18T00:21:06.2271037Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2271140Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2271360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2271456Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2271646Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2271783Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2271918Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2272074Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2272616Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2273149Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2273481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2273799Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2274085Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2274333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2274621Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2274867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2274965Z Execution Analysis: .......... 2024-12-18T00:21:06.2275201Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2275398Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2275662Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2122 counts during 2022 steps 2024-12-18T00:21:06.2275667Z 2024-12-18T00:21:06.2275855Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2275965Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2276232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2276334Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2276520Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2276655Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2276785Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2276938Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2277271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2277594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2277881Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2278128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2278415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2278658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2278928Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2279045Z Execution Analysis: (:1) 2024-12-18T00:21:06.2279280Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2279579Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2279584Z 2024-12-18T00:21:06.2279770Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2279879Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2280089Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2280195Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2280383Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2280515Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2280652Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2280804Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2281356Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2281885Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2282219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2282542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2282828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2283077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2283358Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2283610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2283704Z Execution Analysis: .......... 2024-12-18T00:21:06.2283953Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2284140Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2284410Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2124 counts during 2023 steps 2024-12-18T00:21:06.2284415Z 2024-12-18T00:21:06.2284599Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2284703Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2284974Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:21:06.2285074Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2285268Z Execution Analysis: Graph Hash: b823769de82237f1cfb807cc15a25dfa 2024-12-18T00:21:06.2285401Z Execution Analysis: Number of Graph Inputs: 18 2024-12-18T00:21:06.2285538Z Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:21:06.2285695Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2286025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2024-12-18T00:21:06.2286353Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2286638Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2286893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2287175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2287426Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2287694Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2024-12-18T00:21:06.2287814Z Execution Analysis: (:1) 2024-12-18T00:21:06.2288124Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2288339Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2288343Z 2024-12-18T00:21:06.2288536Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2288639Z Execution Analysis: Execution Cause 2024-12-18T00:21:06.2288855Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2024-12-18T00:21:06.2288959Z Execution Analysis: Graph Info: 2024-12-18T00:21:06.2289152Z Execution Analysis: Graph Hash: ddfa10b3717cb33b5f3a3076a39333f8 2024-12-18T00:21:06.2289280Z Execution Analysis: Number of Graph Inputs: 34 2024-12-18T00:21:06.2289412Z Execution Analysis: Number of Graph Outputs: 53 2024-12-18T00:21:06.2289569Z Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:21:06.2290113Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2024-12-18T00:21:06.2290650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2024-12-18T00:21:06.2290981Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2024-12-18T00:21:06.2291311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2024-12-18T00:21:06.2291593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2024-12-18T00:21:06.2291848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2024-12-18T00:21:06.2292129Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2024-12-18T00:21:06.2292373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2024-12-18T00:21:06.2292481Z Execution Analysis: .......... 2024-12-18T00:21:06.2292720Z Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:21:06.2292910Z Execution Analysis: ================================================================================ 2024-12-18T00:21:06.2293171Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2125 counts during 2024 steps 2024-12-18T00:21:06.2293176Z 2024-12-18T00:21:06.2293259Z . 2024-12-18T00:21:06.2293400Z ---------------------------------------------------------------------- 2024-12-18T00:21:06.2293488Z Ran 1 test in 66.097s 2024-12-18T00:21:06.2293498Z 2024-12-18T00:21:06.2293573Z OK 2024-12-18T00:21:06.2293813Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2024-12-18T00:21:06.2294090Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py' 2024-12-18T00:21:06.2294339Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2024-12-18T00:21:06.2294443Z ++ command -v nvidia-smi 2024-12-18T00:21:06.2294525Z + '[' -x '' ']' 2024-12-18T00:21:06.2294619Z + PJRT_DEVICE=CPU 2024-12-18T00:21:06.2294708Z + CPU_NUM_DEVICES=1 2024-12-18T00:21:06.2294920Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2024-12-18T00:21:06.2295008Z + '[' 0 '!=' 0 ']' 2024-12-18T00:21:06.2295205Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2024-12-18T00:21:07.8298281Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:21:07.8319558Z [ RUN ] TestExperimentalPjrt.test_default_ordinals 2024-12-18T00:21:07.8320649Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2024-12-18T00:21:07.8321324Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2024-12-18T00:21:07.8321965Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2024-12-18T00:21:07.8322770Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2024-12-18T00:21:07.8323562Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2024-12-18T00:21:07.8404106Z [ OK ] TestExperimentalPjrt.test_default_ordinals 2024-12-18T00:21:07.8404649Z [ RUN ] TestExperimentalPjrt.test_device_type0 ('CPU', 'CPU') 2024-12-18T00:21:07.8407906Z [ OK ] TestExperimentalPjrt.test_device_type0 ('CPU', 'CPU') 2024-12-18T00:21:07.8408422Z [ RUN ] TestExperimentalPjrt.test_device_type1 ('CUDA', 'CUDA') 2024-12-18T00:21:07.8413864Z [ OK ] TestExperimentalPjrt.test_device_type1 ('CUDA', 'CUDA') 2024-12-18T00:21:07.8414374Z [ RUN ] TestExperimentalPjrt.test_device_type2 ('TPU', 'TPU') 2024-12-18T00:21:07.8420001Z [ OK ] TestExperimentalPjrt.test_device_type2 ('TPU', 'TPU') 2024-12-18T00:21:07.8420458Z [ RUN ] TestExperimentalPjrt.test_host_index 2024-12-18T00:21:07.8420866Z [ OK ] TestExperimentalPjrt.test_host_index 2024-12-18T00:21:07.8421296Z [ RUN ] TestExperimentalPjrt.test_num_global_devices 2024-12-18T00:21:07.8421742Z [ OK ] TestExperimentalPjrt.test_num_global_devices 2024-12-18T00:21:07.8422164Z [ RUN ] TestExperimentalPjrt.test_num_local_devices 2024-12-18T00:21:07.8422591Z [ OK ] TestExperimentalPjrt.test_num_local_devices 2024-12-18T00:21:07.8423055Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_default 2024-12-18T00:21:07.8494403Z W1218 00:21:07.848984 140037983851712 runtime.py:79] Defaulting to PJRT_DEVICE=CPU 2024-12-18T00:21:07.8495020Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_default 2024-12-18T00:21:07.8495574Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_gpu_num_devives 2024-12-18T00:21:07.8562348Z W1218 00:21:07.855590 140037983851712 runtime.py:66] GPU_NUM_DEVICES is set. Setting PJRT_DEVICE=CUDA 2024-12-18T00:21:07.8563042Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_gpu_num_devives 2024-12-18T00:21:07.8563609Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_no_default 2024-12-18T00:21:07.8624540Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_no_default 2024-12-18T00:21:07.8625107Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_cpu 2024-12-18T00:21:07.8691941Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_cpu 2024-12-18T00:21:07.8692870Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_gpu 2024-12-18T00:21:07.8753455Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_gpu 2024-12-18T00:21:07.8754065Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_tpu_precedence 2024-12-18T00:21:07.8818625Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_tpu_precedence 2024-12-18T00:21:07.8819187Z [ RUN ] TestExperimentalPjrt.test_set_device_type 2024-12-18T00:21:07.8824447Z [ OK ] TestExperimentalPjrt.test_set_device_type 2024-12-18T00:21:07.8824895Z [ RUN ] TestExperimentalPjrt.test_set_device_type_error 2024-12-18T00:21:07.8832849Z [ OK ] TestExperimentalPjrt.test_set_device_type_error 2024-12-18T00:21:07.8833382Z [ RUN ] TestExperimentalPjrt.test_set_device_type_same_device 2024-12-18T00:21:07.8840942Z [ OK ] TestExperimentalPjrt.test_set_device_type_same_device 2024-12-18T00:21:07.8841426Z [ RUN ] TestExperimentalPjrt.test_xla_device_error 2024-12-18T00:21:07.8841858Z [ OK ] TestExperimentalPjrt.test_xla_device_error 2024-12-18T00:21:07.8842287Z ---------------------------------------------------------------------- 2024-12-18T00:21:07.8842668Z Ran 17 tests in 0.053s 2024-12-18T00:21:07.8842846Z 2024-12-18T00:21:07.8842939Z OK 2024-12-18T00:21:08.4479278Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2024-12-18T00:21:08.4480152Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py' 2024-12-18T00:21:08.4481035Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2024-12-18T00:21:08.4481639Z ++ command -v nvidia-smi 2024-12-18T00:21:08.4482343Z + '[' -x '' ']' 2024-12-18T00:21:08.4482647Z + PJRT_DEVICE=CPU 2024-12-18T00:21:08.4482902Z + CPU_NUM_DEVICES=1 2024-12-18T00:21:08.4483357Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2024-12-18T00:21:08.4483893Z + '[' 0 '!=' 0 ']' 2024-12-18T00:21:08.4484333Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2024-12-18T00:21:11.4377022Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:21:11.4397335Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_addressable_device_count 2024-12-18T00:21:11.4398032Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_addressable_device_count 2024-12-18T00:21:11.4398729Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_addressable_runtime_device_count 2024-12-18T00:21:11.4399458Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_addressable_runtime_device_count 2024-12-18T00:21:11.4400148Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_local_process_count 2024-12-18T00:21:11.4400766Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_local_process_count 2024-12-18T00:21:11.4401388Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_num_global_device_count 2024-12-18T00:21:11.4402010Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_num_global_device_count 2024-12-18T00:21:11.4402628Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_num_local_devices 2024-12-18T00:21:11.4403213Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_num_local_devices 2024-12-18T00:21:11.4403758Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_ordinal 2024-12-18T00:21:11.4404260Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_ordinal 2024-12-18T00:21:11.4404787Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_process_count 2024-12-18T00:21:11.4405323Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_process_count 2024-12-18T00:21:11.4405869Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_process_index 2024-12-18T00:21:11.4406424Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_process_index 2024-12-18T00:21:11.4406959Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_world_size 2024-12-18T00:21:11.4407477Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_world_size 2024-12-18T00:21:11.4407956Z ---------------------------------------------------------------------- 2024-12-18T00:21:11.4408345Z Ran 9 tests in 0.000s 2024-12-18T00:21:11.4408524Z 2024-12-18T00:21:11.4408623Z OK (skipped=9) 2024-12-18T00:21:11.9821109Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2024-12-18T00:21:11.9821943Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py' 2024-12-18T00:21:11.9822772Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2024-12-18T00:21:11.9823639Z ++ command -v nvidia-smi 2024-12-18T00:21:11.9825656Z + '[' -x '' ']' 2024-12-18T00:21:11.9825914Z + PJRT_DEVICE=CPU 2024-12-18T00:21:11.9826155Z + CPU_NUM_DEVICES=1 2024-12-18T00:21:11.9826659Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2024-12-18T00:21:11.9827175Z + '[' 0 '!=' 0 ']' 2024-12-18T00:21:11.9827594Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2024-12-18T00:21:14.9825394Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:21:14.9847233Z [ RUN ] TestExperimentalPjrtMultiGpu.test_addressable_device_count 2024-12-18T00:21:14.9847872Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_addressable_device_count 2024-12-18T00:21:14.9848507Z [ RUN ] TestExperimentalPjrtMultiGpu.test_addressable_runtime_device_count 2024-12-18T00:21:14.9849168Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_addressable_runtime_device_count 2024-12-18T00:21:14.9849770Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_gather_pinned 2024-12-18T00:21:14.9850298Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_gather_pinned 2024-12-18T00:21:14.9851032Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_gather_unpinned 2024-12-18T00:21:14.9851764Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_gather_unpinned 2024-12-18T00:21:14.9852307Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_to_all_pinned 2024-12-18T00:21:14.9852813Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_to_all_pinned 2024-12-18T00:21:14.9853345Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_to_all_unpinned 2024-12-18T00:21:14.9853883Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_to_all_unpinned 2024-12-18T00:21:14.9854546Z [ RUN ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_synchronized_parameters 2024-12-18T00:21:14.9855340Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_synchronized_parameters 2024-12-18T00:21:14.9856133Z [ RUN ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_unsynchronized_parameters 2024-12-18T00:21:14.9857026Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_unsynchronized_parameters 2024-12-18T00:21:14.9857714Z [ RUN ] TestExperimentalPjrtMultiGpu.test_default_gpu_device 2024-12-18T00:21:14.9858250Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_default_gpu_device 2024-12-18T00:21:14.9858788Z [ RUN ] TestExperimentalPjrtMultiGpu.test_global_device_count 2024-12-18T00:21:14.9859327Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_global_device_count 2024-12-18T00:21:14.9859849Z [ RUN ] TestExperimentalPjrtMultiGpu.test_global_ordinal 2024-12-18T00:21:14.9860336Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_global_ordinal 2024-12-18T00:21:14.9860849Z [ RUN ] TestExperimentalPjrtMultiGpu.test_local_device_count 2024-12-18T00:21:14.9861379Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_local_device_count 2024-12-18T00:21:14.9861893Z [ RUN ] TestExperimentalPjrtMultiGpu.test_local_ordinal 2024-12-18T00:21:14.9862389Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_local_ordinal 2024-12-18T00:21:14.9862904Z [ RUN ] TestExperimentalPjrtMultiGpu.test_local_process_count 2024-12-18T00:21:14.9863458Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_local_process_count 2024-12-18T00:21:14.9864003Z [ RUN ] TestExperimentalPjrtMultiGpu.test_multi_gpu_backwards 2024-12-18T00:21:14.9864545Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_multi_gpu_backwards 2024-12-18T00:21:14.9865065Z [ RUN ] TestExperimentalPjrtMultiGpu.test_multi_gpu_devices 2024-12-18T00:21:14.9865586Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_multi_gpu_devices 2024-12-18T00:21:14.9866098Z [ RUN ] TestExperimentalPjrtMultiGpu.test_process_count 2024-12-18T00:21:14.9866608Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_process_count 2024-12-18T00:21:14.9867114Z [ RUN ] TestExperimentalPjrtMultiGpu.test_process_index 2024-12-18T00:21:14.9867611Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_process_index 2024-12-18T00:21:14.9868126Z [ RUN ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_pinned 2024-12-18T00:21:14.9868692Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_pinned 2024-12-18T00:21:14.9869273Z [ RUN ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_unpinned 2024-12-18T00:21:14.9869852Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_unpinned 2024-12-18T00:21:14.9870388Z [ RUN ] TestExperimentalPjrtMultiGpu.test_spawn_pjrt 2024-12-18T00:21:14.9870866Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_spawn_pjrt 2024-12-18T00:21:14.9871323Z [ RUN ] TestExperimentalPjrtMultiGpu.test_spawn_xmp 2024-12-18T00:21:14.9871788Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_spawn_xmp 2024-12-18T00:21:14.9872258Z [ RUN ] TestExperimentalPjrtMultiGpu.test_world_size 2024-12-18T00:21:14.9872732Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_world_size 2024-12-18T00:21:14.9873199Z ---------------------------------------------------------------------- 2024-12-18T00:21:14.9873580Z Ran 23 tests in 0.001s 2024-12-18T00:21:14.9873756Z 2024-12-18T00:21:14.9873855Z OK (skipped=23) 2024-12-18T00:21:15.5305266Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2024-12-18T00:21:15.5307847Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py' 2024-12-18T00:21:15.5308654Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2024-12-18T00:21:15.5309223Z ++ command -v nvidia-smi 2024-12-18T00:21:15.5309807Z + '[' -x '' ']' 2024-12-18T00:21:15.5310135Z + PJRT_DEVICE=CPU 2024-12-18T00:21:15.5310389Z + CPU_NUM_DEVICES=1 2024-12-18T00:21:15.5310837Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2024-12-18T00:21:15.5311340Z + '[' 0 '!=' 0 ']' 2024-12-18T00:21:15.5311747Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2024-12-18T00:21:18.5381477Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:21:18.5404521Z [ RUN ] TestExperimentalPjrtMultiCpu.test_all_reduce_no_op_with_one_replica 2024-12-18T00:21:18.5405281Z [ SKIPPED ] TestExperimentalPjrtMultiCpu.test_all_reduce_no_op_with_one_replica 2024-12-18T00:21:18.5405920Z [ RUN ] TestExperimentalPjrtMultiCpu.test_default_cpu_device 2024-12-18T00:21:22.1020406Z [ OK ] TestExperimentalPjrtMultiCpu.test_default_cpu_device 2024-12-18T00:21:22.1021001Z [ RUN ] TestExperimentalPjrtMultiCpu.test_global_ordinal 2024-12-18T00:21:25.6875588Z [ OK ] TestExperimentalPjrtMultiCpu.test_global_ordinal 2024-12-18T00:21:25.6876121Z [ RUN ] TestExperimentalPjrtMultiCpu.test_hlo_dump 2024-12-18T00:21:29.4748203Z [ OK ] TestExperimentalPjrtMultiCpu.test_hlo_dump 2024-12-18T00:21:29.4748760Z [ RUN ] TestExperimentalPjrtMultiCpu.test_local_ordinal 2024-12-18T00:21:33.0881205Z [ OK ] TestExperimentalPjrtMultiCpu.test_local_ordinal 2024-12-18T00:21:33.0881787Z [ RUN ] TestExperimentalPjrtMultiCpu.test_multi_cpu_backwards 2024-12-18T00:21:36.8063685Z [ OK ] TestExperimentalPjrtMultiCpu.test_multi_cpu_backwards 2024-12-18T00:21:36.8064293Z [ RUN ] TestExperimentalPjrtMultiCpu.test_multi_cpu_devices 2024-12-18T00:21:40.3981231Z [ OK ] TestExperimentalPjrtMultiCpu.test_multi_cpu_devices 2024-12-18T00:21:40.3981818Z [ RUN ] TestExperimentalPjrtMultiCpu.test_spawn_pjrt 2024-12-18T00:21:43.9968706Z [ OK ] TestExperimentalPjrtMultiCpu.test_spawn_pjrt 2024-12-18T00:21:43.9969274Z [ RUN ] TestExperimentalPjrtMultiCpu.test_spawn_xmp 2024-12-18T00:21:47.5646450Z [ OK ] TestExperimentalPjrtMultiCpu.test_spawn_xmp 2024-12-18T00:21:47.5646971Z ---------------------------------------------------------------------- 2024-12-18T00:21:47.5647370Z Ran 9 tests in 29.024s 2024-12-18T00:21:47.5647558Z 2024-12-18T00:21:47.5647662Z OK (skipped=1) 2024-12-18T00:21:48.1643205Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2024-12-18T00:21:48.1643958Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py' 2024-12-18T00:21:48.1644946Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2024-12-18T00:21:48.1645530Z ++ command -v nvidia-smi 2024-12-18T00:21:48.1646049Z + '[' -x '' ']' 2024-12-18T00:21:48.1646310Z + PJRT_DEVICE=CPU 2024-12-18T00:21:48.1646638Z + CPU_NUM_DEVICES=1 2024-12-18T00:21:48.1647069Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2024-12-18T00:21:48.1647548Z + '[' 0 '!=' 0 ']' 2024-12-18T00:21:48.1647942Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2024-12-18T00:21:51.1683112Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:21:51.1699738Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v3-8_process_0 2024-12-18T00:21:51.1717392Z /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py:331: DeprecationWarning: assertDictContainsSubset is deprecated 2024-12-18T00:21:51.1718245Z self.assertDictContainsSubset(expected, os.environ) 2024-12-18T00:21:51.1718782Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v3-8_process_0 2024-12-18T00:21:51.1719619Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v4-16_worker_1_process_0 2024-12-18T00:21:51.1725080Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v4-16_worker_1_process_0 2024-12-18T00:21:51.1726019Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_0 2024-12-18T00:21:51.1736380Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_0 2024-12-18T00:21:51.1737130Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_3 2024-12-18T00:21:51.1747796Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_3 2024-12-18T00:21:51.1748423Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v5-4_process_0 2024-12-18T00:21:51.1765904Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v5-4_process_0 2024-12-18T00:21:51.1766560Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-16_process_0 2024-12-18T00:21:51.1770344Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-16_process_0 2024-12-18T00:21:51.1771012Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-4_process_0 2024-12-18T00:21:51.1781253Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-4_process_0 2024-12-18T00:21:51.1781829Z [ RUN ] TestExperimentalTpu.test_get_worker_ips_four_hosts 2024-12-18T00:21:51.1784716Z [ OK ] TestExperimentalTpu.test_get_worker_ips_four_hosts 2024-12-18T00:21:51.1785192Z [ RUN ] TestExperimentalTpu.test_get_worker_ips_one_host 2024-12-18T00:21:51.1787351Z [ OK ] TestExperimentalTpu.test_get_worker_ips_one_host 2024-12-18T00:21:51.1787845Z [ RUN ] TestExperimentalTpu.test_num_available_chips_four_chips 2024-12-18T00:21:51.1819117Z [ OK ] TestExperimentalTpu.test_num_available_chips_four_chips 2024-12-18T00:21:51.1819673Z [ RUN ] TestExperimentalTpu.test_num_available_chips_no_chips 2024-12-18T00:21:51.1839254Z [ OK ] TestExperimentalTpu.test_num_available_chips_no_chips 2024-12-18T00:21:51.1839832Z [ RUN ] TestExperimentalTpu.test_num_available_chips_one_chip 2024-12-18T00:21:51.1854129Z [ OK ] TestExperimentalTpu.test_num_available_chips_one_chip 2024-12-18T00:21:51.1854629Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v2-8 2024-12-18T00:21:51.1858608Z [ OK ] TestExperimentalTpu.test_num_available_devices_v2-8 2024-12-18T00:21:51.1859093Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v3-8 2024-12-18T00:21:51.1863438Z [ OK ] TestExperimentalTpu.test_num_available_devices_v3-8 2024-12-18T00:21:51.1863927Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v4-8 2024-12-18T00:21:51.1867657Z [ OK ] TestExperimentalTpu.test_num_available_devices_v4-8 2024-12-18T00:21:51.1868169Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v4-8_one_chip 2024-12-18T00:21:51.1871944Z [ OK ] TestExperimentalTpu.test_num_available_devices_v4-8_one_chip 2024-12-18T00:21:51.1872526Z [ RUN ] TestExperimentalTpu.test_num_local_processes_default_one_host 2024-12-18T00:21:51.1881300Z [ OK ] TestExperimentalTpu.test_num_local_processes_default_one_host 2024-12-18T00:21:51.1881921Z [ RUN ] TestExperimentalTpu.test_num_local_processes_multi_process_one_host 2024-12-18T00:21:51.1889720Z [ OK ] TestExperimentalTpu.test_num_local_processes_multi_process_one_host 2024-12-18T00:21:51.1890354Z [ RUN ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-16 2024-12-18T00:21:51.1898044Z [ OK ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-16 2024-12-18T00:21:51.1898665Z [ RUN ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-32 2024-12-18T00:21:51.1906167Z [ OK ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-32 2024-12-18T00:21:51.1906791Z [ RUN ] TestExperimentalTpu.test_num_local_processes_one_process_one_host 2024-12-18T00:21:51.1915086Z [ OK ] TestExperimentalTpu.test_num_local_processes_one_process_one_host 2024-12-18T00:21:51.1915877Z [ RUN ] TestExperimentalTpu.test_num_local_processes_single_chip_default 2024-12-18T00:21:51.1923190Z [ OK ] TestExperimentalTpu.test_num_local_processes_single_chip_default 2024-12-18T00:21:51.1923820Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_default_one_host 2024-12-18T00:21:51.1929182Z [ OK ] TestExperimentalTpu.test_process_bounds_size_default_one_host 2024-12-18T00:21:51.1929782Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_multi_process_one_host 2024-12-18T00:21:51.1935276Z [ OK ] TestExperimentalTpu.test_process_bounds_size_multi_process_one_host 2024-12-18T00:21:51.1935890Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-16 2024-12-18T00:21:51.1941398Z [ OK ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-16 2024-12-18T00:21:51.1942004Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-32 2024-12-18T00:21:51.1947574Z [ OK ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-32 2024-12-18T00:21:51.1948175Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_one_process_one_host 2024-12-18T00:21:51.1953506Z [ OK ] TestExperimentalTpu.test_process_bounds_size_one_process_one_host 2024-12-18T00:21:51.1954044Z [ RUN ] TestExperimentalTpu.test_task_id0 (None, None) 2024-12-18T00:21:51.1959373Z [ OK ] TestExperimentalTpu.test_task_id0 (None, None) 2024-12-18T00:21:51.1959812Z [ RUN ] TestExperimentalTpu.test_task_id1 ('0', 0) 2024-12-18T00:21:51.1965555Z [ OK ] TestExperimentalTpu.test_task_id1 ('0', 0) 2024-12-18T00:21:51.1965971Z [ RUN ] TestExperimentalTpu.test_task_id2 ('1', 1) 2024-12-18T00:21:51.1971319Z [ OK ] TestExperimentalTpu.test_task_id2 ('1', 1) 2024-12-18T00:21:51.1971742Z [ RUN ] TestExperimentalTpu.test_task_id3 ('15', 15) 2024-12-18T00:21:51.1977445Z [ OK ] TestExperimentalTpu.test_task_id3 ('15', 15) 2024-12-18T00:21:51.1977937Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_env_vars_all-vars-set 2024-12-18T00:21:51.1983787Z [ OK ] TestExperimentalTpu.test_tpu_env_from_env_vars_all-vars-set 2024-12-18T00:21:51.1984349Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_env_vars_defaults-only 2024-12-18T00:21:51.1989917Z [ OK ] TestExperimentalTpu.test_tpu_env_from_env_vars_defaults-only 2024-12-18T00:21:51.1990458Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v4 2024-12-18T00:21:51.2011454Z [ OK ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v4 2024-12-18T00:21:51.2012096Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v5 2024-12-18T00:21:51.2021047Z [ OK ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v5 2024-12-18T00:21:51.2021569Z [ RUN ] TestExperimentalTpu.test_worker_id0 ('0', 0) 2024-12-18T00:21:51.2028501Z [ OK ] TestExperimentalTpu.test_worker_id0 ('0', 0) 2024-12-18T00:21:51.2028919Z [ RUN ] TestExperimentalTpu.test_worker_id1 ('1', 1) 2024-12-18T00:21:51.2031102Z [ OK ] TestExperimentalTpu.test_worker_id1 ('1', 1) 2024-12-18T00:21:51.2031550Z [ RUN ] TestExperimentalTpu.test_worker_id2 ('15', 15) 2024-12-18T00:21:51.2033623Z [ OK ] TestExperimentalTpu.test_worker_id2 ('15', 15) 2024-12-18T00:21:51.2034070Z ---------------------------------------------------------------------- 2024-12-18T00:21:51.2034464Z Ran 38 tests in 0.034s 2024-12-18T00:21:51.2034630Z 2024-12-18T00:21:51.2034724Z OK 2024-12-18T00:21:51.7520459Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2024-12-18T00:21:51.7521530Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py' 2024-12-18T00:21:51.7522241Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2024-12-18T00:21:51.7522742Z ++ command -v nvidia-smi 2024-12-18T00:21:51.7523022Z + '[' -x '' ']' 2024-12-18T00:21:51.7523278Z + PJRT_DEVICE=CPU 2024-12-18T00:21:51.7523520Z + CPU_NUM_DEVICES=1 2024-12-18T00:21:51.7523894Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2024-12-18T00:21:51.7524702Z + '[' 0 '!=' 0 ']' 2024-12-18T00:21:51.7525119Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2024-12-18T00:21:54.7651583Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:21:54.7665393Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_correctness_env_init 2024-12-18T00:21:58.1759148Z [rank0]:[W1218 00:21:58.870852470 logger.cpp:340] Warning: Time stats are currently only collected for CPU and CUDA devices. Please refer to CpuTimer or CudaTimer for how to register timer for other device type. (function operator()) 2024-12-18T00:21:59.1642258Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_correctness_env_init 2024-12-18T00:21:59.1642952Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_correctness_large_net 2024-12-18T00:22:02.7727538Z [rank0]:[W1218 00:22:02.467614481 logger.cpp:340] Warning: Time stats are currently only collected for CPU and CUDA devices. Please refer to CpuTimer or CudaTimer for how to register timer for other device type. (function operator()) 2024-12-18T00:22:03.9388034Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_correctness_large_net 2024-12-18T00:22:03.9388703Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_correctness_small_net 2024-12-18T00:22:07.2578463Z [rank0]:[W1218 00:22:07.952619210 logger.cpp:340] Warning: Time stats are currently only collected for CPU and CUDA devices. Please refer to CpuTimer or CudaTimer for how to register timer for other device type. (function operator()) 2024-12-18T00:22:08.2364431Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_correctness_small_net 2024-12-18T00:22:08.2365056Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_init 2024-12-18T00:22:12.0179723Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_init 2024-12-18T00:22:12.0180309Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_init_threaded 2024-12-18T00:22:12.0180910Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2024-12-18T00:22:12.0181571Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2024-12-18T00:22:12.0182200Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2024-12-18T00:22:12.0182804Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2024-12-18T00:22:12.0183417Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2024-12-18T00:22:12.1407239Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_init_threaded 2024-12-18T00:22:12.1407778Z ---------------------------------------------------------------------- 2024-12-18T00:22:12.1408188Z Ran 5 tests in 17.374s 2024-12-18T00:22:12.1408370Z 2024-12-18T00:22:12.1408469Z OK 2024-12-18T00:22:12.7048341Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2024-12-18T00:22:12.7049096Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py' 2024-12-18T00:22:12.7049839Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2024-12-18T00:22:12.7050425Z ++ command -v nvidia-smi 2024-12-18T00:22:12.7051559Z + '[' -x '' ']' 2024-12-18T00:22:12.7051819Z + PJRT_DEVICE=CPU 2024-12-18T00:22:12.7052076Z + CPU_NUM_DEVICES=1 2024-12-18T00:22:12.7052507Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2024-12-18T00:22:12.7052978Z + '[' 0 '!=' 0 ']' 2024-12-18T00:22:12.7053373Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2024-12-18T00:22:15.7103416Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:22:15.7126518Z [ RUN ] PjRtMeshServiceTest.test_mesh_reduce 2024-12-18T00:22:19.3892424Z [ OK ] PjRtMeshServiceTest.test_mesh_reduce 2024-12-18T00:22:19.3893025Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_default_payload_cpu_transfers 2024-12-18T00:22:23.0036862Z [ OK ] PjRtMeshServiceTest.test_rendezvous_default_payload_cpu_transfers 2024-12-18T00:22:23.0037472Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_dynamic_size 2024-12-18T00:22:26.6326932Z [ OK ] PjRtMeshServiceTest.test_rendezvous_dynamic_size 2024-12-18T00:22:26.6327569Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_empty_payload 2024-12-18T00:22:30.2652912Z [ OK ] PjRtMeshServiceTest.test_rendezvous_empty_payload 2024-12-18T00:22:30.2653452Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_replica_groups 2024-12-18T00:22:33.9276213Z [ OK ] PjRtMeshServiceTest.test_rendezvous_replica_groups 2024-12-18T00:22:33.9276787Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_static_size 2024-12-18T00:22:37.5546170Z [ OK ] PjRtMeshServiceTest.test_rendezvous_static_size 2024-12-18T00:22:37.5546706Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_string_payload 2024-12-18T00:22:41.1463537Z [ OK ] PjRtMeshServiceTest.test_rendezvous_string_payload 2024-12-18T00:22:41.1464049Z ---------------------------------------------------------------------- 2024-12-18T00:22:41.1464447Z Ran 7 tests in 25.434s 2024-12-18T00:22:41.1464629Z 2024-12-18T00:22:41.1464754Z OK 2024-12-18T00:22:41.7029331Z + run_test /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2024-12-18T00:22:41.7030041Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_python_ops.py' 2024-12-18T00:22:41.7030724Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2024-12-18T00:22:41.7032723Z ++ command -v nvidia-smi 2024-12-18T00:22:41.7048653Z + '[' -x '' ']' 2024-12-18T00:22:41.7049029Z + PJRT_DEVICE=CPU 2024-12-18T00:22:41.7049300Z + CPU_NUM_DEVICES=1 2024-12-18T00:22:41.7049682Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2024-12-18T00:22:41.7050137Z + '[' 0 '!=' 0 ']' 2024-12-18T00:22:41.7050869Z + python3 /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2024-12-18T00:22:45.1505286Z 2024-12-18T00:22:45.1505740Z Running tests... 2024-12-18T00:22:45.1506144Z ---------------------------------------------------------------------- 2024-12-18T00:25:29.6960987Z .sss........sss....... 2024-12-18T00:25:29.6963595Z ---------------------------------------------------------------------- 2024-12-18T00:25:29.6964068Z Ran 22 tests in 164.545s 2024-12-18T00:25:29.6964261Z 2024-12-18T00:25:29.6964363Z OK (skipped=6) 2024-12-18T00:25:29.6964506Z 2024-12-18T00:25:29.6964632Z Generating XML reports... 2024-12-18T00:25:30.6977401Z + run_test /var/lib/jenkins/workspace/xla/test/test_ops.py 2024-12-18T00:25:30.6978061Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_ops.py' 2024-12-18T00:25:30.6978708Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_ops.py 2024-12-18T00:25:30.6979180Z ++ command -v nvidia-smi 2024-12-18T00:25:30.6979469Z + '[' -x '' ']' 2024-12-18T00:25:30.6979718Z + PJRT_DEVICE=CPU 2024-12-18T00:25:30.6979974Z + CPU_NUM_DEVICES=1 2024-12-18T00:25:30.6980311Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_ops.py 2024-12-18T00:25:30.6980711Z + '[' 0 '!=' 0 ']' 2024-12-18T00:25:30.6981033Z + python3 /var/lib/jenkins/workspace/xla/test/test_ops.py 2024-12-18T00:26:20.1098748Z .................................................../opt/conda/lib/python3.10/site-packages/torch/testing/_internal/opinfo/core.py:1178: UserWarning: torch.cholesky is deprecated in favor of torch.linalg.cholesky and will be removed in a future PyTorch release. 2024-12-18T00:26:20.1100767Z L = torch.cholesky(A) 2024-12-18T00:26:20.1101210Z should be replaced with 2024-12-18T00:26:20.1101675Z L = torch.linalg.cholesky(A) 2024-12-18T00:26:20.1102119Z and 2024-12-18T00:26:20.1102493Z U = torch.cholesky(A, upper=True) 2024-12-18T00:26:20.1103005Z should be replaced with 2024-12-18T00:26:20.1103470Z U = torch.linalg.cholesky(A).mH 2024-12-18T00:26:20.1105249Z This transform will produce equivalent results for all valid (symmetric positive definite) inputs. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:1765.) 2024-12-18T00:26:20.1107057Z return self.op(*args, **kwargs) 2024-12-18T00:26:26.8647017Z ................/opt/conda/lib/python3.10/site-packages/torch/testing/_internal/opinfo/core.py:1178: UserWarning: Using torch.cross without specifying the dim arg is deprecated. 2024-12-18T00:26:26.8648780Z Please either pass the dim explicitly or simply use torch.linalg.cross. 2024-12-18T00:26:26.8650237Z The default value of dim will change to agree with that of linalg.cross in a future release. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/Cross.cpp:66.) 2024-12-18T00:26:26.8651651Z return self.op(*args, **kwargs) 2024-12-18T00:28:46.1704851Z ...........................................................................s...................................................................................................................s...........ss................................................................................... 2024-12-18T00:28:46.1705636Z ---------------------------------------------------------------------- 2024-12-18T00:28:46.1706029Z Ran 355 tests in 191.248s 2024-12-18T00:28:46.1706224Z 2024-12-18T00:28:46.1706354Z OK (skipped=4) 2024-12-18T00:28:47.1600538Z + run_test /var/lib/jenkins/workspace/xla/test/test_metrics.py 2024-12-18T00:28:47.1601208Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_metrics.py' 2024-12-18T00:28:47.1601886Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_metrics.py 2024-12-18T00:28:47.1602369Z ++ command -v nvidia-smi 2024-12-18T00:28:47.1602673Z + '[' -x '' ']' 2024-12-18T00:28:47.1603225Z + PJRT_DEVICE=CPU 2024-12-18T00:28:47.1603523Z + CPU_NUM_DEVICES=1 2024-12-18T00:28:47.1603913Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_metrics.py 2024-12-18T00:28:47.1604351Z + '[' 0 '!=' 0 ']' 2024-12-18T00:28:47.1604696Z + python3 /var/lib/jenkins/workspace/xla/test/test_metrics.py 2024-12-18T00:28:51.2914017Z ........... 2024-12-18T00:28:51.2914430Z ---------------------------------------------------------------------- 2024-12-18T00:28:51.2914876Z Ran 11 tests in 1.124s 2024-12-18T00:28:51.2915045Z 2024-12-18T00:28:51.2915133Z OK 2024-12-18T00:28:51.8824066Z + run_test /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2024-12-18T00:28:51.8824757Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_deprecation.py' 2024-12-18T00:28:51.8825517Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2024-12-18T00:28:51.8826290Z ++ command -v nvidia-smi 2024-12-18T00:28:51.8828716Z + '[' -x '' ']' 2024-12-18T00:28:51.8828973Z + PJRT_DEVICE=CPU 2024-12-18T00:28:51.8829214Z + CPU_NUM_DEVICES=1 2024-12-18T00:28:51.8829618Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2024-12-18T00:28:51.8830074Z + '[' 0 '!=' 0 ']' 2024-12-18T00:28:51.8830440Z + python3 /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2024-12-18T00:28:54.8559050Z .. 2024-12-18T00:28:54.8559466Z ---------------------------------------------------------------------- 2024-12-18T00:28:54.8559908Z Ran 2 tests in 0.001s 2024-12-18T00:28:54.8560077Z 2024-12-18T00:28:54.8560180Z OK 2024-12-18T00:28:55.3855793Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2024-12-18T00:28:55.3856769Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py' 2024-12-18T00:28:55.3857721Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2024-12-18T00:28:55.3858343Z ++ command -v nvidia-smi 2024-12-18T00:28:55.3860664Z + '[' -x '' ']' 2024-12-18T00:28:55.3860924Z + PJRT_DEVICE=CPU 2024-12-18T00:28:55.3861187Z + CPU_NUM_DEVICES=1 2024-12-18T00:28:55.3861668Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2024-12-18T00:28:55.3862226Z + '[' 0 '!=' 0 ']' 2024-12-18T00:28:55.3862687Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2024-12-18T00:28:58.7294649Z ....... 2024-12-18T00:28:58.7295205Z ---------------------------------------------------------------------- 2024-12-18T00:28:58.7295862Z Ran 7 tests in 0.359s 2024-12-18T00:28:58.7296751Z 2024-12-18T00:28:58.7296898Z OK 2024-12-18T00:28:59.3323414Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2024-12-18T00:28:59.3324231Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py' 2024-12-18T00:28:59.3325037Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2024-12-18T00:28:59.3325610Z ++ command -v nvidia-smi 2024-12-18T00:28:59.3325888Z + '[' -x '' ']' 2024-12-18T00:28:59.3326135Z + PJRT_DEVICE=CPU 2024-12-18T00:28:59.3326372Z + CPU_NUM_DEVICES=1 2024-12-18T00:28:59.3326811Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2024-12-18T00:28:59.3327309Z + '[' 0 '!=' 0 ']' 2024-12-18T00:28:59.3327727Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2024-12-18T00:29:02.7645359Z .......... 2024-12-18T00:29:02.7645873Z ---------------------------------------------------------------------- 2024-12-18T00:29:02.7646586Z Ran 10 tests in 0.429s 2024-12-18T00:29:02.7646865Z 2024-12-18T00:29:02.7646996Z OK 2024-12-18T00:29:03.3419955Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2024-12-18T00:29:03.3420703Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py' 2024-12-18T00:29:03.3421429Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2024-12-18T00:29:03.3421971Z ++ command -v nvidia-smi 2024-12-18T00:29:03.3423508Z + '[' -x '' ']' 2024-12-18T00:29:03.3423765Z + PJRT_DEVICE=CPU 2024-12-18T00:29:03.3424023Z + CPU_NUM_DEVICES=1 2024-12-18T00:29:03.3424426Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2024-12-18T00:29:03.3424892Z + '[' 0 '!=' 0 ']' 2024-12-18T00:29:03.3425255Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2024-12-18T00:29:26.9786584Z ......s.s.s...ss.s........W1218 00:29:26.977000 43493 site-packages/torch/_logging/_internal.py:1089] [2/0] Profiler function will be ignored 2024-12-18T00:29:32.6551239Z .. 2024-12-18T00:29:32.6551660Z ---------------------------------------------------------------------- 2024-12-18T00:29:32.6552219Z Ran 28 tests in 26.200s 2024-12-18T00:29:32.6552404Z 2024-12-18T00:29:32.6552503Z OK (skipped=6) 2024-12-18T00:29:33.5523994Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2024-12-18T00:29:33.5524865Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py' 2024-12-18T00:29:33.5525733Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2024-12-18T00:29:33.5526345Z ++ command -v nvidia-smi 2024-12-18T00:29:33.5526631Z + '[' -x '' ']' 2024-12-18T00:29:33.5526871Z + PJRT_DEVICE=CPU 2024-12-18T00:29:33.5527135Z + CPU_NUM_DEVICES=1 2024-12-18T00:29:33.5527610Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2024-12-18T00:29:33.5528174Z + '[' 0 '!=' 0 ']' 2024-12-18T00:29:33.5528619Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2024-12-18T00:29:56.3194194Z .......s 2024-12-18T00:29:56.3194655Z ---------------------------------------------------------------------- 2024-12-18T00:29:56.3195071Z Ran 8 tests in 19.688s 2024-12-18T00:29:56.3195249Z 2024-12-18T00:29:56.3195347Z OK (skipped=1) 2024-12-18T00:29:57.2580816Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2024-12-18T00:29:57.2581522Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py' 2024-12-18T00:29:57.2582440Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2024-12-18T00:29:57.2583141Z ++ command -v nvidia-smi 2024-12-18T00:29:57.2584775Z + '[' -x '' ']' 2024-12-18T00:29:57.2585125Z + PJRT_DEVICE=CPU 2024-12-18T00:29:57.2585386Z + CPU_NUM_DEVICES=1 2024-12-18T00:29:57.2586033Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2024-12-18T00:29:57.2586809Z + '[' 0 '!=' 0 ']' 2024-12-18T00:29:57.2587606Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2024-12-18T00:30:00.4374521Z 2024-12-18T00:30:00.4375185Z Running tests... 2024-12-18T00:30:00.4375617Z ---------------------------------------------------------------------- 2024-12-18T00:30:01.0547593Z .frames [('total', 1), ('ok', 1)] 2024-12-18T00:30:01.0548055Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2024-12-18T00:30:01.0548451Z aot_autograd [('total', 1), ('ok', 1)] 2024-12-18T00:30:01.1797464Z .frames [('total', 1), ('ok', 1)] 2024-12-18T00:30:01.1797894Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2024-12-18T00:30:01.1798296Z aot_autograd [('total', 1), ('ok', 1)] 2024-12-18T00:30:01.2980789Z ./opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/_dynamo/dynamo_bridge.py:833: UserWarning: Found tensor with shape torch.Size([3]) on cpu. Please move all tensors to xla device to execute on XLA device. 2024-12-18T00:30:01.2982221Z warnings.warn( 2024-12-18T00:30:01.3958639Z frames [('total', 1), ('ok', 1)] 2024-12-18T00:30:01.3959108Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2024-12-18T00:30:01.3959508Z aot_autograd [('total', 1), ('ok', 1)] 2024-12-18T00:30:01.7929798Z ..frames [('total', 1), ('ok', 1)] 2024-12-18T00:30:01.7930375Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2024-12-18T00:30:01.7930763Z aot_autograd [('total', 1), ('ok', 1)] 2024-12-18T00:30:02.6393349Z ...frames [('total', 1), ('ok', 1)] 2024-12-18T00:30:02.6394053Z inline_call [] 2024-12-18T00:30:02.6394470Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2024-12-18T00:30:02.6394853Z aot_autograd [('total', 1), ('ok', 1)] 2024-12-18T00:30:02.6656978Z ./opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/_dynamo/dynamo_bridge.py:833: UserWarning: Found tensor with shape torch.Size([3]) on cpu. Please move all tensors to xla device to execute on XLA device. 2024-12-18T00:30:02.6658249Z warnings.warn( 2024-12-18T00:30:02.6664077Z frames [('total', 1), ('ok', 1)] 2024-12-18T00:30:02.6664689Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2024-12-18T00:30:02.6665068Z aot_autograd [('total', 1), ('ok', 1)] 2024-12-18T00:30:03.0555891Z .expected_output: 2024-12-18T00:30:03.0556497Z [tensor([[-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0556961Z -0.0874, 0.0034], 2024-12-18T00:30:03.0557325Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0557712Z -0.0874, 0.0034], 2024-12-18T00:30:03.0558070Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0558465Z -0.0874, 0.0034], 2024-12-18T00:30:03.0558817Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0559213Z -0.0874, 0.0034], 2024-12-18T00:30:03.0559590Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0560151Z -0.0874, 0.0034]], device='xla:0'), tensor([0.2000, 0.2000, 0.2000, 0.2000, 0.2000], device='xla:0')] 2024-12-18T00:30:03.0560640Z actual_output: 2024-12-18T00:30:03.0560986Z [tensor([[-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0561408Z -0.0874, 0.0034], 2024-12-18T00:30:03.0561761Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0562142Z -0.0874, 0.0034], 2024-12-18T00:30:03.0562491Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0562884Z -0.0874, 0.0034], 2024-12-18T00:30:03.0563231Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0563623Z -0.0874, 0.0034], 2024-12-18T00:30:03.0564165Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2024-12-18T00:30:03.0564905Z -0.0874, 0.0034]], device='xla:0'), tensor([0.2000, 0.2000, 0.2000, 0.2000, 0.2000], device='xla:0')] 2024-12-18T00:30:03.0565408Z frames [('total', 3), ('ok', 3)] 2024-12-18T00:30:03.0565705Z inline_call [] 2024-12-18T00:30:03.0565950Z unimplemented [] 2024-12-18T00:30:03.0566224Z graph_break [('Tensor.backward', 1)] 2024-12-18T00:30:03.0566579Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2024-12-18T00:30:03.4832059Z .expected_output: 2024-12-18T00:30:03.4832668Z [tensor([[[[-0.2111, -0.1610, 0.0259], 2024-12-18T00:30:03.4833026Z [-0.2274, -0.0024, 0.1752], 2024-12-18T00:30:03.4833332Z [-0.1434, 0.1030, -0.1211]], 2024-12-18T00:30:03.4833553Z 2024-12-18T00:30:03.4833651Z [[-0.1547, 0.1979, 0.0639], 2024-12-18T00:30:03.4833956Z [ 0.0246, 0.1635, -0.1678], 2024-12-18T00:30:03.4834259Z [ 0.2300, -0.1006, 0.0044]], 2024-12-18T00:30:03.4834514Z 2024-12-18T00:30:03.4834633Z [[-0.0315, 0.0969, -0.1511], 2024-12-18T00:30:03.4834965Z [ 0.0229, -0.0664, -0.0201], 2024-12-18T00:30:03.4835272Z [ 0.1521, -0.1607, 0.0669]]], 2024-12-18T00:30:03.4835476Z 2024-12-18T00:30:03.4835480Z 2024-12-18T00:30:03.4835588Z [[[-0.1136, 0.1280, -0.1644], 2024-12-18T00:30:03.4835893Z [-0.0965, -0.1072, 0.0701], 2024-12-18T00:30:03.4836184Z [-0.2735, 0.0679, 0.0361]], 2024-12-18T00:30:03.4836397Z 2024-12-18T00:30:03.4836493Z [[ 0.1658, 0.1183, -0.0699], 2024-12-18T00:30:03.4836798Z [-0.1186, -0.0327, -0.0896], 2024-12-18T00:30:03.4837104Z [ 0.2017, -0.0935, 0.1166]], 2024-12-18T00:30:03.4837305Z 2024-12-18T00:30:03.4837416Z [[ 0.0482, -0.1383, -0.2425], 2024-12-18T00:30:03.4837709Z [ 0.1879, -0.1784, -0.0643], 2024-12-18T00:30:03.4838012Z [ 0.0667, -0.1372, 0.0676]]], 2024-12-18T00:30:03.4838229Z 2024-12-18T00:30:03.4838233Z 2024-12-18T00:30:03.4838332Z [[[ 0.2678, 0.1837, -0.3151], 2024-12-18T00:30:03.4838645Z [ 0.0841, -0.3076, -0.0264], 2024-12-18T00:30:03.4838970Z [ 0.0238, 0.1743, -0.1330]], 2024-12-18T00:30:03.4839173Z 2024-12-18T00:30:03.4839285Z [[-0.0466, -0.0402, 0.1108], 2024-12-18T00:30:03.4839591Z [ 0.0535, 0.0294, -0.1435], 2024-12-18T00:30:03.4839882Z [-0.0593, -0.0774, 0.0738]], 2024-12-18T00:30:03.4840099Z 2024-12-18T00:30:03.4840198Z [[ 0.0169, 0.0425, 0.1195], 2024-12-18T00:30:03.4840507Z [-0.1143, 0.0370, -0.0381], 2024-12-18T00:30:03.4840817Z [-0.0361, 0.0981, -0.3143]]], 2024-12-18T00:30:03.4841022Z 2024-12-18T00:30:03.4841026Z 2024-12-18T00:30:03.4841141Z [[[ 0.0914, -0.0925, -0.1136], 2024-12-18T00:30:03.4841451Z [-0.0827, 0.2555, -0.0965], 2024-12-18T00:30:03.4841745Z [ 0.0466, 0.0556, -0.2735]], 2024-12-18T00:30:03.4841965Z 2024-12-18T00:30:03.4842065Z [[ 0.0104, -0.0668, 0.1658], 2024-12-18T00:30:03.4842379Z [-0.0374, -0.1550, -0.1186], 2024-12-18T00:30:03.4842692Z [ 0.1135, 0.1915, 0.2017]], 2024-12-18T00:30:03.4842897Z 2024-12-18T00:30:03.4843010Z [[-0.0213, 0.0340, 0.0482], 2024-12-18T00:30:03.4843304Z [-0.1122, -0.0944, 0.1879], 2024-12-18T00:30:03.4843614Z [ 0.0985, -0.0576, 0.0667]]], 2024-12-18T00:30:03.4843833Z 2024-12-18T00:30:03.4843837Z 2024-12-18T00:30:03.4843937Z [[[-0.1847, -0.2655, 0.1420], 2024-12-18T00:30:03.4844480Z [-0.1014, 0.1627, 0.0593], 2024-12-18T00:30:03.4844794Z [ 0.1392, 0.1409, -0.1831]], 2024-12-18T00:30:03.4844999Z 2024-12-18T00:30:03.4845117Z [[-0.0814, 0.0718, 0.0106], 2024-12-18T00:30:03.4845411Z [-0.0516, 0.2063, -0.0575], 2024-12-18T00:30:03.4845715Z [ 0.0817, 0.0513, 0.1583]], 2024-12-18T00:30:03.4845930Z 2024-12-18T00:30:03.4846028Z [[-0.3198, -0.1175, -0.0086], 2024-12-18T00:30:03.4846329Z [-0.2251, -0.0053, -0.0658], 2024-12-18T00:30:03.4846860Z [-0.0227, -0.1734, 0.0872]]], 2024-12-18T00:30:03.4847114Z 2024-12-18T00:30:03.4847173Z 2024-12-18T00:30:03.4847288Z [[[ 0.0914, -0.0925, -0.1136], 2024-12-18T00:30:03.4847580Z [-0.0827, 0.2555, -0.0965], 2024-12-18T00:30:03.4847883Z [ 0.0466, 0.0556, -0.2735]], 2024-12-18T00:30:03.4848096Z 2024-12-18T00:30:03.4848191Z [[ 0.0104, -0.0668, 0.1658], 2024-12-18T00:30:03.4848490Z [-0.0374, -0.1550, -0.1186], 2024-12-18T00:30:03.4848792Z [ 0.1135, 0.1915, 0.2017]], 2024-12-18T00:30:03.4848992Z 2024-12-18T00:30:03.4849086Z [[-0.0213, 0.0340, 0.0482], 2024-12-18T00:30:03.4849385Z [-0.1122, -0.0944, 0.1879], 2024-12-18T00:30:03.4849909Z [ 0.0985, -0.0576, 0.0667]]]], device='xla:0'), tensor([0.1667, 0.1667, 0.1667, 0.1667, 0.1667, 0.1667], device='xla:0')] 2024-12-18T00:30:03.4850442Z actual_output: 2024-12-18T00:30:03.4850695Z [tensor([[[[-0.2111, -0.1610, 0.0259], 2024-12-18T00:30:03.4850999Z [-0.2274, -0.0024, 0.1752], 2024-12-18T00:30:03.4851310Z [-0.1434, 0.1030, -0.1211]], 2024-12-18T00:30:03.4851521Z 2024-12-18T00:30:03.4851617Z [[-0.1547, 0.1979, 0.0639], 2024-12-18T00:30:03.4851918Z [ 0.0246, 0.1635, -0.1678], 2024-12-18T00:30:03.4852220Z [ 0.2300, -0.1006, 0.0044]], 2024-12-18T00:30:03.4852421Z 2024-12-18T00:30:03.4852530Z [[-0.0315, 0.0969, -0.1511], 2024-12-18T00:30:03.4852820Z [ 0.0229, -0.0664, -0.0201], 2024-12-18T00:30:03.4853126Z [ 0.1521, -0.1607, 0.0669]]], 2024-12-18T00:30:03.4853341Z 2024-12-18T00:30:03.4853345Z 2024-12-18T00:30:03.4853442Z [[[-0.1136, 0.1280, -0.1644], 2024-12-18T00:30:03.4853745Z [-0.0965, -0.1072, 0.0701], 2024-12-18T00:30:03.4854046Z [-0.2735, 0.0679, 0.0361]], 2024-12-18T00:30:03.4854246Z 2024-12-18T00:30:03.4854344Z [[ 0.1658, 0.1183, -0.0699], 2024-12-18T00:30:03.4854651Z [-0.1186, -0.0327, -0.0896], 2024-12-18T00:30:03.4854958Z [ 0.2017, -0.0935, 0.1166]], 2024-12-18T00:30:03.4855175Z 2024-12-18T00:30:03.4855275Z [[ 0.0482, -0.1383, -0.2425], 2024-12-18T00:30:03.4855582Z [ 0.1879, -0.1784, -0.0643], 2024-12-18T00:30:03.4855887Z [ 0.0667, -0.1372, 0.0676]]], 2024-12-18T00:30:03.4856092Z 2024-12-18T00:30:03.4856096Z 2024-12-18T00:30:03.4856193Z [[[ 0.2678, 0.1837, -0.3151], 2024-12-18T00:30:03.4856587Z [ 0.0841, -0.3076, -0.0264], 2024-12-18T00:30:03.4856898Z [ 0.0238, 0.1743, -0.1330]], 2024-12-18T00:30:03.4857100Z 2024-12-18T00:30:03.4857213Z [[-0.0466, -0.0402, 0.1108], 2024-12-18T00:30:03.4857540Z [ 0.0535, 0.0294, -0.1435], 2024-12-18T00:30:03.4857833Z [-0.0593, -0.0774, 0.0738]], 2024-12-18T00:30:03.4858049Z 2024-12-18T00:30:03.4858145Z [[ 0.0169, 0.0425, 0.1195], 2024-12-18T00:30:03.4858452Z [-0.1143, 0.0370, -0.0381], 2024-12-18T00:30:03.4858755Z [-0.0361, 0.0981, -0.3143]]], 2024-12-18T00:30:03.4858966Z 2024-12-18T00:30:03.4858970Z 2024-12-18T00:30:03.4859082Z [[[ 0.0914, -0.0925, -0.1136], 2024-12-18T00:30:03.4859386Z [-0.0827, 0.2555, -0.0965], 2024-12-18T00:30:03.4859677Z [ 0.0466, 0.0556, -0.2735]], 2024-12-18T00:30:03.4859891Z 2024-12-18T00:30:03.4859988Z [[ 0.0104, -0.0668, 0.1658], 2024-12-18T00:30:03.4860293Z [-0.0374, -0.1550, -0.1186], 2024-12-18T00:30:03.4860596Z [ 0.1135, 0.1915, 0.2017]], 2024-12-18T00:30:03.4860796Z 2024-12-18T00:30:03.4860903Z [[-0.0213, 0.0340, 0.0482], 2024-12-18T00:30:03.4861190Z [-0.1122, -0.0944, 0.1879], 2024-12-18T00:30:03.4861490Z [ 0.0985, -0.0576, 0.0667]]], 2024-12-18T00:30:03.4861706Z 2024-12-18T00:30:03.4861710Z 2024-12-18T00:30:03.4861806Z [[[-0.1847, -0.2655, 0.1420], 2024-12-18T00:30:03.4862106Z [-0.1014, 0.1627, 0.0593], 2024-12-18T00:30:03.4862408Z [ 0.1392, 0.1409, -0.1831]], 2024-12-18T00:30:03.4862609Z 2024-12-18T00:30:03.4862831Z [[-0.0814, 0.0718, 0.0106], 2024-12-18T00:30:03.4863155Z [-0.0516, 0.2063, -0.0575], 2024-12-18T00:30:03.4863457Z [ 0.0817, 0.0513, 0.1583]], 2024-12-18T00:30:03.4863670Z 2024-12-18T00:30:03.4863767Z [[-0.3198, -0.1175, -0.0086], 2024-12-18T00:30:03.4864076Z [-0.2251, -0.0053, -0.0658], 2024-12-18T00:30:03.4864388Z [-0.0227, -0.1734, 0.0872]]], 2024-12-18T00:30:03.4864592Z 2024-12-18T00:30:03.4864596Z 2024-12-18T00:30:03.4864710Z [[[ 0.0914, -0.0925, -0.1136], 2024-12-18T00:30:03.4865004Z [-0.0827, 0.2555, -0.0965], 2024-12-18T00:30:03.4865309Z [ 0.0466, 0.0556, -0.2735]], 2024-12-18T00:30:03.4865522Z 2024-12-18T00:30:03.4865619Z [[ 0.0104, -0.0668, 0.1658], 2024-12-18T00:30:03.4865925Z [-0.0374, -0.1550, -0.1186], 2024-12-18T00:30:03.4866226Z [ 0.1135, 0.1915, 0.2017]], 2024-12-18T00:30:03.4866426Z 2024-12-18T00:30:03.4866522Z [[-0.0213, 0.0340, 0.0482], 2024-12-18T00:30:03.4866831Z [-0.1122, -0.0944, 0.1879], 2024-12-18T00:30:03.4867349Z [ 0.0985, -0.0576, 0.0667]]]], device='xla:0'), tensor([0.1667, 0.1667, 0.1667, 0.1667, 0.1667, 0.1667], device='xla:0')] 2024-12-18T00:30:03.4867887Z frames [('total', 3), ('ok', 3)] 2024-12-18T00:30:03.4868187Z inline_call [] 2024-12-18T00:30:03.4868419Z unimplemented [] 2024-12-18T00:30:03.4868695Z graph_break [('Tensor.backward', 1)] 2024-12-18T00:30:03.4869067Z stats [('calls_captured', 3), ('unique_graphs', 1)] 2024-12-18T00:30:03.7880161Z .expected_output: 2024-12-18T00:30:03.7880693Z [] 2024-12-18T00:30:03.7880954Z actual_output: 2024-12-18T00:30:03.7881179Z [] 2024-12-18T00:30:03.7881414Z frames [('total', 3), ('ok', 3)] 2024-12-18T00:30:03.7881725Z inline_call [] 2024-12-18T00:30:03.7881971Z unimplemented [] 2024-12-18T00:30:03.7882243Z graph_break [('Tensor.backward', 1)] 2024-12-18T00:30:03.7882602Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2024-12-18T00:30:03.7883000Z . 2024-12-18T00:30:03.7883305Z ---------------------------------------------------------------------- 2024-12-18T00:30:03.7883699Z Ran 13 tests in 3.351s 2024-12-18T00:30:03.7883867Z 2024-12-18T00:30:03.7883968Z OK 2024-12-18T00:30:03.7884079Z 2024-12-18T00:30:03.7884203Z Generating XML reports... 2024-12-18T00:30:04.5000056Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2024-12-18T00:30:04.5000828Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py' 2024-12-18T00:30:04.5001599Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2024-12-18T00:30:04.5002140Z ++ command -v nvidia-smi 2024-12-18T00:30:04.5002447Z + '[' -x '' ']' 2024-12-18T00:30:04.5002702Z + PJRT_DEVICE=CPU 2024-12-18T00:30:04.5002963Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:04.5003395Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2024-12-18T00:30:04.5003862Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:04.5004287Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2024-12-18T00:30:07.5705744Z ... 2024-12-18T00:30:07.5706130Z ---------------------------------------------------------------------- 2024-12-18T00:30:07.5706554Z Ran 3 tests in 0.095s 2024-12-18T00:30:07.5706734Z 2024-12-18T00:30:07.5706825Z OK 2024-12-18T00:30:08.1284116Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2024-12-18T00:30:08.1284945Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py' 2024-12-18T00:30:08.1286058Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2024-12-18T00:30:08.1286651Z ++ command -v nvidia-smi 2024-12-18T00:30:08.1286931Z + '[' -x '' ']' 2024-12-18T00:30:08.1287180Z + PJRT_DEVICE=CPU 2024-12-18T00:30:08.1287435Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:08.1287894Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2024-12-18T00:30:08.1288656Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:08.1289190Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2024-12-18T00:30:11.1437938Z . 2024-12-18T00:30:11.1438358Z ---------------------------------------------------------------------- 2024-12-18T00:30:11.1438762Z Ran 1 test in 0.011s 2024-12-18T00:30:11.1438945Z 2024-12-18T00:30:11.1439032Z OK 2024-12-18T00:30:11.6918945Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2024-12-18T00:30:11.6919729Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py' 2024-12-18T00:30:11.6920721Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2024-12-18T00:30:11.6921373Z ++ command -v nvidia-smi 2024-12-18T00:30:11.6921644Z + '[' -x '' ']' 2024-12-18T00:30:11.6921893Z + PJRT_DEVICE=CPU 2024-12-18T00:30:11.6922146Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:11.6922578Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2024-12-18T00:30:11.6923113Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:11.6923515Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2024-12-18T00:30:14.8900643Z . 2024-12-18T00:30:14.8901076Z ---------------------------------------------------------------------- 2024-12-18T00:30:14.8901516Z Ran 1 test in 0.215s 2024-12-18T00:30:14.8901687Z 2024-12-18T00:30:14.8901796Z OK 2024-12-18T00:30:14.8902001Z False 2024-12-18T00:30:15.4620036Z + run_save_tensor_ir run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:15.4620669Z + local run_test_func=run_test 2024-12-18T00:30:15.4620964Z + shift 2024-12-18T00:30:15.4621491Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py' 2024-12-18T00:30:15.4622348Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:15.4623203Z + run_save_tensor run_test text /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:15.4623811Z + local run_test_func=run_test 2024-12-18T00:30:15.4624118Z + local file_graph_format=text 2024-12-18T00:30:15.4624407Z + shift 2 2024-12-18T00:30:15.4624912Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py' 2024-12-18T00:30:15.4625775Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:15.4626378Z + local base_file=/tmp/xla_test_save_ir.txt 2024-12-18T00:30:15.4626727Z + ls '/tmp/xla_test_save_ir.txt*' 2024-12-18T00:30:15.4658833Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2024-12-18T00:30:15.4659239Z + XLA_SAVE_TENSORS_FMT=text 2024-12-18T00:30:15.4659696Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:15.4660462Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py' 2024-12-18T00:30:15.4661326Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:15.4662027Z ++ command -v nvidia-smi 2024-12-18T00:30:15.4664153Z + '[' -x '' ']' 2024-12-18T00:30:15.4664478Z + PJRT_DEVICE=CPU 2024-12-18T00:30:15.4664735Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:15.4665188Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:15.4665704Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:15.4666131Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2024-12-18T00:30:18.6572565Z . 2024-12-18T00:30:18.6572974Z ---------------------------------------------------------------------- 2024-12-18T00:30:18.6573407Z Ran 1 test in 0.115s 2024-12-18T00:30:18.6573572Z 2024-12-18T00:30:18.6573675Z OK 2024-12-18T00:30:19.2609248Z + local test_status=0 2024-12-18T00:30:19.2609594Z + local actual_file 2024-12-18T00:30:19.2612951Z ++ head -n1 2024-12-18T00:30:19.2613211Z ++ ls /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:19.2635645Z + actual_file=/tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:19.2636202Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2024-12-18T00:30:19.2636631Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2024-12-18T00:30:19.2637132Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:19.2637535Z + rm /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:19.2645591Z + return 0 2024-12-18T00:30:19.2645952Z + run_test /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:19.2646548Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2024-12-18T00:30:19.2647214Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:19.2647946Z ++ command -v nvidia-smi 2024-12-18T00:30:19.2650123Z + '[' -x '' ']' 2024-12-18T00:30:19.2650376Z + PJRT_DEVICE=CPU 2024-12-18T00:30:19.2650624Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:19.2650991Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:19.2651437Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:19.2651796Z + python3 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:22.3127679Z ... 2024-12-18T00:30:22.3128088Z ---------------------------------------------------------------------- 2024-12-18T00:30:22.3128516Z Ran 3 tests in 0.066s 2024-12-18T00:30:22.3128683Z 2024-12-18T00:30:22.3128793Z OK 2024-12-18T00:30:22.8719461Z + run_use_bf16 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:22.8720262Z + echo 'Running with XLA_USE_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2024-12-18T00:30:22.8720951Z Running with XLA_USE_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:22.8721431Z + XLA_USE_BF16=1 2024-12-18T00:30:22.8721778Z + run_test /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:22.8722392Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2024-12-18T00:30:22.8723251Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:22.8723771Z ++ command -v nvidia-smi 2024-12-18T00:30:22.8724063Z + '[' -x '' ']' 2024-12-18T00:30:22.8724296Z + PJRT_DEVICE=CPU 2024-12-18T00:30:22.8724547Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:22.8724926Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:22.8725358Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:22.8725710Z + python3 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:25.8943050Z ... 2024-12-18T00:30:25.8943430Z ---------------------------------------------------------------------- 2024-12-18T00:30:25.8943835Z Ran 3 tests in 0.050s 2024-12-18T00:30:25.8944015Z 2024-12-18T00:30:25.8944105Z OK 2024-12-18T00:30:26.4461752Z XLA_USE_BF16 will be deprecated after the 2.6 release, please convert your model to bf16 directly 2024-12-18T00:30:26.4462499Z + run_downcast_bf16 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:26.4463214Z + echo 'Running with XLA_DOWNCAST_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2024-12-18T00:30:26.4463952Z Running with XLA_DOWNCAST_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:26.4464448Z + XLA_DOWNCAST_BF16=1 2024-12-18T00:30:26.4464818Z + run_test /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:26.4465419Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2024-12-18T00:30:26.4466079Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:26.4466579Z ++ command -v nvidia-smi 2024-12-18T00:30:26.4466854Z + '[' -x '' ']' 2024-12-18T00:30:26.4467085Z + PJRT_DEVICE=CPU 2024-12-18T00:30:26.4467336Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:26.4467716Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:26.4468152Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:26.4468502Z + python3 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2024-12-18T00:30:29.4976735Z ... 2024-12-18T00:30:29.4977443Z ---------------------------------------------------------------------- 2024-12-18T00:30:29.4977960Z Ran 3 tests in 0.050s 2024-12-18T00:30:29.4978145Z 2024-12-18T00:30:29.4978236Z OK 2024-12-18T00:30:29.4978685Z XLA_DOWNCAST_BF16 will be deprecated after the 2.6 release, please downcast your model directly 2024-12-18T00:30:30.0597284Z + run_test /var/lib/jenkins/workspace/xla/test/test_fp8.py 2024-12-18T00:30:30.0597971Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_fp8.py' 2024-12-18T00:30:30.0598598Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_fp8.py 2024-12-18T00:30:30.0599068Z ++ command -v nvidia-smi 2024-12-18T00:30:30.0600262Z + '[' -x '' ']' 2024-12-18T00:30:30.0600576Z + PJRT_DEVICE=CPU 2024-12-18T00:30:30.0600838Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:30.0601256Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_fp8.py 2024-12-18T00:30:30.0601666Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:30.0602035Z + python3 /var/lib/jenkins/workspace/xla/test/test_fp8.py 2024-12-18T00:30:33.1847072Z ...... 2024-12-18T00:30:33.1847484Z ---------------------------------------------------------------------- 2024-12-18T00:30:33.1847911Z Ran 6 tests in 0.118s 2024-12-18T00:30:33.1848093Z 2024-12-18T00:30:33.1848182Z OK 2024-12-18T00:30:33.7535192Z + run_xla_ir_debug /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:33.7535964Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2024-12-18T00:30:33.7536891Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:33.7537404Z + XLA_IR_DEBUG=1 2024-12-18T00:30:33.7537798Z + run_test /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:33.7538450Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2024-12-18T00:30:33.7539160Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:33.7539675Z ++ command -v nvidia-smi 2024-12-18T00:30:33.7539975Z + '[' -x '' ']' 2024-12-18T00:30:33.7540230Z + PJRT_DEVICE=CPU 2024-12-18T00:30:33.7540483Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:33.7540886Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:33.7541328Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:33.7541704Z + python3 /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:36.7428708Z . 2024-12-18T00:30:36.7429121Z ---------------------------------------------------------------------- 2024-12-18T00:30:36.7429562Z Ran 1 test in 0.009s 2024-12-18T00:30:36.7429726Z 2024-12-18T00:30:36.7429826Z OK 2024-12-18T00:30:37.2838331Z + run_xla_hlo_debug /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:37.2839127Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2024-12-18T00:30:37.2839863Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:37.2840416Z + XLA_HLO_DEBUG=1 2024-12-18T00:30:37.2840817Z + run_test /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:37.2841474Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2024-12-18T00:30:37.2842186Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:37.2842696Z ++ command -v nvidia-smi 2024-12-18T00:30:37.2842982Z + '[' -x '' ']' 2024-12-18T00:30:37.2843227Z + PJRT_DEVICE=CPU 2024-12-18T00:30:37.2843466Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:37.2843867Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:37.2844550Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:37.2844935Z + python3 /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2024-12-18T00:30:40.2785855Z . 2024-12-18T00:30:40.2786265Z ---------------------------------------------------------------------- 2024-12-18T00:30:40.2786665Z Ran 1 test in 0.009s 2024-12-18T00:30:40.2786840Z 2024-12-18T00:30:40.2787225Z OK 2024-12-18T00:30:40.8289125Z + run_xla_hlo_debug /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2024-12-18T00:30:40.8290149Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py' 2024-12-18T00:30:40.8291027Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2024-12-18T00:30:40.8291611Z + XLA_HLO_DEBUG=1 2024-12-18T00:30:40.8292048Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2024-12-18T00:30:40.8292851Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py' 2024-12-18T00:30:40.8293713Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2024-12-18T00:30:40.8294306Z ++ command -v nvidia-smi 2024-12-18T00:30:40.8294588Z + '[' -x '' ']' 2024-12-18T00:30:40.8294831Z + PJRT_DEVICE=CPU 2024-12-18T00:30:40.8295075Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:40.8295570Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2024-12-18T00:30:40.8296106Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:40.8296693Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2024-12-18T00:30:45.3708952Z ......... 2024-12-18T00:30:45.3709481Z ---------------------------------------------------------------------- 2024-12-18T00:30:45.3710128Z Ran 9 tests in 1.481s 2024-12-18T00:30:45.3710404Z 2024-12-18T00:30:45.3710542Z OK 2024-12-18T00:30:45.9796077Z + run_save_tensor_ir run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:45.9796686Z + local run_test_func=run_test 2024-12-18T00:30:45.9796984Z + shift 2024-12-18T00:30:45.9797474Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2024-12-18T00:30:45.9798310Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:45.9799145Z + run_save_tensor run_test text /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:45.9799710Z + local run_test_func=run_test 2024-12-18T00:30:45.9800016Z + local file_graph_format=text 2024-12-18T00:30:45.9800303Z + shift 2 2024-12-18T00:30:45.9800786Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2024-12-18T00:30:45.9801616Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:45.9802201Z + local base_file=/tmp/xla_test_save_ir.txt 2024-12-18T00:30:45.9802553Z + ls '/tmp/xla_test_save_ir.txt*' 2024-12-18T00:30:45.9815808Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2024-12-18T00:30:45.9817028Z + XLA_SAVE_TENSORS_FMT=text 2024-12-18T00:30:45.9818300Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:45.9820413Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2024-12-18T00:30:45.9821214Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:45.9821762Z ++ command -v nvidia-smi 2024-12-18T00:30:45.9822985Z + '[' -x '' ']' 2024-12-18T00:30:45.9823237Z + PJRT_DEVICE=CPU 2024-12-18T00:30:45.9823478Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:45.9823917Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:45.9824411Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:45.9824822Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.0433068Z . 2024-12-18T00:30:49.0433500Z ---------------------------------------------------------------------- 2024-12-18T00:30:49.0433926Z Ran 1 test in 0.064s 2024-12-18T00:30:49.0434094Z 2024-12-18T00:30:49.0434189Z OK 2024-12-18T00:30:49.6087971Z + local test_status=0 2024-12-18T00:30:49.6088337Z + local actual_file 2024-12-18T00:30:49.6090543Z ++ ls /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:49.6091227Z ++ head -n1 2024-12-18T00:30:49.6106381Z + actual_file=/tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:49.6106771Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2024-12-18T00:30:49.6107217Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2024-12-18T00:30:49.6107720Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:49.6108118Z + rm /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:49.6116610Z + return 0 2024-12-18T00:30:49.6117244Z + run_save_tensor_hlo run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.6117835Z + local run_test_func=run_test 2024-12-18T00:30:49.6118323Z + shift 2024-12-18T00:30:49.6119005Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2024-12-18T00:30:49.6119833Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.6120623Z + run_save_tensor run_test hlo /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.6121188Z + local run_test_func=run_test 2024-12-18T00:30:49.6121480Z + local file_graph_format=hlo 2024-12-18T00:30:49.6121769Z + shift 2 2024-12-18T00:30:49.6122265Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2024-12-18T00:30:49.6123093Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.6123684Z + local base_file=/tmp/xla_test_save_ir.txt 2024-12-18T00:30:49.6124023Z + ls '/tmp/xla_test_save_ir.txt*' 2024-12-18T00:30:49.6134060Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2024-12-18T00:30:49.6134727Z + XLA_SAVE_TENSORS_FMT=hlo 2024-12-18T00:30:49.6135168Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.6135889Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2024-12-18T00:30:49.6136755Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.6137849Z ++ command -v nvidia-smi 2024-12-18T00:30:49.6140332Z + '[' -x '' ']' 2024-12-18T00:30:49.6140583Z + PJRT_DEVICE=CPU 2024-12-18T00:30:49.6140843Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:49.6141279Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:49.6141774Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:49.6142166Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2024-12-18T00:30:52.6469225Z . 2024-12-18T00:30:52.6469604Z ---------------------------------------------------------------------- 2024-12-18T00:30:52.6470013Z Ran 1 test in 0.058s 2024-12-18T00:30:52.6470189Z 2024-12-18T00:30:52.6470275Z OK 2024-12-18T00:30:53.2009593Z + local test_status=0 2024-12-18T00:30:53.2009962Z + local actual_file 2024-12-18T00:30:53.2012186Z ++ head -n1 2024-12-18T00:30:53.2012445Z ++ ls /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:53.2031437Z + actual_file=/tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:53.2031885Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2024-12-18T00:30:53.2032331Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2024-12-18T00:30:53.2032825Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:53.2033227Z + rm /tmp/xla_test_save_ir.txt.0 2024-12-18T00:30:53.2042298Z + return 0 2024-12-18T00:30:53.2042530Z + run_xla_op_tests2 2024-12-18T00:30:53.2042914Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2024-12-18T00:30:53.2043542Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py' 2024-12-18T00:30:53.2044986Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2024-12-18T00:30:53.2045489Z ++ command -v nvidia-smi 2024-12-18T00:30:53.2047063Z + '[' -x '' ']' 2024-12-18T00:30:53.2047302Z + PJRT_DEVICE=CPU 2024-12-18T00:30:53.2047559Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:53.2047951Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2024-12-18T00:30:53.2048682Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:53.2049107Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2024-12-18T00:30:56.2946471Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:30:56.2971322Z [ RUN ] TestDtypes.test_bool_round_trip 2024-12-18T00:30:56.2971879Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2024-12-18T00:30:56.2972517Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2024-12-18T00:30:56.2973444Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2024-12-18T00:30:56.2974197Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2024-12-18T00:30:56.2974873Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2024-12-18T00:30:56.3137840Z [ OK ] TestDtypes.test_bool_round_trip 2024-12-18T00:30:56.3138373Z [ RUN ] TestDtypes.test_float_round_trip0 (torch.float16) 2024-12-18T00:30:56.3138879Z [ OK ] TestDtypes.test_float_round_trip0 (torch.float16) 2024-12-18T00:30:56.3139364Z [ RUN ] TestDtypes.test_float_round_trip1 (torch.float32) 2024-12-18T00:30:56.3139825Z [ OK ] TestDtypes.test_float_round_trip1 (torch.float32) 2024-12-18T00:30:56.3140272Z [ RUN ] TestDtypes.test_float_round_trip2 (torch.float64) 2024-12-18T00:30:56.3140823Z [ OK ] TestDtypes.test_float_round_trip2 (torch.float64) 2024-12-18T00:30:56.3141292Z [ RUN ] TestDtypes.test_float_round_trip3 (torch.bfloat16) 2024-12-18T00:30:56.3144928Z [ OK ] TestDtypes.test_float_round_trip3 (torch.bfloat16) 2024-12-18T00:30:56.3145412Z [ RUN ] TestDtypes.test_float_round_trip4 (torch.complex64) 2024-12-18T00:30:56.3149895Z [ OK ] TestDtypes.test_float_round_trip4 (torch.complex64) 2024-12-18T00:30:56.3150358Z [ RUN ] TestDtypes.test_int_round_trip0 (torch.uint8) 2024-12-18T00:30:56.3153480Z [ OK ] TestDtypes.test_int_round_trip0 (torch.uint8) 2024-12-18T00:30:56.3153922Z [ RUN ] TestDtypes.test_int_round_trip1 (torch.int8) 2024-12-18T00:30:56.3156933Z [ OK ] TestDtypes.test_int_round_trip1 (torch.int8) 2024-12-18T00:30:56.3157365Z [ RUN ] TestDtypes.test_int_round_trip2 (torch.int16) 2024-12-18T00:30:56.3160062Z [ OK ] TestDtypes.test_int_round_trip2 (torch.int16) 2024-12-18T00:30:56.3160498Z [ RUN ] TestDtypes.test_int_round_trip3 (torch.int32) 2024-12-18T00:30:56.3163156Z [ OK ] TestDtypes.test_int_round_trip3 (torch.int32) 2024-12-18T00:30:56.3163591Z [ RUN ] TestDtypes.test_int_round_trip4 (torch.int64) 2024-12-18T00:30:56.3166261Z [ OK ] TestDtypes.test_int_round_trip4 (torch.int64) 2024-12-18T00:30:56.3166695Z ---------------------------------------------------------------------- 2024-12-18T00:30:56.3167100Z Ran 11 tests in 0.020s 2024-12-18T00:30:56.3167264Z 2024-12-18T00:30:56.3167370Z OK 2024-12-18T00:30:56.8807005Z + run_test /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2024-12-18T00:30:56.8807743Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_while_loop.py' 2024-12-18T00:30:56.8808436Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2024-12-18T00:30:56.8809053Z ++ command -v nvidia-smi 2024-12-18T00:30:56.8809349Z + '[' -x '' ']' 2024-12-18T00:30:56.8809595Z + PJRT_DEVICE=CPU 2024-12-18T00:30:56.8809849Z + CPU_NUM_DEVICES=1 2024-12-18T00:30:56.8810237Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2024-12-18T00:30:56.8810667Z + '[' 0 '!=' 0 ']' 2024-12-18T00:30:56.8811030Z + python3 /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2024-12-18T00:31:01.6808618Z s... 2024-12-18T00:31:01.6809061Z ---------------------------------------------------------------------- 2024-12-18T00:31:01.6809481Z Ran 4 tests in 1.806s 2024-12-18T00:31:01.6809649Z 2024-12-18T00:31:01.6809759Z OK (skipped=1) 2024-12-18T00:31:02.2620072Z + run_test /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2024-12-18T00:31:02.2621331Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan.py' 2024-12-18T00:31:02.2622284Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2024-12-18T00:31:02.2622787Z ++ command -v nvidia-smi 2024-12-18T00:31:02.2623166Z + '[' -x '' ']' 2024-12-18T00:31:02.2623577Z + PJRT_DEVICE=CPU 2024-12-18T00:31:02.2624003Z + CPU_NUM_DEVICES=1 2024-12-18T00:31:02.2624386Z + run_coverage /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2024-12-18T00:31:02.2624827Z + '[' 0 '!=' 0 ']' 2024-12-18T00:31:02.2625181Z + python3 /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2024-12-18T00:31:09.7796397Z ............... 2024-12-18T00:31:09.7796819Z ---------------------------------------------------------------------- 2024-12-18T00:31:09.7797245Z Ran 15 tests in 4.517s 2024-12-18T00:31:09.7797420Z 2024-12-18T00:31:09.7797528Z OK 2024-12-18T00:31:10.3839510Z + run_test /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2024-12-18T00:31:10.3840257Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py' 2024-12-18T00:31:10.3841006Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2024-12-18T00:31:10.3841559Z ++ command -v nvidia-smi 2024-12-18T00:31:10.3841847Z + '[' -x '' ']' 2024-12-18T00:31:10.3842106Z + PJRT_DEVICE=CPU 2024-12-18T00:31:10.3842366Z + CPU_NUM_DEVICES=1 2024-12-18T00:31:10.3842770Z + run_coverage /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2024-12-18T00:31:10.3843234Z + '[' 0 '!=' 0 ']' 2024-12-18T00:31:10.3843610Z + python3 /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2024-12-18T00:31:13.3828973Z s 2024-12-18T00:31:13.3829379Z ---------------------------------------------------------------------- 2024-12-18T00:31:13.3829818Z Ran 1 test in 0.000s 2024-12-18T00:31:13.3830007Z 2024-12-18T00:31:13.3830112Z OK (skipped=1) 2024-12-18T00:31:13.9330320Z + run_test /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2024-12-18T00:31:13.9331096Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py' 2024-12-18T00:31:13.9331885Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2024-12-18T00:31:13.9332432Z ++ command -v nvidia-smi 2024-12-18T00:31:13.9332730Z + '[' -x '' ']' 2024-12-18T00:31:13.9332988Z + PJRT_DEVICE=CPU 2024-12-18T00:31:13.9333252Z + CPU_NUM_DEVICES=1 2024-12-18T00:31:13.9333683Z + run_coverage /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2024-12-18T00:31:13.9334149Z + '[' 0 '!=' 0 ']' 2024-12-18T00:31:13.9334536Z + python3 /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2024-12-18T00:32:33.4876568Z ...... 2024-12-18T00:32:33.4876995Z ---------------------------------------------------------------------- 2024-12-18T00:32:33.4877505Z Ran 6 tests in 76.565s 2024-12-18T00:32:33.4877679Z 2024-12-18T00:32:33.4877783Z OK 2024-12-18T00:32:34.1016199Z + run_test /var/lib/jenkins/workspace/xla/test/test_autocast.py 2024-12-18T00:32:34.1017092Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_autocast.py' 2024-12-18T00:32:34.1017789Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_autocast.py 2024-12-18T00:32:34.1018276Z ++ command -v nvidia-smi 2024-12-18T00:32:34.1018750Z + '[' -x '' ']' 2024-12-18T00:32:34.1019010Z + PJRT_DEVICE=CPU 2024-12-18T00:32:34.1019270Z + CPU_NUM_DEVICES=1 2024-12-18T00:32:34.1019646Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_autocast.py 2024-12-18T00:32:34.1020126Z + '[' 0 '!=' 0 ']' 2024-12-18T00:32:34.1020523Z + python3 /var/lib/jenkins/workspace/xla/test/test_autocast.py 2024-12-18T00:32:37.2858674Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:99: UserWarning: `devkind` argument is deprecated and will be removed in a future release. 2024-12-18T00:32:37.2859918Z warnings.warn("`devkind` argument is deprecated and will be removed in a " 2024-12-18T00:32:37.2951147Z test_autocast_banned (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2952082Z test_autocast_linalg_fp16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2952856Z test_autocast_methods_expect_builtin_promote (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2953633Z test_autocast_methods_fp16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2954333Z test_autocast_methods_fp32 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2955005Z test_autocast_nn_fp16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2955651Z test_autocast_nn_fp32 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2956315Z test_autocast_torch_bf16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2957056Z test_autocast_torch_expect_builtin_promote (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2957833Z test_autocast_torch_fp32 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2958585Z test_autocast_torch_need_autocast_promote (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2024-12-18T00:32:37.2959339Z test_autocast_methods_bf16 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2960098Z test_autocast_methods_expect_builtin_promote (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2960858Z test_autocast_methods_fp32 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2961514Z test_autocast_nn_fp32 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2962224Z test_autocast_torch_expect_builtin_promote (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2962965Z test_autocast_torch_fp32 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2963701Z test_autocast_torch_need_autocast_promote (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2964458Z test_autocast_tpu_check_dtype (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2024-12-18T00:32:37.2964867Z 2024-12-18T00:32:37.2965042Z ---------------------------------------------------------------------- 2024-12-18T00:32:37.2965434Z Ran 19 tests in 0.000s 2024-12-18T00:32:37.2965597Z 2024-12-18T00:32:37.2965695Z OK (skipped=19) 2024-12-18T00:32:37.9045989Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2024-12-18T00:32:37.9046664Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager.py' 2024-12-18T00:32:37.9047357Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2024-12-18T00:32:37.9047853Z ++ command -v nvidia-smi 2024-12-18T00:32:37.9048491Z + '[' -x '' ']' 2024-12-18T00:32:37.9048768Z + PJRT_DEVICE=CPU 2024-12-18T00:32:37.9049032Z + CPU_NUM_DEVICES=1 2024-12-18T00:32:37.9049460Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2024-12-18T00:32:37.9049931Z + '[' 0 '!=' 0 ']' 2024-12-18T00:32:37.9050305Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2024-12-18T00:32:41.8887218Z ....... 2024-12-18T00:32:41.8887641Z ---------------------------------------------------------------------- 2024-12-18T00:32:41.8888125Z Ran 7 tests in 1.013s 2024-12-18T00:32:41.8888300Z 2024-12-18T00:32:41.8888409Z OK 2024-12-18T00:32:42.4575746Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2024-12-18T00:32:42.4576794Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py' 2024-12-18T00:32:42.4577678Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2024-12-18T00:32:42.4578279Z ++ command -v nvidia-smi 2024-12-18T00:32:42.4578556Z + '[' -x '' ']' 2024-12-18T00:32:42.4578788Z + PJRT_DEVICE=CPU 2024-12-18T00:32:42.4579041Z + CPU_NUM_DEVICES=1 2024-12-18T00:32:42.4579720Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2024-12-18T00:32:42.4580447Z + '[' 0 '!=' 0 ']' 2024-12-18T00:32:42.4580906Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2024-12-18T00:32:46.5863435Z .. 2024-12-18T00:32:46.5863961Z Unexpected Execution Analysis: ================================================================================ 2024-12-18T00:32:46.5864559Z Unexpected Execution Analysis: Compilation Cause 2024-12-18T00:32:46.5865199Z Unexpected Execution Analysis: most likely user code trying to access tensor value before mark_step 2024-12-18T00:32:46.5865831Z Unexpected Execution Analysis: Graph Info: 2024-12-18T00:32:46.5866291Z Unexpected Execution Analysis: Graph Name: dummy_graph_break 2024-12-18T00:32:46.5866878Z Unexpected Execution Analysis: Graph Hash: 37218855eb22a65b74da9f370aebe976 2024-12-18T00:32:46.5867448Z Unexpected Execution Analysis: Number of Graph Inputs: 1 2024-12-18T00:32:46.5867967Z Unexpected Execution Analysis: Number of Graph Outputs: 1 2024-12-18T00:32:46.5868527Z Unexpected Execution Analysis: Python Frame Triggered Execution: 2024-12-18T00:32:46.5869372Z Unexpected Execution Analysis: dummy_graph_break (/var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py:24) 2024-12-18T00:32:46.5870267Z Unexpected Execution Analysis: inner (/opt/conda/lib/python3.10/contextlib.py:79) 2024-12-18T00:32:46.5871232Z Unexpected Execution Analysis: test_eager_with_compile_graph_break (/var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py:78) 2024-12-18T00:32:46.5872256Z Unexpected Execution Analysis: _callTestMethod (/opt/conda/lib/python3.10/unittest/case.py:549) 2024-12-18T00:32:46.5872997Z Unexpected Execution Analysis: run (/opt/conda/lib/python3.10/unittest/case.py:591) 2024-12-18T00:32:46.5873702Z Unexpected Execution Analysis: __call__ (/opt/conda/lib/python3.10/unittest/case.py:650) 2024-12-18T00:32:46.5874413Z Unexpected Execution Analysis: run (/opt/conda/lib/python3.10/unittest/suite.py:122) 2024-12-18T00:32:46.5875132Z Unexpected Execution Analysis: __call__ (/opt/conda/lib/python3.10/unittest/suite.py:84) 2024-12-18T00:32:46.5875689Z Unexpected Execution Analysis: .......... 2024-12-18T00:32:46.5876261Z Unexpected Execution Analysis: -------------------------------------------------------------------------------- 2024-12-18T00:32:46.5876951Z Unexpected Execution Analysis: ================================================================================ 2024-12-18T00:32:46.5879475Z . 2024-12-18T00:32:46.5879764Z ---------------------------------------------------------------------- 2024-12-18T00:32:46.5880147Z Ran 3 tests in 1.144s 2024-12-18T00:32:46.5880310Z 2024-12-18T00:32:46.5880408Z OK 2024-12-18T00:32:47.1424988Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2024-12-18T00:32:47.1425898Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py' 2024-12-18T00:32:47.1426838Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2024-12-18T00:32:47.1427467Z ++ command -v nvidia-smi 2024-12-18T00:32:47.1429900Z + '[' -x '' ']' 2024-12-18T00:32:47.1430161Z + PJRT_DEVICE=CPU 2024-12-18T00:32:47.1430402Z + CPU_NUM_DEVICES=1 2024-12-18T00:32:47.1430879Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2024-12-18T00:32:47.1431421Z + '[' 0 '!=' 0 ']' 2024-12-18T00:32:47.1431873Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2024-12-18T00:32:51.0374507Z . 2024-12-18T00:32:51.0374911Z ---------------------------------------------------------------------- 2024-12-18T00:32:51.0375342Z Ran 1 test in 0.903s 2024-12-18T00:32:51.0375507Z 2024-12-18T00:32:51.0375606Z OK 2024-12-18T00:32:51.6116694Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2024-12-18T00:32:51.6117801Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py' 2024-12-18T00:32:51.6118992Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2024-12-18T00:32:51.6119610Z ++ command -v nvidia-smi 2024-12-18T00:32:51.6119886Z + '[' -x '' ']' 2024-12-18T00:32:51.6120133Z + PJRT_DEVICE=CPU 2024-12-18T00:32:51.6120386Z + CPU_NUM_DEVICES=1 2024-12-18T00:32:51.6120858Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2024-12-18T00:32:51.6121407Z + '[' 0 '!=' 0 ']' 2024-12-18T00:32:51.6121859Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2024-12-18T00:32:58.6693606Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2024-12-18T00:32:58.6694372Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py' 2024-12-18T00:32:58.6695132Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2024-12-18T00:32:58.6695736Z ++ command -v nvidia-smi 2024-12-18T00:32:58.6696035Z + '[' -x '' ']' 2024-12-18T00:32:58.6696294Z + PJRT_DEVICE=CPU 2024-12-18T00:32:58.6696746Z + CPU_NUM_DEVICES=1 2024-12-18T00:32:58.6697149Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2024-12-18T00:32:58.6697621Z + '[' 0 '!=' 0 ']' 2024-12-18T00:32:58.6698011Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2024-12-18T00:33:02.1578372Z .. 2024-12-18T00:33:02.1578748Z ---------------------------------------------------------------------- 2024-12-18T00:33:02.1579166Z Ran 2 tests in 0.494s 2024-12-18T00:33:02.1579347Z 2024-12-18T00:33:02.1579439Z OK 2024-12-18T00:33:02.7223236Z + run_test /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:02.7223932Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py' 2024-12-18T00:33:02.7224622Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:02.7225653Z ++ command -v nvidia-smi 2024-12-18T00:33:02.7228244Z + '[' -x '' ']' 2024-12-18T00:33:02.7228505Z + PJRT_DEVICE=CPU 2024-12-18T00:33:02.7228750Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:02.7229123Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:02.7229550Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:02.7229897Z + python3 /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:05.7124642Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:33:05.7139269Z [ RUN ] TestExperimentalCallback.test_callback 2024-12-18T00:33:05.7140441Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2024-12-18T00:33:05.7141079Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2024-12-18T00:33:05.7141703Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2024-12-18T00:33:05.7142316Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2024-12-18T00:33:05.7142946Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2024-12-18T00:33:05.9075793Z [ OK ] TestExperimentalCallback.test_callback 2024-12-18T00:33:05.9076330Z [ RUN ] TestExperimentalCallback.test_callback_event 2024-12-18T00:33:05.9094724Z [ OK ] TestExperimentalCallback.test_callback_event 2024-12-18T00:33:05.9095218Z ---------------------------------------------------------------------- 2024-12-18T00:33:05.9095623Z Ran 2 tests in 0.195s 2024-12-18T00:33:05.9095788Z 2024-12-18T00:33:05.9095879Z OK 2024-12-18T00:33:06.4680337Z + XLA_USE_SPMD=1 2024-12-18T00:33:06.4680804Z + run_test /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:06.4681440Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py' 2024-12-18T00:33:06.4682113Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:06.4682636Z ++ command -v nvidia-smi 2024-12-18T00:33:06.4682932Z + '[' -x '' ']' 2024-12-18T00:33:06.4683563Z + PJRT_DEVICE=CPU 2024-12-18T00:33:06.4683822Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:06.4684241Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:06.4684675Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:06.4685024Z + python3 /var/lib/jenkins/workspace/xla/test/test_callback.py 2024-12-18T00:33:09.4506992Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:33:09.4530302Z [ RUN ] TestExperimentalCallback.test_callback 2024-12-18T00:33:09.4531401Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2024-12-18T00:33:09.4532067Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2024-12-18T00:33:09.4532708Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2024-12-18T00:33:09.4533348Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2024-12-18T00:33:09.4533978Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2024-12-18T00:33:09.6450056Z [ OK ] TestExperimentalCallback.test_callback 2024-12-18T00:33:09.6450553Z [ RUN ] TestExperimentalCallback.test_callback_event 2024-12-18T00:33:09.6472251Z [ OK ] TestExperimentalCallback.test_callback_event 2024-12-18T00:33:09.6472757Z ---------------------------------------------------------------------- 2024-12-18T00:33:09.6473148Z Ran 2 tests in 0.195s 2024-12-18T00:33:09.6473326Z 2024-12-18T00:33:09.6473418Z OK 2024-12-18T00:33:10.2059753Z + run_xla_op_tests3 2024-12-18T00:33:10.2060254Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2024-12-18T00:33:10.2060971Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py' 2024-12-18T00:33:10.2061726Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2024-12-18T00:33:10.2062586Z ++ command -v nvidia-smi 2024-12-18T00:33:10.2065326Z + '[' -x '' ']' 2024-12-18T00:33:10.2065585Z + PJRT_DEVICE=CPU 2024-12-18T00:33:10.2065841Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:10.2066314Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2024-12-18T00:33:10.2066795Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:10.2067179Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2024-12-18T00:33:13.3352578Z /opt/conda/lib/python3.10/site-packages/torch/export/_unlift.py:75: UserWarning: Attempted to insert a get_attr Node with no underlying reference in the owning GraphModule! Call GraphModule.add_submodule to add the necessary submodule, GraphModule.add_parameter to add the necessary Parameter, or nn.Module.register_buffer to add the necessary buffer 2024-12-18T00:33:13.3354283Z getattr_node = gm.graph.get_attr(lifted_node) 2024-12-18T00:33:13.3374058Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1801: UserWarning: Node lifted_tensor_0 target lifted_tensor_0 lifted_tensor_0 of does not reference an nn.Module, nn.Parameter, or buffer, which is what 'get_attr' Nodes typically target 2024-12-18T00:33:13.3375302Z warnings.warn( 2024-12-18T00:33:14.5789689Z ..... 2024-12-18T00:33:14.5790278Z ---------------------------------------------------------------------- 2024-12-18T00:33:14.5790944Z Ran 5 tests in 1.386s 2024-12-18T00:33:14.5791223Z 2024-12-18T00:33:14.5791361Z OK 2024-12-18T00:33:15.1960202Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2024-12-18T00:33:15.1961037Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py' 2024-12-18T00:33:15.1961885Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2024-12-18T00:33:15.1962459Z ++ command -v nvidia-smi 2024-12-18T00:33:15.1963620Z + '[' -x '' ']' 2024-12-18T00:33:15.1963881Z + PJRT_DEVICE=CPU 2024-12-18T00:33:15.1964136Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:15.1964607Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2024-12-18T00:33:15.1965118Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:15.1965844Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2024-12-18T00:33:19.1837944Z ............ 2024-12-18T00:33:19.1838525Z ---------------------------------------------------------------------- 2024-12-18T00:33:19.1839207Z Ran 12 tests in 0.993s 2024-12-18T00:33:19.1839491Z 2024-12-18T00:33:19.1839630Z OK 2024-12-18T00:33:19.1839982Z ExportedProgram: 2024-12-18T00:33:19.1840428Z class GraphModule(torch.nn.Module): 2024-12-18T00:33:19.1841112Z def forward(self, args_0: "f32[20, 768]", args_1: "i64[s0, 10]"): 2024-12-18T00:33:19.1842859Z # File: /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/stablehlo_test_utils.py:27 in forward, code: return f(*args) 2024-12-18T00:33:19.1845061Z embedding: "f32[s0, 10, 768]" = torch.ops.aten.embedding.default(args_0, args_1); args_0 = args_1 = None 2024-12-18T00:33:19.1846030Z return (embedding,) 2024-12-18T00:33:19.1846494Z 2024-12-18T00:33:19.1849328Z Graph signature: ExportGraphSignature(input_specs=[InputSpec(kind=, arg=TensorArgument(name='args_0'), target=None, persistent=None), InputSpec(kind=, arg=TensorArgument(name='args_1'), target=None, persistent=None)], output_specs=[OutputSpec(kind=, arg=TensorArgument(name='embedding'), target=None)]) 2024-12-18T00:33:19.1852285Z Range constraints: {s0: VR[0, int_oo]} 2024-12-18T00:33:19.1852656Z 2024-12-18T00:33:19.1852816Z ExportedProgram: 2024-12-18T00:33:19.1853260Z class GraphModule(torch.nn.Module): 2024-12-18T00:33:19.1853959Z def forward(self, args_0: "f32[20, 768]", args_1: "i64[s0, 10]"): 2024-12-18T00:33:19.1854711Z # No stacktrace found for following nodes 2024-12-18T00:33:19.1855470Z sym_size_int_1: "Sym(s0)" = torch.ops.aten.sym_size.int(args_1, 0) 2024-12-18T00:33:19.1856207Z mul: "Sym(10*s0)" = sym_size_int_1 * 10 2024-12-18T00:33:19.1857118Z reshape: "i64[10*s0]" = torch.ops.aten.reshape(args_1, [mul]); args_1 = mul = None 2024-12-18T00:33:19.1857897Z 2024-12-18T00:33:19.1859304Z # File: /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/utils/stablehlo_test_utils.py:27 in forward, code: return f(*args) 2024-12-18T00:33:19.1861311Z embedding: "f32[s0, 10, 768]" = torch.ops.aten.embedding.default(args_0, reshape); args_0 = reshape = None 2024-12-18T00:33:19.1862268Z 2024-12-18T00:33:19.1862699Z # No stacktrace found for following nodes 2024-12-18T00:33:19.1863793Z reshape_1: "f32[s0, 10, 768]" = torch.ops.aten.reshape(embedding, [sym_size_int_1, 10, 768]); embedding = sym_size_int_1 = None 2024-12-18T00:33:19.1864841Z return (reshape_1,) 2024-12-18T00:33:19.1865308Z 2024-12-18T00:33:19.1868088Z Graph signature: ExportGraphSignature(input_specs=[InputSpec(kind=, arg=TensorArgument(name='args_0'), target=None, persistent=None), InputSpec(kind=, arg=TensorArgument(name='args_1'), target=None, persistent=None)], output_specs=[OutputSpec(kind=, arg=TensorArgument(name='embedding'), target=None)]) 2024-12-18T00:33:19.1871046Z Range constraints: {s0: VR[0, int_oo]} 2024-12-18T00:33:19.1871417Z 2024-12-18T00:33:19.7847176Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2024-12-18T00:33:19.7848071Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py' 2024-12-18T00:33:19.7848974Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2024-12-18T00:33:19.7849569Z ++ command -v nvidia-smi 2024-12-18T00:33:19.7849863Z + '[' -x '' ']' 2024-12-18T00:33:19.7850111Z + PJRT_DEVICE=CPU 2024-12-18T00:33:19.7850364Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:19.7851066Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2024-12-18T00:33:19.7851830Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:19.7852296Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2024-12-18T00:33:22.8028285Z ........... 2024-12-18T00:33:22.8028668Z ---------------------------------------------------------------------- 2024-12-18T00:33:22.8029098Z Ran 11 tests in 0.028s 2024-12-18T00:33:22.8029288Z 2024-12-18T00:33:22.8029393Z OK 2024-12-18T00:33:23.3486635Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2024-12-18T00:33:23.3487439Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py' 2024-12-18T00:33:23.3488229Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2024-12-18T00:33:23.3488805Z ++ command -v nvidia-smi 2024-12-18T00:33:23.3489096Z + '[' -x '' ']' 2024-12-18T00:33:23.3489351Z + PJRT_DEVICE=CPU 2024-12-18T00:33:23.3489616Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:23.3490107Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2024-12-18T00:33:23.3490610Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:23.3491017Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2024-12-18T00:33:26.3594162Z ERROR:root:This module is need tensorflow with xla support. 2024-12-18T00:33:26.3594748Z Please install tensorflow with `pip install tf-nightly`. 2024-12-18T00:33:26.3595057Z 2024-12-18T00:33:29.9142834Z .........s.s. 2024-12-18T00:33:29.9143225Z ---------------------------------------------------------------------- 2024-12-18T00:33:29.9143637Z Ran 13 tests in 3.554s 2024-12-18T00:33:29.9143804Z 2024-12-18T00:33:29.9143916Z OK (skipped=2) 2024-12-18T00:33:29.9144416Z tf is not installed. The tf.saved_model tests will be skipped. 2024-12-18T00:33:30.5405614Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2024-12-18T00:33:30.5406392Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py' 2024-12-18T00:33:30.5407183Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2024-12-18T00:33:30.5407737Z ++ command -v nvidia-smi 2024-12-18T00:33:30.5408017Z + '[' -x '' ']' 2024-12-18T00:33:30.5408271Z + PJRT_DEVICE=CPU 2024-12-18T00:33:30.5408515Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:30.5408940Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2024-12-18T00:33:30.5409424Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:30.5409826Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2024-12-18T00:33:33.6395665Z ERROR:root:This module is need tensorflow with xla support. 2024-12-18T00:33:33.6396236Z Please install tensorflow with `pip install tf-nightly`. 2024-12-18T00:33:33.6396548Z 2024-12-18T00:33:33.7985822Z ..W1218 00:33:33.797000 53625 site-packages/torch/_export/__init__.py:67] +============================+ 2024-12-18T00:33:33.7986670Z W1218 00:33:33.798000 53625 site-packages/torch/_export/__init__.py:68] | !!! WARNING !!! | 2024-12-18T00:33:33.7987468Z W1218 00:33:33.798000 53625 site-packages/torch/_export/__init__.py:69] +============================+ 2024-12-18T00:33:33.7988477Z W1218 00:33:33.798000 53625 site-packages/torch/_export/__init__.py:70] capture_pre_autograd_graph() is deprecated and doesn't provide any function guarantee moving forward. 2024-12-18T00:33:33.7989636Z W1218 00:33:33.798000 53625 site-packages/torch/_export/__init__.py:71] Please switch to use torch.export.export_for_training instead. 2024-12-18T00:33:34.3489029Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training) on an already erased node 2024-12-18T00:33:34.3490688Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3502088Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_1) on an already erased node 2024-12-18T00:33:34.3504016Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3516512Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_2) on an already erased node 2024-12-18T00:33:34.3518107Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3530630Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_3) on an already erased node 2024-12-18T00:33:34.3532219Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3544884Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_4) on an already erased node 2024-12-18T00:33:34.3546485Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3558670Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_5) on an already erased node 2024-12-18T00:33:34.3560275Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3572834Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_6) on an already erased node 2024-12-18T00:33:34.3574419Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3585969Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_7) on an already erased node 2024-12-18T00:33:34.3587562Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3599759Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_8) on an already erased node 2024-12-18T00:33:34.3601346Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3614043Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_9) on an already erased node 2024-12-18T00:33:34.3615633Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3627441Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_10) on an already erased node 2024-12-18T00:33:34.3629071Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3641434Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_11) on an already erased node 2024-12-18T00:33:34.3643041Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3654348Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_12) on an already erased node 2024-12-18T00:33:34.3655992Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3668585Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_13) on an already erased node 2024-12-18T00:33:34.3670197Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3683386Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_14) on an already erased node 2024-12-18T00:33:34.3685100Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3698102Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_15) on an already erased node 2024-12-18T00:33:34.3699799Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3715026Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_16) on an already erased node 2024-12-18T00:33:34.3716753Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3725853Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_17) on an already erased node 2024-12-18T00:33:34.3727559Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3742352Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_18) on an already erased node 2024-12-18T00:33:34.3744328Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.3759237Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_19) on an already erased node 2024-12-18T00:33:34.3760868Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:34.4182705Z /opt/conda/lib/python3.10/site-packages/torch/ao/quantization/observer.py:1318: UserWarning: must run observer before calling calculate_qparams. Returning default scale and zero point 2024-12-18T00:33:34.4184514Z warnings.warn( 2024-12-18T00:33:34.4195730Z /opt/conda/lib/python3.10/site-packages/torch/ao/quantization/utils.py:408: UserWarning: must run observer before calling calculate_qparams. Returning default values. 2024-12-18T00:33:34.4197279Z warnings.warn( 2024-12-18T00:33:36.5170136Z ./opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training) on an already erased node 2024-12-18T00:33:36.5171816Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5183620Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_1) on an already erased node 2024-12-18T00:33:36.5185265Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5198343Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_2) on an already erased node 2024-12-18T00:33:36.5199977Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5212178Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_3) on an already erased node 2024-12-18T00:33:36.5213771Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5226047Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_4) on an already erased node 2024-12-18T00:33:36.5227895Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5239884Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_5) on an already erased node 2024-12-18T00:33:36.5241752Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5253737Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_6) on an already erased node 2024-12-18T00:33:36.5255329Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5267073Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_7) on an already erased node 2024-12-18T00:33:36.5268885Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5280209Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_8) on an already erased node 2024-12-18T00:33:36.5282274Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5293128Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_9) on an already erased node 2024-12-18T00:33:36.5295082Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5306041Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_10) on an already erased node 2024-12-18T00:33:36.5307920Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5319714Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_11) on an already erased node 2024-12-18T00:33:36.5321560Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5331848Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_12) on an already erased node 2024-12-18T00:33:36.5333706Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5344101Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_13) on an already erased node 2024-12-18T00:33:36.5346120Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5356422Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_14) on an already erased node 2024-12-18T00:33:36.5358286Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5368314Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_15) on an already erased node 2024-12-18T00:33:36.5370060Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5385004Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_16) on an already erased node 2024-12-18T00:33:36.5386624Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5395636Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_17) on an already erased node 2024-12-18T00:33:36.5397378Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5411551Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_18) on an already erased node 2024-12-18T00:33:36.5413237Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:36.5427249Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1199: UserWarning: erase_node(_native_batch_norm_legit_no_training_19) on an already erased node 2024-12-18T00:33:36.5428837Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2024-12-18T00:33:38.5330889Z . 2024-12-18T00:33:38.5331467Z ---------------------------------------------------------------------- 2024-12-18T00:33:38.5332121Z Ran 4 tests in 4.893s 2024-12-18T00:33:38.5332401Z 2024-12-18T00:33:38.5332545Z OK 2024-12-18T00:33:38.5333040Z tf is not installed. The tf.saved_model tests will be skipped. 2024-12-18T00:33:39.2253620Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2024-12-18T00:33:39.2254537Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py' 2024-12-18T00:33:39.2255444Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2024-12-18T00:33:39.2256073Z ++ command -v nvidia-smi 2024-12-18T00:33:39.2258763Z + '[' -x '' ']' 2024-12-18T00:33:39.2259017Z + PJRT_DEVICE=CPU 2024-12-18T00:33:39.2259270Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:39.2259937Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2024-12-18T00:33:39.2261384Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:39.2261861Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2024-12-18T00:33:42.9730540Z ...... 2024-12-18T00:33:42.9730951Z ---------------------------------------------------------------------- 2024-12-18T00:33:42.9731392Z Ran 6 tests in 0.748s 2024-12-18T00:33:42.9731588Z 2024-12-18T00:33:42.9731686Z OK 2024-12-18T00:33:43.5401731Z + run_xla_hlo_debug /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2024-12-18T00:33:43.5402671Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py' 2024-12-18T00:33:43.5403568Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2024-12-18T00:33:43.5404170Z + XLA_HLO_DEBUG=1 2024-12-18T00:33:43.5404647Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2024-12-18T00:33:43.5405527Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py' 2024-12-18T00:33:43.5406417Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2024-12-18T00:33:43.5407033Z ++ command -v nvidia-smi 2024-12-18T00:33:43.5407299Z + '[' -x '' ']' 2024-12-18T00:33:43.5407550Z + PJRT_DEVICE=CPU 2024-12-18T00:33:43.5407810Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:43.5408286Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2024-12-18T00:33:43.5408822Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:43.5409258Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2024-12-18T00:33:49.2344835Z .... 2024-12-18T00:33:49.2345420Z ---------------------------------------------------------------------- 2024-12-18T00:33:49.2346073Z Ran 4 tests in 2.605s 2024-12-18T00:33:49.2346346Z 2024-12-18T00:33:49.2346478Z OK 2024-12-18T00:33:49.9020653Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2024-12-18T00:33:49.9021581Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py' 2024-12-18T00:33:49.9022448Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2024-12-18T00:33:49.9023058Z ++ command -v nvidia-smi 2024-12-18T00:33:49.9024558Z + '[' -x '' ']' 2024-12-18T00:33:49.9024817Z + PJRT_DEVICE=CPU 2024-12-18T00:33:49.9025072Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:49.9025549Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2024-12-18T00:33:49.9026083Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:49.9026510Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2024-12-18T00:33:53.8344344Z . 2024-12-18T00:33:53.8344778Z ---------------------------------------------------------------------- 2024-12-18T00:33:53.8345208Z Ran 1 test in 0.776s 2024-12-18T00:33:53.8345395Z 2024-12-18T00:33:53.8345516Z OK 2024-12-18T00:33:54.4537417Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2024-12-18T00:33:54.4538336Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py' 2024-12-18T00:33:54.4539204Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2024-12-18T00:33:54.4539808Z ++ command -v nvidia-smi 2024-12-18T00:33:54.4540096Z + '[' -x '' ']' 2024-12-18T00:33:54.4540344Z + PJRT_DEVICE=CPU 2024-12-18T00:33:54.4540601Z + CPU_NUM_DEVICES=1 2024-12-18T00:33:54.4541060Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2024-12-18T00:33:54.4541591Z + '[' 0 '!=' 0 ']' 2024-12-18T00:33:54.4542038Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2024-12-18T00:33:57.4418094Z ERROR:root:This module is need tensorflow with xla support. 2024-12-18T00:33:57.4418849Z Please install tensorflow with `pip install tf-nightly`. 2024-12-18T00:33:57.4419292Z 2024-12-18T00:34:06.5585604Z .................s..s................... 2024-12-18T00:34:06.5586322Z ---------------------------------------------------------------------- 2024-12-18T00:34:06.5586972Z Ran 40 tests in 9.107s 2024-12-18T00:34:06.5587238Z 2024-12-18T00:34:06.5587391Z OK (skipped=2) 2024-12-18T00:34:06.5587938Z tf is not installed. The tf.saved_model tests will be skipped. 2024-12-18T00:34:07.1997770Z + run_test /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2024-12-18T00:34:07.1998682Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py' 2024-12-18T00:34:07.1999579Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2024-12-18T00:34:07.2000198Z ++ command -v nvidia-smi 2024-12-18T00:34:07.2000493Z + '[' -x '' ']' 2024-12-18T00:34:07.2000760Z + PJRT_DEVICE=CPU 2024-12-18T00:34:07.2001005Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:07.2001540Z + run_coverage /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2024-12-18T00:34:07.2002083Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:07.2002543Z + python3 /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2024-12-18T00:34:10.8761614Z ............. 2024-12-18T00:34:10.8762122Z ---------------------------------------------------------------------- 2024-12-18T00:34:10.8762651Z Ran 13 tests in 0.635s 2024-12-18T00:34:10.8762819Z 2024-12-18T00:34:10.8762923Z OK 2024-12-18T00:34:11.4619706Z + run_test /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2024-12-18T00:34:11.4620521Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py' 2024-12-18T00:34:11.4621353Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2024-12-18T00:34:11.4621931Z ++ command -v nvidia-smi 2024-12-18T00:34:11.4623246Z + '[' -x '' ']' 2024-12-18T00:34:11.4623708Z + PJRT_DEVICE=CPU 2024-12-18T00:34:11.4623967Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:11.4624434Z + run_coverage /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2024-12-18T00:34:11.4624956Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:11.4625376Z + python3 /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2024-12-18T00:34:14.6777001Z .... 2024-12-18T00:34:14.6777579Z ---------------------------------------------------------------------- 2024-12-18T00:34:14.6778255Z Ran 4 tests in 0.211s 2024-12-18T00:34:14.6778521Z 2024-12-18T00:34:14.6778675Z OK 2024-12-18T00:34:15.2446763Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2024-12-18T00:34:15.2447541Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py' 2024-12-18T00:34:15.2448309Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2024-12-18T00:34:15.2448856Z ++ command -v nvidia-smi 2024-12-18T00:34:15.2449170Z + '[' -x '' ']' 2024-12-18T00:34:15.2449437Z + PJRT_DEVICE=CPU 2024-12-18T00:34:15.2449691Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:15.2450121Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2024-12-18T00:34:15.2450609Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:15.2451004Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2024-12-18T00:34:19.6584484Z .s....sss..........s.................ss......s......s....ss.ss..s..... 2024-12-18T00:34:19.6585019Z ---------------------------------------------------------------------- 2024-12-18T00:34:19.6585414Z Ran 70 tests in 1.424s 2024-12-18T00:34:19.6585593Z 2024-12-18T00:34:19.6585694Z OK (skipped=14) 2024-12-18T00:34:20.2251404Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2024-12-18T00:34:20.2252247Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py' 2024-12-18T00:34:20.2253244Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2024-12-18T00:34:20.2253941Z ++ command -v nvidia-smi 2024-12-18T00:34:20.2255955Z + '[' -x '' ']' 2024-12-18T00:34:20.2256202Z + PJRT_DEVICE=CPU 2024-12-18T00:34:20.2256550Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:20.2256995Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2024-12-18T00:34:20.2257497Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:20.2257908Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2024-12-18T00:34:23.2636512Z . 2024-12-18T00:34:23.2636946Z ---------------------------------------------------------------------- 2024-12-18T00:34:23.2637389Z Ran 1 test in 0.048s 2024-12-18T00:34:23.2637577Z 2024-12-18T00:34:23.2637671Z OK 2024-12-18T00:34:23.8210985Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2024-12-18T00:34:23.8211844Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py' 2024-12-18T00:34:23.8212695Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2024-12-18T00:34:23.8213314Z ++ command -v nvidia-smi 2024-12-18T00:34:23.8215042Z + '[' -x '' ']' 2024-12-18T00:34:23.8215284Z + PJRT_DEVICE=CPU 2024-12-18T00:34:23.8215541Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:23.8215993Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2024-12-18T00:34:23.8216631Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:23.8217061Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2024-12-18T00:34:27.0064488Z ............ 2024-12-18T00:34:27.0064899Z ---------------------------------------------------------------------- 2024-12-18T00:34:27.0065313Z Ran 12 tests in 0.214s 2024-12-18T00:34:27.0065478Z 2024-12-18T00:34:27.0065580Z OK 2024-12-18T00:34:27.5580601Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2024-12-18T00:34:27.5581361Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py' 2024-12-18T00:34:27.5582166Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2024-12-18T00:34:27.5582713Z ++ command -v nvidia-smi 2024-12-18T00:34:27.5583840Z + '[' -x '' ']' 2024-12-18T00:34:27.5584095Z + PJRT_DEVICE=CPU 2024-12-18T00:34:27.5584334Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:27.5584748Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2024-12-18T00:34:27.5585226Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:27.5585612Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2024-12-18T00:34:31.4846158Z .s....s. 2024-12-18T00:34:31.4846579Z ---------------------------------------------------------------------- 2024-12-18T00:34:31.4846997Z Ran 8 tests in 0.919s 2024-12-18T00:34:31.4847181Z 2024-12-18T00:34:31.4847284Z OK (skipped=2) 2024-12-18T00:34:32.0671863Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2024-12-18T00:34:32.0672668Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py' 2024-12-18T00:34:32.0673510Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2024-12-18T00:34:32.0674079Z ++ command -v nvidia-smi 2024-12-18T00:34:32.0675796Z + '[' -x '' ']' 2024-12-18T00:34:32.0676053Z + PJRT_DEVICE=CPU 2024-12-18T00:34:32.0676306Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:32.0676729Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2024-12-18T00:34:32.0677222Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:32.0677627Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2024-12-18T00:34:35.0670671Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2024-12-18T00:34:35.0671964Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2024-12-18T00:34:35.1054797Z ┌───────┬───────┬───────┬────────┬───────┬───────┬────────┬────────┐ 2024-12-18T00:34:35.1055720Z │ │ │ │ │ │ │ │ │ 2024-12-18T00:34:35.1056251Z │ CPU 0 │ CPU 4 │ CPU 8 │ CPU 12 │ CPU 2 │ CPU 6 │ CPU 10 │ CPU 14 │ 2024-12-18T00:34:35.1056823Z │ │ │ │ │ │ │ │ │ 2024-12-18T00:34:35.1057321Z ├───────┼───────┼───────┼────────┼───────┼───────┼────────┼────────┤ 2024-12-18T00:34:35.1057777Z │ │ │ │ │ │ │ │ │ 2024-12-18T00:34:35.1058260Z │ CPU 1 │ CPU 5 │ CPU 9 │ CPU 13 │ CPU 3 │ CPU 7 │ CPU 11 │ CPU 15 │ 2024-12-18T00:34:35.1058739Z │ │ │ │ │ │ │ │ │ 2024-12-18T00:34:35.1059231Z └───────┴───────┴───────┴────────┴───────┴───────┴────────┴────────┘ 2024-12-18T00:34:35.1148669Z .s┌─────────┐ 2024-12-18T00:34:35.1148976Z │ │ 2024-12-18T00:34:35.1149238Z │ CPU [0] │ 2024-12-18T00:34:35.1149491Z │ │ 2024-12-18T00:34:35.1149748Z └─────────┘ 2024-12-18T00:34:35.1185424Z .s┌──────────────┐ 2024-12-18T00:34:35.1185758Z │ │ 2024-12-18T00:34:35.1186053Z │ CPU [0, 1] │ 2024-12-18T00:34:35.1186329Z │ │ 2024-12-18T00:34:35.1186607Z ├──────────────┤ 2024-12-18T00:34:35.1186855Z │ │ 2024-12-18T00:34:35.1187116Z │ CPU [4, 5] │ 2024-12-18T00:34:35.1187376Z │ │ 2024-12-18T00:34:35.1187648Z ├──────────────┤ 2024-12-18T00:34:35.1187909Z │ │ 2024-12-18T00:34:35.1188160Z │ CPU [8, 9] │ 2024-12-18T00:34:35.1188419Z │ │ 2024-12-18T00:34:35.1188691Z ├──────────────┤ 2024-12-18T00:34:35.1188949Z │ │ 2024-12-18T00:34:35.1189200Z │ CPU [12, 13] │ 2024-12-18T00:34:35.1189464Z │ │ 2024-12-18T00:34:35.1189737Z ├──────────────┤ 2024-12-18T00:34:35.1190000Z │ │ 2024-12-18T00:34:35.1190270Z │ CPU [2, 3] │ 2024-12-18T00:34:35.1190522Z │ │ 2024-12-18T00:34:35.1190793Z ├──────────────┤ 2024-12-18T00:34:35.1191052Z │ │ 2024-12-18T00:34:35.1191318Z │ CPU [6, 7] │ 2024-12-18T00:34:35.1191611Z │ │ 2024-12-18T00:34:35.1191875Z ├──────────────┤ 2024-12-18T00:34:35.1192134Z │ │ 2024-12-18T00:34:35.1192399Z │ CPU [10, 11] │ 2024-12-18T00:34:35.1192660Z │ │ 2024-12-18T00:34:35.1192917Z ├──────────────┤ 2024-12-18T00:34:35.1193177Z │ │ 2024-12-18T00:34:35.1193442Z │ CPU [14, 15] │ 2024-12-18T00:34:35.1193712Z │ │ 2024-12-18T00:34:35.1193981Z └──────────────┘ 2024-12-18T00:34:35.1241021Z .s┌─────────┐ 2024-12-18T00:34:35.1241856Z │ │ 2024-12-18T00:34:35.1242207Z │ CPU [0] │ 2024-12-18T00:34:35.1242471Z │ │ 2024-12-18T00:34:35.1242742Z └─────────┘ 2024-12-18T00:34:35.1264535Z .s┌─────────┐ 2024-12-18T00:34:35.1264815Z │ │ 2024-12-18T00:34:35.1265053Z │ CPU [0] │ 2024-12-18T00:34:35.1265297Z │ │ 2024-12-18T00:34:35.1265550Z └─────────┘ 2024-12-18T00:34:35.1290382Z .s┌─────────┐ 2024-12-18T00:34:35.1290661Z │ │ 2024-12-18T00:34:35.1290917Z │ CPU [0] │ 2024-12-18T00:34:35.1291407Z │ │ 2024-12-18T00:34:35.1291651Z └─────────┘ 2024-12-18T00:34:35.1297522Z .s 2024-12-18T00:34:35.1297817Z ---------------------------------------------------------------------- 2024-12-18T00:34:35.1298212Z Ran 12 tests in 0.063s 2024-12-18T00:34:35.1298375Z 2024-12-18T00:34:35.1298487Z OK (skipped=6) 2024-12-18T00:34:35.6899691Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2024-12-18T00:34:35.6900607Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py' 2024-12-18T00:34:35.6901502Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2024-12-18T00:34:35.6902128Z ++ command -v nvidia-smi 2024-12-18T00:34:35.6902815Z + '[' -x '' ']' 2024-12-18T00:34:35.6903072Z + PJRT_DEVICE=CPU 2024-12-18T00:34:35.6903327Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:35.6903808Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2024-12-18T00:34:35.6904408Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:35.6904882Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2024-12-18T00:34:38.7288370Z sE1218 00:34:38.728086701 57348 server_chttp2.cc:40] {"created":"@1734482078.728071272","description":"Only 1 addresses added out of total 2 resolved","file":"external/com_github_grpc_grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc","file_line":404,"referenced_errors":[{"created":"@1734482078.728069076","description":"Address family not supported by protocol","errno":97,"file":"external/com_github_grpc_grpc/src/core/lib/iomgr/socket_utils_common_posix.cc","file_line":420,"os_error":"Address family not supported by protocol","syscall":"socket","target_address":"[::1]:8547"}]} 2024-12-18T00:34:38.7326791Z WARNING: All log messages before absl::InitializeLog() is called are written to STDERR 2024-12-18T00:34:38.7327731Z I0000 00:00:1734482078.731470 57348 coordination_service_agent.cc:367] Coordination agent has successfully connected. 2024-12-18T00:34:38.7329080Z I0000 00:00:1734482078.731526 57348 coordination_service_agent.cc:440] Polling for error from coordination service. This is a long-running RPC that will return only if an error is encountered or cancelled (e.g. due to shutdown). 2024-12-18T00:34:38.7403581Z /opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/state_dict_saver.py:290: UserWarning: The function definition for SavePlanner.set_up_planner has been updated to include the storage_meta argument. Please update your implementation to include this parameter. 2024-12-18T00:34:38.7404976Z warnings.warn( 2024-12-18T00:34:38.7450975Z /opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/filesystem.py:116: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2024-12-18T00:34:38.7452753Z if tensor.storage().size() != tensor.numel(): 2024-12-18T00:34:40.6340301Z .....s2024-12-18 00:34:40.633193: W external/xla/xla/tsl/distributed_runtime/preemption/preemption_notifier.cc:89] SIGTERM caught at 2024-12-18T00:34:40.633075347+00:00 2024-12-18T00:34:40.6341684Z I0000 00:00:1734482080.633754 57600 preemption_sync_manager.cc:202] Received preemption notice with death_time 2024-12-18T00:34:40.633075347+00:00 2024-12-18T00:34:40.6343034Z I0000 00:00:1734482080.633877 57719 preemption_sync_manager.cc:162] Notified coordination service that this task will be preempted at 2024-12-18T00:34:40.633075347+00:00. absl::Status: OK 2024-12-18T00:34:40.6344414Z I0000 00:00:1734482080.634235 57720 preemption_sync_manager.cc:295] Preemption sync counter is set: 11 2024-12-18T00:34:40.6468117Z ./opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/runtime.py:242: UserWarning: Replicating tensors already initialized on non-virtual XLA device for SPMD to force SPMD mode. This is one-time overhead to setup, and to minimize such, please set SPMD mode before initializting tensors (i.e., call use_spmd() in the beginning of the program). 2024-12-18T00:34:40.6470150Z warnings.warn( 2024-12-18T00:34:40.6502480Z .sss/opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/state_dict_saver.py:143: UserWarning: torch.distributed is unavailable or uninitialized, assuming the intent is to save in a single process. 2024-12-18T00:34:40.6503640Z warnings.warn( 2024-12-18T00:34:40.6542208Z /opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/state_dict_loader.py:144: UserWarning: torch.distributed is unavailable or uninitialized, assuming the intent is to load in a single process. 2024-12-18T00:34:40.6543354Z warnings.warn( 2024-12-18T00:34:40.7612042Z .s.ss.s.s.s.. 2024-12-18T00:34:40.7612446Z ---------------------------------------------------------------------- 2024-12-18T00:34:40.7612916Z Ran 25 tests in 2.041s 2024-12-18T00:34:40.7613108Z 2024-12-18T00:34:40.7613241Z OK (skipped=11) 2024-12-18T00:34:41.2489674Z I0000 00:00:1734482081.247954 57348 coordination_service_agent.cc:617] Coordination agent has initiated Shutdown(). 2024-12-18T00:34:41.2491012Z I0000 00:00:1734482081.248943 57348 coordination_service_agent.cc:638] Coordination agent has successfully shut down. 2024-12-18T00:34:41.2492074Z I0000 00:00:1734482081.249021 57600 coordination_service_agent.cc:447] Cancelling error polling because the service or the agent is shutting down. 2024-12-18T00:34:41.3697809Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2024-12-18T00:34:41.3698769Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py' 2024-12-18T00:34:41.3699711Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2024-12-18T00:34:41.3700370Z ++ command -v nvidia-smi 2024-12-18T00:34:41.3700701Z + '[' -x '' ']' 2024-12-18T00:34:41.3700961Z + PJRT_DEVICE=CPU 2024-12-18T00:34:41.3701221Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:41.3701722Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2024-12-18T00:34:41.3702291Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:41.3702771Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2024-12-18T00:34:44.3517261Z s.........../opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/runtime.py:242: UserWarning: Replicating tensors already initialized on non-virtual XLA device for SPMD to force SPMD mode. This is one-time overhead to setup, and to minimize such, please set SPMD mode before initializting tensors (i.e., call use_spmd() in the beginning of the program). 2024-12-18T00:34:44.3519102Z warnings.warn( 2024-12-18T00:34:44.3994844Z ..../opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:99: UserWarning: `devkind` argument is deprecated and will be removed in a future release. 2024-12-18T00:34:44.3996128Z warnings.warn("`devkind` argument is deprecated and will be removed in a " 2024-12-18T00:34:44.3997781Z ....... 2024-12-18T00:34:44.3998090Z ---------------------------------------------------------------------- 2024-12-18T00:34:44.3998491Z Ran 23 tests in 0.060s 2024-12-18T00:34:44.3998658Z 2024-12-18T00:34:44.3998757Z OK (skipped=1) 2024-12-18T00:34:44.9539541Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2024-12-18T00:34:44.9540927Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py' 2024-12-18T00:34:44.9541807Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2024-12-18T00:34:44.9542401Z ++ command -v nvidia-smi 2024-12-18T00:34:44.9542681Z + '[' -x '' ']' 2024-12-18T00:34:44.9542930Z + PJRT_DEVICE=CPU 2024-12-18T00:34:44.9543494Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:44.9544005Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2024-12-18T00:34:44.9544753Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:44.9545186Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2024-12-18T00:34:47.9457238Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2024-12-18T00:34:47.9458480Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2024-12-18T00:34:48.2779087Z ... 2024-12-18T00:34:48.2779472Z ---------------------------------------------------------------------- 2024-12-18T00:34:48.2779882Z Ran 3 tests in 0.342s 2024-12-18T00:34:48.2780066Z 2024-12-18T00:34:48.2780155Z OK 2024-12-18T00:34:48.8383852Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2024-12-18T00:34:48.8384762Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py' 2024-12-18T00:34:48.8385617Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2024-12-18T00:34:48.8386200Z ++ command -v nvidia-smi 2024-12-18T00:34:48.8388498Z + '[' -x '' ']' 2024-12-18T00:34:48.8388750Z + PJRT_DEVICE=CPU 2024-12-18T00:34:48.8389006Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:48.8389472Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2024-12-18T00:34:48.8390002Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:48.8390423Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2024-12-18T00:34:51.8352953Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2024-12-18T00:34:51.8354234Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2024-12-18T00:34:51.8415634Z WARNING: All log messages before absl::InitializeLog() is called are written to STDERR 2024-12-18T00:34:51.8416657Z W0000 00:00:1734482091.841019 58367 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2024-12-18T00:34:51.8417760Z I0000 00:00:1734482091.841034 58367 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2024-12-18T00:34:51.9190891Z W0000 00:00:1734482091.918625 58367 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2024-12-18T00:34:51.9192021Z I0000 00:00:1734482091.918641 58367 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2024-12-18T00:34:51.9876220Z . 2024-12-18T00:34:51.9876630Z ---------------------------------------------------------------------- 2024-12-18T00:34:51.9877029Z Ran 1 test in 0.161s 2024-12-18T00:34:51.9877251Z 2024-12-18T00:34:51.9877383Z OK 2024-12-18T00:34:52.5490779Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2024-12-18T00:34:52.5491634Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py' 2024-12-18T00:34:52.5492464Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2024-12-18T00:34:52.5493061Z ++ command -v nvidia-smi 2024-12-18T00:34:52.5493354Z + '[' -x '' ']' 2024-12-18T00:34:52.5493598Z + PJRT_DEVICE=CPU 2024-12-18T00:34:52.5493862Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:52.5494316Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2024-12-18T00:34:52.5494814Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:52.5495230Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2024-12-18T00:34:55.5281730Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.6.0+gitcfe54bf-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2024-12-18T00:34:55.5283263Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2024-12-18T00:34:55.5330551Z .WARNING: All log messages before absl::InitializeLog() is called are written to STDERR 2024-12-18T00:34:55.5333059Z W0000 00:00:1734482095.532590 58689 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2024-12-18T00:34:55.5335983Z I0000 00:00:1734482095.532697 58689 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2024-12-18T00:34:55.6800627Z .W0000 00:00:1734482095.679480 58689 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2024-12-18T00:34:55.6801750Z I0000 00:00:1734482095.679493 58689 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2024-12-18T00:34:55.7518526Z W0000 00:00:1734482095.751107 58689 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2024-12-18T00:34:55.7519715Z I0000 00:00:1734482095.751124 58689 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2024-12-18T00:34:55.8199546Z . 2024-12-18T00:34:55.8199955Z ---------------------------------------------------------------------- 2024-12-18T00:34:55.8200387Z Ran 3 tests in 0.302s 2024-12-18T00:34:55.8200561Z 2024-12-18T00:34:55.8200666Z OK 2024-12-18T00:34:56.3849703Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2024-12-18T00:34:56.3850561Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py' 2024-12-18T00:34:56.3851427Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2024-12-18T00:34:56.3852062Z ++ command -v nvidia-smi 2024-12-18T00:34:56.3854694Z + '[' -x '' ']' 2024-12-18T00:34:56.3854960Z + PJRT_DEVICE=CPU 2024-12-18T00:34:56.3855225Z + CPU_NUM_DEVICES=1 2024-12-18T00:34:56.3855704Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2024-12-18T00:34:56.3856245Z + '[' 0 '!=' 0 ']' 2024-12-18T00:34:56.3856775Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2024-12-18T00:34:59.5245500Z . 2024-12-18T00:34:59.5245910Z ---------------------------------------------------------------------- 2024-12-18T00:34:59.5246354Z Ran 1 test in 0.160s 2024-12-18T00:34:59.5246527Z 2024-12-18T00:34:59.5246636Z OK 2024-12-18T00:35:00.0820371Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2024-12-18T00:35:00.0821214Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py' 2024-12-18T00:35:00.0822039Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2024-12-18T00:35:00.0822685Z ++ command -v nvidia-smi 2024-12-18T00:35:00.0825264Z + '[' -x '' ']' 2024-12-18T00:35:00.0825657Z + PJRT_DEVICE=CPU 2024-12-18T00:35:00.0825904Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:00.0826368Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2024-12-18T00:35:00.0826881Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:00.0827297Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2024-12-18T00:35:03.0896190Z ssssss 2024-12-18T00:35:03.0896773Z ---------------------------------------------------------------------- 2024-12-18T00:35:03.0897183Z Ran 6 tests in 0.000s 2024-12-18T00:35:03.0897365Z 2024-12-18T00:35:03.0897464Z OK (skipped=6) 2024-12-18T00:35:03.6420135Z + run_save_tensor_hlo run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:03.6420824Z + local run_test_func=run_test 2024-12-18T00:35:03.6421133Z + shift 2024-12-18T00:35:03.6421886Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py' 2024-12-18T00:35:03.6423009Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:03.6423864Z + run_save_tensor run_test hlo /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:03.6424454Z + local run_test_func=run_test 2024-12-18T00:35:03.6424762Z + local file_graph_format=hlo 2024-12-18T00:35:03.6425047Z + shift 2 2024-12-18T00:35:03.6425572Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py' 2024-12-18T00:35:03.6426449Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:03.6427070Z + local base_file=/tmp/xla_test_save_ir.txt 2024-12-18T00:35:03.6441631Z + ls '/tmp/xla_test_save_ir.txt*' 2024-12-18T00:35:03.6442078Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2024-12-18T00:35:03.6442467Z + XLA_SAVE_TENSORS_FMT=hlo 2024-12-18T00:35:03.6442963Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:03.6443754Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py' 2024-12-18T00:35:03.6444815Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:03.6445399Z ++ command -v nvidia-smi 2024-12-18T00:35:03.6445687Z + '[' -x '' ']' 2024-12-18T00:35:03.6445933Z + PJRT_DEVICE=CPU 2024-12-18T00:35:03.6446173Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:03.6446632Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:03.6447152Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:03.6447586Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2024-12-18T00:35:06.7855799Z .. 2024-12-18T00:35:06.7856379Z ---------------------------------------------------------------------- 2024-12-18T00:35:06.7857099Z Ran 2 tests in 0.172s 2024-12-18T00:35:06.7857432Z 2024-12-18T00:35:06.7857569Z OK 2024-12-18T00:35:07.3704780Z + local test_status=0 2024-12-18T00:35:07.3705162Z + local actual_file 2024-12-18T00:35:07.3710710Z ++ ls /tmp/xla_test_save_ir.txt.0 2024-12-18T00:35:07.3711036Z ++ head -n1 2024-12-18T00:35:07.3732098Z + actual_file=/tmp/xla_test_save_ir.txt.0 2024-12-18T00:35:07.3732483Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2024-12-18T00:35:07.3732921Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2024-12-18T00:35:07.3733421Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2024-12-18T00:35:07.3733821Z + rm /tmp/xla_test_save_ir.txt.0 2024-12-18T00:35:07.3739981Z + return 0 2024-12-18T00:35:07.3740494Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2024-12-18T00:35:07.3741312Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py' --verbosity=2 2024-12-18T00:35:07.3742175Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2024-12-18T00:35:07.3743055Z ++ command -v nvidia-smi 2024-12-18T00:35:07.3745892Z + '[' -x '' ']' 2024-12-18T00:35:07.3746133Z + PJRT_DEVICE=CPU 2024-12-18T00:35:07.3746390Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:07.3746859Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2024-12-18T00:35:07.3747388Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:07.3747829Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2024-12-18T00:35:10.5615133Z test_div_by_f64 (__main__.TestOperationsHlo) ... ok 2024-12-18T00:35:10.5624297Z test_dropout_by_u8_mask (__main__.TestOperationsHlo) ... ok 2024-12-18T00:35:10.5638214Z test_expand (__main__.TestOperationsHlo) ... ok 2024-12-18T00:35:10.5647123Z test_special_scalars_addcdiv_addcmul (__main__.TestOperationsHlo) ... ok 2024-12-18T00:35:10.5647567Z 2024-12-18T00:35:10.5647747Z ---------------------------------------------------------------------- 2024-12-18T00:35:10.5648393Z Ran 4 tests in 0.191s 2024-12-18T00:35:10.5648615Z 2024-12-18T00:35:10.5648703Z OK 2024-12-18T00:35:11.1333751Z + run_test /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2024-12-18T00:35:11.1334670Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py' 2024-12-18T00:35:11.1335454Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2024-12-18T00:35:11.1336004Z ++ command -v nvidia-smi 2024-12-18T00:35:11.1336283Z + '[' -x '' ']' 2024-12-18T00:35:11.1336654Z + PJRT_DEVICE=CPU 2024-12-18T00:35:11.1336907Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:11.1337339Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2024-12-18T00:35:11.1337834Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:11.1338228Z + python3 /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2024-12-18T00:35:15.1784509Z ...... 2024-12-18T00:35:15.1784908Z ---------------------------------------------------------------------- 2024-12-18T00:35:15.1785368Z Ran 6 tests in 1.059s 2024-12-18T00:35:15.1785534Z 2024-12-18T00:35:15.1785628Z OK 2024-12-18T00:35:15.7501573Z + run_test /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2024-12-18T00:35:15.7502448Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py' 2024-12-18T00:35:15.7503328Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2024-12-18T00:35:15.7503920Z ++ command -v nvidia-smi 2024-12-18T00:35:15.7506450Z + '[' -x '' ']' 2024-12-18T00:35:15.7506714Z + PJRT_DEVICE=CPU 2024-12-18T00:35:15.7506970Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:15.7507442Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2024-12-18T00:35:15.7507988Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:15.7508417Z + python3 /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2024-12-18T00:35:18.7567633Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:35:18.7585347Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2024-12-18T00:35:18.7585999Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2024-12-18T00:35:18.7586604Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2024-12-18T00:35:18.7587218Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2024-12-18T00:35:18.7587826Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2024-12-18T00:35:18.7683127Z [ RUN ] XlaBackendTest.test_all_scalar_allgather 2024-12-18T00:35:18.7715213Z [ OK ] XlaBackendTest.test_all_scalar_allgather 2024-12-18T00:35:18.7715658Z [ RUN ] XlaBackendTest.test_allgather 2024-12-18T00:35:18.7732714Z [ OK ] XlaBackendTest.test_allgather 2024-12-18T00:35:18.7733166Z [ RUN ] XlaBackendTest.test_allgather_coalesced 2024-12-18T00:35:18.7743439Z [ OK ] XlaBackendTest.test_allgather_coalesced 2024-12-18T00:35:18.7743889Z [ RUN ] XlaBackendTest.test_allreduce 2024-12-18T00:35:18.7750498Z [ OK ] XlaBackendTest.test_allreduce 2024-12-18T00:35:18.7750888Z [ RUN ] XlaBackendTest.test_allreduce_with_mesh 2024-12-18T00:35:18.7771502Z [ OK ] XlaBackendTest.test_allreduce_with_mesh 2024-12-18T00:35:18.7771926Z [ RUN ] XlaBackendTest.test_barrier 2024-12-18T00:35:18.7772281Z [ OK ] XlaBackendTest.test_barrier 2024-12-18T00:35:18.7772640Z [ RUN ] XlaBackendTest.test_broadcast 2024-12-18T00:35:18.7775361Z [ OK ] XlaBackendTest.test_broadcast 2024-12-18T00:35:18.7775753Z [ RUN ] XlaBackendTest.test_new_group_entire_world 2024-12-18T00:35:18.7784456Z [ OK ] XlaBackendTest.test_new_group_entire_world 2024-12-18T00:35:18.7784898Z [ RUN ] XlaBackendTest.test_new_group_horizontal 2024-12-18T00:35:18.7811736Z [ OK ] XlaBackendTest.test_new_group_horizontal 2024-12-18T00:35:18.7812231Z [ RUN ] XlaBackendTest.test_new_group_invalid_horizontal 2024-12-18T00:35:18.7835185Z [ OK ] XlaBackendTest.test_new_group_invalid_horizontal 2024-12-18T00:35:18.7835690Z [ RUN ] XlaBackendTest.test_new_group_invalid_ranks 2024-12-18T00:35:18.7837637Z [ OK ] XlaBackendTest.test_new_group_invalid_ranks 2024-12-18T00:35:18.7838067Z [ RUN ] XlaBackendTest.test_new_group_invalid_vertical 2024-12-18T00:35:18.7853160Z [ OK ] XlaBackendTest.test_new_group_invalid_vertical 2024-12-18T00:35:18.7853596Z [ RUN ] XlaBackendTest.test_new_group_no_ranks 2024-12-18T00:35:18.7865872Z [ OK ] XlaBackendTest.test_new_group_no_ranks 2024-12-18T00:35:18.7866329Z [ RUN ] XlaBackendTest.test_new_group_one_paticipant 2024-12-18T00:35:18.7873948Z [ OK ] XlaBackendTest.test_new_group_one_paticipant 2024-12-18T00:35:18.7874378Z [ RUN ] XlaBackendTest.test_new_group_vertical 2024-12-18T00:35:18.7898775Z [ OK ] XlaBackendTest.test_new_group_vertical 2024-12-18T00:35:18.7899211Z [ RUN ] XlaBackendTest.test_recv 2024-12-18T00:35:18.7906323Z [ OK ] XlaBackendTest.test_recv 2024-12-18T00:35:18.7906697Z [ RUN ] XlaBackendTest.test_reduce_scatter 2024-12-18T00:35:18.7915630Z [ OK ] XlaBackendTest.test_reduce_scatter 2024-12-18T00:35:18.7916068Z [ RUN ] XlaBackendTest.test_reduce_scatter_coalesced 2024-12-18T00:35:18.7916512Z [ SKIPPED ] XlaBackendTest.test_reduce_scatter_coalesced 2024-12-18T00:35:18.7916924Z [ RUN ] XlaBackendTest.test_send 2024-12-18T00:35:18.7931577Z [ OK ] XlaBackendTest.test_send 2024-12-18T00:35:18.7932033Z [ RUN ] XlaBackendTest.test_unimplemented_op0 ('reduce') 2024-12-18T00:35:18.7932507Z [ OK ] XlaBackendTest.test_unimplemented_op0 ('reduce') 2024-12-18T00:35:18.7933012Z [ RUN ] XlaBackendTest.test_unimplemented_op1 ('allreduce_coalesced') 2024-12-18T00:35:18.7933592Z [ OK ] XlaBackendTest.test_unimplemented_op1 ('allreduce_coalesced') 2024-12-18T00:35:18.7934119Z [ RUN ] XlaBackendTest.test_unimplemented_op2 ('alltoall') 2024-12-18T00:35:18.7934600Z [ OK ] XlaBackendTest.test_unimplemented_op2 ('alltoall') 2024-12-18T00:35:18.7935068Z [ RUN ] XlaBackendTest.test_unimplemented_op3 ('gather') 2024-12-18T00:35:18.7936074Z [ OK ] XlaBackendTest.test_unimplemented_op3 ('gather') 2024-12-18T00:35:18.7936636Z [ RUN ] XlaBackendTest.test_unimplemented_op4 ('scatter') 2024-12-18T00:35:18.7938114Z [ OK ] XlaBackendTest.test_unimplemented_op4 ('scatter') 2024-12-18T00:35:18.7938607Z [ RUN ] XlaBackendTest.test_unimplemented_op5 ('recv_anysource') 2024-12-18T00:35:18.7939933Z [ OK ] XlaBackendTest.test_unimplemented_op5 ('recv_anysource') 2024-12-18T00:35:18.7940471Z [ RUN ] XlaBackendTest.test_unimplemented_op6 ('monitored_barrier') 2024-12-18T00:35:18.7941868Z [ OK ] XlaBackendTest.test_unimplemented_op6 ('monitored_barrier') 2024-12-18T00:35:18.7942342Z [ RUN ] XlaBackendTest.test_xla_backend_exists 2024-12-18T00:35:18.7942730Z [ OK ] XlaBackendTest.test_xla_backend_exists 2024-12-18T00:35:18.7943154Z ---------------------------------------------------------------------- 2024-12-18T00:35:18.7943546Z Ran 27 tests in 0.036s 2024-12-18T00:35:18.7943724Z 2024-12-18T00:35:18.7943826Z OK (skipped=1) 2024-12-18T00:35:19.3492478Z + run_torchrun /var/lib/jenkins/workspace/xla/test/pjrt/test_torchrun.py 2024-12-18T00:35:19.3493124Z ++ command -v nvidia-smi 2024-12-18T00:35:19.3495219Z + '[' -x '' ']' 2024-12-18T00:35:19.3495941Z + run_test /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2024-12-18T00:35:19.3496793Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py' 2024-12-18T00:35:19.3497537Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2024-12-18T00:35:19.3499864Z ++ command -v nvidia-smi 2024-12-18T00:35:19.3502396Z + '[' -x '' ']' 2024-12-18T00:35:19.3502653Z + PJRT_DEVICE=CPU 2024-12-18T00:35:19.3502907Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:19.3503322Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2024-12-18T00:35:19.3504103Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:19.3504550Z + python3 /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2024-12-18T00:35:22.3639369Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:35:22.3654092Z [ RUN ] PersistentCacheTest.test_persistent_cache_mp 2024-12-18T00:35:22.3654581Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_mp 2024-12-18T00:35:22.3655087Z [ RUN ] PersistentCacheTest.test_persistent_cache_single_device 2024-12-18T00:35:22.3655634Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_single_device 2024-12-18T00:35:22.3656205Z [ RUN ] PersistentCacheTest.test_persistent_cache_spmd_replicated 2024-12-18T00:35:22.3656875Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_spmd_replicated 2024-12-18T00:35:22.3657417Z [ RUN ] PersistentCacheTest.test_persistent_cache_spmd_sharded 2024-12-18T00:35:22.3657959Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_spmd_sharded 2024-12-18T00:35:22.3658491Z [ RUN ] PersistentCacheTest.test_replicated_spmd_hash 2024-12-18T00:35:22.3658963Z [ SKIPPED ] PersistentCacheTest.test_replicated_spmd_hash 2024-12-18T00:35:22.3659422Z ---------------------------------------------------------------------- 2024-12-18T00:35:22.3659797Z Ran 5 tests in 0.000s 2024-12-18T00:35:22.3659976Z 2024-12-18T00:35:22.3660072Z OK (skipped=5) 2024-12-18T00:35:22.9166676Z + run_test /var/lib/jenkins/workspace/xla/test/test_devices.py 2024-12-18T00:35:22.9167335Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_devices.py' 2024-12-18T00:35:22.9168006Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_devices.py 2024-12-18T00:35:22.9168517Z ++ command -v nvidia-smi 2024-12-18T00:35:22.9168801Z + '[' -x '' ']' 2024-12-18T00:35:22.9169056Z + PJRT_DEVICE=CPU 2024-12-18T00:35:22.9169319Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:22.9169689Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_devices.py 2024-12-18T00:35:22.9170156Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:22.9170513Z + python3 /var/lib/jenkins/workspace/xla/test/test_devices.py 2024-12-18T00:35:25.9031012Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2024-12-18T00:35:25.9050407Z [ RUN ] TestDevices.test_device0 (None, device(type='xla', index=0)) 2024-12-18T00:35:25.9051025Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2024-12-18T00:35:25.9051651Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2024-12-18T00:35:25.9052254Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2024-12-18T00:35:25.9052871Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2024-12-18T00:35:25.9053493Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2024-12-18T00:35:25.9136577Z [ OK ] TestDevices.test_device0 (None, device(type='xla', index=0)) 2024-12-18T00:35:25.9137179Z [ RUN ] TestDevices.test_device1 (0, device(type='xla', index=0)) 2024-12-18T00:35:25.9137758Z [ OK ] TestDevices.test_device1 (0, device(type='xla', index=0)) 2024-12-18T00:35:25.9138273Z [ RUN ] TestDevices.test_device2 (3, device(type='xla', index=3)) 2024-12-18T00:35:25.9138889Z [ OK ] TestDevices.test_device2 (3, device(type='xla', index=3)) 2024-12-18T00:35:25.9139331Z [ RUN ] TestDevices.test_device_count 2024-12-18T00:35:25.9139677Z [ OK ] TestDevices.test_device_count 2024-12-18T00:35:25.9140030Z [ RUN ] TestDevices.test_devices 2024-12-18T00:35:25.9140370Z [ OK ] TestDevices.test_devices 2024-12-18T00:35:25.9140715Z [ RUN ] TestDevices.test_real_devices 2024-12-18T00:35:25.9141070Z [ OK ] TestDevices.test_real_devices 2024-12-18T00:35:25.9141404Z [ RUN ] TestDevices.test_step 2024-12-18T00:35:25.9145833Z [ OK ] TestDevices.test_step 2024-12-18T00:35:25.9146190Z [ RUN ] TestDevices.test_step_exception 2024-12-18T00:35:25.9148827Z [ OK ] TestDevices.test_step_exception 2024-12-18T00:35:25.9149431Z [ RUN ] TestDevices.test_sync 2024-12-18T00:35:25.9150134Z [ OK ] TestDevices.test_sync 2024-12-18T00:35:25.9150467Z [ RUN ] TestDevices.test_trivial_model 2024-12-18T00:35:26.0759416Z [ OK ] TestDevices.test_trivial_model 2024-12-18T00:35:26.0759902Z ---------------------------------------------------------------------- 2024-12-18T00:35:26.0760361Z Ran 10 tests in 0.171s 2024-12-18T00:35:26.0760551Z 2024-12-18T00:35:26.0760649Z OK 2024-12-18T00:35:26.6368107Z + run_device_detection_test /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2024-12-18T00:35:26.6368987Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py' 2024-12-18T00:35:26.6369780Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2024-12-18T00:35:26.6370325Z + current_device= 2024-12-18T00:35:26.6370589Z + current_num_gpu_devices= 2024-12-18T00:35:26.6370892Z + unset PJRT_DEVICE 2024-12-18T00:35:26.6371159Z + unset GPU_NUM_DEVICES 2024-12-18T00:35:26.6371661Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2024-12-18T00:35:26.6372158Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:26.6372549Z + python3 /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2024-12-18T00:35:29.6979625Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2024-12-18T00:35:29.6995895Z s 2024-12-18T00:35:29.6996313Z ---------------------------------------------------------------------- 2024-12-18T00:35:29.6996731Z Ran 1 test in 0.000s 2024-12-18T00:35:29.6996894Z 2024-12-18T00:35:29.6996992Z OK (skipped=1) 2024-12-18T00:35:30.2443451Z + export GPU_NUM_DEVICES= 2024-12-18T00:35:30.2443835Z + GPU_NUM_DEVICES= 2024-12-18T00:35:30.2444115Z + export PJRT_DEVICE= 2024-12-18T00:35:30.2444669Z + PJRT_DEVICE= 2024-12-18T00:35:30.2444921Z + PJRT_DEVICE=CPU 2024-12-18T00:35:30.2445160Z + CPU_NUM_DEVICES=1 2024-12-18T00:35:30.2445568Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_core_aten_ops.py 2024-12-18T00:35:30.2446064Z + '[' 0 '!=' 0 ']' 2024-12-18T00:35:30.2446451Z + python3 /var/lib/jenkins/workspace/xla/test/test_core_aten_ops.py 2024-12-18T00:37:57.0380834Z ...........................................................................................................................................................................................s..............................................................................................................................sss.............................................................................................................................................................................. 2024-12-18T00:37:57.0381901Z ---------------------------------------------------------------------- 2024-12-18T00:37:57.0382335Z Ran 491 tests in 143.770s 2024-12-18T00:37:57.0382540Z 2024-12-18T00:37:57.0382661Z OK (skipped=4) 2024-12-18T00:37:58.0336303Z + run_test /var/lib/jenkins/workspace/xla/test/test_pallas.py 2024-12-18T00:37:58.0337202Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_pallas.py' 2024-12-18T00:37:58.0337881Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_pallas.py 2024-12-18T00:37:58.0338371Z ++ command -v nvidia-smi 2024-12-18T00:37:58.0338650Z + '[' -x '' ']' 2024-12-18T00:37:58.0338902Z + PJRT_DEVICE=CPU 2024-12-18T00:37:58.0339154Z + CPU_NUM_DEVICES=1 2024-12-18T00:37:58.0339508Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_pallas.py 2024-12-18T00:37:58.0339931Z + '[' 0 '!=' 0 ']' 2024-12-18T00:37:58.0340274Z + python3 /var/lib/jenkins/workspace/xla/test/test_pallas.py 2024-12-18T00:38:01.0299869Z ssssssssssssssssssssssssssss 2024-12-18T00:38:01.0300362Z ---------------------------------------------------------------------- 2024-12-18T00:38:01.0300779Z Ran 28 tests in 0.000s 2024-12-18T00:38:01.0300946Z 2024-12-18T00:38:01.0301067Z OK (skipped=28) 2024-12-18T00:38:01.5683216Z ++ command -v nvidia-smi 2024-12-18T00:38:01.5683596Z + '[' -x '' ']' 2024-12-18T00:38:01.5683854Z + [[ '' != \1 ]] 2024-12-18T00:38:01.5684617Z + run_torch_op_tests 2024-12-18T00:38:01.5685210Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:01.5686121Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2024-12-18T00:38:01.5687098Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:01.5687803Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:38:01.5688427Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:01.5689273Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2024-12-18T00:38:01.5690179Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:01.5690784Z ++ command -v nvidia-smi 2024-12-18T00:38:01.5691068Z + '[' -x '' ']' 2024-12-18T00:38:01.5691302Z + PJRT_DEVICE=CPU 2024-12-18T00:38:01.5691553Z + CPU_NUM_DEVICES=1 2024-12-18T00:38:01.5692048Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:01.5692601Z + '[' 0 '!=' 0 ']' 2024-12-18T00:38:01.5693070Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:04.9395959Z 2024-12-18T00:38:04.9396507Z Running tests... 2024-12-18T00:38:04.9396917Z ---------------------------------------------------------------------- 2024-12-18T00:38:04.9397556Z Test results will be stored in test-reports/python-unittest/test.......test.test_view_ops 2024-12-18T00:38:05.0333994Z test_T_view_xla (__main__.TestViewOpsXLA) ... ok (0.094s) 2024-12-18T00:38:05.0943615Z test_advanced_indexing_assignment_xla (__main__.TestViewOpsXLA) ... ok (0.061s) 2024-12-18T00:38:05.1854965Z test_advanced_indexing_nonview_xla (__main__.TestViewOpsXLA) ... ok (0.091s) 2024-12-18T00:38:05.1876242Z test_as_strided_gradients_xla (__main__.TestViewOpsXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py:746: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2024-12-18T00:38:05.1878181Z assert max_offset < len(y.storage()), "test case resizes storage" 2024-12-18T00:38:05.4260777Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4261752Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4283682Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4284629Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4301625Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4302505Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4324663Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4325567Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4340671Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4341550Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4364155Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4365321Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4381020Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4381906Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4404378Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4405283Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4422690Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4423575Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4447505Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4448428Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4480824Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4481735Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4499629Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4500520Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4522018Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4522939Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4538692Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4539594Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4561980Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4562892Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4578278Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4579143Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4598861Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4599780Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4615607Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4616647Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4638565Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4639494Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4657719Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:05.4658614Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:05.4664292Z ok (0.281s) 2024-12-18T00:38:05.5485655Z test_as_strided_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.081s) 2024-12-18T00:38:05.6284649Z test_as_strided_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2024-12-18T00:38:05.7172881Z test_basic_indexing_ellipses_view_xla (__main__.TestViewOpsXLA) ... ok (0.089s) 2024-12-18T00:38:05.8052825Z test_basic_indexing_newaxis_view_xla (__main__.TestViewOpsXLA) ... ok (0.088s) 2024-12-18T00:38:05.8939507Z test_basic_indexing_slice_view_xla (__main__.TestViewOpsXLA) ... ok (0.088s) 2024-12-18T00:38:05.8940337Z test_chunk_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2024-12-18T00:38:05.8951118Z test_conj_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:05.8961149Z test_conj_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:05.8969585Z test_conj_self_xla_bfloat16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.8977647Z test_conj_self_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:05.8985859Z test_conj_self_xla_float32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.8994334Z test_conj_self_xla_float64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.9002821Z test_conj_self_xla_int16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.9011195Z test_conj_self_xla_int32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.9019826Z test_conj_self_xla_int64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.9028228Z test_conj_self_xla_int8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.9036677Z test_conj_self_xla_uint8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:05.9046379Z test_conj_view_with_shared_memory_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:05.9054569Z test_contiguous_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:05.9062512Z test_contiguous_self_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:06.1138114Z test_diagonal_view_xla (__main__.TestViewOpsXLA) ... ok (0.207s) 2024-12-18T00:38:06.1144644Z test_expand_as_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:06.1153519Z test_expand_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:06.1164856Z test_flatten_nonview_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:06.1180172Z test_flatten_view_xla (__main__.TestViewOpsXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:06.1188916Z test_imag_noncomplex_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:06.1197281Z test_imag_noncomplex_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:06.1205824Z test_imag_noncomplex_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:06.1214301Z test_imag_noncomplex_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:06.1222895Z test_imag_noncomplex_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:06.1231388Z test_imag_noncomplex_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:06.1239893Z test_imag_noncomplex_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:06.1248684Z test_imag_noncomplex_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:06.1257225Z test_imag_noncomplex_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:07.0596747Z test_movedim_view_xla (__main__.TestViewOpsXLA) ... ok (0.933s) 2024-12-18T00:38:07.1482518Z test_narrow_view_xla (__main__.TestViewOpsXLA) ... ok (0.089s) 2024-12-18T00:38:07.1498661Z test_permute_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2024-12-18T00:38:07.1512683Z test_real_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.1524063Z test_real_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2329642Z test_reshape_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2024-12-18T00:38:07.2334375Z test_reshape_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:07.2349647Z test_reshape_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:07.2763110Z test_select_view_xla (__main__.TestViewOpsXLA) ... ok (0.041s) 2024-12-18T00:38:07.2770824Z test_set_real_imag_xla_complex128_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2782029Z test_set_real_imag_xla_complex128_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2792975Z test_set_real_imag_xla_complex128_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2803871Z test_set_real_imag_xla_complex128_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2814801Z test_set_real_imag_xla_complex128_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2825911Z test_set_real_imag_xla_complex128_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2836899Z test_set_real_imag_xla_complex128_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2848067Z test_set_real_imag_xla_complex128_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2859130Z test_set_real_imag_xla_complex128_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2870357Z test_set_real_imag_xla_complex128_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2881049Z test_set_real_imag_xla_complex128_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2891924Z test_set_real_imag_xla_complex128_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.2903012Z test_set_real_imag_xla_complex64_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2914348Z test_set_real_imag_xla_complex64_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2925381Z test_set_real_imag_xla_complex64_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2936251Z test_set_real_imag_xla_complex64_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2947573Z test_set_real_imag_xla_complex64_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2958500Z test_set_real_imag_xla_complex64_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2969403Z test_set_real_imag_xla_complex64_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2980458Z test_set_real_imag_xla_complex64_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.2991655Z test_set_real_imag_xla_complex64_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.3002374Z test_set_real_imag_xla_complex64_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.3013416Z test_set_real_imag_xla_complex64_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.3024521Z test_set_real_imag_xla_complex64_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.3029263Z test_split_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2024-12-18T00:38:07.3447092Z test_squeeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.041s) 2024-12-18T00:38:07.3853915Z test_squeeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.041s) 2024-12-18T00:38:07.4659071Z test_t_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2024-12-18T00:38:07.4678356Z test_t_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2024-12-18T00:38:07.4708981Z test_transpose_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.003s) 2024-12-18T00:38:07.4739019Z test_transpose_view_xla (__main__.TestViewOpsXLA) ... ok (0.003s) 2024-12-18T00:38:07.7143550Z test_unbind_view_xla (__main__.TestViewOpsXLA) ... ok (0.240s) 2024-12-18T00:38:07.7201689Z test_unbind_xla (__main__.TestViewOpsXLA) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:07.7202779Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:07.7203660Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:07.7204530Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:07.7205424Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:07.7206306Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:07.7213472Z ok (0.007s) 2024-12-18T00:38:07.7222983Z test_unfold_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:07.8039428Z test_unsqueeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.081s) 2024-12-18T00:38:07.8847463Z test_unsqueeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.081s) 2024-12-18T00:38:07.8861636Z test_view_as_complex_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:07.8875833Z test_view_as_real_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:07.8887116Z test_view_as_real_xla_complex32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2024-12-18T00:38:07.8899754Z test_view_as_real_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:07.8919635Z test_view_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:08.1794480Z test_view_copy_out_xla (__main__.TestViewOpsXLA) ... ok (0.287s) 2024-12-18T00:38:08.1815297Z test_view_copy_output_contiguous_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2024-12-18T00:38:08.3218879Z test_view_copy_xla (__main__.TestViewOpsXLA) ... ok (0.140s) 2024-12-18T00:38:08.3246692Z test_view_dtype_new_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3276774Z test_view_dtype_new_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.003s) 2024-12-18T00:38:08.3303980Z test_view_dtype_new_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.003s) 2024-12-18T00:38:08.3333156Z test_view_dtype_new_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2024-12-18T00:38:08.3361324Z test_view_dtype_new_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3388853Z test_view_dtype_new_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3417160Z test_view_dtype_new_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3445347Z test_view_dtype_new_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3473241Z test_view_dtype_new_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3500854Z test_view_dtype_new_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3529030Z test_view_dtype_new_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:08.3540822Z test_view_dtype_upsize_errors_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3553482Z test_view_dtype_upsize_errors_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3566072Z test_view_dtype_upsize_errors_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:08.3578613Z test_view_dtype_upsize_errors_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:08.3591079Z test_view_dtype_upsize_errors_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:08.3603690Z test_view_dtype_upsize_errors_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3616233Z test_view_dtype_upsize_errors_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3628893Z test_view_dtype_upsize_errors_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3641487Z test_view_dtype_upsize_errors_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3654224Z test_view_dtype_upsize_errors_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3666937Z test_view_dtype_upsize_errors_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3679567Z test_view_dtype_upsize_errors_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3688965Z test_view_tensor_dsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3698592Z test_view_tensor_dsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3707963Z test_view_tensor_dsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:08.3717317Z test_view_tensor_dsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:08.3726631Z test_view_tensor_dsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:08.3736080Z test_view_tensor_dsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3745923Z test_view_tensor_dsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3755182Z test_view_tensor_dsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3764558Z test_view_tensor_dsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3773992Z test_view_tensor_dsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3783491Z test_view_tensor_dsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3792881Z test_view_tensor_dsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3802313Z test_view_tensor_hsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3811771Z test_view_tensor_hsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3821359Z test_view_tensor_hsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:08.3830651Z test_view_tensor_hsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:08.3840007Z test_view_tensor_hsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:08.3849761Z test_view_tensor_hsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3859313Z test_view_tensor_hsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3868716Z test_view_tensor_hsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3878119Z test_view_tensor_hsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3887578Z test_view_tensor_hsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3897132Z test_view_tensor_hsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3906597Z test_view_tensor_hsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3916545Z test_view_tensor_split_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3926421Z test_view_tensor_split_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3936404Z test_view_tensor_split_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:08.3946452Z test_view_tensor_split_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:08.3956253Z test_view_tensor_split_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:08.3966195Z test_view_tensor_split_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3976110Z test_view_tensor_split_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3986091Z test_view_tensor_split_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.3996053Z test_view_tensor_split_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4006087Z test_view_tensor_split_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4015886Z test_view_tensor_split_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4025835Z test_view_tensor_split_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4035291Z test_view_tensor_vsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4044825Z test_view_tensor_vsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4054264Z test_view_tensor_vsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:08.4063757Z test_view_tensor_vsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:08.4073106Z test_view_tensor_vsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:08.4082555Z test_view_tensor_vsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4091964Z test_view_tensor_vsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4101509Z test_view_tensor_vsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4110906Z test_view_tensor_vsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4120335Z test_view_tensor_vsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4129752Z test_view_tensor_vsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4139310Z test_view_tensor_vsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:08.4155403Z test_view_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2024-12-18T00:38:08.4155965Z 2024-12-18T00:38:08.4156142Z ---------------------------------------------------------------------- 2024-12-18T00:38:08.4156673Z Ran 163 tests in 3.477s 2024-12-18T00:38:08.4156842Z 2024-12-18T00:38:08.4157024Z OK (skipped=123) 2024-12-18T00:38:08.4157174Z 2024-12-18T00:38:08.4157298Z Generating XML reports... 2024-12-18T00:38:08.4304803Z Generated XML report: test-reports/python-unittest/test.......test.test_view_ops/TEST-TestViewOpsXLA-20241218003804.xml 2024-12-18T00:38:09.1185909Z + run_test_without_functionalization /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:09.1187081Z + echo 'Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2024-12-18T00:38:09.1188232Z Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:09.1188960Z + XLA_DISABLE_FUNCTIONALIZATION=1 2024-12-18T00:38:09.1189500Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:09.1190344Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2024-12-18T00:38:09.1191251Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:09.1191859Z ++ command -v nvidia-smi 2024-12-18T00:38:09.1192130Z + '[' -x '' ']' 2024-12-18T00:38:09.1192374Z + PJRT_DEVICE=CPU 2024-12-18T00:38:09.1192623Z + CPU_NUM_DEVICES=1 2024-12-18T00:38:09.1193119Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:09.1193656Z + '[' 0 '!=' 0 ']' 2024-12-18T00:38:09.1194480Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2024-12-18T00:38:12.4955633Z 2024-12-18T00:38:12.4956059Z Running tests... 2024-12-18T00:38:12.4956469Z ---------------------------------------------------------------------- 2024-12-18T00:38:12.4957090Z Test results will be stored in test-reports/python-unittest/test.......test.test_view_ops 2024-12-18T00:38:12.6659356Z test_T_view_xla (__main__.TestViewOpsXLA) ... ok (0.170s) 2024-12-18T00:38:12.7260629Z test_advanced_indexing_assignment_xla (__main__.TestViewOpsXLA) ... ok (0.060s) 2024-12-18T00:38:12.8158923Z test_advanced_indexing_nonview_xla (__main__.TestViewOpsXLA) ... ok (0.089s) 2024-12-18T00:38:12.8177479Z test_as_strided_gradients_xla (__main__.TestViewOpsXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py:746: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2024-12-18T00:38:12.8179449Z assert max_offset < len(y.storage()), "test case resizes storage" 2024-12-18T00:38:13.0379428Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0380406Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0403243Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0404173Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0419876Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0420758Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0443646Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0444802Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0459292Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0460166Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0482687Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0483608Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0499108Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0499990Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0523395Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0524304Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0540655Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0541531Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0569999Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0570905Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0586966Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0588026Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0611987Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0612904Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0627410Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0628294Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0647713Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0648616Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0667157Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0668047Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0690770Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0691678Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0705119Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0705994Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0727211Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0728099Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0747429Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0748331Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0774853Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:13.0775770Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:13.0776726Z ok (0.262s) 2024-12-18T00:38:13.1578958Z test_as_strided_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2024-12-18T00:38:13.2367445Z test_as_strided_view_xla (__main__.TestViewOpsXLA) ... ok (0.079s) 2024-12-18T00:38:13.3244400Z test_basic_indexing_ellipses_view_xla (__main__.TestViewOpsXLA) ... ok (0.087s) 2024-12-18T00:38:13.4113165Z test_basic_indexing_newaxis_view_xla (__main__.TestViewOpsXLA) ... ok (0.087s) 2024-12-18T00:38:13.4979636Z test_basic_indexing_slice_view_xla (__main__.TestViewOpsXLA) ... ok (0.087s) 2024-12-18T00:38:13.4981049Z test_chunk_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2024-12-18T00:38:13.4991826Z test_conj_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:13.5001933Z test_conj_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:13.5010033Z test_conj_self_xla_bfloat16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5018192Z test_conj_self_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:13.5026174Z test_conj_self_xla_float32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5034333Z test_conj_self_xla_float64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5042474Z test_conj_self_xla_int16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5051042Z test_conj_self_xla_int32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5059469Z test_conj_self_xla_int64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5067484Z test_conj_self_xla_int8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5075542Z test_conj_self_xla_uint8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.5085038Z test_conj_view_with_shared_memory_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:13.5093331Z test_contiguous_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:13.5101065Z test_contiguous_self_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:13.7142457Z test_diagonal_view_xla (__main__.TestViewOpsXLA) ... ok (0.204s) 2024-12-18T00:38:13.7152030Z test_expand_as_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:13.7160795Z test_expand_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:13.7172141Z test_flatten_nonview_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:13.7187330Z test_flatten_view_xla (__main__.TestViewOpsXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:13.7196037Z test_imag_noncomplex_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:13.7204434Z test_imag_noncomplex_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:13.7213045Z test_imag_noncomplex_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:13.7221738Z test_imag_noncomplex_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:13.7230220Z test_imag_noncomplex_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:13.7238857Z test_imag_noncomplex_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:13.7247611Z test_imag_noncomplex_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:13.7256078Z test_imag_noncomplex_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:13.7264731Z test_imag_noncomplex_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2024-12-18T00:38:14.6428412Z test_movedim_view_xla (__main__.TestViewOpsXLA) ... ok (0.916s) 2024-12-18T00:38:14.7295571Z test_narrow_view_xla (__main__.TestViewOpsXLA) ... ok (0.086s) 2024-12-18T00:38:14.7306107Z test_permute_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2024-12-18T00:38:14.7320730Z test_real_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.7332455Z test_real_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8130958Z test_reshape_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.079s) 2024-12-18T00:38:14.8136916Z test_reshape_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:14.8150837Z test_reshape_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:14.8557231Z test_select_view_xla (__main__.TestViewOpsXLA) ... ok (0.040s) 2024-12-18T00:38:14.8564095Z test_set_real_imag_xla_complex128_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8575016Z test_set_real_imag_xla_complex128_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8586101Z test_set_real_imag_xla_complex128_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8597147Z test_set_real_imag_xla_complex128_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8607956Z test_set_real_imag_xla_complex128_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8619042Z test_set_real_imag_xla_complex128_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8630022Z test_set_real_imag_xla_complex128_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8640900Z test_set_real_imag_xla_complex128_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8652085Z test_set_real_imag_xla_complex128_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8663108Z test_set_real_imag_xla_complex128_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8673936Z test_set_real_imag_xla_complex128_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8684863Z test_set_real_imag_xla_complex128_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:14.8695756Z test_set_real_imag_xla_complex64_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8706804Z test_set_real_imag_xla_complex64_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8718173Z test_set_real_imag_xla_complex64_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8729101Z test_set_real_imag_xla_complex64_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8740144Z test_set_real_imag_xla_complex64_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8751227Z test_set_real_imag_xla_complex64_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8762094Z test_set_real_imag_xla_complex64_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8773024Z test_set_real_imag_xla_complex64_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8783967Z test_set_real_imag_xla_complex64_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8794885Z test_set_real_imag_xla_complex64_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8805857Z test_set_real_imag_xla_complex64_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8816827Z test_set_real_imag_xla_complex64_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:14.8821546Z test_split_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2024-12-18T00:38:14.9223565Z test_squeeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.040s) 2024-12-18T00:38:14.9625569Z test_squeeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.040s) 2024-12-18T00:38:15.0418337Z test_t_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.079s) 2024-12-18T00:38:15.0427662Z test_t_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:15.0458112Z test_transpose_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.003s) 2024-12-18T00:38:15.0489286Z test_transpose_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2024-12-18T00:38:15.2854133Z test_unbind_view_xla (__main__.TestViewOpsXLA) ... ok (0.236s) 2024-12-18T00:38:15.2906954Z test_unbind_xla (__main__.TestViewOpsXLA) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:15.2908025Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:15.2910582Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:15.2911469Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:15.2914634Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:38:15.2915509Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:38:15.2922744Z ok (0.007s) 2024-12-18T00:38:15.2932393Z test_unfold_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:15.3735674Z test_unsqueeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2024-12-18T00:38:15.4529131Z test_unsqueeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.079s) 2024-12-18T00:38:15.4542234Z test_view_as_complex_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:15.4556531Z test_view_as_real_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:15.4567814Z test_view_as_real_xla_complex32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2024-12-18T00:38:15.4580507Z test_view_as_real_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:15.4594918Z test_view_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:15.7408727Z test_view_copy_out_xla (__main__.TestViewOpsXLA) ... ok (0.281s) 2024-12-18T00:38:15.7417551Z test_view_copy_output_contiguous_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:15.8801945Z test_view_copy_xla (__main__.TestViewOpsXLA) ... ok (0.138s) 2024-12-18T00:38:15.8826637Z test_view_dtype_new_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.8855452Z test_view_dtype_new_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.003s) 2024-12-18T00:38:15.8884173Z test_view_dtype_new_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.003s) 2024-12-18T00:38:15.8911989Z test_view_dtype_new_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2024-12-18T00:38:15.8939384Z test_view_dtype_new_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.8968049Z test_view_dtype_new_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.8996258Z test_view_dtype_new_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.9023343Z test_view_dtype_new_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.9050987Z test_view_dtype_new_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.9079721Z test_view_dtype_new_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.9107134Z test_view_dtype_new_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:15.9119366Z test_view_dtype_upsize_errors_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9132102Z test_view_dtype_upsize_errors_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9144610Z test_view_dtype_upsize_errors_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:15.9157093Z test_view_dtype_upsize_errors_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:15.9169543Z test_view_dtype_upsize_errors_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:15.9182257Z test_view_dtype_upsize_errors_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9194844Z test_view_dtype_upsize_errors_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9207501Z test_view_dtype_upsize_errors_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9220211Z test_view_dtype_upsize_errors_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9232852Z test_view_dtype_upsize_errors_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9245675Z test_view_dtype_upsize_errors_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9258271Z test_view_dtype_upsize_errors_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9267719Z test_view_tensor_dsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9277082Z test_view_tensor_dsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9286512Z test_view_tensor_dsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:15.9295814Z test_view_tensor_dsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:15.9305243Z test_view_tensor_dsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:15.9314633Z test_view_tensor_dsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9324122Z test_view_tensor_dsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9333510Z test_view_tensor_dsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9343004Z test_view_tensor_dsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9352673Z test_view_tensor_dsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9362063Z test_view_tensor_dsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9371455Z test_view_tensor_dsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9381113Z test_view_tensor_hsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9390489Z test_view_tensor_hsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9399875Z test_view_tensor_hsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:15.9409327Z test_view_tensor_hsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:15.9418752Z test_view_tensor_hsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:15.9428154Z test_view_tensor_hsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9437568Z test_view_tensor_hsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9447238Z test_view_tensor_hsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9456676Z test_view_tensor_hsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9466165Z test_view_tensor_hsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9475600Z test_view_tensor_hsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9485053Z test_view_tensor_hsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9495002Z test_view_tensor_split_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9504883Z test_view_tensor_split_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9514769Z test_view_tensor_split_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:15.9524564Z test_view_tensor_split_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:15.9534352Z test_view_tensor_split_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:15.9544570Z test_view_tensor_split_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9554523Z test_view_tensor_split_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9564435Z test_view_tensor_split_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9574322Z test_view_tensor_split_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9584384Z test_view_tensor_split_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9594258Z test_view_tensor_split_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9604151Z test_view_tensor_split_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9613515Z test_view_tensor_vsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9622996Z test_view_tensor_vsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9632348Z test_view_tensor_vsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:15.9641687Z test_view_tensor_vsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:15.9651212Z test_view_tensor_vsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:15.9660722Z test_view_tensor_vsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9670751Z test_view_tensor_vsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9679519Z test_view_tensor_vsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9688930Z test_view_tensor_vsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9698490Z test_view_tensor_vsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9707982Z test_view_tensor_vsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9717284Z test_view_tensor_vsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:15.9737925Z test_view_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2024-12-18T00:38:15.9738260Z 2024-12-18T00:38:15.9738457Z ---------------------------------------------------------------------- 2024-12-18T00:38:15.9738849Z Ran 163 tests in 3.478s 2024-12-18T00:38:15.9739031Z 2024-12-18T00:38:15.9739128Z OK (skipped=123) 2024-12-18T00:38:15.9739286Z 2024-12-18T00:38:15.9739397Z Generating XML reports... 2024-12-18T00:38:15.9887599Z Generated XML report: test-reports/python-unittest/test.......test.test_view_ops/TEST-TestViewOpsXLA-20241218003812.xml 2024-12-18T00:38:16.6740024Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2024-12-18T00:38:16.6741007Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestTorchDeviceTypeXLA 2024-12-18T00:38:16.6741987Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2024-12-18T00:38:16.6742640Z ++ command -v nvidia-smi 2024-12-18T00:38:16.6743280Z + '[' -x '' ']' 2024-12-18T00:38:16.6743857Z + PJRT_DEVICE=CPU 2024-12-18T00:38:16.6744477Z + CPU_NUM_DEVICES=1 2024-12-18T00:38:16.6745054Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2024-12-18T00:38:16.6745651Z + '[' 0 '!=' 0 ']' 2024-12-18T00:38:16.6746157Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2024-12-18T00:38:21.0692321Z 2024-12-18T00:38:21.0692799Z Running tests... 2024-12-18T00:38:21.0693541Z ---------------------------------------------------------------------- 2024-12-18T00:38:21.0694145Z Test results will be stored in test-reports/python-unittest/test.......test.test_torch 2024-12-18T00:38:21.0724128Z test_addcdiv_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.003s) 2024-12-18T00:38:21.0738194Z test_addcdiv_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:38:21.0758467Z test_addcdiv_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:21.0778098Z test_addcdiv_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:21.0797912Z test_addcdiv_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:21.0817447Z test_addcdiv_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:21.0837141Z test_addcdiv_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:21.0855190Z test_addcdiv_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:21.0875705Z test_addcdiv_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:21.0893139Z test_addcmul_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:21.0901098Z test_assertRaisesRegex_ignore_msg_non_native_device_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:21.0910665Z test_bernoulli_edge_cases_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:21.4923212Z test_bernoulli_edge_cases_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.400s) 2024-12-18T00:38:21.9265165Z test_bernoulli_edge_cases_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.434s) 2024-12-18T00:38:21.9276583Z test_bernoulli_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:22.4818505Z test_bernoulli_p_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.553s) 2024-12-18T00:38:22.9430364Z test_bernoulli_p_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.461s) 2024-12-18T00:38:23.6538587Z test_bernoulli_self_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.711s) 2024-12-18T00:38:23.9528134Z test_bernoulli_self_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.299s) 2024-12-18T00:38:23.9536125Z test_bfloat16_neg_abs_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:24.0016960Z test_bool_tensor_value_change_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.047s) 2024-12-18T00:38:24.0052611Z test_broadcast_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.004s) 2024-12-18T00:38:24.0064984Z test_bytes_to_scalar_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0076482Z test_bytes_to_scalar_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:24.0087863Z test_bytes_to_scalar_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:24.0099556Z test_bytes_to_scalar_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0110935Z test_bytes_to_scalar_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0122334Z test_bytes_to_scalar_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0133656Z test_bytes_to_scalar_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0145428Z test_bytes_to_scalar_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0156831Z test_bytes_to_scalar_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0168161Z test_bytes_to_scalar_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0179686Z test_bytes_to_scalar_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0190949Z test_bytes_to_scalar_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0202272Z test_bytes_to_scalar_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:24.0210895Z test_cauchy_kstest_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:24.0219914Z test_cauchy_no_inf_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:24.0228601Z test_cauchy_no_inf_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:24.1130438Z test_cauchy_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.090s) 2024-12-18T00:38:24.1139971Z test_cauchy_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:24.2009240Z test_cauchy_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.086s) 2024-12-18T00:38:24.2864037Z test_cauchy_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.086s) 2024-12-18T00:38:24.2879117Z test_cdist_cuda_backward_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:38:24.6086837Z test_cdist_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.320s) 2024-12-18T00:38:24.6133286Z test_cdist_euclidean_large_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.005s) 2024-12-18T00:38:25.4744629Z test_cdist_grad_p_lt_1_no_nan_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.861s) 2024-12-18T00:38:25.4756363Z test_cdist_large_batch_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:25.4766772Z test_cdist_large_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:25.4782203Z test_cdist_non_contiguous_batch_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:25.4796769Z test_cdist_non_contiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:25.4808973Z test_cdist_norm_batch_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:25.4821050Z test_cdist_norm_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:26.4884859Z test_cdist_same_inputs_xla (__main__.TestTorchDeviceTypeXLA) ... ok (1.006s) 2024-12-18T00:38:27.8058168Z test_check_tensor_all_xla (__main__.TestTorchDeviceTypeXLA) ... ok (1.317s) 2024-12-18T00:38:27.8161098Z test_check_tensor_internal_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.010s) 2024-12-18T00:38:27.8166396Z test_clone_all_dtypes_and_devices_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:27.8175419Z test_clone_not_memory_dense_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:27.8187534Z test_clone_zero_stride_dim_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:27.8202510Z test_complex_half_experimental_warning_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:27.8211584Z test_constants_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:27.8314248Z test_conv_transposed_backward_agnostic_to_memory_format_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.010s) 2024-12-18T00:38:27.8323161Z test_conv_transposed_large_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:27.8337219Z test_copy__xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:27.8346777Z test_copy_all_dtypes_and_devices_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:27.8362599Z test_copy_math_view_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:27.8371554Z test_copy_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:27.8384068Z test_copy_transpose_math_view_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:27.8396429Z test_copy_transpose_math_view_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:27.8408736Z test_copy_transpose_math_view_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:27.8417675Z test_corrcoef_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:27.8426776Z test_corrcoef_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:27.8435561Z test_corrcoef_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:27.8444511Z test_cov_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:27.8889371Z test_cpp_warnings_have_python_context_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.044s) 2024-12-18T00:38:27.8905511Z test_cublas_config_nondeterministic_alert_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:38:27.8928099Z test_cummax_cummin_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:27.8939069Z test_cummax_discontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:27.8950152Z test_cummin_discontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.0608915Z test_cumprod_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.166s) 2024-12-18T00:38:28.0628695Z test_cumsum_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:28.0639157Z test_deepcopy_scalar_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:28.0652644Z test_deepcopy_scalar_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:28.0668807Z test_deepcopy_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:28.0680647Z test_deterministic_cumsum_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:28.0695492Z test_deterministic_empty_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0710158Z test_deterministic_empty_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0724859Z test_deterministic_empty_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:28.0739442Z test_deterministic_empty_xla_complex32 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2024-12-18T00:38:28.0754139Z test_deterministic_empty_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:28.0768547Z test_deterministic_empty_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:28.0783109Z test_deterministic_empty_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0797670Z test_deterministic_empty_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0812113Z test_deterministic_empty_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0826788Z test_deterministic_empty_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0841362Z test_deterministic_empty_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0856411Z test_deterministic_empty_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0871173Z test_deterministic_empty_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0885749Z test_deterministic_empty_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0900475Z test_deterministic_empty_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.0915001Z test_deterministic_empty_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:28.1668105Z test_deterministic_interpolate_bilinear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.075s) 2024-12-18T00:38:28.1723279Z test_deterministic_replication_pad2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.006s) 2024-12-18T00:38:28.1745987Z test_deterministic_resize_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1767555Z test_deterministic_resize_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1789449Z test_deterministic_resize_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:38:28.1810777Z test_deterministic_resize_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:38:28.1832236Z test_deterministic_resize_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:38:28.1854082Z test_deterministic_resize_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1875736Z test_deterministic_resize_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1897144Z test_deterministic_resize_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1918598Z test_deterministic_resize_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1940284Z test_deterministic_resize_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1962161Z test_deterministic_resize_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.1983869Z test_deterministic_resize_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.2005374Z test_deterministic_resize_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.2026763Z test_deterministic_resize_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.2048490Z test_deterministic_resize_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:28.2072179Z test_device_guard_xla (__main__.TestTorchDeviceTypeXLA) ... skip: fewer than 2 devices detected (0.002s) 2024-12-18T00:38:28.2083477Z test_diff_noncontig_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2094558Z test_diff_noncontig_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:28.2105591Z test_diff_noncontig_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:28.2116542Z test_diff_noncontig_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:28.2127621Z test_diff_noncontig_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2138949Z test_diff_noncontig_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2150307Z test_diff_noncontig_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2161386Z test_diff_noncontig_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2172423Z test_diff_noncontig_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2183707Z test_diff_noncontig_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2194761Z test_diff_noncontig_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:28.2207871Z test_diff_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2221743Z test_diff_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:28.2235266Z test_diff_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:28.2248804Z test_diff_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2262337Z test_diff_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2275767Z test_diff_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2289124Z test_diff_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2302748Z test_diff_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2316178Z test_diff_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2329520Z test_diff_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2397211Z test_dim_function_empty_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.007s) 2024-12-18T00:38:28.2406658Z test_discontiguous_out_cumsum_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2416795Z test_dist_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:28.2425672Z test_dtypetensor_warnings_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:28.2436911Z test_errors_index_copy_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:28.2444078Z test_expected_failure_xla_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:28.6811274Z test_exponential_kstest_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.436s) 2024-12-18T00:38:28.6819987Z test_exponential_kstest_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:28.9963030Z test_exponential_kstest_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.313s) 2024-12-18T00:38:29.2539949Z test_exponential_kstest_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.258s) 2024-12-18T00:38:29.2547834Z test_exponential_no_zero_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:29.2557208Z test_exponential_no_zero_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:29.3460019Z test_exponential_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.090s) 2024-12-18T00:38:29.3470549Z test_exponential_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:29.4306285Z test_exponential_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.083s) 2024-12-18T00:38:29.5139054Z test_exponential_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.083s) 2024-12-18T00:38:29.5146028Z test_gather_backward_deterministic_path_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.5154232Z test_gather_backward_one_dim_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:29.5163464Z test_geometric_kstest_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:29.5184904Z test_geometric_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:29.5194328Z test_geometric_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:29.5218408Z test_geometric_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:29.5237141Z test_geometric_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:29.5676228Z test_geometric_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.044s) 2024-12-18T00:38:29.6106494Z test_geometric_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2024-12-18T00:38:29.6542052Z test_geometric_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2024-12-18T00:38:29.6978773Z test_geometric_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2024-12-18T00:38:29.7413615Z test_geometric_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2024-12-18T00:38:29.7420481Z test_grad_scale_will_not_overflow_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7428926Z test_grad_scaler_deprecated_warning_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7445694Z test_grad_scaler_pass_itself_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7456135Z test_grad_scaling_accumulation_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7475424Z test_grad_scaling_autocast_foreach0_fused0_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7494001Z test_grad_scaling_autocast_foreach0_fused0_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7511679Z test_grad_scaling_autocast_foreach0_fused0_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7530042Z test_grad_scaling_autocast_foreach2_fused_True_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7547234Z test_grad_scaling_autocast_foreach2_fused_True_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7566208Z test_grad_scaling_autocast_foreach2_fused_True_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7583133Z test_grad_scaling_autocast_foreach_True_fused1_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7602033Z test_grad_scaling_autocast_foreach_True_fused1_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7619093Z test_grad_scaling_autocast_foreach_True_fused1_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7631707Z test_grad_scaling_clipping_separate_unscale_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7644511Z test_grad_scaling_clipping_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7662996Z test_grad_scaling_multiple_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7678513Z test_grad_scaling_penalty_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7690618Z test_grad_scaling_state_dict_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7715801Z test_grad_scaling_unscale_sparse_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7745828Z test_grad_scaling_unscale_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:29.7776885Z test_grad_scaling_unscale_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:38:29.7788118Z test_grad_scaling_update_scale_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7810738Z test_gradient_all_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:38:29.7832351Z test_gradient_all_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7853528Z test_gradient_all_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.7868104Z test_gradient_extreme_cases_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:29.7882541Z test_gradient_extreme_cases_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7897143Z test_gradient_extreme_cases_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7911445Z test_gradient_spacing_list_length_error_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:29.7923314Z test_gradient_spacing_list_length_error_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7936424Z test_gradient_spacing_list_length_error_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.7960105Z test_gradient_type_promotion_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:29.9743100Z test_hook_remove_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.178s) 2024-12-18T00:38:29.9755821Z test_index_add_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9768176Z test_index_add_large_inputs_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:29.9779751Z test_index_add_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:29.9791490Z test_index_copy_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9802868Z test_index_copy_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9813585Z test_index_copy_scalars_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9824382Z test_index_copy_scalars_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9835039Z test_index_copy_scalars_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:29.9846002Z test_index_copy_scalars_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:29.9856510Z test_index_copy_scalars_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:29.9867489Z test_index_copy_scalars_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9878101Z test_index_copy_scalars_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9888733Z test_index_copy_scalars_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9899614Z test_index_copy_scalars_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9910302Z test_index_copy_scalars_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9921023Z test_index_copy_scalars_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9931734Z test_index_copy_scalars_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9947286Z test_index_copy_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:29.9957573Z test_index_fill_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:29.9969606Z test_index_fill_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:29.9982386Z test_index_put_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:29.9993705Z test_index_put_non_accumulate_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:30.0015924Z test_index_reduce_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:30.0036545Z test_index_select_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0056079Z test_index_select_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0077367Z test_index_select_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:38:30.0098000Z test_index_select_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:38:30.0118043Z test_index_select_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:38:30.0138141Z test_index_select_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0158767Z test_index_select_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0178939Z test_index_select_xla_float8_e4m3fn (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0199975Z test_index_select_xla_float8_e4m3fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0220022Z test_index_select_xla_float8_e5m2 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0241030Z test_index_select_xla_float8_e5m2fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0260605Z test_index_select_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0282070Z test_index_select_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0301542Z test_index_select_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0322590Z test_index_select_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0342200Z test_index_select_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.0358890Z test_invalid_shapes_grid_sampler_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:30.0374014Z test_is_set_to_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.0382917Z test_is_signed_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.0841463Z test_item_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.1297206Z test_item_xla_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.1303614Z test_item_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:30.1313870Z test_item_xla_complex32 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2024-12-18T00:38:30.1323599Z test_item_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:30.1333554Z test_item_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.1788019Z test_item_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.2245885Z test_item_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.2252458Z test_item_xla_float8_e4m3fn (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2024-12-18T00:38:30.2262695Z test_item_xla_float8_e4m3fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2024-12-18T00:38:30.2272761Z test_item_xla_float8_e5m2 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2024-12-18T00:38:30.2282861Z test_item_xla_float8_e5m2fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2024-12-18T00:38:30.2739224Z test_item_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.3194454Z test_item_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.3648179Z test_item_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.4099327Z test_item_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.4109048Z test_item_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2024-12-18T00:38:30.4119187Z test_item_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2024-12-18T00:38:30.4129320Z test_item_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2024-12-18T00:38:30.4583771Z test_item_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2024-12-18T00:38:30.4593454Z test_large_cumprod_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.4603668Z test_large_cumsum_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.4613032Z test_lazy_clone_binary_op_no_materialize_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4622551Z test_lazy_clone_binary_op_no_materialize_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4631848Z test_lazy_clone_binary_op_no_materialize_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:30.4641174Z test_lazy_clone_binary_op_no_materialize_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:30.4650729Z test_lazy_clone_binary_op_no_materialize_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.4660020Z test_lazy_clone_binary_op_no_materialize_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4669278Z test_lazy_clone_binary_op_no_materialize_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4678527Z test_lazy_clone_binary_op_no_materialize_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4687821Z test_lazy_clone_binary_op_no_materialize_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4697192Z test_lazy_clone_binary_op_no_materialize_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4706460Z test_lazy_clone_binary_op_no_materialize_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4715711Z test_lazy_clone_binary_op_no_materialize_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4734152Z test_lazy_clone_view_materialize_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4750568Z test_lazy_clone_view_materialize_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4768858Z test_lazy_clone_view_materialize_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:38:30.4785159Z test_lazy_clone_view_materialize_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:38:30.4803699Z test_lazy_clone_view_materialize_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:38:30.4820229Z test_lazy_clone_view_materialize_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4838907Z test_lazy_clone_view_materialize_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4855322Z test_lazy_clone_view_materialize_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4873359Z test_lazy_clone_view_materialize_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4891033Z test_lazy_clone_view_materialize_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4906971Z test_lazy_clone_view_materialize_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4925404Z test_lazy_clone_view_materialize_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2024-12-18T00:38:30.4937172Z test_lazy_clone_view_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4950049Z test_lazy_clone_view_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.4963968Z test_lazy_clone_view_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:30.4975488Z test_lazy_clone_view_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:30.4988297Z test_lazy_clone_view_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.5001034Z test_lazy_clone_view_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5013686Z test_lazy_clone_view_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5026463Z test_lazy_clone_view_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5040382Z test_lazy_clone_view_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5052148Z test_lazy_clone_view_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5064971Z test_lazy_clone_view_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5078796Z test_lazy_clone_view_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5089064Z test_lazy_clone_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5100593Z test_lazy_clone_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5111857Z test_lazy_clone_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:30.5123077Z test_lazy_clone_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:30.5134282Z test_lazy_clone_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.5145852Z test_lazy_clone_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5157140Z test_lazy_clone_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5168438Z test_lazy_clone_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5180027Z test_lazy_clone_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5191329Z test_lazy_clone_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5202650Z test_lazy_clone_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5213996Z test_lazy_clone_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:30.5241873Z test_log_normal_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5246752Z test_log_normal_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.5266450Z test_log_normal_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5292362Z test_log_normal_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5303803Z test_logcumsumexp_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:30.5312847Z test_lognormal_kstest_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:30.5322244Z test_masked_fill_bool_tensor_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.5332617Z test_masked_fill_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.5354696Z test_masked_fill_xla_bfloat16_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5375336Z test_masked_fill_xla_bfloat16_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5395819Z test_masked_fill_xla_bool_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5414549Z test_masked_fill_xla_bool_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5430002Z test_masked_fill_xla_complex128_bool (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:30.5443917Z test_masked_fill_xla_complex128_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:30.5459199Z test_masked_fill_xla_complex64_bool (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:30.5475103Z test_masked_fill_xla_complex64_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:30.5489953Z test_masked_fill_xla_float16_bool (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.5504165Z test_masked_fill_xla_float16_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:30.5525082Z test_masked_fill_xla_float32_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5542770Z test_masked_fill_xla_float32_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5564103Z test_masked_fill_xla_float64_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5581749Z test_masked_fill_xla_float64_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5602549Z test_masked_fill_xla_int16_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5620377Z test_masked_fill_xla_int16_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5641197Z test_masked_fill_xla_int32_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5659402Z test_masked_fill_xla_int32_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5680409Z test_masked_fill_xla_int64_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5698395Z test_masked_fill_xla_int64_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5719054Z test_masked_fill_xla_int8_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5737825Z test_masked_fill_xla_int8_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5758165Z test_masked_fill_xla_uint8_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.5776655Z test_masked_fill_xla_uint8_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.6330704Z test_masked_scatter_bool_tensor_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.055s) 2024-12-18T00:38:30.6343132Z test_masked_scatter_inplace_noncontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6353105Z test_masked_scatter_large_tensor_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:30.6362468Z test_masked_scatter_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.6382692Z test_masked_scatter_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6403469Z test_masked_scatter_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:38:30.6422244Z test_masked_scatter_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:38:30.6443057Z test_masked_scatter_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:38:30.6462024Z test_masked_scatter_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6483132Z test_masked_scatter_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6501883Z test_masked_scatter_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6522144Z test_masked_scatter_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6540966Z test_masked_scatter_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6561103Z test_masked_scatter_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6580713Z test_masked_scatter_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:30.6592848Z test_masked_select_discontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.6613532Z test_masked_select_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:30.6622984Z test_memory_format_clone_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.6646911Z test_memory_format_consistency_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:30.6658175Z test_memory_format_cpu_and_cuda_ops_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:30.6673141Z test_memory_format_empty_like_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:30.6685875Z test_memory_format_factory_like_functions_preserve_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:44.3797590Z test_memory_format_operators_xla (__main__.TestTorchDeviceTypeXLA) ... ok (13.711s) 2024-12-18T00:38:44.3821540Z test_memory_format_preserved_after_permute_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:44.3841297Z test_memory_format_propagation_rules_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:44.3851184Z test_memory_format_to_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:44.3864365Z test_memory_format_type_shortcuts_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:44.3874439Z test_memory_format_type_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:44.3882905Z test_module_share_memory_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:44.3898129Z test_multinomial_cpu_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:44.3914044Z test_multinomial_cpu_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:38:44.3924493Z test_multinomial_deterministic_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:44.3935467Z test_multinomial_deterministic_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:44.3946988Z test_multinomial_deterministic_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:44.3955215Z test_multinomial_device_constrain_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:44.4856983Z test_multinomial_empty_w_replacement_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.090s) 2024-12-18T00:38:44.5794596Z test_multinomial_empty_wo_replacement_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.094s) 2024-12-18T00:38:44.5800347Z test_multinomial_gpu_device_constrain_xla (__main__.TestTorchDeviceTypeXLA) ... skip: fewer than 2 devices detected (0.001s) 2024-12-18T00:38:44.5811767Z test_multinomial_rng_state_advance_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:44.5842556Z test_multinomial_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.003s) 2024-12-18T00:38:44.5850707Z test_narrow_copy_non_contiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:44.5874442Z test_narrow_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:44.5898826Z test_nondeterministic_alert_AdaptiveAvgPool2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:44.5923384Z test_nondeterministic_alert_AdaptiveAvgPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:44.5941084Z test_nondeterministic_alert_AdaptiveMaxPool2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:44.5968093Z test_nondeterministic_alert_AvgPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:44.8728724Z test_nondeterministic_alert_CTCLoss_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.276s) 2024-12-18T00:38:44.8745277Z test_nondeterministic_alert_EmbeddingBag_max_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:45.1352850Z test_nondeterministic_alert_FractionalMaxPool2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.260s) 2024-12-18T00:38:45.4260352Z test_nondeterministic_alert_FractionalMaxPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.291s) 2024-12-18T00:38:45.4297175Z test_nondeterministic_alert_MaxPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.004s) 2024-12-18T00:38:45.4312475Z test_nondeterministic_alert_MaxUnpool1d_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:45.4326549Z test_nondeterministic_alert_MaxUnpool1d_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:45.4340324Z test_nondeterministic_alert_MaxUnpool1d_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:45.4354192Z test_nondeterministic_alert_MaxUnpool2d_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:45.4367840Z test_nondeterministic_alert_MaxUnpool2d_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:45.4381565Z test_nondeterministic_alert_MaxUnpool2d_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:45.4395241Z test_nondeterministic_alert_MaxUnpool3d_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:45.4409001Z test_nondeterministic_alert_MaxUnpool3d_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:45.4422866Z test_nondeterministic_alert_MaxUnpool3d_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:45.4450695Z test_nondeterministic_alert_NLLLoss_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.4478076Z test_nondeterministic_alert_ReflectionPad1d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.4505105Z test_nondeterministic_alert_ReflectionPad2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.4533252Z test_nondeterministic_alert_ReflectionPad3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.4559873Z test_nondeterministic_alert_ReplicationPad1d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.4595302Z test_nondeterministic_alert_ReplicationPad2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.4626355Z test_nondeterministic_alert_ReplicationPad3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.4650141Z test_nondeterministic_alert_bincount_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:45.5783250Z test_nondeterministic_alert_grid_sample_2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.113s) 2024-12-18T00:38:45.6707069Z test_nondeterministic_alert_grid_sample_3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.092s) 2024-12-18T00:38:45.6727534Z test_nondeterministic_alert_histc_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:45.7714762Z test_nondeterministic_alert_interpolate_bicubic_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.098s) 2024-12-18T00:38:45.7739060Z test_nondeterministic_alert_interpolate_bilinear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:38:45.9139118Z test_nondeterministic_alert_interpolate_linear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.140s) 2024-12-18T00:38:45.9649695Z test_nondeterministic_alert_interpolate_trilinear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.051s) 2024-12-18T00:38:45.9697165Z test_nondeterministic_alert_kthvalue_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.005s) 2024-12-18T00:38:46.8966094Z test_nondeterministic_alert_median_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.927s) 2024-12-18T00:38:46.8984459Z test_nondeterministic_alert_put_accumulate_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:38:46.8995687Z test_nondeterministic_alert_put_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:46.9005012Z test_nondeterministic_resize_quantized_xla_qint32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:46.9013920Z test_nondeterministic_resize_quantized_xla_qint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:46.9022979Z test_nondeterministic_resize_quantized_xla_quint2x4 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:46.9032327Z test_nondeterministic_resize_quantized_xla_quint4x2 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:46.9040670Z test_nondeterministic_resize_quantized_xla_quint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:46.9050885Z test_normal_kstest_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:47.7813069Z test_normal_kstest_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.876s) 2024-12-18T00:38:48.5067158Z test_normal_kstest_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.726s) 2024-12-18T00:38:48.5179007Z test_nullary_op_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.011s) 2024-12-18T00:38:48.8755965Z test_pairwise_distance_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.358s) 2024-12-18T00:38:48.8769812Z test_parallel_cow_materialize_error_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:48.8784989Z test_params_invalidated_with_grads_invalidated_between_unscale_and_step_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:48.8799672Z test_params_invalidated_with_grads_invalidated_between_unscale_and_step_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:48.8812452Z test_params_invalidated_with_grads_invalidated_between_unscale_and_step_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:49.0649563Z test_pdist_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.183s) 2024-12-18T00:38:49.0657692Z test_pdist_norm_large_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:49.0674031Z test_pickle_gradscaler_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:49.0688039Z test_pin_memory_from_constructor_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:49.3484522Z test_put_accumulate_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.279s) 2024-12-18T00:38:49.3496612Z test_put_accumulate_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:49.3507614Z test_put_accumulate_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:49.3518961Z test_put_accumulate_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:49.8734989Z test_put_accumulate_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.521s) 2024-12-18T00:38:50.3358963Z test_put_accumulate_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.462s) 2024-12-18T00:38:50.8084394Z test_put_accumulate_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.472s) 2024-12-18T00:38:51.2507235Z test_put_accumulate_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.442s) 2024-12-18T00:38:51.6920676Z test_put_accumulate_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.441s) 2024-12-18T00:38:52.1968440Z test_put_accumulate_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.505s) 2024-12-18T00:38:52.7018552Z test_put_accumulate_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.505s) 2024-12-18T00:38:53.4928814Z test_put_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.791s) 2024-12-18T00:38:53.4940010Z test_put_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:53.4964814Z test_put_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:53.4977030Z test_reduced_type_float_copy_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:53.4989125Z test_reduced_type_float_copy_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:53.6377463Z test_repeat_interleave_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.138s) 2024-12-18T00:38:53.6508826Z test_scalar_check_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.013s) 2024-12-18T00:38:53.7279404Z test_scatter_add_bool_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.077s) 2024-12-18T00:38:53.9764961Z test_scatter_add_non_unique_index_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.248s) 2024-12-18T00:38:53.9779808Z test_scatter_add_one_dim_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:38:54.0390152Z test_scatter_add_to_large_input_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.061s) 2024-12-18T00:38:54.0995765Z test_scatter_bool_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.060s) 2024-12-18T00:38:54.1007346Z test_scatter_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:54.1018332Z test_scatter_reduce_multiply_unsupported_dtypes_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:54.1027835Z test_scatter_reduce_multiply_unsupported_dtypes_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:54.1041944Z test_scatter_reduce_non_unique_index_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:54.1056272Z test_scatter_reduce_non_unique_index_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:54.2669852Z test_scatter_reduce_non_unique_index_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py:3833: UserWarning: The reduce argument of torch.scatter with Tensor src is deprecated and will be removed in a future PyTorch release. Use torch.scatter_reduce instead for more reduction options. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:234.) 2024-12-18T00:38:54.2672166Z input.scatter_(0, index, src, reduce=operation) 2024-12-18T00:38:54.2681684Z ok (0.162s) 2024-12-18T00:38:54.4276073Z test_scatter_reduce_non_unique_index_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.159s) 2024-12-18T00:38:54.4288826Z test_scatter_reduce_operations_to_large_input_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:38:54.4305236Z test_scatter_reduce_operations_to_large_input_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:38:54.4879844Z test_scatter_reduce_operations_to_large_input_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.057s) 2024-12-18T00:38:54.6003659Z test_scatter_reduce_operations_to_large_input_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.112s) 2024-12-18T00:38:54.6017325Z test_scatter_reduce_scalar_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:38:54.6033345Z test_scatter_reduce_scalar_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:54.7158849Z test_scatter_reduce_scalar_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.112s) 2024-12-18T00:38:54.8280203Z test_scatter_reduce_scalar_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.112s) 2024-12-18T00:38:54.8850345Z test_scatter_to_large_input_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.057s) 2024-12-18T00:38:54.8860060Z test_scatter_zero_size_index_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.8874231Z test_serialization_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:54.8886839Z test_set_default_tensor_type_warnings_xla (__main__.TestTorchDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/__init__.py:1210: UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/tensor/python_tensor.cpp:436.) 2024-12-18T00:38:54.8888758Z _C._set_default_tensor_type(t) 2024-12-18T00:38:54.8889049Z ok (0.001s) 2024-12-18T00:38:54.8899699Z test_set_storage_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.8912254Z test_set_storage_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.8924783Z test_set_storage_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:54.8937540Z test_set_storage_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:54.8950245Z test_set_storage_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:54.8962850Z test_set_storage_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.8975508Z test_set_storage_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.8988316Z test_set_storage_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9002581Z test_set_storage_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9013583Z test_set_storage_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9026743Z test_set_storage_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9039015Z test_set_storage_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9047773Z test_shift_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:54.9055087Z test_skip_xla_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:38:54.9066707Z test_storage_all_devices_non_blocking_False_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:54.9077902Z test_storage_all_devices_non_blocking_True_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:38:54.9094650Z test_storage_meta_errors_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py:345: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2024-12-18T00:38:54.9096790Z s0 = torch.TypedStorage([1, 2, 3, 4], device='meta', dtype=dtype) 2024-12-18T00:38:54.9188061Z ok (0.011s) 2024-12-18T00:38:54.9273436Z test_storage_meta_errors_xla_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9284263Z test_storage_meta_errors_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:54.9299172Z test_storage_meta_errors_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:54.9315029Z test_storage_meta_errors_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:54.9399060Z test_storage_meta_errors_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9477667Z test_storage_meta_errors_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9558382Z test_storage_meta_errors_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9639525Z test_storage_meta_errors_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9718683Z test_storage_meta_errors_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9800282Z test_storage_meta_errors_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9880989Z test_storage_meta_errors_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:38:54.9887201Z test_storage_meta_from_tensor_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9896456Z test_storage_meta_from_tensor_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9905678Z test_storage_meta_from_tensor_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:54.9914801Z test_storage_meta_from_tensor_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:54.9923890Z test_storage_meta_from_tensor_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:54.9933085Z test_storage_meta_from_tensor_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9942484Z test_storage_meta_from_tensor_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9952192Z test_storage_meta_from_tensor_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9961346Z test_storage_meta_from_tensor_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9970571Z test_storage_meta_from_tensor_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9979954Z test_storage_meta_from_tensor_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9989161Z test_storage_meta_from_tensor_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:54.9997558Z test_storage_meta_ok_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0006298Z test_storage_meta_ok_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0014682Z test_storage_meta_ok_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:55.0023300Z test_storage_meta_ok_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:55.0031910Z test_storage_meta_ok_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:38:55.0040175Z test_storage_meta_ok_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0049355Z test_storage_meta_ok_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0058347Z test_storage_meta_ok_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0066641Z test_storage_meta_ok_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0075163Z test_storage_meta_ok_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0083621Z test_storage_meta_ok_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0092089Z test_storage_meta_ok_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:38:55.0105990Z test_storage_setitem_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0120532Z test_storage_setitem_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:38:55.0133195Z test_storage_setitem_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:38:55.0147147Z test_storage_setitem_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0161608Z test_storage_setitem_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0174274Z test_storage_setitem_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0187999Z test_storage_setitem_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0203115Z test_storage_setitem_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0215360Z test_storage_setitem_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0230023Z test_storage_setitem_xla_qint32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0242788Z test_storage_setitem_xla_qint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0256739Z test_storage_setitem_xla_quint4x2 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0271217Z test_storage_setitem_xla_quint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0283788Z test_storage_setitem_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:38:55.0297914Z test_storage_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:38:55.0318463Z test_strides_propagation_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:38:55.0337896Z test_sync_warning_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:38:55.3608135Z test_take_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.327s) 2024-12-18T00:39:01.1011069Z test_take_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (5.740s) 2024-12-18T00:39:05.0404957Z test_take_xla_bool (__main__.TestTorchDeviceTypeXLA) ... ok (3.939s) 2024-12-18T00:39:05.0420340Z test_take_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:39:05.0436635Z test_take_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:39:05.0452182Z test_take_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:39:09.3818867Z test_take_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (4.336s) 2024-12-18T00:39:13.4051663Z test_take_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (4.023s) 2024-12-18T00:39:17.3806564Z test_take_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (3.975s) 2024-12-18T00:39:21.3832516Z test_take_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (4.003s) 2024-12-18T00:39:25.3757871Z test_take_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (3.992s) 2024-12-18T00:39:29.3803641Z test_take_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (4.004s) 2024-12-18T00:39:33.3741441Z test_take_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (3.994s) 2024-12-18T00:39:33.3757697Z test_tensor_from_storage_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:39:33.3771081Z test_tensor_from_storage_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3783785Z test_tensor_from_storage_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:39:33.3795983Z test_tensor_from_storage_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:39:33.3808286Z test_tensor_from_storage_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:39:33.3820829Z test_tensor_from_storage_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3833131Z test_tensor_from_storage_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3845693Z test_tensor_from_storage_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3858030Z test_tensor_from_storage_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3870156Z test_tensor_from_storage_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3882583Z test_tensor_from_storage_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3894651Z test_tensor_from_storage_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3906958Z test_tensor_from_storage_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3919069Z test_tensor_from_storage_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3931277Z test_tensor_from_storage_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3941513Z test_tensor_set_errors_multigpu_xla (__main__.TestTorchDeviceTypeXLA) ... skip: fewer than 2 devices detected (0.001s) 2024-12-18T00:39:33.3972124Z test_tensor_shape_empty_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.003s) 2024-12-18T00:39:33.3981787Z test_tensor_storage_type_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.3991217Z test_tensor_storage_type_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4000765Z test_tensor_storage_type_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:39:33.4010089Z test_tensor_storage_type_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:39:33.4019777Z test_tensor_storage_type_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:39:33.4029316Z test_tensor_storage_type_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4038862Z test_tensor_storage_type_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4048718Z test_tensor_storage_type_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4058419Z test_tensor_storage_type_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4067995Z test_tensor_storage_type_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4077394Z test_tensor_storage_type_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4086944Z test_tensor_storage_type_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4110830Z test_tensor_type_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:39:33.4121034Z test_ternary_op_mem_overlap_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2024-12-18T00:39:33.4130823Z test_typed_storage_meta_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4140638Z test_typed_storage_meta_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4150470Z test_typed_storage_meta_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:39:33.4159945Z test_typed_storage_meta_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:39:33.4169406Z test_typed_storage_meta_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:39:33.4179290Z test_typed_storage_meta_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4188786Z test_typed_storage_meta_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4198261Z test_typed_storage_meta_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4207827Z test_typed_storage_meta_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4217634Z test_typed_storage_meta_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4227187Z test_typed_storage_meta_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:33.4236813Z test_typed_storage_meta_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:34.0149154Z test_uniform_kstest_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.591s) 2024-12-18T00:39:34.0159715Z test_uniform_kstest_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:39:34.5099993Z test_uniform_kstest_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.494s) 2024-12-18T00:39:34.9337492Z test_uniform_kstest_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.423s) 2024-12-18T00:39:34.9347010Z test_untyped_storage_meta_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:39:34.9357376Z test_warn_always_caught_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:39:34.9376229Z test_where_scalar_handcrafted_values_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:39:34.9377212Z 2024-12-18T00:39:34.9377510Z ---------------------------------------------------------------------- 2024-12-18T00:39:34.9377957Z Ran 615 tests in 73.869s 2024-12-18T00:39:34.9378132Z 2024-12-18T00:39:34.9378378Z OK (skipped=456) 2024-12-18T00:39:34.9378642Z 2024-12-18T00:39:34.9378843Z Generating XML reports... 2024-12-18T00:39:34.9858747Z Generated XML report: test-reports/python-unittest/test.......test.test_torch/TEST-TestTorchDeviceTypeXLA-20241218003821.xml 2024-12-18T00:39:35.9896749Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2024-12-18T00:39:35.9897737Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestDevicePrecisionXLA 2024-12-18T00:39:35.9898755Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2024-12-18T00:39:35.9899618Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:39:35.9900292Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2024-12-18T00:39:35.9901203Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestDevicePrecisionXLA 2024-12-18T00:39:35.9902279Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2024-12-18T00:39:35.9902924Z ++ command -v nvidia-smi 2024-12-18T00:39:35.9903189Z + '[' -x '' ']' 2024-12-18T00:39:35.9903433Z + PJRT_DEVICE=CPU 2024-12-18T00:39:35.9903685Z + CPU_NUM_DEVICES=1 2024-12-18T00:39:35.9904204Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2024-12-18T00:39:35.9904770Z + '[' 0 '!=' 0 ']' 2024-12-18T00:39:35.9905266Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2024-12-18T00:39:40.3456984Z 2024-12-18T00:39:40.3457441Z Running tests... 2024-12-18T00:39:40.3457824Z ---------------------------------------------------------------------- 2024-12-18T00:39:40.3458797Z Test results will be stored in test-reports/python-unittest/test.......test.test_torch 2024-12-18T00:39:40.4666152Z test_advancedindex_mixed_cpu_devices_xla (__main__.TestDevicePrecisionXLA) ... ok (0.121s) 2024-12-18T00:39:40.5130487Z test_advancedindex_mixed_devices_error_xla (__main__.TestDevicePrecisionXLA) ... ok (0.046s) 2024-12-18T00:39:46.2764660Z test_clamp_xla_float32 (__main__.TestDevicePrecisionXLA) ... ok (5.763s) 2024-12-18T00:39:51.5153735Z test_clamp_xla_float64 (__main__.TestDevicePrecisionXLA) ... ok (5.239s) 2024-12-18T00:39:56.6683764Z test_clamp_xla_int64 (__main__.TestDevicePrecisionXLA) ... ok (5.153s) 2024-12-18T00:39:56.6691586Z test_copy_broadcast_xla (__main__.TestDevicePrecisionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:39:56.7619720Z test_copy_noncontig_xla (__main__.TestDevicePrecisionXLA) ... ok (0.092s) 2024-12-18T00:39:56.7631527Z test_cuda_device_idx_xla (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2024-12-18T00:39:56.8612118Z test_device_serialization_xla (__main__.TestDevicePrecisionXLA) ... ok (0.097s) 2024-12-18T00:39:56.8623711Z test_from_sequence_xla_float32 (__main__.TestDevicePrecisionXLA) ... ok (0.002s) 2024-12-18T00:39:56.8640327Z test_from_sequence_xla_float64 (__main__.TestDevicePrecisionXLA) ... ok (0.002s) 2024-12-18T00:39:56.8654457Z test_from_sequence_xla_int16 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2024-12-18T00:39:56.8669466Z test_from_sequence_xla_int32 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2024-12-18T00:39:56.8684205Z test_from_sequence_xla_int64 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2024-12-18T00:39:56.8698375Z test_from_sequence_xla_int8 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2024-12-18T00:39:56.8714306Z test_from_sequence_xla_uint8 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2024-12-18T00:39:56.8724048Z test_index_add_bfloat16_xla (__main__.TestDevicePrecisionXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:39:56.8733839Z test_multidevice_serialization_xla (__main__.TestDevicePrecisionXLA) ... skip: fewer than 2 devices detected (0.001s) 2024-12-18T00:39:56.8742785Z test_type_conversions_same_device_xla (__main__.TestDevicePrecisionXLA) ... skip: fewer than 2 devices detected (0.001s) 2024-12-18T00:39:56.8743577Z 2024-12-18T00:39:56.8743746Z ---------------------------------------------------------------------- 2024-12-18T00:39:56.8744293Z Ran 19 tests in 16.529s 2024-12-18T00:39:56.8744526Z 2024-12-18T00:39:56.8744678Z OK (skipped=4) 2024-12-18T00:39:56.8744879Z 2024-12-18T00:39:56.8745005Z Generating XML reports... 2024-12-18T00:39:56.8784847Z Generated XML report: test-reports/python-unittest/test.......test.test_torch/TEST-TestDevicePrecisionXLA-20241218003940.xml 2024-12-18T00:39:57.7795710Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2024-12-18T00:39:57.7796696Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestTensorDeviceOpsXLA 2024-12-18T00:39:57.7797714Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2024-12-18T00:39:57.7798384Z ++ command -v nvidia-smi 2024-12-18T00:39:57.7798679Z + '[' -x '' ']' 2024-12-18T00:39:57.7798937Z + PJRT_DEVICE=CPU 2024-12-18T00:39:57.7799199Z + CPU_NUM_DEVICES=1 2024-12-18T00:39:57.7799725Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2024-12-18T00:39:57.7800334Z + '[' 0 '!=' 0 ']' 2024-12-18T00:39:57.7800833Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2024-12-18T00:40:02.1227819Z 2024-12-18T00:40:02.1228334Z Running tests... 2024-12-18T00:40:02.1228728Z ---------------------------------------------------------------------- 2024-12-18T00:40:02.1229039Z 2024-12-18T00:40:02.1229199Z ---------------------------------------------------------------------- 2024-12-18T00:40:02.1229589Z Ran 0 tests in 0.000s 2024-12-18T00:40:02.1230052Z 2024-12-18T00:40:02.1230219Z OK 2024-12-18T00:40:02.1230333Z 2024-12-18T00:40:02.1230514Z Generating XML reports... 2024-12-18T00:40:02.1263056Z Test results will be stored in test-reports/python-unittest/test.......test.test_torch 2024-12-18T00:40:02.9687446Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2024-12-18T00:40:02.9688983Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py' -v TestIndexingXLA 2024-12-18T00:40:02.9690417Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2024-12-18T00:40:02.9691054Z ++ command -v nvidia-smi 2024-12-18T00:40:02.9691401Z + '[' -x '' ']' 2024-12-18T00:40:02.9691659Z + PJRT_DEVICE=CPU 2024-12-18T00:40:02.9691904Z + CPU_NUM_DEVICES=1 2024-12-18T00:40:02.9692416Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2024-12-18T00:40:02.9692985Z + '[' 0 '!=' 0 ']' 2024-12-18T00:40:02.9693509Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2024-12-18T00:40:06.3478888Z 2024-12-18T00:40:06.3479395Z Running tests... 2024-12-18T00:40:06.3479900Z ---------------------------------------------------------------------- 2024-12-18T00:40:06.3480528Z Test results will be stored in test-reports/python-unittest/test.......test.test_indexing 2024-12-18T00:40:06.4311582Z test_advancedindex_big_xla (__main__.TestIndexingXLA) ... ok (0.083s) 2024-12-18T00:40:06.4495817Z test_advancedindex_xla_float16 (__main__.TestIndexingXLA) ... skip: XLA does not support dtype torch.float16 (0.019s) 2024-12-18T00:40:06.4680808Z test_advancedindex_xla_float64 (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.018s) 2024-12-18T00:40:06.6709697Z test_basic_advanced_combined_xla (__main__.TestIndexingXLA) ... ok (0.203s) 2024-12-18T00:40:06.8194646Z test_bool_indices_accumulate_xla (__main__.TestIndexingXLA) ... ok (0.148s) 2024-12-18T00:40:06.8205184Z test_bool_indices_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.0277491Z test_byte_mask2d_xla (__main__.TestIndexingXLA) ... ok (0.207s) 2024-12-18T00:40:07.0285471Z test_byte_mask_accumulate_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.0295780Z test_byte_mask_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.0306120Z test_byte_tensor_assignment_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.0315049Z test_cpu_indices_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:40:07.0332451Z test_cuda_broadcast_index_use_deterministic_algorithms_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:40:07.1286824Z test_ellipsis_tensor_xla (__main__.TestIndexingXLA) ... ok (0.095s) 2024-12-18T00:40:07.2704206Z test_empty_index_xla (__main__.TestIndexingXLA) ... ok (0.142s) 2024-12-18T00:40:07.2725031Z test_empty_ndim_index_bool_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:07.2732623Z test_empty_ndim_index_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.2741192Z test_empty_slice_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.2752084Z test_gather_take_along_dim_cross_device_xla_float32 (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:40:07.2764361Z test_getitem_scalars_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.2774941Z test_index_getitem_copy_bools_slices_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:07.2787083Z test_index_ind_dtype_xla (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:40:07.2797840Z test_index_limits_xla (__main__.TestIndexingXLA) ... ok (0.001s) 2024-12-18T00:40:07.2809007Z test_index_put_accumulate_duplicate_indices_xla (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:40:07.2816054Z test_index_put_accumulate_empty_xla (__main__.TestIndexingXLA) ... skip: Marked as skipped for XLA (0.001s) 2024-12-18T00:40:07.2832725Z test_index_put_accumulate_expanded_values_xla (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:40:16.5104233Z test_index_put_accumulate_large_tensor_xla (__main__.TestIndexingXLA) ... ok (9.227s) 2024-12-18T00:40:16.5116661Z test_index_put_accumulate_non_contiguous_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:40:16.5128151Z test_index_put_accumulate_with_optional_tensors_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:40:16.5140362Z test_index_put_large_indices_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:40:16.5158117Z test_index_put_src_datatype_xla_bfloat16 (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:16.5172840Z test_index_put_src_datatype_xla_bool (__main__.TestIndexingXLA) ... ok (0.001s) 2024-12-18T00:40:16.5182798Z test_index_put_src_datatype_xla_complex128 (__main__.TestIndexingXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:40:16.5193157Z test_index_put_src_datatype_xla_complex64 (__main__.TestIndexingXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:40:16.5207813Z test_index_put_src_datatype_xla_float32 (__main__.TestIndexingXLA) ... ok (0.001s) 2024-12-18T00:40:16.5221509Z test_index_put_src_datatype_xla_int64 (__main__.TestIndexingXLA) ... ok (0.001s) 2024-12-18T00:40:16.6511484Z test_index_scalar_with_bool_mask_xla (__main__.TestIndexingXLA) ... ok (0.129s) 2024-12-18T00:40:16.6521839Z test_index_setitem_bools_slices_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:16.6538749Z test_index_src_datatype_xla_bfloat16 (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:16.6554714Z test_index_src_datatype_xla_bool (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:16.6571542Z test_index_src_datatype_xla_float32 (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:16.6586601Z test_index_src_datatype_xla_int64 (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:22.5648040Z test_index_xla (__main__.TestIndexingXLA) ... ok (5.906s) 2024-12-18T00:40:22.6590053Z test_int_assignment_xla (__main__.TestIndexingXLA) ... ok (0.094s) 2024-12-18T00:40:22.7079580Z test_int_indices2d_xla (__main__.TestIndexingXLA) ... ok (0.049s) 2024-12-18T00:40:22.7575843Z test_int_indices_broadcast_xla (__main__.TestIndexingXLA) ... ok (0.049s) 2024-12-18T00:40:22.7600380Z test_int_indices_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:22.7606470Z test_invalid_device_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:40:22.7615839Z test_invalid_index_xla (__main__.TestIndexingXLA) ... ok (0.001s) 2024-12-18T00:40:22.9682092Z test_jit_indexing_xla (__main__.TestIndexingXLA) ... ok (0.206s) 2024-12-18T00:40:22.9704062Z test_multiple_bool_indices_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:22.9713863Z test_multiple_byte_mask_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:22.9734262Z test_multiple_int_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:22.9750113Z test_none_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:22.9773653Z test_out_of_bound_index_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:23.0202191Z test_set_item_to_scalar_tensor_xla (__main__.TestIndexingXLA) ... ok (0.043s) 2024-12-18T00:40:23.0207634Z test_setitem_expansion_error_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:23.0218133Z test_setitem_scalars_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:23.0232452Z test_single_int_xla (__main__.TestIndexingXLA) ... ok (0.001s) 2024-12-18T00:40:23.1104783Z test_step_assignment_xla (__main__.TestIndexingXLA) ... ok (0.087s) 2024-12-18T00:40:23.3746608Z test_step_xla (__main__.TestIndexingXLA) ... ok (0.264s) 2024-12-18T00:40:23.3779123Z test_take_along_dim_invalid_xla_float32 (__main__.TestIndexingXLA) ... ok (0.003s) 2024-12-18T00:40:23.3808450Z test_take_along_dim_invalid_xla_int64 (__main__.TestIndexingXLA) ... ok (0.003s) 2024-12-18T00:40:25.5986645Z test_take_along_dim_xla_float32 (__main__.TestIndexingXLA) ... ok (2.218s) 2024-12-18T00:40:27.2834296Z test_take_along_dim_xla_int64 (__main__.TestIndexingXLA) ... ok (1.684s) 2024-12-18T00:40:27.2849458Z test_unravel_index_errors_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:27.4288155Z test_variable_slicing_xla (__main__.TestIndexingXLA) ... ok (0.143s) 2024-12-18T00:40:27.4301288Z test_zero_dim_index_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2024-12-18T00:40:27.4301897Z 2024-12-18T00:40:27.4302150Z ---------------------------------------------------------------------- 2024-12-18T00:40:27.4302653Z Ran 67 tests in 21.083s 2024-12-18T00:40:27.4302822Z 2024-12-18T00:40:27.4302944Z OK (skipped=27) 2024-12-18T00:40:27.4303181Z 2024-12-18T00:40:27.4303425Z Generating XML reports... 2024-12-18T00:40:27.4380092Z Generated XML report: test-reports/python-unittest/test.......test.test_indexing/TEST-TestIndexingXLA-20241218004006.xml 2024-12-18T00:40:28.1301607Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2024-12-18T00:40:28.1302540Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py' -v NumpyTestsXLA 2024-12-18T00:40:28.1303453Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2024-12-18T00:40:28.1304391Z ++ command -v nvidia-smi 2024-12-18T00:40:28.1306610Z + '[' -x '' ']' 2024-12-18T00:40:28.1307015Z + PJRT_DEVICE=CPU 2024-12-18T00:40:28.1307317Z + CPU_NUM_DEVICES=1 2024-12-18T00:40:28.1307823Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2024-12-18T00:40:28.1308383Z + '[' 0 '!=' 0 ']' 2024-12-18T00:40:28.1308854Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2024-12-18T00:40:31.4928234Z 2024-12-18T00:40:31.4928691Z Running tests... 2024-12-18T00:40:31.4929224Z ---------------------------------------------------------------------- 2024-12-18T00:40:31.4940430Z Test results will be stored in test-reports/python-unittest/test.......test.test_indexing 2024-12-18T00:40:31.4941207Z test_boolean_assignment_value_mismatch_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:40:31.5007963Z test_boolean_indexing_alldims_xla (__main__.NumpyTestsXLA) ... ok (0.006s) 2024-12-18T00:40:31.6017825Z test_boolean_indexing_onedim_xla (__main__.NumpyTestsXLA) ... ok (0.101s) 2024-12-18T00:40:31.9698490Z test_boolean_indexing_twodim_xla (__main__.NumpyTestsXLA) ... ok (0.368s) 2024-12-18T00:40:31.9706661Z test_boolean_indexing_weirdness_tensors_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:31.9715336Z test_boolean_indexing_weirdness_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:32.0692862Z test_boolean_list_indexing_xla (__main__.NumpyTestsXLA) ... ok (0.097s) 2024-12-18T00:40:32.0700993Z test_boolean_shape_mismatch_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:32.1805232Z test_broadcast_subspace_xla (__main__.NumpyTestsXLA) ... ok (0.110s) 2024-12-18T00:40:32.1811401Z test_broaderrors_indexing_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:32.1822306Z test_ellipsis_index_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:32.1831093Z test_empty_fancy_index_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:32.1838366Z test_empty_tuple_index_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:32.1847886Z test_everything_returns_views_xla (__main__.NumpyTestsXLA) ... ok (0.001s) 2024-12-18T00:40:32.2493308Z test_index_is_larger_xla (__main__.NumpyTestsXLA) ... ok (0.064s) 2024-12-18T00:40:32.2525131Z test_index_no_floats_xla (__main__.NumpyTestsXLA) ... ok (0.003s) 2024-12-18T00:40:32.2531324Z test_none_index_xla (__main__.NumpyTestsXLA) ... ok (0.001s) 2024-12-18T00:40:32.4122229Z test_single_bool_index_xla (__main__.NumpyTestsXLA) ... ok (0.159s) 2024-12-18T00:40:32.5016603Z test_single_int_index_xla (__main__.NumpyTestsXLA) ... ok (0.089s) 2024-12-18T00:40:32.5023494Z test_trivial_fancy_out_of_bounds_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:40:32.5037422Z test_truncate_leading_1s_xla (__main__.NumpyTestsXLA) ... ok (0.001s) 2024-12-18T00:40:32.5037877Z 2024-12-18T00:40:32.5038201Z ---------------------------------------------------------------------- 2024-12-18T00:40:32.5038964Z Ran 21 tests in 1.011s 2024-12-18T00:40:32.5039157Z 2024-12-18T00:40:32.5039266Z OK (skipped=9) 2024-12-18T00:40:32.5039420Z 2024-12-18T00:40:32.5039528Z Generating XML reports... 2024-12-18T00:40:32.5095451Z Generated XML report: test-reports/python-unittest/test.......test.test_indexing/TEST-NumpyTestsXLA-20241218004031.xml 2024-12-18T00:40:33.1881669Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:33.1882782Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py' -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:33.1883891Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:33.1884691Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:40:33.1885411Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:33.1886424Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py' -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:33.1887467Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:33.1888143Z ++ command -v nvidia-smi 2024-12-18T00:40:33.1888423Z + '[' -x '' ']' 2024-12-18T00:40:33.1888669Z + PJRT_DEVICE=CPU 2024-12-18T00:40:33.1888926Z + CPU_NUM_DEVICES=1 2024-12-18T00:40:33.1889476Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:33.1890099Z + '[' 0 '!=' 0 ']' 2024-12-18T00:40:33.1890633Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2024-12-18T00:40:36.5189814Z 2024-12-18T00:40:36.5190271Z Running tests... 2024-12-18T00:40:36.5190676Z ---------------------------------------------------------------------- 2024-12-18T00:40:36.5191360Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_dropout 2024-12-18T00:40:37.1195941Z test_Dropout1d_xla_float64 (__main__.TestDropoutNNDeviceTypeXLA) ... ok (0.600s) 2024-12-18T00:40:37.1207926Z test_Dropout2d_xla (__main__.TestDropoutNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:40:38.0928843Z test_Dropout3d_xla (__main__.TestDropoutNNDeviceTypeXLA) ... ok (0.971s) 2024-12-18T00:42:27.9585226Z test_Dropout_xla (__main__.TestDropoutNNDeviceTypeXLA) ... ok (109.866s) 2024-12-18T00:42:28.0850169Z test_empty_dropout_xla (__main__.TestDropoutNNDeviceTypeXLA) ... ok (0.126s) 2024-12-18T00:42:28.0850595Z 2024-12-18T00:42:28.0850763Z ---------------------------------------------------------------------- 2024-12-18T00:42:28.0851158Z Ran 5 tests in 111.566s 2024-12-18T00:42:28.0851338Z 2024-12-18T00:42:28.0851437Z OK (skipped=1) 2024-12-18T00:42:28.0851578Z 2024-12-18T00:42:28.0851701Z Generating XML reports... 2024-12-18T00:42:28.0882446Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_dropout/TEST-TestDropoutNNDeviceTypeXLA-20241218004036.xml 2024-12-18T00:42:29.0037039Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:29.0038155Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py' -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:29.0039283Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:29.0040084Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:42:29.0040795Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:29.0041761Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py' -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:29.0042837Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:29.0043525Z ++ command -v nvidia-smi 2024-12-18T00:42:29.0043811Z + '[' -x '' ']' 2024-12-18T00:42:29.0044057Z + PJRT_DEVICE=CPU 2024-12-18T00:42:29.0044485Z + CPU_NUM_DEVICES=1 2024-12-18T00:42:29.0045039Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:29.0045663Z + '[' 0 '!=' 0 ']' 2024-12-18T00:42:29.0046207Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2024-12-18T00:42:32.4420097Z 2024-12-18T00:42:32.4420529Z Running tests... 2024-12-18T00:42:32.4420941Z ---------------------------------------------------------------------- 2024-12-18T00:42:32.4421589Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_pooling 2024-12-18T00:42:32.4440605Z test_AdaptiveMaxPool1d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:42:32.4444612Z test_AdaptiveMaxPool2d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:42:32.4452251Z test_AdaptiveMaxPool3d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:42:32.4464918Z test_AdaptiveMaxPool_zero_batch_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4474316Z test_AvgPool2d_empty_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4483499Z test_AvgPool3d_backward_after_cat_dim1_device_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:42:32.4491878Z test_FractionalMaxPool2d_zero_batch_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4500073Z test_FractionalMaxPool2d_zero_out_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4509609Z test_FractionalMaxPool2d_zero_samples_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4518046Z test_FractionalMaxPool3d_zero_batch_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4526054Z test_FractionalMaxPool3d_zero_out_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4535812Z test_FractionalMaxPool3d_zero_samples_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4542695Z test_MaxPool1d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:42:32.4550237Z test_MaxPool2d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:42:32.4557066Z test_MaxPool3d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:42:32.4569244Z test_MaxPool_zero_batch_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4592832Z test_MaxUnpool_index_errors_case10_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4615665Z test_MaxUnpool_index_errors_case1_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4638416Z test_MaxUnpool_index_errors_case2_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4660575Z test_MaxUnpool_index_errors_case3_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4684150Z test_MaxUnpool_index_errors_case4_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4705884Z test_MaxUnpool_index_errors_case5_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4729359Z test_MaxUnpool_index_errors_case6_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4751236Z test_MaxUnpool_index_errors_case7_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4774695Z test_MaxUnpool_index_errors_case8_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4797608Z test_MaxUnpool_index_errors_case9_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:32.4813298Z test_MaxUnpool_zero_batch_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4825875Z test_adaptive_avg_pool2d_output_size_one_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:32.4835331Z test_adaptive_avg_pool3d_output_size_one_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:38.5839398Z test_adaptive_pool_odd_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... ok (6.100s) 2024-12-18T00:42:38.5850877Z test_adaptive_pooling_empty_output_size_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:38.5863479Z test_adaptive_pooling_empty_output_size_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:42.8048304Z test_adaptive_pooling_max_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (4.198s) 2024-12-18T00:42:47.0832389Z test_adaptive_pooling_max_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (4.298s) 2024-12-18T00:42:47.0947321Z test_adaptive_pooling_no_suppot_input_xla_int16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:47.0949625Z test_adaptive_pooling_no_suppot_input_xla_int32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:47.0963641Z test_adaptive_pooling_no_suppot_input_xla_int64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:47.0965911Z test_adaptive_pooling_no_suppot_input_xla_int8 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:47.0968386Z test_adaptive_pooling_no_suppot_input_xla_uint8 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:47.0970735Z test_adaptive_pooling_zero_batch_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:47.1022660Z test_adaptive_pooling_zero_batch_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:42:47.1024635Z test_avg_pool2d_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:42:47.1026513Z test_avg_pool2d_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:42:47.1028297Z test_avg_pool2d_reduced_floating_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:42:47.1040252Z test_avg_pool2d_reduced_floating_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:42:47.1064402Z test_fractional_max_pool2d_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:47.1088124Z test_fractional_max_pool3d_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:47.1105982Z test_fractional_max_pool_nan_inf_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:47.1126221Z test_max_pool1d_corner_cases_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:42:47.1146030Z test_max_pool1d_corner_cases_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:42:47.1170091Z test_max_pool1d_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:42:47.1192508Z test_max_pool1d_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:42:47.1211455Z test_max_pool2d_corner_cases_xla_int32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:42:47.1230356Z test_max_pool2d_corner_cases_xla_int64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:42:47.1249064Z test_max_pool2d_indices_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:42:47.1276203Z test_max_pool2d_nhwc_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:42:47.1302472Z test_max_pool2d_nhwc_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2024-12-18T00:42:47.1328857Z test_max_pool2d_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:47.1355883Z test_max_pool2d_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:42:47.1372525Z test_max_pool2d_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:42:47.1414638Z test_max_pool3d_ndhwc_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.004s) 2024-12-18T00:42:47.1456353Z test_max_pool3d_ndhwc_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.004s) 2024-12-18T00:42:47.1498308Z test_max_pool3d_ndhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.004s) 2024-12-18T00:42:47.1540080Z test_max_pool3d_ndhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.004s) 2024-12-18T00:42:47.1569121Z test_max_pool_bfloat16_half_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.003s) 2024-12-18T00:42:47.1597873Z test_max_pool_bfloat16_half_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2024-12-18T00:42:47.1619126Z test_max_pool_nan_inf_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:49.9523206Z test_maxpool3d_non_square_backward_xla (__main__.TestPoolingNNDeviceTypeXLA) ... ok (2.790s) 2024-12-18T00:42:49.9531525Z test_maxpool_indices_no_batch_dim_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) 2024-12-18T00:42:51.4884639Z Check that indices with no batch dim is consistent with a single batch. ... ok (1.536s) 2024-12-18T00:42:51.4897687Z test_pool3d_large_size_int64_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:42:51.4909571Z test_pool3d_size_one_feature_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:42:51.4920312Z test_pool_invalid_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:42:51.4954111Z test_pool_large_size_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:42:51.4966821Z test_pooling_bfloat16_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:42:51.4977217Z test_pooling_large_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:42:53.0121100Z test_pooling_max_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (1.510s) 2024-12-18T00:42:54.5549034Z test_pooling_max_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (1.536s) 2024-12-18T00:42:54.5550132Z test_pooling_shape_xla (__main__.TestPoolingNNDeviceTypeXLA) 2024-12-18T00:42:54.5679623Z Test the output shape calculation for pooling functions ... ok (0.024s) 2024-12-18T00:42:54.5697323Z test_pooling_zero_stride_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:42:54.5698392Z 2024-12-18T00:42:54.5698651Z ---------------------------------------------------------------------- 2024-12-18T00:42:54.5699302Z Ran 79 tests in 22.128s 2024-12-18T00:42:54.5699769Z 2024-12-18T00:42:54.5701512Z OK (skipped=70) 2024-12-18T00:42:54.5701833Z 2024-12-18T00:42:54.5703148Z Generating XML reports... 2024-12-18T00:42:54.5854709Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_pooling/TEST-TestPoolingNNDeviceTypeXLA-20241218004232.xml 2024-12-18T00:42:55.4398927Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:55.4400065Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py' -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:55.4401229Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:55.4402080Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:42:55.4402800Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:55.4403826Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py' -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:55.4404900Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:55.4405611Z ++ command -v nvidia-smi 2024-12-18T00:42:55.4405891Z + '[' -x '' ']' 2024-12-18T00:42:55.4406139Z + PJRT_DEVICE=CPU 2024-12-18T00:42:55.4406400Z + CPU_NUM_DEVICES=1 2024-12-18T00:42:55.4406974Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:55.4407628Z + '[' 0 '!=' 0 ']' 2024-12-18T00:42:55.4409957Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2024-12-18T00:42:58.8040266Z 2024-12-18T00:42:58.8040753Z Running tests... 2024-12-18T00:42:58.8041156Z ---------------------------------------------------------------------- 2024-12-18T00:42:58.8041825Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_embedding 2024-12-18T00:42:59.6449540Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.841s) 2024-12-18T00:42:59.6468989Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:00.2132011Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.566s) 2024-12-18T00:43:00.6912046Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.478s) 2024-12-18T00:43:00.9457596Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.255s) 2024-12-18T00:43:00.9476617Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:00.9557638Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:00.9634951Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:00.9716116Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:00.9734785Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:00.9813842Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:00.9891556Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:00.9971015Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:00.9989706Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:01.0067505Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:01.0143447Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2024-12-18T00:43:01.0165072Z test_EmbeddingBag_per_sample_weights_and_new_offsets_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:43:01.0178882Z test_EmbeddingBag_per_sample_weights_and_no_offsets_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:02.3257920Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (1.307s) 2024-12-18T00:43:02.3273632Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:03.3694541Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (1.041s) 2024-12-18T00:43:04.2081842Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.839s) 2024-12-18T00:43:04.4625681Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.255s) 2024-12-18T00:43:04.4644707Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:04.4741675Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.010s) 2024-12-18T00:43:04.4834869Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.009s) 2024-12-18T00:43:05.0892599Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.605s) 2024-12-18T00:43:05.0907887Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:05.6961394Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.605s) 2024-12-18T00:43:06.1707501Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.475s) 2024-12-18T00:43:06.1816783Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.011s) 2024-12-18T00:43:06.1835955Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:06.1931333Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.009s) 2024-12-18T00:43:06.2024023Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.009s) 2024-12-18T00:43:06.2041701Z test_EmbeddingBag_per_sample_weights_failures_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:43:06.2056912Z test_embedding_backward_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:06.2084681Z test_embedding_bag_1D_padding_idx_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:43:06.2112009Z test_embedding_bag_1D_padding_idx_xla_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2024-12-18T00:43:06.2134852Z test_embedding_bag_2D_padding_idx_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:06.2158214Z test_embedding_bag_2D_padding_idx_xla_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:06.2167425Z test_embedding_bag_bfloat16_xla_int32_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.2176445Z test_embedding_bag_bfloat16_xla_int32_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.2185618Z test_embedding_bag_bfloat16_xla_int64_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.2194625Z test_embedding_bag_bfloat16_xla_int64_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.2209866Z test_embedding_bag_device_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:06.5784742Z test_embedding_bag_dimension_errors_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.357s) 2024-12-18T00:43:06.6745847Z test_embedding_bag_empty_input_xla_int32_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.096s) 2024-12-18T00:43:06.6789333Z test_embedding_bag_empty_input_xla_int32_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.004s) 2024-12-18T00:43:06.6830927Z test_embedding_bag_empty_input_xla_int64_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.004s) 2024-12-18T00:43:06.6872684Z test_embedding_bag_empty_input_xla_int64_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.004s) 2024-12-18T00:43:06.6881333Z test_embedding_bag_half_xla_int32_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.6889250Z test_embedding_bag_half_xla_int32_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.6896982Z test_embedding_bag_half_xla_int64_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.6904926Z test_embedding_bag_half_xla_int64_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:06.9475998Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.257s) 2024-12-18T00:43:06.9491796Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:07.1818177Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.232s) 2024-12-18T00:43:07.3622171Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.180s) 2024-12-18T00:43:07.4917138Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.129s) 2024-12-18T00:43:07.4933832Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:07.6203079Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.127s) 2024-12-18T00:43:07.7175176Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.097s) 2024-12-18T00:43:07.8479101Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.131s) 2024-12-18T00:43:07.8495686Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:07.9879760Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.138s) 2024-12-18T00:43:08.0849838Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.096s) 2024-12-18T00:43:08.2146278Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.130s) 2024-12-18T00:43:08.2162139Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:08.3432383Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.127s) 2024-12-18T00:43:08.4420774Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.099s) 2024-12-18T00:43:08.4435433Z test_embedding_bag_out_of_bounds_idx_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:43:08.4464634Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_False_per_sample_weights_use_grad_False_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:43:08.5703775Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_False_per_sample_weights_use_grad_True_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.124s) 2024-12-18T00:43:08.5739333Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_True_per_sample_weights_use_grad_False_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.004s) 2024-12-18T00:43:08.5771775Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_True_per_sample_weights_use_grad_True_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:43:08.5782230Z test_embedding_dense_grad_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:08.7982858Z test_embedding_max_norm_backward_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.220s) 2024-12-18T00:43:08.7996004Z test_embedding_max_norm_device_xla_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:43:08.8007442Z test_embedding_max_norm_device_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:08.8018889Z test_embedding_max_norm_device_xla_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:08.8032192Z test_embedding_max_norm_fwd_AD_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: forward AD doesn't work on xla (0.001s) 2024-12-18T00:43:09.5560812Z test_embedding_padding_idx_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.752s) 2024-12-18T00:43:09.5568613Z test_embedding_scalar_weight_error_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:09.5569452Z 2024-12-18T00:43:09.5569654Z ---------------------------------------------------------------------- 2024-12-18T00:43:09.5570067Z Ran 83 tests in 10.753s 2024-12-18T00:43:09.5570271Z 2024-12-18T00:43:09.5570372Z OK (skipped=36) 2024-12-18T00:43:09.5570541Z 2024-12-18T00:43:09.5570653Z Generating XML reports... 2024-12-18T00:43:09.5660915Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_embedding/TEST-TestEmbeddingNNDeviceTypeXLA-20241218004258.xml 2024-12-18T00:43:10.2636489Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:10.2637679Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py' -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:10.2638851Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:10.2639698Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:43:10.2640459Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:10.2641557Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py' -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:10.2642685Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:10.2643398Z ++ command -v nvidia-smi 2024-12-18T00:43:10.2643687Z + '[' -x '' ']' 2024-12-18T00:43:10.2643925Z + PJRT_DEVICE=CPU 2024-12-18T00:43:10.2644384Z + CPU_NUM_DEVICES=1 2024-12-18T00:43:10.2645003Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:10.2645664Z + '[' 0 '!=' 0 ']' 2024-12-18T00:43:10.2646239Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2024-12-18T00:43:14.0934878Z 2024-12-18T00:43:14.0935497Z Running tests... 2024-12-18T00:43:14.0936122Z ---------------------------------------------------------------------- 2024-12-18T00:43:14.0937141Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_convolution 2024-12-18T00:43:14.0953363Z test_Conv2d_backward_depthwise_xla_complex128 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:43:14.0963999Z test_Conv2d_backward_depthwise_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:14.0984955Z test_Conv2d_depthwise_naive_groups_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:14.1006811Z test_Conv2d_depthwise_naive_groups_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:14.1026419Z test_Conv2d_depthwise_naive_groups_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:14.1040782Z test_Conv2d_deterministic_cudnn_xla_complex128 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:43:14.1052654Z test_Conv2d_deterministic_cudnn_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:14.1065716Z test_Conv2d_deterministic_cudnn_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:43:14.1080020Z test_Conv2d_deterministic_cudnn_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:14.1091756Z test_Conv2d_deterministic_cudnn_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:14.1102926Z test_Conv2d_large_workspace_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:43:14.1119530Z test_Conv2d_large_workspace_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:14.1129452Z test_Conv2d_large_workspace_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:14.9880375Z test_Conv2d_naive_groups_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.874s) 2024-12-18T00:43:14.9891217Z test_Conv2d_size_1_kernel_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:14.9915453Z test_Conv3d_depthwise_naive_groups_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:14.9937486Z test_Conv3d_depthwise_naive_groups_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:14.9959272Z test_Conv3d_depthwise_naive_groups_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:14.9969688Z test_ConvTranspose2d_large_output_padding_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:43:14.9980909Z test_ConvTranspose2d_large_output_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:14.9993066Z test_ConvTranspose2d_size_1_kernel_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:15.0005308Z test_ConvTranspose3d_size_1_kernel_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:15.0014370Z test_contig_wrong_stride_cudnn_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:15.0030251Z test_conv1d_same_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:15.2581578Z test_conv1d_same_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py:1840: UserWarning: Using padding='same' with even kernel lengths and odd dilation may require a zero-padded copy of the input be created (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/Convolution.cpp:1037.) 2024-12-18T00:43:15.2583821Z z = F.conv1d(x, y, padding="same") 2024-12-18T00:43:15.7587558Z ok (0.756s) 2024-12-18T00:43:15.7607050Z test_conv1d_same_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:16.4836275Z test_conv1d_same_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.722s) 2024-12-18T00:43:16.4847630Z test_conv1d_valid_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:16.7393435Z test_conv1d_valid_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.254s) 2024-12-18T00:43:16.7402266Z test_conv1d_valid_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:16.8639521Z test_conv1d_valid_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.123s) 2024-12-18T00:43:17.3846779Z test_conv1d_vs_scipy_mode_same_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.520s) 2024-12-18T00:43:17.6255689Z test_conv1d_vs_scipy_mode_valid_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.241s) 2024-12-18T00:43:17.6270126Z test_conv1d_vs_scipy_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:17.6279090Z test_conv2d_no_grad_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:43:17.6296280Z test_conv2d_same_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:18.3416638Z test_conv2d_same_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.712s) 2024-12-18T00:43:18.3431255Z test_conv2d_same_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:18.9179938Z test_conv2d_same_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.574s) 2024-12-18T00:43:18.9190649Z test_conv2d_valid_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:19.1737191Z test_conv2d_valid_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.254s) 2024-12-18T00:43:19.1746114Z test_conv2d_valid_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:19.2987963Z test_conv2d_valid_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.124s) 2024-12-18T00:43:19.8231596Z test_conv2d_vs_scipy_mode_same_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.524s) 2024-12-18T00:43:20.0572955Z test_conv2d_vs_scipy_mode_valid_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.234s) 2024-12-18T00:43:20.0591496Z test_conv2d_vs_scipy_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:20.0596080Z test_conv3d_64bit_indexing_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:20.0605592Z test_conv3d_large_batch_1_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:20.0625025Z test_conv3d_same_padding_backward_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:43:20.0639968Z test_conv3d_same_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:20.6501661Z test_conv3d_same_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.586s) 2024-12-18T00:43:20.6516149Z test_conv3d_valid_padding_backward_xla_complex128 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:43:20.6529413Z test_conv3d_valid_padding_backward_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:20.6538326Z test_conv3d_valid_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:20.7780613Z test_conv3d_valid_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.124s) 2024-12-18T00:43:21.3137584Z test_conv3d_vs_scipy_mode_same_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.535s) 2024-12-18T00:43:21.5514978Z test_conv3d_vs_scipy_mode_valid_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.238s) 2024-12-18T00:43:21.5531217Z test_conv3d_vs_scipy_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:21.6867032Z test_convTranspose_empty_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.133s) 2024-12-18T00:43:21.6959730Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7051582Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7141549Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7233323Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7325969Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7417551Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7508707Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7600516Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7693270Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7784433Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7876756Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.7968648Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8060155Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8151443Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8242868Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8337010Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8428318Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8520810Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8612447Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8703739Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8798575Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8891237Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.8980837Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9075641Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9168024Z test_conv_backend_cudnn1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9258924Z test_conv_backend_cudnn1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9351537Z test_conv_backend_cudnn1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9443604Z test_conv_backend_cudnn1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9535290Z test_conv_backend_cudnn1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9625806Z test_conv_backend_cudnn1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9719782Z test_conv_backend_cudnn1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9811859Z test_conv_backend_cudnn1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9903427Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:21.9998636Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0090810Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0182472Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0277030Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0371687Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0462200Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0555217Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0647960Z test_conv_backend_cudnn2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0739861Z test_conv_backend_cudnn2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0833073Z test_conv_backend_cudnn2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.0924495Z test_conv_backend_cudnn2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1016045Z test_conv_backend_cudnn2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1107397Z test_conv_backend_cudnn2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1200685Z test_conv_backend_cudnn2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1294179Z test_conv_backend_cudnn2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1387171Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1480115Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1572112Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1662625Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1755018Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1846923Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.1938291Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2029925Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2123058Z test_conv_backend_cudnn3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2214737Z test_conv_backend_cudnn3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2305322Z test_conv_backend_cudnn3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2400828Z test_conv_backend_cudnn3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2492884Z test_conv_backend_cudnn3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2585022Z test_conv_backend_cudnn3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2679871Z test_conv_backend_cudnn3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2773413Z test_conv_backend_cudnn3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.2864827Z test_conv_backend_empty_batch1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.2958736Z test_conv_backend_empty_batch1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3050389Z test_conv_backend_empty_batch1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3141433Z test_conv_backend_empty_batch1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3237133Z test_conv_backend_empty_batch1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3328903Z test_conv_backend_empty_batch1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3421193Z test_conv_backend_empty_batch1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3514700Z test_conv_backend_empty_batch1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3606925Z test_conv_backend_empty_batch2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3698548Z test_conv_backend_empty_batch2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3792916Z test_conv_backend_empty_batch2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3885166Z test_conv_backend_empty_batch2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.3975772Z test_conv_backend_empty_batch2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4066139Z test_conv_backend_empty_batch2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4157947Z test_conv_backend_empty_batch2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4249483Z test_conv_backend_empty_batch2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4340500Z test_conv_backend_empty_batch3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4431529Z test_conv_backend_empty_batch3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4523271Z test_conv_backend_empty_batch3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4614332Z test_conv_backend_empty_batch3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4704896Z test_conv_backend_empty_batch3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4798299Z test_conv_backend_empty_batch3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4891254Z test_conv_backend_empty_batch3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.4981367Z test_conv_backend_empty_batch3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5072298Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5165206Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5256094Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5347876Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5439917Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5532058Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5621636Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5713928Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5807264Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5898360Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.5989186Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6081162Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6173545Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6264896Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6359429Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6449692Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6540588Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6630974Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6722234Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6814218Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6904820Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.6996968Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7088493Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7180097Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7271966Z test_conv_backend_empty_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7365940Z test_conv_backend_empty_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7458433Z test_conv_backend_empty_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7549743Z test_conv_backend_empty_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7641004Z test_conv_backend_empty_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7731507Z test_conv_backend_empty_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7822641Z test_conv_backend_empty_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.7914508Z test_conv_backend_empty_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8005951Z test_conv_backend_empty_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8097705Z test_conv_backend_empty_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8188176Z test_conv_backend_empty_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8280626Z test_conv_backend_empty_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8374084Z test_conv_backend_empty_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8464488Z test_conv_backend_empty_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8555830Z test_conv_backend_empty_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8646996Z test_conv_backend_empty_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8738483Z test_conv_backend_empty_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8829210Z test_conv_backend_empty_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.8921930Z test_conv_backend_empty_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.9014895Z test_conv_backend_empty_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.9106807Z test_conv_backend_empty_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.9199062Z test_conv_backend_empty_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.9291233Z test_conv_backend_empty_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.9383300Z test_conv_backend_empty_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:22.9475601Z test_conv_backend_miopen1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.9568729Z test_conv_backend_miopen1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.9661268Z test_conv_backend_miopen1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.9753378Z test_conv_backend_miopen1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.9845920Z test_conv_backend_miopen1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:22.9939465Z test_conv_backend_miopen1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0033038Z test_conv_backend_miopen1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0127716Z test_conv_backend_miopen1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0218750Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0312819Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0405486Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0498287Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0590753Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0683471Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0776358Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0867663Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.0961802Z test_conv_backend_miopen2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1054000Z test_conv_backend_miopen2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1146172Z test_conv_backend_miopen2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1238060Z test_conv_backend_miopen2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1333109Z test_conv_backend_miopen2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1424033Z test_conv_backend_miopen2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1516609Z test_conv_backend_miopen2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1608773Z test_conv_backend_miopen2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1701467Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1793313Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1886127Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.1978685Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2072385Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2164436Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2255899Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2347895Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2441302Z test_conv_backend_miopen3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2533709Z test_conv_backend_miopen3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2623350Z test_conv_backend_miopen3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2717734Z test_conv_backend_miopen3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2810278Z test_conv_backend_miopen3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2901351Z test_conv_backend_miopen3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.2993516Z test_conv_backend_miopen3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3086969Z test_conv_backend_miopen3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3178387Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3269370Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3363888Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3455398Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3546797Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3639005Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3731190Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3822937Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.3917124Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4009704Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4102888Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4196478Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4289048Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4381085Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4475265Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4568016Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4660345Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4752428Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4845496Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.4938305Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5031024Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5123798Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5215312Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5306264Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5400287Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5494503Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5586198Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5680047Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5772365Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5864661Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.5958762Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.6050261Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:23.6142093Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6234076Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6329015Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6420283Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6513035Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6605557Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6698411Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6791153Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6884529Z test_conv_backend_mkldnn1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.6976576Z test_conv_backend_mkldnn1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7068476Z test_conv_backend_mkldnn1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7161944Z test_conv_backend_mkldnn1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7252963Z test_conv_backend_mkldnn1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7345776Z test_conv_backend_mkldnn1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7439177Z test_conv_backend_mkldnn1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7531549Z test_conv_backend_mkldnn1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7622369Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7715188Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7807940Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7899858Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.7993006Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8086286Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8178115Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8268838Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8363445Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8455380Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8545945Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8639245Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8731441Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8823572Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.8919092Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9011728Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9102717Z test_conv_backend_mkldnn2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9196988Z test_conv_backend_mkldnn2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9289413Z test_conv_backend_mkldnn2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9382437Z test_conv_backend_mkldnn2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9476251Z test_conv_backend_mkldnn2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9568673Z test_conv_backend_mkldnn2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9659922Z test_conv_backend_mkldnn2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9752255Z test_conv_backend_mkldnn2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9845465Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:23.9938254Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0031862Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0124316Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0215729Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0306786Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0401193Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0493369Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0584825Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0677984Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0770631Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0862005Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.0954454Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1046692Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1138389Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1230848Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1325384Z test_conv_backend_mkldnn3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1418134Z test_conv_backend_mkldnn3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1511060Z test_conv_backend_mkldnn3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1603380Z test_conv_backend_mkldnn3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1696988Z test_conv_backend_mkldnn3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1789270Z test_conv_backend_mkldnn3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1883352Z test_conv_backend_mkldnn3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.1975795Z test_conv_backend_mkldnn3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2067033Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2159909Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2251336Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2344457Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2437775Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2530131Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2621534Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2713977Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2806244Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2898829Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.2990827Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3083075Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3175311Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3266509Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3360128Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3453769Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3543365Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3637528Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3730827Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3822684Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.3916984Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4008774Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4100121Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4191955Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4284649Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4378974Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4471636Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4565322Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4656203Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4747664Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4840902Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.4933363Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5023959Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5117229Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5209156Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5300452Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5395549Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5488684Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5579859Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5671813Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5766066Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5857726Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.5950519Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6042759Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6134281Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6224774Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6318534Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6410119Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6501126Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6594501Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6687318Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6778482Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6869277Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.6962931Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7054183Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7145609Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7237939Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7330006Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7420479Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7513521Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7606096Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7698125Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7788390Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7880814Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.7974452Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8066122Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8158435Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8249709Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8341599Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8433646Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8525635Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8617474Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8708514Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8802334Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8894972Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.8987491Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.9082468Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.9174905Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.9265149Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.9359605Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:24.9452781Z test_conv_backend_slow1d_dilated_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:24.9543368Z test_conv_backend_slow1d_dilated_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:24.9636380Z test_conv_backend_slow1d_dilated_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:24.9729733Z test_conv_backend_slow1d_dilated_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:24.9822600Z test_conv_backend_slow1d_dilated_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:24.9915142Z test_conv_backend_slow1d_dilated_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0009271Z test_conv_backend_slow1d_dilated_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0102788Z test_conv_backend_slow1d_dilated_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0198505Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0292353Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0387153Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0481196Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0575260Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0668605Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0762475Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0857264Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.0952020Z test_conv_backend_slow1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1044464Z test_conv_backend_slow1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1136760Z test_conv_backend_slow1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1227322Z test_conv_backend_slow1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1322675Z test_conv_backend_slow1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1414778Z test_conv_backend_slow1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1506879Z test_conv_backend_slow1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1601200Z test_conv_backend_slow1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1693851Z test_conv_backend_slow1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1784549Z test_conv_backend_slow1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1877868Z test_conv_backend_slow1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.1970270Z test_conv_backend_slow1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2061390Z test_conv_backend_slow1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2153787Z test_conv_backend_slow1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2245753Z test_conv_backend_slow1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2338110Z test_conv_backend_slow1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2428915Z test_conv_backend_slow2d_dilated_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2523851Z test_conv_backend_slow2d_dilated_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2616949Z test_conv_backend_slow2d_dilated_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2708405Z test_conv_backend_slow2d_dilated_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2802082Z test_conv_backend_slow2d_dilated_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2895918Z test_conv_backend_slow2d_dilated_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.2987383Z test_conv_backend_slow2d_dilated_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3082348Z test_conv_backend_slow2d_dilated_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3175505Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3265933Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3360135Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3452166Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3544607Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3636355Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3728465Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3819827Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.3913809Z test_conv_backend_slow2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4007406Z test_conv_backend_slow2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4100652Z test_conv_backend_slow2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4194385Z test_conv_backend_slow2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4287014Z test_conv_backend_slow2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4381094Z test_conv_backend_slow2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4473238Z test_conv_backend_slow2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4568655Z test_conv_backend_slow2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4660243Z test_conv_backend_slow2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4752171Z test_conv_backend_slow2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4844749Z test_conv_backend_slow2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.4935711Z test_conv_backend_slow2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.5028276Z test_conv_backend_slow2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.5121237Z test_conv_backend_slow2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.5213652Z test_conv_backend_slow2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.5304717Z test_conv_backend_slow2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.5400282Z test_conv_backend_slow3d_cpu_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.5495336Z test_conv_backend_slow3d_cpu_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.5588195Z test_conv_backend_slow3d_cpu_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.5681329Z test_conv_backend_slow3d_cpu_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.5773923Z test_conv_backend_slow3d_cpu_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.5864689Z test_conv_backend_slow3d_cpu_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.5957995Z test_conv_backend_slow3d_cpu_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.6050870Z test_conv_backend_slow3d_cpu_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2024-12-18T00:43:25.6141632Z test_conv_backend_slow3d_cuda_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6233213Z test_conv_backend_slow3d_cuda_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6326883Z test_conv_backend_slow3d_cuda_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6418430Z test_conv_backend_slow3d_cuda_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6510598Z test_conv_backend_slow3d_cuda_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6603557Z test_conv_backend_slow3d_cuda_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6695511Z test_conv_backend_slow3d_cuda_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6786104Z test_conv_backend_slow3d_cuda_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2024-12-18T00:43:25.6879076Z test_conv_backend_slow3d_dilated_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.6972240Z test_conv_backend_slow3d_dilated_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.7063675Z test_conv_backend_slow3d_dilated_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.7157955Z test_conv_backend_slow3d_dilated_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.7248929Z test_conv_backend_slow3d_dilated_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.7341762Z test_conv_backend_slow3d_dilated_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.7433610Z test_conv_backend_slow3d_dilated_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.7526044Z test_conv_backend_slow3d_dilated_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2024-12-18T00:43:25.7536737Z test_conv_contiguous_for_oneDNN_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:43:25.7547646Z test_conv_cudnn_mismatch_memory_format_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:25.7568701Z test_conv_cudnn_ndhwc_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:25.7587209Z test_conv_cudnn_ndhwc_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:25.7596891Z test_conv_cudnn_nhwc_support_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:25.7606588Z test_conv_cudnn_nhwc_support_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:25.7626288Z test_conv_cudnn_nhwc_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:43:25.7647039Z test_conv_cudnn_nhwc_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:25.7666480Z test_conv_cudnn_nhwc_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:25.7817876Z test_conv_double_backward_groups_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.7820728Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.7833154Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.7835203Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.7845505Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.7847314Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.7882156Z ok (0.021s) 2024-12-18T00:43:25.7964631Z test_conv_double_backward_no_bias_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.7967578Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.7975260Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.7977390Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.7985003Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.7986754Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8009892Z ok (0.013s) 2024-12-18T00:43:25.8075484Z test_conv_double_backward_stride_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8077993Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8084689Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8086634Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8093399Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8094931Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8171039Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8172948Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8180853Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8182594Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8189501Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8191187Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8266093Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8267852Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8275737Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8277495Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8284294Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8285797Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8361657Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8363417Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8371257Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8373002Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8380061Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8381601Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8456359Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8458239Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8466145Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8467887Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8474789Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8476497Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8556053Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8557804Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8566044Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8568042Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8575405Z /opt/conda/lib/python3.10/site-packages/torch/autograd/gradcheck.py:1156: FutureWarning: Please use `torch.vmap` instead of `torch._vmap_internals.vmap`. 2024-12-18T00:43:25.8577278Z result = vmap(vjp)(torch.stack(grad_outputs)) 2024-12-18T00:43:25.8598629Z ok (0.059s) 2024-12-18T00:43:25.8656497Z test_conv_double_backward_strided_with_3D_input_and_weight_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.006s) 2024-12-18T00:43:25.8670150Z test_conv_double_backward_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:25.8685704Z test_conv_empty_channel_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:43:25.8711013Z test_conv_empty_channel_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/nn/init.py:511: UserWarning: Initializing zero-element tensors is a no-op 2024-12-18T00:43:25.8712911Z warnings.warn("Initializing zero-element tensors is a no-op") 2024-12-18T00:43:26.2980099Z ok (0.429s) 2024-12-18T00:43:26.2991703Z test_conv_ic1_channels_last_for_oneDNN_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:43:26.3003233Z test_conv_large_batch_1_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:26.3013986Z test_conv_large_nosplit_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:26.3030479Z test_conv_large_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:26.6391090Z test_conv_noncontig_weights_and_bias_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.336s) 2024-12-18T00:43:26.6534275Z test_conv_noncontig_weights_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.014s) 2024-12-18T00:43:26.6566644Z test_conv_thnn_nhwc_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.003s) 2024-12-18T00:43:26.6598273Z test_conv_thnn_nhwc_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.003s) 2024-12-18T00:43:26.6622292Z test_conv_transpose_with_output_size_and_no_batch_dim_ConvTranspose2d_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:43:26.6646410Z test_conv_transpose_with_output_size_and_no_batch_dim_ConvTranspose3d_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:43:26.6663718Z test_conv_transposed_large_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:26.6676227Z test_convert_conv2d_weight_memory_format_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:26.6686778Z test_convert_conv3d_weight_memory_format_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:26.6703998Z test_cudnn_convolution_add_relu_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:26.6720979Z test_cudnn_convolution_add_relu_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:26.6737059Z test_cudnn_convolution_relu_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:26.6753248Z test_cudnn_convolution_relu_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2024-12-18T00:43:26.7298395Z test_group_convTranspose_empty_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.054s) 2024-12-18T00:43:26.7333965Z test_group_conv_empty_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.004s) 2024-12-18T00:43:26.7347271Z test_noncontig_conv_grad_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:43:26.7360187Z test_noncontig_conv_grad_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2024-12-18T00:43:26.7372577Z test_noncontig_conv_grad_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:26.7373491Z 2024-12-18T00:43:26.7373743Z ---------------------------------------------------------------------- 2024-12-18T00:43:26.7374360Z Ran 537 tests in 12.644s 2024-12-18T00:43:26.7374648Z 2024-12-18T00:43:26.7374788Z OK (skipped=508) 2024-12-18T00:43:26.7375000Z 2024-12-18T00:43:26.7375336Z Generating XML reports... 2024-12-18T00:43:26.7860249Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_convolution/TEST-TestConvolutionNNDeviceTypeXLA-20241218004314.xml 2024-12-18T00:43:27.5793908Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:27.5795237Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py' -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:27.5796780Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:27.5797686Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:43:27.5798474Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:27.5799686Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py' -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:27.5800943Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:27.5801737Z ++ command -v nvidia-smi 2024-12-18T00:43:27.5802010Z + '[' -x '' ']' 2024-12-18T00:43:27.5802256Z + PJRT_DEVICE=CPU 2024-12-18T00:43:27.5802505Z + CPU_NUM_DEVICES=1 2024-12-18T00:43:27.5803183Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:27.5803913Z + '[' 0 '!=' 0 ']' 2024-12-18T00:43:27.5804558Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2024-12-18T00:43:30.9215446Z 2024-12-18T00:43:30.9215959Z Running tests... 2024-12-18T00:43:30.9216539Z ---------------------------------------------------------------------- 2024-12-18T00:43:30.9217255Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_multihead_attention 2024-12-18T00:43:30.9231647Z test_multihead_attention_dtype_batch_first_xla_float16 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:43:30.9242940Z test_multihead_attention_dtype_batch_first_xla_float32 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2024-12-18T00:43:30.9255238Z test_multihead_attention_dtype_batch_first_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2024-12-18T00:43:30.9265329Z test_multihead_attention_dtype_xla_float16 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:43:30.9275440Z test_multihead_attention_dtype_xla_float32 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2024-12-18T00:43:30.9285450Z test_multihead_attention_dtype_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2024-12-18T00:43:30.9293950Z test_multihead_attn_fast_path_query_and_bias_have_different_dtypes_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:30.9338993Z test_multihead_attn_fast_path_small_test_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... ok (0.004s) 2024-12-18T00:43:30.9366493Z test_multihead_attn_in_proj_bias_none_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... ok (0.002s) 2024-12-18T00:43:30.9395931Z test_multihead_attn_in_proj_weight_none_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... ok (0.003s) 2024-12-18T00:43:30.9399636Z test_multihead_self_attn_two_masks_fast_path_mock_xla (__main__.TestMultiheadAttentionNNDeviceTypeXLA) 2024-12-18T00:43:30.9404449Z Multihead self-attention should take fast path when both attention mask (mask type 0) ... skip: Fastpath only runs on CPU and CUDA and PrivateUse1. (0.001s) 2024-12-18T00:43:30.9418038Z test_multihead_self_attn_two_masks_fast_path_xla (__main__.TestMultiheadAttentionNNDeviceTypeXLA) 2024-12-18T00:43:31.3783673Z Multihead self-attention should give the same result on the fast path (BetterTransformer) as on the slow path ... ok (0.438s) 2024-12-18T00:43:31.3784312Z 2024-12-18T00:43:31.3784494Z ---------------------------------------------------------------------- 2024-12-18T00:43:31.3784878Z Ran 12 tests in 0.457s 2024-12-18T00:43:31.3785056Z 2024-12-18T00:43:31.3785155Z OK (skipped=8) 2024-12-18T00:43:31.3785313Z 2024-12-18T00:43:31.3785420Z Generating XML reports... 2024-12-18T00:43:31.3820893Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_multihead_attention/TEST-TestMultiheadAttentionNNDeviceTypeXLA-20241218004330.xml 2024-12-18T00:43:32.0563688Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2024-12-18T00:43:32.0564796Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py' -v TestTypePromotionXLA 2024-12-18T00:43:32.0565870Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2024-12-18T00:43:32.0566652Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2024-12-18T00:43:32.0567311Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2024-12-18T00:43:32.0568263Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py' -v TestTypePromotionXLA 2024-12-18T00:43:32.0569272Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2024-12-18T00:43:32.0569933Z ++ command -v nvidia-smi 2024-12-18T00:43:32.0570232Z + '[' -x '' ']' 2024-12-18T00:43:32.0570478Z + PJRT_DEVICE=CPU 2024-12-18T00:43:32.0570719Z + CPU_NUM_DEVICES=1 2024-12-18T00:43:32.0571269Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2024-12-18T00:43:32.0571876Z + '[' 0 '!=' 0 ']' 2024-12-18T00:43:32.0572399Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2024-12-18T00:43:35.5512080Z 2024-12-18T00:43:35.5512667Z Running tests... 2024-12-18T00:43:35.5513059Z ---------------------------------------------------------------------- 2024-12-18T00:43:35.5513701Z Test results will be stored in test-reports/python-unittest/test.......test.test_type_promotion 2024-12-18T00:43:35.6599422Z test_add_wrapped_xla (__main__.TestTypePromotionXLA) ... ok (0.108s) 2024-12-18T00:43:35.7495571Z test_alpha_mismatch_xla (__main__.TestTypePromotionXLA) ... ok (0.089s) 2024-12-18T00:43:35.7502049Z test_alternate_result_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:43:36.8476249Z test_bfloat16_xla (__main__.TestTypePromotionXLA) ... ok (1.097s) 2024-12-18T00:43:36.9350172Z test_booleans_xla (__main__.TestTypePromotionXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py:434: UserWarning: This overload of add is deprecated: 2024-12-18T00:43:36.9351255Z add(Tensor input, Number alpha, Tensor other, *, Tensor out = None) 2024-12-18T00:43:36.9351988Z Consider using one of the following signatures instead: 2024-12-18T00:43:36.9352919Z add(Tensor input, Tensor other, *, Number alpha = 1, Tensor out = None) (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/utils/python_arg_parser.cpp:1661.) 2024-12-18T00:43:36.9353874Z self.assertEqual(torch.add(torch.tensor(True, device=device), 2024-12-18T00:43:36.9788918Z ok (0.132s) 2024-12-18T00:43:36.9796660Z test_can_cast_xla (__main__.TestTypePromotionXLA) ... ok (0.001s) 2024-12-18T00:43:36.9810671Z test_cat_different_dtypes_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:36.9821383Z test_cat_out_different_dtypes_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:43:36.9845949Z test_clamp_type_promotion_xla_bool_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:36.9869682Z test_clamp_type_promotion_xla_bool_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:36.9893037Z test_clamp_type_promotion_xla_bool_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:36.9916189Z test_clamp_type_promotion_xla_bool_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:36.9939276Z test_clamp_type_promotion_xla_bool_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:36.9962612Z test_clamp_type_promotion_xla_bool_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:36.9986276Z test_clamp_type_promotion_xla_bool_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0010251Z test_clamp_type_promotion_xla_bool_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0033194Z test_clamp_type_promotion_xla_bool_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0055781Z test_clamp_type_promotion_xla_bool_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0079952Z test_clamp_type_promotion_xla_bool_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0103213Z test_clamp_type_promotion_xla_bool_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0127042Z test_clamp_type_promotion_xla_bool_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0149826Z test_clamp_type_promotion_xla_bool_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0174724Z test_clamp_type_promotion_xla_bool_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0197946Z test_clamp_type_promotion_xla_bool_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0220506Z test_clamp_type_promotion_xla_float32_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0244752Z test_clamp_type_promotion_xla_float32_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0266985Z test_clamp_type_promotion_xla_float32_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0291392Z test_clamp_type_promotion_xla_float32_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0314487Z test_clamp_type_promotion_xla_float32_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0338542Z test_clamp_type_promotion_xla_float32_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0362688Z test_clamp_type_promotion_xla_float32_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0384956Z test_clamp_type_promotion_xla_float32_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0409400Z test_clamp_type_promotion_xla_float32_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0432101Z test_clamp_type_promotion_xla_float32_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0454781Z test_clamp_type_promotion_xla_float32_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0479485Z test_clamp_type_promotion_xla_float32_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0502516Z test_clamp_type_promotion_xla_float32_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0526378Z test_clamp_type_promotion_xla_float32_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0549060Z test_clamp_type_promotion_xla_float32_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0573517Z test_clamp_type_promotion_xla_float32_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0597165Z test_clamp_type_promotion_xla_float64_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0620328Z test_clamp_type_promotion_xla_float64_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0644601Z test_clamp_type_promotion_xla_float64_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0666989Z test_clamp_type_promotion_xla_float64_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0691380Z test_clamp_type_promotion_xla_float64_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0715806Z test_clamp_type_promotion_xla_float64_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0738666Z test_clamp_type_promotion_xla_float64_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0763573Z test_clamp_type_promotion_xla_float64_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0785924Z test_clamp_type_promotion_xla_float64_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0810411Z test_clamp_type_promotion_xla_float64_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0833263Z test_clamp_type_promotion_xla_float64_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0855916Z test_clamp_type_promotion_xla_float64_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0880414Z test_clamp_type_promotion_xla_float64_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0903284Z test_clamp_type_promotion_xla_float64_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0927214Z test_clamp_type_promotion_xla_float64_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0949996Z test_clamp_type_promotion_xla_float64_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0974599Z test_clamp_type_promotion_xla_int32_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.0998427Z test_clamp_type_promotion_xla_int32_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1021221Z test_clamp_type_promotion_xla_int32_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1045440Z test_clamp_type_promotion_xla_int32_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1067438Z test_clamp_type_promotion_xla_int32_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1092088Z test_clamp_type_promotion_xla_int32_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1115496Z test_clamp_type_promotion_xla_int32_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1138750Z test_clamp_type_promotion_xla_int32_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1162832Z test_clamp_type_promotion_xla_int32_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1185589Z test_clamp_type_promotion_xla_int32_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1210421Z test_clamp_type_promotion_xla_int32_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1233205Z test_clamp_type_promotion_xla_int32_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1255743Z test_clamp_type_promotion_xla_int32_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1279411Z test_clamp_type_promotion_xla_int32_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1303186Z test_clamp_type_promotion_xla_int32_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:43:37.1327132Z test_clamp_type_promotion_xla_int32_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2024-12-18T00:44:08.5228295Z test_comparison_ops_with_type_promotion_xla (__main__.TestTypePromotionXLA) ... ok (31.390s) 2024-12-18T00:44:08.5242492Z test_complex_assertraises_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.5257453Z test_complex_half_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.5282022Z test_complex_promotion_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.002s) 2024-12-18T00:44:08.5288577Z test_complex_scalar_mult_tensor_promotion_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:44:08.5301345Z test_computation_ignores_out_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.9903944Z test_create_bool_tensors_xla (__main__.TestTypePromotionXLA) ... ok (0.460s) 2024-12-18T00:44:08.9914724Z test_div_promotion_inplace_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:44:08.9927115Z test_div_promotion_out_xla_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.9939210Z test_div_promotion_out_xla_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.9951314Z test_div_promotion_out_xla_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.9963060Z test_div_promotion_out_xla_int16 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.9975105Z test_div_promotion_out_xla_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.9986821Z test_div_promotion_out_xla_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:08.9998570Z test_div_promotion_out_xla_int8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:09.0010627Z test_div_promotion_out_xla_uint8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:10.4073147Z test_div_promotion_xla_bool (__main__.TestTypePromotionXLA) ... ok (1.406s) 2024-12-18T00:44:11.8027206Z test_div_promotion_xla_int16 (__main__.TestTypePromotionXLA) ... ok (1.396s) 2024-12-18T00:44:13.2096993Z test_div_promotion_xla_int32 (__main__.TestTypePromotionXLA) ... ok (1.406s) 2024-12-18T00:44:14.6172897Z test_div_promotion_xla_int64 (__main__.TestTypePromotionXLA) ... ok (1.408s) 2024-12-18T00:44:16.0285445Z test_div_promotion_xla_int8 (__main__.TestTypePromotionXLA) ... ok (1.411s) 2024-12-18T00:44:17.4349323Z test_div_promotion_xla_uint8 (__main__.TestTypePromotionXLA) ... ok (1.406s) 2024-12-18T00:44:17.5768710Z test_float_promotion_xla (__main__.TestTypePromotionXLA) ... ok (0.142s) 2024-12-18T00:44:17.5802086Z test_from_issue_xla (__main__.TestTypePromotionXLA) ... ok (0.003s) 2024-12-18T00:44:17.5807665Z test_half_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:44:17.6026163Z test_indexing_fail_xla (__main__.TestTypePromotionXLA) ... ok (0.022s) 2024-12-18T00:44:17.6036603Z test_indexing_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:44:17.6056637Z test_inplace_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:44:17.6997654Z test_int_promotion_xla (__main__.TestTypePromotionXLA) ... ok (0.094s) 2024-12-18T00:44:17.7006278Z test_int_to_float_xla (__main__.TestTypePromotionXLA) ... ok (0.001s) 2024-12-18T00:44:17.7016495Z test_integer_addcdiv_deprecated_xla_int16 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:17.7025695Z test_integer_addcdiv_deprecated_xla_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:17.7034689Z test_integer_addcdiv_deprecated_xla_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:17.7043689Z test_integer_addcdiv_deprecated_xla_int8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:17.7053053Z test_integer_addcdiv_deprecated_xla_uint8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:19.0829069Z test_lt_with_type_promotion_xla (__main__.TestTypePromotionXLA) ... ok (1.377s) 2024-12-18T00:44:19.0843968Z test_many_promotions_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2024-12-18T00:44:19.1971872Z test_mixed_type_backward_xla (__main__.TestTypePromotionXLA) ... ok (0.112s) 2024-12-18T00:44:19.2211343Z test_non_promoting_ops_xla (__main__.TestTypePromotionXLA) ... ok (0.024s) 2024-12-18T00:44:19.2222058Z test_numpy_array_binary_ufunc_promotion_xla_bool_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.2239382Z test_numpy_array_binary_ufunc_promotion_xla_bool_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.2254182Z test_numpy_array_binary_ufunc_promotion_xla_bool_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.2270539Z test_numpy_array_binary_ufunc_promotion_xla_bool_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2286227Z test_numpy_array_binary_ufunc_promotion_xla_bool_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.2301220Z test_numpy_array_binary_ufunc_promotion_xla_bool_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.2318043Z test_numpy_array_binary_ufunc_promotion_xla_bool_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.2333469Z test_numpy_array_binary_ufunc_promotion_xla_bool_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.2348724Z test_numpy_array_binary_ufunc_promotion_xla_bool_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.2365312Z test_numpy_array_binary_ufunc_promotion_xla_bool_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.2380380Z test_numpy_array_binary_ufunc_promotion_xla_bool_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.2396836Z test_numpy_array_binary_ufunc_promotion_xla_complex128_bool (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2412396Z test_numpy_array_binary_ufunc_promotion_xla_complex128_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2427174Z test_numpy_array_binary_ufunc_promotion_xla_complex128_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2444806Z test_numpy_array_binary_ufunc_promotion_xla_complex128_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2458940Z test_numpy_array_binary_ufunc_promotion_xla_complex128_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.2475259Z test_numpy_array_binary_ufunc_promotion_xla_complex128_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2491649Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2505847Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2522072Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2536946Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2552635Z test_numpy_array_binary_ufunc_promotion_xla_complex128_uint8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.2569733Z test_numpy_array_binary_ufunc_promotion_xla_complex64_bool (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2584080Z test_numpy_array_binary_ufunc_promotion_xla_complex64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2602217Z test_numpy_array_binary_ufunc_promotion_xla_complex64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2615699Z test_numpy_array_binary_ufunc_promotion_xla_complex64_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2632047Z test_numpy_array_binary_ufunc_promotion_xla_complex64_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2647267Z test_numpy_array_binary_ufunc_promotion_xla_complex64_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2662765Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2680729Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2696003Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2710168Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2726308Z test_numpy_array_binary_ufunc_promotion_xla_complex64_uint8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2741213Z test_numpy_array_binary_ufunc_promotion_xla_float16_bool (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2757808Z test_numpy_array_binary_ufunc_promotion_xla_float16_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2773278Z test_numpy_array_binary_ufunc_promotion_xla_float16_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2787898Z test_numpy_array_binary_ufunc_promotion_xla_float16_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2804206Z test_numpy_array_binary_ufunc_promotion_xla_float16_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2818856Z test_numpy_array_binary_ufunc_promotion_xla_float16_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2835107Z test_numpy_array_binary_ufunc_promotion_xla_float16_int16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2849794Z test_numpy_array_binary_ufunc_promotion_xla_float16_int32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2865496Z test_numpy_array_binary_ufunc_promotion_xla_float16_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2881689Z test_numpy_array_binary_ufunc_promotion_xla_float16_int8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2898639Z test_numpy_array_binary_ufunc_promotion_xla_float16_uint8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2912961Z test_numpy_array_binary_ufunc_promotion_xla_float32_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.2928406Z test_numpy_array_binary_ufunc_promotion_xla_float32_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.2942981Z test_numpy_array_binary_ufunc_promotion_xla_float32_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.2959548Z test_numpy_array_binary_ufunc_promotion_xla_float32_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.2975232Z test_numpy_array_binary_ufunc_promotion_xla_float32_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.2991022Z test_numpy_array_binary_ufunc_promotion_xla_float32_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3007087Z test_numpy_array_binary_ufunc_promotion_xla_float32_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3021773Z test_numpy_array_binary_ufunc_promotion_xla_float32_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3038266Z test_numpy_array_binary_ufunc_promotion_xla_float32_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3053539Z test_numpy_array_binary_ufunc_promotion_xla_float32_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.3070090Z test_numpy_array_binary_ufunc_promotion_xla_float32_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3085777Z test_numpy_array_binary_ufunc_promotion_xla_float64_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3100528Z test_numpy_array_binary_ufunc_promotion_xla_float64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.3116873Z test_numpy_array_binary_ufunc_promotion_xla_float64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.3132118Z test_numpy_array_binary_ufunc_promotion_xla_float64_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.3147084Z test_numpy_array_binary_ufunc_promotion_xla_float64_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.3163533Z test_numpy_array_binary_ufunc_promotion_xla_float64_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3178518Z test_numpy_array_binary_ufunc_promotion_xla_float64_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3194974Z test_numpy_array_binary_ufunc_promotion_xla_float64_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3210562Z test_numpy_array_binary_ufunc_promotion_xla_float64_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3225532Z test_numpy_array_binary_ufunc_promotion_xla_float64_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.3241967Z test_numpy_array_binary_ufunc_promotion_xla_float64_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3257030Z test_numpy_array_binary_ufunc_promotion_xla_int16_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3273396Z test_numpy_array_binary_ufunc_promotion_xla_int16_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.3288643Z test_numpy_array_binary_ufunc_promotion_xla_int16_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.3303382Z test_numpy_array_binary_ufunc_promotion_xla_int16_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.3319603Z test_numpy_array_binary_ufunc_promotion_xla_int16_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3335110Z test_numpy_array_binary_ufunc_promotion_xla_int16_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3350229Z test_numpy_array_binary_ufunc_promotion_xla_int16_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.3366625Z test_numpy_array_binary_ufunc_promotion_xla_int16_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3381597Z test_numpy_array_binary_ufunc_promotion_xla_int16_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3397982Z test_numpy_array_binary_ufunc_promotion_xla_int16_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3413682Z test_numpy_array_binary_ufunc_promotion_xla_int16_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3430038Z test_numpy_array_binary_ufunc_promotion_xla_int32_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3444084Z test_numpy_array_binary_ufunc_promotion_xla_int32_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.3459867Z test_numpy_array_binary_ufunc_promotion_xla_int32_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.3476105Z test_numpy_array_binary_ufunc_promotion_xla_int32_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.3491660Z test_numpy_array_binary_ufunc_promotion_xla_int32_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3506563Z test_numpy_array_binary_ufunc_promotion_xla_int32_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3522888Z test_numpy_array_binary_ufunc_promotion_xla_int32_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3538029Z test_numpy_array_binary_ufunc_promotion_xla_int32_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3553820Z test_numpy_array_binary_ufunc_promotion_xla_int32_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.3570346Z test_numpy_array_binary_ufunc_promotion_xla_int32_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3585260Z test_numpy_array_binary_ufunc_promotion_xla_int32_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3601698Z test_numpy_array_binary_ufunc_promotion_xla_int64_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3616521Z test_numpy_array_binary_ufunc_promotion_xla_int64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.3631830Z test_numpy_array_binary_ufunc_promotion_xla_int64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.3647469Z test_numpy_array_binary_ufunc_promotion_xla_int64_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.3663031Z test_numpy_array_binary_ufunc_promotion_xla_int64_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3679609Z test_numpy_array_binary_ufunc_promotion_xla_int64_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3695282Z test_numpy_array_binary_ufunc_promotion_xla_int64_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3710927Z test_numpy_array_binary_ufunc_promotion_xla_int64_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3726347Z test_numpy_array_binary_ufunc_promotion_xla_int64_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3741212Z test_numpy_array_binary_ufunc_promotion_xla_int64_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3757970Z test_numpy_array_binary_ufunc_promotion_xla_int64_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2024-12-18T00:44:19.3773511Z test_numpy_array_binary_ufunc_promotion_xla_int8_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3788336Z test_numpy_array_binary_ufunc_promotion_xla_int8_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.3804514Z test_numpy_array_binary_ufunc_promotion_xla_int8_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.3819120Z test_numpy_array_binary_ufunc_promotion_xla_int8_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.3835481Z test_numpy_array_binary_ufunc_promotion_xla_int8_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3850304Z test_numpy_array_binary_ufunc_promotion_xla_int8_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3865933Z test_numpy_array_binary_ufunc_promotion_xla_int8_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3882425Z test_numpy_array_binary_ufunc_promotion_xla_int8_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3897326Z test_numpy_array_binary_ufunc_promotion_xla_int8_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3913585Z test_numpy_array_binary_ufunc_promotion_xla_int8_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3929076Z test_numpy_array_binary_ufunc_promotion_xla_int8_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3944045Z test_numpy_array_binary_ufunc_promotion_xla_uint8_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.3960709Z test_numpy_array_binary_ufunc_promotion_xla_uint8_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:19.3976111Z test_numpy_array_binary_ufunc_promotion_xla_uint8_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:19.3991227Z test_numpy_array_binary_ufunc_promotion_xla_uint8_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2024-12-18T00:44:19.4007471Z test_numpy_array_binary_ufunc_promotion_xla_uint8_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.4022219Z test_numpy_array_binary_ufunc_promotion_xla_uint8_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.4038740Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.4053507Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.4070301Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.4085826Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.4100647Z test_numpy_array_binary_ufunc_promotion_xla_uint8_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2024-12-18T00:44:19.4126384Z test_promote_self_xla (__main__.TestTypePromotionXLA) ... ok (0.002s) 2024-12-18T00:44:19.4164468Z test_promote_types_xla (__main__.TestTypePromotionXLA) ... ok (0.004s) 2024-12-18T00:44:19.4209305Z test_result_type_tensor_vs_scalar_xla (__main__.TestTypePromotionXLA) ... ok (0.004s) 2024-12-18T00:44:19.4218247Z test_result_type_xla_bfloat16_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.4748760Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.054s) 2024-12-18T00:44:19.4767758Z test_result_type_xla_bfloat16_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.4809580Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:19.4819594Z test_result_type_xla_bfloat16_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.4824177Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.4843290Z test_result_type_xla_bfloat16_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.4845903Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.4856540Z test_result_type_xla_bfloat16_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.4860967Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.4879439Z test_result_type_xla_bfloat16_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.5375458Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2024-12-18T00:44:19.5385524Z test_result_type_xla_bfloat16_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.5885509Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2024-12-18T00:44:19.5897271Z test_result_type_xla_bfloat16_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.6390153Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2024-12-18T00:44:19.6408078Z test_result_type_xla_bfloat16_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.6894910Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.050s) 2024-12-18T00:44:19.6903626Z test_result_type_xla_bfloat16_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.7398513Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.050s) 2024-12-18T00:44:19.7412656Z test_result_type_xla_bfloat16_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.7899123Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.050s) 2024-12-18T00:44:19.7917955Z test_result_type_xla_bfloat16_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8408473Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.050s) 2024-12-18T00:44:19.8418214Z test_result_type_xla_bool_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8460743Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:19.8479295Z test_result_type_xla_bool_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8514883Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.8527812Z test_result_type_xla_bool_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8528583Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.8541630Z test_result_type_xla_bool_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8546351Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.8565662Z test_result_type_xla_bool_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8566650Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.8578426Z test_result_type_xla_bool_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8620168Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.8637220Z test_result_type_xla_bool_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8680531Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:19.8695894Z test_result_type_xla_bool_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8732407Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.8742097Z test_result_type_xla_bool_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8780126Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.8798965Z test_result_type_xla_bool_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8834629Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.8846120Z test_result_type_xla_bool_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8886152Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.8897936Z test_result_type_xla_bool_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8936311Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.8947303Z test_result_type_xla_complex128_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8951674Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.8970997Z test_result_type_xla_complex128_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8971792Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.8983761Z test_result_type_xla_complex128_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.8987975Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9007559Z test_result_type_xla_complex128_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9008359Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9020011Z test_result_type_xla_complex128_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9024360Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9043945Z test_result_type_xla_complex128_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9045320Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9056752Z test_result_type_xla_complex128_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9061000Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9080472Z test_result_type_xla_complex128_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9081350Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9097050Z test_result_type_xla_complex128_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9097930Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9115321Z test_result_type_xla_complex128_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9116200Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9132585Z test_result_type_xla_complex128_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9133365Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9147113Z test_result_type_xla_complex128_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9151484Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9168670Z test_result_type_xla_complex64_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9169694Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9183196Z test_result_type_xla_complex64_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9187596Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9206983Z test_result_type_xla_complex64_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9207781Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9219573Z test_result_type_xla_complex64_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9223913Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9243661Z test_result_type_xla_complex64_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9244634Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9255971Z test_result_type_xla_complex64_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9260445Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9279841Z test_result_type_xla_complex64_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9280686Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9297945Z test_result_type_xla_complex64_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9298736Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9313986Z test_result_type_xla_complex64_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9314785Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9332100Z test_result_type_xla_complex64_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9332848Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9346496Z test_result_type_xla_complex64_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9350917Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9369782Z test_result_type_xla_complex64_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9370572Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9382859Z test_result_type_xla_float16_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9387223Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9406380Z test_result_type_xla_float16_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9407147Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9419471Z test_result_type_xla_float16_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9423750Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9443541Z test_result_type_xla_float16_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9444989Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9455670Z test_result_type_xla_float16_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9460192Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9479287Z test_result_type_xla_float16_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9480132Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9498027Z test_result_type_xla_float16_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9498812Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9515829Z test_result_type_xla_float16_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9516673Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9531935Z test_result_type_xla_float16_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9533086Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9546952Z test_result_type_xla_float16_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9552327Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9571642Z test_result_type_xla_float16_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9572510Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9584111Z test_result_type_xla_float16_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9588396Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9607608Z test_result_type_xla_float32_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9651790Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:19.9665057Z test_result_type_xla_float32_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9707283Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:19.9726623Z test_result_type_xla_float32_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9727517Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:19.9739287Z test_result_type_xla_float32_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9743544Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:19.9762537Z test_result_type_xla_float32_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9763396Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:19.9778583Z test_result_type_xla_float32_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9822784Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:19.9842211Z test_result_type_xla_float32_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9888268Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:19.9898277Z test_result_type_xla_float32_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:19.9941844Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:19.9955164Z test_result_type_xla_float32_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0002158Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0018203Z test_result_type_xla_float32_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0057054Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0076462Z test_result_type_xla_float32_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0119197Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0133945Z test_result_type_xla_float32_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0178541Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0187029Z test_result_type_xla_float64_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0237730Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0247778Z test_result_type_xla_float64_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0294255Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.0303001Z test_result_type_xla_float64_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0307484Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:20.0327228Z test_result_type_xla_float64_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0328012Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:20.0339392Z test_result_type_xla_float64_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0343708Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:20.0364388Z test_result_type_xla_float64_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0413001Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0420968Z test_result_type_xla_float64_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0467813Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0487147Z test_result_type_xla_float64_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0529826Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0539472Z test_result_type_xla_float64_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0583197Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0601746Z test_result_type_xla_float64_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0646692Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0656964Z test_result_type_xla_float64_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0700094Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0719143Z test_result_type_xla_float64_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0762400Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0775871Z test_result_type_xla_int16_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0818201Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.0828003Z test_result_type_xla_int16_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0865809Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.0884595Z test_result_type_xla_int16_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0885633Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:20.0898665Z test_result_type_xla_int16_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0901783Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:20.0921141Z test_result_type_xla_int16_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0921919Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:20.0937975Z test_result_type_xla_int16_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.0978788Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.0995592Z test_result_type_xla_int16_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1039072Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.1047608Z test_result_type_xla_int16_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1089599Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1098496Z test_result_type_xla_int16_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1139150Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1150439Z test_result_type_xla_int16_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1190300Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1208074Z test_result_type_xla_int16_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1246289Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1255668Z test_result_type_xla_int16_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1297597Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1307462Z test_result_type_xla_int32_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1351280Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.1370726Z test_result_type_xla_int32_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1407282Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1417391Z test_result_type_xla_int32_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1420388Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:20.1438289Z test_result_type_xla_int32_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1439072Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:20.1452064Z test_result_type_xla_int32_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1456572Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:20.1475724Z test_result_type_xla_int32_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1517671Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.1533850Z test_result_type_xla_int32_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1575182Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.1585984Z test_result_type_xla_int32_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1624333Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1643133Z test_result_type_xla_int32_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1681603Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1696778Z test_result_type_xla_int32_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1733932Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1742555Z test_result_type_xla_int32_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1781307Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1799370Z test_result_type_xla_int32_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1839915Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1848421Z test_result_type_xla_int64_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1896058Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.1903791Z test_result_type_xla_int64_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1940864Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.1953984Z test_result_type_xla_int64_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1958417Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:20.1977494Z test_result_type_xla_int64_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1978285Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:20.1995018Z test_result_type_xla_int64_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.1995844Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:20.2013821Z test_result_type_xla_int64_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2051721Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.2064696Z test_result_type_xla_int64_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2108066Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.2127305Z test_result_type_xla_int64_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2166110Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2177191Z test_result_type_xla_int64_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2218265Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2225796Z test_result_type_xla_int64_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2263723Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2281518Z test_result_type_xla_int64_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2320704Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2333834Z test_result_type_xla_int64_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2373408Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2381262Z test_result_type_xla_int8_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2424777Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.2443799Z test_result_type_xla_int8_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2479792Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2495490Z test_result_type_xla_int8_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2496558Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:20.2507836Z test_result_type_xla_int8_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2512276Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:20.2531679Z test_result_type_xla_int8_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2532594Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:20.2544565Z test_result_type_xla_int8_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2587911Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.2607233Z test_result_type_xla_int8_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2647062Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.2659242Z test_result_type_xla_int8_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2699071Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2717045Z test_result_type_xla_int8_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2751888Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2770627Z test_result_type_xla_int8_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2809281Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2818627Z test_result_type_xla_int8_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2857187Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2875417Z test_result_type_xla_int8_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2915122Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.2930246Z test_result_type_xla_uint8_bfloat16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.2974009Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.2981937Z test_result_type_xla_uint8_bool (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3019178Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.3037010Z test_result_type_xla_uint8_complex128 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3037874Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2024-12-18T00:44:20.3049938Z test_result_type_xla_uint8_complex64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3054352Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2024-12-18T00:44:20.3067720Z test_result_type_xla_uint8_float16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3072197Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2024-12-18T00:44:20.3090945Z test_result_type_xla_uint8_float32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3133114Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.3143112Z test_result_type_xla_uint8_float64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3186416Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2024-12-18T00:44:20.3205605Z test_result_type_xla_uint8_int16 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3243647Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.3253348Z test_result_type_xla_uint8_int32 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3294752Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.3304923Z test_result_type_xla_uint8_int64 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3343320Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.3360980Z test_result_type_xla_uint8_int8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3400102Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.3414750Z test_result_type_xla_uint8_uint8 (__main__.TestTypePromotionXLA) 2024-12-18T00:44:20.3447349Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2024-12-18T00:44:20.3453656Z test_sparse_add_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3462648Z test_sparse_div_promotion_xla_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3471268Z test_sparse_div_promotion_xla_int16 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3479893Z test_sparse_div_promotion_xla_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3488627Z test_sparse_div_promotion_xla_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3497407Z test_sparse_div_promotion_xla_uint8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3504139Z test_sparse_div_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3510658Z test_sparse_mul_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3517093Z test_sparse_sub_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.3526719Z test_ternary_out_promotion_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4475009Z test_transpose_xla (__main__.TestTypePromotionXLA) ... ok (0.094s) 2024-12-18T00:44:20.4485136Z test_unary_op_out_casting_xla_complex128_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4499862Z test_unary_op_out_casting_xla_complex128_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4514790Z test_unary_op_out_casting_xla_complex128_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4528045Z test_unary_op_out_casting_xla_complex128_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4542019Z test_unary_op_out_casting_xla_complex128_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4557508Z test_unary_op_out_casting_xla_complex64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4570442Z test_unary_op_out_casting_xla_complex64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4584613Z test_unary_op_out_casting_xla_complex64_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4599481Z test_unary_op_out_casting_xla_complex64_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4613877Z test_unary_op_out_casting_xla_complex64_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4626746Z test_unary_op_out_casting_xla_float32_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4641638Z test_unary_op_out_casting_xla_float32_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4655266Z test_unary_op_out_casting_xla_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4670502Z test_unary_op_out_casting_xla_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4684845Z test_unary_op_out_casting_xla_float32_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4698131Z test_unary_op_out_casting_xla_float64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4711954Z test_unary_op_out_casting_xla_float64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4727066Z test_unary_op_out_casting_xla_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4740316Z test_unary_op_out_casting_xla_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4754751Z test_unary_op_out_casting_xla_float64_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4769683Z test_unary_op_out_casting_xla_int64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2024-12-18T00:44:20.4782980Z test_unary_op_out_casting_xla_int64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2024-12-18T00:44:20.4797906Z test_unary_op_out_casting_xla_int64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4811138Z test_unary_op_out_casting_xla_int64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4825463Z test_unary_op_out_casting_xla_int64_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2024-12-18T00:44:20.4836900Z test_unsigned_xla (__main__.TestTypePromotionXLA) ... ok (0.001s) 2024-12-18T00:44:20.4837331Z 2024-12-18T00:44:20.4837496Z ---------------------------------------------------------------------- 2024-12-18T00:44:20.4837905Z Ran 416 tests in 44.933s 2024-12-18T00:44:20.4838097Z 2024-12-18T00:44:20.4838194Z OK (skipped=309) 2024-12-18T00:44:20.4838354Z 2024-12-18T00:44:20.4838463Z Generating XML reports... 2024-12-18T00:44:20.5200411Z Generated XML report: test-reports/python-unittest/test.......test.test_type_promotion/TEST-TestTypePromotionXLA-20241218004335.xml 2024-12-18T00:44:21.2335928Z + [[ 1 != \1 ]] 2024-12-18T00:44:21.2338238Z + popd 2024-12-18T00:44:21.2338494Z /var/lib/jenkins/workspace 2024-12-18T00:44:21.2339016Z + run_torch_xla_cpp_tests /var/lib/jenkins/workspace /var/lib/jenkins/workspace/xla 0 2024-12-18T00:44:21.2339551Z + PYTORCH_DIR=/var/lib/jenkins/workspace 2024-12-18T00:44:21.2339909Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2024-12-18T00:44:21.2340237Z + USE_COVERAGE=0 2024-12-18T00:44:21.2340494Z + pushd /var/lib/jenkins/workspace/xla 2024-12-18T00:44:21.2340918Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2024-12-18T00:44:21.2341332Z + echo 'Running C++ Tests on PJRT' 2024-12-18T00:44:21.2341648Z Running C++ Tests on PJRT 2024-12-18T00:44:21.2341935Z + EXTRA_ARGS= 2024-12-18T00:44:21.2342158Z + '[' 0 '!=' 0 ']' 2024-12-18T00:44:21.2342401Z + '[' '!' -z '' ']' 2024-12-18T00:44:21.2342642Z + '[' 0 '!=' 0 ']' 2024-12-18T00:44:21.2342927Z ++ command -v nvidia-smi 2024-12-18T00:44:21.2345922Z + '[' -x '' ']' 2024-12-18T00:44:21.2346164Z + PJRT_DEVICE=CPU 2024-12-18T00:44:21.2346437Z + test/cpp/run_tests.sh -L 2024-12-18T00:44:21.2363508Z /bin/bash: /opt/conda/lib/libtinfo.so.6: no version information available (required by /bin/bash) 2024-12-18T00:44:21.2378322Z +++ dirname test/cpp/run_tests.sh 2024-12-18T00:44:21.2382993Z ++ cd test/cpp 2024-12-18T00:44:21.2383249Z ++ pwd -P 2024-12-18T00:44:21.2385016Z + RUNDIR=/var/lib/jenkins/workspace/xla/test/cpp 2024-12-18T00:44:21.2385385Z + BUILDTYPE=opt 2024-12-18T00:44:21.2385626Z + VERB= 2024-12-18T00:44:21.2385842Z + FILTER= 2024-12-18T00:44:21.2386087Z + LOGFILE=/tmp/pytorch_cpp_test.log 2024-12-18T00:44:21.2386428Z + XLA_EXPERIMENTAL=nonzero:masked_select:nms 2024-12-18T00:44:21.2386942Z + BAZEL_REMOTE_CACHE=0 2024-12-18T00:44:21.2387214Z + BAZEL_VERB=test 2024-12-18T00:44:21.2387524Z + CONTINUE_ON_ERROR=false 2024-12-18T00:44:21.2387812Z + [[ false == \1 ]] 2024-12-18T00:44:21.2388042Z + '[' '' == 1 ']' 2024-12-18T00:44:21.2388297Z + getopts VLDKBF:X:RC OPTION 2024-12-18T00:44:21.2388589Z + case $OPTION in 2024-12-18T00:44:21.2388831Z + LOGFILE= 2024-12-18T00:44:21.2389081Z + getopts VLDKBF:X:RC OPTION 2024-12-18T00:44:21.2389365Z + shift 1 2024-12-18T00:44:21.2389607Z + export XLA_EXPERIMENTAL 2024-12-18T00:44:21.2389870Z + EXTRA_FLAGS= 2024-12-18T00:44:21.2390104Z + [[ '' == \1 ]] 2024-12-18T00:44:21.2390349Z + [[ -n '' ]] 2024-12-18T00:44:21.2390584Z + '[' '!' -z '' ']' 2024-12-18T00:44:21.2390814Z + [[ 0 == \1 ]] 2024-12-18T00:44:21.2391048Z + [[ 0 == \1 ]] 2024-12-18T00:44:21.2391296Z + [[ test == \c\o\v\e\r\a\g\e ]] 2024-12-18T00:44:21.2391602Z + test_names=("all") 2024-12-18T00:44:21.2391876Z + [[ '' == \c\p\p\_\t\e\s\t\s\1 ]] 2024-12-18T00:44:21.2392177Z + [[ '' == \c\p\p\_\t\e\s\t\s\2 ]] 2024-12-18T00:44:21.2392497Z + for name in "${test_names[@]}" 2024-12-18T00:44:21.2392814Z + echo 'Running all cpp test...' 2024-12-18T00:44:21.2393123Z Running all cpp test... 2024-12-18T00:44:21.2393393Z + '[' '' '!=' '' ']' 2024-12-18T00:44:21.2393781Z + bazel test //torch_xla/csrc/runtime:all //test/cpp:all --test_timeout 1200 2024-12-18T00:44:21.2654579Z INFO: Options provided by the client: 2024-12-18T00:44:21.2655117Z Inherited 'common' options: --isatty=1 --terminal_columns=0 2024-12-18T00:44:21.2655822Z INFO: Reading rc options for 'test' from /var/lib/jenkins/workspace/xla/.bazelrc: 2024-12-18T00:44:21.2656547Z Inherited 'common' options: --experimental_repo_remote_exec 2024-12-18T00:44:21.2657236Z INFO: Reading rc options for 'test' from /var/lib/jenkins/workspace/xla/.bazelrc: 2024-12-18T00:44:21.2661051Z Inherited 'build' options: --announce_rc --nocheck_visibility --enable_platform_specific_config --experimental_cc_shared_library --define=no_aws_support=true --define=no_hdfs_support=true --define=no_hdfs_support=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true -c opt --config=short_logs --action_env=CC=gcc --action_env=CXX=g++ --spawn_strategy=standalone --incompatible_strict_action_env --noremote_upload_local_results --java_runtime_version=remotejdk_11 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --define framework_shared_object=false --define tsl_protobuf_header_only=false --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --define=with_xla_support=true --noincompatible_remove_legacy_whole_archive --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility 2024-12-18T00:44:21.2664912Z INFO: Reading rc options for 'test' from /var/lib/jenkins/workspace/xla/.bazelrc: 2024-12-18T00:44:21.2667941Z 'test' options: --test_env=TPU_NUM_DEVICES --test_env=GPU_NUM_DEVICES --test_env=CPU_NUM_DEVICES --test_env=XRT_LOCAL_WORKER --test_env=XRT_TPU_CONFIG --test_env=XRT_DEVICE_MAP --test_env=XRT_WORKERS --test_env=XRT_MESH_SERVICE_ADDRESS --test_env=XRT_SHARD_WORLD_SIZE --test_env=XRT_MULTI_PROCESSING_DEVICE --test_env=XRT_HOST_ORDINAL --test_env=XRT_SHARD_ORDINAL --test_env=XRT_START_LOCAL_SERVER --test_env=TPUVM_MODE --test_env=PJRT_DEVICE --test_env=PJRT_TPU_MAX_INFLIGHT_COMPUTATIONS --test_env=PJRT_CPU_ASYNC_CLIENT --test_env=PJRT_GPU_ASYNC_CLIENT --test_env=TPU_LIBRARY_PATH --test_env=PJRT_DIST_SERVICE_ADDR --test_env=PJRT_LOCAL_PROCESS_RANK --test_env=XLA_EXPERIMENTAL --test_env=LD_LIBRARY_PATH --notrim_test_configuration 2024-12-18T00:44:21.2671511Z INFO: Found applicable config definition build:short_logs in file /var/lib/jenkins/workspace/xla/.bazelrc: --output_filter=DONT_MATCH_ANYTHING 2024-12-18T00:44:21.2675546Z INFO: Found applicable config definition build:linux in file /var/lib/jenkins/workspace/xla/.bazelrc: --config=posix --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --define=build_with_onednn_v2=true --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable 2024-12-18T00:44:21.2679259Z INFO: Found applicable config definition build:posix in file /var/lib/jenkins/workspace/xla/.bazelrc: --copt=-Wno-sign-compare --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 2024-12-18T00:44:21.2680937Z INFO: Found applicable config definition build:dynamic_kernels in file /var/lib/jenkins/workspace/xla/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS 2024-12-18T00:44:22.0353869Z Loading: 2024-12-18T00:44:22.1528405Z 2024-12-18T00:44:22.1529703Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:154:14: 2024-12-18T00:44:22.1530690Z HERMETIC_PYTHON_VERSION variable was not set correctly, using default version. 2024-12-18T00:44:22.1531190Z Python 3.10 will be used. 2024-12-18T00:44:22.1531625Z To select Python version, either set HERMETIC_PYTHON_VERSION env variable in 2024-12-18T00:44:22.1532084Z your shell: 2024-12-18T00:44:22.1532342Z export HERMETIC_PYTHON_VERSION=3.12 2024-12-18T00:44:22.1532794Z OR pass it as an argument to bazel command directly or inside your .bazelrc 2024-12-18T00:44:22.1533230Z file: 2024-12-18T00:44:22.1533487Z --repo_env=HERMETIC_PYTHON_VERSION=3.12 2024-12-18T00:44:22.1533862Z Loading: 2024-12-18T00:44:22.1534179Z Fetching repository @python_version_repo; starting 2024-12-18T00:44:22.1534858Z 2024-12-18T00:44:22.1534978Z  2024-12-18T00:44:22.1535801Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:87:10: 2024-12-18T00:44:22.1536693Z ============================= 2024-12-18T00:44:22.1536997Z Hermetic Python configuration: 2024-12-18T00:44:22.1537291Z Version: "3.10" 2024-12-18T00:44:22.1537535Z Kind: "" 2024-12-18T00:44:22.1537821Z Interpreter: "default" (provided by rules_python) 2024-12-18T00:44:22.1538348Z Requirements_lock label: "@python_version_repo//:requirements_lock_3_10.txt" 2024-12-18T00:44:22.1538828Z ===================================== 2024-12-18T00:44:22.1539154Z Loading: 2024-12-18T00:44:22.1539470Z Fetching repository @python_version_repo; starting 2024-12-18T00:44:22.2149189Z 2024-12-18T00:44:22.2149816Z  2024-12-18T00:44:22.2150685Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2024-12-18T00:44:22.2151681Z Warning: skipping import of repository 'llvm-raw' because it already exists. 2024-12-18T00:44:22.2152241Z Loading: 2024-12-18T00:44:22.2417426Z 2024-12-18T00:44:22.2418895Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2024-12-18T00:44:22.2419956Z Warning: skipping import of repository 'pybind11_bazel' because it already exists. 2024-12-18T00:44:22.2420513Z Loading: 2024-12-18T00:44:22.2420858Z 2024-12-18T00:44:22.2421506Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2024-12-18T00:44:22.2422488Z Warning: skipping import of repository 'pybind11' because it already exists. 2024-12-18T00:44:22.2423005Z Loading: 2024-12-18T00:44:22.2423170Z 2024-12-18T00:44:22.2423802Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2024-12-18T00:44:22.2424854Z Warning: skipping import of repository 'jsoncpp_git' because it already exists. 2024-12-18T00:44:22.2425496Z Loading: 2024-12-18T00:44:22.3713665Z 2024-12-18T00:44:22.3714421Z Loading: 2024-12-18T00:44:22.3714692Z 2024-12-18T00:44:22.3714942Z Loading: 0 packages loaded 2024-12-18T00:44:22.4035432Z 2024-12-18T00:44:22.4036549Z INFO: Build options --cxxopt, --test_env, --test_timeout, and 1 more have changed, discarding analysis cache. 2024-12-18T00:44:22.4037397Z Analyzing: 45 targets (2 packages loaded) 2024-12-18T00:44:22.4815331Z 2024-12-18T00:44:22.4816384Z Analyzing: 45 targets (2 packages loaded, 0 targets configured) 2024-12-18T00:44:22.6828724Z 2024-12-18T00:44:22.6830445Z Analyzing: 45 targets (152 packages loaded, 3313 targets configured) 2024-12-18T00:44:22.6831492Z currently loading: @xla//xla/mlir_hlo ... (13 packages) 2024-12-18T00:44:22.6832387Z Fetching repository @com_google_googletest; starting 2024-12-18T00:44:22.6833140Z Fetching repository @llvm-project; starting 2024-12-18T00:44:22.6833840Z Fetching ...ternal/com_google_googletest; Extracting release-1.12.1.tar.gz 2024-12-18T00:44:22.6834789Z Fetching repository @local_config_sycl; starting 2024-12-18T00:44:22.9307501Z 2024-12-18T00:44:22.9308293Z  2024-12-18T00:44:22.9308740Z  2024-12-18T00:44:22.9309129Z  2024-12-18T00:44:22.9309555Z  2024-12-18T00:44:22.9309942Z  2024-12-18T00:44:22.9310763Z Analyzing: 45 targets (190 packages loaded, 15420 targets configured) 2024-12-18T00:44:22.9311737Z currently loading: @xla//xla/mlir_hlo ... (6 packages) 2024-12-18T00:44:22.9312426Z Fetching repository @llvm-project; starting 2024-12-18T00:44:23.1502967Z 2024-12-18T00:44:23.1503691Z  2024-12-18T00:44:23.1504140Z  2024-12-18T00:44:23.1505012Z Analyzing: 45 targets (199 packages loaded, 31095 targets configured) 2024-12-18T00:44:23.1506025Z currently loading: @xla//xla/mlir_hlo ... (7 packages) 2024-12-18T00:44:23.4379711Z 2024-12-18T00:44:23.4380402Z  2024-12-18T00:44:23.4380961Z Analyzing: 45 targets (224 packages loaded, 40708 targets configured) 2024-12-18T00:44:23.6899484Z 2024-12-18T00:44:23.6900409Z INFO: Analyzed 45 targets (224 packages loaded, 40802 targets configured). 2024-12-18T00:44:23.6900999Z  checking cached actions 2024-12-18T00:44:23.6978379Z 2024-12-18T00:44:23.6978950Z INFO: Found 28 targets and 17 test targets... 2024-12-18T00:44:23.6979479Z  checking cached actions 2024-12-18T00:44:23.7403269Z 2024-12-18T00:44:23.7404181Z [0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2024-12-18T00:44:23.9414173Z 2024-12-18T00:44:23.9415200Z [505 / 19,753] 40 actions, 37 running 2024-12-18T00:44:23.9416191Z Compiling googletest/src/gtest-assertion-result.cc; 0s local 2024-12-18T00:44:23.9417384Z Compiling googletest/src/gtest-death-test.cc; 0s local 2024-12-18T00:44:23.9418325Z Compiling absl/profiling/internal/exponential_biased.cc; 0s local 2024-12-18T00:44:23.9419208Z Compiling googlemock/src/gmock_main.cc; 0s local 2024-12-18T00:44:23.9420111Z Compiling absl/time/internal/cctz/src/civil_time_detail.cc; 0s local 2024-12-18T00:44:23.9421174Z Compiling absl/time/internal/cctz/src/time_zone_fixed.cc; 0s local 2024-12-18T00:44:23.9422424Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2024-12-18T00:44:23.9423238Z Compiling deflate.c; 0s local ... 2024-12-18T00:44:24.2151010Z 2024-12-18T00:44:24.2151647Z  2024-12-18T00:44:24.2151944Z  2024-12-18T00:44:24.2152210Z  2024-12-18T00:44:24.2152438Z  2024-12-18T00:44:24.2152679Z  2024-12-18T00:44:24.2152915Z  2024-12-18T00:44:24.2153152Z  2024-12-18T00:44:24.2153374Z  2024-12-18T00:44:24.2153713Z [829 / 19,839] 41 actions, 40 running 2024-12-18T00:44:24.2154366Z Compiling googletest/src/gtest-assertion-result.cc; 0s local 2024-12-18T00:44:24.2155000Z Compiling googletest/src/gtest-death-test.cc; 0s local 2024-12-18T00:44:24.2155529Z Compiling absl/profiling/internal/exponential_biased.cc; 0s local 2024-12-18T00:44:24.2156017Z Compiling googlemock/src/gmock_main.cc; 0s local 2024-12-18T00:44:24.2156526Z Compiling absl/time/internal/cctz/src/civil_time_detail.cc; 0s local 2024-12-18T00:44:24.2157114Z Compiling absl/time/internal/cctz/src/time_zone_fixed.cc; 0s local 2024-12-18T00:44:24.2157692Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2024-12-18T00:44:24.2158161Z Compiling deflate.c; 0s local ... 2024-12-18T00:44:24.4154076Z 2024-12-18T00:44:24.4154927Z  2024-12-18T00:44:24.4155357Z  2024-12-18T00:44:24.4155753Z  2024-12-18T00:44:24.4156127Z  2024-12-18T00:44:24.4156505Z  2024-12-18T00:44:24.4156880Z  2024-12-18T00:44:24.4157270Z  2024-12-18T00:44:24.4157644Z  2024-12-18T00:44:24.4158259Z [1,007 / 20,220] 46 actions, 45 running 2024-12-18T00:44:24.4159072Z Compiling googletest/src/gtest-assertion-result.cc; 0s local 2024-12-18T00:44:24.4159943Z Compiling googletest/src/gtest-death-test.cc; 0s local 2024-12-18T00:44:24.4160684Z Compiling googlemock/src/gmock_main.cc; 0s local 2024-12-18T00:44:24.4161543Z Compiling absl/time/internal/cctz/src/civil_time_detail.cc; 0s local 2024-12-18T00:44:24.4162561Z Compiling absl/time/internal/cctz/src/time_zone_fixed.cc; 0s local 2024-12-18T00:44:24.4163567Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2024-12-18T00:44:24.4164325Z Compiling deflate.c; 0s local 2024-12-18T00:44:24.4164887Z Compiling absl/numeric/int128.cc; 0s local ... 2024-12-18T00:44:24.6172056Z 2024-12-18T00:44:24.6172922Z  2024-12-18T00:44:24.6173447Z  2024-12-18T00:44:24.6173867Z  2024-12-18T00:44:24.6174378Z  2024-12-18T00:44:24.6174752Z  2024-12-18T00:44:24.6175172Z  2024-12-18T00:44:24.6175548Z  2024-12-18T00:44:24.6175952Z  2024-12-18T00:44:24.6176653Z [1,201 / 20,222] 43 actions, 42 running 2024-12-18T00:44:24.6177397Z Compiling googletest/src/gtest-death-test.cc; 0s local 2024-12-18T00:44:24.6178197Z Compiling googlemock/src/gmock_main.cc; 0s local 2024-12-18T00:44:24.6179084Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2024-12-18T00:44:24.6179951Z Compiling absl/numeric/int128.cc; 0s local 2024-12-18T00:44:24.6180579Z Compiling googletest/src/gtest.cc; 0s local 2024-12-18T00:44:24.6181324Z Compiling googletest/src/gtest-typed-test.cc; 0s local 2024-12-18T00:44:24.6182215Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2024-12-18T00:44:24.6183268Z Compiling absl/time/internal/cctz/src/time_zone_impl.cc; 0s local ... 2024-12-18T00:44:24.8185582Z 2024-12-18T00:44:24.8186484Z  2024-12-18T00:44:24.8187012Z  2024-12-18T00:44:24.8187539Z  2024-12-18T00:44:24.8187930Z  2024-12-18T00:44:24.8188314Z  2024-12-18T00:44:24.8188696Z  2024-12-18T00:44:24.8189066Z  2024-12-18T00:44:24.8189457Z  2024-12-18T00:44:24.8190017Z [1,362 / 20,222] 44 actions, 43 running 2024-12-18T00:44:24.8190786Z Compiling googletest/src/gtest-death-test.cc; 1s local 2024-12-18T00:44:24.8191580Z Compiling googlemock/src/gmock_main.cc; 1s local 2024-12-18T00:44:24.8192795Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 1s local 2024-12-18T00:44:24.8193667Z Compiling googletest/src/gtest.cc; 1s local 2024-12-18T00:44:24.8194427Z Compiling googletest/src/gtest-typed-test.cc; 1s local 2024-12-18T00:44:24.8195408Z Compiling absl/time/internal/cctz/src/time_zone_impl.cc; 1s local 2024-12-18T00:44:24.8196437Z Compiling src/google/protobuf/compiler/main.cc [for tool]; 1s local 2024-12-18T00:44:24.8197316Z @com_google_protobuf//:protoc_lib; 1s local ... 2024-12-18T00:44:25.0197749Z 2024-12-18T00:44:25.0198608Z  2024-12-18T00:44:25.0199069Z  2024-12-18T00:44:25.0199598Z  2024-12-18T00:44:25.0200014Z  2024-12-18T00:44:25.0200422Z  2024-12-18T00:44:25.0200851Z  2024-12-18T00:44:25.0201268Z  2024-12-18T00:44:25.0201708Z  2024-12-18T00:44:25.0202357Z [1,556 / 20,222] 44 actions, 43 running 2024-12-18T00:44:25.0203232Z Compiling googletest/src/gtest-death-test.cc; 1s local 2024-12-18T00:44:25.0203986Z Compiling googlemock/src/gmock_main.cc; 1s local 2024-12-18T00:44:25.0205058Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 1s local 2024-12-18T00:44:25.0206043Z Compiling googletest/src/gtest.cc; 1s local 2024-12-18T00:44:25.0206896Z Compiling googletest/src/gtest-typed-test.cc; 1s local 2024-12-18T00:44:25.0207745Z @com_google_protobuf//:protoc_lib; 1s local 2024-12-18T00:44:25.0208450Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2024-12-18T00:44:25.0209371Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 1s local ... 2024-12-18T00:44:25.2226986Z 2024-12-18T00:44:25.2227913Z  2024-12-18T00:44:25.2228295Z  2024-12-18T00:44:25.2228599Z  2024-12-18T00:44:25.2228914Z  2024-12-18T00:44:25.2229256Z  2024-12-18T00:44:25.2229623Z  2024-12-18T00:44:25.2229931Z  2024-12-18T00:44:25.2230258Z  2024-12-18T00:44:25.2230757Z [1,654 / 20,222] 42 actions, 41 running 2024-12-18T00:44:25.2231497Z Compiling googletest/src/gtest-death-test.cc; 1s local 2024-12-18T00:44:25.2232262Z Compiling googlemock/src/gmock_main.cc; 1s local 2024-12-18T00:44:25.2232891Z Compiling googletest/src/gtest.cc; 1s local 2024-12-18T00:44:25.2233514Z Compiling googletest/src/gtest-typed-test.cc; 1s local 2024-12-18T00:44:25.2234149Z @com_google_protobuf//:protoc_lib; 1s local 2024-12-18T00:44:25.2234776Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2024-12-18T00:44:25.2235552Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 1s local 2024-12-18T00:44:25.2236281Z Compiling src/lib_json/json_writer.cpp; 1s local ... 2024-12-18T00:44:25.4230209Z 2024-12-18T00:44:25.4231028Z  2024-12-18T00:44:25.4231502Z  2024-12-18T00:44:25.4231886Z  2024-12-18T00:44:25.4232270Z  2024-12-18T00:44:25.4232647Z  2024-12-18T00:44:25.4233014Z  2024-12-18T00:44:25.4233389Z  2024-12-18T00:44:25.4233790Z  2024-12-18T00:44:25.4234376Z [1,859 / 20,226] 43 actions, 41 running 2024-12-18T00:44:25.4235137Z Compiling googletest/src/gtest-death-test.cc; 1s local 2024-12-18T00:44:25.4235898Z Compiling googlemock/src/gmock_main.cc; 1s local 2024-12-18T00:44:25.4236596Z Compiling googletest/src/gtest.cc; 1s local 2024-12-18T00:44:25.4237329Z Compiling googletest/src/gtest-typed-test.cc; 1s local 2024-12-18T00:44:25.4238069Z @com_google_protobuf//:protoc_lib; 1s local 2024-12-18T00:44:25.4238772Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2024-12-18T00:44:25.4239629Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 1s local 2024-12-18T00:44:25.4240508Z Compiling src/lib_json/json_writer.cpp; 1s local ... 2024-12-18T00:44:25.6247203Z 2024-12-18T00:44:25.6248654Z  2024-12-18T00:44:25.6249160Z  2024-12-18T00:44:25.6249570Z  2024-12-18T00:44:25.6249972Z  2024-12-18T00:44:25.6250354Z  2024-12-18T00:44:25.6251043Z  2024-12-18T00:44:25.6251448Z  2024-12-18T00:44:25.6251851Z  2024-12-18T00:44:25.6252424Z [2,108 / 20,486] 45 actions, 44 running 2024-12-18T00:44:25.6253217Z Compiling googletest/src/gtest-death-test.cc; 1s local 2024-12-18T00:44:25.6254017Z Compiling googletest/src/gtest.cc; 1s local 2024-12-18T00:44:25.6254723Z @com_google_protobuf//:protoc_lib; 1s local 2024-12-18T00:44:25.6255490Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2024-12-18T00:44:25.6256794Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 1s local 2024-12-18T00:44:25.6257912Z Compiling src/lib_json/json_writer.cpp; 1s local 2024-12-18T00:44:25.6258690Z Compiling googlemock/src/gmock_main.cc; 1s local 2024-12-18T00:44:25.6259578Z Compiling src/compiler/cpp_plugin.cc [for tool]; 1s local ... 2024-12-18T00:44:25.8266666Z 2024-12-18T00:44:25.8267947Z  2024-12-18T00:44:25.8268439Z  2024-12-18T00:44:25.8268861Z  2024-12-18T00:44:25.8269271Z  2024-12-18T00:44:25.8269621Z  2024-12-18T00:44:25.8269997Z  2024-12-18T00:44:25.8270398Z  2024-12-18T00:44:25.8270796Z  2024-12-18T00:44:25.8282010Z [2,457 / 20,499] 44 actions, 41 running 2024-12-18T00:44:25.8282821Z Compiling googletest/src/gtest-death-test.cc; 2s local 2024-12-18T00:44:25.8283613Z Compiling googletest/src/gtest.cc; 2s local 2024-12-18T00:44:25.8284374Z Compiling xla/tsl/util/stats_calculator.cc; 2s local 2024-12-18T00:44:25.8285289Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 2s local 2024-12-18T00:44:25.8286228Z Compiling src/lib_json/json_writer.cpp; 1s local 2024-12-18T00:44:25.8287042Z Compiling src/compiler/cpp_plugin.cc [for tool]; 1s local 2024-12-18T00:44:25.8288118Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 1s local 2024-12-18T00:44:25.8289158Z Compiling googlemock/src/gmock-internal-utils.cc; 1s local ... 2024-12-18T00:44:26.0264443Z 2024-12-18T00:44:26.0265357Z  2024-12-18T00:44:26.0265815Z  2024-12-18T00:44:26.0266189Z  2024-12-18T00:44:26.0266578Z  2024-12-18T00:44:26.0266983Z  2024-12-18T00:44:26.0267427Z  2024-12-18T00:44:26.0267816Z  2024-12-18T00:44:26.0268156Z  2024-12-18T00:44:26.0268716Z [2,831 / 20,548] 44 actions, 43 running 2024-12-18T00:44:26.0269505Z Compiling googletest/src/gtest-death-test.cc; 2s local 2024-12-18T00:44:26.0270264Z Compiling googletest/src/gtest.cc; 2s local 2024-12-18T00:44:26.0270989Z Compiling xla/tsl/util/stats_calculator.cc; 2s local 2024-12-18T00:44:26.0271743Z Compiling src/lib_json/json_writer.cpp; 2s local 2024-12-18T00:44:26.0272491Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2024-12-18T00:44:26.0273581Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:44:26.0274634Z Compiling googlemock/src/gmock-internal-utils.cc; 1s local 2024-12-18T00:44:26.0275511Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 1s local ... 2024-12-18T00:44:26.2282522Z 2024-12-18T00:44:26.2283402Z  2024-12-18T00:44:26.2283828Z  2024-12-18T00:44:26.2284163Z  2024-12-18T00:44:26.2284486Z  2024-12-18T00:44:26.2284829Z  2024-12-18T00:44:26.2285171Z  2024-12-18T00:44:26.2285514Z  2024-12-18T00:44:26.2285861Z  2024-12-18T00:44:26.2286354Z [3,149 / 20,548] 45 actions, 43 running 2024-12-18T00:44:26.2287031Z Compiling googletest/src/gtest-death-test.cc; 2s local 2024-12-18T00:44:26.2287717Z Compiling googletest/src/gtest.cc; 2s local 2024-12-18T00:44:26.2288343Z Compiling src/lib_json/json_writer.cpp; 2s local 2024-12-18T00:44:26.2289047Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2024-12-18T00:44:26.2289932Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:44:26.2290849Z Compiling googlemock/src/gmock-internal-utils.cc; 1s local 2024-12-18T00:44:26.2291882Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 1s local 2024-12-18T00:44:26.2292586Z Compiling google/threading.cc; 1s local ... 2024-12-18T00:44:26.4323254Z 2024-12-18T00:44:26.4324201Z  2024-12-18T00:44:26.4324686Z  2024-12-18T00:44:26.4325044Z  2024-12-18T00:44:26.4325471Z  2024-12-18T00:44:26.4325860Z  2024-12-18T00:44:26.4326244Z  2024-12-18T00:44:26.4326636Z  2024-12-18T00:44:26.4327013Z  2024-12-18T00:44:26.4328269Z [3,302 / 20,557] 43 actions, 41 running 2024-12-18T00:44:26.4329510Z Compiling googletest/src/gtest-death-test.cc; 2s local 2024-12-18T00:44:26.4330376Z Compiling googletest/src/gtest.cc; 2s local 2024-12-18T00:44:26.4331140Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2024-12-18T00:44:26.4332171Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:44:26.4333373Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 2s local 2024-12-18T00:44:26.4334267Z Compiling google/threading.cc; 2s local 2024-12-18T00:44:26.4334939Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:44:26.4335514Z Compiling googlemock/src/gmock.cc; 1s local ... 2024-12-18T00:44:26.6306438Z 2024-12-18T00:44:26.6307787Z  2024-12-18T00:44:26.6308252Z  2024-12-18T00:44:26.6308660Z  2024-12-18T00:44:26.6309041Z  2024-12-18T00:44:26.6309416Z  2024-12-18T00:44:26.6309797Z  2024-12-18T00:44:26.6310169Z  2024-12-18T00:44:26.6310526Z  2024-12-18T00:44:26.6311306Z [3,653 / 20,567] 44 actions, 42 running 2024-12-18T00:44:26.6312098Z Compiling googletest/src/gtest-death-test.cc; 2s local 2024-12-18T00:44:26.6312862Z Compiling googletest/src/gtest.cc; 2s local 2024-12-18T00:44:26.6313622Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2024-12-18T00:44:26.6314603Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:44:26.6315656Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 2s local 2024-12-18T00:44:26.6316400Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:44:26.6317008Z Compiling googlemock/src/gmock.cc; 2s local 2024-12-18T00:44:26.6317941Z Compiling googlemock/src/gmock-matchers.cc; 1s local ... 2024-12-18T00:44:26.8318201Z 2024-12-18T00:44:26.8319126Z  2024-12-18T00:44:26.8319570Z  2024-12-18T00:44:26.8319942Z  2024-12-18T00:44:26.8320332Z  2024-12-18T00:44:26.8320715Z  2024-12-18T00:44:26.8321112Z  2024-12-18T00:44:26.8321529Z  2024-12-18T00:44:26.8321926Z  2024-12-18T00:44:26.8322517Z [3,988 / 20,573] 47 actions, 45 running 2024-12-18T00:44:26.8323276Z Compiling googletest/src/gtest-death-test.cc; 3s local 2024-12-18T00:44:26.8324011Z Compiling googletest/src/gtest.cc; 3s local 2024-12-18T00:44:26.8324738Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2024-12-18T00:44:26.8325738Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2024-12-18T00:44:26.8326861Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 2s local 2024-12-18T00:44:26.8327646Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:44:26.8328345Z Compiling googlemock/src/gmock-matchers.cc; 2s local 2024-12-18T00:44:26.8329217Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local ... 2024-12-18T00:44:27.0319948Z 2024-12-18T00:44:27.0320825Z  2024-12-18T00:44:27.0321456Z  2024-12-18T00:44:27.0321902Z  2024-12-18T00:44:27.0322298Z  2024-12-18T00:44:27.0322745Z  2024-12-18T00:44:27.0323117Z  2024-12-18T00:44:27.0323513Z  2024-12-18T00:44:27.0323887Z  2024-12-18T00:44:27.0324457Z [4,354 / 20,573] 47 actions, 45 running 2024-12-18T00:44:27.0325202Z Compiling googletest/src/gtest-death-test.cc; 3s local 2024-12-18T00:44:27.0325984Z Compiling googletest/src/gtest.cc; 3s local 2024-12-18T00:44:27.0326689Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2024-12-18T00:44:27.0328185Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:27.0329136Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:44:27.0329786Z Compiling googlemock/src/gmock-matchers.cc; 2s local 2024-12-18T00:44:27.0330624Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2024-12-18T00:44:27.0331573Z Compiling googlemock/src/gmock-spec-builders.cc; 1s local ... 2024-12-18T00:44:27.2335325Z 2024-12-18T00:44:27.2336169Z  2024-12-18T00:44:27.2337183Z  2024-12-18T00:44:27.2337585Z  2024-12-18T00:44:27.2338093Z  2024-12-18T00:44:27.2338486Z  2024-12-18T00:44:27.2338870Z  2024-12-18T00:44:27.2339254Z  2024-12-18T00:44:27.2339617Z  2024-12-18T00:44:27.2340210Z [4,721 / 20,583] 47 actions, 46 running 2024-12-18T00:44:27.2340932Z Compiling googletest/src/gtest.cc; 3s local 2024-12-18T00:44:27.2341720Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2024-12-18T00:44:27.2342777Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:27.2343681Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:44:27.2344664Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2024-12-18T00:44:27.2345589Z Compiling googlemock/src/gmock-spec-builders.cc; 1s local 2024-12-18T00:44:27.2346453Z Compiling googletest/src/gtest-printers.cc; 1s local 2024-12-18T00:44:27.2347267Z Compiling googletest/src/gtest-port.cc; 1s local ... 2024-12-18T00:44:27.4346316Z 2024-12-18T00:44:27.4347214Z  2024-12-18T00:44:27.4347715Z  2024-12-18T00:44:27.4348096Z  2024-12-18T00:44:27.4348485Z  2024-12-18T00:44:27.4348883Z  2024-12-18T00:44:27.4349277Z  2024-12-18T00:44:27.4349633Z  2024-12-18T00:44:27.4350015Z  2024-12-18T00:44:27.4350598Z [5,088 / 20,583] 48 actions, 46 running 2024-12-18T00:44:27.4351306Z Compiling googletest/src/gtest.cc; 3s local 2024-12-18T00:44:27.4352103Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2024-12-18T00:44:27.4353110Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:27.4354038Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:27.4354778Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2024-12-18T00:44:27.4355652Z Compiling googlemock/src/gmock-spec-builders.cc; 1s local 2024-12-18T00:44:27.4356478Z Compiling googletest/src/gtest-printers.cc; 1s local 2024-12-18T00:44:27.4357255Z Compiling googletest/src/gtest-port.cc; 1s local ... 2024-12-18T00:44:27.6349328Z 2024-12-18T00:44:27.6350361Z  2024-12-18T00:44:27.6350785Z  2024-12-18T00:44:27.6351136Z  2024-12-18T00:44:27.6351518Z  2024-12-18T00:44:27.6351880Z  2024-12-18T00:44:27.6352270Z  2024-12-18T00:44:27.6352642Z  2024-12-18T00:44:27.6353030Z  2024-12-18T00:44:27.6353715Z [5,465 / 20,583] 48 actions, 46 running 2024-12-18T00:44:27.6354395Z Compiling googletest/src/gtest.cc; 3s local 2024-12-18T00:44:27.6355326Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:27.6356169Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:27.6356915Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2024-12-18T00:44:27.6357841Z Compiling googlemock/src/gmock-spec-builders.cc; 2s local 2024-12-18T00:44:27.6358624Z Compiling googletest/src/gtest-port.cc; 1s local 2024-12-18T00:44:27.6359319Z @com_google_protobuf//:protoc_lib; 1s local 2024-12-18T00:44:27.6360077Z Compiling src/google/protobuf/extension_set.cc; 1s local ... 2024-12-18T00:44:27.8853623Z 2024-12-18T00:44:27.8854532Z  2024-12-18T00:44:27.8855050Z  2024-12-18T00:44:27.8855456Z  2024-12-18T00:44:27.8855846Z  2024-12-18T00:44:27.8856312Z  2024-12-18T00:44:27.8856839Z  2024-12-18T00:44:27.8857534Z  2024-12-18T00:44:27.8857924Z  2024-12-18T00:44:27.8858494Z [5,763 / 20,583] 47 actions, 45 running 2024-12-18T00:44:27.8859174Z Compiling googletest/src/gtest.cc; 4s local 2024-12-18T00:44:27.8859784Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:27.8860567Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2024-12-18T00:44:27.8861470Z Compiling googlemock/src/gmock-spec-builders.cc; 2s local 2024-12-18T00:44:27.8862307Z Compiling googletest/src/gtest-port.cc; 2s local 2024-12-18T00:44:27.8863347Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:27.8864296Z Compiling src/google/protobuf/extension_set.cc; 1s local 2024-12-18T00:44:27.8865078Z @com_google_protobuf//:protobuf_lite; 1s local ... 2024-12-18T00:44:28.0852945Z 2024-12-18T00:44:28.0853807Z  2024-12-18T00:44:28.0854302Z  2024-12-18T00:44:28.0854723Z  2024-12-18T00:44:28.0855130Z  2024-12-18T00:44:28.0855564Z  2024-12-18T00:44:28.0855962Z  2024-12-18T00:44:28.0856395Z  2024-12-18T00:44:28.0856935Z  2024-12-18T00:44:28.0857503Z [6,125 / 20,583] 46 actions running 2024-12-18T00:44:28.0858193Z Compiling googletest/src/gtest.cc; 4s local 2024-12-18T00:44:28.0858860Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:28.0859652Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2024-12-18T00:44:28.0860621Z Compiling googlemock/src/gmock-spec-builders.cc; 2s local 2024-12-18T00:44:28.0861455Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:28.0862254Z Compiling src/google/protobuf/extension_set.cc; 2s local 2024-12-18T00:44:28.0863275Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2024-12-18T00:44:28.0864624Z Compiling llvm/utils/TableGen/VTEmitter.cpp [for tool]; 2s local ... 2024-12-18T00:44:28.2866126Z 2024-12-18T00:44:28.2867389Z  2024-12-18T00:44:28.2867861Z  2024-12-18T00:44:28.2868297Z  2024-12-18T00:44:28.2868679Z  2024-12-18T00:44:28.2869063Z  2024-12-18T00:44:28.2869438Z  2024-12-18T00:44:28.2869813Z  2024-12-18T00:44:28.2870194Z  2024-12-18T00:44:28.2870788Z [6,488 / 20,588] 47 actions, 46 running 2024-12-18T00:44:28.2871487Z Compiling googletest/src/gtest.cc; 4s local 2024-12-18T00:44:28.2872151Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:28.2872905Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2024-12-18T00:44:28.2873857Z Compiling googlemock/src/gmock-spec-builders.cc; 2s local 2024-12-18T00:44:28.2874720Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:28.2875554Z Compiling src/google/protobuf/extension_set.cc; 2s local 2024-12-18T00:44:28.2876623Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2024-12-18T00:44:28.2877710Z Compiling src/google/protobuf/wire_format.cc; 2s local ... 2024-12-18T00:44:28.4878265Z 2024-12-18T00:44:28.4879434Z  2024-12-18T00:44:28.4880246Z  2024-12-18T00:44:28.4881249Z  2024-12-18T00:44:28.4881737Z  2024-12-18T00:44:28.4882158Z  2024-12-18T00:44:28.4882534Z  2024-12-18T00:44:28.4882965Z  2024-12-18T00:44:28.4883365Z  2024-12-18T00:44:28.4883926Z [6,795 / 20,588] 48 actions, 47 running 2024-12-18T00:44:28.4884610Z Compiling googletest/src/gtest.cc; 4s local 2024-12-18T00:44:28.4885232Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:28.4885972Z Compiling src/compiler/ruby_generator.cc [for tool]; 3s local 2024-12-18T00:44:28.4886947Z Compiling googlemock/src/gmock-spec-builders.cc; 2s local 2024-12-18T00:44:28.4887889Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:28.4888636Z Compiling src/google/protobuf/extension_set.cc; 2s local 2024-12-18T00:44:28.4889640Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2024-12-18T00:44:28.4890727Z Compiling src/google/protobuf/wire_format.cc; 2s local ... 2024-12-18T00:44:28.6885137Z 2024-12-18T00:44:28.6886048Z  2024-12-18T00:44:28.6886529Z  2024-12-18T00:44:28.6886928Z  2024-12-18T00:44:28.6887323Z  2024-12-18T00:44:28.6887697Z  2024-12-18T00:44:28.6888111Z  2024-12-18T00:44:28.6888504Z  2024-12-18T00:44:28.6888888Z  2024-12-18T00:44:28.6889475Z [6,994 / 20,588] 48 actions, 47 running 2024-12-18T00:44:28.6890161Z Compiling googletest/src/gtest.cc; 4s local 2024-12-18T00:44:28.6891202Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:28.6892091Z Compiling googlemock/src/gmock-spec-builders.cc; 3s local 2024-12-18T00:44:28.6892854Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:28.6893591Z Compiling src/google/protobuf/extension_set.cc; 2s local 2024-12-18T00:44:28.6894544Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2024-12-18T00:44:28.6895497Z Compiling src/google/protobuf/wire_format.cc; 2s local 2024-12-18T00:44:28.6896258Z Compiling src/lib_json/json_value.cpp; 2s local ... 2024-12-18T00:44:28.8900092Z 2024-12-18T00:44:28.8901004Z  2024-12-18T00:44:28.8901482Z  2024-12-18T00:44:28.8901931Z  2024-12-18T00:44:28.8902310Z  2024-12-18T00:44:28.8902716Z  2024-12-18T00:44:28.8903109Z  2024-12-18T00:44:28.8903504Z  2024-12-18T00:44:28.8903882Z  2024-12-18T00:44:28.8904438Z [7,206 / 20,588] 48 actions, 47 running 2024-12-18T00:44:28.8905157Z Compiling googletest/src/gtest.cc; 5s local 2024-12-18T00:44:28.8905785Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:28.8906519Z Compiling googlemock/src/gmock-spec-builders.cc; 3s local 2024-12-18T00:44:28.8907474Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:44:28.8908228Z Compiling src/google/protobuf/extension_set.cc; 2s local 2024-12-18T00:44:28.8909224Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2024-12-18T00:44:28.8910271Z Compiling src/google/protobuf/wire_format.cc; 2s local 2024-12-18T00:44:28.8911072Z Compiling src/lib_json/json_value.cpp; 2s local ... 2024-12-18T00:44:29.0900229Z 2024-12-18T00:44:29.0902315Z  2024-12-18T00:44:29.0902809Z  2024-12-18T00:44:29.0903248Z  2024-12-18T00:44:29.0905092Z  2024-12-18T00:44:29.0905510Z  2024-12-18T00:44:29.0907294Z  2024-12-18T00:44:29.0907701Z  2024-12-18T00:44:29.0909599Z  2024-12-18T00:44:29.0910239Z [7,412 / 20,588] 48 actions, 47 running 2024-12-18T00:44:29.0910968Z Compiling googletest/src/gtest.cc; 5s local 2024-12-18T00:44:29.0912895Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:29.0913511Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:44:29.0914275Z Compiling src/google/protobuf/extension_set.cc; 3s local 2024-12-18T00:44:29.0916457Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:44:29.0917522Z Compiling src/google/protobuf/wire_format.cc; 3s local 2024-12-18T00:44:29.0918361Z Compiling src/lib_json/json_value.cpp; 2s local 2024-12-18T00:44:29.0919121Z @llvm-project//llvm:llvm-min-tblgen; 2s local ... 2024-12-18T00:44:29.2918602Z 2024-12-18T00:44:29.2920760Z  2024-12-18T00:44:29.2922478Z  2024-12-18T00:44:29.2924067Z  2024-12-18T00:44:29.2925682Z  2024-12-18T00:44:29.2927289Z  2024-12-18T00:44:29.2928873Z  2024-12-18T00:44:29.2930532Z  2024-12-18T00:44:29.2932000Z  2024-12-18T00:44:29.2934017Z [7,621 / 20,588] 48 actions, 47 running 2024-12-18T00:44:29.2935993Z Compiling googletest/src/gtest.cc; 5s local 2024-12-18T00:44:29.2938014Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:29.2939827Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:44:29.2941841Z Compiling src/google/protobuf/extension_set.cc; 3s local 2024-12-18T00:44:29.2944376Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:44:29.2951262Z Compiling src/google/protobuf/wire_format.cc; 3s local 2024-12-18T00:44:29.2952501Z @llvm-project//llvm:llvm-min-tblgen; 2s local 2024-12-18T00:44:29.2954621Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:29.4919700Z 2024-12-18T00:44:29.4921768Z  2024-12-18T00:44:29.4923282Z  2024-12-18T00:44:29.4924743Z  2024-12-18T00:44:29.4926159Z  2024-12-18T00:44:29.4928439Z  2024-12-18T00:44:29.4929889Z  2024-12-18T00:44:29.4931433Z  2024-12-18T00:44:29.4933493Z  2024-12-18T00:44:29.4935281Z [7,828 / 20,588] 48 actions, 47 running 2024-12-18T00:44:29.4937242Z Compiling googletest/src/gtest.cc; 5s local 2024-12-18T00:44:29.4939044Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:29.4940722Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:44:29.4942498Z Compiling src/google/protobuf/extension_set.cc; 3s local 2024-12-18T00:44:29.4944820Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:44:29.4946929Z Compiling src/google/protobuf/wire_format.cc; 3s local 2024-12-18T00:44:29.4948904Z Compiling src/google/protobuf/compiler/cpp/enum.cc [for tool]; 2s local 2024-12-18T00:44:29.4951090Z @llvm-project//llvm:llvm-min-tblgen; 2s local ... 2024-12-18T00:44:29.6939519Z 2024-12-18T00:44:29.6941545Z  2024-12-18T00:44:29.6943059Z  2024-12-18T00:44:29.6944990Z  2024-12-18T00:44:29.6946511Z  2024-12-18T00:44:29.6948497Z  2024-12-18T00:44:29.6950446Z  2024-12-18T00:44:29.6952222Z  2024-12-18T00:44:29.6953962Z  2024-12-18T00:44:29.6955895Z [8,039 / 20,588] 48 actions, 47 running 2024-12-18T00:44:29.6957994Z Compiling googletest/src/gtest.cc; 5s local 2024-12-18T00:44:29.6960056Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:29.6962034Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:44:29.6964019Z Compiling src/google/protobuf/extension_set.cc; 3s local 2024-12-18T00:44:29.6966415Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:44:29.6969183Z Compiling src/google/protobuf/wire_format.cc; 3s local 2024-12-18T00:44:29.6971908Z Compiling src/google/protobuf/compiler/cpp/enum.cc [for tool]; 3s local 2024-12-18T00:44:29.6974518Z @llvm-project//llvm:llvm-min-tblgen; 3s local ... 2024-12-18T00:44:29.8943603Z 2024-12-18T00:44:29.8946142Z  2024-12-18T00:44:29.8948033Z  2024-12-18T00:44:29.8949949Z  2024-12-18T00:44:29.8951809Z  2024-12-18T00:44:29.8953662Z  2024-12-18T00:44:29.8955558Z  2024-12-18T00:44:29.8957393Z  2024-12-18T00:44:29.8959417Z  2024-12-18T00:44:29.8961764Z [8,236 / 20,588] 48 actions, 47 running 2024-12-18T00:44:29.8964141Z Compiling googletest/src/gtest.cc; 6s local 2024-12-18T00:44:29.8966512Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:44:29.8968709Z Compiling src/google/protobuf/extension_set.cc; 3s local 2024-12-18T00:44:29.8971183Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:44:29.8974057Z Compiling src/google/protobuf/wire_format.cc; 3s local 2024-12-18T00:44:29.8976852Z Compiling src/google/protobuf/compiler/cpp/enum.cc [for tool]; 3s local 2024-12-18T00:44:29.8979585Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:29.8982362Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local ... 2024-12-18T00:44:30.0954765Z 2024-12-18T00:44:30.0955658Z  2024-12-18T00:44:30.0956070Z  2024-12-18T00:44:30.0956396Z  2024-12-18T00:44:30.0956727Z  2024-12-18T00:44:30.0957172Z  2024-12-18T00:44:30.0957552Z  2024-12-18T00:44:30.0958002Z  2024-12-18T00:44:30.0958465Z  2024-12-18T00:44:30.0959151Z [8,440 / 20,588] 48 actions, 47 running 2024-12-18T00:44:30.0960229Z Compiling googletest/src/gtest.cc; 6s local 2024-12-18T00:44:30.0960965Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:44:30.0961718Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:44:30.0962756Z Compiling src/google/protobuf/compiler/cpp/enum.cc [for tool]; 3s local 2024-12-18T00:44:30.0964147Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:30.0965321Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:44:30.0966500Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:44:30.0967397Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:30.2963503Z 2024-12-18T00:44:30.2964392Z  2024-12-18T00:44:30.2964824Z  2024-12-18T00:44:30.2965175Z  2024-12-18T00:44:30.2965535Z  2024-12-18T00:44:30.2965929Z  2024-12-18T00:44:30.2966290Z  2024-12-18T00:44:30.2966671Z  2024-12-18T00:44:30.2967099Z  2024-12-18T00:44:30.2967698Z [8,647 / 20,588] 48 actions, 47 running 2024-12-18T00:44:30.2968389Z Compiling googletest/src/gtest.cc; 6s local 2024-12-18T00:44:30.2968994Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:44:30.2969673Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:44:30.2970615Z Compiling src/google/protobuf/compiler/cpp/enum.cc [for tool]; 3s local 2024-12-18T00:44:30.2971807Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:30.2972999Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:44:30.2973958Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:44:30.2974679Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:30.4976758Z 2024-12-18T00:44:30.4977630Z  2024-12-18T00:44:30.4978096Z  2024-12-18T00:44:30.4978511Z  2024-12-18T00:44:30.4978893Z  2024-12-18T00:44:30.4979311Z  2024-12-18T00:44:30.4979715Z  2024-12-18T00:44:30.4980135Z  2024-12-18T00:44:30.4980551Z  2024-12-18T00:44:30.4981093Z [8,858 / 20,588] 48 actions, 47 running 2024-12-18T00:44:30.4981734Z Compiling googletest/src/gtest.cc; 6s local 2024-12-18T00:44:30.4982370Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:44:30.4983101Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:44:30.4984136Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 3s local 2024-12-18T00:44:30.4985361Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:44:30.4986259Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:44:30.4987033Z Compiling src/compiler/cpp_generator.cc [for tool]; 2s local 2024-12-18T00:44:30.4987997Z Compiling src/google/protobuf/repeated_field.cc; 2s local ... 2024-12-18T00:44:30.6988963Z 2024-12-18T00:44:30.6989809Z  2024-12-18T00:44:30.6990278Z  2024-12-18T00:44:30.6990609Z  2024-12-18T00:44:30.6990998Z  2024-12-18T00:44:30.6991412Z  2024-12-18T00:44:30.6991825Z  2024-12-18T00:44:30.6992226Z  2024-12-18T00:44:30.6992620Z  2024-12-18T00:44:30.6993207Z [9,053 / 20,588] 48 actions, 47 running 2024-12-18T00:44:30.6993873Z Compiling googletest/src/gtest.cc; 6s local 2024-12-18T00:44:30.6994481Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:44:30.6995152Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:44:30.6996159Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:30.6997372Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2024-12-18T00:44:30.6998458Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:44:30.6999270Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2024-12-18T00:44:30.7000066Z Compiling src/google/protobuf/repeated_field.cc; 2s local ... 2024-12-18T00:44:30.8992920Z 2024-12-18T00:44:30.8993746Z  2024-12-18T00:44:30.8994165Z  2024-12-18T00:44:30.8994510Z  2024-12-18T00:44:30.8994837Z  2024-12-18T00:44:30.8995231Z  2024-12-18T00:44:30.8995639Z  2024-12-18T00:44:30.8996046Z  2024-12-18T00:44:30.8996435Z  2024-12-18T00:44:30.8997051Z [9,248 / 20,588] 48 actions, 47 running 2024-12-18T00:44:30.8997764Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:44:30.8998723Z @com_google_protobuf//:protoc_lib; 5s local 2024-12-18T00:44:30.8999758Z Compiling src/google/protobuf/wire_format.cc; 4s local 2024-12-18T00:44:30.9000903Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:30.9002274Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:30.9003401Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 3s local 2024-12-18T00:44:30.9004315Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2024-12-18T00:44:30.9005175Z Compiling src/google/protobuf/repeated_field.cc; 3s local ... 2024-12-18T00:44:31.1012889Z 2024-12-18T00:44:31.1013753Z  2024-12-18T00:44:31.1014181Z  2024-12-18T00:44:31.1014534Z  2024-12-18T00:44:31.1014914Z  2024-12-18T00:44:31.1015333Z  2024-12-18T00:44:31.1015752Z  2024-12-18T00:44:31.1016160Z  2024-12-18T00:44:31.1016741Z  2024-12-18T00:44:31.1017328Z [9,446 / 20,588] 48 actions, 47 running 2024-12-18T00:44:31.1018089Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:44:31.1018688Z @com_google_protobuf//:protoc_lib; 5s local 2024-12-18T00:44:31.1019521Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:31.1020692Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:31.1021801Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:44:31.1022801Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2024-12-18T00:44:31.1023533Z Compiling google/fft.cc; 3s local 2024-12-18T00:44:31.1024130Z Compiling llvm/lib/Support/APFloat.cpp; 3s local ... 2024-12-18T00:44:31.3031314Z 2024-12-18T00:44:31.3032306Z  2024-12-18T00:44:31.3032797Z  2024-12-18T00:44:31.3033251Z  2024-12-18T00:44:31.3033719Z  2024-12-18T00:44:31.3034165Z  2024-12-18T00:44:31.3034605Z  2024-12-18T00:44:31.3035070Z  2024-12-18T00:44:31.3035538Z  2024-12-18T00:44:31.3036219Z [9,657 / 20,599] 48 actions, 47 running 2024-12-18T00:44:31.3036930Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:44:31.3037642Z @com_google_protobuf//:protoc_lib; 5s local 2024-12-18T00:44:31.3038755Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:31.3039981Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:31.3041110Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:44:31.3041958Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2024-12-18T00:44:31.3042594Z Compiling google/fft.cc; 3s local 2024-12-18T00:44:31.3043206Z Compiling llvm/lib/Support/APFloat.cpp; 3s local ... 2024-12-18T00:44:31.5350937Z 2024-12-18T00:44:31.5351949Z  2024-12-18T00:44:31.5352442Z  2024-12-18T00:44:31.5352846Z  2024-12-18T00:44:31.5353250Z  2024-12-18T00:44:31.5353623Z  2024-12-18T00:44:31.5354115Z  2024-12-18T00:44:31.5354527Z  2024-12-18T00:44:31.5354919Z  2024-12-18T00:44:31.5355470Z [9,721 / 20,599] 48 actions, 47 running 2024-12-18T00:44:31.5356163Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:44:31.5356854Z @com_google_protobuf//:protoc_lib; 5s local 2024-12-18T00:44:31.5357751Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:31.5359037Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:31.5359997Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:44:31.5360878Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2024-12-18T00:44:31.5361627Z Compiling google/fft.cc; 3s local 2024-12-18T00:44:31.5362322Z Compiling llvm/lib/Support/APFloat.cpp; 3s local ... 2024-12-18T00:44:31.7498279Z 2024-12-18T00:44:31.7499143Z  2024-12-18T00:44:31.7499646Z  2024-12-18T00:44:31.7500052Z  2024-12-18T00:44:31.7500801Z  2024-12-18T00:44:31.7501217Z  2024-12-18T00:44:31.7501706Z  2024-12-18T00:44:31.7502111Z  2024-12-18T00:44:31.7502498Z  2024-12-18T00:44:31.7503034Z [9,727 / 20,599] 48 actions, 47 running 2024-12-18T00:44:31.7503716Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:44:31.7504368Z @com_google_protobuf//:protoc_lib; 5s local 2024-12-18T00:44:31.7505262Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:44:31.7506393Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:31.7507406Z Executing genrule //torch_xla/csrc:gen_lazy_tensor; 4s local 2024-12-18T00:44:31.7508327Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2024-12-18T00:44:31.7509070Z Compiling google/fft.cc; 3s local 2024-12-18T00:44:31.7509730Z Compiling llvm/lib/Support/APFloat.cpp; 3s local ... 2024-12-18T00:44:31.9723876Z 2024-12-18T00:44:31.9724792Z  2024-12-18T00:44:31.9725241Z  2024-12-18T00:44:31.9725588Z  2024-12-18T00:44:31.9725957Z  2024-12-18T00:44:31.9726292Z  2024-12-18T00:44:31.9726768Z  2024-12-18T00:44:31.9727123Z  2024-12-18T00:44:31.9727457Z  2024-12-18T00:44:31.9728007Z [9,733 / 20,599] 48 actions, 47 running 2024-12-18T00:44:31.9728649Z Compiling googletest/src/gtest.cc; 8s local 2024-12-18T00:44:31.9729297Z @com_google_protobuf//:protoc_lib; 6s local 2024-12-18T00:44:31.9730152Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:44:31.9731207Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:31.9732341Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2024-12-18T00:44:31.9733190Z Compiling google/fft.cc; 4s local 2024-12-18T00:44:31.9733916Z Compiling llvm/lib/Support/APFloat.cpp; 3s local 2024-12-18T00:44:31.9734762Z @llvm-project//llvm:llvm-min-tblgen; 3s local ... 2024-12-18T00:44:32.1952485Z 2024-12-18T00:44:32.1953271Z  2024-12-18T00:44:32.1953769Z  2024-12-18T00:44:32.1954187Z  2024-12-18T00:44:32.1954575Z  2024-12-18T00:44:32.1954979Z  2024-12-18T00:44:32.1955356Z  2024-12-18T00:44:32.1955749Z  2024-12-18T00:44:32.1956144Z  2024-12-18T00:44:32.1956742Z [9,740 / 20,599] 48 actions, 47 running 2024-12-18T00:44:32.1957484Z Compiling googletest/src/gtest.cc; 8s local 2024-12-18T00:44:32.1958352Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:44:32.1959543Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:32.1960609Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2024-12-18T00:44:32.1961350Z Compiling google/fft.cc; 4s local 2024-12-18T00:44:32.1962036Z Compiling llvm/lib/Support/APFloat.cpp; 4s local 2024-12-18T00:44:32.1962996Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:32.1964140Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local ... 2024-12-18T00:44:32.4481063Z 2024-12-18T00:44:32.4481891Z  2024-12-18T00:44:32.4482323Z  2024-12-18T00:44:32.4482716Z  2024-12-18T00:44:32.4483033Z  2024-12-18T00:44:32.4483377Z  2024-12-18T00:44:32.4483743Z  2024-12-18T00:44:32.4484083Z  2024-12-18T00:44:32.4484658Z  2024-12-18T00:44:32.4485162Z [9,747 / 20,599] 48 actions, 47 running 2024-12-18T00:44:32.4485779Z Compiling googletest/src/gtest.cc; 8s local 2024-12-18T00:44:32.4486555Z Compiling llvm/utils/TableGen/IntrinsicEmitter.cpp [for tool]; 5s local 2024-12-18T00:44:32.4487542Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:32.4488301Z Compiling google/fft.cc; 4s local 2024-12-18T00:44:32.4488824Z Compiling llvm/lib/Support/APFloat.cpp; 4s local 2024-12-18T00:44:32.4489715Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:32.4490852Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 4s local 2024-12-18T00:44:32.4491788Z Compiling llvm/lib/Support/BalancedPartitioning.cpp; 4s local ... 2024-12-18T00:44:32.6880656Z 2024-12-18T00:44:32.6881537Z  2024-12-18T00:44:32.6882011Z  2024-12-18T00:44:32.6882408Z  2024-12-18T00:44:32.6882834Z  2024-12-18T00:44:32.6883197Z  2024-12-18T00:44:32.6883591Z  2024-12-18T00:44:32.6883962Z  2024-12-18T00:44:32.6884308Z  2024-12-18T00:44:32.6884816Z [9,758 / 20,599] 48 actions running 2024-12-18T00:44:32.6885466Z Compiling googletest/src/gtest.cc; 8s local 2024-12-18T00:44:32.6886477Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:32.6887296Z Compiling google/fft.cc; 4s local 2024-12-18T00:44:32.6887931Z Compiling llvm/lib/Support/APFloat.cpp; 4s local 2024-12-18T00:44:32.6888850Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:32.6889901Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2024-12-18T00:44:32.6890800Z Compiling llvm/lib/Support/CommandLine.cpp; 3s local 2024-12-18T00:44:32.6891610Z @llvm-project//llvm:llvm-min-tblgen; 3s local ... 2024-12-18T00:44:32.8884562Z 2024-12-18T00:44:32.8885383Z  2024-12-18T00:44:32.8885897Z  2024-12-18T00:44:32.8886298Z  2024-12-18T00:44:32.8886705Z  2024-12-18T00:44:32.8887117Z  2024-12-18T00:44:32.8887526Z  2024-12-18T00:44:32.8887934Z  2024-12-18T00:44:32.8888331Z  2024-12-18T00:44:32.8888907Z [9,769 / 20,599] 48 actions running 2024-12-18T00:44:32.8889637Z Compiling googletest/src/gtest.cc; 9s local 2024-12-18T00:44:32.8890539Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:32.8891394Z Compiling google/fft.cc; 4s local 2024-12-18T00:44:32.8892025Z Compiling llvm/lib/Support/APFloat.cpp; 4s local 2024-12-18T00:44:32.8893017Z Compiling llvm/utils/TableGen/DirectiveEmitter.cpp [for tool]; 4s local 2024-12-18T00:44:32.8894028Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2024-12-18T00:44:32.8894900Z Compiling llvm/lib/Support/CommandLine.cpp; 3s local 2024-12-18T00:44:32.8895687Z @llvm-project//llvm:llvm-min-tblgen; 3s local ... 2024-12-18T00:44:33.1370027Z 2024-12-18T00:44:33.1370905Z  2024-12-18T00:44:33.1371361Z  2024-12-18T00:44:33.1371760Z  2024-12-18T00:44:33.1372133Z  2024-12-18T00:44:33.1372530Z  2024-12-18T00:44:33.1372918Z  2024-12-18T00:44:33.1373304Z  2024-12-18T00:44:33.1373672Z  2024-12-18T00:44:33.1374256Z [9,775 / 20,599] 48 actions, 47 running 2024-12-18T00:44:33.1375174Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:33.1376024Z Compiling google/fft.cc; 5s local 2024-12-18T00:44:33.1376850Z Compiling llvm/lib/Support/APFloat.cpp; 5s local 2024-12-18T00:44:33.1377651Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2024-12-18T00:44:33.1378448Z Compiling llvm/lib/Support/CommandLine.cpp; 3s local 2024-12-18T00:44:33.1379166Z @llvm-project//llvm:llvm-min-tblgen; 3s local 2024-12-18T00:44:33.1379808Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:33.1380503Z Compiling src/google/protobuf/map_field.cc; 3s local ... 2024-12-18T00:44:33.3853149Z 2024-12-18T00:44:33.3854025Z  2024-12-18T00:44:33.3854484Z  2024-12-18T00:44:33.3854879Z  2024-12-18T00:44:33.3855264Z  2024-12-18T00:44:33.3855640Z  2024-12-18T00:44:33.3856006Z  2024-12-18T00:44:33.3856368Z  2024-12-18T00:44:33.3856905Z  2024-12-18T00:44:33.3857470Z [9,789 / 20,599] 48 actions, 47 running 2024-12-18T00:44:33.3858341Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:33.3859665Z Compiling google/fft.cc; 5s local 2024-12-18T00:44:33.3860562Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2024-12-18T00:44:33.3861502Z Compiling llvm/lib/Support/CommandLine.cpp; 4s local 2024-12-18T00:44:33.3862208Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:33.3863060Z Compiling src/google/protobuf/compiler/cpp/field.cc [for tool]; 3s local 2024-12-18T00:44:33.3864172Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 3s local 2024-12-18T00:44:33.3865073Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:33.6065376Z 2024-12-18T00:44:33.6066263Z  2024-12-18T00:44:33.6066738Z  2024-12-18T00:44:33.6067127Z  2024-12-18T00:44:33.6067505Z  2024-12-18T00:44:33.6067888Z  2024-12-18T00:44:33.6068251Z  2024-12-18T00:44:33.6068634Z  2024-12-18T00:44:33.6069578Z  2024-12-18T00:44:33.6070131Z [9,794 / 20,599] 48 actions, 47 running 2024-12-18T00:44:33.6071026Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:33.6071917Z Compiling google/fft.cc; 5s local 2024-12-18T00:44:33.6072666Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2024-12-18T00:44:33.6073531Z Compiling llvm/lib/Support/CommandLine.cpp; 4s local 2024-12-18T00:44:33.6074231Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:33.6075076Z Compiling src/google/protobuf/compiler/cpp/field.cc [for tool]; 3s local 2024-12-18T00:44:33.6076188Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 3s local 2024-12-18T00:44:33.6077211Z Compiling llvm/lib/Support/APFixedPoint.cpp; 2s local ... 2024-12-18T00:44:33.8130083Z 2024-12-18T00:44:33.8131031Z  2024-12-18T00:44:33.8131515Z  2024-12-18T00:44:33.8131948Z  2024-12-18T00:44:33.8132359Z  2024-12-18T00:44:33.8132773Z  2024-12-18T00:44:33.8133148Z  2024-12-18T00:44:33.8133521Z  2024-12-18T00:44:33.8133916Z  2024-12-18T00:44:33.8134561Z [9,806 / 20,599] 48 actions, 47 running 2024-12-18T00:44:33.8135625Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:33.8136617Z Compiling google/fft.cc; 5s local 2024-12-18T00:44:33.8137382Z Compiling src/compiler/python_generator.cc [for tool]; 5s local 2024-12-18T00:44:33.8138294Z Compiling llvm/lib/Support/CommandLine.cpp; 4s local 2024-12-18T00:44:33.8139041Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:33.8139919Z Compiling src/google/protobuf/compiler/cpp/field.cc [for tool]; 3s local 2024-12-18T00:44:33.8141027Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 3s local 2024-12-18T00:44:33.8142099Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 2s local ... 2024-12-18T00:44:34.0159951Z 2024-12-18T00:44:34.0160805Z  2024-12-18T00:44:34.0161265Z  2024-12-18T00:44:34.0161669Z  2024-12-18T00:44:34.0162043Z  2024-12-18T00:44:34.0162424Z  2024-12-18T00:44:34.0162827Z  2024-12-18T00:44:34.0163210Z  2024-12-18T00:44:34.0163582Z  2024-12-18T00:44:34.0164148Z [9,812 / 20,599] 48 actions, 47 running 2024-12-18T00:44:34.0165010Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:34.0165900Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:34.0166673Z Compiling src/compiler/python_generator.cc [for tool]; 5s local 2024-12-18T00:44:34.0167793Z Compiling llvm/lib/Support/CommandLine.cpp; 4s local 2024-12-18T00:44:34.0168495Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:34.0169380Z Compiling src/google/protobuf/compiler/cpp/field.cc [for tool]; 3s local 2024-12-18T00:44:34.0170418Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 3s local 2024-12-18T00:44:34.0171479Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 2s local ... 2024-12-18T00:44:34.2700742Z 2024-12-18T00:44:34.2701605Z  2024-12-18T00:44:34.2702063Z  2024-12-18T00:44:34.2702813Z  2024-12-18T00:44:34.2703226Z  2024-12-18T00:44:34.2703703Z  2024-12-18T00:44:34.2704107Z  2024-12-18T00:44:34.2704516Z  2024-12-18T00:44:34.2704907Z  2024-12-18T00:44:34.2705485Z [9,820 / 20,599] 48 actions, 47 running 2024-12-18T00:44:34.2706373Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:34.2707278Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:34.2707965Z Compiling llvm/lib/Support/CommandLine.cpp; 5s local 2024-12-18T00:44:34.2708697Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:34.2709538Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 3s local 2024-12-18T00:44:34.2710581Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 2s local 2024-12-18T00:44:34.2711561Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 2s local 2024-12-18T00:44:34.2712676Z Compiling mlir/lib/Support/StorageUniquer.cpp [for tool]; 2s local ... 2024-12-18T00:44:34.4893172Z 2024-12-18T00:44:34.4894074Z  2024-12-18T00:44:34.4894542Z  2024-12-18T00:44:34.4894925Z  2024-12-18T00:44:34.4895308Z  2024-12-18T00:44:34.4895648Z  2024-12-18T00:44:34.4896060Z  2024-12-18T00:44:34.4896608Z  2024-12-18T00:44:34.4896978Z  2024-12-18T00:44:34.4897537Z [9,828 / 20,599] 48 actions running 2024-12-18T00:44:34.4898466Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:34.4899368Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:34.4900080Z Compiling llvm/lib/Support/CommandLine.cpp; 5s local 2024-12-18T00:44:34.4900792Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:34.4901590Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 4s local 2024-12-18T00:44:34.4902576Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 3s local 2024-12-18T00:44:34.4903583Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 2s local 2024-12-18T00:44:34.4904679Z Compiling mlir/lib/Support/StorageUniquer.cpp [for tool]; 2s local ... 2024-12-18T00:44:34.7096661Z 2024-12-18T00:44:34.7097525Z  2024-12-18T00:44:34.7098013Z  2024-12-18T00:44:34.7098429Z  2024-12-18T00:44:34.7098841Z  2024-12-18T00:44:34.7099226Z  2024-12-18T00:44:34.7099617Z  2024-12-18T00:44:34.7100026Z  2024-12-18T00:44:34.7100479Z  2024-12-18T00:44:34.7101103Z [9,836 / 20,599] 48 actions, 47 running 2024-12-18T00:44:34.7102079Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:34.7103155Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:34.7103809Z Compiling llvm/lib/Support/CommandLine.cpp; 5s local 2024-12-18T00:44:34.7104431Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:34.7105709Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 4s local 2024-12-18T00:44:34.7106767Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 3s local 2024-12-18T00:44:34.7107994Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 2s local 2024-12-18T00:44:34.7109280Z Compiling mlir/lib/Support/StorageUniquer.cpp [for tool]; 2s local ... 2024-12-18T00:44:34.9100804Z 2024-12-18T00:44:34.9101668Z  2024-12-18T00:44:34.9102138Z  2024-12-18T00:44:34.9102592Z  2024-12-18T00:44:34.9102996Z  2024-12-18T00:44:34.9103625Z  2024-12-18T00:44:34.9103993Z  2024-12-18T00:44:34.9104374Z  2024-12-18T00:44:34.9104753Z  2024-12-18T00:44:34.9105325Z [9,843 / 20,599] 48 actions, 47 running 2024-12-18T00:44:34.9106246Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:34.9107136Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:34.9107836Z Compiling llvm/lib/Support/CommandLine.cpp; 5s local 2024-12-18T00:44:34.9108562Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:34.9109616Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 4s local 2024-12-18T00:44:34.9110846Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 3s local 2024-12-18T00:44:34.9111861Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 3s local 2024-12-18T00:44:34.9112816Z Compiling llvm/lib/Support/JSON.cpp; 2s local ... 2024-12-18T00:44:35.1247771Z 2024-12-18T00:44:35.1249725Z  2024-12-18T00:44:35.1250300Z  2024-12-18T00:44:35.1250703Z  2024-12-18T00:44:35.1251080Z  2024-12-18T00:44:35.1251437Z  2024-12-18T00:44:35.1251820Z  2024-12-18T00:44:35.1252202Z  2024-12-18T00:44:35.1252582Z  2024-12-18T00:44:35.1253139Z [9,849 / 20,599] 48 actions, 47 running 2024-12-18T00:44:35.1254040Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:35.1254882Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:35.1255546Z Compiling llvm/lib/Support/CommandLine.cpp; 5s local 2024-12-18T00:44:35.1256263Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:35.1257226Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 4s local 2024-12-18T00:44:35.1258344Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 3s local 2024-12-18T00:44:35.1259364Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 3s local 2024-12-18T00:44:35.1260306Z Compiling llvm/lib/Support/JSON.cpp; 3s local ... 2024-12-18T00:44:35.3412950Z 2024-12-18T00:44:35.3413903Z  2024-12-18T00:44:35.3414382Z  2024-12-18T00:44:35.3414771Z  2024-12-18T00:44:35.3415190Z  2024-12-18T00:44:35.3415561Z  2024-12-18T00:44:35.3415961Z  2024-12-18T00:44:35.3416363Z  2024-12-18T00:44:35.3416895Z  2024-12-18T00:44:35.3417495Z [9,857 / 20,599] 48 actions, 47 running 2024-12-18T00:44:35.3418439Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:35.3419283Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:35.3420021Z Compiling llvm/lib/Support/CommandLine.cpp; 6s local 2024-12-18T00:44:35.3420696Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:35.3421495Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 4s local 2024-12-18T00:44:35.3422440Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 3s local 2024-12-18T00:44:35.3423425Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 3s local 2024-12-18T00:44:35.3424352Z Compiling llvm/lib/Support/JSON.cpp; 3s local ... 2024-12-18T00:44:35.5953402Z 2024-12-18T00:44:35.5954182Z  2024-12-18T00:44:35.5954683Z  2024-12-18T00:44:35.5964175Z  2024-12-18T00:44:35.5964629Z  2024-12-18T00:44:35.5965048Z  2024-12-18T00:44:35.5965456Z  2024-12-18T00:44:35.5965871Z  2024-12-18T00:44:35.5966265Z  2024-12-18T00:44:35.5966871Z [9,867 / 20,599] 48 actions, 47 running 2024-12-18T00:44:35.5967887Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:35.5968854Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:35.5969709Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 5s local 2024-12-18T00:44:35.5970731Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2024-12-18T00:44:35.5971760Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 3s local 2024-12-18T00:44:35.5972988Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 3s local 2024-12-18T00:44:35.5974127Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:44:35.5975109Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local ... 2024-12-18T00:44:35.8193637Z 2024-12-18T00:44:35.8194514Z  2024-12-18T00:44:35.8194994Z  2024-12-18T00:44:35.8195421Z  2024-12-18T00:44:35.8195836Z  2024-12-18T00:44:35.8196212Z  2024-12-18T00:44:35.8196602Z  2024-12-18T00:44:35.8196991Z  2024-12-18T00:44:35.8197370Z  2024-12-18T00:44:35.8198305Z [9,877 / 20,599] 48 actions, 47 running 2024-12-18T00:44:35.8199239Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:35.8200136Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:35.8201029Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 5s local 2024-12-18T00:44:35.8202087Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2024-12-18T00:44:35.8203132Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 4s local 2024-12-18T00:44:35.8204312Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 3s local 2024-12-18T00:44:35.8205402Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:44:35.8206467Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local ... 2024-12-18T00:44:36.0727344Z 2024-12-18T00:44:36.0728310Z  2024-12-18T00:44:36.0728775Z  2024-12-18T00:44:36.0729190Z  2024-12-18T00:44:36.0729618Z  2024-12-18T00:44:36.0730041Z  2024-12-18T00:44:36.0730444Z  2024-12-18T00:44:36.0730855Z  2024-12-18T00:44:36.0731230Z  2024-12-18T00:44:36.0731826Z [9,882 / 20,599] 48 actions, 47 running 2024-12-18T00:44:36.0732770Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:36.0733672Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:36.0734589Z Compiling src/google/protobuf/compiler/cpp/file.cc [for tool]; 5s local 2024-12-18T00:44:36.0735640Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2024-12-18T00:44:36.0736889Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 4s local 2024-12-18T00:44:36.0738087Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 3s local 2024-12-18T00:44:36.0739033Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 3s local 2024-12-18T00:44:36.0740095Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local ... 2024-12-18T00:44:36.2909465Z 2024-12-18T00:44:36.2910351Z  2024-12-18T00:44:36.2910832Z  2024-12-18T00:44:36.2911215Z  2024-12-18T00:44:36.2911569Z  2024-12-18T00:44:36.2911936Z  2024-12-18T00:44:36.2912321Z  2024-12-18T00:44:36.2912718Z  2024-12-18T00:44:36.2913124Z  2024-12-18T00:44:36.2913673Z [9,890 / 20,599] 47 actions running 2024-12-18T00:44:36.2914592Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:36.2915396Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:36.2916105Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2024-12-18T00:44:36.2917078Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 4s local 2024-12-18T00:44:36.2918223Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 4s local 2024-12-18T00:44:36.2919233Z Compiling mlir/lib/Support/Timing.cpp [for tool]; 4s local 2024-12-18T00:44:36.2920201Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:36.2921273Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local ... 2024-12-18T00:44:36.4911369Z 2024-12-18T00:44:36.4912286Z  2024-12-18T00:44:36.4912774Z  2024-12-18T00:44:36.4913179Z  2024-12-18T00:44:36.4913575Z  2024-12-18T00:44:36.4913964Z  2024-12-18T00:44:36.4914367Z  2024-12-18T00:44:36.4914991Z  2024-12-18T00:44:36.4915373Z  2024-12-18T00:44:36.4915916Z [9,898 / 20,599] 48 actions running 2024-12-18T00:44:36.4920905Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:36.4921944Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:36.4922713Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2024-12-18T00:44:36.4923761Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 4s local 2024-12-18T00:44:36.4925094Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 4s local 2024-12-18T00:44:36.4926372Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:36.4927423Z Compiling src/compiler/csharp_generator.cc [for tool]; 4s local 2024-12-18T00:44:36.4928373Z Compiling src/graph/utils/pm/pbuilder.cpp; 3s local ... 2024-12-18T00:44:36.6925957Z 2024-12-18T00:44:36.6926941Z  2024-12-18T00:44:36.6927357Z  2024-12-18T00:44:36.6927713Z  2024-12-18T00:44:36.6928032Z  2024-12-18T00:44:36.6928345Z  2024-12-18T00:44:36.6928650Z  2024-12-18T00:44:36.6928987Z  2024-12-18T00:44:36.6929370Z  2024-12-18T00:44:36.6929950Z [9,905 / 20,599] 48 actions, 47 running 2024-12-18T00:44:36.6930688Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:36.6931456Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:36.6932095Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2024-12-18T00:44:36.6932948Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 4s local 2024-12-18T00:44:36.6934006Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 4s local 2024-12-18T00:44:36.6935249Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:36.6936264Z Compiling src/graph/utils/pm/pbuilder.cpp; 3s local 2024-12-18T00:44:36.6937606Z Compiling src/google/protobuf/util/message_differencer.cc; 3s local ... 2024-12-18T00:44:36.9357054Z 2024-12-18T00:44:36.9357859Z  2024-12-18T00:44:36.9358334Z  2024-12-18T00:44:36.9358746Z  2024-12-18T00:44:36.9359131Z  2024-12-18T00:44:36.9359559Z  2024-12-18T00:44:36.9359937Z  2024-12-18T00:44:36.9360306Z  2024-12-18T00:44:36.9360673Z  2024-12-18T00:44:36.9361210Z [9,909 / 20,599] 48 actions, 47 running 2024-12-18T00:44:36.9362156Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:36.9363065Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:36.9363801Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2024-12-18T00:44:36.9364843Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 5s local 2024-12-18T00:44:36.9366057Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 4s local 2024-12-18T00:44:36.9367260Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2024-12-18T00:44:36.9368281Z Compiling src/graph/utils/pm/pbuilder.cpp; 4s local 2024-12-18T00:44:36.9369288Z Compiling src/google/protobuf/util/message_differencer.cc; 3s local ... 2024-12-18T00:44:37.2176964Z 2024-12-18T00:44:37.2177726Z  2024-12-18T00:44:37.2178188Z  2024-12-18T00:44:37.2178573Z  2024-12-18T00:44:37.2178971Z  2024-12-18T00:44:37.2179403Z  2024-12-18T00:44:37.2179788Z  2024-12-18T00:44:37.2180166Z  2024-12-18T00:44:37.2180515Z  2024-12-18T00:44:37.2181045Z [9,920 / 20,599] 48 actions, 47 running 2024-12-18T00:44:37.2181989Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:37.2182844Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:37.2183539Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2024-12-18T00:44:37.2184875Z Compiling xla/service/cpu/runtime_single_threaded_matmul_u8.cc; 5s local 2024-12-18T00:44:37.2186018Z Compiling src/google/protobuf/compiler/cpp/helpers.cc [for tool]; 5s local 2024-12-18T00:44:37.2187660Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:37.2188621Z Compiling src/graph/utils/pm/pbuilder.cpp; 4s local 2024-12-18T00:44:37.2189848Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local ... 2024-12-18T00:44:37.4968999Z 2024-12-18T00:44:37.4969860Z  2024-12-18T00:44:37.4970379Z  2024-12-18T00:44:37.4970777Z  2024-12-18T00:44:37.4971197Z  2024-12-18T00:44:37.4971620Z  2024-12-18T00:44:37.4972023Z  2024-12-18T00:44:37.4974903Z  2024-12-18T00:44:37.4975325Z  2024-12-18T00:44:37.4975904Z [9,926 / 20,599] 48 actions running 2024-12-18T00:44:37.4976948Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:37.4977809Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:37.4978505Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 6s local 2024-12-18T00:44:37.4979567Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:37.4980556Z Compiling src/graph/utils/pm/pbuilder.cpp; 4s local 2024-12-18T00:44:37.4981526Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local 2024-12-18T00:44:37.4982547Z Compiling llvm/lib/TableGen/Main.cpp [for tool]; 3s local 2024-12-18T00:44:37.4983378Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:44:37.6973419Z 2024-12-18T00:44:37.6974271Z  2024-12-18T00:44:37.6974783Z  2024-12-18T00:44:37.6975192Z  2024-12-18T00:44:37.6975651Z  2024-12-18T00:44:37.6975987Z  2024-12-18T00:44:37.6976335Z  2024-12-18T00:44:37.6976846Z  2024-12-18T00:44:37.6977219Z  2024-12-18T00:44:37.6977713Z [9,936 / 20,599] 48 actions running 2024-12-18T00:44:37.6978545Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:37.6979509Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:37.6980241Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:37.6981196Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local 2024-12-18T00:44:37.6982193Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 3s local 2024-12-18T00:44:37.6983193Z Compiling llvm/lib/Support/ScopedPrinter.cpp; 3s local 2024-12-18T00:44:37.6983992Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2024-12-18T00:44:37.6984945Z Compiling llvm/lib/TableGen/SetTheory.cpp [for tool]; 2s local ... 2024-12-18T00:44:37.9087320Z 2024-12-18T00:44:37.9088181Z  2024-12-18T00:44:37.9088618Z  2024-12-18T00:44:37.9088971Z  2024-12-18T00:44:37.9089346Z  2024-12-18T00:44:37.9089715Z  2024-12-18T00:44:37.9090133Z  2024-12-18T00:44:37.9090553Z  2024-12-18T00:44:37.9090978Z  2024-12-18T00:44:37.9091570Z [9,940 / 20,599] 48 actions, 47 running 2024-12-18T00:44:37.9092510Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:37.9093411Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:37.9094264Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2024-12-18T00:44:37.9095327Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local 2024-12-18T00:44:37.9096578Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 3s local 2024-12-18T00:44:37.9097590Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2024-12-18T00:44:37.9098425Z Compiling llvm/lib/TableGen/SetTheory.cpp [for tool]; 2s local 2024-12-18T00:44:37.9099314Z Compiling llvm/lib/Support/TimeProfiler.cpp; 2s local ... 2024-12-18T00:44:38.1553580Z 2024-12-18T00:44:38.1554417Z  2024-12-18T00:44:38.1554922Z  2024-12-18T00:44:38.1555351Z  2024-12-18T00:44:38.1555755Z  2024-12-18T00:44:38.1556145Z  2024-12-18T00:44:38.1556527Z  2024-12-18T00:44:38.1556895Z  2024-12-18T00:44:38.1557572Z  2024-12-18T00:44:38.1558149Z [9,944 / 20,599] 48 actions, 47 running 2024-12-18T00:44:38.1559098Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:38.1560234Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:38.1561132Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:38.1562267Z Compiling src/google/protobuf/util/message_differencer.cc; 4s local 2024-12-18T00:44:38.1563570Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 3s local 2024-12-18T00:44:38.1564749Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2024-12-18T00:44:38.1565687Z Compiling llvm/lib/TableGen/SetTheory.cpp [for tool]; 3s local 2024-12-18T00:44:38.1566652Z Compiling llvm/lib/Support/TimeProfiler.cpp; 2s local ... 2024-12-18T00:44:38.3717297Z 2024-12-18T00:44:38.3718151Z  2024-12-18T00:44:38.3718631Z  2024-12-18T00:44:38.3719042Z  2024-12-18T00:44:38.3719460Z  2024-12-18T00:44:38.3719872Z  2024-12-18T00:44:38.3720267Z  2024-12-18T00:44:38.3720660Z  2024-12-18T00:44:38.3721045Z  2024-12-18T00:44:38.3721642Z [9,953 / 20,599] 48 actions, 47 running 2024-12-18T00:44:38.3722592Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:38.3723501Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:38.3724386Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:38.3725529Z Compiling src/google/protobuf/util/message_differencer.cc; 5s local 2024-12-18T00:44:38.3726699Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 4s local 2024-12-18T00:44:38.3727731Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2024-12-18T00:44:38.3728606Z Compiling llvm/lib/Support/TimeProfiler.cpp; 3s local 2024-12-18T00:44:38.3729381Z Compiling llvm/lib/Support/Timer.cpp; 3s local ... 2024-12-18T00:44:38.5933606Z 2024-12-18T00:44:38.5934461Z  2024-12-18T00:44:38.5934910Z  2024-12-18T00:44:38.5935306Z  2024-12-18T00:44:38.5935680Z  2024-12-18T00:44:38.5936083Z  2024-12-18T00:44:38.5936696Z  2024-12-18T00:44:38.5937083Z  2024-12-18T00:44:38.5937457Z  2024-12-18T00:44:38.5938084Z [9,957 / 20,599] 48 actions, 47 running 2024-12-18T00:44:38.5939038Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:38.5939968Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:38.5940838Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:38.5941987Z Compiling src/google/protobuf/util/message_differencer.cc; 5s local 2024-12-18T00:44:38.5943194Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 4s local 2024-12-18T00:44:38.5944550Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2024-12-18T00:44:38.5945469Z Compiling llvm/lib/Support/TimeProfiler.cpp; 3s local 2024-12-18T00:44:38.5946268Z Compiling llvm/lib/Support/Timer.cpp; 3s local ... 2024-12-18T00:44:38.7950522Z 2024-12-18T00:44:38.7951428Z  2024-12-18T00:44:38.7951911Z  2024-12-18T00:44:38.7952408Z  2024-12-18T00:44:38.7952789Z  2024-12-18T00:44:38.7953170Z  2024-12-18T00:44:38.7953542Z  2024-12-18T00:44:38.7953922Z  2024-12-18T00:44:38.7954312Z  2024-12-18T00:44:38.7954883Z [9,972 / 20,599] 48 actions, 47 running 2024-12-18T00:44:38.7955826Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:38.7956703Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:38.7957548Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:38.7958728Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 4s local 2024-12-18T00:44:38.7959775Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2024-12-18T00:44:38.7960953Z Compiling llvm/lib/Support/TimeProfiler.cpp; 3s local 2024-12-18T00:44:38.7961614Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:38.7962494Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 2s local ... 2024-12-18T00:44:38.9979816Z 2024-12-18T00:44:38.9980695Z  2024-12-18T00:44:38.9981173Z  2024-12-18T00:44:38.9981590Z  2024-12-18T00:44:38.9982003Z  2024-12-18T00:44:38.9982370Z  2024-12-18T00:44:38.9982753Z  2024-12-18T00:44:38.9983131Z  2024-12-18T00:44:38.9983510Z  2024-12-18T00:44:38.9984497Z [9,986 / 20,599] 48 actions, 47 running 2024-12-18T00:44:38.9985472Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:38.9986355Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:38.9987235Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2024-12-18T00:44:38.9988396Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 4s local 2024-12-18T00:44:38.9989459Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2024-12-18T00:44:38.9990208Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:38.9990925Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 2s local 2024-12-18T00:44:38.9991836Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:39.2988282Z 2024-12-18T00:44:39.2989109Z  2024-12-18T00:44:39.2989572Z  2024-12-18T00:44:39.2989970Z  2024-12-18T00:44:39.2990372Z  2024-12-18T00:44:39.2990763Z  2024-12-18T00:44:39.2991164Z  2024-12-18T00:44:39.2991593Z  2024-12-18T00:44:39.2991995Z  2024-12-18T00:44:39.2992538Z [10,004 / 20,599] 48 actions running 2024-12-18T00:44:39.2993430Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:39.2994285Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:39.2995169Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:39.2996397Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 5s local 2024-12-18T00:44:39.2997456Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2024-12-18T00:44:39.2998222Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:39.2998951Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 3s local 2024-12-18T00:44:39.2999761Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:44:39.5095508Z 2024-12-18T00:44:39.5096374Z  2024-12-18T00:44:39.5097008Z  2024-12-18T00:44:39.5097406Z  2024-12-18T00:44:39.5097863Z  2024-12-18T00:44:39.5098274Z  2024-12-18T00:44:39.5098666Z  2024-12-18T00:44:39.5099061Z  2024-12-18T00:44:39.5099364Z  2024-12-18T00:44:39.5099967Z [10,014 / 20,599] 48 actions, 47 running 2024-12-18T00:44:39.5100923Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:39.5101854Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:39.5102701Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:39.5103869Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 5s local 2024-12-18T00:44:39.5104972Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2024-12-18T00:44:39.5105749Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:39.5106421Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 3s local 2024-12-18T00:44:39.5107172Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:44:39.7182582Z 2024-12-18T00:44:39.7183496Z  2024-12-18T00:44:39.7183947Z  2024-12-18T00:44:39.7184328Z  2024-12-18T00:44:39.7184724Z  2024-12-18T00:44:39.7185073Z  2024-12-18T00:44:39.7185442Z  2024-12-18T00:44:39.7185816Z  2024-12-18T00:44:39.7186169Z  2024-12-18T00:44:39.7186729Z [10,021 / 20,599] 48 actions, 47 running 2024-12-18T00:44:39.7187639Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:39.7188752Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:39.7189553Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:39.7190878Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 5s local 2024-12-18T00:44:39.7191873Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:44:39.7192579Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:39.7193272Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 3s local 2024-12-18T00:44:39.7194295Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:44:39.9992329Z 2024-12-18T00:44:39.9993167Z  2024-12-18T00:44:39.9993651Z  2024-12-18T00:44:39.9994057Z  2024-12-18T00:44:39.9994481Z  2024-12-18T00:44:39.9994904Z  2024-12-18T00:44:39.9995319Z  2024-12-18T00:44:39.9995719Z  2024-12-18T00:44:39.9996138Z  2024-12-18T00:44:39.9996785Z [10,027 / 20,599] 48 actions, 47 running 2024-12-18T00:44:39.9997832Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:39.9998915Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:39.9999833Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2024-12-18T00:44:40.0001083Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 5s local 2024-12-18T00:44:40.0002163Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:44:40.0002965Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:40.0003734Z @com_github_grpc_grpc//:grpc_lb_policy_xds_secure; 3s local 2024-12-18T00:44:40.0004545Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:44:40.2381833Z 2024-12-18T00:44:40.2382696Z  2024-12-18T00:44:40.2383190Z  2024-12-18T00:44:40.2383560Z  2024-12-18T00:44:40.2383946Z  2024-12-18T00:44:40.2384349Z  2024-12-18T00:44:40.2384762Z  2024-12-18T00:44:40.2385162Z  2024-12-18T00:44:40.2385549Z  2024-12-18T00:44:40.2386179Z [10,036 / 20,599] 48 actions, 47 running 2024-12-18T00:44:40.2387110Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:40.2388050Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:40.2388871Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:40.2390106Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 5s local 2024-12-18T00:44:40.2391233Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:44:40.2392035Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:40.2392672Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:44:40.2393514Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2024-12-18T00:44:40.4386550Z 2024-12-18T00:44:40.4387420Z  2024-12-18T00:44:40.4387878Z  2024-12-18T00:44:40.4388276Z  2024-12-18T00:44:40.4388708Z  2024-12-18T00:44:40.4389107Z  2024-12-18T00:44:40.4389464Z  2024-12-18T00:44:40.4389856Z  2024-12-18T00:44:40.4390274Z  2024-12-18T00:44:40.4390928Z [10,043 / 20,599] 48 actions, 47 running 2024-12-18T00:44:40.4391967Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:40.4392943Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:40.4393881Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:40.4395195Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2024-12-18T00:44:40.4396383Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2024-12-18T00:44:40.4397225Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:40.4398087Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 4s local 2024-12-18T00:44:40.4399029Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 3s local ... 2024-12-18T00:44:40.6771360Z 2024-12-18T00:44:40.6772494Z  2024-12-18T00:44:40.6772983Z  2024-12-18T00:44:40.6773390Z  2024-12-18T00:44:40.6773789Z  2024-12-18T00:44:40.6774245Z  2024-12-18T00:44:40.6774637Z  2024-12-18T00:44:40.6775258Z  2024-12-18T00:44:40.6775712Z  2024-12-18T00:44:40.6776319Z [10,052 / 20,599] 48 actions, 47 running 2024-12-18T00:44:40.6777472Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:40.6778361Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:40.6779438Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:40.6780742Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2024-12-18T00:44:40.6781767Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:44:40.6782505Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:40.6783263Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2024-12-18T00:44:40.6784253Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 4s local ... 2024-12-18T00:44:40.8996002Z 2024-12-18T00:44:40.8996838Z  2024-12-18T00:44:40.8997309Z  2024-12-18T00:44:40.8997715Z  2024-12-18T00:44:40.8998145Z  2024-12-18T00:44:40.8998543Z  2024-12-18T00:44:40.8998949Z  2024-12-18T00:44:40.8999345Z  2024-12-18T00:44:40.8999731Z  2024-12-18T00:44:40.9000340Z [10,056 / 20,599] 48 actions running 2024-12-18T00:44:40.9001319Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:40.9002403Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:40.9003288Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:40.9004459Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2024-12-18T00:44:40.9005510Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:44:40.9006309Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:40.9007106Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2024-12-18T00:44:40.9008111Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 4s local ... 2024-12-18T00:44:41.1003140Z 2024-12-18T00:44:41.1004119Z  2024-12-18T00:44:41.1004636Z  2024-12-18T00:44:41.1005043Z  2024-12-18T00:44:41.1005446Z  2024-12-18T00:44:41.1005842Z  2024-12-18T00:44:41.1006202Z  2024-12-18T00:44:41.1006590Z  2024-12-18T00:44:41.1006971Z  2024-12-18T00:44:41.1007549Z [10,062 / 20,599] 48 actions running 2024-12-18T00:44:41.1008510Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:41.1009415Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:41.1010313Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2024-12-18T00:44:41.1011530Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2024-12-18T00:44:41.1012667Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:44:41.1013484Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:41.1014251Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2024-12-18T00:44:41.1015282Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 4s local ... 2024-12-18T00:44:41.3349092Z 2024-12-18T00:44:41.3350468Z  2024-12-18T00:44:41.3350965Z  2024-12-18T00:44:41.3351379Z  2024-12-18T00:44:41.3351921Z  2024-12-18T00:44:41.3352305Z  2024-12-18T00:44:41.3352686Z  2024-12-18T00:44:41.3353123Z  2024-12-18T00:44:41.3353526Z  2024-12-18T00:44:41.3354085Z [10,071 / 20,599] 48 actions, 47 running 2024-12-18T00:44:41.3355051Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:41.3355972Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:41.3356855Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:41.3358364Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2024-12-18T00:44:41.3359500Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:44:41.3360497Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:41.3361257Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2024-12-18T00:44:41.3362259Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 4s local ... 2024-12-18T00:44:41.5375095Z 2024-12-18T00:44:41.5376005Z  2024-12-18T00:44:41.5376632Z  2024-12-18T00:44:41.5377321Z  2024-12-18T00:44:41.5377859Z  2024-12-18T00:44:41.5378241Z  2024-12-18T00:44:41.5378645Z  2024-12-18T00:44:41.5379016Z  2024-12-18T00:44:41.5379413Z  2024-12-18T00:44:41.5379982Z [10,076 / 20,599] 48 actions, 47 running 2024-12-18T00:44:41.5380928Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:41.5381786Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:41.5382670Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:41.5383786Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2024-12-18T00:44:41.5384922Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2024-12-18T00:44:41.5385615Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:44:41.5386323Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2024-12-18T00:44:41.5387270Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 4s local ... 2024-12-18T00:44:41.7604272Z 2024-12-18T00:44:41.7605437Z  2024-12-18T00:44:41.7606335Z  2024-12-18T00:44:41.7607072Z  2024-12-18T00:44:41.7608133Z  2024-12-18T00:44:41.7608601Z  2024-12-18T00:44:41.7610520Z  2024-12-18T00:44:41.7613253Z  2024-12-18T00:44:41.7613928Z  2024-12-18T00:44:41.7614922Z [10,082 / 20,599] 48 actions, 47 running 2024-12-18T00:44:41.7616047Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:41.7617203Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:41.7618365Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:41.7619737Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2024-12-18T00:44:41.7621125Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:44:41.7622036Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:44:41.7622912Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2024-12-18T00:44:41.7624201Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 5s local ... 2024-12-18T00:44:41.9865526Z 2024-12-18T00:44:41.9866464Z  2024-12-18T00:44:41.9866959Z  2024-12-18T00:44:41.9867367Z  2024-12-18T00:44:41.9867742Z  2024-12-18T00:44:41.9868122Z  2024-12-18T00:44:41.9868519Z  2024-12-18T00:44:41.9868928Z  2024-12-18T00:44:41.9869348Z  2024-12-18T00:44:41.9869941Z [10,095 / 20,599] 48 actions, 47 running 2024-12-18T00:44:41.9870975Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:41.9871903Z Compiling google/fft.cc; 14s local 2024-12-18T00:44:41.9872826Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2024-12-18T00:44:41.9874016Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2024-12-18T00:44:41.9875081Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:44:41.9875863Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:44:41.9876627Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2024-12-18T00:44:41.9877612Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 5s local ... 2024-12-18T00:44:42.2199124Z 2024-12-18T00:44:42.2199937Z  2024-12-18T00:44:42.2200414Z  2024-12-18T00:44:42.2200843Z  2024-12-18T00:44:42.2201217Z  2024-12-18T00:44:42.2201865Z  2024-12-18T00:44:42.2202234Z  2024-12-18T00:44:42.2202614Z  2024-12-18T00:44:42.2202997Z  2024-12-18T00:44:42.2203591Z [10,100 / 20,599] 48 actions, 47 running 2024-12-18T00:44:42.2204707Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:42.2205580Z Compiling google/fft.cc; 14s local 2024-12-18T00:44:42.2206458Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:42.2207717Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2024-12-18T00:44:42.2208934Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:44:42.2209732Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:44:42.2210481Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2024-12-18T00:44:42.2211419Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 5s local ... 2024-12-18T00:44:42.4804601Z 2024-12-18T00:44:42.4805522Z  2024-12-18T00:44:42.4805957Z  2024-12-18T00:44:42.4806340Z  2024-12-18T00:44:42.4806731Z  2024-12-18T00:44:42.4807107Z  2024-12-18T00:44:42.4807487Z  2024-12-18T00:44:42.4807843Z  2024-12-18T00:44:42.4808251Z  2024-12-18T00:44:42.4808852Z [10,107 / 20,599] 48 actions, 47 running 2024-12-18T00:44:42.4809703Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:42.4810509Z Compiling google/fft.cc; 14s local 2024-12-18T00:44:42.4811499Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:42.4812740Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 8s local 2024-12-18T00:44:42.4813768Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2024-12-18T00:44:42.4814704Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2024-12-18T00:44:42.4815785Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 5s local 2024-12-18T00:44:42.4817003Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 5s local ... 2024-12-18T00:44:42.7018395Z 2024-12-18T00:44:42.7019159Z  2024-12-18T00:44:42.7019642Z  2024-12-18T00:44:42.7020024Z  2024-12-18T00:44:42.7020419Z  2024-12-18T00:44:42.7020801Z  2024-12-18T00:44:42.7021201Z  2024-12-18T00:44:42.7021597Z  2024-12-18T00:44:42.7021978Z  2024-12-18T00:44:42.7022546Z [10,113 / 20,599] 47 actions running 2024-12-18T00:44:42.7023513Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:42.7024558Z Compiling google/fft.cc; 14s local 2024-12-18T00:44:42.7025444Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:42.7026662Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 8s local 2024-12-18T00:44:42.7027720Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2024-12-18T00:44:42.7028676Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2024-12-18T00:44:42.7029788Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 6s local 2024-12-18T00:44:42.7030966Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 6s local ... 2024-12-18T00:44:42.9243383Z 2024-12-18T00:44:42.9244474Z  2024-12-18T00:44:42.9244958Z  2024-12-18T00:44:42.9245350Z  2024-12-18T00:44:42.9245716Z  2024-12-18T00:44:42.9246094Z  2024-12-18T00:44:42.9246482Z  2024-12-18T00:44:42.9246832Z  2024-12-18T00:44:42.9247251Z  2024-12-18T00:44:42.9247821Z [10,131 / 20,600] 48 actions, 47 running 2024-12-18T00:44:42.9248724Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:42.9249603Z Compiling google/fft.cc; 15s local 2024-12-18T00:44:42.9250403Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:42.9251368Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2024-12-18T00:44:42.9252502Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2024-12-18T00:44:42.9253487Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 6s local 2024-12-18T00:44:42.9254773Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 6s local 2024-12-18T00:44:42.9255781Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 6s local ... 2024-12-18T00:44:43.1356722Z 2024-12-18T00:44:43.1357501Z  2024-12-18T00:44:43.1357916Z  2024-12-18T00:44:43.1358264Z  2024-12-18T00:44:43.1358931Z  2024-12-18T00:44:43.1359291Z  2024-12-18T00:44:43.1359639Z  2024-12-18T00:44:43.1359981Z  2024-12-18T00:44:43.1360318Z  2024-12-18T00:44:43.1360853Z [10,146 / 20,600] 48 actions, 47 running 2024-12-18T00:44:43.1361710Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:43.1362503Z Compiling google/fft.cc; 15s local 2024-12-18T00:44:43.1363261Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2024-12-18T00:44:43.1364156Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2024-12-18T00:44:43.1364986Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2024-12-18T00:44:43.1365914Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 6s local 2024-12-18T00:44:43.1366923Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 6s local 2024-12-18T00:44:43.1367866Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 6s local ... 2024-12-18T00:44:43.3773614Z 2024-12-18T00:44:43.3774466Z  2024-12-18T00:44:43.3774955Z  2024-12-18T00:44:43.3775349Z  2024-12-18T00:44:43.3775750Z  2024-12-18T00:44:43.3776146Z  2024-12-18T00:44:43.3776772Z  2024-12-18T00:44:43.3777154Z  2024-12-18T00:44:43.3777551Z  2024-12-18T00:44:43.3778140Z [10,150 / 20,600] 48 actions, 47 running 2024-12-18T00:44:43.3779103Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:43.3780024Z Compiling google/fft.cc; 15s local 2024-12-18T00:44:43.3780887Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:43.3781936Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2024-12-18T00:44:43.3782975Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 6s local 2024-12-18T00:44:43.3784119Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 6s local 2024-12-18T00:44:43.3785300Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 6s local 2024-12-18T00:44:43.3786385Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 6s local ... 2024-12-18T00:44:43.5928265Z 2024-12-18T00:44:43.5929198Z  2024-12-18T00:44:43.5929664Z  2024-12-18T00:44:43.5930044Z  2024-12-18T00:44:43.5930442Z  2024-12-18T00:44:43.5930862Z  2024-12-18T00:44:43.5931282Z  2024-12-18T00:44:43.5931666Z  2024-12-18T00:44:43.5932040Z  2024-12-18T00:44:43.5932638Z [10,154 / 20,600] 48 actions, 47 running 2024-12-18T00:44:43.5933575Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:43.5934434Z Compiling google/fft.cc; 15s local 2024-12-18T00:44:43.5935229Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:43.5936596Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:44:43.5937602Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2024-12-18T00:44:43.5938734Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 6s local 2024-12-18T00:44:43.5939789Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 6s local 2024-12-18T00:44:43.5940820Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 6s local ... 2024-12-18T00:44:43.7936660Z 2024-12-18T00:44:43.7937909Z  2024-12-18T00:44:43.7938378Z  2024-12-18T00:44:43.7938791Z  2024-12-18T00:44:43.7939200Z  2024-12-18T00:44:43.7939611Z  2024-12-18T00:44:43.7940012Z  2024-12-18T00:44:43.7940412Z  2024-12-18T00:44:43.7941086Z  2024-12-18T00:44:43.7942036Z [10,167 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:43.7943226Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:43.7949466Z Compiling google/fft.cc; 15s local 2024-12-18T00:44:43.7951151Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:43.7952229Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:44:43.7953258Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2024-12-18T00:44:43.7954452Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:44:43.7955541Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 6s local 2024-12-18T00:44:43.7956619Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 6s local ... 2024-12-18T00:44:44.0000252Z 2024-12-18T00:44:44.0001133Z  2024-12-18T00:44:44.0001610Z  2024-12-18T00:44:44.0001993Z  2024-12-18T00:44:44.0002406Z  2024-12-18T00:44:44.0002788Z  2024-12-18T00:44:44.0003194Z  2024-12-18T00:44:44.0003603Z  2024-12-18T00:44:44.0003998Z  2024-12-18T00:44:44.0004920Z [10,178 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:44.0006107Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:44.0006976Z Compiling google/fft.cc; 16s local 2024-12-18T00:44:44.0007865Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2024-12-18T00:44:44.0008935Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:44:44.0009919Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2024-12-18T00:44:44.0011046Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:44:44.0012184Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:44:44.0013271Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 6s local ... 2024-12-18T00:44:44.2827677Z 2024-12-18T00:44:44.2828732Z  2024-12-18T00:44:44.2829228Z  2024-12-18T00:44:44.2829650Z  2024-12-18T00:44:44.2830057Z  2024-12-18T00:44:44.2830492Z  2024-12-18T00:44:44.2830898Z  2024-12-18T00:44:44.2831310Z  2024-12-18T00:44:44.2831714Z  2024-12-18T00:44:44.2832646Z [10,183 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:44.2833869Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:44.2834774Z Compiling google/fft.cc; 16s local 2024-12-18T00:44:44.2835710Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:44.2836776Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:44:44.2837843Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2024-12-18T00:44:44.2839074Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:44:44.2840318Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:44:44.2841459Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 7s local ... 2024-12-18T00:44:44.5030481Z 2024-12-18T00:44:44.5031318Z  2024-12-18T00:44:44.5031800Z  2024-12-18T00:44:44.5032201Z  2024-12-18T00:44:44.5032588Z  2024-12-18T00:44:44.5032996Z  2024-12-18T00:44:44.5033395Z  2024-12-18T00:44:44.5033803Z  2024-12-18T00:44:44.5034204Z  2024-12-18T00:44:44.5035145Z [10,197 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:44.5036650Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:44.5037706Z Compiling google/fft.cc; 16s local 2024-12-18T00:44:44.5038573Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:44.5039598Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2024-12-18T00:44:44.5040637Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2024-12-18T00:44:44.5042071Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2024-12-18T00:44:44.5043155Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:44:44.5044440Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 7s local ... 2024-12-18T00:44:44.7035871Z 2024-12-18T00:44:44.7036737Z  2024-12-18T00:44:44.7037193Z  2024-12-18T00:44:44.7037582Z  2024-12-18T00:44:44.7037982Z  2024-12-18T00:44:44.7038371Z  2024-12-18T00:44:44.7038752Z  2024-12-18T00:44:44.7039148Z  2024-12-18T00:44:44.7039545Z  2024-12-18T00:44:44.7040476Z [10,207 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:44.7041786Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:44.7042648Z Compiling google/fft.cc; 16s local 2024-12-18T00:44:44.7043549Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:44.7044962Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2024-12-18T00:44:44.7046106Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:44:44.7047196Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2024-12-18T00:44:44.7048316Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 7s local 2024-12-18T00:44:44.7049372Z Compiling src/google/protobuf/descriptor.cc; 7s local ... 2024-12-18T00:44:44.9253470Z 2024-12-18T00:44:44.9254269Z  2024-12-18T00:44:44.9254726Z  2024-12-18T00:44:44.9255131Z  2024-12-18T00:44:44.9255505Z  2024-12-18T00:44:44.9255881Z  2024-12-18T00:44:44.9256259Z  2024-12-18T00:44:44.9256814Z  2024-12-18T00:44:44.9257185Z  2024-12-18T00:44:44.9258098Z [10,221 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:44.9259316Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:44.9260135Z Compiling google/fft.cc; 17s local 2024-12-18T00:44:44.9260989Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2024-12-18T00:44:44.9262141Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2024-12-18T00:44:44.9263294Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:44:44.9264499Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:44:44.9265703Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 7s local 2024-12-18T00:44:44.9266737Z Compiling src/google/protobuf/descriptor.cc; 7s local ... 2024-12-18T00:44:45.1574485Z 2024-12-18T00:44:45.1575321Z  2024-12-18T00:44:45.1575776Z  2024-12-18T00:44:45.1576168Z  2024-12-18T00:44:45.1576716Z  2024-12-18T00:44:45.1577110Z  2024-12-18T00:44:45.1577499Z  2024-12-18T00:44:45.1577920Z  2024-12-18T00:44:45.1578452Z  2024-12-18T00:44:45.1579404Z [10,228 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:45.1580650Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:45.1581601Z Compiling google/fft.cc; 17s local 2024-12-18T00:44:45.1582344Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:45.1583761Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2024-12-18T00:44:45.1585058Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:44:45.1586147Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:44:45.1587351Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:44:45.1588386Z Compiling src/google/protobuf/descriptor.cc; 7s local ... 2024-12-18T00:44:45.3604327Z 2024-12-18T00:44:45.3605469Z  2024-12-18T00:44:45.3605992Z  2024-12-18T00:44:45.3606390Z  2024-12-18T00:44:45.3606792Z  2024-12-18T00:44:45.3607199Z  2024-12-18T00:44:45.3607563Z  2024-12-18T00:44:45.3608074Z  2024-12-18T00:44:45.3608460Z  2024-12-18T00:44:45.3609374Z [10,238 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:45.3610621Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:45.3611481Z Compiling google/fft.cc; 17s local 2024-12-18T00:44:45.3612330Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:45.3613480Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:44:45.3614681Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:44:45.3615782Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:44:45.3616980Z Compiling src/google/protobuf/descriptor.cc; 7s local 2024-12-18T00:44:45.3617829Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 5s local ... 2024-12-18T00:44:45.5720699Z 2024-12-18T00:44:45.5721533Z  2024-12-18T00:44:45.5722015Z  2024-12-18T00:44:45.5722423Z  2024-12-18T00:44:45.5722832Z  2024-12-18T00:44:45.5723238Z  2024-12-18T00:44:45.5723650Z  2024-12-18T00:44:45.5723957Z  2024-12-18T00:44:45.5724298Z  2024-12-18T00:44:45.5725041Z [10,248 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:45.5726007Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:45.5739018Z Compiling google/fft.cc; 17s local 2024-12-18T00:44:45.5739795Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:45.5740769Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2024-12-18T00:44:45.5741851Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:44:45.5743082Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:44:45.5744354Z Compiling src/google/protobuf/descriptor.cc; 7s local 2024-12-18T00:44:45.5745358Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 5s local ... 2024-12-18T00:44:45.8010838Z 2024-12-18T00:44:45.8011699Z  2024-12-18T00:44:45.8012156Z  2024-12-18T00:44:45.8012590Z  2024-12-18T00:44:45.8012983Z  2024-12-18T00:44:45.8013359Z  2024-12-18T00:44:45.8013788Z  2024-12-18T00:44:45.8014166Z  2024-12-18T00:44:45.8014548Z  2024-12-18T00:44:45.8015474Z [10,256 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:45.8016833Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:45.8017781Z Compiling google/fft.cc; 17s local 2024-12-18T00:44:45.8018653Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:45.8019829Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2024-12-18T00:44:45.8020990Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2024-12-18T00:44:45.8022314Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:44:45.8023657Z Compiling src/google/protobuf/descriptor.cc; 8s local 2024-12-18T00:44:45.8024621Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 5s local ... 2024-12-18T00:44:46.0142084Z 2024-12-18T00:44:46.0142955Z  2024-12-18T00:44:46.0143569Z  2024-12-18T00:44:46.0143985Z  2024-12-18T00:44:46.0144621Z  2024-12-18T00:44:46.0144978Z  2024-12-18T00:44:46.0145391Z  2024-12-18T00:44:46.0145800Z  2024-12-18T00:44:46.0146198Z  2024-12-18T00:44:46.0147375Z [10,262 / 20,600] 1 / 17 tests; 47 actions, 46 running; last test: ...che_test 2024-12-18T00:44:46.0148579Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:46.0149440Z Compiling google/fft.cc; 18s local 2024-12-18T00:44:46.0150328Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2024-12-18T00:44:46.0151498Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2024-12-18T00:44:46.0152765Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:44:46.0154128Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2024-12-18T00:44:46.0155061Z Compiling src/google/protobuf/descriptor.cc; 8s local 2024-12-18T00:44:46.0155966Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 6s local ... 2024-12-18T00:44:46.2182283Z 2024-12-18T00:44:46.2183174Z  2024-12-18T00:44:46.2183635Z  2024-12-18T00:44:46.2184009Z  2024-12-18T00:44:46.2184466Z  2024-12-18T00:44:46.2184852Z  2024-12-18T00:44:46.2185248Z  2024-12-18T00:44:46.2185650Z  2024-12-18T00:44:46.2186038Z  2024-12-18T00:44:46.2187003Z [10,268 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:46.2188153Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:46.2189083Z Compiling google/fft.cc; 18s local 2024-12-18T00:44:46.2189950Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:46.2191228Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2024-12-18T00:44:46.2192388Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:44:46.2193514Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:44:46.2194482Z Compiling src/google/protobuf/descriptor.cc; 8s local 2024-12-18T00:44:46.2195421Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 6s local ... 2024-12-18T00:44:46.4220761Z 2024-12-18T00:44:46.4221610Z  2024-12-18T00:44:46.4222031Z  2024-12-18T00:44:46.4222374Z  2024-12-18T00:44:46.4222746Z  2024-12-18T00:44:46.4223108Z  2024-12-18T00:44:46.4223480Z  2024-12-18T00:44:46.4223852Z  2024-12-18T00:44:46.4224216Z  2024-12-18T00:44:46.4225127Z [10,275 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:46.4226329Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:46.4227257Z Compiling google/fft.cc; 18s local 2024-12-18T00:44:46.4228194Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:46.4229238Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2024-12-18T00:44:46.4230631Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:44:46.4231781Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:44:46.4232782Z Compiling src/google/protobuf/descriptor.cc; 8s local 2024-12-18T00:44:46.4233624Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 6s local ... 2024-12-18T00:44:46.6425259Z 2024-12-18T00:44:46.6426138Z  2024-12-18T00:44:46.6426632Z  2024-12-18T00:44:46.6427323Z  2024-12-18T00:44:46.6427714Z  2024-12-18T00:44:46.6428122Z  2024-12-18T00:44:46.6428526Z  2024-12-18T00:44:46.6428947Z  2024-12-18T00:44:46.6429357Z  2024-12-18T00:44:46.6430522Z [10,284 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:46.6431782Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:46.6432680Z Compiling google/fft.cc; 18s local 2024-12-18T00:44:46.6433699Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:46.6434933Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2024-12-18T00:44:46.6436063Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:44:46.6437036Z Compiling src/google/protobuf/descriptor.cc; 9s local 2024-12-18T00:44:46.6437986Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 6s local 2024-12-18T00:44:46.6438965Z @onednn//:onednn_autogen; 4s local ... 2024-12-18T00:44:46.8572444Z 2024-12-18T00:44:46.8573327Z  2024-12-18T00:44:46.8573805Z  2024-12-18T00:44:46.8574194Z  2024-12-18T00:44:46.8574653Z  2024-12-18T00:44:46.8575208Z  2024-12-18T00:44:46.8575605Z  2024-12-18T00:44:46.8575975Z  2024-12-18T00:44:46.8576366Z  2024-12-18T00:44:46.8577433Z [10,293 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:46.8578584Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:46.8579463Z Compiling google/fft.cc; 18s local 2024-12-18T00:44:46.8580309Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:46.8581396Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:44:46.8582523Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:44:46.8583495Z Compiling src/google/protobuf/descriptor.cc; 9s local 2024-12-18T00:44:46.8584430Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 6s local 2024-12-18T00:44:46.8585274Z @onednn//:onednn_autogen; 4s local ... 2024-12-18T00:44:47.1051952Z 2024-12-18T00:44:47.1052819Z  2024-12-18T00:44:47.1053303Z  2024-12-18T00:44:47.1053725Z  2024-12-18T00:44:47.1054134Z  2024-12-18T00:44:47.1054528Z  2024-12-18T00:44:47.1054921Z  2024-12-18T00:44:47.1055321Z  2024-12-18T00:44:47.1055761Z  2024-12-18T00:44:47.1056856Z [10,296 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:47.1058050Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:47.1058916Z Compiling google/fft.cc; 19s local 2024-12-18T00:44:47.1059743Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2024-12-18T00:44:47.1060832Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:44:47.1061965Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2024-12-18T00:44:47.1063005Z Compiling src/google/protobuf/descriptor.cc; 9s local 2024-12-18T00:44:47.1063987Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:44:47.1064750Z @onednn//:onednn_autogen; 4s local ... 2024-12-18T00:44:47.3057687Z 2024-12-18T00:44:47.3058541Z  2024-12-18T00:44:47.3058997Z  2024-12-18T00:44:47.3059504Z  2024-12-18T00:44:47.3060121Z  2024-12-18T00:44:47.3060607Z  2024-12-18T00:44:47.3061016Z  2024-12-18T00:44:47.3061392Z  2024-12-18T00:44:47.3061869Z  2024-12-18T00:44:47.3062659Z [10,309 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:47.3063718Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:47.3064806Z Compiling google/fft.cc; 19s local 2024-12-18T00:44:47.3065636Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:47.3066910Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:44:47.3067794Z Compiling src/google/protobuf/descriptor.cc; 9s local 2024-12-18T00:44:47.3068774Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:44:47.3069609Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:47.3070351Z @com_google_protobuf//:protobuf; 4s local ... 2024-12-18T00:44:47.5166703Z 2024-12-18T00:44:47.5167614Z  2024-12-18T00:44:47.5168168Z  2024-12-18T00:44:47.5168573Z  2024-12-18T00:44:47.5168981Z  2024-12-18T00:44:47.5169399Z  2024-12-18T00:44:47.5169805Z  2024-12-18T00:44:47.5170197Z  2024-12-18T00:44:47.5170605Z  2024-12-18T00:44:47.5171537Z [10,316 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:47.5172699Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:47.5173601Z Compiling google/fft.cc; 19s local 2024-12-18T00:44:47.5174617Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:47.5175835Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:44:47.5177113Z Compiling src/google/protobuf/descriptor.cc; 9s local 2024-12-18T00:44:47.5178140Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:44:47.5179034Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:47.5179660Z @com_google_protobuf//:protobuf; 4s local ... 2024-12-18T00:44:47.7529285Z 2024-12-18T00:44:47.7530199Z  2024-12-18T00:44:47.7530666Z  2024-12-18T00:44:47.7531079Z  2024-12-18T00:44:47.7531463Z  2024-12-18T00:44:47.7531855Z  2024-12-18T00:44:47.7532291Z  2024-12-18T00:44:47.7532680Z  2024-12-18T00:44:47.7533076Z  2024-12-18T00:44:47.7533981Z [10,326 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:47.7535163Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:47.7536180Z Compiling google/fft.cc; 19s local 2024-12-18T00:44:47.7537202Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:47.7538553Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:44:47.7539633Z Compiling src/google/protobuf/descriptor.cc; 10s local 2024-12-18T00:44:47.7540660Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:44:47.7541561Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:47.7542187Z @com_google_protobuf//:protobuf; 4s local ... 2024-12-18T00:44:47.9537282Z 2024-12-18T00:44:47.9538141Z  2024-12-18T00:44:47.9538643Z  2024-12-18T00:44:47.9539001Z  2024-12-18T00:44:47.9539404Z  2024-12-18T00:44:47.9539785Z  2024-12-18T00:44:47.9540183Z  2024-12-18T00:44:47.9540553Z  2024-12-18T00:44:47.9540956Z  2024-12-18T00:44:47.9541899Z [10,333 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:47.9543045Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:47.9543921Z Compiling google/fft.cc; 20s local 2024-12-18T00:44:47.9545110Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2024-12-18T00:44:47.9546246Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:44:47.9547246Z Compiling src/google/protobuf/descriptor.cc; 10s local 2024-12-18T00:44:47.9548413Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2024-12-18T00:44:47.9549313Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:47.9550253Z @com_google_protobuf//:protobuf; 4s local ... 2024-12-18T00:44:48.1545706Z 2024-12-18T00:44:48.1546643Z  2024-12-18T00:44:48.1547148Z  2024-12-18T00:44:48.1547915Z  2024-12-18T00:44:48.1548309Z  2024-12-18T00:44:48.1548740Z  2024-12-18T00:44:48.1549161Z  2024-12-18T00:44:48.1549540Z  2024-12-18T00:44:48.1549969Z  2024-12-18T00:44:48.1550683Z [10,338 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:48.1552083Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:48.1552975Z Compiling google/fft.cc; 20s local 2024-12-18T00:44:48.1553773Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:48.1554836Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:44:48.1555759Z Compiling src/google/protobuf/descriptor.cc; 10s local 2024-12-18T00:44:48.1556688Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 8s local 2024-12-18T00:44:48.1557546Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:48.1558221Z @com_google_protobuf//:protobuf; 5s local ... 2024-12-18T00:44:48.3618481Z 2024-12-18T00:44:48.3619345Z  2024-12-18T00:44:48.3619827Z  2024-12-18T00:44:48.3620223Z  2024-12-18T00:44:48.3620621Z  2024-12-18T00:44:48.3621036Z  2024-12-18T00:44:48.3621441Z  2024-12-18T00:44:48.3621837Z  2024-12-18T00:44:48.3622265Z  2024-12-18T00:44:48.3623189Z [10,345 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:48.3624414Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:48.3625353Z Compiling google/fft.cc; 20s local 2024-12-18T00:44:48.3626228Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:48.3627403Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:44:48.3628438Z Compiling src/google/protobuf/descriptor.cc; 10s local 2024-12-18T00:44:48.3629189Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:48.3630062Z Compiling src/google/protobuf/generated_message_reflection.cc; 5s local 2024-12-18T00:44:48.3631211Z Compiling .../cpu/runtime_single_threaded_matmul_c128.cc; 4s local ... 2024-12-18T00:44:48.5607998Z 2024-12-18T00:44:48.5608898Z  2024-12-18T00:44:48.5609321Z  2024-12-18T00:44:48.5609710Z  2024-12-18T00:44:48.5610077Z  2024-12-18T00:44:48.5610425Z  2024-12-18T00:44:48.5610791Z  2024-12-18T00:44:48.5611138Z  2024-12-18T00:44:48.5611492Z  2024-12-18T00:44:48.5612347Z [10,357 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:48.5613433Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:48.5614281Z Compiling google/fft.cc; 20s local 2024-12-18T00:44:48.5615030Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:48.5616161Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:44:48.5617319Z Compiling src/google/protobuf/descriptor.cc; 10s local 2024-12-18T00:44:48.5618031Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:44:48.5618858Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 4s local 2024-12-18T00:44:48.5619849Z Compiling src/google/protobuf/text_format.cc; 3s local ... 2024-12-18T00:44:48.8174682Z 2024-12-18T00:44:48.8175563Z  2024-12-18T00:44:48.8176031Z  2024-12-18T00:44:48.8176570Z  2024-12-18T00:44:48.8176957Z  2024-12-18T00:44:48.8177455Z  2024-12-18T00:44:48.8177856Z  2024-12-18T00:44:48.8178247Z  2024-12-18T00:44:48.8178651Z  2024-12-18T00:44:48.8179581Z [10,365 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:48.8181060Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:48.8182072Z Compiling google/fft.cc; 20s local 2024-12-18T00:44:48.8182923Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:48.8184088Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:44:48.8185271Z Compiling src/google/protobuf/descriptor.cc; 11s local 2024-12-18T00:44:48.8186455Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 4s local 2024-12-18T00:44:48.8187598Z Compiling src/google/protobuf/text_format.cc; 3s local 2024-12-18T00:44:48.8188559Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 3s local ... 2024-12-18T00:44:49.0418178Z 2024-12-18T00:44:49.0419039Z  2024-12-18T00:44:49.0419532Z  2024-12-18T00:44:49.0419924Z  2024-12-18T00:44:49.0420315Z  2024-12-18T00:44:49.0420743Z  2024-12-18T00:44:49.0421115Z  2024-12-18T00:44:49.0421487Z  2024-12-18T00:44:49.0421874Z  2024-12-18T00:44:49.0422791Z [10,371 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:49.0423963Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:49.0424857Z Compiling google/fft.cc; 21s local 2024-12-18T00:44:49.0425710Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2024-12-18T00:44:49.0426914Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:44:49.0427964Z Compiling src/google/protobuf/descriptor.cc; 11s local 2024-12-18T00:44:49.0429091Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 4s local 2024-12-18T00:44:49.0430079Z Compiling src/google/protobuf/text_format.cc; 4s local 2024-12-18T00:44:49.0431064Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 3s local ... 2024-12-18T00:44:49.2716923Z 2024-12-18T00:44:49.2717800Z  2024-12-18T00:44:49.2718255Z  2024-12-18T00:44:49.2718619Z  2024-12-18T00:44:49.2719012Z  2024-12-18T00:44:49.2719421Z  2024-12-18T00:44:49.2719793Z  2024-12-18T00:44:49.2720152Z  2024-12-18T00:44:49.2720529Z  2024-12-18T00:44:49.2721457Z [10,377 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:49.2722667Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:49.2723579Z Compiling google/fft.cc; 21s local 2024-12-18T00:44:49.2724394Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:49.2725509Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:44:49.2726494Z Compiling src/google/protobuf/descriptor.cc; 11s local 2024-12-18T00:44:49.2727446Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 5s local 2024-12-18T00:44:49.2728441Z Compiling src/google/protobuf/text_format.cc; 4s local 2024-12-18T00:44:49.2729366Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 3s local ... 2024-12-18T00:44:49.5069174Z 2024-12-18T00:44:49.5070050Z  2024-12-18T00:44:49.5070501Z  2024-12-18T00:44:49.5070895Z  2024-12-18T00:44:49.5071282Z  2024-12-18T00:44:49.5071659Z  2024-12-18T00:44:49.5072010Z  2024-12-18T00:44:49.5072402Z  2024-12-18T00:44:49.5072792Z  2024-12-18T00:44:49.5073775Z [10,381 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:49.5074951Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:49.5075777Z Compiling google/fft.cc; 21s local 2024-12-18T00:44:49.5076564Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:49.5077644Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:44:49.5079040Z Compiling src/google/protobuf/descriptor.cc; 11s local 2024-12-18T00:44:49.5080132Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 5s local 2024-12-18T00:44:49.5081079Z Compiling src/google/protobuf/text_format.cc; 4s local 2024-12-18T00:44:49.5081831Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 4s local ... 2024-12-18T00:44:49.7073668Z 2024-12-18T00:44:49.7074539Z  2024-12-18T00:44:49.7075004Z  2024-12-18T00:44:49.7075406Z  2024-12-18T00:44:49.7076130Z  2024-12-18T00:44:49.7076539Z  2024-12-18T00:44:49.7076942Z  2024-12-18T00:44:49.7077313Z  2024-12-18T00:44:49.7077651Z  2024-12-18T00:44:49.7078669Z [10,387 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:49.7079792Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:49.7080678Z Compiling google/fft.cc; 21s local 2024-12-18T00:44:49.7081516Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:49.7082635Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:44:49.7083680Z Compiling src/google/protobuf/descriptor.cc; 12s local 2024-12-18T00:44:49.7084666Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 5s local 2024-12-18T00:44:49.7085673Z Compiling src/google/protobuf/text_format.cc; 4s local 2024-12-18T00:44:49.7086590Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 4s local ... 2024-12-18T00:44:49.9707283Z 2024-12-18T00:44:49.9708338Z  2024-12-18T00:44:49.9708824Z  2024-12-18T00:44:49.9709236Z  2024-12-18T00:44:49.9709628Z  2024-12-18T00:44:49.9710002Z  2024-12-18T00:44:49.9710389Z  2024-12-18T00:44:49.9710743Z  2024-12-18T00:44:49.9711120Z  2024-12-18T00:44:49.9712025Z [10,396 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:49.9713255Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:49.9714154Z Compiling google/fft.cc; 22s local 2024-12-18T00:44:49.9715016Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2024-12-18T00:44:49.9716162Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:44:49.9717155Z Compiling src/google/protobuf/descriptor.cc; 12s local 2024-12-18T00:44:49.9718168Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 5s local 2024-12-18T00:44:49.9719190Z Compiling src/google/protobuf/text_format.cc; 5s local 2024-12-18T00:44:49.9720216Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 4s local ... 2024-12-18T00:44:50.1833770Z 2024-12-18T00:44:50.1834661Z  2024-12-18T00:44:50.1835154Z  2024-12-18T00:44:50.1835536Z  2024-12-18T00:44:50.1835969Z  2024-12-18T00:44:50.1836342Z  2024-12-18T00:44:50.1836745Z  2024-12-18T00:44:50.1837149Z  2024-12-18T00:44:50.1837541Z  2024-12-18T00:44:50.1838488Z [10,402 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:50.1839689Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:50.1840601Z Compiling google/fft.cc; 22s local 2024-12-18T00:44:50.1841447Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:50.1842626Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:44:50.1843638Z Compiling src/google/protobuf/descriptor.cc; 12s local 2024-12-18T00:44:50.1844897Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2024-12-18T00:44:50.1845927Z Compiling src/google/protobuf/text_format.cc; 5s local 2024-12-18T00:44:50.1846872Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 4s local ... 2024-12-18T00:44:50.3823208Z 2024-12-18T00:44:50.3824099Z  2024-12-18T00:44:50.3824586Z  2024-12-18T00:44:50.3824963Z  2024-12-18T00:44:50.3825650Z  2024-12-18T00:44:50.3826144Z  2024-12-18T00:44:50.3826591Z  2024-12-18T00:44:50.3826959Z  2024-12-18T00:44:50.3827328Z  2024-12-18T00:44:50.3828227Z [10,410 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:50.3829702Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:50.3830739Z Compiling google/fft.cc; 22s local 2024-12-18T00:44:50.3831581Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:50.3832819Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:44:50.3833689Z Compiling src/google/protobuf/descriptor.cc; 12s local 2024-12-18T00:44:50.3834628Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2024-12-18T00:44:50.3835597Z Compiling src/google/protobuf/text_format.cc; 5s local 2024-12-18T00:44:50.3836512Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 4s local ... 2024-12-18T00:44:50.5866019Z 2024-12-18T00:44:50.5866880Z  2024-12-18T00:44:50.5867310Z  2024-12-18T00:44:50.5867632Z  2024-12-18T00:44:50.5867997Z  2024-12-18T00:44:50.5868364Z  2024-12-18T00:44:50.5868741Z  2024-12-18T00:44:50.5869114Z  2024-12-18T00:44:50.5869494Z  2024-12-18T00:44:50.5870465Z [10,419 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:50.5871648Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:50.5872549Z Compiling google/fft.cc; 22s local 2024-12-18T00:44:50.5873431Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:50.5874593Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:44:50.5875617Z Compiling src/google/protobuf/descriptor.cc; 12s local 2024-12-18T00:44:50.5876576Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2024-12-18T00:44:50.5877587Z Compiling src/google/protobuf/text_format.cc; 5s local 2024-12-18T00:44:50.5878473Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 5s local ... 2024-12-18T00:44:50.8035290Z 2024-12-18T00:44:50.8036137Z  2024-12-18T00:44:50.8036630Z  2024-12-18T00:44:50.8037090Z  2024-12-18T00:44:50.8037437Z  2024-12-18T00:44:50.8037937Z  2024-12-18T00:44:50.8038315Z  2024-12-18T00:44:50.8038739Z  2024-12-18T00:44:50.8039133Z  2024-12-18T00:44:50.8039950Z [10,437 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:50.8041208Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:50.8042148Z Compiling google/fft.cc; 22s local 2024-12-18T00:44:50.8043059Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:50.8044543Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:44:50.8045614Z Compiling src/google/protobuf/descriptor.cc; 13s local 2024-12-18T00:44:50.8046687Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2024-12-18T00:44:50.8047758Z Compiling src/google/protobuf/text_format.cc; 5s local 2024-12-18T00:44:50.8048726Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 5s local ... 2024-12-18T00:44:51.0048445Z 2024-12-18T00:44:51.0049253Z  2024-12-18T00:44:51.0049743Z  2024-12-18T00:44:51.0050092Z  2024-12-18T00:44:51.0050463Z  2024-12-18T00:44:51.0050836Z  2024-12-18T00:44:51.0051213Z  2024-12-18T00:44:51.0051583Z  2024-12-18T00:44:51.0051928Z  2024-12-18T00:44:51.0053050Z [10,456 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:51.0054214Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:51.0055195Z Compiling google/fft.cc; 23s local 2024-12-18T00:44:51.0056065Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2024-12-18T00:44:51.0057420Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:44:51.0058449Z Compiling src/google/protobuf/descriptor.cc; 13s local 2024-12-18T00:44:51.0059591Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2024-12-18T00:44:51.0060659Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 5s local 2024-12-18T00:44:51.0061414Z Compiling google/fft.cc; 5s local ... 2024-12-18T00:44:51.2201172Z 2024-12-18T00:44:51.2202012Z  2024-12-18T00:44:51.2202481Z  2024-12-18T00:44:51.2202879Z  2024-12-18T00:44:51.2203288Z  2024-12-18T00:44:51.2203671Z  2024-12-18T00:44:51.2204058Z  2024-12-18T00:44:51.2204439Z  2024-12-18T00:44:51.2204814Z  2024-12-18T00:44:51.2205765Z [10,468 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:51.2206958Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:51.2207854Z Compiling google/fft.cc; 23s local 2024-12-18T00:44:51.2208703Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:51.2209875Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:44:51.2210860Z Compiling src/google/protobuf/descriptor.cc; 13s local 2024-12-18T00:44:51.2211855Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 7s local 2024-12-18T00:44:51.2212928Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 5s local 2024-12-18T00:44:51.2213640Z Compiling google/fft.cc; 5s local ... 2024-12-18T00:44:51.4569527Z 2024-12-18T00:44:51.4570418Z  2024-12-18T00:44:51.4570937Z  2024-12-18T00:44:51.4571366Z  2024-12-18T00:44:51.4571785Z  2024-12-18T00:44:51.4572217Z  2024-12-18T00:44:51.4572612Z  2024-12-18T00:44:51.4572951Z  2024-12-18T00:44:51.4573270Z  2024-12-18T00:44:51.4574041Z [10,473 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:51.4575166Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:51.4576068Z Compiling google/fft.cc; 23s local 2024-12-18T00:44:51.4577057Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:51.4578195Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:44:51.4579223Z Compiling src/google/protobuf/descriptor.cc; 13s local 2024-12-18T00:44:51.4580271Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 7s local 2024-12-18T00:44:51.4581292Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 6s local 2024-12-18T00:44:51.4582045Z Compiling google/fft.cc; 5s local ... 2024-12-18T00:44:51.6690080Z 2024-12-18T00:44:51.6691388Z  2024-12-18T00:44:51.6691914Z  2024-12-18T00:44:51.6692475Z  2024-12-18T00:44:51.6692855Z  2024-12-18T00:44:51.6693267Z  2024-12-18T00:44:51.6693642Z  2024-12-18T00:44:51.6694042Z  2024-12-18T00:44:51.6694430Z  2024-12-18T00:44:51.6695400Z [10,481 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:51.6696800Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:51.6697744Z Compiling google/fft.cc; 23s local 2024-12-18T00:44:51.6698591Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:51.6699743Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:44:51.6701032Z Compiling src/google/protobuf/descriptor.cc; 14s local 2024-12-18T00:44:51.6702014Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 6s local 2024-12-18T00:44:51.6702960Z Compiling google/fft.cc; 5s local 2024-12-18T00:44:51.6703767Z Compiling llvm/lib/Support/YAMLParser.cpp [for tool]; 3s local ... 2024-12-18T00:44:51.8778498Z 2024-12-18T00:44:51.8779809Z  2024-12-18T00:44:51.8780294Z  2024-12-18T00:44:51.8780690Z  2024-12-18T00:44:51.8781094Z  2024-12-18T00:44:51.8781975Z  2024-12-18T00:44:51.8782385Z  2024-12-18T00:44:51.8782766Z  2024-12-18T00:44:51.8783172Z  2024-12-18T00:44:51.8784108Z [10,489 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:51.8785318Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:51.8786249Z Compiling google/fft.cc; 23s local 2024-12-18T00:44:51.8787173Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:51.8788375Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:44:51.8789325Z Compiling src/google/protobuf/descriptor.cc; 14s local 2024-12-18T00:44:51.8790104Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:51.8790937Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2024-12-18T00:44:51.8791853Z @onednn//:onednn_autogen; 3s local ... 2024-12-18T00:44:52.1087094Z 2024-12-18T00:44:52.1088112Z  2024-12-18T00:44:52.1088659Z  2024-12-18T00:44:52.1089066Z  2024-12-18T00:44:52.1089469Z  2024-12-18T00:44:52.1089867Z  2024-12-18T00:44:52.1090250Z  2024-12-18T00:44:52.1090634Z  2024-12-18T00:44:52.1091022Z  2024-12-18T00:44:52.1091951Z [10,495 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:52.1092923Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:52.1093821Z Compiling google/fft.cc; 24s local 2024-12-18T00:44:52.1094687Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2024-12-18T00:44:52.1095834Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:44:52.1097118Z Compiling src/google/protobuf/descriptor.cc; 14s local 2024-12-18T00:44:52.1097822Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:52.1098716Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2024-12-18T00:44:52.1099604Z @onednn//:onednn_autogen; 3s local ... 2024-12-18T00:44:52.3091930Z 2024-12-18T00:44:52.3092908Z  2024-12-18T00:44:52.3094697Z  2024-12-18T00:44:52.3095113Z  2024-12-18T00:44:52.3095473Z  2024-12-18T00:44:52.3095820Z  2024-12-18T00:44:52.3096272Z  2024-12-18T00:44:52.3096864Z  2024-12-18T00:44:52.3097346Z  2024-12-18T00:44:52.3098273Z [10,501 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:52.3099423Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:52.3100316Z Compiling google/fft.cc; 24s local 2024-12-18T00:44:52.3101192Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:52.3102333Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:44:52.3103378Z Compiling src/google/protobuf/descriptor.cc; 14s local 2024-12-18T00:44:52.3104210Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:52.3105117Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2024-12-18T00:44:52.3106085Z @onednn//:onednn_autogen; 3s local ... 2024-12-18T00:44:52.5315677Z 2024-12-18T00:44:52.5316705Z  2024-12-18T00:44:52.5317167Z  2024-12-18T00:44:52.5317567Z  2024-12-18T00:44:52.5318202Z  2024-12-18T00:44:52.5318550Z  2024-12-18T00:44:52.5318960Z  2024-12-18T00:44:52.5319360Z  2024-12-18T00:44:52.5319743Z  2024-12-18T00:44:52.5320862Z [10,510 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:52.5322085Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:52.5323009Z Compiling google/fft.cc; 24s local 2024-12-18T00:44:52.5323861Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:52.5325471Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:44:52.5326500Z Compiling src/google/protobuf/descriptor.cc; 14s local 2024-12-18T00:44:52.5327238Z Compiling google/fft.cc; 6s local 2024-12-18T00:44:52.5327835Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:52.5328512Z Compiling src/crypto/fipsmodule/bcm.c; 2s local ... 2024-12-18T00:44:52.7934114Z 2024-12-18T00:44:52.7934954Z  2024-12-18T00:44:52.7935460Z  2024-12-18T00:44:52.7935960Z  2024-12-18T00:44:52.7936371Z  2024-12-18T00:44:52.7936912Z  2024-12-18T00:44:52.7937299Z  2024-12-18T00:44:52.7937855Z  2024-12-18T00:44:52.7938222Z  2024-12-18T00:44:52.7939143Z [10,519 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:52.7940355Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:52.7941239Z Compiling google/fft.cc; 24s local 2024-12-18T00:44:52.7942235Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:52.7943505Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:44:52.7944862Z Compiling src/google/protobuf/descriptor.cc; 15s local 2024-12-18T00:44:52.7945687Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:52.7946358Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:52.7947146Z Compiling src/crypto/fipsmodule/bcm.c; 2s local ... 2024-12-18T00:44:52.9996949Z 2024-12-18T00:44:52.9997834Z  2024-12-18T00:44:52.9998262Z  2024-12-18T00:44:52.9998700Z  2024-12-18T00:44:52.9999079Z  2024-12-18T00:44:52.9999448Z  2024-12-18T00:44:52.9999839Z  2024-12-18T00:44:53.0000171Z  2024-12-18T00:44:53.0000544Z  2024-12-18T00:44:53.0001460Z [10,527 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:53.0002591Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:53.0003504Z Compiling google/fft.cc; 25s local 2024-12-18T00:44:53.0004355Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2024-12-18T00:44:53.0005538Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:44:53.0006539Z Compiling src/google/protobuf/descriptor.cc; 15s local 2024-12-18T00:44:53.0007264Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:53.0007845Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:53.0008481Z Compiling src/crypto/fipsmodule/bcm.c; 2s local ... 2024-12-18T00:44:53.2118882Z 2024-12-18T00:44:53.2119694Z  2024-12-18T00:44:53.2120175Z  2024-12-18T00:44:53.2120564Z  2024-12-18T00:44:53.2120973Z  2024-12-18T00:44:53.2121371Z  2024-12-18T00:44:53.2121770Z  2024-12-18T00:44:53.2122159Z  2024-12-18T00:44:53.2122514Z  2024-12-18T00:44:53.2123474Z [10,534 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:53.2124651Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:53.2125511Z Compiling google/fft.cc; 25s local 2024-12-18T00:44:53.2126360Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:53.2127520Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:44:53.2128847Z Compiling src/google/protobuf/descriptor.cc; 15s local 2024-12-18T00:44:53.2129603Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:53.2130324Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:53.2131024Z Compiling src/crypto/fipsmodule/bcm.c; 2s local ... 2024-12-18T00:44:53.4426671Z 2024-12-18T00:44:53.4427540Z  2024-12-18T00:44:53.4428019Z  2024-12-18T00:44:53.4428432Z  2024-12-18T00:44:53.4428880Z  2024-12-18T00:44:53.4429272Z  2024-12-18T00:44:53.4430041Z  2024-12-18T00:44:53.4430439Z  2024-12-18T00:44:53.4430833Z  2024-12-18T00:44:53.4431766Z [10,542 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:53.4432971Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:53.4433878Z Compiling google/fft.cc; 25s local 2024-12-18T00:44:53.4434798Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:53.4435985Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:44:53.4437044Z Compiling src/google/protobuf/descriptor.cc; 15s local 2024-12-18T00:44:53.4437826Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:53.4438438Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:53.4439320Z Compiling src/crypto/fipsmodule/bcm.c; 3s local ... 2024-12-18T00:44:53.6434218Z 2024-12-18T00:44:53.6435184Z  2024-12-18T00:44:53.6435724Z  2024-12-18T00:44:53.6436162Z  2024-12-18T00:44:53.6436589Z  2024-12-18T00:44:53.6437007Z  2024-12-18T00:44:53.6437451Z  2024-12-18T00:44:53.6437830Z  2024-12-18T00:44:53.6438228Z  2024-12-18T00:44:53.6439185Z [10,551 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:53.6440425Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:53.6441368Z Compiling google/fft.cc; 25s local 2024-12-18T00:44:53.6442202Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:53.6443491Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:44:53.6445958Z Compiling src/google/protobuf/descriptor.cc; 16s local 2024-12-18T00:44:53.6446684Z Compiling google/fft.cc; 7s local 2024-12-18T00:44:53.6447265Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:53.6447931Z Compiling src/crypto/fipsmodule/bcm.c; 3s local ... 2024-12-18T00:44:53.8833940Z 2024-12-18T00:44:53.8834901Z  2024-12-18T00:44:53.8835393Z  2024-12-18T00:44:53.8835814Z  2024-12-18T00:44:53.8836224Z  2024-12-18T00:44:53.8836625Z  2024-12-18T00:44:53.8837045Z  2024-12-18T00:44:53.8837439Z  2024-12-18T00:44:53.8837822Z  2024-12-18T00:44:53.8838717Z [10,560 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:53.8839955Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:53.8840856Z Compiling google/fft.cc; 25s local 2024-12-18T00:44:53.8841739Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:53.8842669Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:53.8843280Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:53.8843940Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2024-12-18T00:44:53.8844867Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:53.8845567Z Compiling llvm/lib/Support/JSON.cpp [for tool]; 2s local ... 2024-12-18T00:44:54.1116618Z 2024-12-18T00:44:54.1117548Z  2024-12-18T00:44:54.1118086Z  2024-12-18T00:44:54.1118524Z  2024-12-18T00:44:54.1118962Z  2024-12-18T00:44:54.1119369Z  2024-12-18T00:44:54.1119803Z  2024-12-18T00:44:54.1120700Z  2024-12-18T00:44:54.1121162Z  2024-12-18T00:44:54.1122092Z [10,568 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:54.1123463Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:54.1124400Z Compiling google/fft.cc; 26s local 2024-12-18T00:44:54.1125286Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2024-12-18T00:44:54.1126208Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:54.1126926Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:54.1127666Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2024-12-18T00:44:54.1128616Z Compiling llvm/lib/Support/JSON.cpp [for tool]; 2s local 2024-12-18T00:44:54.1129428Z @com_github_grpc_grpc//:grpc_transport_chttp2; 2s local ... 2024-12-18T00:44:54.3121084Z 2024-12-18T00:44:54.3122171Z  2024-12-18T00:44:54.3122680Z  2024-12-18T00:44:54.3123106Z  2024-12-18T00:44:54.3123554Z  2024-12-18T00:44:54.3123931Z  2024-12-18T00:44:54.3124334Z  2024-12-18T00:44:54.3124770Z  2024-12-18T00:44:54.3125196Z  2024-12-18T00:44:54.3126149Z [10,575 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:54.3127293Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:54.3128156Z Compiling google/fft.cc; 26s local 2024-12-18T00:44:54.3129036Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:54.3129937Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:54.3130527Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:54.3131152Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:44:54.3132035Z Compiling llvm/lib/Support/JSON.cpp [for tool]; 2s local 2024-12-18T00:44:54.3132929Z @com_github_grpc_grpc//:grpc_transport_chttp2; 2s local ... 2024-12-18T00:44:54.5233232Z 2024-12-18T00:44:54.5234165Z  2024-12-18T00:44:54.5234681Z  2024-12-18T00:44:54.5235101Z  2024-12-18T00:44:54.5235505Z  2024-12-18T00:44:54.5235900Z  2024-12-18T00:44:54.5236373Z  2024-12-18T00:44:54.5236777Z  2024-12-18T00:44:54.5237163Z  2024-12-18T00:44:54.5238046Z [10,594 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:54.5239401Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:54.5240335Z Compiling google/fft.cc; 26s local 2024-12-18T00:44:54.5241240Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:54.5242155Z Compiling google/fft.cc; 8s local 2024-12-18T00:44:54.5242826Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:44:54.5243665Z Compiling llvm/lib/Support/JSON.cpp [for tool]; 2s local 2024-12-18T00:44:54.5244939Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 2s local 2024-12-18T00:44:54.5246036Z Compiling llvm/lib/Support/KnownBits.cpp [for tool]; 2s local ... 2024-12-18T00:44:54.7432214Z 2024-12-18T00:44:54.7433149Z  2024-12-18T00:44:54.7433645Z  2024-12-18T00:44:54.7434097Z  2024-12-18T00:44:54.7434505Z  2024-12-18T00:44:54.7434880Z  2024-12-18T00:44:54.7435315Z  2024-12-18T00:44:54.7435705Z  2024-12-18T00:44:54.7436065Z  2024-12-18T00:44:54.7436952Z [10,607 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:54.7438131Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:54.7438997Z Compiling google/fft.cc; 26s local 2024-12-18T00:44:54.7439824Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:54.7440736Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:54.7441351Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:44:54.7442391Z Compiling llvm/lib/Support/JSON.cpp [for tool]; 2s local 2024-12-18T00:44:54.7443305Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 2s local 2024-12-18T00:44:54.7444672Z Compiling llvm/lib/Support/KnownBits.cpp [for tool]; 2s local ... 2024-12-18T00:44:55.0497972Z 2024-12-18T00:44:55.0498902Z  2024-12-18T00:44:55.0499383Z  2024-12-18T00:44:55.0499803Z  2024-12-18T00:44:55.0500217Z  2024-12-18T00:44:55.0500621Z  2024-12-18T00:44:55.0501032Z  2024-12-18T00:44:55.0501455Z  2024-12-18T00:44:55.0502312Z  2024-12-18T00:44:55.0503234Z [10,615 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:55.0504385Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:44:55.0505325Z Compiling google/fft.cc; 27s local 2024-12-18T00:44:55.0506183Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2024-12-18T00:44:55.0507049Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:55.0507666Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2024-12-18T00:44:55.0508458Z Compiling llvm/lib/Support/JSON.cpp [for tool]; 3s local 2024-12-18T00:44:55.0509358Z Compiling llvm/lib/Support/KnownBits.cpp [for tool]; 2s local 2024-12-18T00:44:55.0510196Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:55.3130078Z 2024-12-18T00:44:55.3130982Z  2024-12-18T00:44:55.3131526Z  2024-12-18T00:44:55.3131972Z  2024-12-18T00:44:55.3132393Z  2024-12-18T00:44:55.3132845Z  2024-12-18T00:44:55.3133304Z  2024-12-18T00:44:55.3133715Z  2024-12-18T00:44:55.3134108Z  2024-12-18T00:44:55.3135039Z [10,620 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:55.3136248Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:44:55.3137337Z Compiling google/fft.cc; 27s local 2024-12-18T00:44:55.3138237Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:55.3139177Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:55.3139878Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:44:55.3140687Z Compiling llvm/lib/Support/JSON.cpp [for tool]; 3s local 2024-12-18T00:44:55.3141747Z Compiling llvm/lib/Support/KnownBits.cpp [for tool]; 2s local 2024-12-18T00:44:55.3142602Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:55.5134384Z 2024-12-18T00:44:55.5135394Z  2024-12-18T00:44:55.5135882Z  2024-12-18T00:44:55.5136319Z  2024-12-18T00:44:55.5136876Z  2024-12-18T00:44:55.5137284Z  2024-12-18T00:44:55.5137731Z  2024-12-18T00:44:55.5138074Z  2024-12-18T00:44:55.5138466Z  2024-12-18T00:44:55.5139386Z [10,624 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:55.5140577Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:44:55.5141588Z Compiling google/fft.cc; 27s local 2024-12-18T00:44:55.5142408Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:55.5143314Z Compiling google/fft.cc; 9s local 2024-12-18T00:44:55.5143976Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:44:55.5144862Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:55.5145442Z Compiling src/common/lrn.cpp; 2s local 2024-12-18T00:44:55.5146012Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:55.7243068Z 2024-12-18T00:44:55.7244728Z  2024-12-18T00:44:55.7254433Z  2024-12-18T00:44:55.7255304Z  2024-12-18T00:44:55.7255745Z  2024-12-18T00:44:55.7256160Z  2024-12-18T00:44:55.7256673Z  2024-12-18T00:44:55.7257038Z  2024-12-18T00:44:55.7257392Z  2024-12-18T00:44:55.7258259Z [10,628 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:55.7259675Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:44:55.7260684Z Compiling google/fft.cc; 27s local 2024-12-18T00:44:55.7261512Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:55.7262294Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:55.7262913Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:44:55.7263586Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:55.7264507Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:55.7265165Z Compiling src/common/matmul.cpp; 2s local ... 2024-12-18T00:44:55.9402461Z 2024-12-18T00:44:55.9403403Z  2024-12-18T00:44:55.9403887Z  2024-12-18T00:44:55.9404318Z  2024-12-18T00:44:55.9404743Z  2024-12-18T00:44:55.9405139Z  2024-12-18T00:44:55.9405489Z  2024-12-18T00:44:55.9405861Z  2024-12-18T00:44:55.9406281Z  2024-12-18T00:44:55.9407185Z [10,637 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:55.9408390Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:44:55.9409263Z Compiling google/fft.cc; 28s local 2024-12-18T00:44:55.9410110Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2024-12-18T00:44:55.9410949Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:55.9411579Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:44:55.9412298Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:55.9412938Z Compiling src/common/matmul.cpp; 2s local 2024-12-18T00:44:55.9413763Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 2s local ... 2024-12-18T00:44:56.1974828Z 2024-12-18T00:44:56.1975719Z  2024-12-18T00:44:56.1976206Z  2024-12-18T00:44:56.1976787Z  2024-12-18T00:44:56.1977187Z  2024-12-18T00:44:56.1977523Z  2024-12-18T00:44:56.1977840Z  2024-12-18T00:44:56.1978153Z  2024-12-18T00:44:56.1978454Z  2024-12-18T00:44:56.1979220Z [10,644 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:56.1980176Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:44:56.1980939Z Compiling google/fft.cc; 28s local 2024-12-18T00:44:56.1981678Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:56.1982453Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:56.1983045Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2024-12-18T00:44:56.1983709Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:56.1984535Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 2s local 2024-12-18T00:44:56.1985500Z Compiling llvm/lib/Support/ELFAttributeParser.cpp; 2s local ... 2024-12-18T00:44:56.4909758Z 2024-12-18T00:44:56.4910622Z  2024-12-18T00:44:56.4911104Z  2024-12-18T00:44:56.4911510Z  2024-12-18T00:44:56.4911909Z  2024-12-18T00:44:56.4912317Z  2024-12-18T00:44:56.4912713Z  2024-12-18T00:44:56.4913133Z  2024-12-18T00:44:56.4913520Z  2024-12-18T00:44:56.4914436Z [10,652 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:56.4915584Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:44:56.4916476Z Compiling google/fft.cc; 28s local 2024-12-18T00:44:56.4917279Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:56.4918154Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:56.4918790Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:44:56.4919699Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 2s local 2024-12-18T00:44:56.4920604Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:56.4921683Z @com_github_grpc_grpc//:grpc_xds_client_secure; 2s local ... 2024-12-18T00:44:56.7022147Z 2024-12-18T00:44:56.7022975Z  2024-12-18T00:44:56.7023444Z  2024-12-18T00:44:56.7024066Z  2024-12-18T00:44:56.7024490Z  2024-12-18T00:44:56.7024860Z  2024-12-18T00:44:56.7025275Z  2024-12-18T00:44:56.7025661Z  2024-12-18T00:44:56.7026061Z  2024-12-18T00:44:56.7027020Z [10,658 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:56.7028455Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:44:56.7029286Z Compiling google/fft.cc; 28s local 2024-12-18T00:44:56.7030090Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:56.7030938Z Compiling google/fft.cc; 10s local 2024-12-18T00:44:56.7031748Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:44:56.7032704Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 3s local 2024-12-18T00:44:56.7033841Z Compiling src/core/ext/filters/client_channel/xds/xds_client.cc; 2s local 2024-12-18T00:44:56.7034832Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:56.9143605Z 2024-12-18T00:44:56.9144910Z  2024-12-18T00:44:56.9145413Z  2024-12-18T00:44:56.9145819Z  2024-12-18T00:44:56.9146190Z  2024-12-18T00:44:56.9146550Z  2024-12-18T00:44:56.9146926Z  2024-12-18T00:44:56.9147287Z  2024-12-18T00:44:56.9147694Z  2024-12-18T00:44:56.9148609Z [10,664 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:56.9149803Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:44:56.9150697Z Compiling google/fft.cc; 29s local 2024-12-18T00:44:56.9151549Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:56.9152434Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:56.9153084Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:44:56.9154016Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 3s local 2024-12-18T00:44:56.9155107Z Compiling src/core/ext/filters/client_channel/xds/xds_client.cc; 2s local 2024-12-18T00:44:56.9156010Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:57.1192842Z 2024-12-18T00:44:57.1193726Z  2024-12-18T00:44:57.1194224Z  2024-12-18T00:44:57.1194635Z  2024-12-18T00:44:57.1195073Z  2024-12-18T00:44:57.1195473Z  2024-12-18T00:44:57.1195978Z  2024-12-18T00:44:57.1196442Z  2024-12-18T00:44:57.1196895Z  2024-12-18T00:44:57.1197869Z [10,673 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:57.1199096Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:44:57.1200078Z Compiling google/fft.cc; 29s local 2024-12-18T00:44:57.1200957Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2024-12-18T00:44:57.1201909Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:57.1202599Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2024-12-18T00:44:57.1203517Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 3s local 2024-12-18T00:44:57.1204617Z Compiling src/core/ext/filters/client_channel/xds/xds_client.cc; 2s local 2024-12-18T00:44:57.1205516Z @onednn//:onednn_autogen; 2s local ... 2024-12-18T00:44:57.3196575Z 2024-12-18T00:44:57.3197469Z  2024-12-18T00:44:57.3197923Z  2024-12-18T00:44:57.3198307Z  2024-12-18T00:44:57.3198658Z  2024-12-18T00:44:57.3199038Z  2024-12-18T00:44:57.3199397Z  2024-12-18T00:44:57.3199781Z  2024-12-18T00:44:57.3200181Z  2024-12-18T00:44:57.3201101Z [10,679 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:57.3202506Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:44:57.3203384Z Compiling google/fft.cc; 29s local 2024-12-18T00:44:57.3204415Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:57.3205300Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:57.3205881Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:44:57.3206721Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 3s local 2024-12-18T00:44:57.3207747Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:44:57.3208666Z Compiling src/common/memory.cpp; 2s local ... 2024-12-18T00:44:57.5712084Z 2024-12-18T00:44:57.5712945Z  2024-12-18T00:44:57.5713417Z  2024-12-18T00:44:57.5713820Z  2024-12-18T00:44:57.5714220Z  2024-12-18T00:44:57.5714606Z  2024-12-18T00:44:57.5715015Z  2024-12-18T00:44:57.5715405Z  2024-12-18T00:44:57.5715785Z  2024-12-18T00:44:57.5716870Z [10,691 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:57.5718040Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:44:57.5718954Z Compiling google/fft.cc; 29s local 2024-12-18T00:44:57.5719825Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:57.5720734Z Compiling google/fft.cc; 11s local 2024-12-18T00:44:57.5721403Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:44:57.5722328Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 3s local 2024-12-18T00:44:57.5723211Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:57.5723945Z Compiling llvm/lib/Support/Path.cpp [for tool]; 2s local ... 2024-12-18T00:44:57.7905648Z 2024-12-18T00:44:57.7906713Z  2024-12-18T00:44:57.7907196Z  2024-12-18T00:44:57.7907619Z  2024-12-18T00:44:57.7908033Z  2024-12-18T00:44:57.7908453Z  2024-12-18T00:44:57.7908847Z  2024-12-18T00:44:57.7909264Z  2024-12-18T00:44:57.7909662Z  2024-12-18T00:44:57.7910650Z [10,698 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:57.7911989Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:44:57.7912878Z Compiling google/fft.cc; 29s local 2024-12-18T00:44:57.7913741Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:57.7914657Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:57.7915333Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:44:57.7916258Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 4s local 2024-12-18T00:44:57.7917095Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:57.7917791Z Compiling llvm/lib/Support/Path.cpp [for tool]; 2s local ... 2024-12-18T00:44:57.9952808Z 2024-12-18T00:44:57.9953747Z  2024-12-18T00:44:57.9954295Z  2024-12-18T00:44:57.9954678Z  2024-12-18T00:44:57.9955040Z  2024-12-18T00:44:57.9955437Z  2024-12-18T00:44:57.9955818Z  2024-12-18T00:44:57.9956203Z  2024-12-18T00:44:57.9956620Z  2024-12-18T00:44:57.9957479Z [10,711 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:57.9958754Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:44:57.9959918Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2024-12-18T00:44:57.9960798Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:57.9961449Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:44:57.9962341Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 4s local 2024-12-18T00:44:57.9963203Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:57.9963920Z Compiling llvm/lib/Support/Path.cpp [for tool]; 2s local 2024-12-18T00:44:57.9965051Z Compiling src/common/memory_desc.cpp; 2s local ... 2024-12-18T00:44:58.2107859Z 2024-12-18T00:44:58.2108879Z  2024-12-18T00:44:58.2109390Z  2024-12-18T00:44:58.2109789Z  2024-12-18T00:44:58.2110472Z  2024-12-18T00:44:58.2111036Z  2024-12-18T00:44:58.2111415Z  2024-12-18T00:44:58.2111763Z  2024-12-18T00:44:58.2112148Z  2024-12-18T00:44:58.2113052Z [10,713 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:58.2114351Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:44:58.2115491Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:58.2116321Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:58.2116902Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2024-12-18T00:44:58.2117768Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 4s local 2024-12-18T00:44:58.2118604Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:44:58.2119290Z Compiling llvm/lib/Support/Path.cpp [for tool]; 3s local 2024-12-18T00:44:58.2120097Z Compiling src/common/memory_desc.cpp; 2s local ... 2024-12-18T00:44:58.4254763Z 2024-12-18T00:44:58.4255822Z  2024-12-18T00:44:58.4256303Z  2024-12-18T00:44:58.4256797Z  2024-12-18T00:44:58.4257173Z  2024-12-18T00:44:58.4257603Z  2024-12-18T00:44:58.4257965Z  2024-12-18T00:44:58.4258338Z  2024-12-18T00:44:58.4258716Z  2024-12-18T00:44:58.4259633Z [10,718 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:58.4260795Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:44:58.4261903Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:58.4262777Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:58.4263423Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2024-12-18T00:44:58.4264302Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 4s local 2024-12-18T00:44:58.4265154Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:58.4265851Z Compiling llvm/lib/Support/Path.cpp [for tool]; 3s local 2024-12-18T00:44:58.4266600Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:58.6526427Z 2024-12-18T00:44:58.6527628Z  2024-12-18T00:44:58.6528639Z  2024-12-18T00:44:58.6529411Z  2024-12-18T00:44:58.6530352Z  2024-12-18T00:44:58.6530675Z  2024-12-18T00:44:58.6530949Z  2024-12-18T00:44:58.6531210Z  2024-12-18T00:44:58.6531459Z  2024-12-18T00:44:58.6532042Z [10,736 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:58.6533397Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:44:58.6534072Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:58.6534584Z Compiling google/fft.cc; 12s local 2024-12-18T00:44:58.6535104Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 4s local 2024-12-18T00:44:58.6535628Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:58.6536199Z Compiling src/google/protobuf/compiler/java/field.cc [for tool]; 2s local 2024-12-18T00:44:58.6537107Z Compiling src/common/memory_desc_wrapper.cpp; 2s local 2024-12-18T00:44:58.6537878Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:58.9204993Z 2024-12-18T00:44:58.9205818Z  2024-12-18T00:44:58.9206332Z  2024-12-18T00:44:58.9206729Z  2024-12-18T00:44:58.9207102Z  2024-12-18T00:44:58.9207490Z  2024-12-18T00:44:58.9207899Z  2024-12-18T00:44:58.9208302Z  2024-12-18T00:44:58.9208700Z  2024-12-18T00:44:58.9209685Z [10,749 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:44:58.9210850Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:44:58.9212273Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2024-12-18T00:44:58.9213328Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:58.9214161Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 5s local 2024-12-18T00:44:58.9215054Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:58.9215744Z Compiling src/common/memory_desc_wrapper.cpp; 2s local 2024-12-18T00:44:58.9217073Z Compiling src/google/protobuf/compiler/java/file.cc [for tool]; 2s local 2024-12-18T00:44:58.9218105Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:44:59.1835564Z 2024-12-18T00:44:59.1836474Z  2024-12-18T00:44:59.1836900Z  2024-12-18T00:44:59.1837296Z  2024-12-18T00:44:59.1837664Z  2024-12-18T00:44:59.1838013Z  2024-12-18T00:44:59.1838365Z  2024-12-18T00:44:59.1838739Z  2024-12-18T00:44:59.1839101Z  2024-12-18T00:44:59.1840013Z [10,760 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:59.1841149Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:44:59.1842345Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:59.1843184Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:59.1844452Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 5s local 2024-12-18T00:44:59.1845270Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:44:59.1846017Z Compiling src/common/memory_desc_wrapper.cpp; 3s local 2024-12-18T00:44:59.1847063Z Compiling src/google/protobuf/compiler/java/file.cc [for tool]; 2s local 2024-12-18T00:44:59.1848158Z Compiling src/graph/interface/shape_infer.cpp; 2s local ... 2024-12-18T00:44:59.4021213Z 2024-12-18T00:44:59.4022036Z  2024-12-18T00:44:59.4022499Z  2024-12-18T00:44:59.4022877Z  2024-12-18T00:44:59.4023302Z  2024-12-18T00:44:59.4023693Z  2024-12-18T00:44:59.4024083Z  2024-12-18T00:44:59.4024472Z  2024-12-18T00:44:59.4024870Z  2024-12-18T00:44:59.4025800Z [10,767 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:59.4027064Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:44:59.4028281Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:59.4029265Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:59.4030343Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 5s local 2024-12-18T00:44:59.4031245Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:59.4031954Z Compiling src/common/memory_desc_wrapper.cpp; 3s local 2024-12-18T00:44:59.4033662Z Compiling src/google/protobuf/compiler/java/file.cc [for tool]; 3s local 2024-12-18T00:44:59.4034771Z Compiling src/graph/interface/shape_infer.cpp; 2s local ... 2024-12-18T00:44:59.6450423Z 2024-12-18T00:44:59.6451295Z  2024-12-18T00:44:59.6451896Z  2024-12-18T00:44:59.6452267Z  2024-12-18T00:44:59.6452639Z  2024-12-18T00:44:59.6453038Z  2024-12-18T00:44:59.6453472Z  2024-12-18T00:44:59.6453855Z  2024-12-18T00:44:59.6454246Z  2024-12-18T00:44:59.6455213Z [10,775 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:59.6456601Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:44:59.6457754Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:59.6458641Z Compiling google/fft.cc; 13s local 2024-12-18T00:44:59.6459511Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 5s local 2024-12-18T00:44:59.6460394Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:44:59.6461089Z Compiling src/common/memory_desc_wrapper.cpp; 3s local 2024-12-18T00:44:59.6462390Z Compiling src/google/protobuf/compiler/java/file.cc [for tool]; 3s local 2024-12-18T00:44:59.6463405Z Compiling src/graph/interface/shape_infer.cpp; 2s local ... 2024-12-18T00:44:59.8455256Z 2024-12-18T00:44:59.8456368Z  2024-12-18T00:44:59.8457009Z  2024-12-18T00:44:59.8457406Z  2024-12-18T00:44:59.8457780Z  2024-12-18T00:44:59.8458181Z  2024-12-18T00:44:59.8458697Z  2024-12-18T00:44:59.8459123Z  2024-12-18T00:44:59.8459525Z  2024-12-18T00:44:59.8460674Z [10,782 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:44:59.8462002Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:44:59.8463213Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:44:59.8464141Z Compiling google/fft.cc; 14s local 2024-12-18T00:44:59.8464990Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2024-12-18T00:44:59.8466001Z Compiling src/common/memory_desc_wrapper.cpp; 3s local 2024-12-18T00:44:59.8466902Z Compiling src/graph/interface/shape_infer.cpp; 3s local 2024-12-18T00:44:59.8467722Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:44:59.8468656Z Compiling llvm/lib/Support/ScopedPrinter.cpp [for tool]; 2s local ... 2024-12-18T00:45:00.0806603Z 2024-12-18T00:45:00.0807446Z  2024-12-18T00:45:00.0807914Z  2024-12-18T00:45:00.0808321Z  2024-12-18T00:45:00.0808740Z  2024-12-18T00:45:00.0809111Z  2024-12-18T00:45:00.0809544Z  2024-12-18T00:45:00.0809938Z  2024-12-18T00:45:00.0810327Z  2024-12-18T00:45:00.0811373Z [10,786 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:00.0812530Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:00.0813771Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2024-12-18T00:45:00.0814746Z Compiling google/fft.cc; 14s local 2024-12-18T00:45:00.0815674Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2024-12-18T00:45:00.0816910Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:00.0817773Z Compiling src/graph/interface/shape_infer.cpp; 3s local 2024-12-18T00:45:00.0818515Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:00.0819410Z Compiling llvm/lib/Support/ScopedPrinter.cpp [for tool]; 2s local ... 2024-12-18T00:45:00.3009166Z 2024-12-18T00:45:00.3010096Z  2024-12-18T00:45:00.3010571Z  2024-12-18T00:45:00.3010988Z  2024-12-18T00:45:00.3011414Z  2024-12-18T00:45:00.3011832Z  2024-12-18T00:45:00.3012199Z  2024-12-18T00:45:00.3012608Z  2024-12-18T00:45:00.3012988Z  2024-12-18T00:45:00.3013945Z [10,796 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:00.3015192Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:00.3016403Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:45:00.3017531Z Compiling google/fft.cc; 14s local 2024-12-18T00:45:00.3018374Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2024-12-18T00:45:00.3019315Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:00.3020136Z Compiling src/graph/interface/shape_infer.cpp; 3s local 2024-12-18T00:45:00.3021019Z Compiling llvm/lib/Support/ScopedPrinter.cpp [for tool]; 3s local 2024-12-18T00:45:00.3021913Z @com_google_protobuf//:protobuf_lite; 2s local ... 2024-12-18T00:45:00.5217575Z 2024-12-18T00:45:00.5218393Z  2024-12-18T00:45:00.5218862Z  2024-12-18T00:45:00.5219243Z  2024-12-18T00:45:00.5219627Z  2024-12-18T00:45:00.5220029Z  2024-12-18T00:45:00.5220450Z  2024-12-18T00:45:00.5220832Z  2024-12-18T00:45:00.5221498Z  2024-12-18T00:45:00.5222471Z [10,803 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:00.5223871Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:00.5225249Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:45:00.5226192Z Compiling google/fft.cc; 14s local 2024-12-18T00:45:00.5227029Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2024-12-18T00:45:00.5228143Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:00.5229098Z Compiling src/graph/interface/shape_infer.cpp; 3s local 2024-12-18T00:45:00.5230089Z Compiling llvm/lib/Support/ScopedPrinter.cpp [for tool]; 3s local 2024-12-18T00:45:00.5231024Z @com_google_protobuf//:protobuf_lite; 3s local ... 2024-12-18T00:45:00.7361291Z 2024-12-18T00:45:00.7362158Z  2024-12-18T00:45:00.7362631Z  2024-12-18T00:45:00.7363084Z  2024-12-18T00:45:00.7363502Z  2024-12-18T00:45:00.7363913Z  2024-12-18T00:45:00.7364317Z  2024-12-18T00:45:00.7364709Z  2024-12-18T00:45:00.7365127Z  2024-12-18T00:45:00.7366087Z [10,811 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:00.7367280Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:00.7368478Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:45:00.7369427Z Compiling google/fft.cc; 15s local 2024-12-18T00:45:00.7370340Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2024-12-18T00:45:00.7371395Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:00.7372312Z Compiling src/graph/interface/shape_infer.cpp; 4s local 2024-12-18T00:45:00.7373406Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:45:00.7374457Z @com_google_protobuf//:protobuf_lite; 2s local ... 2024-12-18T00:45:00.9444795Z 2024-12-18T00:45:00.9445701Z  2024-12-18T00:45:00.9446184Z  2024-12-18T00:45:00.9446581Z  2024-12-18T00:45:00.9446976Z  2024-12-18T00:45:00.9447341Z  2024-12-18T00:45:00.9447701Z  2024-12-18T00:45:00.9448079Z  2024-12-18T00:45:00.9448459Z  2024-12-18T00:45:00.9449332Z [10,820 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:00.9450565Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:00.9451949Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:45:00.9452884Z Compiling google/fft.cc; 15s local 2024-12-18T00:45:00.9453636Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2024-12-18T00:45:00.9454571Z Compiling src/graph/interface/shape_infer.cpp; 4s local 2024-12-18T00:45:00.9455678Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:45:00.9456779Z @com_google_protobuf//:protobuf_lite; 2s local 2024-12-18T00:45:00.9457740Z Compiling llvm/lib/Support/SpecialCaseList.cpp [for tool]; 2s local ... 2024-12-18T00:45:01.1484975Z 2024-12-18T00:45:01.1485918Z  2024-12-18T00:45:01.1486436Z  2024-12-18T00:45:01.1486792Z  2024-12-18T00:45:01.1487171Z  2024-12-18T00:45:01.1487553Z  2024-12-18T00:45:01.1487922Z  2024-12-18T00:45:01.1488301Z  2024-12-18T00:45:01.1488686Z  2024-12-18T00:45:01.1489605Z [10,824 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:01.1490772Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:01.1491953Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2024-12-18T00:45:01.1492839Z Compiling google/fft.cc; 15s local 2024-12-18T00:45:01.1493960Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2024-12-18T00:45:01.1494943Z Compiling src/graph/interface/shape_infer.cpp; 4s local 2024-12-18T00:45:01.1496042Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:45:01.1497173Z @com_google_protobuf//:protobuf_lite; 3s local 2024-12-18T00:45:01.1498065Z Compiling llvm/lib/Support/SpecialCaseList.cpp [for tool]; 2s local ... 2024-12-18T00:45:01.3652075Z 2024-12-18T00:45:01.3653012Z  2024-12-18T00:45:01.3653568Z  2024-12-18T00:45:01.3654398Z  2024-12-18T00:45:01.3654823Z  2024-12-18T00:45:01.3655233Z  2024-12-18T00:45:01.3655627Z  2024-12-18T00:45:01.3656042Z  2024-12-18T00:45:01.3656726Z  2024-12-18T00:45:01.3657693Z [10,840 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:01.3659065Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:01.3660202Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:45:01.3661098Z Compiling google/fft.cc; 15s local 2024-12-18T00:45:01.3661883Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2024-12-18T00:45:01.3662864Z Compiling src/graph/interface/shape_infer.cpp; 4s local 2024-12-18T00:45:01.3663884Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2024-12-18T00:45:01.3664853Z @com_google_protobuf//:protobuf_lite; 3s local 2024-12-18T00:45:01.3665639Z Compiling src/common/memory_zero_pad.cpp; 2s local ... 2024-12-18T00:45:01.5990647Z 2024-12-18T00:45:01.5991514Z  2024-12-18T00:45:01.5991994Z  2024-12-18T00:45:01.5992407Z  2024-12-18T00:45:01.5992814Z  2024-12-18T00:45:01.5993214Z  2024-12-18T00:45:01.5993613Z  2024-12-18T00:45:01.5994151Z  2024-12-18T00:45:01.5994574Z  2024-12-18T00:45:01.5995528Z [10,859 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:01.5996717Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:01.5997909Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:45:01.5998840Z Compiling google/fft.cc; 15s local 2024-12-18T00:45:01.5999655Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2024-12-18T00:45:01.6000648Z Compiling src/graph/interface/shape_infer.cpp; 4s local 2024-12-18T00:45:01.6001701Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 4s local 2024-12-18T00:45:01.6002679Z @com_google_protobuf//:protobuf_lite; 3s local 2024-12-18T00:45:01.6003480Z Compiling src/common/memory_zero_pad.cpp; 3s local ... 2024-12-18T00:45:01.8106531Z 2024-12-18T00:45:01.8107698Z  2024-12-18T00:45:01.8108433Z  2024-12-18T00:45:01.8109022Z  2024-12-18T00:45:01.8109540Z  2024-12-18T00:45:01.8110032Z  2024-12-18T00:45:01.8110397Z  2024-12-18T00:45:01.8110770Z  2024-12-18T00:45:01.8111123Z  2024-12-18T00:45:01.8112024Z [10,882 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:01.8113175Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:01.8114239Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:45:01.8115149Z Compiling google/fft.cc; 16s local 2024-12-18T00:45:01.8116012Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 8s local 2024-12-18T00:45:01.8117061Z Compiling src/graph/interface/shape_infer.cpp; 5s local 2024-12-18T00:45:01.8117734Z @com_google_protobuf//:protobuf_lite; 3s local 2024-12-18T00:45:01.8118447Z Compiling src/common/memory_zero_pad.cpp; 3s local 2024-12-18T00:45:01.8119217Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:45:02.0120727Z 2024-12-18T00:45:02.0121972Z  2024-12-18T00:45:02.0122468Z  2024-12-18T00:45:02.0122994Z  2024-12-18T00:45:02.0123422Z  2024-12-18T00:45:02.0123762Z  2024-12-18T00:45:02.0124077Z  2024-12-18T00:45:02.0124521Z  2024-12-18T00:45:02.0124853Z  2024-12-18T00:45:02.0125620Z [10,912 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:02.0126595Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:02.0127695Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2024-12-18T00:45:02.0128536Z Compiling google/fft.cc; 16s local 2024-12-18T00:45:02.0129132Z Compiling src/graph/interface/shape_infer.cpp; 5s local 2024-12-18T00:45:02.0129843Z Compiling src/common/memory_zero_pad.cpp; 3s local 2024-12-18T00:45:02.0130448Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:02.0131007Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:02.0131563Z @onednn//:onednn_autogen; 2s local ... 2024-12-18T00:45:02.2382011Z 2024-12-18T00:45:02.2382875Z  2024-12-18T00:45:02.2383376Z  2024-12-18T00:45:02.2383829Z  2024-12-18T00:45:02.2384265Z  2024-12-18T00:45:02.2384685Z  2024-12-18T00:45:02.2385063Z  2024-12-18T00:45:02.2385419Z  2024-12-18T00:45:02.2385812Z  2024-12-18T00:45:02.2386753Z [10,933 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:02.2387971Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:02.2389186Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:45:02.2390269Z Compiling google/fft.cc; 16s local 2024-12-18T00:45:02.2391021Z Compiling src/graph/interface/shape_infer.cpp; 5s local 2024-12-18T00:45:02.2391840Z Compiling src/common/memory_zero_pad.cpp; 3s local 2024-12-18T00:45:02.2392561Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:02.2393174Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:02.2393807Z @onednn//:onednn_autogen; 2s local ... 2024-12-18T00:45:02.5230679Z 2024-12-18T00:45:02.5231707Z  2024-12-18T00:45:02.5232210Z  2024-12-18T00:45:02.5232624Z  2024-12-18T00:45:02.5233030Z  2024-12-18T00:45:02.5233436Z  2024-12-18T00:45:02.5233798Z  2024-12-18T00:45:02.5234188Z  2024-12-18T00:45:02.5234583Z  2024-12-18T00:45:02.5235529Z [10,941 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:02.5236780Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:02.5238017Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:45:02.5238948Z Compiling google/fft.cc; 16s local 2024-12-18T00:45:02.5239680Z Compiling src/common/memory_zero_pad.cpp; 4s local 2024-12-18T00:45:02.5240447Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:02.5241146Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:02.5241820Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:45:02.5242478Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:45:02.7235752Z 2024-12-18T00:45:02.7236644Z  2024-12-18T00:45:02.7237261Z  2024-12-18T00:45:02.7237633Z  2024-12-18T00:45:02.7238022Z  2024-12-18T00:45:02.7238444Z  2024-12-18T00:45:02.7238832Z  2024-12-18T00:45:02.7239186Z  2024-12-18T00:45:02.7239733Z  2024-12-18T00:45:02.7240619Z [10,943 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:02.7241808Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:02.7242957Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:45:02.7243808Z Compiling google/fft.cc; 17s local 2024-12-18T00:45:02.7245006Z Compiling src/common/memory_zero_pad.cpp; 4s local 2024-12-18T00:45:02.7245644Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:02.7246438Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:02.7247000Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:45:02.7247631Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:45:03.0765437Z 2024-12-18T00:45:03.0766633Z  2024-12-18T00:45:03.0767292Z  2024-12-18T00:45:03.0767947Z  2024-12-18T00:45:03.0769083Z  2024-12-18T00:45:03.0769931Z  2024-12-18T00:45:03.0770344Z  2024-12-18T00:45:03.0770746Z  2024-12-18T00:45:03.0771109Z  2024-12-18T00:45:03.0771987Z [10,948 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:03.0773185Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2024-12-18T00:45:03.0774254Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2024-12-18T00:45:03.0775210Z Compiling google/fft.cc; 17s local 2024-12-18T00:45:03.0775911Z Compiling src/common/memory_zero_pad.cpp; 4s local 2024-12-18T00:45:03.0776842Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:03.0777498Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:03.0778105Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:03.0778664Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:45:03.3240466Z 2024-12-18T00:45:03.3241882Z  2024-12-18T00:45:03.3242411Z  2024-12-18T00:45:03.3242820Z  2024-12-18T00:45:03.3243163Z  2024-12-18T00:45:03.3243506Z  2024-12-18T00:45:03.3243856Z  2024-12-18T00:45:03.3244495Z  2024-12-18T00:45:03.3244899Z  2024-12-18T00:45:03.3245805Z [10,952 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:03.3246948Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:45:03.3247879Z Compiling google/fft.cc; 17s local 2024-12-18T00:45:03.3248557Z Compiling src/common/memory_zero_pad.cpp; 4s local 2024-12-18T00:45:03.3249278Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:03.3249924Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:03.3250738Z Compiling llvm/lib/Support/TimeProfiler.cpp [for tool]; 2s local 2024-12-18T00:45:03.3251721Z Compiling llvm/lib/Support/Timer.cpp [for tool]; 2s local 2024-12-18T00:45:03.3252582Z Compiling src/common/primitive_attr.cpp; 2s local ... 2024-12-18T00:45:03.5267310Z 2024-12-18T00:45:03.5268708Z  2024-12-18T00:45:03.5269184Z  2024-12-18T00:45:03.5269577Z  2024-12-18T00:45:03.5269984Z  2024-12-18T00:45:03.5270345Z  2024-12-18T00:45:03.5270706Z  2024-12-18T00:45:03.5271064Z  2024-12-18T00:45:03.5271447Z  2024-12-18T00:45:03.5272368Z [10,955 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:03.5273608Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:45:03.5274530Z Compiling google/fft.cc; 17s local 2024-12-18T00:45:03.5275216Z Compiling src/common/memory_zero_pad.cpp; 5s local 2024-12-18T00:45:03.5275951Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:03.5276617Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:03.5277385Z Compiling llvm/lib/Support/TimeProfiler.cpp [for tool]; 2s local 2024-12-18T00:45:03.5278368Z Compiling llvm/lib/Support/Timer.cpp [for tool]; 2s local 2024-12-18T00:45:03.5279331Z Compiling src/cpp/client/generic_stub.cc; 2s local ... 2024-12-18T00:45:03.7531373Z 2024-12-18T00:45:03.7532451Z  2024-12-18T00:45:03.7533157Z  2024-12-18T00:45:03.7534647Z  2024-12-18T00:45:03.7535603Z  2024-12-18T00:45:03.7536062Z  2024-12-18T00:45:03.7536634Z  2024-12-18T00:45:03.7537324Z  2024-12-18T00:45:03.7537730Z  2024-12-18T00:45:03.7538690Z [10,959 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:03.7539992Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:45:03.7540931Z Compiling google/fft.cc; 18s local 2024-12-18T00:45:03.7541624Z Compiling src/common/memory_zero_pad.cpp; 5s local 2024-12-18T00:45:03.7542325Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:03.7543229Z Compiling llvm/lib/Support/TimeProfiler.cpp [for tool]; 3s local 2024-12-18T00:45:03.7544709Z Compiling llvm/lib/Support/Timer.cpp [for tool]; 3s local 2024-12-18T00:45:03.7545604Z Compiling src/cpp/client/generic_stub.cc; 2s local 2024-12-18T00:45:03.7546358Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:45:04.0436272Z 2024-12-18T00:45:04.0437230Z  2024-12-18T00:45:04.0437745Z  2024-12-18T00:45:04.0438165Z  2024-12-18T00:45:04.0438613Z  2024-12-18T00:45:04.0439025Z  2024-12-18T00:45:04.0439423Z  2024-12-18T00:45:04.0439828Z  2024-12-18T00:45:04.0440235Z  2024-12-18T00:45:04.0441203Z [10,962 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:04.0442467Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2024-12-18T00:45:04.0443410Z Compiling google/fft.cc; 18s local 2024-12-18T00:45:04.0444132Z Compiling src/common/memory_zero_pad.cpp; 5s local 2024-12-18T00:45:04.0445138Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:04.0445974Z Compiling llvm/lib/Support/TimeProfiler.cpp [for tool]; 3s local 2024-12-18T00:45:04.0446931Z Compiling src/cpp/client/generic_stub.cc; 2s local 2024-12-18T00:45:04.0447686Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:04.0448488Z Compiling src/common/primitive_cache.cpp; 2s local ... 2024-12-18T00:45:04.2835802Z 2024-12-18T00:45:04.2836790Z  2024-12-18T00:45:04.2837299Z  2024-12-18T00:45:04.2837699Z  2024-12-18T00:45:04.2838101Z  2024-12-18T00:45:04.2838525Z  2024-12-18T00:45:04.2838952Z  2024-12-18T00:45:04.2839373Z  2024-12-18T00:45:04.2839920Z  2024-12-18T00:45:04.2840887Z [10,965 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:04.2842144Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:45:04.2843114Z Compiling google/fft.cc; 18s local 2024-12-18T00:45:04.2843811Z Compiling src/common/memory_zero_pad.cpp; 5s local 2024-12-18T00:45:04.2844833Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:04.2845546Z Compiling src/cpp/client/generic_stub.cc; 3s local 2024-12-18T00:45:04.2846353Z Compiling src/common/primitive_cache.cpp; 2s local 2024-12-18T00:45:04.2847127Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:04.2847853Z Compiling src/common/concat.cpp; 2s local ... 2024-12-18T00:45:04.5017764Z 2024-12-18T00:45:04.5018745Z  2024-12-18T00:45:04.5019212Z  2024-12-18T00:45:04.5019636Z  2024-12-18T00:45:04.5020030Z  2024-12-18T00:45:04.5020453Z  2024-12-18T00:45:04.5020835Z  2024-12-18T00:45:04.5021354Z  2024-12-18T00:45:04.5021731Z  2024-12-18T00:45:04.5022626Z [10,972 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:04.5023771Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:45:04.5024613Z Compiling google/fft.cc; 18s local 2024-12-18T00:45:04.5025270Z Compiling src/common/memory_zero_pad.cpp; 6s local 2024-12-18T00:45:04.5025934Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:04.5026580Z Compiling src/cpp/client/generic_stub.cc; 3s local 2024-12-18T00:45:04.5027321Z Compiling src/common/primitive_cache.cpp; 3s local 2024-12-18T00:45:04.5028277Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:04.5028936Z Compiling src/common/concat.cpp; 2s local ... 2024-12-18T00:45:04.7040397Z 2024-12-18T00:45:04.7041201Z  2024-12-18T00:45:04.7041855Z  2024-12-18T00:45:04.7042223Z  2024-12-18T00:45:04.7042561Z  2024-12-18T00:45:04.7042917Z  2024-12-18T00:45:04.7043288Z  2024-12-18T00:45:04.7043645Z  2024-12-18T00:45:04.7043993Z  2024-12-18T00:45:04.7045378Z [10,979 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:04.7046570Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:45:04.7047374Z Compiling google/fft.cc; 18s local 2024-12-18T00:45:04.7047964Z Compiling src/common/memory_zero_pad.cpp; 6s local 2024-12-18T00:45:04.7048561Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:04.7049123Z Compiling src/cpp/client/generic_stub.cc; 3s local 2024-12-18T00:45:04.7049763Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:04.7050363Z Compiling src/common/concat.cpp; 2s local 2024-12-18T00:45:04.7050963Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:45:04.9108185Z 2024-12-18T00:45:04.9109020Z  2024-12-18T00:45:04.9109494Z  2024-12-18T00:45:04.9109898Z  2024-12-18T00:45:04.9110316Z  2024-12-18T00:45:04.9110682Z  2024-12-18T00:45:04.9111063Z  2024-12-18T00:45:04.9111434Z  2024-12-18T00:45:04.9111820Z  2024-12-18T00:45:04.9112733Z [10,984 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:04.9113936Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:45:04.9114854Z Compiling google/fft.cc; 19s local 2024-12-18T00:45:04.9115544Z Compiling src/common/memory_zero_pad.cpp; 6s local 2024-12-18T00:45:04.9116232Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:04.9116868Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:04.9117523Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:04.9118216Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:04.9118987Z Compiling src/common/primitive_iface.cpp; 2s local ... 2024-12-18T00:45:05.1166970Z 2024-12-18T00:45:05.1167837Z  2024-12-18T00:45:05.1168343Z  2024-12-18T00:45:05.1168755Z  2024-12-18T00:45:05.1169173Z  2024-12-18T00:45:05.1169596Z  2024-12-18T00:45:05.1170010Z  2024-12-18T00:45:05.1170423Z  2024-12-18T00:45:05.1170890Z  2024-12-18T00:45:05.1171866Z [10,991 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:05.1173129Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2024-12-18T00:45:05.1174015Z Compiling google/fft.cc; 19s local 2024-12-18T00:45:05.1174732Z Compiling src/common/memory_zero_pad.cpp; 6s local 2024-12-18T00:45:05.1175433Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:05.1176045Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:05.1176870Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:45:05.1177525Z @com_google_protobuf//:protoc_lib; 2s local 2024-12-18T00:45:05.1178162Z @com_google_protobuf//:protoc_lib; 2s local ... 2024-12-18T00:45:05.3255273Z 2024-12-18T00:45:05.3256127Z  2024-12-18T00:45:05.3256740Z  2024-12-18T00:45:05.3257120Z  2024-12-18T00:45:05.3257511Z  2024-12-18T00:45:05.3257906Z  2024-12-18T00:45:05.3258341Z  2024-12-18T00:45:05.3258730Z  2024-12-18T00:45:05.3259119Z  2024-12-18T00:45:05.3260073Z [10,996 / 20,600] 1 / 17 tests; 47 actions running; last test: ...e:cache_test 2024-12-18T00:45:05.3261310Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:05.3262233Z Compiling google/fft.cc; 19s local 2024-12-18T00:45:05.3263163Z Compiling src/common/memory_zero_pad.cpp; 6s local 2024-12-18T00:45:05.3263849Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:05.3264963Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:05.3265916Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:05.3266780Z Compiling src/graph/interface/partition_impl.cpp; 2s local 2024-12-18T00:45:05.3267678Z @onednn//:onednn_autogen; 2s local ... 2024-12-18T00:45:05.7259980Z 2024-12-18T00:45:05.7260869Z  2024-12-18T00:45:05.7261349Z  2024-12-18T00:45:05.7261758Z  2024-12-18T00:45:05.7262634Z  2024-12-18T00:45:05.7263035Z  2024-12-18T00:45:05.7263446Z  2024-12-18T00:45:05.7263869Z  2024-12-18T00:45:05.7264287Z  2024-12-18T00:45:05.7265226Z [11,001 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:05.7266490Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:05.7267481Z Compiling google/fft.cc; 20s local 2024-12-18T00:45:05.7268206Z Compiling src/common/memory_zero_pad.cpp; 7s local 2024-12-18T00:45:05.7268943Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:05.7269579Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:05.7270195Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:05.7270819Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:45:05.7271633Z Compiling src/google/protobuf/extension_set.cc; 2s local ... 2024-12-18T00:45:05.9267540Z 2024-12-18T00:45:05.9268313Z  2024-12-18T00:45:05.9268746Z  2024-12-18T00:45:05.9269069Z  2024-12-18T00:45:05.9269371Z  2024-12-18T00:45:05.9269688Z  2024-12-18T00:45:05.9270000Z  2024-12-18T00:45:05.9270311Z  2024-12-18T00:45:05.9270605Z  2024-12-18T00:45:05.9271343Z [11,005 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:05.9272260Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:05.9272983Z Compiling google/fft.cc; 20s local 2024-12-18T00:45:05.9273524Z Compiling src/common/memory_zero_pad.cpp; 7s local 2024-12-18T00:45:05.9274089Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:05.9274572Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:05.9275041Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:05.9275518Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:05.9276124Z Compiling src/google/protobuf/extension_set.cc; 3s local ... 2024-12-18T00:45:06.1276033Z 2024-12-18T00:45:06.1276541Z  2024-12-18T00:45:06.1277071Z  2024-12-18T00:45:06.1277588Z  2024-12-18T00:45:06.1278114Z  2024-12-18T00:45:06.1278614Z  2024-12-18T00:45:06.1279122Z  2024-12-18T00:45:06.1279643Z  2024-12-18T00:45:06.1280150Z  2024-12-18T00:45:06.1281152Z [11,008 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:06.1282632Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2024-12-18T00:45:06.1283656Z Compiling google/fft.cc; 20s local 2024-12-18T00:45:06.1284473Z Compiling src/common/memory_zero_pad.cpp; 7s local 2024-12-18T00:45:06.1293704Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:06.1294419Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:06.1295107Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:06.1295793Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:06.1296824Z Compiling src/google/protobuf/extension_set.cc; 3s local ... 2024-12-18T00:45:06.3547009Z 2024-12-18T00:45:06.3547973Z  2024-12-18T00:45:06.3549589Z  2024-12-18T00:45:06.3550060Z  2024-12-18T00:45:06.3550439Z  2024-12-18T00:45:06.3550851Z  2024-12-18T00:45:06.3551261Z  2024-12-18T00:45:06.3551673Z  2024-12-18T00:45:06.3552098Z  2024-12-18T00:45:06.3553115Z [11,010 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:06.3554659Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:06.3555770Z Compiling google/fft.cc; 20s local 2024-12-18T00:45:06.3556505Z Compiling src/common/memory_zero_pad.cpp; 7s local 2024-12-18T00:45:06.3557251Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:06.3557855Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:06.3558472Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:06.3559217Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:06.3560111Z Compiling src/google/protobuf/extension_set.cc; 3s local ... 2024-12-18T00:45:06.7281161Z 2024-12-18T00:45:06.7282041Z  2024-12-18T00:45:06.7282526Z  2024-12-18T00:45:06.7282940Z  2024-12-18T00:45:06.7283326Z  2024-12-18T00:45:06.7283697Z  2024-12-18T00:45:06.7284121Z  2024-12-18T00:45:06.7284617Z  2024-12-18T00:45:06.7285114Z  2024-12-18T00:45:06.7286136Z [11,013 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:06.7287338Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:06.7288178Z Compiling google/fft.cc; 21s local 2024-12-18T00:45:06.7288814Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:45:06.7289660Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:06.7290285Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:06.7290893Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:06.7291623Z Compiling src/google/protobuf/extension_set.cc; 3s local 2024-12-18T00:45:06.7292564Z Compiling src/google/protobuf/extension_set.cc [for tool]; 3s local ... 2024-12-18T00:45:06.9286036Z 2024-12-18T00:45:06.9286853Z  2024-12-18T00:45:06.9287335Z  2024-12-18T00:45:06.9287743Z  2024-12-18T00:45:06.9288165Z  2024-12-18T00:45:06.9288711Z  2024-12-18T00:45:06.9289164Z  2024-12-18T00:45:06.9289524Z  2024-12-18T00:45:06.9289853Z  2024-12-18T00:45:06.9290796Z [11,017 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:06.9292040Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:06.9292947Z Compiling google/fft.cc; 21s local 2024-12-18T00:45:06.9293661Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:45:06.9294396Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:06.9295039Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:06.9295656Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:06.9296577Z Compiling src/google/protobuf/extension_set.cc; 4s local 2024-12-18T00:45:06.9297664Z Compiling src/google/protobuf/extension_set.cc [for tool]; 3s local ... 2024-12-18T00:45:07.1298254Z 2024-12-18T00:45:07.1299001Z  2024-12-18T00:45:07.1299466Z  2024-12-18T00:45:07.1299883Z  2024-12-18T00:45:07.1300267Z  2024-12-18T00:45:07.1300661Z  2024-12-18T00:45:07.1301002Z  2024-12-18T00:45:07.1301368Z  2024-12-18T00:45:07.1301743Z  2024-12-18T00:45:07.1302612Z [11,024 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:07.1303742Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2024-12-18T00:45:07.1304561Z Compiling google/fft.cc; 21s local 2024-12-18T00:45:07.1305223Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:45:07.1305917Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.1306460Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.1307103Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.1307913Z Compiling src/google/protobuf/extension_set.cc [for tool]; 4s local 2024-12-18T00:45:07.1308776Z Compiling src/common/rnn.cpp; 3s local ... 2024-12-18T00:45:07.4406556Z 2024-12-18T00:45:07.4407881Z  2024-12-18T00:45:07.4408355Z  2024-12-18T00:45:07.4408696Z  2024-12-18T00:45:07.4409104Z  2024-12-18T00:45:07.4409611Z  2024-12-18T00:45:07.4409985Z  2024-12-18T00:45:07.4410545Z  2024-12-18T00:45:07.4410944Z  2024-12-18T00:45:07.4411834Z [11,035 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:07.4413016Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:07.4413882Z Compiling google/fft.cc; 21s local 2024-12-18T00:45:07.4414773Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:45:07.4415583Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:07.4416142Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.4416844Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.4417351Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:07.4418067Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:45:07.7085233Z 2024-12-18T00:45:07.7086150Z  2024-12-18T00:45:07.7086668Z  2024-12-18T00:45:07.7087124Z  2024-12-18T00:45:07.7087514Z  2024-12-18T00:45:07.7087901Z  2024-12-18T00:45:07.7088320Z  2024-12-18T00:45:07.7088717Z  2024-12-18T00:45:07.7089056Z  2024-12-18T00:45:07.7090120Z [11,038 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:07.7091274Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:07.7092307Z Compiling google/fft.cc; 21s local 2024-12-18T00:45:07.7092945Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:45:07.7093716Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:07.7094418Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:07.7095071Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.7095616Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.7096210Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:45:07.9293486Z 2024-12-18T00:45:07.9294372Z  2024-12-18T00:45:07.9294843Z  2024-12-18T00:45:07.9295254Z  2024-12-18T00:45:07.9295642Z  2024-12-18T00:45:07.9296074Z  2024-12-18T00:45:07.9296603Z  2024-12-18T00:45:07.9297037Z  2024-12-18T00:45:07.9297439Z  2024-12-18T00:45:07.9298347Z [11,041 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:07.9299569Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2024-12-18T00:45:07.9300484Z Compiling google/fft.cc; 22s local 2024-12-18T00:45:07.9301147Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:45:07.9301837Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:07.9302419Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:07.9303000Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:07.9303741Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:07.9304322Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:45:08.1758051Z 2024-12-18T00:45:08.1758882Z  2024-12-18T00:45:08.1759325Z  2024-12-18T00:45:08.1759868Z  2024-12-18T00:45:08.1760358Z  2024-12-18T00:45:08.1760715Z  2024-12-18T00:45:08.1761217Z  2024-12-18T00:45:08.1761584Z  2024-12-18T00:45:08.1761951Z  2024-12-18T00:45:08.1762949Z [11,046 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:08.1764068Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2024-12-18T00:45:08.1765001Z Compiling google/fft.cc; 22s local 2024-12-18T00:45:08.1765630Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:45:08.1766292Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:08.1766869Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:08.1767419Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:08.1768285Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:08.1769072Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:45:08.4595763Z 2024-12-18T00:45:08.4596612Z  2024-12-18T00:45:08.4597299Z  2024-12-18T00:45:08.4597711Z  2024-12-18T00:45:08.4598106Z  2024-12-18T00:45:08.4598458Z  2024-12-18T00:45:08.4598797Z  2024-12-18T00:45:08.4599159Z  2024-12-18T00:45:08.4599499Z  2024-12-18T00:45:08.4600558Z [11,050 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:08.4601784Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2024-12-18T00:45:08.4602651Z Compiling google/fft.cc; 22s local 2024-12-18T00:45:08.4603333Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:08.4603995Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:08.4604573Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:08.4605200Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:08.4605770Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:08.4606436Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:45:08.6954401Z 2024-12-18T00:45:08.6955331Z  2024-12-18T00:45:08.6955812Z  2024-12-18T00:45:08.6956214Z  2024-12-18T00:45:08.6956611Z  2024-12-18T00:45:08.6957014Z  2024-12-18T00:45:08.6957398Z  2024-12-18T00:45:08.6957793Z  2024-12-18T00:45:08.6958188Z  2024-12-18T00:45:08.6959261Z [11,058 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:08.6960412Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2024-12-18T00:45:08.6961277Z Compiling google/fft.cc; 22s local 2024-12-18T00:45:08.6961912Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:08.6962536Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:08.6963112Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:08.6963708Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:08.6964371Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:08.6965024Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:45:08.9305328Z 2024-12-18T00:45:08.9306148Z  2024-12-18T00:45:08.9306640Z  2024-12-18T00:45:08.9307065Z  2024-12-18T00:45:08.9307474Z  2024-12-18T00:45:08.9307862Z  2024-12-18T00:45:08.9308275Z  2024-12-18T00:45:08.9308673Z  2024-12-18T00:45:08.9309119Z  2024-12-18T00:45:08.9310096Z [11,061 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:08.9311352Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2024-12-18T00:45:08.9312306Z Compiling google/fft.cc; 23s local 2024-12-18T00:45:08.9313043Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:08.9313776Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:08.9314391Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:08.9315048Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:08.9315757Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:08.9316486Z @com_google_protobuf//:protoc_lib; 3s local ... 2024-12-18T00:45:09.1542762Z 2024-12-18T00:45:09.1543649Z  2024-12-18T00:45:09.1544109Z  2024-12-18T00:45:09.1544657Z  2024-12-18T00:45:09.1544985Z  2024-12-18T00:45:09.1545319Z  2024-12-18T00:45:09.1545711Z  2024-12-18T00:45:09.1546046Z  2024-12-18T00:45:09.1546379Z  2024-12-18T00:45:09.1547174Z [11,065 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:09.1547955Z Compiling google/fft.cc; 23s local 2024-12-18T00:45:09.1548522Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:09.1549127Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:09.1549891Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:09.1550429Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:09.1551164Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:09.1551826Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:09.1552452Z @onednn//:onednn_autogen; 2s local ... 2024-12-18T00:45:09.4089108Z 2024-12-18T00:45:09.4090028Z  2024-12-18T00:45:09.4090503Z  2024-12-18T00:45:09.4090892Z  2024-12-18T00:45:09.4091252Z  2024-12-18T00:45:09.4091971Z  2024-12-18T00:45:09.4092354Z  2024-12-18T00:45:09.4092740Z  2024-12-18T00:45:09.4093131Z  2024-12-18T00:45:09.4094049Z [11,067 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:09.4094979Z Compiling google/fft.cc; 23s local 2024-12-18T00:45:09.4095645Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:09.4096346Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:09.4097084Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:09.4097700Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:09.4098342Z @com_google_protobuf//:protoc_lib; 3s local 2024-12-18T00:45:09.4098976Z @onednn//:onednn_autogen; 2s local 2024-12-18T00:45:09.4099586Z Compiling src/cpu/bfloat16.cpp; 2s local ... 2024-12-18T00:45:09.6282682Z 2024-12-18T00:45:09.6283490Z  2024-12-18T00:45:09.6283974Z  2024-12-18T00:45:09.6284392Z  2024-12-18T00:45:09.6284833Z  2024-12-18T00:45:09.6285251Z  2024-12-18T00:45:09.6285665Z  2024-12-18T00:45:09.6286077Z  2024-12-18T00:45:09.6286488Z  2024-12-18T00:45:09.6287493Z [11,072 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:09.6288424Z Compiling google/fft.cc; 23s local 2024-12-18T00:45:09.6289067Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:09.6289682Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:09.6290251Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:09.6290849Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:09.6291488Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:09.6292232Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:09.6292883Z Compiling src/cpu/bfloat16.cpp; 3s local ... 2024-12-18T00:45:09.8291434Z 2024-12-18T00:45:09.8292361Z  2024-12-18T00:45:09.8292931Z  2024-12-18T00:45:09.8293335Z  2024-12-18T00:45:09.8293715Z  2024-12-18T00:45:09.8294122Z  2024-12-18T00:45:09.8294514Z  2024-12-18T00:45:09.8294882Z  2024-12-18T00:45:09.8295257Z  2024-12-18T00:45:09.8296152Z [11,074 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:09.8297407Z Compiling google/fft.cc; 24s local 2024-12-18T00:45:09.8298114Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:09.8298794Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:09.8299375Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:09.8299974Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:09.8300607Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:09.8301176Z Compiling src/cpu/bfloat16.cpp; 3s local 2024-12-18T00:45:09.8301968Z Compiling src/common/verbose.cpp; 3s local ... 2024-12-18T00:45:10.0415922Z 2024-12-18T00:45:10.0416974Z  2024-12-18T00:45:10.0417520Z  2024-12-18T00:45:10.0417908Z  2024-12-18T00:45:10.0418291Z  2024-12-18T00:45:10.0418687Z  2024-12-18T00:45:10.0419064Z  2024-12-18T00:45:10.0419444Z  2024-12-18T00:45:10.0419814Z  2024-12-18T00:45:10.0420732Z [11,078 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:10.0421582Z Compiling google/fft.cc; 24s local 2024-12-18T00:45:10.0422515Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:10.0423171Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:10.0423746Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:10.0424473Z @com_google_protobuf//:protoc_lib; 4s local 2024-12-18T00:45:10.0425082Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:10.0425660Z Compiling src/cpu/bfloat16.cpp; 3s local 2024-12-18T00:45:10.0426311Z Compiling src/common/verbose.cpp; 3s local ... 2024-12-18T00:45:10.2436438Z 2024-12-18T00:45:10.2437279Z  2024-12-18T00:45:10.2438287Z  2024-12-18T00:45:10.2438679Z  2024-12-18T00:45:10.2439038Z  2024-12-18T00:45:10.2439417Z  2024-12-18T00:45:10.2439787Z  2024-12-18T00:45:10.2440174Z  2024-12-18T00:45:10.2440539Z  2024-12-18T00:45:10.2441453Z [11,080 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:10.2442370Z Compiling google/fft.cc; 24s local 2024-12-18T00:45:10.2443039Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:10.2443688Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:10.2444597Z @com_google_protobuf//:protoc_lib; 5s local 2024-12-18T00:45:10.2445229Z @onednn//:onednn_autogen; 3s local 2024-12-18T00:45:10.2445814Z Compiling src/cpu/bfloat16.cpp; 3s local 2024-12-18T00:45:10.2446439Z Compiling src/common/verbose.cpp; 3s local 2024-12-18T00:45:10.2447247Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 3s local ... 2024-12-18T00:45:10.4898934Z 2024-12-18T00:45:10.4899783Z  2024-12-18T00:45:10.4900232Z  2024-12-18T00:45:10.4900635Z  2024-12-18T00:45:10.4901019Z  2024-12-18T00:45:10.4901435Z  2024-12-18T00:45:10.4901859Z  2024-12-18T00:45:10.4902272Z  2024-12-18T00:45:10.4902683Z  2024-12-18T00:45:10.4903601Z [11,087 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:10.4904452Z Compiling google/fft.cc; 24s local 2024-12-18T00:45:10.4905093Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:45:10.4905744Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:10.4906284Z Compiling src/cpu/bfloat16.cpp; 4s local 2024-12-18T00:45:10.4906883Z Compiling src/common/verbose.cpp; 3s local 2024-12-18T00:45:10.4907662Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 3s local 2024-12-18T00:45:10.4908532Z Compiling src/common/memory_desc_wrapper.cpp; 3s local 2024-12-18T00:45:10.4909684Z Compiling src/google/protobuf/compiler/parser.cc [for tool]; 3s local ... 2024-12-18T00:45:10.7228967Z 2024-12-18T00:45:10.7229799Z  2024-12-18T00:45:10.7230264Z  2024-12-18T00:45:10.7230665Z  2024-12-18T00:45:10.7231038Z  2024-12-18T00:45:10.7231408Z  2024-12-18T00:45:10.7231807Z  2024-12-18T00:45:10.7232210Z  2024-12-18T00:45:10.7232600Z  2024-12-18T00:45:10.7233518Z [11,089 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:10.7234430Z Compiling google/fft.cc; 25s local 2024-12-18T00:45:10.7235143Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:45:10.7235840Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:10.7236479Z Compiling src/cpu/bfloat16.cpp; 4s local 2024-12-18T00:45:10.7237124Z Compiling src/common/verbose.cpp; 4s local 2024-12-18T00:45:10.7237933Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 3s local 2024-12-18T00:45:10.7238879Z Compiling src/common/memory_desc_wrapper.cpp; 3s local 2024-12-18T00:45:10.7239889Z Compiling src/google/protobuf/compiler/parser.cc [for tool]; 3s local ... 2024-12-18T00:45:10.9316055Z 2024-12-18T00:45:10.9316956Z  2024-12-18T00:45:10.9317375Z  2024-12-18T00:45:10.9317730Z  2024-12-18T00:45:10.9318088Z  2024-12-18T00:45:10.9318455Z  2024-12-18T00:45:10.9319112Z  2024-12-18T00:45:10.9319489Z  2024-12-18T00:45:10.9319894Z  2024-12-18T00:45:10.9320740Z [11,096 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:10.9321824Z Compiling google/fft.cc; 25s local 2024-12-18T00:45:10.9322469Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:45:10.9323165Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:10.9323741Z Compiling src/cpu/bfloat16.cpp; 4s local 2024-12-18T00:45:10.9324477Z Compiling src/common/verbose.cpp; 4s local 2024-12-18T00:45:10.9325341Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 4s local 2024-12-18T00:45:10.9326169Z Compiling src/common/memory_desc_wrapper.cpp; 3s local 2024-12-18T00:45:10.9327103Z Compiling src/google/protobuf/compiler/parser.cc [for tool]; 3s local ... 2024-12-18T00:45:11.1671606Z 2024-12-18T00:45:11.1672446Z  2024-12-18T00:45:11.1672915Z  2024-12-18T00:45:11.1673375Z  2024-12-18T00:45:11.1673744Z  2024-12-18T00:45:11.1674146Z  2024-12-18T00:45:11.1674537Z  2024-12-18T00:45:11.1674951Z  2024-12-18T00:45:11.1675363Z  2024-12-18T00:45:11.1676292Z [11,100 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:11.1677191Z Compiling google/fft.cc; 25s local 2024-12-18T00:45:11.1677880Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:45:11.1678527Z @onednn//:onednn_autogen; 4s local 2024-12-18T00:45:11.1679160Z Compiling src/cpu/bfloat16.cpp; 4s local 2024-12-18T00:45:11.1679831Z Compiling src/common/verbose.cpp; 4s local 2024-12-18T00:45:11.1680608Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 4s local 2024-12-18T00:45:11.1681468Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:11.1682555Z Compiling src/google/protobuf/compiler/parser.cc [for tool]; 3s local ... 2024-12-18T00:45:11.5322384Z 2024-12-18T00:45:11.5323243Z  2024-12-18T00:45:11.5323709Z  2024-12-18T00:45:11.5324124Z  2024-12-18T00:45:11.5324503Z  2024-12-18T00:45:11.5324899Z  2024-12-18T00:45:11.5325259Z  2024-12-18T00:45:11.5325660Z  2024-12-18T00:45:11.5326027Z  2024-12-18T00:45:11.5326908Z [11,102 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:11.5327855Z Compiling google/fft.cc; 25s local 2024-12-18T00:45:11.5328510Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:11.5329214Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:11.5329974Z Compiling src/cpu/bfloat16.cpp; 5s local 2024-12-18T00:45:11.5330633Z Compiling src/common/verbose.cpp; 5s local 2024-12-18T00:45:11.5331475Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 4s local 2024-12-18T00:45:11.5332364Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:11.5333379Z Compiling src/google/protobuf/compiler/parser.cc [for tool]; 4s local ... 2024-12-18T00:45:11.8365800Z 2024-12-18T00:45:11.8366660Z  2024-12-18T00:45:11.8367154Z  2024-12-18T00:45:11.8367544Z  2024-12-18T00:45:11.8367984Z  2024-12-18T00:45:11.8368392Z  2024-12-18T00:45:11.8368812Z  2024-12-18T00:45:11.8369225Z  2024-12-18T00:45:11.8369648Z  2024-12-18T00:45:11.8370584Z [11,105 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:11.8371561Z Compiling google/fft.cc; 26s local 2024-12-18T00:45:11.8372309Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:11.8373057Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:11.8373656Z Compiling src/cpu/bfloat16.cpp; 5s local 2024-12-18T00:45:11.8374286Z Compiling src/common/verbose.cpp; 5s local 2024-12-18T00:45:11.8375067Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2024-12-18T00:45:11.8376249Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:11.8377321Z Compiling src/google/protobuf/compiler/parser.cc [for tool]; 4s local ... 2024-12-18T00:45:12.0659936Z 2024-12-18T00:45:12.0661054Z  2024-12-18T00:45:12.0661615Z  2024-12-18T00:45:12.0662050Z  2024-12-18T00:45:12.0662503Z  2024-12-18T00:45:12.0662922Z  2024-12-18T00:45:12.0663345Z  2024-12-18T00:45:12.0663770Z  2024-12-18T00:45:12.0664184Z  2024-12-18T00:45:12.0665376Z [11,108 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:12.0666529Z Compiling google/fft.cc; 26s local 2024-12-18T00:45:12.0667307Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:12.0668044Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:12.0668684Z Compiling src/cpu/bfloat16.cpp; 5s local 2024-12-18T00:45:12.0669424Z Compiling src/common/verbose.cpp; 5s local 2024-12-18T00:45:12.0670337Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2024-12-18T00:45:12.0671364Z Compiling src/common/memory_desc_wrapper.cpp; 4s local 2024-12-18T00:45:12.0672154Z Compiling src/cpu/cpu_binary_list.cpp; 4s local ... 2024-12-18T00:45:12.3329821Z 2024-12-18T00:45:12.3330766Z  2024-12-18T00:45:12.3331235Z  2024-12-18T00:45:12.3331633Z  2024-12-18T00:45:12.3332009Z  2024-12-18T00:45:12.3332403Z  2024-12-18T00:45:12.3332763Z  2024-12-18T00:45:12.3333135Z  2024-12-18T00:45:12.3333519Z  2024-12-18T00:45:12.3334460Z [11,112 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:12.3335349Z Compiling google/fft.cc; 26s local 2024-12-18T00:45:12.3336010Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:12.3336955Z Compiling src/cpu/bfloat16.cpp; 5s local 2024-12-18T00:45:12.3337634Z Compiling src/common/verbose.cpp; 5s local 2024-12-18T00:45:12.3338436Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2024-12-18T00:45:12.3339260Z Compiling src/cpu/cpu_binary_list.cpp; 5s local 2024-12-18T00:45:12.3339975Z Compiling src/cpu/cpu_concat.cpp; 5s local 2024-12-18T00:45:12.3340819Z Compiling src/google/protobuf/descriptor.cc [for tool]; 5s local ... 2024-12-18T00:45:12.5333986Z 2024-12-18T00:45:12.5334880Z  2024-12-18T00:45:12.5335342Z  2024-12-18T00:45:12.5335736Z  2024-12-18T00:45:12.5336145Z  2024-12-18T00:45:12.5336659Z  2024-12-18T00:45:12.5337119Z  2024-12-18T00:45:12.5337499Z  2024-12-18T00:45:12.5337892Z  2024-12-18T00:45:12.5338781Z [11,114 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:12.5339799Z Compiling google/fft.cc; 26s local 2024-12-18T00:45:12.5340377Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:12.5341054Z Compiling src/cpu/bfloat16.cpp; 6s local 2024-12-18T00:45:12.5341681Z Compiling src/common/verbose.cpp; 6s local 2024-12-18T00:45:12.5342415Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2024-12-18T00:45:12.5343216Z Compiling src/cpu/cpu_binary_list.cpp; 5s local 2024-12-18T00:45:12.5343962Z Compiling src/cpu/cpu_concat.cpp; 5s local 2024-12-18T00:45:12.5350176Z Compiling src/google/protobuf/descriptor.cc [for tool]; 5s local ... 2024-12-18T00:45:12.7400327Z 2024-12-18T00:45:12.7401207Z  2024-12-18T00:45:12.7401696Z  2024-12-18T00:45:12.7402138Z  2024-12-18T00:45:12.7402699Z  2024-12-18T00:45:12.7403105Z  2024-12-18T00:45:12.7403497Z  2024-12-18T00:45:12.7403908Z  2024-12-18T00:45:12.7404320Z  2024-12-18T00:45:12.7405293Z [11,122 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:12.7406276Z Compiling google/fft.cc; 27s local 2024-12-18T00:45:12.7406985Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:12.7408212Z Compiling src/cpu/bfloat16.cpp; 6s local 2024-12-18T00:45:12.7408918Z Compiling src/common/verbose.cpp; 6s local 2024-12-18T00:45:12.7409867Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2024-12-18T00:45:12.7410758Z Compiling src/cpu/cpu_concat.cpp; 5s local 2024-12-18T00:45:12.7411798Z Compiling src/google/protobuf/descriptor.cc [for tool]; 5s local 2024-12-18T00:45:12.7412832Z Compiling src/cpu/cpu_convolution_list.cpp; 5s local ... 2024-12-18T00:45:12.9864933Z 2024-12-18T00:45:12.9866108Z  2024-12-18T00:45:12.9866650Z  2024-12-18T00:45:12.9867072Z  2024-12-18T00:45:12.9867511Z  2024-12-18T00:45:12.9867920Z  2024-12-18T00:45:12.9868331Z  2024-12-18T00:45:12.9868761Z  2024-12-18T00:45:12.9869178Z  2024-12-18T00:45:12.9870133Z [11,125 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:12.9871139Z Compiling google/fft.cc; 27s local 2024-12-18T00:45:12.9871858Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:12.9872580Z Compiling src/cpu/bfloat16.cpp; 6s local 2024-12-18T00:45:12.9873260Z Compiling src/common/verbose.cpp; 6s local 2024-12-18T00:45:12.9874088Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2024-12-18T00:45:12.9874956Z Compiling src/cpu/cpu_concat.cpp; 5s local 2024-12-18T00:45:12.9875843Z Compiling src/google/protobuf/descriptor.cc [for tool]; 5s local 2024-12-18T00:45:12.9876864Z Compiling src/cpu/cpu_convolution_list.cpp; 5s local ... 2024-12-18T00:45:13.2247087Z 2024-12-18T00:45:13.2247975Z  2024-12-18T00:45:13.2248441Z  2024-12-18T00:45:13.2248817Z  2024-12-18T00:45:13.2249199Z  2024-12-18T00:45:13.2249611Z  2024-12-18T00:45:13.2249984Z  2024-12-18T00:45:13.2250391Z  2024-12-18T00:45:13.2250784Z  2024-12-18T00:45:13.2251763Z [11,128 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:13.2252714Z Compiling google/fft.cc; 27s local 2024-12-18T00:45:13.2253438Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:13.2254203Z Compiling src/common/verbose.cpp; 6s local 2024-12-18T00:45:13.2254968Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2024-12-18T00:45:13.2255799Z Compiling src/cpu/cpu_concat.cpp; 5s local 2024-12-18T00:45:13.2256815Z Compiling src/google/protobuf/descriptor.cc [for tool]; 5s local 2024-12-18T00:45:13.2257780Z Compiling src/cpu/cpu_convolution_list.cpp; 5s local 2024-12-18T00:45:13.2258657Z Compiling src/cpu/cpu_deconvolution_list.cpp; 5s local ... 2024-12-18T00:45:13.4701234Z 2024-12-18T00:45:13.4702079Z  2024-12-18T00:45:13.4702541Z  2024-12-18T00:45:13.4702932Z  2024-12-18T00:45:13.4703343Z  2024-12-18T00:45:13.4703739Z  2024-12-18T00:45:13.4704172Z  2024-12-18T00:45:13.4704585Z  2024-12-18T00:45:13.4704979Z  2024-12-18T00:45:13.4705911Z [11,132 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:13.4706864Z Compiling google/fft.cc; 27s local 2024-12-18T00:45:13.4707596Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:13.4708339Z Compiling src/common/verbose.cpp; 6s local 2024-12-18T00:45:13.4709162Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2024-12-18T00:45:13.4710001Z Compiling src/cpu/cpu_concat.cpp; 6s local 2024-12-18T00:45:13.4710874Z Compiling src/google/protobuf/descriptor.cc [for tool]; 6s local 2024-12-18T00:45:13.4711789Z Compiling src/cpu/cpu_convolution_list.cpp; 6s local 2024-12-18T00:45:13.4712672Z Compiling src/cpu/cpu_deconvolution_list.cpp; 6s local ... 2024-12-18T00:45:13.7345168Z 2024-12-18T00:45:13.7346071Z  2024-12-18T00:45:13.7346508Z  2024-12-18T00:45:13.7347149Z  2024-12-18T00:45:13.7347499Z  2024-12-18T00:45:13.7347891Z  2024-12-18T00:45:13.7348265Z  2024-12-18T00:45:13.7348644Z  2024-12-18T00:45:13.7349030Z  2024-12-18T00:45:13.7350135Z [11,135 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:13.7351041Z Compiling google/fft.cc; 28s local 2024-12-18T00:45:13.7351679Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:13.7352353Z Compiling src/common/verbose.cpp; 7s local 2024-12-18T00:45:13.7353281Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2024-12-18T00:45:13.7354004Z Compiling src/cpu/cpu_concat.cpp; 6s local 2024-12-18T00:45:13.7354783Z Compiling src/google/protobuf/descriptor.cc [for tool]; 6s local 2024-12-18T00:45:13.7355706Z Compiling src/cpu/cpu_convolution_list.cpp; 6s local 2024-12-18T00:45:13.7356570Z Compiling src/cpu/cpu_deconvolution_list.cpp; 6s local ... 2024-12-18T00:45:14.1348105Z 2024-12-18T00:45:14.1348920Z  2024-12-18T00:45:14.1349379Z  2024-12-18T00:45:14.1349780Z  2024-12-18T00:45:14.1350162Z  2024-12-18T00:45:14.1350553Z  2024-12-18T00:45:14.1350982Z  2024-12-18T00:45:14.1351361Z  2024-12-18T00:45:14.1351724Z  2024-12-18T00:45:14.1352632Z [11,139 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:14.1353542Z Compiling google/fft.cc; 28s local 2024-12-18T00:45:14.1354182Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:14.1354902Z Compiling src/common/verbose.cpp; 7s local 2024-12-18T00:45:14.1355690Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local 2024-12-18T00:45:14.1356587Z Compiling src/cpu/cpu_concat.cpp; 6s local 2024-12-18T00:45:14.1357423Z Compiling src/google/protobuf/descriptor.cc [for tool]; 6s local 2024-12-18T00:45:14.1358351Z Compiling src/cpu/cpu_convolution_list.cpp; 6s local 2024-12-18T00:45:14.1359197Z Compiling src/cpu/cpu_deconvolution_list.cpp; 6s local ... 2024-12-18T00:45:14.3352794Z 2024-12-18T00:45:14.3353755Z  2024-12-18T00:45:14.3354264Z  2024-12-18T00:45:14.3354702Z  2024-12-18T00:45:14.3355112Z  2024-12-18T00:45:14.3355466Z  2024-12-18T00:45:14.3355853Z  2024-12-18T00:45:14.3356251Z  2024-12-18T00:45:14.3356657Z  2024-12-18T00:45:14.3357638Z [11,140 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:14.3358625Z Compiling google/fft.cc; 28s local 2024-12-18T00:45:14.3359296Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:14.3360029Z Compiling src/common/verbose.cpp; 7s local 2024-12-18T00:45:14.3360838Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local 2024-12-18T00:45:14.3361809Z Compiling src/cpu/cpu_concat.cpp; 7s local 2024-12-18T00:45:14.3362701Z Compiling src/google/protobuf/descriptor.cc [for tool]; 7s local 2024-12-18T00:45:14.3363671Z Compiling src/cpu/cpu_convolution_list.cpp; 7s local 2024-12-18T00:45:14.3364494Z Compiling src/cpu/cpu_deconvolution_list.cpp; 6s local ... 2024-12-18T00:45:14.5873105Z 2024-12-18T00:45:14.5874127Z  2024-12-18T00:45:14.5874595Z  2024-12-18T00:45:14.5875030Z  2024-12-18T00:45:14.5875385Z  2024-12-18T00:45:14.5875788Z  2024-12-18T00:45:14.5876215Z  2024-12-18T00:45:14.5876621Z  2024-12-18T00:45:14.5877041Z  2024-12-18T00:45:14.5878043Z [11,145 / 20,600] 1 / 17 tests; 47 actions, 46 running; last test: ...che_test 2024-12-18T00:45:14.5879009Z Compiling google/fft.cc; 28s local 2024-12-18T00:45:14.5879697Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:14.5880437Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:14.5881273Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local 2024-12-18T00:45:14.5882659Z Compiling src/google/protobuf/descriptor.cc [for tool]; 7s local 2024-12-18T00:45:14.5883585Z Compiling src/cpu/cpu_convolution_list.cpp; 7s local 2024-12-18T00:45:14.5884531Z Compiling src/cpu/cpu_deconvolution_list.cpp; 7s local 2024-12-18T00:45:14.5885363Z Compiling src/cpu/cpu_eltwise_list.cpp; 7s local ... 2024-12-18T00:45:14.8235659Z 2024-12-18T00:45:14.8236500Z  2024-12-18T00:45:14.8236972Z  2024-12-18T00:45:14.8237382Z  2024-12-18T00:45:14.8237749Z  2024-12-18T00:45:14.8238144Z  2024-12-18T00:45:14.8238926Z  2024-12-18T00:45:14.8239346Z  2024-12-18T00:45:14.8239730Z  2024-12-18T00:45:14.8240682Z [11,149 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:14.8241655Z Compiling google/fft.cc; 29s local 2024-12-18T00:45:14.8242365Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:14.8243107Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:14.8243861Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local 2024-12-18T00:45:14.8245061Z Compiling src/google/protobuf/descriptor.cc [for tool]; 7s local 2024-12-18T00:45:14.8246006Z Compiling src/cpu/cpu_convolution_list.cpp; 7s local 2024-12-18T00:45:14.8246867Z Compiling src/cpu/cpu_deconvolution_list.cpp; 7s local 2024-12-18T00:45:14.8247706Z Compiling src/cpu/cpu_eltwise_list.cpp; 7s local ... 2024-12-18T00:45:15.0591115Z 2024-12-18T00:45:15.0592018Z  2024-12-18T00:45:15.0592490Z  2024-12-18T00:45:15.0592920Z  2024-12-18T00:45:15.0593319Z  2024-12-18T00:45:15.0593722Z  2024-12-18T00:45:15.0594126Z  2024-12-18T00:45:15.0594509Z  2024-12-18T00:45:15.0594924Z  2024-12-18T00:45:15.0595868Z [11,155 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:15.0596763Z Compiling google/fft.cc; 29s local 2024-12-18T00:45:15.0597478Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:15.0598224Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:15.0599051Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2024-12-18T00:45:15.0600076Z Compiling src/google/protobuf/descriptor.cc [for tool]; 7s local 2024-12-18T00:45:15.0601008Z Compiling src/cpu/cpu_convolution_list.cpp; 7s local 2024-12-18T00:45:15.0601856Z Compiling src/cpu/cpu_deconvolution_list.cpp; 7s local 2024-12-18T00:45:15.0602865Z Compiling src/cpu/cpu_eltwise_list.cpp; 7s local ... 2024-12-18T00:45:15.3361533Z 2024-12-18T00:45:15.3362447Z  2024-12-18T00:45:15.3363067Z  2024-12-18T00:45:15.3363485Z  2024-12-18T00:45:15.3363881Z  2024-12-18T00:45:15.3364293Z  2024-12-18T00:45:15.3364700Z  2024-12-18T00:45:15.3365089Z  2024-12-18T00:45:15.3365482Z  2024-12-18T00:45:15.3366444Z [11,157 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:15.3367408Z Compiling google/fft.cc; 29s local 2024-12-18T00:45:15.3368076Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:15.3368799Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:15.3369604Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2024-12-18T00:45:15.3370582Z Compiling src/google/protobuf/descriptor.cc [for tool]; 8s local 2024-12-18T00:45:15.3371499Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2024-12-18T00:45:15.3372362Z Compiling src/cpu/cpu_deconvolution_list.cpp; 7s local 2024-12-18T00:45:15.3373180Z Compiling src/cpu/cpu_eltwise_list.cpp; 7s local ... 2024-12-18T00:45:15.5700930Z 2024-12-18T00:45:15.5701851Z  2024-12-18T00:45:15.5702319Z  2024-12-18T00:45:15.5702717Z  2024-12-18T00:45:15.5703124Z  2024-12-18T00:45:15.5703531Z  2024-12-18T00:45:15.5703927Z  2024-12-18T00:45:15.5704318Z  2024-12-18T00:45:15.5704986Z  2024-12-18T00:45:15.5705943Z [11,161 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:15.5706987Z Compiling google/fft.cc; 29s local 2024-12-18T00:45:15.5707697Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:15.5708434Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:15.5709266Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2024-12-18T00:45:15.5710253Z Compiling src/google/protobuf/descriptor.cc [for tool]; 8s local 2024-12-18T00:45:15.5711367Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2024-12-18T00:45:15.5712225Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local 2024-12-18T00:45:15.5713049Z Compiling src/cpu/cpu_eltwise_list.cpp; 8s local ... 2024-12-18T00:45:15.7926552Z 2024-12-18T00:45:15.7927498Z  2024-12-18T00:45:15.7928020Z  2024-12-18T00:45:15.7928448Z  2024-12-18T00:45:15.7928845Z  2024-12-18T00:45:15.7929297Z  2024-12-18T00:45:15.7929655Z  2024-12-18T00:45:15.7930032Z  2024-12-18T00:45:15.7930394Z  2024-12-18T00:45:15.7931348Z [11,164 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:15.7932296Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:15.7932999Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:15.7933806Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2024-12-18T00:45:15.7934862Z Compiling src/google/protobuf/descriptor.cc [for tool]; 8s local 2024-12-18T00:45:15.7935727Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2024-12-18T00:45:15.7936679Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local 2024-12-18T00:45:15.7937466Z Compiling src/cpu/cpu_eltwise_list.cpp; 8s local 2024-12-18T00:45:15.7938232Z Compiling src/common/memory_zero_pad.cpp; 7s local ... 2024-12-18T00:45:16.0503134Z 2024-12-18T00:45:16.0504063Z  2024-12-18T00:45:16.0504550Z  2024-12-18T00:45:16.0504932Z  2024-12-18T00:45:16.0505332Z  2024-12-18T00:45:16.0505736Z  2024-12-18T00:45:16.0506129Z  2024-12-18T00:45:16.0506659Z  2024-12-18T00:45:16.0507060Z  2024-12-18T00:45:16.0508011Z [11,167 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:16.0509052Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:16.0509761Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:16.0510604Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local 2024-12-18T00:45:16.0511594Z Compiling src/google/protobuf/descriptor.cc [for tool]; 8s local 2024-12-18T00:45:16.0512541Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2024-12-18T00:45:16.0513400Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local 2024-12-18T00:45:16.0514216Z Compiling src/cpu/cpu_eltwise_list.cpp; 8s local 2024-12-18T00:45:16.0515027Z Compiling src/common/memory_zero_pad.cpp; 7s local ... 2024-12-18T00:45:16.3369057Z 2024-12-18T00:45:16.3369911Z  2024-12-18T00:45:16.3370400Z  2024-12-18T00:45:16.3370824Z  2024-12-18T00:45:16.3371192Z  2024-12-18T00:45:16.3371579Z  2024-12-18T00:45:16.3371918Z  2024-12-18T00:45:16.3372286Z  2024-12-18T00:45:16.3372631Z  2024-12-18T00:45:16.3373519Z [11,169 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:16.3374474Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:16.3375176Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:16.3375937Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local 2024-12-18T00:45:16.3377041Z Compiling src/google/protobuf/descriptor.cc [for tool]; 9s local 2024-12-18T00:45:16.3377930Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2024-12-18T00:45:16.3379139Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local 2024-12-18T00:45:16.3380126Z Compiling src/cpu/cpu_eltwise_list.cpp; 8s local 2024-12-18T00:45:16.3381288Z Compiling src/common/memory_zero_pad.cpp; 8s local ... 2024-12-18T00:45:16.5373023Z 2024-12-18T00:45:16.5373859Z  2024-12-18T00:45:16.5374315Z  2024-12-18T00:45:16.5374673Z  2024-12-18T00:45:16.5375031Z  2024-12-18T00:45:16.5375404Z  2024-12-18T00:45:16.5375793Z  2024-12-18T00:45:16.5376181Z  2024-12-18T00:45:16.5376731Z  2024-12-18T00:45:16.5378248Z [11,175 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:16.5379212Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:16.5379916Z Compiling src/common/verbose.cpp; 10s local 2024-12-18T00:45:16.5380666Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local 2024-12-18T00:45:16.5381587Z Compiling src/google/protobuf/descriptor.cc [for tool]; 9s local 2024-12-18T00:45:16.5382492Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2024-12-18T00:45:16.5383341Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2024-12-18T00:45:16.5384187Z Compiling src/cpu/cpu_eltwise_list.cpp; 9s local 2024-12-18T00:45:16.5385013Z Compiling src/common/memory_zero_pad.cpp; 8s local ... 2024-12-18T00:45:16.8334647Z 2024-12-18T00:45:16.8336154Z  2024-12-18T00:45:16.8336727Z  2024-12-18T00:45:16.8337097Z  2024-12-18T00:45:16.8337460Z  2024-12-18T00:45:16.8337846Z  2024-12-18T00:45:16.8338205Z  2024-12-18T00:45:16.8338575Z  2024-12-18T00:45:16.8338937Z  2024-12-18T00:45:16.8339749Z [11,181 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:16.8340616Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:16.8341247Z Compiling src/common/verbose.cpp; 10s local 2024-12-18T00:45:16.8341940Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:16.8342791Z Compiling src/google/protobuf/descriptor.cc [for tool]; 9s local 2024-12-18T00:45:16.8343616Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2024-12-18T00:45:16.8344833Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2024-12-18T00:45:16.8345556Z Compiling src/cpu/cpu_eltwise_list.cpp; 9s local 2024-12-18T00:45:16.8346267Z Compiling src/common/memory_zero_pad.cpp; 8s local ... 2024-12-18T00:45:17.0742361Z 2024-12-18T00:45:17.0743284Z  2024-12-18T00:45:17.0743802Z  2024-12-18T00:45:17.0750673Z  2024-12-18T00:45:17.0751370Z  2024-12-18T00:45:17.0751738Z  2024-12-18T00:45:17.0752105Z  2024-12-18T00:45:17.0752462Z  2024-12-18T00:45:17.0752802Z  2024-12-18T00:45:17.0753682Z [11,183 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:17.0754646Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:17.0755466Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:17.0756409Z Compiling src/google/protobuf/descriptor.cc [for tool]; 9s local 2024-12-18T00:45:17.0757246Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2024-12-18T00:45:17.0757984Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2024-12-18T00:45:17.0758678Z Compiling src/cpu/cpu_eltwise_list.cpp; 9s local 2024-12-18T00:45:17.0759374Z Compiling src/common/memory_zero_pad.cpp; 8s local 2024-12-18T00:45:17.0760045Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:17.3381874Z 2024-12-18T00:45:17.3382857Z  2024-12-18T00:45:17.3383308Z  2024-12-18T00:45:17.3383672Z  2024-12-18T00:45:17.3384039Z  2024-12-18T00:45:17.3384393Z  2024-12-18T00:45:17.3384755Z  2024-12-18T00:45:17.3385111Z  2024-12-18T00:45:17.3385452Z  2024-12-18T00:45:17.3386299Z [11,186 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:17.3387450Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:17.3388380Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:17.3389303Z Compiling src/google/protobuf/descriptor.cc [for tool]; 10s local 2024-12-18T00:45:17.3390215Z Compiling src/cpu/cpu_convolution_list.cpp; 10s local 2024-12-18T00:45:17.3391033Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2024-12-18T00:45:17.3391972Z Compiling src/cpu/cpu_eltwise_list.cpp; 9s local 2024-12-18T00:45:17.3392716Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:45:17.3393375Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:17.7386181Z 2024-12-18T00:45:17.7387545Z  2024-12-18T00:45:17.7388051Z  2024-12-18T00:45:17.7388407Z  2024-12-18T00:45:17.7388813Z  2024-12-18T00:45:17.7401794Z  2024-12-18T00:45:17.7402264Z  2024-12-18T00:45:17.7402646Z  2024-12-18T00:45:17.7403012Z  2024-12-18T00:45:17.7403971Z [11,188 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:17.7404993Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:45:17.7405873Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:17.7406843Z Compiling src/google/protobuf/descriptor.cc [for tool]; 10s local 2024-12-18T00:45:17.7407912Z Compiling src/cpu/cpu_convolution_list.cpp; 10s local 2024-12-18T00:45:17.7408677Z Compiling src/cpu/cpu_deconvolution_list.cpp; 10s local 2024-12-18T00:45:17.7409487Z Compiling src/cpu/cpu_eltwise_list.cpp; 10s local 2024-12-18T00:45:17.7410206Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:45:17.7410847Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:45:17.9391714Z 2024-12-18T00:45:17.9392685Z  2024-12-18T00:45:17.9393227Z  2024-12-18T00:45:17.9393623Z  2024-12-18T00:45:17.9394031Z  2024-12-18T00:45:17.9394430Z  2024-12-18T00:45:17.9394810Z  2024-12-18T00:45:17.9395168Z  2024-12-18T00:45:17.9395551Z  2024-12-18T00:45:17.9396622Z [11,190 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:17.9397646Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:45:17.9398524Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:17.9399559Z Compiling src/google/protobuf/descriptor.cc [for tool]; 10s local 2024-12-18T00:45:17.9400516Z Compiling src/cpu/cpu_convolution_list.cpp; 10s local 2024-12-18T00:45:17.9401315Z Compiling src/cpu/cpu_deconvolution_list.cpp; 10s local 2024-12-18T00:45:17.9402095Z Compiling src/cpu/cpu_eltwise_list.cpp; 10s local 2024-12-18T00:45:17.9402882Z Compiling src/common/memory_zero_pad.cpp; 9s local 2024-12-18T00:45:17.9403600Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:45:18.3397316Z 2024-12-18T00:45:18.3398299Z  2024-12-18T00:45:18.3398795Z  2024-12-18T00:45:18.3399209Z  2024-12-18T00:45:18.3399573Z  2024-12-18T00:45:18.3400005Z  2024-12-18T00:45:18.3400394Z  2024-12-18T00:45:18.3400777Z  2024-12-18T00:45:18.3401171Z  2024-12-18T00:45:18.3402096Z [11,192 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:18.3403105Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:45:18.3403961Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:18.3404931Z Compiling src/google/protobuf/descriptor.cc [for tool]; 11s local 2024-12-18T00:45:18.3405795Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2024-12-18T00:45:18.3406630Z Compiling src/cpu/cpu_deconvolution_list.cpp; 10s local 2024-12-18T00:45:18.3407487Z Compiling src/cpu/cpu_eltwise_list.cpp; 10s local 2024-12-18T00:45:18.3408564Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:18.3409212Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:45:18.5401911Z 2024-12-18T00:45:18.5403051Z  2024-12-18T00:45:18.5403607Z  2024-12-18T00:45:18.5403999Z  2024-12-18T00:45:18.5404378Z  2024-12-18T00:45:18.5404769Z  2024-12-18T00:45:18.5405173Z  2024-12-18T00:45:18.5405567Z  2024-12-18T00:45:18.5405971Z  2024-12-18T00:45:18.5407072Z [11,194 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:18.5408183Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:18.5409021Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:18.5409970Z Compiling src/google/protobuf/descriptor.cc [for tool]; 11s local 2024-12-18T00:45:18.5410925Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2024-12-18T00:45:18.5411801Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2024-12-18T00:45:18.5412640Z Compiling src/cpu/cpu_eltwise_list.cpp; 11s local 2024-12-18T00:45:18.5413405Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:18.5414141Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:45:18.8196412Z 2024-12-18T00:45:18.8197342Z  2024-12-18T00:45:18.8197847Z  2024-12-18T00:45:18.8198247Z  2024-12-18T00:45:18.8198630Z  2024-12-18T00:45:18.8199045Z  2024-12-18T00:45:18.8199438Z  2024-12-18T00:45:18.8199888Z  2024-12-18T00:45:18.8200430Z  2024-12-18T00:45:18.8201421Z [11,196 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:18.8202481Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:18.8203388Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:18.8204364Z Compiling src/google/protobuf/descriptor.cc [for tool]; 11s local 2024-12-18T00:45:18.8205260Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2024-12-18T00:45:18.8206114Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2024-12-18T00:45:18.8206969Z Compiling src/cpu/cpu_eltwise_list.cpp; 11s local 2024-12-18T00:45:18.8207737Z Compiling src/common/memory_zero_pad.cpp; 10s local 2024-12-18T00:45:18.8208452Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:45:19.1377674Z 2024-12-18T00:45:19.1378546Z  2024-12-18T00:45:19.1379003Z  2024-12-18T00:45:19.1379465Z  2024-12-18T00:45:19.1379892Z  2024-12-18T00:45:19.1380297Z  2024-12-18T00:45:19.1380710Z  2024-12-18T00:45:19.1381107Z  2024-12-18T00:45:19.1381516Z  2024-12-18T00:45:19.1382474Z [11,197 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:19.1383480Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:19.1384308Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2024-12-18T00:45:19.1385267Z Compiling src/google/protobuf/descriptor.cc [for tool]; 11s local 2024-12-18T00:45:19.1386393Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2024-12-18T00:45:19.1387210Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2024-12-18T00:45:19.1387998Z Compiling src/cpu/cpu_eltwise_list.cpp; 11s local 2024-12-18T00:45:19.1388785Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:19.1389462Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:45:19.3408590Z 2024-12-18T00:45:19.3409421Z  2024-12-18T00:45:19.3409885Z  2024-12-18T00:45:19.3410290Z  2024-12-18T00:45:19.3410676Z  2024-12-18T00:45:19.3411066Z  2024-12-18T00:45:19.3411446Z  2024-12-18T00:45:19.3411832Z  2024-12-18T00:45:19.3412232Z  2024-12-18T00:45:19.3413147Z [11,198 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:19.3414429Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:19.3415241Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2024-12-18T00:45:19.3416382Z Compiling src/google/protobuf/descriptor.cc [for tool]; 12s local 2024-12-18T00:45:19.3417453Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:19.3418415Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2024-12-18T00:45:19.3419248Z Compiling src/cpu/cpu_eltwise_list.cpp; 11s local 2024-12-18T00:45:19.3420326Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:19.3421031Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:45:19.6597358Z 2024-12-18T00:45:19.6598226Z  2024-12-18T00:45:19.6598691Z  2024-12-18T00:45:19.6599099Z  2024-12-18T00:45:19.6599466Z  2024-12-18T00:45:19.6599817Z  2024-12-18T00:45:19.6600196Z  2024-12-18T00:45:19.6600562Z  2024-12-18T00:45:19.6600958Z  2024-12-18T00:45:19.6601844Z [11,199 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:19.6602848Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:19.6603727Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2024-12-18T00:45:19.6604707Z Compiling src/google/protobuf/descriptor.cc [for tool]; 12s local 2024-12-18T00:45:19.6605595Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:19.6606452Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2024-12-18T00:45:19.6607207Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:19.6607879Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:19.6608639Z Compiling src/cpu/cpu_inner_product_list.cpp; 8s local ... 2024-12-18T00:45:19.9416034Z 2024-12-18T00:45:19.9416977Z  2024-12-18T00:45:19.9417461Z  2024-12-18T00:45:19.9417879Z  2024-12-18T00:45:19.9418321Z  2024-12-18T00:45:19.9418711Z  2024-12-18T00:45:19.9419099Z  2024-12-18T00:45:19.9419507Z  2024-12-18T00:45:19.9419898Z  2024-12-18T00:45:19.9420869Z [11,200 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:19.9421930Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:19.9422812Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:19.9423807Z Compiling src/google/protobuf/descriptor.cc [for tool]; 12s local 2024-12-18T00:45:19.9424715Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:19.9425549Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2024-12-18T00:45:19.9426372Z Compiling src/common/memory_zero_pad.cpp; 11s local 2024-12-18T00:45:19.9427159Z Compiling src/cpu/cpu_inner_product_list.cpp; 9s local 2024-12-18T00:45:19.9427885Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:20.1756840Z 2024-12-18T00:45:20.1757726Z  2024-12-18T00:45:20.1758166Z  2024-12-18T00:45:20.1758576Z  2024-12-18T00:45:20.1758953Z  2024-12-18T00:45:20.1759377Z  2024-12-18T00:45:20.1759824Z  2024-12-18T00:45:20.1760219Z  2024-12-18T00:45:20.1760607Z  2024-12-18T00:45:20.1761541Z [11,203 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:20.1762519Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:20.1763411Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:20.1764316Z Compiling src/google/protobuf/descriptor.cc [for tool]; 12s local 2024-12-18T00:45:20.1765274Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:20.1766142Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2024-12-18T00:45:20.1766961Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:45:20.1768049Z Compiling src/cpu/cpu_inner_product_list.cpp; 9s local 2024-12-18T00:45:20.1768818Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:20.3795468Z 2024-12-18T00:45:20.3796339Z  2024-12-18T00:45:20.3797075Z  2024-12-18T00:45:20.3797499Z  2024-12-18T00:45:20.3797865Z  2024-12-18T00:45:20.3798230Z  2024-12-18T00:45:20.3798576Z  2024-12-18T00:45:20.3798936Z  2024-12-18T00:45:20.3799308Z  2024-12-18T00:45:20.3800318Z [11,204 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:20.3801416Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:20.3802303Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:20.3803219Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2024-12-18T00:45:20.3804117Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2024-12-18T00:45:20.3804933Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2024-12-18T00:45:20.3805703Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:45:20.3806468Z Compiling src/cpu/cpu_inner_product_list.cpp; 9s local 2024-12-18T00:45:20.3807158Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:20.7425080Z 2024-12-18T00:45:20.7425920Z  2024-12-18T00:45:20.7426377Z  2024-12-18T00:45:20.7426774Z  2024-12-18T00:45:20.7427157Z  2024-12-18T00:45:20.7427533Z  2024-12-18T00:45:20.7427906Z  2024-12-18T00:45:20.7428294Z  2024-12-18T00:45:20.7428729Z  2024-12-18T00:45:20.7429667Z [11,204 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:20.7430670Z Compiling src/common/memory_zero_pad.cpp; 22s local 2024-12-18T00:45:20.7431514Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:20.7432470Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2024-12-18T00:45:20.7433386Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2024-12-18T00:45:20.7434192Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2024-12-18T00:45:20.7435003Z Compiling src/common/memory_zero_pad.cpp; 12s local 2024-12-18T00:45:20.7435780Z Compiling src/cpu/cpu_inner_product_list.cpp; 9s local 2024-12-18T00:45:20.7436493Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:21.1430678Z 2024-12-18T00:45:21.1431544Z  2024-12-18T00:45:21.1432274Z  2024-12-18T00:45:21.1432665Z  2024-12-18T00:45:21.1433147Z  2024-12-18T00:45:21.1433500Z  2024-12-18T00:45:21.1433855Z  2024-12-18T00:45:21.1434220Z  2024-12-18T00:45:21.1434588Z  2024-12-18T00:45:21.1435500Z [11,205 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:21.1436569Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2024-12-18T00:45:21.1437677Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2024-12-18T00:45:21.1438692Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2024-12-18T00:45:21.1439557Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2024-12-18T00:45:21.1440397Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:21.1441253Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2024-12-18T00:45:21.1442055Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:21.1442758Z Compiling src/cpu/cpu_lrn_list.cpp; 7s local ... 2024-12-18T00:45:21.3435084Z 2024-12-18T00:45:21.3435930Z  2024-12-18T00:45:21.3436382Z  2024-12-18T00:45:21.3436791Z  2024-12-18T00:45:21.3437183Z  2024-12-18T00:45:21.3437571Z  2024-12-18T00:45:21.3437942Z  2024-12-18T00:45:21.3438302Z  2024-12-18T00:45:21.3438685Z  2024-12-18T00:45:21.3439606Z [11,207 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:21.3440964Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2024-12-18T00:45:21.3441965Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2024-12-18T00:45:21.3443001Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:21.3443672Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2024-12-18T00:45:21.3444591Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:21.3445260Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2024-12-18T00:45:21.3446057Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local 2024-12-18T00:45:21.3446672Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:21.6232774Z 2024-12-18T00:45:21.6233689Z  2024-12-18T00:45:21.6234189Z  2024-12-18T00:45:21.6234617Z  2024-12-18T00:45:21.6235015Z  2024-12-18T00:45:21.6235418Z  2024-12-18T00:45:21.6235831Z  2024-12-18T00:45:21.6236236Z  2024-12-18T00:45:21.6236625Z  2024-12-18T00:45:21.6237594Z [11,209 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:21.6238755Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2024-12-18T00:45:21.6239706Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2024-12-18T00:45:21.6240572Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:21.6241376Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2024-12-18T00:45:21.6242136Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:21.6242933Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2024-12-18T00:45:21.6243681Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local 2024-12-18T00:45:21.6244570Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:21.8355841Z 2024-12-18T00:45:21.8356774Z  2024-12-18T00:45:21.8357222Z  2024-12-18T00:45:21.8357639Z  2024-12-18T00:45:21.8358038Z  2024-12-18T00:45:21.8358463Z  2024-12-18T00:45:21.8358842Z  2024-12-18T00:45:21.8359197Z  2024-12-18T00:45:21.8359549Z  2024-12-18T00:45:21.8360517Z [11,211 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:21.8361610Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2024-12-18T00:45:21.8362744Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2024-12-18T00:45:21.8363689Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:21.8364579Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2024-12-18T00:45:21.8365427Z Compiling src/common/memory_zero_pad.cpp; 13s local 2024-12-18T00:45:21.8366287Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2024-12-18T00:45:21.8367089Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local 2024-12-18T00:45:21.8367767Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:22.1443116Z 2024-12-18T00:45:22.1443982Z  2024-12-18T00:45:22.1444803Z  2024-12-18T00:45:22.1445242Z  2024-12-18T00:45:22.1445642Z  2024-12-18T00:45:22.1446059Z  2024-12-18T00:45:22.1446465Z  2024-12-18T00:45:22.1446867Z  2024-12-18T00:45:22.1447284Z  2024-12-18T00:45:22.1448235Z [11,212 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:22.1449328Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2024-12-18T00:45:22.1450332Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2024-12-18T00:45:22.1451279Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:22.1452117Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2024-12-18T00:45:22.1452921Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:22.1453734Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local 2024-12-18T00:45:22.1454516Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local 2024-12-18T00:45:22.1455450Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:22.5121728Z 2024-12-18T00:45:22.5122808Z  2024-12-18T00:45:22.5123308Z  2024-12-18T00:45:22.5123705Z  2024-12-18T00:45:22.5124325Z  2024-12-18T00:45:22.5124691Z  2024-12-18T00:45:22.5125022Z  2024-12-18T00:45:22.5125369Z  2024-12-18T00:45:22.5125749Z  2024-12-18T00:45:22.5126710Z [11,213 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:22.5128135Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local 2024-12-18T00:45:22.5129023Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2024-12-18T00:45:22.5129852Z Compiling src/cpu/cpu_deconvolution_list.cpp; 15s local 2024-12-18T00:45:22.5130625Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:22.5131418Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local 2024-12-18T00:45:22.5132206Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2024-12-18T00:45:22.5132858Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:22.5133517Z Compiling src/cpu/cpu_pooling_list.cpp; 7s local ... 2024-12-18T00:45:22.7448679Z 2024-12-18T00:45:22.7449722Z  2024-12-18T00:45:22.7450199Z  2024-12-18T00:45:22.7450610Z  2024-12-18T00:45:22.7451007Z  2024-12-18T00:45:22.7451389Z  2024-12-18T00:45:22.7451775Z  2024-12-18T00:45:22.7452146Z  2024-12-18T00:45:22.7452529Z  2024-12-18T00:45:22.7453489Z [11,216 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:22.7454602Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local 2024-12-18T00:45:22.7455520Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2024-12-18T00:45:22.7456343Z Compiling src/cpu/cpu_deconvolution_list.cpp; 15s local 2024-12-18T00:45:22.7457272Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:22.7458082Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local 2024-12-18T00:45:22.7458838Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2024-12-18T00:45:22.7459526Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:22.7460152Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local ... 2024-12-18T00:45:22.9453141Z 2024-12-18T00:45:22.9453983Z  2024-12-18T00:45:22.9454450Z  2024-12-18T00:45:22.9454846Z  2024-12-18T00:45:22.9455249Z  2024-12-18T00:45:22.9455606Z  2024-12-18T00:45:22.9455893Z  2024-12-18T00:45:22.9456237Z  2024-12-18T00:45:22.9456739Z  2024-12-18T00:45:22.9457685Z [11,217 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:22.9458800Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local 2024-12-18T00:45:22.9459692Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2024-12-18T00:45:22.9460469Z Compiling src/cpu/cpu_deconvolution_list.cpp; 15s local 2024-12-18T00:45:22.9461278Z Compiling src/common/memory_zero_pad.cpp; 14s local 2024-12-18T00:45:22.9462020Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2024-12-18T00:45:22.9462730Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2024-12-18T00:45:22.9463356Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:22.9464049Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local ... 2024-12-18T00:45:23.2170562Z 2024-12-18T00:45:23.2171503Z  2024-12-18T00:45:23.2171969Z  2024-12-18T00:45:23.2172419Z  2024-12-18T00:45:23.2172809Z  2024-12-18T00:45:23.2173155Z  2024-12-18T00:45:23.2173529Z  2024-12-18T00:45:23.2173882Z  2024-12-18T00:45:23.2174277Z  2024-12-18T00:45:23.2175222Z [11,221 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:23.2176307Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local 2024-12-18T00:45:23.2177660Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2024-12-18T00:45:23.2178503Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:23.2179451Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2024-12-18T00:45:23.2180199Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2024-12-18T00:45:23.2180830Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:23.2181461Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2024-12-18T00:45:23.2182117Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:23.4179841Z 2024-12-18T00:45:23.4180652Z  2024-12-18T00:45:23.4181070Z  2024-12-18T00:45:23.4181420Z  2024-12-18T00:45:23.4181967Z  2024-12-18T00:45:23.4182311Z  2024-12-18T00:45:23.4182647Z  2024-12-18T00:45:23.4183023Z  2024-12-18T00:45:23.4183389Z  2024-12-18T00:45:23.4184213Z [11,222 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:23.4185105Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:23.4185816Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:23.4186576Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2024-12-18T00:45:23.4187234Z Compiling src/cpu/cpu_lrn_list.cpp; 10s local 2024-12-18T00:45:23.4187808Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:23.4188385Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2024-12-18T00:45:23.4188971Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:23.4189584Z Compiling src/common/verbose.cpp; 7s local ... 2024-12-18T00:45:23.6189716Z 2024-12-18T00:45:23.6190564Z  2024-12-18T00:45:23.6190962Z  2024-12-18T00:45:23.6191293Z  2024-12-18T00:45:23.6191621Z  2024-12-18T00:45:23.6191945Z  2024-12-18T00:45:23.6192281Z  2024-12-18T00:45:23.6192606Z  2024-12-18T00:45:23.6192940Z  2024-12-18T00:45:23.6193795Z [11,225 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:23.6194663Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:23.6195376Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:23.6196040Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2024-12-18T00:45:23.6196633Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:23.6197185Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2024-12-18T00:45:23.6197737Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:23.6198284Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:23.6198966Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local ... 2024-12-18T00:45:23.9410372Z 2024-12-18T00:45:23.9411266Z  2024-12-18T00:45:23.9411737Z  2024-12-18T00:45:23.9412119Z  2024-12-18T00:45:23.9412492Z  2024-12-18T00:45:23.9412867Z  2024-12-18T00:45:23.9413251Z  2024-12-18T00:45:23.9413642Z  2024-12-18T00:45:23.9414020Z  2024-12-18T00:45:23.9414917Z [11,227 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:23.9415869Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:23.9416769Z Compiling src/common/memory_zero_pad.cpp; 15s local 2024-12-18T00:45:23.9417483Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2024-12-18T00:45:23.9418136Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:23.9418775Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2024-12-18T00:45:23.9419424Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:23.9419978Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:23.9420773Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2024-12-18T00:45:24.1463156Z 2024-12-18T00:45:24.1464010Z  2024-12-18T00:45:24.1464401Z  2024-12-18T00:45:24.1464745Z  2024-12-18T00:45:24.1465081Z  2024-12-18T00:45:24.1465677Z  2024-12-18T00:45:24.1466011Z  2024-12-18T00:45:24.1466330Z  2024-12-18T00:45:24.1466658Z  2024-12-18T00:45:24.1467580Z [11,231 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:24.1468439Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:24.1469100Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:24.1469753Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2024-12-18T00:45:24.1470478Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:24.1471121Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2024-12-18T00:45:24.1471690Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:24.1472212Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:24.1472878Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2024-12-18T00:45:24.3466202Z 2024-12-18T00:45:24.3467064Z  2024-12-18T00:45:24.3467570Z  2024-12-18T00:45:24.3467959Z  2024-12-18T00:45:24.3468344Z  2024-12-18T00:45:24.3468705Z  2024-12-18T00:45:24.3469072Z  2024-12-18T00:45:24.3469428Z  2024-12-18T00:45:24.3469818Z  2024-12-18T00:45:24.3470723Z [11,235 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:24.3471835Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:24.3472622Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:24.3473440Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2024-12-18T00:45:24.3474188Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:24.3474857Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2024-12-18T00:45:24.3475531Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:24.3476146Z Compiling src/common/verbose.cpp; 8s local 2024-12-18T00:45:24.3476966Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2024-12-18T00:45:24.6054128Z 2024-12-18T00:45:24.6054991Z  2024-12-18T00:45:24.6055460Z  2024-12-18T00:45:24.6055827Z  2024-12-18T00:45:24.6056187Z  2024-12-18T00:45:24.6056701Z  2024-12-18T00:45:24.6057126Z  2024-12-18T00:45:24.6057505Z  2024-12-18T00:45:24.6057887Z  2024-12-18T00:45:24.6058776Z [11,238 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:24.6059689Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:24.6060498Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:24.6061304Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2024-12-18T00:45:24.6062002Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:24.6062598Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2024-12-18T00:45:24.6063244Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:24.6063843Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:24.6064652Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2024-12-18T00:45:24.8821130Z 2024-12-18T00:45:24.8821961Z  2024-12-18T00:45:24.8822389Z  2024-12-18T00:45:24.8822762Z  2024-12-18T00:45:24.8823094Z  2024-12-18T00:45:24.8823449Z  2024-12-18T00:45:24.8823788Z  2024-12-18T00:45:24.8824130Z  2024-12-18T00:45:24.8824448Z  2024-12-18T00:45:24.8825245Z [11,239 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:24.8826082Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:24.8826703Z Compiling src/common/memory_zero_pad.cpp; 16s local 2024-12-18T00:45:24.8827377Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2024-12-18T00:45:24.8827963Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:24.8828491Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2024-12-18T00:45:24.8829140Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:24.8829913Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:24.8830598Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2024-12-18T00:45:25.1420376Z 2024-12-18T00:45:25.1421253Z  2024-12-18T00:45:25.1421707Z  2024-12-18T00:45:25.1422099Z  2024-12-18T00:45:25.1422499Z  2024-12-18T00:45:25.1422869Z  2024-12-18T00:45:25.1423254Z  2024-12-18T00:45:25.1423641Z  2024-12-18T00:45:25.1424020Z  2024-12-18T00:45:25.1425137Z [11,241 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:25.1426219Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:25.1427011Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:25.1427818Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:25.1428594Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:25.1429316Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2024-12-18T00:45:25.1430033Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:25.1430687Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:25.1431580Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2024-12-18T00:45:25.3474027Z 2024-12-18T00:45:25.3474856Z  2024-12-18T00:45:25.3475339Z  2024-12-18T00:45:25.3475751Z  2024-12-18T00:45:25.3476144Z  2024-12-18T00:45:25.3476527Z  2024-12-18T00:45:25.3476931Z  2024-12-18T00:45:25.3477349Z  2024-12-18T00:45:25.3477751Z  2024-12-18T00:45:25.3478685Z [11,243 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:25.3479863Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:45:25.3480693Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:25.3481553Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:25.3482309Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:25.3482961Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2024-12-18T00:45:25.3483672Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:25.3484345Z Compiling src/common/verbose.cpp; 9s local 2024-12-18T00:45:25.3485222Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2024-12-18T00:45:25.7478862Z 2024-12-18T00:45:25.7479780Z  2024-12-18T00:45:25.7480204Z  2024-12-18T00:45:25.7480555Z  2024-12-18T00:45:25.7480867Z  2024-12-18T00:45:25.7481239Z  2024-12-18T00:45:25.7481575Z  2024-12-18T00:45:25.7481904Z  2024-12-18T00:45:25.7482271Z  2024-12-18T00:45:25.7483064Z [11,244 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:25.7483996Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:45:25.7484726Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:25.7485383Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:25.7486005Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:25.7486574Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2024-12-18T00:45:25.7487128Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:25.7487611Z Compiling src/common/verbose.cpp; 10s local 2024-12-18T00:45:25.7488432Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2024-12-18T00:45:25.9483614Z 2024-12-18T00:45:25.9484493Z  2024-12-18T00:45:25.9485021Z  2024-12-18T00:45:25.9485405Z  2024-12-18T00:45:25.9485826Z  2024-12-18T00:45:25.9486215Z  2024-12-18T00:45:25.9486636Z  2024-12-18T00:45:25.9487052Z  2024-12-18T00:45:25.9487454Z  2024-12-18T00:45:25.9488403Z [11,247 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:25.9489503Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:45:25.9490645Z Compiling src/common/memory_zero_pad.cpp; 17s local 2024-12-18T00:45:25.9491515Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2024-12-18T00:45:25.9492433Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:25.9493172Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2024-12-18T00:45:25.9493837Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:25.9494638Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:25.9495625Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:45:26.1493677Z 2024-12-18T00:45:26.1494537Z  2024-12-18T00:45:26.1495001Z  2024-12-18T00:45:26.1495411Z  2024-12-18T00:45:26.1495820Z  2024-12-18T00:45:26.1496196Z  2024-12-18T00:45:26.1496744Z  2024-12-18T00:45:26.1497140Z  2024-12-18T00:45:26.1497533Z  2024-12-18T00:45:26.1498490Z [11,252 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:26.1499517Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:45:26.1500321Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:26.1501152Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2024-12-18T00:45:26.1501921Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:26.1502613Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2024-12-18T00:45:26.1503305Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:26.1504124Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:26.1504961Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:45:26.3675475Z 2024-12-18T00:45:26.3676326Z  2024-12-18T00:45:26.3676722Z  2024-12-18T00:45:26.3677031Z  2024-12-18T00:45:26.3677359Z  2024-12-18T00:45:26.3677692Z  2024-12-18T00:45:26.3678057Z  2024-12-18T00:45:26.3678434Z  2024-12-18T00:45:26.3678787Z  2024-12-18T00:45:26.3679717Z [11,255 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:26.3680640Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:26.3681332Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:26.3682017Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2024-12-18T00:45:26.3682620Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:26.3683193Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2024-12-18T00:45:26.3683776Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:26.3684427Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:26.3685084Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:45:26.6491338Z 2024-12-18T00:45:26.6492205Z  2024-12-18T00:45:26.6492699Z  2024-12-18T00:45:26.6493120Z  2024-12-18T00:45:26.6493519Z  2024-12-18T00:45:26.6493939Z  2024-12-18T00:45:26.6494375Z  2024-12-18T00:45:26.6494778Z  2024-12-18T00:45:26.6495174Z  2024-12-18T00:45:26.6496126Z [11,256 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:26.6497346Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:26.6498193Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:26.6499039Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2024-12-18T00:45:26.6499896Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:26.6500556Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2024-12-18T00:45:26.6501279Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:26.6502022Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2024-12-18T00:45:26.6502696Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:45:26.8970160Z 2024-12-18T00:45:26.8971017Z  2024-12-18T00:45:26.8971492Z  2024-12-18T00:45:26.8971870Z  2024-12-18T00:45:26.8972539Z  2024-12-18T00:45:26.8972914Z  2024-12-18T00:45:26.8973253Z  2024-12-18T00:45:26.8973581Z  2024-12-18T00:45:26.8973949Z  2024-12-18T00:45:26.8974983Z [11,258 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:26.8975860Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:26.8976727Z Compiling src/common/memory_zero_pad.cpp; 18s local 2024-12-18T00:45:26.8977437Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:26.8978366Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:26.8978971Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2024-12-18T00:45:26.8979585Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:26.8980284Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:26.8981032Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:45:27.1492256Z 2024-12-18T00:45:27.1493096Z  2024-12-18T00:45:27.1493545Z  2024-12-18T00:45:27.1493963Z  2024-12-18T00:45:27.1494355Z  2024-12-18T00:45:27.1494769Z  2024-12-18T00:45:27.1495185Z  2024-12-18T00:45:27.1495609Z  2024-12-18T00:45:27.1495991Z  2024-12-18T00:45:27.1497086Z [11,260 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:27.1498165Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:27.1499031Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:45:27.1499889Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:27.1500642Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:27.1501337Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2024-12-18T00:45:27.1502064Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:27.1502862Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:27.1503701Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:45:27.3496203Z 2024-12-18T00:45:27.3497176Z  2024-12-18T00:45:27.3497652Z  2024-12-18T00:45:27.3498081Z  2024-12-18T00:45:27.3498496Z  2024-12-18T00:45:27.3498930Z  2024-12-18T00:45:27.3499336Z  2024-12-18T00:45:27.3499732Z  2024-12-18T00:45:27.3500139Z  2024-12-18T00:45:27.3501095Z [11,266 / 20,600] 1 / 17 tests; 47 actions, 46 running; last test: ...che_test 2024-12-18T00:45:27.3502308Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:27.3503162Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:45:27.3503953Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:27.3504672Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:27.3505356Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2024-12-18T00:45:27.3506039Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:27.3506798Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:27.3507613Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:45:27.5885207Z 2024-12-18T00:45:27.5886098Z  2024-12-18T00:45:27.5886587Z  2024-12-18T00:45:27.5886976Z  2024-12-18T00:45:27.5887368Z  2024-12-18T00:45:27.5887720Z  2024-12-18T00:45:27.5888113Z  2024-12-18T00:45:27.5888496Z  2024-12-18T00:45:27.5888890Z  2024-12-18T00:45:27.5889817Z [11,270 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:27.5890809Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:27.5891602Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:45:27.5892395Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:27.5893109Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:27.5893767Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2024-12-18T00:45:27.5894870Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2024-12-18T00:45:27.5895614Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:27.5896582Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local ... 2024-12-18T00:45:27.9224946Z 2024-12-18T00:45:27.9225843Z  2024-12-18T00:45:27.9226323Z  2024-12-18T00:45:27.9226699Z  2024-12-18T00:45:27.9227070Z  2024-12-18T00:45:27.9227437Z  2024-12-18T00:45:27.9227803Z  2024-12-18T00:45:27.9228306Z  2024-12-18T00:45:27.9228817Z  2024-12-18T00:45:27.9230276Z [11,271 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:27.9231405Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:27.9232176Z Compiling src/common/memory_zero_pad.cpp; 19s local 2024-12-18T00:45:27.9232936Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:27.9233812Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2024-12-18T00:45:27.9234706Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2024-12-18T00:45:27.9235510Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:27.9236198Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2024-12-18T00:45:27.9236984Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local ... 2024-12-18T00:45:28.1504883Z 2024-12-18T00:45:28.1505810Z  2024-12-18T00:45:28.1506284Z  2024-12-18T00:45:28.1506650Z  2024-12-18T00:45:28.1507068Z  2024-12-18T00:45:28.1507556Z  2024-12-18T00:45:28.1507966Z  2024-12-18T00:45:28.1508350Z  2024-12-18T00:45:28.1508715Z  2024-12-18T00:45:28.1509825Z [11,274 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:28.1510847Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:28.1511635Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:28.1512520Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:28.1513361Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2024-12-18T00:45:28.1514193Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2024-12-18T00:45:28.1514974Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:28.1515654Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2024-12-18T00:45:28.1516544Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local ... 2024-12-18T00:45:28.4644488Z 2024-12-18T00:45:28.4645366Z  2024-12-18T00:45:28.4645898Z  2024-12-18T00:45:28.4646280Z  2024-12-18T00:45:28.4646673Z  2024-12-18T00:45:28.4647057Z  2024-12-18T00:45:28.4647429Z  2024-12-18T00:45:28.4647837Z  2024-12-18T00:45:28.4648212Z  2024-12-18T00:45:28.4649148Z [11,279 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:28.4650160Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:28.4650999Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:28.4651844Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:28.4652671Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2024-12-18T00:45:28.4653543Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2024-12-18T00:45:28.4654307Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:28.4655024Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:28.4655946Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local ... 2024-12-18T00:45:28.7511229Z 2024-12-18T00:45:28.7512073Z  2024-12-18T00:45:28.7512509Z  2024-12-18T00:45:28.7512869Z  2024-12-18T00:45:28.7513258Z  2024-12-18T00:45:28.7513641Z  2024-12-18T00:45:28.7514038Z  2024-12-18T00:45:28.7514431Z  2024-12-18T00:45:28.7514848Z  2024-12-18T00:45:28.7515753Z [11,282 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:28.7516996Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:28.7517875Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:28.7518649Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:28.7519456Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:28.7520260Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2024-12-18T00:45:28.7521030Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:28.7521866Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:28.7522706Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local ... 2024-12-18T00:45:28.9515333Z 2024-12-18T00:45:28.9516206Z  2024-12-18T00:45:28.9516727Z  2024-12-18T00:45:28.9517120Z  2024-12-18T00:45:28.9517659Z  2024-12-18T00:45:28.9518055Z  2024-12-18T00:45:28.9518463Z  2024-12-18T00:45:28.9518905Z  2024-12-18T00:45:28.9519292Z  2024-12-18T00:45:28.9520269Z [11,284 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:28.9521381Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:28.9522219Z Compiling src/common/memory_zero_pad.cpp; 20s local 2024-12-18T00:45:28.9523092Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2024-12-18T00:45:28.9523922Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:28.9524851Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:28.9525656Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:28.9526383Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:28.9527251Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local ... 2024-12-18T00:45:29.1821315Z 2024-12-18T00:45:29.1822197Z  2024-12-18T00:45:29.1822647Z  2024-12-18T00:45:29.1823109Z  2024-12-18T00:45:29.1823479Z  2024-12-18T00:45:29.1823856Z  2024-12-18T00:45:29.1824273Z  2024-12-18T00:45:29.1824704Z  2024-12-18T00:45:29.1825077Z  2024-12-18T00:45:29.1825997Z [11,289 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:29.1827015Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:29.1827822Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:29.1828674Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2024-12-18T00:45:29.1829451Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:29.1830300Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:29.1831110Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:29.1831839Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2024-12-18T00:45:29.1832728Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local ... 2024-12-18T00:45:29.4952968Z 2024-12-18T00:45:29.4953847Z  2024-12-18T00:45:29.4954317Z  2024-12-18T00:45:29.4954705Z  2024-12-18T00:45:29.4955111Z  2024-12-18T00:45:29.4955515Z  2024-12-18T00:45:29.4955945Z  2024-12-18T00:45:29.4956339Z  2024-12-18T00:45:29.4956719Z  2024-12-18T00:45:29.4957648Z [11,291 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:29.4958687Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:45:29.4959530Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:29.4960355Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2024-12-18T00:45:29.4961158Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:29.4961992Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:29.4972259Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:29.4973105Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2024-12-18T00:45:29.4974255Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local ... 2024-12-18T00:45:29.7522798Z 2024-12-18T00:45:29.7523649Z  2024-12-18T00:45:29.7524394Z  2024-12-18T00:45:29.7524825Z  2024-12-18T00:45:29.7525215Z  2024-12-18T00:45:29.7525598Z  2024-12-18T00:45:29.7525995Z  2024-12-18T00:45:29.7526393Z  2024-12-18T00:45:29.7526789Z  2024-12-18T00:45:29.7527882Z [11,292 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:29.7529157Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:45:29.7529921Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:29.7530701Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2024-12-18T00:45:29.7531494Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:29.7532284Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2024-12-18T00:45:29.7533094Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:29.7533779Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2024-12-18T00:45:29.7534651Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local ... 2024-12-18T00:45:30.0027541Z 2024-12-18T00:45:30.0028376Z  2024-12-18T00:45:30.0028972Z  2024-12-18T00:45:30.0029357Z  2024-12-18T00:45:30.0029744Z  2024-12-18T00:45:30.0030125Z  2024-12-18T00:45:30.0030510Z  2024-12-18T00:45:30.0030892Z  2024-12-18T00:45:30.0031257Z  2024-12-18T00:45:30.0032205Z [11,298 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:30.0033200Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:45:30.0033987Z Compiling src/common/memory_zero_pad.cpp; 21s local 2024-12-18T00:45:30.0034791Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:30.0035555Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:30.0036408Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2024-12-18T00:45:30.0037192Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:45:30.0037896Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2024-12-18T00:45:30.0038748Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local ... 2024-12-18T00:45:30.2582113Z 2024-12-18T00:45:30.2582964Z  2024-12-18T00:45:30.2583417Z  2024-12-18T00:45:30.2583795Z  2024-12-18T00:45:30.2584178Z  2024-12-18T00:45:30.2584608Z  2024-12-18T00:45:30.2584994Z  2024-12-18T00:45:30.2585377Z  2024-12-18T00:45:30.2585762Z  2024-12-18T00:45:30.2586666Z [11,300 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:30.2587664Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:45:30.2588459Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:30.2589246Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:30.2590043Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2024-12-18T00:45:30.2590732Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:45:30.2591406Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2024-12-18T00:45:30.2592232Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2024-12-18T00:45:30.2593114Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local ... 2024-12-18T00:45:30.4903261Z 2024-12-18T00:45:30.4904171Z  2024-12-18T00:45:30.4904673Z  2024-12-18T00:45:30.4905094Z  2024-12-18T00:45:30.4905520Z  2024-12-18T00:45:30.4905950Z  2024-12-18T00:45:30.4906376Z  2024-12-18T00:45:30.4906803Z  2024-12-18T00:45:30.4907216Z  2024-12-18T00:45:30.4908159Z [11,302 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:30.4909675Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:30.4910555Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:30.4911516Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:30.4912389Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2024-12-18T00:45:30.4913300Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:30.4914115Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2024-12-18T00:45:30.4914969Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2024-12-18T00:45:30.4916066Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local ... 2024-12-18T00:45:30.7343629Z 2024-12-18T00:45:30.7344779Z  2024-12-18T00:45:30.7345293Z  2024-12-18T00:45:30.7345709Z  2024-12-18T00:45:30.7346084Z  2024-12-18T00:45:30.7346506Z  2024-12-18T00:45:30.7346917Z  2024-12-18T00:45:30.7347301Z  2024-12-18T00:45:30.7347714Z  2024-12-18T00:45:30.7348666Z [11,304 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:30.7349709Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:30.7350585Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:30.7351406Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:30.7352225Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:30.7353056Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2024-12-18T00:45:30.7353956Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:30.7354796Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2024-12-18T00:45:30.7355532Z Compiling src/cpu/cpu_sum.cpp; 9s local ... 2024-12-18T00:45:30.9532714Z 2024-12-18T00:45:30.9533571Z  2024-12-18T00:45:30.9534084Z  2024-12-18T00:45:30.9534507Z  2024-12-18T00:45:30.9534885Z  2024-12-18T00:45:30.9535265Z  2024-12-18T00:45:30.9535660Z  2024-12-18T00:45:30.9536072Z  2024-12-18T00:45:30.9536633Z  2024-12-18T00:45:30.9537605Z [11,306 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:30.9538627Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:30.9539428Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:30.9540210Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:30.9541002Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:30.9541754Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:30.9542483Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2024-12-18T00:45:30.9543180Z Compiling src/cpu/cpu_sum.cpp; 9s local 2024-12-18T00:45:30.9543834Z Compiling src/cpu/cpu_sum.cpp; 7s local ... 2024-12-18T00:45:31.1554765Z 2024-12-18T00:45:31.1555629Z  2024-12-18T00:45:31.1556131Z  2024-12-18T00:45:31.1556574Z  2024-12-18T00:45:31.1556952Z  2024-12-18T00:45:31.1557343Z  2024-12-18T00:45:31.1557720Z  2024-12-18T00:45:31.1558134Z  2024-12-18T00:45:31.1558651Z  2024-12-18T00:45:31.1559576Z [11,308 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:31.1560551Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:31.1561360Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:31.1562172Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:31.1562971Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:31.1563838Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:31.1564650Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:31.1565382Z Compiling src/cpu/cpu_sum.cpp; 9s local 2024-12-18T00:45:31.1566049Z Compiling src/cpu/cpu_sum.cpp; 8s local ... 2024-12-18T00:45:31.4156913Z 2024-12-18T00:45:31.4157754Z  2024-12-18T00:45:31.4158203Z  2024-12-18T00:45:31.4158569Z  2024-12-18T00:45:31.4158939Z  2024-12-18T00:45:31.4159301Z  2024-12-18T00:45:31.4160012Z  2024-12-18T00:45:31.4160385Z  2024-12-18T00:45:31.4160721Z  2024-12-18T00:45:31.4161610Z [11,310 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:31.4162553Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:31.4163607Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:31.4164409Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:31.4165141Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2024-12-18T00:45:31.4165910Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:31.4166662Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:31.4167304Z Compiling src/cpu/cpu_sum.cpp; 9s local 2024-12-18T00:45:31.4167937Z Compiling src/cpu/cpu_sum.cpp; 8s local ... 2024-12-18T00:45:31.6995400Z 2024-12-18T00:45:31.6996297Z  2024-12-18T00:45:31.6996763Z  2024-12-18T00:45:31.6997204Z  2024-12-18T00:45:31.6997609Z  2024-12-18T00:45:31.6998015Z  2024-12-18T00:45:31.6998440Z  2024-12-18T00:45:31.6998849Z  2024-12-18T00:45:31.6999216Z  2024-12-18T00:45:31.7000302Z [11,313 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:31.7001335Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:31.7002197Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:31.7002987Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:31.7003737Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2024-12-18T00:45:31.7004464Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2024-12-18T00:45:31.7005256Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:31.7005984Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:31.7006628Z Compiling src/cpu/cpu_sum.cpp; 8s local ... 2024-12-18T00:45:31.9541582Z 2024-12-18T00:45:31.9542452Z  2024-12-18T00:45:31.9543071Z  2024-12-18T00:45:31.9543437Z  2024-12-18T00:45:31.9543829Z  2024-12-18T00:45:31.9544402Z  2024-12-18T00:45:31.9544784Z  2024-12-18T00:45:31.9545167Z  2024-12-18T00:45:31.9545515Z  2024-12-18T00:45:31.9546449Z [11,316 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:31.9547467Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:31.9548205Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:31.9548950Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:31.9549721Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2024-12-18T00:45:31.9550552Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2024-12-18T00:45:31.9551359Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2024-12-18T00:45:31.9552100Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:31.9552777Z Compiling src/cpu/cpu_sum.cpp; 8s local ... 2024-12-18T00:45:32.1546256Z 2024-12-18T00:45:32.1547118Z  2024-12-18T00:45:32.1547586Z  2024-12-18T00:45:32.1547965Z  2024-12-18T00:45:32.1548325Z  2024-12-18T00:45:32.1548706Z  2024-12-18T00:45:32.1549092Z  2024-12-18T00:45:32.1549508Z  2024-12-18T00:45:32.1549893Z  2024-12-18T00:45:32.1550812Z [11,317 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:32.1551831Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:32.1552698Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:32.1553522Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:32.1554589Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2024-12-18T00:45:32.1555396Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2024-12-18T00:45:32.1556544Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:32.1557256Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:32.1557902Z Compiling src/cpu/cpu_sum.cpp; 9s local ... 2024-12-18T00:45:32.5339639Z 2024-12-18T00:45:32.5340507Z  2024-12-18T00:45:32.5340958Z  2024-12-18T00:45:32.5341381Z  2024-12-18T00:45:32.5342137Z  2024-12-18T00:45:32.5342526Z  2024-12-18T00:45:32.5342917Z  2024-12-18T00:45:32.5343295Z  2024-12-18T00:45:32.5343670Z  2024-12-18T00:45:32.5344871Z [11,319 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:32.5345892Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:45:32.5346752Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:32.5347544Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:32.5348346Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:32.5349186Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2024-12-18T00:45:32.5350015Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:32.5350745Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:32.5351370Z Compiling src/cpu/cpu_sum.cpp; 9s local ... 2024-12-18T00:45:32.7552012Z 2024-12-18T00:45:32.7552937Z  2024-12-18T00:45:32.7553419Z  2024-12-18T00:45:32.7553833Z  2024-12-18T00:45:32.7554255Z  2024-12-18T00:45:32.7554675Z  2024-12-18T00:45:32.7555077Z  2024-12-18T00:45:32.7555498Z  2024-12-18T00:45:32.7555894Z  2024-12-18T00:45:32.7556886Z [11,324 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:32.7558017Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:45:32.7558930Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:32.7559893Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2024-12-18T00:45:32.7560656Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:32.7561494Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:32.7562304Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:32.7563003Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:32.7563678Z Compiling src/cpu/cpu_sum.cpp; 9s local ... 2024-12-18T00:45:32.9556419Z 2024-12-18T00:45:32.9557284Z  2024-12-18T00:45:32.9557770Z  2024-12-18T00:45:32.9558205Z  2024-12-18T00:45:32.9558620Z  2024-12-18T00:45:32.9558990Z  2024-12-18T00:45:32.9559341Z  2024-12-18T00:45:32.9559740Z  2024-12-18T00:45:32.9560131Z  2024-12-18T00:45:32.9561085Z [11,325 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:32.9562103Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:45:32.9562931Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:32.9563719Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2024-12-18T00:45:32.9564528Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:32.9565382Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:32.9566181Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2024-12-18T00:45:32.9566907Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:32.9567551Z Compiling src/cpu/cpu_sum.cpp; 9s local ... 2024-12-18T00:45:33.3002351Z 2024-12-18T00:45:33.3003254Z  2024-12-18T00:45:33.3003730Z  2024-12-18T00:45:33.3004118Z  2024-12-18T00:45:33.3004514Z  2024-12-18T00:45:33.3004903Z  2024-12-18T00:45:33.3005582Z  2024-12-18T00:45:33.3005956Z  2024-12-18T00:45:33.3006341Z  2024-12-18T00:45:33.3007241Z [11,328 / 20,600] 1 / 17 tests; 47 actions, 46 running; last test: ...che_test 2024-12-18T00:45:33.3008410Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:33.3009297Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:33.3010241Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2024-12-18T00:45:33.3011001Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:33.3012094Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:33.3012834Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:33.3013469Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:33.3014208Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local ... 2024-12-18T00:45:33.5222430Z 2024-12-18T00:45:33.5223307Z  2024-12-18T00:45:33.5223845Z  2024-12-18T00:45:33.5224346Z  2024-12-18T00:45:33.5224798Z  2024-12-18T00:45:33.5225238Z  2024-12-18T00:45:33.5225677Z  2024-12-18T00:45:33.5226087Z  2024-12-18T00:45:33.5226562Z  2024-12-18T00:45:33.5227581Z [11,329 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:33.5228688Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:33.5229560Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:33.5230362Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:33.5231190Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2024-12-18T00:45:33.5231949Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:33.5232624Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:33.5233222Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:33.5234032Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local ... 2024-12-18T00:45:33.7517585Z 2024-12-18T00:45:33.7518423Z  2024-12-18T00:45:33.7518881Z  2024-12-18T00:45:33.7519258Z  2024-12-18T00:45:33.7519635Z  2024-12-18T00:45:33.7520002Z  2024-12-18T00:45:33.7520406Z  2024-12-18T00:45:33.7520772Z  2024-12-18T00:45:33.7521146Z  2024-12-18T00:45:33.7522063Z [11,331 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:33.7523063Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:33.7523790Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:33.7524545Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:33.7525275Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:33.7526021Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:33.7526777Z Compiling src/cpu/cpu_sum.cpp; 12s local 2024-12-18T00:45:33.7527475Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:33.7528289Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local ... 2024-12-18T00:45:33.9564138Z 2024-12-18T00:45:33.9565019Z  2024-12-18T00:45:33.9565504Z  2024-12-18T00:45:33.9565955Z  2024-12-18T00:45:33.9566365Z  2024-12-18T00:45:33.9566787Z  2024-12-18T00:45:33.9567178Z  2024-12-18T00:45:33.9567586Z  2024-12-18T00:45:33.9567990Z  2024-12-18T00:45:33.9568989Z [11,335 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:33.9570118Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:33.9570998Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:45:33.9571898Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:33.9572748Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:33.9573600Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2024-12-18T00:45:33.9574576Z Compiling src/cpu/cpu_sum.cpp; 12s local 2024-12-18T00:45:33.9575225Z Compiling src/cpu/cpu_sum.cpp; 10s local 2024-12-18T00:45:33.9576119Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local ... 2024-12-18T00:45:34.2044015Z 2024-12-18T00:45:34.2045065Z  2024-12-18T00:45:34.2045541Z  2024-12-18T00:45:34.2045958Z  2024-12-18T00:45:34.2046367Z  2024-12-18T00:45:34.2046781Z  2024-12-18T00:45:34.2047200Z  2024-12-18T00:45:34.2047593Z  2024-12-18T00:45:34.2048001Z  2024-12-18T00:45:34.2049329Z [11,339 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:34.2050409Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:34.2051263Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:45:34.2051970Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:34.2052789Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:34.2053644Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:34.2054402Z Compiling src/cpu/cpu_sum.cpp; 12s local 2024-12-18T00:45:34.2055088Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:34.2055878Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local ... 2024-12-18T00:45:34.4067331Z 2024-12-18T00:45:34.4068214Z  2024-12-18T00:45:34.4068699Z  2024-12-18T00:45:34.4069091Z  2024-12-18T00:45:34.4069467Z  2024-12-18T00:45:34.4069842Z  2024-12-18T00:45:34.4070257Z  2024-12-18T00:45:34.4070653Z  2024-12-18T00:45:34.4071058Z  2024-12-18T00:45:34.4072029Z [11,344 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:34.4073077Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:45:34.4073950Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:45:34.4074829Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2024-12-18T00:45:34.4075676Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:34.4076489Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:34.4077217Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:34.4077935Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2024-12-18T00:45:34.4078835Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:34.7107132Z 2024-12-18T00:45:34.7108049Z  2024-12-18T00:45:34.7108531Z  2024-12-18T00:45:34.7108978Z  2024-12-18T00:45:34.7109511Z  2024-12-18T00:45:34.7109885Z  2024-12-18T00:45:34.7110241Z  2024-12-18T00:45:34.7110616Z  2024-12-18T00:45:34.7110989Z  2024-12-18T00:45:34.7111898Z [11,346 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:34.7112913Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:45:34.7113769Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:45:34.7114566Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:45:34.7115416Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2024-12-18T00:45:34.7116195Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:34.7116864Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:34.7117559Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2024-12-18T00:45:34.7118239Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:34.9573114Z 2024-12-18T00:45:34.9573972Z  2024-12-18T00:45:34.9574444Z  2024-12-18T00:45:34.9574847Z  2024-12-18T00:45:34.9575249Z  2024-12-18T00:45:34.9575641Z  2024-12-18T00:45:34.9576043Z  2024-12-18T00:45:34.9576563Z  2024-12-18T00:45:34.9576966Z  2024-12-18T00:45:34.9577911Z [11,350 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:34.9579142Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:45:34.9579959Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:34.9580910Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:45:34.9581725Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2024-12-18T00:45:34.9582522Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2024-12-18T00:45:34.9583190Z Compiling src/cpu/cpu_sum.cpp; 11s local 2024-12-18T00:45:34.9584107Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2024-12-18T00:45:34.9584919Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:35.3579021Z 2024-12-18T00:45:35.3579907Z  2024-12-18T00:45:35.3580381Z  2024-12-18T00:45:35.3580808Z  2024-12-18T00:45:35.3581232Z  2024-12-18T00:45:35.3581666Z  2024-12-18T00:45:35.3582071Z  2024-12-18T00:45:35.3582496Z  2024-12-18T00:45:35.3582920Z  2024-12-18T00:45:35.3583907Z [11,352 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:35.3584979Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:45:35.3585826Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:35.3586687Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2024-12-18T00:45:35.3587533Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2024-12-18T00:45:35.3588350Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2024-12-18T00:45:35.3589099Z Compiling src/cpu/cpu_sum.cpp; 12s local 2024-12-18T00:45:35.3589865Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:35.3590619Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:35.5583306Z 2024-12-18T00:45:35.5584164Z  2024-12-18T00:45:35.5584709Z  2024-12-18T00:45:35.5585166Z  2024-12-18T00:45:35.5585577Z  2024-12-18T00:45:35.5585983Z  2024-12-18T00:45:35.5586453Z  2024-12-18T00:45:35.5586881Z  2024-12-18T00:45:35.5587323Z  2024-12-18T00:45:35.5588316Z [11,353 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:35.5589368Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:45:35.5590247Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:35.5591246Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:35.5592104Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2024-12-18T00:45:35.5592925Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2024-12-18T00:45:35.5593631Z Compiling src/cpu/cpu_sum.cpp; 12s local 2024-12-18T00:45:35.5594370Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:35.5595130Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:35.8419569Z 2024-12-18T00:45:35.8420473Z  2024-12-18T00:45:35.8420941Z  2024-12-18T00:45:35.8421377Z  2024-12-18T00:45:35.8421770Z  2024-12-18T00:45:35.8422155Z  2024-12-18T00:45:35.8422517Z  2024-12-18T00:45:35.8422908Z  2024-12-18T00:45:35.8423294Z  2024-12-18T00:45:35.8424190Z [11,355 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:35.8425202Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:45:35.8426007Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:35.8426843Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:35.8427659Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:35.8428420Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2024-12-18T00:45:35.8429201Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:35.8429917Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:35.8430628Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local ... 2024-12-18T00:45:36.0585233Z 2024-12-18T00:45:36.0586115Z  2024-12-18T00:45:36.0586611Z  2024-12-18T00:45:36.0586997Z  2024-12-18T00:45:36.0587374Z  2024-12-18T00:45:36.0587726Z  2024-12-18T00:45:36.0588343Z  2024-12-18T00:45:36.0588733Z  2024-12-18T00:45:36.0589101Z  2024-12-18T00:45:36.0589983Z [11,356 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:36.0590829Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:45:36.0591771Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:36.0592563Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:36.0593289Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:36.0593888Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2024-12-18T00:45:36.0594514Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:36.0595226Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:36.0595889Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local ... 2024-12-18T00:45:36.3414408Z 2024-12-18T00:45:36.3415280Z  2024-12-18T00:45:36.3415795Z  2024-12-18T00:45:36.3416219Z  2024-12-18T00:45:36.3416731Z  2024-12-18T00:45:36.3417095Z  2024-12-18T00:45:36.3417421Z  2024-12-18T00:45:36.3417790Z  2024-12-18T00:45:36.3418171Z  2024-12-18T00:45:36.3419159Z [11,362 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:36.3420207Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:36.3421024Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:36.3421818Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2024-12-18T00:45:36.3422666Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:36.3423455Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:36.3424308Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:36.3424980Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local 2024-12-18T00:45:36.3425718Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:36.5592481Z 2024-12-18T00:45:36.5593382Z  2024-12-18T00:45:36.5593860Z  2024-12-18T00:45:36.5594249Z  2024-12-18T00:45:36.5594631Z  2024-12-18T00:45:36.5595004Z  2024-12-18T00:45:36.5595386Z  2024-12-18T00:45:36.5595753Z  2024-12-18T00:45:36.5596152Z  2024-12-18T00:45:36.5597065Z [11,362 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:36.5597995Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:36.5598766Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:36.5599500Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:36.5600425Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2024-12-18T00:45:36.5601228Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:36.5601946Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:36.5602690Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local 2024-12-18T00:45:36.5603435Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:36.7596172Z 2024-12-18T00:45:36.7597077Z  2024-12-18T00:45:36.7597558Z  2024-12-18T00:45:36.7597934Z  2024-12-18T00:45:36.7598324Z  2024-12-18T00:45:36.7598698Z  2024-12-18T00:45:36.7599124Z  2024-12-18T00:45:36.7599501Z  2024-12-18T00:45:36.7599876Z  2024-12-18T00:45:36.7600692Z [11,363 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:36.7601490Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:36.7602326Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:36.7603398Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:36.7604014Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:36.7604834Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:36.7605508Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:36.7606172Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local 2024-12-18T00:45:36.7606788Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:37.1490643Z 2024-12-18T00:45:37.1491493Z  2024-12-18T00:45:37.1491888Z  2024-12-18T00:45:37.1492644Z  2024-12-18T00:45:37.1492984Z  2024-12-18T00:45:37.1493331Z  2024-12-18T00:45:37.1493652Z  2024-12-18T00:45:37.1494010Z  2024-12-18T00:45:37.1494365Z  2024-12-18T00:45:37.1495152Z [11,368 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:37.1495990Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:37.1496819Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:37.1497505Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:37.1498173Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:37.1498849Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:37.1499469Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.1499981Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.1500466Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:37.3472854Z 2024-12-18T00:45:37.3473708Z  2024-12-18T00:45:37.3474137Z  2024-12-18T00:45:37.3474501Z  2024-12-18T00:45:37.3474838Z  2024-12-18T00:45:37.3475177Z  2024-12-18T00:45:37.3475504Z  2024-12-18T00:45:37.3475876Z  2024-12-18T00:45:37.3476235Z  2024-12-18T00:45:37.3477115Z [11,372 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:37.3478033Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:37.3478911Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:37.3479658Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2024-12-18T00:45:37.3480371Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:37.3480998Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.3481509Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.3481994Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:37.3482580Z Compiling src/cpu/nchw_pooling.cpp; 7s local ... 2024-12-18T00:45:37.5605239Z 2024-12-18T00:45:37.5606043Z  2024-12-18T00:45:37.5606517Z  2024-12-18T00:45:37.5606921Z  2024-12-18T00:45:37.5607328Z  2024-12-18T00:45:37.5607713Z  2024-12-18T00:45:37.5608108Z  2024-12-18T00:45:37.5608509Z  2024-12-18T00:45:37.5608903Z  2024-12-18T00:45:37.5609842Z [11,373 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:37.5610901Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:37.5611887Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:37.5612762Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:37.5613658Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2024-12-18T00:45:37.5614468Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.5615123Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.5615810Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:37.5616677Z Compiling src/cpu/nchw_pooling.cpp; 7s local ... 2024-12-18T00:45:37.8347964Z 2024-12-18T00:45:37.8348812Z  2024-12-18T00:45:37.8349284Z  2024-12-18T00:45:37.8349673Z  2024-12-18T00:45:37.8350057Z  2024-12-18T00:45:37.8350423Z  2024-12-18T00:45:37.8350806Z  2024-12-18T00:45:37.8351199Z  2024-12-18T00:45:37.8351863Z  2024-12-18T00:45:37.8352794Z [11,381 / 20,600] 1 / 17 tests; 48 actions, 46 running; last test: ...che_test 2024-12-18T00:45:37.8353892Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:37.8354721Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:37.8355534Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:37.8356289Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:37.8356996Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.8357822Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:37.8358366Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:37.8358979Z Compiling src/cpu/nhwc_pooling.cpp; 7s local ... 2024-12-18T00:45:38.0693844Z 2024-12-18T00:45:38.0694715Z  2024-12-18T00:45:38.0695183Z  2024-12-18T00:45:38.0695575Z  2024-12-18T00:45:38.0695946Z  2024-12-18T00:45:38.0696321Z  2024-12-18T00:45:38.0696885Z  2024-12-18T00:45:38.0697281Z  2024-12-18T00:45:38.0697639Z  2024-12-18T00:45:38.0698584Z [11,386 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:38.0699602Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:38.0700417Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2024-12-18T00:45:38.0701227Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:38.0702035Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:38.0702730Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:38.0703305Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:38.0703833Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:38.0704520Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local ... 2024-12-18T00:45:38.3612023Z 2024-12-18T00:45:38.3612848Z  2024-12-18T00:45:38.3613318Z  2024-12-18T00:45:38.3613747Z  2024-12-18T00:45:38.3614158Z  2024-12-18T00:45:38.3614533Z  2024-12-18T00:45:38.3614877Z  2024-12-18T00:45:38.3615234Z  2024-12-18T00:45:38.3615597Z  2024-12-18T00:45:38.3616705Z [11,390 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:38.3617789Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:45:38.3618642Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2024-12-18T00:45:38.3619488Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2024-12-18T00:45:38.3620332Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:38.3621091Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:38.3621687Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:38.3622299Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:38.3623053Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local ... 2024-12-18T00:45:38.6596373Z 2024-12-18T00:45:38.6597217Z  2024-12-18T00:45:38.6597669Z  2024-12-18T00:45:38.6598045Z  2024-12-18T00:45:38.6598424Z  2024-12-18T00:45:38.6598806Z  2024-12-18T00:45:38.6599190Z  2024-12-18T00:45:38.6599582Z  2024-12-18T00:45:38.6599958Z  2024-12-18T00:45:38.6600908Z [11,391 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:38.6601900Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:45:38.6602745Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:45:38.6603585Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2024-12-18T00:45:38.6604346Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:38.6604911Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:38.6605501Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:38.6606187Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local 2024-12-18T00:45:38.6607264Z Compiling src/cpu/ref_deconvolution.cpp; 5s local ... 2024-12-18T00:45:38.9618651Z 2024-12-18T00:45:38.9619530Z  2024-12-18T00:45:38.9619974Z  2024-12-18T00:45:38.9620332Z  2024-12-18T00:45:38.9621088Z  2024-12-18T00:45:38.9621458Z  2024-12-18T00:45:38.9621849Z  2024-12-18T00:45:38.9622241Z  2024-12-18T00:45:38.9622645Z  2024-12-18T00:45:38.9623568Z [11,393 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:38.9624777Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:45:38.9625738Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:45:38.9626524Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:38.9627224Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:38.9627829Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:38.9628397Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:38.9629111Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2024-12-18T00:45:38.9630128Z Compiling src/cpu/ref_deconvolution.cpp; 5s local ... 2024-12-18T00:45:39.1622843Z 2024-12-18T00:45:39.1623691Z  2024-12-18T00:45:39.1624209Z  2024-12-18T00:45:39.1624631Z  2024-12-18T00:45:39.1625059Z  2024-12-18T00:45:39.1625457Z  2024-12-18T00:45:39.1625836Z  2024-12-18T00:45:39.1626227Z  2024-12-18T00:45:39.1626611Z  2024-12-18T00:45:39.1627560Z [11,396 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:39.1628683Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:45:39.1629475Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2024-12-18T00:45:39.1630300Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:39.1631009Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:39.1631631Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:39.1632422Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2024-12-18T00:45:39.1633256Z Compiling src/cpu/ref_deconvolution.cpp; 6s local 2024-12-18T00:45:39.1634106Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local ... 2024-12-18T00:45:39.4692607Z 2024-12-18T00:45:39.4693466Z  2024-12-18T00:45:39.4693922Z  2024-12-18T00:45:39.4694297Z  2024-12-18T00:45:39.4694650Z  2024-12-18T00:45:39.4695022Z  2024-12-18T00:45:39.4695402Z  2024-12-18T00:45:39.4695779Z  2024-12-18T00:45:39.4696156Z  2024-12-18T00:45:39.4697275Z [11,399 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:39.4698180Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:39.4698989Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:39.4699815Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:39.4700468Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:39.4701156Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2024-12-18T00:45:39.4701939Z Compiling src/cpu/ref_deconvolution.cpp; 6s local 2024-12-18T00:45:39.4702743Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2024-12-18T00:45:39.4703502Z @onednn//:onednn_autogen; 5s local ... 2024-12-18T00:45:39.7104327Z 2024-12-18T00:45:39.7105154Z  2024-12-18T00:45:39.7105658Z  2024-12-18T00:45:39.7106057Z  2024-12-18T00:45:39.7106530Z  2024-12-18T00:45:39.7106954Z  2024-12-18T00:45:39.7107393Z  2024-12-18T00:45:39.7107781Z  2024-12-18T00:45:39.7108176Z  2024-12-18T00:45:39.7109200Z [11,403 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:39.7110219Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:39.7111077Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:39.7112245Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2024-12-18T00:45:39.7112960Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:39.7113653Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2024-12-18T00:45:39.7114609Z Compiling src/cpu/ref_deconvolution.cpp; 6s local 2024-12-18T00:45:39.7115397Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2024-12-18T00:45:39.7116079Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:39.9630176Z 2024-12-18T00:45:39.9630983Z  2024-12-18T00:45:39.9631430Z  2024-12-18T00:45:39.9632161Z  2024-12-18T00:45:39.9632508Z  2024-12-18T00:45:39.9632860Z  2024-12-18T00:45:39.9633206Z  2024-12-18T00:45:39.9633580Z  2024-12-18T00:45:39.9633936Z  2024-12-18T00:45:39.9634880Z [11,407 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:39.9635862Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:39.9636725Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:39.9637575Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:45:39.9638360Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:39.9639113Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2024-12-18T00:45:39.9639987Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2024-12-18T00:45:39.9640742Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:39.9641465Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local ... 2024-12-18T00:45:40.1631401Z 2024-12-18T00:45:40.1632287Z  2024-12-18T00:45:40.1634779Z  2024-12-18T00:45:40.1635289Z  2024-12-18T00:45:40.1635688Z  2024-12-18T00:45:40.1636084Z  2024-12-18T00:45:40.1636474Z  2024-12-18T00:45:40.1636859Z  2024-12-18T00:45:40.1637247Z  2024-12-18T00:45:40.1638178Z [11,410 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:40.1639283Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:40.1640115Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2024-12-18T00:45:40.1640985Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:45:40.1641782Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2024-12-18T00:45:40.1642599Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2024-12-18T00:45:40.1643275Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:40.1643987Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2024-12-18T00:45:40.1645045Z Compiling src/cpu/ref_eltwise.cpp; 6s local ... 2024-12-18T00:45:40.5638537Z 2024-12-18T00:45:40.5639454Z  2024-12-18T00:45:40.5639868Z  2024-12-18T00:45:40.5640202Z  2024-12-18T00:45:40.5640534Z  2024-12-18T00:45:40.5640863Z  2024-12-18T00:45:40.5641210Z  2024-12-18T00:45:40.5641578Z  2024-12-18T00:45:40.5641946Z  2024-12-18T00:45:40.5642883Z [11,412 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:40.5643831Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:45:40.5644755Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:40.5645447Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2024-12-18T00:45:40.5646135Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2024-12-18T00:45:40.5646732Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:40.5647315Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2024-12-18T00:45:40.5647951Z Compiling src/cpu/ref_eltwise.cpp; 6s local 2024-12-18T00:45:40.5648515Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2024-12-18T00:45:40.7641346Z 2024-12-18T00:45:40.7642292Z  2024-12-18T00:45:40.7642779Z  2024-12-18T00:45:40.7643159Z  2024-12-18T00:45:40.7643525Z  2024-12-18T00:45:40.7643927Z  2024-12-18T00:45:40.7644965Z  2024-12-18T00:45:40.7645389Z  2024-12-18T00:45:40.7645802Z  2024-12-18T00:45:40.7646920Z [11,419 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:40.7647933Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:45:40.7648868Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:40.7649888Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:40.7651055Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2024-12-18T00:45:40.7652081Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2024-12-18T00:45:40.7652846Z Compiling src/cpu/ref_eltwise.cpp; 6s local 2024-12-18T00:45:40.7653504Z Compiling src/cpu/ref_lrn.cpp; 6s local 2024-12-18T00:45:40.7654182Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2024-12-18T00:45:41.1278600Z 2024-12-18T00:45:41.1279339Z  2024-12-18T00:45:41.1279791Z  2024-12-18T00:45:41.1280216Z  2024-12-18T00:45:41.1280566Z  2024-12-18T00:45:41.1280944Z  2024-12-18T00:45:41.1281318Z  2024-12-18T00:45:41.1281699Z  2024-12-18T00:45:41.1282077Z  2024-12-18T00:45:41.1282951Z [11,422 / 20,600] 1 / 17 tests; 47 actions, 46 running; last test: ...che_test 2024-12-18T00:45:41.1283958Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:45:41.1284745Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:41.1285539Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:41.1286370Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2024-12-18T00:45:41.1287130Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2024-12-18T00:45:41.1287777Z Compiling src/cpu/ref_lrn.cpp; 6s local 2024-12-18T00:45:41.1288418Z Compiling src/cpu/ref_pooling.cpp; 6s local 2024-12-18T00:45:41.1289056Z @onednn//:onednn_autogen; 5s local ... 2024-12-18T00:45:41.3379664Z 2024-12-18T00:45:41.3380469Z  2024-12-18T00:45:41.3380903Z  2024-12-18T00:45:41.3381251Z  2024-12-18T00:45:41.3381599Z  2024-12-18T00:45:41.3391168Z  2024-12-18T00:45:41.3391917Z  2024-12-18T00:45:41.3392282Z  2024-12-18T00:45:41.3392636Z  2024-12-18T00:45:41.3393465Z [11,424 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:41.3394378Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:41.3395117Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2024-12-18T00:45:41.3395862Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:41.3396589Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:41.3397265Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2024-12-18T00:45:41.3397853Z Compiling src/cpu/ref_lrn.cpp; 6s local 2024-12-18T00:45:41.3398419Z Compiling src/cpu/ref_pooling.cpp; 6s local 2024-12-18T00:45:41.3399004Z @onednn//:onednn_autogen; 5s local ... 2024-12-18T00:45:41.5649066Z 2024-12-18T00:45:41.5649984Z  2024-12-18T00:45:41.5650455Z  2024-12-18T00:45:41.5650840Z  2024-12-18T00:45:41.5651251Z  2024-12-18T00:45:41.5651625Z  2024-12-18T00:45:41.5651985Z  2024-12-18T00:45:41.5652366Z  2024-12-18T00:45:41.5652715Z  2024-12-18T00:45:41.5653656Z [11,424 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:41.5654657Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:41.5655449Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:45:41.5656230Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2024-12-18T00:45:41.5657202Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:41.5657937Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2024-12-18T00:45:41.5658572Z Compiling src/cpu/ref_lrn.cpp; 7s local 2024-12-18T00:45:41.5659522Z Compiling src/cpu/ref_pooling.cpp; 6s local 2024-12-18T00:45:41.5660144Z @onednn//:onednn_autogen; 5s local ... 2024-12-18T00:45:41.8306432Z 2024-12-18T00:45:41.8307761Z  2024-12-18T00:45:41.8308279Z  2024-12-18T00:45:41.8308679Z  2024-12-18T00:45:41.8309053Z  2024-12-18T00:45:41.8309420Z  2024-12-18T00:45:41.8309788Z  2024-12-18T00:45:41.8310157Z  2024-12-18T00:45:41.8310544Z  2024-12-18T00:45:41.8311645Z [11,425 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:41.8312742Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:41.8313478Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:45:41.8314284Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:41.8315063Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:41.8315813Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2024-12-18T00:45:41.8316452Z Compiling src/cpu/ref_lrn.cpp; 7s local 2024-12-18T00:45:41.8317068Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:45:41.8317709Z @onednn//:onednn_autogen; 5s local ... 2024-12-18T00:45:42.0791917Z 2024-12-18T00:45:42.0792809Z  2024-12-18T00:45:42.0793281Z  2024-12-18T00:45:42.0793643Z  2024-12-18T00:45:42.0794019Z  2024-12-18T00:45:42.0794384Z  2024-12-18T00:45:42.0794763Z  2024-12-18T00:45:42.0795133Z  2024-12-18T00:45:42.0795553Z  2024-12-18T00:45:42.0796452Z [11,427 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:42.0797436Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:42.0798211Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:45:42.0799018Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:42.0799869Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:42.0800612Z Compiling src/cpu/ref_eltwise.cpp; 8s local 2024-12-18T00:45:42.0801250Z Compiling src/cpu/ref_lrn.cpp; 7s local 2024-12-18T00:45:42.0801900Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:45:42.0802568Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:42.2876956Z 2024-12-18T00:45:42.2877824Z  2024-12-18T00:45:42.2878328Z  2024-12-18T00:45:42.2878738Z  2024-12-18T00:45:42.2879146Z  2024-12-18T00:45:42.2879497Z  2024-12-18T00:45:42.2879900Z  2024-12-18T00:45:42.2880244Z  2024-12-18T00:45:42.2880620Z  2024-12-18T00:45:42.2881556Z [11,433 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:42.2882727Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:42.2883480Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2024-12-18T00:45:42.2884281Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:42.2885015Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2024-12-18T00:45:42.2885712Z Compiling src/cpu/ref_eltwise.cpp; 8s local 2024-12-18T00:45:42.2886317Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:45:42.2886903Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:42.2887484Z Compiling src/cpu/ref_reduction.cpp; 6s local ... 2024-12-18T00:45:42.5587617Z 2024-12-18T00:45:42.5588530Z  2024-12-18T00:45:42.5589014Z  2024-12-18T00:45:42.5589473Z  2024-12-18T00:45:42.5589832Z  2024-12-18T00:45:42.5590196Z  2024-12-18T00:45:42.5590571Z  2024-12-18T00:45:42.5590953Z  2024-12-18T00:45:42.5591328Z  2024-12-18T00:45:42.5592284Z [11,437 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:42.5593259Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:42.5594333Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:42.5595164Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2024-12-18T00:45:42.5596109Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:42.5596851Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:45:42.5597485Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:42.5598103Z Compiling src/cpu/ref_reduction.cpp; 6s local 2024-12-18T00:45:42.5598758Z Compiling src/cpu/nchw_pooling.cpp; 5s local ... 2024-12-18T00:45:42.7659348Z 2024-12-18T00:45:42.7660442Z  2024-12-18T00:45:42.7660949Z  2024-12-18T00:45:42.7661341Z  2024-12-18T00:45:42.7661730Z  2024-12-18T00:45:42.7662126Z  2024-12-18T00:45:42.7662530Z  2024-12-18T00:45:42.7662886Z  2024-12-18T00:45:42.7663271Z  2024-12-18T00:45:42.7664218Z [11,439 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:42.7665296Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:42.7666128Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:42.7666959Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:42.7667786Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:42.7668523Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:42.7669172Z Compiling src/cpu/ref_reduction.cpp; 6s local 2024-12-18T00:45:42.7669903Z Compiling src/cpu/nchw_pooling.cpp; 5s local 2024-12-18T00:45:42.7670738Z Compiling src/cpu/ncsp_batch_normalization.cpp; 5s local ... 2024-12-18T00:45:42.9663572Z 2024-12-18T00:45:42.9664423Z  2024-12-18T00:45:42.9664901Z  2024-12-18T00:45:42.9665310Z  2024-12-18T00:45:42.9665692Z  2024-12-18T00:45:42.9666065Z  2024-12-18T00:45:42.9666468Z  2024-12-18T00:45:42.9666878Z  2024-12-18T00:45:42.9667271Z  2024-12-18T00:45:42.9668315Z [11,440 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:42.9669314Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:42.9670163Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:42.9670999Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:42.9671832Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:42.9672505Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:42.9673129Z Compiling src/cpu/ref_reduction.cpp; 6s local 2024-12-18T00:45:42.9673865Z Compiling src/cpu/nchw_pooling.cpp; 6s local 2024-12-18T00:45:42.9674693Z Compiling src/cpu/ncsp_batch_normalization.cpp; 6s local ... 2024-12-18T00:45:43.2257933Z 2024-12-18T00:45:43.2258774Z  2024-12-18T00:45:43.2259238Z  2024-12-18T00:45:43.2259632Z  2024-12-18T00:45:43.2259998Z  2024-12-18T00:45:43.2260400Z  2024-12-18T00:45:43.2260776Z  2024-12-18T00:45:43.2261139Z  2024-12-18T00:45:43.2261508Z  2024-12-18T00:45:43.2262424Z [11,443 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:43.2263467Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:43.2264292Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:43.2265132Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:43.2266000Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2024-12-18T00:45:43.2266728Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:43.2267397Z Compiling src/cpu/ref_reduction.cpp; 7s local 2024-12-18T00:45:43.2268135Z Compiling src/cpu/nchw_pooling.cpp; 6s local 2024-12-18T00:45:43.2268903Z Compiling src/graph/interface/graph.cpp; 5s local ... 2024-12-18T00:45:43.4400019Z 2024-12-18T00:45:43.4400909Z  2024-12-18T00:45:43.4401372Z  2024-12-18T00:45:43.4402026Z  2024-12-18T00:45:43.4402382Z  2024-12-18T00:45:43.4402874Z  2024-12-18T00:45:43.4403280Z  2024-12-18T00:45:43.4403664Z  2024-12-18T00:45:43.4404051Z  2024-12-18T00:45:43.4405143Z [11,444 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:43.4406153Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:43.4406950Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2024-12-18T00:45:43.4407929Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:43.4408864Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:43.4409486Z Compiling src/cpu/ref_reduction.cpp; 7s local 2024-12-18T00:45:43.4410152Z Compiling src/cpu/nchw_pooling.cpp; 6s local 2024-12-18T00:45:43.4410871Z Compiling src/graph/interface/graph.cpp; 6s local 2024-12-18T00:45:43.4411769Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 5s local ... 2024-12-18T00:45:43.6541605Z 2024-12-18T00:45:43.6542488Z  2024-12-18T00:45:43.6542973Z  2024-12-18T00:45:43.6543386Z  2024-12-18T00:45:43.6543798Z  2024-12-18T00:45:43.6544437Z  2024-12-18T00:45:43.6544899Z  2024-12-18T00:45:43.6545303Z  2024-12-18T00:45:43.6545689Z  2024-12-18T00:45:43.6546645Z [11,446 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:43.6547680Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:43.6548546Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:45:43.6549399Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2024-12-18T00:45:43.6550132Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:43.6550800Z Compiling src/cpu/nchw_pooling.cpp; 6s local 2024-12-18T00:45:43.6551528Z Compiling src/graph/interface/graph.cpp; 6s local 2024-12-18T00:45:43.6552445Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 5s local 2024-12-18T00:45:43.6553494Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 5s local ... 2024-12-18T00:45:43.8600401Z 2024-12-18T00:45:43.8601265Z  2024-12-18T00:45:43.8601715Z  2024-12-18T00:45:43.8602153Z  2024-12-18T00:45:43.8602553Z  2024-12-18T00:45:43.8602952Z  2024-12-18T00:45:43.8603353Z  2024-12-18T00:45:43.8603717Z  2024-12-18T00:45:43.8604109Z  2024-12-18T00:45:43.8605038Z [11,449 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:43.8606091Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:43.8606876Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:45:43.8607677Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2024-12-18T00:45:43.8608404Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:43.8609053Z Compiling src/cpu/nchw_pooling.cpp; 7s local 2024-12-18T00:45:43.8609822Z Compiling src/graph/interface/graph.cpp; 6s local 2024-12-18T00:45:43.8610675Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2024-12-18T00:45:43.8611679Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local ... 2024-12-18T00:45:44.1676663Z 2024-12-18T00:45:44.1677577Z  2024-12-18T00:45:44.1678164Z  2024-12-18T00:45:44.1678642Z  2024-12-18T00:45:44.1679048Z  2024-12-18T00:45:44.1679432Z  2024-12-18T00:45:44.1679863Z  2024-12-18T00:45:44.1680309Z  2024-12-18T00:45:44.1680677Z  2024-12-18T00:45:44.1681792Z [11,451 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:44.1682851Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:44.1683725Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:45:44.1684531Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2024-12-18T00:45:44.1685296Z Compiling src/cpu/nchw_pooling.cpp; 7s local 2024-12-18T00:45:44.1686287Z Compiling src/graph/interface/graph.cpp; 6s local 2024-12-18T00:45:44.1687177Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2024-12-18T00:45:44.1688314Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local 2024-12-18T00:45:44.1689360Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 6s local ... 2024-12-18T00:45:44.4275339Z 2024-12-18T00:45:44.4276281Z  2024-12-18T00:45:44.4276760Z  2024-12-18T00:45:44.4277160Z  2024-12-18T00:45:44.4277886Z  2024-12-18T00:45:44.4278356Z  2024-12-18T00:45:44.4278753Z  2024-12-18T00:45:44.4279114Z  2024-12-18T00:45:44.4279493Z  2024-12-18T00:45:44.4280433Z [11,454 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:44.4281442Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:44.4282209Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2024-12-18T00:45:44.4283061Z Compiling src/cpu/nchw_pooling.cpp; 7s local 2024-12-18T00:45:44.4283797Z Compiling src/graph/interface/graph.cpp; 7s local 2024-12-18T00:45:44.4284669Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2024-12-18T00:45:44.4285616Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local 2024-12-18T00:45:44.4286603Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 6s local 2024-12-18T00:45:44.4287543Z Compiling src/cpu/reorder/cpu_reorder_regular_f16.cpp; 6s local ... 2024-12-18T00:45:44.7057555Z 2024-12-18T00:45:44.7058405Z  2024-12-18T00:45:44.7058901Z  2024-12-18T00:45:44.7059294Z  2024-12-18T00:45:44.7059682Z  2024-12-18T00:45:44.7060095Z  2024-12-18T00:45:44.7060489Z  2024-12-18T00:45:44.7060893Z  2024-12-18T00:45:44.7061248Z  2024-12-18T00:45:44.7062141Z [11,455 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:44.7063237Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:44.7064090Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:45:44.7064886Z Compiling src/cpu/nchw_pooling.cpp; 7s local 2024-12-18T00:45:44.7065629Z Compiling src/graph/interface/graph.cpp; 7s local 2024-12-18T00:45:44.7066530Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2024-12-18T00:45:44.7067542Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local 2024-12-18T00:45:44.7068588Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 6s local 2024-12-18T00:45:44.7069636Z Compiling src/cpu/reorder/cpu_reorder_regular_f16.cpp; 6s local ... 2024-12-18T00:45:44.9684469Z 2024-12-18T00:45:44.9685350Z  2024-12-18T00:45:44.9685823Z  2024-12-18T00:45:44.9686246Z  2024-12-18T00:45:44.9686653Z  2024-12-18T00:45:44.9687075Z  2024-12-18T00:45:44.9687475Z  2024-12-18T00:45:44.9687889Z  2024-12-18T00:45:44.9688292Z  2024-12-18T00:45:44.9689277Z [11,456 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:44.9690271Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:44.9691087Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:45:44.9691895Z Compiling src/graph/interface/graph.cpp; 7s local 2024-12-18T00:45:44.9692743Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2024-12-18T00:45:44.9693759Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2024-12-18T00:45:44.9694693Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local 2024-12-18T00:45:44.9695689Z Compiling src/cpu/reorder/cpu_reorder_regular_f16.cpp; 7s local 2024-12-18T00:45:44.9696925Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local ... 2024-12-18T00:45:45.2527981Z 2024-12-18T00:45:45.2528878Z  2024-12-18T00:45:45.2529620Z  2024-12-18T00:45:45.2530010Z  2024-12-18T00:45:45.2530380Z  2024-12-18T00:45:45.2530758Z  2024-12-18T00:45:45.2531140Z  2024-12-18T00:45:45.2531546Z  2024-12-18T00:45:45.2532109Z  2024-12-18T00:45:45.2533067Z [11,457 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:45.2534029Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:45.2534786Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2024-12-18T00:45:45.2535796Z Compiling src/graph/interface/graph.cpp; 7s local 2024-12-18T00:45:45.2536788Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2024-12-18T00:45:45.2537705Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2024-12-18T00:45:45.2538623Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local 2024-12-18T00:45:45.2539648Z Compiling src/cpu/reorder/cpu_reorder_regular_f16.cpp; 7s local 2024-12-18T00:45:45.2540619Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local ... 2024-12-18T00:45:45.4690013Z 2024-12-18T00:45:45.4690936Z  2024-12-18T00:45:45.4691421Z  2024-12-18T00:45:45.4691827Z  2024-12-18T00:45:45.4692221Z  2024-12-18T00:45:45.4692622Z  2024-12-18T00:45:45.4693014Z  2024-12-18T00:45:45.4693393Z  2024-12-18T00:45:45.4693779Z  2024-12-18T00:45:45.4694730Z [11,459 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:45.4695785Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:45.4696802Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:45.4697621Z Compiling src/graph/interface/graph.cpp; 8s local 2024-12-18T00:45:45.4698611Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2024-12-18T00:45:45.4699571Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2024-12-18T00:45:45.4700544Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local 2024-12-18T00:45:45.4701485Z Compiling src/cpu/reorder/cpu_reorder_regular_f16.cpp; 7s local 2024-12-18T00:45:45.4702489Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local ... 2024-12-18T00:45:45.7328716Z 2024-12-18T00:45:45.7329596Z  2024-12-18T00:45:45.7330035Z  2024-12-18T00:45:45.7330381Z  2024-12-18T00:45:45.7330690Z  2024-12-18T00:45:45.7331014Z  2024-12-18T00:45:45.7331330Z  2024-12-18T00:45:45.7331650Z  2024-12-18T00:45:45.7332018Z  2024-12-18T00:45:45.7332762Z [11,465 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:45.7333565Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:45.7334200Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:45.7334834Z Compiling src/graph/interface/graph.cpp; 8s local 2024-12-18T00:45:45.7335548Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:45:45.7336308Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2024-12-18T00:45:45.7337295Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local 2024-12-18T00:45:45.7338126Z Compiling src/cpu/reorder/cpu_reorder_regular_f16.cpp; 7s local 2024-12-18T00:45:45.7339084Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local ... 2024-12-18T00:45:45.9462951Z 2024-12-18T00:45:45.9463818Z  2024-12-18T00:45:45.9464329Z  2024-12-18T00:45:45.9464709Z  2024-12-18T00:45:45.9465063Z  2024-12-18T00:45:45.9465441Z  2024-12-18T00:45:45.9465798Z  2024-12-18T00:45:45.9466158Z  2024-12-18T00:45:45.9466510Z  2024-12-18T00:45:45.9467385Z [11,466 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:45.9468537Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:45.9469718Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:45.9470528Z Compiling src/graph/interface/graph.cpp; 8s local 2024-12-18T00:45:45.9471582Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:45:45.9472575Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:45:45.9473516Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2024-12-18T00:45:45.9474470Z Compiling src/cpu/reorder/cpu_reorder_regular_f16.cpp; 8s local 2024-12-18T00:45:45.9475763Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 8s local ... 2024-12-18T00:45:46.1693940Z 2024-12-18T00:45:46.1694841Z  2024-12-18T00:45:46.1695255Z  2024-12-18T00:45:46.1695593Z  2024-12-18T00:45:46.1695920Z  2024-12-18T00:45:46.1696238Z  2024-12-18T00:45:46.1696699Z  2024-12-18T00:45:46.1697031Z  2024-12-18T00:45:46.1697358Z  2024-12-18T00:45:46.1698195Z [11,471 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:46.1699075Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:46.1699754Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:46.1700542Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:45:46.1701558Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:45:46.1702443Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2024-12-18T00:45:46.1703308Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 8s local 2024-12-18T00:45:46.1704176Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f32.cpp; 7s local 2024-12-18T00:45:46.1704839Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:46.3700395Z 2024-12-18T00:45:46.3701285Z  2024-12-18T00:45:46.3701752Z  2024-12-18T00:45:46.3702147Z  2024-12-18T00:45:46.3702522Z  2024-12-18T00:45:46.3702886Z  2024-12-18T00:45:46.3703283Z  2024-12-18T00:45:46.3703669Z  2024-12-18T00:45:46.3704057Z  2024-12-18T00:45:46.3704972Z [11,474 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:46.3706071Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:45:46.3706804Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2024-12-18T00:45:46.3707679Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:45:46.3708627Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:45:46.3709489Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2024-12-18T00:45:46.3710224Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:46.3710760Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:46.3711519Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_fp8.cpp; 6s local ... 2024-12-18T00:45:46.6282351Z 2024-12-18T00:45:46.6283252Z  2024-12-18T00:45:46.6283745Z  2024-12-18T00:45:46.6284144Z  2024-12-18T00:45:46.6284551Z  2024-12-18T00:45:46.6284957Z  2024-12-18T00:45:46.6285395Z  2024-12-18T00:45:46.6285789Z  2024-12-18T00:45:46.6286191Z  2024-12-18T00:45:46.6287153Z [11,476 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:46.6288208Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:45:46.6289062Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:46.6289946Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2024-12-18T00:45:46.6290855Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2024-12-18T00:45:46.6291818Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2024-12-18T00:45:46.6292621Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:46.6293265Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:46.6294374Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s8.cpp; 6s local ... 2024-12-18T00:45:46.8769392Z 2024-12-18T00:45:46.8770285Z  2024-12-18T00:45:46.8770999Z  2024-12-18T00:45:46.8771412Z  2024-12-18T00:45:46.8771812Z  2024-12-18T00:45:46.8772211Z  2024-12-18T00:45:46.8772722Z  2024-12-18T00:45:46.8773133Z  2024-12-18T00:45:46.8773554Z  2024-12-18T00:45:46.8774656Z [11,480 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:46.8775812Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:45:46.8776770Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:46.8777690Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:45:46.8778688Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2024-12-18T00:45:46.8779708Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local 2024-12-18T00:45:46.8780495Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:46.8781090Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:46.8781974Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s8.cpp; 6s local ... 2024-12-18T00:45:47.1504000Z 2024-12-18T00:45:47.1504848Z  2024-12-18T00:45:47.1505326Z  2024-12-18T00:45:47.1505745Z  2024-12-18T00:45:47.1506150Z  2024-12-18T00:45:47.1506527Z  2024-12-18T00:45:47.1506896Z  2024-12-18T00:45:47.1507276Z  2024-12-18T00:45:47.1507726Z  2024-12-18T00:45:47.1508647Z [11,481 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:47.1509686Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:45:47.1510536Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:47.1511456Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:45:47.1512455Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2024-12-18T00:45:47.1513399Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local 2024-12-18T00:45:47.1514201Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:47.1514745Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:47.1515546Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s8.cpp; 7s local ... 2024-12-18T00:45:47.3701888Z 2024-12-18T00:45:47.3702756Z  2024-12-18T00:45:47.3703216Z  2024-12-18T00:45:47.3703629Z  2024-12-18T00:45:47.3704083Z  2024-12-18T00:45:47.3704503Z  2024-12-18T00:45:47.3704927Z  2024-12-18T00:45:47.3705326Z  2024-12-18T00:45:47.3705715Z  2024-12-18T00:45:47.3706684Z [11,484 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:47.3707741Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:47.3708605Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2024-12-18T00:45:47.3709584Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:45:47.3710676Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2024-12-18T00:45:47.3711679Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local 2024-12-18T00:45:47.3712500Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:47.3713127Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:47.3714019Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s8.cpp; 7s local ... 2024-12-18T00:45:47.7728743Z 2024-12-18T00:45:47.7729689Z  2024-12-18T00:45:47.7730168Z  2024-12-18T00:45:47.7730558Z  2024-12-18T00:45:47.7730959Z  2024-12-18T00:45:47.7731335Z  2024-12-18T00:45:47.7731728Z  2024-12-18T00:45:47.7732118Z  2024-12-18T00:45:47.7732501Z  2024-12-18T00:45:47.7733426Z [11,487 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:47.7734654Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:47.7735505Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:45:47.7736725Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:47.7737760Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:45:47.7738688Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2024-12-18T00:45:47.7739452Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:47.7740262Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:47.7741092Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s8.cpp; 7s local ... 2024-12-18T00:45:47.9895690Z 2024-12-18T00:45:47.9896618Z  2024-12-18T00:45:47.9897074Z  2024-12-18T00:45:47.9897482Z  2024-12-18T00:45:47.9897881Z  2024-12-18T00:45:47.9898273Z  2024-12-18T00:45:47.9898646Z  2024-12-18T00:45:47.9899042Z  2024-12-18T00:45:47.9899458Z  2024-12-18T00:45:47.9900387Z [11,488 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:47.9901450Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:47.9902262Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:45:47.9903348Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:47.9904394Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:45:47.9905436Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2024-12-18T00:45:47.9906267Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:47.9906889Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:47.9907720Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s8.cpp; 7s local ... 2024-12-18T00:45:48.2557836Z 2024-12-18T00:45:48.2558746Z  2024-12-18T00:45:48.2559222Z  2024-12-18T00:45:48.2559623Z  2024-12-18T00:45:48.2560058Z  2024-12-18T00:45:48.2560455Z  2024-12-18T00:45:48.2560866Z  2024-12-18T00:45:48.2561273Z  2024-12-18T00:45:48.2561629Z  2024-12-18T00:45:48.2562567Z [11,492 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:48.2563590Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:48.2564366Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2024-12-18T00:45:48.2565316Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:48.2566309Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:45:48.2567326Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2024-12-18T00:45:48.2568121Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:48.2568744Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:48.2569513Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local ... 2024-12-18T00:45:48.5323740Z 2024-12-18T00:45:48.5324594Z  2024-12-18T00:45:48.5325113Z  2024-12-18T00:45:48.5325524Z  2024-12-18T00:45:48.5325885Z  2024-12-18T00:45:48.5326267Z  2024-12-18T00:45:48.5326666Z  2024-12-18T00:45:48.5327031Z  2024-12-18T00:45:48.5327370Z  2024-12-18T00:45:48.5328253Z [11,495 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:48.5329244Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:48.5330009Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:48.5330950Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:48.5331964Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:45:48.5332892Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2024-12-18T00:45:48.5333644Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:48.5334479Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:48.5335188Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local ... 2024-12-18T00:45:48.7712461Z 2024-12-18T00:45:48.7713337Z  2024-12-18T00:45:48.7714089Z  2024-12-18T00:45:48.7714522Z  2024-12-18T00:45:48.7714923Z  2024-12-18T00:45:48.7715310Z  2024-12-18T00:45:48.7715702Z  2024-12-18T00:45:48.7716120Z  2024-12-18T00:45:48.7716533Z  2024-12-18T00:45:48.7717691Z [11,498 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:48.7718892Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:48.7719708Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:48.7720600Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:45:48.7721664Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:45:48.7722668Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:45:48.7723667Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2024-12-18T00:45:48.7724615Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 7s local 2024-12-18T00:45:48.7725674Z Compiling src/cpu/reorder/cpu_reorder_regular_s32.cpp; 6s local ... 2024-12-18T00:45:49.0794387Z 2024-12-18T00:45:49.0795252Z  2024-12-18T00:45:49.0795745Z  2024-12-18T00:45:49.0796175Z  2024-12-18T00:45:49.0796540Z  2024-12-18T00:45:49.0796899Z  2024-12-18T00:45:49.0797302Z  2024-12-18T00:45:49.0797735Z  2024-12-18T00:45:49.0798142Z  2024-12-18T00:45:49.0799090Z [11,501 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:49.0800196Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:49.0801068Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:49.0801989Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:45:49.0803057Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:45:49.0804073Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:45:49.0805125Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2024-12-18T00:45:49.0806078Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local 2024-12-18T00:45:49.0807110Z Compiling src/cpu/reorder/cpu_reorder_regular_s32.cpp; 7s local ... 2024-12-18T00:45:49.2885984Z 2024-12-18T00:45:49.2886933Z  2024-12-18T00:45:49.2887450Z  2024-12-18T00:45:49.2887864Z  2024-12-18T00:45:49.2888257Z  2024-12-18T00:45:49.2888659Z  2024-12-18T00:45:49.2889073Z  2024-12-18T00:45:49.2889482Z  2024-12-18T00:45:49.2889888Z  2024-12-18T00:45:49.2890865Z [11,506 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:49.2891945Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:49.2892804Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2024-12-18T00:45:49.2893702Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:45:49.2894741Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:45:49.2895783Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:45:49.2896964Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local 2024-12-18T00:45:49.2897822Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:49.2898619Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 6s local ... 2024-12-18T00:45:49.5695520Z 2024-12-18T00:45:49.5696424Z  2024-12-18T00:45:49.5697061Z  2024-12-18T00:45:49.5697487Z  2024-12-18T00:45:49.5697908Z  2024-12-18T00:45:49.5698317Z  2024-12-18T00:45:49.5698742Z  2024-12-18T00:45:49.5699136Z  2024-12-18T00:45:49.5699825Z  2024-12-18T00:45:49.5700765Z [11,507 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:49.5701947Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:49.5702803Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:45:49.5703729Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:45:49.5704762Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:45:49.5705958Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:45:49.5707082Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local 2024-12-18T00:45:49.5707884Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:49.5708676Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local ... 2024-12-18T00:45:49.7721557Z 2024-12-18T00:45:49.7722489Z  2024-12-18T00:45:49.7722910Z  2024-12-18T00:45:49.7723297Z  2024-12-18T00:45:49.7723729Z  2024-12-18T00:45:49.7724129Z  2024-12-18T00:45:49.7724523Z  2024-12-18T00:45:49.7724907Z  2024-12-18T00:45:49.7725319Z  2024-12-18T00:45:49.7726283Z [11,508 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:49.7727313Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:49.7728131Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:45:49.7729125Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:45:49.7730030Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:45:49.7730981Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:45:49.7731927Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local 2024-12-18T00:45:49.7732677Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:49.7733376Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local ... 2024-12-18T00:45:50.0254282Z 2024-12-18T00:45:50.0255160Z  2024-12-18T00:45:50.0255714Z  2024-12-18T00:45:50.0256147Z  2024-12-18T00:45:50.0256728Z  2024-12-18T00:45:50.0257193Z  2024-12-18T00:45:50.0257605Z  2024-12-18T00:45:50.0258004Z  2024-12-18T00:45:50.0258428Z  2024-12-18T00:45:50.0259374Z [11,511 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:50.0260471Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:50.0261208Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:45:50.0262031Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:45:50.0263039Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:45:50.0263972Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:45:50.0264784Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:50.0265576Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local 2024-12-18T00:45:50.0266421Z Compiling src/cpu/ref_eltwise.cpp; 6s local ... 2024-12-18T00:45:50.2359817Z 2024-12-18T00:45:50.2360854Z  2024-12-18T00:45:50.2361328Z  2024-12-18T00:45:50.2361713Z  2024-12-18T00:45:50.2362095Z  2024-12-18T00:45:50.2362479Z  2024-12-18T00:45:50.2362866Z  2024-12-18T00:45:50.2363229Z  2024-12-18T00:45:50.2363605Z  2024-12-18T00:45:50.2364493Z [11,513 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:50.2365534Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:50.2366317Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2024-12-18T00:45:50.2367177Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:45:50.2368124Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:45:50.2369297Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:45:50.2370063Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:50.2370986Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local 2024-12-18T00:45:50.2371842Z Compiling src/cpu/ref_eltwise.cpp; 7s local ... 2024-12-18T00:45:50.4572386Z 2024-12-18T00:45:50.4573302Z  2024-12-18T00:45:50.4573780Z  2024-12-18T00:45:50.4574155Z  2024-12-18T00:45:50.4574535Z  2024-12-18T00:45:50.4574909Z  2024-12-18T00:45:50.4575718Z  2024-12-18T00:45:50.4576114Z  2024-12-18T00:45:50.4576621Z  2024-12-18T00:45:50.4577501Z [11,514 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:50.4578518Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:45:50.4579324Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:50.4580226Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:45:50.4581184Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:45:50.4582618Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:45:50.4583596Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:50.4584486Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2024-12-18T00:45:50.4585472Z Compiling src/cpu/ref_eltwise.cpp; 7s local ... 2024-12-18T00:45:50.7729654Z 2024-12-18T00:45:50.7730550Z  2024-12-18T00:45:50.7731044Z  2024-12-18T00:45:50.7731449Z  2024-12-18T00:45:50.7731857Z  2024-12-18T00:45:50.7732256Z  2024-12-18T00:45:50.7732649Z  2024-12-18T00:45:50.7733016Z  2024-12-18T00:45:50.7733414Z  2024-12-18T00:45:50.7734379Z [11,515 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:50.7735469Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:45:50.7736355Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:50.7737467Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:45:50.7738335Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:45:50.7739257Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:45:50.7740040Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:50.7740841Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2024-12-18T00:45:50.7741764Z Compiling src/cpu/ref_eltwise.cpp; 7s local ... 2024-12-18T00:45:50.9869279Z 2024-12-18T00:45:50.9870221Z  2024-12-18T00:45:50.9870709Z  2024-12-18T00:45:50.9871133Z  2024-12-18T00:45:50.9871536Z  2024-12-18T00:45:50.9871899Z  2024-12-18T00:45:50.9872303Z  2024-12-18T00:45:50.9872689Z  2024-12-18T00:45:50.9873048Z  2024-12-18T00:45:50.9873941Z [11,518 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:50.9874991Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:45:50.9875724Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:50.9876780Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:45:50.9877748Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:45:50.9878723Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:45:50.9879525Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:50.9880247Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2024-12-18T00:45:50.9881101Z Compiling src/cpu/ref_eltwise.cpp; 7s local ... 2024-12-18T00:45:51.2472898Z 2024-12-18T00:45:51.2473849Z  2024-12-18T00:45:51.2474356Z  2024-12-18T00:45:51.2474756Z  2024-12-18T00:45:51.2475173Z  2024-12-18T00:45:51.2475825Z  2024-12-18T00:45:51.2476252Z  2024-12-18T00:45:51.2476672Z  2024-12-18T00:45:51.2477063Z  2024-12-18T00:45:51.2478162Z [11,521 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:51.2479273Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:45:51.2480152Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2024-12-18T00:45:51.2481138Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:45:51.2482318Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:45:51.2483487Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:45:51.2484341Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:51.2485141Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2024-12-18T00:45:51.2486073Z Compiling src/cpu/rnn/brgemm_cell_common.cpp; 7s local ... 2024-12-18T00:45:51.4533287Z 2024-12-18T00:45:51.4534196Z  2024-12-18T00:45:51.4534651Z  2024-12-18T00:45:51.4535033Z  2024-12-18T00:45:51.4535422Z  2024-12-18T00:45:51.4535816Z  2024-12-18T00:45:51.4536220Z  2024-12-18T00:45:51.4536767Z  2024-12-18T00:45:51.4537193Z  2024-12-18T00:45:51.4538167Z [11,524 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:51.4539218Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:45:51.4540107Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:51.4541099Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:45:51.4542111Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:45:51.4543149Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:45:51.4543970Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:51.4545001Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2024-12-18T00:45:51.4545987Z Compiling src/cpu/rnn/brgemm_cell_common.cpp; 7s local ... 2024-12-18T00:45:51.6628872Z 2024-12-18T00:45:51.6629805Z  2024-12-18T00:45:51.6630315Z  2024-12-18T00:45:51.6630767Z  2024-12-18T00:45:51.6631162Z  2024-12-18T00:45:51.6631551Z  2024-12-18T00:45:51.6631962Z  2024-12-18T00:45:51.6632375Z  2024-12-18T00:45:51.6632786Z  2024-12-18T00:45:51.6633735Z [11,528 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:51.6634875Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:45:51.6635770Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:51.6636759Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:45:51.6637858Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:45:51.6638831Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:45:51.6639690Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:51.6640521Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2024-12-18T00:45:51.6641452Z Compiling src/cpu/rnn/brgemm_cell_common.cpp; 7s local ... 2024-12-18T00:45:51.9245623Z 2024-12-18T00:45:51.9246501Z  2024-12-18T00:45:51.9246979Z  2024-12-18T00:45:51.9247331Z  2024-12-18T00:45:51.9247735Z  2024-12-18T00:45:51.9248140Z  2024-12-18T00:45:51.9248531Z  2024-12-18T00:45:51.9248937Z  2024-12-18T00:45:51.9249348Z  2024-12-18T00:45:51.9250268Z [11,532 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:51.9251280Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:45:51.9252133Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:51.9253077Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:45:51.9254339Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:45:51.9255341Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:45:51.9256284Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:51.9257180Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2024-12-18T00:45:51.9258041Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:52.1724982Z 2024-12-18T00:45:52.1725925Z  2024-12-18T00:45:52.1726357Z  2024-12-18T00:45:52.1726696Z  2024-12-18T00:45:52.1727347Z  2024-12-18T00:45:52.1727681Z  2024-12-18T00:45:52.1728008Z  2024-12-18T00:45:52.1728330Z  2024-12-18T00:45:52.1728665Z  2024-12-18T00:45:52.1729440Z [11,533 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:52.1730290Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:45:52.1730974Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:52.1731858Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:45:52.1732663Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:45:52.1733489Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:45:52.1734099Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:52.1734759Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2024-12-18T00:45:52.1735563Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:52.3742910Z 2024-12-18T00:45:52.3743761Z  2024-12-18T00:45:52.3744405Z  2024-12-18T00:45:52.3744810Z  2024-12-18T00:45:52.3745211Z  2024-12-18T00:45:52.3745627Z  2024-12-18T00:45:52.3746027Z  2024-12-18T00:45:52.3746412Z  2024-12-18T00:45:52.3746823Z  2024-12-18T00:45:52.3747802Z [11,535 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:52.3748836Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:45:52.3759743Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2024-12-18T00:45:52.3760891Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:45:52.3761901Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:45:52.3762969Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:45:52.3763741Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:52.3764555Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2024-12-18T00:45:52.3765346Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:52.5886468Z 2024-12-18T00:45:52.5887349Z  2024-12-18T00:45:52.5887831Z  2024-12-18T00:45:52.5888226Z  2024-12-18T00:45:52.5888629Z  2024-12-18T00:45:52.5888987Z  2024-12-18T00:45:52.5889383Z  2024-12-18T00:45:52.5889767Z  2024-12-18T00:45:52.5890198Z  2024-12-18T00:45:52.5891127Z [11,539 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:52.5892138Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:45:52.5892938Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:52.5893837Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:45:52.5894820Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:45:52.5895796Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:45:52.5896860Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:52.5897796Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 10s local 2024-12-18T00:45:52.5898630Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:52.8590991Z 2024-12-18T00:45:52.8591846Z  2024-12-18T00:45:52.8592329Z  2024-12-18T00:45:52.8592727Z  2024-12-18T00:45:52.8595565Z  2024-12-18T00:45:52.8595973Z  2024-12-18T00:45:52.8596382Z  2024-12-18T00:45:52.8596783Z  2024-12-18T00:45:52.8597187Z  2024-12-18T00:45:52.8598294Z [11,543 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:52.8599341Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:45:52.8600175Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:52.8601207Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2024-12-18T00:45:52.8602235Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2024-12-18T00:45:52.8603166Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 15s local 2024-12-18T00:45:52.8603935Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:52.8604537Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:52.8605167Z Compiling src/cpu/ref_lrn.cpp; 7s local ... 2024-12-18T00:45:53.1017722Z 2024-12-18T00:45:53.1018542Z  2024-12-18T00:45:53.1019065Z  2024-12-18T00:45:53.1019578Z  2024-12-18T00:45:53.1020026Z  2024-12-18T00:45:53.1020405Z  2024-12-18T00:45:53.1020830Z  2024-12-18T00:45:53.1021236Z  2024-12-18T00:45:53.1021630Z  2024-12-18T00:45:53.1022583Z [11,547 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:53.1023620Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:45:53.1024432Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:53.1025262Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2024-12-18T00:45:53.1026057Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:53.1026632Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:53.1027234Z Compiling src/cpu/ref_lrn.cpp; 7s local 2024-12-18T00:45:53.1027784Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:45:53.1028506Z Compiling src/cpu/rnn/ref_postgemm_lstm.cpp; 6s local ... 2024-12-18T00:45:53.3753466Z 2024-12-18T00:45:53.3754333Z  2024-12-18T00:45:53.3754794Z  2024-12-18T00:45:53.3755197Z  2024-12-18T00:45:53.3755631Z  2024-12-18T00:45:53.3755982Z  2024-12-18T00:45:53.3756353Z  2024-12-18T00:45:53.3756749Z  2024-12-18T00:45:53.3757143Z  2024-12-18T00:45:53.3758098Z [11,549 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:53.3759146Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:45:53.3760070Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2024-12-18T00:45:53.3760799Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:53.3761409Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:53.3761932Z Compiling src/cpu/ref_lrn.cpp; 7s local 2024-12-18T00:45:53.3762541Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:45:53.3763176Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:53.3763842Z Compiling src/cpu/ref_reduction.cpp; 6s local ... 2024-12-18T00:45:53.6132944Z 2024-12-18T00:45:53.6133904Z  2024-12-18T00:45:53.6134443Z  2024-12-18T00:45:53.6134872Z  2024-12-18T00:45:53.6135495Z  2024-12-18T00:45:53.6135919Z  2024-12-18T00:45:53.6136324Z  2024-12-18T00:45:53.6136859Z  2024-12-18T00:45:53.6137269Z  2024-12-18T00:45:53.6138379Z [11,552 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:53.6139488Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:45:53.6140479Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:53.6141326Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:53.6142071Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:53.6142862Z Compiling src/cpu/ref_pooling.cpp; 7s local 2024-12-18T00:45:53.6143654Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:53.6147127Z Compiling src/cpu/ref_reduction.cpp; 6s local 2024-12-18T00:45:53.6147765Z @onednn//:onednn_autogen; 5s local ... 2024-12-18T00:45:53.8629935Z 2024-12-18T00:45:53.8631544Z  2024-12-18T00:45:53.8632064Z  2024-12-18T00:45:53.8632434Z  2024-12-18T00:45:53.8632802Z  2024-12-18T00:45:53.8633183Z  2024-12-18T00:45:53.8633587Z  2024-12-18T00:45:53.8633961Z  2024-12-18T00:45:53.8634329Z  2024-12-18T00:45:53.8635470Z [11,554 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:53.8636590Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:45:53.8637422Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:53.8638154Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:53.8638728Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:53.8639304Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:53.8639980Z Compiling src/cpu/ref_reduction.cpp; 6s local 2024-12-18T00:45:53.8640787Z @onednn//:onednn_autogen; 5s local 2024-12-18T00:45:53.8641474Z Compiling src/cpu/rnn/ref_rnn.cpp; 5s local ... 2024-12-18T00:45:54.1291517Z 2024-12-18T00:45:54.1292457Z  2024-12-18T00:45:54.1292900Z  2024-12-18T00:45:54.1293297Z  2024-12-18T00:45:54.1293671Z  2024-12-18T00:45:54.1294062Z  2024-12-18T00:45:54.1294438Z  2024-12-18T00:45:54.1294809Z  2024-12-18T00:45:54.1295094Z  2024-12-18T00:45:54.1295953Z [11,557 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:54.1297093Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:45:54.1297779Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:54.1298330Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:54.1298856Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:54.1299455Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:54.1300095Z Compiling src/cpu/ref_reduction.cpp; 6s local 2024-12-18T00:45:54.1300759Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:54.1301422Z Compiling src/cpu/rnn/ref_rnn.cpp; 5s local ... 2024-12-18T00:45:54.3760272Z 2024-12-18T00:45:54.3761092Z  2024-12-18T00:45:54.3761531Z  2024-12-18T00:45:54.3761919Z  2024-12-18T00:45:54.3762245Z  2024-12-18T00:45:54.3762621Z  2024-12-18T00:45:54.3762936Z  2024-12-18T00:45:54.3763269Z  2024-12-18T00:45:54.3763641Z  2024-12-18T00:45:54.3764501Z [11,558 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:54.3765421Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:45:54.3766149Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2024-12-18T00:45:54.3766784Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:54.3767361Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:54.3767922Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:54.3768555Z Compiling src/cpu/ref_reduction.cpp; 7s local 2024-12-18T00:45:54.3769186Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:54.3769790Z Compiling src/cpu/rnn/ref_rnn.cpp; 6s local ... 2024-12-18T00:45:54.5763914Z 2024-12-18T00:45:54.5764796Z  2024-12-18T00:45:54.5765261Z  2024-12-18T00:45:54.5765643Z  2024-12-18T00:45:54.5766031Z  2024-12-18T00:45:54.5766383Z  2024-12-18T00:45:54.5766773Z  2024-12-18T00:45:54.5767179Z  2024-12-18T00:45:54.5767555Z  2024-12-18T00:45:54.5768496Z [11,559 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:54.5769520Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:45:54.5770335Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:54.5771038Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:54.5771939Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:54.5772535Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:54.5773287Z Compiling src/cpu/ref_reduction.cpp; 7s local 2024-12-18T00:45:54.5773957Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:54.5774589Z Compiling src/cpu/rnn/ref_rnn.cpp; 6s local ... 2024-12-18T00:45:54.9123677Z 2024-12-18T00:45:54.9124572Z  2024-12-18T00:45:54.9125059Z  2024-12-18T00:45:54.9125455Z  2024-12-18T00:45:54.9125869Z  2024-12-18T00:45:54.9126624Z  2024-12-18T00:45:54.9127047Z  2024-12-18T00:45:54.9127470Z  2024-12-18T00:45:54.9127874Z  2024-12-18T00:45:54.9128807Z [11,562 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:54.9129815Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:45:54.9130618Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:54.9131268Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:54.9131880Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:54.9132504Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:54.9133107Z @onednn//:onednn_autogen; 6s local 2024-12-18T00:45:54.9133767Z Compiling src/cpu/rnn/ref_rnn.cpp; 6s local 2024-12-18T00:45:54.9134424Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:55.1772917Z 2024-12-18T00:45:55.1773822Z  2024-12-18T00:45:55.1774281Z  2024-12-18T00:45:55.1774684Z  2024-12-18T00:45:55.1775110Z  2024-12-18T00:45:55.1775505Z  2024-12-18T00:45:55.1775858Z  2024-12-18T00:45:55.1776219Z  2024-12-18T00:45:55.1776774Z  2024-12-18T00:45:55.1777740Z [11,564 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:55.1778784Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:45:55.1779612Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:55.1780332Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:55.1780913Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:55.1781517Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:55.1782086Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:55.1782717Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local 2024-12-18T00:45:55.1783391Z @onednn//:onednn_autogen; 6s local ... 2024-12-18T00:45:55.3777264Z 2024-12-18T00:45:55.3778181Z  2024-12-18T00:45:55.3778657Z  2024-12-18T00:45:55.3779098Z  2024-12-18T00:45:55.3779486Z  2024-12-18T00:45:55.3779855Z  2024-12-18T00:45:55.3780225Z  2024-12-18T00:45:55.3780617Z  2024-12-18T00:45:55.3780999Z  2024-12-18T00:45:55.3781924Z [11,566 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:55.3782942Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:45:55.3783784Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2024-12-18T00:45:55.3784498Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:55.3785118Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:55.3785746Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:55.3786301Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:55.3786941Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local 2024-12-18T00:45:55.3787614Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:55.6523531Z 2024-12-18T00:45:55.6524420Z  2024-12-18T00:45:55.6524948Z  2024-12-18T00:45:55.6525341Z  2024-12-18T00:45:55.6525727Z  2024-12-18T00:45:55.6526122Z  2024-12-18T00:45:55.6526508Z  2024-12-18T00:45:55.6526874Z  2024-12-18T00:45:55.6527371Z  2024-12-18T00:45:55.6528300Z [11,570 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:55.6529341Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:45:55.6530469Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:45:55.6531246Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:55.6531979Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:55.6532582Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:55.6533239Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local 2024-12-18T00:45:55.6533841Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:55.6534447Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:55.9783552Z 2024-12-18T00:45:55.9784761Z  2024-12-18T00:45:55.9785245Z  2024-12-18T00:45:55.9785639Z  2024-12-18T00:45:55.9786007Z  2024-12-18T00:45:55.9786407Z  2024-12-18T00:45:55.9786805Z  2024-12-18T00:45:55.9787220Z  2024-12-18T00:45:55.9787597Z  2024-12-18T00:45:55.9788536Z [11,572 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:55.9789586Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:45:55.9790397Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2024-12-18T00:45:55.9791115Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:55.9791752Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:55.9792354Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:55.9793023Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local 2024-12-18T00:45:55.9793676Z @onednn//:onednn_autogen; 7s local 2024-12-18T00:45:55.9794298Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:45:56.5821731Z 2024-12-18T00:45:56.5822610Z  2024-12-18T00:45:56.5823080Z  2024-12-18T00:45:56.5823484Z  2024-12-18T00:45:56.5823868Z  2024-12-18T00:45:56.5824268Z  2024-12-18T00:45:56.5824679Z  2024-12-18T00:45:56.5825090Z  2024-12-18T00:45:56.5825478Z  2024-12-18T00:45:56.5826400Z [11,573 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:56.5827517Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:45:56.5828367Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:56.5829111Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:56.5829695Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:56.5830234Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:56.5830819Z Compiling src/cpu/rnn/ref_rnn.cpp; 8s local 2024-12-18T00:45:56.5831439Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:56.5832062Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:56.9417007Z 2024-12-18T00:45:56.9417899Z  2024-12-18T00:45:56.9418380Z  2024-12-18T00:45:56.9418787Z  2024-12-18T00:45:56.9419181Z  2024-12-18T00:45:56.9419596Z  2024-12-18T00:45:56.9419937Z  2024-12-18T00:45:56.9420432Z  2024-12-18T00:45:56.9420826Z  2024-12-18T00:45:56.9421753Z [11,578 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:56.9422873Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:45:56.9423734Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:56.9424394Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:56.9425005Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:56.9425630Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:56.9426303Z Compiling src/cpu/rnn/ref_rnn.cpp; 8s local 2024-12-18T00:45:56.9426983Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:56.9427644Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:57.1569714Z 2024-12-18T00:45:57.1570555Z  2024-12-18T00:45:57.1570984Z  2024-12-18T00:45:57.1571317Z  2024-12-18T00:45:57.1571665Z  2024-12-18T00:45:57.1572017Z  2024-12-18T00:45:57.1572367Z  2024-12-18T00:45:57.1572692Z  2024-12-18T00:45:57.1573033Z  2024-12-18T00:45:57.1574026Z [11,580 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:57.1575143Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:45:57.1575898Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:57.1576623Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:45:57.1577143Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:57.1577671Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.1578228Z Compiling src/cpu/rnn/ref_rnn.cpp; 8s local 2024-12-18T00:45:57.1578977Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:45:57.1579471Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:57.3793328Z 2024-12-18T00:45:57.3794208Z  2024-12-18T00:45:57.3794690Z  2024-12-18T00:45:57.3795099Z  2024-12-18T00:45:57.3795515Z  2024-12-18T00:45:57.3795929Z  2024-12-18T00:45:57.3796329Z  2024-12-18T00:45:57.3796735Z  2024-12-18T00:45:57.3797140Z  2024-12-18T00:45:57.3798160Z [11,583 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:57.3799195Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:45:57.3800048Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2024-12-18T00:45:57.3800789Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:57.3801419Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:57.3802044Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.3802715Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2024-12-18T00:45:57.3803397Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.3804028Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:57.6281496Z 2024-12-18T00:45:57.6282454Z  2024-12-18T00:45:57.6282885Z  2024-12-18T00:45:57.6283284Z  2024-12-18T00:45:57.6283686Z  2024-12-18T00:45:57.6284080Z  2024-12-18T00:45:57.6284464Z  2024-12-18T00:45:57.6284860Z  2024-12-18T00:45:57.6285286Z  2024-12-18T00:45:57.6286203Z [11,585 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:57.6287209Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:45:57.6287970Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:57.6288668Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:57.6289247Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:57.6289846Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.6290483Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2024-12-18T00:45:57.6291098Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.6291678Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:45:57.9303049Z 2024-12-18T00:45:57.9303918Z  2024-12-18T00:45:57.9304408Z  2024-12-18T00:45:57.9304826Z  2024-12-18T00:45:57.9305242Z  2024-12-18T00:45:57.9305635Z  2024-12-18T00:45:57.9306076Z  2024-12-18T00:45:57.9306494Z  2024-12-18T00:45:57.9306896Z  2024-12-18T00:45:57.9307843Z [11,586 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:57.9308899Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:45:57.9309753Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:57.9310492Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:57.9311126Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.9311922Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2024-12-18T00:45:57.9312568Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.9313135Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:57.9313926Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local ... 2024-12-18T00:45:58.1577817Z 2024-12-18T00:45:58.1578699Z  2024-12-18T00:45:58.1579172Z  2024-12-18T00:45:58.1579588Z  2024-12-18T00:45:58.1579994Z  2024-12-18T00:45:58.1580645Z  2024-12-18T00:45:58.1581030Z  2024-12-18T00:45:58.1581420Z  2024-12-18T00:45:58.1581798Z  2024-12-18T00:45:58.1582928Z [11,587 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:58.1583991Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:45:58.1584775Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:58.1585471Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:45:58.1586141Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:58.1586887Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2024-12-18T00:45:58.1587539Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:58.1588100Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:58.1588935Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local ... 2024-12-18T00:45:58.3801738Z 2024-12-18T00:45:58.3802590Z  2024-12-18T00:45:58.3803085Z  2024-12-18T00:45:58.3803527Z  2024-12-18T00:45:58.3803914Z  2024-12-18T00:45:58.3804277Z  2024-12-18T00:45:58.3804650Z  2024-12-18T00:45:58.3805006Z  2024-12-18T00:45:58.3805347Z  2024-12-18T00:45:58.3806280Z [11,588 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:58.3807264Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:45:58.3808086Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2024-12-18T00:45:58.3808769Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:58.3809417Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2024-12-18T00:45:58.3810089Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:58.3810784Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:58.3811562Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:45:58.3812508Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local ... 2024-12-18T00:45:58.5806198Z 2024-12-18T00:45:58.5807030Z  2024-12-18T00:45:58.5807504Z  2024-12-18T00:45:58.5807891Z  2024-12-18T00:45:58.5808301Z  2024-12-18T00:45:58.5808712Z  2024-12-18T00:45:58.5809148Z  2024-12-18T00:45:58.5809673Z  2024-12-18T00:45:58.5810045Z  2024-12-18T00:45:58.5810973Z [11,590 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:58.5812004Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:45:58.5812844Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:58.5813559Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:58.5814166Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2024-12-18T00:45:58.5814806Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:58.5815389Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:58.5816144Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:45:58.5817284Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local ... 2024-12-18T00:45:58.9811865Z 2024-12-18T00:45:58.9812677Z  2024-12-18T00:45:58.9813143Z  2024-12-18T00:45:58.9813557Z  2024-12-18T00:45:58.9813935Z  2024-12-18T00:45:58.9814334Z  2024-12-18T00:45:58.9814739Z  2024-12-18T00:45:58.9815129Z  2024-12-18T00:45:58.9815471Z  2024-12-18T00:45:58.9816379Z [11,591 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:58.9817533Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:45:58.9818322Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:58.9818996Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:58.9819590Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2024-12-18T00:45:58.9820181Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:58.9820710Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:58.9821771Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2024-12-18T00:45:58.9822769Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local ... 2024-12-18T00:45:59.1815900Z 2024-12-18T00:45:59.1817162Z  2024-12-18T00:45:59.1817733Z  2024-12-18T00:45:59.1818113Z  2024-12-18T00:45:59.1818472Z  2024-12-18T00:45:59.1818825Z  2024-12-18T00:45:59.1819241Z  2024-12-18T00:45:59.1819611Z  2024-12-18T00:45:59.1820001Z  2024-12-18T00:45:59.1821104Z [11,592 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:45:59.1822234Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:45:59.1823061Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:59.1823773Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:45:59.1824422Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:45:59.1825087Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:59.1825685Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:59.1826448Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:59.1827513Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local ... 2024-12-18T00:45:59.4186898Z 2024-12-18T00:45:59.4187805Z  2024-12-18T00:45:59.4188277Z  2024-12-18T00:45:59.4188676Z  2024-12-18T00:45:59.4189050Z  2024-12-18T00:45:59.4189412Z  2024-12-18T00:45:59.4189782Z  2024-12-18T00:45:59.4190153Z  2024-12-18T00:45:59.4190591Z  2024-12-18T00:45:59.4191489Z [11,597 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:59.4192476Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:45:59.4193299Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2024-12-18T00:45:59.4194052Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:45:59.4194701Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:45:59.4195305Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:59.4196088Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:59.4197120Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:45:59.4198013Z Compiling src/cpu/simple_resampling.cpp; 8s local ... 2024-12-18T00:45:59.6627980Z 2024-12-18T00:45:59.6628849Z  2024-12-18T00:45:59.6629266Z  2024-12-18T00:45:59.6629618Z  2024-12-18T00:45:59.6630007Z  2024-12-18T00:45:59.6630365Z  2024-12-18T00:45:59.6630736Z  2024-12-18T00:45:59.6631108Z  2024-12-18T00:45:59.6631523Z  2024-12-18T00:45:59.6632397Z [11,598 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:59.6633407Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:45:59.6634213Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:45:59.6634799Z @onednn//:onednn_autogen; 14s local 2024-12-18T00:45:59.6635332Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:45:59.6635864Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:45:59.6636516Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:59.6637320Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:45:59.6638056Z Compiling src/cpu/simple_resampling.cpp; 9s local ... 2024-12-18T00:45:59.9074310Z 2024-12-18T00:45:59.9075180Z  2024-12-18T00:45:59.9075639Z  2024-12-18T00:45:59.9076049Z  2024-12-18T00:45:59.9076435Z  2024-12-18T00:45:59.9076819Z  2024-12-18T00:45:59.9077197Z  2024-12-18T00:45:59.9077568Z  2024-12-18T00:45:59.9077926Z  2024-12-18T00:45:59.9078862Z [11,602 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:45:59.9080121Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:45:59.9080924Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:45:59.9081678Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:45:59.9082674Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2024-12-18T00:45:59.9083659Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:45:59.9084518Z Compiling src/cpu/simple_resampling.cpp; 9s local 2024-12-18T00:45:59.9085199Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:45:59.9086261Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local ... 2024-12-18T00:46:00.1603288Z 2024-12-18T00:46:00.1604138Z  2024-12-18T00:46:00.1604607Z  2024-12-18T00:46:00.1605035Z  2024-12-18T00:46:00.1605412Z  2024-12-18T00:46:00.1605820Z  2024-12-18T00:46:00.1606215Z  2024-12-18T00:46:00.1606616Z  2024-12-18T00:46:00.1607003Z  2024-12-18T00:46:00.1607966Z [11,605 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:00.1609027Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:46:00.1609892Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:46:00.1610656Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:46:00.1611527Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:46:00.1612585Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2024-12-18T00:46:00.1613431Z Compiling src/cpu/simple_resampling.cpp; 9s local 2024-12-18T00:46:00.1614046Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:46:00.1614806Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2024-12-18T00:46:00.3826705Z 2024-12-18T00:46:00.3827569Z  2024-12-18T00:46:00.3828093Z  2024-12-18T00:46:00.3828500Z  2024-12-18T00:46:00.3828929Z  2024-12-18T00:46:00.3829388Z  2024-12-18T00:46:00.3829787Z  2024-12-18T00:46:00.3830214Z  2024-12-18T00:46:00.3830630Z  2024-12-18T00:46:00.3831714Z [11,610 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:00.3832828Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:46:00.3833694Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2024-12-18T00:46:00.3834675Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:46:00.3835570Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:46:00.3836670Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:46:00.3837636Z Compiling src/cpu/simple_resampling.cpp; 9s local 2024-12-18T00:46:00.3838383Z @onednn//:onednn_autogen; 9s local 2024-12-18T00:46:00.3839246Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2024-12-18T00:46:00.9608301Z 2024-12-18T00:46:00.9609224Z  2024-12-18T00:46:00.9609712Z  2024-12-18T00:46:00.9610089Z  2024-12-18T00:46:00.9610601Z  2024-12-18T00:46:00.9610959Z  2024-12-18T00:46:00.9611357Z  2024-12-18T00:46:00.9611831Z  2024-12-18T00:46:00.9612206Z  2024-12-18T00:46:00.9613133Z [11,611 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:00.9614120Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:46:00.9614927Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:46:00.9615686Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:46:00.9616675Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2024-12-18T00:46:00.9617650Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2024-12-18T00:46:00.9618577Z Compiling src/cpu/simple_resampling.cpp; 10s local 2024-12-18T00:46:00.9619255Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:46:00.9620361Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2024-12-18T00:46:01.1833801Z 2024-12-18T00:46:01.1834681Z  2024-12-18T00:46:01.1835166Z  2024-12-18T00:46:01.1835564Z  2024-12-18T00:46:01.1836241Z  2024-12-18T00:46:01.1836607Z  2024-12-18T00:46:01.1836947Z  2024-12-18T00:46:01.1837286Z  2024-12-18T00:46:01.1837652Z  2024-12-18T00:46:01.1838531Z [11,613 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:01.1839620Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:46:01.1840433Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:46:01.1841083Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:46:01.1841827Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:46:01.1842707Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:46:01.1843513Z Compiling src/cpu/simple_resampling.cpp; 10s local 2024-12-18T00:46:01.1844446Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:46:01.1845192Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2024-12-18T00:46:01.4212686Z 2024-12-18T00:46:01.4213940Z  2024-12-18T00:46:01.4214713Z  2024-12-18T00:46:01.4215365Z  2024-12-18T00:46:01.4216610Z  2024-12-18T00:46:01.4217121Z  2024-12-18T00:46:01.4217530Z  2024-12-18T00:46:01.4217914Z  2024-12-18T00:46:01.4218327Z  2024-12-18T00:46:01.4219361Z [11,615 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:01.4220403Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:01.4221240Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2024-12-18T00:46:01.4221989Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:46:01.4222804Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:46:01.4223817Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:46:01.4224693Z Compiling src/cpu/simple_resampling.cpp; 10s local 2024-12-18T00:46:01.4225458Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:46:01.4226273Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2024-12-18T00:46:01.7838365Z 2024-12-18T00:46:01.7839330Z  2024-12-18T00:46:01.7839813Z  2024-12-18T00:46:01.7840202Z  2024-12-18T00:46:01.7840611Z  2024-12-18T00:46:01.7840994Z  2024-12-18T00:46:01.7841460Z  2024-12-18T00:46:01.7841855Z  2024-12-18T00:46:01.7842232Z  2024-12-18T00:46:01.7843232Z [11,616 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:01.7844596Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:01.7845471Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:46:01.7846270Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:46:01.7847152Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:46:01.7848182Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:46:01.7849058Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:46:01.7849728Z @onednn//:onednn_autogen; 10s local 2024-12-18T00:46:01.7850451Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2024-12-18T00:46:01.9843333Z 2024-12-18T00:46:01.9844499Z  2024-12-18T00:46:01.9844987Z  2024-12-18T00:46:01.9845324Z  2024-12-18T00:46:01.9845667Z  2024-12-18T00:46:01.9845999Z  2024-12-18T00:46:01.9846384Z  2024-12-18T00:46:01.9846744Z  2024-12-18T00:46:01.9847109Z  2024-12-18T00:46:01.9847977Z [11,617 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:01.9848906Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:01.9849837Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:46:01.9850493Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:46:01.9851427Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2024-12-18T00:46:01.9852307Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2024-12-18T00:46:01.9853137Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:46:01.9853790Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:46:01.9854654Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2024-12-18T00:46:02.1913155Z 2024-12-18T00:46:02.1914055Z  2024-12-18T00:46:02.1914557Z  2024-12-18T00:46:02.1914976Z  2024-12-18T00:46:02.1915389Z  2024-12-18T00:46:02.1915908Z  2024-12-18T00:46:02.1916326Z  2024-12-18T00:46:02.1916733Z  2024-12-18T00:46:02.1917126Z  2024-12-18T00:46:02.1918099Z [11,620 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:02.1919181Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:02.1920028Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:46:02.1920799Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:46:02.1921660Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:46:02.1922700Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:46:02.1923635Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:46:02.1924363Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:46:02.1925212Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local ... 2024-12-18T00:46:02.3924559Z 2024-12-18T00:46:02.3925549Z  2024-12-18T00:46:02.3926043Z  2024-12-18T00:46:02.3926474Z  2024-12-18T00:46:02.3926897Z  2024-12-18T00:46:02.3927307Z  2024-12-18T00:46:02.3927761Z  2024-12-18T00:46:02.3928217Z  2024-12-18T00:46:02.3928668Z  2024-12-18T00:46:02.3929636Z [11,621 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:02.3930709Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:02.3931594Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2024-12-18T00:46:02.3932382Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:46:02.3933317Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:46:02.3934388Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:46:02.3935340Z Compiling src/cpu/simple_resampling.cpp; 11s local 2024-12-18T00:46:02.3936255Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:46:02.3937216Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:46:02.6300948Z 2024-12-18T00:46:02.6302273Z  2024-12-18T00:46:02.6302800Z  2024-12-18T00:46:02.6303198Z  2024-12-18T00:46:02.6303578Z  2024-12-18T00:46:02.6303965Z  2024-12-18T00:46:02.6304379Z  2024-12-18T00:46:02.6304782Z  2024-12-18T00:46:02.6305141Z  2024-12-18T00:46:02.6306012Z [11,623 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:02.6307049Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:02.6307885Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:46:02.6308660Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:46:02.6309542Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:46:02.6310560Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:46:02.6311442Z Compiling src/cpu/simple_resampling.cpp; 12s local 2024-12-18T00:46:02.6312327Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:46:02.6313402Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:46:02.9001130Z 2024-12-18T00:46:02.9002171Z  2024-12-18T00:46:02.9002572Z  2024-12-18T00:46:02.9002880Z  2024-12-18T00:46:02.9003449Z  2024-12-18T00:46:02.9003775Z  2024-12-18T00:46:02.9004092Z  2024-12-18T00:46:02.9004389Z  2024-12-18T00:46:02.9004704Z  2024-12-18T00:46:02.9005470Z [11,624 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:02.9006406Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:02.9007127Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:46:02.9007709Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:46:02.9008355Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2024-12-18T00:46:02.9009124Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2024-12-18T00:46:02.9009825Z Compiling src/cpu/simple_resampling.cpp; 12s local 2024-12-18T00:46:02.9010505Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2024-12-18T00:46:02.9011259Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 10s local ... 2024-12-18T00:46:03.1856611Z 2024-12-18T00:46:03.1857551Z  2024-12-18T00:46:03.1858020Z  2024-12-18T00:46:03.1858442Z  2024-12-18T00:46:03.1858843Z  2024-12-18T00:46:03.1859261Z  2024-12-18T00:46:03.1859668Z  2024-12-18T00:46:03.1860075Z  2024-12-18T00:46:03.1860468Z  2024-12-18T00:46:03.1861455Z [11,625 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:03.1862540Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:03.1863398Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2024-12-18T00:46:03.1864224Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:46:03.1865079Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:46:03.1866111Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:46:03.1867065Z Compiling src/cpu/simple_resampling.cpp; 12s local 2024-12-18T00:46:03.1868009Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:46:03.1869089Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local ... 2024-12-18T00:46:03.4936322Z 2024-12-18T00:46:03.4937378Z  2024-12-18T00:46:03.4937831Z  2024-12-18T00:46:03.4938185Z  2024-12-18T00:46:03.4938587Z  2024-12-18T00:46:03.4938949Z  2024-12-18T00:46:03.4939343Z  2024-12-18T00:46:03.4939700Z  2024-12-18T00:46:03.4940047Z  2024-12-18T00:46:03.4940903Z [11,628 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:03.4941833Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:46:03.4942595Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:46:03.4943283Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:46:03.4944064Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:46:03.4945233Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:46:03.4946047Z Compiling src/cpu/simple_resampling.cpp; 13s local 2024-12-18T00:46:03.4946854Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:46:03.4947759Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local ... 2024-12-18T00:46:03.7716685Z 2024-12-18T00:46:03.7717808Z  2024-12-18T00:46:03.7718324Z  2024-12-18T00:46:03.7718742Z  2024-12-18T00:46:03.7719171Z  2024-12-18T00:46:03.7719614Z  2024-12-18T00:46:03.7720038Z  2024-12-18T00:46:03.7720468Z  2024-12-18T00:46:03.7720890Z  2024-12-18T00:46:03.7721901Z [11,630 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:03.7723287Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:46:03.7724191Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:46:03.7725110Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:46:03.7726047Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:46:03.7727151Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:46:03.7728138Z Compiling src/cpu/simple_resampling.cpp; 13s local 2024-12-18T00:46:03.7729253Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:46:03.7730479Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local ... 2024-12-18T00:46:03.9859876Z 2024-12-18T00:46:03.9861051Z  2024-12-18T00:46:03.9861774Z  2024-12-18T00:46:03.9862402Z  2024-12-18T00:46:03.9862820Z  2024-12-18T00:46:03.9863277Z  2024-12-18T00:46:03.9863661Z  2024-12-18T00:46:03.9864080Z  2024-12-18T00:46:03.9864473Z  2024-12-18T00:46:03.9865404Z [11,635 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:03.9866558Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:46:03.9867421Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2024-12-18T00:46:03.9868230Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:46:03.9869079Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2024-12-18T00:46:03.9870184Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2024-12-18T00:46:03.9871085Z Compiling src/cpu/simple_resampling.cpp; 13s local 2024-12-18T00:46:03.9872036Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2024-12-18T00:46:03.9873089Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local ... 2024-12-18T00:46:04.4976039Z 2024-12-18T00:46:04.4977635Z  2024-12-18T00:46:04.4978142Z  2024-12-18T00:46:04.4980633Z  2024-12-18T00:46:04.4981126Z  2024-12-18T00:46:04.4981511Z  2024-12-18T00:46:04.4982058Z  2024-12-18T00:46:04.4982456Z  2024-12-18T00:46:04.4982892Z  2024-12-18T00:46:04.4983901Z [11,637 / 20,600] 1 / 17 tests; 47 actions, 46 running; last test: ...che_test 2024-12-18T00:46:04.4984993Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:46:04.4985858Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:46:04.4986656Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:46:04.4987554Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2024-12-18T00:46:04.4988610Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2024-12-18T00:46:04.4989566Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:46:04.4990495Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:46:04.4991513Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2024-12-18T00:46:04.7475807Z 2024-12-18T00:46:04.7477804Z  2024-12-18T00:46:04.7478311Z  2024-12-18T00:46:04.7478735Z  2024-12-18T00:46:04.7479155Z  2024-12-18T00:46:04.7479540Z  2024-12-18T00:46:04.7479946Z  2024-12-18T00:46:04.7480340Z  2024-12-18T00:46:04.7480735Z  2024-12-18T00:46:04.7481611Z [11,640 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:04.7482644Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:46:04.7483446Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:46:04.7484190Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:46:04.7485013Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2024-12-18T00:46:04.7485808Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:46:04.7486658Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:46:04.7487850Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2024-12-18T00:46:04.7488644Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:04.9869857Z 2024-12-18T00:46:04.9880556Z  2024-12-18T00:46:04.9881370Z  2024-12-18T00:46:04.9881800Z  2024-12-18T00:46:04.9882216Z  2024-12-18T00:46:04.9882611Z  2024-12-18T00:46:04.9883035Z  2024-12-18T00:46:04.9883450Z  2024-12-18T00:46:04.9883857Z  2024-12-18T00:46:04.9885095Z [11,643 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:04.9886222Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:46:04.9887071Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:46:04.9887879Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:46:04.9888561Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:46:04.9889423Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2024-12-18T00:46:04.9890389Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2024-12-18T00:46:04.9891484Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 10s local 2024-12-18T00:46:04.9892403Z @onednn//:mkl_dnn; 9s local ... 2024-12-18T00:46:05.3388088Z 2024-12-18T00:46:05.3389032Z  2024-12-18T00:46:05.3389525Z  2024-12-18T00:46:05.3389930Z  2024-12-18T00:46:05.3390335Z  2024-12-18T00:46:05.3390749Z  2024-12-18T00:46:05.3391209Z  2024-12-18T00:46:05.3391596Z  2024-12-18T00:46:05.3392018Z  2024-12-18T00:46:05.3392992Z [11,644 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:05.3394006Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:05.3394801Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2024-12-18T00:46:05.3395578Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:05.3396343Z Compiling src/cpu/simple_resampling.cpp; 14s local 2024-12-18T00:46:05.3397270Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:46:05.3398260Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2024-12-18T00:46:05.3399320Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 10s local 2024-12-18T00:46:05.3400203Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:05.5873810Z 2024-12-18T00:46:05.5875055Z  2024-12-18T00:46:05.5875594Z  2024-12-18T00:46:05.5875971Z  2024-12-18T00:46:05.5876348Z  2024-12-18T00:46:05.5876754Z  2024-12-18T00:46:05.5877143Z  2024-12-18T00:46:05.5877551Z  2024-12-18T00:46:05.5877941Z  2024-12-18T00:46:05.5878853Z [11,649 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:05.5879884Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:05.5880752Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:46:05.5881541Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:05.5882283Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:46:05.5883161Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:46:05.5884249Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2024-12-18T00:46:05.5885383Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 10s local 2024-12-18T00:46:05.5886240Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:05.8447140Z 2024-12-18T00:46:05.8448076Z  2024-12-18T00:46:05.8448558Z  2024-12-18T00:46:05.8449006Z  2024-12-18T00:46:05.8449394Z  2024-12-18T00:46:05.8449773Z  2024-12-18T00:46:05.8450147Z  2024-12-18T00:46:05.8450513Z  2024-12-18T00:46:05.8450904Z  2024-12-18T00:46:05.8451837Z [11,650 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:05.8453073Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:05.8454014Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:46:05.8454769Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:05.8455421Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:46:05.8456260Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:46:05.8457483Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2024-12-18T00:46:05.8458555Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2024-12-18T00:46:05.8459394Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:06.0697175Z 2024-12-18T00:46:06.0698108Z  2024-12-18T00:46:06.0698541Z  2024-12-18T00:46:06.0698909Z  2024-12-18T00:46:06.0699256Z  2024-12-18T00:46:06.0699618Z  2024-12-18T00:46:06.0700012Z  2024-12-18T00:46:06.0700401Z  2024-12-18T00:46:06.0700812Z  2024-12-18T00:46:06.0701807Z [11,653 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:06.0702820Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:06.0703683Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:46:06.0704379Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:06.0705065Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:46:06.0705897Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2024-12-18T00:46:06.0706945Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2024-12-18T00:46:06.0707941Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2024-12-18T00:46:06.0708753Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:06.3881713Z 2024-12-18T00:46:06.3883141Z  2024-12-18T00:46:06.3883682Z  2024-12-18T00:46:06.3884069Z  2024-12-18T00:46:06.3884432Z  2024-12-18T00:46:06.3884830Z  2024-12-18T00:46:06.3885240Z  2024-12-18T00:46:06.3885630Z  2024-12-18T00:46:06.3886027Z  2024-12-18T00:46:06.3886988Z [11,653 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:06.3888030Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:06.3888820Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2024-12-18T00:46:06.3889575Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:06.3890345Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:46:06.3891223Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 15s local 2024-12-18T00:46:06.3892180Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2024-12-18T00:46:06.3893210Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2024-12-18T00:46:06.3894110Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:46:06.6192241Z 2024-12-18T00:46:06.6193184Z  2024-12-18T00:46:06.6193624Z  2024-12-18T00:46:06.6193994Z  2024-12-18T00:46:06.6194403Z  2024-12-18T00:46:06.6194804Z  2024-12-18T00:46:06.6195209Z  2024-12-18T00:46:06.6195612Z  2024-12-18T00:46:06.6195943Z  2024-12-18T00:46:06.6196857Z [11,659 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:06.6197884Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:06.6198712Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:46:06.6199409Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:06.6200163Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:06.6201057Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 15s local 2024-12-18T00:46:06.6202027Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2024-12-18T00:46:06.6203375Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2024-12-18T00:46:06.6204244Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:46:06.8302638Z 2024-12-18T00:46:06.8304354Z  2024-12-18T00:46:06.8304890Z  2024-12-18T00:46:06.8305306Z  2024-12-18T00:46:06.8305728Z  2024-12-18T00:46:06.8306094Z  2024-12-18T00:46:06.8306478Z  2024-12-18T00:46:06.8306855Z  2024-12-18T00:46:06.8307231Z  2024-12-18T00:46:06.8308341Z [11,665 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:06.8309427Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:06.8310243Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:46:06.8310996Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:06.8311755Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:06.8312627Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2024-12-18T00:46:06.8313659Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2024-12-18T00:46:06.8314518Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:06.8315075Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:46:07.0729733Z 2024-12-18T00:46:07.0730650Z  2024-12-18T00:46:07.0731199Z  2024-12-18T00:46:07.0731571Z  2024-12-18T00:46:07.0731970Z  2024-12-18T00:46:07.0732349Z  2024-12-18T00:46:07.0732733Z  2024-12-18T00:46:07.0733175Z  2024-12-18T00:46:07.0733567Z  2024-12-18T00:46:07.0734529Z [11,668 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:07.0735563Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:07.0736408Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:46:07.0737251Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:07.0737878Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:07.0738734Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2024-12-18T00:46:07.0739717Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2024-12-18T00:46:07.0740398Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:07.0740924Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:46:07.3889866Z 2024-12-18T00:46:07.3891293Z  2024-12-18T00:46:07.3891836Z  2024-12-18T00:46:07.3893294Z  2024-12-18T00:46:07.3894248Z  2024-12-18T00:46:07.3895472Z  2024-12-18T00:46:07.3896955Z  2024-12-18T00:46:07.3898289Z  2024-12-18T00:46:07.3899502Z  2024-12-18T00:46:07.3901244Z [11,670 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:07.3902258Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:07.3903120Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2024-12-18T00:46:07.3903926Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:46:07.3904694Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:07.3905615Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:07.3906694Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2024-12-18T00:46:07.3907609Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:07.3908177Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:46:07.5894129Z 2024-12-18T00:46:07.5896352Z  2024-12-18T00:46:07.5896996Z  2024-12-18T00:46:07.5897542Z  2024-12-18T00:46:07.5897937Z  2024-12-18T00:46:07.5898316Z  2024-12-18T00:46:07.5898698Z  2024-12-18T00:46:07.5899082Z  2024-12-18T00:46:07.5899464Z  2024-12-18T00:46:07.5900408Z [11,672 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:07.5901710Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:07.5902511Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:46:07.5903281Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:46:07.5904164Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:46:07.5905031Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:07.5906047Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2024-12-18T00:46:07.5906882Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:07.5907849Z Compiling src/cpu/x64/gemm/f32/jit_avx_gemm_f32.cpp; 11s local ... 2024-12-18T00:46:07.8227875Z 2024-12-18T00:46:07.8228837Z  2024-12-18T00:46:07.8229262Z  2024-12-18T00:46:07.8229645Z  2024-12-18T00:46:07.8230077Z  2024-12-18T00:46:07.8230499Z  2024-12-18T00:46:07.8230921Z  2024-12-18T00:46:07.8231281Z  2024-12-18T00:46:07.8231694Z  2024-12-18T00:46:07.8232705Z [11,677 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:07.8233747Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:07.8234612Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:46:07.8235392Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:46:07.8236164Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:46:07.8237066Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:07.8238164Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 13s local 2024-12-18T00:46:07.8239032Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:07.8239580Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:08.1900868Z 2024-12-18T00:46:08.1902274Z  2024-12-18T00:46:08.1902756Z  2024-12-18T00:46:08.1904332Z  2024-12-18T00:46:08.1905385Z  2024-12-18T00:46:08.1906578Z  2024-12-18T00:46:08.1907968Z  2024-12-18T00:46:08.1909296Z  2024-12-18T00:46:08.1910580Z  2024-12-18T00:46:08.1912268Z [11,679 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:08.1913428Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:08.1914279Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2024-12-18T00:46:08.1915064Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:08.1915869Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:46:08.1916770Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:08.1917467Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:08.1917964Z @onednn//:mkl_dnn; 10s local 2024-12-18T00:46:08.1918444Z @onednn//:mkl_dnn; 9s local ... 2024-12-18T00:46:08.4714248Z 2024-12-18T00:46:08.4715153Z  2024-12-18T00:46:08.4715679Z  2024-12-18T00:46:08.4716066Z  2024-12-18T00:46:08.4716471Z  2024-12-18T00:46:08.4716936Z  2024-12-18T00:46:08.4717259Z  2024-12-18T00:46:08.4717613Z  2024-12-18T00:46:08.4717969Z  2024-12-18T00:46:08.4718874Z [11,681 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:08.4719829Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:46:08.4720601Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:46:08.4721304Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:08.4722039Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:08.4722849Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:08.4723573Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:08.4724084Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:08.4724540Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:08.6919198Z 2024-12-18T00:46:08.6920106Z  2024-12-18T00:46:08.6920594Z  2024-12-18T00:46:08.6921253Z  2024-12-18T00:46:08.6921656Z  2024-12-18T00:46:08.6922038Z  2024-12-18T00:46:08.6922417Z  2024-12-18T00:46:08.6922780Z  2024-12-18T00:46:08.6923161Z  2024-12-18T00:46:08.6924265Z [11,687 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:08.6925328Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:46:08.6926136Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:46:08.6927027Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:08.6927849Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:08.6928704Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:08.6929459Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:08.6929979Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:08.6930489Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:08.9472078Z 2024-12-18T00:46:08.9472936Z  2024-12-18T00:46:08.9473370Z  2024-12-18T00:46:08.9473738Z  2024-12-18T00:46:08.9474099Z  2024-12-18T00:46:08.9474459Z  2024-12-18T00:46:08.9474829Z  2024-12-18T00:46:08.9475219Z  2024-12-18T00:46:08.9475571Z  2024-12-18T00:46:08.9476419Z [11,690 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:08.9477321Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:46:08.9478027Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:46:08.9478694Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:08.9479320Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:08.9480062Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:08.9480734Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:08.9481199Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:08.9481669Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:09.1753380Z 2024-12-18T00:46:09.1754400Z  2024-12-18T00:46:09.1754851Z  2024-12-18T00:46:09.1755226Z  2024-12-18T00:46:09.1755591Z  2024-12-18T00:46:09.1755981Z  2024-12-18T00:46:09.1756384Z  2024-12-18T00:46:09.1756776Z  2024-12-18T00:46:09.1757158Z  2024-12-18T00:46:09.1758550Z [11,699 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:09.1759736Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:46:09.1760702Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:46:09.1761499Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:09.1762346Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:09.1763250Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:09.1764078Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:09.1764710Z @onednn//:mkl_dnn; 10s local 2024-12-18T00:46:09.1765356Z @onednn//:mkl_dnn; 9s local ... 2024-12-18T00:46:09.3910998Z 2024-12-18T00:46:09.3912003Z  2024-12-18T00:46:09.3912496Z  2024-12-18T00:46:09.3912924Z  2024-12-18T00:46:09.3913379Z  2024-12-18T00:46:09.3913799Z  2024-12-18T00:46:09.3914190Z  2024-12-18T00:46:09.3914558Z  2024-12-18T00:46:09.3914921Z  2024-12-18T00:46:09.3915836Z [11,700 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:09.3916871Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:09.3917693Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2024-12-18T00:46:09.3918386Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:09.3919110Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:09.3919989Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:09.3920762Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:09.3921610Z @onednn//:mkl_dnn; 10s local 2024-12-18T00:46:09.3922073Z @onednn//:mkl_dnn; 9s local ... 2024-12-18T00:46:09.5940165Z 2024-12-18T00:46:09.5941127Z  2024-12-18T00:46:09.5941905Z  2024-12-18T00:46:09.5942361Z  2024-12-18T00:46:09.5942777Z  2024-12-18T00:46:09.5943187Z  2024-12-18T00:46:09.5943625Z  2024-12-18T00:46:09.5944000Z  2024-12-18T00:46:09.5944597Z  2024-12-18T00:46:09.5945685Z [11,701 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:09.5946925Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:09.5947721Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:46:09.5948432Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:09.5949122Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:46:09.5949889Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:09.5950608Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:09.5951082Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:09.5951600Z @onednn//:mkl_dnn; 9s local ... 2024-12-18T00:46:09.9916633Z 2024-12-18T00:46:09.9917628Z  2024-12-18T00:46:09.9918144Z  2024-12-18T00:46:09.9918592Z  2024-12-18T00:46:09.9919029Z  2024-12-18T00:46:09.9919449Z  2024-12-18T00:46:09.9919844Z  2024-12-18T00:46:09.9920263Z  2024-12-18T00:46:09.9920686Z  2024-12-18T00:46:09.9921704Z [11,703 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:09.9922691Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:09.9923488Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:46:09.9924222Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:09.9924947Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:46:09.9925844Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:09.9926556Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:09.9927081Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:09.9927611Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:10.1920409Z 2024-12-18T00:46:10.1921423Z  2024-12-18T00:46:10.1921917Z  2024-12-18T00:46:10.1922321Z  2024-12-18T00:46:10.1922736Z  2024-12-18T00:46:10.1923127Z  2024-12-18T00:46:10.1923571Z  2024-12-18T00:46:10.1923977Z  2024-12-18T00:46:10.1924327Z  2024-12-18T00:46:10.1925388Z [11,708 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:10.1926408Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:10.1927188Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2024-12-18T00:46:10.1927932Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:10.1928640Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:46:10.1929471Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:10.1930207Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:10.1930749Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:10.1931281Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:10.4472717Z 2024-12-18T00:46:10.4473661Z  2024-12-18T00:46:10.4474153Z  2024-12-18T00:46:10.4474576Z  2024-12-18T00:46:10.4474995Z  2024-12-18T00:46:10.4475416Z  2024-12-18T00:46:10.4475853Z  2024-12-18T00:46:10.4476251Z  2024-12-18T00:46:10.4476612Z  2024-12-18T00:46:10.4477541Z [11,711 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:10.4478530Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:10.4479320Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:10.4480043Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:10.4481011Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:46:10.4481800Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2024-12-18T00:46:10.4482622Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:10.4483127Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:10.4483628Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:10.7789218Z 2024-12-18T00:46:10.7790208Z  2024-12-18T00:46:10.7790718Z  2024-12-18T00:46:10.7791131Z  2024-12-18T00:46:10.7791547Z  2024-12-18T00:46:10.7792349Z  2024-12-18T00:46:10.7792789Z  2024-12-18T00:46:10.7793200Z  2024-12-18T00:46:10.7793620Z  2024-12-18T00:46:10.7794583Z [11,713 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:10.7795574Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:10.7796311Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:10.7797091Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:10.7797841Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:10.7798737Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2024-12-18T00:46:10.7799540Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:10.7800097Z @onednn//:mkl_dnn; 10s local 2024-12-18T00:46:10.7800846Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2024-12-18T00:46:10.9908720Z 2024-12-18T00:46:10.9909674Z  2024-12-18T00:46:10.9910251Z  2024-12-18T00:46:10.9910713Z  2024-12-18T00:46:10.9911143Z  2024-12-18T00:46:10.9911546Z  2024-12-18T00:46:10.9911954Z  2024-12-18T00:46:10.9912386Z  2024-12-18T00:46:10.9912808Z  2024-12-18T00:46:10.9913804Z [11,716 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:10.9914725Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:10.9915473Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:10.9916201Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:10.9916952Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:10.9917788Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2024-12-18T00:46:10.9918566Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:10.9919096Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:10.9919848Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2024-12-18T00:46:11.1928656Z 2024-12-18T00:46:11.1929651Z  2024-12-18T00:46:11.1930140Z  2024-12-18T00:46:11.1930584Z  2024-12-18T00:46:11.1931016Z  2024-12-18T00:46:11.1931421Z  2024-12-18T00:46:11.1931880Z  2024-12-18T00:46:11.1932258Z  2024-12-18T00:46:11.1932657Z  2024-12-18T00:46:11.1933653Z [11,719 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:11.1934720Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:11.1935585Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:11.1936388Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:11.1937342Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:11.1938258Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2024-12-18T00:46:11.1939096Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:11.1939681Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:11.1940517Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 10s local ... 2024-12-18T00:46:11.3933639Z 2024-12-18T00:46:11.3934957Z  2024-12-18T00:46:11.3935448Z  2024-12-18T00:46:11.3935879Z  2024-12-18T00:46:11.3936285Z  2024-12-18T00:46:11.3936833Z  2024-12-18T00:46:11.3937235Z  2024-12-18T00:46:11.3937644Z  2024-12-18T00:46:11.3938053Z  2024-12-18T00:46:11.3939281Z [11,720 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:11.3940374Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:11.3941360Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2024-12-18T00:46:11.3942061Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:11.3942755Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:11.3943619Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:11.3945169Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:11.3945725Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:11.3946301Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:46:11.5951527Z 2024-12-18T00:46:11.5953519Z  2024-12-18T00:46:11.5954022Z  2024-12-18T00:46:11.5955236Z  2024-12-18T00:46:11.5956508Z  2024-12-18T00:46:11.5957836Z  2024-12-18T00:46:11.5959099Z  2024-12-18T00:46:11.5960369Z  2024-12-18T00:46:11.5961691Z  2024-12-18T00:46:11.5963567Z [11,723 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:11.5964632Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:11.5965494Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:11.5966282Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:11.5966938Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:11.5967734Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:11.5968444Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:11.5968894Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:11.5969359Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:46:11.8275490Z 2024-12-18T00:46:11.8276921Z  2024-12-18T00:46:11.8277405Z  2024-12-18T00:46:11.8277806Z  2024-12-18T00:46:11.8278252Z  2024-12-18T00:46:11.8278706Z  2024-12-18T00:46:11.8279175Z  2024-12-18T00:46:11.8279548Z  2024-12-18T00:46:11.8279922Z  2024-12-18T00:46:11.8280838Z [11,726 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:11.8281887Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:11.8282720Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:11.8283534Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:11.8284312Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:11.8285216Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:11.8285970Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:11.8286441Z @onednn//:mkl_dnn; 11s local 2024-12-18T00:46:11.8286927Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:46:12.0620322Z 2024-12-18T00:46:12.0621733Z  2024-12-18T00:46:12.0622254Z  2024-12-18T00:46:12.0622726Z  2024-12-18T00:46:12.0623167Z  2024-12-18T00:46:12.0623557Z  2024-12-18T00:46:12.0623981Z  2024-12-18T00:46:12.0624430Z  2024-12-18T00:46:12.0624857Z  2024-12-18T00:46:12.0625821Z [11,730 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:12.0626849Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:12.0627613Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:12.0628204Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:12.0628868Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:12.0629701Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:12.0630445Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:12.0630958Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:46:12.0631705Z Compiling src/cpu/reorder/cpu_reorder_regular_u8.cpp; 7s local ... 2024-12-18T00:46:12.2930497Z 2024-12-18T00:46:12.2933095Z  2024-12-18T00:46:12.2933550Z  2024-12-18T00:46:12.2933937Z  2024-12-18T00:46:12.2934317Z  2024-12-18T00:46:12.2934712Z  2024-12-18T00:46:12.2935083Z  2024-12-18T00:46:12.2935774Z  2024-12-18T00:46:12.2936167Z  2024-12-18T00:46:12.2937265Z [11,735 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:12.2938289Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:12.2939302Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2024-12-18T00:46:12.2940258Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:46:12.2940991Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:12.2941860Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:12.2942649Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:12.2943153Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:46:12.2943762Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:46:12.5942919Z 2024-12-18T00:46:12.5943873Z  2024-12-18T00:46:12.5944981Z  2024-12-18T00:46:12.5945429Z  2024-12-18T00:46:12.5945792Z  2024-12-18T00:46:12.5946200Z  2024-12-18T00:46:12.5946609Z  2024-12-18T00:46:12.5947010Z  2024-12-18T00:46:12.5947409Z  2024-12-18T00:46:12.5948379Z [11,736 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:12.5949496Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:12.5950366Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:46:12.5951142Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:46:12.5951879Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:46:12.5952744Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2024-12-18T00:46:12.5953505Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:12.5954083Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:46:12.5954686Z @onednn//:onednn_autogen; 7s local ... 2024-12-18T00:46:12.8727277Z 2024-12-18T00:46:12.8728263Z  2024-12-18T00:46:12.8728793Z  2024-12-18T00:46:12.8729175Z  2024-12-18T00:46:12.8729560Z  2024-12-18T00:46:12.8730021Z  2024-12-18T00:46:12.8730389Z  2024-12-18T00:46:12.8730757Z  2024-12-18T00:46:12.8731125Z  2024-12-18T00:46:12.8732190Z [11,744 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:12.8733277Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:12.8734079Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:46:12.8734885Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:46:12.8735635Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:46:12.8736281Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:46:12.8736958Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:46:12.8737655Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 6s local 2024-12-18T00:46:12.8738550Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 6s local ... 2024-12-18T00:46:13.1187240Z 2024-12-18T00:46:13.1188690Z  2024-12-18T00:46:13.1189161Z  2024-12-18T00:46:13.1189557Z  2024-12-18T00:46:13.1189936Z  2024-12-18T00:46:13.1190331Z  2024-12-18T00:46:13.1190729Z  2024-12-18T00:46:13.1191124Z  2024-12-18T00:46:13.1191499Z  2024-12-18T00:46:13.1192349Z [11,746 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:13.1193321Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:13.1194091Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:46:13.1194828Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:46:13.1195512Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:46:13.1196459Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:13.1197033Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:46:13.1197753Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 6s local 2024-12-18T00:46:13.1198825Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 6s local ... 2024-12-18T00:46:13.3950454Z 2024-12-18T00:46:13.3952695Z  2024-12-18T00:46:13.3954362Z  2024-12-18T00:46:13.3955821Z  2024-12-18T00:46:13.3957315Z  2024-12-18T00:46:13.3958770Z  2024-12-18T00:46:13.3960271Z  2024-12-18T00:46:13.3962320Z  2024-12-18T00:46:13.3963829Z  2024-12-18T00:46:13.3965843Z [11,748 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:13.3967204Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:13.3968263Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2024-12-18T00:46:13.3969232Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:13.3970206Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:46:13.3971119Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:13.3972287Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:46:13.3973132Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 6s local 2024-12-18T00:46:13.3974060Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 6s local ... 2024-12-18T00:46:13.6335539Z 2024-12-18T00:46:13.6336423Z  2024-12-18T00:46:13.6337130Z  2024-12-18T00:46:13.6338572Z  2024-12-18T00:46:13.6339431Z  2024-12-18T00:46:13.6340135Z  2024-12-18T00:46:13.6340596Z  2024-12-18T00:46:13.6341033Z  2024-12-18T00:46:13.6341492Z  2024-12-18T00:46:13.6342504Z [11,753 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:13.6343632Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:13.6344764Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:46:13.6345618Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:13.6346430Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:46:13.6347185Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:13.6347751Z @onednn//:onednn_autogen; 8s local 2024-12-18T00:46:13.6348521Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 6s local 2024-12-18T00:46:13.6349517Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 6s local ... 2024-12-18T00:46:13.8554191Z 2024-12-18T00:46:13.8555206Z  2024-12-18T00:46:13.8555737Z  2024-12-18T00:46:13.8556134Z  2024-12-18T00:46:13.8556526Z  2024-12-18T00:46:13.8556922Z  2024-12-18T00:46:13.8557305Z  2024-12-18T00:46:13.8557698Z  2024-12-18T00:46:13.8558093Z  2024-12-18T00:46:13.8558998Z [11,758 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:13.8559974Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:13.8560801Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:46:13.8561489Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:13.8562209Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:46:13.8562954Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local 2024-12-18T00:46:13.8563722Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 7s local 2024-12-18T00:46:13.8564591Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 6s local 2024-12-18T00:46:13.8565669Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 6s local ... 2024-12-18T00:46:14.0764999Z 2024-12-18T00:46:14.0766003Z  2024-12-18T00:46:14.0766507Z  2024-12-18T00:46:14.0766966Z  2024-12-18T00:46:14.0767406Z  2024-12-18T00:46:14.0767820Z  2024-12-18T00:46:14.0768226Z  2024-12-18T00:46:14.0768567Z  2024-12-18T00:46:14.0768926Z  2024-12-18T00:46:14.0770107Z [11,761 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:14.0771173Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:14.0772143Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:46:14.0772927Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:14.0773701Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:46:14.0774565Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local 2024-12-18T00:46:14.0775699Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 7s local 2024-12-18T00:46:14.0776953Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 6s local 2024-12-18T00:46:14.0778160Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 6s local ... 2024-12-18T00:46:14.3009214Z 2024-12-18T00:46:14.3010116Z  2024-12-18T00:46:14.3010595Z  2024-12-18T00:46:14.3010988Z  2024-12-18T00:46:14.3011388Z  2024-12-18T00:46:14.3011784Z  2024-12-18T00:46:14.3012154Z  2024-12-18T00:46:14.3012539Z  2024-12-18T00:46:14.3012950Z  2024-12-18T00:46:14.3013900Z [11,764 / 20,600] 1 / 17 tests; 48 actions, 47 running; last test: ...che_test 2024-12-18T00:46:14.3014931Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:46:14.3015718Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2024-12-18T00:46:14.3016604Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:46:14.3017354Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:46:14.3018292Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local 2024-12-18T00:46:14.3019197Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 7s local 2024-12-18T00:46:14.3020175Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 6s local 2024-12-18T00:46:14.3021287Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 6s local ... 2024-12-18T00:46:14.5960299Z 2024-12-18T00:46:14.5961206Z  2024-12-18T00:46:14.5961759Z  2024-12-18T00:46:14.5962190Z  2024-12-18T00:46:14.5962607Z  2024-12-18T00:46:14.5963005Z  2024-12-18T00:46:14.5963439Z  2024-12-18T00:46:14.5963866Z  2024-12-18T00:46:14.5964286Z  2024-12-18T00:46:14.5965270Z [11,765 / 20,600] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:14.5966397Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:46:14.5967325Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:14.5968153Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:46:14.5968974Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:14.5969883Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local 2024-12-18T00:46:14.5970963Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 7s local 2024-12-18T00:46:14.5972008Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 7s local 2024-12-18T00:46:14.5973124Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 7s local ... 2024-12-18T00:46:14.7964222Z 2024-12-18T00:46:14.7966504Z  2024-12-18T00:46:14.7967023Z  2024-12-18T00:46:14.7967481Z  2024-12-18T00:46:14.7967923Z  2024-12-18T00:46:14.7969657Z  2024-12-18T00:46:14.7970126Z  2024-12-18T00:46:14.7971686Z  2024-12-18T00:46:14.7972151Z  2024-12-18T00:46:14.7974385Z [11,773 / 20,601] 1 / 17 tests; 48 actions running; last test: ...e:cache_test 2024-12-18T00:46:14.7975538Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:46:14.7976431Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:14.7977473Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:46:14.7978272Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:14.7979190Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2024-12-18T00:46:14.7980461Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 8s local 2024-12-18T00:46:14.7981632Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 7s local 2024-12-18T00:46:14.7982728Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 7s local ... 2024-12-18T00:46:15.1970255Z 2024-12-18T00:46:15.1971264Z  2024-12-18T00:46:15.1971805Z  2024-12-18T00:46:15.1973481Z  2024-12-18T00:46:15.1973951Z  2024-12-18T00:46:15.1975462Z  2024-12-18T00:46:15.1976394Z  2024-12-18T00:46:15.1976988Z  2024-12-18T00:46:15.1978566Z  2024-12-18T00:46:15.1979617Z [11,775 / 20,601] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:15.1980756Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:46:15.1981638Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:15.1982481Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:46:15.1983296Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:15.1984222Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2024-12-18T00:46:15.1985193Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 8s local 2024-12-18T00:46:15.1986282Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 7s local 2024-12-18T00:46:15.1987399Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 7s local ... 2024-12-18T00:46:15.4068125Z 2024-12-18T00:46:15.4069328Z  2024-12-18T00:46:15.4070942Z  2024-12-18T00:46:15.4072405Z  2024-12-18T00:46:15.4073913Z  2024-12-18T00:46:15.4075358Z  2024-12-18T00:46:15.4076813Z  2024-12-18T00:46:15.4078259Z  2024-12-18T00:46:15.4079731Z  2024-12-18T00:46:15.4081907Z [11,776 / 20,601] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:15.4084250Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:46:15.4086181Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2024-12-18T00:46:15.4087945Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:46:15.4089678Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:15.4091514Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2024-12-18T00:46:15.4093412Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 8s local 2024-12-18T00:46:15.4095467Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 7s local 2024-12-18T00:46:15.4097742Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 7s local ... 2024-12-18T00:46:15.6435911Z 2024-12-18T00:46:15.6437050Z  2024-12-18T00:46:15.6437554Z  2024-12-18T00:46:15.6437950Z  2024-12-18T00:46:15.6438366Z  2024-12-18T00:46:15.6438765Z  2024-12-18T00:46:15.6439147Z  2024-12-18T00:46:15.6439499Z  2024-12-18T00:46:15.6439925Z  2024-12-18T00:46:15.6440853Z [11,777 / 20,601] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:15.6441889Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:46:15.6442715Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:15.6443471Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:46:15.6444429Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:15.6445219Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2024-12-18T00:46:15.6446078Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 8s local 2024-12-18T00:46:15.6447032Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 8s local 2024-12-18T00:46:15.6448141Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 8s local ... 2024-12-18T00:46:15.9842161Z 2024-12-18T00:46:15.9843165Z  2024-12-18T00:46:15.9843625Z  2024-12-18T00:46:15.9843997Z  2024-12-18T00:46:15.9844994Z  2024-12-18T00:46:15.9845360Z  2024-12-18T00:46:15.9845703Z  2024-12-18T00:46:15.9846065Z  2024-12-18T00:46:15.9846420Z  2024-12-18T00:46:15.9847482Z [11,780 / 20,601] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:15.9848410Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:46:15.9849140Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:15.9849827Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:46:15.9850735Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:15.9851458Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2024-12-18T00:46:15.9852225Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local 2024-12-18T00:46:15.9853156Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 8s local 2024-12-18T00:46:15.9854298Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 8s local ... 2024-12-18T00:46:16.1979727Z 2024-12-18T00:46:16.1980744Z  2024-12-18T00:46:16.1981282Z  2024-12-18T00:46:16.1982876Z  2024-12-18T00:46:16.1983355Z  2024-12-18T00:46:16.1984910Z  2024-12-18T00:46:16.1985382Z  2024-12-18T00:46:16.1986865Z  2024-12-18T00:46:16.1987314Z  2024-12-18T00:46:16.1989466Z [11,782 / 20,601] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:16.1990600Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:46:16.1991522Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:16.1992349Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:16.1993147Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:16.1994046Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2024-12-18T00:46:16.1994956Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local 2024-12-18T00:46:16.1995997Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 8s local 2024-12-18T00:46:16.1997103Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 8s local ... 2024-12-18T00:46:16.3983138Z 2024-12-18T00:46:16.3984089Z  2024-12-18T00:46:16.3984545Z  2024-12-18T00:46:16.3984909Z  2024-12-18T00:46:16.3985286Z  2024-12-18T00:46:16.3985683Z  2024-12-18T00:46:16.3986077Z  2024-12-18T00:46:16.3986482Z  2024-12-18T00:46:16.3986862Z  2024-12-18T00:46:16.3997583Z [11,785 / 20,601] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:16.3998695Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:46:16.3999525Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2024-12-18T00:46:16.4000215Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:16.4000945Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:16.4001793Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2024-12-18T00:46:16.4002721Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local 2024-12-18T00:46:16.4003769Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 8s local 2024-12-18T00:46:16.4004900Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 8s local ... 2024-12-18T00:46:16.6727411Z 2024-12-18T00:46:16.6728224Z  2024-12-18T00:46:16.6728624Z  2024-12-18T00:46:16.6728955Z  2024-12-18T00:46:16.6729291Z  2024-12-18T00:46:16.6729714Z  2024-12-18T00:46:16.6730070Z  2024-12-18T00:46:16.6730446Z  2024-12-18T00:46:16.6730816Z  2024-12-18T00:46:16.6731588Z [11,789 / 20,601] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:16.6732559Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:46:16.6733221Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:16.6734087Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:16.6734710Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:46:16.6735494Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2024-12-18T00:46:16.6736251Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local 2024-12-18T00:46:16.6737265Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 9s local 2024-12-18T00:46:16.6738246Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 9s local ... 2024-12-18T00:46:16.9989634Z 2024-12-18T00:46:16.9990875Z  2024-12-18T00:46:16.9991473Z  2024-12-18T00:46:16.9991886Z  2024-12-18T00:46:16.9993752Z  2024-12-18T00:46:16.9994212Z  2024-12-18T00:46:16.9995773Z  2024-12-18T00:46:16.9996233Z  2024-12-18T00:46:16.9997764Z  2024-12-18T00:46:16.9998785Z [11,793 / 20,601] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:16.9999955Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:46:17.0000803Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:17.0001646Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:17.0002367Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:46:17.0003219Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2024-12-18T00:46:17.0004145Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 10s local 2024-12-18T00:46:17.0005185Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 9s local 2024-12-18T00:46:17.0006374Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 9s local ... 2024-12-18T00:46:17.1992678Z 2024-12-18T00:46:17.1993505Z  2024-12-18T00:46:17.1993998Z  2024-12-18T00:46:17.1994405Z  2024-12-18T00:46:17.1994813Z  2024-12-18T00:46:17.1995227Z  2024-12-18T00:46:17.1995614Z  2024-12-18T00:46:17.1996002Z  2024-12-18T00:46:17.1996417Z  2024-12-18T00:46:17.1997388Z [11,794 / 20,601] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:17.1998470Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:46:17.1999301Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:17.2000392Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:46:17.2001187Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:46:17.2002042Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2024-12-18T00:46:17.2003049Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 10s local 2024-12-18T00:46:17.2004074Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 9s local 2024-12-18T00:46:17.2005279Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 9s local ... 2024-12-18T00:46:17.4126465Z 2024-12-18T00:46:17.4127436Z  2024-12-18T00:46:17.4127972Z  2024-12-18T00:46:17.4129575Z  2024-12-18T00:46:17.4130047Z  2024-12-18T00:46:17.4131536Z  2024-12-18T00:46:17.4131993Z  2024-12-18T00:46:17.4133496Z  2024-12-18T00:46:17.4133946Z  2024-12-18T00:46:17.4136156Z [11,796 / 20,601] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:17.4137383Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:46:17.4138262Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2024-12-18T00:46:17.4139112Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:46:17.4139933Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:46:17.4140782Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2024-12-18T00:46:17.4141828Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 9s local 2024-12-18T00:46:17.4142937Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 9s local 2024-12-18T00:46:17.4144009Z Compiling src/cpu/x64/jit_avx2_1x1_conv_kernel_f32.cpp; 8s local ... 2024-12-18T00:46:17.6866124Z 2024-12-18T00:46:17.6866965Z  2024-12-18T00:46:17.6867487Z  2024-12-18T00:46:17.6867926Z  2024-12-18T00:46:17.6868619Z  2024-12-18T00:46:17.6869051Z  2024-12-18T00:46:17.6869452Z  2024-12-18T00:46:17.6869856Z  2024-12-18T00:46:17.6870233Z  2024-12-18T00:46:17.6871192Z [11,799 / 20,601] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:17.6872436Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:46:17.6873452Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:46:17.6874221Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:46:17.6874999Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:46:17.6875849Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2024-12-18T00:46:17.6876908Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 10s local 2024-12-18T00:46:17.6877978Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 10s local 2024-12-18T00:46:17.6879107Z Compiling src/cpu/x64/jit_avx2_1x1_conv_kernel_f32.cpp; 9s local ... 2024-12-18T00:46:18.0000632Z 2024-12-18T00:46:18.0001525Z  2024-12-18T00:46:18.0002028Z  2024-12-18T00:46:18.0002430Z  2024-12-18T00:46:18.0002887Z  2024-12-18T00:46:18.0003308Z  2024-12-18T00:46:18.0003724Z  2024-12-18T00:46:18.0004113Z  2024-12-18T00:46:18.0004523Z  2024-12-18T00:46:18.0005515Z [11,800 / 20,601] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:18.0006519Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:46:18.0007351Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:46:18.0008098Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:46:18.0008827Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:46:18.0009692Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2024-12-18T00:46:18.0010681Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 10s local 2024-12-18T00:46:18.0011813Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 10s local 2024-12-18T00:46:18.0012860Z Compiling src/cpu/x64/jit_avx2_1x1_conv_kernel_f32.cpp; 9s local ... 2024-12-18T00:46:18.3680872Z 2024-12-18T00:46:18.3681889Z  2024-12-18T00:46:18.3682378Z  2024-12-18T00:46:18.3682839Z  2024-12-18T00:46:18.3683307Z  2024-12-18T00:46:18.3683747Z  2024-12-18T00:46:18.3684184Z  2024-12-18T00:46:18.3684791Z  2024-12-18T00:46:18.3685216Z  2024-12-18T00:46:18.3686197Z [11,803 / 20,601] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:18.3687306Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2024-12-18T00:46:18.3688204Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2024-12-18T00:46:18.3689038Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:46:18.3689860Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:46:18.3690787Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2024-12-18T00:46:18.3692060Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 10s local 2024-12-18T00:46:18.3693281Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 10s local 2024-12-18T00:46:18.3694446Z Compiling src/cpu/x64/jit_avx2_1x1_conv_kernel_f32.cpp; 9s local ... 2024-12-18T00:46:18.6007123Z 2024-12-18T00:46:18.6009181Z  2024-12-18T00:46:18.6009707Z  2024-12-18T00:46:18.6010120Z  2024-12-18T00:46:18.6010537Z  2024-12-18T00:46:18.6010961Z  2024-12-18T00:46:18.6011363Z  2024-12-18T00:46:18.6011774Z  2024-12-18T00:46:18.6012127Z  2024-12-18T00:46:18.6013237Z [11,810 / 20,601] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:18.6014599Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2024-12-18T00:46:18.6015474Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:18.6016737Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:46:18.6017526Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:18.6018396Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2024-12-18T00:46:18.6019457Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local 2024-12-18T00:46:18.6020906Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 11s local 2024-12-18T00:46:18.6022058Z Compiling src/cpu/x64/jit_avx2_1x1_conv_kernel_f32.cpp; 10s local ... 2024-12-18T00:46:18.8014985Z 2024-12-18T00:46:18.8015926Z  2024-12-18T00:46:18.8018512Z  2024-12-18T00:46:18.8019192Z  2024-12-18T00:46:18.8019751Z  2024-12-18T00:46:18.8020325Z  2024-12-18T00:46:18.8022528Z  2024-12-18T00:46:18.8023110Z  2024-12-18T00:46:18.8025172Z  2024-12-18T00:46:18.8026498Z [11,813 / 20,602] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:18.8027921Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2024-12-18T00:46:18.8029051Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:18.8030108Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:46:18.8031124Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:18.8032433Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2024-12-18T00:46:18.8033773Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local 2024-12-18T00:46:18.8035264Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 11s local 2024-12-18T00:46:18.8036518Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2024-12-18T00:46:19.0928429Z 2024-12-18T00:46:19.0929337Z  2024-12-18T00:46:19.0929970Z  2024-12-18T00:46:19.0930573Z  2024-12-18T00:46:19.0930993Z  2024-12-18T00:46:19.0931408Z  2024-12-18T00:46:19.0931873Z  2024-12-18T00:46:19.0932305Z  2024-12-18T00:46:19.0932761Z  2024-12-18T00:46:19.0933735Z [11,814 / 20,602] 2 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:46:19.0934850Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2024-12-18T00:46:19.0935916Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:19.0936920Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:46:19.0937678Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:19.0938569Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2024-12-18T00:46:19.0939787Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local 2024-12-18T00:46:19.0940909Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 11s local 2024-12-18T00:46:19.0941895Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2024-12-18T00:46:19.4018981Z 2024-12-18T00:46:19.4019892Z  2024-12-18T00:46:19.4020380Z  2024-12-18T00:46:19.4020814Z  2024-12-18T00:46:19.4021256Z  2024-12-18T00:46:19.4021658Z  2024-12-18T00:46:19.4022046Z  2024-12-18T00:46:19.4022472Z  2024-12-18T00:46:19.4022866Z  2024-12-18T00:46:19.4023760Z [11,814 / 20,602] 2 / 17 tests; 48 actions running; last test: ...ys_util_test 2024-12-18T00:46:19.4024823Z Compiling src/cpu/cpu_convolution_list.cpp; 72s local 2024-12-18T00:46:19.4025664Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2024-12-18T00:46:19.4026449Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:46:19.4027199Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:19.4028015Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2024-12-18T00:46:19.4028976Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local 2024-12-18T00:46:19.4030384Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 11s local 2024-12-18T00:46:19.4031442Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2024-12-18T00:46:19.6024025Z 2024-12-18T00:46:19.6024916Z  2024-12-18T00:46:19.6025403Z  2024-12-18T00:46:19.6025843Z  2024-12-18T00:46:19.6026222Z  2024-12-18T00:46:19.6026612Z  2024-12-18T00:46:19.6027024Z  2024-12-18T00:46:19.6027450Z  2024-12-18T00:46:19.6027857Z  2024-12-18T00:46:19.6029273Z [11,818 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:19.6030230Z Compiling src/cpu/cpu_convolution_list.cpp; 72s local 2024-12-18T00:46:19.6031084Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:19.6031882Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:46:19.6032669Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:46:19.6033567Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2024-12-18T00:46:19.6034591Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2024-12-18T00:46:19.6035796Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 12s local 2024-12-18T00:46:19.6036796Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:46:19.8821690Z 2024-12-18T00:46:19.8822603Z  2024-12-18T00:46:19.8823084Z  2024-12-18T00:46:19.8823494Z  2024-12-18T00:46:19.8823946Z  2024-12-18T00:46:19.8824402Z  2024-12-18T00:46:19.8824800Z  2024-12-18T00:46:19.8825205Z  2024-12-18T00:46:19.8825607Z  2024-12-18T00:46:19.8826536Z [11,820 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:19.8827546Z Compiling src/cpu/cpu_convolution_list.cpp; 72s local 2024-12-18T00:46:19.8828318Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:19.8829131Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:46:19.8829899Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:46:19.8830734Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2024-12-18T00:46:19.8831764Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2024-12-18T00:46:19.8832890Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 12s local 2024-12-18T00:46:19.8833879Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:46:20.1085278Z 2024-12-18T00:46:20.1087386Z  2024-12-18T00:46:20.1087835Z  2024-12-18T00:46:20.1088220Z  2024-12-18T00:46:20.1088567Z  2024-12-18T00:46:20.1088934Z  2024-12-18T00:46:20.1089301Z  2024-12-18T00:46:20.1089660Z  2024-12-18T00:46:20.1090024Z  2024-12-18T00:46:20.1091036Z [11,822 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:20.1091958Z Compiling src/cpu/cpu_convolution_list.cpp; 72s local 2024-12-18T00:46:20.1092717Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:20.1093408Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:46:20.1094059Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:46:20.1094833Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2024-12-18T00:46:20.1095747Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2024-12-18T00:46:20.1096928Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 12s local 2024-12-18T00:46:20.1097836Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:46:20.3482128Z 2024-12-18T00:46:20.3483115Z  2024-12-18T00:46:20.3485004Z  2024-12-18T00:46:20.3485493Z  2024-12-18T00:46:20.3485956Z  2024-12-18T00:46:20.3486384Z  2024-12-18T00:46:20.3486785Z  2024-12-18T00:46:20.3487215Z  2024-12-18T00:46:20.3487967Z  2024-12-18T00:46:20.3488983Z [11,824 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:20.3490294Z Compiling src/cpu/cpu_convolution_list.cpp; 73s local 2024-12-18T00:46:20.3491149Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2024-12-18T00:46:20.3491926Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:20.3492707Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:46:20.3495876Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2024-12-18T00:46:20.3497483Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2024-12-18T00:46:20.3498659Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 12s local 2024-12-18T00:46:20.3499627Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:46:20.5792870Z 2024-12-18T00:46:20.5793768Z  2024-12-18T00:46:20.5794255Z  2024-12-18T00:46:20.5794664Z  2024-12-18T00:46:20.5795056Z  2024-12-18T00:46:20.5795413Z  2024-12-18T00:46:20.5795792Z  2024-12-18T00:46:20.5796162Z  2024-12-18T00:46:20.5796537Z  2024-12-18T00:46:20.5797404Z [11,833 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:20.5798307Z Compiling src/cpu/cpu_convolution_list.cpp; 73s local 2024-12-18T00:46:20.5799049Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:20.5799719Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:20.5800464Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2024-12-18T00:46:20.5801369Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2024-12-18T00:46:20.5802368Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2024-12-18T00:46:20.5803390Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 11s local 2024-12-18T00:46:20.5804230Z @onednn//:mkl_dnn; 10s local ... 2024-12-18T00:46:20.8033247Z 2024-12-18T00:46:20.8034157Z  2024-12-18T00:46:20.8034658Z  2024-12-18T00:46:20.8035129Z  2024-12-18T00:46:20.8035539Z  2024-12-18T00:46:20.8036009Z  2024-12-18T00:46:20.8036420Z  2024-12-18T00:46:20.8036821Z  2024-12-18T00:46:20.8037251Z  2024-12-18T00:46:20.8038215Z [11,834 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:20.8039306Z Compiling src/cpu/cpu_convolution_list.cpp; 73s local 2024-12-18T00:46:20.8040187Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:20.8040981Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:20.8041938Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2024-12-18T00:46:20.8043129Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2024-12-18T00:46:20.8044612Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 12s local 2024-12-18T00:46:20.8045924Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 11s local 2024-12-18T00:46:20.8047185Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 10s local ... 2024-12-18T00:46:21.0781296Z 2024-12-18T00:46:21.0783712Z  2024-12-18T00:46:21.0785415Z  2024-12-18T00:46:21.0785980Z  2024-12-18T00:46:21.0787422Z  2024-12-18T00:46:21.0788903Z  2024-12-18T00:46:21.0789445Z  2024-12-18T00:46:21.0790874Z  2024-12-18T00:46:21.0792337Z  2024-12-18T00:46:21.0793449Z [11,837 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:21.0795624Z Compiling src/cpu/cpu_convolution_list.cpp; 73s local 2024-12-18T00:46:21.0797524Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:21.0799578Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:21.0800711Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2024-12-18T00:46:21.0803451Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2024-12-18T00:46:21.0805288Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 12s local 2024-12-18T00:46:21.0806737Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 11s local 2024-12-18T00:46:21.0808533Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 10s local ... 2024-12-18T00:46:21.3642896Z 2024-12-18T00:46:21.3645495Z  2024-12-18T00:46:21.3647432Z  2024-12-18T00:46:21.3649096Z  2024-12-18T00:46:21.3650561Z  2024-12-18T00:46:21.3652001Z  2024-12-18T00:46:21.3653433Z  2024-12-18T00:46:21.3654864Z  2024-12-18T00:46:21.3656261Z  2024-12-18T00:46:21.3658454Z [11,841 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:21.3659982Z Compiling src/cpu/cpu_convolution_list.cpp; 74s local 2024-12-18T00:46:21.3660999Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2024-12-18T00:46:21.3662784Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:46:21.3663865Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2024-12-18T00:46:21.3666095Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2024-12-18T00:46:21.3668398Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 12s local 2024-12-18T00:46:21.3669792Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 11s local 2024-12-18T00:46:21.3672026Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 11s local ... 2024-12-18T00:46:21.6041679Z 2024-12-18T00:46:21.6042541Z  2024-12-18T00:46:21.6043027Z  2024-12-18T00:46:21.6043457Z  2024-12-18T00:46:21.6043854Z  2024-12-18T00:46:21.6044582Z  2024-12-18T00:46:21.6045001Z  2024-12-18T00:46:21.6045401Z  2024-12-18T00:46:21.6045821Z  2024-12-18T00:46:21.6046800Z [11,842 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:21.6047910Z Compiling src/cpu/cpu_convolution_list.cpp; 74s local 2024-12-18T00:46:21.6048796Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:21.6049551Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:46:21.6050451Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2024-12-18T00:46:21.6051576Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2024-12-18T00:46:21.6052724Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2024-12-18T00:46:21.6053821Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 12s local 2024-12-18T00:46:21.6054995Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 11s local ... 2024-12-18T00:46:22.0047793Z 2024-12-18T00:46:22.0048697Z  2024-12-18T00:46:22.0049220Z  2024-12-18T00:46:22.0049629Z  2024-12-18T00:46:22.0050015Z  2024-12-18T00:46:22.0050418Z  2024-12-18T00:46:22.0050807Z  2024-12-18T00:46:22.0051187Z  2024-12-18T00:46:22.0051583Z  2024-12-18T00:46:22.0052443Z [11,843 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:22.0053434Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:22.0054192Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:46:22.0055114Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2024-12-18T00:46:22.0056278Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2024-12-18T00:46:22.0057601Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2024-12-18T00:46:22.0058896Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 12s local 2024-12-18T00:46:22.0060082Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 11s local 2024-12-18T00:46:22.0061493Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 11s local ... 2024-12-18T00:46:22.2054038Z 2024-12-18T00:46:22.2054918Z  2024-12-18T00:46:22.2055629Z  2024-12-18T00:46:22.2056038Z  2024-12-18T00:46:22.2056577Z  2024-12-18T00:46:22.2056985Z  2024-12-18T00:46:22.2057373Z  2024-12-18T00:46:22.2057781Z  2024-12-18T00:46:22.2058169Z  2024-12-18T00:46:22.2059313Z [11,845 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:22.2060446Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:22.2061226Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:22.2062157Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2024-12-18T00:46:22.2063318Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2024-12-18T00:46:22.2064545Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2024-12-18T00:46:22.2065784Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 12s local 2024-12-18T00:46:22.2066993Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 12s local 2024-12-18T00:46:22.2068095Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 11s local ... 2024-12-18T00:46:22.4085865Z 2024-12-18T00:46:22.4086733Z  2024-12-18T00:46:22.4087257Z  2024-12-18T00:46:22.4087711Z  2024-12-18T00:46:22.4088148Z  2024-12-18T00:46:22.4088649Z  2024-12-18T00:46:22.4089034Z  2024-12-18T00:46:22.4089465Z  2024-12-18T00:46:22.4089861Z  2024-12-18T00:46:22.4090856Z [11,849 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:22.4091991Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2024-12-18T00:46:22.4092840Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:22.4094041Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2024-12-18T00:46:22.4095359Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2024-12-18T00:46:22.4096862Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2024-12-18T00:46:22.4098326Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 12s local 2024-12-18T00:46:22.4099528Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 12s local 2024-12-18T00:46:22.4100833Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 11s local ... 2024-12-18T00:46:22.6289935Z 2024-12-18T00:46:22.6290784Z  2024-12-18T00:46:22.6291256Z  2024-12-18T00:46:22.6291657Z  2024-12-18T00:46:22.6292054Z  2024-12-18T00:46:22.6292430Z  2024-12-18T00:46:22.6292820Z  2024-12-18T00:46:22.6293205Z  2024-12-18T00:46:22.6293579Z  2024-12-18T00:46:22.6294753Z [11,856 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:22.6295873Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:22.6296888Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:22.6297812Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2024-12-18T00:46:22.6298883Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2024-12-18T00:46:22.6300150Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 13s local 2024-12-18T00:46:22.6301325Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 12s local 2024-12-18T00:46:22.6302449Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local 2024-12-18T00:46:22.6303424Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local ... 2024-12-18T00:46:22.9809080Z 2024-12-18T00:46:22.9809918Z  2024-12-18T00:46:22.9810409Z  2024-12-18T00:46:22.9810830Z  2024-12-18T00:46:22.9811245Z  2024-12-18T00:46:22.9811954Z  2024-12-18T00:46:22.9812350Z  2024-12-18T00:46:22.9812776Z  2024-12-18T00:46:22.9813194Z  2024-12-18T00:46:22.9814322Z [11,859 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:22.9815338Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:22.9816136Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:22.9817260Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2024-12-18T00:46:22.9818730Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2024-12-18T00:46:22.9819947Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 13s local 2024-12-18T00:46:22.9821176Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 12s local 2024-12-18T00:46:22.9822296Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local 2024-12-18T00:46:22.9823212Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local ... 2024-12-18T00:46:23.2061812Z 2024-12-18T00:46:23.2062689Z  2024-12-18T00:46:23.2063180Z  2024-12-18T00:46:23.2063620Z  2024-12-18T00:46:23.2064045Z  2024-12-18T00:46:23.2064488Z  2024-12-18T00:46:23.2064900Z  2024-12-18T00:46:23.2065293Z  2024-12-18T00:46:23.2065701Z  2024-12-18T00:46:23.2066831Z [11,861 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:23.2067886Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:23.2068733Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:23.2069859Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2024-12-18T00:46:23.2071059Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2024-12-18T00:46:23.2072368Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 13s local 2024-12-18T00:46:23.2073551Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local 2024-12-18T00:46:23.2074490Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2024-12-18T00:46:23.2075667Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 11s local ... 2024-12-18T00:46:23.4066381Z 2024-12-18T00:46:23.4067289Z  2024-12-18T00:46:23.4067748Z  2024-12-18T00:46:23.4068140Z  2024-12-18T00:46:23.4068508Z  2024-12-18T00:46:23.4068894Z  2024-12-18T00:46:23.4069272Z  2024-12-18T00:46:23.4069678Z  2024-12-18T00:46:23.4070046Z  2024-12-18T00:46:23.4071050Z [11,862 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:23.4072112Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2024-12-18T00:46:23.4072877Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:23.4073704Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2024-12-18T00:46:23.4074804Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2024-12-18T00:46:23.4075965Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 13s local 2024-12-18T00:46:23.4077142Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local 2024-12-18T00:46:23.4078036Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:46:23.4078977Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 11s local ... 2024-12-18T00:46:23.6093314Z 2024-12-18T00:46:23.6094151Z  2024-12-18T00:46:23.6094625Z  2024-12-18T00:46:23.6095051Z  2024-12-18T00:46:23.6095459Z  2024-12-18T00:46:23.6095864Z  2024-12-18T00:46:23.6096266Z  2024-12-18T00:46:23.6096844Z  2024-12-18T00:46:23.6097247Z  2024-12-18T00:46:23.6098183Z [11,863 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:23.6099249Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:46:23.6100305Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:23.6101208Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2024-12-18T00:46:23.6102496Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2024-12-18T00:46:23.6103748Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 14s local 2024-12-18T00:46:23.6104921Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local 2024-12-18T00:46:23.6105805Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:46:23.6107013Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 11s local ... 2024-12-18T00:46:24.0072361Z 2024-12-18T00:46:24.0073220Z  2024-12-18T00:46:24.0073730Z  2024-12-18T00:46:24.0074137Z  2024-12-18T00:46:24.0074531Z  2024-12-18T00:46:24.0074958Z  2024-12-18T00:46:24.0075377Z  2024-12-18T00:46:24.0075803Z  2024-12-18T00:46:24.0076216Z  2024-12-18T00:46:24.0077165Z [11,865 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:24.0078198Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2024-12-18T00:46:24.0078954Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:24.0079892Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2024-12-18T00:46:24.0081070Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2024-12-18T00:46:24.0082269Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 14s local 2024-12-18T00:46:24.0083391Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local 2024-12-18T00:46:24.0084275Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2024-12-18T00:46:24.0085198Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 12s local ... 2024-12-18T00:46:24.7150245Z 2024-12-18T00:46:24.7151044Z  2024-12-18T00:46:24.7151530Z  2024-12-18T00:46:24.7151930Z  2024-12-18T00:46:24.7152313Z  2024-12-18T00:46:24.7152697Z  2024-12-18T00:46:24.7153069Z  2024-12-18T00:46:24.7153437Z  2024-12-18T00:46:24.7153817Z  2024-12-18T00:46:24.7154783Z [11,866 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:24.7155834Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:46:24.7156601Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:46:24.7157543Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2024-12-18T00:46:24.7158677Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2024-12-18T00:46:24.7159881Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:46:24.7161028Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2024-12-18T00:46:24.7161859Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:46:24.7162774Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 12s local ... 2024-12-18T00:46:25.0081137Z 2024-12-18T00:46:25.0082007Z  2024-12-18T00:46:25.0082504Z  2024-12-18T00:46:25.0082934Z  2024-12-18T00:46:25.0083374Z  2024-12-18T00:46:25.0083809Z  2024-12-18T00:46:25.0084226Z  2024-12-18T00:46:25.0084652Z  2024-12-18T00:46:25.0085078Z  2024-12-18T00:46:25.0086062Z [11,867 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:25.0087176Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:46:25.0088008Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:46:25.0088988Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2024-12-18T00:46:25.0090186Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2024-12-18T00:46:25.0091461Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:46:25.0092926Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2024-12-18T00:46:25.0093871Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:46:25.0094962Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 13s local ... 2024-12-18T00:46:25.2085533Z 2024-12-18T00:46:25.2086407Z  2024-12-18T00:46:25.2086898Z  2024-12-18T00:46:25.2087326Z  2024-12-18T00:46:25.2087753Z  2024-12-18T00:46:25.2088164Z  2024-12-18T00:46:25.2088592Z  2024-12-18T00:46:25.2088998Z  2024-12-18T00:46:25.2089690Z  2024-12-18T00:46:25.2090782Z [11,870 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:25.2091913Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2024-12-18T00:46:25.2092716Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:46:25.2093674Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2024-12-18T00:46:25.2094896Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2024-12-18T00:46:25.2096185Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:46:25.2097535Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2024-12-18T00:46:25.2098472Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2024-12-18T00:46:25.2099441Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 13s local ... 2024-12-18T00:46:25.5227722Z 2024-12-18T00:46:25.5228511Z  2024-12-18T00:46:25.5228993Z  2024-12-18T00:46:25.5229467Z  2024-12-18T00:46:25.5229882Z  2024-12-18T00:46:25.5230303Z  2024-12-18T00:46:25.5230721Z  2024-12-18T00:46:25.5231145Z  2024-12-18T00:46:25.5231571Z  2024-12-18T00:46:25.5232542Z [11,875 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:25.5233661Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:46:25.5234502Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:46:25.5235484Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2024-12-18T00:46:25.5236882Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2024-12-18T00:46:25.5238197Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:46:25.5239461Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2024-12-18T00:46:25.5240585Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:46:25.5241594Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 13s local ... 2024-12-18T00:46:25.7780124Z 2024-12-18T00:46:25.7780964Z  2024-12-18T00:46:25.7781464Z  2024-12-18T00:46:25.7781901Z  2024-12-18T00:46:25.7782286Z  2024-12-18T00:46:25.7782663Z  2024-12-18T00:46:25.7783072Z  2024-12-18T00:46:25.7783490Z  2024-12-18T00:46:25.7783883Z  2024-12-18T00:46:25.7784843Z [11,876 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:25.7785901Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:46:25.7786741Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:46:25.7787725Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2024-12-18T00:46:25.7788930Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2024-12-18T00:46:25.7790102Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2024-12-18T00:46:25.7791238Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local 2024-12-18T00:46:25.7792096Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:46:25.7793062Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 13s local ... 2024-12-18T00:46:26.0094281Z 2024-12-18T00:46:26.0095115Z  2024-12-18T00:46:26.0095807Z  2024-12-18T00:46:26.0096670Z  2024-12-18T00:46:26.0097077Z  2024-12-18T00:46:26.0097479Z  2024-12-18T00:46:26.0097878Z  2024-12-18T00:46:26.0098282Z  2024-12-18T00:46:26.0098702Z  2024-12-18T00:46:26.0102070Z [11,878 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:26.0103423Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2024-12-18T00:46:26.0104239Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:46:26.0105328Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2024-12-18T00:46:26.0106624Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2024-12-18T00:46:26.0107893Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2024-12-18T00:46:26.0109110Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local 2024-12-18T00:46:26.0109918Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2024-12-18T00:46:26.0110818Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local ... 2024-12-18T00:46:26.5279817Z 2024-12-18T00:46:26.5280662Z  2024-12-18T00:46:26.5281146Z  2024-12-18T00:46:26.5281531Z  2024-12-18T00:46:26.5281940Z  2024-12-18T00:46:26.5282301Z  2024-12-18T00:46:26.5282691Z  2024-12-18T00:46:26.5283106Z  2024-12-18T00:46:26.5283518Z  2024-12-18T00:46:26.5284468Z [11,880 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:46:26.5285535Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:46:26.5286300Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:46:26.5287226Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:46:26.5288354Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2024-12-18T00:46:26.5289509Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2024-12-18T00:46:26.5290448Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:46:26.5291336Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2024-12-18T00:46:26.5292340Z Compiling src/cpu/simple_resampling.cpp; 13s local ... 2024-12-18T00:46:26.8101636Z 2024-12-18T00:46:26.8102475Z  2024-12-18T00:46:26.8102937Z  2024-12-18T00:46:26.8103299Z  2024-12-18T00:46:26.8103687Z  2024-12-18T00:46:26.8104086Z  2024-12-18T00:46:26.8104479Z  2024-12-18T00:46:26.8104875Z  2024-12-18T00:46:26.8105295Z  2024-12-18T00:46:26.8106291Z [11,882 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:26.8107353Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:46:26.8108149Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:46:26.8109104Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:46:26.8110297Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2024-12-18T00:46:26.8111480Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:46:26.8112468Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:46:26.8113351Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2024-12-18T00:46:26.8114314Z Compiling src/cpu/simple_resampling.cpp; 14s local ... 2024-12-18T00:46:27.0105837Z 2024-12-18T00:46:27.0106680Z  2024-12-18T00:46:27.0107154Z  2024-12-18T00:46:27.0107591Z  2024-12-18T00:46:27.0108002Z  2024-12-18T00:46:27.0108409Z  2024-12-18T00:46:27.0108809Z  2024-12-18T00:46:27.0109172Z  2024-12-18T00:46:27.0109558Z  2024-12-18T00:46:27.0110533Z [11,884 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:27.0111649Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:46:27.0112703Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:46:27.0113631Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:46:27.0114966Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2024-12-18T00:46:27.0116173Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:46:27.0117116Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2024-12-18T00:46:27.0117951Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2024-12-18T00:46:27.0119134Z Compiling src/cpu/simple_resampling.cpp; 14s local ... 2024-12-18T00:46:27.4111317Z 2024-12-18T00:46:27.4112246Z  2024-12-18T00:46:27.4112839Z  2024-12-18T00:46:27.4113312Z  2024-12-18T00:46:27.4113679Z  2024-12-18T00:46:27.4114076Z  2024-12-18T00:46:27.4114462Z  2024-12-18T00:46:27.4114857Z  2024-12-18T00:46:27.4115239Z  2024-12-18T00:46:27.4116212Z [11,888 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:27.4117179Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2024-12-18T00:46:27.4117904Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:46:27.4118753Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:46:27.4119881Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2024-12-18T00:46:27.4121157Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:46:27.4122157Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:46:27.4123000Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2024-12-18T00:46:27.4123960Z Compiling src/cpu/simple_resampling.cpp; 14s local ... 2024-12-18T00:46:27.6115597Z 2024-12-18T00:46:27.6116492Z  2024-12-18T00:46:27.6117023Z  2024-12-18T00:46:27.6117410Z  2024-12-18T00:46:27.6118017Z  2024-12-18T00:46:27.6118406Z  2024-12-18T00:46:27.6118801Z  2024-12-18T00:46:27.6119167Z  2024-12-18T00:46:27.6119572Z  2024-12-18T00:46:27.6120556Z [11,890 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:27.6121588Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2024-12-18T00:46:27.6122349Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:46:27.6123209Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:46:27.6124335Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2024-12-18T00:46:27.6125542Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:46:27.6126524Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:46:27.6127398Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2024-12-18T00:46:27.6128386Z Compiling src/cpu/simple_resampling.cpp; 14s local ... 2024-12-18T00:46:27.8509231Z 2024-12-18T00:46:27.8510103Z  2024-12-18T00:46:27.8510587Z  2024-12-18T00:46:27.8510988Z  2024-12-18T00:46:27.8511387Z  2024-12-18T00:46:27.8511769Z  2024-12-18T00:46:27.8512165Z  2024-12-18T00:46:27.8512555Z  2024-12-18T00:46:27.8512955Z  2024-12-18T00:46:27.8513902Z [11,892 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:27.8514890Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:46:27.8515809Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:46:27.8516933Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2024-12-18T00:46:27.8518133Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:46:27.8519112Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:46:27.8519898Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:46:27.8521203Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:46:27.8521847Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:46:28.2121964Z 2024-12-18T00:46:28.2123135Z  2024-12-18T00:46:28.2123694Z  2024-12-18T00:46:28.2124171Z  2024-12-18T00:46:28.2124636Z  2024-12-18T00:46:28.2125096Z  2024-12-18T00:46:28.2125550Z  2024-12-18T00:46:28.2125971Z  2024-12-18T00:46:28.2126397Z  2024-12-18T00:46:28.2127549Z [11,893 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:28.2128659Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:28.2129588Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:46:28.2130743Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2024-12-18T00:46:28.2131943Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:46:28.2132935Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2024-12-18T00:46:28.2133835Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:46:28.2134792Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:46:28.2135511Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:46:28.4127200Z 2024-12-18T00:46:28.4128044Z  2024-12-18T00:46:28.4128527Z  2024-12-18T00:46:28.4128941Z  2024-12-18T00:46:28.4129352Z  2024-12-18T00:46:28.4129760Z  2024-12-18T00:46:28.4130183Z  2024-12-18T00:46:28.4130581Z  2024-12-18T00:46:28.4130981Z  2024-12-18T00:46:28.4131952Z [11,894 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:28.4132987Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:28.4133898Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:46:28.4135059Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2024-12-18T00:46:28.4136284Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:46:28.4137424Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:28.4138311Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:46:28.4139248Z Compiling src/cpu/simple_resampling.cpp; 15s local 2024-12-18T00:46:28.4139960Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:46:28.7389369Z 2024-12-18T00:46:28.7390267Z  2024-12-18T00:46:28.7390771Z  2024-12-18T00:46:28.7391182Z  2024-12-18T00:46:28.7391570Z  2024-12-18T00:46:28.7391943Z  2024-12-18T00:46:28.7392299Z  2024-12-18T00:46:28.7392678Z  2024-12-18T00:46:28.7393039Z  2024-12-18T00:46:28.7393903Z [11,895 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:28.7394811Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:28.7395704Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:46:28.7396792Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2024-12-18T00:46:28.7397963Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:46:28.7398956Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:28.7399759Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:46:28.7400597Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:28.7401269Z @onednn//:mkl_dnn; 16s local ... 2024-12-18T00:46:28.9521685Z 2024-12-18T00:46:28.9522545Z  2024-12-18T00:46:28.9523028Z  2024-12-18T00:46:28.9523446Z  2024-12-18T00:46:28.9523836Z  2024-12-18T00:46:28.9524233Z  2024-12-18T00:46:28.9524621Z  2024-12-18T00:46:28.9525021Z  2024-12-18T00:46:28.9525417Z  2024-12-18T00:46:28.9526673Z [11,899 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:28.9527541Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:28.9528559Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:46:28.9529655Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2024-12-18T00:46:28.9530733Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:46:28.9531776Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:28.9542967Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:28.9543918Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 16s local 2024-12-18T00:46:28.9545254Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local ... 2024-12-18T00:46:29.2134769Z 2024-12-18T00:46:29.2135604Z  2024-12-18T00:46:29.2136097Z  2024-12-18T00:46:29.2136690Z  2024-12-18T00:46:29.2137093Z  2024-12-18T00:46:29.2137456Z  2024-12-18T00:46:29.2137967Z  2024-12-18T00:46:29.2138353Z  2024-12-18T00:46:29.2138756Z  2024-12-18T00:46:29.2139741Z [11,901 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:29.2140824Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:29.2141719Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:46:29.2142819Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2024-12-18T00:46:29.2144005Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:46:29.2145229Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2024-12-18T00:46:29.2145996Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:29.2146941Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2024-12-18T00:46:29.2148006Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2024-12-18T00:46:29.5397091Z 2024-12-18T00:46:29.5397950Z  2024-12-18T00:46:29.5398439Z  2024-12-18T00:46:29.5398864Z  2024-12-18T00:46:29.5399291Z  2024-12-18T00:46:29.5399711Z  2024-12-18T00:46:29.5400137Z  2024-12-18T00:46:29.5400555Z  2024-12-18T00:46:29.5400958Z  2024-12-18T00:46:29.5401956Z [11,904 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:29.5403015Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:29.5404016Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:46:29.5405243Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2024-12-18T00:46:29.5406545Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:46:29.5407580Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:29.5408385Z Compiling src/cpu/simple_resampling.cpp; 16s local 2024-12-18T00:46:29.5409385Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2024-12-18T00:46:29.5410516Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2024-12-18T00:46:29.7623384Z 2024-12-18T00:46:29.7624199Z  2024-12-18T00:46:29.7624639Z  2024-12-18T00:46:29.7624990Z  2024-12-18T00:46:29.7625335Z  2024-12-18T00:46:29.7625659Z  2024-12-18T00:46:29.7626000Z  2024-12-18T00:46:29.7626361Z  2024-12-18T00:46:29.7626767Z  2024-12-18T00:46:29.7627623Z [11,905 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:29.7628492Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:29.7629286Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:46:29.7630303Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:46:29.7631708Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:46:29.7632591Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:29.7633381Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:46:29.7634203Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2024-12-18T00:46:29.7635172Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2024-12-18T00:46:29.9914910Z 2024-12-18T00:46:29.9915764Z  2024-12-18T00:46:29.9916543Z  2024-12-18T00:46:29.9917082Z  2024-12-18T00:46:29.9917445Z  2024-12-18T00:46:29.9917824Z  2024-12-18T00:46:29.9918241Z  2024-12-18T00:46:29.9918631Z  2024-12-18T00:46:29.9918995Z  2024-12-18T00:46:29.9919926Z [11,908 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:29.9920906Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:29.9921859Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:46:29.9923021Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:46:29.9924386Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:46:29.9925387Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:29.9926176Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:46:29.9927132Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:46:29.9928181Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2024-12-18T00:46:30.2145875Z 2024-12-18T00:46:30.2146728Z  2024-12-18T00:46:30.2147208Z  2024-12-18T00:46:30.2147639Z  2024-12-18T00:46:30.2148047Z  2024-12-18T00:46:30.2148448Z  2024-12-18T00:46:30.2148863Z  2024-12-18T00:46:30.2149263Z  2024-12-18T00:46:30.2149656Z  2024-12-18T00:46:30.2150665Z [11,910 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:30.2151709Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:30.2152675Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:46:30.2153801Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:46:30.2154853Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:46:30.2155813Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2024-12-18T00:46:30.2156564Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:46:30.2157523Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:46:30.2158549Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2024-12-18T00:46:30.6150942Z 2024-12-18T00:46:30.6151804Z  2024-12-18T00:46:30.6152271Z  2024-12-18T00:46:30.6152719Z  2024-12-18T00:46:30.6153129Z  2024-12-18T00:46:30.6153522Z  2024-12-18T00:46:30.6153924Z  2024-12-18T00:46:30.6154285Z  2024-12-18T00:46:30.6154687Z  2024-12-18T00:46:30.6155692Z [11,912 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:30.6156730Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:30.6157731Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:46:30.6158907Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:46:30.6160106Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:46:30.6161069Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:46:30.6161785Z Compiling src/cpu/simple_resampling.cpp; 17s local 2024-12-18T00:46:30.6162641Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:46:30.6163931Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2024-12-18T00:46:30.8155201Z 2024-12-18T00:46:30.8156094Z  2024-12-18T00:46:30.8156580Z  2024-12-18T00:46:30.8156994Z  2024-12-18T00:46:30.8157715Z  2024-12-18T00:46:30.8158100Z  2024-12-18T00:46:30.8158498Z  2024-12-18T00:46:30.8158887Z  2024-12-18T00:46:30.8159280Z  2024-12-18T00:46:30.8160248Z [11,913 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:30.8161449Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:30.8162460Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:46:30.8163617Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:46:30.8164900Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:46:30.8165906Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:46:30.8166627Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:30.8167503Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2024-12-18T00:46:30.8168574Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2024-12-18T00:46:31.1276783Z 2024-12-18T00:46:31.1277607Z  2024-12-18T00:46:31.1278092Z  2024-12-18T00:46:31.1278506Z  2024-12-18T00:46:31.1278890Z  2024-12-18T00:46:31.1279289Z  2024-12-18T00:46:31.1279714Z  2024-12-18T00:46:31.1280117Z  2024-12-18T00:46:31.1280565Z  2024-12-18T00:46:31.1281500Z [11,914 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:31.1282510Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:31.1283376Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:46:31.1284416Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:46:31.1285590Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:46:31.1293443Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2024-12-18T00:46:31.1294271Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:31.1295209Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2024-12-18T00:46:31.1296291Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2024-12-18T00:46:31.4161080Z 2024-12-18T00:46:31.4162006Z  2024-12-18T00:46:31.4162472Z  2024-12-18T00:46:31.4162897Z  2024-12-18T00:46:31.4163301Z  2024-12-18T00:46:31.4163677Z  2024-12-18T00:46:31.4164017Z  2024-12-18T00:46:31.4164557Z  2024-12-18T00:46:31.4164941Z  2024-12-18T00:46:31.4165833Z [11,915 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:31.4166745Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:31.4167681Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:46:31.4168825Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:46:31.4170003Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:46:31.4170914Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:31.4171654Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:31.4172541Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2024-12-18T00:46:31.4173610Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2024-12-18T00:46:31.6165462Z 2024-12-18T00:46:31.6166352Z  2024-12-18T00:46:31.6166824Z  2024-12-18T00:46:31.6167243Z  2024-12-18T00:46:31.6167656Z  2024-12-18T00:46:31.6168052Z  2024-12-18T00:46:31.6168463Z  2024-12-18T00:46:31.6168854Z  2024-12-18T00:46:31.6169270Z  2024-12-18T00:46:31.6170526Z [11,916 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:31.6171514Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:31.6172581Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:46:31.6173675Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:46:31.6174922Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:46:31.6175832Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:31.6177053Z Compiling src/cpu/simple_resampling.cpp; 18s local 2024-12-18T00:46:31.6178042Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2024-12-18T00:46:31.6179132Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2024-12-18T00:46:31.8316627Z 2024-12-18T00:46:31.8317446Z  2024-12-18T00:46:31.8317943Z  2024-12-18T00:46:31.8318379Z  2024-12-18T00:46:31.8318848Z  2024-12-18T00:46:31.8319257Z  2024-12-18T00:46:31.8319687Z  2024-12-18T00:46:31.8320123Z  2024-12-18T00:46:31.8320554Z  2024-12-18T00:46:31.8321553Z [11,919 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:31.8322592Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:31.8323585Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:46:31.8324834Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:46:31.8326142Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:46:31.8327200Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:31.8328010Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:46:31.8329002Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 19s local 2024-12-18T00:46:31.8330142Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2024-12-18T00:46:32.0822840Z 2024-12-18T00:46:32.0823717Z  2024-12-18T00:46:32.0824202Z  2024-12-18T00:46:32.0824598Z  2024-12-18T00:46:32.0825019Z  2024-12-18T00:46:32.0825417Z  2024-12-18T00:46:32.0825775Z  2024-12-18T00:46:32.0826132Z  2024-12-18T00:46:32.0826501Z  2024-12-18T00:46:32.0827402Z [11,922 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:32.0828385Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:32.0829314Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:46:32.0830493Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:46:32.0831673Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:46:32.0832613Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2024-12-18T00:46:32.0833328Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:46:32.0834204Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:32.0834996Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:46:32.4173114Z 2024-12-18T00:46:32.4173970Z  2024-12-18T00:46:32.4174466Z  2024-12-18T00:46:32.4174892Z  2024-12-18T00:46:32.4175293Z  2024-12-18T00:46:32.4175714Z  2024-12-18T00:46:32.4176124Z  2024-12-18T00:46:32.4176688Z  2024-12-18T00:46:32.4177091Z  2024-12-18T00:46:32.4178047Z [11,923 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:32.4179045Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:46:32.4179960Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:46:32.4181101Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:46:32.4182065Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:32.4183120Z Compiling src/cpu/simple_resampling.cpp; 19s local 2024-12-18T00:46:32.4184024Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:32.4185169Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:46:32.4186019Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:46:32.6173591Z 2024-12-18T00:46:32.6174603Z  2024-12-18T00:46:32.6175117Z  2024-12-18T00:46:32.6175532Z  2024-12-18T00:46:32.6175951Z  2024-12-18T00:46:32.6176821Z  2024-12-18T00:46:32.6177351Z  2024-12-18T00:46:32.6177773Z  2024-12-18T00:46:32.6178186Z  2024-12-18T00:46:32.6179161Z [11,924 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:32.6180130Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:46:32.6181059Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:46:32.6182173Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:46:32.6183089Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:32.6183778Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:32.6184659Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:32.6185697Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:46:32.6186547Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:46:32.8384908Z 2024-12-18T00:46:32.8386068Z  2024-12-18T00:46:32.8386783Z  2024-12-18T00:46:32.8387415Z  2024-12-18T00:46:32.8388495Z  2024-12-18T00:46:32.8389047Z  2024-12-18T00:46:32.8389511Z  2024-12-18T00:46:32.8389953Z  2024-12-18T00:46:32.8390360Z  2024-12-18T00:46:32.8391358Z [11,925 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:32.8392438Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:46:32.8393448Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:46:32.8394667Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:46:32.8395596Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:32.8396366Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:32.8397327Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2024-12-18T00:46:32.8398461Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:46:32.8399389Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:46:33.0491454Z 2024-12-18T00:46:33.0492374Z  2024-12-18T00:46:33.0492843Z  2024-12-18T00:46:33.0493212Z  2024-12-18T00:46:33.0493563Z  2024-12-18T00:46:33.0493942Z  2024-12-18T00:46:33.0494312Z  2024-12-18T00:46:33.0494698Z  2024-12-18T00:46:33.0495106Z  2024-12-18T00:46:33.0496083Z [11,930 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:33.0497148Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:46:33.0498022Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:46:33.0499107Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:46:33.0500067Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:33.0500791Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:33.0501686Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:33.0502669Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:46:33.0503459Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:46:33.2630126Z 2024-12-18T00:46:33.2631134Z  2024-12-18T00:46:33.2631558Z  2024-12-18T00:46:33.2631887Z  2024-12-18T00:46:33.2632583Z  2024-12-18T00:46:33.2632936Z  2024-12-18T00:46:33.2633308Z  2024-12-18T00:46:33.2633674Z  2024-12-18T00:46:33.2634019Z  2024-12-18T00:46:33.2635010Z [11,932 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:33.2635903Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:33.2636725Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:46:33.2637778Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:46:33.2638945Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2024-12-18T00:46:33.2639681Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:33.2640520Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:33.2641489Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:46:33.2642285Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:46:33.5084803Z 2024-12-18T00:46:33.5086098Z  2024-12-18T00:46:33.5086610Z  2024-12-18T00:46:33.5087026Z  2024-12-18T00:46:33.5087426Z  2024-12-18T00:46:33.5087803Z  2024-12-18T00:46:33.5088195Z  2024-12-18T00:46:33.5088589Z  2024-12-18T00:46:33.5088989Z  2024-12-18T00:46:33.5089907Z [11,935 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:33.5090889Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:33.5091809Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:46:33.5092944Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:46:33.5093864Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:33.5094613Z Compiling src/cpu/simple_resampling.cpp; 20s local 2024-12-18T00:46:33.5095441Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:33.5096659Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 14s local 2024-12-18T00:46:33.5097509Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:46:33.7252740Z 2024-12-18T00:46:33.7253666Z  2024-12-18T00:46:33.7254220Z  2024-12-18T00:46:33.7254642Z  2024-12-18T00:46:33.7255066Z  2024-12-18T00:46:33.7255486Z  2024-12-18T00:46:33.7255896Z  2024-12-18T00:46:33.7256309Z  2024-12-18T00:46:33.7256812Z  2024-12-18T00:46:33.7257786Z [11,938 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:33.7258838Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:33.7259822Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:46:33.7261049Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:46:33.7262022Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:33.7262825Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:33.7263779Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2024-12-18T00:46:33.7264613Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:33.7265365Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 12s local ... 2024-12-18T00:46:33.9506077Z 2024-12-18T00:46:33.9507437Z  2024-12-18T00:46:33.9507922Z  2024-12-18T00:46:33.9508329Z  2024-12-18T00:46:33.9508713Z  2024-12-18T00:46:33.9509112Z  2024-12-18T00:46:33.9509464Z  2024-12-18T00:46:33.9509852Z  2024-12-18T00:46:33.9510296Z  2024-12-18T00:46:33.9511251Z [11,939 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:33.9512231Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:33.9513150Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:46:33.9514296Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:46:33.9515559Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:33.9516285Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:33.9517297Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:33.9518074Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:33.9518757Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2024-12-18T00:46:34.2183798Z 2024-12-18T00:46:34.2184672Z  2024-12-18T00:46:34.2185152Z  2024-12-18T00:46:34.2185523Z  2024-12-18T00:46:34.2186286Z  2024-12-18T00:46:34.2186678Z  2024-12-18T00:46:34.2187061Z  2024-12-18T00:46:34.2187466Z  2024-12-18T00:46:34.2187848Z  2024-12-18T00:46:34.2188844Z [11,940 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:34.2189749Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:34.2190650Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:46:34.2191793Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:46:34.2192727Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2024-12-18T00:46:34.2193464Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:34.2194241Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:34.2194972Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:46:34.2195684Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2024-12-18T00:46:34.4801661Z 2024-12-18T00:46:34.4803103Z  2024-12-18T00:46:34.4803776Z  2024-12-18T00:46:34.4804815Z  2024-12-18T00:46:34.4805638Z  2024-12-18T00:46:34.4806428Z  2024-12-18T00:46:34.4806924Z  2024-12-18T00:46:34.4807333Z  2024-12-18T00:46:34.4807720Z  2024-12-18T00:46:34.4808720Z [11,943 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:34.4809786Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:34.4810753Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:46:34.4811761Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:34.4812567Z Compiling src/cpu/simple_resampling.cpp; 21s local 2024-12-18T00:46:34.4813516Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:34.4814340Z @onednn//:mkl_dnn; 14s local 2024-12-18T00:46:34.4815078Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local 2024-12-18T00:46:34.4815966Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 13s local ... 2024-12-18T00:46:34.8191307Z 2024-12-18T00:46:34.8192098Z  2024-12-18T00:46:34.8192552Z  2024-12-18T00:46:34.8192904Z  2024-12-18T00:46:34.8193268Z  2024-12-18T00:46:34.8193657Z  2024-12-18T00:46:34.8194024Z  2024-12-18T00:46:34.8194353Z  2024-12-18T00:46:34.8194749Z  2024-12-18T00:46:34.8195600Z [11,944 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:34.8196417Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:34.8197221Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:46:34.8198049Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:34.8198736Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:46:34.8199492Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2024-12-18T00:46:34.8200353Z @onednn//:mkl_dnn; 14s local 2024-12-18T00:46:34.8201064Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local 2024-12-18T00:46:34.8201952Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 13s local ... 2024-12-18T00:46:35.0453560Z 2024-12-18T00:46:35.0454437Z  2024-12-18T00:46:35.0454904Z  2024-12-18T00:46:35.0455314Z  2024-12-18T00:46:35.0455742Z  2024-12-18T00:46:35.0456419Z  2024-12-18T00:46:35.0456938Z  2024-12-18T00:46:35.0457337Z  2024-12-18T00:46:35.0457762Z  2024-12-18T00:46:35.0458837Z [11,948 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:35.0459803Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:35.0460742Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:46:35.0461675Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2024-12-18T00:46:35.0462544Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:46:35.0463511Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2024-12-18T00:46:35.0464321Z @onednn//:mkl_dnn; 14s local 2024-12-18T00:46:35.0465028Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local 2024-12-18T00:46:35.0465940Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 14s local ... 2024-12-18T00:46:35.4197748Z 2024-12-18T00:46:35.4198597Z  2024-12-18T00:46:35.4199122Z  2024-12-18T00:46:35.4199541Z  2024-12-18T00:46:35.4199944Z  2024-12-18T00:46:35.4200360Z  2024-12-18T00:46:35.4200779Z  2024-12-18T00:46:35.4201206Z  2024-12-18T00:46:35.4201598Z  2024-12-18T00:46:35.4202598Z [11,948 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:35.4203652Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:46:35.4204656Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:46:35.4205766Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:46:35.4206551Z Compiling src/cpu/simple_resampling.cpp; 22s local 2024-12-18T00:46:35.4207441Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2024-12-18T00:46:35.4208241Z @onednn//:mkl_dnn; 14s local 2024-12-18T00:46:35.4208919Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local 2024-12-18T00:46:35.4209786Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 14s local ... 2024-12-18T00:46:35.6202993Z 2024-12-18T00:46:35.6203833Z  2024-12-18T00:46:35.6204254Z  2024-12-18T00:46:35.6204595Z  2024-12-18T00:46:35.6204975Z  2024-12-18T00:46:35.6205329Z  2024-12-18T00:46:35.6205684Z  2024-12-18T00:46:35.6206027Z  2024-12-18T00:46:35.6206388Z  2024-12-18T00:46:35.6207242Z [11,949 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:35.6208101Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:46:35.6208922Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:46:35.6209725Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:46:35.6210374Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:46:35.6211155Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2024-12-18T00:46:35.6211932Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local 2024-12-18T00:46:35.6212639Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 14s local 2024-12-18T00:46:35.6213240Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:46:36.1262915Z 2024-12-18T00:46:36.1263766Z  2024-12-18T00:46:36.1264197Z  2024-12-18T00:46:36.1264578Z  2024-12-18T00:46:36.1264912Z  2024-12-18T00:46:36.1265267Z  2024-12-18T00:46:36.1265627Z  2024-12-18T00:46:36.1265977Z  2024-12-18T00:46:36.1266304Z  2024-12-18T00:46:36.1267136Z [11,950 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:36.1267979Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:46:36.1268769Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:46:36.1269540Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2024-12-18T00:46:36.1270316Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:46:36.1271324Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:36.1272140Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2024-12-18T00:46:36.1274824Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2024-12-18T00:46:36.1275607Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:46:36.4209702Z 2024-12-18T00:46:36.4210506Z  2024-12-18T00:46:36.4210946Z  2024-12-18T00:46:36.4211324Z  2024-12-18T00:46:36.4211698Z  2024-12-18T00:46:36.4212071Z  2024-12-18T00:46:36.4212434Z  2024-12-18T00:46:36.4213157Z  2024-12-18T00:46:36.4213542Z  2024-12-18T00:46:36.4214434Z [11,950 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:36.4215329Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:46:36.4216145Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:46:36.4217150Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:36.4217833Z Compiling src/cpu/simple_resampling.cpp; 23s local 2024-12-18T00:46:36.4218656Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:36.4219520Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2024-12-18T00:46:36.4220270Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2024-12-18T00:46:36.4220920Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:46:36.6213450Z 2024-12-18T00:46:36.6214480Z  2024-12-18T00:46:36.6214962Z  2024-12-18T00:46:36.6215338Z  2024-12-18T00:46:36.6215762Z  2024-12-18T00:46:36.6216139Z  2024-12-18T00:46:36.6216685Z  2024-12-18T00:46:36.6217102Z  2024-12-18T00:46:36.6217500Z  2024-12-18T00:46:36.6218478Z [11,951 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:36.6219476Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:46:36.6220369Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:46:36.6221335Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:36.6222060Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:36.6223432Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:36.6224502Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2024-12-18T00:46:36.6225481Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2024-12-18T00:46:36.6226238Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:46:36.8317228Z 2024-12-18T00:46:36.8318157Z  2024-12-18T00:46:36.8318619Z  2024-12-18T00:46:36.8319001Z  2024-12-18T00:46:36.8319400Z  2024-12-18T00:46:36.8319787Z  2024-12-18T00:46:36.8320181Z  2024-12-18T00:46:36.8320572Z  2024-12-18T00:46:36.8320983Z  2024-12-18T00:46:36.8321950Z [11,952 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:36.8323016Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:46:36.8323976Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:46:36.8324929Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:36.8325722Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:36.8326618Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2024-12-18T00:46:36.8327524Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2024-12-18T00:46:36.8328402Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2024-12-18T00:46:36.8329155Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:46:37.1698034Z 2024-12-18T00:46:37.1698899Z  2024-12-18T00:46:37.1699378Z  2024-12-18T00:46:37.1699791Z  2024-12-18T00:46:37.1700229Z  2024-12-18T00:46:37.1700659Z  2024-12-18T00:46:37.1701064Z  2024-12-18T00:46:37.1701496Z  2024-12-18T00:46:37.1701917Z  2024-12-18T00:46:37.1703184Z [11,955 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:37.1704219Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:46:37.1705309Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:46:37.1706314Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2024-12-18T00:46:37.1707106Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:37.1708037Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2024-12-18T00:46:37.1709225Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local 2024-12-18T00:46:37.1710118Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local 2024-12-18T00:46:37.1710848Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:46:37.4224880Z 2024-12-18T00:46:37.4225731Z  2024-12-18T00:46:37.4226218Z  2024-12-18T00:46:37.4226646Z  2024-12-18T00:46:37.4227085Z  2024-12-18T00:46:37.4227491Z  2024-12-18T00:46:37.4227942Z  2024-12-18T00:46:37.4228358Z  2024-12-18T00:46:37.4228788Z  2024-12-18T00:46:37.4229801Z [11,960 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:37.4230837Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:46:37.4231825Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:46:37.4232813Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:46:37.4233613Z Compiling src/cpu/simple_resampling.cpp; 24s local 2024-12-18T00:46:37.4234499Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local 2024-12-18T00:46:37.4235337Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local 2024-12-18T00:46:37.4236296Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 14s local 2024-12-18T00:46:37.4237433Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local ... 2024-12-18T00:46:37.7499689Z 2024-12-18T00:46:37.7500569Z  2024-12-18T00:46:37.7501029Z  2024-12-18T00:46:37.7501462Z  2024-12-18T00:46:37.7501886Z  2024-12-18T00:46:37.7502308Z  2024-12-18T00:46:37.7502716Z  2024-12-18T00:46:37.7503151Z  2024-12-18T00:46:37.7503534Z  2024-12-18T00:46:37.7504486Z [11,962 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:37.7505535Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:46:37.7506486Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:46:37.7507386Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:46:37.7508114Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:37.7508924Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local 2024-12-18T00:46:37.7509727Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local 2024-12-18T00:46:37.7510606Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 15s local 2024-12-18T00:46:37.7511657Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local ... 2024-12-18T00:46:38.0231815Z 2024-12-18T00:46:38.0232674Z  2024-12-18T00:46:38.0233179Z  2024-12-18T00:46:38.0233640Z  2024-12-18T00:46:38.0234075Z  2024-12-18T00:46:38.0234482Z  2024-12-18T00:46:38.0234906Z  2024-12-18T00:46:38.0235327Z  2024-12-18T00:46:38.0235709Z  2024-12-18T00:46:38.0236715Z [11,963 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:38.0237775Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:46:38.0238771Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:46:38.0239772Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:46:38.0240553Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:38.0241437Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2024-12-18T00:46:38.0242563Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2024-12-18T00:46:38.0243515Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 15s local 2024-12-18T00:46:38.0245024Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local ... 2024-12-18T00:46:38.2236314Z 2024-12-18T00:46:38.2237172Z  2024-12-18T00:46:38.2237636Z  2024-12-18T00:46:38.2238254Z  2024-12-18T00:46:38.2238679Z  2024-12-18T00:46:38.2239098Z  2024-12-18T00:46:38.2239521Z  2024-12-18T00:46:38.2239921Z  2024-12-18T00:46:38.2240681Z  2024-12-18T00:46:38.2241662Z [11,964 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:38.2242668Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:46:38.2243564Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:46:38.2245027Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2024-12-18T00:46:38.2245708Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:38.2246480Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2024-12-18T00:46:38.2247281Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2024-12-18T00:46:38.2248106Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 15s local 2024-12-18T00:46:38.2249102Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local ... 2024-12-18T00:46:38.5836906Z 2024-12-18T00:46:38.5837736Z  2024-12-18T00:46:38.5838207Z  2024-12-18T00:46:38.5838654Z  2024-12-18T00:46:38.5839062Z  2024-12-18T00:46:38.5839482Z  2024-12-18T00:46:38.5839880Z  2024-12-18T00:46:38.5840278Z  2024-12-18T00:46:38.5840659Z  2024-12-18T00:46:38.5841614Z [11,968 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:38.5842627Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:46:38.5843632Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:46:38.5844880Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:46:38.5845690Z Compiling src/cpu/simple_resampling.cpp; 25s local 2024-12-18T00:46:38.5846530Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2024-12-18T00:46:38.5847412Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2024-12-18T00:46:38.5848310Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 15s local 2024-12-18T00:46:38.5849401Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local ... 2024-12-18T00:46:38.8242828Z 2024-12-18T00:46:38.8243711Z  2024-12-18T00:46:38.8244366Z  2024-12-18T00:46:38.8244801Z  2024-12-18T00:46:38.8245227Z  2024-12-18T00:46:38.8245626Z  2024-12-18T00:46:38.8246060Z  2024-12-18T00:46:38.8246455Z  2024-12-18T00:46:38.8246862Z  2024-12-18T00:46:38.8247845Z [11,969 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:38.8248926Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:46:38.8249903Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:46:38.8250841Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:46:38.8251614Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:46:38.8252477Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2024-12-18T00:46:38.8253317Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2024-12-18T00:46:38.8254402Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local 2024-12-18T00:46:38.8255482Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local ... 2024-12-18T00:46:39.0246531Z 2024-12-18T00:46:39.0247337Z  2024-12-18T00:46:39.0247834Z  2024-12-18T00:46:39.0248251Z  2024-12-18T00:46:39.0248665Z  2024-12-18T00:46:39.0249081Z  2024-12-18T00:46:39.0249757Z  2024-12-18T00:46:39.0250158Z  2024-12-18T00:46:39.0250564Z  2024-12-18T00:46:39.0251646Z [11,970 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:39.0252616Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:46:39.0253535Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:46:39.0254481Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2024-12-18T00:46:39.0255248Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:46:39.0256270Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:46:39.0257284Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2024-12-18T00:46:39.0258200Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local 2024-12-18T00:46:39.0259329Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local ... 2024-12-18T00:46:39.3636489Z 2024-12-18T00:46:39.3637392Z  2024-12-18T00:46:39.3637917Z  2024-12-18T00:46:39.3638300Z  2024-12-18T00:46:39.3638669Z  2024-12-18T00:46:39.3639083Z  2024-12-18T00:46:39.3639469Z  2024-12-18T00:46:39.3639865Z  2024-12-18T00:46:39.3640229Z  2024-12-18T00:46:39.3641215Z [11,971 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:39.3642196Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:46:39.3643313Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:46:39.3644514Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:39.3645276Z Compiling src/cpu/simple_resampling.cpp; 26s local 2024-12-18T00:46:39.3646109Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:46:39.3646941Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2024-12-18T00:46:39.3647912Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local 2024-12-18T00:46:39.3649011Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local ... 2024-12-18T00:46:39.6572047Z 2024-12-18T00:46:39.6572938Z  2024-12-18T00:46:39.6573459Z  2024-12-18T00:46:39.6573907Z  2024-12-18T00:46:39.6574328Z  2024-12-18T00:46:39.6574707Z  2024-12-18T00:46:39.6575093Z  2024-12-18T00:46:39.6575500Z  2024-12-18T00:46:39.6575907Z  2024-12-18T00:46:39.6576962Z [11,972 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:39.6577976Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:46:39.6578904Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:46:39.6579777Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:39.6580507Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:46:39.6581343Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:46:39.6582100Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2024-12-18T00:46:39.6582923Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local 2024-12-18T00:46:39.6583978Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local ... 2024-12-18T00:46:39.8577670Z 2024-12-18T00:46:39.8578482Z  2024-12-18T00:46:39.8578976Z  2024-12-18T00:46:39.8579404Z  2024-12-18T00:46:39.8579784Z  2024-12-18T00:46:39.8580183Z  2024-12-18T00:46:39.8580599Z  2024-12-18T00:46:39.8581013Z  2024-12-18T00:46:39.8581462Z  2024-12-18T00:46:39.8582421Z [11,975 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:39.8583395Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:46:39.8584291Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:46:39.8585134Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:39.8586101Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:46:39.8586885Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2024-12-18T00:46:39.8587783Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2024-12-18T00:46:39.8588680Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:46:39.8589741Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local ... 2024-12-18T00:46:40.0587851Z 2024-12-18T00:46:40.0588730Z  2024-12-18T00:46:40.0589240Z  2024-12-18T00:46:40.0589627Z  2024-12-18T00:46:40.0590416Z  2024-12-18T00:46:40.0590831Z  2024-12-18T00:46:40.0591226Z  2024-12-18T00:46:40.0591589Z  2024-12-18T00:46:40.0591978Z  2024-12-18T00:46:40.0592960Z [11,977 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:40.0593892Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:46:40.0594791Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:46:40.0595654Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:40.0596412Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:46:40.0597233Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local 2024-12-18T00:46:40.0598032Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:46:40.0598923Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:46:40.0599999Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local ... 2024-12-18T00:46:40.2759907Z 2024-12-18T00:46:40.2760775Z  2024-12-18T00:46:40.2761254Z  2024-12-18T00:46:40.2761832Z  2024-12-18T00:46:40.2762231Z  2024-12-18T00:46:40.2762650Z  2024-12-18T00:46:40.2763051Z  2024-12-18T00:46:40.2763455Z  2024-12-18T00:46:40.2763856Z  2024-12-18T00:46:40.2764780Z [11,979 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:40.2765789Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:46:40.2766736Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:46:40.2767707Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2024-12-18T00:46:40.2768491Z Compiling src/cpu/simple_resampling.cpp; 27s local 2024-12-18T00:46:40.2769322Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local 2024-12-18T00:46:40.2770177Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:46:40.2771135Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:46:40.2772221Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local ... 2024-12-18T00:46:40.6601069Z 2024-12-18T00:46:40.6601875Z  2024-12-18T00:46:40.6602345Z  2024-12-18T00:46:40.6602759Z  2024-12-18T00:46:40.6603153Z  2024-12-18T00:46:40.6603563Z  2024-12-18T00:46:40.6603976Z  2024-12-18T00:46:40.6604418Z  2024-12-18T00:46:40.6604799Z  2024-12-18T00:46:40.6605747Z [11,982 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:40.6606761Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:46:40.6607698Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:46:40.6608665Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:46:40.6609398Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:40.6610219Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:46:40.6611134Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:46:40.6612534Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:46:40.6613634Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local ... 2024-12-18T00:46:40.8606543Z 2024-12-18T00:46:40.8607402Z  2024-12-18T00:46:40.8608191Z  2024-12-18T00:46:40.8608628Z  2024-12-18T00:46:40.8609066Z  2024-12-18T00:46:40.8609455Z  2024-12-18T00:46:40.8609864Z  2024-12-18T00:46:40.8610230Z  2024-12-18T00:46:40.8610795Z  2024-12-18T00:46:40.8611752Z [11,984 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:40.8612770Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:46:40.8613730Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:46:40.8615776Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:46:40.8616661Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:40.8617467Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:46:40.8618263Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2024-12-18T00:46:40.8619383Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:46:40.8620420Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local ... 2024-12-18T00:46:41.1860028Z 2024-12-18T00:46:41.1860872Z  2024-12-18T00:46:41.1861338Z  2024-12-18T00:46:41.1861742Z  2024-12-18T00:46:41.1871774Z  2024-12-18T00:46:41.1872204Z  2024-12-18T00:46:41.1872621Z  2024-12-18T00:46:41.1873029Z  2024-12-18T00:46:41.1873419Z  2024-12-18T00:46:41.1874370Z [11,988 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:41.1875381Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:46:41.1876233Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:46:41.1877182Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2024-12-18T00:46:41.1877895Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:41.1878733Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:46:41.1879614Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2024-12-18T00:46:41.1880673Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:46:41.1881748Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local ... 2024-12-18T00:46:41.6004446Z 2024-12-18T00:46:41.6005354Z  2024-12-18T00:46:41.6005864Z  2024-12-18T00:46:41.6006314Z  2024-12-18T00:46:41.6006746Z  2024-12-18T00:46:41.6007191Z  2024-12-18T00:46:41.6007632Z  2024-12-18T00:46:41.6008068Z  2024-12-18T00:46:41.6008556Z  2024-12-18T00:46:41.6009604Z [11,989 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:41.6010679Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:46:41.6011708Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:46:41.6012735Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:46:41.6013579Z Compiling src/cpu/simple_resampling.cpp; 28s local 2024-12-18T00:46:41.6014439Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:46:41.6015436Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2024-12-18T00:46:41.6016748Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:46:41.6017771Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local ... 2024-12-18T00:46:41.8010317Z 2024-12-18T00:46:41.8011137Z  2024-12-18T00:46:41.8011543Z  2024-12-18T00:46:41.8011897Z  2024-12-18T00:46:41.8012275Z  2024-12-18T00:46:41.8012595Z  2024-12-18T00:46:41.8012938Z  2024-12-18T00:46:41.8013272Z  2024-12-18T00:46:41.8013614Z  2024-12-18T00:46:41.8014458Z [11,991 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:41.8015271Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:46:41.8016065Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:46:41.8017279Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:46:41.8018016Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:46:41.8018780Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:46:41.8019505Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2024-12-18T00:46:41.8020471Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:46:41.8021454Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local ... 2024-12-18T00:46:42.2016418Z 2024-12-18T00:46:42.2017410Z  2024-12-18T00:46:42.2017895Z  2024-12-18T00:46:42.2018301Z  2024-12-18T00:46:42.2018680Z  2024-12-18T00:46:42.2019066Z  2024-12-18T00:46:42.2019466Z  2024-12-18T00:46:42.2019856Z  2024-12-18T00:46:42.2020259Z  2024-12-18T00:46:42.2021221Z [11,995 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:42.2022268Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:46:42.2023209Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:46:42.2024166Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2024-12-18T00:46:42.2024923Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:46:42.2025732Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:46:42.2026635Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2024-12-18T00:46:42.2027766Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:46:42.2028819Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local ... 2024-12-18T00:46:42.4203264Z 2024-12-18T00:46:42.4204136Z  2024-12-18T00:46:42.4204629Z  2024-12-18T00:46:42.4205143Z  2024-12-18T00:46:42.4205525Z  2024-12-18T00:46:42.4205893Z  2024-12-18T00:46:42.4206388Z  2024-12-18T00:46:42.4206796Z  2024-12-18T00:46:42.4207191Z  2024-12-18T00:46:42.4208112Z [11,997 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:42.4209200Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:46:42.4210170Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:46:42.4211073Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:46:42.4211871Z Compiling src/cpu/simple_resampling.cpp; 29s local 2024-12-18T00:46:42.4212780Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:46:42.4213621Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2024-12-18T00:46:42.4214616Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:46:42.4215661Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local ... 2024-12-18T00:46:42.8021887Z 2024-12-18T00:46:42.8022834Z  2024-12-18T00:46:42.8023293Z  2024-12-18T00:46:42.8023685Z  2024-12-18T00:46:42.8024092Z  2024-12-18T00:46:42.8024462Z  2024-12-18T00:46:42.8024843Z  2024-12-18T00:46:42.8025231Z  2024-12-18T00:46:42.8025649Z  2024-12-18T00:46:42.8026596Z [11,997 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:42.8027533Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:46:42.8028439Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:46:42.8029368Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:46:42.8030078Z Compiling src/cpu/simple_resampling.cpp; 30s local 2024-12-18T00:46:42.8030811Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:46:42.8031677Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:46:42.8032690Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:46:42.8034023Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local ... 2024-12-18T00:46:43.0027893Z 2024-12-18T00:46:43.0028721Z  2024-12-18T00:46:43.0029200Z  2024-12-18T00:46:43.0029858Z  2024-12-18T00:46:43.0030286Z  2024-12-18T00:46:43.0030676Z  2024-12-18T00:46:43.0031081Z  2024-12-18T00:46:43.0031451Z  2024-12-18T00:46:43.0031851Z  2024-12-18T00:46:43.0032816Z [11,999 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:43.0034045Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:46:43.0034968Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:46:43.0035897Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2024-12-18T00:46:43.0036657Z Compiling src/cpu/simple_resampling.cpp; 30s local 2024-12-18T00:46:43.0037470Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:46:43.0038358Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:46:43.0039407Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:46:43.0040461Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local ... 2024-12-18T00:46:43.3901697Z 2024-12-18T00:46:43.3902582Z  2024-12-18T00:46:43.3903046Z  2024-12-18T00:46:43.3903454Z  2024-12-18T00:46:43.3903862Z  2024-12-18T00:46:43.3904280Z  2024-12-18T00:46:43.3904691Z  2024-12-18T00:46:43.3905081Z  2024-12-18T00:46:43.3905513Z  2024-12-18T00:46:43.3906492Z [12,002 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:43.3907429Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:46:43.3908367Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:46:43.3909287Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:43.3910050Z Compiling src/cpu/simple_resampling.cpp; 30s local 2024-12-18T00:46:43.3910873Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:46:43.3911725Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:46:43.3912726Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:46:43.3913727Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local ... 2024-12-18T00:46:43.6031329Z 2024-12-18T00:46:43.6032173Z  2024-12-18T00:46:43.6032609Z  2024-12-18T00:46:43.6033029Z  2024-12-18T00:46:43.6033407Z  2024-12-18T00:46:43.6033775Z  2024-12-18T00:46:43.6034139Z  2024-12-18T00:46:43.6034490Z  2024-12-18T00:46:43.6034865Z  2024-12-18T00:46:43.6035801Z [12,006 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:43.6036746Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:46:43.6037600Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:46:43.6038505Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:43.6039181Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:46:43.6039974Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:46:43.6040924Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:46:43.6041861Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2024-12-18T00:46:43.6042931Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2024-12-18T00:46:43.8034771Z 2024-12-18T00:46:43.8035647Z  2024-12-18T00:46:43.8036097Z  2024-12-18T00:46:43.8036497Z  2024-12-18T00:46:43.8036909Z  2024-12-18T00:46:43.8037319Z  2024-12-18T00:46:43.8037740Z  2024-12-18T00:46:43.8038148Z  2024-12-18T00:46:43.8038586Z  2024-12-18T00:46:43.8039546Z [12,007 / 20,602] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2024-12-18T00:46:43.8040825Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:46:43.8041900Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:46:43.8042837Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:43.8043556Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:46:43.8044703Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2024-12-18T00:46:43.8045949Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:46:43.8047024Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2024-12-18T00:46:43.8048050Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2024-12-18T00:46:44.0509568Z 2024-12-18T00:46:44.0510541Z  2024-12-18T00:46:44.0511026Z  2024-12-18T00:46:44.0511410Z  2024-12-18T00:46:44.0511779Z  2024-12-18T00:46:44.0512198Z  2024-12-18T00:46:44.0512609Z  2024-12-18T00:46:44.0512984Z  2024-12-18T00:46:44.0513382Z  2024-12-18T00:46:44.0514344Z [12,009 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:44.0515347Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:46:44.0516214Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:46:44.0517211Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:44.0518065Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:46:44.0518987Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2024-12-18T00:46:44.0520035Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:46:44.0521050Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2024-12-18T00:46:44.0522358Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2024-12-18T00:46:44.3077728Z 2024-12-18T00:46:44.3078565Z  2024-12-18T00:46:44.3079090Z  2024-12-18T00:46:44.3079527Z  2024-12-18T00:46:44.3079943Z  2024-12-18T00:46:44.3080376Z  2024-12-18T00:46:44.3080830Z  2024-12-18T00:46:44.3081438Z  2024-12-18T00:46:44.3081839Z  2024-12-18T00:46:44.3082802Z [12,010 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:44.3083787Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:46:44.3084735Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:46:44.3085703Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2024-12-18T00:46:44.3086453Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:46:44.3087310Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2024-12-18T00:46:44.3088349Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:46:44.3089404Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2024-12-18T00:46:44.3090397Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2024-12-18T00:46:44.6042678Z 2024-12-18T00:46:44.6043611Z  2024-12-18T00:46:44.6044048Z  2024-12-18T00:46:44.6044631Z  2024-12-18T00:46:44.6045003Z  2024-12-18T00:46:44.6045371Z  2024-12-18T00:46:44.6045743Z  2024-12-18T00:46:44.6046105Z  2024-12-18T00:46:44.6046473Z  2024-12-18T00:46:44.6047423Z [12,011 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:44.6048339Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:46:44.6049136Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:46:44.6049962Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:46:44.6050674Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:46:44.6051788Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2024-12-18T00:46:44.6052805Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:46:44.6053945Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:46:44.6054969Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local ... 2024-12-18T00:46:44.8048181Z 2024-12-18T00:46:44.8049028Z  2024-12-18T00:46:44.8049512Z  2024-12-18T00:46:44.8049907Z  2024-12-18T00:46:44.8050303Z  2024-12-18T00:46:44.8050709Z  2024-12-18T00:46:44.8051505Z  2024-12-18T00:46:44.8051929Z  2024-12-18T00:46:44.8052318Z  2024-12-18T00:46:44.8053276Z [12,013 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:44.8054261Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:46:44.8055193Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:46:44.8056154Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:46:44.8057079Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:46:44.8057966Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:46:44.8058907Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:46:44.8059779Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local 2024-12-18T00:46:44.8060752Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 12s local ... 2024-12-18T00:46:45.1542786Z 2024-12-18T00:46:45.1543745Z  2024-12-18T00:46:45.1544407Z  2024-12-18T00:46:45.1544778Z  2024-12-18T00:46:45.1545145Z  2024-12-18T00:46:45.1545495Z  2024-12-18T00:46:45.1545859Z  2024-12-18T00:46:45.1546220Z  2024-12-18T00:46:45.1546624Z  2024-12-18T00:46:45.1547540Z [12,014 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:45.1548535Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:46:45.1549442Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:46:45.1550358Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2024-12-18T00:46:45.1551109Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:46:45.1552033Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:46:45.1553020Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:46:45.1553961Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local 2024-12-18T00:46:45.1554954Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:46:45.4055082Z 2024-12-18T00:46:45.4055970Z  2024-12-18T00:46:45.4056438Z  2024-12-18T00:46:45.4056993Z  2024-12-18T00:46:45.4057375Z  2024-12-18T00:46:45.4057769Z  2024-12-18T00:46:45.4058144Z  2024-12-18T00:46:45.4058534Z  2024-12-18T00:46:45.4058945Z  2024-12-18T00:46:45.4059877Z [12,014 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:45.4060858Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:46:45.4061742Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:46:45.4062657Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:45.4063386Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:46:45.4064289Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:46:45.4065282Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:46:45.4066241Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local 2024-12-18T00:46:45.4067175Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:46:45.6059319Z 2024-12-18T00:46:45.6060154Z  2024-12-18T00:46:45.6060641Z  2024-12-18T00:46:45.6061364Z  2024-12-18T00:46:45.6061777Z  2024-12-18T00:46:45.6062180Z  2024-12-18T00:46:45.6062584Z  2024-12-18T00:46:45.6062986Z  2024-12-18T00:46:45.6063396Z  2024-12-18T00:46:45.6064452Z [12,017 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:45.6065451Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:46:45.6066406Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:46:45.6067453Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:45.6068328Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:46:45.6069256Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:46:45.6070234Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2024-12-18T00:46:45.6071210Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:46:45.6072244Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:46:45.9421264Z 2024-12-18T00:46:45.9422171Z  2024-12-18T00:46:45.9422644Z  2024-12-18T00:46:45.9423051Z  2024-12-18T00:46:45.9423457Z  2024-12-18T00:46:45.9423932Z  2024-12-18T00:46:45.9424300Z  2024-12-18T00:46:45.9424729Z  2024-12-18T00:46:45.9425116Z  2024-12-18T00:46:45.9426065Z [12,018 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:45.9427055Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:46:45.9427995Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:46:45.9428939Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:45.9429660Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:46:45.9430516Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:46:45.9431397Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2024-12-18T00:46:45.9432367Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:46:45.9433320Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:46:46.2066989Z 2024-12-18T00:46:46.2067834Z  2024-12-18T00:46:46.2068423Z  2024-12-18T00:46:46.2068955Z  2024-12-18T00:46:46.2069478Z  2024-12-18T00:46:46.2069981Z  2024-12-18T00:46:46.2070400Z  2024-12-18T00:46:46.2071012Z  2024-12-18T00:46:46.2071437Z  2024-12-18T00:46:46.2072425Z [12,019 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:46.2073420Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:46:46.2074348Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:46:46.2075332Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2024-12-18T00:46:46.2076059Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:46:46.2076893Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:46:46.2077837Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2024-12-18T00:46:46.2078798Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:46:46.2079794Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:46:46.4609849Z 2024-12-18T00:46:46.4610737Z  2024-12-18T00:46:46.4611210Z  2024-12-18T00:46:46.4611606Z  2024-12-18T00:46:46.4611993Z  2024-12-18T00:46:46.4612436Z  2024-12-18T00:46:46.4612824Z  2024-12-18T00:46:46.4613234Z  2024-12-18T00:46:46.4613592Z  2024-12-18T00:46:46.4614552Z [12,021 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:46.4615537Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:46:46.4616655Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:46:46.4617857Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:46.4618612Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:46:46.4619675Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:46:46.4620684Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2024-12-18T00:46:46.4621675Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:46:46.4622646Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:46:46.6779644Z 2024-12-18T00:46:46.6780537Z  2024-12-18T00:46:46.6781054Z  2024-12-18T00:46:46.6781473Z  2024-12-18T00:46:46.6781840Z  2024-12-18T00:46:46.6782222Z  2024-12-18T00:46:46.6782649Z  2024-12-18T00:46:46.6783059Z  2024-12-18T00:46:46.6783501Z  2024-12-18T00:46:46.6784426Z [12,023 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:46.6785363Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:46:46.6786304Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:46:46.6787306Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:46.6788073Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:46:46.6789075Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:46:46.6789939Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2024-12-18T00:46:46.6790890Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:46:46.6791856Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:46:47.0075541Z 2024-12-18T00:46:47.0076392Z  2024-12-18T00:46:47.0076895Z  2024-12-18T00:46:47.0077334Z  2024-12-18T00:46:47.0077747Z  2024-12-18T00:46:47.0078177Z  2024-12-18T00:46:47.0078600Z  2024-12-18T00:46:47.0079056Z  2024-12-18T00:46:47.0079424Z  2024-12-18T00:46:47.0080411Z [12,026 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:47.0081406Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:46:47.0082348Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:46:47.0083444Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:47.0084133Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:46:47.0084936Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2024-12-18T00:46:47.0085857Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2024-12-18T00:46:47.0089026Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:46:47.0090199Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:46:47.2078321Z 2024-12-18T00:46:47.2079194Z  2024-12-18T00:46:47.2079708Z  2024-12-18T00:46:47.2080107Z  2024-12-18T00:46:47.2080516Z  2024-12-18T00:46:47.2080894Z  2024-12-18T00:46:47.2081282Z  2024-12-18T00:46:47.2081668Z  2024-12-18T00:46:47.2082072Z  2024-12-18T00:46:47.2082968Z [12,027 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:47.2083922Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:46:47.2084783Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:46:47.2085716Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2024-12-18T00:46:47.2086441Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:46:47.2087287Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2024-12-18T00:46:47.2088232Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2024-12-18T00:46:47.2089447Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:46:47.2090674Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local ... 2024-12-18T00:46:47.4149849Z 2024-12-18T00:46:47.4150685Z  2024-12-18T00:46:47.4151148Z  2024-12-18T00:46:47.4151818Z  2024-12-18T00:46:47.4152220Z  2024-12-18T00:46:47.4152617Z  2024-12-18T00:46:47.4153004Z  2024-12-18T00:46:47.4153397Z  2024-12-18T00:46:47.4153763Z  2024-12-18T00:46:47.4154694Z [12,028 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:47.4155988Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:46:47.4156913Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:46:47.4157828Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:46:47.4158539Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:46:47.4159403Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2024-12-18T00:46:47.4160349Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2024-12-18T00:46:47.4161323Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:46:47.4162349Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local ... 2024-12-18T00:46:47.7759979Z 2024-12-18T00:46:47.7760852Z  2024-12-18T00:46:47.7761326Z  2024-12-18T00:46:47.7761737Z  2024-12-18T00:46:47.7762139Z  2024-12-18T00:46:47.7762545Z  2024-12-18T00:46:47.7762943Z  2024-12-18T00:46:47.7763320Z  2024-12-18T00:46:47.7763884Z  2024-12-18T00:46:47.7764812Z [12,029 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:47.7765835Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:46:47.7766778Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:46:47.7767716Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:46:47.7768472Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:46:47.7769296Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:46:47.7770170Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2024-12-18T00:46:47.7771212Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:46:47.7772161Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local ... 2024-12-18T00:46:48.0086467Z 2024-12-18T00:46:48.0087293Z  2024-12-18T00:46:48.0087784Z  2024-12-18T00:46:48.0088172Z  2024-12-18T00:46:48.0088577Z  2024-12-18T00:46:48.0088979Z  2024-12-18T00:46:48.0089381Z  2024-12-18T00:46:48.0089792Z  2024-12-18T00:46:48.0090181Z  2024-12-18T00:46:48.0091132Z [12,030 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:48.0092121Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:46:48.0093079Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:46:48.0094033Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:46:48.0094826Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:46:48.0095725Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:46:48.0096852Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2024-12-18T00:46:48.0097884Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:46:48.0098893Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local ... 2024-12-18T00:46:48.2454564Z 2024-12-18T00:46:48.2455588Z  2024-12-18T00:46:48.2456080Z  2024-12-18T00:46:48.2456628Z  2024-12-18T00:46:48.2457049Z  2024-12-18T00:46:48.2457453Z  2024-12-18T00:46:48.2457858Z  2024-12-18T00:46:48.2458277Z  2024-12-18T00:46:48.2458686Z  2024-12-18T00:46:48.2459670Z [12,032 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:48.2460982Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:46:48.2462246Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:46:48.2463206Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2024-12-18T00:46:48.2463950Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:46:48.2464881Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:46:48.2466081Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2024-12-18T00:46:48.2467154Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:46:48.2468114Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local ... 2024-12-18T00:46:48.6092714Z 2024-12-18T00:46:48.6093579Z  2024-12-18T00:46:48.6094050Z  2024-12-18T00:46:48.6094420Z  2024-12-18T00:46:48.6094771Z  2024-12-18T00:46:48.6095163Z  2024-12-18T00:46:48.6095585Z  2024-12-18T00:46:48.6095973Z  2024-12-18T00:46:48.6096346Z  2024-12-18T00:46:48.6097526Z [12,035 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:48.6098500Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:46:48.6099349Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:46:48.6100283Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:46:48.6101041Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:46:48.6101910Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:46:48.6102879Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2024-12-18T00:46:48.6103855Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:46:48.6104849Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local ... 2024-12-18T00:46:48.8097883Z 2024-12-18T00:46:48.8098783Z  2024-12-18T00:46:48.8099273Z  2024-12-18T00:46:48.8099653Z  2024-12-18T00:46:48.8100043Z  2024-12-18T00:46:48.8100420Z  2024-12-18T00:46:48.8100823Z  2024-12-18T00:46:48.8101256Z  2024-12-18T00:46:48.8101670Z  2024-12-18T00:46:48.8102626Z [12,036 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:48.8103603Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:46:48.8104549Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:46:48.8105503Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:46:48.8106254Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:46:48.8107318Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2024-12-18T00:46:48.8108343Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2024-12-18T00:46:48.8109371Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:46:48.8110396Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local ... 2024-12-18T00:46:49.3034198Z 2024-12-18T00:46:49.3035125Z  2024-12-18T00:46:49.3035648Z  2024-12-18T00:46:49.3036055Z  2024-12-18T00:46:49.3036454Z  2024-12-18T00:46:49.3036861Z  2024-12-18T00:46:49.3037273Z  2024-12-18T00:46:49.3037682Z  2024-12-18T00:46:49.3038048Z  2024-12-18T00:46:49.3038981Z [12,037 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:49.3039913Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:46:49.3040787Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:46:49.3041676Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2024-12-18T00:46:49.3042397Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:46:49.3043274Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2024-12-18T00:46:49.3044709Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2024-12-18T00:46:49.3045676Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:46:49.3046744Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local ... 2024-12-18T00:46:49.5694707Z 2024-12-18T00:46:49.5695613Z  2024-12-18T00:46:49.5696142Z  2024-12-18T00:46:49.5696724Z  2024-12-18T00:46:49.5697126Z  2024-12-18T00:46:49.5697516Z  2024-12-18T00:46:49.5697919Z  2024-12-18T00:46:49.5698699Z  2024-12-18T00:46:49.5699108Z  2024-12-18T00:46:49.5700083Z [12,038 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:49.5701063Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:46:49.5702006Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:46:49.5702994Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:46:49.5703792Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:46:49.5704695Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2024-12-18T00:46:49.5705709Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2024-12-18T00:46:49.5706720Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2024-12-18T00:46:49.5707728Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local ... 2024-12-18T00:46:49.8107149Z 2024-12-18T00:46:49.8107994Z  2024-12-18T00:46:49.8108487Z  2024-12-18T00:46:49.8108957Z  2024-12-18T00:46:49.8109369Z  2024-12-18T00:46:49.8109764Z  2024-12-18T00:46:49.8110180Z  2024-12-18T00:46:49.8110576Z  2024-12-18T00:46:49.8110982Z  2024-12-18T00:46:49.8111904Z [12,039 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:49.8112899Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:46:49.8113891Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:46:49.8114872Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2024-12-18T00:46:49.8115656Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:46:49.8116566Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2024-12-18T00:46:49.8117545Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2024-12-18T00:46:49.8118554Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2024-12-18T00:46:49.8119601Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local ... 2024-12-18T00:46:50.3986196Z 2024-12-18T00:46:50.3987128Z  2024-12-18T00:46:50.3987616Z  2024-12-18T00:46:50.3988049Z  2024-12-18T00:46:50.3988461Z  2024-12-18T00:46:50.3988877Z  2024-12-18T00:46:50.3989291Z  2024-12-18T00:46:50.3989697Z  2024-12-18T00:46:50.3990098Z  2024-12-18T00:46:50.3991112Z [12,040 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:50.3992164Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:46:50.3993138Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:46:50.3994009Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:46:50.3994708Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:46:50.3995567Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2024-12-18T00:46:50.3996587Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2024-12-18T00:46:50.3997771Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2024-12-18T00:46:50.3998760Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local ... 2024-12-18T00:46:50.6114881Z 2024-12-18T00:46:50.6115829Z  2024-12-18T00:46:50.6116289Z  2024-12-18T00:46:50.6116678Z  2024-12-18T00:46:50.6117078Z  2024-12-18T00:46:50.6117815Z  2024-12-18T00:46:50.6118234Z  2024-12-18T00:46:50.6118619Z  2024-12-18T00:46:50.6119027Z  2024-12-18T00:46:50.6120229Z [12,041 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:50.6121433Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:46:50.6122361Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:46:50.6123298Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:46:50.6124154Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:46:50.6125077Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2024-12-18T00:46:50.6126049Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:46:50.6127013Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:46:50.6127948Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local ... 2024-12-18T00:46:50.8119949Z 2024-12-18T00:46:50.8120812Z  2024-12-18T00:46:50.8121305Z  2024-12-18T00:46:50.8121704Z  2024-12-18T00:46:50.8122105Z  2024-12-18T00:46:50.8122510Z  2024-12-18T00:46:50.8122919Z  2024-12-18T00:46:50.8123322Z  2024-12-18T00:46:50.8123717Z  2024-12-18T00:46:50.8124665Z [12,042 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:50.8125657Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:46:50.8126582Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:46:50.8127555Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:46:50.8128309Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:46:50.8129232Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:46:50.8130220Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:46:50.8131415Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:46:50.8132459Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local ... 2024-12-18T00:46:51.1701097Z 2024-12-18T00:46:51.1702033Z  2024-12-18T00:46:51.1702519Z  2024-12-18T00:46:51.1702906Z  2024-12-18T00:46:51.1703296Z  2024-12-18T00:46:51.1703695Z  2024-12-18T00:46:51.1704095Z  2024-12-18T00:46:51.1704473Z  2024-12-18T00:46:51.1704856Z  2024-12-18T00:46:51.1705812Z [12,045 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:51.1706760Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:46:51.1707607Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:46:51.1708467Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2024-12-18T00:46:51.1709154Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:46:51.1710007Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:46:51.1710933Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:46:51.1711859Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:46:51.1712773Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local ... 2024-12-18T00:46:51.4127201Z 2024-12-18T00:46:51.4128039Z  2024-12-18T00:46:51.4128513Z  2024-12-18T00:46:51.4128916Z  2024-12-18T00:46:51.4129321Z  2024-12-18T00:46:51.4129711Z  2024-12-18T00:46:51.4130140Z  2024-12-18T00:46:51.4130548Z  2024-12-18T00:46:51.4130924Z  2024-12-18T00:46:51.4131878Z [12,047 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:51.4132843Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:46:51.4133716Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:46:51.4134910Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:51.4135669Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:46:51.4136910Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:46:51.4137877Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:46:51.4138833Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:46:51.4139810Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local ... 2024-12-18T00:46:51.6302326Z 2024-12-18T00:46:51.6303201Z  2024-12-18T00:46:51.6304013Z  2024-12-18T00:46:51.6304405Z  2024-12-18T00:46:51.6304970Z  2024-12-18T00:46:51.6305371Z  2024-12-18T00:46:51.6305753Z  2024-12-18T00:46:51.6306127Z  2024-12-18T00:46:51.6306648Z  2024-12-18T00:46:51.6307538Z [12,048 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:51.6308459Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:46:51.6309493Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:46:51.6310349Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:51.6311026Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:46:51.6311898Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:46:51.6312818Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:46:51.6313733Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2024-12-18T00:46:51.6314631Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 15s local ... 2024-12-18T00:46:51.9151245Z 2024-12-18T00:46:51.9152148Z  2024-12-18T00:46:51.9152633Z  2024-12-18T00:46:51.9153050Z  2024-12-18T00:46:51.9153445Z  2024-12-18T00:46:51.9153843Z  2024-12-18T00:46:51.9154229Z  2024-12-18T00:46:51.9154631Z  2024-12-18T00:46:51.9155024Z  2024-12-18T00:46:51.9156173Z [12,049 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:51.9157141Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:46:51.9158041Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:46:51.9158938Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:51.9159651Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:46:51.9160522Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:46:51.9161500Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:46:51.9162389Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2024-12-18T00:46:51.9163290Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 15s local ... 2024-12-18T00:46:52.1603907Z 2024-12-18T00:46:52.1604749Z  2024-12-18T00:46:52.1605256Z  2024-12-18T00:46:52.1605627Z  2024-12-18T00:46:52.1606036Z  2024-12-18T00:46:52.1606391Z  2024-12-18T00:46:52.1606787Z  2024-12-18T00:46:52.1607293Z  2024-12-18T00:46:52.1607933Z  2024-12-18T00:46:52.1609019Z [12,050 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:52.1610004Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:46:52.1610867Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:46:52.1611845Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2024-12-18T00:46:52.1612786Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:46:52.1613689Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:46:52.1614672Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:46:52.1615605Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local 2024-12-18T00:46:52.1616754Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local ... 2024-12-18T00:46:52.4013664Z 2024-12-18T00:46:52.4014532Z  2024-12-18T00:46:52.4015052Z  2024-12-18T00:46:52.4015473Z  2024-12-18T00:46:52.4015878Z  2024-12-18T00:46:52.4016272Z  2024-12-18T00:46:52.4017112Z  2024-12-18T00:46:52.4017543Z  2024-12-18T00:46:52.4017964Z  2024-12-18T00:46:52.4018933Z [12,051 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:52.4019980Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:46:52.4021106Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:46:52.4022316Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:52.4023122Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:46:52.4024115Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:46:52.4025180Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:46:52.4026173Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local 2024-12-18T00:46:52.4027146Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local ... 2024-12-18T00:46:52.6138374Z 2024-12-18T00:46:52.6139270Z  2024-12-18T00:46:52.6139763Z  2024-12-18T00:46:52.6140192Z  2024-12-18T00:46:52.6140599Z  2024-12-18T00:46:52.6140950Z  2024-12-18T00:46:52.6141341Z  2024-12-18T00:46:52.6141732Z  2024-12-18T00:46:52.6142123Z  2024-12-18T00:46:52.6143108Z [12,052 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:52.6144097Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:46:52.6145327Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:46:52.6146263Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:52.6147046Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:46:52.6147903Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:46:52.6148905Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:46:52.6149860Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local 2024-12-18T00:46:52.6150785Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local ... 2024-12-18T00:46:52.8165287Z 2024-12-18T00:46:52.8166165Z  2024-12-18T00:46:52.8166617Z  2024-12-18T00:46:52.8167001Z  2024-12-18T00:46:52.8167403Z  2024-12-18T00:46:52.8167806Z  2024-12-18T00:46:52.8168239Z  2024-12-18T00:46:52.8168665Z  2024-12-18T00:46:52.8169095Z  2024-12-18T00:46:52.8170092Z [12,055 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:52.8171142Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:46:52.8172108Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:46:52.8173133Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:52.8173931Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:46:52.8174908Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:46:52.8175990Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:46:52.8177161Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local 2024-12-18T00:46:52.8178040Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local ... 2024-12-18T00:46:53.1126158Z 2024-12-18T00:46:53.1127015Z  2024-12-18T00:46:53.1127548Z  2024-12-18T00:46:53.1127965Z  2024-12-18T00:46:53.1128372Z  2024-12-18T00:46:53.1128772Z  2024-12-18T00:46:53.1129190Z  2024-12-18T00:46:53.1129605Z  2024-12-18T00:46:53.1130028Z  2024-12-18T00:46:53.1130961Z [12,056 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:53.1131971Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:46:53.1133226Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:46:53.1134225Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2024-12-18T00:46:53.1135083Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:46:53.1135884Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:46:53.1137015Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:46:53.1137878Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local 2024-12-18T00:46:53.1138964Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local ... 2024-12-18T00:46:53.3243061Z 2024-12-18T00:46:53.3243905Z  2024-12-18T00:46:53.3244637Z  2024-12-18T00:46:53.3245040Z  2024-12-18T00:46:53.3245443Z  2024-12-18T00:46:53.3245834Z  2024-12-18T00:46:53.3246219Z  2024-12-18T00:46:53.3246603Z  2024-12-18T00:46:53.3246980Z  2024-12-18T00:46:53.3247930Z [12,059 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:53.3248881Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:46:53.3249820Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:46:53.3250703Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:53.3251413Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:46:53.3252259Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:46:53.3253242Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:46:53.3254139Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:46:53.3254940Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2024-12-18T00:46:53.5379415Z 2024-12-18T00:46:53.5380265Z  2024-12-18T00:46:53.5380720Z  2024-12-18T00:46:53.5381090Z  2024-12-18T00:46:53.5381483Z  2024-12-18T00:46:53.5381897Z  2024-12-18T00:46:53.5382276Z  2024-12-18T00:46:53.5382659Z  2024-12-18T00:46:53.5383031Z  2024-12-18T00:46:53.5383942Z [12,060 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:53.5393781Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:46:53.5394617Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:46:53.5395504Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:53.5396262Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:46:53.5397159Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:46:53.5398104Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:46:53.5399022Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:46:53.5399907Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2024-12-18T00:46:53.8145359Z 2024-12-18T00:46:53.8146304Z  2024-12-18T00:46:53.8146807Z  2024-12-18T00:46:53.8147265Z  2024-12-18T00:46:53.8147687Z  2024-12-18T00:46:53.8148066Z  2024-12-18T00:46:53.8148430Z  2024-12-18T00:46:53.8148842Z  2024-12-18T00:46:53.8149244Z  2024-12-18T00:46:53.8150232Z [12,061 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:53.8151231Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:46:53.8152163Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:46:53.8153111Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:53.8153867Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:46:53.8154742Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:46:53.8155690Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:46:53.8156579Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:46:53.8157654Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2024-12-18T00:46:54.0970877Z 2024-12-18T00:46:54.0971728Z  2024-12-18T00:46:54.0972456Z  2024-12-18T00:46:54.0972858Z  2024-12-18T00:46:54.0973253Z  2024-12-18T00:46:54.0973616Z  2024-12-18T00:46:54.0973992Z  2024-12-18T00:46:54.0974360Z  2024-12-18T00:46:54.0974743Z  2024-12-18T00:46:54.0975838Z [12,065 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:54.0977018Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:46:54.0977931Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:46:54.0978857Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2024-12-18T00:46:54.0979602Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:46:54.0980497Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:46:54.0981397Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:46:54.0982282Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:46:54.0983114Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2024-12-18T00:46:54.4153984Z 2024-12-18T00:46:54.4154841Z  2024-12-18T00:46:54.4155297Z  2024-12-18T00:46:54.4155696Z  2024-12-18T00:46:54.4156114Z  2024-12-18T00:46:54.4156516Z  2024-12-18T00:46:54.4156879Z  2024-12-18T00:46:54.4157259Z  2024-12-18T00:46:54.4157711Z  2024-12-18T00:46:54.4158666Z [12,065 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:54.4159622Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:46:54.4160492Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:46:54.4161423Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:54.4162161Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:46:54.4163003Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:46:54.4163962Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:46:54.4164860Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:46:54.4165650Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local ... 2024-12-18T00:46:54.6157640Z 2024-12-18T00:46:54.6158512Z  2024-12-18T00:46:54.6158989Z  2024-12-18T00:46:54.6159431Z  2024-12-18T00:46:54.6159810Z  2024-12-18T00:46:54.6160165Z  2024-12-18T00:46:54.6160538Z  2024-12-18T00:46:54.6160913Z  2024-12-18T00:46:54.6161284Z  2024-12-18T00:46:54.6162203Z [12,068 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:54.6163154Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:46:54.6164057Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:46:54.6164972Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:54.6165706Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:46:54.6166619Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:46:54.6167545Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:46:54.6168363Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:46:54.6169209Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local ... 2024-12-18T00:46:54.8903608Z 2024-12-18T00:46:54.8904503Z  2024-12-18T00:46:54.8905001Z  2024-12-18T00:46:54.8905426Z  2024-12-18T00:46:54.8905850Z  2024-12-18T00:46:54.8906260Z  2024-12-18T00:46:54.8906659Z  2024-12-18T00:46:54.8907084Z  2024-12-18T00:46:54.8907503Z  2024-12-18T00:46:54.8908458Z [12,070 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:54.8909790Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:46:54.8910855Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:46:54.8911814Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:54.8912571Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:46:54.8913468Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:46:54.8914575Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:46:54.8915556Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:46:54.8916416Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local ... 2024-12-18T00:46:55.1278397Z 2024-12-18T00:46:55.1279053Z  2024-12-18T00:46:55.1279530Z  2024-12-18T00:46:55.1279948Z  2024-12-18T00:46:55.1280335Z  2024-12-18T00:46:55.1280742Z  2024-12-18T00:46:55.1281163Z  2024-12-18T00:46:55.1281565Z  2024-12-18T00:46:55.1281947Z  2024-12-18T00:46:55.1283361Z [12,075 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:55.1284356Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:46:55.1285261Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:46:55.1286166Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2024-12-18T00:46:55.1286908Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:46:55.1287807Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:46:55.1288769Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:46:55.1289671Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:46:55.1290591Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local ... 2024-12-18T00:46:55.4166089Z 2024-12-18T00:46:55.4166967Z  2024-12-18T00:46:55.4167479Z  2024-12-18T00:46:55.4167867Z  2024-12-18T00:46:55.4168265Z  2024-12-18T00:46:55.4168637Z  2024-12-18T00:46:55.4169021Z  2024-12-18T00:46:55.4169474Z  2024-12-18T00:46:55.4169953Z  2024-12-18T00:46:55.4171072Z [12,076 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:55.4172048Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:46:55.4172862Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:46:55.4173677Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:46:55.4174308Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:46:55.4175097Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:46:55.4176002Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:46:55.4177097Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:46:55.4178061Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local ... 2024-12-18T00:46:55.8171582Z 2024-12-18T00:46:55.8172441Z  2024-12-18T00:46:55.8172954Z  2024-12-18T00:46:55.8173407Z  2024-12-18T00:46:55.8173791Z  2024-12-18T00:46:55.8174210Z  2024-12-18T00:46:55.8174629Z  2024-12-18T00:46:55.8175012Z  2024-12-18T00:46:55.8175423Z  2024-12-18T00:46:55.8176364Z [12,077 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:55.8177557Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:46:55.8178496Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:46:55.8179381Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:46:55.8180116Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:46:55.8181006Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:46:55.8182239Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2024-12-18T00:46:55.8183151Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:46:55.8184261Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local ... 2024-12-18T00:46:56.0176277Z 2024-12-18T00:46:56.0177270Z  2024-12-18T00:46:56.0177760Z  2024-12-18T00:46:56.0178141Z  2024-12-18T00:46:56.0178536Z  2024-12-18T00:46:56.0178932Z  2024-12-18T00:46:56.0179323Z  2024-12-18T00:46:56.0179704Z  2024-12-18T00:46:56.0180486Z  2024-12-18T00:46:56.0181427Z [12,078 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:56.0182393Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:46:56.0183261Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:46:56.0184136Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2024-12-18T00:46:56.0184838Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:46:56.0185708Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:46:56.0186682Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2024-12-18T00:46:56.0187532Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:46:56.0188426Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local ... 2024-12-18T00:46:56.3302084Z 2024-12-18T00:46:56.3302929Z  2024-12-18T00:46:56.3303357Z  2024-12-18T00:46:56.3303762Z  2024-12-18T00:46:56.3304160Z  2024-12-18T00:46:56.3304505Z  2024-12-18T00:46:56.3304857Z  2024-12-18T00:46:56.3305210Z  2024-12-18T00:46:56.3305571Z  2024-12-18T00:46:56.3306405Z [12,080 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:56.3307283Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:46:56.3308107Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:46:56.3308936Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:56.3309621Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:46:56.3310427Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:46:56.3311280Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2024-12-18T00:46:56.3312101Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 20s local 2024-12-18T00:46:56.3312953Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local ... 2024-12-18T00:46:56.6182397Z 2024-12-18T00:46:56.6183203Z  2024-12-18T00:46:56.6183612Z  2024-12-18T00:46:56.6183957Z  2024-12-18T00:46:56.6184266Z  2024-12-18T00:46:56.6184617Z  2024-12-18T00:46:56.6184930Z  2024-12-18T00:46:56.6185273Z  2024-12-18T00:46:56.6185592Z  2024-12-18T00:46:56.6186400Z [12,083 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:56.6187218Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:46:56.6187978Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:46:56.6188724Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:56.6189303Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:46:56.6190006Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:46:56.6190787Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2024-12-18T00:46:56.6191563Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2024-12-18T00:46:56.6192301Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local ... 2024-12-18T00:46:56.8187959Z 2024-12-18T00:46:56.8188958Z  2024-12-18T00:46:56.8189442Z  2024-12-18T00:46:56.8189830Z  2024-12-18T00:46:56.8190233Z  2024-12-18T00:46:56.8190593Z  2024-12-18T00:46:56.8191435Z  2024-12-18T00:46:56.8191815Z  2024-12-18T00:46:56.8192205Z  2024-12-18T00:46:56.8193289Z [12,084 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:56.8194253Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:46:56.8195200Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:46:56.8196158Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:56.8196911Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:46:56.8198025Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:46:56.8198972Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2024-12-18T00:46:56.8199935Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2024-12-18T00:46:56.8200855Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local ... 2024-12-18T00:46:57.1417139Z 2024-12-18T00:46:57.1417976Z  2024-12-18T00:46:57.1418455Z  2024-12-18T00:46:57.1418854Z  2024-12-18T00:46:57.1419258Z  2024-12-18T00:46:57.1419658Z  2024-12-18T00:46:57.1420061Z  2024-12-18T00:46:57.1420450Z  2024-12-18T00:46:57.1420864Z  2024-12-18T00:46:57.1421797Z [12,087 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:57.1422788Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:46:57.1423768Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:46:57.1424650Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2024-12-18T00:46:57.1425307Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:46:57.1426105Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:46:57.1426999Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2024-12-18T00:46:57.1427901Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2024-12-18T00:46:57.1428756Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local ... 2024-12-18T00:46:57.4194182Z 2024-12-18T00:46:57.4195046Z  2024-12-18T00:46:57.4195539Z  2024-12-18T00:46:57.4195960Z  2024-12-18T00:46:57.4196526Z  2024-12-18T00:46:57.4196897Z  2024-12-18T00:46:57.4197283Z  2024-12-18T00:46:57.4197679Z  2024-12-18T00:46:57.4198092Z  2024-12-18T00:46:57.4199039Z [12,088 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:57.4200089Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:46:57.4201018Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:46:57.4201932Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:57.4202687Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:46:57.4203580Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:46:57.4204589Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2024-12-18T00:46:57.4205565Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2024-12-18T00:46:57.4206507Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local ... 2024-12-18T00:46:57.6198436Z 2024-12-18T00:46:57.6199347Z  2024-12-18T00:46:57.6199838Z  2024-12-18T00:46:57.6200238Z  2024-12-18T00:46:57.6200636Z  2024-12-18T00:46:57.6201019Z  2024-12-18T00:46:57.6201404Z  2024-12-18T00:46:57.6201786Z  2024-12-18T00:46:57.6202216Z  2024-12-18T00:46:57.6203155Z [12,089 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:57.6204123Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:46:57.6205019Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 50s local 2024-12-18T00:46:57.6205933Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:57.6206905Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:46:57.6207787Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:46:57.6208930Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:46:57.6209845Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2024-12-18T00:46:57.6210724Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local ... 2024-12-18T00:46:57.9100453Z 2024-12-18T00:46:57.9101261Z  2024-12-18T00:46:57.9101737Z  2024-12-18T00:46:57.9102145Z  2024-12-18T00:46:57.9102996Z  2024-12-18T00:46:57.9103411Z  2024-12-18T00:46:57.9103794Z  2024-12-18T00:46:57.9104182Z  2024-12-18T00:46:57.9104593Z  2024-12-18T00:46:57.9105535Z [12,091 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:57.9106496Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:46:57.9107190Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:57.9107915Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:46:57.9108856Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:46:57.9109861Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:46:57.9110831Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2024-12-18T00:46:57.9111697Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local 2024-12-18T00:46:57.9112606Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local ... 2024-12-18T00:46:58.2205422Z 2024-12-18T00:46:58.2206240Z  2024-12-18T00:46:58.2206724Z  2024-12-18T00:46:58.2207099Z  2024-12-18T00:46:58.2207485Z  2024-12-18T00:46:58.2207874Z  2024-12-18T00:46:58.2208277Z  2024-12-18T00:46:58.2208678Z  2024-12-18T00:46:58.2209062Z  2024-12-18T00:46:58.2210019Z [12,091 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:58.2211046Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:46:58.2211738Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2024-12-18T00:46:58.2212498Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:46:58.2213389Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:46:58.2214419Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:46:58.2215415Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2024-12-18T00:46:58.2216292Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local 2024-12-18T00:46:58.2217335Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local ... 2024-12-18T00:46:58.4249914Z 2024-12-18T00:46:58.4250720Z  2024-12-18T00:46:58.4251191Z  2024-12-18T00:46:58.4251602Z  2024-12-18T00:46:58.4252027Z  2024-12-18T00:46:58.4252432Z  2024-12-18T00:46:58.4252875Z  2024-12-18T00:46:58.4253277Z  2024-12-18T00:46:58.4253689Z  2024-12-18T00:46:58.4254649Z [12,094 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:58.4255660Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:46:58.4256402Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:46:58.4257297Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:46:58.4258228Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:46:58.4259267Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2024-12-18T00:46:58.4260214Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:46:58.4261207Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:46:58.4262378Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:46:58.8212975Z 2024-12-18T00:46:58.8213838Z  2024-12-18T00:46:58.8214697Z  2024-12-18T00:46:58.8215106Z  2024-12-18T00:46:58.8215496Z  2024-12-18T00:46:58.8215910Z  2024-12-18T00:46:58.8216312Z  2024-12-18T00:46:58.8216839Z  2024-12-18T00:46:58.8217402Z  2024-12-18T00:46:58.8218342Z [12,094 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:58.8219322Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:46:58.8220030Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:46:58.8220924Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:46:58.8221883Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:46:58.8222894Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2024-12-18T00:46:58.8223773Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:46:58.8224694Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:46:58.8225809Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:46:59.0217738Z 2024-12-18T00:46:59.0218633Z  2024-12-18T00:46:59.0219106Z  2024-12-18T00:46:59.0219541Z  2024-12-18T00:46:59.0219944Z  2024-12-18T00:46:59.0220344Z  2024-12-18T00:46:59.0220749Z  2024-12-18T00:46:59.0221140Z  2024-12-18T00:46:59.0221551Z  2024-12-18T00:46:59.0222515Z [12,095 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:59.0223527Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:46:59.0224244Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:46:59.0224985Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:46:59.0225874Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:46:59.0226853Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2024-12-18T00:46:59.0227763Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:46:59.0228690Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:46:59.0230001Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:46:59.2884702Z 2024-12-18T00:46:59.2885584Z  2024-12-18T00:46:59.2886083Z  2024-12-18T00:46:59.2886488Z  2024-12-18T00:46:59.2886881Z  2024-12-18T00:46:59.2887263Z  2024-12-18T00:46:59.2887640Z  2024-12-18T00:46:59.2888007Z  2024-12-18T00:46:59.2888397Z  2024-12-18T00:46:59.2889467Z [12,097 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:59.2890581Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:46:59.2891338Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2024-12-18T00:46:59.2892047Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:46:59.2892871Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:46:59.2893975Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:46:59.2894944Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:46:59.2895814Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:46:59.2897006Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local ... 2024-12-18T00:46:59.5441484Z 2024-12-18T00:46:59.5442356Z  2024-12-18T00:46:59.5442818Z  2024-12-18T00:46:59.5443221Z  2024-12-18T00:46:59.5443589Z  2024-12-18T00:46:59.5443954Z  2024-12-18T00:46:59.5444629Z  2024-12-18T00:46:59.5445022Z  2024-12-18T00:46:59.5445422Z  2024-12-18T00:46:59.5446323Z [12,098 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:46:59.5447216Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:46:59.5448131Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:46:59.5448868Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:46:59.5450061Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:46:59.5451085Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:46:59.5451980Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2024-12-18T00:46:59.5452915Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2024-12-18T00:46:59.5454160Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local ... 2024-12-18T00:46:59.8225819Z 2024-12-18T00:46:59.8226691Z  2024-12-18T00:46:59.8227240Z  2024-12-18T00:46:59.8227672Z  2024-12-18T00:46:59.8228094Z  2024-12-18T00:46:59.8228529Z  2024-12-18T00:46:59.8228961Z  2024-12-18T00:46:59.8229406Z  2024-12-18T00:46:59.8229829Z  2024-12-18T00:46:59.8230829Z [12,100 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:46:59.8232058Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:46:59.8232793Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:46:59.8233568Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:46:59.8234471Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:46:59.8235441Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:46:59.8236342Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2024-12-18T00:46:59.8237270Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2024-12-18T00:46:59.8238388Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local ... 2024-12-18T00:47:00.2231987Z 2024-12-18T00:47:00.2232872Z  2024-12-18T00:47:00.2233346Z  2024-12-18T00:47:00.2233753Z  2024-12-18T00:47:00.2234145Z  2024-12-18T00:47:00.2234535Z  2024-12-18T00:47:00.2234934Z  2024-12-18T00:47:00.2235329Z  2024-12-18T00:47:00.2235744Z  2024-12-18T00:47:00.2236698Z [12,101 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:00.2237643Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:47:00.2238319Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2024-12-18T00:47:00.2239033Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:47:00.2239900Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:47:00.2240804Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2024-12-18T00:47:00.2241701Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2024-12-18T00:47:00.2242780Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2024-12-18T00:47:00.2243611Z @onednn//:mkl_dnn; 18s local ... 2024-12-18T00:47:00.4237154Z 2024-12-18T00:47:00.4238017Z  2024-12-18T00:47:00.4238523Z  2024-12-18T00:47:00.4238925Z  2024-12-18T00:47:00.4239296Z  2024-12-18T00:47:00.4239640Z  2024-12-18T00:47:00.4240023Z  2024-12-18T00:47:00.4240425Z  2024-12-18T00:47:00.4240838Z  2024-12-18T00:47:00.4241796Z [12,105 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:00.4242744Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:47:00.4243424Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:47:00.4244428Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:47:00.4245337Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:47:00.4246131Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:47:00.4247045Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2024-12-18T00:47:00.4248129Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:47:00.4249296Z @onednn//:mkl_dnn; 18s local ... 2024-12-18T00:47:00.8242343Z 2024-12-18T00:47:00.8243205Z  2024-12-18T00:47:00.8243662Z  2024-12-18T00:47:00.8244044Z  2024-12-18T00:47:00.8247089Z  2024-12-18T00:47:00.8247547Z  2024-12-18T00:47:00.8247945Z  2024-12-18T00:47:00.8248341Z  2024-12-18T00:47:00.8248733Z  2024-12-18T00:47:00.8249677Z [12,109 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:00.8250849Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:47:00.8251707Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:47:00.8252430Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:47:00.8253320Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:00.8254251Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:47:00.8255199Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2024-12-18T00:47:00.8256313Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:47:00.8257297Z @onednn//:mkl_dnn; 18s local ... 2024-12-18T00:47:01.0247982Z 2024-12-18T00:47:01.0248845Z  2024-12-18T00:47:01.0249340Z  2024-12-18T00:47:01.0249689Z  2024-12-18T00:47:01.0250064Z  2024-12-18T00:47:01.0250409Z  2024-12-18T00:47:01.0250770Z  2024-12-18T00:47:01.0251139Z  2024-12-18T00:47:01.0251517Z  2024-12-18T00:47:01.0252471Z [12,110 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:01.0253407Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:47:01.0254075Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2024-12-18T00:47:01.0254811Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:01.0255660Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:01.0256643Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:47:01.0257532Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2024-12-18T00:47:01.0258619Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:47:01.0259424Z @onednn//:mkl_dnn; 19s local ... 2024-12-18T00:47:01.3714837Z 2024-12-18T00:47:01.3715755Z  2024-12-18T00:47:01.3716257Z  2024-12-18T00:47:01.3716658Z  2024-12-18T00:47:01.3717075Z  2024-12-18T00:47:01.3717482Z  2024-12-18T00:47:01.3717915Z  2024-12-18T00:47:01.3718313Z  2024-12-18T00:47:01.3718683Z  2024-12-18T00:47:01.3719787Z [12,112 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:01.3720709Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:01.3721396Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:47:01.3722138Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:01.3723024Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:01.3723911Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:47:01.3724850Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2024-12-18T00:47:01.3725933Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2024-12-18T00:47:01.3727004Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local ... 2024-12-18T00:47:01.6254991Z 2024-12-18T00:47:01.6255907Z  2024-12-18T00:47:01.6256395Z  2024-12-18T00:47:01.6256952Z  2024-12-18T00:47:01.6257362Z  2024-12-18T00:47:01.6257692Z  2024-12-18T00:47:01.6258096Z  2024-12-18T00:47:01.6258475Z  2024-12-18T00:47:01.6258862Z  2024-12-18T00:47:01.6259809Z [12,114 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:01.6261088Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:01.6261814Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:47:01.6262561Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:01.6263600Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:01.6264455Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:47:01.6265384Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:47:01.6266600Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2024-12-18T00:47:01.6267777Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local ... 2024-12-18T00:47:01.8259172Z 2024-12-18T00:47:01.8260035Z  2024-12-18T00:47:01.8260504Z  2024-12-18T00:47:01.8260914Z  2024-12-18T00:47:01.8261314Z  2024-12-18T00:47:01.8261701Z  2024-12-18T00:47:01.8262100Z  2024-12-18T00:47:01.8262490Z  2024-12-18T00:47:01.8262917Z  2024-12-18T00:47:01.8263841Z [12,115 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:01.8264767Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:01.8265425Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:47:01.8266196Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:01.8267081Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:47:01.8267950Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:47:01.8268895Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:47:01.8269955Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2024-12-18T00:47:01.8271064Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local ... 2024-12-18T00:47:02.0517766Z 2024-12-18T00:47:02.0518576Z  2024-12-18T00:47:02.0519088Z  2024-12-18T00:47:02.0519542Z  2024-12-18T00:47:02.0519965Z  2024-12-18T00:47:02.0520364Z  2024-12-18T00:47:02.0520783Z  2024-12-18T00:47:02.0521198Z  2024-12-18T00:47:02.0521625Z  2024-12-18T00:47:02.0522612Z [12,118 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:02.0523789Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:02.0524565Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2024-12-18T00:47:02.0525389Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:47:02.0526551Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:47:02.0527533Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:47:02.0528577Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2024-12-18T00:47:02.0529804Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2024-12-18T00:47:02.0531148Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local ... 2024-12-18T00:47:02.4265687Z 2024-12-18T00:47:02.4266600Z  2024-12-18T00:47:02.4267073Z  2024-12-18T00:47:02.4267471Z  2024-12-18T00:47:02.4267863Z  2024-12-18T00:47:02.4268277Z  2024-12-18T00:47:02.4268646Z  2024-12-18T00:47:02.4268992Z  2024-12-18T00:47:02.4269359Z  2024-12-18T00:47:02.4270251Z [12,119 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:02.4271444Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:47:02.4272109Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:47:02.4272834Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:47:02.4273690Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:47:02.4274567Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2024-12-18T00:47:02.4275514Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:47:02.4276881Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2024-12-18T00:47:02.4278123Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local ... 2024-12-18T00:47:02.7236082Z 2024-12-18T00:47:02.7236947Z  2024-12-18T00:47:02.7237453Z  2024-12-18T00:47:02.7237872Z  2024-12-18T00:47:02.7238278Z  2024-12-18T00:47:02.7238701Z  2024-12-18T00:47:02.7239108Z  2024-12-18T00:47:02.7239526Z  2024-12-18T00:47:02.7239934Z  2024-12-18T00:47:02.7241310Z [12,123 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:02.7242349Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:47:02.7243091Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:47:02.7244021Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:47:02.7245145Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:02.7246071Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2024-12-18T00:47:02.7247213Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:47:02.7248376Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2024-12-18T00:47:02.7249521Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local ... 2024-12-18T00:47:03.0272436Z 2024-12-18T00:47:03.0273253Z  2024-12-18T00:47:03.0273709Z  2024-12-18T00:47:03.0274106Z  2024-12-18T00:47:03.0274537Z  2024-12-18T00:47:03.0274931Z  2024-12-18T00:47:03.0275324Z  2024-12-18T00:47:03.0275745Z  2024-12-18T00:47:03.0276097Z  2024-12-18T00:47:03.0277053Z [12,123 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:03.0278216Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:47:03.0278920Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:47:03.0279680Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:47:03.0280473Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:03.0281373Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2024-12-18T00:47:03.0282322Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:47:03.0283455Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2024-12-18T00:47:03.0284571Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2024-12-18T00:47:03.3000046Z 2024-12-18T00:47:03.3000897Z  2024-12-18T00:47:03.3001387Z  2024-12-18T00:47:03.3001797Z  2024-12-18T00:47:03.3002334Z  2024-12-18T00:47:03.3002731Z  2024-12-18T00:47:03.3003143Z  2024-12-18T00:47:03.3003541Z  2024-12-18T00:47:03.3003950Z  2024-12-18T00:47:03.3004919Z [12,124 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:03.3006161Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:47:03.3006910Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2024-12-18T00:47:03.3007690Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:47:03.3008670Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:03.3009637Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2024-12-18T00:47:03.3010655Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2024-12-18T00:47:03.3012015Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2024-12-18T00:47:03.3013175Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2024-12-18T00:47:03.6279692Z 2024-12-18T00:47:03.6280471Z  2024-12-18T00:47:03.6280952Z  2024-12-18T00:47:03.6281344Z  2024-12-18T00:47:03.6281741Z  2024-12-18T00:47:03.6282135Z  2024-12-18T00:47:03.6282792Z  2024-12-18T00:47:03.6283181Z  2024-12-18T00:47:03.6283571Z  2024-12-18T00:47:03.6284541Z [12,124 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:03.6285682Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:47:03.6286390Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:47:03.6287116Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:47:03.6287985Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:03.6289110Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:47:03.6290067Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:47:03.6291132Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2024-12-18T00:47:03.6292194Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2024-12-18T00:47:03.9762383Z 2024-12-18T00:47:03.9763299Z  2024-12-18T00:47:03.9763748Z  2024-12-18T00:47:03.9764131Z  2024-12-18T00:47:03.9764513Z  2024-12-18T00:47:03.9764906Z  2024-12-18T00:47:03.9765311Z  2024-12-18T00:47:03.9765699Z  2024-12-18T00:47:03.9766127Z  2024-12-18T00:47:03.9767085Z [12,126 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:03.9768077Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:47:03.9768803Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:47:03.9769510Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:03.9770362Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:47:03.9771253Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:47:03.9772208Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:47:03.9773396Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:47:03.9774490Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local ... 2024-12-18T00:47:04.1934590Z 2024-12-18T00:47:04.1935431Z  2024-12-18T00:47:04.1935928Z  2024-12-18T00:47:04.1936346Z  2024-12-18T00:47:04.1936906Z  2024-12-18T00:47:04.1937329Z  2024-12-18T00:47:04.1937717Z  2024-12-18T00:47:04.1938109Z  2024-12-18T00:47:04.1938489Z  2024-12-18T00:47:04.1939456Z [12,127 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:04.1940461Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:04.1941191Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2024-12-18T00:47:04.1941979Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:04.1942850Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:47:04.1943792Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:47:04.1946713Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2024-12-18T00:47:04.1947898Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:47:04.1949012Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local ... 2024-12-18T00:47:04.4289301Z 2024-12-18T00:47:04.4290138Z  2024-12-18T00:47:04.4290635Z  2024-12-18T00:47:04.4291052Z  2024-12-18T00:47:04.4291475Z  2024-12-18T00:47:04.4291893Z  2024-12-18T00:47:04.4292304Z  2024-12-18T00:47:04.4292706Z  2024-12-18T00:47:04.4293161Z  2024-12-18T00:47:04.4294164Z [12,127 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:04.4295217Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:04.4295969Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:47:04.4296900Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:04.4298083Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:47:04.4299066Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 24s local 2024-12-18T00:47:04.4300175Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:47:04.4301405Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:47:04.4302548Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local ... 2024-12-18T00:47:04.8294138Z 2024-12-18T00:47:04.8294987Z  2024-12-18T00:47:04.8295478Z  2024-12-18T00:47:04.8296250Z  2024-12-18T00:47:04.8296792Z  2024-12-18T00:47:04.8297206Z  2024-12-18T00:47:04.8297621Z  2024-12-18T00:47:04.8298031Z  2024-12-18T00:47:04.8298443Z  2024-12-18T00:47:04.8299435Z [12,132 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:04.8300477Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:04.8301236Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:47:04.8302029Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:04.8302990Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:04.8304095Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:47:04.8305303Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2024-12-18T00:47:04.8306396Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2024-12-18T00:47:04.8307382Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local ... 2024-12-18T00:47:05.0299250Z 2024-12-18T00:47:05.0300085Z  2024-12-18T00:47:05.0300568Z  2024-12-18T00:47:05.0300976Z  2024-12-18T00:47:05.0301391Z  2024-12-18T00:47:05.0301978Z  2024-12-18T00:47:05.0302378Z  2024-12-18T00:47:05.0302781Z  2024-12-18T00:47:05.0303173Z  2024-12-18T00:47:05.0304128Z [12,133 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:05.0305126Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:05.0305816Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:47:05.0306518Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:05.0307341Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:05.0308394Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:47:05.0309512Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:47:05.0310509Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2024-12-18T00:47:05.0311430Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local ... 2024-12-18T00:47:05.2499133Z 2024-12-18T00:47:05.2499962Z  2024-12-18T00:47:05.2500456Z  2024-12-18T00:47:05.2500882Z  2024-12-18T00:47:05.2501298Z  2024-12-18T00:47:05.2501721Z  2024-12-18T00:47:05.2502143Z  2024-12-18T00:47:05.2502559Z  2024-12-18T00:47:05.2502963Z  2024-12-18T00:47:05.2503917Z [12,134 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:05.2504932Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:47:05.2505658Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2024-12-18T00:47:05.2506437Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:05.2507376Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:05.2508490Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2024-12-18T00:47:05.2509657Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:47:05.2510748Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2024-12-18T00:47:05.2511755Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local ... 2024-12-18T00:47:05.5511381Z 2024-12-18T00:47:05.5512487Z  2024-12-18T00:47:05.5512983Z  2024-12-18T00:47:05.5513392Z  2024-12-18T00:47:05.5513795Z  2024-12-18T00:47:05.5514213Z  2024-12-18T00:47:05.5514881Z  2024-12-18T00:47:05.5515305Z  2024-12-18T00:47:05.5515690Z  2024-12-18T00:47:05.5516652Z [12,136 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:05.5517641Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:47:05.5518516Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:47:05.5519426Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:05.5520333Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:05.5521424Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:47:05.5522592Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:47:05.5523678Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:47:05.5524655Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2024-12-18T00:47:05.7728935Z 2024-12-18T00:47:05.7729769Z  2024-12-18T00:47:05.7730226Z  2024-12-18T00:47:05.7730585Z  2024-12-18T00:47:05.7730940Z  2024-12-18T00:47:05.7731296Z  2024-12-18T00:47:05.7731642Z  2024-12-18T00:47:05.7732004Z  2024-12-18T00:47:05.7732405Z  2024-12-18T00:47:05.7733361Z [12,139 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:05.7734384Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:47:05.7735132Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:47:05.7735905Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:05.7737006Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:05.7738128Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:47:05.7739109Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2024-12-18T00:47:05.7739965Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:47:05.7740731Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2024-12-18T00:47:06.0308131Z 2024-12-18T00:47:06.0308984Z  2024-12-18T00:47:06.0309453Z  2024-12-18T00:47:06.0309851Z  2024-12-18T00:47:06.0310413Z  2024-12-18T00:47:06.0310827Z  2024-12-18T00:47:06.0311229Z  2024-12-18T00:47:06.0311664Z  2024-12-18T00:47:06.0312042Z  2024-12-18T00:47:06.0312997Z [12,140 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:06.0314017Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:47:06.0314723Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2024-12-18T00:47:06.0315472Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:47:06.0316414Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:06.0317475Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:47:06.0318649Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:47:06.0319732Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:47:06.0329412Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2024-12-18T00:47:06.3175309Z 2024-12-18T00:47:06.3176195Z  2024-12-18T00:47:06.3176868Z  2024-12-18T00:47:06.3177284Z  2024-12-18T00:47:06.3177701Z  2024-12-18T00:47:06.3178090Z  2024-12-18T00:47:06.3178510Z  2024-12-18T00:47:06.3179087Z  2024-12-18T00:47:06.3179501Z  2024-12-18T00:47:06.3180490Z [12,143 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:06.3181449Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:47:06.3182408Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:47:06.3183173Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:47:06.3186212Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:06.3187359Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2024-12-18T00:47:06.3188434Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:47:06.3189642Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:47:06.3190655Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2024-12-18T00:47:06.6314282Z 2024-12-18T00:47:06.6315158Z  2024-12-18T00:47:06.6315624Z  2024-12-18T00:47:06.6316014Z  2024-12-18T00:47:06.6316419Z  2024-12-18T00:47:06.6316832Z  2024-12-18T00:47:06.6317228Z  2024-12-18T00:47:06.6317614Z  2024-12-18T00:47:06.6317989Z  2024-12-18T00:47:06.6318925Z [12,144 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:06.6319892Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:47:06.6320572Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:47:06.6321317Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:47:06.6322154Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:06.6323208Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:47:06.6324356Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2024-12-18T00:47:06.6325365Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2024-12-18T00:47:06.6326301Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local ... 2024-12-18T00:47:07.0320583Z 2024-12-18T00:47:07.0321451Z  2024-12-18T00:47:07.0322024Z  2024-12-18T00:47:07.0322441Z  2024-12-18T00:47:07.0322861Z  2024-12-18T00:47:07.0323316Z  2024-12-18T00:47:07.0323796Z  2024-12-18T00:47:07.0324231Z  2024-12-18T00:47:07.0324681Z  2024-12-18T00:47:07.0325756Z [12,145 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:07.0326879Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:47:07.0327649Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:47:07.0328368Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:07.0329368Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:47:07.0330489Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:47:07.0331656Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:47:07.0332777Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2024-12-18T00:47:07.0333717Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local ... 2024-12-18T00:47:07.2324815Z 2024-12-18T00:47:07.2325650Z  2024-12-18T00:47:07.2326140Z  2024-12-18T00:47:07.2326549Z  2024-12-18T00:47:07.2326941Z  2024-12-18T00:47:07.2327376Z  2024-12-18T00:47:07.2327773Z  2024-12-18T00:47:07.2328166Z  2024-12-18T00:47:07.2328555Z  2024-12-18T00:47:07.2329527Z [12,146 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:07.2330481Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:07.2331149Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2024-12-18T00:47:07.2331845Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:07.2332654Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:47:07.2333697Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2024-12-18T00:47:07.2334759Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:47:07.2336038Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2024-12-18T00:47:07.2337086Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local ... 2024-12-18T00:47:07.5375375Z 2024-12-18T00:47:07.5376271Z  2024-12-18T00:47:07.5376897Z  2024-12-18T00:47:07.5377259Z  2024-12-18T00:47:07.5377657Z  2024-12-18T00:47:07.5378060Z  2024-12-18T00:47:07.5378473Z  2024-12-18T00:47:07.5378865Z  2024-12-18T00:47:07.5379247Z  2024-12-18T00:47:07.5380372Z [12,149 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:07.5381424Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:07.5382128Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:47:07.5382833Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:07.5383683Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:47:07.5384750Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:47:07.5385816Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:47:07.5386826Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2024-12-18T00:47:07.5387751Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local ... 2024-12-18T00:47:07.8333127Z 2024-12-18T00:47:07.8333976Z  2024-12-18T00:47:07.8334462Z  2024-12-18T00:47:07.8334853Z  2024-12-18T00:47:07.8335233Z  2024-12-18T00:47:07.8335653Z  2024-12-18T00:47:07.8336028Z  2024-12-18T00:47:07.8336417Z  2024-12-18T00:47:07.8336951Z  2024-12-18T00:47:07.8337939Z [12,152 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:07.8338897Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:07.8339595Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:47:07.8340366Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:07.8341264Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:47:07.8342263Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:47:07.8343336Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2024-12-18T00:47:07.8344591Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2024-12-18T00:47:07.8345510Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local ... 2024-12-18T00:47:08.0337231Z 2024-12-18T00:47:08.0338119Z  2024-12-18T00:47:08.0338608Z  2024-12-18T00:47:08.0338996Z  2024-12-18T00:47:08.0339390Z  2024-12-18T00:47:08.0339781Z  2024-12-18T00:47:08.0340179Z  2024-12-18T00:47:08.0340555Z  2024-12-18T00:47:08.0340958Z  2024-12-18T00:47:08.0341931Z [12,153 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:08.0342950Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:08.0343623Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2024-12-18T00:47:08.0344577Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:47:08.0345451Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:47:08.0346454Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2024-12-18T00:47:08.0347475Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:47:08.0348487Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2024-12-18T00:47:08.0349417Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local ... 2024-12-18T00:47:08.4342759Z 2024-12-18T00:47:08.4343576Z  2024-12-18T00:47:08.4344062Z  2024-12-18T00:47:08.4344655Z  2024-12-18T00:47:08.4345013Z  2024-12-18T00:47:08.4345392Z  2024-12-18T00:47:08.4345756Z  2024-12-18T00:47:08.4346566Z  2024-12-18T00:47:08.4347010Z  2024-12-18T00:47:08.4347950Z [12,154 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:08.4349112Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:47:08.4349810Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:47:08.4350520Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:47:08.4351323Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:47:08.4352536Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 27s local 2024-12-18T00:47:08.4353814Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:47:08.4354720Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2024-12-18T00:47:08.4355616Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local ... 2024-12-18T00:47:08.7908171Z 2024-12-18T00:47:08.7909036Z  2024-12-18T00:47:08.7909493Z  2024-12-18T00:47:08.7909853Z  2024-12-18T00:47:08.7910211Z  2024-12-18T00:47:08.7910579Z  2024-12-18T00:47:08.7910943Z  2024-12-18T00:47:08.7911321Z  2024-12-18T00:47:08.7911659Z  2024-12-18T00:47:08.7912502Z [12,155 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:08.7913375Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:47:08.7913987Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:47:08.7914672Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:47:08.7915468Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:47:08.7916416Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2024-12-18T00:47:08.7917336Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2024-12-18T00:47:08.7918119Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2024-12-18T00:47:08.7919010Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local ... 2024-12-18T00:47:09.0350487Z 2024-12-18T00:47:09.0351393Z  2024-12-18T00:47:09.0351865Z  2024-12-18T00:47:09.0352273Z  2024-12-18T00:47:09.0352719Z  2024-12-18T00:47:09.0353120Z  2024-12-18T00:47:09.0353510Z  2024-12-18T00:47:09.0353920Z  2024-12-18T00:47:09.0354333Z  2024-12-18T00:47:09.0355448Z [12,155 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:09.0356589Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:47:09.0357245Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:47:09.0357994Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:47:09.0358868Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:47:09.0359921Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:47:09.0360928Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2024-12-18T00:47:09.0361785Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2024-12-18T00:47:09.0362715Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local ... 2024-12-18T00:47:09.3021763Z 2024-12-18T00:47:09.3022600Z  2024-12-18T00:47:09.3023104Z  2024-12-18T00:47:09.3023497Z  2024-12-18T00:47:09.3023870Z  2024-12-18T00:47:09.3024248Z  2024-12-18T00:47:09.3024621Z  2024-12-18T00:47:09.3024982Z  2024-12-18T00:47:09.3025378Z  2024-12-18T00:47:09.3026272Z [12,159 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:09.3027190Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:47:09.3027864Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2024-12-18T00:47:09.3028581Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:47:09.3029327Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:47:09.3030585Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:47:09.3031660Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2024-12-18T00:47:09.3032555Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2024-12-18T00:47:09.3033486Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:09.6356293Z 2024-12-18T00:47:09.6357179Z  2024-12-18T00:47:09.6357660Z  2024-12-18T00:47:09.6358065Z  2024-12-18T00:47:09.6358737Z  2024-12-18T00:47:09.6359244Z  2024-12-18T00:47:09.6359626Z  2024-12-18T00:47:09.6360001Z  2024-12-18T00:47:09.6360365Z  2024-12-18T00:47:09.6361300Z [12,161 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:09.6362251Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:47:09.6362946Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:47:09.6363658Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:47:09.6364582Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:47:09.6365836Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2024-12-18T00:47:09.6366879Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:47:09.6367782Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2024-12-18T00:47:09.6368555Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:10.0189937Z 2024-12-18T00:47:10.0190795Z  2024-12-18T00:47:10.0191258Z  2024-12-18T00:47:10.0191643Z  2024-12-18T00:47:10.0192030Z  2024-12-18T00:47:10.0192400Z  2024-12-18T00:47:10.0192784Z  2024-12-18T00:47:10.0193141Z  2024-12-18T00:47:10.0193519Z  2024-12-18T00:47:10.0194437Z [12,164 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:10.0195406Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:47:10.0196054Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:47:10.0196767Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:47:10.0197596Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:47:10.0198593Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:47:10.0199522Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:47:10.0200429Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2024-12-18T00:47:10.0201250Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:10.2362922Z 2024-12-18T00:47:10.2363822Z  2024-12-18T00:47:10.2364272Z  2024-12-18T00:47:10.2364668Z  2024-12-18T00:47:10.2365054Z  2024-12-18T00:47:10.2365428Z  2024-12-18T00:47:10.2365813Z  2024-12-18T00:47:10.2366185Z  2024-12-18T00:47:10.2366604Z  2024-12-18T00:47:10.2367518Z [12,164 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:10.2368471Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:47:10.2369142Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2024-12-18T00:47:10.2369847Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:47:10.2370661Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:47:10.2371687Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:47:10.2372707Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:47:10.2373567Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2024-12-18T00:47:10.2374302Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:10.4367420Z 2024-12-18T00:47:10.4368280Z  2024-12-18T00:47:10.4368771Z  2024-12-18T00:47:10.4369172Z  2024-12-18T00:47:10.4369852Z  2024-12-18T00:47:10.4370210Z  2024-12-18T00:47:10.4370591Z  2024-12-18T00:47:10.4370975Z  2024-12-18T00:47:10.4371345Z  2024-12-18T00:47:10.4372512Z [12,165 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:10.4373520Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:47:10.4374185Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:47:10.4374866Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:47:10.4375863Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:47:10.4377135Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:47:10.4378077Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:47:10.4379034Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2024-12-18T00:47:10.4379842Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:10.7780379Z 2024-12-18T00:47:10.7781234Z  2024-12-18T00:47:10.7781740Z  2024-12-18T00:47:10.7782144Z  2024-12-18T00:47:10.7782523Z  2024-12-18T00:47:10.7782913Z  2024-12-18T00:47:10.7783274Z  2024-12-18T00:47:10.7783681Z  2024-12-18T00:47:10.7784053Z  2024-12-18T00:47:10.7784921Z [12,170 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:10.7785799Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:47:10.7786465Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:47:10.7787210Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:47:10.7788095Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:47:10.7789092Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2024-12-18T00:47:10.7790070Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2024-12-18T00:47:10.7790987Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:47:10.7791805Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:11.0374148Z 2024-12-18T00:47:11.0375018Z  2024-12-18T00:47:11.0375505Z  2024-12-18T00:47:11.0375914Z  2024-12-18T00:47:11.0376300Z  2024-12-18T00:47:11.0376847Z  2024-12-18T00:47:11.0377250Z  2024-12-18T00:47:11.0377634Z  2024-12-18T00:47:11.0378001Z  2024-12-18T00:47:11.0378916Z [12,171 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:11.0379925Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:47:11.0380643Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:47:11.0381359Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:47:11.0382200Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:47:11.0383155Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:47:11.0384100Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2024-12-18T00:47:11.0385000Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:47:11.0385830Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:11.2378808Z 2024-12-18T00:47:11.2379667Z  2024-12-18T00:47:11.2380085Z  2024-12-18T00:47:11.2380437Z  2024-12-18T00:47:11.2380817Z  2024-12-18T00:47:11.2381173Z  2024-12-18T00:47:11.2381510Z  2024-12-18T00:47:11.2381864Z  2024-12-18T00:47:11.2382369Z  2024-12-18T00:47:11.2383211Z [12,172 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:11.2384051Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:47:11.2384658Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2024-12-18T00:47:11.2385299Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:47:11.2386056Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:47:11.2387241Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:47:11.2388206Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2024-12-18T00:47:11.2389031Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:47:11.2389714Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:11.5586278Z 2024-12-18T00:47:11.5587201Z  2024-12-18T00:47:11.5587670Z  2024-12-18T00:47:11.5588082Z  2024-12-18T00:47:11.5588839Z  2024-12-18T00:47:11.5589222Z  2024-12-18T00:47:11.5589617Z  2024-12-18T00:47:11.5590007Z  2024-12-18T00:47:11.5590381Z  2024-12-18T00:47:11.5591307Z [12,174 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:11.5592243Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:47:11.5592910Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:47:11.5593626Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:47:11.5594502Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:47:11.5595522Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:47:11.5596466Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2024-12-18T00:47:11.5597371Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2024-12-18T00:47:11.5598151Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:11.8386062Z 2024-12-18T00:47:11.8386902Z  2024-12-18T00:47:11.8387311Z  2024-12-18T00:47:11.8387675Z  2024-12-18T00:47:11.8388041Z  2024-12-18T00:47:11.8388406Z  2024-12-18T00:47:11.8388768Z  2024-12-18T00:47:11.8389122Z  2024-12-18T00:47:11.8389488Z  2024-12-18T00:47:11.8390318Z [12,174 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:11.8391171Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:47:11.8391784Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:47:11.8392435Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:47:11.8393231Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:47:11.8394176Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2024-12-18T00:47:11.8395068Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2024-12-18T00:47:11.8395883Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 17s local 2024-12-18T00:47:11.8396645Z @onednn//:mkl_dnn; 15s local ... 2024-12-18T00:47:12.1865673Z 2024-12-18T00:47:12.1866448Z  2024-12-18T00:47:12.1866830Z  2024-12-18T00:47:12.1867134Z  2024-12-18T00:47:12.1867451Z  2024-12-18T00:47:12.1867789Z  2024-12-18T00:47:12.1868105Z  2024-12-18T00:47:12.1868421Z  2024-12-18T00:47:12.1868735Z  2024-12-18T00:47:12.1869448Z [12,176 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:12.1870192Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:47:12.1870744Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2024-12-18T00:47:12.1871455Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:47:12.1872115Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:47:12.1872940Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:47:12.1873735Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2024-12-18T00:47:12.1874506Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2024-12-18T00:47:12.1875230Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2024-12-18T00:47:12.5276989Z 2024-12-18T00:47:12.5277836Z  2024-12-18T00:47:12.5278276Z  2024-12-18T00:47:12.5278642Z  2024-12-18T00:47:12.5279297Z  2024-12-18T00:47:12.5279675Z  2024-12-18T00:47:12.5280023Z  2024-12-18T00:47:12.5280378Z  2024-12-18T00:47:12.5280744Z  2024-12-18T00:47:12.5281768Z [12,177 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:12.5282712Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:47:12.5283370Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:47:12.5284047Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:47:12.5285103Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:47:12.5286099Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:47:12.5287088Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:47:12.5288009Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2024-12-18T00:47:12.5288896Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2024-12-18T00:47:12.7281411Z 2024-12-18T00:47:12.7282318Z  2024-12-18T00:47:12.7282805Z  2024-12-18T00:47:12.7283195Z  2024-12-18T00:47:12.7283583Z  2024-12-18T00:47:12.7283982Z  2024-12-18T00:47:12.7284373Z  2024-12-18T00:47:12.7284734Z  2024-12-18T00:47:12.7285124Z  2024-12-18T00:47:12.7286052Z [12,179 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:12.7286988Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:47:12.7287713Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:47:12.7288428Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:47:12.7289293Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:47:12.7290335Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2024-12-18T00:47:12.7291342Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:47:12.7292324Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 16s local 2024-12-18T00:47:12.7293417Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local ... 2024-12-18T00:47:13.1100640Z 2024-12-18T00:47:13.1101491Z  2024-12-18T00:47:13.1101947Z  2024-12-18T00:47:13.1102369Z  2024-12-18T00:47:13.1102771Z  2024-12-18T00:47:13.1103180Z  2024-12-18T00:47:13.1103556Z  2024-12-18T00:47:13.1103956Z  2024-12-18T00:47:13.1104329Z  2024-12-18T00:47:13.1105273Z [12,180 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:13.1106222Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:47:13.1106945Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2024-12-18T00:47:13.1107657Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:47:13.1108505Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:47:13.1109571Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:47:13.1110561Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:47:13.1111504Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local 2024-12-18T00:47:13.1112507Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local ... 2024-12-18T00:47:13.3287455Z 2024-12-18T00:47:13.3288350Z  2024-12-18T00:47:13.3288803Z  2024-12-18T00:47:13.3289183Z  2024-12-18T00:47:13.3289564Z  2024-12-18T00:47:13.3289994Z  2024-12-18T00:47:13.3290368Z  2024-12-18T00:47:13.3290731Z  2024-12-18T00:47:13.3291083Z  2024-12-18T00:47:13.3292002Z [12,180 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:13.3292946Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:47:13.3293611Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:47:13.3294753Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:47:13.3295586Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:47:13.3296974Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:47:13.3297980Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:47:13.3298885Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2024-12-18T00:47:13.3299899Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local ... 2024-12-18T00:47:13.7292364Z 2024-12-18T00:47:13.7293200Z  2024-12-18T00:47:13.7293651Z  2024-12-18T00:47:13.7294016Z  2024-12-18T00:47:13.7294373Z  2024-12-18T00:47:13.7294730Z  2024-12-18T00:47:13.7295100Z  2024-12-18T00:47:13.7295494Z  2024-12-18T00:47:13.7295878Z  2024-12-18T00:47:13.7296963Z [12,181 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:13.7297931Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:47:13.7298610Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:47:13.7299355Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:47:13.7300176Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:47:13.7301196Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:47:13.7302193Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:47:13.7303136Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2024-12-18T00:47:13.7304124Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local ... 2024-12-18T00:47:13.9296173Z 2024-12-18T00:47:13.9297235Z  2024-12-18T00:47:13.9297716Z  2024-12-18T00:47:13.9298095Z  2024-12-18T00:47:13.9298484Z  2024-12-18T00:47:13.9298850Z  2024-12-18T00:47:13.9299228Z  2024-12-18T00:47:13.9299652Z  2024-12-18T00:47:13.9300025Z  2024-12-18T00:47:13.9300956Z [12,184 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:13.9301897Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:47:13.9302576Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2024-12-18T00:47:13.9303285Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:47:13.9304105Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:47:13.9305125Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2024-12-18T00:47:13.9306073Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:47:13.9306985Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2024-12-18T00:47:13.9307953Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local ... 2024-12-18T00:47:14.3301638Z 2024-12-18T00:47:14.3302543Z  2024-12-18T00:47:14.3302960Z  2024-12-18T00:47:14.3303304Z  2024-12-18T00:47:14.3303648Z  2024-12-18T00:47:14.3303981Z  2024-12-18T00:47:14.3304305Z  2024-12-18T00:47:14.3304630Z  2024-12-18T00:47:14.3304966Z  2024-12-18T00:47:14.3305745Z [12,187 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:14.3306549Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:14.3307131Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:47:14.3307729Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:47:14.3308450Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:47:14.3309307Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:47:14.3310155Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:47:14.3310950Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:47:14.3312081Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local ... 2024-12-18T00:47:14.5305434Z 2024-12-18T00:47:14.5306266Z  2024-12-18T00:47:14.5306761Z  2024-12-18T00:47:14.5307431Z  2024-12-18T00:47:14.5307858Z  2024-12-18T00:47:14.5308258Z  2024-12-18T00:47:14.5308652Z  2024-12-18T00:47:14.5309065Z  2024-12-18T00:47:14.5309462Z  2024-12-18T00:47:14.5310441Z [12,188 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:14.5311773Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:14.5312484Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:47:14.5313247Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:47:14.5314110Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:47:14.5315158Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:47:14.5316228Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:47:14.5317132Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:47:14.5318143Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local ... 2024-12-18T00:47:14.7663957Z 2024-12-18T00:47:14.7664824Z  2024-12-18T00:47:14.7665285Z  2024-12-18T00:47:14.7665687Z  2024-12-18T00:47:14.7666059Z  2024-12-18T00:47:14.7666449Z  2024-12-18T00:47:14.7666856Z  2024-12-18T00:47:14.7667226Z  2024-12-18T00:47:14.7667653Z  2024-12-18T00:47:14.7668530Z [12,190 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:14.7669482Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:14.7670174Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:47:14.7670912Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:47:14.7671771Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:47:14.7672858Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2024-12-18T00:47:14.7673878Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:47:14.7674827Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:47:14.7675951Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local ... 2024-12-18T00:47:15.0143777Z 2024-12-18T00:47:15.0144819Z  2024-12-18T00:47:15.0145316Z  2024-12-18T00:47:15.0145730Z  2024-12-18T00:47:15.0146183Z  2024-12-18T00:47:15.0146586Z  2024-12-18T00:47:15.0146972Z  2024-12-18T00:47:15.0147400Z  2024-12-18T00:47:15.0147820Z  2024-12-18T00:47:15.0148784Z [12,192 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:15.0149805Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:15.0150537Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:47:15.0151305Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:47:15.0152238Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:47:15.0153360Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:47:15.0154435Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:47:15.0155440Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:47:15.0156534Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local ... 2024-12-18T00:47:15.2899641Z 2024-12-18T00:47:15.2900561Z  2024-12-18T00:47:15.2901049Z  2024-12-18T00:47:15.2901429Z  2024-12-18T00:47:15.2901804Z  2024-12-18T00:47:15.2902206Z  2024-12-18T00:47:15.2902616Z  2024-12-18T00:47:15.2903004Z  2024-12-18T00:47:15.2903393Z  2024-12-18T00:47:15.2904323Z [12,195 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:15.2905655Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:47:15.2906383Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2024-12-18T00:47:15.2907277Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:47:15.2908200Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:47:15.2909263Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:47:15.2910405Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:47:15.2911441Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2024-12-18T00:47:15.2912501Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local ... 2024-12-18T00:47:15.5313372Z 2024-12-18T00:47:15.5314274Z  2024-12-18T00:47:15.5314744Z  2024-12-18T00:47:15.5315168Z  2024-12-18T00:47:15.5315583Z  2024-12-18T00:47:15.5315998Z  2024-12-18T00:47:15.5316383Z  2024-12-18T00:47:15.5316794Z  2024-12-18T00:47:15.5317213Z  2024-12-18T00:47:15.5318233Z [12,195 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:15.5319309Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:47:15.5320025Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:47:15.5320802Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:47:15.5321755Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:47:15.5322863Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:47:15.5323944Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:47:15.5324893Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2024-12-18T00:47:15.5325956Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local ... 2024-12-18T00:47:15.7317396Z 2024-12-18T00:47:15.7318263Z  2024-12-18T00:47:15.7318740Z  2024-12-18T00:47:15.7319147Z  2024-12-18T00:47:15.7319569Z  2024-12-18T00:47:15.7319987Z  2024-12-18T00:47:15.7320406Z  2024-12-18T00:47:15.7320841Z  2024-12-18T00:47:15.7321247Z  2024-12-18T00:47:15.7322252Z [12,196 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:15.7323289Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:47:15.7323990Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:47:15.7324707Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:47:15.7325601Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2024-12-18T00:47:15.7326708Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2024-12-18T00:47:15.7327748Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:47:15.7328652Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2024-12-18T00:47:15.7329650Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local ... 2024-12-18T00:47:16.2182255Z 2024-12-18T00:47:16.2183125Z  2024-12-18T00:47:16.2183606Z  2024-12-18T00:47:16.2183991Z  2024-12-18T00:47:16.2184378Z  2024-12-18T00:47:16.2184766Z  2024-12-18T00:47:16.2185146Z  2024-12-18T00:47:16.2185561Z  2024-12-18T00:47:16.2185973Z  2024-12-18T00:47:16.2186941Z [12,197 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:16.2187874Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:16.2188569Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2024-12-18T00:47:16.2189358Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:47:16.2190319Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2024-12-18T00:47:16.2191444Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:47:16.2192805Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:47:16.2193869Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2024-12-18T00:47:16.2195078Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local ... 2024-12-18T00:47:16.4237994Z 2024-12-18T00:47:16.4238828Z  2024-12-18T00:47:16.4239264Z  2024-12-18T00:47:16.4239654Z  2024-12-18T00:47:16.4240039Z  2024-12-18T00:47:16.4240412Z  2024-12-18T00:47:16.4240781Z  2024-12-18T00:47:16.4241541Z  2024-12-18T00:47:16.4241942Z  2024-12-18T00:47:16.4242856Z [12,201 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:16.4243829Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:16.4244823Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:47:16.4245553Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:47:16.4246488Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:47:16.4247501Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:47:16.4248466Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2024-12-18T00:47:16.4249310Z Compiling src/google/protobuf/descriptor.cc; 14s local 2024-12-18T00:47:16.4250429Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 11s local ... 2024-12-18T00:47:16.6761957Z 2024-12-18T00:47:16.6762856Z  2024-12-18T00:47:16.6763370Z  2024-12-18T00:47:16.6763782Z  2024-12-18T00:47:16.6764180Z  2024-12-18T00:47:16.6764544Z  2024-12-18T00:47:16.6764921Z  2024-12-18T00:47:16.6765287Z  2024-12-18T00:47:16.6765679Z  2024-12-18T00:47:16.6766645Z [12,203 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:16.6767674Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:16.6768442Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:47:16.6769204Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:47:16.6770206Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:47:16.6771247Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:47:16.6772114Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2024-12-18T00:47:16.6773024Z Compiling src/google/protobuf/descriptor.cc; 15s local 2024-12-18T00:47:16.6774002Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local ... 2024-12-18T00:47:16.9326199Z 2024-12-18T00:47:16.9327065Z  2024-12-18T00:47:16.9327551Z  2024-12-18T00:47:16.9327946Z  2024-12-18T00:47:16.9328356Z  2024-12-18T00:47:16.9328767Z  2024-12-18T00:47:16.9329156Z  2024-12-18T00:47:16.9329566Z  2024-12-18T00:47:16.9329966Z  2024-12-18T00:47:16.9330917Z [12,203 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:16.9331926Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:16.9332645Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:47:16.9333385Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:47:16.9334342Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2024-12-18T00:47:16.9335390Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:47:16.9336383Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2024-12-18T00:47:16.9337533Z Compiling src/google/protobuf/descriptor.cc; 15s local 2024-12-18T00:47:16.9338530Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local ... 2024-12-18T00:47:17.1541507Z 2024-12-18T00:47:17.1542336Z  2024-12-18T00:47:17.1542809Z  2024-12-18T00:47:17.1543240Z  2024-12-18T00:47:17.1543668Z  2024-12-18T00:47:17.1544755Z  2024-12-18T00:47:17.1545155Z  2024-12-18T00:47:17.1545533Z  2024-12-18T00:47:17.1545910Z  2024-12-18T00:47:17.1547030Z [12,205 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:17.1547991Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:17.1548748Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2024-12-18T00:47:17.1549489Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:47:17.1550630Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:47:17.1551763Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:47:17.1552656Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2024-12-18T00:47:17.1553534Z Compiling src/google/protobuf/descriptor.cc; 15s local 2024-12-18T00:47:17.1554477Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local ... 2024-12-18T00:47:17.5332376Z 2024-12-18T00:47:17.5333315Z  2024-12-18T00:47:17.5333746Z  2024-12-18T00:47:17.5334094Z  2024-12-18T00:47:17.5334457Z  2024-12-18T00:47:17.5334848Z  2024-12-18T00:47:17.5335201Z  2024-12-18T00:47:17.5335609Z  2024-12-18T00:47:17.5336006Z  2024-12-18T00:47:17.5337133Z [12,207 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:17.5338112Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:17.5338788Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:47:17.5339503Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:47:17.5340428Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:47:17.5341415Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:47:17.5342305Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:47:17.5343136Z Compiling src/google/protobuf/descriptor.cc; 16s local 2024-12-18T00:47:17.5344093Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local ... 2024-12-18T00:47:17.7337195Z 2024-12-18T00:47:17.7338047Z  2024-12-18T00:47:17.7338559Z  2024-12-18T00:47:17.7338971Z  2024-12-18T00:47:17.7339394Z  2024-12-18T00:47:17.7339777Z  2024-12-18T00:47:17.7340137Z  2024-12-18T00:47:17.7340506Z  2024-12-18T00:47:17.7340872Z  2024-12-18T00:47:17.7341732Z [12,209 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:17.7342616Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:17.7343272Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:47:17.7343918Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:47:17.7345021Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2024-12-18T00:47:17.7345912Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:47:17.7346798Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:47:17.7347644Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2024-12-18T00:47:17.7348416Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:17.9500282Z 2024-12-18T00:47:17.9501158Z  2024-12-18T00:47:17.9501588Z  2024-12-18T00:47:17.9501968Z  2024-12-18T00:47:17.9502329Z  2024-12-18T00:47:17.9502681Z  2024-12-18T00:47:17.9503032Z  2024-12-18T00:47:17.9503398Z  2024-12-18T00:47:17.9503805Z  2024-12-18T00:47:17.9504725Z [12,211 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:17.9505694Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:17.9506408Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:47:17.9507141Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:47:17.9508021Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:47:17.9509203Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:47:17.9510179Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:47:17.9511046Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2024-12-18T00:47:17.9511775Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:18.1506309Z 2024-12-18T00:47:18.1507230Z  2024-12-18T00:47:18.1507688Z  2024-12-18T00:47:18.1508091Z  2024-12-18T00:47:18.1508483Z  2024-12-18T00:47:18.1509345Z  2024-12-18T00:47:18.1509770Z  2024-12-18T00:47:18.1510176Z  2024-12-18T00:47:18.1510592Z  2024-12-18T00:47:18.1511589Z [12,212 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:18.1512543Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:18.1513244Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2024-12-18T00:47:18.1513980Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:47:18.1514941Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:47:18.1515886Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:47:18.1516867Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:47:18.1517876Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2024-12-18T00:47:18.1518654Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:18.3567083Z 2024-12-18T00:47:18.3567978Z  2024-12-18T00:47:18.3568465Z  2024-12-18T00:47:18.3568867Z  2024-12-18T00:47:18.3569276Z  2024-12-18T00:47:18.3569658Z  2024-12-18T00:47:18.3570048Z  2024-12-18T00:47:18.3570448Z  2024-12-18T00:47:18.3570816Z  2024-12-18T00:47:18.3571703Z [12,214 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:18.3572693Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:47:18.3573432Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:47:18.3574241Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:47:18.3575241Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:47:18.3576359Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2024-12-18T00:47:18.3577600Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2024-12-18T00:47:18.3578429Z @onednn//:mkl_dnn; 12s local 2024-12-18T00:47:18.3579381Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local ... 2024-12-18T00:47:18.6774602Z 2024-12-18T00:47:18.6775500Z  2024-12-18T00:47:18.6775981Z  2024-12-18T00:47:18.6776403Z  2024-12-18T00:47:18.6776982Z  2024-12-18T00:47:18.6777404Z  2024-12-18T00:47:18.6777817Z  2024-12-18T00:47:18.6778210Z  2024-12-18T00:47:18.6778612Z  2024-12-18T00:47:18.6779615Z [12,216 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:18.6780604Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:47:18.6781342Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:47:18.6782128Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:47:18.6783132Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:47:18.6784260Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2024-12-18T00:47:18.6785306Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 14s local 2024-12-18T00:47:18.6786186Z @onednn//:mkl_dnn; 13s local 2024-12-18T00:47:18.6786975Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local ... 2024-12-18T00:47:18.9348175Z 2024-12-18T00:47:18.9349002Z  2024-12-18T00:47:18.9349581Z  2024-12-18T00:47:18.9350059Z  2024-12-18T00:47:18.9350449Z  2024-12-18T00:47:18.9351137Z  2024-12-18T00:47:18.9360337Z  2024-12-18T00:47:18.9361115Z  2024-12-18T00:47:18.9361520Z  2024-12-18T00:47:18.9362715Z [12,221 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:18.9363697Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:47:18.9364394Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2024-12-18T00:47:18.9365120Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:47:18.9366320Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2024-12-18T00:47:18.9367468Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2024-12-18T00:47:18.9368375Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:47:18.9369383Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:47:18.9370235Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:47:19.3348096Z 2024-12-18T00:47:19.3349075Z  2024-12-18T00:47:19.3349546Z  2024-12-18T00:47:19.3349973Z  2024-12-18T00:47:19.3350366Z  2024-12-18T00:47:19.3350779Z  2024-12-18T00:47:19.3351174Z  2024-12-18T00:47:19.3351567Z  2024-12-18T00:47:19.3351953Z  2024-12-18T00:47:19.3352915Z [12,222 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:19.3353923Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:47:19.3354657Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:47:19.3355417Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:47:19.3356413Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:47:19.3357452Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2024-12-18T00:47:19.3358397Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:47:19.3359482Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:47:19.3360284Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:47:19.5715061Z 2024-12-18T00:47:19.5716010Z  2024-12-18T00:47:19.5716484Z  2024-12-18T00:47:19.5716919Z  2024-12-18T00:47:19.5717325Z  2024-12-18T00:47:19.5717741Z  2024-12-18T00:47:19.5718134Z  2024-12-18T00:47:19.5718533Z  2024-12-18T00:47:19.5718917Z  2024-12-18T00:47:19.5719854Z [12,223 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:19.5720874Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:47:19.5721562Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:47:19.5722316Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:47:19.5723344Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:47:19.5724437Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:47:19.5725441Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:47:19.5726499Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:47:19.5727402Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:19.8703215Z 2024-12-18T00:47:19.8704078Z  2024-12-18T00:47:19.8704639Z  2024-12-18T00:47:19.8704991Z  2024-12-18T00:47:19.8705308Z  2024-12-18T00:47:19.8705644Z  2024-12-18T00:47:19.8705991Z  2024-12-18T00:47:19.8706331Z  2024-12-18T00:47:19.8706687Z  2024-12-18T00:47:19.8707538Z [12,227 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:19.8708377Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:47:19.8709021Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:47:19.8709667Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:47:19.8710463Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2024-12-18T00:47:19.8711579Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:47:19.8712484Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:47:19.8713363Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:47:19.8714073Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:20.1354304Z 2024-12-18T00:47:20.1355220Z  2024-12-18T00:47:20.1355700Z  2024-12-18T00:47:20.1356126Z  2024-12-18T00:47:20.1356508Z  2024-12-18T00:47:20.1357272Z  2024-12-18T00:47:20.1357669Z  2024-12-18T00:47:20.1358084Z  2024-12-18T00:47:20.1358453Z  2024-12-18T00:47:20.1359383Z [12,230 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:20.1360328Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:47:20.1361036Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2024-12-18T00:47:20.1361820Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:47:20.1362790Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:47:20.1363895Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:47:20.1364833Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:47:20.1365835Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:47:20.1366617Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:20.4361643Z 2024-12-18T00:47:20.4362534Z  2024-12-18T00:47:20.4363013Z  2024-12-18T00:47:20.4363449Z  2024-12-18T00:47:20.4363856Z  2024-12-18T00:47:20.4364253Z  2024-12-18T00:47:20.4364666Z  2024-12-18T00:47:20.4365083Z  2024-12-18T00:47:20.4365497Z  2024-12-18T00:47:20.4366426Z [12,231 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:20.4367428Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:20.4368154Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:47:20.4368944Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:47:20.4369873Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:47:20.4370891Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2024-12-18T00:47:20.4371879Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:47:20.4372795Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:47:20.4373622Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:20.6656873Z 2024-12-18T00:47:20.6658106Z  2024-12-18T00:47:20.6658593Z  2024-12-18T00:47:20.6658985Z  2024-12-18T00:47:20.6659364Z  2024-12-18T00:47:20.6659764Z  2024-12-18T00:47:20.6660153Z  2024-12-18T00:47:20.6660561Z  2024-12-18T00:47:20.6660976Z  2024-12-18T00:47:20.6661887Z [12,233 / 20,602] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2024-12-18T00:47:20.6662921Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:20.6663657Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:47:20.6664446Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:47:20.6665437Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:47:20.6666468Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:47:20.6667396Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:47:20.6668426Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:47:20.6669305Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:47:20.9132244Z 2024-12-18T00:47:20.9133105Z  2024-12-18T00:47:20.9133546Z  2024-12-18T00:47:20.9133919Z  2024-12-18T00:47:20.9134551Z  2024-12-18T00:47:20.9134961Z  2024-12-18T00:47:20.9135370Z  2024-12-18T00:47:20.9135762Z  2024-12-18T00:47:20.9136168Z  2024-12-18T00:47:20.9137425Z [12,238 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:20.9138416Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:20.9139125Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:47:20.9139885Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:47:20.9140986Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2024-12-18T00:47:20.9142150Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:47:20.9143175Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:47:20.9144404Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 14s local 2024-12-18T00:47:20.9145456Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 11s local ... 2024-12-18T00:47:21.1362054Z 2024-12-18T00:47:21.1362936Z  2024-12-18T00:47:21.1363403Z  2024-12-18T00:47:21.1363803Z  2024-12-18T00:47:21.1364193Z  2024-12-18T00:47:21.1364594Z  2024-12-18T00:47:21.1364994Z  2024-12-18T00:47:21.1365382Z  2024-12-18T00:47:21.1365771Z  2024-12-18T00:47:21.1366722Z [12,241 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:21.1367740Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:21.1368509Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2024-12-18T00:47:21.1369294Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:47:21.1370315Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:47:21.1371378Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:47:21.1372397Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:47:21.1373420Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 11s local 2024-12-18T00:47:21.1374251Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:47:21.3634289Z 2024-12-18T00:47:21.3635196Z  2024-12-18T00:47:21.3635721Z  2024-12-18T00:47:21.3636135Z  2024-12-18T00:47:21.3636553Z  2024-12-18T00:47:21.3636970Z  2024-12-18T00:47:21.3637389Z  2024-12-18T00:47:21.3637784Z  2024-12-18T00:47:21.3638206Z  2024-12-18T00:47:21.3639184Z [12,244 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:21.3640228Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:47:21.3640980Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:47:21.3641777Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:47:21.3642803Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:47:21.3643940Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2024-12-18T00:47:21.3645199Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:47:21.3646230Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 11s local 2024-12-18T00:47:21.3647069Z @onednn//:mkl_dnn; 11s local ... 2024-12-18T00:47:21.7368414Z 2024-12-18T00:47:21.7369270Z  2024-12-18T00:47:21.7369741Z  2024-12-18T00:47:21.7370106Z  2024-12-18T00:47:21.7370431Z  2024-12-18T00:47:21.7370789Z  2024-12-18T00:47:21.7371158Z  2024-12-18T00:47:21.7371536Z  2024-12-18T00:47:21.7371961Z  2024-12-18T00:47:21.7372848Z [12,250 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:21.7373726Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:47:21.7374372Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:47:21.7375099Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:47:21.7376291Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2024-12-18T00:47:21.7377479Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2024-12-18T00:47:21.7378597Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:47:21.7379523Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2024-12-18T00:47:21.7380268Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:22.1490556Z 2024-12-18T00:47:22.1491440Z  2024-12-18T00:47:22.1491927Z  2024-12-18T00:47:22.1492336Z  2024-12-18T00:47:22.1493249Z  2024-12-18T00:47:22.1493704Z  2024-12-18T00:47:22.1494112Z  2024-12-18T00:47:22.1494511Z  2024-12-18T00:47:22.1494935Z  2024-12-18T00:47:22.1495885Z [12,251 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:22.1497039Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:47:22.1497762Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2024-12-18T00:47:22.1498538Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:47:22.1499513Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:47:22.1500542Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2024-12-18T00:47:22.1501387Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:47:22.1502673Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2024-12-18T00:47:22.1503408Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:22.5376593Z 2024-12-18T00:47:22.5377658Z  2024-12-18T00:47:22.5378119Z  2024-12-18T00:47:22.5378533Z  2024-12-18T00:47:22.5378928Z  2024-12-18T00:47:22.5379333Z  2024-12-18T00:47:22.5379731Z  2024-12-18T00:47:22.5380155Z  2024-12-18T00:47:22.5380551Z  2024-12-18T00:47:22.5381499Z [12,253 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:22.5382539Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:47:22.5383256Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:47:22.5384062Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:47:22.5385045Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:47:22.5386084Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:47:22.5387093Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:47:22.5388078Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:47:22.5388864Z @onednn//:mkl_dnn; 12s local ... 2024-12-18T00:47:22.7844703Z 2024-12-18T00:47:22.7845562Z  2024-12-18T00:47:22.7846005Z  2024-12-18T00:47:22.7846356Z  2024-12-18T00:47:22.7846703Z  2024-12-18T00:47:22.7847062Z  2024-12-18T00:47:22.7847427Z  2024-12-18T00:47:22.7847766Z  2024-12-18T00:47:22.7848152Z  2024-12-18T00:47:22.7849032Z [12,255 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:22.7849954Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:47:22.7850589Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:47:22.7851238Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:47:22.7852091Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2024-12-18T00:47:22.7853014Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:47:22.7853866Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:22.7854692Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:47:22.7855376Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:23.0274184Z 2024-12-18T00:47:23.0275051Z  2024-12-18T00:47:23.0275517Z  2024-12-18T00:47:23.0275915Z  2024-12-18T00:47:23.0276300Z  2024-12-18T00:47:23.0276978Z  2024-12-18T00:47:23.0277377Z  2024-12-18T00:47:23.0277779Z  2024-12-18T00:47:23.0278186Z  2024-12-18T00:47:23.0279287Z [12,258 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:23.0280256Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:47:23.0280936Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:47:23.0281670Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:47:23.0282809Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:47:23.0283984Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:47:23.0284966Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:23.0285943Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:47:23.0286750Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:23.2590148Z 2024-12-18T00:47:23.2591078Z  2024-12-18T00:47:23.2591533Z  2024-12-18T00:47:23.2591925Z  2024-12-18T00:47:23.2592333Z  2024-12-18T00:47:23.2592754Z  2024-12-18T00:47:23.2593164Z  2024-12-18T00:47:23.2593576Z  2024-12-18T00:47:23.2593992Z  2024-12-18T00:47:23.2594968Z [12,259 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:23.2595993Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:23.2596750Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2024-12-18T00:47:23.2597528Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:47:23.2598498Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:47:23.2599564Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2024-12-18T00:47:23.2600551Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:23.2601588Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2024-12-18T00:47:23.2602437Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:23.5386552Z 2024-12-18T00:47:23.5387580Z  2024-12-18T00:47:23.5388100Z  2024-12-18T00:47:23.5388572Z  2024-12-18T00:47:23.5389010Z  2024-12-18T00:47:23.5389450Z  2024-12-18T00:47:23.5389871Z  2024-12-18T00:47:23.5390307Z  2024-12-18T00:47:23.5390722Z  2024-12-18T00:47:23.5391663Z [12,259 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:23.5392700Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:23.5393413Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:47:23.5394182Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:47:23.5395205Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2024-12-18T00:47:23.5396302Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2024-12-18T00:47:23.5397371Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:23.5398383Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:47:23.5399208Z @onednn//:mkl_dnn; 13s local ... 2024-12-18T00:47:23.9392215Z 2024-12-18T00:47:23.9393107Z  2024-12-18T00:47:23.9393653Z  2024-12-18T00:47:23.9394135Z  2024-12-18T00:47:23.9394625Z  2024-12-18T00:47:23.9395008Z  2024-12-18T00:47:23.9395391Z  2024-12-18T00:47:23.9395779Z  2024-12-18T00:47:23.9396135Z  2024-12-18T00:47:23.9397087Z [12,262 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:23.9398029Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:23.9398752Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:47:23.9399499Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:47:23.9400422Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:47:23.9401771Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2024-12-18T00:47:23.9402766Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:23.9403840Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:47:23.9404630Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:24.1395788Z 2024-12-18T00:47:24.1396636Z  2024-12-18T00:47:24.1397134Z  2024-12-18T00:47:24.1397526Z  2024-12-18T00:47:24.1397904Z  2024-12-18T00:47:24.1398304Z  2024-12-18T00:47:24.1399085Z  2024-12-18T00:47:24.1399482Z  2024-12-18T00:47:24.1399893Z  2024-12-18T00:47:24.1400773Z [12,263 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:24.1401701Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:24.1402357Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2024-12-18T00:47:24.1403217Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:47:24.1404139Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:47:24.1405145Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2024-12-18T00:47:24.1406064Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:24.1407154Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2024-12-18T00:47:24.1407901Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:24.4207391Z 2024-12-18T00:47:24.4208298Z  2024-12-18T00:47:24.4208845Z  2024-12-18T00:47:24.4209267Z  2024-12-18T00:47:24.4209668Z  2024-12-18T00:47:24.4210069Z  2024-12-18T00:47:24.4210467Z  2024-12-18T00:47:24.4210868Z  2024-12-18T00:47:24.4211246Z  2024-12-18T00:47:24.4212132Z [12,266 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:24.4213139Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:24.4213897Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:24.4214668Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:47:24.4215653Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:47:24.4216818Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2024-12-18T00:47:24.4217808Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:24.4218733Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:47:24.4219530Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:24.6408315Z 2024-12-18T00:47:24.6409235Z  2024-12-18T00:47:24.6409696Z  2024-12-18T00:47:24.6410093Z  2024-12-18T00:47:24.6410488Z  2024-12-18T00:47:24.6410904Z  2024-12-18T00:47:24.6411314Z  2024-12-18T00:47:24.6411730Z  2024-12-18T00:47:24.6412151Z  2024-12-18T00:47:24.6413084Z [12,268 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:24.6414128Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:24.6414792Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:24.6415542Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:47:24.6416443Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:47:24.6417619Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:24.6418553Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:47:24.6419347Z @onednn//:mkl_dnn; 14s local 2024-12-18T00:47:24.6419877Z @onednn//:mkl_dnn; 14s local ... 2024-12-18T00:47:24.9248662Z 2024-12-18T00:47:24.9249535Z  2024-12-18T00:47:24.9250032Z  2024-12-18T00:47:24.9250436Z  2024-12-18T00:47:24.9250833Z  2024-12-18T00:47:24.9251240Z  2024-12-18T00:47:24.9251619Z  2024-12-18T00:47:24.9252332Z  2024-12-18T00:47:24.9252743Z  2024-12-18T00:47:24.9253698Z [12,270 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:24.9254818Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:24.9255523Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:24.9256256Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:47:24.9257405Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2024-12-18T00:47:24.9258713Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:47:24.9259800Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:47:24.9260904Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:47:24.9262007Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2024-12-18T00:47:25.1404185Z 2024-12-18T00:47:25.1405067Z  2024-12-18T00:47:25.1405574Z  2024-12-18T00:47:25.1405978Z  2024-12-18T00:47:25.1406365Z  2024-12-18T00:47:25.1406756Z  2024-12-18T00:47:25.1407157Z  2024-12-18T00:47:25.1407550Z  2024-12-18T00:47:25.1407962Z  2024-12-18T00:47:25.1408896Z [12,271 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:25.1409894Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:25.1410589Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2024-12-18T00:47:25.1411343Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:47:25.1412306Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:47:25.1413347Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:47:25.1414291Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2024-12-18T00:47:25.1415388Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:47:25.1416630Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2024-12-18T00:47:25.5409247Z 2024-12-18T00:47:25.5410103Z  2024-12-18T00:47:25.5410599Z  2024-12-18T00:47:25.5411017Z  2024-12-18T00:47:25.5411437Z  2024-12-18T00:47:25.5412037Z  2024-12-18T00:47:25.5412456Z  2024-12-18T00:47:25.5412876Z  2024-12-18T00:47:25.5413220Z  2024-12-18T00:47:25.5414205Z [12,273 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:25.5415254Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:25.5415960Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:47:25.5416893Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:47:25.5417873Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:47:25.5418972Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:47:25.5420007Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:47:25.5421294Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:47:25.5422419Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2024-12-18T00:47:25.7413962Z 2024-12-18T00:47:25.7414794Z  2024-12-18T00:47:25.7415266Z  2024-12-18T00:47:25.7415652Z  2024-12-18T00:47:25.7416046Z  2024-12-18T00:47:25.7416582Z  2024-12-18T00:47:25.7416991Z  2024-12-18T00:47:25.7417398Z  2024-12-18T00:47:25.7417851Z  2024-12-18T00:47:25.7418811Z [12,274 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:25.7419766Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:25.7420478Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:47:25.7421248Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:47:25.7422240Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2024-12-18T00:47:25.7423601Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:47:25.7424674Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:47:25.7425713Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2024-12-18T00:47:25.7426809Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2024-12-18T00:47:26.1419037Z 2024-12-18T00:47:26.1419935Z  2024-12-18T00:47:26.1420466Z  2024-12-18T00:47:26.1421334Z  2024-12-18T00:47:26.1421804Z  2024-12-18T00:47:26.1422249Z  2024-12-18T00:47:26.1422692Z  2024-12-18T00:47:26.1423127Z  2024-12-18T00:47:26.1423541Z  2024-12-18T00:47:26.1424529Z [12,275 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:26.1425564Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:26.1426326Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2024-12-18T00:47:26.1427098Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:47:26.1428099Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:47:26.1429192Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:47:26.1430176Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:47:26.1431278Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2024-12-18T00:47:26.1432389Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2024-12-18T00:47:26.3423833Z 2024-12-18T00:47:26.3424718Z  2024-12-18T00:47:26.3425196Z  2024-12-18T00:47:26.3425617Z  2024-12-18T00:47:26.3426020Z  2024-12-18T00:47:26.3426445Z  2024-12-18T00:47:26.3426840Z  2024-12-18T00:47:26.3427227Z  2024-12-18T00:47:26.3427621Z  2024-12-18T00:47:26.3428585Z [12,276 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:26.3429613Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:26.3430343Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:47:26.3431099Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:47:26.3432061Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:47:26.3433145Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:47:26.3434128Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2024-12-18T00:47:26.3435273Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2024-12-18T00:47:26.3436352Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2024-12-18T00:47:26.5852925Z 2024-12-18T00:47:26.5853803Z  2024-12-18T00:47:26.5854293Z  2024-12-18T00:47:26.5854677Z  2024-12-18T00:47:26.5855068Z  2024-12-18T00:47:26.5855489Z  2024-12-18T00:47:26.5855847Z  2024-12-18T00:47:26.5856215Z  2024-12-18T00:47:26.5856780Z  2024-12-18T00:47:26.5857739Z [12,279 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:26.5858722Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:26.5859586Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:47:26.5860294Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:47:26.5861261Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:47:26.5862372Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:47:26.5863335Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:26.5864431Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2024-12-18T00:47:26.5865559Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2024-12-18T00:47:26.8908970Z 2024-12-18T00:47:26.8909863Z  2024-12-18T00:47:26.8910306Z  2024-12-18T00:47:26.8910698Z  2024-12-18T00:47:26.8911078Z  2024-12-18T00:47:26.8911451Z  2024-12-18T00:47:26.8911801Z  2024-12-18T00:47:26.8912434Z  2024-12-18T00:47:26.8912833Z  2024-12-18T00:47:26.8913735Z [12,283 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:26.8914655Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:26.8915291Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:47:26.8916322Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:47:26.8917266Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2024-12-18T00:47:26.8918265Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:26.8919202Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:26.8920249Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:47:26.8921302Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2024-12-18T00:47:27.1214412Z 2024-12-18T00:47:27.1215241Z  2024-12-18T00:47:27.1215712Z  2024-12-18T00:47:27.1216121Z  2024-12-18T00:47:27.1216629Z  2024-12-18T00:47:27.1217002Z  2024-12-18T00:47:27.1217393Z  2024-12-18T00:47:27.1217806Z  2024-12-18T00:47:27.1218190Z  2024-12-18T00:47:27.1219145Z [12,284 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:27.1220101Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:27.1220753Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2024-12-18T00:47:27.1221516Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:47:27.1222421Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:47:27.1223445Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:27.1224353Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:27.1225451Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:47:27.1226436Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2024-12-18T00:47:27.3432088Z 2024-12-18T00:47:27.3433003Z  2024-12-18T00:47:27.3433483Z  2024-12-18T00:47:27.3433918Z  2024-12-18T00:47:27.3434345Z  2024-12-18T00:47:27.3434779Z  2024-12-18T00:47:27.3435211Z  2024-12-18T00:47:27.3435671Z  2024-12-18T00:47:27.3436095Z  2024-12-18T00:47:27.3437225Z [12,288 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:27.3438266Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:27.3439013Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:27.3439815Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:47:27.3441028Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:47:27.3442187Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:27.3443233Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2024-12-18T00:47:27.3444649Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:47:27.3445820Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2024-12-18T00:47:27.5435510Z 2024-12-18T00:47:27.5436337Z  2024-12-18T00:47:27.5436807Z  2024-12-18T00:47:27.5437164Z  2024-12-18T00:47:27.5437535Z  2024-12-18T00:47:27.5437921Z  2024-12-18T00:47:27.5438304Z  2024-12-18T00:47:27.5438714Z  2024-12-18T00:47:27.5439144Z  2024-12-18T00:47:27.5440074Z [12,289 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:27.5441065Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:27.5441936Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:27.5442725Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:47:27.5443888Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:47:27.5445237Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:27.5446079Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:27.5449199Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2024-12-18T00:47:27.5450718Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2024-12-18T00:47:27.8544817Z 2024-12-18T00:47:27.8545713Z  2024-12-18T00:47:27.8546198Z  2024-12-18T00:47:27.8546584Z  2024-12-18T00:47:27.8546995Z  2024-12-18T00:47:27.8547388Z  2024-12-18T00:47:27.8547774Z  2024-12-18T00:47:27.8548184Z  2024-12-18T00:47:27.8548547Z  2024-12-18T00:47:27.8549455Z [12,291 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:27.8550388Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:27.8551105Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:27.8551850Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:47:27.8552816Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2024-12-18T00:47:27.8553874Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:47:27.8554902Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:27.8555983Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:47:27.8557155Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2024-12-18T00:47:28.1127761Z 2024-12-18T00:47:28.1128672Z  2024-12-18T00:47:28.1129158Z  2024-12-18T00:47:28.1129575Z  2024-12-18T00:47:28.1130021Z  2024-12-18T00:47:28.1130427Z  2024-12-18T00:47:28.1130821Z  2024-12-18T00:47:28.1131231Z  2024-12-18T00:47:28.1131637Z  2024-12-18T00:47:28.1132604Z [12,292 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:28.1133600Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:28.1134332Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2024-12-18T00:47:28.1135031Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:47:28.1136059Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:47:28.1137349Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:47:28.1138379Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:28.1139398Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:47:28.1140494Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2024-12-18T00:47:28.3444331Z 2024-12-18T00:47:28.3445152Z  2024-12-18T00:47:28.3445624Z  2024-12-18T00:47:28.3446007Z  2024-12-18T00:47:28.3446358Z  2024-12-18T00:47:28.3446720Z  2024-12-18T00:47:28.3447097Z  2024-12-18T00:47:28.3447497Z  2024-12-18T00:47:28.3447823Z  2024-12-18T00:47:28.3448739Z [12,293 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:28.3449630Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:47:28.3450319Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:47:28.3451034Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:47:28.3451903Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2024-12-18T00:47:28.3452880Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:47:28.3453824Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2024-12-18T00:47:28.3455164Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2024-12-18T00:47:28.3456342Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2024-12-18T00:47:29.1119463Z 2024-12-18T00:47:29.1120408Z  2024-12-18T00:47:29.1120909Z  2024-12-18T00:47:29.1121255Z  2024-12-18T00:47:29.1121597Z  2024-12-18T00:47:29.1121932Z  2024-12-18T00:47:29.1122268Z  2024-12-18T00:47:29.1122584Z  2024-12-18T00:47:29.1122926Z  2024-12-18T00:47:29.1123926Z [12,294 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:29.1125080Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:47:29.1125910Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2024-12-18T00:47:29.1126624Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:47:29.1127589Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:47:29.1128740Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:47:29.1129708Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:47:29.1130755Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:47:29.1131804Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2024-12-18T00:47:29.3451673Z 2024-12-18T00:47:29.3452530Z  2024-12-18T00:47:29.3452987Z  2024-12-18T00:47:29.3453391Z  2024-12-18T00:47:29.3453796Z  2024-12-18T00:47:29.3454213Z  2024-12-18T00:47:29.3454615Z  2024-12-18T00:47:29.3455012Z  2024-12-18T00:47:29.3455420Z  2024-12-18T00:47:29.3456362Z [12,294 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:29.3457456Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:47:29.3458159Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:47:29.3458918Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:47:29.3459873Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:47:29.3460941Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:47:29.3461872Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2024-12-18T00:47:29.3462941Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:47:29.3464024Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2024-12-18T00:47:29.5454909Z 2024-12-18T00:47:29.5455804Z  2024-12-18T00:47:29.5456274Z  2024-12-18T00:47:29.5456792Z  2024-12-18T00:47:29.5457141Z  2024-12-18T00:47:29.5457556Z  2024-12-18T00:47:29.5457907Z  2024-12-18T00:47:29.5458331Z  2024-12-18T00:47:29.5458723Z  2024-12-18T00:47:29.5459620Z [12,296 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:29.5460653Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:47:29.5461360Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:47:29.5462062Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:47:29.5462931Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2024-12-18T00:47:29.5463969Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:47:29.5464894Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:47:29.5465969Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2024-12-18T00:47:29.5467023Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2024-12-18T00:47:30.1925410Z 2024-12-18T00:47:30.1926361Z  2024-12-18T00:47:30.1926838Z  2024-12-18T00:47:30.1927236Z  2024-12-18T00:47:30.1927641Z  2024-12-18T00:47:30.1928036Z  2024-12-18T00:47:30.1928439Z  2024-12-18T00:47:30.1929105Z  2024-12-18T00:47:30.1929498Z  2024-12-18T00:47:30.1930428Z [12,297 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:30.1931632Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:30.1932411Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2024-12-18T00:47:30.1933212Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:47:30.1934209Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:47:30.1935453Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:47:30.1936663Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2024-12-18T00:47:30.1937756Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:47:30.1938901Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local ... 2024-12-18T00:47:30.5226971Z 2024-12-18T00:47:30.5227864Z  2024-12-18T00:47:30.5228302Z  2024-12-18T00:47:30.5228639Z  2024-12-18T00:47:30.5228976Z  2024-12-18T00:47:30.5229285Z  2024-12-18T00:47:30.5229613Z  2024-12-18T00:47:30.5229938Z  2024-12-18T00:47:30.5230268Z  2024-12-18T00:47:30.5231070Z [12,298 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:30.5231816Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:30.5232387Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:30.5233024Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:47:30.5233804Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:47:30.5234653Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:47:30.5235396Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:30.5236287Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:47:30.5237181Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local ... 2024-12-18T00:47:30.7463426Z 2024-12-18T00:47:30.7464421Z  2024-12-18T00:47:30.7464929Z  2024-12-18T00:47:30.7465326Z  2024-12-18T00:47:30.7465741Z  2024-12-18T00:47:30.7466119Z  2024-12-18T00:47:30.7466668Z  2024-12-18T00:47:30.7467003Z  2024-12-18T00:47:30.7467358Z  2024-12-18T00:47:30.7468236Z [12,299 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:30.7469166Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:30.7469788Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:30.7470413Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:47:30.7471255Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2024-12-18T00:47:30.7472117Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 25s local 2024-12-18T00:47:30.7472890Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:30.7473724Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2024-12-18T00:47:30.7474583Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local ... 2024-12-18T00:47:30.9505240Z 2024-12-18T00:47:30.9506411Z  2024-12-18T00:47:30.9506802Z  2024-12-18T00:47:30.9507131Z  2024-12-18T00:47:30.9507452Z  2024-12-18T00:47:30.9507774Z  2024-12-18T00:47:30.9508069Z  2024-12-18T00:47:30.9508390Z  2024-12-18T00:47:30.9508753Z  2024-12-18T00:47:30.9509513Z [12,302 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:30.9510273Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:30.9510819Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:30.9511441Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:47:30.9512358Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:47:30.9513645Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:30.9514782Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:47:30.9515759Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local 2024-12-18T00:47:30.9516544Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local ... 2024-12-18T00:47:31.2132347Z 2024-12-18T00:47:31.2133341Z  2024-12-18T00:47:31.2133829Z  2024-12-18T00:47:31.2134220Z  2024-12-18T00:47:31.2134968Z  2024-12-18T00:47:31.2135364Z  2024-12-18T00:47:31.2135763Z  2024-12-18T00:47:31.2136174Z  2024-12-18T00:47:31.2136684Z  2024-12-18T00:47:31.2137661Z [12,304 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:31.2138663Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:31.2139394Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2024-12-18T00:47:31.2140186Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:47:31.2141168Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:47:31.2142274Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2024-12-18T00:47:31.2143408Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:47:31.2144707Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local 2024-12-18T00:47:31.2145592Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local ... 2024-12-18T00:47:31.5411081Z 2024-12-18T00:47:31.5412061Z  2024-12-18T00:47:31.5413469Z  2024-12-18T00:47:31.5414500Z  2024-12-18T00:47:31.5415226Z  2024-12-18T00:47:31.5415635Z  2024-12-18T00:47:31.5416009Z  2024-12-18T00:47:31.5416392Z  2024-12-18T00:47:31.5416951Z  2024-12-18T00:47:31.5417829Z [12,306 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:31.5418766Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:31.5419455Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:47:31.5420199Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:47:31.5421144Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:47:31.5422137Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:47:31.5423163Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:47:31.5424128Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local 2024-12-18T00:47:31.5424908Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local ... 2024-12-18T00:47:31.7471770Z 2024-12-18T00:47:31.7472752Z  2024-12-18T00:47:31.7473214Z  2024-12-18T00:47:31.7473625Z  2024-12-18T00:47:31.7474043Z  2024-12-18T00:47:31.7474455Z  2024-12-18T00:47:31.7474870Z  2024-12-18T00:47:31.7475263Z  2024-12-18T00:47:31.7475667Z  2024-12-18T00:47:31.7476638Z [12,308 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:31.7477633Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:31.7478352Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:47:31.7479125Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:47:31.7480121Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2024-12-18T00:47:31.7481249Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:47:31.7482377Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2024-12-18T00:47:31.7483475Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2024-12-18T00:47:31.7484440Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local ... 2024-12-18T00:47:31.9811828Z 2024-12-18T00:47:31.9812954Z  2024-12-18T00:47:31.9813358Z  2024-12-18T00:47:31.9813689Z  2024-12-18T00:47:31.9814009Z  2024-12-18T00:47:31.9814319Z  2024-12-18T00:47:31.9814647Z  2024-12-18T00:47:31.9815151Z  2024-12-18T00:47:31.9815483Z  2024-12-18T00:47:31.9816226Z [12,313 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:31.9817138Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:31.9817699Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:47:31.9827522Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:47:31.9828336Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:47:31.9829470Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:47:31.9830327Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2024-12-18T00:47:31.9831081Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:47:31.9831888Z Compiling src/cpu/x64/jit_brgemm_deconv.cpp; 10s local ... 2024-12-18T00:47:32.2764890Z 2024-12-18T00:47:32.2765792Z  2024-12-18T00:47:32.2766266Z  2024-12-18T00:47:32.2766714Z  2024-12-18T00:47:32.2767119Z  2024-12-18T00:47:32.2767526Z  2024-12-18T00:47:32.2767930Z  2024-12-18T00:47:32.2768333Z  2024-12-18T00:47:32.2768732Z  2024-12-18T00:47:32.2769663Z [12,316 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:32.2770656Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:32.2771380Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2024-12-18T00:47:32.2772050Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:47:32.2772908Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2024-12-18T00:47:32.2773960Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:47:32.2774987Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:47:32.2775883Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:47:32.2776872Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:47:32.5311962Z 2024-12-18T00:47:32.5312815Z  2024-12-18T00:47:32.5313200Z  2024-12-18T00:47:32.5313492Z  2024-12-18T00:47:32.5313801Z  2024-12-18T00:47:32.5314102Z  2024-12-18T00:47:32.5314410Z  2024-12-18T00:47:32.5314694Z  2024-12-18T00:47:32.5314994Z  2024-12-18T00:47:32.5315754Z [12,317 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:32.5316466Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:32.5316998Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:47:32.5317522Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:47:32.5318187Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:47:32.5318987Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2024-12-18T00:47:32.5319773Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:47:32.5320545Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:47:32.5321218Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:32.7493803Z 2024-12-18T00:47:32.7494621Z  2024-12-18T00:47:32.7495001Z  2024-12-18T00:47:32.7495326Z  2024-12-18T00:47:32.7495646Z  2024-12-18T00:47:32.7496003Z  2024-12-18T00:47:32.7496312Z  2024-12-18T00:47:32.7496780Z  2024-12-18T00:47:32.7497084Z  2024-12-18T00:47:32.7497846Z [12,321 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:32.7498632Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:32.7499219Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:47:32.7500058Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:47:32.7500790Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:47:32.7501591Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:47:32.7502286Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local 2024-12-18T00:47:32.7502951Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:47:32.7503587Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:32.9481972Z 2024-12-18T00:47:32.9482839Z  2024-12-18T00:47:32.9483609Z  2024-12-18T00:47:32.9483930Z  2024-12-18T00:47:32.9484280Z  2024-12-18T00:47:32.9484627Z  2024-12-18T00:47:32.9484951Z  2024-12-18T00:47:32.9485273Z  2024-12-18T00:47:32.9485606Z  2024-12-18T00:47:32.9486404Z [12,323 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:32.9487210Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:32.9487791Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:47:32.9488384Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:47:32.9489123Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:47:32.9489828Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2024-12-18T00:47:32.9490578Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2024-12-18T00:47:32.9491242Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:47:32.9491754Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:33.1483214Z 2024-12-18T00:47:33.1484535Z  2024-12-18T00:47:33.1485280Z  2024-12-18T00:47:33.1486461Z  2024-12-18T00:47:33.1486958Z  2024-12-18T00:47:33.1487373Z  2024-12-18T00:47:33.1487780Z  2024-12-18T00:47:33.1488205Z  2024-12-18T00:47:33.1488627Z  2024-12-18T00:47:33.1489610Z [12,324 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:33.1490663Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:33.1491427Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2024-12-18T00:47:33.1492247Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:47:33.1493179Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2024-12-18T00:47:33.1494138Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:47:33.1495119Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2024-12-18T00:47:33.1495972Z @onednn//:onednn_autogen; 11s local 2024-12-18T00:47:33.1496792Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:33.5627437Z 2024-12-18T00:47:33.5628812Z  2024-12-18T00:47:33.5629265Z  2024-12-18T00:47:33.5629634Z  2024-12-18T00:47:33.5630006Z  2024-12-18T00:47:33.5630410Z  2024-12-18T00:47:33.5630818Z  2024-12-18T00:47:33.5631209Z  2024-12-18T00:47:33.5631623Z  2024-12-18T00:47:33.5632563Z [12,325 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:33.5633554Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:47:33.5634291Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:47:33.5635078Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:47:33.5635983Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:47:33.5636835Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:47:33.5637789Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2024-12-18T00:47:33.5638558Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:47:33.8746231Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:33.8746760Z 2024-12-18T00:47:33.8747148Z  2024-12-18T00:47:33.8747558Z  2024-12-18T00:47:33.8747979Z  2024-12-18T00:47:33.8748366Z  2024-12-18T00:47:33.8749100Z  2024-12-18T00:47:33.8749510Z  2024-12-18T00:47:33.8749905Z  2024-12-18T00:47:33.8750307Z  2024-12-18T00:47:33.8751401Z [12,329 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:33.8752479Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:47:33.8753168Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:47:33.8753866Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:47:33.8754830Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:47:33.8755799Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2024-12-18T00:47:33.8756642Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2024-12-18T00:47:33.8757365Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:47:33.8757916Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:34.1494526Z 2024-12-18T00:47:34.1495440Z  2024-12-18T00:47:34.1495968Z  2024-12-18T00:47:34.1496402Z  2024-12-18T00:47:34.1496952Z  2024-12-18T00:47:34.1497366Z  2024-12-18T00:47:34.1497793Z  2024-12-18T00:47:34.1498218Z  2024-12-18T00:47:34.1498663Z  2024-12-18T00:47:34.1499650Z [12,333 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:34.1500645Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:47:34.1501392Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2024-12-18T00:47:34.1502159Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:47:34.1503081Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2024-12-18T00:47:34.1503984Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:47:34.1504893Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2024-12-18T00:47:34.1505720Z @onednn//:onednn_autogen; 12s local 2024-12-18T00:47:34.1506538Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 11s local ... 2024-12-18T00:47:34.4391566Z 2024-12-18T00:47:34.4392475Z  2024-12-18T00:47:34.4392986Z  2024-12-18T00:47:34.4393398Z  2024-12-18T00:47:34.4393788Z  2024-12-18T00:47:34.4394240Z  2024-12-18T00:47:34.4394644Z  2024-12-18T00:47:34.4395045Z  2024-12-18T00:47:34.4395463Z  2024-12-18T00:47:34.4396415Z [12,336 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:34.4397432Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:34.4398205Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:47:34.4398991Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:47:34.4399904Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 25s local 2024-12-18T00:47:34.4400775Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:47:34.4401714Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2024-12-18T00:47:34.4402549Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:47:34.4403356Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local ... 2024-12-18T00:47:34.7502646Z 2024-12-18T00:47:34.7503605Z  2024-12-18T00:47:34.7504147Z  2024-12-18T00:47:34.7504595Z  2024-12-18T00:47:34.7504992Z  2024-12-18T00:47:34.7505389Z  2024-12-18T00:47:34.7505828Z  2024-12-18T00:47:34.7506284Z  2024-12-18T00:47:34.7506694Z  2024-12-18T00:47:34.7507723Z [12,337 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:34.7508756Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:34.7509489Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:47:34.7510289Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:47:34.7511185Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 25s local 2024-12-18T00:47:34.7512041Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:47:34.7513252Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2024-12-18T00:47:34.7514098Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:47:34.7515052Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local ... 2024-12-18T00:47:34.9507300Z 2024-12-18T00:47:34.9508161Z  2024-12-18T00:47:34.9508613Z  2024-12-18T00:47:34.9509015Z  2024-12-18T00:47:34.9509418Z  2024-12-18T00:47:34.9509793Z  2024-12-18T00:47:34.9510189Z  2024-12-18T00:47:34.9510598Z  2024-12-18T00:47:34.9511413Z  2024-12-18T00:47:34.9512326Z [12,338 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:34.9513204Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:34.9513880Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:47:34.9514587Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:47:34.9515379Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2024-12-18T00:47:34.9516272Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:47:34.9517072Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:47:34.9517827Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local 2024-12-18T00:47:34.9518824Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local ... 2024-12-18T00:47:35.2276280Z 2024-12-18T00:47:35.2277182Z  2024-12-18T00:47:35.2277794Z  2024-12-18T00:47:35.2278231Z  2024-12-18T00:47:35.2278694Z  2024-12-18T00:47:35.2279120Z  2024-12-18T00:47:35.2279491Z  2024-12-18T00:47:35.2279887Z  2024-12-18T00:47:35.2280308Z  2024-12-18T00:47:35.2281436Z [12,340 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:35.2282439Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:35.2283153Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2024-12-18T00:47:35.2283936Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:47:35.2284777Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:47:35.2285736Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:47:35.2286615Z @onednn//:onednn_autogen; 13s local 2024-12-18T00:47:35.2287345Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local 2024-12-18T00:47:35.2288312Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local ... 2024-12-18T00:47:35.4298217Z 2024-12-18T00:47:35.4299132Z  2024-12-18T00:47:35.4299630Z  2024-12-18T00:47:35.4300017Z  2024-12-18T00:47:35.4300406Z  2024-12-18T00:47:35.4300782Z  2024-12-18T00:47:35.4301186Z  2024-12-18T00:47:35.4301580Z  2024-12-18T00:47:35.4301990Z  2024-12-18T00:47:35.4302921Z [12,342 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:35.4303853Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:35.4304554Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:47:35.4305295Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:47:35.4306075Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:47:35.4306922Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:47:35.4307852Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 13s local 2024-12-18T00:47:35.4308772Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2024-12-18T00:47:35.4309527Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:35.7516240Z 2024-12-18T00:47:35.7517107Z  2024-12-18T00:47:35.7517577Z  2024-12-18T00:47:35.7517967Z  2024-12-18T00:47:35.7518371Z  2024-12-18T00:47:35.7518753Z  2024-12-18T00:47:35.7519142Z  2024-12-18T00:47:35.7519552Z  2024-12-18T00:47:35.7519938Z  2024-12-18T00:47:35.7521156Z [12,342 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:35.7522106Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:35.7523091Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:47:35.7523864Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:47:35.7524664Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:47:35.7525519Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2024-12-18T00:47:35.7526931Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 13s local 2024-12-18T00:47:35.7527809Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2024-12-18T00:47:35.7528546Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:35.9599678Z 2024-12-18T00:47:35.9600527Z  2024-12-18T00:47:35.9601010Z  2024-12-18T00:47:35.9601416Z  2024-12-18T00:47:35.9601827Z  2024-12-18T00:47:35.9602216Z  2024-12-18T00:47:35.9602634Z  2024-12-18T00:47:35.9603031Z  2024-12-18T00:47:35.9603420Z  2024-12-18T00:47:35.9604397Z [12,346 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:35.9605400Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:35.9606120Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2024-12-18T00:47:35.9606886Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:47:35.9607710Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2024-12-18T00:47:35.9608676Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2024-12-18T00:47:35.9609667Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 13s local 2024-12-18T00:47:35.9610648Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2024-12-18T00:47:35.9611470Z @onednn//:onednn_autogen; 13s local ... 2024-12-18T00:47:36.3524184Z 2024-12-18T00:47:36.3525063Z  2024-12-18T00:47:36.3525573Z  2024-12-18T00:47:36.3526151Z  2024-12-18T00:47:36.3526554Z  2024-12-18T00:47:36.3526965Z  2024-12-18T00:47:36.3527354Z  2024-12-18T00:47:36.3527755Z  2024-12-18T00:47:36.3528123Z  2024-12-18T00:47:36.3529037Z [12,349 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:36.3529983Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:47:36.3530669Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:47:36.3531430Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:47:36.3532215Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:47:36.3533151Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2024-12-18T00:47:36.3534196Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2024-12-18T00:47:36.3535120Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2024-12-18T00:47:36.3535938Z @onednn//:onednn_autogen; 13s local ... 2024-12-18T00:47:36.5527406Z 2024-12-18T00:47:36.5528275Z  2024-12-18T00:47:36.5528768Z  2024-12-18T00:47:36.5529192Z  2024-12-18T00:47:36.5529641Z  2024-12-18T00:47:36.5530047Z  2024-12-18T00:47:36.5530464Z  2024-12-18T00:47:36.5530883Z  2024-12-18T00:47:36.5531294Z  2024-12-18T00:47:36.5532277Z [12,350 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:36.5533345Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:47:36.5534116Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:47:36.5534919Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:47:36.5535771Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:47:36.5536917Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2024-12-18T00:47:36.5537956Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2024-12-18T00:47:36.5539273Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2024-12-18T00:47:36.5540100Z @onednn//:onednn_autogen; 13s local ... 2024-12-18T00:47:36.9445664Z 2024-12-18T00:47:36.9446844Z  2024-12-18T00:47:36.9447373Z  2024-12-18T00:47:36.9447796Z  2024-12-18T00:47:36.9448195Z  2024-12-18T00:47:36.9448584Z  2024-12-18T00:47:36.9448971Z  2024-12-18T00:47:36.9449518Z  2024-12-18T00:47:36.9449919Z  2024-12-18T00:47:36.9451038Z [12,354 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:36.9452240Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:47:36.9452946Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:47:36.9453690Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:47:36.9454505Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2024-12-18T00:47:36.9455443Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:47:36.9456633Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2024-12-18T00:47:36.9457593Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:47:36.9458361Z @onednn//:onednn_autogen; 14s local ... 2024-12-18T00:47:37.1531186Z 2024-12-18T00:47:37.1532153Z  2024-12-18T00:47:37.1532661Z  2024-12-18T00:47:37.1533104Z  2024-12-18T00:47:37.1533553Z  2024-12-18T00:47:37.1533999Z  2024-12-18T00:47:37.1534450Z  2024-12-18T00:47:37.1535067Z  2024-12-18T00:47:37.1535422Z  2024-12-18T00:47:37.1536334Z [12,357 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:37.1537615Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:47:37.1538342Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2024-12-18T00:47:37.1539109Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:47:37.1539851Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:47:37.1540700Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:47:37.1541667Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2024-12-18T00:47:37.1542607Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:47:37.1543391Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:47:37.3535609Z 2024-12-18T00:47:37.3536709Z  2024-12-18T00:47:37.3537249Z  2024-12-18T00:47:37.3537696Z  2024-12-18T00:47:37.3538185Z  2024-12-18T00:47:37.3538784Z  2024-12-18T00:47:37.3539176Z  2024-12-18T00:47:37.3539576Z  2024-12-18T00:47:37.3539994Z  2024-12-18T00:47:37.3541000Z [12,358 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:37.3542045Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:47:37.3542826Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:37.3543614Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:47:37.3544662Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:47:37.3545640Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:47:37.3546697Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2024-12-18T00:47:37.3547702Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:47:37.3548522Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:47:37.7104118Z 2024-12-18T00:47:37.7105070Z  2024-12-18T00:47:37.7105604Z  2024-12-18T00:47:37.7106025Z  2024-12-18T00:47:37.7106466Z  2024-12-18T00:47:37.7106888Z  2024-12-18T00:47:37.7107260Z  2024-12-18T00:47:37.7107643Z  2024-12-18T00:47:37.7108017Z  2024-12-18T00:47:37.7108975Z [12,360 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:37.7110208Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:47:37.7110920Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:37.7111833Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:47:37.7112625Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:47:37.7113563Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2024-12-18T00:47:37.7114583Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2024-12-18T00:47:37.7115682Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2024-12-18T00:47:37.7117163Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local ... 2024-12-18T00:47:37.9542115Z 2024-12-18T00:47:37.9543001Z  2024-12-18T00:47:37.9543510Z  2024-12-18T00:47:37.9543944Z  2024-12-18T00:47:37.9544550Z  2024-12-18T00:47:37.9544980Z  2024-12-18T00:47:37.9545358Z  2024-12-18T00:47:37.9545722Z  2024-12-18T00:47:37.9546119Z  2024-12-18T00:47:37.9547062Z [12,362 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:37.9548075Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:47:37.9548790Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:37.9549531Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:47:37.9550303Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2024-12-18T00:47:37.9551207Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:47:37.9552194Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2024-12-18T00:47:37.9553173Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:47:37.9554179Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local ... 2024-12-18T00:47:38.2333002Z 2024-12-18T00:47:38.2333948Z  2024-12-18T00:47:38.2334471Z  2024-12-18T00:47:38.2334944Z  2024-12-18T00:47:38.2335371Z  2024-12-18T00:47:38.2335795Z  2024-12-18T00:47:38.2336133Z  2024-12-18T00:47:38.2336685Z  2024-12-18T00:47:38.2337023Z  2024-12-18T00:47:38.2337859Z [12,363 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:38.2338722Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:47:38.2339353Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2024-12-18T00:47:38.2340002Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:47:38.2340714Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:47:38.2341517Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:47:38.2342384Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2024-12-18T00:47:38.2343221Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:47:38.2344114Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local ... 2024-12-18T00:47:38.4722407Z 2024-12-18T00:47:38.4723324Z  2024-12-18T00:47:38.4723823Z  2024-12-18T00:47:38.4724284Z  2024-12-18T00:47:38.4724719Z  2024-12-18T00:47:38.4725192Z  2024-12-18T00:47:38.4725541Z  2024-12-18T00:47:38.4725858Z  2024-12-18T00:47:38.4726206Z  2024-12-18T00:47:38.4727003Z [12,367 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:38.4727831Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:47:38.4728609Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:47:38.4729232Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:47:38.4729904Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:47:38.4730854Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:47:38.4731682Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2024-12-18T00:47:38.4732750Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:47:38.4733651Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local ... 2024-12-18T00:47:38.7526236Z 2024-12-18T00:47:38.7527406Z  2024-12-18T00:47:38.7527964Z  2024-12-18T00:47:38.7528386Z  2024-12-18T00:47:38.7528816Z  2024-12-18T00:47:38.7529197Z  2024-12-18T00:47:38.7529601Z  2024-12-18T00:47:38.7530004Z  2024-12-18T00:47:38.7530377Z  2024-12-18T00:47:38.7531485Z [12,370 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:38.7532573Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:47:38.7533263Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:47:38.7533995Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:47:38.7534791Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:47:38.7535680Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2024-12-18T00:47:38.7536822Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2024-12-18T00:47:38.7537796Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2024-12-18T00:47:38.7538782Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local ... 2024-12-18T00:47:38.9551058Z 2024-12-18T00:47:38.9552009Z  2024-12-18T00:47:38.9552544Z  2024-12-18T00:47:38.9553005Z  2024-12-18T00:47:38.9553452Z  2024-12-18T00:47:38.9553889Z  2024-12-18T00:47:38.9554327Z  2024-12-18T00:47:38.9554685Z  2024-12-18T00:47:38.9555042Z  2024-12-18T00:47:38.9555972Z [12,372 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:38.9557215Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:47:38.9557901Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:47:38.9558589Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:47:38.9559364Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2024-12-18T00:47:38.9560234Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2024-12-18T00:47:38.9561190Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2024-12-18T00:47:38.9562114Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2024-12-18T00:47:38.9563045Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local ... 2024-12-18T00:47:39.1556052Z 2024-12-18T00:47:39.1556989Z  2024-12-18T00:47:39.1557583Z  2024-12-18T00:47:39.1558029Z  2024-12-18T00:47:39.1558436Z  2024-12-18T00:47:39.1558853Z  2024-12-18T00:47:39.1559236Z  2024-12-18T00:47:39.1559594Z  2024-12-18T00:47:39.1559972Z  2024-12-18T00:47:39.1560890Z [12,373 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:39.1561837Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:47:39.1562554Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2024-12-18T00:47:39.1563283Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:47:39.1564088Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:47:39.1564979Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2024-12-18T00:47:39.1565973Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2024-12-18T00:47:39.1566936Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2024-12-18T00:47:39.1567912Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local ... 2024-12-18T00:47:39.5564660Z 2024-12-18T00:47:39.5565567Z  2024-12-18T00:47:39.5566083Z  2024-12-18T00:47:39.5566497Z  2024-12-18T00:47:39.5566910Z  2024-12-18T00:47:39.5567328Z  2024-12-18T00:47:39.5567711Z  2024-12-18T00:47:39.5568053Z  2024-12-18T00:47:39.5568471Z  2024-12-18T00:47:39.5569696Z [12,375 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:39.5570692Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:47:39.5571555Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:39.5572314Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:47:39.5573131Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:47:39.5574047Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2024-12-18T00:47:39.5575166Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2024-12-18T00:47:39.5576154Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2024-12-18T00:47:39.5577313Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local ... 2024-12-18T00:47:39.8378475Z 2024-12-18T00:47:39.8379383Z  2024-12-18T00:47:39.8379900Z  2024-12-18T00:47:39.8380350Z  2024-12-18T00:47:39.8380761Z  2024-12-18T00:47:39.8381183Z  2024-12-18T00:47:39.8381548Z  2024-12-18T00:47:39.8381925Z  2024-12-18T00:47:39.8382299Z  2024-12-18T00:47:39.8383193Z [12,376 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:39.8384089Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:47:39.8384763Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:39.8385490Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:47:39.8386263Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:47:39.8387105Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:47:39.8388032Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2024-12-18T00:47:39.8388935Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:47:39.8389909Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 13s local ... 2024-12-18T00:47:40.0453589Z 2024-12-18T00:47:40.0454528Z  2024-12-18T00:47:40.0455047Z  2024-12-18T00:47:40.0455470Z  2024-12-18T00:47:40.0455896Z  2024-12-18T00:47:40.0456310Z  2024-12-18T00:47:40.0456807Z  2024-12-18T00:47:40.0457226Z  2024-12-18T00:47:40.0457628Z  2024-12-18T00:47:40.0458584Z [12,377 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:40.0459607Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:47:40.0460346Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2024-12-18T00:47:40.0461136Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:47:40.0461981Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2024-12-18T00:47:40.0462909Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:47:40.0463937Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2024-12-18T00:47:40.0464903Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:47:40.0465965Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 13s local ... 2024-12-18T00:47:40.3568727Z 2024-12-18T00:47:40.3569670Z  2024-12-18T00:47:40.3570278Z  2024-12-18T00:47:40.3570861Z  2024-12-18T00:47:40.3571278Z  2024-12-18T00:47:40.3571696Z  2024-12-18T00:47:40.3572038Z  2024-12-18T00:47:40.3572581Z  2024-12-18T00:47:40.3572932Z  2024-12-18T00:47:40.3573908Z [12,379 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:40.3574832Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:47:40.3575487Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:40.3576198Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:47:40.3577103Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:47:40.3577955Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:47:40.3579152Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:47:40.3580042Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:47:40.3581220Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 13s local ... 2024-12-18T00:47:40.5573133Z 2024-12-18T00:47:40.5574167Z  2024-12-18T00:47:40.5574710Z  2024-12-18T00:47:40.5575129Z  2024-12-18T00:47:40.5575589Z  2024-12-18T00:47:40.5576034Z  2024-12-18T00:47:40.5576413Z  2024-12-18T00:47:40.5576934Z  2024-12-18T00:47:40.5577895Z  2024-12-18T00:47:40.5578890Z [12,381 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:40.5579913Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:47:40.5580611Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:40.5581348Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:47:40.5582191Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:47:40.5583134Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2024-12-18T00:47:40.5584186Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:47:40.5585150Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2024-12-18T00:47:40.5586183Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 13s local ... 2024-12-18T00:47:40.8684643Z 2024-12-18T00:47:40.8685596Z  2024-12-18T00:47:40.8686113Z  2024-12-18T00:47:40.8686589Z  2024-12-18T00:47:40.8687062Z  2024-12-18T00:47:40.8687470Z  2024-12-18T00:47:40.8687855Z  2024-12-18T00:47:40.8688259Z  2024-12-18T00:47:40.8688660Z  2024-12-18T00:47:40.8689593Z [12,385 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:40.8690569Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:40.8691372Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:47:40.8692181Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2024-12-18T00:47:40.8693147Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2024-12-18T00:47:40.8694161Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:47:40.8695130Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2024-12-18T00:47:40.8696239Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 10s local 2024-12-18T00:47:40.8697612Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 8s local ... 2024-12-18T00:47:41.1579860Z 2024-12-18T00:47:41.1580990Z  2024-12-18T00:47:41.1581770Z  2024-12-18T00:47:41.1582478Z  2024-12-18T00:47:41.1583117Z  2024-12-18T00:47:41.1583574Z  2024-12-18T00:47:41.1583992Z  2024-12-18T00:47:41.1584416Z  2024-12-18T00:47:41.1584856Z  2024-12-18T00:47:41.1585819Z [12,385 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:41.1587086Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2024-12-18T00:47:41.1587862Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:47:41.1588706Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:47:41.1589648Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2024-12-18T00:47:41.1590646Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2024-12-18T00:47:41.1591629Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2024-12-18T00:47:41.1592741Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 10s local 2024-12-18T00:47:41.3585641Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 9s local ... 2024-12-18T00:47:41.3586430Z 2024-12-18T00:47:41.3586915Z  2024-12-18T00:47:41.3587379Z  2024-12-18T00:47:41.3587765Z  2024-12-18T00:47:41.3588137Z  2024-12-18T00:47:41.3588734Z  2024-12-18T00:47:41.3589106Z  2024-12-18T00:47:41.3589485Z  2024-12-18T00:47:41.3589863Z  2024-12-18T00:47:41.3590890Z [12,386 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:41.3591856Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:47:41.3592595Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:47:41.3593423Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:47:41.3594358Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2024-12-18T00:47:41.3595406Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2024-12-18T00:47:41.3596282Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2024-12-18T00:47:41.3597260Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 9s local 2024-12-18T00:47:41.3598103Z @onednn//:onednn_autogen; 8s local ... 2024-12-18T00:47:41.8089028Z 2024-12-18T00:47:41.8089942Z  2024-12-18T00:47:41.8090429Z  2024-12-18T00:47:41.8090857Z  2024-12-18T00:47:41.8091264Z  2024-12-18T00:47:41.8091664Z  2024-12-18T00:47:41.8092035Z  2024-12-18T00:47:41.8092442Z  2024-12-18T00:47:41.8092825Z  2024-12-18T00:47:41.8093718Z [12,387 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:41.8094647Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:47:41.8095338Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:47:41.8096146Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2024-12-18T00:47:41.8097160Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2024-12-18T00:47:41.8098074Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2024-12-18T00:47:41.8098943Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2024-12-18T00:47:41.8099827Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 9s local 2024-12-18T00:47:41.8100614Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:47:42.1597427Z 2024-12-18T00:47:42.1598249Z  2024-12-18T00:47:42.1598744Z  2024-12-18T00:47:42.1599174Z  2024-12-18T00:47:42.1599622Z  2024-12-18T00:47:42.1600054Z  2024-12-18T00:47:42.1600482Z  2024-12-18T00:47:42.1600910Z  2024-12-18T00:47:42.1601318Z  2024-12-18T00:47:42.1602308Z [12,388 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:42.1603381Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2024-12-18T00:47:42.1604192Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:47:42.1605046Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:47:42.1606003Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2024-12-18T00:47:42.1607039Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2024-12-18T00:47:42.1608199Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2024-12-18T00:47:42.1609255Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 10s local 2024-12-18T00:47:42.1610340Z @onednn//:onednn_autogen; 9s local ... 2024-12-18T00:47:42.9680716Z 2024-12-18T00:47:42.9681599Z  2024-12-18T00:47:42.9682078Z  2024-12-18T00:47:42.9682514Z  2024-12-18T00:47:42.9682936Z  2024-12-18T00:47:42.9683289Z  2024-12-18T00:47:42.9683689Z  2024-12-18T00:47:42.9684098Z  2024-12-18T00:47:42.9684519Z  2024-12-18T00:47:42.9685544Z [12,389 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:42.9686558Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:47:42.9687373Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:47:42.9688239Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2024-12-18T00:47:42.9689184Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:47:42.9690462Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2024-12-18T00:47:42.9691441Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:47:42.9692551Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 10s local 2024-12-18T00:47:42.9693440Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:47:43.2129844Z 2024-12-18T00:47:43.2130738Z  2024-12-18T00:47:43.2131191Z  2024-12-18T00:47:43.2131588Z  2024-12-18T00:47:43.2132001Z  2024-12-18T00:47:43.2132763Z  2024-12-18T00:47:43.2133172Z  2024-12-18T00:47:43.2133549Z  2024-12-18T00:47:43.2133924Z  2024-12-18T00:47:43.2134852Z [12,391 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:43.2135835Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2024-12-18T00:47:43.2136736Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:47:43.2137499Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:47:43.2138437Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:47:43.2139476Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2024-12-18T00:47:43.2140404Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:47:43.2141354Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 11s local 2024-12-18T00:47:43.2142133Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:47:43.4957130Z 2024-12-18T00:47:43.4958087Z  2024-12-18T00:47:43.4958576Z  2024-12-18T00:47:43.4958947Z  2024-12-18T00:47:43.4959325Z  2024-12-18T00:47:43.4959697Z  2024-12-18T00:47:43.4960026Z  2024-12-18T00:47:43.4960380Z  2024-12-18T00:47:43.4960730Z  2024-12-18T00:47:43.4961540Z [12,392 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:43.4962530Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:43.4963270Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:47:43.4964082Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:47:43.4964879Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:47:43.4965737Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2024-12-18T00:47:43.4966542Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:47:43.4967417Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 11s local 2024-12-18T00:47:43.4968189Z @onednn//:onednn_autogen; 10s local ... 2024-12-18T00:47:43.7607597Z 2024-12-18T00:47:43.7608494Z  2024-12-18T00:47:43.7608935Z  2024-12-18T00:47:43.7609349Z  2024-12-18T00:47:43.7609756Z  2024-12-18T00:47:43.7610164Z  2024-12-18T00:47:43.7610545Z  2024-12-18T00:47:43.7610925Z  2024-12-18T00:47:43.7611329Z  2024-12-18T00:47:43.7612330Z [12,393 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:43.7613306Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:43.7614095Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:47:43.7614849Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:47:43.7615736Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2024-12-18T00:47:43.7617111Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2024-12-18T00:47:43.7618109Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2024-12-18T00:47:43.7618998Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 11s local 2024-12-18T00:47:43.7619799Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:44.0375011Z 2024-12-18T00:47:44.0375870Z  2024-12-18T00:47:44.0376369Z  2024-12-18T00:47:44.0376907Z  2024-12-18T00:47:44.0377319Z  2024-12-18T00:47:44.0377961Z  2024-12-18T00:47:44.0378369Z  2024-12-18T00:47:44.0378794Z  2024-12-18T00:47:44.0379199Z  2024-12-18T00:47:44.0380264Z [12,398 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:44.0381281Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:44.0382063Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:47:44.0382895Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2024-12-18T00:47:44.0383914Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:47:44.0385020Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2024-12-18T00:47:44.0385989Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:47:44.0386978Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 11s local 2024-12-18T00:47:44.0387836Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:44.2483233Z 2024-12-18T00:47:44.2484204Z  2024-12-18T00:47:44.2484659Z  2024-12-18T00:47:44.2485066Z  2024-12-18T00:47:44.2485457Z  2024-12-18T00:47:44.2485838Z  2024-12-18T00:47:44.2486233Z  2024-12-18T00:47:44.2486622Z  2024-12-18T00:47:44.2487026Z  2024-12-18T00:47:44.2487984Z [12,400 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:44.2488930Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2024-12-18T00:47:44.2489639Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:47:44.2490457Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:47:44.2491293Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:47:44.2492251Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2024-12-18T00:47:44.2493124Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:47:44.2494107Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local 2024-12-18T00:47:44.2494957Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:44.5256375Z 2024-12-18T00:47:44.5257460Z  2024-12-18T00:47:44.5257986Z  2024-12-18T00:47:44.5258451Z  2024-12-18T00:47:44.5258852Z  2024-12-18T00:47:44.5259266Z  2024-12-18T00:47:44.5259632Z  2024-12-18T00:47:44.5260036Z  2024-12-18T00:47:44.5260434Z  2024-12-18T00:47:44.5261401Z [12,401 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:44.5262415Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:47:44.5263173Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:47:44.5263937Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:47:44.5264862Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:47:44.5265852Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2024-12-18T00:47:44.5266763Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:47:44.5267696Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local 2024-12-18T00:47:44.5268554Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:44.7616904Z 2024-12-18T00:47:44.7617780Z  2024-12-18T00:47:44.7618272Z  2024-12-18T00:47:44.7618681Z  2024-12-18T00:47:44.7619084Z  2024-12-18T00:47:44.7619502Z  2024-12-18T00:47:44.7619899Z  2024-12-18T00:47:44.7620280Z  2024-12-18T00:47:44.7620690Z  2024-12-18T00:47:44.7621740Z [12,401 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:44.7622792Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:47:44.7623595Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:47:44.7624414Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:47:44.7625333Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2024-12-18T00:47:44.7626544Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2024-12-18T00:47:44.7627608Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2024-12-18T00:47:44.7639442Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local 2024-12-18T00:47:44.7640602Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:45.0719910Z 2024-12-18T00:47:45.0720783Z  2024-12-18T00:47:45.0721274Z  2024-12-18T00:47:45.0721677Z  2024-12-18T00:47:45.0722068Z  2024-12-18T00:47:45.0722824Z  2024-12-18T00:47:45.0723248Z  2024-12-18T00:47:45.0723649Z  2024-12-18T00:47:45.0724046Z  2024-12-18T00:47:45.0724983Z [12,402 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:45.0725936Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:47:45.0726708Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:47:45.0727556Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2024-12-18T00:47:45.0728487Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:47:45.0729523Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2024-12-18T00:47:45.0730482Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2024-12-18T00:47:45.0731475Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local 2024-12-18T00:47:45.0732269Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:45.2838615Z 2024-12-18T00:47:45.2839583Z  2024-12-18T00:47:45.2840064Z  2024-12-18T00:47:45.2840496Z  2024-12-18T00:47:45.2840908Z  2024-12-18T00:47:45.2841286Z  2024-12-18T00:47:45.2841655Z  2024-12-18T00:47:45.2842051Z  2024-12-18T00:47:45.2842467Z  2024-12-18T00:47:45.2843424Z [12,406 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:45.2844675Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2024-12-18T00:47:45.2845466Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:47:45.2846288Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:47:45.2847190Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:47:45.2848178Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2024-12-18T00:47:45.2849105Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2024-12-18T00:47:45.2850077Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local 2024-12-18T00:47:45.2850918Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:45.5625820Z 2024-12-18T00:47:45.5626652Z  2024-12-18T00:47:45.5627104Z  2024-12-18T00:47:45.5627479Z  2024-12-18T00:47:45.5627847Z  2024-12-18T00:47:45.5628222Z  2024-12-18T00:47:45.5628616Z  2024-12-18T00:47:45.5629015Z  2024-12-18T00:47:45.5629417Z  2024-12-18T00:47:45.5630424Z [12,407 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:45.5631396Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:47:45.5632141Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:47:45.5632918Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:47:45.5633840Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2024-12-18T00:47:45.5634842Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2024-12-18T00:47:45.5635791Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2024-12-18T00:47:45.5636752Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local 2024-12-18T00:47:45.5637568Z @onednn//:onednn_autogen; 11s local ... 2024-12-18T00:47:45.8047297Z 2024-12-18T00:47:45.8048209Z  2024-12-18T00:47:45.8048719Z  2024-12-18T00:47:45.8049151Z  2024-12-18T00:47:45.8049591Z  2024-12-18T00:47:45.8050390Z  2024-12-18T00:47:45.8050824Z  2024-12-18T00:47:45.8051178Z  2024-12-18T00:47:45.8051569Z  2024-12-18T00:47:45.8052697Z [12,408 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:45.8053760Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:47:45.8054584Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:47:45.8055393Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2024-12-18T00:47:45.8056398Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:47:45.8057650Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2024-12-18T00:47:45.8058644Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:47:45.8059667Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local 2024-12-18T00:47:45.8060426Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:46.1632844Z 2024-12-18T00:47:46.1633690Z  2024-12-18T00:47:46.1634130Z  2024-12-18T00:47:46.1634487Z  2024-12-18T00:47:46.1634809Z  2024-12-18T00:47:46.1635138Z  2024-12-18T00:47:46.1635481Z  2024-12-18T00:47:46.1635837Z  2024-12-18T00:47:46.1636138Z  2024-12-18T00:47:46.1636916Z [12,410 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:46.1637677Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2024-12-18T00:47:46.1638270Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:47:46.1638908Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:47:46.1639581Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:47:46.1640519Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2024-12-18T00:47:46.1641515Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:47:46.1642435Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:47:46.1643327Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:46.3637144Z 2024-12-18T00:47:46.3638025Z  2024-12-18T00:47:46.3638528Z  2024-12-18T00:47:46.3638953Z  2024-12-18T00:47:46.3639359Z  2024-12-18T00:47:46.3639747Z  2024-12-18T00:47:46.3640135Z  2024-12-18T00:47:46.3640518Z  2024-12-18T00:47:46.3640907Z  2024-12-18T00:47:46.3641853Z [12,413 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:46.3642818Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:46.3643699Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:47:46.3644775Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:47:46.3645608Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:47:46.3646540Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:47:46.3647419Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:47:46.3648349Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:47:46.3649186Z @onednn//:onednn_autogen; 12s local ... 2024-12-18T00:47:46.6639477Z 2024-12-18T00:47:46.6640332Z  2024-12-18T00:47:46.6640828Z  2024-12-18T00:47:46.6641256Z  2024-12-18T00:47:46.6641661Z  2024-12-18T00:47:46.6642080Z  2024-12-18T00:47:46.6642503Z  2024-12-18T00:47:46.6642921Z  2024-12-18T00:47:46.6643389Z  2024-12-18T00:47:46.6644553Z [12,416 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:46.6645613Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:46.6646428Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:47:46.6647279Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:47:46.6648242Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2024-12-18T00:47:46.6649501Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:47:46.6650581Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2024-12-18T00:47:46.6651612Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:47:46.6652502Z @onednn//:onednn_autogen; 13s local ... 2024-12-18T00:47:46.8980479Z 2024-12-18T00:47:46.8981350Z  2024-12-18T00:47:46.8981846Z  2024-12-18T00:47:46.8982263Z  2024-12-18T00:47:46.8983100Z  2024-12-18T00:47:46.8983506Z  2024-12-18T00:47:46.8983895Z  2024-12-18T00:47:46.8984277Z  2024-12-18T00:47:46.8984660Z  2024-12-18T00:47:46.8985620Z [12,419 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:46.8986601Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:46.8987375Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:47:46.8988162Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2024-12-18T00:47:46.8989084Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:47:46.8990121Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:47:46.8991102Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:47:46.8992102Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local 2024-12-18T00:47:46.8992924Z @onednn//:onednn_autogen; 13s local ... 2024-12-18T00:47:47.1645688Z 2024-12-18T00:47:47.1646579Z  2024-12-18T00:47:47.1647068Z  2024-12-18T00:47:47.1647476Z  2024-12-18T00:47:47.1647863Z  2024-12-18T00:47:47.1648260Z  2024-12-18T00:47:47.1648656Z  2024-12-18T00:47:47.1649046Z  2024-12-18T00:47:47.1649445Z  2024-12-18T00:47:47.1650400Z [12,423 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:47.1651398Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2024-12-18T00:47:47.1652165Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:47:47.1652985Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:47:47.1653862Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:47:47.1654743Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2024-12-18T00:47:47.1655707Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:47:47.1656855Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:47:47.1657713Z @onednn//:onednn_autogen; 13s local ... 2024-12-18T00:47:47.4331650Z 2024-12-18T00:47:47.4332565Z  2024-12-18T00:47:47.4333072Z  2024-12-18T00:47:47.4333446Z  2024-12-18T00:47:47.4333865Z  2024-12-18T00:47:47.4334272Z  2024-12-18T00:47:47.4334624Z  2024-12-18T00:47:47.4335004Z  2024-12-18T00:47:47.4335397Z  2024-12-18T00:47:47.4336321Z [12,426 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:47.4337453Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:47.4338279Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:47:47.4339119Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:47:47.4340027Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:47:47.4341098Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:47:47.4342052Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:47:47.4343078Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:47:47.4344017Z @llvm-project//mlir:mlir-tblgen; 12s local ... 2024-12-18T00:47:47.6787899Z 2024-12-18T00:47:47.6788739Z  2024-12-18T00:47:47.6789235Z  2024-12-18T00:47:47.6789658Z  2024-12-18T00:47:47.6790380Z  2024-12-18T00:47:47.6790809Z  2024-12-18T00:47:47.6791225Z  2024-12-18T00:47:47.6791646Z  2024-12-18T00:47:47.6792069Z  2024-12-18T00:47:47.6793138Z [12,429 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:47.6794176Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:47.6794982Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:47:47.6795833Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:47:47.6796942Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2024-12-18T00:47:47.6797963Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:47:47.6798941Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:47:47.6799974Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:47:47.6800905Z @llvm-project//mlir:mlir-tblgen; 13s local ... 2024-12-18T00:47:47.9021868Z 2024-12-18T00:47:47.9022736Z  2024-12-18T00:47:47.9023210Z  2024-12-18T00:47:47.9023571Z  2024-12-18T00:47:47.9023953Z  2024-12-18T00:47:47.9024347Z  2024-12-18T00:47:47.9024769Z  2024-12-18T00:47:47.9025154Z  2024-12-18T00:47:47.9025522Z  2024-12-18T00:47:47.9026567Z [12,434 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:47.9027508Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:47.9028259Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:47:47.9029040Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2024-12-18T00:47:47.9029893Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:47:47.9030992Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:47:47.9031771Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:47:47.9032618Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local 2024-12-18T00:47:47.9033424Z @llvm-project//mlir:mlir-tblgen; 13s local ... 2024-12-18T00:47:48.1341970Z 2024-12-18T00:47:48.1342889Z  2024-12-18T00:47:48.1343336Z  2024-12-18T00:47:48.1343707Z  2024-12-18T00:47:48.1344064Z  2024-12-18T00:47:48.1344622Z  2024-12-18T00:47:48.1344986Z  2024-12-18T00:47:48.1345364Z  2024-12-18T00:47:48.1345722Z  2024-12-18T00:47:48.1346580Z [12,440 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:47:48.1347531Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2024-12-18T00:47:48.1348198Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:47:48.1348854Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:47:48.1349614Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:47:48.1350450Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2024-12-18T00:47:48.1351263Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:47:48.1352082Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:47:48.1352824Z @llvm-project//mlir:mlir-tblgen; 13s local ... 2024-12-18T00:47:48.3386681Z 2024-12-18T00:47:48.3387571Z  2024-12-18T00:47:48.3388093Z  2024-12-18T00:47:48.3388509Z  2024-12-18T00:47:48.3388933Z  2024-12-18T00:47:48.3389357Z  2024-12-18T00:47:48.3389789Z  2024-12-18T00:47:48.3390263Z  2024-12-18T00:47:48.3390676Z  2024-12-18T00:47:48.3391684Z [12,443 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:48.3392734Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:48.3393550Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:47:48.3394425Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:47:48.3395698Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:47:48.3396739Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:47:48.3397972Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:47:48.3399011Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:47:48.3399959Z @llvm-project//mlir:mlir-tblgen; 13s local ... 2024-12-18T00:47:48.5453839Z 2024-12-18T00:47:48.5454746Z  2024-12-18T00:47:48.5455212Z  2024-12-18T00:47:48.5456152Z  2024-12-18T00:47:48.5456692Z  2024-12-18T00:47:48.5457092Z  2024-12-18T00:47:48.5457484Z  2024-12-18T00:47:48.5457850Z  2024-12-18T00:47:48.5458227Z  2024-12-18T00:47:48.5459149Z [12,447 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:48.5460128Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:48.5460903Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:47:48.5461681Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:47:48.5462585Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:47:48.5463595Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:47:48.5464550Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:47:48.5465520Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:47:48.5466423Z @llvm-project//mlir:mlir-tblgen; 13s local ... 2024-12-18T00:47:48.7659530Z 2024-12-18T00:47:48.7660439Z  2024-12-18T00:47:48.7660919Z  2024-12-18T00:47:48.7661326Z  2024-12-18T00:47:48.7661708Z  2024-12-18T00:47:48.7662108Z  2024-12-18T00:47:48.7662463Z  2024-12-18T00:47:48.7662857Z  2024-12-18T00:47:48.7663222Z  2024-12-18T00:47:48.7664117Z [12,454 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:48.7665107Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:48.7665818Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:47:48.7666631Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:47:48.7667501Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2024-12-18T00:47:48.7668472Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:47:48.7669397Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:47:48.7670353Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:47:48.7671196Z @llvm-project//mlir:mlir-tblgen; 14s local ... 2024-12-18T00:47:48.9823033Z 2024-12-18T00:47:48.9824010Z  2024-12-18T00:47:48.9824553Z  2024-12-18T00:47:48.9824883Z  2024-12-18T00:47:48.9825306Z  2024-12-18T00:47:48.9825736Z  2024-12-18T00:47:48.9826229Z  2024-12-18T00:47:48.9826680Z  2024-12-18T00:47:48.9827144Z  2024-12-18T00:47:48.9828015Z [12,460 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:48.9829016Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:48.9829725Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2024-12-18T00:47:48.9830668Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:47:48.9831657Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:47:48.9832627Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:47:48.9833531Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2024-12-18T00:47:48.9834304Z @llvm-project//mlir:mlir-tblgen; 14s local 2024-12-18T00:47:48.9834962Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 12s local ... 2024-12-18T00:47:49.1901488Z 2024-12-18T00:47:49.1902365Z  2024-12-18T00:47:49.1903070Z  2024-12-18T00:47:49.1903441Z  2024-12-18T00:47:49.1903831Z  2024-12-18T00:47:49.1904231Z  2024-12-18T00:47:49.1904605Z  2024-12-18T00:47:49.1904968Z  2024-12-18T00:47:49.1905532Z  2024-12-18T00:47:49.1906462Z [12,476 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:49.1907423Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2024-12-18T00:47:49.1908177Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:47:49.1909335Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:47:49.1910329Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2024-12-18T00:47:49.1911236Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:47:49.1912141Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:47:49.1912922Z @llvm-project//mlir:mlir-tblgen; 14s local 2024-12-18T00:47:49.1913730Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:47:49.3915807Z 2024-12-18T00:47:49.3916704Z  2024-12-18T00:47:49.3917200Z  2024-12-18T00:47:49.3917614Z  2024-12-18T00:47:49.3918033Z  2024-12-18T00:47:49.3918434Z  2024-12-18T00:47:49.3918801Z  2024-12-18T00:47:49.3919211Z  2024-12-18T00:47:49.3919621Z  2024-12-18T00:47:49.3920538Z [12,495 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:49.3921527Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:49.3922316Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:47:49.3923219Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:47:49.3924240Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:47:49.3925120Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:47:49.3926088Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:47:49.3926911Z @llvm-project//mlir:mlir-tblgen; 14s local 2024-12-18T00:47:49.3927786Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:47:49.5927761Z 2024-12-18T00:47:49.5928609Z  2024-12-18T00:47:49.5929096Z  2024-12-18T00:47:49.5929513Z  2024-12-18T00:47:49.5929889Z  2024-12-18T00:47:49.5930287Z  2024-12-18T00:47:49.5930647Z  2024-12-18T00:47:49.5931040Z  2024-12-18T00:47:49.5931436Z  2024-12-18T00:47:49.5932432Z [12,516 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:49.5933359Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:49.5934121Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:47:49.5934972Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2024-12-18T00:47:49.5935926Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:47:49.5936991Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:47:49.5937934Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:47:49.5938809Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:47:49.5939590Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:47:49.7936013Z 2024-12-18T00:47:49.7937052Z  2024-12-18T00:47:49.7937556Z  2024-12-18T00:47:49.7937939Z  2024-12-18T00:47:49.7938327Z  2024-12-18T00:47:49.7938763Z  2024-12-18T00:47:49.7939193Z  2024-12-18T00:47:49.7939578Z  2024-12-18T00:47:49.7939978Z  2024-12-18T00:47:49.7940903Z [12,540 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:49.7941876Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:49.7942635Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:47:49.7943767Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:47:49.7945046Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:47:49.7946118Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:47:49.7947085Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:47:49.7947907Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:47:49.7948685Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:47:49.9990259Z 2024-12-18T00:47:49.9991118Z  2024-12-18T00:47:49.9991605Z  2024-12-18T00:47:49.9992002Z  2024-12-18T00:47:49.9992395Z  2024-12-18T00:47:49.9992721Z  2024-12-18T00:47:49.9993118Z  2024-12-18T00:47:49.9993500Z  2024-12-18T00:47:49.9993891Z  2024-12-18T00:47:49.9994807Z [12,564 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:47:49.9995765Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:49.9996442Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2024-12-18T00:47:49.9997273Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:47:49.9998175Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:47:49.9999067Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:47:49.9999938Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2024-12-18T00:47:50.0000800Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:47:50.0001579Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 13s local ... 2024-12-18T00:47:50.2032623Z 2024-12-18T00:47:50.2033777Z  2024-12-18T00:47:50.2034273Z  2024-12-18T00:47:50.2034659Z  2024-12-18T00:47:50.2035068Z  2024-12-18T00:47:50.2035482Z  2024-12-18T00:47:50.2036137Z  2024-12-18T00:47:50.2036568Z  2024-12-18T00:47:50.2037007Z  2024-12-18T00:47:50.2038108Z [12,595 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:50.2039329Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2024-12-18T00:47:50.2040443Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:47:50.2041453Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:47:50.2042546Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2024-12-18T00:47:50.2043554Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:47:50.2050598Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2024-12-18T00:47:50.2051397Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:47:50.2052240Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:47:50.5028810Z 2024-12-18T00:47:50.5029809Z  2024-12-18T00:47:50.5030341Z  2024-12-18T00:47:50.5030762Z  2024-12-18T00:47:50.5031182Z  2024-12-18T00:47:50.5031599Z  2024-12-18T00:47:50.5031996Z  2024-12-18T00:47:50.5032356Z  2024-12-18T00:47:50.5032730Z  2024-12-18T00:47:50.5033699Z [12,622 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:50.5034686Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:50.5035461Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:47:50.5036362Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:47:50.5037354Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:47:50.5038297Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:47:50.5039268Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2024-12-18T00:47:50.5040144Z @llvm-project//mlir:mlir-tblgen; 15s local 2024-12-18T00:47:50.5040949Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:47:50.7155327Z 2024-12-18T00:47:50.7156247Z  2024-12-18T00:47:50.7156733Z  2024-12-18T00:47:50.7157128Z  2024-12-18T00:47:50.7157499Z  2024-12-18T00:47:50.7158158Z  2024-12-18T00:47:50.7158595Z  2024-12-18T00:47:50.7158991Z  2024-12-18T00:47:50.7159399Z  2024-12-18T00:47:50.7160512Z [12,625 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:50.7161546Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:50.7162632Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:47:50.7163727Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2024-12-18T00:47:50.7164747Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:47:50.7165694Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:47:50.7166678Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2024-12-18T00:47:50.7167583Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:47:50.7168435Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:47:50.9355372Z 2024-12-18T00:47:50.9356762Z  2024-12-18T00:47:50.9357219Z  2024-12-18T00:47:50.9357569Z  2024-12-18T00:47:50.9357971Z  2024-12-18T00:47:50.9358356Z  2024-12-18T00:47:50.9358769Z  2024-12-18T00:47:50.9359129Z  2024-12-18T00:47:50.9359549Z  2024-12-18T00:47:50.9360564Z [12,629 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:50.9361572Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:50.9362308Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2024-12-18T00:47:50.9363224Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:47:50.9364186Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:47:50.9365151Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2024-12-18T00:47:50.9366063Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2024-12-18T00:47:50.9366957Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:47:50.9367779Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 14s local ... 2024-12-18T00:47:51.1670734Z 2024-12-18T00:47:51.1671666Z  2024-12-18T00:47:51.1672210Z  2024-12-18T00:47:51.1672585Z  2024-12-18T00:47:51.1672950Z  2024-12-18T00:47:51.1673316Z  2024-12-18T00:47:51.1673740Z  2024-12-18T00:47:51.1674124Z  2024-12-18T00:47:51.1674493Z  2024-12-18T00:47:51.1675388Z [12,631 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:51.1676597Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2024-12-18T00:47:51.1677351Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:47:51.1678265Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:47:51.1679254Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2024-12-18T00:47:51.1680221Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:47:51.1681072Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:47:51.1681874Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local 2024-12-18T00:47:51.1682836Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 10s local ... 2024-12-18T00:47:51.3675762Z 2024-12-18T00:47:51.3676808Z  2024-12-18T00:47:51.3677309Z  2024-12-18T00:47:51.3677695Z  2024-12-18T00:47:51.3678102Z  2024-12-18T00:47:51.3678497Z  2024-12-18T00:47:51.3678907Z  2024-12-18T00:47:51.3679316Z  2024-12-18T00:47:51.3679713Z  2024-12-18T00:47:51.3680706Z [12,635 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:51.3681958Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:47:51.3682754Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:47:51.3683783Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:47:51.3684780Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2024-12-18T00:47:51.3685803Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:47:51.3686673Z @llvm-project//mlir:mlir-tblgen; 16s local 2024-12-18T00:47:51.3687609Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local 2024-12-18T00:47:51.3688727Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 10s local ... 2024-12-18T00:47:51.6399915Z 2024-12-18T00:47:51.6400842Z  2024-12-18T00:47:51.6401391Z  2024-12-18T00:47:51.6401797Z  2024-12-18T00:47:51.6402197Z  2024-12-18T00:47:51.6402558Z  2024-12-18T00:47:51.6402952Z  2024-12-18T00:47:51.6403346Z  2024-12-18T00:47:51.6403724Z  2024-12-18T00:47:51.6404687Z [12,639 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:51.6405620Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:47:51.6406399Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:47:51.6407349Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2024-12-18T00:47:51.6408432Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2024-12-18T00:47:51.6409425Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:47:51.6410309Z @llvm-project//mlir:mlir-tblgen; 17s local 2024-12-18T00:47:51.6411082Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local 2024-12-18T00:47:51.6412041Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 11s local ... 2024-12-18T00:47:51.8841259Z 2024-12-18T00:47:51.8842144Z  2024-12-18T00:47:51.8842624Z  2024-12-18T00:47:51.8843023Z  2024-12-18T00:47:51.8843447Z  2024-12-18T00:47:51.8843866Z  2024-12-18T00:47:51.8844562Z  2024-12-18T00:47:51.8844962Z  2024-12-18T00:47:51.8845339Z  2024-12-18T00:47:51.8846295Z [12,642 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:51.8847291Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:47:51.8848054Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2024-12-18T00:47:51.8848932Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:47:51.8849951Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2024-12-18T00:47:51.8850936Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2024-12-18T00:47:51.8851777Z @llvm-project//mlir:mlir-tblgen; 17s local 2024-12-18T00:47:51.8852577Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 15s local 2024-12-18T00:47:51.8853533Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 11s local ... 2024-12-18T00:47:52.1687505Z 2024-12-18T00:47:52.1688362Z  2024-12-18T00:47:52.1688852Z  2024-12-18T00:47:52.1689263Z  2024-12-18T00:47:52.1689663Z  2024-12-18T00:47:52.1690039Z  2024-12-18T00:47:52.1690502Z  2024-12-18T00:47:52.1690886Z  2024-12-18T00:47:52.1691275Z  2024-12-18T00:47:52.1692227Z [12,647 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:52.1693162Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2024-12-18T00:47:52.1693947Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:47:52.1694811Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:47:52.1695764Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2024-12-18T00:47:52.1696812Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 20s local 2024-12-18T00:47:52.1697569Z @llvm-project//mlir:mlir-tblgen; 17s local 2024-12-18T00:47:52.1698586Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local 2024-12-18T00:47:52.1699510Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 11s local ... 2024-12-18T00:47:52.5376056Z 2024-12-18T00:47:52.5377324Z  2024-12-18T00:47:52.5377843Z  2024-12-18T00:47:52.5378244Z  2024-12-18T00:47:52.5378625Z  2024-12-18T00:47:52.5379013Z  2024-12-18T00:47:52.5379398Z  2024-12-18T00:47:52.5379770Z  2024-12-18T00:47:52.5380138Z  2024-12-18T00:47:52.5381233Z [12,650 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:52.5382285Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:47:52.5383032Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:47:52.5383900Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2024-12-18T00:47:52.5384833Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2024-12-18T00:47:52.5385797Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 20s local 2024-12-18T00:47:52.5386615Z @llvm-project//mlir:mlir-tblgen; 17s local 2024-12-18T00:47:52.5387605Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local 2024-12-18T00:47:52.5388537Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 12s local ... 2024-12-18T00:47:52.7693234Z 2024-12-18T00:47:52.7694044Z  2024-12-18T00:47:52.7694515Z  2024-12-18T00:47:52.7694915Z  2024-12-18T00:47:52.7695262Z  2024-12-18T00:47:52.7695611Z  2024-12-18T00:47:52.7696021Z  2024-12-18T00:47:52.7696385Z  2024-12-18T00:47:52.7696852Z  2024-12-18T00:47:52.7697676Z [12,652 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:52.7698596Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:47:52.7699299Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:47:52.7700080Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:52.7700982Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2024-12-18T00:47:52.7701873Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 20s local 2024-12-18T00:47:52.7702677Z @llvm-project//mlir:mlir-tblgen; 18s local 2024-12-18T00:47:52.7703420Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local 2024-12-18T00:47:52.7704314Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 12s local ... 2024-12-18T00:47:52.9697746Z 2024-12-18T00:47:52.9698553Z  2024-12-18T00:47:52.9699079Z  2024-12-18T00:47:52.9699479Z  2024-12-18T00:47:52.9699880Z  2024-12-18T00:47:52.9700288Z  2024-12-18T00:47:52.9700683Z  2024-12-18T00:47:52.9701075Z  2024-12-18T00:47:52.9701447Z  2024-12-18T00:47:52.9702396Z [12,657 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:52.9703381Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2024-12-18T00:47:52.9704144Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2024-12-18T00:47:52.9705022Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:52.9705983Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2024-12-18T00:47:52.9706800Z @llvm-project//mlir:mlir-tblgen; 18s local 2024-12-18T00:47:52.9707576Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local 2024-12-18T00:47:52.9708502Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 12s local 2024-12-18T00:47:52.9709479Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 9s local ... 2024-12-18T00:47:53.3281723Z 2024-12-18T00:47:53.3282576Z  2024-12-18T00:47:53.3283033Z  2024-12-18T00:47:53.3283432Z  2024-12-18T00:47:53.3283839Z  2024-12-18T00:47:53.3284209Z  2024-12-18T00:47:53.3284598Z  2024-12-18T00:47:53.3284998Z  2024-12-18T00:47:53.3285387Z  2024-12-18T00:47:53.3286543Z [12,666 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:53.3287480Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:53.3288335Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:53.3289162Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:53.3290070Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:47:53.3290845Z @llvm-project//mlir:mlir-tblgen; 18s local 2024-12-18T00:47:53.3291715Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2024-12-18T00:47:53.3292684Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 12s local 2024-12-18T00:47:53.3293609Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 9s local ... 2024-12-18T00:47:53.5468879Z 2024-12-18T00:47:53.5469709Z  2024-12-18T00:47:53.5470188Z  2024-12-18T00:47:53.5470583Z  2024-12-18T00:47:53.5470957Z  2024-12-18T00:47:53.5471380Z  2024-12-18T00:47:53.5471781Z  2024-12-18T00:47:53.5472166Z  2024-12-18T00:47:53.5472554Z  2024-12-18T00:47:53.5473535Z [12,669 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:53.5474495Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:53.5475216Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:53.5476116Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:53.5477008Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:47:53.5477826Z @llvm-project//mlir:mlir-tblgen; 18s local 2024-12-18T00:47:53.5478532Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2024-12-18T00:47:53.5479467Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 13s local 2024-12-18T00:47:53.5480429Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 10s local ... 2024-12-18T00:47:53.7548804Z 2024-12-18T00:47:53.7549655Z  2024-12-18T00:47:53.7550135Z  2024-12-18T00:47:53.7550536Z  2024-12-18T00:47:53.7550931Z  2024-12-18T00:47:53.7551299Z  2024-12-18T00:47:53.7551702Z  2024-12-18T00:47:53.7552119Z  2024-12-18T00:47:53.7552511Z  2024-12-18T00:47:53.7553422Z [12,673 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:53.7554333Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:53.7555093Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:53.7555948Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2024-12-18T00:47:53.7556884Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:47:53.7557722Z @llvm-project//mlir:mlir-tblgen; 19s local 2024-12-18T00:47:53.7558470Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2024-12-18T00:47:53.7559336Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 13s local 2024-12-18T00:47:53.7560286Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 10s local ... 2024-12-18T00:47:53.9707932Z 2024-12-18T00:47:53.9708753Z  2024-12-18T00:47:53.9709278Z  2024-12-18T00:47:53.9709696Z  2024-12-18T00:47:53.9710062Z  2024-12-18T00:47:53.9710420Z  2024-12-18T00:47:53.9710772Z  2024-12-18T00:47:53.9711141Z  2024-12-18T00:47:53.9711511Z  2024-12-18T00:47:53.9712457Z [12,676 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:53.9713407Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:53.9714121Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2024-12-18T00:47:53.9714952Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:47:53.9715869Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:47:53.9716630Z @llvm-project//mlir:mlir-tblgen; 19s local 2024-12-18T00:47:53.9717667Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2024-12-18T00:47:53.9718533Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 13s local 2024-12-18T00:47:53.9719544Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 10s local ... 2024-12-18T00:47:54.2510407Z 2024-12-18T00:47:54.2511312Z  2024-12-18T00:47:54.2511801Z  2024-12-18T00:47:54.2512191Z  2024-12-18T00:47:54.2512579Z  2024-12-18T00:47:54.2512957Z  2024-12-18T00:47:54.2513351Z  2024-12-18T00:47:54.2513749Z  2024-12-18T00:47:54.2514550Z  2024-12-18T00:47:54.2515509Z [12,681 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:54.2516480Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2024-12-18T00:47:54.2517243Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:47:54.2518146Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:47:54.2519147Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2024-12-18T00:47:54.2519996Z @llvm-project//mlir:mlir-tblgen; 19s local 2024-12-18T00:47:54.2520784Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2024-12-18T00:47:54.2521734Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 13s local 2024-12-18T00:47:54.2522713Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 10s local ... 2024-12-18T00:47:54.4572586Z 2024-12-18T00:47:54.4573409Z  2024-12-18T00:47:54.4573890Z  2024-12-18T00:47:54.4574353Z  2024-12-18T00:47:54.4574756Z  2024-12-18T00:47:54.4575156Z  2024-12-18T00:47:54.4575567Z  2024-12-18T00:47:54.4575968Z  2024-12-18T00:47:54.4576383Z  2024-12-18T00:47:54.4577458Z [12,685 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:54.4578443Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:54.4579208Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:47:54.4580112Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:47:54.4581100Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 32s local 2024-12-18T00:47:54.4581930Z @llvm-project//mlir:mlir-tblgen; 19s local 2024-12-18T00:47:54.4582750Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2024-12-18T00:47:54.4583671Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 14s local 2024-12-18T00:47:54.4584698Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 10s local ... 2024-12-18T00:47:54.6710385Z 2024-12-18T00:47:54.6711240Z  2024-12-18T00:47:54.6711727Z  2024-12-18T00:47:54.6712147Z  2024-12-18T00:47:54.6712642Z  2024-12-18T00:47:54.6713170Z  2024-12-18T00:47:54.6713803Z  2024-12-18T00:47:54.6714210Z  2024-12-18T00:47:54.6714582Z  2024-12-18T00:47:54.6715464Z [12,688 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:54.6716464Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:54.6717251Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:47:54.6718167Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2024-12-18T00:47:54.6719136Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 32s local 2024-12-18T00:47:54.6719969Z @llvm-project//mlir:mlir-tblgen; 20s local 2024-12-18T00:47:54.6720749Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2024-12-18T00:47:54.6721682Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 14s local 2024-12-18T00:47:54.6722644Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 11s local ... 2024-12-18T00:47:54.8989057Z 2024-12-18T00:47:54.8989952Z  2024-12-18T00:47:54.8990461Z  2024-12-18T00:47:54.8990889Z  2024-12-18T00:47:54.8991286Z  2024-12-18T00:47:54.8991706Z  2024-12-18T00:47:54.8992394Z  2024-12-18T00:47:54.8992802Z  2024-12-18T00:47:54.8993202Z  2024-12-18T00:47:54.8994295Z [12,690 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:54.8995309Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:54.8996088Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2024-12-18T00:47:54.8997006Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:54.8997894Z @llvm-project//mlir:mlir-tblgen; 20s local 2024-12-18T00:47:54.8998954Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2024-12-18T00:47:54.8999930Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 14s local 2024-12-18T00:47:54.9001010Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 11s local 2024-12-18T00:47:54.9001826Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 10s local ... 2024-12-18T00:47:55.1563431Z 2024-12-18T00:47:55.1564306Z  2024-12-18T00:47:55.1564802Z  2024-12-18T00:47:55.1565208Z  2024-12-18T00:47:55.1565593Z  2024-12-18T00:47:55.1565963Z  2024-12-18T00:47:55.1566361Z  2024-12-18T00:47:55.1566767Z  2024-12-18T00:47:55.1567192Z  2024-12-18T00:47:55.1568090Z [12,694 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:55.1569060Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2024-12-18T00:47:55.1569810Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:47:55.1570714Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:55.1571586Z @llvm-project//mlir:mlir-tblgen; 20s local 2024-12-18T00:47:55.1572378Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2024-12-18T00:47:55.1573317Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 14s local 2024-12-18T00:47:55.1574202Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 11s local 2024-12-18T00:47:55.1575086Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 11s local ... 2024-12-18T00:47:55.3718613Z 2024-12-18T00:47:55.3719450Z  2024-12-18T00:47:55.3719953Z  2024-12-18T00:47:55.3720355Z  2024-12-18T00:47:55.3720768Z  2024-12-18T00:47:55.3721168Z  2024-12-18T00:47:55.3721553Z  2024-12-18T00:47:55.3721953Z  2024-12-18T00:47:55.3722340Z  2024-12-18T00:47:55.3723284Z [12,697 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:55.3724272Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:55.3725024Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:47:55.3725901Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:55.3726837Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2024-12-18T00:47:55.3727745Z Compiling src/cpu/x64/jit_uni_dw_conv_kernel_f32.cpp; 14s local 2024-12-18T00:47:55.3728674Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 11s local 2024-12-18T00:47:55.3729507Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 11s local 2024-12-18T00:47:55.3730291Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 9s local ... 2024-12-18T00:47:55.6028801Z 2024-12-18T00:47:55.6029708Z  2024-12-18T00:47:55.6030210Z  2024-12-18T00:47:55.6030620Z  2024-12-18T00:47:55.6031002Z  2024-12-18T00:47:55.6031378Z  2024-12-18T00:47:55.6031758Z  2024-12-18T00:47:55.6032121Z  2024-12-18T00:47:55.6032688Z  2024-12-18T00:47:55.6033650Z [12,704 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:55.6034631Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:55.6035393Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:47:55.6036213Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2024-12-18T00:47:55.6037151Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2024-12-18T00:47:55.6038332Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 12s local 2024-12-18T00:47:55.6039176Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 11s local 2024-12-18T00:47:55.6040171Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 9s local 2024-12-18T00:47:55.6041096Z Compiling src/cpu/x64/jit_uni_group_normalization.cpp; 8s local ... 2024-12-18T00:47:55.9725076Z 2024-12-18T00:47:55.9725924Z  2024-12-18T00:47:55.9726314Z  2024-12-18T00:47:55.9726673Z  2024-12-18T00:47:55.9727014Z  2024-12-18T00:47:55.9727750Z  2024-12-18T00:47:55.9728095Z  2024-12-18T00:47:55.9728575Z  2024-12-18T00:47:55.9737807Z  2024-12-18T00:47:55.9738697Z [12,709 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:55.9739546Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:55.9740210Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2024-12-18T00:47:55.9741001Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:47:55.9741846Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2024-12-18T00:47:55.9742674Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 12s local 2024-12-18T00:47:55.9743420Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 12s local 2024-12-18T00:47:55.9744462Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 9s local 2024-12-18T00:47:55.9745336Z Compiling src/cpu/x64/jit_uni_group_normalization.cpp; 8s local ... 2024-12-18T00:47:56.2256188Z 2024-12-18T00:47:56.2257157Z  2024-12-18T00:47:56.2257639Z  2024-12-18T00:47:56.2258029Z  2024-12-18T00:47:56.2258399Z  2024-12-18T00:47:56.2258768Z  2024-12-18T00:47:56.2259142Z  2024-12-18T00:47:56.2259514Z  2024-12-18T00:47:56.2259891Z  2024-12-18T00:47:56.2260784Z [12,716 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:56.2261738Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2024-12-18T00:47:56.2262450Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:56.2263296Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:47:56.2264203Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local 2024-12-18T00:47:56.2265015Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 12s local 2024-12-18T00:47:56.2265733Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 12s local 2024-12-18T00:47:56.2266527Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 9s local 2024-12-18T00:47:56.2267454Z Compiling src/cpu/x64/jit_uni_group_normalization.cpp; 9s local ... 2024-12-18T00:47:56.4861162Z 2024-12-18T00:47:56.4861999Z  2024-12-18T00:47:56.4862419Z  2024-12-18T00:47:56.4862782Z  2024-12-18T00:47:56.4863140Z  2024-12-18T00:47:56.4863514Z  2024-12-18T00:47:56.4863864Z  2024-12-18T00:47:56.4864261Z  2024-12-18T00:47:56.4864604Z  2024-12-18T00:47:56.4865481Z [12,724 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:56.4866357Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:47:56.4867036Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:56.4867834Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:47:56.4868690Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local 2024-12-18T00:47:56.4869510Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 12s local 2024-12-18T00:47:56.4870290Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 12s local 2024-12-18T00:47:56.4871041Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local 2024-12-18T00:47:56.4871914Z Compiling src/cpu/x64/jit_uni_group_normalization.cpp; 9s local ... 2024-12-18T00:47:56.6936227Z 2024-12-18T00:47:56.6937146Z  2024-12-18T00:47:56.6937558Z  2024-12-18T00:47:56.6938241Z  2024-12-18T00:47:56.6938592Z  2024-12-18T00:47:56.6938939Z  2024-12-18T00:47:56.6939304Z  2024-12-18T00:47:56.6939645Z  2024-12-18T00:47:56.6939991Z  2024-12-18T00:47:56.6940917Z [12,727 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:56.6941748Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:47:56.6942409Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:56.6943263Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2024-12-18T00:47:56.6944383Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 13s local 2024-12-18T00:47:56.6945118Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 12s local 2024-12-18T00:47:56.6945797Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local 2024-12-18T00:47:56.6946583Z Compiling src/cpu/x64/jit_uni_group_normalization.cpp; 9s local 2024-12-18T00:47:56.6947392Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 9s local ... 2024-12-18T00:47:56.9697442Z 2024-12-18T00:47:56.9698255Z  2024-12-18T00:47:56.9698743Z  2024-12-18T00:47:56.9699112Z  2024-12-18T00:47:56.9699498Z  2024-12-18T00:47:56.9699903Z  2024-12-18T00:47:56.9700287Z  2024-12-18T00:47:56.9700666Z  2024-12-18T00:47:56.9701027Z  2024-12-18T00:47:56.9701943Z [12,730 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:56.9702897Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:47:56.9703630Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2024-12-18T00:47:56.9704479Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:56.9705365Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 13s local 2024-12-18T00:47:56.9706174Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 13s local 2024-12-18T00:47:56.9706961Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local 2024-12-18T00:47:56.9707856Z Compiling src/cpu/x64/jit_uni_group_normalization.cpp; 9s local 2024-12-18T00:47:56.9708770Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 9s local ... 2024-12-18T00:47:57.1735188Z 2024-12-18T00:47:57.1736097Z  2024-12-18T00:47:57.1736731Z  2024-12-18T00:47:57.1737140Z  2024-12-18T00:47:57.1737527Z  2024-12-18T00:47:57.1737920Z  2024-12-18T00:47:57.1738310Z  2024-12-18T00:47:57.1738708Z  2024-12-18T00:47:57.1739281Z  2024-12-18T00:47:57.1740238Z [12,731 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:47:57.1741195Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2024-12-18T00:47:57.1741938Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:57.1742797Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:57.1743669Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 13s local 2024-12-18T00:47:57.1744720Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 13s local 2024-12-18T00:47:57.1745496Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local 2024-12-18T00:47:57.1746414Z Compiling src/cpu/x64/jit_uni_group_normalization.cpp; 10s local 2024-12-18T00:47:57.1747337Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 10s local ... 2024-12-18T00:47:57.3993113Z 2024-12-18T00:47:57.3993876Z  2024-12-18T00:47:57.3994360Z  2024-12-18T00:47:57.3994759Z  2024-12-18T00:47:57.3995138Z  2024-12-18T00:47:57.3995553Z  2024-12-18T00:47:57.3995933Z  2024-12-18T00:47:57.3996314Z  2024-12-18T00:47:57.3996687Z  2024-12-18T00:47:57.3997601Z [12,736 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:57.3998590Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:57.3999345Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:57.4000535Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:57.4001466Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 13s local 2024-12-18T00:47:57.4002485Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 13s local 2024-12-18T00:47:57.4003317Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2024-12-18T00:47:57.4004164Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 10s local 2024-12-18T00:47:57.4005071Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 6s local ... 2024-12-18T00:47:57.6440751Z 2024-12-18T00:47:57.6442036Z  2024-12-18T00:47:57.6442543Z  2024-12-18T00:47:57.6442941Z  2024-12-18T00:47:57.6443321Z  2024-12-18T00:47:57.6443682Z  2024-12-18T00:47:57.6444078Z  2024-12-18T00:47:57.6444682Z  2024-12-18T00:47:57.6445056Z  2024-12-18T00:47:57.6445981Z [12,742 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:57.6446951Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:57.6447706Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:57.6448597Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2024-12-18T00:47:57.6449536Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 14s local 2024-12-18T00:47:57.6450350Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 13s local 2024-12-18T00:47:57.6451090Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2024-12-18T00:47:57.6451891Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 10s local 2024-12-18T00:47:57.6452820Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 6s local ... 2024-12-18T00:47:57.8465190Z 2024-12-18T00:47:57.8465968Z  2024-12-18T00:47:57.8466457Z  2024-12-18T00:47:57.8466878Z  2024-12-18T00:47:57.8467256Z  2024-12-18T00:47:57.8467679Z  2024-12-18T00:47:57.8468079Z  2024-12-18T00:47:57.8468471Z  2024-12-18T00:47:57.8468873Z  2024-12-18T00:47:57.8469838Z [12,749 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:57.8470873Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:57.8471635Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:57.8472548Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:57.8473543Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 14s local 2024-12-18T00:47:57.8474432Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 13s local 2024-12-18T00:47:57.8475272Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2024-12-18T00:47:57.8476151Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 10s local 2024-12-18T00:47:57.8477101Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 7s local ... 2024-12-18T00:47:58.0506716Z 2024-12-18T00:47:58.0507643Z  2024-12-18T00:47:58.0508141Z  2024-12-18T00:47:58.0508514Z  2024-12-18T00:47:58.0509001Z  2024-12-18T00:47:58.0509389Z  2024-12-18T00:47:58.0509780Z  2024-12-18T00:47:58.0510140Z  2024-12-18T00:47:58.0510571Z  2024-12-18T00:47:58.0511533Z [12,758 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:58.0512523Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:58.0513265Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2024-12-18T00:47:58.0514150Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:58.0515144Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 14s local 2024-12-18T00:47:58.0516001Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 14s local 2024-12-18T00:47:58.0516758Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2024-12-18T00:47:58.0517635Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 11s local 2024-12-18T00:47:58.0518566Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 7s local ... 2024-12-18T00:47:58.3058698Z 2024-12-18T00:47:58.3059589Z  2024-12-18T00:47:58.3060044Z  2024-12-18T00:47:58.3060505Z  2024-12-18T00:47:58.3061021Z  2024-12-18T00:47:58.3061805Z  2024-12-18T00:47:58.3062277Z  2024-12-18T00:47:58.3062708Z  2024-12-18T00:47:58.3063072Z  2024-12-18T00:47:58.3064023Z [12,764 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:58.3065080Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2024-12-18T00:47:58.3066102Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:47:58.3066975Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:58.3067896Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 14s local 2024-12-18T00:47:58.3068712Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 14s local 2024-12-18T00:47:58.3069491Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2024-12-18T00:47:58.3070330Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 11s local 2024-12-18T00:47:58.3071259Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 7s local ... 2024-12-18T00:47:58.5268949Z 2024-12-18T00:47:58.5269833Z  2024-12-18T00:47:58.5270310Z  2024-12-18T00:47:58.5270689Z  2024-12-18T00:47:58.5271091Z  2024-12-18T00:47:58.5271483Z  2024-12-18T00:47:58.5271866Z  2024-12-18T00:47:58.5272224Z  2024-12-18T00:47:58.5272608Z  2024-12-18T00:47:58.5273561Z [12,769 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:58.5274522Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:58.5275289Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:47:58.5276146Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:58.5277009Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 15s local 2024-12-18T00:47:58.5277784Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 14s local 2024-12-18T00:47:58.5278539Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 11s local 2024-12-18T00:47:58.5279408Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 7s local 2024-12-18T00:47:58.5280249Z Compiling llvm/lib/TextAPI/TextStub.cpp; 7s local ... 2024-12-18T00:47:58.7276495Z 2024-12-18T00:47:58.7277356Z  2024-12-18T00:47:58.7277834Z  2024-12-18T00:47:58.7278267Z  2024-12-18T00:47:58.7278673Z  2024-12-18T00:47:58.7279052Z  2024-12-18T00:47:58.7279513Z  2024-12-18T00:47:58.7279935Z  2024-12-18T00:47:58.7280340Z  2024-12-18T00:47:58.7281308Z [12,779 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:58.7282203Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:58.7282921Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:47:58.7283833Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2024-12-18T00:47:58.7284860Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 15s local 2024-12-18T00:47:58.7285793Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 14s local 2024-12-18T00:47:58.7286683Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 11s local 2024-12-18T00:47:58.7287691Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 8s local 2024-12-18T00:47:58.7288601Z Compiling llvm/lib/TextAPI/TextStub.cpp; 7s local ... 2024-12-18T00:47:58.9300929Z 2024-12-18T00:47:58.9301780Z  2024-12-18T00:47:58.9302321Z  2024-12-18T00:47:58.9302735Z  2024-12-18T00:47:58.9303155Z  2024-12-18T00:47:58.9303570Z  2024-12-18T00:47:58.9303980Z  2024-12-18T00:47:58.9304385Z  2024-12-18T00:47:58.9304825Z  2024-12-18T00:47:58.9305823Z [12,792 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:58.9306874Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:58.9307971Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2024-12-18T00:47:58.9308929Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:47:58.9310227Z Compiling src/cpu/x64/jit_uni_dw_convolution.cpp; 15s local 2024-12-18T00:47:58.9311115Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 15s local 2024-12-18T00:47:58.9311995Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 11s local 2024-12-18T00:47:58.9312988Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 8s local 2024-12-18T00:47:58.9314191Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 7s local ... 2024-12-18T00:47:59.1749202Z 2024-12-18T00:47:59.1750111Z  2024-12-18T00:47:59.1750602Z  2024-12-18T00:47:59.1750995Z  2024-12-18T00:47:59.1751378Z  2024-12-18T00:47:59.1751756Z  2024-12-18T00:47:59.1752145Z  2024-12-18T00:47:59.1752544Z  2024-12-18T00:47:59.1752942Z  2024-12-18T00:47:59.1753919Z [12,796 / 20,602] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2024-12-18T00:47:59.1754907Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2024-12-18T00:47:59.1755696Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:59.1756562Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:47:59.1757485Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 15s local 2024-12-18T00:47:59.1758356Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 12s local 2024-12-18T00:47:59.1759304Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 8s local 2024-12-18T00:47:59.1760082Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:47:59.1760779Z @onednn//:mkl_dnn; 7s local ... 2024-12-18T00:47:59.3847688Z 2024-12-18T00:47:59.3848576Z  2024-12-18T00:47:59.3849072Z  2024-12-18T00:47:59.3849469Z  2024-12-18T00:47:59.3849883Z  2024-12-18T00:47:59.3850334Z  2024-12-18T00:47:59.3850758Z  2024-12-18T00:47:59.3851164Z  2024-12-18T00:47:59.3851567Z  2024-12-18T00:47:59.3852545Z [12,802 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:59.3853536Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:47:59.3854284Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:59.3855200Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:47:59.3856113Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 15s local 2024-12-18T00:47:59.3857149Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 12s local 2024-12-18T00:47:59.3858129Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 8s local 2024-12-18T00:47:59.3859098Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:47:59.3859899Z @onednn//:mkl_dnn; 7s local ... 2024-12-18T00:47:59.6783829Z 2024-12-18T00:47:59.6784775Z  2024-12-18T00:47:59.6785314Z  2024-12-18T00:47:59.6785718Z  2024-12-18T00:47:59.6786089Z  2024-12-18T00:47:59.6786485Z  2024-12-18T00:47:59.6786916Z  2024-12-18T00:47:59.6787338Z  2024-12-18T00:47:59.6787753Z  2024-12-18T00:47:59.6788704Z [12,807 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:59.6790001Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:47:59.6790806Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:59.6791772Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2024-12-18T00:47:59.6792702Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 15s local 2024-12-18T00:47:59.6793561Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 12s local 2024-12-18T00:47:59.6794532Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 8s local 2024-12-18T00:47:59.6795568Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:47:59.6796848Z @onednn//:mkl_dnn; 7s local ... 2024-12-18T00:47:59.9096365Z 2024-12-18T00:47:59.9097912Z  2024-12-18T00:47:59.9098384Z  2024-12-18T00:47:59.9098749Z  2024-12-18T00:47:59.9099358Z  2024-12-18T00:47:59.9099766Z  2024-12-18T00:47:59.9100169Z  2024-12-18T00:47:59.9100547Z  2024-12-18T00:47:59.9100945Z  2024-12-18T00:47:59.9101871Z [12,815 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:47:59.9102959Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:47:59.9103779Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:47:59.9104638Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:47:59.9105456Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 15s local 2024-12-18T00:47:59.9106233Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 12s local 2024-12-18T00:47:59.9107056Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 9s local 2024-12-18T00:47:59.9107918Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:47:59.9108661Z @onednn//:mkl_dnn; 8s local ... 2024-12-18T00:48:00.1118878Z 2024-12-18T00:48:00.1119834Z  2024-12-18T00:48:00.1120315Z  2024-12-18T00:48:00.1120678Z  2024-12-18T00:48:00.1121035Z  2024-12-18T00:48:00.1121389Z  2024-12-18T00:48:00.1121730Z  2024-12-18T00:48:00.1122051Z  2024-12-18T00:48:00.1122408Z  2024-12-18T00:48:00.1123256Z [12,830 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:00.1124214Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2024-12-18T00:48:00.1124898Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2024-12-18T00:48:00.1125822Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:48:00.1126676Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 16s local 2024-12-18T00:48:00.1127480Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 13s local 2024-12-18T00:48:00.1128374Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 9s local 2024-12-18T00:48:00.1129300Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 8s local 2024-12-18T00:48:00.1130013Z @onednn//:mkl_dnn; 8s local ... 2024-12-18T00:48:00.3204367Z 2024-12-18T00:48:00.3205800Z  2024-12-18T00:48:00.3206328Z  2024-12-18T00:48:00.3206732Z  2024-12-18T00:48:00.3207100Z  2024-12-18T00:48:00.3207526Z  2024-12-18T00:48:00.3207964Z  2024-12-18T00:48:00.3208395Z  2024-12-18T00:48:00.3208787Z  2024-12-18T00:48:00.3209752Z [12,841 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:00.3210801Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:48:00.3211609Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:48:00.3212573Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:48:00.3213553Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 16s local 2024-12-18T00:48:00.3214447Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 13s local 2024-12-18T00:48:00.3215478Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 9s local 2024-12-18T00:48:00.3216648Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:48:00.3217480Z @onednn//:mkl_dnn; 8s local ... 2024-12-18T00:48:00.5326535Z 2024-12-18T00:48:00.5327472Z  2024-12-18T00:48:00.5327977Z  2024-12-18T00:48:00.5328435Z  2024-12-18T00:48:00.5328835Z  2024-12-18T00:48:00.5329219Z  2024-12-18T00:48:00.5329633Z  2024-12-18T00:48:00.5330040Z  2024-12-18T00:48:00.5330434Z  2024-12-18T00:48:00.5331356Z [12,846 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:00.5332299Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:48:00.5333397Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:48:00.5334349Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2024-12-18T00:48:00.5335420Z Compiling src/cpu/x64/jit_uni_eltwise.cpp; 16s local 2024-12-18T00:48:00.5336244Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 13s local 2024-12-18T00:48:00.5337309Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 9s local 2024-12-18T00:48:00.5338253Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:48:00.5339198Z @onednn//:mkl_dnn; 8s local ... 2024-12-18T00:48:00.7756169Z 2024-12-18T00:48:00.7757558Z  2024-12-18T00:48:00.7758006Z  2024-12-18T00:48:00.7758356Z  2024-12-18T00:48:00.7758703Z  2024-12-18T00:48:00.7759065Z  2024-12-18T00:48:00.7759424Z  2024-12-18T00:48:00.7759759Z  2024-12-18T00:48:00.7760092Z  2024-12-18T00:48:00.7760918Z [12,852 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:00.7761776Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:48:00.7762387Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:48:00.7763238Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:48:00.7764090Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 13s local 2024-12-18T00:48:00.7764999Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local 2024-12-18T00:48:00.7765918Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:48:00.7767081Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 9s local 2024-12-18T00:48:00.7768110Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 7s local ... 2024-12-18T00:48:00.9761924Z 2024-12-18T00:48:00.9763373Z  2024-12-18T00:48:00.9763846Z  2024-12-18T00:48:00.9764223Z  2024-12-18T00:48:00.9764613Z  2024-12-18T00:48:00.9764998Z  2024-12-18T00:48:00.9765406Z  2024-12-18T00:48:00.9765803Z  2024-12-18T00:48:00.9766152Z  2024-12-18T00:48:00.9767073Z [12,854 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:00.9768010Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:48:00.9768742Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2024-12-18T00:48:00.9769648Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:48:00.9770560Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 13s local 2024-12-18T00:48:00.9771531Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local 2024-12-18T00:48:00.9772496Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local 2024-12-18T00:48:00.9773494Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 9s local 2024-12-18T00:48:00.9774559Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 8s local ... 2024-12-18T00:48:01.2486073Z 2024-12-18T00:48:01.2487416Z  2024-12-18T00:48:01.2488092Z  2024-12-18T00:48:01.2488697Z  2024-12-18T00:48:01.2489426Z  2024-12-18T00:48:01.2490596Z  2024-12-18T00:48:01.2491062Z  2024-12-18T00:48:01.2491507Z  2024-12-18T00:48:01.2491926Z  2024-12-18T00:48:01.2492889Z [12,858 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:01.2493921Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2024-12-18T00:48:01.2494697Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:48:01.2495670Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:48:01.2496819Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local 2024-12-18T00:48:01.2497775Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2024-12-18T00:48:01.2498997Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 9s local 2024-12-18T00:48:01.2499928Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 8s local 2024-12-18T00:48:01.2500906Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 6s local ... 2024-12-18T00:48:01.4527570Z 2024-12-18T00:48:01.4528467Z  2024-12-18T00:48:01.4531044Z  2024-12-18T00:48:01.4531688Z  2024-12-18T00:48:01.4532081Z  2024-12-18T00:48:01.4532457Z  2024-12-18T00:48:01.4532849Z  2024-12-18T00:48:01.4533298Z  2024-12-18T00:48:01.4533712Z  2024-12-18T00:48:01.4534803Z [12,869 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:01.4535852Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:48:01.4536782Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:48:01.4537676Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:48:01.4538672Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local 2024-12-18T00:48:01.4539643Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2024-12-18T00:48:01.4540672Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 9s local 2024-12-18T00:48:01.4541738Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 8s local 2024-12-18T00:48:01.4542618Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 6s local ... 2024-12-18T00:48:01.6701114Z 2024-12-18T00:48:01.6702012Z  2024-12-18T00:48:01.6702523Z  2024-12-18T00:48:01.6702940Z  2024-12-18T00:48:01.6703336Z  2024-12-18T00:48:01.6703704Z  2024-12-18T00:48:01.6704171Z  2024-12-18T00:48:01.6704697Z  2024-12-18T00:48:01.6705072Z  2024-12-18T00:48:01.6706107Z [12,875 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:01.6707103Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:48:01.6707864Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:48:01.6708731Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2024-12-18T00:48:01.6709763Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local 2024-12-18T00:48:01.6710713Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2024-12-18T00:48:01.6711758Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 9s local 2024-12-18T00:48:01.6712790Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 8s local 2024-12-18T00:48:01.6713676Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 6s local ... 2024-12-18T00:48:01.8857813Z 2024-12-18T00:48:01.8858724Z  2024-12-18T00:48:01.8859268Z  2024-12-18T00:48:01.8859680Z  2024-12-18T00:48:01.8860074Z  2024-12-18T00:48:01.8860485Z  2024-12-18T00:48:01.8860881Z  2024-12-18T00:48:01.8861275Z  2024-12-18T00:48:01.8861665Z  2024-12-18T00:48:01.8862604Z [12,881 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:01.8863691Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:48:01.8864451Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2024-12-18T00:48:01.8865394Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:48:01.8866388Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local 2024-12-18T00:48:01.8867298Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2024-12-18T00:48:01.8868359Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 10s local 2024-12-18T00:48:01.8869409Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 8s local 2024-12-18T00:48:01.8870288Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 6s local ... 2024-12-18T00:48:02.1254808Z 2024-12-18T00:48:02.1255691Z  2024-12-18T00:48:02.1256144Z  2024-12-18T00:48:02.1256613Z  2024-12-18T00:48:02.1256988Z  2024-12-18T00:48:02.1257465Z  2024-12-18T00:48:02.1257963Z  2024-12-18T00:48:02.1258376Z  2024-12-18T00:48:02.1258724Z  2024-12-18T00:48:02.1259937Z [12,885 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:02.1260827Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2024-12-18T00:48:02.1261745Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:48:02.1262656Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:48:02.1263630Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local 2024-12-18T00:48:02.1264584Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:48:02.1265839Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 10s local 2024-12-18T00:48:02.1266884Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 9s local 2024-12-18T00:48:02.1267758Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 7s local ... 2024-12-18T00:48:02.3426141Z 2024-12-18T00:48:02.3427028Z  2024-12-18T00:48:02.3427648Z  2024-12-18T00:48:02.3428036Z  2024-12-18T00:48:02.3428456Z  2024-12-18T00:48:02.3428844Z  2024-12-18T00:48:02.3429208Z  2024-12-18T00:48:02.3429583Z  2024-12-18T00:48:02.3429992Z  2024-12-18T00:48:02.3430950Z [12,888 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:02.3431928Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:48:02.3432711Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:48:02.3433609Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:48:02.3434611Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local 2024-12-18T00:48:02.3435570Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:48:02.3436609Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 10s local 2024-12-18T00:48:02.3437654Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 9s local 2024-12-18T00:48:02.3438487Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 7s local ... 2024-12-18T00:48:02.5426881Z 2024-12-18T00:48:02.5427664Z  2024-12-18T00:48:02.5428190Z  2024-12-18T00:48:02.5428624Z  2024-12-18T00:48:02.5429043Z  2024-12-18T00:48:02.5429469Z  2024-12-18T00:48:02.5429924Z  2024-12-18T00:48:02.5430353Z  2024-12-18T00:48:02.5430758Z  2024-12-18T00:48:02.5431702Z [12,892 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:02.5432740Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:48:02.5433564Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:48:02.5434441Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:48:02.5435451Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local 2024-12-18T00:48:02.5436431Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:48:02.5437513Z Compiling src/graph/backend/dnnl/patterns/quantize_fusion.cpp; 10s local 2024-12-18T00:48:02.5438595Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 9s local 2024-12-18T00:48:02.5439407Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 7s local ... 2024-12-18T00:48:02.7652768Z 2024-12-18T00:48:02.7653726Z  2024-12-18T00:48:02.7654214Z  2024-12-18T00:48:02.7654604Z  2024-12-18T00:48:02.7655018Z  2024-12-18T00:48:02.7655408Z  2024-12-18T00:48:02.7655762Z  2024-12-18T00:48:02.7656117Z  2024-12-18T00:48:02.7656658Z  2024-12-18T00:48:02.7657610Z [12,904 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:02.7658627Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:48:02.7659412Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:48:02.7660288Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2024-12-18T00:48:02.7661270Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2024-12-18T00:48:02.7664487Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:48:02.7665402Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 9s local 2024-12-18T00:48:02.7666430Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 7s local 2024-12-18T00:48:02.7667357Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2024-12-18T00:48:02.9776960Z 2024-12-18T00:48:02.9777861Z  2024-12-18T00:48:02.9778354Z  2024-12-18T00:48:02.9778756Z  2024-12-18T00:48:02.9779139Z  2024-12-18T00:48:02.9779533Z  2024-12-18T00:48:02.9780357Z  2024-12-18T00:48:02.9780757Z  2024-12-18T00:48:02.9781145Z  2024-12-18T00:48:02.9782089Z [12,919 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:02.9783079Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:48:02.9783796Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2024-12-18T00:48:02.9784675Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:48:02.9785670Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2024-12-18T00:48:02.9786620Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2024-12-18T00:48:02.9787498Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 10s local 2024-12-18T00:48:02.9788295Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 8s local 2024-12-18T00:48:02.9789213Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2024-12-18T00:48:03.1869357Z 2024-12-18T00:48:03.1870265Z  2024-12-18T00:48:03.1870755Z  2024-12-18T00:48:03.1871135Z  2024-12-18T00:48:03.1871541Z  2024-12-18T00:48:03.1871937Z  2024-12-18T00:48:03.1872342Z  2024-12-18T00:48:03.1872741Z  2024-12-18T00:48:03.1873124Z  2024-12-18T00:48:03.1874251Z [12,932 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:03.1875239Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2024-12-18T00:48:03.1875981Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:48:03.1876866Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:48:03.1877825Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2024-12-18T00:48:03.1878776Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:48:03.1879633Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 10s local 2024-12-18T00:48:03.1880463Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 8s local 2024-12-18T00:48:03.1881393Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2024-12-18T00:48:03.3856090Z 2024-12-18T00:48:03.3857108Z  2024-12-18T00:48:03.3857552Z  2024-12-18T00:48:03.3857957Z  2024-12-18T00:48:03.3858349Z  2024-12-18T00:48:03.3858750Z  2024-12-18T00:48:03.3859150Z  2024-12-18T00:48:03.3859541Z  2024-12-18T00:48:03.3859973Z  2024-12-18T00:48:03.3860899Z [12,942 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:03.3861834Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:48:03.3862553Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:48:03.3863395Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:48:03.3864343Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2024-12-18T00:48:03.3865261Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:48:03.3866092Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 10s local 2024-12-18T00:48:03.3866913Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 8s local 2024-12-18T00:48:03.3867853Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2024-12-18T00:48:03.6132078Z 2024-12-18T00:48:03.6132918Z  2024-12-18T00:48:03.6133404Z  2024-12-18T00:48:03.6134069Z  2024-12-18T00:48:03.6134486Z  2024-12-18T00:48:03.6134864Z  2024-12-18T00:48:03.6135216Z  2024-12-18T00:48:03.6135620Z  2024-12-18T00:48:03.6136027Z  2024-12-18T00:48:03.6137384Z [12,946 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:03.6138408Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:48:03.6139170Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:48:03.6140115Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2024-12-18T00:48:03.6141124Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2024-12-18T00:48:03.6142011Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:48:03.6142881Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 10s local 2024-12-18T00:48:03.6143653Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 8s local 2024-12-18T00:48:03.6144816Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local ... 2024-12-18T00:48:03.8191862Z 2024-12-18T00:48:03.8192838Z  2024-12-18T00:48:03.8193417Z  2024-12-18T00:48:03.8193861Z  2024-12-18T00:48:03.8194236Z  2024-12-18T00:48:03.8194670Z  2024-12-18T00:48:03.8195168Z  2024-12-18T00:48:03.8195615Z  2024-12-18T00:48:03.8196011Z  2024-12-18T00:48:03.8197044Z [12,947 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:03.8198064Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:48:03.8198880Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:48:03.8199823Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:48:03.8200879Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2024-12-18T00:48:03.8201889Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:48:03.8202794Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 10s local 2024-12-18T00:48:03.8203633Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 8s local 2024-12-18T00:48:03.8204582Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local ... 2024-12-18T00:48:04.0784166Z 2024-12-18T00:48:04.0785034Z  2024-12-18T00:48:04.0785523Z  2024-12-18T00:48:04.0785905Z  2024-12-18T00:48:04.0786296Z  2024-12-18T00:48:04.0786690Z  2024-12-18T00:48:04.0787066Z  2024-12-18T00:48:04.0787456Z  2024-12-18T00:48:04.0787832Z  2024-12-18T00:48:04.0788798Z [12,950 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:04.0789777Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:48:04.0790536Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2024-12-18T00:48:04.0791425Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:48:04.0792405Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2024-12-18T00:48:04.0793356Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2024-12-18T00:48:04.0794227Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 11s local 2024-12-18T00:48:04.0795064Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 9s local 2024-12-18T00:48:04.0795978Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local ... 2024-12-18T00:48:04.2840509Z 2024-12-18T00:48:04.2841394Z  2024-12-18T00:48:04.2841885Z  2024-12-18T00:48:04.2842277Z  2024-12-18T00:48:04.2842652Z  2024-12-18T00:48:04.2843083Z  2024-12-18T00:48:04.2843463Z  2024-12-18T00:48:04.2843839Z  2024-12-18T00:48:04.2844488Z  2024-12-18T00:48:04.2845366Z [12,975 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:48:04.2846288Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2024-12-18T00:48:04.2847053Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:48:04.2848165Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:48:04.2849176Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2024-12-18T00:48:04.2850318Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2024-12-18T00:48:04.2851208Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 11s local 2024-12-18T00:48:04.2852011Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 9s local 2024-12-18T00:48:04.2852880Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local ... 2024-12-18T00:48:04.4900152Z 2024-12-18T00:48:04.4901039Z  2024-12-18T00:48:04.4901541Z  2024-12-18T00:48:04.4901968Z  2024-12-18T00:48:04.4902386Z  2024-12-18T00:48:04.4902802Z  2024-12-18T00:48:04.4903198Z  2024-12-18T00:48:04.4903617Z  2024-12-18T00:48:04.4904009Z  2024-12-18T00:48:04.4904940Z [12,992 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:04.4905910Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2024-12-18T00:48:04.4906683Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:48:04.4907594Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:48:04.4908639Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2024-12-18T00:48:04.4909610Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2024-12-18T00:48:04.4910714Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 11s local 2024-12-18T00:48:04.4911582Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 9s local 2024-12-18T00:48:04.4912580Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local ... 2024-12-18T00:48:04.7420295Z 2024-12-18T00:48:04.7421161Z  2024-12-18T00:48:04.7421630Z  2024-12-18T00:48:04.7422050Z  2024-12-18T00:48:04.7422455Z  2024-12-18T00:48:04.7422862Z  2024-12-18T00:48:04.7423275Z  2024-12-18T00:48:04.7423682Z  2024-12-18T00:48:04.7424076Z  2024-12-18T00:48:04.7424981Z [12,999 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:04.7425990Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2024-12-18T00:48:04.7426756Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:48:04.7427660Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2024-12-18T00:48:04.7428667Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2024-12-18T00:48:04.7429576Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2024-12-18T00:48:04.7430523Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 11s local 2024-12-18T00:48:04.7431389Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 9s local 2024-12-18T00:48:04.7432342Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local ... 2024-12-18T00:48:04.9870105Z 2024-12-18T00:48:04.9871003Z  2024-12-18T00:48:04.9871498Z  2024-12-18T00:48:04.9871940Z  2024-12-18T00:48:04.9872354Z  2024-12-18T00:48:04.9872763Z  2024-12-18T00:48:04.9873155Z  2024-12-18T00:48:04.9873559Z  2024-12-18T00:48:04.9873933Z  2024-12-18T00:48:04.9874896Z [12,999 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:04.9875856Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2024-12-18T00:48:04.9876727Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2024-12-18T00:48:04.9877680Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:48:04.9878748Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2024-12-18T00:48:04.9879687Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2024-12-18T00:48:04.9880605Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 12s local 2024-12-18T00:48:04.9881476Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 10s local 2024-12-18T00:48:04.9882729Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local ... 2024-12-18T00:48:05.1875610Z 2024-12-18T00:48:05.1876491Z  2024-12-18T00:48:05.1877010Z  2024-12-18T00:48:05.1877412Z  2024-12-18T00:48:05.1878087Z  2024-12-18T00:48:05.1878514Z  2024-12-18T00:48:05.1878932Z  2024-12-18T00:48:05.1879303Z  2024-12-18T00:48:05.1879699Z  2024-12-18T00:48:05.1880644Z [13,001 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:05.1881838Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2024-12-18T00:48:05.1882705Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:48:05.1883564Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:48:05.1884543Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2024-12-18T00:48:05.1885502Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:48:05.1886408Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 12s local 2024-12-18T00:48:05.1887187Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 10s local 2024-12-18T00:48:05.1888089Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local ... 2024-12-18T00:48:05.3937922Z 2024-12-18T00:48:05.3938843Z  2024-12-18T00:48:05.3939304Z  2024-12-18T00:48:05.3939718Z  2024-12-18T00:48:05.3940128Z  2024-12-18T00:48:05.3940530Z  2024-12-18T00:48:05.3940918Z  2024-12-18T00:48:05.3941317Z  2024-12-18T00:48:05.3941698Z  2024-12-18T00:48:05.3942630Z [13,015 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:05.3943623Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:48:05.3944817Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:48:05.3945840Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2024-12-18T00:48:05.3946849Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:48:05.3947777Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 12s local 2024-12-18T00:48:05.3948640Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 10s local 2024-12-18T00:48:05.3949595Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2024-12-18T00:48:05.3950621Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 8s local ... 2024-12-18T00:48:05.6011758Z 2024-12-18T00:48:05.6012620Z  2024-12-18T00:48:05.6013102Z  2024-12-18T00:48:05.6013522Z  2024-12-18T00:48:05.6013951Z  2024-12-18T00:48:05.6014354Z  2024-12-18T00:48:05.6014758Z  2024-12-18T00:48:05.6015171Z  2024-12-18T00:48:05.6015583Z  2024-12-18T00:48:05.6016722Z [13,023 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:05.6017787Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:48:05.6018738Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2024-12-18T00:48:05.6019711Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2024-12-18T00:48:05.6020714Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:48:05.6021654Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 12s local 2024-12-18T00:48:05.6022536Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 10s local 2024-12-18T00:48:05.6023494Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:48:05.6024622Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 9s local ... 2024-12-18T00:48:05.8291367Z 2024-12-18T00:48:05.8292249Z  2024-12-18T00:48:05.8292724Z  2024-12-18T00:48:05.8293141Z  2024-12-18T00:48:05.8293514Z  2024-12-18T00:48:05.8293821Z  2024-12-18T00:48:05.8294114Z  2024-12-18T00:48:05.8294439Z  2024-12-18T00:48:05.8294839Z  2024-12-18T00:48:05.8295773Z [13,032 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:05.8297216Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:48:05.8298296Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:48:05.8299167Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 15s local 2024-12-18T00:48:05.8300132Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:48:05.8301029Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 12s local 2024-12-18T00:48:05.8302021Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 10s local 2024-12-18T00:48:05.8303011Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:48:05.8304030Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 9s local ... 2024-12-18T00:48:06.0625274Z 2024-12-18T00:48:06.0626159Z  2024-12-18T00:48:06.0626679Z  2024-12-18T00:48:06.0627101Z  2024-12-18T00:48:06.0627512Z  2024-12-18T00:48:06.0627945Z  2024-12-18T00:48:06.0628352Z  2024-12-18T00:48:06.0628764Z  2024-12-18T00:48:06.0629170Z  2024-12-18T00:48:06.0630169Z [13,044 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:06.0631199Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2024-12-18T00:48:06.0632090Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:48:06.0633094Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 15s local 2024-12-18T00:48:06.0634111Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2024-12-18T00:48:06.0635029Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 13s local 2024-12-18T00:48:06.0635899Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 11s local 2024-12-18T00:48:06.0636866Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:48:06.0648646Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 9s local ... 2024-12-18T00:48:06.2989031Z 2024-12-18T00:48:06.2989888Z  2024-12-18T00:48:06.2990308Z  2024-12-18T00:48:06.2990711Z  2024-12-18T00:48:06.2991113Z  2024-12-18T00:48:06.2991534Z  2024-12-18T00:48:06.2991975Z  2024-12-18T00:48:06.2992370Z  2024-12-18T00:48:06.2992781Z  2024-12-18T00:48:06.2993712Z [13,052 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:06.2994784Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:48:06.2995684Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:48:06.2997095Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:48:06.2998006Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 13s local 2024-12-18T00:48:06.2998866Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 11s local 2024-12-18T00:48:06.2999795Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:48:06.3000818Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 9s local 2024-12-18T00:48:06.3001755Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 9s local ... 2024-12-18T00:48:06.5091693Z 2024-12-18T00:48:06.5092626Z  2024-12-18T00:48:06.5093201Z  2024-12-18T00:48:06.5093619Z  2024-12-18T00:48:06.5094025Z  2024-12-18T00:48:06.5094400Z  2024-12-18T00:48:06.5094772Z  2024-12-18T00:48:06.5095147Z  2024-12-18T00:48:06.5095551Z  2024-12-18T00:48:06.5096735Z [13,069 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:06.5097762Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:48:06.5098642Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:48:06.5099603Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:48:06.5100513Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 13s local 2024-12-18T00:48:06.5101633Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 11s local 2024-12-18T00:48:06.5102576Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2024-12-18T00:48:06.5103711Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 10s local 2024-12-18T00:48:06.5104617Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 9s local ... 2024-12-18T00:48:06.7452562Z 2024-12-18T00:48:06.7453397Z  2024-12-18T00:48:06.7453792Z  2024-12-18T00:48:06.7454147Z  2024-12-18T00:48:06.7454495Z  2024-12-18T00:48:06.7454848Z  2024-12-18T00:48:06.7457680Z  2024-12-18T00:48:06.7458295Z  2024-12-18T00:48:06.7458675Z  2024-12-18T00:48:06.7459580Z [13,081 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:06.7460547Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:48:06.7461327Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2024-12-18T00:48:06.7462311Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:48:06.7463258Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 13s local 2024-12-18T00:48:06.7464096Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 11s local 2024-12-18T00:48:06.7464993Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:48:06.7466015Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 10s local 2024-12-18T00:48:06.7466855Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 9s local ... 2024-12-18T00:48:06.9888069Z 2024-12-18T00:48:06.9888932Z  2024-12-18T00:48:06.9889349Z  2024-12-18T00:48:06.9889703Z  2024-12-18T00:48:06.9890047Z  2024-12-18T00:48:06.9890395Z  2024-12-18T00:48:06.9890722Z  2024-12-18T00:48:06.9891065Z  2024-12-18T00:48:06.9891420Z  2024-12-18T00:48:06.9892248Z [13,086 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:06.9893134Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2024-12-18T00:48:06.9893854Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:48:06.9894678Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2024-12-18T00:48:06.9895438Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 14s local 2024-12-18T00:48:06.9896160Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 12s local 2024-12-18T00:48:06.9897148Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:48:06.9898026Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 10s local 2024-12-18T00:48:06.9898825Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 9s local ... 2024-12-18T00:48:07.1920690Z 2024-12-18T00:48:07.1921572Z  2024-12-18T00:48:07.1921992Z  2024-12-18T00:48:07.1922317Z  2024-12-18T00:48:07.1922660Z  2024-12-18T00:48:07.1923000Z  2024-12-18T00:48:07.1923337Z  2024-12-18T00:48:07.1923661Z  2024-12-18T00:48:07.1924030Z  2024-12-18T00:48:07.1924834Z [13,108 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:07.1925684Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:48:07.1926419Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:48:07.1927206Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:48:07.1927923Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 14s local 2024-12-18T00:48:07.1928615Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 12s local 2024-12-18T00:48:07.1929392Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:48:07.1930209Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 10s local 2024-12-18T00:48:07.1930895Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 9s local ... 2024-12-18T00:48:07.4595670Z 2024-12-18T00:48:07.4596545Z  2024-12-18T00:48:07.4597045Z  2024-12-18T00:48:07.4597796Z  2024-12-18T00:48:07.4598264Z  2024-12-18T00:48:07.4598733Z  2024-12-18T00:48:07.4599153Z  2024-12-18T00:48:07.4599631Z  2024-12-18T00:48:07.4600098Z  2024-12-18T00:48:07.4601421Z [13,121 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:07.4602426Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:48:07.4603153Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:48:07.4604088Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:48:07.4604911Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 14s local 2024-12-18T00:48:07.4605564Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 12s local 2024-12-18T00:48:07.4606295Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2024-12-18T00:48:07.4607098Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 10s local 2024-12-18T00:48:07.4607813Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 10s local ... 2024-12-18T00:48:07.6751110Z 2024-12-18T00:48:07.6751966Z  2024-12-18T00:48:07.6752423Z  2024-12-18T00:48:07.6752800Z  2024-12-18T00:48:07.6753200Z  2024-12-18T00:48:07.6753604Z  2024-12-18T00:48:07.6754019Z  2024-12-18T00:48:07.6754395Z  2024-12-18T00:48:07.6754765Z  2024-12-18T00:48:07.6755660Z [13,125 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:07.6756663Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:48:07.6757551Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2024-12-18T00:48:07.6758484Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:48:07.6759345Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 14s local 2024-12-18T00:48:07.6760077Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 12s local 2024-12-18T00:48:07.6760793Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:48:07.6761598Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 11s local 2024-12-18T00:48:07.6762466Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 10s local ... 2024-12-18T00:48:07.9100788Z 2024-12-18T00:48:07.9101673Z  2024-12-18T00:48:07.9102122Z  2024-12-18T00:48:07.9102491Z  2024-12-18T00:48:07.9102853Z  2024-12-18T00:48:07.9103209Z  2024-12-18T00:48:07.9103568Z  2024-12-18T00:48:07.9103902Z  2024-12-18T00:48:07.9104253Z  2024-12-18T00:48:07.9105117Z [13,137 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:07.9105935Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:48:07.9106680Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2024-12-18T00:48:07.9107448Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:48:07.9108174Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 15s local 2024-12-18T00:48:07.9108881Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 13s local 2024-12-18T00:48:07.9109688Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:48:07.9110530Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 11s local 2024-12-18T00:48:07.9111249Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 10s local ... 2024-12-18T00:48:08.1116071Z 2024-12-18T00:48:08.1117021Z  2024-12-18T00:48:08.1117506Z  2024-12-18T00:48:08.1117893Z  2024-12-18T00:48:08.1118332Z  2024-12-18T00:48:08.1118711Z  2024-12-18T00:48:08.1119072Z  2024-12-18T00:48:08.1119442Z  2024-12-18T00:48:08.1119839Z  2024-12-18T00:48:08.1120783Z [13,156 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:08.1121736Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2024-12-18T00:48:08.1122590Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2024-12-18T00:48:08.1124101Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2024-12-18T00:48:08.1125130Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 15s local 2024-12-18T00:48:08.1125944Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 13s local 2024-12-18T00:48:08.1126859Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:48:08.1127834Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 11s local 2024-12-18T00:48:08.1128930Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 10s local ... 2024-12-18T00:48:08.3894811Z 2024-12-18T00:48:08.3896074Z  2024-12-18T00:48:08.3896711Z  2024-12-18T00:48:08.3897298Z  2024-12-18T00:48:08.3897697Z  2024-12-18T00:48:08.3898084Z  2024-12-18T00:48:08.3898440Z  2024-12-18T00:48:08.3898838Z  2024-12-18T00:48:08.3899229Z  2024-12-18T00:48:08.3900174Z [13,162 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:08.3901190Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:48:08.3902086Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2024-12-18T00:48:08.3903038Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:48:08.3903901Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 15s local 2024-12-18T00:48:08.3904689Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 13s local 2024-12-18T00:48:08.3905630Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2024-12-18T00:48:08.3906643Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 11s local 2024-12-18T00:48:08.3907491Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 11s local ... 2024-12-18T00:48:08.5989377Z 2024-12-18T00:48:08.5990318Z  2024-12-18T00:48:08.5990801Z  2024-12-18T00:48:08.5991220Z  2024-12-18T00:48:08.5991625Z  2024-12-18T00:48:08.5992016Z  2024-12-18T00:48:08.5992407Z  2024-12-18T00:48:08.5992798Z  2024-12-18T00:48:08.5993185Z  2024-12-18T00:48:08.5994126Z [13,165 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:08.5995118Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:48:08.5995972Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2024-12-18T00:48:08.5996887Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:48:08.5997783Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 15s local 2024-12-18T00:48:08.5998597Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 13s local 2024-12-18T00:48:08.5999482Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:48:08.6000414Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 12s local 2024-12-18T00:48:08.6001272Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 11s local ... 2024-12-18T00:48:08.8238357Z 2024-12-18T00:48:08.8239620Z  2024-12-18T00:48:08.8241125Z  2024-12-18T00:48:08.8241646Z  2024-12-18T00:48:08.8242045Z  2024-12-18T00:48:08.8242480Z  2024-12-18T00:48:08.8242910Z  2024-12-18T00:48:08.8243372Z  2024-12-18T00:48:08.8243792Z  2024-12-18T00:48:08.8248237Z [13,187 / 20,602] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2024-12-18T00:48:08.8249261Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:48:08.8250130Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 54s local 2024-12-18T00:48:08.8251096Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:48:08.8251964Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 15s local 2024-12-18T00:48:08.8252750Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 13s local 2024-12-18T00:48:08.8253612Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:48:08.8254549Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 12s local 2024-12-18T00:48:08.8255628Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 11s local ... 2024-12-18T00:48:09.0269703Z 2024-12-18T00:48:09.0270691Z  2024-12-18T00:48:09.0272821Z  2024-12-18T00:48:09.0273309Z  2024-12-18T00:48:09.0273671Z  2024-12-18T00:48:09.0274056Z  2024-12-18T00:48:09.0274423Z  2024-12-18T00:48:09.0274843Z  2024-12-18T00:48:09.0275270Z  2024-12-18T00:48:09.0276395Z [13,219 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:09.0277600Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2024-12-18T00:48:09.0278475Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2024-12-18T00:48:09.0279398Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local 2024-12-18T00:48:09.0280283Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 14s local 2024-12-18T00:48:09.0281253Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:48:09.0282351Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 12s local 2024-12-18T00:48:09.0283291Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 11s local 2024-12-18T00:48:09.0284278Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 8s local ... 2024-12-18T00:48:09.2262748Z 2024-12-18T00:48:09.2263689Z  2024-12-18T00:48:09.2265746Z  2024-12-18T00:48:09.2266263Z  2024-12-18T00:48:09.2266701Z  2024-12-18T00:48:09.2267165Z  2024-12-18T00:48:09.2267599Z  2024-12-18T00:48:09.2268190Z  2024-12-18T00:48:09.2268619Z  2024-12-18T00:48:09.2269600Z [13,226 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:09.2270659Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:48:09.2271546Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:48:09.2272486Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local 2024-12-18T00:48:09.2273439Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 14s local 2024-12-18T00:48:09.2274479Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:48:09.2275552Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 12s local 2024-12-18T00:48:09.2276454Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 11s local 2024-12-18T00:48:09.2277411Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 8s local ... 2024-12-18T00:48:09.4929426Z 2024-12-18T00:48:09.4930191Z  2024-12-18T00:48:09.4930545Z  2024-12-18T00:48:09.4930819Z  2024-12-18T00:48:09.4931058Z  2024-12-18T00:48:09.4931315Z  2024-12-18T00:48:09.4931570Z  2024-12-18T00:48:09.4931817Z  2024-12-18T00:48:09.4932127Z  2024-12-18T00:48:09.4932736Z [13,234 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:09.4933396Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:48:09.4933914Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:48:09.4934486Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local 2024-12-18T00:48:09.4934981Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 14s local 2024-12-18T00:48:09.4935527Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2024-12-18T00:48:09.4936104Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 12s local 2024-12-18T00:48:09.4936799Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 12s local 2024-12-18T00:48:09.4937343Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 8s local ... 2024-12-18T00:48:09.7308972Z 2024-12-18T00:48:09.7309795Z  2024-12-18T00:48:09.7310278Z  2024-12-18T00:48:09.7310691Z  2024-12-18T00:48:09.7311093Z  2024-12-18T00:48:09.7311481Z  2024-12-18T00:48:09.7311894Z  2024-12-18T00:48:09.7312311Z  2024-12-18T00:48:09.7312698Z  2024-12-18T00:48:09.7313971Z [13,239 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:09.7315016Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:48:09.7316029Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:48:09.7316950Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 16s local 2024-12-18T00:48:09.7317821Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 14s local 2024-12-18T00:48:09.7318758Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:48:09.7319979Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 13s local 2024-12-18T00:48:09.7320898Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 12s local 2024-12-18T00:48:09.7321847Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 9s local ... 2024-12-18T00:48:09.9909855Z 2024-12-18T00:48:09.9910731Z  2024-12-18T00:48:09.9911218Z  2024-12-18T00:48:09.9911631Z  2024-12-18T00:48:09.9912010Z  2024-12-18T00:48:09.9912473Z  2024-12-18T00:48:09.9912856Z  2024-12-18T00:48:09.9913190Z  2024-12-18T00:48:09.9913550Z  2024-12-18T00:48:09.9914473Z [13,244 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:09.9915448Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2024-12-18T00:48:09.9916186Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2024-12-18T00:48:09.9917041Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:48:09.9917872Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local 2024-12-18T00:48:09.9918740Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:48:09.9919730Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 13s local 2024-12-18T00:48:09.9920611Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 12s local 2024-12-18T00:48:09.9921400Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 9s local ... 2024-12-18T00:48:10.1911638Z 2024-12-18T00:48:10.1914180Z  2024-12-18T00:48:10.1914726Z  2024-12-18T00:48:10.1915139Z  2024-12-18T00:48:10.1915535Z  2024-12-18T00:48:10.1915947Z  2024-12-18T00:48:10.1916382Z  2024-12-18T00:48:10.1916788Z  2024-12-18T00:48:10.1917185Z  2024-12-18T00:48:10.1918104Z [13,252 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:10.1919135Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:48:10.1920047Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:48:10.1920952Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:48:10.1921827Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local 2024-12-18T00:48:10.1922753Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:48:10.1923802Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 13s local 2024-12-18T00:48:10.1924721Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 12s local 2024-12-18T00:48:10.1925621Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 9s local ... 2024-12-18T00:48:10.3982243Z 2024-12-18T00:48:10.3983441Z  2024-12-18T00:48:10.3983974Z  2024-12-18T00:48:10.3984383Z  2024-12-18T00:48:10.3984766Z  2024-12-18T00:48:10.3985138Z  2024-12-18T00:48:10.3985533Z  2024-12-18T00:48:10.3985924Z  2024-12-18T00:48:10.3986319Z  2024-12-18T00:48:10.3987270Z [13,265 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:10.3988296Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:48:10.3989109Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:48:10.3990005Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:48:10.3990854Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local 2024-12-18T00:48:10.3992138Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2024-12-18T00:48:10.3993119Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 13s local 2024-12-18T00:48:10.3994324Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 13s local 2024-12-18T00:48:10.3995251Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 9s local ... 2024-12-18T00:48:10.6111345Z 2024-12-18T00:48:10.6112215Z  2024-12-18T00:48:10.6112713Z  2024-12-18T00:48:10.6113101Z  2024-12-18T00:48:10.6113489Z  2024-12-18T00:48:10.6113884Z  2024-12-18T00:48:10.6114673Z  2024-12-18T00:48:10.6115096Z  2024-12-18T00:48:10.6115489Z  2024-12-18T00:48:10.6116449Z [13,286 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:10.6117478Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:48:10.6118369Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:48:10.6119309Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:48:10.6120158Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local 2024-12-18T00:48:10.6121084Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:48:10.6122136Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 14s local 2024-12-18T00:48:10.6123025Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 13s local 2024-12-18T00:48:10.6123978Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 10s local ... 2024-12-18T00:48:10.8302575Z 2024-12-18T00:48:10.8303479Z  2024-12-18T00:48:10.8303984Z  2024-12-18T00:48:10.8304412Z  2024-12-18T00:48:10.8304816Z  2024-12-18T00:48:10.8305242Z  2024-12-18T00:48:10.8305683Z  2024-12-18T00:48:10.8306073Z  2024-12-18T00:48:10.8306461Z  2024-12-18T00:48:10.8307415Z [13,317 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:10.8308498Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:48:10.8309400Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:48:10.8310304Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 17s local 2024-12-18T00:48:10.8311151Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local 2024-12-18T00:48:10.8312092Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:48:10.8313109Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 14s local 2024-12-18T00:48:10.8314024Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 13s local 2024-12-18T00:48:10.8314995Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 10s local ... 2024-12-18T00:48:11.0507920Z 2024-12-18T00:48:11.0508820Z  2024-12-18T00:48:11.0509275Z  2024-12-18T00:48:11.0509654Z  2024-12-18T00:48:11.0510053Z  2024-12-18T00:48:11.0510462Z  2024-12-18T00:48:11.0510860Z  2024-12-18T00:48:11.0511274Z  2024-12-18T00:48:11.0511685Z  2024-12-18T00:48:11.0512609Z [13,349 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:11.0513626Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2024-12-18T00:48:11.0514497Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2024-12-18T00:48:11.0515339Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:48:11.0516149Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local 2024-12-18T00:48:11.0517102Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:48:11.0518138Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 14s local 2024-12-18T00:48:11.0518994Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 13s local 2024-12-18T00:48:11.0519859Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 10s local ... 2024-12-18T00:48:11.2578483Z 2024-12-18T00:48:11.2579302Z  2024-12-18T00:48:11.2579778Z  2024-12-18T00:48:11.2580423Z  2024-12-18T00:48:11.2581036Z  2024-12-18T00:48:11.2581452Z  2024-12-18T00:48:11.2581857Z  2024-12-18T00:48:11.2582269Z  2024-12-18T00:48:11.2582660Z  2024-12-18T00:48:11.2583839Z [13,383 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:11.2584932Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:48:11.2585828Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:48:11.2586901Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:48:11.2587865Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local 2024-12-18T00:48:11.2588855Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:48:11.2589932Z Compiling src/cpu/x64/jit_uni_reduction_kernel.cpp; 14s local 2024-12-18T00:48:11.2590891Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 14s local 2024-12-18T00:48:11.2591806Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 10s local ... 2024-12-18T00:48:11.4600715Z 2024-12-18T00:48:11.4601590Z  2024-12-18T00:48:11.4602071Z  2024-12-18T00:48:11.4602469Z  2024-12-18T00:48:11.4602918Z  2024-12-18T00:48:11.4603342Z  2024-12-18T00:48:11.4603751Z  2024-12-18T00:48:11.4604153Z  2024-12-18T00:48:11.4604552Z  2024-12-18T00:48:11.4605503Z [13,422 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:11.4606604Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:48:11.4607529Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:48:11.4608477Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:48:11.4609330Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local 2024-12-18T00:48:11.4610345Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2024-12-18T00:48:11.4611380Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 14s local 2024-12-18T00:48:11.4612356Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 10s local 2024-12-18T00:48:11.4613277Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2024-12-18T00:48:11.6923637Z 2024-12-18T00:48:11.6925004Z  2024-12-18T00:48:11.6925526Z  2024-12-18T00:48:11.6925939Z  2024-12-18T00:48:11.6926269Z  2024-12-18T00:48:11.6926644Z  2024-12-18T00:48:11.6926999Z  2024-12-18T00:48:11.6927406Z  2024-12-18T00:48:11.6927790Z  2024-12-18T00:48:11.6928712Z [13,452 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:11.6929594Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:48:11.6930396Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:48:11.6931192Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local 2024-12-18T00:48:11.6932042Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local 2024-12-18T00:48:11.6932933Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:48:11.6933829Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 14s local 2024-12-18T00:48:11.6934709Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 11s local 2024-12-18T00:48:11.6935579Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2024-12-18T00:48:11.8912162Z 2024-12-18T00:48:11.8913525Z  2024-12-18T00:48:11.8914029Z  2024-12-18T00:48:11.8914432Z  2024-12-18T00:48:11.8914843Z  2024-12-18T00:48:11.8915269Z  2024-12-18T00:48:11.8915687Z  2024-12-18T00:48:11.8916082Z  2024-12-18T00:48:11.8916666Z  2024-12-18T00:48:11.8917664Z [13,489 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:48:11.8918789Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:48:11.8919716Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:48:11.8920896Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:48:11.8921781Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local 2024-12-18T00:48:11.8922921Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:48:11.8923929Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 14s local 2024-12-18T00:48:11.8924900Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 11s local 2024-12-18T00:48:11.8925849Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2024-12-18T00:48:12.0943897Z 2024-12-18T00:48:12.0952439Z  2024-12-18T00:48:12.0952983Z  2024-12-18T00:48:12.0953400Z  2024-12-18T00:48:12.0953803Z  2024-12-18T00:48:12.0954179Z  2024-12-18T00:48:12.0954565Z  2024-12-18T00:48:12.0954964Z  2024-12-18T00:48:12.0955385Z  2024-12-18T00:48:12.0956338Z [13,628 / 20,602] 3 / 17 tests; 48 actions, 45 running; last test: ...ash_test 2024-12-18T00:48:12.0957405Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2024-12-18T00:48:12.0958311Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2024-12-18T00:48:12.0959215Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:48:12.0960037Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local 2024-12-18T00:48:12.0960984Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:48:12.0961952Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 14s local 2024-12-18T00:48:12.0962887Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 11s local 2024-12-18T00:48:12.0963752Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:48:12.3481531Z 2024-12-18T00:48:12.3482845Z  2024-12-18T00:48:12.3483354Z  2024-12-18T00:48:12.3483762Z  2024-12-18T00:48:12.3484153Z  2024-12-18T00:48:12.3484565Z  2024-12-18T00:48:12.3484966Z  2024-12-18T00:48:12.3485375Z  2024-12-18T00:48:12.3485789Z  2024-12-18T00:48:12.3486742Z [13,640 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:12.3488295Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:48:12.3489275Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:12.3490324Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:48:12.3491192Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local 2024-12-18T00:48:12.3492135Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2024-12-18T00:48:12.3493095Z Compiling src/cpu/x64/jit_uni_reorder.cpp; 15s local 2024-12-18T00:48:12.3493982Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 11s local 2024-12-18T00:48:12.3494783Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2024-12-18T00:48:12.5928655Z 2024-12-18T00:48:12.5929880Z  2024-12-18T00:48:12.5930405Z  2024-12-18T00:48:12.5930835Z  2024-12-18T00:48:12.5931290Z  2024-12-18T00:48:12.5931695Z  2024-12-18T00:48:12.5932098Z  2024-12-18T00:48:12.5932512Z  2024-12-18T00:48:12.5932927Z  2024-12-18T00:48:12.5933843Z [13,641 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:12.5934791Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:48:12.5935620Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:12.5936667Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:48:12.5937856Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local 2024-12-18T00:48:12.5938830Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:48:12.5939832Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local 2024-12-18T00:48:12.5940559Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:48:12.5941313Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 11s local ... 2024-12-18T00:48:12.7933022Z 2024-12-18T00:48:12.7933952Z  2024-12-18T00:48:12.7934382Z  2024-12-18T00:48:12.7934734Z  2024-12-18T00:48:12.7935074Z  2024-12-18T00:48:12.7935436Z  2024-12-18T00:48:12.7936005Z  2024-12-18T00:48:12.7936382Z  2024-12-18T00:48:12.7936929Z  2024-12-18T00:48:12.7937835Z [13,642 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:12.7938802Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:48:12.7939804Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:12.7940741Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local 2024-12-18T00:48:12.7941541Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local 2024-12-18T00:48:12.7942449Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:48:12.7943452Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local 2024-12-18T00:48:12.7944614Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:48:12.7945343Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 11s local ... 2024-12-18T00:48:13.0706250Z 2024-12-18T00:48:13.0707553Z  2024-12-18T00:48:13.0708082Z  2024-12-18T00:48:13.0708477Z  2024-12-18T00:48:13.0708837Z  2024-12-18T00:48:13.0709216Z  2024-12-18T00:48:13.0709660Z  2024-12-18T00:48:13.0710092Z  2024-12-18T00:48:13.0710482Z  2024-12-18T00:48:13.0711461Z [13,644 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:13.0712436Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2024-12-18T00:48:13.0713251Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:13.0714126Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 20s local 2024-12-18T00:48:13.0715073Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:48:13.0716070Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local 2024-12-18T00:48:13.0716901Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:48:13.0717652Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 11s local 2024-12-18T00:48:13.0718610Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 11s local ... 2024-12-18T00:48:13.3785208Z 2024-12-18T00:48:13.3786417Z  2024-12-18T00:48:13.3789316Z  2024-12-18T00:48:13.3790116Z  2024-12-18T00:48:13.3790623Z  2024-12-18T00:48:13.3792640Z  2024-12-18T00:48:13.3793485Z  2024-12-18T00:48:13.3794003Z  2024-12-18T00:48:13.3795847Z  2024-12-18T00:48:13.3797024Z [13,651 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:13.3798201Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:48:13.3800644Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:48:13.3801833Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 20s local 2024-12-18T00:48:13.3802975Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2024-12-18T00:48:13.3805490Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local 2024-12-18T00:48:13.3806605Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:48:13.3808141Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 12s local 2024-12-18T00:48:13.3809147Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local ... 2024-12-18T00:48:13.5940121Z 2024-12-18T00:48:13.5940976Z  2024-12-18T00:48:13.5941498Z  2024-12-18T00:48:13.5941934Z  2024-12-18T00:48:13.5942345Z  2024-12-18T00:48:13.5942764Z  2024-12-18T00:48:13.5943188Z  2024-12-18T00:48:13.5943594Z  2024-12-18T00:48:13.5944019Z  2024-12-18T00:48:13.5948314Z [13,654 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:13.5949416Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:48:13.5950723Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:48:13.5951822Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:48:13.5953038Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 13s local 2024-12-18T00:48:13.5953928Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:48:13.5954708Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 12s local 2024-12-18T00:48:13.5955763Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local 2024-12-18T00:48:13.5956949Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_conv_kernel.cpp; 12s local ... 2024-12-18T00:48:13.7945875Z 2024-12-18T00:48:13.7946702Z  2024-12-18T00:48:13.7947195Z  2024-12-18T00:48:13.7947630Z  2024-12-18T00:48:13.7948021Z  2024-12-18T00:48:13.7948428Z  2024-12-18T00:48:13.7948849Z  2024-12-18T00:48:13.7949272Z  2024-12-18T00:48:13.7949700Z  2024-12-18T00:48:13.7950697Z [13,660 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:13.7951804Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2024-12-18T00:48:13.7952697Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:48:13.7953758Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2024-12-18T00:48:13.7954830Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 13s local 2024-12-18T00:48:13.7955731Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:48:13.7956489Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 12s local 2024-12-18T00:48:13.7957411Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local 2024-12-18T00:48:13.7958564Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 11s local ... 2024-12-18T00:48:14.1713398Z 2024-12-18T00:48:14.1714311Z  2024-12-18T00:48:14.1714788Z  2024-12-18T00:48:14.1715248Z  2024-12-18T00:48:14.1715801Z  2024-12-18T00:48:14.1716218Z  2024-12-18T00:48:14.1716584Z  2024-12-18T00:48:14.1717119Z  2024-12-18T00:48:14.1717521Z  2024-12-18T00:48:14.1718494Z [13,662 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:14.1719484Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:48:14.1720277Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:48:14.1721250Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 13s local 2024-12-18T00:48:14.1722115Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:48:14.1722858Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 13s local 2024-12-18T00:48:14.1723798Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2024-12-18T00:48:14.1724940Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 11s local 2024-12-18T00:48:14.1726146Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 8s local ... 2024-12-18T00:48:14.3952082Z 2024-12-18T00:48:14.3952927Z  2024-12-18T00:48:14.3953427Z  2024-12-18T00:48:14.3953839Z  2024-12-18T00:48:14.3954286Z  2024-12-18T00:48:14.3954707Z  2024-12-18T00:48:14.3955101Z  2024-12-18T00:48:14.3955488Z  2024-12-18T00:48:14.3955897Z  2024-12-18T00:48:14.3956877Z [13,665 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:14.3957995Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:48:14.3958873Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:48:14.3959842Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 13s local 2024-12-18T00:48:14.3960711Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:48:14.3961403Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 13s local 2024-12-18T00:48:14.3962302Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2024-12-18T00:48:14.3963884Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 11s local 2024-12-18T00:48:14.3965258Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 9s local ... 2024-12-18T00:48:14.5954853Z 2024-12-18T00:48:14.5955797Z  2024-12-18T00:48:14.5956286Z  2024-12-18T00:48:14.5956646Z  2024-12-18T00:48:14.5956980Z  2024-12-18T00:48:14.5957328Z  2024-12-18T00:48:14.5957681Z  2024-12-18T00:48:14.5958037Z  2024-12-18T00:48:14.5958400Z  2024-12-18T00:48:14.5959769Z [13,669 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:14.5960782Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:48:14.5961661Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:48:14.5962843Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local 2024-12-18T00:48:14.5963750Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:48:14.5964507Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 13s local 2024-12-18T00:48:14.5965434Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2024-12-18T00:48:14.5966591Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 11s local 2024-12-18T00:48:14.5967791Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 9s local ... 2024-12-18T00:48:14.9220917Z 2024-12-18T00:48:14.9221846Z  2024-12-18T00:48:14.9222326Z  2024-12-18T00:48:14.9222744Z  2024-12-18T00:48:14.9223186Z  2024-12-18T00:48:14.9223610Z  2024-12-18T00:48:14.9224007Z  2024-12-18T00:48:14.9224369Z  2024-12-18T00:48:14.9224766Z  2024-12-18T00:48:14.9225769Z [13,674 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:14.9226891Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2024-12-18T00:48:14.9227850Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:48:14.9228794Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local 2024-12-18T00:48:14.9229671Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:48:14.9230592Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 13s local 2024-12-18T00:48:14.9231569Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2024-12-18T00:48:14.9232680Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 12s local 2024-12-18T00:48:14.9233783Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 9s local ... 2024-12-18T00:48:15.1960235Z 2024-12-18T00:48:15.1961115Z  2024-12-18T00:48:15.1961609Z  2024-12-18T00:48:15.1962013Z  2024-12-18T00:48:15.1962418Z  2024-12-18T00:48:15.1962801Z  2024-12-18T00:48:15.1963193Z  2024-12-18T00:48:15.1963596Z  2024-12-18T00:48:15.1964015Z  2024-12-18T00:48:15.1965126Z [13,679 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:15.1966209Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:48:15.1967084Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:15.1968224Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local 2024-12-18T00:48:15.1969096Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:48:15.1969830Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 14s local 2024-12-18T00:48:15.1970775Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2024-12-18T00:48:15.1971867Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 9s local 2024-12-18T00:48:15.1972958Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 9s local ... 2024-12-18T00:48:15.4251465Z 2024-12-18T00:48:15.4252434Z  2024-12-18T00:48:15.4252963Z  2024-12-18T00:48:15.4253409Z  2024-12-18T00:48:15.4253846Z  2024-12-18T00:48:15.4254513Z  2024-12-18T00:48:15.4254949Z  2024-12-18T00:48:15.4255381Z  2024-12-18T00:48:15.4255807Z  2024-12-18T00:48:15.4257067Z [13,685 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:15.4258211Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:48:15.4259334Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:15.4260353Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local 2024-12-18T00:48:15.4261393Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 14s local 2024-12-18T00:48:15.4262471Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2024-12-18T00:48:15.4263605Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 10s local 2024-12-18T00:48:15.4264707Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 9s local 2024-12-18T00:48:15.4265814Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 9s local ... 2024-12-18T00:48:15.6403679Z 2024-12-18T00:48:15.6404552Z  2024-12-18T00:48:15.6405070Z  2024-12-18T00:48:15.6405487Z  2024-12-18T00:48:15.6405928Z  2024-12-18T00:48:15.6406328Z  2024-12-18T00:48:15.6406732Z  2024-12-18T00:48:15.6407120Z  2024-12-18T00:48:15.6407521Z  2024-12-18T00:48:15.6408493Z [13,690 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:15.6409590Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:48:15.6410544Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:15.6411492Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2024-12-18T00:48:15.6412403Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 14s local 2024-12-18T00:48:15.6413341Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2024-12-18T00:48:15.6414399Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 10s local 2024-12-18T00:48:15.6415460Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 9s local 2024-12-18T00:48:15.6416675Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 6s local ... 2024-12-18T00:48:15.8485276Z 2024-12-18T00:48:15.8486169Z  2024-12-18T00:48:15.8486681Z  2024-12-18T00:48:15.8487099Z  2024-12-18T00:48:15.8487523Z  2024-12-18T00:48:15.8487914Z  2024-12-18T00:48:15.8488331Z  2024-12-18T00:48:15.8488744Z  2024-12-18T00:48:15.8489159Z  2024-12-18T00:48:15.8490108Z [13,695 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:15.8491110Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:48:15.8491978Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:15.8493066Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2024-12-18T00:48:15.8494109Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 14s local 2024-12-18T00:48:15.8495062Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2024-12-18T00:48:15.8496128Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 10s local 2024-12-18T00:48:15.8497396Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 9s local 2024-12-18T00:48:15.8498415Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 6s local ... 2024-12-18T00:48:16.0745096Z 2024-12-18T00:48:16.0745965Z  2024-12-18T00:48:16.0746465Z  2024-12-18T00:48:16.0746881Z  2024-12-18T00:48:16.0747320Z  2024-12-18T00:48:16.0747733Z  2024-12-18T00:48:16.0748142Z  2024-12-18T00:48:16.0748694Z  2024-12-18T00:48:16.0749080Z  2024-12-18T00:48:16.0750172Z [13,696 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:16.0751218Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2024-12-18T00:48:16.0752061Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:16.0753316Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2024-12-18T00:48:16.0754211Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 14s local 2024-12-18T00:48:16.0755310Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2024-12-18T00:48:16.0756420Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 10s local 2024-12-18T00:48:16.0757445Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 10s local 2024-12-18T00:48:16.0758666Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 7s local ... 2024-12-18T00:48:16.3680906Z 2024-12-18T00:48:16.3681816Z  2024-12-18T00:48:16.3682396Z  2024-12-18T00:48:16.3682781Z  2024-12-18T00:48:16.3683184Z  2024-12-18T00:48:16.3683581Z  2024-12-18T00:48:16.3683951Z  2024-12-18T00:48:16.3684351Z  2024-12-18T00:48:16.3684721Z  2024-12-18T00:48:16.3685666Z [13,700 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:16.3686727Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:48:16.3687603Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2024-12-18T00:48:16.3688491Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2024-12-18T00:48:16.3689445Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 15s local 2024-12-18T00:48:16.3690419Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2024-12-18T00:48:16.3691466Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 10s local 2024-12-18T00:48:16.3692489Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 10s local 2024-12-18T00:48:16.3693555Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 7s local ... 2024-12-18T00:48:16.5792504Z 2024-12-18T00:48:16.5793365Z  2024-12-18T00:48:16.5793884Z  2024-12-18T00:48:16.5794302Z  2024-12-18T00:48:16.5794720Z  2024-12-18T00:48:16.5795140Z  2024-12-18T00:48:16.5795534Z  2024-12-18T00:48:16.5795937Z  2024-12-18T00:48:16.5796348Z  2024-12-18T00:48:16.5797341Z [13,705 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:16.5798404Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:48:16.5799308Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2024-12-18T00:48:16.5800234Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2024-12-18T00:48:16.5801106Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 15s local 2024-12-18T00:48:16.5802005Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2024-12-18T00:48:16.5803062Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 11s local 2024-12-18T00:48:16.5804108Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 10s local 2024-12-18T00:48:16.5805148Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 7s local ... 2024-12-18T00:48:16.7976728Z 2024-12-18T00:48:16.7977604Z  2024-12-18T00:48:16.7978046Z  2024-12-18T00:48:16.7978429Z  2024-12-18T00:48:16.7978816Z  2024-12-18T00:48:16.7979234Z  2024-12-18T00:48:16.7979591Z  2024-12-18T00:48:16.7989573Z  2024-12-18T00:48:16.7990346Z  2024-12-18T00:48:16.7991316Z [13,707 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:16.7992357Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:48:16.7993247Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2024-12-18T00:48:16.7994121Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 15s local 2024-12-18T00:48:16.7995023Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2024-12-18T00:48:16.7996095Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 11s local 2024-12-18T00:48:16.7997093Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 10s local 2024-12-18T00:48:16.7998500Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 7s local 2024-12-18T00:48:16.7999569Z Compiling src/crypto/fipsmodule/bcm.c; 5s local ... 2024-12-18T00:48:17.0966998Z 2024-12-18T00:48:17.0967833Z  2024-12-18T00:48:17.0968297Z  2024-12-18T00:48:17.0968717Z  2024-12-18T00:48:17.0969115Z  2024-12-18T00:48:17.0969490Z  2024-12-18T00:48:17.0969874Z  2024-12-18T00:48:17.0970292Z  2024-12-18T00:48:17.0970707Z  2024-12-18T00:48:17.0972051Z [13,710 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:17.0973088Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2024-12-18T00:48:17.0973952Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2024-12-18T00:48:17.0974812Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 15s local 2024-12-18T00:48:17.0975741Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2024-12-18T00:48:17.0976971Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 11s local 2024-12-18T00:48:17.0978005Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 11s local 2024-12-18T00:48:17.0979014Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 8s local 2024-12-18T00:48:17.0979929Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2024-12-18T00:48:17.3762433Z 2024-12-18T00:48:17.3763340Z  2024-12-18T00:48:17.3763828Z  2024-12-18T00:48:17.3764238Z  2024-12-18T00:48:17.3764680Z  2024-12-18T00:48:17.3765088Z  2024-12-18T00:48:17.3765484Z  2024-12-18T00:48:17.3765894Z  2024-12-18T00:48:17.3766300Z  2024-12-18T00:48:17.3767289Z [13,715 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:17.3768348Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:48:17.3769268Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2024-12-18T00:48:17.3770181Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local 2024-12-18T00:48:17.3771177Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2024-12-18T00:48:17.3772279Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 12s local 2024-12-18T00:48:17.3773346Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 11s local 2024-12-18T00:48:17.3774412Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 8s local 2024-12-18T00:48:17.3775343Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2024-12-18T00:48:17.5845665Z 2024-12-18T00:48:17.5846535Z  2024-12-18T00:48:17.5847047Z  2024-12-18T00:48:17.5847483Z  2024-12-18T00:48:17.5847912Z  2024-12-18T00:48:17.5848321Z  2024-12-18T00:48:17.5848876Z  2024-12-18T00:48:17.5849293Z  2024-12-18T00:48:17.5849687Z  2024-12-18T00:48:17.5850632Z [13,721 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:17.5851672Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:48:17.5852590Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2024-12-18T00:48:17.5853666Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local 2024-12-18T00:48:17.5854575Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2024-12-18T00:48:17.5855621Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 12s local 2024-12-18T00:48:17.5856833Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 11s local 2024-12-18T00:48:17.5857841Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 8s local 2024-12-18T00:48:17.5858777Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2024-12-18T00:48:17.7985601Z 2024-12-18T00:48:17.7986500Z  2024-12-18T00:48:17.7986998Z  2024-12-18T00:48:17.7987384Z  2024-12-18T00:48:17.7987781Z  2024-12-18T00:48:17.7988375Z  2024-12-18T00:48:17.7988768Z  2024-12-18T00:48:17.7989134Z  2024-12-18T00:48:17.7989507Z  2024-12-18T00:48:17.7990648Z [13,724 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:17.7991674Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:48:17.7992574Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2024-12-18T00:48:17.7993472Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local 2024-12-18T00:48:17.7994636Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2024-12-18T00:48:17.7995826Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 12s local 2024-12-18T00:48:17.7996896Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 11s local 2024-12-18T00:48:17.7997893Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 8s local 2024-12-18T00:48:17.7998767Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2024-12-18T00:48:18.0486224Z 2024-12-18T00:48:18.0487083Z  2024-12-18T00:48:18.0487575Z  2024-12-18T00:48:18.0488008Z  2024-12-18T00:48:18.0488397Z  2024-12-18T00:48:18.0488811Z  2024-12-18T00:48:18.0489245Z  2024-12-18T00:48:18.0489661Z  2024-12-18T00:48:18.0490081Z  2024-12-18T00:48:18.0491056Z [13,731 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:18.0492153Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2024-12-18T00:48:18.0493102Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2024-12-18T00:48:18.0494047Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local 2024-12-18T00:48:18.0495039Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2024-12-18T00:48:18.0496203Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 12s local 2024-12-18T00:48:18.0497661Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:48:18.0498784Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 9s local 2024-12-18T00:48:18.0499772Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2024-12-18T00:48:18.3769158Z 2024-12-18T00:48:18.3770030Z  2024-12-18T00:48:18.3770711Z  2024-12-18T00:48:18.3771143Z  2024-12-18T00:48:18.3771559Z  2024-12-18T00:48:18.3771992Z  2024-12-18T00:48:18.3772430Z  2024-12-18T00:48:18.3772873Z  2024-12-18T00:48:18.3773285Z  2024-12-18T00:48:18.3774296Z [13,738 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:18.3775357Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:48:18.3776295Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2024-12-18T00:48:18.3777399Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local 2024-12-18T00:48:18.3778327Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2024-12-18T00:48:18.3779470Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 13s local 2024-12-18T00:48:18.3780676Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:48:18.3781732Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 9s local 2024-12-18T00:48:18.3782689Z Compiling src/crypto/fipsmodule/bcm.c; 7s local ... 2024-12-18T00:48:18.5993305Z 2024-12-18T00:48:18.5994192Z  2024-12-18T00:48:18.5994646Z  2024-12-18T00:48:18.5995052Z  2024-12-18T00:48:18.5995452Z  2024-12-18T00:48:18.5995899Z  2024-12-18T00:48:18.5996310Z  2024-12-18T00:48:18.5996706Z  2024-12-18T00:48:18.5997106Z  2024-12-18T00:48:18.5997992Z [13,741 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:18.5998939Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:48:18.5999830Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2024-12-18T00:48:18.6001065Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local 2024-12-18T00:48:18.6002004Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2024-12-18T00:48:18.6003222Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 13s local 2024-12-18T00:48:18.6004249Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:48:18.6005285Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 9s local 2024-12-18T00:48:18.6006334Z Compiling src/crypto/fipsmodule/bcm.c; 7s local ... 2024-12-18T00:48:18.8267832Z 2024-12-18T00:48:18.8268670Z  2024-12-18T00:48:18.8269152Z  2024-12-18T00:48:18.8269590Z  2024-12-18T00:48:18.8269995Z  2024-12-18T00:48:18.8270401Z  2024-12-18T00:48:18.8270825Z  2024-12-18T00:48:18.8271250Z  2024-12-18T00:48:18.8271651Z  2024-12-18T00:48:18.8272613Z [13,742 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:18.8273735Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:48:18.8274611Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2024-12-18T00:48:18.8275463Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local 2024-12-18T00:48:18.8276362Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2024-12-18T00:48:18.8277426Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 13s local 2024-12-18T00:48:18.8278461Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 12s local 2024-12-18T00:48:18.8279472Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 9s local 2024-12-18T00:48:18.8280415Z Compiling src/crypto/fipsmodule/bcm.c; 7s local ... 2024-12-18T00:48:19.0277728Z 2024-12-18T00:48:19.0278620Z  2024-12-18T00:48:19.0279097Z  2024-12-18T00:48:19.0279492Z  2024-12-18T00:48:19.0279892Z  2024-12-18T00:48:19.0280281Z  2024-12-18T00:48:19.0280709Z  2024-12-18T00:48:19.0281094Z  2024-12-18T00:48:19.0281485Z  2024-12-18T00:48:19.0282449Z [13,750 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:19.0283476Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2024-12-18T00:48:19.0284352Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2024-12-18T00:48:19.0285224Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local 2024-12-18T00:48:19.0286135Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2024-12-18T00:48:19.0287188Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 13s local 2024-12-18T00:48:19.0288201Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:48:19.0289199Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 10s local 2024-12-18T00:48:19.0290089Z Compiling src/crypto/fipsmodule/bcm.c; 7s local ... 2024-12-18T00:48:19.3305150Z 2024-12-18T00:48:19.3306064Z  2024-12-18T00:48:19.3306540Z  2024-12-18T00:48:19.3306952Z  2024-12-18T00:48:19.3307361Z  2024-12-18T00:48:19.3307753Z  2024-12-18T00:48:19.3308187Z  2024-12-18T00:48:19.3308598Z  2024-12-18T00:48:19.3309193Z  2024-12-18T00:48:19.3310195Z [13,754 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:19.3311221Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:48:19.3312205Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2024-12-18T00:48:19.3313045Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:48:19.3313959Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:48:19.3314965Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 13s local 2024-12-18T00:48:19.3316055Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:48:19.3317319Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 10s local 2024-12-18T00:48:19.3318275Z Compiling src/crypto/fipsmodule/bcm.c; 8s local ... 2024-12-18T00:48:19.6002773Z 2024-12-18T00:48:19.6003937Z  2024-12-18T00:48:19.6004472Z  2024-12-18T00:48:19.6004863Z  2024-12-18T00:48:19.6005245Z  2024-12-18T00:48:19.6005618Z  2024-12-18T00:48:19.6005997Z  2024-12-18T00:48:19.6006388Z  2024-12-18T00:48:19.6006753Z  2024-12-18T00:48:19.6007917Z [13,757 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:19.6009006Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:48:19.6009870Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:48:19.6010728Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:48:19.6011584Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:48:19.6012621Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 14s local 2024-12-18T00:48:19.6013626Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:48:19.6014629Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 10s local 2024-12-18T00:48:19.6015521Z Compiling src/crypto/fipsmodule/bcm.c; 8s local ... 2024-12-18T00:48:19.8007688Z 2024-12-18T00:48:19.8008562Z  2024-12-18T00:48:19.8009065Z  2024-12-18T00:48:19.8009497Z  2024-12-18T00:48:19.8009915Z  2024-12-18T00:48:19.8010341Z  2024-12-18T00:48:19.8010752Z  2024-12-18T00:48:19.8011159Z  2024-12-18T00:48:19.8011557Z  2024-12-18T00:48:19.8012504Z [13,763 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:19.8013571Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:48:19.8014469Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:48:19.8015417Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:48:19.8016390Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:48:19.8017674Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 14s local 2024-12-18T00:48:19.8018713Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 13s local 2024-12-18T00:48:19.8019782Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 10s local 2024-12-18T00:48:19.8020927Z Compiling src/crypto/fipsmodule/bcm.c; 8s local ... 2024-12-18T00:48:20.0462186Z 2024-12-18T00:48:20.0463046Z  2024-12-18T00:48:20.0463518Z  2024-12-18T00:48:20.0463901Z  2024-12-18T00:48:20.0464276Z  2024-12-18T00:48:20.0464707Z  2024-12-18T00:48:20.0465084Z  2024-12-18T00:48:20.0465448Z  2024-12-18T00:48:20.0465803Z  2024-12-18T00:48:20.0466709Z [13,768 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:20.0467715Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2024-12-18T00:48:20.0468599Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:48:20.0469483Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2024-12-18T00:48:20.0470404Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2024-12-18T00:48:20.0471442Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 14s local 2024-12-18T00:48:20.0472421Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 14s local 2024-12-18T00:48:20.0473380Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 11s local 2024-12-18T00:48:20.0474289Z Compiling src/crypto/fipsmodule/bcm.c; 8s local ... 2024-12-18T00:48:20.2670460Z 2024-12-18T00:48:20.2671332Z  2024-12-18T00:48:20.2671829Z  2024-12-18T00:48:20.2672251Z  2024-12-18T00:48:20.2672620Z  2024-12-18T00:48:20.2673000Z  2024-12-18T00:48:20.2673722Z  2024-12-18T00:48:20.2674125Z  2024-12-18T00:48:20.2674540Z  2024-12-18T00:48:20.2675663Z [13,772 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:20.2676683Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:48:20.2677566Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:48:20.2678459Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2024-12-18T00:48:20.2679514Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2024-12-18T00:48:20.2680697Z Compiling src/cpu/x64/jit_uni_x8s8s32x_1x1_convolution.cpp; 14s local 2024-12-18T00:48:20.2681709Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 14s local 2024-12-18T00:48:20.2682737Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 11s local 2024-12-18T00:48:20.2683671Z Compiling src/crypto/fipsmodule/bcm.c; 9s local ... 2024-12-18T00:48:20.5479527Z 2024-12-18T00:48:20.5480443Z  2024-12-18T00:48:20.5480936Z  2024-12-18T00:48:20.5481343Z  2024-12-18T00:48:20.5481717Z  2024-12-18T00:48:20.5482125Z  2024-12-18T00:48:20.5482537Z  2024-12-18T00:48:20.5482960Z  2024-12-18T00:48:20.5483351Z  2024-12-18T00:48:20.5484298Z [13,779 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:20.5485328Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:48:20.5486259Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2024-12-18T00:48:20.5487183Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2024-12-18T00:48:20.5488129Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2024-12-18T00:48:20.5489120Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 14s local 2024-12-18T00:48:20.5490031Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 11s local 2024-12-18T00:48:20.5491051Z Compiling src/crypto/fipsmodule/bcm.c; 9s local 2024-12-18T00:48:20.5491795Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 9s local ... 2024-12-18T00:48:20.7818390Z 2024-12-18T00:48:20.7819269Z  2024-12-18T00:48:20.7819793Z  2024-12-18T00:48:20.7820395Z  2024-12-18T00:48:20.7820806Z  2024-12-18T00:48:20.7821212Z  2024-12-18T00:48:20.7821627Z  2024-12-18T00:48:20.7822042Z  2024-12-18T00:48:20.7822515Z  2024-12-18T00:48:20.7823521Z [13,787 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:20.7824496Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:48:20.7825276Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2024-12-18T00:48:20.7826192Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2024-12-18T00:48:20.7827257Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 14s local 2024-12-18T00:48:20.7828317Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 11s local 2024-12-18T00:48:20.7829196Z Compiling src/crypto/fipsmodule/bcm.c; 9s local 2024-12-18T00:48:20.7829980Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 9s local 2024-12-18T00:48:20.7830895Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 8s local ... 2024-12-18T00:48:21.0018366Z 2024-12-18T00:48:21.0019243Z  2024-12-18T00:48:21.0019727Z  2024-12-18T00:48:21.0020097Z  2024-12-18T00:48:21.0020469Z  2024-12-18T00:48:21.0020873Z  2024-12-18T00:48:21.0021276Z  2024-12-18T00:48:21.0021730Z  2024-12-18T00:48:21.0022122Z  2024-12-18T00:48:21.0023099Z [13,788 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:21.0024020Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2024-12-18T00:48:21.0024842Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2024-12-18T00:48:21.0025791Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2024-12-18T00:48:21.0027059Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 15s local 2024-12-18T00:48:21.0028208Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 12s local 2024-12-18T00:48:21.0029119Z Compiling src/crypto/fipsmodule/bcm.c; 9s local 2024-12-18T00:48:21.0029904Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 9s local 2024-12-18T00:48:21.0030842Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 8s local ... 2024-12-18T00:48:21.2096312Z 2024-12-18T00:48:21.2097275Z  2024-12-18T00:48:21.2098147Z  2024-12-18T00:48:21.2098589Z  2024-12-18T00:48:21.2099001Z  2024-12-18T00:48:21.2099404Z  2024-12-18T00:48:21.2099813Z  2024-12-18T00:48:21.2100213Z  2024-12-18T00:48:21.2100619Z  2024-12-18T00:48:21.2101551Z [13,795 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:21.2102540Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:48:21.2103394Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:48:21.2104379Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2024-12-18T00:48:21.2105449Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 15s local 2024-12-18T00:48:21.2106514Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 12s local 2024-12-18T00:48:21.2107400Z Compiling src/crypto/fipsmodule/bcm.c; 10s local 2024-12-18T00:48:21.2108211Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 9s local 2024-12-18T00:48:21.2109164Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 9s local ... 2024-12-18T00:48:21.5860574Z 2024-12-18T00:48:21.5861474Z  2024-12-18T00:48:21.5861962Z  2024-12-18T00:48:21.5862376Z  2024-12-18T00:48:21.5862788Z  2024-12-18T00:48:21.5863206Z  2024-12-18T00:48:21.5863595Z  2024-12-18T00:48:21.5864016Z  2024-12-18T00:48:21.5864474Z  2024-12-18T00:48:21.5865344Z [13,801 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:21.5866430Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:48:21.5867185Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:48:21.5868104Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2024-12-18T00:48:21.5869035Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 15s local 2024-12-18T00:48:21.5870053Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 12s local 2024-12-18T00:48:21.5870942Z Compiling src/crypto/fipsmodule/bcm.c; 10s local 2024-12-18T00:48:21.5871741Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 10s local 2024-12-18T00:48:21.5872634Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 9s local ... 2024-12-18T00:48:21.8026002Z 2024-12-18T00:48:21.8026906Z  2024-12-18T00:48:21.8027385Z  2024-12-18T00:48:21.8027842Z  2024-12-18T00:48:21.8028233Z  2024-12-18T00:48:21.8028623Z  2024-12-18T00:48:21.8029018Z  2024-12-18T00:48:21.8029414Z  2024-12-18T00:48:21.8029811Z  2024-12-18T00:48:21.8030793Z [13,804 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:21.8031842Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:48:21.8032678Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:48:21.8033643Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2024-12-18T00:48:21.8034757Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 15s local 2024-12-18T00:48:21.8035802Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 12s local 2024-12-18T00:48:21.8036774Z Compiling src/crypto/fipsmodule/bcm.c; 10s local 2024-12-18T00:48:21.8037570Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 10s local 2024-12-18T00:48:21.8038470Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 9s local ... 2024-12-18T00:48:22.0151845Z 2024-12-18T00:48:22.0152692Z  2024-12-18T00:48:22.0153216Z  2024-12-18T00:48:22.0153644Z  2024-12-18T00:48:22.0154338Z  2024-12-18T00:48:22.0154733Z  2024-12-18T00:48:22.0155241Z  2024-12-18T00:48:22.0155646Z  2024-12-18T00:48:22.0156049Z  2024-12-18T00:48:22.0157285Z [13,808 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:22.0158531Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2024-12-18T00:48:22.0159465Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2024-12-18T00:48:22.0160419Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2024-12-18T00:48:22.0161474Z Compiling src/cpu/x64/jit_uni_x8s8s32x_conv_kernel.cpp; 16s local 2024-12-18T00:48:22.0162553Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 13s local 2024-12-18T00:48:22.0163519Z Compiling src/crypto/fipsmodule/bcm.c; 10s local 2024-12-18T00:48:22.0164339Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 10s local 2024-12-18T00:48:22.0165438Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 9s local ... 2024-12-18T00:48:22.2599769Z 2024-12-18T00:48:22.2600679Z  2024-12-18T00:48:22.2601164Z  2024-12-18T00:48:22.2601564Z  2024-12-18T00:48:22.2601978Z  2024-12-18T00:48:22.2602376Z  2024-12-18T00:48:22.2602776Z  2024-12-18T00:48:22.2603159Z  2024-12-18T00:48:22.2603550Z  2024-12-18T00:48:22.2604555Z [13,819 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:48:22.2605608Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:48:22.2606396Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:48:22.2607323Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 21s local 2024-12-18T00:48:22.2608438Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 13s local 2024-12-18T00:48:22.2609399Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 10s local 2024-12-18T00:48:22.2610397Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:48:22.2611591Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 10s local 2024-12-18T00:48:22.2612680Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 9s local ... 2024-12-18T00:48:22.4711835Z 2024-12-18T00:48:22.4712688Z  2024-12-18T00:48:22.4713177Z  2024-12-18T00:48:22.4713812Z  2024-12-18T00:48:22.4714222Z  2024-12-18T00:48:22.4714621Z  2024-12-18T00:48:22.4715046Z  2024-12-18T00:48:22.4715459Z  2024-12-18T00:48:22.4715883Z  2024-12-18T00:48:22.4716855Z [13,823 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:22.4717947Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:48:22.4718768Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:48:22.4719725Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 21s local 2024-12-18T00:48:22.4720843Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 13s local 2024-12-18T00:48:22.4721790Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 11s local 2024-12-18T00:48:22.4722778Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:48:22.4723907Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 10s local 2024-12-18T00:48:22.4724757Z @onednn//:mkl_dnn; 7s local ... 2024-12-18T00:48:22.6742467Z 2024-12-18T00:48:22.6743370Z  2024-12-18T00:48:22.6743839Z  2024-12-18T00:48:22.6744438Z  2024-12-18T00:48:22.6744858Z  2024-12-18T00:48:22.6745223Z  2024-12-18T00:48:22.6745565Z  2024-12-18T00:48:22.6745923Z  2024-12-18T00:48:22.6746341Z  2024-12-18T00:48:22.6747279Z [13,829 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:22.6748848Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:48:22.6749852Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:48:22.6750774Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 13s local 2024-12-18T00:48:22.6751742Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 11s local 2024-12-18T00:48:22.6752767Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:48:22.6754155Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 10s local 2024-12-18T00:48:22.6755271Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 7s local 2024-12-18T00:48:22.6756384Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local ... 2024-12-18T00:48:22.8891738Z 2024-12-18T00:48:22.8892599Z  2024-12-18T00:48:22.8893032Z  2024-12-18T00:48:22.8893441Z  2024-12-18T00:48:22.8893867Z  2024-12-18T00:48:22.8894261Z  2024-12-18T00:48:22.8894634Z  2024-12-18T00:48:22.8894992Z  2024-12-18T00:48:22.8895325Z  2024-12-18T00:48:22.8896257Z [13,838 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:22.8897350Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2024-12-18T00:48:22.8897987Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:48:22.8898891Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 13s local 2024-12-18T00:48:22.8899845Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 11s local 2024-12-18T00:48:22.8900788Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2024-12-18T00:48:22.8901840Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 10s local 2024-12-18T00:48:22.8902913Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 7s local 2024-12-18T00:48:23.1137986Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local ... 2024-12-18T00:48:23.1138700Z 2024-12-18T00:48:23.1139151Z  2024-12-18T00:48:23.1139609Z  2024-12-18T00:48:23.1140043Z  2024-12-18T00:48:23.1140477Z  2024-12-18T00:48:23.1140918Z  2024-12-18T00:48:23.1141346Z  2024-12-18T00:48:23.1141807Z  2024-12-18T00:48:23.1142249Z  2024-12-18T00:48:23.1143179Z [13,845 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:23.1144430Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:48:23.1145300Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2024-12-18T00:48:23.1146251Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 14s local 2024-12-18T00:48:23.1147200Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 11s local 2024-12-18T00:48:23.1148200Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:48:23.1149407Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 8s local 2024-12-18T00:48:23.1150459Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local 2024-12-18T00:48:23.1151230Z @onednn//:mkl_dnn; 3s local ... 2024-12-18T00:48:23.4035278Z 2024-12-18T00:48:23.4036185Z  2024-12-18T00:48:23.4036670Z  2024-12-18T00:48:23.4037050Z  2024-12-18T00:48:23.4037436Z  2024-12-18T00:48:23.4037841Z  2024-12-18T00:48:23.4038235Z  2024-12-18T00:48:23.4038629Z  2024-12-18T00:48:23.4039018Z  2024-12-18T00:48:23.4039991Z [13,847 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:23.4041019Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:48:23.4041801Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2024-12-18T00:48:23.4042678Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 14s local 2024-12-18T00:48:23.4043639Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 12s local 2024-12-18T00:48:23.4045145Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:48:23.4046350Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 8s local 2024-12-18T00:48:23.4047580Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local 2024-12-18T00:48:23.4048368Z @onednn//:mkl_dnn; 4s local ... 2024-12-18T00:48:23.6696995Z 2024-12-18T00:48:23.6698307Z  2024-12-18T00:48:23.6698781Z  2024-12-18T00:48:23.6699193Z  2024-12-18T00:48:23.6699579Z  2024-12-18T00:48:23.6699955Z  2024-12-18T00:48:23.6700729Z  2024-12-18T00:48:23.6701126Z  2024-12-18T00:48:23.6701540Z  2024-12-18T00:48:23.6702507Z [13,850 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:23.6703447Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:48:23.6704242Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2024-12-18T00:48:23.6705130Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 14s local 2024-12-18T00:48:23.6706052Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 12s local 2024-12-18T00:48:23.6707052Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:48:23.6708244Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 8s local 2024-12-18T00:48:23.6709254Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2024-12-18T00:48:23.6710008Z @onednn//:mkl_dnn; 4s local ... 2024-12-18T00:48:23.9111405Z 2024-12-18T00:48:23.9112330Z  2024-12-18T00:48:23.9112866Z  2024-12-18T00:48:23.9113246Z  2024-12-18T00:48:23.9113626Z  2024-12-18T00:48:23.9114004Z  2024-12-18T00:48:23.9114413Z  2024-12-18T00:48:23.9114821Z  2024-12-18T00:48:23.9115210Z  2024-12-18T00:48:23.9116139Z [13,854 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:23.9117109Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2024-12-18T00:48:23.9117876Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2024-12-18T00:48:23.9118924Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 14s local 2024-12-18T00:48:23.9119915Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 12s local 2024-12-18T00:48:23.9121060Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2024-12-18T00:48:23.9122293Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 8s local 2024-12-18T00:48:23.9123395Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2024-12-18T00:48:23.9124200Z @onednn//:mkl_dnn; 4s local ... 2024-12-18T00:48:24.1577833Z 2024-12-18T00:48:24.1578789Z  2024-12-18T00:48:24.1579346Z  2024-12-18T00:48:24.1579784Z  2024-12-18T00:48:24.1580239Z  2024-12-18T00:48:24.1580619Z  2024-12-18T00:48:24.1581061Z  2024-12-18T00:48:24.1581474Z  2024-12-18T00:48:24.1581944Z  2024-12-18T00:48:24.1582924Z [13,857 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:24.1584035Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:48:24.1584808Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:48:24.1585745Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 15s local 2024-12-18T00:48:24.1586722Z Compiling src/cpu/x64/jit_uni_xf16_sum.cpp; 12s local 2024-12-18T00:48:24.1587759Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:48:24.1589013Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2024-12-18T00:48:24.1589949Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2024-12-18T00:48:24.1590650Z @onednn//:mkl_dnn; 5s local ... 2024-12-18T00:48:24.3653972Z 2024-12-18T00:48:24.3654854Z  2024-12-18T00:48:24.3655373Z  2024-12-18T00:48:24.3656027Z  2024-12-18T00:48:24.3656416Z  2024-12-18T00:48:24.3656913Z  2024-12-18T00:48:24.3657293Z  2024-12-18T00:48:24.3657691Z  2024-12-18T00:48:24.3658076Z  2024-12-18T00:48:24.3659128Z [13,865 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:24.3660181Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:48:24.3661031Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:48:24.3662060Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 15s local 2024-12-18T00:48:24.3663233Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:48:24.3664554Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2024-12-18T00:48:24.3665573Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2024-12-18T00:48:24.3666588Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn_fwd_blocked.cpp; 5s local 2024-12-18T00:48:24.3667737Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn_fwd_nhwc.cpp; 5s local ... 2024-12-18T00:48:24.5991794Z 2024-12-18T00:48:24.5992630Z  2024-12-18T00:48:24.5993163Z  2024-12-18T00:48:24.5993632Z  2024-12-18T00:48:24.5994019Z  2024-12-18T00:48:24.5994415Z  2024-12-18T00:48:24.5994797Z  2024-12-18T00:48:24.5995180Z  2024-12-18T00:48:24.5995549Z  2024-12-18T00:48:24.5996480Z [13,868 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:24.5997514Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:48:24.5998319Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:48:24.5999203Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 15s local 2024-12-18T00:48:24.6000330Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:48:24.6001538Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2024-12-18T00:48:24.6002630Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2024-12-18T00:48:24.6003576Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn_fwd_blocked.cpp; 5s local 2024-12-18T00:48:24.6004739Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn_fwd_nhwc.cpp; 5s local ... 2024-12-18T00:48:24.8045124Z 2024-12-18T00:48:24.8046191Z  2024-12-18T00:48:24.8046991Z  2024-12-18T00:48:24.8048022Z  2024-12-18T00:48:24.8048469Z  2024-12-18T00:48:24.8048869Z  2024-12-18T00:48:24.8049259Z  2024-12-18T00:48:24.8049684Z  2024-12-18T00:48:24.8050069Z  2024-12-18T00:48:24.8051025Z [13,872 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:24.8052024Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:48:24.8052843Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:48:24.8053761Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 15s local 2024-12-18T00:48:24.8054886Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2024-12-18T00:48:24.8056096Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2024-12-18T00:48:24.8057348Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2024-12-18T00:48:24.8058370Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn_fwd_nhwc.cpp; 5s local 2024-12-18T00:48:24.8059364Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 5s local ... 2024-12-18T00:48:25.0929811Z 2024-12-18T00:48:25.0930748Z  2024-12-18T00:48:25.0931239Z  2024-12-18T00:48:25.0931629Z  2024-12-18T00:48:25.0932002Z  2024-12-18T00:48:25.0932392Z  2024-12-18T00:48:25.0932796Z  2024-12-18T00:48:25.0933184Z  2024-12-18T00:48:25.0933568Z  2024-12-18T00:48:25.0934483Z [13,877 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:25.0935756Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2024-12-18T00:48:25.0936681Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2024-12-18T00:48:25.0937763Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local 2024-12-18T00:48:25.0938851Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:48:25.0940008Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2024-12-18T00:48:25.0941005Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2024-12-18T00:48:25.0942192Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 5s local 2024-12-18T00:48:25.0943056Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 4s local ... 2024-12-18T00:48:25.3640424Z 2024-12-18T00:48:25.3641263Z  2024-12-18T00:48:25.3641666Z  2024-12-18T00:48:25.3641995Z  2024-12-18T00:48:25.3642320Z  2024-12-18T00:48:25.3642638Z  2024-12-18T00:48:25.3642965Z  2024-12-18T00:48:25.3643316Z  2024-12-18T00:48:25.3643636Z  2024-12-18T00:48:25.3644645Z [13,881 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:25.3645439Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:48:25.3646066Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 24s local 2024-12-18T00:48:25.3646772Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local 2024-12-18T00:48:25.3647628Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:48:25.3648577Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2024-12-18T00:48:25.3649380Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2024-12-18T00:48:25.3650082Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 5s local 2024-12-18T00:48:25.3650760Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 4s local ... 2024-12-18T00:48:25.5953670Z 2024-12-18T00:48:25.5954519Z  2024-12-18T00:48:25.5955034Z  2024-12-18T00:48:25.5955420Z  2024-12-18T00:48:25.5955789Z  2024-12-18T00:48:25.5956155Z  2024-12-18T00:48:25.5956537Z  2024-12-18T00:48:25.5956924Z  2024-12-18T00:48:25.5957295Z  2024-12-18T00:48:25.5958185Z [13,887 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:25.5959164Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:48:25.5960059Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local 2024-12-18T00:48:25.5961111Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:48:25.5962216Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2024-12-18T00:48:25.5963205Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2024-12-18T00:48:25.5964053Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 5s local 2024-12-18T00:48:25.5964850Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 5s local 2024-12-18T00:48:25.5965648Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 4s local ... 2024-12-18T00:48:25.8058751Z 2024-12-18T00:48:25.8059584Z  2024-12-18T00:48:25.8060104Z  2024-12-18T00:48:25.8060491Z  2024-12-18T00:48:25.8060894Z  2024-12-18T00:48:25.8061259Z  2024-12-18T00:48:25.8061644Z  2024-12-18T00:48:25.8062050Z  2024-12-18T00:48:25.8062441Z  2024-12-18T00:48:25.8063420Z [13,890 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:25.8064468Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:48:25.8065436Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local 2024-12-18T00:48:25.8066593Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:48:25.8067716Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2024-12-18T00:48:25.8069142Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2024-12-18T00:48:25.8070021Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 6s local 2024-12-18T00:48:25.8071078Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 5s local 2024-12-18T00:48:25.8071950Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 5s local ... 2024-12-18T00:48:26.0521822Z 2024-12-18T00:48:26.0522643Z  2024-12-18T00:48:26.0523123Z  2024-12-18T00:48:26.0523549Z  2024-12-18T00:48:26.0523909Z  2024-12-18T00:48:26.0524303Z  2024-12-18T00:48:26.0524659Z  2024-12-18T00:48:26.0525471Z  2024-12-18T00:48:26.0525851Z  2024-12-18T00:48:26.0526784Z [13,894 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:26.0527801Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2024-12-18T00:48:26.0528763Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local 2024-12-18T00:48:26.0529892Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2024-12-18T00:48:26.0531065Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2024-12-18T00:48:26.0532127Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2024-12-18T00:48:26.0533026Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 6s local 2024-12-18T00:48:26.0533861Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 5s local 2024-12-18T00:48:26.0534724Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 5s local ... 2024-12-18T00:48:26.2921800Z 2024-12-18T00:48:26.2922685Z  2024-12-18T00:48:26.2923174Z  2024-12-18T00:48:26.2923601Z  2024-12-18T00:48:26.2924016Z  2024-12-18T00:48:26.2924413Z  2024-12-18T00:48:26.2924817Z  2024-12-18T00:48:26.2925227Z  2024-12-18T00:48:26.2925638Z  2024-12-18T00:48:26.2926606Z [13,898 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:26.2927681Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:48:26.2928657Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local 2024-12-18T00:48:26.2929843Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:48:26.2931006Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2024-12-18T00:48:26.2932048Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2024-12-18T00:48:26.2932940Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 6s local 2024-12-18T00:48:26.2933855Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 5s local 2024-12-18T00:48:26.2934735Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 5s local ... 2024-12-18T00:48:26.5471441Z 2024-12-18T00:48:26.5472278Z  2024-12-18T00:48:26.5472749Z  2024-12-18T00:48:26.5473130Z  2024-12-18T00:48:26.5473529Z  2024-12-18T00:48:26.5473935Z  2024-12-18T00:48:26.5474319Z  2024-12-18T00:48:26.5474766Z  2024-12-18T00:48:26.5475152Z  2024-12-18T00:48:26.5476073Z [13,901 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:26.5477111Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:48:26.5478074Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local 2024-12-18T00:48:26.5479132Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:48:26.5480364Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2024-12-18T00:48:26.5481470Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2024-12-18T00:48:26.5482393Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 6s local 2024-12-18T00:48:26.5483186Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 6s local 2024-12-18T00:48:26.5483980Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 5s local ... 2024-12-18T00:48:26.7539773Z 2024-12-18T00:48:26.7540594Z  2024-12-18T00:48:26.7541338Z  2024-12-18T00:48:26.7541732Z  2024-12-18T00:48:26.7542083Z  2024-12-18T00:48:26.7542459Z  2024-12-18T00:48:26.7542833Z  2024-12-18T00:48:26.7543254Z  2024-12-18T00:48:26.7543755Z  2024-12-18T00:48:26.7544917Z [13,908 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:26.7545925Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:48:26.7546828Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local 2024-12-18T00:48:26.7548181Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:48:26.7549382Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2024-12-18T00:48:26.7550397Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2024-12-18T00:48:26.7551334Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 7s local 2024-12-18T00:48:26.7552188Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 6s local 2024-12-18T00:48:26.7553021Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 6s local ... 2024-12-18T00:48:27.0068539Z 2024-12-18T00:48:27.0069410Z  2024-12-18T00:48:27.0069909Z  2024-12-18T00:48:27.0070321Z  2024-12-18T00:48:27.0070729Z  2024-12-18T00:48:27.0071130Z  2024-12-18T00:48:27.0071556Z  2024-12-18T00:48:27.0071954Z  2024-12-18T00:48:27.0072332Z  2024-12-18T00:48:27.0073312Z [13,910 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:27.0074390Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2024-12-18T00:48:27.0075332Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local 2024-12-18T00:48:27.0076484Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2024-12-18T00:48:27.0077704Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2024-12-18T00:48:27.0078796Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2024-12-18T00:48:27.0079749Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 7s local 2024-12-18T00:48:27.0080654Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 6s local 2024-12-18T00:48:27.0081534Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 6s local ... 2024-12-18T00:48:27.2085781Z 2024-12-18T00:48:27.2086602Z  2024-12-18T00:48:27.2087101Z  2024-12-18T00:48:27.2087524Z  2024-12-18T00:48:27.2087941Z  2024-12-18T00:48:27.2088347Z  2024-12-18T00:48:27.2088801Z  2024-12-18T00:48:27.2089205Z  2024-12-18T00:48:27.2089599Z  2024-12-18T00:48:27.2090515Z [13,918 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:27.2091573Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:48:27.2092537Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local 2024-12-18T00:48:27.2093682Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:48:27.2094873Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:48:27.2095878Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2024-12-18T00:48:27.2096970Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 7s local 2024-12-18T00:48:27.2097824Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 6s local 2024-12-18T00:48:27.2098697Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 6s local ... 2024-12-18T00:48:27.4990633Z 2024-12-18T00:48:27.4991504Z  2024-12-18T00:48:27.4991963Z  2024-12-18T00:48:27.4992386Z  2024-12-18T00:48:27.4992781Z  2024-12-18T00:48:27.4993199Z  2024-12-18T00:48:27.4993622Z  2024-12-18T00:48:27.4994030Z  2024-12-18T00:48:27.4994426Z  2024-12-18T00:48:27.4995405Z [13,924 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:27.4996748Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:48:27.4997699Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local 2024-12-18T00:48:27.4998994Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:48:27.5000233Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:48:27.5001304Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2024-12-18T00:48:27.5002255Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 7s local 2024-12-18T00:48:27.5003361Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 7s local 2024-12-18T00:48:27.5004284Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 6s local ... 2024-12-18T00:48:27.7511230Z 2024-12-18T00:48:27.7512113Z  2024-12-18T00:48:27.7512595Z  2024-12-18T00:48:27.7513027Z  2024-12-18T00:48:27.7513440Z  2024-12-18T00:48:27.7513817Z  2024-12-18T00:48:27.7514202Z  2024-12-18T00:48:27.7514626Z  2024-12-18T00:48:27.7515010Z  2024-12-18T00:48:27.7515983Z [13,932 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:27.7517079Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:48:27.7518022Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local 2024-12-18T00:48:27.7519216Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:48:27.7520447Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:48:27.7521538Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2024-12-18T00:48:27.7522455Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 8s local 2024-12-18T00:48:27.7532198Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 7s local 2024-12-18T00:48:27.7533244Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 7s local ... 2024-12-18T00:48:27.9836522Z 2024-12-18T00:48:27.9837325Z  2024-12-18T00:48:27.9837846Z  2024-12-18T00:48:27.9838256Z  2024-12-18T00:48:27.9838656Z  2024-12-18T00:48:27.9839075Z  2024-12-18T00:48:27.9839441Z  2024-12-18T00:48:27.9839846Z  2024-12-18T00:48:27.9840259Z  2024-12-18T00:48:27.9841334Z [13,935 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:27.9842383Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2024-12-18T00:48:27.9843299Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 19s local 2024-12-18T00:48:27.9844728Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2024-12-18T00:48:27.9845903Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2024-12-18T00:48:27.9846912Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2024-12-18T00:48:27.9847825Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 8s local 2024-12-18T00:48:27.9848652Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 7s local 2024-12-18T00:48:27.9849481Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 7s local ... 2024-12-18T00:48:28.2077944Z 2024-12-18T00:48:28.2078782Z  2024-12-18T00:48:28.2079291Z  2024-12-18T00:48:28.2079682Z  2024-12-18T00:48:28.2080092Z  2024-12-18T00:48:28.2080472Z  2024-12-18T00:48:28.2080882Z  2024-12-18T00:48:28.2081289Z  2024-12-18T00:48:28.2081699Z  2024-12-18T00:48:28.2082678Z [13,939 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:28.2083763Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:48:28.2084816Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:48:28.2086081Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 13s local 2024-12-18T00:48:28.2087124Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2024-12-18T00:48:28.2088315Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 8s local 2024-12-18T00:48:28.2089196Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 7s local 2024-12-18T00:48:28.2090182Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 7s local 2024-12-18T00:48:28.2091173Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local ... 2024-12-18T00:48:28.5855615Z 2024-12-18T00:48:28.5856456Z  2024-12-18T00:48:28.5857089Z  2024-12-18T00:48:28.5857497Z  2024-12-18T00:48:28.5857888Z  2024-12-18T00:48:28.5858302Z  2024-12-18T00:48:28.5858684Z  2024-12-18T00:48:28.5859445Z  2024-12-18T00:48:28.5859835Z  2024-12-18T00:48:28.5860782Z [13,942 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:28.5861765Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:48:28.5862805Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:48:28.5864001Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 13s local 2024-12-18T00:48:28.5865018Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2024-12-18T00:48:28.5865914Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 8s local 2024-12-18T00:48:28.5866731Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 8s local 2024-12-18T00:48:28.5867575Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 7s local 2024-12-18T00:48:28.5868534Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local ... 2024-12-18T00:48:28.7878514Z 2024-12-18T00:48:28.7879454Z  2024-12-18T00:48:28.7879932Z  2024-12-18T00:48:28.7880325Z  2024-12-18T00:48:28.7880698Z  2024-12-18T00:48:28.7881068Z  2024-12-18T00:48:28.7881461Z  2024-12-18T00:48:28.7881869Z  2024-12-18T00:48:28.7882274Z  2024-12-18T00:48:28.7883268Z [13,947 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:28.7884349Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:48:28.7885323Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:48:28.7886350Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2024-12-18T00:48:28.7887286Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 9s local 2024-12-18T00:48:28.7888148Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 8s local 2024-12-18T00:48:28.7888990Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 8s local 2024-12-18T00:48:28.7889946Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2024-12-18T00:48:28.7891033Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 7s local ... 2024-12-18T00:48:29.0085697Z 2024-12-18T00:48:29.0086600Z  2024-12-18T00:48:29.0087076Z  2024-12-18T00:48:29.0087497Z  2024-12-18T00:48:29.0088077Z  2024-12-18T00:48:29.0088483Z  2024-12-18T00:48:29.0088890Z  2024-12-18T00:48:29.0089294Z  2024-12-18T00:48:29.0089698Z  2024-12-18T00:48:29.0090706Z [13,954 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:29.0091814Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2024-12-18T00:48:29.0092841Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2024-12-18T00:48:29.0093940Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2024-12-18T00:48:29.0094887Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 9s local 2024-12-18T00:48:29.0095753Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 8s local 2024-12-18T00:48:29.0096774Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 8s local 2024-12-18T00:48:29.0097705Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2024-12-18T00:48:29.0098799Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 7s local ... 2024-12-18T00:48:29.2385800Z 2024-12-18T00:48:29.2386649Z  2024-12-18T00:48:29.2387143Z  2024-12-18T00:48:29.2387809Z  2024-12-18T00:48:29.2388198Z  2024-12-18T00:48:29.2388580Z  2024-12-18T00:48:29.2388962Z  2024-12-18T00:48:29.2389297Z  2024-12-18T00:48:29.2389668Z  2024-12-18T00:48:29.2390790Z [13,962 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:29.2391818Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:48:29.2392681Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2024-12-18T00:48:29.2393723Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 9s local 2024-12-18T00:48:29.2394700Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 8s local 2024-12-18T00:48:29.2395593Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 8s local 2024-12-18T00:48:29.2396474Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2024-12-18T00:48:29.2397488Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 7s local 2024-12-18T00:48:29.2398533Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 6s local ... 2024-12-18T00:48:29.4635903Z 2024-12-18T00:48:29.4636760Z  2024-12-18T00:48:29.4637443Z  2024-12-18T00:48:29.4637861Z  2024-12-18T00:48:29.4638298Z  2024-12-18T00:48:29.4638721Z  2024-12-18T00:48:29.4639143Z  2024-12-18T00:48:29.4639565Z  2024-12-18T00:48:29.4639961Z  2024-12-18T00:48:29.4640928Z [13,972 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:29.4642007Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:48:29.4643205Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2024-12-18T00:48:29.4644431Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 9s local 2024-12-18T00:48:29.4645309Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 9s local 2024-12-18T00:48:29.4646152Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 8s local 2024-12-18T00:48:29.4647109Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 8s local 2024-12-18T00:48:29.4648164Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 7s local 2024-12-18T00:48:29.4649284Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 6s local ... 2024-12-18T00:48:29.6725969Z 2024-12-18T00:48:29.6726827Z  2024-12-18T00:48:29.6727326Z  2024-12-18T00:48:29.6727761Z  2024-12-18T00:48:29.6728191Z  2024-12-18T00:48:29.6728574Z  2024-12-18T00:48:29.6728985Z  2024-12-18T00:48:29.6729417Z  2024-12-18T00:48:29.6729848Z  2024-12-18T00:48:29.6730823Z [13,981 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:29.6731796Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:48:29.6732597Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:29.6733513Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 9s local 2024-12-18T00:48:29.6734396Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 9s local 2024-12-18T00:48:29.6735240Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2024-12-18T00:48:29.6736131Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 8s local 2024-12-18T00:48:29.6737193Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 6s local 2024-12-18T00:48:29.6738107Z @llvm-project//mlir:mlir-tblgen; 6s local ... 2024-12-18T00:48:29.8826863Z 2024-12-18T00:48:29.8827724Z  2024-12-18T00:48:29.8828203Z  2024-12-18T00:48:29.8828612Z  2024-12-18T00:48:29.8829040Z  2024-12-18T00:48:29.8829478Z  2024-12-18T00:48:29.8829887Z  2024-12-18T00:48:29.8830299Z  2024-12-18T00:48:29.8830674Z  2024-12-18T00:48:29.8831628Z [13,994 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:29.8832607Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2024-12-18T00:48:29.8833509Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:29.8834737Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 10s local 2024-12-18T00:48:29.8835633Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 9s local 2024-12-18T00:48:29.8836576Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2024-12-18T00:48:29.8837543Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 8s local 2024-12-18T00:48:29.8838557Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 6s local 2024-12-18T00:48:29.8839616Z @llvm-project//mlir:mlir-tblgen; 6s local ... 2024-12-18T00:48:30.1220806Z 2024-12-18T00:48:30.1221696Z  2024-12-18T00:48:30.1222185Z  2024-12-18T00:48:30.1222583Z  2024-12-18T00:48:30.1222995Z  2024-12-18T00:48:30.1223395Z  2024-12-18T00:48:30.1223750Z  2024-12-18T00:48:30.1224104Z  2024-12-18T00:48:30.1224521Z  2024-12-18T00:48:30.1225484Z [14,001 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:30.1226548Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:48:30.1227427Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:30.1228340Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 10s local 2024-12-18T00:48:30.1229087Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 9s local 2024-12-18T00:48:30.1229933Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2024-12-18T00:48:30.1230916Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 8s local 2024-12-18T00:48:30.1231996Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 7s local 2024-12-18T00:48:30.1232886Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2024-12-18T00:48:30.3392344Z 2024-12-18T00:48:30.3393225Z  2024-12-18T00:48:30.3393700Z  2024-12-18T00:48:30.3394127Z  2024-12-18T00:48:30.3394527Z  2024-12-18T00:48:30.3394918Z  2024-12-18T00:48:30.3395392Z  2024-12-18T00:48:30.3395881Z  2024-12-18T00:48:30.3396270Z  2024-12-18T00:48:30.3397276Z [14,002 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:30.3398323Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:48:30.3399164Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:30.3400046Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 10s local 2024-12-18T00:48:30.3400870Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 9s local 2024-12-18T00:48:30.3401639Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2024-12-18T00:48:30.3402572Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 8s local 2024-12-18T00:48:30.3403692Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 7s local 2024-12-18T00:48:30.3404522Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2024-12-18T00:48:30.5397447Z 2024-12-18T00:48:30.5398337Z  2024-12-18T00:48:30.5399002Z  2024-12-18T00:48:30.5399496Z  2024-12-18T00:48:30.5399946Z  2024-12-18T00:48:30.5400332Z  2024-12-18T00:48:30.5400708Z  2024-12-18T00:48:30.5401097Z  2024-12-18T00:48:30.5401504Z  2024-12-18T00:48:30.5402423Z [14,006 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:30.5403434Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:48:30.5404299Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:30.5405191Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 10s local 2024-12-18T00:48:30.5406009Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 10s local 2024-12-18T00:48:30.5406773Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2024-12-18T00:48:30.5407703Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 8s local 2024-12-18T00:48:30.5408741Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 7s local 2024-12-18T00:48:30.5409916Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2024-12-18T00:48:30.7701662Z 2024-12-18T00:48:30.7702509Z  2024-12-18T00:48:30.7702984Z  2024-12-18T00:48:30.7703378Z  2024-12-18T00:48:30.7704017Z  2024-12-18T00:48:30.7704443Z  2024-12-18T00:48:30.7704825Z  2024-12-18T00:48:30.7705219Z  2024-12-18T00:48:30.7705614Z  2024-12-18T00:48:30.7706560Z [14,010 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:30.7707762Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:48:30.7708728Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2024-12-18T00:48:30.7709633Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2024-12-18T00:48:30.7710504Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 10s local 2024-12-18T00:48:30.7711335Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2024-12-18T00:48:30.7712343Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 9s local 2024-12-18T00:48:30.7713328Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 7s local 2024-12-18T00:48:30.7714218Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2024-12-18T00:48:30.9715802Z 2024-12-18T00:48:30.9716685Z  2024-12-18T00:48:30.9717186Z  2024-12-18T00:48:30.9717581Z  2024-12-18T00:48:30.9717987Z  2024-12-18T00:48:30.9718366Z  2024-12-18T00:48:30.9718753Z  2024-12-18T00:48:30.9719144Z  2024-12-18T00:48:30.9719540Z  2024-12-18T00:48:30.9720514Z [14,016 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:30.9721498Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2024-12-18T00:48:30.9722306Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2024-12-18T00:48:30.9723171Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2024-12-18T00:48:30.9724007Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 10s local 2024-12-18T00:48:30.9724837Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2024-12-18T00:48:30.9725762Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 9s local 2024-12-18T00:48:30.9726881Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 8s local 2024-12-18T00:48:30.9727764Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2024-12-18T00:48:31.1927967Z 2024-12-18T00:48:31.1928814Z  2024-12-18T00:48:31.1929282Z  2024-12-18T00:48:31.1929700Z  2024-12-18T00:48:31.1930114Z  2024-12-18T00:48:31.1930546Z  2024-12-18T00:48:31.1930934Z  2024-12-18T00:48:31.1931345Z  2024-12-18T00:48:31.1931725Z  2024-12-18T00:48:31.1932681Z [14,023 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:31.1933762Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:48:31.1934659Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2024-12-18T00:48:31.1935619Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2024-12-18T00:48:31.1936685Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 10s local 2024-12-18T00:48:31.1937529Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2024-12-18T00:48:31.1938489Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 9s local 2024-12-18T00:48:31.1939548Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 8s local 2024-12-18T00:48:31.1940430Z @llvm-project//mlir:mlir-tblgen; 8s local ... 2024-12-18T00:48:31.4037933Z 2024-12-18T00:48:31.4038782Z  2024-12-18T00:48:31.4039279Z  2024-12-18T00:48:31.4039703Z  2024-12-18T00:48:31.4040131Z  2024-12-18T00:48:31.4040547Z  2024-12-18T00:48:31.4040973Z  2024-12-18T00:48:31.4041406Z  2024-12-18T00:48:31.4041838Z  2024-12-18T00:48:31.4042838Z [14,027 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:31.4044426Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:48:31.4045197Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2024-12-18T00:48:31.4046190Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2024-12-18T00:48:31.4046879Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 10s local 2024-12-18T00:48:31.4047927Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2024-12-18T00:48:31.4048858Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 9s local 2024-12-18T00:48:31.4050061Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 8s local 2024-12-18T00:48:31.4050901Z @llvm-project//mlir:mlir-tblgen; 8s local ... 2024-12-18T00:48:31.6103123Z 2024-12-18T00:48:31.6104013Z  2024-12-18T00:48:31.6104535Z  2024-12-18T00:48:31.6104979Z  2024-12-18T00:48:31.6105399Z  2024-12-18T00:48:31.6105816Z  2024-12-18T00:48:31.6106268Z  2024-12-18T00:48:31.6106740Z  2024-12-18T00:48:31.6107300Z  2024-12-18T00:48:31.6108300Z [14,031 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:31.6109364Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:48:31.6110198Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2024-12-18T00:48:31.6111264Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2024-12-18T00:48:31.6112148Z Compiling src/cpu/x64/lrn/jit_uni_lrn.cpp; 11s local 2024-12-18T00:48:31.6112998Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2024-12-18T00:48:31.6113985Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 9s local 2024-12-18T00:48:31.6115044Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 8s local 2024-12-18T00:48:31.6115926Z @llvm-project//mlir:mlir-tblgen; 8s local ... 2024-12-18T00:48:31.8107529Z 2024-12-18T00:48:31.8108355Z  2024-12-18T00:48:31.8108830Z  2024-12-18T00:48:31.8109269Z  2024-12-18T00:48:31.8109657Z  2024-12-18T00:48:31.8110058Z  2024-12-18T00:48:31.8110459Z  2024-12-18T00:48:31.8110853Z  2024-12-18T00:48:31.8111243Z  2024-12-18T00:48:31.8112215Z [14,032 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:31.8113265Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2024-12-18T00:48:31.8114134Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:31.8115069Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2024-12-18T00:48:31.8115914Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2024-12-18T00:48:31.8116788Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 10s local 2024-12-18T00:48:31.8117842Z Compiling src/cpu/x64/matmul/jit_uni_sparse_matmul.cpp; 8s local 2024-12-18T00:48:31.8118699Z @llvm-project//mlir:mlir-tblgen; 8s local 2024-12-18T00:48:31.8119406Z Compiling googletest/src/gtest.cc; 6s local ... 2024-12-18T00:48:32.1206791Z 2024-12-18T00:48:32.1207635Z  2024-12-18T00:48:32.1208114Z  2024-12-18T00:48:32.1208508Z  2024-12-18T00:48:32.1208939Z  2024-12-18T00:48:32.1209337Z  2024-12-18T00:48:32.1209713Z  2024-12-18T00:48:32.1210115Z  2024-12-18T00:48:32.1210509Z  2024-12-18T00:48:32.1211491Z [14,038 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:32.1212558Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:48:32.1213408Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:32.1214257Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2024-12-18T00:48:32.1215168Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2024-12-18T00:48:32.1216170Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 10s local 2024-12-18T00:48:32.1217235Z @llvm-project//mlir:mlir-tblgen; 9s local 2024-12-18T00:48:32.1218272Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:48:32.1219009Z Compiling external/xla/xla/xla.pb.cc; 6s local ... 2024-12-18T00:48:32.3335067Z 2024-12-18T00:48:32.3336132Z  2024-12-18T00:48:32.3336786Z  2024-12-18T00:48:32.3337203Z  2024-12-18T00:48:32.3337602Z  2024-12-18T00:48:32.3338015Z  2024-12-18T00:48:32.3338417Z  2024-12-18T00:48:32.3338831Z  2024-12-18T00:48:32.3339215Z  2024-12-18T00:48:32.3340347Z [14,043 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:32.3341538Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:48:32.3342454Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:32.3343419Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2024-12-18T00:48:32.3344551Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2024-12-18T00:48:32.3345579Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 10s local 2024-12-18T00:48:32.3346454Z @llvm-project//mlir:mlir-tblgen; 9s local 2024-12-18T00:48:32.3347151Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:48:32.3347836Z Compiling external/xla/xla/xla.pb.cc; 6s local ... 2024-12-18T00:48:32.5705464Z 2024-12-18T00:48:32.5706297Z  2024-12-18T00:48:32.5706764Z  2024-12-18T00:48:32.5707170Z  2024-12-18T00:48:32.5707563Z  2024-12-18T00:48:32.5707997Z  2024-12-18T00:48:32.5708427Z  2024-12-18T00:48:32.5708840Z  2024-12-18T00:48:32.5709242Z  2024-12-18T00:48:32.5710180Z [14,046 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:32.5711173Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:48:32.5712068Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:32.5713043Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2024-12-18T00:48:32.5713991Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2024-12-18T00:48:32.5714941Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 10s local 2024-12-18T00:48:32.5715867Z @llvm-project//mlir:mlir-tblgen; 9s local 2024-12-18T00:48:32.5716581Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:48:32.5717362Z Compiling external/xla/xla/xla.pb.cc; 7s local ... 2024-12-18T00:48:32.8115132Z 2024-12-18T00:48:32.8115973Z  2024-12-18T00:48:32.8116439Z  2024-12-18T00:48:32.8116890Z  2024-12-18T00:48:32.8117283Z  2024-12-18T00:48:32.8117696Z  2024-12-18T00:48:32.8118102Z  2024-12-18T00:48:32.8118506Z  2024-12-18T00:48:32.8118909Z  2024-12-18T00:48:32.8119853Z [14,048 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:32.8120917Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:48:32.8121827Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2024-12-18T00:48:32.8122751Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:48:32.8123641Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2024-12-18T00:48:32.8124614Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 11s local 2024-12-18T00:48:32.8125547Z @llvm-project//mlir:mlir-tblgen; 9s local 2024-12-18T00:48:32.8126246Z Compiling googletest/src/gtest.cc; 7s local 2024-12-18T00:48:32.8127020Z Compiling external/xla/xla/xla.pb.cc; 7s local ... 2024-12-18T00:48:33.1007355Z 2024-12-18T00:48:33.1008221Z  2024-12-18T00:48:33.1008723Z  2024-12-18T00:48:33.1009129Z  2024-12-18T00:48:33.1009555Z  2024-12-18T00:48:33.1009980Z  2024-12-18T00:48:33.1010411Z  2024-12-18T00:48:33.1010820Z  2024-12-18T00:48:33.1011214Z  2024-12-18T00:48:33.1012177Z [14,049 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:33.1013670Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2024-12-18T00:48:33.1014793Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2024-12-18T00:48:33.1015752Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:48:33.1016847Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2024-12-18T00:48:33.1017788Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 11s local 2024-12-18T00:48:33.1018855Z @llvm-project//mlir:mlir-tblgen; 9s local 2024-12-18T00:48:33.1019637Z Compiling googletest/src/gtest.cc; 8s local 2024-12-18T00:48:33.1020380Z Compiling external/xla/xla/xla.pb.cc; 7s local ... 2024-12-18T00:48:33.4122408Z 2024-12-18T00:48:33.4123276Z  2024-12-18T00:48:33.4123789Z  2024-12-18T00:48:33.4124154Z  2024-12-18T00:48:33.4124554Z  2024-12-18T00:48:33.4125066Z  2024-12-18T00:48:33.4125585Z  2024-12-18T00:48:33.4126131Z  2024-12-18T00:48:33.4126559Z  2024-12-18T00:48:33.4127503Z [14,054 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:33.4128589Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:48:33.4129456Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2024-12-18T00:48:33.4130326Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:48:33.4131244Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2024-12-18T00:48:33.4132264Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 11s local 2024-12-18T00:48:33.4133144Z @llvm-project//mlir:mlir-tblgen; 10s local 2024-12-18T00:48:33.4133801Z Compiling googletest/src/gtest.cc; 8s local 2024-12-18T00:48:33.4134532Z Compiling external/xla/xla/xla.pb.cc; 7s local ... 2024-12-18T00:48:33.6127396Z 2024-12-18T00:48:33.6128324Z  2024-12-18T00:48:33.6128844Z  2024-12-18T00:48:33.6129247Z  2024-12-18T00:48:33.6129699Z  2024-12-18T00:48:33.6130172Z  2024-12-18T00:48:33.6130580Z  2024-12-18T00:48:33.6130954Z  2024-12-18T00:48:33.6131420Z  2024-12-18T00:48:33.6132422Z [14,057 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:33.6133444Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:48:33.6134270Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2024-12-18T00:48:33.6135208Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2024-12-18T00:48:33.6136105Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2024-12-18T00:48:33.6137237Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 11s local 2024-12-18T00:48:33.6138148Z @llvm-project//mlir:mlir-tblgen; 10s local 2024-12-18T00:48:33.6138859Z Compiling googletest/src/gtest.cc; 8s local 2024-12-18T00:48:33.6139617Z Compiling external/xla/xla/xla.pb.cc; 8s local ... 2024-12-18T00:48:33.8459326Z 2024-12-18T00:48:33.8460174Z  2024-12-18T00:48:33.8460664Z  2024-12-18T00:48:33.8461057Z  2024-12-18T00:48:33.8461456Z  2024-12-18T00:48:33.8461906Z  2024-12-18T00:48:33.8462330Z  2024-12-18T00:48:33.8462745Z  2024-12-18T00:48:33.8463154Z  2024-12-18T00:48:33.8464104Z [14,060 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:33.8465202Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:48:33.8466128Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:33.8467092Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2024-12-18T00:48:33.8468068Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2024-12-18T00:48:33.8469104Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 12s local 2024-12-18T00:48:33.8469956Z Compiling googletest/src/gtest.cc; 9s local 2024-12-18T00:48:33.8470898Z Compiling external/xla/xla/xla.pb.cc; 8s local 2024-12-18T00:48:33.8471737Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2024-12-18T00:48:34.0491583Z 2024-12-18T00:48:34.0492631Z  2024-12-18T00:48:34.0493122Z  2024-12-18T00:48:34.0493518Z  2024-12-18T00:48:34.0493945Z  2024-12-18T00:48:34.0494366Z  2024-12-18T00:48:34.0494781Z  2024-12-18T00:48:34.0495195Z  2024-12-18T00:48:34.0495606Z  2024-12-18T00:48:34.0496896Z [14,062 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:34.0498047Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2024-12-18T00:48:34.0498963Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:34.0499858Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2024-12-18T00:48:34.0500767Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2024-12-18T00:48:34.0501761Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 12s local 2024-12-18T00:48:34.0502708Z Compiling googletest/src/gtest.cc; 9s local 2024-12-18T00:48:34.0503463Z Compiling external/xla/xla/xla.pb.cc; 8s local 2024-12-18T00:48:34.0504344Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2024-12-18T00:48:34.3190935Z 2024-12-18T00:48:34.3191842Z  2024-12-18T00:48:34.3192324Z  2024-12-18T00:48:34.3192722Z  2024-12-18T00:48:34.3193114Z  2024-12-18T00:48:34.3193532Z  2024-12-18T00:48:34.3193987Z  2024-12-18T00:48:34.3194384Z  2024-12-18T00:48:34.3194796Z  2024-12-18T00:48:34.3195742Z [14,064 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:34.3196699Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:48:34.3197557Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:34.3198467Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2024-12-18T00:48:34.3199385Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2024-12-18T00:48:34.3200347Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 12s local 2024-12-18T00:48:34.3201235Z Compiling googletest/src/gtest.cc; 9s local 2024-12-18T00:48:34.3201966Z Compiling external/xla/xla/xla.pb.cc; 8s local 2024-12-18T00:48:34.3202804Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2024-12-18T00:48:34.5278754Z 2024-12-18T00:48:34.5279650Z  2024-12-18T00:48:34.5280185Z  2024-12-18T00:48:34.5280568Z  2024-12-18T00:48:34.5280977Z  2024-12-18T00:48:34.5281380Z  2024-12-18T00:48:34.5281774Z  2024-12-18T00:48:34.5282181Z  2024-12-18T00:48:34.5282561Z  2024-12-18T00:48:34.5283508Z [14,069 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:34.5284482Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:48:34.5285469Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:34.5286403Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2024-12-18T00:48:34.5287370Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2024-12-18T00:48:34.5288332Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 12s local 2024-12-18T00:48:34.5289259Z Compiling googletest/src/gtest.cc; 9s local 2024-12-18T00:48:34.5289989Z Compiling external/xla/xla/xla.pb.cc; 9s local 2024-12-18T00:48:34.5290859Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2024-12-18T00:48:34.7406980Z 2024-12-18T00:48:34.7407853Z  2024-12-18T00:48:34.7408325Z  2024-12-18T00:48:34.7408731Z  2024-12-18T00:48:34.7409126Z  2024-12-18T00:48:34.7409527Z  2024-12-18T00:48:34.7409926Z  2024-12-18T00:48:34.7410339Z  2024-12-18T00:48:34.7410724Z  2024-12-18T00:48:34.7411685Z [14,072 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:34.7413019Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:48:34.7413984Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:34.7414899Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2024-12-18T00:48:34.7415816Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2024-12-18T00:48:34.7416883Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 13s local 2024-12-18T00:48:34.7418046Z Compiling external/xla/xla/xla.pb.cc; 9s local 2024-12-18T00:48:34.7418847Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2024-12-18T00:48:34.7419750Z Compiling external/xla/xla/xla_data.pb.cc; 8s local ... 2024-12-18T00:48:35.0138532Z 2024-12-18T00:48:35.0139371Z  2024-12-18T00:48:35.0139856Z  2024-12-18T00:48:35.0140286Z  2024-12-18T00:48:35.0140692Z  2024-12-18T00:48:35.0141134Z  2024-12-18T00:48:35.0141539Z  2024-12-18T00:48:35.0141948Z  2024-12-18T00:48:35.0142317Z  2024-12-18T00:48:35.0143339Z [14,079 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:35.0144666Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2024-12-18T00:48:35.0145537Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:35.0146479Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2024-12-18T00:48:35.0147395Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2024-12-18T00:48:35.0148408Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 13s local 2024-12-18T00:48:35.0149339Z Compiling external/xla/xla/xla.pb.cc; 9s local 2024-12-18T00:48:35.0150133Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2024-12-18T00:48:35.0151008Z Compiling external/xla/xla/xla_data.pb.cc; 8s local ... 2024-12-18T00:48:35.3345100Z 2024-12-18T00:48:35.3346027Z  2024-12-18T00:48:35.3346503Z  2024-12-18T00:48:35.3346894Z  2024-12-18T00:48:35.3347284Z  2024-12-18T00:48:35.3347722Z  2024-12-18T00:48:35.3348128Z  2024-12-18T00:48:35.3348539Z  2024-12-18T00:48:35.3348931Z  2024-12-18T00:48:35.3349827Z [14,080 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:35.3350827Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:48:35.3351731Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:35.3352631Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2024-12-18T00:48:35.3353521Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2024-12-18T00:48:35.3354464Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 13s local 2024-12-18T00:48:35.3355365Z Compiling external/xla/xla/xla.pb.cc; 9s local 2024-12-18T00:48:35.3356167Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2024-12-18T00:48:35.3356997Z Compiling external/xla/xla/xla_data.pb.cc; 8s local ... 2024-12-18T00:48:35.6145098Z 2024-12-18T00:48:35.6145946Z  2024-12-18T00:48:35.6146424Z  2024-12-18T00:48:35.6146870Z  2024-12-18T00:48:35.6147264Z  2024-12-18T00:48:35.6147668Z  2024-12-18T00:48:35.6148056Z  2024-12-18T00:48:35.6148445Z  2024-12-18T00:48:35.6148822Z  2024-12-18T00:48:35.6149764Z [14,082 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:35.6151008Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:48:35.6151812Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:35.6152942Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2024-12-18T00:48:35.6153870Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2024-12-18T00:48:35.6154866Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 13s local 2024-12-18T00:48:35.6156073Z Compiling external/xla/xla/xla.pb.cc; 10s local 2024-12-18T00:48:35.6156901Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:48:35.6157918Z Compiling external/xla/xla/xla_data.pb.cc; 9s local ... 2024-12-18T00:48:35.9002150Z 2024-12-18T00:48:35.9003033Z  2024-12-18T00:48:35.9003528Z  2024-12-18T00:48:35.9003940Z  2024-12-18T00:48:35.9004349Z  2024-12-18T00:48:35.9004724Z  2024-12-18T00:48:35.9005126Z  2024-12-18T00:48:35.9005528Z  2024-12-18T00:48:35.9006298Z  2024-12-18T00:48:35.9007243Z [14,088 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:35.9008184Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2024-12-18T00:48:35.9009060Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:35.9009933Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2024-12-18T00:48:35.9010863Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2024-12-18T00:48:35.9011853Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 14s local 2024-12-18T00:48:35.9012787Z Compiling external/xla/xla/xla.pb.cc; 10s local 2024-12-18T00:48:35.9013576Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:48:35.9014412Z Compiling external/xla/xla/xla_data.pb.cc; 9s local ... 2024-12-18T00:48:36.1299774Z 2024-12-18T00:48:36.1300700Z  2024-12-18T00:48:36.1301207Z  2024-12-18T00:48:36.1301716Z  2024-12-18T00:48:36.1302236Z  2024-12-18T00:48:36.1302632Z  2024-12-18T00:48:36.1303043Z  2024-12-18T00:48:36.1303435Z  2024-12-18T00:48:36.1303834Z  2024-12-18T00:48:36.1304773Z [14,090 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:36.1305703Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:48:36.1306537Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:36.1307375Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2024-12-18T00:48:36.1308246Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2024-12-18T00:48:36.1309193Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 14s local 2024-12-18T00:48:36.1310102Z Compiling external/xla/xla/xla.pb.cc; 10s local 2024-12-18T00:48:36.1310879Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:48:36.1311723Z Compiling external/xla/xla/xla_data.pb.cc; 9s local ... 2024-12-18T00:48:36.4152861Z 2024-12-18T00:48:36.4153676Z  2024-12-18T00:48:36.4154175Z  2024-12-18T00:48:36.4154594Z  2024-12-18T00:48:36.4154987Z  2024-12-18T00:48:36.4155379Z  2024-12-18T00:48:36.4155781Z  2024-12-18T00:48:36.4156185Z  2024-12-18T00:48:36.4156589Z  2024-12-18T00:48:36.4157568Z [14,091 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:36.4158617Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:48:36.4159425Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:36.4160357Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2024-12-18T00:48:36.4161240Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2024-12-18T00:48:36.4162274Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 14s local 2024-12-18T00:48:36.4163265Z Compiling external/xla/xla/xla.pb.cc; 10s local 2024-12-18T00:48:36.4164082Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2024-12-18T00:48:36.4164970Z Compiling external/xla/xla/xla_data.pb.cc; 9s local ... 2024-12-18T00:48:36.6157801Z 2024-12-18T00:48:36.6158722Z  2024-12-18T00:48:36.6159286Z  2024-12-18T00:48:36.6159720Z  2024-12-18T00:48:36.6160138Z  2024-12-18T00:48:36.6160531Z  2024-12-18T00:48:36.6161216Z  2024-12-18T00:48:36.6161626Z  2024-12-18T00:48:36.6162038Z  2024-12-18T00:48:36.6162986Z [14,093 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:36.6164133Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:48:36.6164995Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:36.6165894Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2024-12-18T00:48:36.6166782Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2024-12-18T00:48:36.6168015Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 14s local 2024-12-18T00:48:36.6168940Z Compiling external/xla/xla/xla.pb.cc; 11s local 2024-12-18T00:48:36.6169721Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2024-12-18T00:48:36.6170550Z Compiling external/xla/xla/xla_data.pb.cc; 10s local ... 2024-12-18T00:48:36.9407378Z 2024-12-18T00:48:36.9408336Z  2024-12-18T00:48:36.9408941Z  2024-12-18T00:48:36.9409382Z  2024-12-18T00:48:36.9409754Z  2024-12-18T00:48:36.9410217Z  2024-12-18T00:48:36.9410590Z  2024-12-18T00:48:36.9410963Z  2024-12-18T00:48:36.9411430Z  2024-12-18T00:48:36.9412362Z [14,094 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:36.9413400Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2024-12-18T00:48:36.9414287Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:36.9415238Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 17s local 2024-12-18T00:48:36.9416143Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2024-12-18T00:48:36.9417318Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 15s local 2024-12-18T00:48:36.9418415Z Compiling external/xla/xla/xla.pb.cc; 11s local 2024-12-18T00:48:36.9419247Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2024-12-18T00:48:36.9420130Z Compiling external/xla/xla/xla_data.pb.cc; 10s local ... 2024-12-18T00:48:37.1517715Z 2024-12-18T00:48:37.1518561Z  2024-12-18T00:48:37.1519054Z  2024-12-18T00:48:37.1519469Z  2024-12-18T00:48:37.1519878Z  2024-12-18T00:48:37.1520251Z  2024-12-18T00:48:37.1520666Z  2024-12-18T00:48:37.1521082Z  2024-12-18T00:48:37.1521493Z  2024-12-18T00:48:37.1522494Z [14,099 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:37.1523617Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:48:37.1524469Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:37.1525361Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2024-12-18T00:48:37.1526181Z Compiling external/xla/xla/xla.pb.cc; 11s local 2024-12-18T00:48:37.1526968Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2024-12-18T00:48:37.1527797Z Compiling external/xla/xla/xla_data.pb.cc; 10s local 2024-12-18T00:48:37.1528761Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 8s local 2024-12-18T00:48:37.1529881Z Compiling src/cpu/x64/rnn/brgemm_cell_common_fwd.cpp; 7s local ... 2024-12-18T00:48:37.4164962Z 2024-12-18T00:48:37.4165818Z  2024-12-18T00:48:37.4166279Z  2024-12-18T00:48:37.4166697Z  2024-12-18T00:48:37.4167121Z  2024-12-18T00:48:37.4167526Z  2024-12-18T00:48:37.4167937Z  2024-12-18T00:48:37.4168320Z  2024-12-18T00:48:37.4168753Z  2024-12-18T00:48:37.4169591Z [14,102 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:37.4170658Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:48:37.4171519Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:37.4172392Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2024-12-18T00:48:37.4173517Z Compiling external/xla/xla/xla.pb.cc; 11s local 2024-12-18T00:48:37.4174360Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2024-12-18T00:48:37.4175342Z Compiling external/xla/xla/xla_data.pb.cc; 10s local 2024-12-18T00:48:37.4176416Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 8s local 2024-12-18T00:48:37.4177621Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2024-12-18T00:48:37.6248204Z 2024-12-18T00:48:37.6249049Z  2024-12-18T00:48:37.6249551Z  2024-12-18T00:48:37.6249974Z  2024-12-18T00:48:37.6250797Z  2024-12-18T00:48:37.6251221Z  2024-12-18T00:48:37.6251628Z  2024-12-18T00:48:37.6252043Z  2024-12-18T00:48:37.6252470Z  2024-12-18T00:48:37.6253448Z [14,104 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:37.6254524Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:48:37.6255425Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:37.6256391Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2024-12-18T00:48:37.6264218Z Compiling external/xla/xla/xla.pb.cc; 12s local 2024-12-18T00:48:37.6265035Z Compiling external/xla/xla/service/hlo.pb.cc; 11s local 2024-12-18T00:48:37.6265872Z Compiling external/xla/xla/xla_data.pb.cc; 11s local 2024-12-18T00:48:37.6266812Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 9s local 2024-12-18T00:48:37.6267848Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2024-12-18T00:48:37.8813522Z 2024-12-18T00:48:37.8814398Z  2024-12-18T00:48:37.8814892Z  2024-12-18T00:48:37.8815269Z  2024-12-18T00:48:37.8815642Z  2024-12-18T00:48:37.8815977Z  2024-12-18T00:48:37.8816346Z  2024-12-18T00:48:37.8816891Z  2024-12-18T00:48:37.8817295Z  2024-12-18T00:48:37.8818188Z [14,105 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:37.8819294Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2024-12-18T00:48:37.8820188Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:48:37.8821154Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:48:37.8822023Z Compiling external/xla/xla/xla.pb.cc; 12s local 2024-12-18T00:48:37.8822882Z Compiling external/xla/xla/service/hlo.pb.cc; 11s local 2024-12-18T00:48:37.8823757Z Compiling external/xla/xla/xla_data.pb.cc; 11s local 2024-12-18T00:48:37.8824789Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 9s local 2024-12-18T00:48:37.8825787Z Compiling llvm/lib/IR/Verifier.cpp; 7s local ... 2024-12-18T00:48:38.1522522Z 2024-12-18T00:48:38.1523361Z  2024-12-18T00:48:38.1523843Z  2024-12-18T00:48:38.1524262Z  2024-12-18T00:48:38.1524671Z  2024-12-18T00:48:38.1525081Z  2024-12-18T00:48:38.1525498Z  2024-12-18T00:48:38.1525909Z  2024-12-18T00:48:38.1526342Z  2024-12-18T00:48:38.1527299Z [14,108 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:38.1528326Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:48:38.1529204Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:48:38.1530141Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:48:38.1530865Z Compiling external/xla/xla/xla.pb.cc; 12s local 2024-12-18T00:48:38.1531764Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 9s local 2024-12-18T00:48:38.1532717Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:48:38.1533477Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2024-12-18T00:48:38.1534166Z @llvm-project//mlir:mlir-tblgen; 6s local ... 2024-12-18T00:48:38.3713851Z 2024-12-18T00:48:38.3714732Z  2024-12-18T00:48:38.3715204Z  2024-12-18T00:48:38.3715593Z  2024-12-18T00:48:38.3716292Z  2024-12-18T00:48:38.3716700Z  2024-12-18T00:48:38.3717076Z  2024-12-18T00:48:38.3717474Z  2024-12-18T00:48:38.3717832Z  2024-12-18T00:48:38.3718928Z [14,109 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:38.3719915Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:48:38.3720747Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:48:38.3721672Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:48:38.3722749Z Compiling external/xla/xla/xla.pb.cc; 12s local 2024-12-18T00:48:38.3723765Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 9s local 2024-12-18T00:48:38.3724769Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:48:38.3725501Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2024-12-18T00:48:38.3726268Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2024-12-18T00:48:38.5813733Z 2024-12-18T00:48:38.5814648Z  2024-12-18T00:48:38.5815120Z  2024-12-18T00:48:38.5815529Z  2024-12-18T00:48:38.5815931Z  2024-12-18T00:48:38.5816335Z  2024-12-18T00:48:38.5816912Z  2024-12-18T00:48:38.5817321Z  2024-12-18T00:48:38.5817702Z  2024-12-18T00:48:38.5818651Z [14,112 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:38.5819651Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:48:38.5820542Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:48:38.5821489Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2024-12-18T00:48:38.5822334Z Compiling external/xla/xla/xla.pb.cc; 13s local 2024-12-18T00:48:38.5823367Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 9s local 2024-12-18T00:48:38.5824376Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:48:38.5825174Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2024-12-18T00:48:38.5825963Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2024-12-18T00:48:38.8175219Z 2024-12-18T00:48:38.8176086Z  2024-12-18T00:48:38.8176718Z  2024-12-18T00:48:38.8177152Z  2024-12-18T00:48:38.8177570Z  2024-12-18T00:48:38.8177971Z  2024-12-18T00:48:38.8178337Z  2024-12-18T00:48:38.8178724Z  2024-12-18T00:48:38.8188018Z  2024-12-18T00:48:38.8189339Z [14,114 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:38.8190327Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:48:38.8191168Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:38.8192041Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2024-12-18T00:48:38.8193067Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 10s local 2024-12-18T00:48:38.8194039Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:48:38.8194743Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2024-12-18T00:48:38.8195676Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 7s local 2024-12-18T00:48:38.8196823Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 6s local ... 2024-12-18T00:48:39.0901855Z 2024-12-18T00:48:39.0902720Z  2024-12-18T00:48:39.0903200Z  2024-12-18T00:48:39.0903637Z  2024-12-18T00:48:39.0904062Z  2024-12-18T00:48:39.0904470Z  2024-12-18T00:48:39.0904888Z  2024-12-18T00:48:39.0905330Z  2024-12-18T00:48:39.0905722Z  2024-12-18T00:48:39.0906659Z [14,115 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:39.0907684Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2024-12-18T00:48:39.0908508Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:39.0909369Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2024-12-18T00:48:39.0910673Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 10s local 2024-12-18T00:48:39.0911631Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:48:39.0912520Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:48:39.0913495Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 7s local 2024-12-18T00:48:39.0914596Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 7s local ... 2024-12-18T00:48:39.2957588Z 2024-12-18T00:48:39.2958442Z  2024-12-18T00:48:39.2959275Z  2024-12-18T00:48:39.2959692Z  2024-12-18T00:48:39.2960100Z  2024-12-18T00:48:39.2960502Z  2024-12-18T00:48:39.2960909Z  2024-12-18T00:48:39.2961329Z  2024-12-18T00:48:39.2961732Z  2024-12-18T00:48:39.2962832Z [14,116 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:39.2963893Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:48:39.2964773Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:39.2965679Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2024-12-18T00:48:39.2966693Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 10s local 2024-12-18T00:48:39.2967541Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:48:39.2968240Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:48:39.2969138Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 8s local 2024-12-18T00:48:39.2970271Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 7s local ... 2024-12-18T00:48:39.5009470Z 2024-12-18T00:48:39.5010297Z  2024-12-18T00:48:39.5010744Z  2024-12-18T00:48:39.5011154Z  2024-12-18T00:48:39.5011562Z  2024-12-18T00:48:39.5011977Z  2024-12-18T00:48:39.5012399Z  2024-12-18T00:48:39.5012792Z  2024-12-18T00:48:39.5013228Z  2024-12-18T00:48:39.5014176Z [14,120 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:39.5015203Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:48:39.5016045Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:39.5017076Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2024-12-18T00:48:39.5018171Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 10s local 2024-12-18T00:48:39.5019169Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:48:39.5019922Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:48:39.5020786Z Compiling src/cpu/x64/rnn/jit_gates_reduction.cpp; 7s local 2024-12-18T00:48:39.5021739Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local ... 2024-12-18T00:48:39.8184063Z 2024-12-18T00:48:39.8184855Z  2024-12-18T00:48:39.8185338Z  2024-12-18T00:48:39.8185736Z  2024-12-18T00:48:39.8186151Z  2024-12-18T00:48:39.8186547Z  2024-12-18T00:48:39.8186933Z  2024-12-18T00:48:39.8187328Z  2024-12-18T00:48:39.8187704Z  2024-12-18T00:48:39.8188649Z [14,126 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:39.8189704Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:48:39.8190518Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:39.8191389Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2024-12-18T00:48:39.8192476Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 11s local 2024-12-18T00:48:39.8193480Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:48:39.8194250Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:48:39.8195106Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2024-12-18T00:48:39.8196042Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2024-12-18T00:48:40.0188565Z 2024-12-18T00:48:40.0189435Z  2024-12-18T00:48:40.0189865Z  2024-12-18T00:48:40.0190253Z  2024-12-18T00:48:40.0190629Z  2024-12-18T00:48:40.0191247Z  2024-12-18T00:48:40.0191639Z  2024-12-18T00:48:40.0192002Z  2024-12-18T00:48:40.0192376Z  2024-12-18T00:48:40.0193274Z [14,128 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:40.0194192Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2024-12-18T00:48:40.0195293Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:40.0196151Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2024-12-18T00:48:40.0196991Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:48:40.0197783Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2024-12-18T00:48:40.0198629Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2024-12-18T00:48:40.0199589Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local 2024-12-18T00:48:40.0200655Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 6s local ... 2024-12-18T00:48:40.2891450Z 2024-12-18T00:48:40.2892325Z  2024-12-18T00:48:40.2892806Z  2024-12-18T00:48:40.2893245Z  2024-12-18T00:48:40.2893657Z  2024-12-18T00:48:40.2894103Z  2024-12-18T00:48:40.2894512Z  2024-12-18T00:48:40.2894922Z  2024-12-18T00:48:40.2895315Z  2024-12-18T00:48:40.2896253Z [14,131 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:40.2897467Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:48:40.2898336Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:40.2899173Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2024-12-18T00:48:40.2899961Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:48:40.2900726Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2024-12-18T00:48:40.2901536Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2024-12-18T00:48:40.2902435Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2024-12-18T00:48:40.2903448Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 7s local ... 2024-12-18T00:48:40.6194932Z 2024-12-18T00:48:40.6195823Z  2024-12-18T00:48:40.6196291Z  2024-12-18T00:48:40.6196677Z  2024-12-18T00:48:40.6197096Z  2024-12-18T00:48:40.6197478Z  2024-12-18T00:48:40.6197903Z  2024-12-18T00:48:40.6198272Z  2024-12-18T00:48:40.6198640Z  2024-12-18T00:48:40.6199625Z [14,132 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:40.6200729Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:48:40.6201630Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:40.6202543Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2024-12-18T00:48:40.6203374Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:48:40.6204148Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2024-12-18T00:48:40.6204980Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2024-12-18T00:48:40.6205848Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2024-12-18T00:48:40.6206865Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 7s local ... 2024-12-18T00:48:40.9318140Z 2024-12-18T00:48:40.9318949Z  2024-12-18T00:48:40.9319420Z  2024-12-18T00:48:40.9319759Z  2024-12-18T00:48:40.9320061Z  2024-12-18T00:48:40.9320469Z  2024-12-18T00:48:40.9320851Z  2024-12-18T00:48:40.9321247Z  2024-12-18T00:48:40.9321612Z  2024-12-18T00:48:40.9322525Z [14,134 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:40.9323446Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2024-12-18T00:48:40.9324513Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:40.9325390Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:48:40.9326339Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:48:40.9327086Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2024-12-18T00:48:40.9327951Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2024-12-18T00:48:40.9328851Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2024-12-18T00:48:40.9330144Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 7s local ... 2024-12-18T00:48:41.1816221Z 2024-12-18T00:48:41.1817271Z  2024-12-18T00:48:41.1817761Z  2024-12-18T00:48:41.1818159Z  2024-12-18T00:48:41.1818558Z  2024-12-18T00:48:41.1818980Z  2024-12-18T00:48:41.1819368Z  2024-12-18T00:48:41.1819769Z  2024-12-18T00:48:41.1820171Z  2024-12-18T00:48:41.1821111Z [14,139 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:41.1822170Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2024-12-18T00:48:41.1822929Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:41.1823816Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:48:41.1824622Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:48:41.1825368Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:48:41.1826247Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:48:41.1827121Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2024-12-18T00:48:41.1828113Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 7s local ... 2024-12-18T00:48:41.3819891Z 2024-12-18T00:48:41.3820767Z  2024-12-18T00:48:41.3821262Z  2024-12-18T00:48:41.3821651Z  2024-12-18T00:48:41.3822151Z  2024-12-18T00:48:41.3822586Z  2024-12-18T00:48:41.3822987Z  2024-12-18T00:48:41.3823428Z  2024-12-18T00:48:41.3823791Z  2024-12-18T00:48:41.3824744Z [14,140 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:41.3825823Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2024-12-18T00:48:41.3826624Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:41.3827620Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:48:41.3828420Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:48:41.3829225Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:48:41.3830096Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:48:41.3831012Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2024-12-18T00:48:41.3832032Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local ... 2024-12-18T00:48:41.6203654Z 2024-12-18T00:48:41.6204525Z  2024-12-18T00:48:41.6205006Z  2024-12-18T00:48:41.6205403Z  2024-12-18T00:48:41.6205787Z  2024-12-18T00:48:41.6206189Z  2024-12-18T00:48:41.6206735Z  2024-12-18T00:48:41.6207183Z  2024-12-18T00:48:41.6207588Z  2024-12-18T00:48:41.6208545Z [14,142 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:41.6209566Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2024-12-18T00:48:41.6210463Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:41.6211402Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2024-12-18T00:48:41.6212214Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:48:41.6212987Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:48:41.6213856Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:48:41.6214743Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2024-12-18T00:48:41.6216161Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local ... 2024-12-18T00:48:41.8209162Z 2024-12-18T00:48:41.8210011Z  2024-12-18T00:48:41.8210506Z  2024-12-18T00:48:41.8211250Z  2024-12-18T00:48:41.8211674Z  2024-12-18T00:48:41.8212074Z  2024-12-18T00:48:41.8212481Z  2024-12-18T00:48:41.8212885Z  2024-12-18T00:48:41.8213294Z  2024-12-18T00:48:41.8214249Z [14,146 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:41.8215615Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2024-12-18T00:48:41.8216661Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:48:41.8217595Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:48:41.8218422Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:48:41.8219172Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:48:41.8220083Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:48:41.8220967Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2024-12-18T00:48:41.8221969Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local ... 2024-12-18T00:48:42.0384672Z 2024-12-18T00:48:42.0385544Z  2024-12-18T00:48:42.0386016Z  2024-12-18T00:48:42.0386385Z  2024-12-18T00:48:42.0386752Z  2024-12-18T00:48:42.0387147Z  2024-12-18T00:48:42.0387542Z  2024-12-18T00:48:42.0387915Z  2024-12-18T00:48:42.0388357Z  2024-12-18T00:48:42.0389316Z [14,148 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:42.0390345Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:48:42.0391237Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:48:42.0392075Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:48:42.0392908Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2024-12-18T00:48:42.0393764Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2024-12-18T00:48:42.0394710Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2024-12-18T00:48:42.0395606Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local 2024-12-18T00:48:42.0396485Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 8s local ... 2024-12-18T00:48:42.2403861Z 2024-12-18T00:48:42.2404711Z  2024-12-18T00:48:42.2405178Z  2024-12-18T00:48:42.2405601Z  2024-12-18T00:48:42.2406036Z  2024-12-18T00:48:42.2406442Z  2024-12-18T00:48:42.2406843Z  2024-12-18T00:48:42.2407257Z  2024-12-18T00:48:42.2407651Z  2024-12-18T00:48:42.2408539Z [14,153 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:42.2409601Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:48:42.2410489Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:48:42.2411318Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:48:42.2412093Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:48:42.2412909Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:48:42.2413809Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2024-12-18T00:48:42.2414759Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 8s local 2024-12-18T00:48:42.2415704Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 8s local ... 2024-12-18T00:48:42.4520261Z 2024-12-18T00:48:42.4521119Z  2024-12-18T00:48:42.4521582Z  2024-12-18T00:48:42.4522001Z  2024-12-18T00:48:42.4522402Z  2024-12-18T00:48:42.4522795Z  2024-12-18T00:48:42.4523183Z  2024-12-18T00:48:42.4523517Z  2024-12-18T00:48:42.4523904Z  2024-12-18T00:48:42.4524870Z [14,155 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:42.4526184Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:48:42.4527259Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2024-12-18T00:48:42.4528093Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:48:42.4528795Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:48:42.4529645Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:48:42.4530564Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2024-12-18T00:48:42.4531821Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:48:42.4532803Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 8s local ... 2024-12-18T00:48:42.7228658Z 2024-12-18T00:48:42.7229472Z  2024-12-18T00:48:42.7229853Z  2024-12-18T00:48:42.7230160Z  2024-12-18T00:48:42.7230546Z  2024-12-18T00:48:42.7230925Z  2024-12-18T00:48:42.7231312Z  2024-12-18T00:48:42.7231708Z  2024-12-18T00:48:42.7232074Z  2024-12-18T00:48:42.7232975Z [14,156 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:42.7233989Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:48:42.7234857Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:48:42.7235655Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:48:42.7236382Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:48:42.7237218Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:48:42.7238077Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2024-12-18T00:48:42.7238920Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:48:42.7239876Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local ... 2024-12-18T00:48:43.0219359Z 2024-12-18T00:48:43.0220270Z  2024-12-18T00:48:43.0220775Z  2024-12-18T00:48:43.0221176Z  2024-12-18T00:48:43.0221567Z  2024-12-18T00:48:43.0221984Z  2024-12-18T00:48:43.0222348Z  2024-12-18T00:48:43.0222721Z  2024-12-18T00:48:43.0223133Z  2024-12-18T00:48:43.0224087Z [14,157 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:43.0225156Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:48:43.0225990Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:48:43.0226741Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:48:43.0227501Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2024-12-18T00:48:43.0228375Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2024-12-18T00:48:43.0229313Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2024-12-18T00:48:43.0230285Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:48:43.0231331Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local ... 2024-12-18T00:48:43.2508773Z 2024-12-18T00:48:43.2509606Z  2024-12-18T00:48:43.2510113Z  2024-12-18T00:48:43.2510500Z  2024-12-18T00:48:43.2511046Z  2024-12-18T00:48:43.2511447Z  2024-12-18T00:48:43.2511847Z  2024-12-18T00:48:43.2512258Z  2024-12-18T00:48:43.2512662Z  2024-12-18T00:48:43.2513566Z [14,158 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:43.2514608Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:48:43.2515495Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:48:43.2516294Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:48:43.2517069Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:48:43.2517903Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:48:43.2518758Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2024-12-18T00:48:43.2520019Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local 2024-12-18T00:48:43.2521112Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local ... 2024-12-18T00:48:43.4918789Z 2024-12-18T00:48:43.4919656Z  2024-12-18T00:48:43.4920108Z  2024-12-18T00:48:43.4920472Z  2024-12-18T00:48:43.4920840Z  2024-12-18T00:48:43.4921215Z  2024-12-18T00:48:43.4921592Z  2024-12-18T00:48:43.4921960Z  2024-12-18T00:48:43.4922335Z  2024-12-18T00:48:43.4923718Z [14,161 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:43.4924731Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:48:43.4925578Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2024-12-18T00:48:43.4926304Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:48:43.4927039Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:48:43.4927887Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:48:43.4928770Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2024-12-18T00:48:43.4929725Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2024-12-18T00:48:43.4930678Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local ... 2024-12-18T00:48:43.7536781Z 2024-12-18T00:48:43.7537653Z  2024-12-18T00:48:43.7538112Z  2024-12-18T00:48:43.7538502Z  2024-12-18T00:48:43.7538901Z  2024-12-18T00:48:43.7539282Z  2024-12-18T00:48:43.7539665Z  2024-12-18T00:48:43.7540061Z  2024-12-18T00:48:43.7540414Z  2024-12-18T00:48:43.7541308Z [14,164 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:43.7542321Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:48:43.7543157Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:48:43.7543948Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:48:43.7545031Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:48:43.7545925Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:48:43.7546796Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2024-12-18T00:48:43.7547798Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2024-12-18T00:48:43.7548724Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local ... 2024-12-18T00:48:44.0228294Z 2024-12-18T00:48:44.0229108Z  2024-12-18T00:48:44.0229615Z  2024-12-18T00:48:44.0230030Z  2024-12-18T00:48:44.0230412Z  2024-12-18T00:48:44.0230798Z  2024-12-18T00:48:44.0231198Z  2024-12-18T00:48:44.0231593Z  2024-12-18T00:48:44.0231965Z  2024-12-18T00:48:44.0232908Z [14,165 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:44.0234007Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:48:44.0234898Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:48:44.0235703Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:48:44.0236480Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2024-12-18T00:48:44.0237310Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2024-12-18T00:48:44.0238208Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2024-12-18T00:48:44.0239202Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2024-12-18T00:48:44.0240181Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local ... 2024-12-18T00:48:44.4233697Z 2024-12-18T00:48:44.4234561Z  2024-12-18T00:48:44.4235047Z  2024-12-18T00:48:44.4235458Z  2024-12-18T00:48:44.4235849Z  2024-12-18T00:48:44.4236223Z  2024-12-18T00:48:44.4236622Z  2024-12-18T00:48:44.4237319Z  2024-12-18T00:48:44.4237729Z  2024-12-18T00:48:44.4238688Z [14,168 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:44.4239981Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:48:44.4241051Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:48:44.4241845Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:48:44.4242618Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2024-12-18T00:48:44.4243630Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2024-12-18T00:48:44.4244960Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2024-12-18T00:48:44.4245957Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 11s local 2024-12-18T00:48:44.4246976Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local ... 2024-12-18T00:48:44.6238252Z 2024-12-18T00:48:44.6239077Z  2024-12-18T00:48:44.6239537Z  2024-12-18T00:48:44.6239952Z  2024-12-18T00:48:44.6240317Z  2024-12-18T00:48:44.6240704Z  2024-12-18T00:48:44.6241094Z  2024-12-18T00:48:44.6241458Z  2024-12-18T00:48:44.6241798Z  2024-12-18T00:48:44.6242756Z [14,169 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:44.6243875Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:48:44.6245020Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2024-12-18T00:48:44.6245841Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:48:44.6246603Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2024-12-18T00:48:44.6247465Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2024-12-18T00:48:44.6248365Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2024-12-18T00:48:44.6249397Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 11s local 2024-12-18T00:48:44.6250391Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local ... 2024-12-18T00:48:45.0244096Z 2024-12-18T00:48:45.0245107Z  2024-12-18T00:48:45.0245538Z  2024-12-18T00:48:45.0245901Z  2024-12-18T00:48:45.0246287Z  2024-12-18T00:48:45.0246629Z  2024-12-18T00:48:45.0246983Z  2024-12-18T00:48:45.0247333Z  2024-12-18T00:48:45.0247707Z  2024-12-18T00:48:45.0248633Z [14,171 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:45.0249631Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:48:45.0250560Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:48:45.0251353Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:48:45.0252141Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2024-12-18T00:48:45.0252891Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2024-12-18T00:48:45.0253711Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2024-12-18T00:48:45.0254570Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2024-12-18T00:48:45.0255517Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:48:45.2249049Z 2024-12-18T00:48:45.2249948Z  2024-12-18T00:48:45.2250553Z  2024-12-18T00:48:45.2250932Z  2024-12-18T00:48:45.2251304Z  2024-12-18T00:48:45.2251680Z  2024-12-18T00:48:45.2252059Z  2024-12-18T00:48:45.2252432Z  2024-12-18T00:48:45.2252840Z  2024-12-18T00:48:45.2253815Z [14,172 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:45.2254848Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:48:45.2255752Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:48:45.2256724Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:48:45.2257449Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:48:45.2258706Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:48:45.2259598Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2024-12-18T00:48:45.2260645Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2024-12-18T00:48:45.2261569Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:48:45.4617710Z 2024-12-18T00:48:45.4618545Z  2024-12-18T00:48:45.4619653Z  2024-12-18T00:48:45.4620078Z  2024-12-18T00:48:45.4620502Z  2024-12-18T00:48:45.4650179Z  2024-12-18T00:48:45.4650522Z  2024-12-18T00:48:45.4650861Z  2024-12-18T00:48:45.4651193Z  2024-12-18T00:48:45.4651983Z [14,174 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:45.4652884Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:48:45.4653531Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2024-12-18T00:48:45.4654142Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:48:45.4654712Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:48:45.4655360Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:48:45.4656028Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2024-12-18T00:48:45.4656823Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2024-12-18T00:48:45.4657511Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:48:45.7237329Z 2024-12-18T00:48:45.7238300Z  2024-12-18T00:48:45.7238786Z  2024-12-18T00:48:45.7239134Z  2024-12-18T00:48:45.7239479Z  2024-12-18T00:48:45.7239857Z  2024-12-18T00:48:45.7240248Z  2024-12-18T00:48:45.7240641Z  2024-12-18T00:48:45.7241041Z  2024-12-18T00:48:45.7241958Z [14,175 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:45.7243030Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:48:45.7243939Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:48:45.7245017Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:48:45.7245779Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:48:45.7246640Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:48:45.7247585Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2024-12-18T00:48:45.7248456Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2024-12-18T00:48:45.7249307Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2024-12-18T00:48:45.9407911Z 2024-12-18T00:48:45.9408723Z  2024-12-18T00:48:45.9409182Z  2024-12-18T00:48:45.9409549Z  2024-12-18T00:48:45.9409919Z  2024-12-18T00:48:45.9410280Z  2024-12-18T00:48:45.9410662Z  2024-12-18T00:48:45.9411039Z  2024-12-18T00:48:45.9411425Z  2024-12-18T00:48:45.9412301Z [14,181 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:45.9413302Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:48:45.9414126Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:48:45.9414873Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:48:45.9415563Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2024-12-18T00:48:45.9416348Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2024-12-18T00:48:45.9417366Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2024-12-18T00:48:45.9418192Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2024-12-18T00:48:45.9419043Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2024-12-18T00:48:46.2254266Z 2024-12-18T00:48:46.2255145Z  2024-12-18T00:48:46.2257211Z  2024-12-18T00:48:46.2258028Z  2024-12-18T00:48:46.2258434Z  2024-12-18T00:48:46.2258819Z  2024-12-18T00:48:46.2259218Z  2024-12-18T00:48:46.2259613Z  2024-12-18T00:48:46.2260006Z  2024-12-18T00:48:46.2261210Z [14,182 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:46.2262315Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:48:46.2263236Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2024-12-18T00:48:46.2264169Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:48:46.2265027Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2024-12-18T00:48:46.2265888Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:48:46.2266816Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2024-12-18T00:48:46.2267714Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2024-12-18T00:48:46.2268628Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2024-12-18T00:48:46.4294519Z 2024-12-18T00:48:46.4295410Z  2024-12-18T00:48:46.4295933Z  2024-12-18T00:48:46.4296320Z  2024-12-18T00:48:46.4296865Z  2024-12-18T00:48:46.4297284Z  2024-12-18T00:48:46.4297658Z  2024-12-18T00:48:46.4298042Z  2024-12-18T00:48:46.4298445Z  2024-12-18T00:48:46.4299376Z [14,184 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:46.4300452Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:48:46.4301336Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:48:46.4302059Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2024-12-18T00:48:46.4302872Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:48:46.4303754Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2024-12-18T00:48:46.4304639Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2024-12-18T00:48:46.4305608Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2024-12-18T00:48:46.4306640Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local ... 2024-12-18T00:48:46.6970645Z 2024-12-18T00:48:46.6971585Z  2024-12-18T00:48:46.6972088Z  2024-12-18T00:48:46.6972510Z  2024-12-18T00:48:46.6972956Z  2024-12-18T00:48:46.6973399Z  2024-12-18T00:48:46.6973808Z  2024-12-18T00:48:46.6974212Z  2024-12-18T00:48:46.6974595Z  2024-12-18T00:48:46.6975573Z [14,187 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:46.6976855Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:48:46.6977608Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:48:46.6978360Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2024-12-18T00:48:46.6979404Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:48:46.6980300Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2024-12-18T00:48:46.6981216Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2024-12-18T00:48:46.6982107Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2024-12-18T00:48:46.6983131Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local ... 2024-12-18T00:48:47.0262344Z 2024-12-18T00:48:47.0263245Z  2024-12-18T00:48:47.0263760Z  2024-12-18T00:48:47.0264173Z  2024-12-18T00:48:47.0264578Z  2024-12-18T00:48:47.0264967Z  2024-12-18T00:48:47.0265418Z  2024-12-18T00:48:47.0265820Z  2024-12-18T00:48:47.0266214Z  2024-12-18T00:48:47.0267145Z [14,191 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:47.0268348Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:48:47.0269211Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:48:47.0270291Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2024-12-18T00:48:47.0271101Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2024-12-18T00:48:47.0272343Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2024-12-18T00:48:47.0273243Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2024-12-18T00:48:47.0274173Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:47.0275187Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local ... 2024-12-18T00:48:47.4265962Z 2024-12-18T00:48:47.4267489Z  2024-12-18T00:48:47.4268190Z  2024-12-18T00:48:47.4268754Z  2024-12-18T00:48:47.4269276Z  2024-12-18T00:48:47.4269812Z  2024-12-18T00:48:47.4270343Z  2024-12-18T00:48:47.4270872Z  2024-12-18T00:48:47.4271372Z  2024-12-18T00:48:47.4272458Z [14,194 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:47.4273610Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:48:47.4274377Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:48:47.4275153Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2024-12-18T00:48:47.4276020Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2024-12-18T00:48:47.4276932Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2024-12-18T00:48:47.4277893Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2024-12-18T00:48:47.4278928Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:47.4280052Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local ... 2024-12-18T00:48:47.6271284Z 2024-12-18T00:48:47.6272223Z  2024-12-18T00:48:47.6272699Z  2024-12-18T00:48:47.6273120Z  2024-12-18T00:48:47.6273565Z  2024-12-18T00:48:47.6273995Z  2024-12-18T00:48:47.6274380Z  2024-12-18T00:48:47.6274849Z  2024-12-18T00:48:47.6275408Z  2024-12-18T00:48:47.6276378Z [14,195 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:47.6277484Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:48:47.6278337Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:48:47.6279088Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2024-12-18T00:48:47.6279884Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2024-12-18T00:48:47.6280792Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2024-12-18T00:48:47.6281708Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2024-12-18T00:48:47.6282615Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2024-12-18T00:48:47.6283574Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local ... 2024-12-18T00:48:48.0276680Z 2024-12-18T00:48:48.0277599Z  2024-12-18T00:48:48.0278088Z  2024-12-18T00:48:48.0278479Z  2024-12-18T00:48:48.0278909Z  2024-12-18T00:48:48.0279322Z  2024-12-18T00:48:48.0279725Z  2024-12-18T00:48:48.0280143Z  2024-12-18T00:48:48.0280549Z  2024-12-18T00:48:48.0281562Z [14,196 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:48.0282670Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:48:48.0283532Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:48:48.0284359Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2024-12-18T00:48:48.0285230Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2024-12-18T00:48:48.0286137Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2024-12-18T00:48:48.0287113Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2024-12-18T00:48:48.0288082Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2024-12-18T00:48:48.0289135Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local ... 2024-12-18T00:48:48.5695732Z 2024-12-18T00:48:48.5696837Z  2024-12-18T00:48:48.5698402Z  2024-12-18T00:48:48.5699445Z  2024-12-18T00:48:48.5700153Z  2024-12-18T00:48:48.5701846Z  2024-12-18T00:48:48.5702744Z  2024-12-18T00:48:48.5703458Z  2024-12-18T00:48:48.5703973Z  2024-12-18T00:48:48.5704945Z [14,197 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:48.5706097Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:48:48.5707262Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:48:48.5708062Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2024-12-18T00:48:48.5708944Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2024-12-18T00:48:48.5709868Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2024-12-18T00:48:48.5710783Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2024-12-18T00:48:48.5711698Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2024-12-18T00:48:48.5712709Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local ... 2024-12-18T00:48:48.8285024Z 2024-12-18T00:48:48.8285910Z  2024-12-18T00:48:48.8286378Z  2024-12-18T00:48:48.8286786Z  2024-12-18T00:48:48.8287166Z  2024-12-18T00:48:48.8287537Z  2024-12-18T00:48:48.8287986Z  2024-12-18T00:48:48.8288473Z  2024-12-18T00:48:48.8288844Z  2024-12-18T00:48:48.8289832Z [14,198 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:48.8290935Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:48:48.8291717Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:48:48.8292480Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2024-12-18T00:48:48.8293350Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2024-12-18T00:48:48.8294310Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2024-12-18T00:48:48.8295214Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2024-12-18T00:48:48.8296111Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:48.8297275Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local ... 2024-12-18T00:48:49.1453243Z 2024-12-18T00:48:49.1454248Z  2024-12-18T00:48:49.1456177Z  2024-12-18T00:48:49.1456841Z  2024-12-18T00:48:49.1457268Z  2024-12-18T00:48:49.1457695Z  2024-12-18T00:48:49.1458152Z  2024-12-18T00:48:49.1458589Z  2024-12-18T00:48:49.1459016Z  2024-12-18T00:48:49.1459987Z [14,199 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:49.1461146Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:48:49.1461976Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:48:49.1462768Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:48:49.1463663Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2024-12-18T00:48:49.1464630Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2024-12-18T00:48:49.1465524Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2024-12-18T00:48:49.1466395Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:49.1467394Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local ... 2024-12-18T00:48:49.3541597Z 2024-12-18T00:48:49.3542486Z  2024-12-18T00:48:49.3542986Z  2024-12-18T00:48:49.3543380Z  2024-12-18T00:48:49.3543742Z  2024-12-18T00:48:49.3544096Z  2024-12-18T00:48:49.3547304Z  2024-12-18T00:48:49.3547735Z  2024-12-18T00:48:49.3548143Z  2024-12-18T00:48:49.3549038Z [14,203 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:49.3550322Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:48:49.3551134Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:48:49.3551922Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:48:49.3552982Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2024-12-18T00:48:49.3553922Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2024-12-18T00:48:49.3554805Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2024-12-18T00:48:49.3555811Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:49.3556875Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local ... 2024-12-18T00:48:49.6293225Z 2024-12-18T00:48:49.6294066Z  2024-12-18T00:48:49.6294524Z  2024-12-18T00:48:49.6294911Z  2024-12-18T00:48:49.6295304Z  2024-12-18T00:48:49.6295704Z  2024-12-18T00:48:49.6296086Z  2024-12-18T00:48:49.6296609Z  2024-12-18T00:48:49.6297003Z  2024-12-18T00:48:49.6297967Z [14,205 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:49.6299000Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:48:49.6299790Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:48:49.6300532Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:48:49.6301372Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2024-12-18T00:48:49.6302229Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2024-12-18T00:48:49.6303108Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:48:49.6303934Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2024-12-18T00:48:49.6304880Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local ... 2024-12-18T00:48:49.8917855Z 2024-12-18T00:48:49.8918849Z  2024-12-18T00:48:49.8919516Z  2024-12-18T00:48:49.8919926Z  2024-12-18T00:48:49.8920336Z  2024-12-18T00:48:49.8920632Z  2024-12-18T00:48:49.8920946Z  2024-12-18T00:48:49.8921252Z  2024-12-18T00:48:49.8921582Z  2024-12-18T00:48:49.8922344Z [14,209 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:48:49.8923376Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:48:49.8924139Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2024-12-18T00:48:49.8924878Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2024-12-18T00:48:49.8925737Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2024-12-18T00:48:49.8926607Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2024-12-18T00:48:49.8927478Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:48:49.8928348Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2024-12-18T00:48:49.8929346Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local ... 2024-12-18T00:48:50.2300288Z 2024-12-18T00:48:50.2301157Z  2024-12-18T00:48:50.2301628Z  2024-12-18T00:48:50.2302025Z  2024-12-18T00:48:50.2302438Z  2024-12-18T00:48:50.2302845Z  2024-12-18T00:48:50.2303271Z  2024-12-18T00:48:50.2303656Z  2024-12-18T00:48:50.2304043Z  2024-12-18T00:48:50.2305004Z [14,209 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:50.2306113Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:48:50.2306976Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2024-12-18T00:48:50.2307742Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:48:50.2308628Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:48:50.2309517Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2024-12-18T00:48:50.2310402Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:48:50.2311604Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2024-12-18T00:48:50.2312586Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local ... 2024-12-18T00:48:50.4302774Z 2024-12-18T00:48:50.4304054Z  2024-12-18T00:48:50.4304546Z  2024-12-18T00:48:50.4304961Z  2024-12-18T00:48:50.4305350Z  2024-12-18T00:48:50.4305754Z  2024-12-18T00:48:50.4306156Z  2024-12-18T00:48:50.4306562Z  2024-12-18T00:48:50.4306950Z  2024-12-18T00:48:50.4308049Z [14,211 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:50.4309230Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:48:50.4310122Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:48:50.4310980Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:48:50.4311882Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2024-12-18T00:48:50.4312796Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2024-12-18T00:48:50.4313696Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2024-12-18T00:48:50.4314660Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2024-12-18T00:48:50.4315635Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2024-12-18T00:48:50.7628834Z 2024-12-18T00:48:50.7629659Z  2024-12-18T00:48:50.7630145Z  2024-12-18T00:48:50.7630556Z  2024-12-18T00:48:50.7630971Z  2024-12-18T00:48:50.7631362Z  2024-12-18T00:48:50.7631800Z  2024-12-18T00:48:50.7632204Z  2024-12-18T00:48:50.7632574Z  2024-12-18T00:48:50.7633506Z [14,213 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:50.7634623Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:48:50.7635666Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:48:50.7636625Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:48:50.7637592Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2024-12-18T00:48:50.7638599Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2024-12-18T00:48:50.7639558Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:50.7640573Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2024-12-18T00:48:50.7641644Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2024-12-18T00:48:51.0309908Z 2024-12-18T00:48:51.0310781Z  2024-12-18T00:48:51.0311231Z  2024-12-18T00:48:51.0311626Z  2024-12-18T00:48:51.0312009Z  2024-12-18T00:48:51.0312408Z  2024-12-18T00:48:51.0312813Z  2024-12-18T00:48:51.0313218Z  2024-12-18T00:48:51.0313603Z  2024-12-18T00:48:51.0314555Z [14,213 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:51.0315722Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:48:51.0316637Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2024-12-18T00:48:51.0317561Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2024-12-18T00:48:51.0318524Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2024-12-18T00:48:51.0319395Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2024-12-18T00:48:51.0330175Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:51.0331250Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2024-12-18T00:48:51.0332288Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2024-12-18T00:48:51.2317137Z 2024-12-18T00:48:51.2317970Z  2024-12-18T00:48:51.2318458Z  2024-12-18T00:48:51.2318879Z  2024-12-18T00:48:51.2319292Z  2024-12-18T00:48:51.2319695Z  2024-12-18T00:48:51.2320106Z  2024-12-18T00:48:51.2320502Z  2024-12-18T00:48:51.2321235Z  2024-12-18T00:48:51.2322180Z [14,216 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:51.2323531Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:48:51.2324434Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2024-12-18T00:48:51.2325294Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:48:51.2326238Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2024-12-18T00:48:51.2327329Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2024-12-18T00:48:51.2328329Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:51.2329376Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2024-12-18T00:48:51.2330412Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2024-12-18T00:48:51.6587674Z 2024-12-18T00:48:51.6588549Z  2024-12-18T00:48:51.6589044Z  2024-12-18T00:48:51.6589480Z  2024-12-18T00:48:51.6589890Z  2024-12-18T00:48:51.6590308Z  2024-12-18T00:48:51.6590715Z  2024-12-18T00:48:51.6591113Z  2024-12-18T00:48:51.6591496Z  2024-12-18T00:48:51.6592441Z [14,217 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:51.6593510Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:48:51.6594372Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2024-12-18T00:48:51.6595251Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:48:51.6596186Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2024-12-18T00:48:51.6597149Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:48:51.6598023Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2024-12-18T00:48:51.6599002Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2024-12-18T00:48:51.6600021Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local ... 2024-12-18T00:48:51.8706825Z 2024-12-18T00:48:51.8707681Z  2024-12-18T00:48:51.8708156Z  2024-12-18T00:48:51.8708565Z  2024-12-18T00:48:51.8708999Z  2024-12-18T00:48:51.8709413Z  2024-12-18T00:48:51.8709826Z  2024-12-18T00:48:51.8710230Z  2024-12-18T00:48:51.8710638Z  2024-12-18T00:48:51.8711618Z [14,224 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:51.8712634Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:48:51.8713454Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2024-12-18T00:48:51.8714328Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2024-12-18T00:48:51.8715282Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2024-12-18T00:48:51.8716217Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:48:51.8717148Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:51.8718159Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:48:51.8719193Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local ... 2024-12-18T00:48:52.2121886Z 2024-12-18T00:48:52.2122690Z  2024-12-18T00:48:52.2123179Z  2024-12-18T00:48:52.2123591Z  2024-12-18T00:48:52.2123985Z  2024-12-18T00:48:52.2124398Z  2024-12-18T00:48:52.2124812Z  2024-12-18T00:48:52.2125211Z  2024-12-18T00:48:52.2125604Z  2024-12-18T00:48:52.2126591Z [14,225 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:52.2127732Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:48:52.2128653Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:48:52.2129574Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:48:52.2130453Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:48:52.2131697Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:48:52.2132797Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:52.2133835Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:48:52.2134858Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local ... 2024-12-18T00:48:52.4226419Z 2024-12-18T00:48:52.4227308Z  2024-12-18T00:48:52.4227775Z  2024-12-18T00:48:52.4228199Z  2024-12-18T00:48:52.4229003Z  2024-12-18T00:48:52.4229399Z  2024-12-18T00:48:52.4229793Z  2024-12-18T00:48:52.4230189Z  2024-12-18T00:48:52.4230560Z  2024-12-18T00:48:52.4231525Z [14,229 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:52.4232639Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:48:52.4233476Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:48:52.4234358Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:48:52.4235332Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:48:52.4236262Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2024-12-18T00:48:52.4237128Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:52.4238071Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:48:52.4239090Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2024-12-18T00:48:52.6328455Z 2024-12-18T00:48:52.6329304Z  2024-12-18T00:48:52.6329784Z  2024-12-18T00:48:52.6330176Z  2024-12-18T00:48:52.6330602Z  2024-12-18T00:48:52.6331006Z  2024-12-18T00:48:52.6331406Z  2024-12-18T00:48:52.6331789Z  2024-12-18T00:48:52.6332205Z  2024-12-18T00:48:52.6333214Z [14,230 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:52.6334367Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:48:52.6335297Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:48:52.6336188Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:48:52.6337256Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:48:52.6338217Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:48:52.6339187Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2024-12-18T00:48:52.6340201Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2024-12-18T00:48:52.6341202Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2024-12-18T00:48:52.8432156Z 2024-12-18T00:48:52.8433070Z  2024-12-18T00:48:52.8433510Z  2024-12-18T00:48:52.8433909Z  2024-12-18T00:48:52.8434299Z  2024-12-18T00:48:52.8434685Z  2024-12-18T00:48:52.8435093Z  2024-12-18T00:48:52.8435480Z  2024-12-18T00:48:52.8435870Z  2024-12-18T00:48:52.8436824Z [14,231 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:52.8437886Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:48:52.8438754Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2024-12-18T00:48:52.8439628Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2024-12-18T00:48:52.8440581Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:48:52.8441445Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:48:52.8442367Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:52.8443327Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:48:52.8444640Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2024-12-18T00:48:53.1481634Z 2024-12-18T00:48:53.1482716Z  2024-12-18T00:48:53.1483216Z  2024-12-18T00:48:53.1483629Z  2024-12-18T00:48:53.1484039Z  2024-12-18T00:48:53.1484463Z  2024-12-18T00:48:53.1484884Z  2024-12-18T00:48:53.1485449Z  2024-12-18T00:48:53.1485858Z  2024-12-18T00:48:53.1486825Z [14,234 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:53.1487913Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:48:53.1488915Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:48:53.1489875Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:48:53.1490927Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2024-12-18T00:48:53.1491878Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:48:53.1492823Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:53.1493820Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:48:53.1494849Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2024-12-18T00:48:53.4335089Z 2024-12-18T00:48:53.4335987Z  2024-12-18T00:48:53.4336649Z  2024-12-18T00:48:53.4337063Z  2024-12-18T00:48:53.4337451Z  2024-12-18T00:48:53.4337840Z  2024-12-18T00:48:53.4338231Z  2024-12-18T00:48:53.4338602Z  2024-12-18T00:48:53.4338997Z  2024-12-18T00:48:53.4339950Z [14,238 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:53.4341044Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:48:53.4341905Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:48:53.4342748Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:48:53.4343669Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:48:53.4344858Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2024-12-18T00:48:53.4345816Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:53.4346810Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:48:53.4347837Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local ... 2024-12-18T00:48:53.6477621Z 2024-12-18T00:48:53.6478472Z  2024-12-18T00:48:53.6478972Z  2024-12-18T00:48:53.6479365Z  2024-12-18T00:48:53.6479741Z  2024-12-18T00:48:53.6480110Z  2024-12-18T00:48:53.6480487Z  2024-12-18T00:48:53.6480941Z  2024-12-18T00:48:53.6481336Z  2024-12-18T00:48:53.6482245Z [14,241 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:53.6483350Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:48:53.6484234Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:48:53.6485083Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:48:53.6486036Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:48:53.6486897Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2024-12-18T00:48:53.6487903Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2024-12-18T00:48:53.6488835Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2024-12-18T00:48:53.6489789Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local ... 2024-12-18T00:48:53.8731850Z 2024-12-18T00:48:53.8732682Z  2024-12-18T00:48:53.8733194Z  2024-12-18T00:48:53.8733586Z  2024-12-18T00:48:53.8733993Z  2024-12-18T00:48:53.8734400Z  2024-12-18T00:48:53.8734794Z  2024-12-18T00:48:53.8735183Z  2024-12-18T00:48:53.8735560Z  2024-12-18T00:48:53.8736661Z [14,243 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:53.8737730Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:48:53.8738838Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2024-12-18T00:48:53.8739682Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2024-12-18T00:48:53.8740667Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:48:53.8741549Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2024-12-18T00:48:53.8742432Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:53.8743370Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:48:53.8746737Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local ... 2024-12-18T00:48:54.1757077Z 2024-12-18T00:48:54.1757956Z  2024-12-18T00:48:54.1758431Z  2024-12-18T00:48:54.1758802Z  2024-12-18T00:48:54.1759183Z  2024-12-18T00:48:54.1759563Z  2024-12-18T00:48:54.1759951Z  2024-12-18T00:48:54.1760333Z  2024-12-18T00:48:54.1760714Z  2024-12-18T00:48:54.1761671Z [14,244 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:54.1762771Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:48:54.1763659Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:48:54.1764510Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:48:54.1765444Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2024-12-18T00:48:54.1766359Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2024-12-18T00:48:54.1767287Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:54.1768173Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:48:54.1769051Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local ... 2024-12-18T00:48:54.4344495Z 2024-12-18T00:48:54.4345335Z  2024-12-18T00:48:54.4345778Z  2024-12-18T00:48:54.4346150Z  2024-12-18T00:48:54.4346556Z  2024-12-18T00:48:54.4346921Z  2024-12-18T00:48:54.4347298Z  2024-12-18T00:48:54.4347708Z  2024-12-18T00:48:54.4348071Z  2024-12-18T00:48:54.4349008Z [14,245 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:54.4349977Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:48:54.4350837Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:48:54.4351652Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:48:54.4352580Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:48:54.4353472Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2024-12-18T00:48:54.4354340Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:54.4355254Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:48:54.4356215Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local ... 2024-12-18T00:48:54.6348789Z 2024-12-18T00:48:54.6349627Z  2024-12-18T00:48:54.6350137Z  2024-12-18T00:48:54.6350542Z  2024-12-18T00:48:54.6350940Z  2024-12-18T00:48:54.6351343Z  2024-12-18T00:48:54.6351732Z  2024-12-18T00:48:54.6352136Z  2024-12-18T00:48:54.6352548Z  2024-12-18T00:48:54.6353487Z [14,247 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:54.6354599Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:48:54.6355505Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:48:54.6356382Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:48:54.6357293Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:48:54.6358194Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:48:54.6359084Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2024-12-18T00:48:54.6360303Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2024-12-18T00:48:54.6361264Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local ... 2024-12-18T00:48:54.8975815Z 2024-12-18T00:48:54.8977119Z  2024-12-18T00:48:54.8977667Z  2024-12-18T00:48:54.8978057Z  2024-12-18T00:48:54.8978431Z  2024-12-18T00:48:54.8978814Z  2024-12-18T00:48:54.8979191Z  2024-12-18T00:48:54.8979585Z  2024-12-18T00:48:54.8979972Z  2024-12-18T00:48:54.8981114Z [14,251 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:54.8982282Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:48:54.8983163Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2024-12-18T00:48:54.8983999Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2024-12-18T00:48:54.8984907Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:48:54.8985776Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:48:54.8986694Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:48:54.8987659Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2024-12-18T00:48:54.8988634Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local ... 2024-12-18T00:48:55.1766362Z 2024-12-18T00:48:55.1767175Z  2024-12-18T00:48:55.1767641Z  2024-12-18T00:48:55.1768116Z  2024-12-18T00:48:55.1768502Z  2024-12-18T00:48:55.1768907Z  2024-12-18T00:48:55.1769288Z  2024-12-18T00:48:55.1769669Z  2024-12-18T00:48:55.1770056Z  2024-12-18T00:48:55.1770977Z [14,253 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:55.1772048Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:48:55.1772889Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2024-12-18T00:48:55.1773741Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:48:55.1774620Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2024-12-18T00:48:55.1775531Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:48:55.1776401Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:48:55.1777492Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2024-12-18T00:48:55.1778461Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local ... 2024-12-18T00:48:55.4357102Z 2024-12-18T00:48:55.4358167Z  2024-12-18T00:48:55.4358648Z  2024-12-18T00:48:55.4359050Z  2024-12-18T00:48:55.4359438Z  2024-12-18T00:48:55.4359839Z  2024-12-18T00:48:55.4360233Z  2024-12-18T00:48:55.4360636Z  2024-12-18T00:48:55.4361028Z  2024-12-18T00:48:55.4362025Z [14,257 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:55.4363159Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:48:55.4364122Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:48:55.4365103Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2024-12-18T00:48:55.4366017Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2024-12-18T00:48:55.4366923Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2024-12-18T00:48:55.4367930Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2024-12-18T00:48:55.4368961Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:55.4369957Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local ... 2024-12-18T00:48:55.8361621Z 2024-12-18T00:48:55.8362452Z  2024-12-18T00:48:55.8362926Z  2024-12-18T00:48:55.8363309Z  2024-12-18T00:48:55.8363714Z  2024-12-18T00:48:55.8364093Z  2024-12-18T00:48:55.8364474Z  2024-12-18T00:48:55.8365138Z  2024-12-18T00:48:55.8365530Z  2024-12-18T00:48:55.8366458Z [14,258 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:55.8367659Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:48:55.8368607Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:48:55.8369500Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2024-12-18T00:48:55.8370422Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2024-12-18T00:48:55.8371671Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:55.8372795Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:48:55.8373699Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:55.8374591Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local ... 2024-12-18T00:48:56.0438589Z 2024-12-18T00:48:56.0439617Z  2024-12-18T00:48:56.0440137Z  2024-12-18T00:48:56.0440525Z  2024-12-18T00:48:56.0440918Z  2024-12-18T00:48:56.0441317Z  2024-12-18T00:48:56.0441890Z  2024-12-18T00:48:56.0442296Z  2024-12-18T00:48:56.0442701Z  2024-12-18T00:48:56.0443679Z [14,259 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:56.0445068Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:48:56.0445978Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2024-12-18T00:48:56.0446910Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2024-12-18T00:48:56.0447811Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2024-12-18T00:48:56.0448718Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:56.0449694Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:48:56.0450690Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:56.0451654Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local ... 2024-12-18T00:48:56.3493091Z 2024-12-18T00:48:56.3493964Z  2024-12-18T00:48:56.3494458Z  2024-12-18T00:48:56.3494894Z  2024-12-18T00:48:56.3495310Z  2024-12-18T00:48:56.3495685Z  2024-12-18T00:48:56.3496105Z  2024-12-18T00:48:56.3496636Z  2024-12-18T00:48:56.3497040Z  2024-12-18T00:48:56.3497997Z [14,264 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:56.3499106Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:48:56.3499994Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2024-12-18T00:48:56.3500939Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2024-12-18T00:48:56.3501881Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2024-12-18T00:48:56.3502818Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:56.3503758Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:48:56.3504739Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2024-12-18T00:48:56.3505679Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local ... 2024-12-18T00:48:56.6369178Z 2024-12-18T00:48:56.6370014Z  2024-12-18T00:48:56.6370502Z  2024-12-18T00:48:56.6370905Z  2024-12-18T00:48:56.6371318Z  2024-12-18T00:48:56.6371735Z  2024-12-18T00:48:56.6372148Z  2024-12-18T00:48:56.6372555Z  2024-12-18T00:48:56.6372985Z  2024-12-18T00:48:56.6373972Z [14,271 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:56.6375128Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:48:56.6376064Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2024-12-18T00:48:56.6377134Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2024-12-18T00:48:56.6378304Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:48:56.6379184Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2024-12-18T00:48:56.6380265Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2024-12-18T00:48:56.6381263Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:48:56.6382252Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local ... 2024-12-18T00:48:56.9061201Z 2024-12-18T00:48:56.9062076Z  2024-12-18T00:48:56.9062594Z  2024-12-18T00:48:56.9063408Z  2024-12-18T00:48:56.9063819Z  2024-12-18T00:48:56.9064201Z  2024-12-18T00:48:56.9064592Z  2024-12-18T00:48:56.9064984Z  2024-12-18T00:48:56.9065371Z  2024-12-18T00:48:56.9066307Z [14,275 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:56.9067411Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:48:56.9068320Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2024-12-18T00:48:56.9069204Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2024-12-18T00:48:56.9070129Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:48:56.9071044Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:56.9072024Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:48:56.9073025Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:48:56.9073951Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2024-12-18T00:48:57.1072785Z 2024-12-18T00:48:57.1073669Z  2024-12-18T00:48:57.1074167Z  2024-12-18T00:48:57.1074586Z  2024-12-18T00:48:57.1075004Z  2024-12-18T00:48:57.1075410Z  2024-12-18T00:48:57.1075807Z  2024-12-18T00:48:57.1076225Z  2024-12-18T00:48:57.1076640Z  2024-12-18T00:48:57.1077647Z [14,278 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:57.1078877Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:48:57.1079742Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:48:57.1080657Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2024-12-18T00:48:57.1081585Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:48:57.1082508Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:57.1083678Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:48:57.1084663Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:48:57.1085604Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2024-12-18T00:48:57.3118784Z 2024-12-18T00:48:57.3119713Z  2024-12-18T00:48:57.3120173Z  2024-12-18T00:48:57.3120582Z  2024-12-18T00:48:57.3121025Z  2024-12-18T00:48:57.3121434Z  2024-12-18T00:48:57.3121810Z  2024-12-18T00:48:57.3122218Z  2024-12-18T00:48:57.3122608Z  2024-12-18T00:48:57.3123564Z [14,281 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:57.3124636Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:48:57.3125560Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:48:57.3126443Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:48:57.3127354Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:48:57.3128259Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:57.3129215Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:48:57.3130159Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2024-12-18T00:48:57.3131065Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2024-12-18T00:48:57.5901797Z 2024-12-18T00:48:57.5902670Z  2024-12-18T00:48:57.5903153Z  2024-12-18T00:48:57.5903549Z  2024-12-18T00:48:57.5903958Z  2024-12-18T00:48:57.5904589Z  2024-12-18T00:48:57.5905007Z  2024-12-18T00:48:57.5905407Z  2024-12-18T00:48:57.5905813Z  2024-12-18T00:48:57.5906770Z [14,285 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:57.5907814Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:48:57.5908937Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:48:57.5909830Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:48:57.5910711Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2024-12-18T00:48:57.5911589Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2024-12-18T00:48:57.5912528Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:48:57.5913467Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:48:57.5914384Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2024-12-18T00:48:57.8378764Z 2024-12-18T00:48:57.8379660Z  2024-12-18T00:48:57.8380096Z  2024-12-18T00:48:57.8380474Z  2024-12-18T00:48:57.8380868Z  2024-12-18T00:48:57.8381266Z  2024-12-18T00:48:57.8381643Z  2024-12-18T00:48:57.8382007Z  2024-12-18T00:48:57.8382367Z  2024-12-18T00:48:57.8383316Z [14,285 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:57.8384362Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:48:57.8385149Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:48:57.8385991Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:48:57.8386851Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:48:57.8387758Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:57.8388676Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:48:57.8389646Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:48:57.8390552Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2024-12-18T00:48:58.0484313Z 2024-12-18T00:48:58.0485165Z  2024-12-18T00:48:58.0485657Z  2024-12-18T00:48:58.0486073Z  2024-12-18T00:48:58.0486484Z  2024-12-18T00:48:58.0486913Z  2024-12-18T00:48:58.0487274Z  2024-12-18T00:48:58.0487655Z  2024-12-18T00:48:58.0488068Z  2024-12-18T00:48:58.0488971Z [14,289 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:58.0490035Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:48:58.0490975Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:48:58.0491911Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:48:58.0492818Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:48:58.0493728Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:58.0494703Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:48:58.0495673Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2024-12-18T00:48:58.0496870Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2024-12-18T00:48:58.4212424Z 2024-12-18T00:48:58.4213315Z  2024-12-18T00:48:58.4213821Z  2024-12-18T00:48:58.4214227Z  2024-12-18T00:48:58.4214614Z  2024-12-18T00:48:58.4214998Z  2024-12-18T00:48:58.4215490Z  2024-12-18T00:48:58.4215893Z  2024-12-18T00:48:58.4216273Z  2024-12-18T00:48:58.4217312Z [14,292 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:58.4218665Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:48:58.4219596Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2024-12-18T00:48:58.4220644Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:48:58.4221531Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:48:58.4222415Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:58.4223321Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:48:58.4224478Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:58.4225406Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2024-12-18T00:48:58.6386359Z 2024-12-18T00:48:58.6387225Z  2024-12-18T00:48:58.6387701Z  2024-12-18T00:48:58.6388119Z  2024-12-18T00:48:58.6388517Z  2024-12-18T00:48:58.6388921Z  2024-12-18T00:48:58.6389295Z  2024-12-18T00:48:58.6389725Z  2024-12-18T00:48:58.6390131Z  2024-12-18T00:48:58.6391087Z [14,293 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:58.6392134Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:48:58.6393044Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2024-12-18T00:48:58.6393897Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:48:58.6394798Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:48:58.6395725Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2024-12-18T00:48:58.6396689Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:48:58.6397659Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:58.6398560Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2024-12-18T00:48:59.1819498Z 2024-12-18T00:48:59.1820359Z  2024-12-18T00:48:59.1820891Z  2024-12-18T00:48:59.1821284Z  2024-12-18T00:48:59.1821649Z  2024-12-18T00:48:59.1821995Z  2024-12-18T00:48:59.1822395Z  2024-12-18T00:48:59.1822763Z  2024-12-18T00:48:59.1823211Z  2024-12-18T00:48:59.1824114Z [14,294 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:59.1825168Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:48:59.1826086Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 26s local 2024-12-18T00:48:59.1826970Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:48:59.1827810Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:48:59.1828656Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:48:59.1829556Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:48:59.1830472Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2024-12-18T00:48:59.1831411Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local ... 2024-12-18T00:48:59.3977080Z 2024-12-18T00:48:59.3977944Z  2024-12-18T00:48:59.3978418Z  2024-12-18T00:48:59.3978850Z  2024-12-18T00:48:59.3979236Z  2024-12-18T00:48:59.3979656Z  2024-12-18T00:48:59.3980074Z  2024-12-18T00:48:59.3980481Z  2024-12-18T00:48:59.3980880Z  2024-12-18T00:48:59.3981783Z [14,298 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:59.3982889Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:48:59.3983796Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:48:59.3984815Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:48:59.3985768Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:48:59.3986741Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:48:59.3987953Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2024-12-18T00:48:59.3988892Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:48:59.3990011Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local ... 2024-12-18T00:48:59.6395069Z 2024-12-18T00:48:59.6395913Z  2024-12-18T00:48:59.6396360Z  2024-12-18T00:48:59.6396787Z  2024-12-18T00:48:59.6397180Z  2024-12-18T00:48:59.6397585Z  2024-12-18T00:48:59.6397994Z  2024-12-18T00:48:59.6398801Z  2024-12-18T00:48:59.6399224Z  2024-12-18T00:48:59.6400198Z [14,299 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:48:59.6401289Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:48:59.6402142Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:48:59.6403283Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:48:59.6404191Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2024-12-18T00:48:59.6405124Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:48:59.6406063Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2024-12-18T00:48:59.6406943Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:48:59.6407838Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local ... 2024-12-18T00:48:59.8780178Z 2024-12-18T00:48:59.8781068Z  2024-12-18T00:48:59.8781604Z  2024-12-18T00:48:59.8782010Z  2024-12-18T00:48:59.8782391Z  2024-12-18T00:48:59.8782771Z  2024-12-18T00:48:59.8783157Z  2024-12-18T00:48:59.8783561Z  2024-12-18T00:48:59.8783946Z  2024-12-18T00:48:59.8784935Z [14,304 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:48:59.8785992Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:48:59.8786971Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:48:59.8787929Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:48:59.8788887Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:48:59.8789892Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:48:59.8790877Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2024-12-18T00:48:59.8791773Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:48:59.8792796Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local ... 2024-12-18T00:49:00.2339451Z 2024-12-18T00:49:00.2340313Z  2024-12-18T00:49:00.2340774Z  2024-12-18T00:49:00.2341183Z  2024-12-18T00:49:00.2341585Z  2024-12-18T00:49:00.2341984Z  2024-12-18T00:49:00.2342373Z  2024-12-18T00:49:00.2342759Z  2024-12-18T00:49:00.2343154Z  2024-12-18T00:49:00.2344116Z [14,307 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:00.2345411Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:49:00.2346331Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:49:00.2347198Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:49:00.2348133Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:49:00.2349071Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:49:00.2349968Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:49:00.2350916Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:49:00.2351897Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local ... 2024-12-18T00:49:00.4402973Z 2024-12-18T00:49:00.4403831Z  2024-12-18T00:49:00.4404343Z  2024-12-18T00:49:00.4404725Z  2024-12-18T00:49:00.4405391Z  2024-12-18T00:49:00.4405758Z  2024-12-18T00:49:00.4406140Z  2024-12-18T00:49:00.4406515Z  2024-12-18T00:49:00.4406889Z  2024-12-18T00:49:00.4407985Z [14,309 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:00.4409037Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:49:00.4409865Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:49:00.4410896Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:49:00.4411932Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:49:00.4412882Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:49:00.4413760Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:49:00.4414703Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:49:00.4415673Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local ... 2024-12-18T00:49:00.6407834Z 2024-12-18T00:49:00.6408754Z  2024-12-18T00:49:00.6409240Z  2024-12-18T00:49:00.6409627Z  2024-12-18T00:49:00.6410240Z  2024-12-18T00:49:00.6410664Z  2024-12-18T00:49:00.6411071Z  2024-12-18T00:49:00.6411475Z  2024-12-18T00:49:00.6411849Z  2024-12-18T00:49:00.6412811Z [14,310 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:00.6413955Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:49:00.6414891Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:00.6415804Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2024-12-18T00:49:00.6416996Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:49:00.6417962Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2024-12-18T00:49:00.6419047Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2024-12-18T00:49:00.6420043Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2024-12-18T00:49:00.6421075Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local ... 2024-12-18T00:49:00.9683360Z 2024-12-18T00:49:00.9684224Z  2024-12-18T00:49:00.9684636Z  2024-12-18T00:49:00.9685009Z  2024-12-18T00:49:00.9685369Z  2024-12-18T00:49:00.9685731Z  2024-12-18T00:49:00.9686064Z  2024-12-18T00:49:00.9686420Z  2024-12-18T00:49:00.9686784Z  2024-12-18T00:49:00.9687749Z [14,316 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:00.9688780Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:49:00.9689624Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:00.9690533Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:49:00.9691491Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:00.9692431Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:49:00.9693356Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2024-12-18T00:49:00.9694219Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:49:00.9695191Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local ... 2024-12-18T00:49:01.2413725Z 2024-12-18T00:49:01.2414604Z  2024-12-18T00:49:01.2415080Z  2024-12-18T00:49:01.2415466Z  2024-12-18T00:49:01.2415890Z  2024-12-18T00:49:01.2416285Z  2024-12-18T00:49:01.2416851Z  2024-12-18T00:49:01.2417246Z  2024-12-18T00:49:01.2417600Z  2024-12-18T00:49:01.2418515Z [14,318 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:01.2419539Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:49:01.2420721Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:01.2421563Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:49:01.2422541Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:01.2423426Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:49:01.2424282Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2024-12-18T00:49:01.2425215Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:49:01.2426284Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local ... 2024-12-18T00:49:01.4414718Z 2024-12-18T00:49:01.4415570Z  2024-12-18T00:49:01.4416029Z  2024-12-18T00:49:01.4416437Z  2024-12-18T00:49:01.4417000Z  2024-12-18T00:49:01.4417376Z  2024-12-18T00:49:01.4417767Z  2024-12-18T00:49:01.4418136Z  2024-12-18T00:49:01.4418503Z  2024-12-18T00:49:01.4419415Z [14,321 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:01.4420488Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:49:01.4421396Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:01.4422285Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:49:01.4423215Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:01.4424126Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:49:01.4425059Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:49:01.4425964Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:49:01.4426836Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local ... 2024-12-18T00:49:01.6668362Z 2024-12-18T00:49:01.6669184Z  2024-12-18T00:49:01.6669663Z  2024-12-18T00:49:01.6670095Z  2024-12-18T00:49:01.6670500Z  2024-12-18T00:49:01.6670943Z  2024-12-18T00:49:01.6671357Z  2024-12-18T00:49:01.6671771Z  2024-12-18T00:49:01.6672173Z  2024-12-18T00:49:01.6673150Z [14,323 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:01.6674304Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:01.6675287Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:01.6676259Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2024-12-18T00:49:01.6677287Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:01.6678310Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:49:01.6679333Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:49:01.6680358Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:49:01.6681322Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local ... 2024-12-18T00:49:01.8722694Z 2024-12-18T00:49:01.8723608Z  2024-12-18T00:49:01.8724109Z  2024-12-18T00:49:01.8724490Z  2024-12-18T00:49:01.8724883Z  2024-12-18T00:49:01.8725285Z  2024-12-18T00:49:01.8725704Z  2024-12-18T00:49:01.8726099Z  2024-12-18T00:49:01.8726510Z  2024-12-18T00:49:01.8727443Z [14,326 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:01.8728509Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:01.8729426Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:01.8730334Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:49:01.8731279Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:01.8732227Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2024-12-18T00:49:01.8733145Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2024-12-18T00:49:01.8734387Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2024-12-18T00:49:01.8735275Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local ... 2024-12-18T00:49:02.2340963Z 2024-12-18T00:49:02.2342045Z  2024-12-18T00:49:02.2342571Z  2024-12-18T00:49:02.2342982Z  2024-12-18T00:49:02.2343380Z  2024-12-18T00:49:02.2343793Z  2024-12-18T00:49:02.2344450Z  2024-12-18T00:49:02.2344834Z  2024-12-18T00:49:02.2345232Z  2024-12-18T00:49:02.2346373Z [14,330 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:02.2347568Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:02.2348553Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:02.2349412Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:49:02.2350378Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:02.2351363Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:49:02.2352360Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:49:02.2353463Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:49:02.2354374Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local ... 2024-12-18T00:49:02.4423182Z 2024-12-18T00:49:02.4424072Z  2024-12-18T00:49:02.4424522Z  2024-12-18T00:49:02.4424907Z  2024-12-18T00:49:02.4425294Z  2024-12-18T00:49:02.4425690Z  2024-12-18T00:49:02.4426107Z  2024-12-18T00:49:02.4426503Z  2024-12-18T00:49:02.4426883Z  2024-12-18T00:49:02.4427827Z [14,333 / 20,602] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2024-12-18T00:49:02.4428920Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:02.4429801Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:02.4430650Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:49:02.4431559Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:02.4432483Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:49:02.4433434Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:49:02.4434344Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:49:02.4435237Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local ... 2024-12-18T00:49:02.6427528Z 2024-12-18T00:49:02.6428455Z  2024-12-18T00:49:02.6428923Z  2024-12-18T00:49:02.6429294Z  2024-12-18T00:49:02.6429679Z  2024-12-18T00:49:02.6430071Z  2024-12-18T00:49:02.6430455Z  2024-12-18T00:49:02.6430835Z  2024-12-18T00:49:02.6431194Z  2024-12-18T00:49:02.6432127Z [14,335 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:02.6433204Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:02.6434093Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:49:02.6435006Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2024-12-18T00:49:02.6435967Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:02.6436952Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:49:02.6437911Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:49:02.6438863Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:49:02.6439821Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local ... 2024-12-18T00:49:02.8658396Z 2024-12-18T00:49:02.8659280Z  2024-12-18T00:49:02.8659730Z  2024-12-18T00:49:02.8660140Z  2024-12-18T00:49:02.8660529Z  2024-12-18T00:49:02.8660924Z  2024-12-18T00:49:02.8661313Z  2024-12-18T00:49:02.8662022Z  2024-12-18T00:49:02.8662410Z  2024-12-18T00:49:02.8663299Z [14,339 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:02.8664499Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:02.8665346Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:49:02.8666187Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:49:02.8667097Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 29s local 2024-12-18T00:49:02.8668313Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2024-12-18T00:49:02.8669248Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2024-12-18T00:49:02.8670217Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2024-12-18T00:49:02.8671127Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local ... 2024-12-18T00:49:03.2077992Z 2024-12-18T00:49:03.2078798Z  2024-12-18T00:49:03.2087786Z  2024-12-18T00:49:03.2088206Z  2024-12-18T00:49:03.2088587Z  2024-12-18T00:49:03.2088948Z  2024-12-18T00:49:03.2089295Z  2024-12-18T00:49:03.2089686Z  2024-12-18T00:49:03.2090064Z  2024-12-18T00:49:03.2090939Z [14,343 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:03.2091941Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:03.2092779Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:49:03.2093597Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:49:03.2094347Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2024-12-18T00:49:03.2095344Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:49:03.2096178Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:49:03.2097094Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2024-12-18T00:49:03.2097864Z Compiling llvm/lib/IR/Constants.cpp; 11s local ... 2024-12-18T00:49:03.4084434Z 2024-12-18T00:49:03.4085276Z  2024-12-18T00:49:03.4085718Z  2024-12-18T00:49:03.4086131Z  2024-12-18T00:49:03.4086534Z  2024-12-18T00:49:03.4086918Z  2024-12-18T00:49:03.4087304Z  2024-12-18T00:49:03.4087673Z  2024-12-18T00:49:03.4088041Z  2024-12-18T00:49:03.4088957Z [14,347 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:03.4090046Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:03.4090963Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:49:03.4091844Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:49:03.4092771Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:49:03.4093683Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:49:03.4094552Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:49:03.4095363Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:49:03.4096096Z @llvm-project//llvm:llvm-tblgen; 7s local ... 2024-12-18T00:49:03.6435293Z 2024-12-18T00:49:03.6436073Z  2024-12-18T00:49:03.6436554Z  2024-12-18T00:49:03.6436937Z  2024-12-18T00:49:03.6437353Z  2024-12-18T00:49:03.6437755Z  2024-12-18T00:49:03.6438144Z  2024-12-18T00:49:03.6438536Z  2024-12-18T00:49:03.6438920Z  2024-12-18T00:49:03.6439922Z [14,353 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:03.6441009Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:03.6441973Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:03.6442934Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2024-12-18T00:49:03.6443905Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2024-12-18T00:49:03.6445424Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:49:03.6446455Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:49:03.6447279Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:49:03.6448091Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local ... 2024-12-18T00:49:04.0050791Z 2024-12-18T00:49:04.0051638Z  2024-12-18T00:49:04.0052126Z  2024-12-18T00:49:04.0052532Z  2024-12-18T00:49:04.0052949Z  2024-12-18T00:49:04.0053750Z  2024-12-18T00:49:04.0054165Z  2024-12-18T00:49:04.0054565Z  2024-12-18T00:49:04.0054987Z  2024-12-18T00:49:04.0055946Z [14,357 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:04.0057248Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:04.0058224Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:04.0059177Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:49:04.0060056Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:04.0061076Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2024-12-18T00:49:04.0062031Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:49:04.0062880Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:49:04.0063733Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local ... 2024-12-18T00:49:04.2213698Z 2024-12-18T00:49:04.2214565Z  2024-12-18T00:49:04.2215005Z  2024-12-18T00:49:04.2215374Z  2024-12-18T00:49:04.2215725Z  2024-12-18T00:49:04.2216096Z  2024-12-18T00:49:04.2216615Z  2024-12-18T00:49:04.2216986Z  2024-12-18T00:49:04.2217336Z  2024-12-18T00:49:04.2218150Z [14,364 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:04.2219164Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:04.2220009Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:04.2220809Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:49:04.2221683Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:04.2222525Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2024-12-18T00:49:04.2223356Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2024-12-18T00:49:04.2224151Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local 2024-12-18T00:49:04.2225043Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local ... 2024-12-18T00:49:04.4442960Z 2024-12-18T00:49:04.4443833Z  2024-12-18T00:49:04.4444584Z  2024-12-18T00:49:04.4445006Z  2024-12-18T00:49:04.4445435Z  2024-12-18T00:49:04.4445853Z  2024-12-18T00:49:04.4446270Z  2024-12-18T00:49:04.4446710Z  2024-12-18T00:49:04.4447137Z  2024-12-18T00:49:04.4448135Z [14,366 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:04.4449227Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:04.4450122Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:04.4451025Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:49:04.4451995Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:04.4453058Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2024-12-18T00:49:04.4453971Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:49:04.4454831Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:04.4455818Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local ... 2024-12-18T00:49:04.6447031Z 2024-12-18T00:49:04.6447855Z  2024-12-18T00:49:04.6448626Z  2024-12-18T00:49:04.6449018Z  2024-12-18T00:49:04.6449390Z  2024-12-18T00:49:04.6449767Z  2024-12-18T00:49:04.6450162Z  2024-12-18T00:49:04.6450538Z  2024-12-18T00:49:04.6451089Z  2024-12-18T00:49:04.6452031Z [14,370 / 20,602] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2024-12-18T00:49:04.6453145Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:04.6454073Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2024-12-18T00:49:04.6455342Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2024-12-18T00:49:04.6456324Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:49:04.6457443Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:04.6458381Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:49:04.6459268Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2024-12-18T00:49:04.6460107Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 7s local ... 2024-12-18T00:49:05.0452200Z 2024-12-18T00:49:05.0453068Z  2024-12-18T00:49:05.0453539Z  2024-12-18T00:49:05.0453956Z  2024-12-18T00:49:05.0454360Z  2024-12-18T00:49:05.0454742Z  2024-12-18T00:49:05.0455127Z  2024-12-18T00:49:05.0455525Z  2024-12-18T00:49:05.0455885Z  2024-12-18T00:49:05.0456992Z [14,372 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:05.0458022Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:49:05.0458850Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:49:05.0459724Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:05.0460585Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:49:05.0461426Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:05.0462365Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:49:05.0463217Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:49:05.0464042Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2024-12-18T00:49:05.2455151Z 2024-12-18T00:49:05.2455969Z  2024-12-18T00:49:05.2456635Z  2024-12-18T00:49:05.2457087Z  2024-12-18T00:49:05.2457450Z  2024-12-18T00:49:05.2457822Z  2024-12-18T00:49:05.2458210Z  2024-12-18T00:49:05.2458592Z  2024-12-18T00:49:05.2459038Z  2024-12-18T00:49:05.2460018Z [14,374 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:05.2461129Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:49:05.2462069Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:49:05.2463054Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:05.2463965Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2024-12-18T00:49:05.2464839Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:05.2465751Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:49:05.2466599Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:49:05.2467441Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2024-12-18T00:49:05.4631166Z 2024-12-18T00:49:05.4631935Z  2024-12-18T00:49:05.4632364Z  2024-12-18T00:49:05.4632736Z  2024-12-18T00:49:05.4633123Z  2024-12-18T00:49:05.4633493Z  2024-12-18T00:49:05.4633873Z  2024-12-18T00:49:05.4634242Z  2024-12-18T00:49:05.4634613Z  2024-12-18T00:49:05.4635438Z [14,376 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:05.4636360Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:49:05.4637344Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:49:05.4638167Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:05.4639122Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:05.4639901Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2024-12-18T00:49:05.4640784Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:49:05.4641534Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:49:05.4642321Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2024-12-18T00:49:05.6809640Z 2024-12-18T00:49:05.6810493Z  2024-12-18T00:49:05.6810917Z  2024-12-18T00:49:05.6811271Z  2024-12-18T00:49:05.6811625Z  2024-12-18T00:49:05.6811954Z  2024-12-18T00:49:05.6812313Z  2024-12-18T00:49:05.6812655Z  2024-12-18T00:49:05.6813002Z  2024-12-18T00:49:05.6813808Z [14,378 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:05.6814789Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:49:05.6815575Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2024-12-18T00:49:05.6816356Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2024-12-18T00:49:05.6817268Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:05.6817950Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2024-12-18T00:49:05.6818676Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:49:05.6819384Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:49:05.6820046Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2024-12-18T00:49:05.9899422Z 2024-12-18T00:49:05.9900271Z  2024-12-18T00:49:05.9900759Z  2024-12-18T00:49:05.9901179Z  2024-12-18T00:49:05.9901561Z  2024-12-18T00:49:05.9901984Z  2024-12-18T00:49:05.9902392Z  2024-12-18T00:49:05.9902821Z  2024-12-18T00:49:05.9903205Z  2024-12-18T00:49:05.9904138Z [14,380 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:05.9905244Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:49:05.9906180Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:49:05.9907145Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 29s local 2024-12-18T00:49:05.9908096Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:05.9909022Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2024-12-18T00:49:05.9909982Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:49:05.9910813Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2024-12-18T00:49:05.9911620Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local ... 2024-12-18T00:49:06.2467198Z 2024-12-18T00:49:06.2468072Z  2024-12-18T00:49:06.2468582Z  2024-12-18T00:49:06.2468976Z  2024-12-18T00:49:06.2469371Z  2024-12-18T00:49:06.2469771Z  2024-12-18T00:49:06.2470180Z  2024-12-18T00:49:06.2470583Z  2024-12-18T00:49:06.2470996Z  2024-12-18T00:49:06.2471911Z [14,386 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:06.2473024Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:49:06.2473975Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:49:06.2474943Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2024-12-18T00:49:06.2475845Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2024-12-18T00:49:06.2476827Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:49:06.2477755Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:49:06.2478623Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local 2024-12-18T00:49:06.2480012Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local ... 2024-12-18T00:49:06.4532513Z 2024-12-18T00:49:06.4533352Z  2024-12-18T00:49:06.4533855Z  2024-12-18T00:49:06.4534546Z  2024-12-18T00:49:06.4534951Z  2024-12-18T00:49:06.4535354Z  2024-12-18T00:49:06.4535772Z  2024-12-18T00:49:06.4536193Z  2024-12-18T00:49:06.4536721Z  2024-12-18T00:49:06.4537648Z [14,388 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:06.4539012Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:49:06.4539867Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2024-12-18T00:49:06.4540696Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:06.4541616Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:06.4542586Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:49:06.4543538Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:49:06.4544611Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:06.4545628Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local ... 2024-12-18T00:49:06.8472906Z 2024-12-18T00:49:06.8473746Z  2024-12-18T00:49:06.8474212Z  2024-12-18T00:49:06.8474577Z  2024-12-18T00:49:06.8474941Z  2024-12-18T00:49:06.8475283Z  2024-12-18T00:49:06.8475634Z  2024-12-18T00:49:06.8475970Z  2024-12-18T00:49:06.8476353Z  2024-12-18T00:49:06.8477189Z [14,392 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:06.8478100Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:06.8478919Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:49:06.8479855Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:06.8480800Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:06.8481699Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:49:06.8482621Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:06.8483414Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:06.8484414Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local ... 2024-12-18T00:49:07.0476847Z 2024-12-18T00:49:07.0477684Z  2024-12-18T00:49:07.0478175Z  2024-12-18T00:49:07.0478631Z  2024-12-18T00:49:07.0479020Z  2024-12-18T00:49:07.0479431Z  2024-12-18T00:49:07.0479834Z  2024-12-18T00:49:07.0480234Z  2024-12-18T00:49:07.0480631Z  2024-12-18T00:49:07.0481593Z [14,393 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:07.0482698Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:07.0483668Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:49:07.0484590Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:07.0485509Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:07.0486476Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:49:07.0487490Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:07.0488369Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:07.0489412Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local ... 2024-12-18T00:49:07.3271682Z 2024-12-18T00:49:07.3272500Z  2024-12-18T00:49:07.3272984Z  2024-12-18T00:49:07.3273385Z  2024-12-18T00:49:07.3273781Z  2024-12-18T00:49:07.3274184Z  2024-12-18T00:49:07.3274610Z  2024-12-18T00:49:07.3275037Z  2024-12-18T00:49:07.3275434Z  2024-12-18T00:49:07.3276678Z [14,396 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:07.3277770Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:07.3278904Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:49:07.3279819Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2024-12-18T00:49:07.3280680Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:07.3281690Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:49:07.3282892Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:07.3283787Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:07.3284875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local ... 2024-12-18T00:49:07.6482531Z 2024-12-18T00:49:07.6483396Z  2024-12-18T00:49:07.6483839Z  2024-12-18T00:49:07.6484196Z  2024-12-18T00:49:07.6484630Z  2024-12-18T00:49:07.6485033Z  2024-12-18T00:49:07.6485437Z  2024-12-18T00:49:07.6485848Z  2024-12-18T00:49:07.6486197Z  2024-12-18T00:49:07.6487107Z [14,397 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:07.6488220Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:07.6489156Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2024-12-18T00:49:07.6489996Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:49:07.6490695Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:49:07.6491454Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:49:07.6492189Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:07.6492877Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:07.6493773Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local ... 2024-12-18T00:49:07.8486551Z 2024-12-18T00:49:07.8487397Z  2024-12-18T00:49:07.8487800Z  2024-12-18T00:49:07.8488164Z  2024-12-18T00:49:07.8488541Z  2024-12-18T00:49:07.8488941Z  2024-12-18T00:49:07.8489310Z  2024-12-18T00:49:07.8489658Z  2024-12-18T00:49:07.8490028Z  2024-12-18T00:49:07.8490922Z [14,399 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:07.8491945Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:07.8492803Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:49:07.8493637Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:49:07.8494495Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:49:07.8495453Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:49:07.8496281Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:07.8497212Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:07.8498059Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local ... 2024-12-18T00:49:08.1505421Z 2024-12-18T00:49:08.1506232Z  2024-12-18T00:49:08.1506671Z  2024-12-18T00:49:08.1507047Z  2024-12-18T00:49:08.1507401Z  2024-12-18T00:49:08.1507761Z  2024-12-18T00:49:08.1508113Z  2024-12-18T00:49:08.1508467Z  2024-12-18T00:49:08.1508862Z  2024-12-18T00:49:08.1509808Z [14,401 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:08.1510851Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:08.1511675Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:49:08.1512538Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2024-12-18T00:49:08.1513414Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:49:08.1514627Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:49:08.1515588Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:08.1516553Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:08.1517596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local ... 2024-12-18T00:49:08.4055999Z 2024-12-18T00:49:08.4057010Z  2024-12-18T00:49:08.4057492Z  2024-12-18T00:49:08.4057899Z  2024-12-18T00:49:08.4058293Z  2024-12-18T00:49:08.4059151Z  2024-12-18T00:49:08.4059552Z  2024-12-18T00:49:08.4059982Z  2024-12-18T00:49:08.4060390Z  2024-12-18T00:49:08.4061320Z [14,405 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:08.4062431Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:08.4063343Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:49:08.4064293Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:08.4065186Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:08.4066141Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:49:08.4067067Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:08.4067905Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:08.4068910Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local ... 2024-12-18T00:49:08.6494250Z 2024-12-18T00:49:08.6495166Z  2024-12-18T00:49:08.6495632Z  2024-12-18T00:49:08.6496032Z  2024-12-18T00:49:08.6496415Z  2024-12-18T00:49:08.6496965Z  2024-12-18T00:49:08.6497319Z  2024-12-18T00:49:08.6497703Z  2024-12-18T00:49:08.6498084Z  2024-12-18T00:49:08.6499013Z [14,406 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:08.6500141Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:08.6500987Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2024-12-18T00:49:08.6501850Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:08.6502695Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:08.6503581Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:49:08.6504486Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:08.6505353Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:08.6506398Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local ... 2024-12-18T00:49:08.9422092Z 2024-12-18T00:49:08.9422970Z  2024-12-18T00:49:08.9423433Z  2024-12-18T00:49:08.9423807Z  2024-12-18T00:49:08.9424186Z  2024-12-18T00:49:08.9424540Z  2024-12-18T00:49:08.9424943Z  2024-12-18T00:49:08.9425318Z  2024-12-18T00:49:08.9425701Z  2024-12-18T00:49:08.9426631Z [14,407 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:08.9427632Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:08.9428498Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:49:08.9429355Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:08.9430199Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:08.9431132Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:49:08.9432040Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2024-12-18T00:49:08.9432874Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:08.9433851Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local ... 2024-12-18T00:49:09.2056966Z 2024-12-18T00:49:09.2058072Z  2024-12-18T00:49:09.2058483Z  2024-12-18T00:49:09.2058844Z  2024-12-18T00:49:09.2059202Z  2024-12-18T00:49:09.2059558Z  2024-12-18T00:49:09.2059908Z  2024-12-18T00:49:09.2060400Z  2024-12-18T00:49:09.2060763Z  2024-12-18T00:49:09.2061612Z [14,416 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:49:09.2062524Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:09.2063413Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:49:09.2064237Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2024-12-18T00:49:09.2064973Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:09.2065778Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:49:09.2066667Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:09.2067502Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:49:09.2068387Z Compiling llvm/lib/IR/Dominators.cpp; 9s local ... 2024-12-18T00:49:09.4141968Z 2024-12-18T00:49:09.4142805Z  2024-12-18T00:49:09.4143325Z  2024-12-18T00:49:09.4143753Z  2024-12-18T00:49:09.4144148Z  2024-12-18T00:49:09.4144794Z  2024-12-18T00:49:09.4145160Z  2024-12-18T00:49:09.4145564Z  2024-12-18T00:49:09.4145978Z  2024-12-18T00:49:09.4146966Z [14,418 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:09.4148103Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:09.4149034Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:49:09.4149998Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 31s local 2024-12-18T00:49:09.4150932Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:09.4151847Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:49:09.4152829Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:09.4153832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:49:09.4154756Z Compiling llvm/lib/Object/ELF.cpp; 6s local ... 2024-12-18T00:49:09.6502712Z 2024-12-18T00:49:09.6503590Z  2024-12-18T00:49:09.6504053Z  2024-12-18T00:49:09.6504448Z  2024-12-18T00:49:09.6504830Z  2024-12-18T00:49:09.6505201Z  2024-12-18T00:49:09.6505566Z  2024-12-18T00:49:09.6505967Z  2024-12-18T00:49:09.6506365Z  2024-12-18T00:49:09.6507292Z [14,422 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:09.6508333Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:09.6509209Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2024-12-18T00:49:09.6510048Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 31s local 2024-12-18T00:49:09.6510922Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:09.6511940Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:49:09.6513050Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:49:09.6513965Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:09.6514720Z Compiling llvm/lib/MC/MCContext.cpp; 6s local ... 2024-12-18T00:49:09.8507002Z 2024-12-18T00:49:09.8507810Z  2024-12-18T00:49:09.8508310Z  2024-12-18T00:49:09.8508663Z  2024-12-18T00:49:09.8509074Z  2024-12-18T00:49:09.8509493Z  2024-12-18T00:49:09.8509952Z  2024-12-18T00:49:09.8510430Z  2024-12-18T00:49:09.8510795Z  2024-12-18T00:49:09.8511659Z [14,425 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:09.8512700Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:09.8513901Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:49:09.8514758Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:09.8515835Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:49:09.8516900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:49:09.8518021Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:09.8518697Z Compiling llvm/lib/MC/MCContext.cpp; 6s local 2024-12-18T00:49:09.8519744Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local ... 2024-12-18T00:49:10.0934644Z 2024-12-18T00:49:10.0935519Z  2024-12-18T00:49:10.0936025Z  2024-12-18T00:49:10.0936420Z  2024-12-18T00:49:10.0936944Z  2024-12-18T00:49:10.0937334Z  2024-12-18T00:49:10.0937732Z  2024-12-18T00:49:10.0938141Z  2024-12-18T00:49:10.0938517Z  2024-12-18T00:49:10.0939353Z [14,427 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:10.0940388Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:10.0941280Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:49:10.0942072Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:10.0943024Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:49:10.0943965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:49:10.0945169Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:10.0945797Z Compiling llvm/lib/MC/MCContext.cpp; 7s local 2024-12-18T00:49:10.0946489Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local ... 2024-12-18T00:49:10.3123176Z 2024-12-18T00:49:10.3123981Z  2024-12-18T00:49:10.3124397Z  2024-12-18T00:49:10.3124740Z  2024-12-18T00:49:10.3125071Z  2024-12-18T00:49:10.3125447Z  2024-12-18T00:49:10.3125764Z  2024-12-18T00:49:10.3126104Z  2024-12-18T00:49:10.3126438Z  2024-12-18T00:49:10.3127241Z [14,430 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:10.3128108Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:10.3128882Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:49:10.3129672Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:10.3130634Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:49:10.3131511Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:10.3132166Z Compiling llvm/lib/MC/MCContext.cpp; 7s local 2024-12-18T00:49:10.3132834Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:49:10.3133611Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local ... 2024-12-18T00:49:10.6514045Z 2024-12-18T00:49:10.6514932Z  2024-12-18T00:49:10.6515418Z  2024-12-18T00:49:10.6515786Z  2024-12-18T00:49:10.6516177Z  2024-12-18T00:49:10.6516563Z  2024-12-18T00:49:10.6516948Z  2024-12-18T00:49:10.6517356Z  2024-12-18T00:49:10.6517736Z  2024-12-18T00:49:10.6518689Z [14,432 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:10.6519733Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:10.6520538Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2024-12-18T00:49:10.6521456Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:49:10.6522506Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:49:10.6523431Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:10.6524190Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:49:10.6525061Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local 2024-12-18T00:49:10.6526240Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:49:10.8518229Z 2024-12-18T00:49:10.8519121Z  2024-12-18T00:49:10.8519592Z  2024-12-18T00:49:10.8520310Z  2024-12-18T00:49:10.8520720Z  2024-12-18T00:49:10.8521105Z  2024-12-18T00:49:10.8521490Z  2024-12-18T00:49:10.8521885Z  2024-12-18T00:49:10.8522290Z  2024-12-18T00:49:10.8523179Z [14,434 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:10.8524561Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:10.8525496Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:49:10.8526419Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:49:10.8527471Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:49:10.8528367Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:10.8529154Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:49:10.8530033Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local 2024-12-18T00:49:10.8530947Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:49:11.1827839Z 2024-12-18T00:49:11.1828656Z  2024-12-18T00:49:11.1829138Z  2024-12-18T00:49:11.1829538Z  2024-12-18T00:49:11.1829926Z  2024-12-18T00:49:11.1830331Z  2024-12-18T00:49:11.1830726Z  2024-12-18T00:49:11.1831134Z  2024-12-18T00:49:11.1831579Z  2024-12-18T00:49:11.1832562Z [14,436 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:11.1833695Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:11.1834647Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:49:11.1835609Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:49:11.1836702Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:49:11.1837683Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:11.1838491Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:11.1839404Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:11.1840342Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:49:11.3871172Z 2024-12-18T00:49:11.3872031Z  2024-12-18T00:49:11.3872495Z  2024-12-18T00:49:11.3872905Z  2024-12-18T00:49:11.3873337Z  2024-12-18T00:49:11.3873744Z  2024-12-18T00:49:11.3874141Z  2024-12-18T00:49:11.3874527Z  2024-12-18T00:49:11.3874930Z  2024-12-18T00:49:11.3875883Z [14,439 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:11.3876939Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:11.3877894Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:49:11.3878826Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:11.3879925Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:49:11.3880884Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:11.3881667Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:11.3882571Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:11.3883684Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local ... 2024-12-18T00:49:11.6525431Z 2024-12-18T00:49:11.6526286Z  2024-12-18T00:49:11.6526752Z  2024-12-18T00:49:11.6527154Z  2024-12-18T00:49:11.6527537Z  2024-12-18T00:49:11.6527917Z  2024-12-18T00:49:11.6528320Z  2024-12-18T00:49:11.6528701Z  2024-12-18T00:49:11.6529070Z  2024-12-18T00:49:11.6529996Z [14,445 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:11.6531294Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:11.6532306Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2024-12-18T00:49:11.6533205Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:11.6534210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:49:11.6535120Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:49:11.6535981Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:11.6537095Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:11.6538067Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local ... 2024-12-18T00:49:11.8938839Z 2024-12-18T00:49:11.8939707Z  2024-12-18T00:49:11.8940199Z  2024-12-18T00:49:11.8940604Z  2024-12-18T00:49:11.8941025Z  2024-12-18T00:49:11.8941443Z  2024-12-18T00:49:11.8941874Z  2024-12-18T00:49:11.8942279Z  2024-12-18T00:49:11.8942659Z  2024-12-18T00:49:11.8943629Z [14,449 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:11.8944965Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:11.8945948Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:49:11.8946902Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:11.8947971Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:49:11.8948948Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:49:11.8949754Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:11.8950645Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:11.8951742Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local ... 2024-12-18T00:49:12.0962900Z 2024-12-18T00:49:12.0963751Z  2024-12-18T00:49:12.0964194Z  2024-12-18T00:49:12.0964593Z  2024-12-18T00:49:12.0964990Z  2024-12-18T00:49:12.0965366Z  2024-12-18T00:49:12.0965741Z  2024-12-18T00:49:12.0966164Z  2024-12-18T00:49:12.0966548Z  2024-12-18T00:49:12.0967446Z [14,452 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:12.0968489Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:12.0969419Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:49:12.0970301Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:12.0971282Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:49:12.0972183Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:49:12.0972915Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:12.0973756Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:12.0974590Z Compiling llvm/lib/IR/Instructions.cpp; 6s local ... 2024-12-18T00:49:12.4533077Z 2024-12-18T00:49:12.4533927Z  2024-12-18T00:49:12.4534446Z  2024-12-18T00:49:12.4534850Z  2024-12-18T00:49:12.4535238Z  2024-12-18T00:49:12.4535623Z  2024-12-18T00:49:12.4536026Z  2024-12-18T00:49:12.4536414Z  2024-12-18T00:49:12.4536991Z  2024-12-18T00:49:12.4537933Z [14,454 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:12.4538998Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:12.4539903Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:49:12.4540815Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:49:12.4541839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:49:12.4542728Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:12.4543816Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:12.4544921Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2024-12-18T00:49:12.4545950Z Compiling llvm/lib/IR/Instructions.cpp; 7s local ... 2024-12-18T00:49:12.6537936Z 2024-12-18T00:49:12.6538849Z  2024-12-18T00:49:12.6539537Z  2024-12-18T00:49:12.6539941Z  2024-12-18T00:49:12.6540339Z  2024-12-18T00:49:12.6540726Z  2024-12-18T00:49:12.6541125Z  2024-12-18T00:49:12.6541521Z  2024-12-18T00:49:12.6542294Z  2024-12-18T00:49:12.6543277Z [14,455 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:12.6544616Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:12.6545502Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2024-12-18T00:49:12.6546393Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:49:12.6547415Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:49:12.6548348Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:12.6549171Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:12.6550011Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2024-12-18T00:49:12.6550869Z Compiling llvm/lib/IR/Instructions.cpp; 7s local ... 2024-12-18T00:49:12.8712701Z 2024-12-18T00:49:12.8713556Z  2024-12-18T00:49:12.8714029Z  2024-12-18T00:49:12.8714473Z  2024-12-18T00:49:12.8714863Z  2024-12-18T00:49:12.8715267Z  2024-12-18T00:49:12.8715657Z  2024-12-18T00:49:12.8716061Z  2024-12-18T00:49:12.8716465Z  2024-12-18T00:49:12.8717445Z [14,459 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:12.8718507Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:12.8719395Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:49:12.8720355Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:49:12.8721428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:49:12.8722323Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:12.8723086Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:12.8723891Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2024-12-18T00:49:12.8724680Z Compiling llvm/lib/IR/Intrinsics.cpp; 6s local ... 2024-12-18T00:49:13.1433502Z 2024-12-18T00:49:13.1434348Z  2024-12-18T00:49:13.1434823Z  2024-12-18T00:49:13.1435229Z  2024-12-18T00:49:13.1435632Z  2024-12-18T00:49:13.1436024Z  2024-12-18T00:49:13.1436427Z  2024-12-18T00:49:13.1436813Z  2024-12-18T00:49:13.1437215Z  2024-12-18T00:49:13.1438275Z [14,463 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:13.1439395Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:13.1440301Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:49:13.1441309Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:49:13.1442247Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:13.1443133Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:13.1443956Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2024-12-18T00:49:13.1445182Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 6s local 2024-12-18T00:49:13.1446253Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 6s local ... 2024-12-18T00:49:13.3690307Z 2024-12-18T00:49:13.3691238Z  2024-12-18T00:49:13.3691726Z  2024-12-18T00:49:13.3692126Z  2024-12-18T00:49:13.3692523Z  2024-12-18T00:49:13.3692926Z  2024-12-18T00:49:13.3693598Z  2024-12-18T00:49:13.3694036Z  2024-12-18T00:49:13.3694527Z  2024-12-18T00:49:13.3695512Z [14,467 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:13.3696958Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:13.3697886Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:49:13.3698937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:49:13.3699909Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:13.3700991Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:13.3701807Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:13.3702697Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 6s local 2024-12-18T00:49:13.3703750Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 6s local ... 2024-12-18T00:49:13.5789575Z 2024-12-18T00:49:13.5790441Z  2024-12-18T00:49:13.5790948Z  2024-12-18T00:49:13.5791367Z  2024-12-18T00:49:13.5791781Z  2024-12-18T00:49:13.5792183Z  2024-12-18T00:49:13.5792581Z  2024-12-18T00:49:13.5792957Z  2024-12-18T00:49:13.5793339Z  2024-12-18T00:49:13.5794221Z [14,472 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:13.5795420Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:13.5796342Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2024-12-18T00:49:13.5797329Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:49:13.5798232Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:13.5799037Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:13.5799757Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:13.5800660Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:49:13.5801742Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local ... 2024-12-18T00:49:13.8530725Z 2024-12-18T00:49:13.8531487Z  2024-12-18T00:49:13.8531775Z  2024-12-18T00:49:13.8532049Z  2024-12-18T00:49:13.8532293Z  2024-12-18T00:49:13.8532531Z  2024-12-18T00:49:13.8532760Z  2024-12-18T00:49:13.8533005Z  2024-12-18T00:49:13.8533243Z  2024-12-18T00:49:13.8533787Z [14,474 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:13.8534419Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:13.8534923Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:49:13.8535492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:49:13.8536022Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:13.8536627Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:13.8537113Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:13.8537624Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:49:13.8538205Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local ... 2024-12-18T00:49:14.0547870Z 2024-12-18T00:49:14.0548745Z  2024-12-18T00:49:14.0549260Z  2024-12-18T00:49:14.0549668Z  2024-12-18T00:49:14.0550087Z  2024-12-18T00:49:14.0550485Z  2024-12-18T00:49:14.0550887Z  2024-12-18T00:49:14.0551293Z  2024-12-18T00:49:14.0551722Z  2024-12-18T00:49:14.0552692Z [14,476 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:14.0553743Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:14.0554674Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:49:14.0555735Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:49:14.0557031Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:14.0557835Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:14.0558816Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:14.0559749Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:49:14.0560787Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local ... 2024-12-18T00:49:14.3930575Z 2024-12-18T00:49:14.3931404Z  2024-12-18T00:49:14.3931855Z  2024-12-18T00:49:14.3932630Z  2024-12-18T00:49:14.3933054Z  2024-12-18T00:49:14.3933432Z  2024-12-18T00:49:14.3933811Z  2024-12-18T00:49:14.3934183Z  2024-12-18T00:49:14.3934551Z  2024-12-18T00:49:14.3935509Z [14,482 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:14.3936693Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:14.3937626Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:49:14.3938660Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:49:14.3939608Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:14.3940391Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:49:14.3941308Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:14.3942270Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local 2024-12-18T00:49:14.3943217Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local ... 2024-12-18T00:49:14.6112067Z 2024-12-18T00:49:14.6112963Z  2024-12-18T00:49:14.6113458Z  2024-12-18T00:49:14.6113877Z  2024-12-18T00:49:14.6114269Z  2024-12-18T00:49:14.6114680Z  2024-12-18T00:49:14.6115066Z  2024-12-18T00:49:14.6115476Z  2024-12-18T00:49:14.6115872Z  2024-12-18T00:49:14.6116813Z [14,487 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:14.6117913Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:14.6127543Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2024-12-18T00:49:14.6128756Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:49:14.6129731Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:14.6130532Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:49:14.6131497Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:14.6132519Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 8s local 2024-12-18T00:49:14.6133412Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local ... 2024-12-18T00:49:14.8554947Z 2024-12-18T00:49:14.8555778Z  2024-12-18T00:49:14.8556281Z  2024-12-18T00:49:14.8556717Z  2024-12-18T00:49:14.8557109Z  2024-12-18T00:49:14.8557519Z  2024-12-18T00:49:14.8557971Z  2024-12-18T00:49:14.8558378Z  2024-12-18T00:49:14.8558783Z  2024-12-18T00:49:14.8559765Z [14,490 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:14.8560784Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:14.8561689Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:49:14.8562648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:49:14.8563573Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:14.8564344Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:49:14.8565274Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:14.8566171Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2024-12-18T00:49:14.8567051Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 6s local ... 2024-12-18T00:49:15.1527321Z 2024-12-18T00:49:15.1528526Z  2024-12-18T00:49:15.1529038Z  2024-12-18T00:49:15.1529443Z  2024-12-18T00:49:15.1529832Z  2024-12-18T00:49:15.1530249Z  2024-12-18T00:49:15.1530666Z  2024-12-18T00:49:15.1531267Z  2024-12-18T00:49:15.1531682Z  2024-12-18T00:49:15.1532623Z [14,493 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:15.1533681Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:15.1534653Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:49:15.1535755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:49:15.1536869Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:15.1537629Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:15.1538513Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:15.1539537Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:15.1540453Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local ... 2024-12-18T00:49:15.3597189Z 2024-12-18T00:49:15.3598033Z  2024-12-18T00:49:15.3598532Z  2024-12-18T00:49:15.3598944Z  2024-12-18T00:49:15.3599300Z  2024-12-18T00:49:15.3599645Z  2024-12-18T00:49:15.3600012Z  2024-12-18T00:49:15.3600364Z  2024-12-18T00:49:15.3600732Z  2024-12-18T00:49:15.3601664Z [14,497 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:15.3602729Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:15.3603668Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:49:15.3604594Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:49:15.3605419Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:15.3606098Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:15.3606981Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:15.3607853Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:15.3608713Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local ... 2024-12-18T00:49:15.5605000Z 2024-12-18T00:49:15.5605812Z  2024-12-18T00:49:15.5606295Z  2024-12-18T00:49:15.5606691Z  2024-12-18T00:49:15.5607071Z  2024-12-18T00:49:15.5607480Z  2024-12-18T00:49:15.5607826Z  2024-12-18T00:49:15.5608245Z  2024-12-18T00:49:15.5608628Z  2024-12-18T00:49:15.5609536Z [14,500 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:15.5610568Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:15.5611456Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2024-12-18T00:49:15.5612442Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:49:15.5613369Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:15.5614137Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:15.5615059Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:15.5615982Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:15.5617036Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local ... 2024-12-18T00:49:15.8562996Z 2024-12-18T00:49:15.8563848Z  2024-12-18T00:49:15.8564326Z  2024-12-18T00:49:15.8564773Z  2024-12-18T00:49:15.8565155Z  2024-12-18T00:49:15.8565539Z  2024-12-18T00:49:15.8565927Z  2024-12-18T00:49:15.8566330Z  2024-12-18T00:49:15.8566710Z  2024-12-18T00:49:15.8567661Z [14,503 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:15.8568767Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:49:15.8570081Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:49:15.8571006Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:15.8571931Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:15.8572854Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:15.8573799Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:15.8574642Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local 2024-12-18T00:49:15.8575828Z Compiling llvm/lib/ObjectYAML/XCOFFEmitter.cpp; 6s local ... 2024-12-18T00:49:16.0567420Z 2024-12-18T00:49:16.0568282Z  2024-12-18T00:49:16.0568763Z  2024-12-18T00:49:16.0569131Z  2024-12-18T00:49:16.0569496Z  2024-12-18T00:49:16.0569903Z  2024-12-18T00:49:16.0570308Z  2024-12-18T00:49:16.0570718Z  2024-12-18T00:49:16.0571101Z  2024-12-18T00:49:16.0572065Z [14,505 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:16.0573172Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:49:16.0574213Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:49:16.0575169Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:16.0575949Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 13s local 2024-12-18T00:49:16.0577091Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:16.0578049Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2024-12-18T00:49:16.0578880Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 7s local 2024-12-18T00:49:16.0579805Z Compiling llvm/lib/ObjectYAML/XCOFFEmitter.cpp; 7s local ... 2024-12-18T00:49:16.3423529Z 2024-12-18T00:49:16.3424406Z  2024-12-18T00:49:16.3424904Z  2024-12-18T00:49:16.3425309Z  2024-12-18T00:49:16.3425697Z  2024-12-18T00:49:16.3426138Z  2024-12-18T00:49:16.3426555Z  2024-12-18T00:49:16.3426958Z  2024-12-18T00:49:16.3427347Z  2024-12-18T00:49:16.3428318Z [14,507 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:16.3429397Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:49:16.3430482Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:49:16.3431463Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:16.3432247Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 13s local 2024-12-18T00:49:16.3433225Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:16.3434141Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2024-12-18T00:49:16.3435052Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:16.3435923Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 6s local ... 2024-12-18T00:49:16.6573332Z 2024-12-18T00:49:16.6574196Z  2024-12-18T00:49:16.6574663Z  2024-12-18T00:49:16.6575071Z  2024-12-18T00:49:16.6575471Z  2024-12-18T00:49:16.6575871Z  2024-12-18T00:49:16.6576252Z  2024-12-18T00:49:16.6576826Z  2024-12-18T00:49:16.6577234Z  2024-12-18T00:49:16.6578177Z [14,510 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:16.6579248Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2024-12-18T00:49:16.6580247Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:49:16.6581184Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:49:16.6582048Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2024-12-18T00:49:16.6582982Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2024-12-18T00:49:16.6583825Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:16.6584620Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 6s local 2024-12-18T00:49:16.6585628Z Compiling xla/debug_options_flags.cc; 6s local ... 2024-12-18T00:49:16.8578058Z 2024-12-18T00:49:16.8578900Z  2024-12-18T00:49:16.8579407Z  2024-12-18T00:49:16.8580109Z  2024-12-18T00:49:16.8580569Z  2024-12-18T00:49:16.8580996Z  2024-12-18T00:49:16.8581431Z  2024-12-18T00:49:16.8581857Z  2024-12-18T00:49:16.8582286Z  2024-12-18T00:49:16.8583270Z [14,511 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:16.8584655Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:49:16.8585624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:49:16.8586546Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:49:16.8587356Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2024-12-18T00:49:16.8588285Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2024-12-18T00:49:16.8589138Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:16.8589971Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 6s local 2024-12-18T00:49:16.8590781Z Compiling xla/debug_options_flags.cc; 6s local ... 2024-12-18T00:49:17.1324377Z 2024-12-18T00:49:17.1325293Z  2024-12-18T00:49:17.1325798Z  2024-12-18T00:49:17.1326214Z  2024-12-18T00:49:17.1326604Z  2024-12-18T00:49:17.1326984Z  2024-12-18T00:49:17.1327384Z  2024-12-18T00:49:17.1327761Z  2024-12-18T00:49:17.1328398Z  2024-12-18T00:49:17.1329343Z [14,515 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:17.1330466Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:49:17.1331462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:49:17.1332382Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:49:17.1333183Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2024-12-18T00:49:17.1334105Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 8s local 2024-12-18T00:49:17.1334969Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 7s local 2024-12-18T00:49:17.1335765Z Compiling xla/debug_options_flags.cc; 7s local 2024-12-18T00:49:17.1336716Z Compiling llvm/lib/IR/Metadata.cpp; 6s local ... 2024-12-18T00:49:17.4163474Z 2024-12-18T00:49:17.4164354Z  2024-12-18T00:49:17.4164791Z  2024-12-18T00:49:17.4165188Z  2024-12-18T00:49:17.4165639Z  2024-12-18T00:49:17.4166022Z  2024-12-18T00:49:17.4166388Z  2024-12-18T00:49:17.4166777Z  2024-12-18T00:49:17.4167167Z  2024-12-18T00:49:17.4168081Z [14,517 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:17.4169122Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:49:17.4170099Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:49:17.4171039Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:49:17.4171783Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2024-12-18T00:49:17.4172632Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2024-12-18T00:49:17.4173491Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 7s local 2024-12-18T00:49:17.4174296Z Compiling xla/debug_options_flags.cc; 7s local 2024-12-18T00:49:17.4174975Z Compiling llvm/lib/IR/Metadata.cpp; 6s local ... 2024-12-18T00:49:17.6223642Z 2024-12-18T00:49:17.6224545Z  2024-12-18T00:49:17.6225050Z  2024-12-18T00:49:17.6225438Z  2024-12-18T00:49:17.6225818Z  2024-12-18T00:49:17.6226197Z  2024-12-18T00:49:17.6226577Z  2024-12-18T00:49:17.6226965Z  2024-12-18T00:49:17.6227344Z  2024-12-18T00:49:17.6228281Z [14,524 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:17.6229612Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2024-12-18T00:49:17.6230609Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:49:17.6231621Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:17.6232339Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2024-12-18T00:49:17.6233144Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2024-12-18T00:49:17.6233931Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 7s local 2024-12-18T00:49:17.6234848Z Compiling xla/debug_options_flags.cc; 7s local 2024-12-18T00:49:17.6235667Z Compiling llvm/lib/IR/Metadata.cpp; 6s local ... 2024-12-18T00:49:17.8585986Z 2024-12-18T00:49:17.8586833Z  2024-12-18T00:49:17.8587328Z  2024-12-18T00:49:17.8587746Z  2024-12-18T00:49:17.8588156Z  2024-12-18T00:49:17.8588564Z  2024-12-18T00:49:17.8588952Z  2024-12-18T00:49:17.8589362Z  2024-12-18T00:49:17.8589804Z  2024-12-18T00:49:17.8590789Z [14,527 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:17.8591949Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:49:17.8593020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:49:17.8594001Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:17.8594847Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2024-12-18T00:49:17.8595707Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 7s local 2024-12-18T00:49:17.8596548Z Compiling xla/debug_options_flags.cc; 7s local 2024-12-18T00:49:17.8597299Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2024-12-18T00:49:17.8598064Z Compiling llvm/lib/IR/Module.cpp; 6s local ... 2024-12-18T00:49:18.1713085Z 2024-12-18T00:49:18.1714054Z  2024-12-18T00:49:18.1714577Z  2024-12-18T00:49:18.1715011Z  2024-12-18T00:49:18.1715420Z  2024-12-18T00:49:18.1715884Z  2024-12-18T00:49:18.1716327Z  2024-12-18T00:49:18.1716769Z  2024-12-18T00:49:18.1717184Z  2024-12-18T00:49:18.1718148Z [14,533 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:18.1719233Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:49:18.1720233Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:49:18.1721140Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:18.1721915Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:18.1722785Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local 2024-12-18T00:49:18.1723566Z Compiling xla/debug_options_flags.cc; 8s local 2024-12-18T00:49:18.1724268Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:18.1725087Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local ... 2024-12-18T00:49:18.3933077Z 2024-12-18T00:49:18.3933980Z  2024-12-18T00:49:18.3934402Z  2024-12-18T00:49:18.3934775Z  2024-12-18T00:49:18.3935151Z  2024-12-18T00:49:18.3935525Z  2024-12-18T00:49:18.3935894Z  2024-12-18T00:49:18.3936251Z  2024-12-18T00:49:18.3936775Z  2024-12-18T00:49:18.3937647Z [14,536 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:18.3938626Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:49:18.3939606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:49:18.3940438Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:18.3941278Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:18.3942165Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local 2024-12-18T00:49:18.3942834Z Compiling xla/debug_options_flags.cc; 8s local 2024-12-18T00:49:18.3943588Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:18.3944822Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 5s local ... 2024-12-18T00:49:18.6593327Z 2024-12-18T00:49:18.6594164Z  2024-12-18T00:49:18.6594661Z  2024-12-18T00:49:18.6595319Z  2024-12-18T00:49:18.6595737Z  2024-12-18T00:49:18.6596239Z  2024-12-18T00:49:18.6596731Z  2024-12-18T00:49:18.6597147Z  2024-12-18T00:49:18.6597505Z  2024-12-18T00:49:18.6598403Z [14,539 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:18.6599756Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2024-12-18T00:49:18.6600707Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:49:18.6601599Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:49:18.6602352Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:18.6603181Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local 2024-12-18T00:49:18.6604005Z Compiling xla/debug_options_flags.cc; 8s local 2024-12-18T00:49:18.6604716Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:18.6605536Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 5s local ... 2024-12-18T00:49:18.8597293Z 2024-12-18T00:49:18.8598190Z  2024-12-18T00:49:18.8598633Z  2024-12-18T00:49:18.8599059Z  2024-12-18T00:49:18.8599464Z  2024-12-18T00:49:18.8599853Z  2024-12-18T00:49:18.8600222Z  2024-12-18T00:49:18.8600595Z  2024-12-18T00:49:18.8600988Z  2024-12-18T00:49:18.8601966Z [14,541 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:18.8603008Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:18.8603951Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:49:18.8604852Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:49:18.8605644Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:18.8606626Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local 2024-12-18T00:49:18.8607402Z Compiling xla/debug_options_flags.cc; 8s local 2024-12-18T00:49:18.8608132Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:18.8608931Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 5s local ... 2024-12-18T00:49:19.1392611Z 2024-12-18T00:49:19.1393460Z  2024-12-18T00:49:19.1393918Z  2024-12-18T00:49:19.1394321Z  2024-12-18T00:49:19.1394733Z  2024-12-18T00:49:19.1395188Z  2024-12-18T00:49:19.1395587Z  2024-12-18T00:49:19.1395989Z  2024-12-18T00:49:19.1396370Z  2024-12-18T00:49:19.1397343Z [14,546 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:19.1398425Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:19.1399484Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:49:19.1400462Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:49:19.1401256Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2024-12-18T00:49:19.1402141Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:19.1402961Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:19.1403694Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:19.1404514Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 5s local ... 2024-12-18T00:49:19.4603048Z 2024-12-18T00:49:19.4603994Z  2024-12-18T00:49:19.4604453Z  2024-12-18T00:49:19.4604830Z  2024-12-18T00:49:19.4605186Z  2024-12-18T00:49:19.4605556Z  2024-12-18T00:49:19.4606039Z  2024-12-18T00:49:19.4606522Z  2024-12-18T00:49:19.4606864Z  2024-12-18T00:49:19.4607752Z [14,547 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:19.4609135Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:19.4610166Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:49:19.4611178Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:19.4611977Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:49:19.4612823Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:19.4613573Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:19.4614261Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:19.4615275Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:49:19.6606736Z 2024-12-18T00:49:19.6607625Z  2024-12-18T00:49:19.6608117Z  2024-12-18T00:49:19.6608503Z  2024-12-18T00:49:19.6609096Z  2024-12-18T00:49:19.6609513Z  2024-12-18T00:49:19.6609926Z  2024-12-18T00:49:19.6610336Z  2024-12-18T00:49:19.6610699Z  2024-12-18T00:49:19.6611684Z [14,549 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:19.6612748Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2024-12-18T00:49:19.6613808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:49:19.6614749Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:19.6615578Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:49:19.6616806Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:19.6617673Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:19.6618381Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:19.6619217Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:49:19.8669889Z 2024-12-18T00:49:19.8670783Z  2024-12-18T00:49:19.8671256Z  2024-12-18T00:49:19.8671680Z  2024-12-18T00:49:19.8672090Z  2024-12-18T00:49:19.8672531Z  2024-12-18T00:49:19.8672937Z  2024-12-18T00:49:19.8673297Z  2024-12-18T00:49:19.8673673Z  2024-12-18T00:49:19.8674655Z [14,556 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:19.8675783Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:19.8676812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:49:19.8677808Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:19.8678641Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:49:19.8679483Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2024-12-18T00:49:19.8680221Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:19.8680880Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:19.8681652Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:49:20.0727790Z 2024-12-18T00:49:20.0728668Z  2024-12-18T00:49:20.0729142Z  2024-12-18T00:49:20.0729548Z  2024-12-18T00:49:20.0729936Z  2024-12-18T00:49:20.0730325Z  2024-12-18T00:49:20.0730712Z  2024-12-18T00:49:20.0731119Z  2024-12-18T00:49:20.0731524Z  2024-12-18T00:49:20.0732471Z [14,562 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:20.0733510Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:20.0734512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:49:20.0735428Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:20.0736201Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2024-12-18T00:49:20.0737236Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:20.0738022Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:20.0738723Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:20.0739781Z Compiling llvm/lib/Object/WasmObjectFile.cpp; 6s local ... 2024-12-18T00:49:20.2782980Z 2024-12-18T00:49:20.2783902Z  2024-12-18T00:49:20.2784371Z  2024-12-18T00:49:20.2785053Z  2024-12-18T00:49:20.2785487Z  2024-12-18T00:49:20.2785879Z  2024-12-18T00:49:20.2786261Z  2024-12-18T00:49:20.2786653Z  2024-12-18T00:49:20.2787057Z  2024-12-18T00:49:20.2787935Z [14,564 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:20.2789221Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:20.2790221Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:49:20.2791115Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:20.2791872Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:20.2792715Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:20.2793484Z Compiling xla/debug_options_flags.cc; 10s local 2024-12-18T00:49:20.2794197Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:20.2794987Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 5s local ... 2024-12-18T00:49:20.5283705Z 2024-12-18T00:49:20.5284551Z  2024-12-18T00:49:20.5285020Z  2024-12-18T00:49:20.5285423Z  2024-12-18T00:49:20.5285836Z  2024-12-18T00:49:20.5286218Z  2024-12-18T00:49:20.5286627Z  2024-12-18T00:49:20.5287001Z  2024-12-18T00:49:20.5287394Z  2024-12-18T00:49:20.5288390Z [14,567 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:20.5289560Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2024-12-18T00:49:20.5290549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:49:20.5291456Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:20.5292252Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:20.5293147Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:20.5293940Z Compiling xla/debug_options_flags.cc; 10s local 2024-12-18T00:49:20.5294655Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:20.5295709Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 5s local ... 2024-12-18T00:49:20.7669150Z 2024-12-18T00:49:20.7670023Z  2024-12-18T00:49:20.7670434Z  2024-12-18T00:49:20.7670823Z  2024-12-18T00:49:20.7671241Z  2024-12-18T00:49:20.7671637Z  2024-12-18T00:49:20.7671986Z  2024-12-18T00:49:20.7672349Z  2024-12-18T00:49:20.7672706Z  2024-12-18T00:49:20.7673609Z [14,569 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:20.7674597Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:20.7675471Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:49:20.7676295Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:20.7676991Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:20.7677774Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:20.7678508Z Compiling xla/debug_options_flags.cc; 10s local 2024-12-18T00:49:20.7679164Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:20.7679840Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 6s local ... 2024-12-18T00:49:21.0125854Z 2024-12-18T00:49:21.0126714Z  2024-12-18T00:49:21.0127124Z  2024-12-18T00:49:21.0127468Z  2024-12-18T00:49:21.0127802Z  2024-12-18T00:49:21.0128122Z  2024-12-18T00:49:21.0128462Z  2024-12-18T00:49:21.0128811Z  2024-12-18T00:49:21.0129149Z  2024-12-18T00:49:21.0129942Z [14,572 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:21.0131080Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:21.0131931Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:49:21.0132802Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:21.0133472Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2024-12-18T00:49:21.0134205Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2024-12-18T00:49:21.0134848Z Compiling xla/debug_options_flags.cc; 10s local 2024-12-18T00:49:21.0135579Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:21.0136560Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 6s local ... 2024-12-18T00:49:21.2621694Z 2024-12-18T00:49:21.2622587Z  2024-12-18T00:49:21.2622988Z  2024-12-18T00:49:21.2623340Z  2024-12-18T00:49:21.2623688Z  2024-12-18T00:49:21.2624022Z  2024-12-18T00:49:21.2624446Z  2024-12-18T00:49:21.2624939Z  2024-12-18T00:49:21.2625443Z  2024-12-18T00:49:21.2626413Z [14,578 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:21.2627326Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:21.2628178Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:49:21.2628959Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:21.2629621Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:21.2630344Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:21.2631042Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:21.2631649Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:21.2632314Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 6s local ... 2024-12-18T00:49:21.4619859Z 2024-12-18T00:49:21.4620726Z  2024-12-18T00:49:21.4621213Z  2024-12-18T00:49:21.4621633Z  2024-12-18T00:49:21.4622038Z  2024-12-18T00:49:21.4622468Z  2024-12-18T00:49:21.4622880Z  2024-12-18T00:49:21.4623296Z  2024-12-18T00:49:21.4623710Z  2024-12-18T00:49:21.4624712Z [14,581 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:21.4625871Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:21.4626962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:49:21.4627945Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2024-12-18T00:49:21.4628789Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:21.4629737Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:21.4630571Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:21.4631340Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:21.4632200Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 6s local ... 2024-12-18T00:49:21.7209124Z 2024-12-18T00:49:21.7210060Z  2024-12-18T00:49:21.7210523Z  2024-12-18T00:49:21.7210905Z  2024-12-18T00:49:21.7211304Z  2024-12-18T00:49:21.7211708Z  2024-12-18T00:49:21.7212079Z  2024-12-18T00:49:21.7212462Z  2024-12-18T00:49:21.7212838Z  2024-12-18T00:49:21.7213749Z [14,582 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:21.7214789Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2024-12-18T00:49:21.7215824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:49:21.7216928Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2024-12-18T00:49:21.7217714Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:21.7218719Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:21.7219506Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:21.7220256Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:21.7221373Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local ... 2024-12-18T00:49:21.9700396Z 2024-12-18T00:49:21.9701325Z  2024-12-18T00:49:21.9701827Z  2024-12-18T00:49:21.9702532Z  2024-12-18T00:49:21.9702931Z  2024-12-18T00:49:21.9703426Z  2024-12-18T00:49:21.9703796Z  2024-12-18T00:49:21.9704203Z  2024-12-18T00:49:21.9704637Z  2024-12-18T00:49:21.9705523Z [14,585 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:21.9706900Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:49:21.9707919Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:49:21.9708894Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2024-12-18T00:49:21.9709769Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2024-12-18T00:49:21.9710671Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:21.9711451Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:21.9712208Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:21.9713135Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local ... 2024-12-18T00:49:22.2516757Z 2024-12-18T00:49:22.2517648Z  2024-12-18T00:49:22.2518113Z  2024-12-18T00:49:22.2518517Z  2024-12-18T00:49:22.2518946Z  2024-12-18T00:49:22.2519354Z  2024-12-18T00:49:22.2519755Z  2024-12-18T00:49:22.2520119Z  2024-12-18T00:49:22.2520502Z  2024-12-18T00:49:22.2521502Z [14,589 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:22.2522576Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:49:22.2523503Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:49:22.2524397Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:49:22.2525189Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:22.2525918Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:22.2526714Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:22.2527515Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2024-12-18T00:49:22.2528372Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 5s local ... 2024-12-18T00:49:22.4629031Z 2024-12-18T00:49:22.4629925Z  2024-12-18T00:49:22.4630432Z  2024-12-18T00:49:22.4630821Z  2024-12-18T00:49:22.4631208Z  2024-12-18T00:49:22.4631670Z  2024-12-18T00:49:22.4632090Z  2024-12-18T00:49:22.4632474Z  2024-12-18T00:49:22.4632888Z  2024-12-18T00:49:22.4633854Z [14,590 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:22.4634939Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:49:22.4635967Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:49:22.4637013Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:49:22.4637834Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:22.4638581Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:22.4639360Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:22.4640216Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2024-12-18T00:49:22.4641069Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 5s local ... 2024-12-18T00:49:22.6635053Z 2024-12-18T00:49:22.6635977Z  2024-12-18T00:49:22.6636450Z  2024-12-18T00:49:22.6636858Z  2024-12-18T00:49:22.6637237Z  2024-12-18T00:49:22.6637602Z  2024-12-18T00:49:22.6637967Z  2024-12-18T00:49:22.6638360Z  2024-12-18T00:49:22.6638709Z  2024-12-18T00:49:22.6639541Z [14,591 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:22.6640908Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2024-12-18T00:49:22.6641846Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:49:22.6642965Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:49:22.6643712Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:22.6644659Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:22.6645351Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:22.6646408Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:22.6647330Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 5s local ... 2024-12-18T00:49:23.0501963Z 2024-12-18T00:49:23.0502782Z  2024-12-18T00:49:23.0503215Z  2024-12-18T00:49:23.0503570Z  2024-12-18T00:49:23.0503946Z  2024-12-18T00:49:23.0504299Z  2024-12-18T00:49:23.0504669Z  2024-12-18T00:49:23.0505057Z  2024-12-18T00:49:23.0505446Z  2024-12-18T00:49:23.0506306Z [14,596 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:23.0507305Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:49:23.0508217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:49:23.0509194Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2024-12-18T00:49:23.0509945Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:23.0510619Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:23.0511348Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2024-12-18T00:49:23.0512101Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:23.0512903Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 5s local ... 2024-12-18T00:49:23.2641259Z 2024-12-18T00:49:23.2642156Z  2024-12-18T00:49:23.2642650Z  2024-12-18T00:49:23.2643068Z  2024-12-18T00:49:23.2643457Z  2024-12-18T00:49:23.2643862Z  2024-12-18T00:49:23.2644531Z  2024-12-18T00:49:23.2644944Z  2024-12-18T00:49:23.2645338Z  2024-12-18T00:49:23.2646298Z [14,599 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:23.2647373Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:49:23.2648389Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:49:23.2649443Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:23.2650278Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:23.2651025Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:23.2651764Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2024-12-18T00:49:23.2652575Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:23.2653441Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local ... 2024-12-18T00:49:23.4645076Z 2024-12-18T00:49:23.4645885Z  2024-12-18T00:49:23.4646361Z  2024-12-18T00:49:23.4646781Z  2024-12-18T00:49:23.4647187Z  2024-12-18T00:49:23.4647588Z  2024-12-18T00:49:23.4648018Z  2024-12-18T00:49:23.4648439Z  2024-12-18T00:49:23.4648827Z  2024-12-18T00:49:23.4649793Z [14,602 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:23.4650922Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2024-12-18T00:49:23.4652014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:49:23.4653050Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:23.4653895Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:23.4654639Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:23.4655395Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2024-12-18T00:49:23.4656667Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:23.4657530Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local ... 2024-12-18T00:49:23.8248147Z 2024-12-18T00:49:23.8249016Z  2024-12-18T00:49:23.8249772Z  2024-12-18T00:49:23.8250224Z  2024-12-18T00:49:23.8250618Z  2024-12-18T00:49:23.8251005Z  2024-12-18T00:49:23.8251418Z  2024-12-18T00:49:23.8251826Z  2024-12-18T00:49:23.8252238Z  2024-12-18T00:49:23.8253382Z [14,606 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:23.8254604Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:23.8255671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:49:23.8256870Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:23.8257717Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:23.8258507Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:23.8259305Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:23.8260137Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:23.8260992Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local ... 2024-12-18T00:49:24.0289562Z 2024-12-18T00:49:24.0290388Z  2024-12-18T00:49:24.0290889Z  2024-12-18T00:49:24.0291292Z  2024-12-18T00:49:24.0291683Z  2024-12-18T00:49:24.0292098Z  2024-12-18T00:49:24.0292498Z  2024-12-18T00:49:24.0292895Z  2024-12-18T00:49:24.0293294Z  2024-12-18T00:49:24.0294202Z [14,609 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:24.0295271Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:24.0296299Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:49:24.0297508Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2024-12-18T00:49:24.0298336Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:24.0299051Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:24.0299855Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:24.0300706Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:24.0301574Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local ... 2024-12-18T00:49:24.2652771Z 2024-12-18T00:49:24.2653626Z  2024-12-18T00:49:24.2654110Z  2024-12-18T00:49:24.2654560Z  2024-12-18T00:49:24.2654969Z  2024-12-18T00:49:24.2655344Z  2024-12-18T00:49:24.2655750Z  2024-12-18T00:49:24.2656134Z  2024-12-18T00:49:24.2656672Z  2024-12-18T00:49:24.2657629Z [14,612 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:24.2658756Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:24.2659767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:49:24.2660780Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:49:24.2661582Z Compiling xla/debug_options_flags.cc; 14s local 2024-12-18T00:49:24.2662336Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:24.2663112Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:24.2663932Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:24.2664782Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local ... 2024-12-18T00:49:24.4653488Z 2024-12-18T00:49:24.4654599Z  2024-12-18T00:49:24.4655619Z  2024-12-18T00:49:24.4656530Z  2024-12-18T00:49:24.4657554Z  2024-12-18T00:49:24.4658021Z  2024-12-18T00:49:24.4658410Z  2024-12-18T00:49:24.4658792Z  2024-12-18T00:49:24.4659202Z  2024-12-18T00:49:24.4660156Z [14,616 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:24.4661490Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2024-12-18T00:49:24.4662679Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:49:24.4663719Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:49:24.4664580Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:24.4665339Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:24.4666198Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:24.4667332Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2024-12-18T00:49:24.4668069Z Compiling llvm/lib/IR/Type.cpp; 6s local ... 2024-12-18T00:49:24.7771183Z 2024-12-18T00:49:24.7772509Z  2024-12-18T00:49:24.7773018Z  2024-12-18T00:49:24.7773396Z  2024-12-18T00:49:24.7773793Z  2024-12-18T00:49:24.7774170Z  2024-12-18T00:49:24.7774564Z  2024-12-18T00:49:24.7775006Z  2024-12-18T00:49:24.7775387Z  2024-12-18T00:49:24.7776325Z [14,618 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:24.7777572Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:24.7778576Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:49:24.7779574Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2024-12-18T00:49:24.7780374Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:24.7781179Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 10s local 2024-12-18T00:49:24.7782001Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:49:24.7782833Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2024-12-18T00:49:24.7783599Z Compiling llvm/lib/IR/Type.cpp; 5s local ... 2024-12-18T00:49:25.0658692Z 2024-12-18T00:49:25.0659964Z  2024-12-18T00:49:25.0660429Z  2024-12-18T00:49:25.0660830Z  2024-12-18T00:49:25.0661219Z  2024-12-18T00:49:25.0661620Z  2024-12-18T00:49:25.0662008Z  2024-12-18T00:49:25.0662381Z  2024-12-18T00:49:25.0662779Z  2024-12-18T00:49:25.0663758Z [14,622 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:25.0664840Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:25.0665799Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:49:25.0666532Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:25.0667269Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:49:25.0668082Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2024-12-18T00:49:25.0668804Z Compiling llvm/lib/IR/Type.cpp; 6s local 2024-12-18T00:49:25.0669466Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2024-12-18T00:49:25.0670223Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local ... 2024-12-18T00:49:25.2662731Z 2024-12-18T00:49:25.2664264Z  2024-12-18T00:49:25.2664730Z  2024-12-18T00:49:25.2665127Z  2024-12-18T00:49:25.2665529Z  2024-12-18T00:49:25.2665942Z  2024-12-18T00:49:25.2666390Z  2024-12-18T00:49:25.2666791Z  2024-12-18T00:49:25.2667200Z  2024-12-18T00:49:25.2668289Z [14,625 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:25.2669404Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:25.2670496Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:49:25.2671429Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:25.2672238Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:49:25.2673071Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2024-12-18T00:49:25.2673962Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2024-12-18T00:49:25.2675003Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local 2024-12-18T00:49:25.2675931Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 5s local ... 2024-12-18T00:49:25.5906680Z 2024-12-18T00:49:25.5907673Z  2024-12-18T00:49:25.5908421Z  2024-12-18T00:49:25.5908849Z  2024-12-18T00:49:25.5909228Z  2024-12-18T00:49:25.5909590Z  2024-12-18T00:49:25.5909994Z  2024-12-18T00:49:25.5910382Z  2024-12-18T00:49:25.5910773Z  2024-12-18T00:49:25.5911900Z [14,627 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:25.5913059Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2024-12-18T00:49:25.5914107Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:49:25.5914974Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:25.5915773Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:25.5916625Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2024-12-18T00:49:25.5917359Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2024-12-18T00:49:25.5918082Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local 2024-12-18T00:49:25.5919000Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 5s local ... 2024-12-18T00:49:25.8052734Z 2024-12-18T00:49:25.8054106Z  2024-12-18T00:49:25.8054532Z  2024-12-18T00:49:25.8054929Z  2024-12-18T00:49:25.8055323Z  2024-12-18T00:49:25.8055718Z  2024-12-18T00:49:25.8056098Z  2024-12-18T00:49:25.8056674Z  2024-12-18T00:49:25.8057074Z  2024-12-18T00:49:25.8057999Z [14,632 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:25.8059048Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:25.8060056Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:49:25.8060968Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:25.8061771Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:25.8062599Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2024-12-18T00:49:25.8063329Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:49:25.8064083Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 5s local 2024-12-18T00:49:25.8065022Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 5s local ... 2024-12-18T00:49:26.0670882Z 2024-12-18T00:49:26.0671832Z  2024-12-18T00:49:26.0681624Z  2024-12-18T00:49:26.0682388Z  2024-12-18T00:49:26.0682795Z  2024-12-18T00:49:26.0683151Z  2024-12-18T00:49:26.0683546Z  2024-12-18T00:49:26.0683932Z  2024-12-18T00:49:26.0684323Z  2024-12-18T00:49:26.0685266Z [14,632 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:26.0686287Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:26.0687314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:49:26.0688194Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:49:26.0688979Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:26.0689774Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2024-12-18T00:49:26.0690451Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:49:26.0691192Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local 2024-12-18T00:49:26.0692174Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local ... 2024-12-18T00:49:26.3316741Z 2024-12-18T00:49:26.3317633Z  2024-12-18T00:49:26.3318236Z  2024-12-18T00:49:26.3318613Z  2024-12-18T00:49:26.3318995Z  2024-12-18T00:49:26.3319355Z  2024-12-18T00:49:26.3319706Z  2024-12-18T00:49:26.3320068Z  2024-12-18T00:49:26.3320424Z  2024-12-18T00:49:26.3321369Z [14,633 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:26.3322693Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:26.3323896Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:49:26.3324800Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:49:26.3325584Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:26.3326354Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:26.3327180Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:49:26.3327985Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local 2024-12-18T00:49:26.3328831Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local ... 2024-12-18T00:49:26.6062629Z 2024-12-18T00:49:26.6063559Z  2024-12-18T00:49:26.6064028Z  2024-12-18T00:49:26.6064415Z  2024-12-18T00:49:26.6064785Z  2024-12-18T00:49:26.6065300Z  2024-12-18T00:49:26.6065672Z  2024-12-18T00:49:26.6066047Z  2024-12-18T00:49:26.6066414Z  2024-12-18T00:49:26.6067303Z [14,637 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:26.6068337Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2024-12-18T00:49:26.6069306Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:49:26.6070268Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:26.6071027Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:26.6071744Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2024-12-18T00:49:26.6072464Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local 2024-12-18T00:49:26.6073323Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local 2024-12-18T00:49:26.6074261Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 6s local ... 2024-12-18T00:49:26.8295371Z 2024-12-18T00:49:26.8296296Z  2024-12-18T00:49:26.8296925Z  2024-12-18T00:49:26.8297342Z  2024-12-18T00:49:26.8297728Z  2024-12-18T00:49:26.8298138Z  2024-12-18T00:49:26.8298570Z  2024-12-18T00:49:26.8298983Z  2024-12-18T00:49:26.8299384Z  2024-12-18T00:49:26.8300331Z [14,641 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:26.8301447Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:26.8302509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:49:26.8303464Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:26.8304350Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:26.8305150Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:26.8305941Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:49:26.8306910Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local 2024-12-18T00:49:26.8307962Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 6s local ... 2024-12-18T00:49:27.0677612Z 2024-12-18T00:49:27.0678520Z  2024-12-18T00:49:27.0679013Z  2024-12-18T00:49:27.0679438Z  2024-12-18T00:49:27.0679840Z  2024-12-18T00:49:27.0680239Z  2024-12-18T00:49:27.0680630Z  2024-12-18T00:49:27.0681019Z  2024-12-18T00:49:27.0681400Z  2024-12-18T00:49:27.0682390Z [14,645 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:27.0683507Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:27.0684517Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:49:27.0685717Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:27.0686479Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:27.0687194Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:27.0688293Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:49:27.0689119Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 6s local 2024-12-18T00:49:27.0690188Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local ... 2024-12-18T00:49:27.2681586Z 2024-12-18T00:49:27.2682474Z  2024-12-18T00:49:27.2682976Z  2024-12-18T00:49:27.2683377Z  2024-12-18T00:49:27.2683798Z  2024-12-18T00:49:27.2684189Z  2024-12-18T00:49:27.2684582Z  2024-12-18T00:49:27.2684984Z  2024-12-18T00:49:27.2685398Z  2024-12-18T00:49:27.2686870Z [14,647 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:27.2688025Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:27.2689066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:49:27.2690099Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:27.2690993Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:27.2691771Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:27.2692505Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:49:27.2693365Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local 2024-12-18T00:49:27.2694288Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local ... 2024-12-18T00:49:27.4754723Z 2024-12-18T00:49:27.4755608Z  2024-12-18T00:49:27.4756136Z  2024-12-18T00:49:27.4756520Z  2024-12-18T00:49:27.4756987Z  2024-12-18T00:49:27.4757363Z  2024-12-18T00:49:27.4757761Z  2024-12-18T00:49:27.4758124Z  2024-12-18T00:49:27.4758502Z  2024-12-18T00:49:27.4759456Z [14,649 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:27.4760561Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2024-12-18T00:49:27.4761602Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:49:27.4762645Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:27.4763474Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:27.4764243Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2024-12-18T00:49:27.4765007Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local 2024-12-18T00:49:27.4765886Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local 2024-12-18T00:49:27.4766809Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local ... 2024-12-18T00:49:27.8688326Z 2024-12-18T00:49:27.8689234Z  2024-12-18T00:49:27.8689730Z  2024-12-18T00:49:27.8690161Z  2024-12-18T00:49:27.8690674Z  2024-12-18T00:49:27.8691034Z  2024-12-18T00:49:27.8691434Z  2024-12-18T00:49:27.8691792Z  2024-12-18T00:49:27.8692195Z  2024-12-18T00:49:27.8693169Z [14,649 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:27.8694223Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:27.8695255Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:49:27.8696330Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:27.8697371Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:27.8698073Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:27.8698822Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:27.8699707Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local 2024-12-18T00:49:27.8700639Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local ... 2024-12-18T00:49:28.0693133Z 2024-12-18T00:49:28.0694002Z  2024-12-18T00:49:28.0694492Z  2024-12-18T00:49:28.0694907Z  2024-12-18T00:49:28.0695308Z  2024-12-18T00:49:28.0695712Z  2024-12-18T00:49:28.0696083Z  2024-12-18T00:49:28.0696637Z  2024-12-18T00:49:28.0697317Z  2024-12-18T00:49:28.0698315Z [14,652 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:28.0699507Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:28.0700344Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:49:28.0701371Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:28.0702233Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:28.0703073Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:28.0703943Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:28.0704783Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:28.0705662Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local ... 2024-12-18T00:49:28.4511199Z 2024-12-18T00:49:28.4512080Z  2024-12-18T00:49:28.4512596Z  2024-12-18T00:49:28.4513013Z  2024-12-18T00:49:28.4513395Z  2024-12-18T00:49:28.4513770Z  2024-12-18T00:49:28.4514148Z  2024-12-18T00:49:28.4514519Z  2024-12-18T00:49:28.4514911Z  2024-12-18T00:49:28.4515845Z [14,655 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:28.4516904Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:28.4517894Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:49:28.4518891Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:28.4519697Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:49:28.4520391Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:28.4521095Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:28.4521916Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:28.4522712Z Compiling llvm/lib/IR/Verifier.cpp; 5s local ... 2024-12-18T00:49:28.6698992Z 2024-12-18T00:49:28.6699919Z  2024-12-18T00:49:28.6700388Z  2024-12-18T00:49:28.6700792Z  2024-12-18T00:49:28.6701205Z  2024-12-18T00:49:28.6701637Z  2024-12-18T00:49:28.6702025Z  2024-12-18T00:49:28.6702395Z  2024-12-18T00:49:28.6702774Z  2024-12-18T00:49:28.6703696Z [14,657 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:28.6704733Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2024-12-18T00:49:28.6705736Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:49:28.6706678Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:28.6707492Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:49:28.6708356Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2024-12-18T00:49:28.6709054Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2024-12-18T00:49:28.6709874Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:28.6710624Z Compiling llvm/lib/IR/Verifier.cpp; 5s local ... 2024-12-18T00:49:28.8702546Z 2024-12-18T00:49:28.8703653Z  2024-12-18T00:49:28.8704142Z  2024-12-18T00:49:28.8704555Z  2024-12-18T00:49:28.8704941Z  2024-12-18T00:49:28.8705299Z  2024-12-18T00:49:28.8705675Z  2024-12-18T00:49:28.8706042Z  2024-12-18T00:49:28.8706393Z  2024-12-18T00:49:28.8707289Z [14,660 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:28.8708269Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:28.8709295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:49:28.8710193Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:28.8711021Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:49:28.8712021Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:49:28.8712678Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:28.8713673Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local 2024-12-18T00:49:28.8714509Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2024-12-18T00:49:29.0903557Z 2024-12-18T00:49:29.0904411Z  2024-12-18T00:49:29.0904895Z  2024-12-18T00:49:29.0905289Z  2024-12-18T00:49:29.0905697Z  2024-12-18T00:49:29.0906154Z  2024-12-18T00:49:29.0906561Z  2024-12-18T00:49:29.0907403Z  2024-12-18T00:49:29.0907784Z  2024-12-18T00:49:29.0908716Z [14,663 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:29.0909822Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:29.0910874Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:49:29.0911894Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:29.0912778Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:49:29.0913541Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:49:29.0914353Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:29.0915237Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2024-12-18T00:49:29.0916089Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2024-12-18T00:49:29.4427229Z 2024-12-18T00:49:29.4428113Z  2024-12-18T00:49:29.4428654Z  2024-12-18T00:49:29.4429116Z  2024-12-18T00:49:29.4429562Z  2024-12-18T00:49:29.4429965Z  2024-12-18T00:49:29.4430450Z  2024-12-18T00:49:29.4430827Z  2024-12-18T00:49:29.4431257Z  2024-12-18T00:49:29.4432188Z [14,666 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:29.4433240Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:29.4434268Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:49:29.4435296Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:29.4436158Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:29.4436934Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:49:29.4437761Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:29.4438587Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2024-12-18T00:49:29.4439512Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2024-12-18T00:49:29.6660830Z 2024-12-18T00:49:29.6661676Z  2024-12-18T00:49:29.6662209Z  2024-12-18T00:49:29.6662645Z  2024-12-18T00:49:29.6663075Z  2024-12-18T00:49:29.6663468Z  2024-12-18T00:49:29.6663860Z  2024-12-18T00:49:29.6664250Z  2024-12-18T00:49:29.6664652Z  2024-12-18T00:49:29.6665569Z [14,670 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:29.6666730Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2024-12-18T00:49:29.6667787Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:49:29.6668777Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:49:29.6669597Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:29.6670364Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2024-12-18T00:49:29.6671141Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2024-12-18T00:49:29.6671943Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2024-12-18T00:49:29.6672739Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 6s local ... 2024-12-18T00:49:29.8710138Z 2024-12-18T00:49:29.8710967Z  2024-12-18T00:49:29.8711459Z  2024-12-18T00:49:29.8711854Z  2024-12-18T00:49:29.8712219Z  2024-12-18T00:49:29.8712647Z  2024-12-18T00:49:29.8713032Z  2024-12-18T00:49:29.8713705Z  2024-12-18T00:49:29.8714070Z  2024-12-18T00:49:29.8714992Z [14,672 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:29.8716166Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:29.8717180Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:49:29.8718193Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:49:29.8719030Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:29.8721903Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:29.8722874Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:29.8723674Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:49:29.8724478Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 6s local ... 2024-12-18T00:49:30.1231949Z 2024-12-18T00:49:30.1232939Z  2024-12-18T00:49:30.1233413Z  2024-12-18T00:49:30.1233854Z  2024-12-18T00:49:30.1234240Z  2024-12-18T00:49:30.1234632Z  2024-12-18T00:49:30.1235022Z  2024-12-18T00:49:30.1235405Z  2024-12-18T00:49:30.1235786Z  2024-12-18T00:49:30.1236698Z [14,676 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:30.1237687Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:30.1238698Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:49:30.1239717Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:49:30.1240518Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:30.1241261Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:30.1241998Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:30.1242755Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:49:30.1243541Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 6s local ... 2024-12-18T00:49:30.4152452Z 2024-12-18T00:49:30.4153373Z  2024-12-18T00:49:30.4153844Z  2024-12-18T00:49:30.4154233Z  2024-12-18T00:49:30.4154633Z  2024-12-18T00:49:30.4155046Z  2024-12-18T00:49:30.4155421Z  2024-12-18T00:49:30.4155912Z  2024-12-18T00:49:30.4156281Z  2024-12-18T00:49:30.4157209Z [14,680 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:30.4158324Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:30.4159364Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:49:30.4160467Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:30.4161195Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:30.4161970Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:30.4162723Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:49:30.4163444Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:49:30.4164174Z Compiling llvm/lib/IR/Attributes.cpp; 6s local ... 2024-12-18T00:49:30.6430796Z 2024-12-18T00:49:30.6432009Z  2024-12-18T00:49:30.6432488Z  2024-12-18T00:49:30.6432858Z  2024-12-18T00:49:30.6433234Z  2024-12-18T00:49:30.6433605Z  2024-12-18T00:49:30.6433997Z  2024-12-18T00:49:30.6434357Z  2024-12-18T00:49:30.6434738Z  2024-12-18T00:49:30.6435695Z [14,683 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:30.6436786Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2024-12-18T00:49:30.6437920Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:49:30.6438891Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:30.6439669Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2024-12-18T00:49:30.6440879Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2024-12-18T00:49:30.6441726Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2024-12-18T00:49:30.6442513Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:49:30.6443438Z Compiling llvm/lib/IR/Attributes.cpp; 6s local ... 2024-12-18T00:49:30.8719303Z 2024-12-18T00:49:30.8720124Z  2024-12-18T00:49:30.8720613Z  2024-12-18T00:49:30.8721384Z  2024-12-18T00:49:30.8721834Z  2024-12-18T00:49:30.8722267Z  2024-12-18T00:49:30.8722813Z  2024-12-18T00:49:30.8723811Z  2024-12-18T00:49:30.8724369Z  2024-12-18T00:49:30.8725444Z [14,686 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:30.8726713Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:30.8727885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:49:30.8729022Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:30.8729908Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:30.8730798Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:49:30.8731712Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:49:30.8732562Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:49:30.8733432Z Compiling llvm/lib/IR/Attributes.cpp; 6s local ... 2024-12-18T00:49:31.0723104Z 2024-12-18T00:49:31.0723983Z  2024-12-18T00:49:31.0724468Z  2024-12-18T00:49:31.0724873Z  2024-12-18T00:49:31.0725325Z  2024-12-18T00:49:31.0725710Z  2024-12-18T00:49:31.0726078Z  2024-12-18T00:49:31.0726419Z  2024-12-18T00:49:31.0726779Z  2024-12-18T00:49:31.0727714Z [14,687 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:31.0728716Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:31.0729752Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:49:31.0730691Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:31.0731427Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:31.0732142Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:49:31.0732847Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:49:31.0733479Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:49:31.0734218Z Compiling llvm/lib/IR/Attributes.cpp; 7s local ... 2024-12-18T00:49:31.2976971Z 2024-12-18T00:49:31.2977992Z  2024-12-18T00:49:31.2978472Z  2024-12-18T00:49:31.2978842Z  2024-12-18T00:49:31.2979268Z  2024-12-18T00:49:31.2979663Z  2024-12-18T00:49:31.2980038Z  2024-12-18T00:49:31.2980423Z  2024-12-18T00:49:31.2980799Z  2024-12-18T00:49:31.2981701Z [14,690 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:31.2982771Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:31.2983696Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:49:31.2984648Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:31.2985339Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:31.2986097Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:49:31.2986868Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:49:31.2987578Z Compiling llvm/lib/IR/AsmWriter.cpp; 7s local 2024-12-18T00:49:31.2988370Z Compiling llvm/lib/IR/Attributes.cpp; 7s local ... 2024-12-18T00:49:31.5671076Z 2024-12-18T00:49:31.5673067Z  2024-12-18T00:49:31.5673591Z  2024-12-18T00:49:31.5674004Z  2024-12-18T00:49:31.5674393Z  2024-12-18T00:49:31.5674797Z  2024-12-18T00:49:31.5675228Z  2024-12-18T00:49:31.5675636Z  2024-12-18T00:49:31.5676034Z  2024-12-18T00:49:31.5677262Z [14,694 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:31.5678439Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2024-12-18T00:49:31.5679470Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:49:31.5680441Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:31.5681199Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2024-12-18T00:49:31.5681945Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2024-12-18T00:49:31.5682994Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2024-12-18T00:49:31.5683701Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:49:31.5684421Z Compiling llvm/lib/IR/Attributes.cpp; 7s local ... 2024-12-18T00:49:31.8730980Z 2024-12-18T00:49:31.8732334Z  2024-12-18T00:49:31.8732835Z  2024-12-18T00:49:31.8733224Z  2024-12-18T00:49:31.8733630Z  2024-12-18T00:49:31.8734058Z  2024-12-18T00:49:31.8734448Z  2024-12-18T00:49:31.8734817Z  2024-12-18T00:49:31.8735227Z  2024-12-18T00:49:31.8736217Z [14,699 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:31.8737510Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:31.8738551Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:49:31.8739470Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:31.8740199Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:31.8740984Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:31.8741804Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:49:31.8742560Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:49:31.8743341Z Compiling llvm/lib/IR/Attributes.cpp; 7s local ... 2024-12-18T00:49:32.1192819Z 2024-12-18T00:49:32.1193716Z  2024-12-18T00:49:32.1194208Z  2024-12-18T00:49:32.1194616Z  2024-12-18T00:49:32.1195038Z  2024-12-18T00:49:32.1195446Z  2024-12-18T00:49:32.1195836Z  2024-12-18T00:49:32.1196251Z  2024-12-18T00:49:32.1196631Z  2024-12-18T00:49:32.1197563Z [14,702 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:32.1198633Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:32.1199623Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:49:32.1200628Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:32.1201426Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:32.1202250Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:32.1203053Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:49:32.1203799Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:49:32.1204586Z Compiling xla/debug_options_flags.cc; 7s local ... 2024-12-18T00:49:32.3425852Z 2024-12-18T00:49:32.3427231Z  2024-12-18T00:49:32.3428285Z  2024-12-18T00:49:32.3428735Z  2024-12-18T00:49:32.3429698Z  2024-12-18T00:49:32.3430459Z  2024-12-18T00:49:32.3431193Z  2024-12-18T00:49:32.3432477Z  2024-12-18T00:49:32.3433890Z  2024-12-18T00:49:32.3434770Z [14,704 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:32.3435763Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:32.3436874Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:49:32.3437781Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:32.3438526Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:32.3439265Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:32.3439962Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:49:32.3440912Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2024-12-18T00:49:32.3441671Z Compiling xla/debug_options_flags.cc; 8s local ... 2024-12-18T00:49:32.6739297Z 2024-12-18T00:49:32.6740152Z  2024-12-18T00:49:32.6740588Z  2024-12-18T00:49:32.6740960Z  2024-12-18T00:49:32.6741325Z  2024-12-18T00:49:32.6741681Z  2024-12-18T00:49:32.6742025Z  2024-12-18T00:49:32.6742390Z  2024-12-18T00:49:32.6742750Z  2024-12-18T00:49:32.6743785Z [14,709 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:32.6745049Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2024-12-18T00:49:32.6746008Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:49:32.6746909Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:32.6747612Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2024-12-18T00:49:32.6748341Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2024-12-18T00:49:32.6749073Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2024-12-18T00:49:32.6749749Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:49:32.6750473Z Compiling xla/debug_options_flags.cc; 8s local ... 2024-12-18T00:49:32.8743230Z 2024-12-18T00:49:32.8744110Z  2024-12-18T00:49:32.8744762Z  2024-12-18T00:49:32.8745121Z  2024-12-18T00:49:32.8745459Z  2024-12-18T00:49:32.8745785Z  2024-12-18T00:49:32.8746126Z  2024-12-18T00:49:32.8746509Z  2024-12-18T00:49:32.8746847Z  2024-12-18T00:49:32.8747619Z [14,712 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:32.8748666Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:49:32.8749410Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:32.8749999Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:32.8750593Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 13s local 2024-12-18T00:49:32.8751187Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:49:32.8751737Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:49:32.8752293Z Compiling xla/debug_options_flags.cc; 8s local 2024-12-18T00:49:32.8752882Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 8s local ... 2024-12-18T00:49:33.1036924Z 2024-12-18T00:49:33.1037822Z  2024-12-18T00:49:33.1038310Z  2024-12-18T00:49:33.1038776Z  2024-12-18T00:49:33.1039183Z  2024-12-18T00:49:33.1039553Z  2024-12-18T00:49:33.1039959Z  2024-12-18T00:49:33.1040354Z  2024-12-18T00:49:33.1040732Z  2024-12-18T00:49:33.1041610Z [14,718 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:33.1042732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:49:33.1043708Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:33.1044676Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:33.1045293Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:49:33.1046064Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:49:33.1046738Z Compiling xla/debug_options_flags.cc; 8s local 2024-12-18T00:49:33.1047454Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 8s local 2024-12-18T00:49:33.1048346Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:49:33.3043977Z 2024-12-18T00:49:33.3045156Z  2024-12-18T00:49:33.3045645Z  2024-12-18T00:49:33.3046035Z  2024-12-18T00:49:33.3046442Z  2024-12-18T00:49:33.3046829Z  2024-12-18T00:49:33.3047219Z  2024-12-18T00:49:33.3047595Z  2024-12-18T00:49:33.3047973Z  2024-12-18T00:49:33.3048881Z [14,721 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:33.3050360Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:49:33.3051391Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:49:33.3054270Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:33.3055174Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:49:33.3055951Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2024-12-18T00:49:33.3056877Z Compiling xla/debug_options_flags.cc; 8s local 2024-12-18T00:49:33.3057814Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 8s local 2024-12-18T00:49:33.3058829Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:49:33.6484248Z 2024-12-18T00:49:33.6485247Z  2024-12-18T00:49:33.6485750Z  2024-12-18T00:49:33.6486122Z  2024-12-18T00:49:33.6486469Z  2024-12-18T00:49:33.6486806Z  2024-12-18T00:49:33.6487188Z  2024-12-18T00:49:33.6487577Z  2024-12-18T00:49:33.6487995Z  2024-12-18T00:49:33.6488976Z [14,725 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:33.6490216Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:49:33.6491196Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:49:33.6491963Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2024-12-18T00:49:33.6492686Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2024-12-18T00:49:33.6493410Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:49:33.6494174Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:33.6494943Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2024-12-18T00:49:33.6495825Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:49:33.8750769Z 2024-12-18T00:49:33.8751755Z  2024-12-18T00:49:33.8752202Z  2024-12-18T00:49:33.8752586Z  2024-12-18T00:49:33.8752984Z  2024-12-18T00:49:33.8753404Z  2024-12-18T00:49:33.8753809Z  2024-12-18T00:49:33.8754178Z  2024-12-18T00:49:33.8754561Z  2024-12-18T00:49:33.8755513Z [14,730 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:33.8756700Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:49:33.8757658Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:49:33.8758425Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:49:33.8759192Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:49:33.8759938Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:49:33.8760693Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:33.8761431Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2024-12-18T00:49:33.8762345Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local ... 2024-12-18T00:49:34.2752709Z 2024-12-18T00:49:34.2753757Z  2024-12-18T00:49:34.2754229Z  2024-12-18T00:49:34.2754654Z  2024-12-18T00:49:34.2755029Z  2024-12-18T00:49:34.2755408Z  2024-12-18T00:49:34.2755771Z  2024-12-18T00:49:34.2756154Z  2024-12-18T00:49:34.2756549Z  2024-12-18T00:49:34.2757465Z [14,731 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:34.2758626Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:49:34.2759739Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:34.2760513Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:49:34.2761264Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:49:34.2761944Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2024-12-18T00:49:34.2762640Z Compiling xla/debug_options_flags.cc; 9s local 2024-12-18T00:49:34.2763361Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2024-12-18T00:49:34.2764650Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local ... 2024-12-18T00:49:34.4755793Z 2024-12-18T00:49:34.4756805Z  2024-12-18T00:49:34.4757300Z  2024-12-18T00:49:34.4757734Z  2024-12-18T00:49:34.4758473Z  2024-12-18T00:49:34.4758908Z  2024-12-18T00:49:34.4759334Z  2024-12-18T00:49:34.4759720Z  2024-12-18T00:49:34.4760089Z  2024-12-18T00:49:34.4760978Z [14,731 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:34.4762432Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:49:34.4763570Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:34.4764356Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2024-12-18T00:49:34.4765102Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:49:34.4765894Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2024-12-18T00:49:34.4766642Z Compiling xla/debug_options_flags.cc; 10s local 2024-12-18T00:49:34.4767417Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2024-12-18T00:49:34.4768384Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local ... 2024-12-18T00:49:34.8013245Z 2024-12-18T00:49:34.8014219Z  2024-12-18T00:49:34.8014773Z  2024-12-18T00:49:34.8015126Z  2024-12-18T00:49:34.8015468Z  2024-12-18T00:49:34.8015801Z  2024-12-18T00:49:34.8016151Z  2024-12-18T00:49:34.8016619Z  2024-12-18T00:49:34.8016962Z  2024-12-18T00:49:34.8017748Z [14,732 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:34.8018745Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:49:34.8019567Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:34.8020213Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:34.8020859Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2024-12-18T00:49:34.8021585Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2024-12-18T00:49:34.8022235Z Compiling xla/debug_options_flags.cc; 10s local 2024-12-18T00:49:34.8022886Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2024-12-18T00:49:34.8023667Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local ... 2024-12-18T00:49:35.0761925Z 2024-12-18T00:49:35.0762938Z  2024-12-18T00:49:35.0763375Z  2024-12-18T00:49:35.0763712Z  2024-12-18T00:49:35.0764081Z  2024-12-18T00:49:35.0764450Z  2024-12-18T00:49:35.0764868Z  2024-12-18T00:49:35.0765218Z  2024-12-18T00:49:35.0765574Z  2024-12-18T00:49:35.0766427Z [14,733 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:35.0767474Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:49:35.0768376Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:35.0769160Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:35.0769842Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:49:35.0770600Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2024-12-18T00:49:35.0771361Z Compiling xla/debug_options_flags.cc; 10s local 2024-12-18T00:49:35.0772093Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2024-12-18T00:49:35.0773026Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local ... 2024-12-18T00:49:35.4766862Z 2024-12-18T00:49:35.4767833Z  2024-12-18T00:49:35.4768383Z  2024-12-18T00:49:35.4768835Z  2024-12-18T00:49:35.4769252Z  2024-12-18T00:49:35.4769643Z  2024-12-18T00:49:35.4770032Z  2024-12-18T00:49:35.4770420Z  2024-12-18T00:49:35.4770803Z  2024-12-18T00:49:35.4771675Z [14,735 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:35.4772791Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:49:35.4774054Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2024-12-18T00:49:35.4774802Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:35.4775677Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:49:35.4776608Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:49:35.4777370Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:35.4778168Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:49:35.4779215Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local ... 2024-12-18T00:49:35.6770962Z 2024-12-18T00:49:35.6771995Z  2024-12-18T00:49:35.6772454Z  2024-12-18T00:49:35.6772855Z  2024-12-18T00:49:35.6773235Z  2024-12-18T00:49:35.6773626Z  2024-12-18T00:49:35.6773981Z  2024-12-18T00:49:35.6774353Z  2024-12-18T00:49:35.6774731Z  2024-12-18T00:49:35.6775680Z [14,737 / 20,602] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2024-12-18T00:49:35.6777063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:49:35.6778035Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2024-12-18T00:49:35.6778754Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2024-12-18T00:49:35.6779464Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:49:35.6780182Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:35.6780936Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:49:35.6781856Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:49:35.6782740Z Compiling llvm/lib/IR/Constants.cpp; 9s local ... 2024-12-18T00:49:35.8786830Z 2024-12-18T00:49:35.8787816Z  2024-12-18T00:49:35.8788275Z  2024-12-18T00:49:35.8788657Z  2024-12-18T00:49:35.8789008Z  2024-12-18T00:49:35.8789351Z  2024-12-18T00:49:35.8789723Z  2024-12-18T00:49:35.8790148Z  2024-12-18T00:49:35.8790513Z  2024-12-18T00:49:35.8791418Z [14,740 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:35.8792576Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:49:35.8793462Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:49:35.8794124Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:49:35.8794752Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:49:35.8795401Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:35.8796079Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:49:35.8796966Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2024-12-18T00:49:35.8797876Z Compiling llvm/lib/IR/Constants.cpp; 9s local ... 2024-12-18T00:49:36.2188156Z 2024-12-18T00:49:36.2189153Z  2024-12-18T00:49:36.2189587Z  2024-12-18T00:49:36.2189953Z  2024-12-18T00:49:36.2190351Z  2024-12-18T00:49:36.2190715Z  2024-12-18T00:49:36.2191080Z  2024-12-18T00:49:36.2191447Z  2024-12-18T00:49:36.2191834Z  2024-12-18T00:49:36.2192789Z [14,745 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:36.2193911Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:49:36.2194793Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:49:36.2195461Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:49:36.2196157Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2024-12-18T00:49:36.2196845Z Compiling xla/debug_options_flags.cc; 11s local 2024-12-18T00:49:36.2197539Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2024-12-18T00:49:36.2198232Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2024-12-18T00:49:36.2198893Z Compiling llvm/lib/IR/Core.cpp; 7s local ... 2024-12-18T00:49:36.4236820Z 2024-12-18T00:49:36.4238122Z  2024-12-18T00:49:36.4238560Z  2024-12-18T00:49:36.4238930Z  2024-12-18T00:49:36.4239284Z  2024-12-18T00:49:36.4239658Z  2024-12-18T00:49:36.4240023Z  2024-12-18T00:49:36.4240574Z  2024-12-18T00:49:36.4240962Z  2024-12-18T00:49:36.4241897Z [14,747 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:36.4243132Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:49:36.4244563Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:49:36.4245415Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:49:36.4246180Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:49:36.4246956Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:36.4247681Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:49:36.4248412Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2024-12-18T00:49:36.4249071Z Compiling llvm/lib/IR/Core.cpp; 7s local ... 2024-12-18T00:49:36.6779726Z 2024-12-18T00:49:36.6780754Z  2024-12-18T00:49:36.6781175Z  2024-12-18T00:49:36.6781534Z  2024-12-18T00:49:36.6781928Z  2024-12-18T00:49:36.6782335Z  2024-12-18T00:49:36.6782715Z  2024-12-18T00:49:36.6783066Z  2024-12-18T00:49:36.6783421Z  2024-12-18T00:49:36.6784358Z [14,751 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:36.6785476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:49:36.6786309Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2024-12-18T00:49:36.6786912Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2024-12-18T00:49:36.6787559Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:49:36.6788236Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:36.6788903Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:49:36.6789592Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:49:36.6790253Z Compiling llvm/lib/IR/Core.cpp; 8s local ... 2024-12-18T00:49:36.8784087Z 2024-12-18T00:49:36.8785078Z  2024-12-18T00:49:36.8785532Z  2024-12-18T00:49:36.8785896Z  2024-12-18T00:49:36.8786258Z  2024-12-18T00:49:36.8786628Z  2024-12-18T00:49:36.8786961Z  2024-12-18T00:49:36.8787313Z  2024-12-18T00:49:36.8787668Z  2024-12-18T00:49:36.8788543Z [14,752 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:36.8789602Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:49:36.8790408Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:36.8791035Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:49:36.8791676Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:49:36.8792331Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:36.8793070Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:49:36.8793810Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:49:36.8794538Z Compiling llvm/lib/IR/Core.cpp; 8s local ... 2024-12-18T00:49:37.2262734Z 2024-12-18T00:49:37.2263600Z  2024-12-18T00:49:37.2263987Z  2024-12-18T00:49:37.2264359Z  2024-12-18T00:49:37.2264690Z  2024-12-18T00:49:37.2265017Z  2024-12-18T00:49:37.2265347Z  2024-12-18T00:49:37.2265658Z  2024-12-18T00:49:37.2265982Z  2024-12-18T00:49:37.2266812Z [14,757 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:37.2267762Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:49:37.2268550Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:37.2269128Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:49:37.2269776Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2024-12-18T00:49:37.2270603Z Compiling xla/debug_options_flags.cc; 12s local 2024-12-18T00:49:37.2271248Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2024-12-18T00:49:37.2271923Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:49:37.2272495Z Compiling llvm/lib/IR/Core.cpp; 8s local ... 2024-12-18T00:49:37.4761193Z 2024-12-18T00:49:37.4762212Z  2024-12-18T00:49:37.4762712Z  2024-12-18T00:49:37.4763110Z  2024-12-18T00:49:37.4763506Z  2024-12-18T00:49:37.4764004Z  2024-12-18T00:49:37.4764785Z  2024-12-18T00:49:37.4765207Z  2024-12-18T00:49:37.4765619Z  2024-12-18T00:49:37.4766595Z [14,763 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:37.4767791Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:49:37.4768744Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:37.4769492Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:49:37.4770233Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:37.4771032Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:49:37.4771804Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2024-12-18T00:49:37.4772496Z Compiling llvm/lib/IR/Core.cpp; 8s local 2024-12-18T00:49:37.4773439Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 8s local ... 2024-12-18T00:49:37.6790113Z 2024-12-18T00:49:37.6791149Z  2024-12-18T00:49:37.6791619Z  2024-12-18T00:49:37.6792002Z  2024-12-18T00:49:37.6792408Z  2024-12-18T00:49:37.6792801Z  2024-12-18T00:49:37.6793204Z  2024-12-18T00:49:37.6793663Z  2024-12-18T00:49:37.6794142Z  2024-12-18T00:49:37.6809290Z [14,764 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:37.6810632Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:49:37.6811577Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2024-12-18T00:49:37.6812303Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2024-12-18T00:49:37.6813111Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:37.6813891Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:49:37.6814608Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:49:37.6815305Z Compiling llvm/lib/IR/Core.cpp; 9s local 2024-12-18T00:49:37.6816292Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 8s local ... 2024-12-18T00:49:37.9984914Z 2024-12-18T00:49:37.9985884Z  2024-12-18T00:49:37.9986340Z  2024-12-18T00:49:37.9986724Z  2024-12-18T00:49:37.9987140Z  2024-12-18T00:49:37.9987495Z  2024-12-18T00:49:37.9987880Z  2024-12-18T00:49:37.9988255Z  2024-12-18T00:49:37.9988625Z  2024-12-18T00:49:37.9989549Z [14,765 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:37.9990689Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:49:37.9991584Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:37.9992255Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:49:37.9992927Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:37.9993645Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:49:37.9994371Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:49:37.9995051Z Compiling llvm/lib/IR/Core.cpp; 9s local 2024-12-18T00:49:37.9996057Z Compiling llvm/utils/TableGen/DecoderEmitter.cpp [for tool]; 8s local ... 2024-12-18T00:49:38.2753318Z 2024-12-18T00:49:38.2754373Z  2024-12-18T00:49:38.2754831Z  2024-12-18T00:49:38.2755223Z  2024-12-18T00:49:38.2755612Z  2024-12-18T00:49:38.2756001Z  2024-12-18T00:49:38.2756389Z  2024-12-18T00:49:38.2757092Z  2024-12-18T00:49:38.2757489Z  2024-12-18T00:49:38.2758403Z [14,771 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:38.2759727Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:49:38.2760633Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:38.2761351Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:49:38.2762042Z Compiling xla/debug_options_flags.cc; 13s local 2024-12-18T00:49:38.2762916Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2024-12-18T00:49:38.2763775Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:49:38.2764631Z Compiling llvm/lib/IR/DebugInfo.cpp; 6s local 2024-12-18T00:49:38.2765637Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local ... 2024-12-18T00:49:38.4797767Z 2024-12-18T00:49:38.4798765Z  2024-12-18T00:49:38.4799268Z  2024-12-18T00:49:38.4799687Z  2024-12-18T00:49:38.4800146Z  2024-12-18T00:49:38.4800549Z  2024-12-18T00:49:38.4800939Z  2024-12-18T00:49:38.4801342Z  2024-12-18T00:49:38.4801717Z  2024-12-18T00:49:38.4802632Z [14,772 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:38.4803849Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:49:38.4804801Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:38.4805531Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:49:38.4806279Z Compiling xla/debug_options_flags.cc; 14s local 2024-12-18T00:49:38.4807053Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:49:38.4807801Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2024-12-18T00:49:38.4808559Z Compiling llvm/lib/IR/DebugInfo.cpp; 6s local 2024-12-18T00:49:38.4809561Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local ... 2024-12-18T00:49:38.6802639Z 2024-12-18T00:49:38.6803639Z  2024-12-18T00:49:38.6804153Z  2024-12-18T00:49:38.6804543Z  2024-12-18T00:49:38.6804942Z  2024-12-18T00:49:38.6805342Z  2024-12-18T00:49:38.6805735Z  2024-12-18T00:49:38.6806146Z  2024-12-18T00:49:38.6806542Z  2024-12-18T00:49:38.6807663Z [14,774 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:38.6808839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:49:38.6809691Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2024-12-18T00:49:38.6810370Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2024-12-18T00:49:38.6811031Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:49:38.6811784Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2024-12-18T00:49:38.6812655Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local 2024-12-18T00:49:38.6813804Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 6s local 2024-12-18T00:49:38.6815039Z Compiling xla/tsl/profiler/utils/xplane_builder.cc; 6s local ... 2024-12-18T00:49:38.8817122Z 2024-12-18T00:49:38.8818104Z  2024-12-18T00:49:38.8818630Z  2024-12-18T00:49:38.8819041Z  2024-12-18T00:49:38.8819441Z  2024-12-18T00:49:38.8819799Z  2024-12-18T00:49:38.8820193Z  2024-12-18T00:49:38.8820592Z  2024-12-18T00:49:38.8820983Z  2024-12-18T00:49:38.8821975Z [14,778 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:38.8823197Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:49:38.8824147Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2024-12-18T00:49:38.8824871Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:49:38.8825603Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:49:38.8826335Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2024-12-18T00:49:38.8827553Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local 2024-12-18T00:49:38.8828568Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 6s local 2024-12-18T00:49:38.8829755Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 6s local ... 2024-12-18T00:49:39.1384966Z 2024-12-18T00:49:39.1385946Z  2024-12-18T00:49:39.1386390Z  2024-12-18T00:49:39.1386780Z  2024-12-18T00:49:39.1387189Z  2024-12-18T00:49:39.1387571Z  2024-12-18T00:49:39.1387943Z  2024-12-18T00:49:39.1388337Z  2024-12-18T00:49:39.1389099Z  2024-12-18T00:49:39.1390055Z [14,780 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:39.1391203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:49:39.1392076Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2024-12-18T00:49:39.1392787Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:49:39.1393538Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:49:39.1394274Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2024-12-18T00:49:39.1395232Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local 2024-12-18T00:49:39.1396207Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 7s local 2024-12-18T00:49:39.1397081Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 6s local ... 2024-12-18T00:49:39.3723752Z 2024-12-18T00:49:39.3724669Z  2024-12-18T00:49:39.3725134Z  2024-12-18T00:49:39.3725527Z  2024-12-18T00:49:39.3725963Z  2024-12-18T00:49:39.3726349Z  2024-12-18T00:49:39.3726868Z  2024-12-18T00:49:39.3727274Z  2024-12-18T00:49:39.3727670Z  2024-12-18T00:49:39.3728622Z [14,782 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:39.3729787Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:49:39.3730743Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:49:39.3731498Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2024-12-18T00:49:39.3732245Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2024-12-18T00:49:39.3733037Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 7s local 2024-12-18T00:49:39.3733862Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 6s local 2024-12-18T00:49:39.3734812Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 6s local 2024-12-18T00:49:39.3735741Z Compiling llvm/lib/MC/MCContext.cpp; 6s local ... 2024-12-18T00:49:39.5735267Z 2024-12-18T00:49:39.5736161Z  2024-12-18T00:49:39.5736752Z  2024-12-18T00:49:39.5737180Z  2024-12-18T00:49:39.5737566Z  2024-12-18T00:49:39.5737952Z  2024-12-18T00:49:39.5738357Z  2024-12-18T00:49:39.5738767Z  2024-12-18T00:49:39.5739169Z  2024-12-18T00:49:39.5740169Z [14,786 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:39.5741261Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:49:39.5742069Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:49:39.5742807Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:49:39.5743514Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2024-12-18T00:49:39.5744677Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 7s local 2024-12-18T00:49:39.5745526Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 7s local 2024-12-18T00:49:39.5746419Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 6s local 2024-12-18T00:49:39.5747371Z Compiling llvm/lib/MC/MCContext.cpp; 6s local ... 2024-12-18T00:49:39.7743713Z 2024-12-18T00:49:39.7744819Z  2024-12-18T00:49:39.7745315Z  2024-12-18T00:49:39.7745731Z  2024-12-18T00:49:39.7746127Z  2024-12-18T00:49:39.7746550Z  2024-12-18T00:49:39.7746956Z  2024-12-18T00:49:39.7747373Z  2024-12-18T00:49:39.7748061Z  2024-12-18T00:49:39.7749051Z [14,789 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:39.7750457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:49:39.7751467Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2024-12-18T00:49:39.7752274Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:49:39.7753071Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:49:39.7753977Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 7s local 2024-12-18T00:49:39.7755019Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 6s local 2024-12-18T00:49:39.7755944Z Compiling llvm/lib/MC/MCContext.cpp; 6s local 2024-12-18T00:49:39.7756929Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2024-12-18T00:49:40.0813280Z 2024-12-18T00:49:40.0814116Z  2024-12-18T00:49:40.0814593Z  2024-12-18T00:49:40.0814973Z  2024-12-18T00:49:40.0815398Z  2024-12-18T00:49:40.0815780Z  2024-12-18T00:49:40.0816198Z  2024-12-18T00:49:40.0816754Z  2024-12-18T00:49:40.0817146Z  2024-12-18T00:49:40.0818152Z [14,791 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:40.0819350Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:49:40.0820249Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:49:40.0820954Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:49:40.0821681Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:49:40.0822467Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2024-12-18T00:49:40.0823371Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:49:40.0824263Z Compiling llvm/lib/MC/MCContext.cpp; 6s local 2024-12-18T00:49:40.0825109Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2024-12-18T00:49:40.3935939Z 2024-12-18T00:49:40.3936918Z  2024-12-18T00:49:40.3937409Z  2024-12-18T00:49:40.3937827Z  2024-12-18T00:49:40.3938203Z  2024-12-18T00:49:40.3938617Z  2024-12-18T00:49:40.3939048Z  2024-12-18T00:49:40.3939465Z  2024-12-18T00:49:40.3939891Z  2024-12-18T00:49:40.3940861Z [14,793 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:40.3941981Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:49:40.3942880Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:49:40.3943535Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2024-12-18T00:49:40.3944442Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2024-12-18T00:49:40.3945150Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2024-12-18T00:49:40.3946162Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:49:40.3946995Z Compiling llvm/lib/MC/MCContext.cpp; 7s local 2024-12-18T00:49:40.3947781Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2024-12-18T00:49:40.6048758Z 2024-12-18T00:49:40.6049655Z  2024-12-18T00:49:40.6050181Z  2024-12-18T00:49:40.6050586Z  2024-12-18T00:49:40.6050992Z  2024-12-18T00:49:40.6051391Z  2024-12-18T00:49:40.6051813Z  2024-12-18T00:49:40.6052203Z  2024-12-18T00:49:40.6052600Z  2024-12-18T00:49:40.6053589Z [14,797 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:40.6054773Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:49:40.6055709Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2024-12-18T00:49:40.6056649Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:49:40.6057446Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2024-12-18T00:49:40.6058362Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:49:40.6059536Z Compiling llvm/lib/MC/MCContext.cpp; 7s local 2024-12-18T00:49:40.6060418Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 5s local 2024-12-18T00:49:40.6061486Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local ... 2024-12-18T00:49:40.8406155Z 2024-12-18T00:49:40.8407025Z  2024-12-18T00:49:40.8407531Z  2024-12-18T00:49:40.8407960Z  2024-12-18T00:49:40.8408373Z  2024-12-18T00:49:40.8408787Z  2024-12-18T00:49:40.8409209Z  2024-12-18T00:49:40.8409617Z  2024-12-18T00:49:40.8410409Z  2024-12-18T00:49:40.8411411Z [14,804 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:40.8412658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:49:40.8413626Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:49:40.8414397Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:49:40.8415241Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2024-12-18T00:49:40.8416204Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local 2024-12-18T00:49:40.8417455Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 5s local 2024-12-18T00:49:40.8418439Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2024-12-18T00:49:40.8419448Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 4s local ... 2024-12-18T00:49:41.0822376Z 2024-12-18T00:49:41.0823291Z  2024-12-18T00:49:41.0823764Z  2024-12-18T00:49:41.0824247Z  2024-12-18T00:49:41.0824770Z  2024-12-18T00:49:41.0825177Z  2024-12-18T00:49:41.0825564Z  2024-12-18T00:49:41.0825932Z  2024-12-18T00:49:41.0826317Z  2024-12-18T00:49:41.0827237Z [14,805 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:41.0828389Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:49:41.0829293Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:49:41.0829973Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:49:41.0830707Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:49:41.0831597Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:41.0832612Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 5s local 2024-12-18T00:49:41.0833510Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2024-12-18T00:49:41.0834419Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local ... 2024-12-18T00:49:41.3151858Z 2024-12-18T00:49:41.3152778Z  2024-12-18T00:49:41.3153237Z  2024-12-18T00:49:41.3153650Z  2024-12-18T00:49:41.3154049Z  2024-12-18T00:49:41.3154466Z  2024-12-18T00:49:41.3154832Z  2024-12-18T00:49:41.3155209Z  2024-12-18T00:49:41.3155577Z  2024-12-18T00:49:41.3156449Z [14,808 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:41.3157603Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:49:41.3158490Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:49:41.3159216Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2024-12-18T00:49:41.3160003Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:49:41.3160910Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:41.3161908Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 5s local 2024-12-18T00:49:41.3162876Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2024-12-18T00:49:41.3163797Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local ... 2024-12-18T00:49:41.5908681Z 2024-12-18T00:49:41.5909563Z  2024-12-18T00:49:41.5910069Z  2024-12-18T00:49:41.5910465Z  2024-12-18T00:49:41.5910854Z  2024-12-18T00:49:41.5911505Z  2024-12-18T00:49:41.5911907Z  2024-12-18T00:49:41.5912306Z  2024-12-18T00:49:41.5912696Z  2024-12-18T00:49:41.5913817Z [14,809 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:41.5914937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:49:41.5915776Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:49:41.5916508Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 17s local 2024-12-18T00:49:41.5917469Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:49:41.5918416Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:41.5919312Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 5s local 2024-12-18T00:49:41.5920207Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2024-12-18T00:49:41.5921118Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local ... 2024-12-18T00:49:41.8057084Z 2024-12-18T00:49:41.8058132Z  2024-12-18T00:49:41.8058615Z  2024-12-18T00:49:41.8059016Z  2024-12-18T00:49:41.8059377Z  2024-12-18T00:49:41.8059753Z  2024-12-18T00:49:41.8060118Z  2024-12-18T00:49:41.8060520Z  2024-12-18T00:49:41.8060901Z  2024-12-18T00:49:41.8061796Z [14,812 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:41.8062945Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:49:41.8063855Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2024-12-18T00:49:41.8064571Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 17s local 2024-12-18T00:49:41.8065302Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2024-12-18T00:49:41.8066199Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2024-12-18T00:49:41.8067144Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 6s local 2024-12-18T00:49:41.8068031Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local 2024-12-18T00:49:41.8068905Z Compiling llvm/lib/ObjectYAML/DWARFEmitter.cpp; 5s local ... 2024-12-18T00:49:42.0832846Z 2024-12-18T00:49:42.0833755Z  2024-12-18T00:49:42.0834266Z  2024-12-18T00:49:42.0834676Z  2024-12-18T00:49:42.0835074Z  2024-12-18T00:49:42.0835454Z  2024-12-18T00:49:42.0835844Z  2024-12-18T00:49:42.0836256Z  2024-12-18T00:49:42.0836646Z  2024-12-18T00:49:42.0837580Z [14,814 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:42.0838697Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:49:42.0839605Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2024-12-18T00:49:42.0840369Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:42.0841250Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:42.0842264Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 6s local 2024-12-18T00:49:42.0843195Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:49:42.0843951Z Compiling llvm/lib/ObjectYAML/DWARFEmitter.cpp; 5s local 2024-12-18T00:49:42.0845064Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 5s local ... 2024-12-18T00:49:42.3041947Z 2024-12-18T00:49:42.3042817Z  2024-12-18T00:49:42.3043263Z  2024-12-18T00:49:42.3043666Z  2024-12-18T00:49:42.3044061Z  2024-12-18T00:49:42.3044687Z  2024-12-18T00:49:42.3045090Z  2024-12-18T00:49:42.3045518Z  2024-12-18T00:49:42.3045901Z  2024-12-18T00:49:42.3046792Z [14,818 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:42.3047866Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:49:42.3048889Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:42.3049870Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:42.3051135Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 6s local 2024-12-18T00:49:42.3052192Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:49:42.3052992Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 5s local 2024-12-18T00:49:42.3053724Z Compiling llvm/lib/IR/Dominators.cpp; 5s local 2024-12-18T00:49:42.3054622Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 5s local ... 2024-12-18T00:49:42.6355107Z 2024-12-18T00:49:42.6355987Z  2024-12-18T00:49:42.6356855Z  2024-12-18T00:49:42.6357277Z  2024-12-18T00:49:42.6357696Z  2024-12-18T00:49:42.6358089Z  2024-12-18T00:49:42.6358495Z  2024-12-18T00:49:42.6358907Z  2024-12-18T00:49:42.6359315Z  2024-12-18T00:49:42.6360268Z [14,821 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:42.6361444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:49:42.6362453Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:42.6363416Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:42.6364446Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local 2024-12-18T00:49:42.6365425Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:49:42.6366293Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 6s local 2024-12-18T00:49:42.6367071Z Compiling llvm/lib/IR/Dominators.cpp; 6s local 2024-12-18T00:49:42.6367996Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 5s local ... 2024-12-18T00:49:42.8839790Z 2024-12-18T00:49:42.8840640Z  2024-12-18T00:49:42.8841133Z  2024-12-18T00:49:42.8841517Z  2024-12-18T00:49:42.8841885Z  2024-12-18T00:49:42.8842285Z  2024-12-18T00:49:42.8842668Z  2024-12-18T00:49:42.8843055Z  2024-12-18T00:49:42.8843405Z  2024-12-18T00:49:42.8844598Z [14,826 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:42.8845714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:49:42.8846667Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2024-12-18T00:49:42.8847532Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2024-12-18T00:49:42.8848488Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local 2024-12-18T00:49:42.8849395Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:49:42.8850221Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 6s local 2024-12-18T00:49:42.8851015Z Compiling llvm/lib/IR/Dominators.cpp; 6s local 2024-12-18T00:49:42.8851870Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local ... 2024-12-18T00:49:43.0843968Z 2024-12-18T00:49:43.0845072Z  2024-12-18T00:49:43.0845573Z  2024-12-18T00:49:43.0845954Z  2024-12-18T00:49:43.0846385Z  2024-12-18T00:49:43.0846777Z  2024-12-18T00:49:43.0847156Z  2024-12-18T00:49:43.0847523Z  2024-12-18T00:49:43.0847908Z  2024-12-18T00:49:43.0848838Z [14,829 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:43.0849985Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:49:43.0850951Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:43.0851883Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2024-12-18T00:49:43.0852944Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local 2024-12-18T00:49:43.0853873Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2024-12-18T00:49:43.0854670Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 6s local 2024-12-18T00:49:43.0855433Z Compiling llvm/lib/IR/Dominators.cpp; 6s local 2024-12-18T00:49:43.0856328Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local ... 2024-12-18T00:49:43.4848762Z 2024-12-18T00:49:43.4849687Z  2024-12-18T00:49:43.4850140Z  2024-12-18T00:49:43.4850518Z  2024-12-18T00:49:43.4850896Z  2024-12-18T00:49:43.4851579Z  2024-12-18T00:49:43.4851963Z  2024-12-18T00:49:43.4852338Z  2024-12-18T00:49:43.4852695Z  2024-12-18T00:49:43.4853585Z [14,831 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:43.4854871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:49:43.4855898Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:43.4856943Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2024-12-18T00:49:43.4857885Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 7s local 2024-12-18T00:49:43.4858816Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2024-12-18T00:49:43.4859610Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:43.4860350Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2024-12-18T00:49:43.4861150Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local ... 2024-12-18T00:49:43.6853172Z 2024-12-18T00:49:43.6854060Z  2024-12-18T00:49:43.6854549Z  2024-12-18T00:49:43.6854945Z  2024-12-18T00:49:43.6855350Z  2024-12-18T00:49:43.6855753Z  2024-12-18T00:49:43.6856141Z  2024-12-18T00:49:43.6856701Z  2024-12-18T00:49:43.6857094Z  2024-12-18T00:49:43.6858045Z [14,833 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:43.6859149Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:49:43.6860098Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:43.6860959Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLTypes.cpp; 8s local 2024-12-18T00:49:43.6861850Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2024-12-18T00:49:43.6862676Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:43.6863395Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2024-12-18T00:49:43.6864152Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2024-12-18T00:49:43.6865037Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 6s local ... 2024-12-18T00:49:43.9769693Z 2024-12-18T00:49:43.9770579Z  2024-12-18T00:49:43.9771065Z  2024-12-18T00:49:43.9771461Z  2024-12-18T00:49:43.9771830Z  2024-12-18T00:49:43.9772264Z  2024-12-18T00:49:43.9772650Z  2024-12-18T00:49:43.9773034Z  2024-12-18T00:49:43.9773432Z  2024-12-18T00:49:43.9774329Z [14,839 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:43.9775474Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:49:43.9776610Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2024-12-18T00:49:43.9777426Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:43.9778112Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2024-12-18T00:49:43.9778858Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2024-12-18T00:49:43.9779635Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 5s local 2024-12-18T00:49:43.9780529Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 5s local 2024-12-18T00:49:43.9781657Z Compiling xla/tsl/profiler/convert/trace_events_to_json.cc; 4s local ... 2024-12-18T00:49:44.2632252Z 2024-12-18T00:49:44.2633155Z  2024-12-18T00:49:44.2633598Z  2024-12-18T00:49:44.2633978Z  2024-12-18T00:49:44.2634390Z  2024-12-18T00:49:44.2634769Z  2024-12-18T00:49:44.2635175Z  2024-12-18T00:49:44.2635589Z  2024-12-18T00:49:44.2635988Z  2024-12-18T00:49:44.2636918Z [14,842 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:44.2638342Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:49:44.2639328Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2024-12-18T00:49:44.2640287Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local 2024-12-18T00:49:44.2641067Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2024-12-18T00:49:44.2642151Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:44.2642980Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 5s local 2024-12-18T00:49:44.2644072Z Compiling llvm/lib/ObjectYAML/GOFFEmitter.cpp; 5s local 2024-12-18T00:49:44.2645193Z Compiling llvm/lib/IR/Instruction.cpp; 4s local ... 2024-12-18T00:49:44.4859290Z 2024-12-18T00:49:44.4860137Z  2024-12-18T00:49:44.4860622Z  2024-12-18T00:49:44.4861022Z  2024-12-18T00:49:44.4861413Z  2024-12-18T00:49:44.4861805Z  2024-12-18T00:49:44.4862215Z  2024-12-18T00:49:44.4862636Z  2024-12-18T00:49:44.4863083Z  2024-12-18T00:49:44.4864024Z [14,847 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:44.4865226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:49:44.4866238Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2024-12-18T00:49:44.4867053Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2024-12-18T00:49:44.4867851Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2024-12-18T00:49:44.4868657Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:44.4869476Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 5s local 2024-12-18T00:49:44.4870254Z Compiling llvm/lib/IR/Instruction.cpp; 4s local 2024-12-18T00:49:44.4871024Z Compiling llvm/lib/IR/Instructions.cpp; 4s local ... 2024-12-18T00:49:44.6863656Z 2024-12-18T00:49:44.6864573Z  2024-12-18T00:49:44.6865096Z  2024-12-18T00:49:44.6865523Z  2024-12-18T00:49:44.6866162Z  2024-12-18T00:49:44.6866553Z  2024-12-18T00:49:44.6866968Z  2024-12-18T00:49:44.6867382Z  2024-12-18T00:49:44.6867812Z  2024-12-18T00:49:44.6868837Z [14,850 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:44.6870047Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:49:44.6871093Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2024-12-18T00:49:44.6871858Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2024-12-18T00:49:44.6872690Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:44.6873555Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local 2024-12-18T00:49:44.6874309Z Compiling llvm/lib/IR/Instruction.cpp; 5s local 2024-12-18T00:49:44.6875085Z Compiling llvm/lib/IR/Instructions.cpp; 4s local 2024-12-18T00:49:44.6875928Z Compiling llvm/lib/IR/IntrinsicInst.cpp; 4s local ... 2024-12-18T00:49:44.9777383Z 2024-12-18T00:49:44.9778253Z  2024-12-18T00:49:44.9778742Z  2024-12-18T00:49:44.9779150Z  2024-12-18T00:49:44.9779533Z  2024-12-18T00:49:44.9779936Z  2024-12-18T00:49:44.9780366Z  2024-12-18T00:49:44.9780772Z  2024-12-18T00:49:44.9781171Z  2024-12-18T00:49:44.9782090Z [14,853 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:44.9783232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:49:44.9784241Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2024-12-18T00:49:44.9785045Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2024-12-18T00:49:44.9785843Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2024-12-18T00:49:44.9786622Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local 2024-12-18T00:49:44.9787382Z Compiling llvm/lib/IR/Instruction.cpp; 5s local 2024-12-18T00:49:44.9788144Z Compiling llvm/lib/IR/Instructions.cpp; 4s local 2024-12-18T00:49:44.9789294Z Compiling llvm/lib/IR/IntrinsicInst.cpp; 4s local ... 2024-12-18T00:49:45.2691072Z 2024-12-18T00:49:45.2691967Z  2024-12-18T00:49:45.2692485Z  2024-12-18T00:49:45.2693197Z  2024-12-18T00:49:45.2693643Z  2024-12-18T00:49:45.2694065Z  2024-12-18T00:49:45.2694461Z  2024-12-18T00:49:45.2694911Z  2024-12-18T00:49:45.2695347Z  2024-12-18T00:49:45.2696345Z [14,860 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:45.2698021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:49:45.2699075Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2024-12-18T00:49:45.2699907Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2024-12-18T00:49:45.2700772Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:45.2701647Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local 2024-12-18T00:49:45.2702413Z Compiling llvm/lib/IR/Instructions.cpp; 4s local 2024-12-18T00:49:45.2703226Z Compiling llvm/lib/IR/IntrinsicInst.cpp; 4s local 2024-12-18T00:49:45.2704067Z Compiling llvm/lib/IR/Intrinsics.cpp; 4s local ... 2024-12-18T00:49:45.4871028Z 2024-12-18T00:49:45.4871891Z  2024-12-18T00:49:45.4872366Z  2024-12-18T00:49:45.4872770Z  2024-12-18T00:49:45.4873171Z  2024-12-18T00:49:45.4873563Z  2024-12-18T00:49:45.4873961Z  2024-12-18T00:49:45.4874345Z  2024-12-18T00:49:45.4874753Z  2024-12-18T00:49:45.4875743Z [14,862 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:45.4876894Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:49:45.4877856Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:45.4878604Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2024-12-18T00:49:45.4879353Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:45.4880132Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local 2024-12-18T00:49:45.4880883Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2024-12-18T00:49:45.4881685Z Compiling llvm/lib/IR/Intrinsics.cpp; 4s local 2024-12-18T00:49:45.4882433Z Compiling llvm/lib/IR/LLVMContext.cpp; 4s local ... 2024-12-18T00:49:45.6912184Z 2024-12-18T00:49:45.6913291Z  2024-12-18T00:49:45.6913773Z  2024-12-18T00:49:45.6914175Z  2024-12-18T00:49:45.6914580Z  2024-12-18T00:49:45.6915016Z  2024-12-18T00:49:45.6915414Z  2024-12-18T00:49:45.6915802Z  2024-12-18T00:49:45.6916170Z  2024-12-18T00:49:45.6917074Z [14,863 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:45.6918187Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:49:45.6919123Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:45.6919907Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2024-12-18T00:49:45.6920664Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:45.6921461Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2024-12-18T00:49:45.6922209Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2024-12-18T00:49:45.6922936Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local 2024-12-18T00:49:45.6923686Z Compiling llvm/lib/IR/LLVMContext.cpp; 4s local ... 2024-12-18T00:49:45.9981023Z 2024-12-18T00:49:45.9981969Z  2024-12-18T00:49:45.9982434Z  2024-12-18T00:49:45.9982817Z  2024-12-18T00:49:45.9983138Z  2024-12-18T00:49:45.9983460Z  2024-12-18T00:49:45.9983762Z  2024-12-18T00:49:45.9984112Z  2024-12-18T00:49:45.9984479Z  2024-12-18T00:49:45.9985437Z [14,868 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:45.9986810Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:49:45.9987797Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:45.9988696Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2024-12-18T00:49:45.9989458Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2024-12-18T00:49:45.9990304Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2024-12-18T00:49:45.9991058Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2024-12-18T00:49:45.9991791Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local 2024-12-18T00:49:45.9992886Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 4s local ... 2024-12-18T00:49:46.2877597Z 2024-12-18T00:49:46.2878455Z  2024-12-18T00:49:46.2879068Z  2024-12-18T00:49:46.2879452Z  2024-12-18T00:49:46.2879838Z  2024-12-18T00:49:46.2880277Z  2024-12-18T00:49:46.2880674Z  2024-12-18T00:49:46.2881069Z  2024-12-18T00:49:46.2881439Z  2024-12-18T00:49:46.2882370Z [14,870 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:46.2883489Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:49:46.2884445Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2024-12-18T00:49:46.2885259Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:49:46.2885999Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2024-12-18T00:49:46.2886712Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2024-12-18T00:49:46.2887460Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local 2024-12-18T00:49:46.2888221Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 5s local 2024-12-18T00:49:46.2889188Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 4s local ... 2024-12-18T00:49:46.5360896Z 2024-12-18T00:49:46.5361805Z  2024-12-18T00:49:46.5362266Z  2024-12-18T00:49:46.5362662Z  2024-12-18T00:49:46.5363026Z  2024-12-18T00:49:46.5363419Z  2024-12-18T00:49:46.5363808Z  2024-12-18T00:49:46.5364312Z  2024-12-18T00:49:46.5364714Z  2024-12-18T00:49:46.5365650Z [14,871 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:46.5366800Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:49:46.5367838Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 10s local 2024-12-18T00:49:46.5368759Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:49:46.5369653Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2024-12-18T00:49:46.5370498Z Compiling llvm/lib/IR/Instructions.cpp; 6s local 2024-12-18T00:49:46.5371165Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local 2024-12-18T00:49:46.5371957Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 5s local 2024-12-18T00:49:46.5372882Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 5s local ... 2024-12-18T00:49:46.7821097Z 2024-12-18T00:49:46.7821983Z  2024-12-18T00:49:46.7822490Z  2024-12-18T00:49:46.7822889Z  2024-12-18T00:49:46.7823316Z  2024-12-18T00:49:46.7823731Z  2024-12-18T00:49:46.7824143Z  2024-12-18T00:49:46.7824578Z  2024-12-18T00:49:46.7824973Z  2024-12-18T00:49:46.7825943Z [14,877 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:46.7827203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:49:46.7828283Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:49:46.7829162Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2024-12-18T00:49:46.7829976Z Compiling llvm/lib/IR/Instructions.cpp; 6s local 2024-12-18T00:49:46.7830759Z Compiling llvm/lib/IR/Intrinsics.cpp; 6s local 2024-12-18T00:49:46.7831577Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 5s local 2024-12-18T00:49:46.7832563Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 5s local 2024-12-18T00:49:46.7833797Z Compiling llvm/lib/ObjectYAML/MachOYAML.cpp; 5s local ... 2024-12-18T00:49:47.2209941Z 2024-12-18T00:49:47.2210801Z  2024-12-18T00:49:47.2211289Z  2024-12-18T00:49:47.2211974Z  2024-12-18T00:49:47.2212394Z  2024-12-18T00:49:47.2212780Z  2024-12-18T00:49:47.2213180Z  2024-12-18T00:49:47.2213587Z  2024-12-18T00:49:47.2213968Z  2024-12-18T00:49:47.2214935Z [14,882 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:47.2216381Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:49:47.2217494Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2024-12-18T00:49:47.2218338Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2024-12-18T00:49:47.2219127Z Compiling llvm/lib/IR/Instructions.cpp; 6s local 2024-12-18T00:49:47.2219882Z Compiling llvm/lib/IR/Intrinsics.cpp; 6s local 2024-12-18T00:49:47.2220713Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 6s local 2024-12-18T00:49:47.2221546Z Compiling llvm/lib/ObjectYAML/MachOYAML.cpp; 5s local 2024-12-18T00:49:47.2222385Z Compiling llvm/lib/MC/MCPseudoProbe.cpp; 5s local ... 2024-12-18T00:49:47.4215077Z 2024-12-18T00:49:47.4215973Z  2024-12-18T00:49:47.4216620Z  2024-12-18T00:49:47.4217035Z  2024-12-18T00:49:47.4217436Z  2024-12-18T00:49:47.4217831Z  2024-12-18T00:49:47.4218219Z  2024-12-18T00:49:47.4218623Z  2024-12-18T00:49:47.4219072Z  2024-12-18T00:49:47.4220071Z [14,885 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:47.4221314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:49:47.4222398Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:47.4223224Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2024-12-18T00:49:47.4223976Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2024-12-18T00:49:47.4224728Z Compiling llvm/lib/IR/Intrinsics.cpp; 6s local 2024-12-18T00:49:47.4225647Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 6s local 2024-12-18T00:49:47.4226462Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2024-12-18T00:49:47.4227294Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 4s local ... 2024-12-18T00:49:47.6320103Z 2024-12-18T00:49:47.6320928Z  2024-12-18T00:49:47.6321388Z  2024-12-18T00:49:47.6321763Z  2024-12-18T00:49:47.6322173Z  2024-12-18T00:49:47.6322538Z  2024-12-18T00:49:47.6322901Z  2024-12-18T00:49:47.6323216Z  2024-12-18T00:49:47.6323561Z  2024-12-18T00:49:47.6324421Z [14,888 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:47.6325579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:49:47.6326544Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:47.6327299Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:47.6328003Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2024-12-18T00:49:47.6328801Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 6s local 2024-12-18T00:49:47.6329598Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2024-12-18T00:49:47.6330432Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 5s local 2024-12-18T00:49:47.6331388Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 3s local ... 2024-12-18T00:49:47.8618402Z 2024-12-18T00:49:47.8619217Z  2024-12-18T00:49:47.8619668Z  2024-12-18T00:49:47.8619989Z  2024-12-18T00:49:47.8620292Z  2024-12-18T00:49:47.8620671Z  2024-12-18T00:49:47.8621041Z  2024-12-18T00:49:47.8621431Z  2024-12-18T00:49:47.8621788Z  2024-12-18T00:49:47.8622683Z [14,893 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:47.8624081Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:49:47.8625057Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:47.8626021Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:47.8626788Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2024-12-18T00:49:47.8627582Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 6s local 2024-12-18T00:49:47.8628405Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2024-12-18T00:49:47.8629416Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 5s local 2024-12-18T00:49:47.8630401Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local ... 2024-12-18T00:49:48.1106002Z 2024-12-18T00:49:48.1106864Z  2024-12-18T00:49:48.1107334Z  2024-12-18T00:49:48.1107745Z  2024-12-18T00:49:48.1108151Z  2024-12-18T00:49:48.1108575Z  2024-12-18T00:49:48.1108955Z  2024-12-18T00:49:48.1109388Z  2024-12-18T00:49:48.1109786Z  2024-12-18T00:49:48.1110730Z [14,898 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:48.1111875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:49:48.1112916Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2024-12-18T00:49:48.1113725Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:48.1114486Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2024-12-18T00:49:48.1115335Z Compiling llvm/lib/ObjectYAML/MachOEmitter.cpp; 7s local 2024-12-18T00:49:48.1116178Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2024-12-18T00:49:48.1117003Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 5s local 2024-12-18T00:49:48.1117981Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local ... 2024-12-18T00:49:48.3568654Z 2024-12-18T00:49:48.3569480Z  2024-12-18T00:49:48.3569983Z  2024-12-18T00:49:48.3570400Z  2024-12-18T00:49:48.3570739Z  2024-12-18T00:49:48.3571086Z  2024-12-18T00:49:48.3571448Z  2024-12-18T00:49:48.3571814Z  2024-12-18T00:49:48.3572215Z  2024-12-18T00:49:48.3573080Z [14,900 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:48.3574187Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:49:48.3575154Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:48.3575951Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2024-12-18T00:49:48.3576861Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2024-12-18T00:49:48.3577596Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2024-12-18T00:49:48.3578296Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 5s local 2024-12-18T00:49:48.3579181Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local 2024-12-18T00:49:48.3580152Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 4s local ... 2024-12-18T00:49:48.6224562Z 2024-12-18T00:49:48.6225455Z  2024-12-18T00:49:48.6225942Z  2024-12-18T00:49:48.6226330Z  2024-12-18T00:49:48.6226749Z  2024-12-18T00:49:48.6227139Z  2024-12-18T00:49:48.6227525Z  2024-12-18T00:49:48.6227942Z  2024-12-18T00:49:48.6228339Z  2024-12-18T00:49:48.6229336Z [14,900 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:48.6230548Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:49:48.6231619Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:48.6232488Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:48.6233306Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:48.6234114Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2024-12-18T00:49:48.6235231Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 6s local 2024-12-18T00:49:48.6236282Z Compiling xla/tsl/profiler/convert/xplane_to_trace_events.cc; 4s local 2024-12-18T00:49:48.6237575Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 4s local ... 2024-12-18T00:49:48.8530545Z 2024-12-18T00:49:48.8531395Z  2024-12-18T00:49:48.8531872Z  2024-12-18T00:49:48.8532284Z  2024-12-18T00:49:48.8532672Z  2024-12-18T00:49:48.8533072Z  2024-12-18T00:49:48.8533487Z  2024-12-18T00:49:48.8533881Z  2024-12-18T00:49:48.8534300Z  2024-12-18T00:49:48.8535717Z [14,905 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:48.8537040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:49:48.8538108Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:48.8539017Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:48.8539856Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:48.8540592Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2024-12-18T00:49:48.8541393Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 5s local 2024-12-18T00:49:48.8542178Z Compiling llvm/lib/IR/Metadata.cpp; 4s local 2024-12-18T00:49:48.8543086Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 4s local ... 2024-12-18T00:49:49.0695010Z 2024-12-18T00:49:49.0695774Z  2024-12-18T00:49:49.0696089Z  2024-12-18T00:49:49.0696329Z  2024-12-18T00:49:49.0696713Z  2024-12-18T00:49:49.0697002Z  2024-12-18T00:49:49.0697256Z  2024-12-18T00:49:49.0697504Z  2024-12-18T00:49:49.0697740Z  2024-12-18T00:49:49.0698307Z [14,908 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:49.0699002Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:49:49.0699591Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2024-12-18T00:49:49.0700094Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:49.0700672Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:49.0701129Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:49.0701591Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 5s local 2024-12-18T00:49:49.0702031Z Compiling llvm/lib/IR/Metadata.cpp; 5s local 2024-12-18T00:49:49.0702538Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 4s local ... 2024-12-18T00:49:49.3344951Z 2024-12-18T00:49:49.3345840Z  2024-12-18T00:49:49.3346334Z  2024-12-18T00:49:49.3346744Z  2024-12-18T00:49:49.3347163Z  2024-12-18T00:49:49.3347587Z  2024-12-18T00:49:49.3348000Z  2024-12-18T00:49:49.3348399Z  2024-12-18T00:49:49.3348824Z  2024-12-18T00:49:49.3349760Z [14,911 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:49.3351004Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:49:49.3352090Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:49.3352966Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:49.3353753Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2024-12-18T00:49:49.3354496Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:49.3355343Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 5s local 2024-12-18T00:49:49.3356144Z Compiling llvm/lib/IR/Metadata.cpp; 5s local 2024-12-18T00:49:49.3357079Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 4s local ... 2024-12-18T00:49:49.5953710Z 2024-12-18T00:49:49.5954602Z  2024-12-18T00:49:49.5955087Z  2024-12-18T00:49:49.5955505Z  2024-12-18T00:49:49.5955917Z  2024-12-18T00:49:49.5956325Z  2024-12-18T00:49:49.5956721Z  2024-12-18T00:49:49.5957106Z  2024-12-18T00:49:49.5957786Z  2024-12-18T00:49:49.5958756Z [14,915 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:49.5960082Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:49:49.5961108Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:49.5961955Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2024-12-18T00:49:49.5962764Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:49.5963698Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 5s local 2024-12-18T00:49:49.5964571Z Compiling llvm/lib/IR/Metadata.cpp; 5s local 2024-12-18T00:49:49.5965402Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 5s local 2024-12-18T00:49:49.5966235Z Compiling llvm/lib/IR/Module.cpp; 5s local ... 2024-12-18T00:49:49.8234664Z 2024-12-18T00:49:49.8235535Z  2024-12-18T00:49:49.8236009Z  2024-12-18T00:49:49.8236389Z  2024-12-18T00:49:49.8236798Z  2024-12-18T00:49:49.8237195Z  2024-12-18T00:49:49.8237597Z  2024-12-18T00:49:49.8237972Z  2024-12-18T00:49:49.8238370Z  2024-12-18T00:49:49.8239322Z [14,918 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:49.8240547Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:49:49.8241544Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:49.8242355Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:49:49.8243195Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2024-12-18T00:49:49.8244024Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 6s local 2024-12-18T00:49:49.8245044Z Compiling llvm/lib/IR/Metadata.cpp; 5s local 2024-12-18T00:49:49.8245908Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 5s local 2024-12-18T00:49:49.8246757Z Compiling llvm/lib/IR/Module.cpp; 5s local ... 2024-12-18T00:49:50.2240820Z 2024-12-18T00:49:50.2241706Z  2024-12-18T00:49:50.2242219Z  2024-12-18T00:49:50.2242654Z  2024-12-18T00:49:50.2243051Z  2024-12-18T00:49:50.2243417Z  2024-12-18T00:49:50.2243843Z  2024-12-18T00:49:50.2244459Z  2024-12-18T00:49:50.2244909Z  2024-12-18T00:49:50.2245892Z [14,922 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:50.2247130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:49:50.2248178Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2024-12-18T00:49:50.2249073Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:49:50.2249861Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2024-12-18T00:49:50.2250723Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 6s local 2024-12-18T00:49:50.2251494Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2024-12-18T00:49:50.2252371Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 5s local 2024-12-18T00:49:50.2253264Z Compiling llvm/lib/IR/Module.cpp; 5s local ... 2024-12-18T00:49:50.4975238Z 2024-12-18T00:49:50.4976075Z  2024-12-18T00:49:50.4976752Z  2024-12-18T00:49:50.4977147Z  2024-12-18T00:49:50.4977514Z  2024-12-18T00:49:50.4977901Z  2024-12-18T00:49:50.4978277Z  2024-12-18T00:49:50.4978669Z  2024-12-18T00:49:50.4979062Z  2024-12-18T00:49:50.4979973Z [14,924 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:50.4981206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:49:50.4982160Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:50.4982982Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2024-12-18T00:49:50.4983757Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2024-12-18T00:49:50.4984483Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 6s local 2024-12-18T00:49:50.4985487Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2024-12-18T00:49:50.4986251Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 5s local 2024-12-18T00:49:50.4987190Z Compiling llvm/lib/IR/Module.cpp; 5s local ... 2024-12-18T00:49:50.8043319Z 2024-12-18T00:49:50.8044434Z  2024-12-18T00:49:50.8044984Z  2024-12-18T00:49:50.8045387Z  2024-12-18T00:49:50.8045776Z  2024-12-18T00:49:50.8046144Z  2024-12-18T00:49:50.8046495Z  2024-12-18T00:49:50.8046861Z  2024-12-18T00:49:50.8047680Z  2024-12-18T00:49:50.8048580Z [14,927 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:50.8049702Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:49:50.8050859Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:50.8051829Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:50.8052638Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2024-12-18T00:49:50.8053560Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local 2024-12-18T00:49:50.8054324Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2024-12-18T00:49:50.8055129Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 6s local 2024-12-18T00:49:50.8055853Z Compiling llvm/lib/IR/Module.cpp; 6s local ... 2024-12-18T00:49:51.0083708Z 2024-12-18T00:49:51.0084539Z  2024-12-18T00:49:51.0084996Z  2024-12-18T00:49:51.0085379Z  2024-12-18T00:49:51.0085807Z  2024-12-18T00:49:51.0086216Z  2024-12-18T00:49:51.0086606Z  2024-12-18T00:49:51.0086964Z  2024-12-18T00:49:51.0087334Z  2024-12-18T00:49:51.0088292Z [14,928 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:51.0089452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:49:51.0090541Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:51.0091362Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:51.0092168Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2024-12-18T00:49:51.0092985Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local 2024-12-18T00:49:51.0093731Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:51.0094560Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 6s local 2024-12-18T00:49:51.0095425Z Compiling llvm/lib/IR/Module.cpp; 6s local ... 2024-12-18T00:49:51.2248450Z 2024-12-18T00:49:51.2249296Z  2024-12-18T00:49:51.2249766Z  2024-12-18T00:49:51.2250175Z  2024-12-18T00:49:51.2250580Z  2024-12-18T00:49:51.2250983Z  2024-12-18T00:49:51.2251371Z  2024-12-18T00:49:51.2251742Z  2024-12-18T00:49:51.2252117Z  2024-12-18T00:49:51.2253036Z [14,931 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:51.2254239Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:49:51.2255306Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2024-12-18T00:49:51.2256161Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:51.2257118Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2024-12-18T00:49:51.2257943Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local 2024-12-18T00:49:51.2258696Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:51.2259582Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 6s local 2024-12-18T00:49:51.2260553Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local ... 2024-12-18T00:49:51.4948968Z 2024-12-18T00:49:51.4949779Z  2024-12-18T00:49:51.4950210Z  2024-12-18T00:49:51.4950581Z  2024-12-18T00:49:51.4950930Z  2024-12-18T00:49:51.4951290Z  2024-12-18T00:49:51.4951652Z  2024-12-18T00:49:51.4952032Z  2024-12-18T00:49:51.4952648Z  2024-12-18T00:49:51.4953554Z [14,934 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:51.4954619Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:49:51.4955544Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:49:51.4956354Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2024-12-18T00:49:51.4957066Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2024-12-18T00:49:51.4957830Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local 2024-12-18T00:49:51.4958593Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:51.4959311Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 6s local 2024-12-18T00:49:51.4960084Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local ... 2024-12-18T00:49:51.7073346Z 2024-12-18T00:49:51.7074255Z  2024-12-18T00:49:51.7074725Z  2024-12-18T00:49:51.7075158Z  2024-12-18T00:49:51.7075540Z  2024-12-18T00:49:51.7075946Z  2024-12-18T00:49:51.7076351Z  2024-12-18T00:49:51.7076763Z  2024-12-18T00:49:51.7077185Z  2024-12-18T00:49:51.7078128Z [14,937 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:51.7079324Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:49:51.7080324Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2024-12-18T00:49:51.7081225Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:51.7082070Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local 2024-12-18T00:49:51.7082850Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:51.7083665Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 7s local 2024-12-18T00:49:51.7084601Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local 2024-12-18T00:49:51.7085510Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local ... 2024-12-18T00:49:51.9358577Z 2024-12-18T00:49:51.9359404Z  2024-12-18T00:49:51.9359869Z  2024-12-18T00:49:51.9360284Z  2024-12-18T00:49:51.9360692Z  2024-12-18T00:49:51.9361143Z  2024-12-18T00:49:51.9361561Z  2024-12-18T00:49:51.9361946Z  2024-12-18T00:49:51.9362287Z  2024-12-18T00:49:51.9363171Z [14,940 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:51.9364348Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:49:51.9365295Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:51.9366105Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2024-12-18T00:49:51.9366857Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2024-12-18T00:49:51.9367796Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2024-12-18T00:49:51.9368760Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 4s local 2024-12-18T00:49:51.9369919Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 4s local 2024-12-18T00:49:51.9370988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local ... 2024-12-18T00:49:52.1689868Z 2024-12-18T00:49:52.1690716Z  2024-12-18T00:49:52.1691197Z  2024-12-18T00:49:52.1691601Z  2024-12-18T00:49:52.1691989Z  2024-12-18T00:49:52.1692359Z  2024-12-18T00:49:52.1692755Z  2024-12-18T00:49:52.1693161Z  2024-12-18T00:49:52.1693569Z  2024-12-18T00:49:52.1694534Z [14,942 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:52.1695750Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:49:52.1696877Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:52.1697689Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2024-12-18T00:49:52.1698470Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:52.1699555Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2024-12-18T00:49:52.1700455Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 5s local 2024-12-18T00:49:52.1701610Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 4s local 2024-12-18T00:49:52.1702731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local ... 2024-12-18T00:49:52.4257116Z 2024-12-18T00:49:52.4257973Z  2024-12-18T00:49:52.4258499Z  2024-12-18T00:49:52.4258906Z  2024-12-18T00:49:52.4259305Z  2024-12-18T00:49:52.4260144Z  2024-12-18T00:49:52.4260530Z  2024-12-18T00:49:52.4260942Z  2024-12-18T00:49:52.4261331Z  2024-12-18T00:49:52.4262339Z [14,943 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:52.4263568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:49:52.4264536Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2024-12-18T00:49:52.4265354Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2024-12-18T00:49:52.4266101Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:52.4266943Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2024-12-18T00:49:52.4267796Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 5s local 2024-12-18T00:49:52.4268770Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 5s local 2024-12-18T00:49:52.4269933Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local ... 2024-12-18T00:49:52.7531714Z 2024-12-18T00:49:52.7532618Z  2024-12-18T00:49:52.7533073Z  2024-12-18T00:49:52.7533466Z  2024-12-18T00:49:52.7533827Z  2024-12-18T00:49:52.7534231Z  2024-12-18T00:49:52.7534643Z  2024-12-18T00:49:52.7535042Z  2024-12-18T00:49:52.7535412Z  2024-12-18T00:49:52.7536332Z [14,947 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:52.7537736Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:49:52.7538723Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:52.7539591Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:49:52.7540311Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:52.7541029Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 5s local 2024-12-18T00:49:52.7541984Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 5s local 2024-12-18T00:49:52.7543063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:49:52.7544387Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 4s local ... 2024-12-18T00:49:52.9517918Z 2024-12-18T00:49:52.9518844Z  2024-12-18T00:49:52.9519340Z  2024-12-18T00:49:52.9519727Z  2024-12-18T00:49:52.9520136Z  2024-12-18T00:49:52.9520525Z  2024-12-18T00:49:52.9520959Z  2024-12-18T00:49:52.9521368Z  2024-12-18T00:49:52.9521711Z  2024-12-18T00:49:52.9522624Z [14,949 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:52.9523761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:49:52.9524723Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:52.9525518Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:49:52.9526292Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2024-12-18T00:49:52.9527091Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 5s local 2024-12-18T00:49:52.9528034Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 5s local 2024-12-18T00:49:52.9529147Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:49:52.9530107Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 5s local ... 2024-12-18T00:49:53.1605899Z 2024-12-18T00:49:53.1606745Z  2024-12-18T00:49:53.1607570Z  2024-12-18T00:49:53.1607997Z  2024-12-18T00:49:53.1608432Z  2024-12-18T00:49:53.1609019Z  2024-12-18T00:49:53.1609436Z  2024-12-18T00:49:53.1609858Z  2024-12-18T00:49:53.1610441Z  2024-12-18T00:49:53.1611431Z [14,953 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:53.1612668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:49:53.1613694Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:53.1616792Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:49:53.1617957Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:53.1618777Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 6s local 2024-12-18T00:49:53.1619739Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 5s local 2024-12-18T00:49:53.1621014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:49:53.1622054Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 5s local ... 2024-12-18T00:49:53.3710295Z 2024-12-18T00:49:53.3711145Z  2024-12-18T00:49:53.3711625Z  2024-12-18T00:49:53.3712056Z  2024-12-18T00:49:53.3712462Z  2024-12-18T00:49:53.3712855Z  2024-12-18T00:49:53.3713252Z  2024-12-18T00:49:53.3713641Z  2024-12-18T00:49:53.3714030Z  2024-12-18T00:49:53.3714983Z [14,959 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:53.3716198Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:49:53.3717231Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2024-12-18T00:49:53.3718035Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:49:53.3718781Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:53.3719581Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 6s local 2024-12-18T00:49:53.3720512Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 6s local 2024-12-18T00:49:53.3721540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2024-12-18T00:49:53.3722634Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 5s local ... 2024-12-18T00:49:53.6202456Z 2024-12-18T00:49:53.6203295Z  2024-12-18T00:49:53.6203796Z  2024-12-18T00:49:53.6204202Z  2024-12-18T00:49:53.6204617Z  2024-12-18T00:49:53.6205028Z  2024-12-18T00:49:53.6205430Z  2024-12-18T00:49:53.6205823Z  2024-12-18T00:49:53.6206256Z  2024-12-18T00:49:53.6207207Z [14,961 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:53.6208420Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:49:53.6209419Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:53.6210231Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2024-12-18T00:49:53.6211034Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:53.6211838Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 6s local 2024-12-18T00:49:53.6212800Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 6s local 2024-12-18T00:49:53.6213924Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:49:53.6215058Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 5s local ... 2024-12-18T00:49:53.8266798Z 2024-12-18T00:49:53.8267723Z  2024-12-18T00:49:53.8268203Z  2024-12-18T00:49:53.8268668Z  2024-12-18T00:49:53.8269071Z  2024-12-18T00:49:53.8269464Z  2024-12-18T00:49:53.8269833Z  2024-12-18T00:49:53.8270194Z  2024-12-18T00:49:53.8270498Z  2024-12-18T00:49:53.8271352Z [14,962 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:53.8272556Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:49:53.8273938Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:53.8274773Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 10s local 2024-12-18T00:49:53.8275901Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2024-12-18T00:49:53.8276675Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 6s local 2024-12-18T00:49:53.8277618Z Compiling llvm/lib/ProfileData/InstrProfCorrelator.cpp; 6s local 2024-12-18T00:49:53.8278878Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:49:53.8280248Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 6s local ... 2024-12-18T00:49:54.0398947Z 2024-12-18T00:49:54.0399847Z  2024-12-18T00:49:54.0400347Z  2024-12-18T00:49:54.0400741Z  2024-12-18T00:49:54.0401146Z  2024-12-18T00:49:54.0401520Z  2024-12-18T00:49:54.0401921Z  2024-12-18T00:49:54.0402325Z  2024-12-18T00:49:54.0402724Z  2024-12-18T00:49:54.0403713Z [14,968 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:54.0404886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:49:54.0405869Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:54.0406616Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:54.0407402Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 7s local 2024-12-18T00:49:54.0408341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:49:54.0409505Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 6s local 2024-12-18T00:49:54.0410466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2024-12-18T00:49:54.0411445Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 5s local ... 2024-12-18T00:49:54.4004511Z 2024-12-18T00:49:54.4005538Z  2024-12-18T00:49:54.4006023Z  2024-12-18T00:49:54.4006423Z  2024-12-18T00:49:54.4006853Z  2024-12-18T00:49:54.4007271Z  2024-12-18T00:49:54.4007710Z  2024-12-18T00:49:54.4008183Z  2024-12-18T00:49:54.4008575Z  2024-12-18T00:49:54.4009509Z [14,971 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:54.4010693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:49:54.4011624Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2024-12-18T00:49:54.4012313Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:54.4013194Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 7s local 2024-12-18T00:49:54.4014187Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2024-12-18T00:49:54.4015215Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 6s local 2024-12-18T00:49:54.4016248Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2024-12-18T00:49:54.4017487Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 5s local ... 2024-12-18T00:49:54.6273230Z 2024-12-18T00:49:54.6274080Z  2024-12-18T00:49:54.6274556Z  2024-12-18T00:49:54.6274956Z  2024-12-18T00:49:54.6275362Z  2024-12-18T00:49:54.6275793Z  2024-12-18T00:49:54.6276175Z  2024-12-18T00:49:54.6276518Z  2024-12-18T00:49:54.6276890Z  2024-12-18T00:49:54.6277846Z [14,973 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:54.6279072Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:49:54.6280063Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:49:54.6280843Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:54.6281620Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 7s local 2024-12-18T00:49:54.6282606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:49:54.6283677Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 6s local 2024-12-18T00:49:54.6285023Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2024-12-18T00:49:54.6286296Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 5s local ... 2024-12-18T00:49:54.8277823Z 2024-12-18T00:49:54.8278711Z  2024-12-18T00:49:54.8279190Z  2024-12-18T00:49:54.8279616Z  2024-12-18T00:49:54.8280030Z  2024-12-18T00:49:54.8280434Z  2024-12-18T00:49:54.8280837Z  2024-12-18T00:49:54.8281225Z  2024-12-18T00:49:54.8281622Z  2024-12-18T00:49:54.8283055Z [14,974 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:54.8284290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:49:54.8285311Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:49:54.8286069Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2024-12-18T00:49:54.8286878Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 7s local 2024-12-18T00:49:54.8287879Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:49:54.8288945Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 7s local 2024-12-18T00:49:54.8289955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:49:54.8291078Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 6s local ... 2024-12-18T00:49:55.0947931Z 2024-12-18T00:49:55.0948891Z  2024-12-18T00:49:55.0949383Z  2024-12-18T00:49:55.0949835Z  2024-12-18T00:49:55.0950316Z  2024-12-18T00:49:55.0950719Z  2024-12-18T00:49:55.0951143Z  2024-12-18T00:49:55.0951592Z  2024-12-18T00:49:55.0952044Z  2024-12-18T00:49:55.0952993Z [14,976 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:55.0954130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:49:55.0955028Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:49:55.0955928Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:55.0956736Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2024-12-18T00:49:55.0957697Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:49:55.0958764Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 7s local 2024-12-18T00:49:55.0959710Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:49:55.0960788Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 6s local ... 2024-12-18T00:49:55.3164891Z 2024-12-18T00:49:55.3165779Z  2024-12-18T00:49:55.3166400Z  2024-12-18T00:49:55.3166814Z  2024-12-18T00:49:55.3167212Z  2024-12-18T00:49:55.3167597Z  2024-12-18T00:49:55.3167970Z  2024-12-18T00:49:55.3168376Z  2024-12-18T00:49:55.3168766Z  2024-12-18T00:49:55.3169701Z [14,978 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:55.3170940Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:49:55.3171963Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2024-12-18T00:49:55.3172741Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:55.3173537Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2024-12-18T00:49:55.3174512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2024-12-18T00:49:55.3175575Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 7s local 2024-12-18T00:49:55.3176943Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:49:55.3178060Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 6s local ... 2024-12-18T00:49:55.6284708Z 2024-12-18T00:49:55.6285541Z  2024-12-18T00:49:55.6286041Z  2024-12-18T00:49:55.6286452Z  2024-12-18T00:49:55.6286857Z  2024-12-18T00:49:55.6287502Z  2024-12-18T00:49:55.6287908Z  2024-12-18T00:49:55.6288313Z  2024-12-18T00:49:55.6288715Z  2024-12-18T00:49:55.6289832Z [14,979 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:55.6291066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:49:55.6292085Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:55.6292878Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:55.6293826Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2024-12-18T00:49:55.6294886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:49:55.6295964Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 7s local 2024-12-18T00:49:55.6297206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2024-12-18T00:49:55.6298280Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 6s local ... 2024-12-18T00:49:55.8957212Z 2024-12-18T00:49:55.8958097Z  2024-12-18T00:49:55.8958514Z  2024-12-18T00:49:55.8958908Z  2024-12-18T00:49:55.8959288Z  2024-12-18T00:49:55.8959671Z  2024-12-18T00:49:55.8960078Z  2024-12-18T00:49:55.8960522Z  2024-12-18T00:49:55.8961007Z  2024-12-18T00:49:55.8961950Z [14,983 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:55.8963217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:49:55.8964205Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:55.8964969Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2024-12-18T00:49:55.8965753Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2024-12-18T00:49:55.8966705Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:49:55.8967769Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2024-12-18T00:49:55.8968907Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2024-12-18T00:49:55.8969962Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 7s local ... 2024-12-18T00:49:56.2291938Z 2024-12-18T00:49:56.2292783Z  2024-12-18T00:49:56.2293252Z  2024-12-18T00:49:56.2293627Z  2024-12-18T00:49:56.2294004Z  2024-12-18T00:49:56.2294367Z  2024-12-18T00:49:56.2294765Z  2024-12-18T00:49:56.2295153Z  2024-12-18T00:49:56.2295542Z  2024-12-18T00:49:56.2296673Z [14,987 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:56.2297869Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:49:56.2298834Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:56.2299597Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:56.2300456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:49:56.2301528Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2024-12-18T00:49:56.2302546Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2024-12-18T00:49:56.2303608Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 7s local 2024-12-18T00:49:56.2304691Z Compiling llvm/utils/TableGen/FastISelEmitter.cpp [for tool]; 7s local ... 2024-12-18T00:49:56.4296037Z 2024-12-18T00:49:56.4297095Z  2024-12-18T00:49:56.4297580Z  2024-12-18T00:49:56.4297991Z  2024-12-18T00:49:56.4298419Z  2024-12-18T00:49:56.4298807Z  2024-12-18T00:49:56.4299202Z  2024-12-18T00:49:56.4299600Z  2024-12-18T00:49:56.4299962Z  2024-12-18T00:49:56.4300906Z [14,988 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:56.4302186Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:49:56.4303133Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2024-12-18T00:49:56.4304248Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:56.4305349Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2024-12-18T00:49:56.4306355Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2024-12-18T00:49:56.4307417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2024-12-18T00:49:56.4308488Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 7s local 2024-12-18T00:49:56.4309479Z @llvm-project//llvm:ProfileData; 7s local ... 2024-12-18T00:49:56.6986821Z 2024-12-18T00:49:56.6987705Z  2024-12-18T00:49:56.6988195Z  2024-12-18T00:49:56.6988592Z  2024-12-18T00:49:56.6988990Z  2024-12-18T00:49:56.6989374Z  2024-12-18T00:49:56.6989739Z  2024-12-18T00:49:56.6990132Z  2024-12-18T00:49:56.6990508Z  2024-12-18T00:49:56.6991427Z [14,989 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:56.6992638Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:49:56.6993588Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2024-12-18T00:49:56.6994320Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:56.6995201Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:49:56.6996222Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2024-12-18T00:49:56.6997398Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:49:56.6998503Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 7s local 2024-12-18T00:49:56.6999385Z @llvm-project//llvm:ProfileData; 7s local ... 2024-12-18T00:49:56.9455340Z 2024-12-18T00:49:56.9456170Z  2024-12-18T00:49:56.9456847Z  2024-12-18T00:49:56.9457292Z  2024-12-18T00:49:56.9457703Z  2024-12-18T00:49:56.9458120Z  2024-12-18T00:49:56.9458565Z  2024-12-18T00:49:56.9458983Z  2024-12-18T00:49:56.9459364Z  2024-12-18T00:49:56.9460120Z [14,993 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:56.9461020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:49:56.9461764Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2024-12-18T00:49:56.9462330Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2024-12-18T00:49:56.9463030Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:49:56.9463866Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:49:56.9464987Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:49:56.9466124Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local 2024-12-18T00:49:56.9470283Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local ... 2024-12-18T00:49:57.1498355Z 2024-12-18T00:49:57.1499200Z  2024-12-18T00:49:57.1499705Z  2024-12-18T00:49:57.1500136Z  2024-12-18T00:49:57.1500524Z  2024-12-18T00:49:57.1500917Z  2024-12-18T00:49:57.1501315Z  2024-12-18T00:49:57.1501773Z  2024-12-18T00:49:57.1502172Z  2024-12-18T00:49:57.1503182Z [14,999 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:57.1504365Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:49:57.1505301Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:57.1506195Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:49:57.1507230Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:49:57.1508400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:49:57.1509395Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local 2024-12-18T00:49:57.1510671Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:49:57.1511737Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 5s local ... 2024-12-18T00:49:57.4304051Z 2024-12-18T00:49:57.4305204Z  2024-12-18T00:49:57.4305684Z  2024-12-18T00:49:57.4306066Z  2024-12-18T00:49:57.4306460Z  2024-12-18T00:49:57.4306869Z  2024-12-18T00:49:57.4307263Z  2024-12-18T00:49:57.4307621Z  2024-12-18T00:49:57.4308009Z  2024-12-18T00:49:57.4309264Z [15,000 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:57.4310580Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:49:57.4311537Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:57.4312463Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2024-12-18T00:49:57.4313639Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:49:57.4314617Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:49:57.4315595Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local 2024-12-18T00:49:57.4316589Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:49:57.4317620Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 5s local ... 2024-12-18T00:49:57.6394798Z 2024-12-18T00:49:57.6395684Z  2024-12-18T00:49:57.6396164Z  2024-12-18T00:49:57.6396588Z  2024-12-18T00:49:57.6397006Z  2024-12-18T00:49:57.6397481Z  2024-12-18T00:49:57.6397861Z  2024-12-18T00:49:57.6398249Z  2024-12-18T00:49:57.6398631Z  2024-12-18T00:49:57.6399560Z [15,004 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:57.6400737Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:49:57.6401794Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:57.6402712Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:49:57.6403754Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2024-12-18T00:49:57.6404790Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2024-12-18T00:49:57.6405858Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local 2024-12-18T00:49:57.6406855Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:49:57.6407946Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local ... 2024-12-18T00:49:57.9294344Z 2024-12-18T00:49:57.9295192Z  2024-12-18T00:49:57.9295665Z  2024-12-18T00:49:57.9296075Z  2024-12-18T00:49:57.9296632Z  2024-12-18T00:49:57.9297039Z  2024-12-18T00:49:57.9297397Z  2024-12-18T00:49:57.9297749Z  2024-12-18T00:49:57.9298107Z  2024-12-18T00:49:57.9299030Z [15,006 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:57.9300255Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:49:57.9301150Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2024-12-18T00:49:57.9302055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:49:57.9303131Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:49:57.9304230Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:49:57.9305290Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:49:57.9306316Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:49:57.9307415Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local ... 2024-12-18T00:49:58.2254757Z 2024-12-18T00:49:58.2255586Z  2024-12-18T00:49:58.2256034Z  2024-12-18T00:49:58.2256625Z  2024-12-18T00:49:58.2257350Z  2024-12-18T00:49:58.2257716Z  2024-12-18T00:49:58.2258110Z  2024-12-18T00:49:58.2258502Z  2024-12-18T00:49:58.2258881Z  2024-12-18T00:49:58.2260007Z [15,007 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:58.2261143Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:49:58.2262120Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:58.2263167Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:49:58.2264357Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:49:58.2265400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:49:58.2266547Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:49:58.2267482Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:49:58.2268491Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local ... 2024-12-18T00:49:58.4311807Z 2024-12-18T00:49:58.4312708Z  2024-12-18T00:49:58.4313188Z  2024-12-18T00:49:58.4313586Z  2024-12-18T00:49:58.4314003Z  2024-12-18T00:49:58.4314411Z  2024-12-18T00:49:58.4314776Z  2024-12-18T00:49:58.4315173Z  2024-12-18T00:49:58.4315570Z  2024-12-18T00:49:58.4316513Z [15,007 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:58.4317657Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:49:58.4318605Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:58.4319471Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2024-12-18T00:49:58.4320547Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:49:58.4321599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:49:58.4322640Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:49:58.4323646Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 8s local 2024-12-18T00:49:58.4324733Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 6s local ... 2024-12-18T00:49:58.6315813Z 2024-12-18T00:49:58.6316653Z  2024-12-18T00:49:58.6317112Z  2024-12-18T00:49:58.6317485Z  2024-12-18T00:49:58.6317911Z  2024-12-18T00:49:58.6318256Z  2024-12-18T00:49:58.6318647Z  2024-12-18T00:49:58.6319038Z  2024-12-18T00:49:58.6319478Z  2024-12-18T00:49:58.6320401Z [15,010 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:58.6321486Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:49:58.6322394Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:58.6323272Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:49:58.6324327Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2024-12-18T00:49:58.6325371Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2024-12-18T00:49:58.6326443Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2024-12-18T00:49:58.6327488Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:49:58.6328522Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 6s local ... 2024-12-18T00:49:58.8461383Z 2024-12-18T00:49:58.8462233Z  2024-12-18T00:49:58.8462688Z  2024-12-18T00:49:58.8463015Z  2024-12-18T00:49:58.8463325Z  2024-12-18T00:49:58.8463655Z  2024-12-18T00:49:58.8463980Z  2024-12-18T00:49:58.8464338Z  2024-12-18T00:49:58.8464658Z  2024-12-18T00:49:58.8465416Z [15,012 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:58.8466517Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:49:58.8467511Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2024-12-18T00:49:58.8468354Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:49:58.8469251Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:49:58.8470129Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:49:58.8471008Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2024-12-18T00:49:58.8472378Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:49:58.8473669Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local ... 2024-12-18T00:49:59.1316162Z 2024-12-18T00:49:59.1317064Z  2024-12-18T00:49:59.1317585Z  2024-12-18T00:49:59.1317994Z  2024-12-18T00:49:59.1318431Z  2024-12-18T00:49:59.1318812Z  2024-12-18T00:49:59.1319215Z  2024-12-18T00:49:59.1319632Z  2024-12-18T00:49:59.1320095Z  2024-12-18T00:49:59.1321067Z [15,018 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:59.1322323Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:49:59.1323263Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:49:59.1324194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:49:59.1325300Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:49:59.1326401Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:49:59.1327538Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2024-12-18T00:49:59.1328589Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:49:59.1329668Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local ... 2024-12-18T00:49:59.3326578Z 2024-12-18T00:49:59.3327451Z  2024-12-18T00:49:59.3327962Z  2024-12-18T00:49:59.3328367Z  2024-12-18T00:49:59.3328753Z  2024-12-18T00:49:59.3329160Z  2024-12-18T00:49:59.3329549Z  2024-12-18T00:49:59.3329933Z  2024-12-18T00:49:59.3330329Z  2024-12-18T00:49:59.3331223Z [15,022 / 20,602] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2024-12-18T00:49:59.3332314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:49:59.3333238Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:49:59.3334186Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:49:59.3335269Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:49:59.3336281Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:49:59.3337452Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2024-12-18T00:49:59.3338436Z Compiling llvm/lib/Bitcode/Writer/ValueEnumerator.cpp; 7s local 2024-12-18T00:49:59.3339606Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local ... 2024-12-18T00:49:59.5946230Z 2024-12-18T00:49:59.5947132Z  2024-12-18T00:49:59.5947652Z  2024-12-18T00:49:59.5948044Z  2024-12-18T00:49:59.5948440Z  2024-12-18T00:49:59.5948829Z  2024-12-18T00:49:59.5949215Z  2024-12-18T00:49:59.5949590Z  2024-12-18T00:49:59.5949974Z  2024-12-18T00:49:59.5950938Z [15,024 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:49:59.5952089Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:49:59.5953005Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:49:59.5953929Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:49:59.5954956Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2024-12-18T00:49:59.5955976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2024-12-18T00:49:59.5957359Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2024-12-18T00:49:59.5958477Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local 2024-12-18T00:49:59.5959529Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local ... 2024-12-18T00:49:59.8325002Z 2024-12-18T00:49:59.8325863Z  2024-12-18T00:49:59.8326328Z  2024-12-18T00:49:59.8326736Z  2024-12-18T00:49:59.8327153Z  2024-12-18T00:49:59.8327559Z  2024-12-18T00:49:59.8328429Z  2024-12-18T00:49:59.8328839Z  2024-12-18T00:49:59.8329241Z  2024-12-18T00:49:59.8330203Z [15,027 / 20,602] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2024-12-18T00:49:59.8331298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:49:59.8332222Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2024-12-18T00:49:59.8333124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:49:59.8334180Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2024-12-18T00:49:59.8335272Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:49:59.8336343Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2024-12-18T00:49:59.8337492Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2024-12-18T00:49:59.8338439Z Compiling torch_xla/csrc/runtime/util_test.cc; 6s local ... 2024-12-18T00:50:00.1859652Z 2024-12-18T00:50:00.1860577Z  2024-12-18T00:50:00.1861038Z  2024-12-18T00:50:00.1861409Z  2024-12-18T00:50:00.1861809Z  2024-12-18T00:50:00.1862184Z  2024-12-18T00:50:00.1862553Z  2024-12-18T00:50:00.1862944Z  2024-12-18T00:50:00.1863342Z  2024-12-18T00:50:00.1864259Z [15,031 / 20,602] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2024-12-18T00:50:00.1865367Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:50:00.1866375Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:50:00.1867376Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2024-12-18T00:50:00.1868421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:50:00.1869429Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2024-12-18T00:50:00.1870374Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:00.1871298Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 6s local 2024-12-18T00:50:00.1872265Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local ... 2024-12-18T00:50:00.4330758Z 2024-12-18T00:50:00.4331632Z  2024-12-18T00:50:00.4332131Z  2024-12-18T00:50:00.4332552Z  2024-12-18T00:50:00.4332945Z  2024-12-18T00:50:00.4333329Z  2024-12-18T00:50:00.4333749Z  2024-12-18T00:50:00.4334140Z  2024-12-18T00:50:00.4334535Z  2024-12-18T00:50:00.4335505Z [15,037 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:00.4336877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:50:00.4337982Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:50:00.4339151Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:50:00.4340184Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2024-12-18T00:50:00.4341113Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:00.4341974Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 6s local 2024-12-18T00:50:00.4342851Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:50:00.4343912Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 5s local ... 2024-12-18T00:50:00.6334899Z 2024-12-18T00:50:00.6335739Z  2024-12-18T00:50:00.6336229Z  2024-12-18T00:50:00.6336778Z  2024-12-18T00:50:00.6337159Z  2024-12-18T00:50:00.6337583Z  2024-12-18T00:50:00.6338301Z  2024-12-18T00:50:00.6338723Z  2024-12-18T00:50:00.6349806Z  2024-12-18T00:50:00.6351030Z [15,038 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:00.6352100Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:00.6353483Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:00.6354549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2024-12-18T00:50:00.6355537Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2024-12-18T00:50:00.6356445Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:00.6357359Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 6s local 2024-12-18T00:50:00.6358320Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:50:00.6359362Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 5s local ... 2024-12-18T00:50:00.8401659Z 2024-12-18T00:50:00.8402516Z  2024-12-18T00:50:00.8402928Z  2024-12-18T00:50:00.8403259Z  2024-12-18T00:50:00.8403641Z  2024-12-18T00:50:00.8403979Z  2024-12-18T00:50:00.8404309Z  2024-12-18T00:50:00.8404625Z  2024-12-18T00:50:00.8404997Z  2024-12-18T00:50:00.8405964Z [15,041 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:00.8406960Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:00.8407891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:00.8408836Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:50:00.8409779Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:50:00.8410612Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:00.8411717Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 6s local 2024-12-18T00:50:00.8412851Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2024-12-18T00:50:00.8414119Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 6s local ... 2024-12-18T00:50:01.1413319Z 2024-12-18T00:50:01.1414211Z  2024-12-18T00:50:01.1414709Z  2024-12-18T00:50:01.1415165Z  2024-12-18T00:50:01.1415578Z  2024-12-18T00:50:01.1415960Z  2024-12-18T00:50:01.1416621Z  2024-12-18T00:50:01.1417051Z  2024-12-18T00:50:01.1417449Z  2024-12-18T00:50:01.1418420Z [15,045 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:01.1419581Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:01.1420719Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:01.1421820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:50:01.1422855Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:50:01.1423817Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:50:01.1424726Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local 2024-12-18T00:50:01.1425676Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:50:01.1426767Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 6s local ... 2024-12-18T00:50:01.3774338Z 2024-12-18T00:50:01.3775226Z  2024-12-18T00:50:01.3775709Z  2024-12-18T00:50:01.3776102Z  2024-12-18T00:50:01.3776650Z  2024-12-18T00:50:01.3777115Z  2024-12-18T00:50:01.3777554Z  2024-12-18T00:50:01.3777907Z  2024-12-18T00:50:01.3778282Z  2024-12-18T00:50:01.3779630Z [15,049 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:01.3781006Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:01.3782182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:01.3783340Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:50:01.3784497Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:50:01.3785599Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:50:01.3786668Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local 2024-12-18T00:50:01.3787592Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:50:01.3788612Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 6s local ... 2024-12-18T00:50:01.6201966Z 2024-12-18T00:50:01.6202798Z  2024-12-18T00:50:01.6203267Z  2024-12-18T00:50:01.6203692Z  2024-12-18T00:50:01.6204105Z  2024-12-18T00:50:01.6204501Z  2024-12-18T00:50:01.6204914Z  2024-12-18T00:50:01.6205326Z  2024-12-18T00:50:01.6205724Z  2024-12-18T00:50:01.6206705Z [15,052 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:01.6207884Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:01.6208965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:01.6210127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2024-12-18T00:50:01.6211105Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:50:01.6212073Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:50:01.6212994Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local 2024-12-18T00:50:01.6213948Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:50:01.6214970Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 6s local ... 2024-12-18T00:50:01.8345405Z 2024-12-18T00:50:01.8346297Z  2024-12-18T00:50:01.8346803Z  2024-12-18T00:50:01.8347180Z  2024-12-18T00:50:01.8347554Z  2024-12-18T00:50:01.8347971Z  2024-12-18T00:50:01.8348390Z  2024-12-18T00:50:01.8348762Z  2024-12-18T00:50:01.8349125Z  2024-12-18T00:50:01.8350077Z [15,054 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:01.8351431Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:01.8352516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:01.8353599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:50:01.8354619Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:01.8355579Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:50:01.8356460Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 7s local 2024-12-18T00:50:01.8357399Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2024-12-18T00:50:01.8358382Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local ... 2024-12-18T00:50:02.0469525Z 2024-12-18T00:50:02.0470379Z  2024-12-18T00:50:02.0470861Z  2024-12-18T00:50:02.0471279Z  2024-12-18T00:50:02.0471692Z  2024-12-18T00:50:02.0472102Z  2024-12-18T00:50:02.0472543Z  2024-12-18T00:50:02.0472955Z  2024-12-18T00:50:02.0473346Z  2024-12-18T00:50:02.0474305Z [15,055 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:02.0475491Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:02.0476634Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:02.0478086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:50:02.0479092Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:02.0480217Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:50:02.0481118Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:50:02.0482061Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local 2024-12-18T00:50:02.0482942Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2024-12-18T00:50:02.3380544Z 2024-12-18T00:50:02.3381436Z  2024-12-18T00:50:02.3381911Z  2024-12-18T00:50:02.3382306Z  2024-12-18T00:50:02.3382696Z  2024-12-18T00:50:02.3383059Z  2024-12-18T00:50:02.3383447Z  2024-12-18T00:50:02.3383838Z  2024-12-18T00:50:02.3384225Z  2024-12-18T00:50:02.3385159Z [15,057 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:02.3386491Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:02.3387655Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:02.3388859Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:50:02.3389825Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:02.3390822Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:50:02.3391808Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:50:02.3392773Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local 2024-12-18T00:50:02.3393625Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2024-12-18T00:50:02.5957756Z 2024-12-18T00:50:02.5958621Z  2024-12-18T00:50:02.5959100Z  2024-12-18T00:50:02.5959493Z  2024-12-18T00:50:02.5959878Z  2024-12-18T00:50:02.5960292Z  2024-12-18T00:50:02.5960712Z  2024-12-18T00:50:02.5961106Z  2024-12-18T00:50:02.5961474Z  2024-12-18T00:50:02.5962334Z [15,060 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:02.5963540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:02.5964644Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:02.5965775Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2024-12-18T00:50:02.5966839Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:02.5967810Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:50:02.5968726Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local 2024-12-18T00:50:02.5969578Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:50:02.5970348Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 5s local ... 2024-12-18T00:50:02.8021582Z 2024-12-18T00:50:02.8022523Z  2024-12-18T00:50:02.8023013Z  2024-12-18T00:50:02.8023442Z  2024-12-18T00:50:02.8023856Z  2024-12-18T00:50:02.8024242Z  2024-12-18T00:50:02.8024623Z  2024-12-18T00:50:02.8025045Z  2024-12-18T00:50:02.8025457Z  2024-12-18T00:50:02.8026385Z [15,066 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:02.8027502Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:02.8028622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:02.8029727Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:50:02.8030746Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:02.8031631Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2024-12-18T00:50:02.8032525Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local 2024-12-18T00:50:02.8033615Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:50:02.8034435Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 5s local ... 2024-12-18T00:50:03.0353094Z 2024-12-18T00:50:03.0353928Z  2024-12-18T00:50:03.0354686Z  2024-12-18T00:50:03.0355106Z  2024-12-18T00:50:03.0355562Z  2024-12-18T00:50:03.0355952Z  2024-12-18T00:50:03.0356320Z  2024-12-18T00:50:03.0356701Z  2024-12-18T00:50:03.0357062Z  2024-12-18T00:50:03.0358330Z [15,068 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:03.0359574Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:03.0360655Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:03.0361714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:50:03.0362686Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:03.0363558Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:50:03.0364456Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:50:03.0365246Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:50:03.0366016Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 6s local ... 2024-12-18T00:50:03.3588305Z 2024-12-18T00:50:03.3589160Z  2024-12-18T00:50:03.3589646Z  2024-12-18T00:50:03.3590070Z  2024-12-18T00:50:03.3590471Z  2024-12-18T00:50:03.3590887Z  2024-12-18T00:50:03.3591344Z  2024-12-18T00:50:03.3591759Z  2024-12-18T00:50:03.3592175Z  2024-12-18T00:50:03.3593274Z [15,069 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:03.3594469Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:03.3595515Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:03.3596704Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:50:03.3597818Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:03.3598756Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:50:03.3599750Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:50:03.3600659Z @llvm-project//llvm:llvm-tblgen; 6s local 2024-12-18T00:50:03.3601525Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 6s local ... 2024-12-18T00:50:03.5656017Z 2024-12-18T00:50:03.5657027Z  2024-12-18T00:50:03.5657498Z  2024-12-18T00:50:03.5657880Z  2024-12-18T00:50:03.5658279Z  2024-12-18T00:50:03.5658685Z  2024-12-18T00:50:03.5659105Z  2024-12-18T00:50:03.5659514Z  2024-12-18T00:50:03.5659860Z  2024-12-18T00:50:03.5660798Z [15,072 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:03.5661988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:03.5663139Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:03.5664446Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2024-12-18T00:50:03.5665514Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:03.5666285Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:50:03.5667242Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:50:03.5668099Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:50:03.5668922Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 6s local ... 2024-12-18T00:50:03.7869511Z 2024-12-18T00:50:03.7870387Z  2024-12-18T00:50:03.7870880Z  2024-12-18T00:50:03.7871287Z  2024-12-18T00:50:03.7871686Z  2024-12-18T00:50:03.7872076Z  2024-12-18T00:50:03.7872452Z  2024-12-18T00:50:03.7873119Z  2024-12-18T00:50:03.7873507Z  2024-12-18T00:50:03.7874451Z [15,075 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:03.7875726Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:50:03.7876820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:03.7877958Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:50:03.7880921Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:03.7882210Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2024-12-18T00:50:03.7883150Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2024-12-18T00:50:03.7884045Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:50:03.7884872Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 6s local ... 2024-12-18T00:50:04.0361388Z 2024-12-18T00:50:04.0362279Z  2024-12-18T00:50:04.0362770Z  2024-12-18T00:50:04.0363168Z  2024-12-18T00:50:04.0363507Z  2024-12-18T00:50:04.0363863Z  2024-12-18T00:50:04.0364221Z  2024-12-18T00:50:04.0364602Z  2024-12-18T00:50:04.0364981Z  2024-12-18T00:50:04.0365901Z [15,075 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:04.0367041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:50:04.0368156Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:04.0369309Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:50:04.0370372Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:50:04.0371309Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:50:04.0372224Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:50:04.0373051Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:50:04.0373825Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 7s local ... 2024-12-18T00:50:04.2365536Z 2024-12-18T00:50:04.2366385Z  2024-12-18T00:50:04.2366903Z  2024-12-18T00:50:04.2367316Z  2024-12-18T00:50:04.2367727Z  2024-12-18T00:50:04.2368114Z  2024-12-18T00:50:04.2368499Z  2024-12-18T00:50:04.2368847Z  2024-12-18T00:50:04.2369192Z  2024-12-18T00:50:04.2369995Z [15,078 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:04.2371103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:50:04.2372213Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:04.2373370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:50:04.2374478Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:50:04.2375316Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:50:04.2376129Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:50:04.2377085Z @llvm-project//llvm:llvm-tblgen; 7s local 2024-12-18T00:50:04.2377826Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 7s local ... 2024-12-18T00:50:04.4382833Z 2024-12-18T00:50:04.4383695Z  2024-12-18T00:50:04.4384130Z  2024-12-18T00:50:04.4384494Z  2024-12-18T00:50:04.4384848Z  2024-12-18T00:50:04.4385213Z  2024-12-18T00:50:04.4385625Z  2024-12-18T00:50:04.4385985Z  2024-12-18T00:50:04.4386328Z  2024-12-18T00:50:04.4387188Z [15,083 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:04.4388268Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:50:04.4389272Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:04.4390572Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2024-12-18T00:50:04.4391463Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:50:04.4392407Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:50:04.4393169Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:50:04.4393856Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 7s local 2024-12-18T00:50:04.4394723Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 6s local ... 2024-12-18T00:50:04.6863873Z 2024-12-18T00:50:04.6865125Z  2024-12-18T00:50:04.6865612Z  2024-12-18T00:50:04.6866035Z  2024-12-18T00:50:04.6866444Z  2024-12-18T00:50:04.6866838Z  2024-12-18T00:50:04.6867253Z  2024-12-18T00:50:04.6867675Z  2024-12-18T00:50:04.6868098Z  2024-12-18T00:50:04.6869046Z [15,087 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:04.6870301Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:04.6871478Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:04.6872665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:50:04.6873746Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2024-12-18T00:50:04.6874761Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2024-12-18T00:50:04.6875644Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:50:04.6876538Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2024-12-18T00:50:04.6877621Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 6s local ... 2024-12-18T00:50:04.9257368Z 2024-12-18T00:50:04.9258205Z  2024-12-18T00:50:04.9258712Z  2024-12-18T00:50:04.9259129Z  2024-12-18T00:50:04.9259527Z  2024-12-18T00:50:04.9259934Z  2024-12-18T00:50:04.9260346Z  2024-12-18T00:50:04.9260776Z  2024-12-18T00:50:04.9261213Z  2024-12-18T00:50:04.9262167Z [15,089 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:04.9263374Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:04.9264542Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:04.9265631Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:50:04.9266622Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:50:04.9267591Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:50:04.9268482Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:50:04.9269343Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2024-12-18T00:50:04.9270394Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 6s local ... 2024-12-18T00:50:05.1261342Z 2024-12-18T00:50:05.1262272Z  2024-12-18T00:50:05.1262771Z  2024-12-18T00:50:05.1263171Z  2024-12-18T00:50:05.1263595Z  2024-12-18T00:50:05.1264013Z  2024-12-18T00:50:05.1264417Z  2024-12-18T00:50:05.1264845Z  2024-12-18T00:50:05.1265231Z  2024-12-18T00:50:05.1266202Z [15,092 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:05.1267525Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:05.1268602Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:05.1269717Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:50:05.1270688Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:50:05.1271711Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:50:05.1272527Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:50:05.1273350Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2024-12-18T00:50:05.1274654Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 6s local ... 2024-12-18T00:50:05.3483502Z 2024-12-18T00:50:05.3484365Z  2024-12-18T00:50:05.3485123Z  2024-12-18T00:50:05.3485535Z  2024-12-18T00:50:05.3485960Z  2024-12-18T00:50:05.3486361Z  2024-12-18T00:50:05.3486757Z  2024-12-18T00:50:05.3487171Z  2024-12-18T00:50:05.3487559Z  2024-12-18T00:50:05.3488729Z [15,096 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:05.3490060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:05.3491691Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:05.3492817Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:50:05.3494073Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:50:05.3495245Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:50:05.3496262Z @llvm-project//llvm:llvm-tblgen; 8s local 2024-12-18T00:50:05.3497398Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2024-12-18T00:50:05.3498587Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 6s local ... 2024-12-18T00:50:05.6371612Z 2024-12-18T00:50:05.6375301Z  2024-12-18T00:50:05.6375852Z  2024-12-18T00:50:05.6376215Z  2024-12-18T00:50:05.6376740Z  2024-12-18T00:50:05.6377143Z  2024-12-18T00:50:05.6377573Z  2024-12-18T00:50:05.6377972Z  2024-12-18T00:50:05.6378369Z  2024-12-18T00:50:05.6379314Z [15,096 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:05.6380408Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:05.6381499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:05.6382625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2024-12-18T00:50:05.6383588Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:50:05.6384516Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2024-12-18T00:50:05.6385280Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:50:05.6385898Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:05.6386655Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local ... 2024-12-18T00:50:05.8705845Z 2024-12-18T00:50:05.8709543Z  2024-12-18T00:50:05.8710037Z  2024-12-18T00:50:05.8710442Z  2024-12-18T00:50:05.8710859Z  2024-12-18T00:50:05.8711271Z  2024-12-18T00:50:05.8711642Z  2024-12-18T00:50:05.8712026Z  2024-12-18T00:50:05.8712427Z  2024-12-18T00:50:05.8713395Z [15,101 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:05.8714653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:05.8715832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:05.8716997Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:50:05.8718070Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2024-12-18T00:50:05.8719012Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:50:05.8719862Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:50:05.8720672Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:05.8721584Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local ... 2024-12-18T00:50:06.1629801Z 2024-12-18T00:50:06.1634793Z  2024-12-18T00:50:06.1635300Z  2024-12-18T00:50:06.1635716Z  2024-12-18T00:50:06.1636126Z  2024-12-18T00:50:06.1636534Z  2024-12-18T00:50:06.1637262Z  2024-12-18T00:50:06.1637648Z  2024-12-18T00:50:06.1638036Z  2024-12-18T00:50:06.1639188Z [15,104 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:06.1640421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:06.1641537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:06.1642579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:50:06.1643687Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:50:06.1645100Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:50:06.1645946Z @llvm-project//llvm:llvm-tblgen; 9s local 2024-12-18T00:50:06.1646770Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:06.1647850Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local ... 2024-12-18T00:50:06.4099412Z 2024-12-18T00:50:06.4100277Z  2024-12-18T00:50:06.4100731Z  2024-12-18T00:50:06.4101101Z  2024-12-18T00:50:06.4101466Z  2024-12-18T00:50:06.4101850Z  2024-12-18T00:50:06.4102231Z  2024-12-18T00:50:06.4102628Z  2024-12-18T00:50:06.4103011Z  2024-12-18T00:50:06.4103967Z [15,109 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:06.4105123Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:06.4106315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:06.4107444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:50:06.4108445Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:50:06.4109341Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:50:06.4110224Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:06.4111107Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2024-12-18T00:50:06.4112086Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local ... 2024-12-18T00:50:06.6245000Z 2024-12-18T00:50:06.6245912Z  2024-12-18T00:50:06.6246379Z  2024-12-18T00:50:06.6246777Z  2024-12-18T00:50:06.6247185Z  2024-12-18T00:50:06.6247615Z  2024-12-18T00:50:06.6248021Z  2024-12-18T00:50:06.6248390Z  2024-12-18T00:50:06.6248785Z  2024-12-18T00:50:06.6249755Z [15,112 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:06.6250967Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:50:06.6252166Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:06.6253304Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2024-12-18T00:50:06.6254301Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:50:06.6255261Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2024-12-18T00:50:06.6256131Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:06.6257180Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:50:06.6258234Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:50:06.8380406Z 2024-12-18T00:50:06.8381384Z  2024-12-18T00:50:06.8381897Z  2024-12-18T00:50:06.8382845Z  2024-12-18T00:50:06.8383243Z  2024-12-18T00:50:06.8383720Z  2024-12-18T00:50:06.8384154Z  2024-12-18T00:50:06.8384579Z  2024-12-18T00:50:06.8384999Z  2024-12-18T00:50:06.8385906Z [15,113 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:06.8387094Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:50:06.8388284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:06.8389642Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:50:06.8390719Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:50:06.8391652Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:50:06.8392547Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:06.8393383Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:50:06.8394543Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:50:07.2384735Z 2024-12-18T00:50:07.2386182Z  2024-12-18T00:50:07.2387020Z  2024-12-18T00:50:07.2387662Z  2024-12-18T00:50:07.2388091Z  2024-12-18T00:50:07.2388520Z  2024-12-18T00:50:07.2388947Z  2024-12-18T00:50:07.2389366Z  2024-12-18T00:50:07.2389767Z  2024-12-18T00:50:07.2390658Z [15,114 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:07.2391870Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:50:07.2393006Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:07.2394129Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:50:07.2395087Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:50:07.2395991Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:50:07.2396888Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:07.2397697Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2024-12-18T00:50:07.2398698Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2024-12-18T00:50:07.6037371Z 2024-12-18T00:50:07.6038237Z  2024-12-18T00:50:07.6038776Z  2024-12-18T00:50:07.6039233Z  2024-12-18T00:50:07.6039675Z  2024-12-18T00:50:07.6040147Z  2024-12-18T00:50:07.6040538Z  2024-12-18T00:50:07.6040915Z  2024-12-18T00:50:07.6041323Z  2024-12-18T00:50:07.6042320Z [15,120 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:07.6043575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:07.6044989Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:07.6046120Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2024-12-18T00:50:07.6047175Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:50:07.6048161Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2024-12-18T00:50:07.6049002Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:50:07.6049841Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:50:07.6050883Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local ... 2024-12-18T00:50:07.8244739Z 2024-12-18T00:50:07.8245733Z  2024-12-18T00:50:07.8246250Z  2024-12-18T00:50:07.8246687Z  2024-12-18T00:50:07.8247100Z  2024-12-18T00:50:07.8247459Z  2024-12-18T00:50:07.8247867Z  2024-12-18T00:50:07.8248276Z  2024-12-18T00:50:07.8248680Z  2024-12-18T00:50:07.8249595Z [15,123 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:07.8250756Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:07.8251903Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:07.8252951Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:50:07.8253970Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:50:07.8254845Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:50:07.8255677Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:50:07.8256943Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:50:07.8257935Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local ... 2024-12-18T00:50:08.0393601Z 2024-12-18T00:50:08.0394524Z  2024-12-18T00:50:08.0395059Z  2024-12-18T00:50:08.0395479Z  2024-12-18T00:50:08.0395907Z  2024-12-18T00:50:08.0396309Z  2024-12-18T00:50:08.0396687Z  2024-12-18T00:50:08.0397058Z  2024-12-18T00:50:08.0397457Z  2024-12-18T00:50:08.0398601Z [15,126 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:08.0399924Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:08.0401019Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:08.0402054Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:50:08.0403026Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:50:08.0403989Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:50:08.0404861Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:50:08.0405697Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2024-12-18T00:50:08.0406781Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local ... 2024-12-18T00:50:08.3046509Z 2024-12-18T00:50:08.3047509Z  2024-12-18T00:50:08.3048047Z  2024-12-18T00:50:08.3048505Z  2024-12-18T00:50:08.3049017Z  2024-12-18T00:50:08.3049454Z  2024-12-18T00:50:08.3049919Z  2024-12-18T00:50:08.3050307Z  2024-12-18T00:50:08.3050708Z  2024-12-18T00:50:08.3051626Z [15,129 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:08.3052823Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:08.3054040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:08.3054995Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:50:08.3055896Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:50:08.3057073Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:50:08.3057911Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:50:08.3058680Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2024-12-18T00:50:08.3059718Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local ... 2024-12-18T00:50:08.5083882Z 2024-12-18T00:50:08.5084844Z  2024-12-18T00:50:08.5085387Z  2024-12-18T00:50:08.5085833Z  2024-12-18T00:50:08.5086262Z  2024-12-18T00:50:08.5086685Z  2024-12-18T00:50:08.5087028Z  2024-12-18T00:50:08.5087406Z  2024-12-18T00:50:08.5087769Z  2024-12-18T00:50:08.5088692Z [15,131 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:08.5089890Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:08.5091060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:08.5092179Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2024-12-18T00:50:08.5093146Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:50:08.5094042Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2024-12-18T00:50:08.5094965Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:08.5095809Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:50:08.5096999Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local ... 2024-12-18T00:50:08.7626861Z 2024-12-18T00:50:08.7627729Z  2024-12-18T00:50:08.7628261Z  2024-12-18T00:50:08.7628681Z  2024-12-18T00:50:08.7629413Z  2024-12-18T00:50:08.7629831Z  2024-12-18T00:50:08.7630264Z  2024-12-18T00:50:08.7630753Z  2024-12-18T00:50:08.7631148Z  2024-12-18T00:50:08.7632257Z [15,133 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:08.7633454Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:50:08.7634563Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:08.7635822Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:50:08.7636925Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:50:08.7637805Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:08.7638572Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:50:08.7639557Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2024-12-18T00:50:08.7640648Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local ... 2024-12-18T00:50:08.9696373Z 2024-12-18T00:50:08.9697471Z  2024-12-18T00:50:08.9697998Z  2024-12-18T00:50:08.9698458Z  2024-12-18T00:50:08.9698908Z  2024-12-18T00:50:08.9699371Z  2024-12-18T00:50:08.9699756Z  2024-12-18T00:50:08.9700135Z  2024-12-18T00:50:08.9700524Z  2024-12-18T00:50:08.9701489Z [15,137 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:08.9702736Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:50:08.9703892Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:08.9705075Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:50:08.9706119Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:50:08.9706968Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:08.9707847Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:50:08.9708850Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2024-12-18T00:50:08.9709872Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local ... 2024-12-18T00:50:09.2402880Z 2024-12-18T00:50:09.2403754Z  2024-12-18T00:50:09.2404301Z  2024-12-18T00:50:09.2404742Z  2024-12-18T00:50:09.2405156Z  2024-12-18T00:50:09.2405591Z  2024-12-18T00:50:09.2405974Z  2024-12-18T00:50:09.2406333Z  2024-12-18T00:50:09.2406680Z  2024-12-18T00:50:09.2407618Z [15,139 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:09.2408761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:50:09.2409835Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:09.2410876Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:50:09.2411868Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:50:09.2412649Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:09.2413520Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2024-12-18T00:50:09.2414504Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2024-12-18T00:50:09.2415518Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local ... 2024-12-18T00:50:09.4832341Z 2024-12-18T00:50:09.4833296Z  2024-12-18T00:50:09.4833807Z  2024-12-18T00:50:09.4834280Z  2024-12-18T00:50:09.4834716Z  2024-12-18T00:50:09.4835151Z  2024-12-18T00:50:09.4835509Z  2024-12-18T00:50:09.4835828Z  2024-12-18T00:50:09.4836169Z  2024-12-18T00:50:09.4836974Z [15,144 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:09.4837943Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:50:09.4839162Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:09.4840093Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2024-12-18T00:50:09.4841024Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:50:09.4841694Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:50:09.4842399Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2024-12-18T00:50:09.4843228Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2024-12-18T00:50:09.4844601Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local ... 2024-12-18T00:50:09.7051870Z 2024-12-18T00:50:09.7052820Z  2024-12-18T00:50:09.7053369Z  2024-12-18T00:50:09.7053838Z  2024-12-18T00:50:09.7054270Z  2024-12-18T00:50:09.7054689Z  2024-12-18T00:50:09.7055091Z  2024-12-18T00:50:09.7055453Z  2024-12-18T00:50:09.7055842Z  2024-12-18T00:50:09.7056918Z [15,147 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:09.7058105Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:50:09.7059283Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:09.7060461Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:50:09.7061502Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:50:09.7062312Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:50:09.7063140Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2024-12-18T00:50:09.7064165Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:50:09.7065255Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local ... 2024-12-18T00:50:09.9446607Z 2024-12-18T00:50:09.9447773Z  2024-12-18T00:50:09.9448280Z  2024-12-18T00:50:09.9448737Z  2024-12-18T00:50:09.9449167Z  2024-12-18T00:50:09.9449595Z  2024-12-18T00:50:09.9450001Z  2024-12-18T00:50:09.9450463Z  2024-12-18T00:50:09.9450875Z  2024-12-18T00:50:09.9451765Z [15,148 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:09.9452991Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:50:09.9453966Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:09.9455043Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:50:09.9456052Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:50:09.9456948Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:50:09.9457731Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2024-12-18T00:50:09.9458710Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:50:09.9459689Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local ... 2024-12-18T00:50:10.1661684Z 2024-12-18T00:50:10.1662663Z  2024-12-18T00:50:10.1663202Z  2024-12-18T00:50:10.1663642Z  2024-12-18T00:50:10.1664111Z  2024-12-18T00:50:10.1664520Z  2024-12-18T00:50:10.1664957Z  2024-12-18T00:50:10.1665340Z  2024-12-18T00:50:10.1665763Z  2024-12-18T00:50:10.1666690Z [15,153 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:10.1667836Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:50:10.1668955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:10.1670063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:50:10.1671060Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:50:10.1671857Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:50:10.1672989Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:50:10.1673956Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:50:10.1675115Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local ... 2024-12-18T00:50:10.4412007Z 2024-12-18T00:50:10.4412908Z  2024-12-18T00:50:10.4413446Z  2024-12-18T00:50:10.4413889Z  2024-12-18T00:50:10.4414299Z  2024-12-18T00:50:10.4414727Z  2024-12-18T00:50:10.4415105Z  2024-12-18T00:50:10.4415846Z  2024-12-18T00:50:10.4416209Z  2024-12-18T00:50:10.4417219Z [15,157 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:10.4418285Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:50:10.4419319Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:10.4420339Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2024-12-18T00:50:10.4421274Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:50:10.4421984Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:50:10.4422762Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:50:10.4423682Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2024-12-18T00:50:10.4424675Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local ... 2024-12-18T00:50:10.8381514Z 2024-12-18T00:50:10.8382792Z  2024-12-18T00:50:10.8383320Z  2024-12-18T00:50:10.8383740Z  2024-12-18T00:50:10.8384175Z  2024-12-18T00:50:10.8384547Z  2024-12-18T00:50:10.8384936Z  2024-12-18T00:50:10.8385304Z  2024-12-18T00:50:10.8385714Z  2024-12-18T00:50:10.8386652Z [15,158 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:10.8387857Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:50:10.8389000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:10.8390144Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:50:10.8391113Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:50:10.8391914Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:50:10.8392768Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:10.8393832Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:11.0419665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local ... 2024-12-18T00:50:11.0420518Z 2024-12-18T00:50:11.0421007Z  2024-12-18T00:50:11.0421458Z  2024-12-18T00:50:11.0421917Z  2024-12-18T00:50:11.0422313Z  2024-12-18T00:50:11.0422827Z  2024-12-18T00:50:11.0423194Z  2024-12-18T00:50:11.0423577Z  2024-12-18T00:50:11.0423949Z  2024-12-18T00:50:11.0424837Z [15,158 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:11.0426022Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:50:11.0427174Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:11.0428306Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:50:11.0429316Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:50:11.0430125Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:50:11.0430890Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:11.0432032Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:11.0433127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local ... 2024-12-18T00:50:11.2440742Z 2024-12-18T00:50:11.2441913Z  2024-12-18T00:50:11.2442433Z  2024-12-18T00:50:11.2442870Z  2024-12-18T00:50:11.2443284Z  2024-12-18T00:50:11.2443707Z  2024-12-18T00:50:11.2444139Z  2024-12-18T00:50:11.2444934Z  2024-12-18T00:50:11.2445338Z  2024-12-18T00:50:11.2446287Z [15,162 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:11.2447518Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:50:11.2449000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:11.2450298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:50:11.2451345Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:50:11.2452139Z @llvm-project//llvm:llvm-tblgen; 14s local 2024-12-18T00:50:11.2453022Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:11.2454071Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:11.2455155Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local ... 2024-12-18T00:50:11.4729300Z 2024-12-18T00:50:11.4730301Z  2024-12-18T00:50:11.4730834Z  2024-12-18T00:50:11.4731245Z  2024-12-18T00:50:11.4731677Z  2024-12-18T00:50:11.4732103Z  2024-12-18T00:50:11.4732497Z  2024-12-18T00:50:11.4732844Z  2024-12-18T00:50:11.4733226Z  2024-12-18T00:50:11.4734121Z [15,165 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:11.4735288Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:50:11.4736349Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:11.4737561Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2024-12-18T00:50:11.4738522Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:50:11.4739310Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:50:11.4740161Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:11.4741254Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2024-12-18T00:50:11.4742335Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local ... 2024-12-18T00:50:11.6767987Z 2024-12-18T00:50:11.6768879Z  2024-12-18T00:50:11.6769424Z  2024-12-18T00:50:11.6769862Z  2024-12-18T00:50:11.6770293Z  2024-12-18T00:50:11.6770755Z  2024-12-18T00:50:11.6771175Z  2024-12-18T00:50:11.6771544Z  2024-12-18T00:50:11.6771927Z  2024-12-18T00:50:11.6772863Z [15,168 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:11.6774046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:50:11.6775160Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:11.6776273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:50:11.6777403Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:50:11.6778204Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:50:11.6788758Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:11.6789824Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:11.6790976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local ... 2024-12-18T00:50:11.9714505Z 2024-12-18T00:50:11.9715380Z  2024-12-18T00:50:11.9715821Z  2024-12-18T00:50:11.9716193Z  2024-12-18T00:50:11.9716586Z  2024-12-18T00:50:11.9716980Z  2024-12-18T00:50:11.9717380Z  2024-12-18T00:50:11.9717761Z  2024-12-18T00:50:11.9718138Z  2024-12-18T00:50:11.9719049Z [15,171 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:11.9720540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:50:11.9721779Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:11.9722880Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:50:11.9723890Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:50:11.9724630Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:50:11.9725615Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:11.9728942Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:11.9729998Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local ... 2024-12-18T00:50:12.2431277Z 2024-12-18T00:50:12.2432185Z  2024-12-18T00:50:12.2432724Z  2024-12-18T00:50:12.2433155Z  2024-12-18T00:50:12.2433564Z  2024-12-18T00:50:12.2434021Z  2024-12-18T00:50:12.2434388Z  2024-12-18T00:50:12.2434764Z  2024-12-18T00:50:12.2435185Z  2024-12-18T00:50:12.2436045Z [15,173 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:50:12.2437146Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:50:12.2438091Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:12.2439135Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:50:12.2440170Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:50:12.2441025Z @llvm-project//llvm:llvm-tblgen; 15s local 2024-12-18T00:50:12.2441768Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:12.2442800Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:12.2443827Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local ... 2024-12-18T00:50:12.4447840Z 2024-12-18T00:50:12.4448730Z  2024-12-18T00:50:12.4449245Z  2024-12-18T00:50:12.4449675Z  2024-12-18T00:50:12.4450111Z  2024-12-18T00:50:12.4450575Z  2024-12-18T00:50:12.4450940Z  2024-12-18T00:50:12.4451332Z  2024-12-18T00:50:12.4451743Z  2024-12-18T00:50:12.4452693Z [15,177 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:12.4453915Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:50:12.4455074Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:12.4456167Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2024-12-18T00:50:12.4457355Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:50:12.4458303Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:12.4459298Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2024-12-18T00:50:12.4460375Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2024-12-18T00:50:12.4461319Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:12.7379614Z 2024-12-18T00:50:12.7380567Z  2024-12-18T00:50:12.7381129Z  2024-12-18T00:50:12.7381593Z  2024-12-18T00:50:12.7382028Z  2024-12-18T00:50:12.7382468Z  2024-12-18T00:50:12.7382838Z  2024-12-18T00:50:12.7383238Z  2024-12-18T00:50:12.7383639Z  2024-12-18T00:50:12.7384681Z [15,180 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:12.7385935Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:50:12.7387092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:12.7388251Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:50:12.7389612Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:12.7390617Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:12.7391857Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:50:12.7392780Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:12.7393652Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local ... 2024-12-18T00:50:12.9547358Z 2024-12-18T00:50:12.9548253Z  2024-12-18T00:50:12.9548757Z  2024-12-18T00:50:12.9549550Z  2024-12-18T00:50:12.9549974Z  2024-12-18T00:50:12.9550328Z  2024-12-18T00:50:12.9550682Z  2024-12-18T00:50:12.9551022Z  2024-12-18T00:50:12.9551397Z  2024-12-18T00:50:12.9552205Z [15,182 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:12.9553227Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:50:12.9554280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:12.9555246Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:50:12.9556128Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:12.9557014Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:12.9557938Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:50:12.9558735Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:12.9559480Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local ... 2024-12-18T00:50:13.2353705Z 2024-12-18T00:50:13.2354652Z  2024-12-18T00:50:13.2355161Z  2024-12-18T00:50:13.2355593Z  2024-12-18T00:50:13.2356002Z  2024-12-18T00:50:13.2356424Z  2024-12-18T00:50:13.2356845Z  2024-12-18T00:50:13.2357194Z  2024-12-18T00:50:13.2357543Z  2024-12-18T00:50:13.2358440Z [15,185 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:13.2359569Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:50:13.2360579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:13.2361652Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:50:13.2362856Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:13.2363874Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:13.2364907Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:50:13.2365809Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:13.2366667Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local ... 2024-12-18T00:50:13.4440869Z 2024-12-18T00:50:13.4441771Z  2024-12-18T00:50:13.4442297Z  2024-12-18T00:50:13.4442757Z  2024-12-18T00:50:13.4443153Z  2024-12-18T00:50:13.4443549Z  2024-12-18T00:50:13.4443882Z  2024-12-18T00:50:13.4446732Z  2024-12-18T00:50:13.4447188Z  2024-12-18T00:50:13.4448108Z [15,187 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:13.4449249Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:50:13.4450318Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:13.4451443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2024-12-18T00:50:13.4452493Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:13.4453442Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2024-12-18T00:50:13.4454479Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2024-12-18T00:50:13.4455372Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:13.4456803Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local ... 2024-12-18T00:50:13.7841710Z 2024-12-18T00:50:13.7842592Z  2024-12-18T00:50:13.7843113Z  2024-12-18T00:50:13.7843761Z  2024-12-18T00:50:13.7844396Z  2024-12-18T00:50:13.7844779Z  2024-12-18T00:50:13.7845122Z  2024-12-18T00:50:13.7845523Z  2024-12-18T00:50:13.7845909Z  2024-12-18T00:50:13.7846828Z [15,189 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:13.7848258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:50:13.7849354Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:13.7850666Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:50:13.7851757Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:13.7852796Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:13.7853882Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:13.7854824Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:13.7855690Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local ... 2024-12-18T00:50:14.0446350Z 2024-12-18T00:50:14.0447373Z  2024-12-18T00:50:14.0447899Z  2024-12-18T00:50:14.0448348Z  2024-12-18T00:50:14.0448746Z  2024-12-18T00:50:14.0449137Z  2024-12-18T00:50:14.0449532Z  2024-12-18T00:50:14.0449938Z  2024-12-18T00:50:14.0450311Z  2024-12-18T00:50:14.0451175Z [15,191 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:14.0452330Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:50:14.0453386Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:14.0454446Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:50:14.0455459Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:14.0456583Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:14.0457644Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:14.0458538Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:14.0459377Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local ... 2024-12-18T00:50:14.3055170Z 2024-12-18T00:50:14.3056211Z  2024-12-18T00:50:14.3056786Z  2024-12-18T00:50:14.3057162Z  2024-12-18T00:50:14.3057553Z  2024-12-18T00:50:14.3058037Z  2024-12-18T00:50:14.3058399Z  2024-12-18T00:50:14.3058726Z  2024-12-18T00:50:14.3059050Z  2024-12-18T00:50:14.3059827Z [15,192 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:14.3060784Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:50:14.3061867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:14.3062895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:50:14.3063731Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:14.3064575Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:14.3065558Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:14.3066409Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:14.3067160Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local ... 2024-12-18T00:50:14.5535127Z 2024-12-18T00:50:14.5536095Z  2024-12-18T00:50:14.5536747Z  2024-12-18T00:50:14.5537192Z  2024-12-18T00:50:14.5537638Z  2024-12-18T00:50:14.5538009Z  2024-12-18T00:50:14.5538668Z  2024-12-18T00:50:14.5539057Z  2024-12-18T00:50:14.5539443Z  2024-12-18T00:50:14.5540490Z [15,201 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:14.5541612Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:50:14.5542730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:14.5543921Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2024-12-18T00:50:14.5545307Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:14.5546376Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2024-12-18T00:50:14.5547487Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2024-12-18T00:50:14.5548404Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:14.5549302Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local ... 2024-12-18T00:50:14.8453449Z 2024-12-18T00:50:14.8454440Z  2024-12-18T00:50:14.8454951Z  2024-12-18T00:50:14.8455378Z  2024-12-18T00:50:14.8455925Z  2024-12-18T00:50:14.8456324Z  2024-12-18T00:50:14.8456889Z  2024-12-18T00:50:14.8457265Z  2024-12-18T00:50:14.8457661Z  2024-12-18T00:50:14.8458573Z [15,204 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:14.8459679Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:50:14.8460855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:50:14.8461958Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:50:14.8462995Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:50:14.8463979Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:50:14.8465031Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:14.8465929Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:14.8466821Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local ... 2024-12-18T00:50:15.1285496Z 2024-12-18T00:50:15.1286439Z  2024-12-18T00:50:15.1286903Z  2024-12-18T00:50:15.1287317Z  2024-12-18T00:50:15.1287699Z  2024-12-18T00:50:15.1288101Z  2024-12-18T00:50:15.1288489Z  2024-12-18T00:50:15.1288881Z  2024-12-18T00:50:15.1289266Z  2024-12-18T00:50:15.1290216Z [15,207 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:15.1291570Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:50:15.1292728Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:50:15.1293891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:50:15.1295002Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:50:15.1295972Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:50:15.1297197Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:15.1298145Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:15.1298992Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local ... 2024-12-18T00:50:15.3953350Z 2024-12-18T00:50:15.3954278Z  2024-12-18T00:50:15.3954772Z  2024-12-18T00:50:15.3955172Z  2024-12-18T00:50:15.3955598Z  2024-12-18T00:50:15.3955970Z  2024-12-18T00:50:15.3956343Z  2024-12-18T00:50:15.3956708Z  2024-12-18T00:50:15.3957080Z  2024-12-18T00:50:15.3957981Z [15,210 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:15.3959102Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:50:15.3960545Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:50:15.3961662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2024-12-18T00:50:15.3962853Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:50:15.3963852Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2024-12-18T00:50:15.3964888Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:15.3965644Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:15.3966700Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local ... 2024-12-18T00:50:15.6461530Z 2024-12-18T00:50:15.6462392Z  2024-12-18T00:50:15.6462881Z  2024-12-18T00:50:15.6463273Z  2024-12-18T00:50:15.6463683Z  2024-12-18T00:50:15.6464079Z  2024-12-18T00:50:15.6464481Z  2024-12-18T00:50:15.6464878Z  2024-12-18T00:50:15.6465287Z  2024-12-18T00:50:15.6466256Z [15,216 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:15.6467468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:50:15.6468606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:15.6469728Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:50:15.6470786Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:15.6471800Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:15.6472885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2024-12-18T00:50:15.6473833Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:15.6474677Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local ... 2024-12-18T00:50:15.8621483Z 2024-12-18T00:50:15.8622374Z  2024-12-18T00:50:15.8622858Z  2024-12-18T00:50:15.8623307Z  2024-12-18T00:50:15.8623730Z  2024-12-18T00:50:15.8624114Z  2024-12-18T00:50:15.8624534Z  2024-12-18T00:50:15.8624957Z  2024-12-18T00:50:15.8625377Z  2024-12-18T00:50:15.8626479Z [15,225 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:15.8627737Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:50:15.8628886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:15.8629963Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:50:15.8631092Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:15.8632124Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:15.8633185Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:15.8634081Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:15.8634966Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local ... 2024-12-18T00:50:16.0675602Z 2024-12-18T00:50:16.0676517Z  2024-12-18T00:50:16.0677022Z  2024-12-18T00:50:16.0677437Z  2024-12-18T00:50:16.0677893Z  2024-12-18T00:50:16.0678329Z  2024-12-18T00:50:16.0678759Z  2024-12-18T00:50:16.0679319Z  2024-12-18T00:50:16.0679728Z  2024-12-18T00:50:16.0680695Z [15,234 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:16.0681916Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:50:16.0683018Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:16.0684077Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:50:16.0685042Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:16.0685998Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:16.0687315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:16.0688255Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:16.0689271Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local ... 2024-12-18T00:50:16.2688260Z 2024-12-18T00:50:16.2689133Z  2024-12-18T00:50:16.2689618Z  2024-12-18T00:50:16.2690002Z  2024-12-18T00:50:16.2690719Z  2024-12-18T00:50:16.2691263Z  2024-12-18T00:50:16.2691768Z  2024-12-18T00:50:16.2692725Z  2024-12-18T00:50:16.2693244Z  2024-12-18T00:50:16.2694453Z [15,245 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:16.2695758Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:50:16.2697168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:16.2698407Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:50:16.2699610Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:16.2700743Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:16.2701914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:16.2702952Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:16.2703959Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local ... 2024-12-18T00:50:16.4805524Z 2024-12-18T00:50:16.4806557Z  2024-12-18T00:50:16.4807046Z  2024-12-18T00:50:16.4807447Z  2024-12-18T00:50:16.4807860Z  2024-12-18T00:50:16.4808287Z  2024-12-18T00:50:16.4808694Z  2024-12-18T00:50:16.4809113Z  2024-12-18T00:50:16.4809501Z  2024-12-18T00:50:16.4810445Z [15,256 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:16.4811644Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:50:16.4812767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:16.4813924Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2024-12-18T00:50:16.4815011Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:16.4815921Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2024-12-18T00:50:16.4817177Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:16.4818100Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:16.4819000Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local ... 2024-12-18T00:50:16.6938047Z 2024-12-18T00:50:16.6939091Z  2024-12-18T00:50:16.6939568Z  2024-12-18T00:50:16.6939966Z  2024-12-18T00:50:16.6940392Z  2024-12-18T00:50:16.6940770Z  2024-12-18T00:50:16.6941195Z  2024-12-18T00:50:16.6941579Z  2024-12-18T00:50:16.6941987Z  2024-12-18T00:50:16.6942939Z [15,268 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:16.6944496Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:50:16.6945723Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:16.6946789Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:50:16.6947902Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2024-12-18T00:50:16.6948894Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2024-12-18T00:50:16.6949940Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2024-12-18T00:50:16.6950849Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:16.6951783Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local ... 2024-12-18T00:50:16.9066585Z 2024-12-18T00:50:16.9067476Z  2024-12-18T00:50:16.9067978Z  2024-12-18T00:50:16.9068366Z  2024-12-18T00:50:16.9068779Z  2024-12-18T00:50:16.9069188Z  2024-12-18T00:50:16.9069889Z  2024-12-18T00:50:16.9070305Z  2024-12-18T00:50:16.9070703Z  2024-12-18T00:50:16.9071696Z [15,277 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:16.9072924Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:50:16.9074302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:16.9075606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:50:16.9076707Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2024-12-18T00:50:16.9077730Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2024-12-18T00:50:16.9078826Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:16.9079818Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:16.9080711Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local ... 2024-12-18T00:50:17.1139527Z 2024-12-18T00:50:17.1140371Z  2024-12-18T00:50:17.1140827Z  2024-12-18T00:50:17.1141250Z  2024-12-18T00:50:17.1141674Z  2024-12-18T00:50:17.1142074Z  2024-12-18T00:50:17.1142474Z  2024-12-18T00:50:17.1142882Z  2024-12-18T00:50:17.1143295Z  2024-12-18T00:50:17.1144498Z [15,289 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:17.1145762Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:50:17.1146974Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:17.1148155Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:50:17.1149271Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2024-12-18T00:50:17.1150379Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:17.1151370Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:17.1152245Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2024-12-18T00:50:17.1153267Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local ... 2024-12-18T00:50:17.3165662Z 2024-12-18T00:50:17.3166541Z  2024-12-18T00:50:17.3167024Z  2024-12-18T00:50:17.3167394Z  2024-12-18T00:50:17.3167822Z  2024-12-18T00:50:17.3168235Z  2024-12-18T00:50:17.3168609Z  2024-12-18T00:50:17.3168981Z  2024-12-18T00:50:17.3169360Z  2024-12-18T00:50:17.3170298Z [15,313 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:17.3171468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:50:17.3172549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:17.3173599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:50:17.3174678Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:17.3175613Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:17.3176574Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:50:17.3177432Z Compiling xla/tsl/platform/default/env.cc; 5s local 2024-12-18T00:50:17.3178183Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2024-12-18T00:50:17.5300584Z 2024-12-18T00:50:17.5301412Z  2024-12-18T00:50:17.5301903Z  2024-12-18T00:50:17.5302283Z  2024-12-18T00:50:17.5302688Z  2024-12-18T00:50:17.5303091Z  2024-12-18T00:50:17.5303490Z  2024-12-18T00:50:17.5303879Z  2024-12-18T00:50:17.5304249Z  2024-12-18T00:50:17.5305169Z [15,328 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:17.5306832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:50:17.5308154Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:17.5309336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2024-12-18T00:50:17.5310495Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2024-12-18T00:50:17.5311465Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:17.5312457Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:50:17.5313481Z Compiling xla/tsl/platform/default/env.cc; 6s local 2024-12-18T00:50:17.5314263Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2024-12-18T00:50:17.7378614Z 2024-12-18T00:50:17.7379516Z  2024-12-18T00:50:17.7380025Z  2024-12-18T00:50:17.7380456Z  2024-12-18T00:50:17.7380848Z  2024-12-18T00:50:17.7381208Z  2024-12-18T00:50:17.7381625Z  2024-12-18T00:50:17.7382011Z  2024-12-18T00:50:17.7382838Z  2024-12-18T00:50:17.7383946Z [15,344 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:17.7385271Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:50:17.7386492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:17.7387738Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:50:17.7389050Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:17.7390137Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:17.7391073Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2024-12-18T00:50:17.7392087Z Compiling xla/tsl/platform/default/env.cc; 6s local 2024-12-18T00:50:17.7392986Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2024-12-18T00:50:17.9464136Z 2024-12-18T00:50:17.9465022Z  2024-12-18T00:50:17.9465449Z  2024-12-18T00:50:17.9465794Z  2024-12-18T00:50:17.9466136Z  2024-12-18T00:50:17.9466476Z  2024-12-18T00:50:17.9466821Z  2024-12-18T00:50:17.9467204Z  2024-12-18T00:50:17.9467549Z  2024-12-18T00:50:17.9468378Z [15,359 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:50:17.9469367Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:50:17.9470302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:17.9471236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:50:17.9472385Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:17.9473231Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:17.9473998Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:17.9474970Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 5s local 2024-12-18T00:50:17.9475811Z Compiling tsl/platform/env.cc; 5s local ... 2024-12-18T00:50:18.1506376Z 2024-12-18T00:50:18.1507378Z  2024-12-18T00:50:18.1507816Z  2024-12-18T00:50:18.1508144Z  2024-12-18T00:50:18.1508492Z  2024-12-18T00:50:18.1508840Z  2024-12-18T00:50:18.1509185Z  2024-12-18T00:50:18.1509537Z  2024-12-18T00:50:18.1509885Z  2024-12-18T00:50:18.1510670Z [15,370 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:18.1511625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:50:18.1512522Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:18.1513425Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:50:18.1514365Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:18.1515375Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:18.1516071Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:18.1517225Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 5s local 2024-12-18T00:50:18.1518080Z Compiling tsl/platform/env.cc; 5s local ... 2024-12-18T00:50:18.3545207Z 2024-12-18T00:50:18.3546517Z  2024-12-18T00:50:18.3546973Z  2024-12-18T00:50:18.3547383Z  2024-12-18T00:50:18.3547784Z  2024-12-18T00:50:18.3548537Z  2024-12-18T00:50:18.3548953Z  2024-12-18T00:50:18.3549351Z  2024-12-18T00:50:18.3549753Z  2024-12-18T00:50:18.3550710Z [15,386 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:18.3551886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:50:18.3553023Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:18.3554148Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:50:18.3555280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:18.3556209Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:18.3557029Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:18.3558109Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:50:18.3559318Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCContract.cpp; 5s local ... 2024-12-18T00:50:18.5658694Z 2024-12-18T00:50:18.5659588Z  2024-12-18T00:50:18.5660090Z  2024-12-18T00:50:18.5660513Z  2024-12-18T00:50:18.5660925Z  2024-12-18T00:50:18.5661343Z  2024-12-18T00:50:18.5661750Z  2024-12-18T00:50:18.5662175Z  2024-12-18T00:50:18.5662594Z  2024-12-18T00:50:18.5663573Z [15,408 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:18.5664722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:50:18.5665863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:18.5666975Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2024-12-18T00:50:18.5668101Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2024-12-18T00:50:18.5669009Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:18.5669886Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:18.5670998Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:50:18.5672023Z Compiling xla/backends/cpu/runtime/kernel.cc; 4s local ... 2024-12-18T00:50:18.7669571Z 2024-12-18T00:50:18.7670516Z  2024-12-18T00:50:18.7671007Z  2024-12-18T00:50:18.7671427Z  2024-12-18T00:50:18.7671854Z  2024-12-18T00:50:18.7672261Z  2024-12-18T00:50:18.7672679Z  2024-12-18T00:50:18.7673062Z  2024-12-18T00:50:18.7673475Z  2024-12-18T00:50:18.7674447Z [15,422 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:18.7675697Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:50:18.7676875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:18.7678053Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:50:18.7679284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:18.7680263Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:18.7681057Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2024-12-18T00:50:18.7682186Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:50:18.7683540Z Compiling xla/backends/cpu/runtime/kernel.cc; 4s local ... 2024-12-18T00:50:18.9773520Z 2024-12-18T00:50:18.9774548Z  2024-12-18T00:50:18.9775068Z  2024-12-18T00:50:18.9775504Z  2024-12-18T00:50:18.9776149Z  2024-12-18T00:50:18.9776723Z  2024-12-18T00:50:18.9777176Z  2024-12-18T00:50:18.9777584Z  2024-12-18T00:50:18.9777994Z  2024-12-18T00:50:18.9778969Z [15,437 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:18.9780393Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:50:18.9781629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:18.9782718Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:50:18.9783828Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:18.9784697Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:18.9785566Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:18.9786689Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:50:18.9787770Z Compiling xla/backends/cpu/runtime/kernel.cc; 4s local ... 2024-12-18T00:50:19.1792551Z 2024-12-18T00:50:19.1793488Z  2024-12-18T00:50:19.1793969Z  2024-12-18T00:50:19.1794386Z  2024-12-18T00:50:19.1794813Z  2024-12-18T00:50:19.1795204Z  2024-12-18T00:50:19.1795593Z  2024-12-18T00:50:19.1796007Z  2024-12-18T00:50:19.1796468Z  2024-12-18T00:50:19.1797420Z [15,469 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:19.1798867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:50:19.1800086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:19.1801402Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:50:19.1802701Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:19.1803769Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:19.1804745Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:19.1805981Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 6s local 2024-12-18T00:50:19.1807168Z Compiling xla/backends/cpu/runtime/kernel.cc; 4s local ... 2024-12-18T00:50:19.3848598Z 2024-12-18T00:50:19.3849589Z  2024-12-18T00:50:19.3850120Z  2024-12-18T00:50:19.3850540Z  2024-12-18T00:50:19.3850953Z  2024-12-18T00:50:19.3851358Z  2024-12-18T00:50:19.3851749Z  2024-12-18T00:50:19.3852151Z  2024-12-18T00:50:19.3852535Z  2024-12-18T00:50:19.3853509Z [15,496 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:19.3854763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:50:19.3855895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:19.3857273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:50:19.3858439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:19.3859390Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:19.3860215Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:19.3861215Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:50:19.3862306Z Compiling xla/backends/cpu/runtime/kernel.cc; 5s local ... 2024-12-18T00:50:19.5980703Z 2024-12-18T00:50:19.5981664Z  2024-12-18T00:50:19.5982130Z  2024-12-18T00:50:19.5982544Z  2024-12-18T00:50:19.5982912Z  2024-12-18T00:50:19.5983247Z  2024-12-18T00:50:19.5983614Z  2024-12-18T00:50:19.5984222Z  2024-12-18T00:50:19.5984584Z  2024-12-18T00:50:19.5985467Z [15,525 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:19.5986686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:50:19.5987729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:19.5988763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2024-12-18T00:50:19.5989900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2024-12-18T00:50:19.5990842Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:19.5991580Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:19.5992518Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:50:19.5993459Z Compiling llvm/lib/CGData/CodeGenData.cpp; 5s local ... 2024-12-18T00:50:19.7991210Z 2024-12-18T00:50:19.7992110Z  2024-12-18T00:50:19.7992526Z  2024-12-18T00:50:19.7992861Z  2024-12-18T00:50:19.7993190Z  2024-12-18T00:50:19.7993517Z  2024-12-18T00:50:19.7993851Z  2024-12-18T00:50:19.7994174Z  2024-12-18T00:50:19.7994505Z  2024-12-18T00:50:19.7995287Z [15,552 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:19.7996215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:50:19.7997124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:19.7998146Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:50:19.7999036Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:19.7999780Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:19.8000452Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2024-12-18T00:50:19.8001329Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:50:19.8002150Z Compiling llvm/lib/CGData/CodeGenData.cpp; 5s local ... 2024-12-18T00:50:20.0071741Z 2024-12-18T00:50:20.0073088Z  2024-12-18T00:50:20.0073603Z  2024-12-18T00:50:20.0074033Z  2024-12-18T00:50:20.0074467Z  2024-12-18T00:50:20.0074868Z  2024-12-18T00:50:20.0075290Z  2024-12-18T00:50:20.0075713Z  2024-12-18T00:50:20.0076137Z  2024-12-18T00:50:20.0077144Z [15,570 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:20.0078399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:50:20.0079611Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:20.0080783Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:50:20.0082085Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:20.0083099Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:20.0083896Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:50:20.0084994Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:50:20.0086030Z Compiling llvm/lib/CGData/CodeGenData.cpp; 5s local ... 2024-12-18T00:50:20.2232832Z 2024-12-18T00:50:20.2233749Z  2024-12-18T00:50:20.2234274Z  2024-12-18T00:50:20.2234665Z  2024-12-18T00:50:20.2235073Z  2024-12-18T00:50:20.2235517Z  2024-12-18T00:50:20.2235916Z  2024-12-18T00:50:20.2236306Z  2024-12-18T00:50:20.2236700Z  2024-12-18T00:50:20.2237665Z [15,592 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:20.2238858Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:50:20.2240018Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:20.2241475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:50:20.2242733Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:20.2243692Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:20.2244847Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:50:20.2245922Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 7s local 2024-12-18T00:50:20.2247135Z Compiling llvm/lib/CGData/CodeGenData.cpp; 5s local ... 2024-12-18T00:50:20.4339094Z 2024-12-18T00:50:20.4340013Z  2024-12-18T00:50:20.4340468Z  2024-12-18T00:50:20.4340886Z  2024-12-18T00:50:20.4341275Z  2024-12-18T00:50:20.4341675Z  2024-12-18T00:50:20.4342045Z  2024-12-18T00:50:20.4342437Z  2024-12-18T00:50:20.4342835Z  2024-12-18T00:50:20.4343783Z [15,618 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:20.4345253Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:50:20.4346514Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:20.4347611Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:50:20.4348741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:20.4349677Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:20.4350536Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:50:20.4351599Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 8s local 2024-12-18T00:50:20.4352805Z Compiling llvm/lib/DebugInfo/PDB/Native/NativeSession.cpp; 4s local ... 2024-12-18T00:50:20.6353526Z 2024-12-18T00:50:20.6354481Z  2024-12-18T00:50:20.6355106Z  2024-12-18T00:50:20.6355547Z  2024-12-18T00:50:20.6355962Z  2024-12-18T00:50:20.6356364Z  2024-12-18T00:50:20.6356738Z  2024-12-18T00:50:20.6357136Z  2024-12-18T00:50:20.6357534Z  2024-12-18T00:50:20.6358515Z [15,641 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:20.6359661Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:50:20.6360773Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:20.6362002Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2024-12-18T00:50:20.6363370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2024-12-18T00:50:20.6364460Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:20.6365483Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2024-12-18T00:50:20.6366839Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 8s local 2024-12-18T00:50:20.6368298Z Compiling llvm/lib/DebugInfo/PDB/Native/NativeSession.cpp; 5s local ... 2024-12-18T00:50:20.8471064Z 2024-12-18T00:50:20.8472333Z  2024-12-18T00:50:20.8472837Z  2024-12-18T00:50:20.8473262Z  2024-12-18T00:50:20.8473692Z  2024-12-18T00:50:20.8474115Z  2024-12-18T00:50:20.8474471Z  2024-12-18T00:50:20.8474852Z  2024-12-18T00:50:20.8475234Z  2024-12-18T00:50:20.8476146Z [15,668 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:20.8477356Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:50:20.8478521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:20.8479675Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:50:20.8480834Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:20.8481735Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:20.8482982Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 8s local 2024-12-18T00:50:20.8484012Z Compiling llvm/lib/SandboxIR/Region.cpp; 4s local 2024-12-18T00:50:20.8485003Z Compiling llvm/lib/SandboxIR/Tracker.cpp; 4s local ... 2024-12-18T00:50:21.0487103Z 2024-12-18T00:50:21.0488065Z  2024-12-18T00:50:21.0488513Z  2024-12-18T00:50:21.0488881Z  2024-12-18T00:50:21.0489234Z  2024-12-18T00:50:21.0489592Z  2024-12-18T00:50:21.0489948Z  2024-12-18T00:50:21.0490278Z  2024-12-18T00:50:21.0491041Z  2024-12-18T00:50:21.0491957Z [15,697 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:21.0493141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:50:21.0494291Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:21.0495358Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:50:21.0496649Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:21.0497579Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:21.0498512Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 8s local 2024-12-18T00:50:21.0499507Z Compiling llvm/lib/SandboxIR/Region.cpp; 4s local 2024-12-18T00:50:21.0500320Z Compiling llvm/lib/SandboxIR/Tracker.cpp; 4s local ... 2024-12-18T00:50:21.2520934Z 2024-12-18T00:50:21.2521845Z  2024-12-18T00:50:21.2522415Z  2024-12-18T00:50:21.2522852Z  2024-12-18T00:50:21.2523263Z  2024-12-18T00:50:21.2523642Z  2024-12-18T00:50:21.2524023Z  2024-12-18T00:50:21.2524404Z  2024-12-18T00:50:21.2524817Z  2024-12-18T00:50:21.2525800Z [15,723 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:21.2527049Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:50:21.2528203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:21.2529321Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:50:21.2530347Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:21.2531233Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:21.2532096Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 8s local 2024-12-18T00:50:21.2533082Z Compiling llvm/lib/SandboxIR/Region.cpp; 5s local 2024-12-18T00:50:21.2533813Z Compiling llvm/lib/SandboxIR/Tracker.cpp; 4s local ... 2024-12-18T00:50:21.4629504Z 2024-12-18T00:50:21.4630465Z  2024-12-18T00:50:21.4630963Z  2024-12-18T00:50:21.4631367Z  2024-12-18T00:50:21.4631771Z  2024-12-18T00:50:21.4632172Z  2024-12-18T00:50:21.4632524Z  2024-12-18T00:50:21.4632911Z  2024-12-18T00:50:21.4633317Z  2024-12-18T00:50:21.4634314Z [15,747 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:21.4635509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:50:21.4636648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:21.4637768Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2024-12-18T00:50:21.4638869Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:21.4639835Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:21.4640742Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 9s local 2024-12-18T00:50:21.4641712Z Compiling llvm/lib/SandboxIR/Region.cpp; 5s local 2024-12-18T00:50:21.4642519Z Compiling llvm/lib/SandboxIR/Tracker.cpp; 5s local ... 2024-12-18T00:50:21.6645122Z 2024-12-18T00:50:21.6646243Z  2024-12-18T00:50:21.6646702Z  2024-12-18T00:50:21.6647482Z  2024-12-18T00:50:21.6653050Z  2024-12-18T00:50:21.6653616Z  2024-12-18T00:50:21.6654097Z  2024-12-18T00:50:21.6654578Z  2024-12-18T00:50:21.6655080Z  2024-12-18T00:50:21.6656361Z [15,764 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:21.6657965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:50:21.6659235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:21.6660751Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:50:21.6662003Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2024-12-18T00:50:21.6663067Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:21.6664077Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 9s local 2024-12-18T00:50:21.6665198Z Compiling llvm/lib/SandboxIR/Tracker.cpp; 5s local 2024-12-18T00:50:21.6666103Z @llvm-project//llvm:InstCombine; 5s local ... 2024-12-18T00:50:21.8662420Z 2024-12-18T00:50:21.8663407Z  2024-12-18T00:50:21.8663916Z  2024-12-18T00:50:21.8666005Z  2024-12-18T00:50:21.8666891Z  2024-12-18T00:50:21.8667548Z  2024-12-18T00:50:21.8668151Z  2024-12-18T00:50:21.8668755Z  2024-12-18T00:50:21.8669370Z  2024-12-18T00:50:21.8670514Z [15,780 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:21.8672001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:50:21.8673456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:21.8675049Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:50:21.8676539Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:21.8677669Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:21.8678873Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 9s local 2024-12-18T00:50:21.8680056Z Compiling llvm/lib/SandboxIR/Tracker.cpp; 5s local 2024-12-18T00:50:21.8681095Z @llvm-project//llvm:InstCombine; 5s local ... 2024-12-18T00:50:22.0975632Z 2024-12-18T00:50:22.0977076Z  2024-12-18T00:50:22.0977903Z  2024-12-18T00:50:22.0979031Z  2024-12-18T00:50:22.0979522Z  2024-12-18T00:50:22.0979950Z  2024-12-18T00:50:22.0990596Z  2024-12-18T00:50:22.0991043Z  2024-12-18T00:50:22.0991519Z  2024-12-18T00:50:22.0992488Z [15,795 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:22.0993651Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:50:22.0994808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:22.0995875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:50:22.0996975Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:22.0997908Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:22.0998835Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 9s local 2024-12-18T00:50:22.1000023Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 5s local 2024-12-18T00:50:22.1001023Z Compiling llvm/lib/SandboxIR/Context.cpp; 5s local ... 2024-12-18T00:50:22.3113833Z 2024-12-18T00:50:22.3114872Z  2024-12-18T00:50:22.3115355Z  2024-12-18T00:50:22.3115998Z  2024-12-18T00:50:22.3116372Z  2024-12-18T00:50:22.3116911Z  2024-12-18T00:50:22.3117422Z  2024-12-18T00:50:22.3117927Z  2024-12-18T00:50:22.3118428Z  2024-12-18T00:50:22.3119483Z [15,801 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:22.3121159Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:50:22.3122402Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:22.3123871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:50:22.3125139Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:22.3126164Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:22.3127246Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 10s local 2024-12-18T00:50:22.3128840Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 5s local 2024-12-18T00:50:22.3129943Z Compiling llvm/lib/SandboxIR/Context.cpp; 5s local ... 2024-12-18T00:50:22.5220282Z 2024-12-18T00:50:22.5221262Z  2024-12-18T00:50:22.5221758Z  2024-12-18T00:50:22.5222167Z  2024-12-18T00:50:22.5222570Z  2024-12-18T00:50:22.5222977Z  2024-12-18T00:50:22.5223355Z  2024-12-18T00:50:22.5223756Z  2024-12-18T00:50:22.5224161Z  2024-12-18T00:50:22.5225115Z [15,811 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:22.5226348Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:50:22.5227480Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:22.5228596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2024-12-18T00:50:22.5229804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2024-12-18T00:50:22.5230758Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:22.5231737Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 10s local 2024-12-18T00:50:22.5232984Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2024-12-18T00:50:22.5234027Z Compiling llvm/lib/SandboxIR/Context.cpp; 5s local ... 2024-12-18T00:50:22.7357147Z 2024-12-18T00:50:22.7358163Z  2024-12-18T00:50:22.7358751Z  2024-12-18T00:50:22.7360110Z  2024-12-18T00:50:22.7360545Z  2024-12-18T00:50:22.7361012Z  2024-12-18T00:50:22.7363120Z  2024-12-18T00:50:22.7365547Z  2024-12-18T00:50:22.7366197Z  2024-12-18T00:50:22.7367351Z [15,822 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:22.7368738Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:50:22.7370196Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:22.7371876Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:50:22.7373237Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:22.7374371Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:22.7375515Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 10s local 2024-12-18T00:50:22.7377300Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2024-12-18T00:50:22.7378616Z Compiling llvm/lib/SandboxIR/Context.cpp; 5s local ... 2024-12-18T00:50:22.9417723Z 2024-12-18T00:50:22.9419003Z  2024-12-18T00:50:22.9419674Z  2024-12-18T00:50:22.9420791Z  2024-12-18T00:50:22.9421247Z  2024-12-18T00:50:22.9421672Z  2024-12-18T00:50:22.9422096Z  2024-12-18T00:50:22.9422508Z  2024-12-18T00:50:22.9422956Z  2024-12-18T00:50:22.9423885Z [15,826 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:22.9424996Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:50:22.9426063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:22.9427099Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:50:22.9428485Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:22.9429377Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:22.9430515Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 10s local 2024-12-18T00:50:22.9431557Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2024-12-18T00:50:22.9432450Z Compiling llvm/lib/SandboxIR/Context.cpp; 6s local ... 2024-12-18T00:50:23.2543050Z 2024-12-18T00:50:23.2543917Z  2024-12-18T00:50:23.2544587Z  2024-12-18T00:50:23.2545330Z  2024-12-18T00:50:23.2545688Z  2024-12-18T00:50:23.2546018Z  2024-12-18T00:50:23.2546368Z  2024-12-18T00:50:23.2546700Z  2024-12-18T00:50:23.2547039Z  2024-12-18T00:50:23.2547879Z [15,827 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:23.2548880Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:50:23.2549858Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:23.2550808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:50:23.2551766Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:23.2552562Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:23.2553474Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 10s local 2024-12-18T00:50:23.2554727Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2024-12-18T00:50:23.2555746Z Compiling llvm/lib/SandboxIR/Context.cpp; 6s local ... 2024-12-18T00:50:23.4995218Z 2024-12-18T00:50:23.4996195Z  2024-12-18T00:50:23.4996673Z  2024-12-18T00:50:23.4997092Z  2024-12-18T00:50:23.4997481Z  2024-12-18T00:50:23.4997840Z  2024-12-18T00:50:23.4998236Z  2024-12-18T00:50:23.4998601Z  2024-12-18T00:50:23.4998949Z  2024-12-18T00:50:23.4999803Z [15,829 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:23.5000900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:50:23.5001927Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:23.5002930Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2024-12-18T00:50:23.5003926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2024-12-18T00:50:23.5004751Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:23.5005615Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2024-12-18T00:50:23.5006693Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 7s local 2024-12-18T00:50:23.5007654Z Compiling llvm/lib/SandboxIR/Context.cpp; 6s local ... 2024-12-18T00:50:23.8548661Z 2024-12-18T00:50:23.8549923Z  2024-12-18T00:50:23.8550443Z  2024-12-18T00:50:23.8550826Z  2024-12-18T00:50:23.8551228Z  2024-12-18T00:50:23.8551705Z  2024-12-18T00:50:23.8552121Z  2024-12-18T00:50:23.8552510Z  2024-12-18T00:50:23.8552945Z  2024-12-18T00:50:23.8553864Z [15,833 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:23.8555158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:50:23.8556338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:23.8557568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:50:23.8558682Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:23.8559646Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:50:23.8560584Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2024-12-18T00:50:23.8561790Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 7s local 2024-12-18T00:50:23.8563217Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local ... 2024-12-18T00:50:24.0553479Z 2024-12-18T00:50:24.0554388Z  2024-12-18T00:50:24.0555140Z  2024-12-18T00:50:24.0555581Z  2024-12-18T00:50:24.0555993Z  2024-12-18T00:50:24.0556400Z  2024-12-18T00:50:24.0556787Z  2024-12-18T00:50:24.0557192Z  2024-12-18T00:50:24.0557586Z  2024-12-18T00:50:24.0558739Z [15,834 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:24.0560010Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:50:24.0561128Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:24.0562285Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:50:24.0563457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:24.0564339Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:50:24.0565278Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2024-12-18T00:50:24.0567101Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 7s local 2024-12-18T00:50:24.0568149Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local ... 2024-12-18T00:50:24.2752911Z 2024-12-18T00:50:24.2753895Z  2024-12-18T00:50:24.2754400Z  2024-12-18T00:50:24.2754783Z  2024-12-18T00:50:24.2755174Z  2024-12-18T00:50:24.2755596Z  2024-12-18T00:50:24.2756618Z  2024-12-18T00:50:24.2757530Z  2024-12-18T00:50:24.2760769Z  2024-12-18T00:50:24.2764501Z [15,838 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:24.2768279Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:50:24.2771977Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:24.2776011Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:50:24.2778952Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:24.2780352Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2024-12-18T00:50:24.2781796Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 7s local 2024-12-18T00:50:24.2783195Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local 2024-12-18T00:50:24.2784605Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 7s local ... 2024-12-18T00:50:24.4852693Z 2024-12-18T00:50:24.4853913Z  2024-12-18T00:50:24.4854678Z  2024-12-18T00:50:24.4855882Z  2024-12-18T00:50:24.4856675Z  2024-12-18T00:50:24.4857091Z  2024-12-18T00:50:24.4857485Z  2024-12-18T00:50:24.4857903Z  2024-12-18T00:50:24.4858319Z  2024-12-18T00:50:24.4859257Z [15,841 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:24.4860513Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:50:24.4861625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:24.4862812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2024-12-18T00:50:24.4864040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2024-12-18T00:50:24.4865305Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 12s local 2024-12-18T00:50:24.4866611Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 8s local 2024-12-18T00:50:24.4867623Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local 2024-12-18T00:50:24.4868492Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 7s local ... 2024-12-18T00:50:24.7549651Z 2024-12-18T00:50:24.7550835Z  2024-12-18T00:50:24.7551533Z  2024-12-18T00:50:24.7553380Z  2024-12-18T00:50:24.7555105Z  2024-12-18T00:50:24.7555614Z  2024-12-18T00:50:24.7556943Z  2024-12-18T00:50:24.7558306Z  2024-12-18T00:50:24.7558796Z  2024-12-18T00:50:24.7561032Z [15,844 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:24.7563259Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:50:24.7564520Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:50:24.7566813Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:50:24.7569067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:24.7570342Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 12s local 2024-12-18T00:50:24.7572616Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 8s local 2024-12-18T00:50:24.7573783Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local 2024-12-18T00:50:24.7575061Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 7s local ... 2024-12-18T00:50:24.9811808Z 2024-12-18T00:50:24.9813012Z  2024-12-18T00:50:24.9813790Z  2024-12-18T00:50:24.9816256Z  2024-12-18T00:50:24.9818367Z  2024-12-18T00:50:24.9819072Z  2024-12-18T00:50:24.9820898Z  2024-12-18T00:50:24.9821558Z  2024-12-18T00:50:24.9823331Z  2024-12-18T00:50:24.9824526Z [15,845 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:24.9827191Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:50:24.9829789Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:50:24.9831104Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:50:24.9833841Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:24.9835157Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 12s local 2024-12-18T00:50:24.9837887Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 8s local 2024-12-18T00:50:24.9839050Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local 2024-12-18T00:50:24.9841443Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 7s local ... 2024-12-18T00:50:25.2565151Z 2024-12-18T00:50:25.2565983Z  2024-12-18T00:50:25.2566472Z  2024-12-18T00:50:25.2566883Z  2024-12-18T00:50:25.2567284Z  2024-12-18T00:50:25.2567654Z  2024-12-18T00:50:25.2568098Z  2024-12-18T00:50:25.2568495Z  2024-12-18T00:50:25.2568882Z  2024-12-18T00:50:25.2569806Z [15,845 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:25.2570870Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:50:25.2571918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:50:25.2572957Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2024-12-18T00:50:25.2573984Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:25.2575044Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 12s local 2024-12-18T00:50:25.2576165Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 8s local 2024-12-18T00:50:25.2577363Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local 2024-12-18T00:50:25.2578190Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 8s local ... 2024-12-18T00:50:25.6570748Z 2024-12-18T00:50:25.6571563Z  2024-12-18T00:50:25.6571990Z  2024-12-18T00:50:25.6572344Z  2024-12-18T00:50:25.6572717Z  2024-12-18T00:50:25.6573072Z  2024-12-18T00:50:25.6573444Z  2024-12-18T00:50:25.6573816Z  2024-12-18T00:50:25.6574190Z  2024-12-18T00:50:25.6575088Z [15,846 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:25.6576606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:50:25.6577800Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:50:25.6578822Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:50:25.6579847Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2024-12-18T00:50:25.6580982Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2024-12-18T00:50:25.6583101Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:25.6584125Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local 2024-12-18T00:50:25.6584955Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 8s local ... 2024-12-18T00:50:25.8575138Z 2024-12-18T00:50:25.8575983Z  2024-12-18T00:50:25.8576598Z  2024-12-18T00:50:25.8577003Z  2024-12-18T00:50:25.8577430Z  2024-12-18T00:50:25.8577818Z  2024-12-18T00:50:25.8578237Z  2024-12-18T00:50:25.8578623Z  2024-12-18T00:50:25.8579013Z  2024-12-18T00:50:25.8579975Z [15,847 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:25.8581041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:50:25.8582045Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:50:25.8583148Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:50:25.8584169Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:25.8585244Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2024-12-18T00:50:25.8586494Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:25.8587455Z Compiling llvm/lib/SandboxIR/Context.cpp; 9s local 2024-12-18T00:50:25.8588287Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 8s local ... 2024-12-18T00:50:26.1450800Z 2024-12-18T00:50:26.1451685Z  2024-12-18T00:50:26.1452151Z  2024-12-18T00:50:26.1452508Z  2024-12-18T00:50:26.1452941Z  2024-12-18T00:50:26.1453345Z  2024-12-18T00:50:26.1453787Z  2024-12-18T00:50:26.1454172Z  2024-12-18T00:50:26.1454569Z  2024-12-18T00:50:26.1455479Z [15,852 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:26.1456877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:50:26.1458102Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:50:26.1459271Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:50:26.1460431Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:26.1461672Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2024-12-18T00:50:26.1462970Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:26.1464112Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 8s local 2024-12-18T00:50:26.1464974Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local ... 2024-12-18T00:50:26.3571987Z 2024-12-18T00:50:26.3573013Z  2024-12-18T00:50:26.3573445Z  2024-12-18T00:50:26.3573814Z  2024-12-18T00:50:26.3574174Z  2024-12-18T00:50:26.3574719Z  2024-12-18T00:50:26.3575101Z  2024-12-18T00:50:26.3575479Z  2024-12-18T00:50:26.3575957Z  2024-12-18T00:50:26.3577023Z [15,854 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:26.3578231Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:50:26.3579376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:50:26.3580763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2024-12-18T00:50:26.3582490Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:26.3583829Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 14s local 2024-12-18T00:50:26.3585095Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:26.3586165Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2024-12-18T00:50:26.3587026Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local ... 2024-12-18T00:50:26.6582358Z 2024-12-18T00:50:26.6583277Z  2024-12-18T00:50:26.6583766Z  2024-12-18T00:50:26.6584201Z  2024-12-18T00:50:26.6584569Z  2024-12-18T00:50:26.6584955Z  2024-12-18T00:50:26.6585327Z  2024-12-18T00:50:26.6585711Z  2024-12-18T00:50:26.6586084Z  2024-12-18T00:50:26.6587020Z [15,854 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:26.6588215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:50:26.6589345Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:26.6590495Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:50:26.6591541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2024-12-18T00:50:26.6592627Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 14s local 2024-12-18T00:50:26.6593839Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:50:26.6594894Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2024-12-18T00:50:26.6595678Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local ... 2024-12-18T00:50:26.8668863Z 2024-12-18T00:50:26.8669706Z  2024-12-18T00:50:26.8670189Z  2024-12-18T00:50:26.8670568Z  2024-12-18T00:50:26.8670943Z  2024-12-18T00:50:26.8671358Z  2024-12-18T00:50:26.8671770Z  2024-12-18T00:50:26.8672197Z  2024-12-18T00:50:26.8672559Z  2024-12-18T00:50:26.8673504Z [15,858 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:26.8674577Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:50:26.8675662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:26.8676747Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:50:26.8677979Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:26.8679144Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 14s local 2024-12-18T00:50:26.8680372Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:50:26.8681408Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2024-12-18T00:50:26.8682252Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local ... 2024-12-18T00:50:27.0700084Z 2024-12-18T00:50:27.0700969Z  2024-12-18T00:50:27.0701446Z  2024-12-18T00:50:27.0701831Z  2024-12-18T00:50:27.0702215Z  2024-12-18T00:50:27.0702628Z  2024-12-18T00:50:27.0703009Z  2024-12-18T00:50:27.0703381Z  2024-12-18T00:50:27.0703766Z  2024-12-18T00:50:27.0704687Z [15,859 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:27.0705824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:50:27.0706934Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:27.0707992Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:50:27.0709238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:27.0710170Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 14s local 2024-12-18T00:50:27.0711731Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:50:27.0712746Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2024-12-18T00:50:27.0713672Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:27.3781886Z 2024-12-18T00:50:27.3782766Z  2024-12-18T00:50:27.3783223Z  2024-12-18T00:50:27.3783630Z  2024-12-18T00:50:27.3784038Z  2024-12-18T00:50:27.3784450Z  2024-12-18T00:50:27.3784859Z  2024-12-18T00:50:27.3785247Z  2024-12-18T00:50:27.3786064Z  2024-12-18T00:50:27.3787009Z [15,862 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:27.3788280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:50:27.3789361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:27.3790435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2024-12-18T00:50:27.3791541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:27.3792690Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2024-12-18T00:50:27.3793884Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:50:27.3794928Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 10s local 2024-12-18T00:50:27.3795705Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:27.6591900Z 2024-12-18T00:50:27.6592714Z  2024-12-18T00:50:27.6593236Z  2024-12-18T00:50:27.6593648Z  2024-12-18T00:50:27.6594042Z  2024-12-18T00:50:27.6594412Z  2024-12-18T00:50:27.6594794Z  2024-12-18T00:50:27.6595186Z  2024-12-18T00:50:27.6595601Z  2024-12-18T00:50:27.6596542Z [15,864 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:27.6597664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:50:27.6598800Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:27.6599906Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:50:27.6601024Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2024-12-18T00:50:27.6602204Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2024-12-18T00:50:27.6603427Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:50:27.6604478Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:27.6605147Z Compiling xla/stream_executor/dnn.cc; 6s local ... 2024-12-18T00:50:27.8596006Z 2024-12-18T00:50:27.8596869Z  2024-12-18T00:50:27.8597364Z  2024-12-18T00:50:27.8597748Z  2024-12-18T00:50:27.8598128Z  2024-12-18T00:50:27.8598502Z  2024-12-18T00:50:27.8598897Z  2024-12-18T00:50:27.8599305Z  2024-12-18T00:50:27.8599698Z  2024-12-18T00:50:27.8600640Z [15,866 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:27.8601818Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:50:27.8602861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:27.8603941Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:50:27.8605035Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:50:27.8606203Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2024-12-18T00:50:27.8607401Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:50:27.8608349Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:27.8609078Z Compiling xla/stream_executor/dnn.cc; 7s local ... 2024-12-18T00:50:28.1261073Z 2024-12-18T00:50:28.1262449Z  2024-12-18T00:50:28.1263232Z  2024-12-18T00:50:28.1264477Z  2024-12-18T00:50:28.1264990Z  2024-12-18T00:50:28.1265398Z  2024-12-18T00:50:28.1265802Z  2024-12-18T00:50:28.1266449Z  2024-12-18T00:50:28.1266866Z  2024-12-18T00:50:28.1267797Z [15,869 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:28.1269068Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:50:28.1270452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:28.1271612Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:50:28.1272713Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:50:28.1274001Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2024-12-18T00:50:28.1275245Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:50:28.1276250Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:28.1276943Z Compiling xla/stream_executor/dnn.cc; 7s local ... 2024-12-18T00:50:28.3505968Z 2024-12-18T00:50:28.3506858Z  2024-12-18T00:50:28.3507370Z  2024-12-18T00:50:28.3507770Z  2024-12-18T00:50:28.3508216Z  2024-12-18T00:50:28.3508613Z  2024-12-18T00:50:28.3509010Z  2024-12-18T00:50:28.3509395Z  2024-12-18T00:50:28.3509796Z  2024-12-18T00:50:28.3510765Z [15,882 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:28.3512014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:50:28.3513143Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:28.3514220Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:50:28.3515333Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:50:28.3516542Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 16s local 2024-12-18T00:50:28.3517820Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:50:28.3518815Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:28.3519514Z Compiling xla/stream_executor/dnn.cc; 7s local ... 2024-12-18T00:50:28.6080049Z 2024-12-18T00:50:28.6080926Z  2024-12-18T00:50:28.6081402Z  2024-12-18T00:50:28.6081778Z  2024-12-18T00:50:28.6082888Z  2024-12-18T00:50:28.6083292Z  2024-12-18T00:50:28.6083682Z  2024-12-18T00:50:28.6084014Z  2024-12-18T00:50:28.6084337Z  2024-12-18T00:50:28.6085287Z [15,890 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:28.6086488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:50:28.6087780Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:28.6088877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2024-12-18T00:50:28.6089996Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2024-12-18T00:50:28.6090884Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:28.6091656Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:50:28.6092713Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 7s local 2024-12-18T00:50:28.6093766Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local ... 2024-12-18T00:50:28.8601829Z 2024-12-18T00:50:28.8602793Z  2024-12-18T00:50:28.8603361Z  2024-12-18T00:50:28.8603763Z  2024-12-18T00:50:28.8604232Z  2024-12-18T00:50:28.8604675Z  2024-12-18T00:50:28.8605131Z  2024-12-18T00:50:28.8605606Z  2024-12-18T00:50:28.8606049Z  2024-12-18T00:50:28.8607001Z [15,891 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:28.8608492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:50:28.8609784Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:50:28.8610885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:50:28.8611989Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:28.8612923Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:28.8615798Z Compiling xla/stream_executor/dnn.cc; 8s local 2024-12-18T00:50:28.8616907Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 7s local 2024-12-18T00:50:28.8617925Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local ... 2024-12-18T00:50:29.0759616Z 2024-12-18T00:50:29.0760533Z  2024-12-18T00:50:29.0760964Z  2024-12-18T00:50:29.0761451Z  2024-12-18T00:50:29.0761819Z  2024-12-18T00:50:29.0762193Z  2024-12-18T00:50:29.0762671Z  2024-12-18T00:50:29.0763123Z  2024-12-18T00:50:29.0763558Z  2024-12-18T00:50:29.0764504Z [15,892 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:29.0765793Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:50:29.0766880Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:50:29.0767954Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:50:29.0769035Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:29.0769906Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:29.0770602Z Compiling xla/stream_executor/dnn.cc; 8s local 2024-12-18T00:50:29.0771518Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 8s local 2024-12-18T00:50:29.0772469Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local ... 2024-12-18T00:50:29.3518899Z 2024-12-18T00:50:29.3519762Z  2024-12-18T00:50:29.3520210Z  2024-12-18T00:50:29.3520596Z  2024-12-18T00:50:29.3520973Z  2024-12-18T00:50:29.3521396Z  2024-12-18T00:50:29.3521786Z  2024-12-18T00:50:29.3522155Z  2024-12-18T00:50:29.3522534Z  2024-12-18T00:50:29.3523444Z [15,896 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:29.3524655Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:50:29.3525781Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:50:29.3527360Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:50:29.3528686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:29.3529746Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:29.3530753Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 8s local 2024-12-18T00:50:29.3531819Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local 2024-12-18T00:50:29.3532805Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local ... 2024-12-18T00:50:29.6099180Z 2024-12-18T00:50:29.6100162Z  2024-12-18T00:50:29.6100682Z  2024-12-18T00:50:29.6101060Z  2024-12-18T00:50:29.6101446Z  2024-12-18T00:50:29.6101805Z  2024-12-18T00:50:29.6102171Z  2024-12-18T00:50:29.6102533Z  2024-12-18T00:50:29.6102906Z  2024-12-18T00:50:29.6103873Z [15,898 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:29.6105018Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:50:29.6106101Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:50:29.6107190Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2024-12-18T00:50:29.6108447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2024-12-18T00:50:29.6109289Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:29.6110334Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 8s local 2024-12-18T00:50:29.6111405Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2024-12-18T00:50:29.6112233Z Compiling xla/stream_executor/dnn.cc; 6s local ... 2024-12-18T00:50:29.8612101Z 2024-12-18T00:50:29.8613003Z  2024-12-18T00:50:29.8613517Z  2024-12-18T00:50:29.8614327Z  2024-12-18T00:50:29.8614750Z  2024-12-18T00:50:29.8615159Z  2024-12-18T00:50:29.8615553Z  2024-12-18T00:50:29.8615954Z  2024-12-18T00:50:29.8616507Z  2024-12-18T00:50:29.8617472Z [15,900 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:29.8618711Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:50:29.8619867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:50:29.8620998Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:50:29.8622168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:29.8623115Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:29.8624084Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 8s local 2024-12-18T00:50:29.8625155Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2024-12-18T00:50:29.8626021Z Compiling xla/stream_executor/dnn.cc; 7s local ... 2024-12-18T00:50:30.0836209Z 2024-12-18T00:50:30.0837236Z  2024-12-18T00:50:30.0837766Z  2024-12-18T00:50:30.0838191Z  2024-12-18T00:50:30.0838638Z  2024-12-18T00:50:30.0839054Z  2024-12-18T00:50:30.0839437Z  2024-12-18T00:50:30.0839819Z  2024-12-18T00:50:30.0840260Z  2024-12-18T00:50:30.0841250Z [15,902 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:30.0842363Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:50:30.0843483Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:50:30.0844877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:50:30.0845972Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:30.0846873Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:30.0847788Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 9s local 2024-12-18T00:50:30.0848854Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2024-12-18T00:50:30.0849735Z Compiling xla/stream_executor/dnn.cc; 7s local ... 2024-12-18T00:50:30.3930593Z 2024-12-18T00:50:30.3931479Z  2024-12-18T00:50:30.3931959Z  2024-12-18T00:50:30.3932402Z  2024-12-18T00:50:30.3932808Z  2024-12-18T00:50:30.3933212Z  2024-12-18T00:50:30.3933607Z  2024-12-18T00:50:30.3934010Z  2024-12-18T00:50:30.3934402Z  2024-12-18T00:50:30.3935350Z [15,908 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:30.3936671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:50:30.3937809Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:50:30.3938931Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2024-12-18T00:50:30.3940036Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:30.3940957Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:30.3941910Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 9s local 2024-12-18T00:50:30.3942890Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:50:30.3943890Z Compiling xla/pjrt/transpose.cc; 6s local ... 2024-12-18T00:50:30.6494159Z 2024-12-18T00:50:30.6495004Z  2024-12-18T00:50:30.6495482Z  2024-12-18T00:50:30.6495898Z  2024-12-18T00:50:30.6496735Z  2024-12-18T00:50:30.6497148Z  2024-12-18T00:50:30.6497561Z  2024-12-18T00:50:30.6497971Z  2024-12-18T00:50:30.6498374Z  2024-12-18T00:50:30.6499324Z [15,913 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:30.6500626Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:50:30.6501859Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:50:30.6502981Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:50:30.6504085Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2024-12-18T00:50:30.6505019Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:30.6505962Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 9s local 2024-12-18T00:50:30.6506930Z Compiling xla/stream_executor/dnn.cc; 7s local 2024-12-18T00:50:30.6507688Z Compiling xla/pjrt/transpose.cc; 6s local ... 2024-12-18T00:50:30.8622646Z 2024-12-18T00:50:30.8623587Z  2024-12-18T00:50:30.8624218Z  2024-12-18T00:50:30.8624620Z  2024-12-18T00:50:30.8625033Z  2024-12-18T00:50:30.8625537Z  2024-12-18T00:50:30.8626012Z  2024-12-18T00:50:30.8626395Z  2024-12-18T00:50:30.8626839Z  2024-12-18T00:50:30.8627872Z [15,913 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:30.8629157Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:50:30.8630326Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:50:30.8631521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:50:30.8632745Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:30.8633698Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:30.8634669Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 9s local 2024-12-18T00:50:30.8635758Z Compiling xla/stream_executor/dnn.cc; 8s local 2024-12-18T00:50:30.8636536Z Compiling xla/pjrt/transpose.cc; 6s local ... 2024-12-18T00:50:31.3685385Z 2024-12-18T00:50:31.3686248Z  2024-12-18T00:50:31.3686744Z  2024-12-18T00:50:31.3687197Z  2024-12-18T00:50:31.3687598Z  2024-12-18T00:50:31.3687985Z  2024-12-18T00:50:31.3688384Z  2024-12-18T00:50:31.3688782Z  2024-12-18T00:50:31.3689159Z  2024-12-18T00:50:31.3690061Z [15,914 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:31.3691233Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:50:31.3692394Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:50:31.3693549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2024-12-18T00:50:31.3694650Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:31.3695445Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:31.3696340Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 10s local 2024-12-18T00:50:31.3697472Z Compiling xla/pjrt/transpose.cc; 7s local 2024-12-18T00:50:31.3698174Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:31.6635158Z 2024-12-18T00:50:31.6636023Z  2024-12-18T00:50:31.6636527Z  2024-12-18T00:50:31.6636949Z  2024-12-18T00:50:31.6637377Z  2024-12-18T00:50:31.6637815Z  2024-12-18T00:50:31.6638249Z  2024-12-18T00:50:31.6638679Z  2024-12-18T00:50:31.6639078Z  2024-12-18T00:50:31.6640418Z [15,915 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:31.6641683Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:50:31.6643047Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:31.6644556Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:50:31.6645769Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2024-12-18T00:50:31.6646793Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:31.6647771Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 10s local 2024-12-18T00:50:31.6648670Z Compiling xla/pjrt/transpose.cc; 7s local 2024-12-18T00:50:31.6649349Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:31.9215583Z 2024-12-18T00:50:31.9216643Z  2024-12-18T00:50:31.9217172Z  2024-12-18T00:50:31.9217597Z  2024-12-18T00:50:31.9218061Z  2024-12-18T00:50:31.9218473Z  2024-12-18T00:50:31.9218890Z  2024-12-18T00:50:31.9219287Z  2024-12-18T00:50:31.9219687Z  2024-12-18T00:50:31.9220666Z [15,918 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:31.9221895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:50:31.9223037Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:31.9224147Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:50:31.9225270Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:31.9226177Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:31.9227072Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2024-12-18T00:50:31.9228067Z Compiling xla/pjrt/transpose.cc; 7s local 2024-12-18T00:50:31.9228790Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:32.2168373Z 2024-12-18T00:50:32.2169155Z  2024-12-18T00:50:32.2169583Z  2024-12-18T00:50:32.2169954Z  2024-12-18T00:50:32.2170308Z  2024-12-18T00:50:32.2170709Z  2024-12-18T00:50:32.2171069Z  2024-12-18T00:50:32.2171437Z  2024-12-18T00:50:32.2171784Z  2024-12-18T00:50:32.2172773Z [15,923 / 20,603] 4 / 17 tests; 48 actions, 46 running; last test: ...til_test 2024-12-18T00:50:32.2173868Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:50:32.2174901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:32.2175926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:50:32.2177080Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:32.2177907Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:32.2178792Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2024-12-18T00:50:32.2179670Z Compiling xla/pjrt/transpose.cc; 8s local 2024-12-18T00:50:32.2180329Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:32.4645157Z 2024-12-18T00:50:32.4646056Z  2024-12-18T00:50:32.4646481Z  2024-12-18T00:50:32.4646887Z  2024-12-18T00:50:32.4647285Z  2024-12-18T00:50:32.4647689Z  2024-12-18T00:50:32.4648037Z  2024-12-18T00:50:32.4648418Z  2024-12-18T00:50:32.4648798Z  2024-12-18T00:50:32.4649796Z [15,925 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:32.4651003Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:50:32.4652173Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:32.4653264Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2024-12-18T00:50:32.4654680Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2024-12-18T00:50:32.4655528Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:32.4656942Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2024-12-18T00:50:32.4657899Z Compiling xla/pjrt/transpose.cc; 8s local 2024-12-18T00:50:32.4658601Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:32.7553066Z 2024-12-18T00:50:32.7553945Z  2024-12-18T00:50:32.7554435Z  2024-12-18T00:50:32.7554831Z  2024-12-18T00:50:32.7555595Z  2024-12-18T00:50:32.7555966Z  2024-12-18T00:50:32.7556357Z  2024-12-18T00:50:32.7556737Z  2024-12-18T00:50:32.7557270Z  2024-12-18T00:50:32.7558246Z [15,928 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:32.7559336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:50:32.7560438Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:32.7561563Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:50:32.7562594Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:32.7563453Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:32.7564360Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2024-12-18T00:50:32.7565306Z Compiling xla/pjrt/transpose.cc; 8s local 2024-12-18T00:50:32.7566028Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:32.9770481Z 2024-12-18T00:50:32.9771402Z  2024-12-18T00:50:32.9771841Z  2024-12-18T00:50:32.9772192Z  2024-12-18T00:50:32.9772520Z  2024-12-18T00:50:32.9772873Z  2024-12-18T00:50:32.9773224Z  2024-12-18T00:50:32.9773574Z  2024-12-18T00:50:32.9773904Z  2024-12-18T00:50:32.9774723Z [15,930 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:32.9775687Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:50:32.9776757Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:32.9777648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:50:32.9778533Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:32.9779260Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:32.9780043Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:50:32.9780816Z Compiling xla/pjrt/transpose.cc; 8s local 2024-12-18T00:50:32.9781389Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:33.2660225Z 2024-12-18T00:50:33.2661108Z  2024-12-18T00:50:33.2661594Z  2024-12-18T00:50:33.2662000Z  2024-12-18T00:50:33.2662417Z  2024-12-18T00:50:33.2662798Z  2024-12-18T00:50:33.2663188Z  2024-12-18T00:50:33.2663592Z  2024-12-18T00:50:33.2663985Z  2024-12-18T00:50:33.2664936Z [15,930 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:33.2666088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:50:33.2667219Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:33.2668352Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:50:33.2669471Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:33.2670382Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:33.2671273Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:50:33.2672225Z Compiling xla/pjrt/transpose.cc; 9s local 2024-12-18T00:50:33.2672925Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:33.5911033Z 2024-12-18T00:50:33.5911916Z  2024-12-18T00:50:33.5912405Z  2024-12-18T00:50:33.5912815Z  2024-12-18T00:50:33.5913181Z  2024-12-18T00:50:33.5913570Z  2024-12-18T00:50:33.5914258Z  2024-12-18T00:50:33.5914664Z  2024-12-18T00:50:33.5915017Z  2024-12-18T00:50:33.5915919Z [15,932 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:33.5917137Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:50:33.5918521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:33.5919580Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2024-12-18T00:50:33.5920729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2024-12-18T00:50:33.5921636Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:33.5922559Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:50:33.5923499Z Compiling xla/pjrt/transpose.cc; 9s local 2024-12-18T00:50:33.5924196Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:33.8660047Z 2024-12-18T00:50:33.8660962Z  2024-12-18T00:50:33.8661470Z  2024-12-18T00:50:33.8661893Z  2024-12-18T00:50:33.8671764Z  2024-12-18T00:50:33.8672537Z  2024-12-18T00:50:33.8672936Z  2024-12-18T00:50:33.8673340Z  2024-12-18T00:50:33.8673734Z  2024-12-18T00:50:33.8674712Z [15,933 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:33.8675936Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:50:33.8677113Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:33.8678215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:50:33.8679352Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:33.8680340Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:33.8681239Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:50:33.8682221Z Compiling xla/pjrt/transpose.cc; 9s local 2024-12-18T00:50:33.8682866Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:34.0664432Z 2024-12-18T00:50:34.0665294Z  2024-12-18T00:50:34.0665755Z  2024-12-18T00:50:34.0666128Z  2024-12-18T00:50:34.0666496Z  2024-12-18T00:50:34.0666890Z  2024-12-18T00:50:34.0667261Z  2024-12-18T00:50:34.0667631Z  2024-12-18T00:50:34.0667994Z  2024-12-18T00:50:34.0668842Z [15,934 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:50:34.0669892Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:50:34.0670920Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:34.0671904Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:50:34.0672937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:34.0673748Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:34.0674591Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:50:34.0675443Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:34.0676070Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:34.2997130Z 2024-12-18T00:50:34.2998095Z  2024-12-18T00:50:34.2998597Z  2024-12-18T00:50:34.2999011Z  2024-12-18T00:50:34.2999398Z  2024-12-18T00:50:34.2999792Z  2024-12-18T00:50:34.3000173Z  2024-12-18T00:50:34.3000595Z  2024-12-18T00:50:34.3000997Z  2024-12-18T00:50:34.3002017Z [15,937 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:34.3003568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:50:34.3004870Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:34.3005929Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:50:34.3007021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:34.3007904Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:34.3008990Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:50:34.3010074Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:34.3010766Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:50:34.5502316Z 2024-12-18T00:50:34.5503155Z  2024-12-18T00:50:34.5503674Z  2024-12-18T00:50:34.5504096Z  2024-12-18T00:50:34.5504511Z  2024-12-18T00:50:34.5504894Z  2024-12-18T00:50:34.5505317Z  2024-12-18T00:50:34.5505727Z  2024-12-18T00:50:34.5506141Z  2024-12-18T00:50:34.5507134Z [15,940 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:34.5508377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:50:34.5509505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:34.5510615Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2024-12-18T00:50:34.5511712Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2024-12-18T00:50:34.5512811Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:50:34.5513783Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:34.5514459Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:34.5515142Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:34.8671670Z 2024-12-18T00:50:34.8672634Z  2024-12-18T00:50:34.8673134Z  2024-12-18T00:50:34.8673531Z  2024-12-18T00:50:34.8673932Z  2024-12-18T00:50:34.8674334Z  2024-12-18T00:50:34.8674744Z  2024-12-18T00:50:34.8675130Z  2024-12-18T00:50:34.8675525Z  2024-12-18T00:50:34.8676481Z [15,942 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:34.8677678Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:50:34.8678836Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:50:34.8679956Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:50:34.8681026Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:34.8682194Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:50:34.8683190Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:34.8683890Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:34.8684548Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:35.0675510Z 2024-12-18T00:50:35.0676383Z  2024-12-18T00:50:35.0676881Z  2024-12-18T00:50:35.0677280Z  2024-12-18T00:50:35.0677677Z  2024-12-18T00:50:35.0678049Z  2024-12-18T00:50:35.0678423Z  2024-12-18T00:50:35.0678813Z  2024-12-18T00:50:35.0679195Z  2024-12-18T00:50:35.0680126Z [15,943 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:35.0681302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:50:35.0682372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:50:35.0683484Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:50:35.0684588Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:35.0686123Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:50:35.0687112Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:35.0687982Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:35.0688702Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:50:35.3800996Z 2024-12-18T00:50:35.3801840Z  2024-12-18T00:50:35.3802286Z  2024-12-18T00:50:35.3802651Z  2024-12-18T00:50:35.3803040Z  2024-12-18T00:50:35.3803447Z  2024-12-18T00:50:35.3804199Z  2024-12-18T00:50:35.3804589Z  2024-12-18T00:50:35.3804936Z  2024-12-18T00:50:35.3805802Z [15,946 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:35.3806892Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:50:35.3808079Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:50:35.3809014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2024-12-18T00:50:35.3809969Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:35.3810978Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:50:35.3811833Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:35.3812517Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2024-12-18T00:50:35.3813191Z @llvm-project//llvm:InstCombine; 6s local ... 2024-12-18T00:50:35.6681563Z 2024-12-18T00:50:35.6682481Z  2024-12-18T00:50:35.6682890Z  2024-12-18T00:50:35.6683233Z  2024-12-18T00:50:35.6683591Z  2024-12-18T00:50:35.6683941Z  2024-12-18T00:50:35.6684267Z  2024-12-18T00:50:35.6684607Z  2024-12-18T00:50:35.6684952Z  2024-12-18T00:50:35.6685947Z [15,946 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:35.6687273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:50:35.6688506Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:35.6689730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:50:35.6691092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2024-12-18T00:50:35.6692379Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:50:35.6693267Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:35.6693954Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2024-12-18T00:50:35.6694663Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:35.8685263Z 2024-12-18T00:50:35.8686139Z  2024-12-18T00:50:35.8686613Z  2024-12-18T00:50:35.8687056Z  2024-12-18T00:50:35.8687576Z  2024-12-18T00:50:35.8687959Z  2024-12-18T00:50:35.8688332Z  2024-12-18T00:50:35.8688747Z  2024-12-18T00:50:35.8689127Z  2024-12-18T00:50:35.8690052Z [15,950 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:35.8691225Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:50:35.8692282Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:35.8693372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:50:35.8694458Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:35.8695582Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:50:35.8696815Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:35.8697553Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2024-12-18T00:50:35.8698332Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:36.1017348Z 2024-12-18T00:50:36.1018483Z  2024-12-18T00:50:36.1018935Z  2024-12-18T00:50:36.1019331Z  2024-12-18T00:50:36.1019701Z  2024-12-18T00:50:36.1020072Z  2024-12-18T00:50:36.1020446Z  2024-12-18T00:50:36.1021005Z  2024-12-18T00:50:36.1021400Z  2024-12-18T00:50:36.1022261Z [15,951 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:36.1023337Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:50:36.1024504Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:36.1025685Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:50:36.1026677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:36.1027745Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:50:36.1028587Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:50:36.1029316Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 10s local 2024-12-18T00:50:36.1030029Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:36.3140977Z 2024-12-18T00:50:36.3141820Z  2024-12-18T00:50:36.3142321Z  2024-12-18T00:50:36.3142738Z  2024-12-18T00:50:36.3143152Z  2024-12-18T00:50:36.3143561Z  2024-12-18T00:50:36.3143958Z  2024-12-18T00:50:36.3144606Z  2024-12-18T00:50:36.3145003Z  2024-12-18T00:50:36.3145965Z [15,953 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:36.3147068Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:50:36.3148172Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:36.3149213Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:50:36.3150243Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:36.3151380Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:50:36.3152294Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:50:36.3153072Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 10s local 2024-12-18T00:50:36.3153845Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:36.5246919Z 2024-12-18T00:50:36.5247830Z  2024-12-18T00:50:36.5248294Z  2024-12-18T00:50:36.5248680Z  2024-12-18T00:50:36.5249057Z  2024-12-18T00:50:36.5249418Z  2024-12-18T00:50:36.5249860Z  2024-12-18T00:50:36.5250250Z  2024-12-18T00:50:36.5250635Z  2024-12-18T00:50:36.5251612Z [15,955 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:36.5252722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:50:36.5253911Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:36.5255056Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2024-12-18T00:50:36.5256110Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2024-12-18T00:50:36.5257423Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:50:36.5258454Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:50:36.5259137Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:36.5259837Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:36.8691359Z 2024-12-18T00:50:36.8692327Z  2024-12-18T00:50:36.8692838Z  2024-12-18T00:50:36.8693317Z  2024-12-18T00:50:36.8693710Z  2024-12-18T00:50:36.8694056Z  2024-12-18T00:50:36.8694413Z  2024-12-18T00:50:36.8694783Z  2024-12-18T00:50:36.8695135Z  2024-12-18T00:50:36.8696004Z [15,957 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:36.8697571Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:50:36.8698627Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:50:36.8699958Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:50:36.8701500Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:36.8702643Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:50:36.8703962Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:50:36.8704834Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:36.8705646Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:37.2274947Z 2024-12-18T00:50:37.2275806Z  2024-12-18T00:50:37.2276251Z  2024-12-18T00:50:37.2276636Z  2024-12-18T00:50:37.2276996Z  2024-12-18T00:50:37.2277361Z  2024-12-18T00:50:37.2277706Z  2024-12-18T00:50:37.2278120Z  2024-12-18T00:50:37.2278482Z  2024-12-18T00:50:37.2279325Z [15,962 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:37.2280697Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:50:37.2281786Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:50:37.2282911Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:50:37.2284603Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:37.2285777Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:50:37.2286757Z Compiling xla/pjrt/transpose.cc; 13s local 2024-12-18T00:50:37.2287476Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:37.2288187Z Compiling xla/shape_util.cc; 8s local ... 2024-12-18T00:50:37.4284206Z 2024-12-18T00:50:37.4285078Z  2024-12-18T00:50:37.4285494Z  2024-12-18T00:50:37.4285895Z  2024-12-18T00:50:37.4286292Z  2024-12-18T00:50:37.4286668Z  2024-12-18T00:50:37.4287064Z  2024-12-18T00:50:37.4287454Z  2024-12-18T00:50:37.4287819Z  2024-12-18T00:50:37.4288712Z [15,964 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:37.4289732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:50:37.4291060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:50:37.4292636Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2024-12-18T00:50:37.4293992Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:37.4295276Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:50:37.4296317Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:37.4297160Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:50:37.4298077Z Compiling llvm/lib/Analysis/CGSCCPassManager.cpp; 7s local ... 2024-12-18T00:50:37.6699112Z 2024-12-18T00:50:37.6700031Z  2024-12-18T00:50:37.6700558Z  2024-12-18T00:50:37.6700963Z  2024-12-18T00:50:37.6701384Z  2024-12-18T00:50:37.6701767Z  2024-12-18T00:50:37.6702188Z  2024-12-18T00:50:37.6702577Z  2024-12-18T00:50:37.6702992Z  2024-12-18T00:50:37.6703982Z [15,964 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:37.6705240Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:50:37.6706408Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:37.6707685Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:50:37.6709254Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2024-12-18T00:50:37.6710885Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:50:37.6711967Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:37.6712864Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:50:37.6713786Z Compiling llvm/lib/Analysis/CGSCCPassManager.cpp; 7s local ... 2024-12-18T00:50:37.8703081Z 2024-12-18T00:50:37.8703987Z  2024-12-18T00:50:37.8704482Z  2024-12-18T00:50:37.8704895Z  2024-12-18T00:50:37.8705304Z  2024-12-18T00:50:37.8705690Z  2024-12-18T00:50:37.8706489Z  2024-12-18T00:50:37.8707016Z  2024-12-18T00:50:37.8707391Z  2024-12-18T00:50:37.8708288Z [15,966 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:37.8709420Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:50:37.8710674Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:37.8711826Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:50:37.8712839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:50:37.8714082Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:50:37.8715058Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:37.8716208Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:50:37.8717179Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 7s local ... 2024-12-18T00:50:38.1739769Z 2024-12-18T00:50:38.1740825Z  2024-12-18T00:50:38.1741294Z  2024-12-18T00:50:38.1741691Z  2024-12-18T00:50:38.1743712Z  2024-12-18T00:50:38.1746999Z  2024-12-18T00:50:38.1750057Z  2024-12-18T00:50:38.1753042Z  2024-12-18T00:50:38.1756215Z  2024-12-18T00:50:38.1759778Z [15,968 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:38.1763781Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:50:38.1767341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:38.1770636Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:50:38.1771959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:50:38.1773276Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2024-12-18T00:50:38.1774359Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:38.1775205Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:50:38.1776119Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 7s local ... 2024-12-18T00:50:38.4713000Z 2024-12-18T00:50:38.4713907Z  2024-12-18T00:50:38.4714409Z  2024-12-18T00:50:38.4714811Z  2024-12-18T00:50:38.4715255Z  2024-12-18T00:50:38.4715652Z  2024-12-18T00:50:38.4716040Z  2024-12-18T00:50:38.4716486Z  2024-12-18T00:50:38.4717005Z  2024-12-18T00:50:38.4718032Z [15,970 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:38.4719259Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:50:38.4720436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:38.4721569Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2024-12-18T00:50:38.4722688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:50:38.4723861Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2024-12-18T00:50:38.4724827Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:38.4725488Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:50:38.4726280Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 7s local ... 2024-12-18T00:50:38.6717267Z 2024-12-18T00:50:38.6718477Z  2024-12-18T00:50:38.6718996Z  2024-12-18T00:50:38.6719481Z  2024-12-18T00:50:38.6720073Z  2024-12-18T00:50:38.6720541Z  2024-12-18T00:50:38.6720978Z  2024-12-18T00:50:38.6721455Z  2024-12-18T00:50:38.6722108Z  2024-12-18T00:50:38.6723199Z [15,972 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:38.6724527Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:50:38.6725926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:38.6729473Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:50:38.6730567Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2024-12-18T00:50:38.6731450Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:38.6732064Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:50:38.6732898Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 8s local 2024-12-18T00:50:38.6733885Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 8s local ... 2024-12-18T00:50:38.8735003Z 2024-12-18T00:50:38.8735863Z  2024-12-18T00:50:38.8736573Z  2024-12-18T00:50:38.8736981Z  2024-12-18T00:50:38.8737382Z  2024-12-18T00:50:38.8737771Z  2024-12-18T00:50:38.8738169Z  2024-12-18T00:50:38.8738547Z  2024-12-18T00:50:38.8738937Z  2024-12-18T00:50:38.8739878Z [15,975 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:38.8741059Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:50:38.8742197Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:38.8743282Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:50:38.8744547Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:50:38.8745449Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:38.8746080Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:50:38.8746776Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 8s local 2024-12-18T00:50:38.8747730Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 8s local ... 2024-12-18T00:50:39.2722746Z 2024-12-18T00:50:39.2723670Z  2024-12-18T00:50:39.2724266Z  2024-12-18T00:50:39.2724668Z  2024-12-18T00:50:39.2725054Z  2024-12-18T00:50:39.2725430Z  2024-12-18T00:50:39.2725876Z  2024-12-18T00:50:39.2726250Z  2024-12-18T00:50:39.2726645Z  2024-12-18T00:50:39.2727592Z [15,977 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:39.2728744Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:50:39.2729831Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:39.2730923Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:50:39.2732035Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:50:39.2732952Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:39.2733583Z Compiling xla/shape_util.cc; 10s local 2024-12-18T00:50:39.2734298Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 8s local 2024-12-18T00:50:39.2735277Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 8s local ... 2024-12-18T00:50:39.4727248Z 2024-12-18T00:50:39.4728275Z  2024-12-18T00:50:39.4728902Z  2024-12-18T00:50:39.4729430Z  2024-12-18T00:50:39.4729961Z  2024-12-18T00:50:39.4730490Z  2024-12-18T00:50:39.4731006Z  2024-12-18T00:50:39.4731498Z  2024-12-18T00:50:39.4731883Z  2024-12-18T00:50:39.4732831Z [15,980 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:39.4734273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:50:39.4735362Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:39.4737009Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2024-12-18T00:50:39.4738182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2024-12-18T00:50:39.4739091Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:39.4739834Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 8s local 2024-12-18T00:50:39.4741052Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 8s local 2024-12-18T00:50:39.4741959Z @llvm-project//llvm:llvm-tblgen; 7s local ... 2024-12-18T00:50:39.8732999Z 2024-12-18T00:50:39.8733924Z  2024-12-18T00:50:39.8734547Z  2024-12-18T00:50:39.8735041Z  2024-12-18T00:50:39.8735424Z  2024-12-18T00:50:39.8735868Z  2024-12-18T00:50:39.8736280Z  2024-12-18T00:50:39.8736893Z  2024-12-18T00:50:39.8737290Z  2024-12-18T00:50:39.8738309Z [15,981 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:39.8739552Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:50:39.8740713Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:50:39.8741858Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:50:39.8743020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:39.8743948Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:39.8745935Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 9s local 2024-12-18T00:50:39.8746918Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local 2024-12-18T00:50:39.8747851Z @llvm-project//llvm:llvm-tblgen; 7s local ... 2024-12-18T00:50:40.0737992Z 2024-12-18T00:50:40.0738925Z  2024-12-18T00:50:40.0739421Z  2024-12-18T00:50:40.0739811Z  2024-12-18T00:50:40.0740217Z  2024-12-18T00:50:40.0740599Z  2024-12-18T00:50:40.0740988Z  2024-12-18T00:50:40.0741398Z  2024-12-18T00:50:40.0741832Z  2024-12-18T00:50:40.0742756Z [15,982 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:40.0743956Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:50:40.0745363Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:50:40.0746496Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:50:40.0747629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:40.0748494Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:40.0749247Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 9s local 2024-12-18T00:50:40.0750209Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local 2024-12-18T00:50:40.0751112Z @llvm-project//llvm:llvm-tblgen; 7s local ... 2024-12-18T00:50:40.3227485Z 2024-12-18T00:50:40.3228336Z  2024-12-18T00:50:40.3228863Z  2024-12-18T00:50:40.3229288Z  2024-12-18T00:50:40.3229684Z  2024-12-18T00:50:40.3230096Z  2024-12-18T00:50:40.3230508Z  2024-12-18T00:50:40.3230913Z  2024-12-18T00:50:40.3231313Z  2024-12-18T00:50:40.3232284Z [15,984 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:40.3233499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:50:40.3234635Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:50:40.3235798Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:50:40.3236954Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:40.3238199Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:40.3238992Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 9s local 2024-12-18T00:50:40.3240166Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local 2024-12-18T00:50:40.3241114Z @llvm-project//llvm:llvm-tblgen; 8s local ... 2024-12-18T00:50:40.5987490Z 2024-12-18T00:50:40.5988343Z  2024-12-18T00:50:40.5988787Z  2024-12-18T00:50:40.5989163Z  2024-12-18T00:50:40.5989532Z  2024-12-18T00:50:40.5989901Z  2024-12-18T00:50:40.5990547Z  2024-12-18T00:50:40.5990997Z  2024-12-18T00:50:40.5991364Z  2024-12-18T00:50:40.5992208Z [15,986 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:40.5993232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:50:40.5994263Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:50:40.5995229Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2024-12-18T00:50:40.5996226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2024-12-18T00:50:40.5997084Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:40.5997815Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 10s local 2024-12-18T00:50:40.5998744Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:50:40.5999599Z @llvm-project//llvm:llvm-tblgen; 8s local ... 2024-12-18T00:50:40.8231260Z 2024-12-18T00:50:40.8232215Z  2024-12-18T00:50:40.8232704Z  2024-12-18T00:50:40.8233109Z  2024-12-18T00:50:40.8233484Z  2024-12-18T00:50:40.8233877Z  2024-12-18T00:50:40.8234281Z  2024-12-18T00:50:40.8234676Z  2024-12-18T00:50:40.8235050Z  2024-12-18T00:50:40.8235907Z [15,989 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:40.8237089Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:50:40.8238123Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:50:40.8239405Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:50:40.8240523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:40.8241448Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:40.8242235Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 10s local 2024-12-18T00:50:40.8243274Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:50:40.8244128Z @llvm-project//llvm:llvm-tblgen; 8s local ... 2024-12-18T00:50:41.0747950Z 2024-12-18T00:50:41.0748819Z  2024-12-18T00:50:41.0749360Z  2024-12-18T00:50:41.0749809Z  2024-12-18T00:50:41.0750296Z  2024-12-18T00:50:41.0750777Z  2024-12-18T00:50:41.0751160Z  2024-12-18T00:50:41.0751547Z  2024-12-18T00:50:41.0751866Z  2024-12-18T00:50:41.0752645Z [15,991 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:41.0753608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:50:41.0754503Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:50:41.0755372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:50:41.0756241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:41.0756987Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:41.0757625Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 10s local 2024-12-18T00:50:41.0758408Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:50:41.0759137Z @llvm-project//llvm:llvm-tblgen; 8s local ... 2024-12-18T00:50:41.4752728Z 2024-12-18T00:50:41.4753639Z  2024-12-18T00:50:41.4754457Z  2024-12-18T00:50:41.4754847Z  2024-12-18T00:50:41.4755248Z  2024-12-18T00:50:41.4755656Z  2024-12-18T00:50:41.4756066Z  2024-12-18T00:50:41.4756464Z  2024-12-18T00:50:41.4757021Z  2024-12-18T00:50:41.4757996Z [15,995 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:41.4759138Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:50:41.4760567Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:50:41.4761763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2024-12-18T00:50:41.4762787Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:41.4763681Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:41.4764560Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2024-12-18T00:50:41.4765706Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2024-12-18T00:50:41.4766746Z @llvm-project//llvm:AggressiveInstCombine; 7s local ... 2024-12-18T00:50:41.6863497Z 2024-12-18T00:50:41.6864403Z  2024-12-18T00:50:41.6865018Z  2024-12-18T00:50:41.6865383Z  2024-12-18T00:50:41.6865776Z  2024-12-18T00:50:41.6866153Z  2024-12-18T00:50:41.6866542Z  2024-12-18T00:50:41.6866932Z  2024-12-18T00:50:41.6867312Z  2024-12-18T00:50:41.6868276Z [15,996 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:41.6869416Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:50:41.6870432Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:41.6871499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:50:41.6872558Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2024-12-18T00:50:41.6873412Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:41.6874267Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 11s local 2024-12-18T00:50:41.6875418Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2024-12-18T00:50:41.6876488Z @llvm-project//llvm:AggressiveInstCombine; 7s local ... 2024-12-18T00:50:41.9473750Z 2024-12-18T00:50:41.9474708Z  2024-12-18T00:50:41.9475221Z  2024-12-18T00:50:41.9475627Z  2024-12-18T00:50:41.9476050Z  2024-12-18T00:50:41.9476504Z  2024-12-18T00:50:41.9477042Z  2024-12-18T00:50:41.9477446Z  2024-12-18T00:50:41.9477831Z  2024-12-18T00:50:41.9478765Z [15,997 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:41.9479950Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:50:41.9481086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:41.9482241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:50:41.9483370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:50:41.9484304Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:41.9485266Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2024-12-18T00:50:41.9486302Z @llvm-project//llvm:AggressiveInstCombine; 7s local 2024-12-18T00:50:41.9487073Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:42.1889618Z 2024-12-18T00:50:42.1891572Z  2024-12-18T00:50:42.1892100Z  2024-12-18T00:50:42.1892510Z  2024-12-18T00:50:42.1892918Z  2024-12-18T00:50:42.1893315Z  2024-12-18T00:50:42.1893725Z  2024-12-18T00:50:42.1894115Z  2024-12-18T00:50:42.1894582Z  2024-12-18T00:50:42.1895629Z [16,002 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:42.1897358Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:50:42.1898599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:42.1899881Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:50:42.1901037Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:50:42.1901934Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:42.1903024Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2024-12-18T00:50:42.1904280Z @llvm-project//llvm:AggressiveInstCombine; 7s local 2024-12-18T00:50:42.1905033Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:42.4755431Z 2024-12-18T00:50:42.4757100Z  2024-12-18T00:50:42.4757643Z  2024-12-18T00:50:42.4758077Z  2024-12-18T00:50:42.4758457Z  2024-12-18T00:50:42.4758953Z  2024-12-18T00:50:42.4759361Z  2024-12-18T00:50:42.4759760Z  2024-12-18T00:50:42.4760175Z  2024-12-18T00:50:42.4761104Z [16,003 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:42.4762335Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:50:42.4763485Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:42.4764608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2024-12-18T00:50:42.4765792Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2024-12-18T00:50:42.4766708Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:42.4767655Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2024-12-18T00:50:42.4768639Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:42.4769566Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 7s local ... 2024-12-18T00:50:42.8760231Z 2024-12-18T00:50:42.8761431Z  2024-12-18T00:50:42.8761951Z  2024-12-18T00:50:42.8762343Z  2024-12-18T00:50:42.8762687Z  2024-12-18T00:50:42.8763066Z  2024-12-18T00:50:42.8763439Z  2024-12-18T00:50:42.8763813Z  2024-12-18T00:50:42.8764197Z  2024-12-18T00:50:42.8765104Z [16,004 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:42.8766173Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:50:42.8767260Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:42.8768352Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:50:42.8769363Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:50:42.8770193Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:42.8770790Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:42.8771371Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:42.8772112Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 7s local ... 2024-12-18T00:50:43.0810451Z 2024-12-18T00:50:43.0812010Z  2024-12-18T00:50:43.0812617Z  2024-12-18T00:50:43.0812999Z  2024-12-18T00:50:43.0813358Z  2024-12-18T00:50:43.0813737Z  2024-12-18T00:50:43.0814108Z  2024-12-18T00:50:43.0814488Z  2024-12-18T00:50:43.0814860Z  2024-12-18T00:50:43.0815728Z [16,007 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:43.0817002Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:50:43.0818078Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:43.0819020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:50:43.0820376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:50:43.0821251Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:43.0822086Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:43.0822749Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:43.0823709Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 7s local ... 2024-12-18T00:50:43.2868966Z 2024-12-18T00:50:43.2870293Z  2024-12-18T00:50:43.2870765Z  2024-12-18T00:50:43.2871196Z  2024-12-18T00:50:43.2871882Z  2024-12-18T00:50:43.2872394Z  2024-12-18T00:50:43.2872817Z  2024-12-18T00:50:43.2873220Z  2024-12-18T00:50:43.2873620Z  2024-12-18T00:50:43.2874592Z [16,009 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:43.2875758Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:50:43.2876826Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:43.2878058Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:50:43.2879191Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:50:43.2880117Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:43.2880799Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:43.2881438Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:43.2882334Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2024-12-18T00:50:43.4953478Z 2024-12-18T00:50:43.4954452Z  2024-12-18T00:50:43.4954940Z  2024-12-18T00:50:43.4955629Z  2024-12-18T00:50:43.4956234Z  2024-12-18T00:50:43.4956740Z  2024-12-18T00:50:43.4957262Z  2024-12-18T00:50:43.4957762Z  2024-12-18T00:50:43.4958283Z  2024-12-18T00:50:43.4959320Z [16,011 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:43.4960696Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:50:43.4962000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:43.4963241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2024-12-18T00:50:43.4964538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2024-12-18T00:50:43.4965503Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:43.4966273Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:43.4967065Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:43.4968082Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2024-12-18T00:50:43.7415770Z 2024-12-18T00:50:43.7416926Z  2024-12-18T00:50:43.7417364Z  2024-12-18T00:50:43.7417722Z  2024-12-18T00:50:43.7418148Z  2024-12-18T00:50:43.7418497Z  2024-12-18T00:50:43.7418856Z  2024-12-18T00:50:43.7419196Z  2024-12-18T00:50:43.7419539Z  2024-12-18T00:50:43.7420360Z [16,013 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:43.7421353Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:50:43.7422316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:50:43.7423300Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:50:43.7424320Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:50:43.7425533Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:43.7427256Z @llvm-project//llvm:llvm-tblgen; 10s local 2024-12-18T00:50:43.7427873Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:43.7428729Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2024-12-18T00:50:44.0676314Z 2024-12-18T00:50:44.0677372Z  2024-12-18T00:50:44.0677845Z  2024-12-18T00:50:44.0678222Z  2024-12-18T00:50:44.0678923Z  2024-12-18T00:50:44.0679356Z  2024-12-18T00:50:44.0679877Z  2024-12-18T00:50:44.0680641Z  2024-12-18T00:50:44.0681188Z  2024-12-18T00:50:44.0682246Z [16,014 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:44.0683573Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:50:44.0685046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:50:44.0686417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:50:44.0687569Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:50:44.0688589Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:44.0689384Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:50:44.0690178Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:44.0691238Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2024-12-18T00:50:44.2771904Z 2024-12-18T00:50:44.2773410Z  2024-12-18T00:50:44.2773941Z  2024-12-18T00:50:44.2774353Z  2024-12-18T00:50:44.2774776Z  2024-12-18T00:50:44.2775145Z  2024-12-18T00:50:44.2775549Z  2024-12-18T00:50:44.2775953Z  2024-12-18T00:50:44.2776368Z  2024-12-18T00:50:44.2777533Z [16,014 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:44.2778820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:50:44.2780041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:50:44.2781256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:50:44.2782451Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:50:44.2783459Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:44.2784139Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:50:44.2784828Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:44.2785779Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 9s local ... 2024-12-18T00:50:44.5739618Z 2024-12-18T00:50:44.5740578Z  2024-12-18T00:50:44.5741072Z  2024-12-18T00:50:44.5741450Z  2024-12-18T00:50:44.5742166Z  2024-12-18T00:50:44.5742729Z  2024-12-18T00:50:44.5743300Z  2024-12-18T00:50:44.5743814Z  2024-12-18T00:50:44.5744588Z  2024-12-18T00:50:44.5745680Z [16,015 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:44.5747299Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:50:44.5748632Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:50:44.5749835Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2024-12-18T00:50:44.5751012Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2024-12-18T00:50:44.5752089Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:44.5752913Z @llvm-project//llvm:llvm-tblgen; 11s local 2024-12-18T00:50:44.5753712Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:44.5754538Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:44.8778524Z 2024-12-18T00:50:44.8779759Z  2024-12-18T00:50:44.8780185Z  2024-12-18T00:50:44.8780560Z  2024-12-18T00:50:44.8780893Z  2024-12-18T00:50:44.8781230Z  2024-12-18T00:50:44.8781582Z  2024-12-18T00:50:44.8781933Z  2024-12-18T00:50:44.8782296Z  2024-12-18T00:50:44.8783109Z [16,019 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:44.8784417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:50:44.8785499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:50:44.8786658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:50:44.8787677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:44.8788517Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:44.8789180Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:44.8789892Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:44.8790789Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local ... 2024-12-18T00:50:45.0782489Z 2024-12-18T00:50:45.0783431Z  2024-12-18T00:50:45.0783844Z  2024-12-18T00:50:45.0784189Z  2024-12-18T00:50:45.0784510Z  2024-12-18T00:50:45.0784847Z  2024-12-18T00:50:45.0785177Z  2024-12-18T00:50:45.0785519Z  2024-12-18T00:50:45.0785874Z  2024-12-18T00:50:45.0786708Z [16,020 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:45.0787854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:50:45.0788782Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:50:45.0789696Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:50:45.0790594Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:45.0791345Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:45.0791899Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:45.0792435Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:45.0793136Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local ... 2024-12-18T00:50:45.3545120Z 2024-12-18T00:50:45.3545981Z  2024-12-18T00:50:45.3546460Z  2024-12-18T00:50:45.3546885Z  2024-12-18T00:50:45.3547283Z  2024-12-18T00:50:45.3547666Z  2024-12-18T00:50:45.3548064Z  2024-12-18T00:50:45.3548452Z  2024-12-18T00:50:45.3548839Z  2024-12-18T00:50:45.3550115Z [16,023 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:45.3551456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:50:45.3552735Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:50:45.3554009Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:50:45.3555237Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:45.3556245Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:50:45.3557033Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:45.3557812Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:45.3558757Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 8s local ... 2024-12-18T00:50:45.5713487Z 2024-12-18T00:50:45.5714429Z  2024-12-18T00:50:45.5715035Z  2024-12-18T00:50:45.5715425Z  2024-12-18T00:50:45.5715835Z  2024-12-18T00:50:45.5716226Z  2024-12-18T00:50:45.5716573Z  2024-12-18T00:50:45.5716953Z  2024-12-18T00:50:45.5717436Z  2024-12-18T00:50:45.5718358Z [16,025 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:45.5719509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:50:45.5731093Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:50:45.5732192Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2024-12-18T00:50:45.5733228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2024-12-18T00:50:45.5734096Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:45.5735134Z @llvm-project//llvm:llvm-tblgen; 12s local 2024-12-18T00:50:45.5735966Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 9s local 2024-12-18T00:50:45.5737203Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local ... 2024-12-18T00:50:45.8789395Z 2024-12-18T00:50:45.8790303Z  2024-12-18T00:50:45.8790750Z  2024-12-18T00:50:45.8791137Z  2024-12-18T00:50:45.8791506Z  2024-12-18T00:50:45.8791892Z  2024-12-18T00:50:45.8792271Z  2024-12-18T00:50:45.8792647Z  2024-12-18T00:50:45.8793660Z  2024-12-18T00:50:45.8794602Z [16,026 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:45.8795749Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:50:45.8797017Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:50:45.8798080Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:50:45.8799240Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:45.8800140Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:45.8800841Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:50:45.8802314Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 9s local 2024-12-18T00:50:45.8803374Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local ... 2024-12-18T00:50:46.0794640Z 2024-12-18T00:50:46.0795635Z  2024-12-18T00:50:46.0796158Z  2024-12-18T00:50:46.0796583Z  2024-12-18T00:50:46.0796975Z  2024-12-18T00:50:46.0797361Z  2024-12-18T00:50:46.0797728Z  2024-12-18T00:50:46.0798119Z  2024-12-18T00:50:46.0798501Z  2024-12-18T00:50:46.0799422Z [16,029 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:46.0800504Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:50:46.0801586Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:50:46.0802686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:50:46.0803764Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:46.0804664Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:46.0805349Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:50:46.0806163Z Compiling llvm/lib/Analysis/TargetTransformInfo.cpp; 9s local 2024-12-18T00:50:46.0807136Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local ... 2024-12-18T00:50:46.3325494Z 2024-12-18T00:50:46.3326480Z  2024-12-18T00:50:46.3327613Z  2024-12-18T00:50:46.3328411Z  2024-12-18T00:50:46.3329148Z  2024-12-18T00:50:46.3330093Z  2024-12-18T00:50:46.3330802Z  2024-12-18T00:50:46.3331556Z  2024-12-18T00:50:46.3331998Z  2024-12-18T00:50:46.3333019Z [16,033 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:46.3334164Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:50:46.3335307Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:50:46.3336578Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2024-12-18T00:50:46.3337750Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:46.3338690Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:50:46.3339410Z @llvm-project//llvm:llvm-tblgen; 13s local 2024-12-18T00:50:46.3340139Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:50:46.3340931Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:46.6800256Z 2024-12-18T00:50:46.6801529Z  2024-12-18T00:50:46.6801984Z  2024-12-18T00:50:46.6802398Z  2024-12-18T00:50:46.6803087Z  2024-12-18T00:50:46.6803475Z  2024-12-18T00:50:46.6803844Z  2024-12-18T00:50:46.6804210Z  2024-12-18T00:50:46.6804593Z  2024-12-18T00:50:46.6805728Z [16,037 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:46.6806968Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:50:46.6808124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:50:46.6809392Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:50:46.6810616Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2024-12-18T00:50:46.6811553Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:46.6812353Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:50:46.6813431Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 9s local 2024-12-18T00:50:46.6814430Z Compiling xla/pjrt/transpose.cc; 9s local ... 2024-12-18T00:50:46.9200232Z 2024-12-18T00:50:46.9201463Z  2024-12-18T00:50:46.9201944Z  2024-12-18T00:50:46.9202332Z  2024-12-18T00:50:46.9202720Z  2024-12-18T00:50:46.9203138Z  2024-12-18T00:50:46.9203518Z  2024-12-18T00:50:46.9203911Z  2024-12-18T00:50:46.9204288Z  2024-12-18T00:50:46.9205196Z [16,043 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:46.9206305Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:50:46.9207390Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:50:46.9208436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:50:46.9209494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:46.9210406Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:46.9211222Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 10s local 2024-12-18T00:50:46.9212379Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 9s local 2024-12-18T00:50:46.9213295Z Compiling xla/pjrt/transpose.cc; 9s local ... 2024-12-18T00:50:47.2120804Z 2024-12-18T00:50:47.2121699Z  2024-12-18T00:50:47.2122185Z  2024-12-18T00:50:47.2122547Z  2024-12-18T00:50:47.2122927Z  2024-12-18T00:50:47.2123310Z  2024-12-18T00:50:47.2123694Z  2024-12-18T00:50:47.2124062Z  2024-12-18T00:50:47.2124469Z  2024-12-18T00:50:47.2125448Z [16,046 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:47.2126630Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:50:47.2128202Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:50:47.2129305Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:50:47.2130629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:47.2131627Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:50:47.2132688Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2024-12-18T00:50:47.2133785Z Compiling xla/pjrt/transpose.cc; 9s local 2024-12-18T00:50:47.2134749Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 9s local ... 2024-12-18T00:50:47.4808488Z 2024-12-18T00:50:47.4809581Z  2024-12-18T00:50:47.4810067Z  2024-12-18T00:50:47.4810492Z  2024-12-18T00:50:47.4810882Z  2024-12-18T00:50:47.4811263Z  2024-12-18T00:50:47.4811983Z  2024-12-18T00:50:47.4812862Z  2024-12-18T00:50:47.4814337Z  2024-12-18T00:50:47.4815716Z [16,046 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:47.4817315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:50:47.4819000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:50:47.4820505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2024-12-18T00:50:47.4822112Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:47.4823329Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:47.4824876Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2024-12-18T00:50:47.4826022Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:47.4827015Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 9s local ... 2024-12-18T00:50:47.6811111Z 2024-12-18T00:50:47.6811963Z  2024-12-18T00:50:47.6812391Z  2024-12-18T00:50:47.6812743Z  2024-12-18T00:50:47.6813119Z  2024-12-18T00:50:47.6813457Z  2024-12-18T00:50:47.6813828Z  2024-12-18T00:50:47.6814166Z  2024-12-18T00:50:47.6814526Z  2024-12-18T00:50:47.6815389Z [16,050 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:50:47.6816901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:50:47.6818046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:50:47.6819183Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:50:47.6820263Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2024-12-18T00:50:47.6821228Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:47.6822331Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2024-12-18T00:50:47.6823299Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:47.6824128Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 9s local ... 2024-12-18T00:50:47.8874549Z 2024-12-18T00:50:47.8876418Z  2024-12-18T00:50:47.8877706Z  2024-12-18T00:50:47.8878523Z  2024-12-18T00:50:47.8879229Z  2024-12-18T00:50:47.8880201Z  2024-12-18T00:50:47.8880878Z  2024-12-18T00:50:47.8881531Z  2024-12-18T00:50:47.8881928Z  2024-12-18T00:50:47.8882805Z [16,052 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:47.8883888Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:50:47.8884927Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:50:47.8886001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:50:47.8887059Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:50:47.8887947Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:47.8888871Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2024-12-18T00:50:47.8889810Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:47.8890632Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 9s local ... 2024-12-18T00:50:48.1145348Z 2024-12-18T00:50:48.1146600Z  2024-12-18T00:50:48.1147029Z  2024-12-18T00:50:48.1147411Z  2024-12-18T00:50:48.1147786Z  2024-12-18T00:50:48.1148140Z  2024-12-18T00:50:48.1148498Z  2024-12-18T00:50:48.1148849Z  2024-12-18T00:50:48.1149210Z  2024-12-18T00:50:48.1150049Z [16,054 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:48.1151120Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:50:48.1152095Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:50:48.1153103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:50:48.1154141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:50:48.1154990Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:50:48.1156093Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2024-12-18T00:50:48.1156958Z Compiling xla/pjrt/transpose.cc; 10s local 2024-12-18T00:50:48.1157816Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 10s local ... 2024-12-18T00:50:48.4818745Z 2024-12-18T00:50:48.4820062Z  2024-12-18T00:50:48.4820686Z  2024-12-18T00:50:48.4821156Z  2024-12-18T00:50:48.4821590Z  2024-12-18T00:50:48.4822050Z  2024-12-18T00:50:48.4822469Z  2024-12-18T00:50:48.4823286Z  2024-12-18T00:50:48.4823714Z  2024-12-18T00:50:48.4824779Z [16,056 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:48.4826108Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:50:48.4827416Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:50:48.4828667Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2024-12-18T00:50:48.4829905Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2024-12-18T00:50:48.4830937Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:50:48.4832014Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2024-12-18T00:50:48.4833095Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:48.4834047Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 10s local ... 2024-12-18T00:50:48.8725177Z 2024-12-18T00:50:48.8726496Z  2024-12-18T00:50:48.8727010Z  2024-12-18T00:50:48.8727402Z  2024-12-18T00:50:48.8727784Z  2024-12-18T00:50:48.8728143Z  2024-12-18T00:50:48.8728530Z  2024-12-18T00:50:48.8728894Z  2024-12-18T00:50:48.8729295Z  2024-12-18T00:50:48.8730213Z [16,057 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:48.8731343Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:50:48.8732441Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:50:48.8733550Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:50:48.8734641Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:48.8735520Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:50:48.8736592Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2024-12-18T00:50:48.8737578Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:48.8738385Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 10s local ... 2024-12-18T00:50:49.0826085Z 2024-12-18T00:50:49.0827046Z  2024-12-18T00:50:49.0827539Z  2024-12-18T00:50:49.0827917Z  2024-12-18T00:50:49.0828306Z  2024-12-18T00:50:49.0828669Z  2024-12-18T00:50:49.0829051Z  2024-12-18T00:50:49.0829475Z  2024-12-18T00:50:49.0829857Z  2024-12-18T00:50:49.0830762Z [16,058 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:49.0831918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:50:49.0833011Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:50:49.0834102Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:50:49.0835190Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:49.0836077Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:50:49.0836986Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2024-12-18T00:50:49.0837941Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:49.0838861Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local ... 2024-12-18T00:50:49.3180617Z 2024-12-18T00:50:49.3181792Z  2024-12-18T00:50:49.3182237Z  2024-12-18T00:50:49.3182671Z  2024-12-18T00:50:49.3183169Z  2024-12-18T00:50:49.3183611Z  2024-12-18T00:50:49.3183957Z  2024-12-18T00:50:49.3184522Z  2024-12-18T00:50:49.3184899Z  2024-12-18T00:50:49.3185803Z [16,060 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:49.3186880Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:50:49.3188085Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:50:49.3189217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:50:49.3190168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:49.3191291Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2024-12-18T00:50:49.3192197Z Compiling xla/pjrt/transpose.cc; 11s local 2024-12-18T00:50:49.3193007Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local 2024-12-18T00:50:49.3193823Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:49.5189755Z 2024-12-18T00:50:49.5190621Z  2024-12-18T00:50:49.5191127Z  2024-12-18T00:50:49.5191533Z  2024-12-18T00:50:49.5191938Z  2024-12-18T00:50:49.5192318Z  2024-12-18T00:50:49.5192715Z  2024-12-18T00:50:49.5193116Z  2024-12-18T00:50:49.5193524Z  2024-12-18T00:50:49.5194503Z [16,062 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:49.5195755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:50:49.5196895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:50:49.5198055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2024-12-18T00:50:49.5199216Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2024-12-18T00:50:49.5200446Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2024-12-18T00:50:49.5201405Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:50:49.5202141Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local 2024-12-18T00:50:49.5202933Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:49.8361262Z 2024-12-18T00:50:49.8362138Z  2024-12-18T00:50:49.8362618Z  2024-12-18T00:50:49.8363044Z  2024-12-18T00:50:49.8363458Z  2024-12-18T00:50:49.8363903Z  2024-12-18T00:50:49.8364287Z  2024-12-18T00:50:49.8364666Z  2024-12-18T00:50:49.8365053Z  2024-12-18T00:50:49.8366018Z [16,065 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:49.8367282Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:50:49.8368582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:50:49.8369671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:50:49.8370825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:50:49.8372040Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2024-12-18T00:50:49.8373061Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:50:49.8373888Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local 2024-12-18T00:50:49.8374743Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:50.0836799Z 2024-12-18T00:50:50.0837734Z  2024-12-18T00:50:50.0838240Z  2024-12-18T00:50:50.0838654Z  2024-12-18T00:50:50.0839064Z  2024-12-18T00:50:50.0839471Z  2024-12-18T00:50:50.0839859Z  2024-12-18T00:50:50.0840257Z  2024-12-18T00:50:50.0840643Z  2024-12-18T00:50:50.0841610Z [16,068 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:50.0843215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:50:50.0844676Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:50:50.0845756Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:50:50.0846758Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:50:50.0847878Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2024-12-18T00:50:50.0849049Z Compiling xla/pjrt/transpose.cc; 12s local 2024-12-18T00:50:50.0849825Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 12s local 2024-12-18T00:50:50.0850629Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:50.4161927Z 2024-12-18T00:50:50.4163098Z  2024-12-18T00:50:50.4163999Z  2024-12-18T00:50:50.4165158Z  2024-12-18T00:50:50.4165631Z  2024-12-18T00:50:50.4166063Z  2024-12-18T00:50:50.4166457Z  2024-12-18T00:50:50.4166877Z  2024-12-18T00:50:50.4167293Z  2024-12-18T00:50:50.4168295Z [16,071 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:50.4169485Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:50:50.4170664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:50:50.4171900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2024-12-18T00:50:50.4173147Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:50:50.4174444Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2024-12-18T00:50:50.4175552Z Compiling xla/pjrt/transpose.cc; 13s local 2024-12-18T00:50:50.4176303Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:50.4177471Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 8s local ... 2024-12-18T00:50:50.6686134Z 2024-12-18T00:50:50.6687070Z  2024-12-18T00:50:50.6687560Z  2024-12-18T00:50:50.6687965Z  2024-12-18T00:50:50.6688389Z  2024-12-18T00:50:50.6688810Z  2024-12-18T00:50:50.6689199Z  2024-12-18T00:50:50.6689614Z  2024-12-18T00:50:50.6690005Z  2024-12-18T00:50:50.6690954Z [16,072 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:50.6692172Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:50:50.6693371Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:50:50.6694533Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:50.6695663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2024-12-18T00:50:50.6696912Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2024-12-18T00:50:50.6697842Z Compiling xla/pjrt/transpose.cc; 13s local 2024-12-18T00:50:50.6698518Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:50.6699407Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 8s local ... 2024-12-18T00:50:50.8841015Z 2024-12-18T00:50:50.8841923Z  2024-12-18T00:50:50.8842411Z  2024-12-18T00:50:50.8842829Z  2024-12-18T00:50:50.8843247Z  2024-12-18T00:50:50.8843652Z  2024-12-18T00:50:50.8844061Z  2024-12-18T00:50:50.8844708Z  2024-12-18T00:50:50.8845133Z  2024-12-18T00:50:50.8846157Z [16,076 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:50.8847328Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:50:50.8848520Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:50:50.8849664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:50.8851134Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:50.8852600Z Compiling xla/pjrt/transpose.cc; 13s local 2024-12-18T00:50:50.8853630Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:50.8854682Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 8s local 2024-12-18T00:50:50.8855913Z Compiling llvm/lib/Transforms/Utils/BasicBlockUtils.cpp; 8s local ... 2024-12-18T00:50:51.1431766Z 2024-12-18T00:50:51.1432633Z  2024-12-18T00:50:51.1433104Z  2024-12-18T00:50:51.1433888Z  2024-12-18T00:50:51.1434295Z  2024-12-18T00:50:51.1434667Z  2024-12-18T00:50:51.1435055Z  2024-12-18T00:50:51.1435459Z  2024-12-18T00:50:51.1435857Z  2024-12-18T00:50:51.1436821Z [16,079 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:51.1438044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:50:51.1439236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:50:51.1440391Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:51.1441593Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:51.1442532Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:51.1443416Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:50:51.1444792Z Compiling llvm/lib/Transforms/Utils/BasicBlockUtils.cpp; 9s local 2024-12-18T00:50:51.1445700Z @llvm-project//llvm:InstCombine; 6s local ... 2024-12-18T00:50:51.4849448Z 2024-12-18T00:50:51.4850333Z  2024-12-18T00:50:51.4850850Z  2024-12-18T00:50:51.4851268Z  2024-12-18T00:50:51.4851656Z  2024-12-18T00:50:51.4852045Z  2024-12-18T00:50:51.4852405Z  2024-12-18T00:50:51.4852829Z  2024-12-18T00:50:51.4853223Z  2024-12-18T00:50:51.4854246Z [16,082 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:51.4855452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:50:51.4856741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:50:51.4857788Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2024-12-18T00:50:51.4858934Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:51.4859892Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:51.4860764Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:50:51.4861831Z Compiling llvm/lib/Transforms/Utils/BasicBlockUtils.cpp; 9s local 2024-12-18T00:50:51.4862738Z @llvm-project//llvm:InstCombine; 6s local ... 2024-12-18T00:50:51.6852831Z 2024-12-18T00:50:51.6853716Z  2024-12-18T00:50:51.6854145Z  2024-12-18T00:50:51.6854458Z  2024-12-18T00:50:51.6854819Z  2024-12-18T00:50:51.6855150Z  2024-12-18T00:50:51.6855481Z  2024-12-18T00:50:51.6855811Z  2024-12-18T00:50:51.6856127Z  2024-12-18T00:50:51.6857103Z [16,083 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:51.6858039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:50:51.6858937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:50:51.6859815Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:51.6860664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2024-12-18T00:50:51.6861389Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:51.6862061Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:50:51.6862874Z Compiling llvm/lib/Transforms/Utils/BasicBlockUtils.cpp; 9s local 2024-12-18T00:50:51.6863914Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:51.8952656Z 2024-12-18T00:50:51.8953534Z  2024-12-18T00:50:51.8953999Z  2024-12-18T00:50:51.8954397Z  2024-12-18T00:50:51.8955057Z  2024-12-18T00:50:51.8955478Z  2024-12-18T00:50:51.8955852Z  2024-12-18T00:50:51.8956194Z  2024-12-18T00:50:51.8956583Z  2024-12-18T00:50:51.8957473Z [16,086 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:51.8958740Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:50:51.8959901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:50:51.8960944Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:51.8962084Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:51.8963161Z Compiling llvm/lib/Transforms/Utils/SimplifyIndVar.cpp; 9s local 2024-12-18T00:50:51.8964134Z @llvm-project//llvm:InstCombine; 7s local 2024-12-18T00:50:51.8964959Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local 2024-12-18T00:50:51.8965840Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:52.2863483Z 2024-12-18T00:50:52.2864335Z  2024-12-18T00:50:52.2864798Z  2024-12-18T00:50:52.2865225Z  2024-12-18T00:50:52.2865592Z  2024-12-18T00:50:52.2865974Z  2024-12-18T00:50:52.2866341Z  2024-12-18T00:50:52.2866738Z  2024-12-18T00:50:52.2867179Z  2024-12-18T00:50:52.2868146Z [16,088 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:52.2869296Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:50:52.2870398Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:50:52.2871510Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:52.2872633Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:52.2873543Z @llvm-project//llvm:InstCombine; 7s local 2024-12-18T00:50:52.2874435Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local 2024-12-18T00:50:52.2875236Z @llvm-project//llvm:InstCombine; 7s local 2024-12-18T00:50:52.2875918Z @llvm-project//llvm:InstCombine; 6s local ... 2024-12-18T00:50:52.4866873Z 2024-12-18T00:50:52.4867795Z  2024-12-18T00:50:52.4868266Z  2024-12-18T00:50:52.4868707Z  2024-12-18T00:50:52.4869094Z  2024-12-18T00:50:52.4869511Z  2024-12-18T00:50:52.4869913Z  2024-12-18T00:50:52.4870280Z  2024-12-18T00:50:52.4870690Z  2024-12-18T00:50:52.4871625Z [16,090 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:52.4872881Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:50:52.4873991Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:50:52.4875092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2024-12-18T00:50:52.4876237Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:52.4877187Z @llvm-project//llvm:InstCombine; 7s local 2024-12-18T00:50:52.4878026Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local 2024-12-18T00:50:52.4878847Z @llvm-project//llvm:InstCombine; 7s local 2024-12-18T00:50:52.4879548Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:52.7028183Z 2024-12-18T00:50:52.7029091Z  2024-12-18T00:50:52.7029576Z  2024-12-18T00:50:52.7029989Z  2024-12-18T00:50:52.7030381Z  2024-12-18T00:50:52.7030783Z  2024-12-18T00:50:52.7031174Z  2024-12-18T00:50:52.7031553Z  2024-12-18T00:50:52.7031934Z  2024-12-18T00:50:52.7032881Z [16,094 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:52.7034391Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:50:52.7035670Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:50:52.7036828Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:52.7037984Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2024-12-18T00:50:52.7038874Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:52.7039759Z @llvm-project//llvm:InstCombine; 7s local 2024-12-18T00:50:52.7040639Z Compiling llvm/lib/Transforms/InstCombine/InstCombineShifts.cpp; 7s local 2024-12-18T00:50:52.7041710Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 6s local ... 2024-12-18T00:50:52.9366278Z 2024-12-18T00:50:52.9367132Z  2024-12-18T00:50:52.9367616Z  2024-12-18T00:50:52.9368028Z  2024-12-18T00:50:52.9368438Z  2024-12-18T00:50:52.9368820Z  2024-12-18T00:50:52.9369217Z  2024-12-18T00:50:52.9369611Z  2024-12-18T00:50:52.9370005Z  2024-12-18T00:50:52.9370974Z [16,097 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:52.9372174Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:50:52.9373381Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:50:52.9374574Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:52.9375751Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:50:52.9376897Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:52.9377583Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:52.9378574Z Compiling llvm/lib/Transforms/InstCombine/InstCombineShifts.cpp; 7s local 2024-12-18T00:50:52.9379737Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 6s local ... 2024-12-18T00:50:53.2872892Z 2024-12-18T00:50:53.2873793Z  2024-12-18T00:50:53.2874265Z  2024-12-18T00:50:53.2874648Z  2024-12-18T00:50:53.2875020Z  2024-12-18T00:50:53.2875411Z  2024-12-18T00:50:53.2875789Z  2024-12-18T00:50:53.2876193Z  2024-12-18T00:50:53.2876701Z  2024-12-18T00:50:53.2877597Z [16,100 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:53.2878751Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:50:53.2879820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:50:53.2880929Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2024-12-18T00:50:53.2882028Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:50:53.2882926Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:53.2883593Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:53.2884532Z Compiling llvm/lib/Transforms/InstCombine/InstCombineShifts.cpp; 7s local 2024-12-18T00:50:53.2885645Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 7s local ... 2024-12-18T00:50:53.7017016Z 2024-12-18T00:50:53.7017874Z  2024-12-18T00:50:53.7018325Z  2024-12-18T00:50:53.7018679Z  2024-12-18T00:50:53.7019038Z  2024-12-18T00:50:53.7019409Z  2024-12-18T00:50:53.7019775Z  2024-12-18T00:50:53.7020176Z  2024-12-18T00:50:53.7020552Z  2024-12-18T00:50:53.7021498Z [16,101 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:53.7022588Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:50:53.7023654Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:50:53.7024767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:50:53.7026141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2024-12-18T00:50:53.7027006Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:53.7027840Z @llvm-project//llvm:InstCombine; 8s local 2024-12-18T00:50:53.7028644Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 7s local 2024-12-18T00:50:53.7029485Z @llvm-project//llvm:InstCombine; 6s local ... 2024-12-18T00:50:54.0880264Z 2024-12-18T00:50:54.0881142Z  2024-12-18T00:50:54.0881588Z  2024-12-18T00:50:54.0881971Z  2024-12-18T00:50:54.0882792Z  2024-12-18T00:50:54.0883170Z  2024-12-18T00:50:54.0883537Z  2024-12-18T00:50:54.0883908Z  2024-12-18T00:50:54.0884263Z  2024-12-18T00:50:54.0885065Z [16,102 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:54.0886141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:50:54.0887284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:50:54.0888233Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2024-12-18T00:50:54.0889338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:50:54.0890210Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:54.0890789Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:54.0891483Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 7s local 2024-12-18T00:50:54.0892279Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:54.6410422Z 2024-12-18T00:50:54.6411275Z  2024-12-18T00:50:54.6411699Z  2024-12-18T00:50:54.6412066Z  2024-12-18T00:50:54.6412395Z  2024-12-18T00:50:54.6412735Z  2024-12-18T00:50:54.6413091Z  2024-12-18T00:50:54.6413426Z  2024-12-18T00:50:54.6413760Z  2024-12-18T00:50:54.6414552Z [16,103 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:54.6415667Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:50:54.6416853Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:50:54.6417897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:54.6418933Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2024-12-18T00:50:54.6419841Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:54.6420419Z @llvm-project//llvm:InstCombine; 9s local 2024-12-18T00:50:54.6421147Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 8s local 2024-12-18T00:50:54.6421903Z @llvm-project//llvm:InstCombine; 7s local ... 2024-12-18T00:50:54.8887257Z 2024-12-18T00:50:54.8888040Z  2024-12-18T00:50:54.8888441Z  2024-12-18T00:50:54.8888786Z  2024-12-18T00:50:54.8889102Z  2024-12-18T00:50:54.8889441Z  2024-12-18T00:50:54.8889818Z  2024-12-18T00:50:54.8890144Z  2024-12-18T00:50:54.8890452Z  2024-12-18T00:50:54.8891249Z [16,105 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:54.8892199Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:50:54.8893115Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:50:54.8893999Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:54.8894918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:54.8895626Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:54.8896164Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:54.8897008Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 8s local 2024-12-18T00:50:54.8897767Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:55.1037685Z 2024-12-18T00:50:55.1038812Z  2024-12-18T00:50:55.1039210Z  2024-12-18T00:50:55.1039515Z  2024-12-18T00:50:55.1039830Z  2024-12-18T00:50:55.1040143Z  2024-12-18T00:50:55.1040454Z  2024-12-18T00:50:55.1040890Z  2024-12-18T00:50:55.1041216Z  2024-12-18T00:50:55.1042036Z [16,106 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:55.1043092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:50:55.1044450Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:50:55.1045421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:55.1046387Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:55.1047093Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:55.1047686Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:55.1048332Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:50:55.1049066Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:55.3070254Z 2024-12-18T00:50:55.3071066Z  2024-12-18T00:50:55.3071503Z  2024-12-18T00:50:55.3071835Z  2024-12-18T00:50:55.3072177Z  2024-12-18T00:50:55.3072511Z  2024-12-18T00:50:55.3072833Z  2024-12-18T00:50:55.3073178Z  2024-12-18T00:50:55.3073494Z  2024-12-18T00:50:55.3074302Z [16,110 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:55.3075336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:50:55.3076372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:50:55.3077381Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:55.3078367Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:55.3079143Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:55.3079731Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:55.3080471Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:50:55.3081212Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:55.5725516Z 2024-12-18T00:50:55.5726412Z  2024-12-18T00:50:55.5726869Z  2024-12-18T00:50:55.5727241Z  2024-12-18T00:50:55.5727643Z  2024-12-18T00:50:55.5728010Z  2024-12-18T00:50:55.5728411Z  2024-12-18T00:50:55.5728833Z  2024-12-18T00:50:55.5729223Z  2024-12-18T00:50:55.5730143Z [16,111 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:55.5731311Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:50:55.5732292Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:50:55.5733244Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2024-12-18T00:50:55.5734164Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2024-12-18T00:50:55.5734952Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:55.5735502Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:55.5736152Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:50:55.5736961Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:50:55.8288869Z 2024-12-18T00:50:55.8289762Z  2024-12-18T00:50:55.8290284Z  2024-12-18T00:50:55.8290691Z  2024-12-18T00:50:55.8291100Z  2024-12-18T00:50:55.8291516Z  2024-12-18T00:50:55.8291938Z  2024-12-18T00:50:55.8292339Z  2024-12-18T00:50:55.8292740Z  2024-12-18T00:50:55.8293676Z [16,118 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:55.8294932Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:50:55.8296308Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:50:55.8297671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:55.8298789Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:55.8299680Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:55.8300515Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:50:55.8303683Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:55.8304931Z Compiling xla/ffi/call_frame.cc; 6s local ... 2024-12-18T00:50:56.0898525Z 2024-12-18T00:50:56.0899416Z  2024-12-18T00:50:56.0899956Z  2024-12-18T00:50:56.0900368Z  2024-12-18T00:50:56.0900748Z  2024-12-18T00:50:56.0901114Z  2024-12-18T00:50:56.0901479Z  2024-12-18T00:50:56.0901851Z  2024-12-18T00:50:56.0902269Z  2024-12-18T00:50:56.0903207Z [16,119 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:56.0904406Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:50:56.0905511Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:50:56.0906575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:56.0907677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:56.0908577Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:56.0909389Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local 2024-12-18T00:50:56.0910470Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:56.0911444Z Compiling xla/ffi/call_frame.cc; 7s local ... 2024-12-18T00:50:56.2904926Z 2024-12-18T00:50:56.2905872Z  2024-12-18T00:50:56.2906473Z  2024-12-18T00:50:56.2906900Z  2024-12-18T00:50:56.2907291Z  2024-12-18T00:50:56.2907671Z  2024-12-18T00:50:56.2908086Z  2024-12-18T00:50:56.2908523Z  2024-12-18T00:50:56.2908979Z  2024-12-18T00:50:56.2909982Z [16,120 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:56.2911257Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:50:56.2912369Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:50:56.2913548Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:56.2914673Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:56.2915537Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:56.2916447Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:50:56.2917553Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:56.2918585Z Compiling xla/ffi/call_frame.cc; 7s local ... 2024-12-18T00:50:56.5503926Z 2024-12-18T00:50:56.5504799Z  2024-12-18T00:50:56.5505285Z  2024-12-18T00:50:56.5505698Z  2024-12-18T00:50:56.5506203Z  2024-12-18T00:50:56.5506621Z  2024-12-18T00:50:56.5507118Z  2024-12-18T00:50:56.5507547Z  2024-12-18T00:50:56.5507910Z  2024-12-18T00:50:56.5508887Z [16,122 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:56.5510107Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:50:56.5511191Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:50:56.5512399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2024-12-18T00:50:56.5513551Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2024-12-18T00:50:56.5514848Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:50:56.5515717Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:50:56.5516906Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2024-12-18T00:50:56.5517930Z Compiling xla/ffi/call_frame.cc; 7s local ... 2024-12-18T00:50:56.8565835Z 2024-12-18T00:50:56.8566692Z  2024-12-18T00:50:56.8567206Z  2024-12-18T00:50:56.8567563Z  2024-12-18T00:50:56.8567949Z  2024-12-18T00:50:56.8568337Z  2024-12-18T00:50:56.8569112Z  2024-12-18T00:50:56.8569525Z  2024-12-18T00:50:56.8569937Z  2024-12-18T00:50:56.8570877Z [16,124 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:56.8572118Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:50:56.8573223Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:50:56.8574258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:50:56.8575329Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:50:56.8576252Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:56.8577242Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:50:56.8578260Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:50:56.8579250Z Compiling xla/ffi/call_frame.cc; 7s local ... 2024-12-18T00:50:57.0913049Z 2024-12-18T00:50:57.0913961Z  2024-12-18T00:50:57.0914528Z  2024-12-18T00:50:57.0914921Z  2024-12-18T00:50:57.0915306Z  2024-12-18T00:50:57.0915721Z  2024-12-18T00:50:57.0916102Z  2024-12-18T00:50:57.0916484Z  2024-12-18T00:50:57.0916870Z  2024-12-18T00:50:57.0917789Z [16,125 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:57.0919002Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:50:57.0920166Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:50:57.0921308Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:50:57.0922385Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:50:57.0923251Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:57.0924035Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2024-12-18T00:50:57.0925107Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:50:57.0926025Z Compiling xla/ffi/call_frame.cc; 8s local ... 2024-12-18T00:50:57.5205863Z 2024-12-18T00:50:57.5206741Z  2024-12-18T00:50:57.5207225Z  2024-12-18T00:50:57.5207634Z  2024-12-18T00:50:57.5208050Z  2024-12-18T00:50:57.5208520Z  2024-12-18T00:50:57.5208924Z  2024-12-18T00:50:57.5209245Z  2024-12-18T00:50:57.5209587Z  2024-12-18T00:50:57.5210571Z [16,126 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:57.5211724Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:50:57.5212856Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:50:57.5213891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2024-12-18T00:50:57.5215083Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2024-12-18T00:50:57.5215941Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:50:57.5216862Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:50:57.5217938Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2024-12-18T00:50:57.5218858Z Compiling xla/ffi/call_frame.cc; 8s local ... 2024-12-18T00:50:57.8920375Z 2024-12-18T00:50:57.8921298Z  2024-12-18T00:50:57.8921870Z  2024-12-18T00:50:57.8922266Z  2024-12-18T00:50:57.8922658Z  2024-12-18T00:50:57.8923044Z  2024-12-18T00:50:57.8923753Z  2024-12-18T00:50:57.8924173Z  2024-12-18T00:50:57.8924557Z  2024-12-18T00:50:57.8925488Z [16,130 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:57.8926615Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:50:57.8928080Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:50:57.8929287Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:57.8930347Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:50:57.8931312Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:57.8932141Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:50:57.8933204Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:50:57.8934104Z Compiling xla/ffi/call_frame.cc; 9s local ... 2024-12-18T00:50:58.2926793Z 2024-12-18T00:50:58.2927717Z  2024-12-18T00:50:58.2928309Z  2024-12-18T00:50:58.2928802Z  2024-12-18T00:50:58.2929305Z  2024-12-18T00:50:58.2929686Z  2024-12-18T00:50:58.2930132Z  2024-12-18T00:50:58.2930521Z  2024-12-18T00:50:58.2930905Z  2024-12-18T00:50:58.2931842Z [16,131 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:58.2933047Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:50:58.2934203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:50:58.2935330Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:58.2936604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:50:58.2937501Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:58.2948406Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:50:58.2949537Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:50:58.2950500Z Compiling xla/ffi/call_frame.cc; 9s local ... 2024-12-18T00:50:58.6420856Z 2024-12-18T00:50:58.6421678Z  2024-12-18T00:50:58.6422147Z  2024-12-18T00:50:58.6422510Z  2024-12-18T00:50:58.6422926Z  2024-12-18T00:50:58.6423306Z  2024-12-18T00:50:58.6423700Z  2024-12-18T00:50:58.6424096Z  2024-12-18T00:50:58.6424481Z  2024-12-18T00:50:58.6425441Z [16,135 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:58.6426528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:50:58.6427576Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:50:58.6428601Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2024-12-18T00:50:58.6429648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2024-12-18T00:50:58.6430502Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:50:58.6431240Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:50:58.6432254Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2024-12-18T00:50:58.6433187Z Compiling xla/ffi/call_frame.cc; 9s local ... 2024-12-18T00:50:58.8932847Z 2024-12-18T00:50:58.8933766Z  2024-12-18T00:50:58.8934224Z  2024-12-18T00:50:58.8934618Z  2024-12-18T00:50:58.8935001Z  2024-12-18T00:50:58.8935396Z  2024-12-18T00:50:58.8935760Z  2024-12-18T00:50:58.8936120Z  2024-12-18T00:50:58.8936641Z  2024-12-18T00:50:58.8937560Z [16,136 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:58.8939122Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:50:58.8940486Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:50:58.8941625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:50:58.8942616Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:50:58.8943482Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:58.8944869Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:50:58.8946014Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 12s local 2024-12-18T00:50:58.8947174Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:59.0937796Z 2024-12-18T00:50:59.0938676Z  2024-12-18T00:50:59.0939130Z  2024-12-18T00:50:59.0939502Z  2024-12-18T00:50:59.0939864Z  2024-12-18T00:50:59.0940273Z  2024-12-18T00:50:59.0940763Z  2024-12-18T00:50:59.0941167Z  2024-12-18T00:50:59.0941656Z  2024-12-18T00:50:59.0942581Z [16,138 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:59.0943709Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:50:59.0945015Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:50:59.0946055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:50:59.0947241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:50:59.0948240Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:59.0948999Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:50:59.0949989Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 12s local 2024-12-18T00:50:59.0950972Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:50:59.4244633Z 2024-12-18T00:50:59.4245532Z  2024-12-18T00:50:59.4245994Z  2024-12-18T00:50:59.4246376Z  2024-12-18T00:50:59.4246769Z  2024-12-18T00:50:59.4247181Z  2024-12-18T00:50:59.4247573Z  2024-12-18T00:50:59.4247931Z  2024-12-18T00:50:59.4248316Z  2024-12-18T00:50:59.4249220Z [16,143 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:59.4250376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:50:59.4251478Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:50:59.4252574Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2024-12-18T00:50:59.4253682Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:50:59.4254527Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:59.4255362Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:50:59.4256163Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:59.4257066Z Compiling .../coordination/coordination_service.cc; 9s local ... 2024-12-18T00:50:59.6504966Z 2024-12-18T00:50:59.6505840Z  2024-12-18T00:50:59.6506340Z  2024-12-18T00:50:59.6506725Z  2024-12-18T00:50:59.6507122Z  2024-12-18T00:50:59.6507485Z  2024-12-18T00:50:59.6507881Z  2024-12-18T00:50:59.6508254Z  2024-12-18T00:50:59.6508641Z  2024-12-18T00:50:59.6509673Z [16,145 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:50:59.6510815Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:50:59.6511941Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:50:59.6513057Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:50:59.6514388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2024-12-18T00:50:59.6515307Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:50:59.6516290Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:50:59.6517100Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:59.6517908Z Compiling .../coordination/coordination_service.cc; 9s local ... 2024-12-18T00:50:59.8945189Z 2024-12-18T00:50:59.8946041Z  2024-12-18T00:50:59.8946508Z  2024-12-18T00:50:59.8946899Z  2024-12-18T00:50:59.8947675Z  2024-12-18T00:50:59.8948058Z  2024-12-18T00:50:59.8948442Z  2024-12-18T00:50:59.8948837Z  2024-12-18T00:50:59.8949221Z  2024-12-18T00:50:59.8950121Z [16,146 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:50:59.8951286Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:50:59.8952421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:50:59.8953510Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:50:59.8954546Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:50:59.8955367Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:50:59.8956135Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:50:59.8956910Z @llvm-project//llvm:InstCombine; 10s local 2024-12-18T00:50:59.8957718Z Compiling .../coordination/coordination_service.cc; 9s local ... 2024-12-18T00:51:00.2950690Z 2024-12-18T00:51:00.2951791Z  2024-12-18T00:51:00.2952263Z  2024-12-18T00:51:00.2952647Z  2024-12-18T00:51:00.2953031Z  2024-12-18T00:51:00.2953410Z  2024-12-18T00:51:00.2953763Z  2024-12-18T00:51:00.2954143Z  2024-12-18T00:51:00.2954517Z  2024-12-18T00:51:00.2955449Z [16,148 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:00.2956660Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:51:00.2957762Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:51:00.2958914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2024-12-18T00:51:00.2960033Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2024-12-18T00:51:00.2960910Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:51:00.2961714Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:51:00.2962471Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:51:00.2963249Z Compiling .../coordination/coordination_service.cc; 10s local ... 2024-12-18T00:51:00.7980621Z 2024-12-18T00:51:00.7981504Z  2024-12-18T00:51:00.7981981Z  2024-12-18T00:51:00.7982404Z  2024-12-18T00:51:00.7983016Z  2024-12-18T00:51:00.7983384Z  2024-12-18T00:51:00.7983777Z  2024-12-18T00:51:00.7984161Z  2024-12-18T00:51:00.7984542Z  2024-12-18T00:51:00.7985498Z [16,149 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:00.7986629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:51:00.7987743Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:00.7988829Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:51:00.7989947Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:51:00.7990828Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:00.7991603Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:51:00.7992409Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:51:00.7993196Z Compiling .../coordination/coordination_service.cc; 10s local ... 2024-12-18T00:51:01.0492261Z 2024-12-18T00:51:01.0493153Z  2024-12-18T00:51:01.0493631Z  2024-12-18T00:51:01.0494029Z  2024-12-18T00:51:01.0494406Z  2024-12-18T00:51:01.0495040Z  2024-12-18T00:51:01.0495453Z  2024-12-18T00:51:01.0495850Z  2024-12-18T00:51:01.0496236Z  2024-12-18T00:51:01.0497270Z [16,151 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:01.0498604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:51:01.0499815Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:01.0500891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:51:01.0501965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:51:01.0502853Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:01.0503664Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:51:01.0504464Z @llvm-project//llvm:InstCombine; 11s local 2024-12-18T00:51:01.0505272Z Compiling .../coordination/coordination_service.cc; 11s local ... 2024-12-18T00:51:01.2962681Z 2024-12-18T00:51:01.2963542Z  2024-12-18T00:51:01.2964030Z  2024-12-18T00:51:01.2964412Z  2024-12-18T00:51:01.2964790Z  2024-12-18T00:51:01.2965147Z  2024-12-18T00:51:01.2965541Z  2024-12-18T00:51:01.2965919Z  2024-12-18T00:51:01.2966306Z  2024-12-18T00:51:01.2967264Z [16,151 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:01.2968407Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:51:01.2969512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:01.2970567Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:51:01.2971654Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:51:01.2972505Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:01.2973299Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:51:01.2974109Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:51:01.2974917Z Compiling .../coordination/coordination_service.cc; 11s local ... 2024-12-18T00:51:01.4966756Z 2024-12-18T00:51:01.4967645Z  2024-12-18T00:51:01.4968140Z  2024-12-18T00:51:01.4968533Z  2024-12-18T00:51:01.4968973Z  2024-12-18T00:51:01.4969347Z  2024-12-18T00:51:01.4969749Z  2024-12-18T00:51:01.4970122Z  2024-12-18T00:51:01.4970525Z  2024-12-18T00:51:01.4971434Z [16,153 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:01.4972573Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:51:01.4973716Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:01.4974807Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2024-12-18T00:51:01.4975896Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2024-12-18T00:51:01.4976942Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:01.4977732Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:51:01.4978504Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:51:01.4979256Z Compiling .../coordination/coordination_service.cc; 11s local ... 2024-12-18T00:51:01.7121217Z 2024-12-18T00:51:01.7122096Z  2024-12-18T00:51:01.7122551Z  2024-12-18T00:51:01.7122959Z  2024-12-18T00:51:01.7123355Z  2024-12-18T00:51:01.7123744Z  2024-12-18T00:51:01.7124126Z  2024-12-18T00:51:01.7124501Z  2024-12-18T00:51:01.7124884Z  2024-12-18T00:51:01.7125796Z [16,155 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:01.7127250Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:01.7128503Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:01.7129601Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:51:01.7130721Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:51:01.7131636Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:01.7132660Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:51:01.7133462Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:51:01.7134262Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:51:01.9718979Z 2024-12-18T00:51:01.9719809Z  2024-12-18T00:51:01.9720240Z  2024-12-18T00:51:01.9720626Z  2024-12-18T00:51:01.9721009Z  2024-12-18T00:51:01.9721393Z  2024-12-18T00:51:01.9721746Z  2024-12-18T00:51:01.9722106Z  2024-12-18T00:51:01.9722472Z  2024-12-18T00:51:01.9723350Z [16,158 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:01.9724404Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:01.9725394Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:01.9726445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:51:01.9727467Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:51:01.9728301Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:51:01.9729042Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:51:01.9729789Z @llvm-project//llvm:InstCombine; 12s local 2024-12-18T00:51:01.9730399Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:51:02.2973400Z 2024-12-18T00:51:02.2974279Z  2024-12-18T00:51:02.2974771Z  2024-12-18T00:51:02.2975185Z  2024-12-18T00:51:02.2975593Z  2024-12-18T00:51:02.2975996Z  2024-12-18T00:51:02.2976559Z  2024-12-18T00:51:02.2976939Z  2024-12-18T00:51:02.2977302Z  2024-12-18T00:51:02.2978276Z [16,159 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:02.2979488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:02.2980688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:02.2981810Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:51:02.2982947Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:51:02.2983898Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:51:02.2984737Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:51:02.2985610Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:51:02.2986329Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:51:02.4978004Z 2024-12-18T00:51:02.4978870Z  2024-12-18T00:51:02.4979375Z  2024-12-18T00:51:02.4979791Z  2024-12-18T00:51:02.4980198Z  2024-12-18T00:51:02.4980594Z  2024-12-18T00:51:02.4980990Z  2024-12-18T00:51:02.4981382Z  2024-12-18T00:51:02.4981787Z  2024-12-18T00:51:02.4982775Z [16,162 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:02.4984022Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:02.4985183Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:02.4986300Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2024-12-18T00:51:02.4987455Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2024-12-18T00:51:02.4988705Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:51:02.4989529Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:51:02.4990530Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:51:02.4991280Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:51:02.8983733Z 2024-12-18T00:51:02.8984612Z  2024-12-18T00:51:02.8985088Z  2024-12-18T00:51:02.8985510Z  2024-12-18T00:51:02.8985918Z  2024-12-18T00:51:02.8986328Z  2024-12-18T00:51:02.8987054Z  2024-12-18T00:51:02.8987441Z  2024-12-18T00:51:02.8987801Z  2024-12-18T00:51:02.8988681Z [16,164 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:02.8989787Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:51:02.8990941Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:51:02.8991970Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:51:02.8993064Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:51:02.8993979Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:02.8994742Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:51:02.8995547Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:51:02.8996235Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:51:03.1151407Z 2024-12-18T00:51:03.1152334Z  2024-12-18T00:51:03.1152812Z  2024-12-18T00:51:03.1153223Z  2024-12-18T00:51:03.1153625Z  2024-12-18T00:51:03.1154008Z  2024-12-18T00:51:03.1154375Z  2024-12-18T00:51:03.1154760Z  2024-12-18T00:51:03.1155146Z  2024-12-18T00:51:03.1156018Z [16,165 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:03.1157211Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:51:03.1158336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:51:03.1159480Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:51:03.1160661Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:51:03.1161600Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:03.1162438Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:51:03.1163310Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:51:03.1163960Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:51:03.4447997Z 2024-12-18T00:51:03.4448848Z  2024-12-18T00:51:03.4449334Z  2024-12-18T00:51:03.4449737Z  2024-12-18T00:51:03.4450148Z  2024-12-18T00:51:03.4450533Z  2024-12-18T00:51:03.4450920Z  2024-12-18T00:51:03.4451323Z  2024-12-18T00:51:03.4451723Z  2024-12-18T00:51:03.4452652Z [16,167 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:03.4453856Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:51:03.4455066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:51:03.4456188Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2024-12-18T00:51:03.4457435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:51:03.4458388Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:03.4459201Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:51:03.4460052Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:51:03.4460765Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:51:03.6990679Z 2024-12-18T00:51:03.6991586Z  2024-12-18T00:51:03.6992401Z  2024-12-18T00:51:03.6992789Z  2024-12-18T00:51:03.6993180Z  2024-12-18T00:51:03.6993558Z  2024-12-18T00:51:03.6993942Z  2024-12-18T00:51:03.6994353Z  2024-12-18T00:51:03.6994924Z  2024-12-18T00:51:03.6995876Z [16,169 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:03.6997067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:51:03.6998094Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:03.6999523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:51:03.7000662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2024-12-18T00:51:03.7001590Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:03.7002388Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:51:03.7003475Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2024-12-18T00:51:03.7004643Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local ... 2024-12-18T00:51:03.8994450Z 2024-12-18T00:51:03.8995258Z  2024-12-18T00:51:03.8995747Z  2024-12-18T00:51:03.8996127Z  2024-12-18T00:51:03.8996508Z  2024-12-18T00:51:03.8996870Z  2024-12-18T00:51:03.8997242Z  2024-12-18T00:51:03.8997619Z  2024-12-18T00:51:03.8997992Z  2024-12-18T00:51:03.8998885Z [16,170 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:03.8999995Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:51:03.9000974Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:03.9001918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:51:03.9002898Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:51:03.9003698Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:51:03.9004420Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:51:03.9005375Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:51:03.9006384Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local ... 2024-12-18T00:51:04.1653139Z 2024-12-18T00:51:04.1653983Z  2024-12-18T00:51:04.1654396Z  2024-12-18T00:51:04.1654766Z  2024-12-18T00:51:04.1655093Z  2024-12-18T00:51:04.1655461Z  2024-12-18T00:51:04.1655792Z  2024-12-18T00:51:04.1656123Z  2024-12-18T00:51:04.1656596Z  2024-12-18T00:51:04.1657427Z [16,173 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:04.1658399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:51:04.1659361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:04.1660308Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:51:04.1661235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:51:04.1661997Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:51:04.1662661Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:51:04.1663576Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:51:04.1664578Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local ... 2024-12-18T00:51:04.4282323Z 2024-12-18T00:51:04.4283219Z  2024-12-18T00:51:04.4283716Z  2024-12-18T00:51:04.4284120Z  2024-12-18T00:51:04.4284501Z  2024-12-18T00:51:04.4284906Z  2024-12-18T00:51:04.4285303Z  2024-12-18T00:51:04.4285689Z  2024-12-18T00:51:04.4286086Z  2024-12-18T00:51:04.4286992Z [16,175 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:04.4288434Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:51:04.4289667Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:04.4290780Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2024-12-18T00:51:04.4291864Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:51:04.4292908Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:51:04.4293945Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:51:04.4294987Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:51:04.4296074Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local ... 2024-12-18T00:51:04.7001989Z 2024-12-18T00:51:04.7002830Z  2024-12-18T00:51:04.7003237Z  2024-12-18T00:51:04.7003577Z  2024-12-18T00:51:04.7003941Z  2024-12-18T00:51:04.7004282Z  2024-12-18T00:51:04.7004637Z  2024-12-18T00:51:04.7004944Z  2024-12-18T00:51:04.7005301Z  2024-12-18T00:51:04.7006128Z [16,176 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:04.7007148Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:51:04.7008108Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:51:04.7009070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:51:04.7010009Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2024-12-18T00:51:04.7010781Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:51:04.7011466Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:51:04.7012400Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2024-12-18T00:51:04.7013388Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local ... 2024-12-18T00:51:05.1717597Z 2024-12-18T00:51:05.1718497Z  2024-12-18T00:51:05.1719104Z  2024-12-18T00:51:05.1719520Z  2024-12-18T00:51:05.1719929Z  2024-12-18T00:51:05.1720303Z  2024-12-18T00:51:05.1720675Z  2024-12-18T00:51:05.1721074Z  2024-12-18T00:51:05.1721458Z  2024-12-18T00:51:05.1722368Z [16,177 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:05.1723570Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:51:05.1724748Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:51:05.1725883Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:51:05.1727033Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:51:05.1727909Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:51:05.1728707Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:51:05.1729785Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:51:05.1730915Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local ... 2024-12-18T00:51:05.3870842Z 2024-12-18T00:51:05.3871709Z  2024-12-18T00:51:05.3872204Z  2024-12-18T00:51:05.3872609Z  2024-12-18T00:51:05.3873017Z  2024-12-18T00:51:05.3873407Z  2024-12-18T00:51:05.3873778Z  2024-12-18T00:51:05.3874208Z  2024-12-18T00:51:05.3874588Z  2024-12-18T00:51:05.3875521Z [16,181 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:05.3876632Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:51:05.3877744Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:51:05.3878882Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:51:05.3880318Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:51:05.3881430Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:51:05.3882519Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:51:05.3883520Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:51:05.3884436Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:51:05.6296213Z 2024-12-18T00:51:05.6297368Z  2024-12-18T00:51:05.6297741Z  2024-12-18T00:51:05.6298079Z  2024-12-18T00:51:05.6298394Z  2024-12-18T00:51:05.6298698Z  2024-12-18T00:51:05.6299044Z  2024-12-18T00:51:05.6299357Z  2024-12-18T00:51:05.6299691Z  2024-12-18T00:51:05.6300458Z [16,183 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:05.6301619Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:05.6302705Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:05.6303813Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2024-12-18T00:51:05.6304856Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2024-12-18T00:51:05.6305811Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:51:05.6306802Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2024-12-18T00:51:05.6307881Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:51:05.6308725Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:51:05.8971246Z 2024-12-18T00:51:05.8972107Z  2024-12-18T00:51:05.8972584Z  2024-12-18T00:51:05.8972974Z  2024-12-18T00:51:05.8973345Z  2024-12-18T00:51:05.8973730Z  2024-12-18T00:51:05.8974136Z  2024-12-18T00:51:05.8974523Z  2024-12-18T00:51:05.8974907Z  2024-12-18T00:51:05.8975811Z [16,184 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:05.8977118Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:05.8978214Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:05.8979292Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:51:05.8980384Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:51:05.8981401Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:51:05.8982457Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:51:05.8983548Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:51:05.8984387Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:06.1012553Z 2024-12-18T00:51:06.1013415Z  2024-12-18T00:51:06.1013859Z  2024-12-18T00:51:06.1014246Z  2024-12-18T00:51:06.1014616Z  2024-12-18T00:51:06.1015013Z  2024-12-18T00:51:06.1015435Z  2024-12-18T00:51:06.1015834Z  2024-12-18T00:51:06.1016227Z  2024-12-18T00:51:06.1017341Z [16,188 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:06.1018431Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:06.1019461Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:06.1020487Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:51:06.1021556Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:51:06.1022579Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:51:06.1023654Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:51:06.1025039Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:51:06.1025912Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:06.3016800Z 2024-12-18T00:51:06.3017714Z  2024-12-18T00:51:06.3018170Z  2024-12-18T00:51:06.3018563Z  2024-12-18T00:51:06.3018923Z  2024-12-18T00:51:06.3019295Z  2024-12-18T00:51:06.3019665Z  2024-12-18T00:51:06.3020032Z  2024-12-18T00:51:06.3020390Z  2024-12-18T00:51:06.3021524Z [16,190 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:06.3022625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:06.3023676Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:06.3024703Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2024-12-18T00:51:06.3025698Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:51:06.3026656Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:51:06.3027622Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:51:06.3028644Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:51:06.3029431Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:06.7022879Z 2024-12-18T00:51:06.7023728Z  2024-12-18T00:51:06.7024232Z  2024-12-18T00:51:06.7024680Z  2024-12-18T00:51:06.7025088Z  2024-12-18T00:51:06.7025488Z  2024-12-18T00:51:06.7025889Z  2024-12-18T00:51:06.7026291Z  2024-12-18T00:51:06.7026672Z  2024-12-18T00:51:06.7027652Z [16,192 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:06.7028889Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:06.7030054Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:06.7031210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:51:06.7032356Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2024-12-18T00:51:06.7033385Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:51:06.7034510Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2024-12-18T00:51:06.7035696Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:51:06.7036609Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:06.9027095Z 2024-12-18T00:51:06.9027972Z  2024-12-18T00:51:06.9028482Z  2024-12-18T00:51:06.9028979Z  2024-12-18T00:51:06.9029401Z  2024-12-18T00:51:06.9029786Z  2024-12-18T00:51:06.9030178Z  2024-12-18T00:51:06.9030566Z  2024-12-18T00:51:06.9030987Z  2024-12-18T00:51:06.9031925Z [16,193 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:06.9033132Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:06.9034346Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:06.9035540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:51:06.9036767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:51:06.9037934Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:51:06.9039093Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:51:06.9040080Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:51:06.9040919Z @llvm-project//llvm:InstCombine; 13s local ... 2024-12-18T00:51:07.1269770Z 2024-12-18T00:51:07.1270537Z  2024-12-18T00:51:07.1271245Z  2024-12-18T00:51:07.1271643Z  2024-12-18T00:51:07.1272031Z  2024-12-18T00:51:07.1272424Z  2024-12-18T00:51:07.1272808Z  2024-12-18T00:51:07.1273187Z  2024-12-18T00:51:07.1273695Z  2024-12-18T00:51:07.1274601Z [16,196 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:07.1275720Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:07.1276820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:07.1278127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:51:07.1279203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:51:07.1280196Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:51:07.1281241Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:51:07.1282344Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:51:07.1283310Z ...//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local ... 2024-12-18T00:51:07.3994962Z 2024-12-18T00:51:07.3995833Z  2024-12-18T00:51:07.3996345Z  2024-12-18T00:51:07.3996717Z  2024-12-18T00:51:07.3997089Z  2024-12-18T00:51:07.3997453Z  2024-12-18T00:51:07.3997799Z  2024-12-18T00:51:07.3998178Z  2024-12-18T00:51:07.3998545Z  2024-12-18T00:51:07.3999476Z [16,198 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:07.4000598Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:07.4001706Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:07.4002819Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:51:07.4003909Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:51:07.4004956Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:51:07.4006026Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:51:07.4007147Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:51:07.4008129Z ...//llvm:X86CommonTableGen__gen_subtarget_genrule; 12s local ... 2024-12-18T00:51:07.6034266Z 2024-12-18T00:51:07.6035183Z  2024-12-18T00:51:07.6035701Z  2024-12-18T00:51:07.6036075Z  2024-12-18T00:51:07.6036526Z  2024-12-18T00:51:07.6036942Z  2024-12-18T00:51:07.6037355Z  2024-12-18T00:51:07.6037702Z  2024-12-18T00:51:07.6038087Z  2024-12-18T00:51:07.6039005Z [16,202 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:07.6040161Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:51:07.6041306Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:07.6042309Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2024-12-18T00:51:07.6043406Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2024-12-18T00:51:07.6044684Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:51:07.6045768Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2024-12-18T00:51:07.6046853Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:51:07.6047727Z @llvm-project//llvm:InstCombine; 11s local ... 2024-12-18T00:51:07.9035477Z 2024-12-18T00:51:07.9036386Z  2024-12-18T00:51:07.9036867Z  2024-12-18T00:51:07.9037269Z  2024-12-18T00:51:07.9037678Z  2024-12-18T00:51:07.9038082Z  2024-12-18T00:51:07.9038465Z  2024-12-18T00:51:07.9038869Z  2024-12-18T00:51:07.9039262Z  2024-12-18T00:51:07.9040523Z [16,203 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:07.9041772Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:51:07.9042962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:51:07.9044079Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:51:07.9045421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:51:07.9046644Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:51:07.9047806Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:51:07.9048910Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:51:07.9049782Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:08.1352128Z 2024-12-18T00:51:08.1353001Z  2024-12-18T00:51:08.1353412Z  2024-12-18T00:51:08.1353778Z  2024-12-18T00:51:08.1354102Z  2024-12-18T00:51:08.1354425Z  2024-12-18T00:51:08.1354731Z  2024-12-18T00:51:08.1355055Z  2024-12-18T00:51:08.1355382Z  2024-12-18T00:51:08.1356158Z [16,205 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:08.1357083Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:51:08.1357948Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:51:08.1358825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:51:08.1359687Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:51:08.1360491Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:51:08.1361328Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:51:08.1362168Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:51:08.1362872Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:08.3654993Z 2024-12-18T00:51:08.3655850Z  2024-12-18T00:51:08.3656326Z  2024-12-18T00:51:08.3656909Z  2024-12-18T00:51:08.3657329Z  2024-12-18T00:51:08.3657725Z  2024-12-18T00:51:08.3658152Z  2024-12-18T00:51:08.3658573Z  2024-12-18T00:51:08.3658979Z  2024-12-18T00:51:08.3659963Z [16,206 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:08.3661226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:51:08.3662424Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:51:08.3663598Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2024-12-18T00:51:08.3664762Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2024-12-18T00:51:08.3665837Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:51:08.3666941Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:51:08.3668056Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:51:08.3668933Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:08.7042468Z 2024-12-18T00:51:08.7043349Z  2024-12-18T00:51:08.7043832Z  2024-12-18T00:51:08.7044506Z  2024-12-18T00:51:08.7044893Z  2024-12-18T00:51:08.7045275Z  2024-12-18T00:51:08.7045709Z  2024-12-18T00:51:08.7046050Z  2024-12-18T00:51:08.7046401Z  2024-12-18T00:51:08.7047308Z [16,207 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:08.7048510Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:08.7049605Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:08.7051031Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:51:08.7052154Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:51:08.7053365Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:51:08.7054388Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2024-12-18T00:51:08.7055530Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:51:08.7056539Z @llvm-project//llvm:InstCombine; 12s local ... 2024-12-18T00:51:08.9045202Z 2024-12-18T00:51:08.9046148Z  2024-12-18T00:51:08.9046646Z  2024-12-18T00:51:08.9047073Z  2024-12-18T00:51:08.9047512Z  2024-12-18T00:51:08.9047973Z  2024-12-18T00:51:08.9048431Z  2024-12-18T00:51:08.9048893Z  2024-12-18T00:51:08.9049325Z  2024-12-18T00:51:08.9050409Z [16,208 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:08.9051806Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:08.9053113Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:08.9054400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:51:08.9055684Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:51:08.9057028Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:51:08.9058287Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2024-12-18T00:51:08.9059567Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:51:08.9060560Z @llvm-project//llvm:InstCombine; 13s local ... 2024-12-18T00:51:09.1090932Z 2024-12-18T00:51:09.1091820Z  2024-12-18T00:51:09.1092342Z  2024-12-18T00:51:09.1092768Z  2024-12-18T00:51:09.1093200Z  2024-12-18T00:51:09.1093659Z  2024-12-18T00:51:09.1094112Z  2024-12-18T00:51:09.1094514Z  2024-12-18T00:51:09.1094862Z  2024-12-18T00:51:09.1095732Z [16,211 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:09.1096919Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:09.1097994Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:09.1099107Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:51:09.1100229Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:51:09.1101205Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:51:09.1102170Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2024-12-18T00:51:09.1103200Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:51:09.1103970Z @llvm-project//llvm:InstCombine; 13s local ... 2024-12-18T00:51:09.3526493Z 2024-12-18T00:51:09.3527385Z  2024-12-18T00:51:09.3527899Z  2024-12-18T00:51:09.3528310Z  2024-12-18T00:51:09.3528692Z  2024-12-18T00:51:09.3529124Z  2024-12-18T00:51:09.3529564Z  2024-12-18T00:51:09.3529936Z  2024-12-18T00:51:09.3530319Z  2024-12-18T00:51:09.3531234Z [16,215 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:09.3532415Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:09.3533516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:09.3534575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:51:09.3535654Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:51:09.3536801Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:51:09.3538035Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:51:09.3538871Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:51:09.3539880Z Compiling llvm/lib/Transforms/Scalar/StructurizeCFG.cpp; 10s local ... 2024-12-18T00:51:09.5930219Z 2024-12-18T00:51:09.5931081Z  2024-12-18T00:51:09.5931570Z  2024-12-18T00:51:09.5932003Z  2024-12-18T00:51:09.5932407Z  2024-12-18T00:51:09.5932777Z  2024-12-18T00:51:09.5933162Z  2024-12-18T00:51:09.5933560Z  2024-12-18T00:51:09.5934390Z  2024-12-18T00:51:09.5935328Z [16,217 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:09.5936632Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 131s local 2024-12-18T00:51:09.5937737Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:09.5938855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2024-12-18T00:51:09.5940015Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2024-12-18T00:51:09.5941063Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:51:09.5942028Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:51:09.5942869Z @llvm-project//llvm:InstCombine; 13s local 2024-12-18T00:51:09.5943638Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local ... 2024-12-18T00:51:09.7935614Z 2024-12-18T00:51:09.7936627Z  2024-12-18T00:51:09.7937139Z  2024-12-18T00:51:09.7937542Z  2024-12-18T00:51:09.7937928Z  2024-12-18T00:51:09.7938319Z  2024-12-18T00:51:09.7938712Z  2024-12-18T00:51:09.7939095Z  2024-12-18T00:51:09.7939474Z  2024-12-18T00:51:09.7940430Z [16,218 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:09.7941572Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 131s local 2024-12-18T00:51:09.7942741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:09.7943899Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:51:09.7945347Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:51:09.7946412Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:51:09.7947373Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:51:09.7948237Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:51:09.7949039Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local ... 2024-12-18T00:51:09.9955258Z 2024-12-18T00:51:09.9956138Z  2024-12-18T00:51:09.9956626Z  2024-12-18T00:51:09.9956992Z  2024-12-18T00:51:09.9957378Z  2024-12-18T00:51:09.9957787Z  2024-12-18T00:51:09.9958262Z  2024-12-18T00:51:09.9958639Z  2024-12-18T00:51:09.9959053Z  2024-12-18T00:51:09.9959981Z [16,219 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:09.9961170Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 131s local 2024-12-18T00:51:09.9962302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:09.9963311Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:51:09.9964389Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:51:09.9965424Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:51:09.9966375Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:51:09.9967189Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:51:09.9967944Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local ... 2024-12-18T00:51:10.3057613Z 2024-12-18T00:51:10.3058512Z  2024-12-18T00:51:10.3058990Z  2024-12-18T00:51:10.3059636Z  2024-12-18T00:51:10.3060010Z  2024-12-18T00:51:10.3060474Z  2024-12-18T00:51:10.3060864Z  2024-12-18T00:51:10.3061228Z  2024-12-18T00:51:10.3061590Z  2024-12-18T00:51:10.3062692Z [16,219 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:10.3063902Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 131s local 2024-12-18T00:51:10.3065024Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:10.3066348Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:51:10.3067421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:51:10.3068377Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:51:10.3069312Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:51:10.3070084Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:51:10.3070835Z Compiling llvm/lib/Analysis/InlineCost.cpp; 11s local ... 2024-12-18T00:51:10.5377836Z 2024-12-18T00:51:10.5378750Z  2024-12-18T00:51:10.5379233Z  2024-12-18T00:51:10.5388540Z  2024-12-18T00:51:10.5389253Z  2024-12-18T00:51:10.5389669Z  2024-12-18T00:51:10.5390074Z  2024-12-18T00:51:10.5390446Z  2024-12-18T00:51:10.5390841Z  2024-12-18T00:51:10.5391748Z [16,222 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:10.5392918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:10.5394044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2024-12-18T00:51:10.5395038Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2024-12-18T00:51:10.5396056Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:51:10.5397057Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:51:10.5397884Z @llvm-project//llvm:InstCombine; 14s local 2024-12-18T00:51:10.5398529Z Compiling llvm/lib/Analysis/InlineCost.cpp; 11s local 2024-12-18T00:51:10.5399421Z @llvm-project//llvm:X86CommonTableGen__gen_dag_isel_genrule; 8s local ... 2024-12-18T00:51:10.9063796Z 2024-12-18T00:51:10.9064649Z  2024-12-18T00:51:10.9065137Z  2024-12-18T00:51:10.9065514Z  2024-12-18T00:51:10.9066004Z  2024-12-18T00:51:10.9066388Z  2024-12-18T00:51:10.9066852Z  2024-12-18T00:51:10.9067351Z  2024-12-18T00:51:10.9067758Z  2024-12-18T00:51:10.9068745Z [16,224 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:10.9069839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:51:10.9070903Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:51:10.9071976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:51:10.9072981Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:51:10.9073873Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:51:10.9074678Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:51:10.9075508Z @llvm-project//llvm:X86CommonTableGen__gen_dag_isel_genrule; 9s local 2024-12-18T00:51:10.9076597Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local ... 2024-12-18T00:51:11.1067650Z 2024-12-18T00:51:11.1068606Z  2024-12-18T00:51:11.1069099Z  2024-12-18T00:51:11.1069501Z  2024-12-18T00:51:11.1069925Z  2024-12-18T00:51:11.1070306Z  2024-12-18T00:51:11.1070687Z  2024-12-18T00:51:11.1071068Z  2024-12-18T00:51:11.1071451Z  2024-12-18T00:51:11.1072368Z [16,225 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:11.1074080Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:51:11.1075092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:51:11.1076441Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:51:11.1077556Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 25s local 2024-12-18T00:51:11.1078580Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:51:11.1079337Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:51:11.1080441Z @llvm-project//llvm:X86CommonTableGen__gen_dag_isel_genrule; 9s local 2024-12-18T00:51:11.1081415Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local ... 2024-12-18T00:51:11.4328804Z 2024-12-18T00:51:11.4329788Z  2024-12-18T00:51:11.4330377Z  2024-12-18T00:51:11.4330782Z  2024-12-18T00:51:11.4331171Z  2024-12-18T00:51:11.4331535Z  2024-12-18T00:51:11.4331962Z  2024-12-18T00:51:11.4332357Z  2024-12-18T00:51:11.4332742Z  2024-12-18T00:51:11.4333662Z [16,228 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:11.4334786Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:51:11.4335866Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2024-12-18T00:51:11.4337131Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:51:11.4338217Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:51:11.4339086Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:51:11.4339926Z @llvm-project//llvm:X86CommonTableGen__gen_dag_isel_genrule; 9s local 2024-12-18T00:51:11.4340874Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2024-12-18T00:51:11.4341896Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local ... 2024-12-18T00:51:11.6494048Z 2024-12-18T00:51:11.6495003Z  2024-12-18T00:51:11.6495531Z  2024-12-18T00:51:11.6495955Z  2024-12-18T00:51:11.6496475Z  2024-12-18T00:51:11.6496915Z  2024-12-18T00:51:11.6497351Z  2024-12-18T00:51:11.6497785Z  2024-12-18T00:51:11.6498227Z  2024-12-18T00:51:11.6499244Z [16,231 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:11.6500468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:11.6501812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:51:11.6502989Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2024-12-18T00:51:11.6504070Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:51:11.6504977Z @llvm-project//llvm:InstCombine; 15s local 2024-12-18T00:51:11.6505877Z @llvm-project//llvm:X86CommonTableGen__gen_dag_isel_genrule; 9s local 2024-12-18T00:51:11.6506946Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local 2024-12-18T00:51:11.6508222Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local ... 2024-12-18T00:51:11.8716329Z 2024-12-18T00:51:11.8717325Z  2024-12-18T00:51:11.8717772Z  2024-12-18T00:51:11.8718137Z  2024-12-18T00:51:11.8718530Z  2024-12-18T00:51:11.8718895Z  2024-12-18T00:51:11.8719284Z  2024-12-18T00:51:11.8719615Z  2024-12-18T00:51:11.8719986Z  2024-12-18T00:51:11.8720855Z [16,233 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:11.8721917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:11.8722914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:51:11.8723912Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:51:11.8724885Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:51:11.8726080Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:11.8726800Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local 2024-12-18T00:51:11.8727835Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local 2024-12-18T00:51:11.8728637Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:51:12.1072464Z 2024-12-18T00:51:12.1073387Z  2024-12-18T00:51:12.1073896Z  2024-12-18T00:51:12.1074345Z  2024-12-18T00:51:12.1074754Z  2024-12-18T00:51:12.1075583Z  2024-12-18T00:51:12.1076030Z  2024-12-18T00:51:12.1076446Z  2024-12-18T00:51:12.1076764Z  2024-12-18T00:51:12.1077564Z [16,238 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:12.1078507Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:12.1079401Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:51:12.1080324Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:51:12.1081190Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:51:12.1081881Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:12.1082564Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 8s local 2024-12-18T00:51:12.1083376Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local 2024-12-18T00:51:12.1084073Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:51:12.3584285Z 2024-12-18T00:51:12.3585297Z  2024-12-18T00:51:12.3585796Z  2024-12-18T00:51:12.3586233Z  2024-12-18T00:51:12.3586677Z  2024-12-18T00:51:12.3587087Z  2024-12-18T00:51:12.3587477Z  2024-12-18T00:51:12.3587931Z  2024-12-18T00:51:12.3588356Z  2024-12-18T00:51:12.3589237Z [16,239 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:12.3590218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:12.3591265Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:51:12.3592337Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:51:12.3593284Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:51:12.3594027Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:12.3594780Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:51:12.3595675Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local 2024-12-18T00:51:12.3596416Z @llvm-project//llvm:InstCombine; 8s local ... 2024-12-18T00:51:12.5598105Z 2024-12-18T00:51:12.5599029Z  2024-12-18T00:51:12.5599557Z  2024-12-18T00:51:12.5599998Z  2024-12-18T00:51:12.5600435Z  2024-12-18T00:51:12.5600850Z  2024-12-18T00:51:12.5601289Z  2024-12-18T00:51:12.5601748Z  2024-12-18T00:51:12.5602179Z  2024-12-18T00:51:12.5603070Z [16,245 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:12.5604379Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:12.5605555Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2024-12-18T00:51:12.5606585Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2024-12-18T00:51:12.5607735Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:51:12.5608541Z @llvm-project//llvm:InstCombine; 16s local 2024-12-18T00:51:12.5609294Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:51:12.5610377Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:51:12.5611326Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:51:12.8736909Z 2024-12-18T00:51:12.8737951Z  2024-12-18T00:51:12.8738434Z  2024-12-18T00:51:12.8738877Z  2024-12-18T00:51:12.8739298Z  2024-12-18T00:51:12.8739688Z  2024-12-18T00:51:12.8740053Z  2024-12-18T00:51:12.8740707Z  2024-12-18T00:51:12.8741117Z  2024-12-18T00:51:12.8742071Z [16,247 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:12.8743256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:51:12.8744678Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:51:12.8745889Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:51:12.8747068Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:51:12.8747884Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:51:12.8748690Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:51:12.8749657Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:51:12.8750487Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:51:13.1083532Z 2024-12-18T00:51:13.1084403Z  2024-12-18T00:51:13.1084840Z  2024-12-18T00:51:13.1085232Z  2024-12-18T00:51:13.1085617Z  2024-12-18T00:51:13.1086003Z  2024-12-18T00:51:13.1086384Z  2024-12-18T00:51:13.1086762Z  2024-12-18T00:51:13.1087149Z  2024-12-18T00:51:13.1088074Z [16,248 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:13.1089229Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:51:13.1090310Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:51:13.1091395Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:51:13.1092398Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:51:13.1093259Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:51:13.1094048Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 9s local 2024-12-18T00:51:13.1095010Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:51:13.1095859Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:51:13.3808539Z 2024-12-18T00:51:13.3809417Z  2024-12-18T00:51:13.3809925Z  2024-12-18T00:51:13.3810330Z  2024-12-18T00:51:13.3810718Z  2024-12-18T00:51:13.3811107Z  2024-12-18T00:51:13.3811493Z  2024-12-18T00:51:13.3811876Z  2024-12-18T00:51:13.3812214Z  2024-12-18T00:51:13.3813086Z [16,252 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:13.3814195Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:51:13.3815228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2024-12-18T00:51:13.3816280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2024-12-18T00:51:13.3817464Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:51:13.3818283Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:51:13.3819073Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:51:13.3820029Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:51:13.3820862Z @llvm-project//llvm:InstCombine; 9s local ... 2024-12-18T00:51:13.7089816Z 2024-12-18T00:51:13.7090722Z  2024-12-18T00:51:13.7091200Z  2024-12-18T00:51:13.7091564Z  2024-12-18T00:51:13.7091965Z  2024-12-18T00:51:13.7092337Z  2024-12-18T00:51:13.7092714Z  2024-12-18T00:51:13.7093096Z  2024-12-18T00:51:13.7093476Z  2024-12-18T00:51:13.7094399Z [16,254 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:13.7095885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:51:13.7097064Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:51:13.7098339Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:13.7099354Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:51:13.7100194Z @llvm-project//llvm:InstCombine; 17s local 2024-12-18T00:51:13.7101029Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:51:13.7102345Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2024-12-18T00:51:13.7103193Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:51:13.9094994Z 2024-12-18T00:51:13.9095849Z  2024-12-18T00:51:13.9096260Z  2024-12-18T00:51:13.9096736Z  2024-12-18T00:51:13.9097088Z  2024-12-18T00:51:13.9097433Z  2024-12-18T00:51:13.9097763Z  2024-12-18T00:51:13.9098167Z  2024-12-18T00:51:13.9098547Z  2024-12-18T00:51:13.9099451Z [16,256 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:51:13.9100505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:51:13.9101449Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:51:13.9102370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:13.9103314Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:51:13.9104045Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:13.9104782Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:51:13.9105684Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2024-12-18T00:51:13.9106404Z @llvm-project//llvm:InstCombine; 10s local ... 2024-12-18T00:51:14.2355488Z 2024-12-18T00:51:14.2356344Z  2024-12-18T00:51:14.2356821Z  2024-12-18T00:51:14.2357200Z  2024-12-18T00:51:14.2357575Z  2024-12-18T00:51:14.2357943Z  2024-12-18T00:51:14.2358327Z  2024-12-18T00:51:14.2358771Z  2024-12-18T00:51:14.2359252Z  2024-12-18T00:51:14.2360157Z [16,259 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:14.2361258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:51:14.2362347Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:51:14.2363431Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:14.2364433Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:51:14.2365221Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:14.2365996Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:51:14.2366793Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:51:14.2367659Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2024-12-18T00:51:14.5100531Z 2024-12-18T00:51:14.5101392Z  2024-12-18T00:51:14.5101895Z  2024-12-18T00:51:14.5102278Z  2024-12-18T00:51:14.5102674Z  2024-12-18T00:51:14.5103076Z  2024-12-18T00:51:14.5103465Z  2024-12-18T00:51:14.5103843Z  2024-12-18T00:51:14.5104230Z  2024-12-18T00:51:14.5105226Z [16,262 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:14.5106397Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:51:14.5107477Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2024-12-18T00:51:14.5108587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2024-12-18T00:51:14.5109653Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:51:14.5110813Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:14.5111667Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:51:14.5112638Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:51:14.5113528Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2024-12-18T00:51:14.7104235Z 2024-12-18T00:51:14.7105104Z  2024-12-18T00:51:14.7105601Z  2024-12-18T00:51:14.7105992Z  2024-12-18T00:51:14.7106359Z  2024-12-18T00:51:14.7106729Z  2024-12-18T00:51:14.7107547Z  2024-12-18T00:51:14.7107947Z  2024-12-18T00:51:14.7108312Z  2024-12-18T00:51:14.7109241Z [16,263 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:14.7110394Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:51:14.7111434Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:51:14.7112559Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:14.7113579Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:51:14.7114412Z @llvm-project//llvm:InstCombine; 18s local 2024-12-18T00:51:14.7115199Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:51:14.7116012Z Compiling xla/shape_util.cc; 8s local 2024-12-18T00:51:14.7116886Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2024-12-18T00:51:15.1013842Z 2024-12-18T00:51:15.1014797Z  2024-12-18T00:51:15.1015255Z  2024-12-18T00:51:15.1015624Z  2024-12-18T00:51:15.1016014Z  2024-12-18T00:51:15.1016514Z  2024-12-18T00:51:15.1016908Z  2024-12-18T00:51:15.1017285Z  2024-12-18T00:51:15.1017646Z  2024-12-18T00:51:15.1018569Z [16,267 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:15.1019755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:51:15.1020968Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:51:15.1021996Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:15.1023008Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:51:15.1023817Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:51:15.1024609Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:51:15.1025420Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:51:15.1026341Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 9s local ... 2024-12-18T00:51:15.3110608Z 2024-12-18T00:51:15.3111463Z  2024-12-18T00:51:15.3111925Z  2024-12-18T00:51:15.3112301Z  2024-12-18T00:51:15.3112672Z  2024-12-18T00:51:15.3113032Z  2024-12-18T00:51:15.3113410Z  2024-12-18T00:51:15.3113822Z  2024-12-18T00:51:15.3114205Z  2024-12-18T00:51:15.3115105Z [16,267 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:15.3116241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:51:15.3117364Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:51:15.3118441Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:15.3119561Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:51:15.3120395Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:51:15.3121192Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:51:15.3122156Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:51:15.3123099Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 9s local ... 2024-12-18T00:51:15.5115080Z 2024-12-18T00:51:15.5116018Z  2024-12-18T00:51:15.5116797Z  2024-12-18T00:51:15.5117214Z  2024-12-18T00:51:15.5117607Z  2024-12-18T00:51:15.5117997Z  2024-12-18T00:51:15.5118398Z  2024-12-18T00:51:15.5118905Z  2024-12-18T00:51:15.5119399Z  2024-12-18T00:51:15.5120308Z [16,268 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:15.5121499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:51:15.5122714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2024-12-18T00:51:15.5123942Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2024-12-18T00:51:15.5125012Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:51:15.5125866Z @llvm-project//llvm:InstCombine; 19s local 2024-12-18T00:51:15.5126744Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:51:15.5127532Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:51:15.5128364Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2024-12-18T00:51:15.7321029Z 2024-12-18T00:51:15.7322024Z  2024-12-18T00:51:15.7322542Z  2024-12-18T00:51:15.7322927Z  2024-12-18T00:51:15.7323302Z  2024-12-18T00:51:15.7323718Z  2024-12-18T00:51:15.7324133Z  2024-12-18T00:51:15.7324571Z  2024-12-18T00:51:15.7324961Z  2024-12-18T00:51:15.7325860Z [16,270 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:15.7327005Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:15.7328142Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:51:15.7329236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:51:15.7330192Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:51:15.7331031Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:51:15.7331869Z Compiling xla/shape_util.cc; 9s local 2024-12-18T00:51:15.7332610Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 8s local 2024-12-18T00:51:15.7333413Z Compiling llvm/lib/Analysis/Lint.cpp; 6s local ... 2024-12-18T00:51:15.9994433Z 2024-12-18T00:51:15.9995350Z  2024-12-18T00:51:15.9995851Z  2024-12-18T00:51:15.9996251Z  2024-12-18T00:51:15.9996604Z  2024-12-18T00:51:15.9997009Z  2024-12-18T00:51:15.9997499Z  2024-12-18T00:51:15.9997909Z  2024-12-18T00:51:15.9998436Z  2024-12-18T00:51:15.9999350Z [16,273 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:16.0000584Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:16.0001746Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:51:16.0002797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:51:16.0003846Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:51:16.0004677Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:51:16.0005465Z Compiling xla/shape_util.cc; 10s local 2024-12-18T00:51:16.0006289Z Compiling llvm/lib/Analysis/LazyValueInfo.cpp; 9s local 2024-12-18T00:51:16.0007158Z Compiling llvm/lib/Analysis/Lint.cpp; 6s local ... 2024-12-18T00:51:16.2774210Z 2024-12-18T00:51:16.2775092Z  2024-12-18T00:51:16.2775556Z  2024-12-18T00:51:16.2775986Z  2024-12-18T00:51:16.2776457Z  2024-12-18T00:51:16.2776815Z  2024-12-18T00:51:16.2777179Z  2024-12-18T00:51:16.2777641Z  2024-12-18T00:51:16.2777996Z  2024-12-18T00:51:16.2778867Z [16,278 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:51:16.2779960Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:16.2781206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:51:16.2782155Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:51:16.2783061Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:51:16.2783785Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:51:16.2784525Z Compiling xla/shape_util.cc; 10s local 2024-12-18T00:51:16.2785068Z Compiling xla/pjrt/metrics.cc; 5s local 2024-12-18T00:51:16.2785985Z Compiling llvm/lib/Analysis/SyntheticCountsUtils.cpp; 5s local ... 2024-12-18T00:51:16.5119656Z 2024-12-18T00:51:16.5121022Z  2024-12-18T00:51:16.5121540Z  2024-12-18T00:51:16.5121972Z  2024-12-18T00:51:16.5122379Z  2024-12-18T00:51:16.5122800Z  2024-12-18T00:51:16.5123215Z  2024-12-18T00:51:16.5123632Z  2024-12-18T00:51:16.5124028Z  2024-12-18T00:51:16.5125042Z [16,280 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:16.5126377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:16.5127604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2024-12-18T00:51:16.5128850Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2024-12-18T00:51:16.5129866Z @llvm-project//llvm:InstCombine; 20s local 2024-12-18T00:51:16.5130757Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:51:16.5131895Z Compiling llvm/lib/Analysis/SyntheticCountsUtils.cpp; 5s local 2024-12-18T00:51:16.5132961Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 5s local 2024-12-18T00:51:16.5134017Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 4s local ... 2024-12-18T00:51:16.7124670Z 2024-12-18T00:51:16.7125604Z  2024-12-18T00:51:16.7126106Z  2024-12-18T00:51:16.7126516Z  2024-12-18T00:51:16.7126938Z  2024-12-18T00:51:16.7127311Z  2024-12-18T00:51:16.7127712Z  2024-12-18T00:51:16.7128120Z  2024-12-18T00:51:16.7128532Z  2024-12-18T00:51:16.7129559Z [16,285 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:16.7130826Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:51:16.7132035Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:51:16.7133235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:16.7134390Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:51:16.7135459Z Compiling llvm/lib/Analysis/SyntheticCountsUtils.cpp; 5s local 2024-12-18T00:51:16.7136643Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 5s local 2024-12-18T00:51:16.7137656Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 5s local 2024-12-18T00:51:16.7138651Z Compiling xla/tsl/framework/bfc_allocator.cc; 5s local ... 2024-12-18T00:51:16.9515596Z 2024-12-18T00:51:16.9516965Z  2024-12-18T00:51:16.9517466Z  2024-12-18T00:51:16.9517879Z  2024-12-18T00:51:16.9518310Z  2024-12-18T00:51:16.9518725Z  2024-12-18T00:51:16.9519129Z  2024-12-18T00:51:16.9519529Z  2024-12-18T00:51:16.9519932Z  2024-12-18T00:51:16.9520926Z [16,289 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:16.9522160Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:51:16.9523309Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:51:16.9524475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:16.9525644Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:51:16.9526730Z Compiling llvm/lib/Analysis/SyntheticCountsUtils.cpp; 5s local 2024-12-18T00:51:16.9528049Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 5s local 2024-12-18T00:51:16.9529052Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 5s local 2024-12-18T00:51:16.9530186Z Compiling xla/tsl/framework/bfc_allocator.cc; 5s local ... 2024-12-18T00:51:17.3130371Z 2024-12-18T00:51:17.3131760Z  2024-12-18T00:51:17.3132213Z  2024-12-18T00:51:17.3132573Z  2024-12-18T00:51:17.3132985Z  2024-12-18T00:51:17.3133350Z  2024-12-18T00:51:17.3133744Z  2024-12-18T00:51:17.3134094Z  2024-12-18T00:51:17.3134924Z  2024-12-18T00:51:17.3135792Z [16,292 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:17.3137059Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:51:17.3138118Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:51:17.3139267Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:17.3140308Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:51:17.3141429Z Compiling llvm/lib/Analysis/SyntheticCountsUtils.cpp; 6s local 2024-12-18T00:51:17.3142301Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 5s local 2024-12-18T00:51:17.3143168Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 5s local 2024-12-18T00:51:17.3144035Z Compiling xla/tsl/framework/bfc_allocator.cc; 5s local ... 2024-12-18T00:51:17.5976121Z 2024-12-18T00:51:17.5977598Z  2024-12-18T00:51:17.5978091Z  2024-12-18T00:51:17.5978491Z  2024-12-18T00:51:17.5978842Z  2024-12-18T00:51:17.5979227Z  2024-12-18T00:51:17.5979613Z  2024-12-18T00:51:17.5980002Z  2024-12-18T00:51:17.5980387Z  2024-12-18T00:51:17.5981492Z [16,294 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:17.5982578Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:51:17.5983744Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2024-12-18T00:51:17.5984960Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2024-12-18T00:51:17.5986039Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:51:17.5986957Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 6s local 2024-12-18T00:51:17.5987902Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 6s local 2024-12-18T00:51:17.5988832Z Compiling xla/tsl/framework/bfc_allocator.cc; 5s local 2024-12-18T00:51:17.5989853Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 5s local ... 2024-12-18T00:51:17.9136785Z 2024-12-18T00:51:17.9138096Z  2024-12-18T00:51:17.9138573Z  2024-12-18T00:51:17.9138967Z  2024-12-18T00:51:17.9139367Z  2024-12-18T00:51:17.9139754Z  2024-12-18T00:51:17.9140171Z  2024-12-18T00:51:17.9140587Z  2024-12-18T00:51:17.9141036Z  2024-12-18T00:51:17.9141994Z [16,295 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:17.9143293Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:51:17.9144729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:51:17.9145729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:51:17.9146746Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:51:17.9147823Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 6s local 2024-12-18T00:51:17.9148816Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 6s local 2024-12-18T00:51:17.9149783Z Compiling xla/tsl/framework/bfc_allocator.cc; 6s local 2024-12-18T00:51:17.9150820Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 5s local ... 2024-12-18T00:51:18.1141817Z 2024-12-18T00:51:18.1142983Z  2024-12-18T00:51:18.1143457Z  2024-12-18T00:51:18.1144404Z  2024-12-18T00:51:18.1144812Z  2024-12-18T00:51:18.1145221Z  2024-12-18T00:51:18.1145634Z  2024-12-18T00:51:18.1146046Z  2024-12-18T00:51:18.1146608Z  2024-12-18T00:51:18.1147484Z [16,298 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:18.1148613Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:51:18.1149855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:51:18.1151064Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:51:18.1152131Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 6s local 2024-12-18T00:51:18.1153121Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 6s local 2024-12-18T00:51:18.1154000Z Compiling xla/tsl/framework/bfc_allocator.cc; 6s local 2024-12-18T00:51:18.1154857Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local 2024-12-18T00:51:18.1155722Z Compiling xla/hlo/ir/hlo_sharding.cc; 5s local ... 2024-12-18T00:51:18.4569399Z 2024-12-18T00:51:18.4570255Z  2024-12-18T00:51:18.4570757Z  2024-12-18T00:51:18.4571125Z  2024-12-18T00:51:18.4571479Z  2024-12-18T00:51:18.4571813Z  2024-12-18T00:51:18.4572160Z  2024-12-18T00:51:18.4572503Z  2024-12-18T00:51:18.4572853Z  2024-12-18T00:51:18.4573702Z [16,300 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:18.4574791Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:51:18.4575862Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2024-12-18T00:51:18.4577039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2024-12-18T00:51:18.4578021Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 6s local 2024-12-18T00:51:18.4578855Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 6s local 2024-12-18T00:51:18.4579745Z Compiling xla/tsl/framework/bfc_allocator.cc; 6s local 2024-12-18T00:51:18.4580746Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local 2024-12-18T00:51:18.4581585Z Compiling xla/hlo/ir/hlo_sharding.cc; 5s local ... 2024-12-18T00:51:18.7147326Z 2024-12-18T00:51:18.7148519Z  2024-12-18T00:51:18.7148904Z  2024-12-18T00:51:18.7149259Z  2024-12-18T00:51:18.7149586Z  2024-12-18T00:51:18.7149906Z  2024-12-18T00:51:18.7150263Z  2024-12-18T00:51:18.7150552Z  2024-12-18T00:51:18.7150853Z  2024-12-18T00:51:18.7151619Z [16,300 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:18.7152551Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:51:18.7153428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:51:18.7154304Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:18.7155092Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 7s local 2024-12-18T00:51:18.7155856Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local 2024-12-18T00:51:18.7156607Z Compiling xla/tsl/framework/bfc_allocator.cc; 7s local 2024-12-18T00:51:18.7157468Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local 2024-12-18T00:51:18.7158242Z Compiling xla/hlo/ir/hlo_sharding.cc; 5s local ... 2024-12-18T00:51:18.9150841Z 2024-12-18T00:51:18.9152138Z  2024-12-18T00:51:18.9152564Z  2024-12-18T00:51:18.9152929Z  2024-12-18T00:51:18.9153298Z  2024-12-18T00:51:18.9153691Z  2024-12-18T00:51:18.9154082Z  2024-12-18T00:51:18.9154467Z  2024-12-18T00:51:18.9154815Z  2024-12-18T00:51:18.9155784Z [16,303 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:18.9157351Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:51:18.9158529Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:51:18.9159842Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:18.9160844Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 7s local 2024-12-18T00:51:18.9161907Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local 2024-12-18T00:51:18.9162908Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local 2024-12-18T00:51:18.9165876Z Compiling xla/hlo/ir/hlo_sharding.cc; 5s local 2024-12-18T00:51:18.9166722Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 5s local ... 2024-12-18T00:51:19.1333807Z 2024-12-18T00:51:19.1339389Z  2024-12-18T00:51:19.1340009Z  2024-12-18T00:51:19.1340506Z  2024-12-18T00:51:19.1341027Z  2024-12-18T00:51:19.1341550Z  2024-12-18T00:51:19.1342092Z  2024-12-18T00:51:19.1342603Z  2024-12-18T00:51:19.1343092Z  2024-12-18T00:51:19.1344403Z [16,305 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:19.1345764Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:51:19.1347054Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:51:19.1348342Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:19.1349514Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 7s local 2024-12-18T00:51:19.1350651Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2024-12-18T00:51:19.1351673Z Compiling xla/hlo/ir/hlo_sharding.cc; 6s local 2024-12-18T00:51:19.1352674Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 5s local 2024-12-18T00:51:19.1353626Z Compiling xla/literal.cc; 5s local ... 2024-12-18T00:51:19.4889690Z 2024-12-18T00:51:19.4890593Z  2024-12-18T00:51:19.4891014Z  2024-12-18T00:51:19.4894003Z  2024-12-18T00:51:19.4897225Z  2024-12-18T00:51:19.4900382Z  2024-12-18T00:51:19.4903322Z  2024-12-18T00:51:19.4906227Z  2024-12-18T00:51:19.4908985Z  2024-12-18T00:51:19.4912175Z [16,307 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:19.4915687Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:51:19.4917098Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2024-12-18T00:51:19.4918390Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:19.4919620Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:51:19.4920933Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2024-12-18T00:51:19.4921988Z Compiling xla/hlo/ir/hlo_sharding.cc; 6s local 2024-12-18T00:51:19.4923046Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 6s local 2024-12-18T00:51:19.4924042Z Compiling xla/literal.cc; 6s local ... 2024-12-18T00:51:19.6934258Z 2024-12-18T00:51:19.6935533Z  2024-12-18T00:51:19.6936583Z  2024-12-18T00:51:19.6937733Z  2024-12-18T00:51:19.6938194Z  2024-12-18T00:51:19.6938598Z  2024-12-18T00:51:19.6939013Z  2024-12-18T00:51:19.6939394Z  2024-12-18T00:51:19.6939800Z  2024-12-18T00:51:19.6940846Z [16,309 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:19.6942193Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:51:19.6943473Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:51:19.6945145Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2024-12-18T00:51:19.6946207Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:51:19.6947420Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2024-12-18T00:51:19.6948223Z Compiling xla/hlo/ir/hlo_sharding.cc; 6s local 2024-12-18T00:51:19.6949116Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 6s local 2024-12-18T00:51:19.6949844Z Compiling xla/literal.cc; 6s local ... 2024-12-18T00:51:19.9159862Z 2024-12-18T00:51:19.9161917Z  2024-12-18T00:51:19.9162426Z  2024-12-18T00:51:19.9162802Z  2024-12-18T00:51:19.9163197Z  2024-12-18T00:51:19.9163570Z  2024-12-18T00:51:19.9163970Z  2024-12-18T00:51:19.9164810Z  2024-12-18T00:51:19.9165213Z  2024-12-18T00:51:19.9166109Z [16,312 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:19.9167235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:51:19.9168328Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:51:19.9169413Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:19.9170445Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:51:19.9171330Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2024-12-18T00:51:19.9172157Z Compiling xla/hlo/ir/hlo_sharding.cc; 6s local 2024-12-18T00:51:19.9172951Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 6s local 2024-12-18T00:51:19.9173584Z Compiling xla/literal.cc; 6s local ... 2024-12-18T00:51:20.1163660Z 2024-12-18T00:51:20.1164818Z  2024-12-18T00:51:20.1165324Z  2024-12-18T00:51:20.1165670Z  2024-12-18T00:51:20.1166004Z  2024-12-18T00:51:20.1166305Z  2024-12-18T00:51:20.1166598Z  2024-12-18T00:51:20.1166913Z  2024-12-18T00:51:20.1167271Z  2024-12-18T00:51:20.1168191Z [16,313 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:20.1169152Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:51:20.1170153Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:51:20.1171248Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:20.1172117Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:51:20.1172864Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2024-12-18T00:51:20.1173617Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2024-12-18T00:51:20.1174439Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 6s local 2024-12-18T00:51:20.1175230Z Compiling xla/literal.cc; 6s local ... 2024-12-18T00:51:20.4442625Z 2024-12-18T00:51:20.4444355Z  2024-12-18T00:51:20.4449297Z  2024-12-18T00:51:20.4449747Z  2024-12-18T00:51:20.4450146Z  2024-12-18T00:51:20.4450526Z  2024-12-18T00:51:20.4450868Z  2024-12-18T00:51:20.4451221Z  2024-12-18T00:51:20.4451629Z  2024-12-18T00:51:20.4452534Z [16,316 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:20.4453700Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:51:20.4454839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2024-12-18T00:51:20.4456132Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2024-12-18T00:51:20.4457341Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:51:20.4458290Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2024-12-18T00:51:20.4459147Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2024-12-18T00:51:20.4460000Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 7s local 2024-12-18T00:51:20.4460837Z Compiling xla/literal.cc; 7s local ... 2024-12-18T00:51:20.7173025Z 2024-12-18T00:51:20.7174027Z  2024-12-18T00:51:20.7174521Z  2024-12-18T00:51:20.7175147Z  2024-12-18T00:51:20.7175529Z  2024-12-18T00:51:20.7175930Z  2024-12-18T00:51:20.7176313Z  2024-12-18T00:51:20.7176850Z  2024-12-18T00:51:20.7177213Z  2024-12-18T00:51:20.7178399Z [16,321 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:20.7179549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:51:20.7180648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:51:20.7181895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:51:20.7182999Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local 2024-12-18T00:51:20.7183960Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2024-12-18T00:51:20.7184797Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2024-12-18T00:51:20.7185603Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 7s local 2024-12-18T00:51:20.7186368Z Compiling xla/literal.cc; 7s local ... 2024-12-18T00:51:20.9178126Z 2024-12-18T00:51:20.9179017Z  2024-12-18T00:51:20.9179449Z  2024-12-18T00:51:20.9179814Z  2024-12-18T00:51:20.9180195Z  2024-12-18T00:51:20.9180537Z  2024-12-18T00:51:20.9180898Z  2024-12-18T00:51:20.9181225Z  2024-12-18T00:51:20.9181582Z  2024-12-18T00:51:20.9182429Z [16,326 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:20.9183480Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:51:20.9184475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:51:20.9185457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:51:20.9186318Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local 2024-12-18T00:51:20.9187143Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2024-12-18T00:51:20.9187918Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2024-12-18T00:51:20.9188670Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 7s local 2024-12-18T00:51:20.9189377Z Compiling xla/literal.cc; 7s local ... 2024-12-18T00:51:21.2767807Z 2024-12-18T00:51:21.2768707Z  2024-12-18T00:51:21.2769172Z  2024-12-18T00:51:21.2769593Z  2024-12-18T00:51:21.2769989Z  2024-12-18T00:51:21.2770382Z  2024-12-18T00:51:21.2770738Z  2024-12-18T00:51:21.2771086Z  2024-12-18T00:51:21.2771432Z  2024-12-18T00:51:21.2772350Z [16,330 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:21.2773468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:51:21.2774547Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:51:21.2775621Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:51:21.2776720Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2024-12-18T00:51:21.2777572Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local 2024-12-18T00:51:21.2778358Z Compiling xla/literal.cc; 7s local 2024-12-18T00:51:21.2779251Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 5s local 2024-12-18T00:51:21.2780390Z Compiling .../preemption/preemption_sync_manager.cc; 5s local ... 2024-12-18T00:51:21.5184116Z 2024-12-18T00:51:21.5185009Z  2024-12-18T00:51:21.5185500Z  2024-12-18T00:51:21.5185929Z  2024-12-18T00:51:21.5186349Z  2024-12-18T00:51:21.5186761Z  2024-12-18T00:51:21.5187182Z  2024-12-18T00:51:21.5187735Z  2024-12-18T00:51:21.5188124Z  2024-12-18T00:51:21.5189057Z [16,330 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:21.5190199Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:51:21.5191607Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2024-12-18T00:51:21.5192714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2024-12-18T00:51:21.5193821Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2024-12-18T00:51:21.5194676Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local 2024-12-18T00:51:21.5195501Z Compiling xla/literal.cc; 8s local 2024-12-18T00:51:21.5196419Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 5s local 2024-12-18T00:51:21.5197713Z Compiling .../preemption/preemption_sync_manager.cc; 5s local ... 2024-12-18T00:51:21.7246820Z 2024-12-18T00:51:21.7247654Z  2024-12-18T00:51:21.7248151Z  2024-12-18T00:51:21.7248571Z  2024-12-18T00:51:21.7248994Z  2024-12-18T00:51:21.7249397Z  2024-12-18T00:51:21.7249822Z  2024-12-18T00:51:21.7250238Z  2024-12-18T00:51:21.7250659Z  2024-12-18T00:51:21.7251596Z [16,331 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:21.7252868Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:51:21.7254090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:51:21.7255284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:21.7256170Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2024-12-18T00:51:21.7257185Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local 2024-12-18T00:51:21.7257989Z Compiling xla/literal.cc; 8s local 2024-12-18T00:51:21.7258936Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 6s local 2024-12-18T00:51:21.7260139Z Compiling .../preemption/preemption_sync_manager.cc; 5s local ... 2024-12-18T00:51:21.9548770Z 2024-12-18T00:51:21.9549686Z  2024-12-18T00:51:21.9550313Z  2024-12-18T00:51:21.9550722Z  2024-12-18T00:51:21.9551111Z  2024-12-18T00:51:21.9551480Z  2024-12-18T00:51:21.9551879Z  2024-12-18T00:51:21.9552278Z  2024-12-18T00:51:21.9552668Z  2024-12-18T00:51:21.9553601Z [16,335 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:21.9554734Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:51:21.9555861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:51:21.9556977Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:21.9557892Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2024-12-18T00:51:21.9558737Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 8s local 2024-12-18T00:51:21.9559508Z Compiling xla/literal.cc; 8s local 2024-12-18T00:51:21.9560440Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 6s local 2024-12-18T00:51:21.9561327Z Compiling xla/layout.cc; 5s local ... 2024-12-18T00:51:22.3195133Z 2024-12-18T00:51:22.3196051Z  2024-12-18T00:51:22.3196540Z  2024-12-18T00:51:22.3196960Z  2024-12-18T00:51:22.3197370Z  2024-12-18T00:51:22.3197771Z  2024-12-18T00:51:22.3198211Z  2024-12-18T00:51:22.3198635Z  2024-12-18T00:51:22.3209354Z  2024-12-18T00:51:22.3210524Z [16,337 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:22.3211573Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:51:22.3212698Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2024-12-18T00:51:22.3213873Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2024-12-18T00:51:22.3214843Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2024-12-18T00:51:22.3215732Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:51:22.3216681Z Compiling xla/literal.cc; 9s local 2024-12-18T00:51:22.3217962Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 6s local 2024-12-18T00:51:22.3219075Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 6s local ... 2024-12-18T00:51:22.7088986Z 2024-12-18T00:51:22.7089910Z  2024-12-18T00:51:22.7090392Z  2024-12-18T00:51:22.7090798Z  2024-12-18T00:51:22.7091231Z  2024-12-18T00:51:22.7091633Z  2024-12-18T00:51:22.7092037Z  2024-12-18T00:51:22.7092437Z  2024-12-18T00:51:22.7092816Z  2024-12-18T00:51:22.7093997Z [16,340 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:22.7095292Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:51:22.7096613Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:51:22.7097755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:22.7098793Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2024-12-18T00:51:22.7099638Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:51:22.7100400Z Compiling xla/literal.cc; 9s local 2024-12-18T00:51:22.7101292Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 7s local 2024-12-18T00:51:22.7102413Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 6s local ... 2024-12-18T00:51:22.9201387Z 2024-12-18T00:51:22.9202365Z  2024-12-18T00:51:22.9202833Z  2024-12-18T00:51:22.9203319Z  2024-12-18T00:51:22.9203795Z  2024-12-18T00:51:22.9204208Z  2024-12-18T00:51:22.9204590Z  2024-12-18T00:51:22.9205034Z  2024-12-18T00:51:22.9205438Z  2024-12-18T00:51:22.9206423Z [16,342 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:22.9207637Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:51:22.9208726Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:51:22.9209861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:22.9210794Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2024-12-18T00:51:22.9211837Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:51:22.9212642Z Compiling xla/literal.cc; 9s local 2024-12-18T00:51:22.9213515Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 7s local 2024-12-18T00:51:22.9214517Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 6s local ... 2024-12-18T00:51:23.1205198Z 2024-12-18T00:51:23.1206113Z  2024-12-18T00:51:23.1206709Z  2024-12-18T00:51:23.1207176Z  2024-12-18T00:51:23.1207562Z  2024-12-18T00:51:23.1207967Z  2024-12-18T00:51:23.1208338Z  2024-12-18T00:51:23.1208722Z  2024-12-18T00:51:23.1209112Z  2024-12-18T00:51:23.1210096Z [16,344 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:23.1211339Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:51:23.1212490Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:51:23.1213639Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:23.1214589Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2024-12-18T00:51:23.1215459Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 9s local 2024-12-18T00:51:23.1216274Z Compiling xla/literal.cc; 9s local 2024-12-18T00:51:23.1217425Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 7s local 2024-12-18T00:51:23.1218439Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 6s local ... 2024-12-18T00:51:23.3795889Z 2024-12-18T00:51:23.3796785Z  2024-12-18T00:51:23.3797252Z  2024-12-18T00:51:23.3797672Z  2024-12-18T00:51:23.3798088Z  2024-12-18T00:51:23.3798477Z  2024-12-18T00:51:23.3799206Z  2024-12-18T00:51:23.3799608Z  2024-12-18T00:51:23.3800026Z  2024-12-18T00:51:23.3800978Z [16,345 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:23.3802295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:51:23.3803423Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2024-12-18T00:51:23.3804476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2024-12-18T00:51:23.3805294Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2024-12-18T00:51:23.3806241Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2024-12-18T00:51:23.3806957Z Compiling xla/literal.cc; 10s local 2024-12-18T00:51:23.3807855Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 7s local 2024-12-18T00:51:23.3808848Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 7s local ... 2024-12-18T00:51:23.7212031Z 2024-12-18T00:51:23.7213011Z  2024-12-18T00:51:23.7213511Z  2024-12-18T00:51:23.7213917Z  2024-12-18T00:51:23.7214342Z  2024-12-18T00:51:23.7214714Z  2024-12-18T00:51:23.7215106Z  2024-12-18T00:51:23.7215476Z  2024-12-18T00:51:23.7215830Z  2024-12-18T00:51:23.7217046Z [16,347 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:23.7218081Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:23.7219058Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:51:23.7220105Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:51:23.7221000Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2024-12-18T00:51:23.7221815Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2024-12-18T00:51:23.7222599Z Compiling xla/literal.cc; 10s local 2024-12-18T00:51:23.7223442Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:51:23.7224492Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 7s local ... 2024-12-18T00:51:23.9215973Z 2024-12-18T00:51:23.9217025Z  2024-12-18T00:51:23.9217561Z  2024-12-18T00:51:23.9217971Z  2024-12-18T00:51:23.9218352Z  2024-12-18T00:51:23.9218758Z  2024-12-18T00:51:23.9219140Z  2024-12-18T00:51:23.9219530Z  2024-12-18T00:51:23.9219955Z  2024-12-18T00:51:23.9220914Z [16,349 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:23.9222030Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:23.9223161Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:51:23.9224290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:51:23.9225273Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2024-12-18T00:51:23.9226191Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2024-12-18T00:51:23.9227024Z Compiling xla/literal.cc; 10s local 2024-12-18T00:51:23.9227975Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:51:23.9229097Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 7s local ... 2024-12-18T00:51:24.3221240Z 2024-12-18T00:51:24.3222275Z  2024-12-18T00:51:24.3222764Z  2024-12-18T00:51:24.3223163Z  2024-12-18T00:51:24.3223562Z  2024-12-18T00:51:24.3223954Z  2024-12-18T00:51:24.3224416Z  2024-12-18T00:51:24.3224827Z  2024-12-18T00:51:24.3225227Z  2024-12-18T00:51:24.3226198Z [16,351 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:24.3227374Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:24.3228512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:51:24.3229847Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:51:24.3230813Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2024-12-18T00:51:24.3231855Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:51:24.3232694Z Compiling xla/literal.cc; 11s local 2024-12-18T00:51:24.3233616Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:51:24.3234704Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 8s local ... 2024-12-18T00:51:24.5225759Z 2024-12-18T00:51:24.5227042Z  2024-12-18T00:51:24.5227528Z  2024-12-18T00:51:24.5227948Z  2024-12-18T00:51:24.5228370Z  2024-12-18T00:51:24.5228763Z  2024-12-18T00:51:24.5229144Z  2024-12-18T00:51:24.5229550Z  2024-12-18T00:51:24.5229930Z  2024-12-18T00:51:24.5230890Z [16,352 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:24.5232022Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:24.5233108Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2024-12-18T00:51:24.5234278Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2024-12-18T00:51:24.5235247Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2024-12-18T00:51:24.5236079Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:51:24.5236866Z Compiling xla/literal.cc; 11s local 2024-12-18T00:51:24.5237797Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2024-12-18T00:51:24.5238890Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 8s local ... 2024-12-18T00:51:24.7854979Z 2024-12-18T00:51:24.7856504Z  2024-12-18T00:51:24.7857362Z  2024-12-18T00:51:24.7858467Z  2024-12-18T00:51:24.7858908Z  2024-12-18T00:51:24.7859281Z  2024-12-18T00:51:24.7859652Z  2024-12-18T00:51:24.7860030Z  2024-12-18T00:51:24.7860439Z  2024-12-18T00:51:24.7861222Z [16,355 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:24.7862141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:51:24.7863046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:51:24.7864090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:24.7864932Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2024-12-18T00:51:24.7865856Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:51:24.7866610Z Compiling xla/literal.cc; 11s local 2024-12-18T00:51:24.7867437Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:51:24.7868504Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 8s local ... 2024-12-18T00:51:24.9928909Z 2024-12-18T00:51:24.9929801Z  2024-12-18T00:51:24.9930280Z  2024-12-18T00:51:24.9930657Z  2024-12-18T00:51:24.9931005Z  2024-12-18T00:51:24.9931379Z  2024-12-18T00:51:24.9931750Z  2024-12-18T00:51:24.9932122Z  2024-12-18T00:51:24.9932505Z  2024-12-18T00:51:24.9933377Z [16,360 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:24.9934438Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:51:24.9935570Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:51:24.9936767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:24.9937808Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:51:24.9938547Z Compiling xla/literal.cc; 11s local 2024-12-18T00:51:24.9939287Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:51:24.9940067Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 8s local 2024-12-18T00:51:24.9941094Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 8s local ... 2024-12-18T00:51:25.2464699Z 2024-12-18T00:51:25.2465690Z  2024-12-18T00:51:25.2466134Z  2024-12-18T00:51:25.2466979Z  2024-12-18T00:51:25.2467346Z  2024-12-18T00:51:25.2467853Z  2024-12-18T00:51:25.2468339Z  2024-12-18T00:51:25.2468833Z  2024-12-18T00:51:25.2469310Z  2024-12-18T00:51:25.2470390Z [16,361 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:25.2472026Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:51:25.2473366Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:51:25.2474514Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:25.2475604Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:51:25.2476405Z Compiling xla/literal.cc; 11s local 2024-12-18T00:51:25.2477287Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:51:25.2478242Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local 2024-12-18T00:51:25.2479231Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 8s local ... 2024-12-18T00:51:25.5229466Z 2024-12-18T00:51:25.5230329Z  2024-12-18T00:51:25.5230734Z  2024-12-18T00:51:25.5231059Z  2024-12-18T00:51:25.5231386Z  2024-12-18T00:51:25.5231704Z  2024-12-18T00:51:25.5232012Z  2024-12-18T00:51:25.5232386Z  2024-12-18T00:51:25.5232715Z  2024-12-18T00:51:25.5233501Z [16,363 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:25.5234459Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:51:25.5235360Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2024-12-18T00:51:25.5236293Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2024-12-18T00:51:25.5237341Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:51:25.5238025Z Compiling xla/literal.cc; 12s local 2024-12-18T00:51:25.5238805Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2024-12-18T00:51:25.5239659Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local 2024-12-18T00:51:25.5240421Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 8s local ... 2024-12-18T00:51:25.9236291Z 2024-12-18T00:51:25.9237243Z  2024-12-18T00:51:25.9239129Z  2024-12-18T00:51:25.9239597Z  2024-12-18T00:51:25.9239992Z  2024-12-18T00:51:25.9240384Z  2024-12-18T00:51:25.9240768Z  2024-12-18T00:51:25.9241176Z  2024-12-18T00:51:25.9241580Z  2024-12-18T00:51:25.9242559Z [16,367 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:25.9243797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:51:25.9245226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:51:25.9246382Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:51:25.9247577Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:51:25.9248397Z Compiling xla/literal.cc; 12s local 2024-12-18T00:51:25.9249354Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2024-12-18T00:51:25.9250443Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local 2024-12-18T00:51:25.9251359Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 8s local ... 2024-12-18T00:51:26.2070614Z 2024-12-18T00:51:26.2071615Z  2024-12-18T00:51:26.2072178Z  2024-12-18T00:51:26.2072803Z  2024-12-18T00:51:26.2073447Z  2024-12-18T00:51:26.2074047Z  2024-12-18T00:51:26.2074642Z  2024-12-18T00:51:26.2075584Z  2024-12-18T00:51:26.2076178Z  2024-12-18T00:51:26.2077322Z [16,369 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:26.2078869Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:51:26.2080224Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:51:26.2081564Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:51:26.2082964Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:51:26.2084071Z Compiling xla/literal.cc; 12s local 2024-12-18T00:51:26.2085191Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2024-12-18T00:51:26.2086453Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 10s local 2024-12-18T00:51:26.2087534Z ...//llvm:X86CommonTableGen__gen_instr_info_genrule; 9s local ... 2024-12-18T00:51:26.4161684Z 2024-12-18T00:51:26.4162692Z  2024-12-18T00:51:26.4163193Z  2024-12-18T00:51:26.4163561Z  2024-12-18T00:51:26.4165428Z  2024-12-18T00:51:26.4168237Z  2024-12-18T00:51:26.4171017Z  2024-12-18T00:51:26.4173724Z  2024-12-18T00:51:26.4176739Z  2024-12-18T00:51:26.4180076Z [16,371 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:26.4183425Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:51:26.4186889Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:51:26.4190040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:51:26.4193207Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:51:26.4196153Z Compiling xla/literal.cc; 13s local 2024-12-18T00:51:26.4199156Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2024-12-18T00:51:26.4200873Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 9s local 2024-12-18T00:51:26.4202107Z @llvm-project//llvm:X86CommonTableGen__gen_fast_isel_genrule; 6s local ... 2024-12-18T00:51:26.6346145Z 2024-12-18T00:51:26.6347121Z  2024-12-18T00:51:26.6347593Z  2024-12-18T00:51:26.6347987Z  2024-12-18T00:51:26.6348368Z  2024-12-18T00:51:26.6348767Z  2024-12-18T00:51:26.6349165Z  2024-12-18T00:51:26.6349525Z  2024-12-18T00:51:26.6349916Z  2024-12-18T00:51:26.6350852Z [16,374 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:26.6352052Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:26.6353144Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2024-12-18T00:51:26.6354130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2024-12-18T00:51:26.6355024Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:51:26.6355852Z Compiling xla/literal.cc; 13s local 2024-12-18T00:51:26.6356730Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 11s local 2024-12-18T00:51:26.6357911Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 9s local 2024-12-18T00:51:26.6358975Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 6s local ... 2024-12-18T00:51:26.9248323Z 2024-12-18T00:51:26.9249249Z  2024-12-18T00:51:26.9249738Z  2024-12-18T00:51:26.9250145Z  2024-12-18T00:51:26.9250557Z  2024-12-18T00:51:26.9251021Z  2024-12-18T00:51:26.9251403Z  2024-12-18T00:51:26.9251800Z  2024-12-18T00:51:26.9252200Z  2024-12-18T00:51:26.9253134Z [16,378 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:26.9254299Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:26.9255452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:51:26.9256987Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:51:26.9258252Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:51:26.9259088Z Compiling xla/literal.cc; 13s local 2024-12-18T00:51:26.9260030Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 11s local 2024-12-18T00:51:26.9261261Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 9s local 2024-12-18T00:51:26.9262516Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 7s local ... 2024-12-18T00:51:27.1424517Z 2024-12-18T00:51:27.1425421Z  2024-12-18T00:51:27.1425926Z  2024-12-18T00:51:27.1426334Z  2024-12-18T00:51:27.1426740Z  2024-12-18T00:51:27.1427271Z  2024-12-18T00:51:27.1427653Z  2024-12-18T00:51:27.1428017Z  2024-12-18T00:51:27.1428375Z  2024-12-18T00:51:27.1429261Z [16,380 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:27.1430434Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:27.1431579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:51:27.1432708Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:51:27.1433763Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:51:27.1434560Z Compiling xla/literal.cc; 13s local 2024-12-18T00:51:27.1435407Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local 2024-12-18T00:51:27.1436546Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 7s local 2024-12-18T00:51:27.1437399Z Compiling mlir/lib/IR/Operation.cpp; 7s local ... 2024-12-18T00:51:27.5256618Z 2024-12-18T00:51:27.5257581Z  2024-12-18T00:51:27.5258188Z  2024-12-18T00:51:27.5258586Z  2024-12-18T00:51:27.5258969Z  2024-12-18T00:51:27.5259391Z  2024-12-18T00:51:27.5259784Z  2024-12-18T00:51:27.5260170Z  2024-12-18T00:51:27.5260528Z  2024-12-18T00:51:27.5261487Z [16,382 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:27.5262569Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:27.5263663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2024-12-18T00:51:27.5264726Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2024-12-18T00:51:27.5265575Z Compiling xla/literal.cc; 14s local 2024-12-18T00:51:27.5266405Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local 2024-12-18T00:51:27.5267442Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 7s local 2024-12-18T00:51:27.5268272Z Compiling mlir/lib/IR/Operation.cpp; 7s local 2024-12-18T00:51:27.5269146Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 6s local ... 2024-12-18T00:51:27.8045607Z 2024-12-18T00:51:27.8046575Z  2024-12-18T00:51:27.8047087Z  2024-12-18T00:51:27.8047531Z  2024-12-18T00:51:27.8048048Z  2024-12-18T00:51:27.8048451Z  2024-12-18T00:51:27.8048837Z  2024-12-18T00:51:27.8049231Z  2024-12-18T00:51:27.8049615Z  2024-12-18T00:51:27.8050526Z [16,383 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:27.8051738Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:51:27.8052968Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:51:27.8054142Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:51:27.8055040Z Compiling xla/literal.cc; 14s local 2024-12-18T00:51:27.8055912Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local 2024-12-18T00:51:27.8057194Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:51:27.8058526Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 7s local 2024-12-18T00:51:27.8059655Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 7s local ... 2024-12-18T00:51:28.1258833Z 2024-12-18T00:51:28.1259776Z  2024-12-18T00:51:28.1260251Z  2024-12-18T00:51:28.1260653Z  2024-12-18T00:51:28.1261045Z  2024-12-18T00:51:28.1261605Z  2024-12-18T00:51:28.1261996Z  2024-12-18T00:51:28.1262413Z  2024-12-18T00:51:28.1262795Z  2024-12-18T00:51:28.1264146Z [16,383 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:28.1265361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:51:28.1266512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:51:28.1267622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:51:28.1268560Z Compiling xla/literal.cc; 14s local 2024-12-18T00:51:28.1269432Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2024-12-18T00:51:28.1270509Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:51:28.1271523Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 7s local 2024-12-18T00:51:28.1272534Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 7s local ... 2024-12-18T00:51:28.4431413Z 2024-12-18T00:51:28.4432418Z  2024-12-18T00:51:28.4432938Z  2024-12-18T00:51:28.4433395Z  2024-12-18T00:51:28.4433774Z  2024-12-18T00:51:28.4434129Z  2024-12-18T00:51:28.4434491Z  2024-12-18T00:51:28.4434939Z  2024-12-18T00:51:28.4435364Z  2024-12-18T00:51:28.4436371Z [16,384 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:28.4437616Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:51:28.4438668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2024-12-18T00:51:28.4439683Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2024-12-18T00:51:28.4440456Z Compiling xla/literal.cc; 15s local 2024-12-18T00:51:28.4441249Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2024-12-18T00:51:28.4442198Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:51:28.4443093Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 7s local 2024-12-18T00:51:28.4444059Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 7s local ... 2024-12-18T00:51:28.7265142Z 2024-12-18T00:51:28.7266183Z  2024-12-18T00:51:28.7266686Z  2024-12-18T00:51:28.7267131Z  2024-12-18T00:51:28.7267651Z  2024-12-18T00:51:28.7268011Z  2024-12-18T00:51:28.7268353Z  2024-12-18T00:51:28.7268742Z  2024-12-18T00:51:28.7269147Z  2024-12-18T00:51:28.7270148Z [16,384 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:28.7271342Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:28.7272544Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:51:28.7273659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:28.7274534Z Compiling xla/literal.cc; 15s local 2024-12-18T00:51:28.7275373Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2024-12-18T00:51:28.7276437Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 8s local 2024-12-18T00:51:28.7277451Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 8s local 2024-12-18T00:51:28.7278442Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 7s local ... 2024-12-18T00:51:28.9818914Z 2024-12-18T00:51:28.9819962Z  2024-12-18T00:51:28.9820467Z  2024-12-18T00:51:28.9821132Z  2024-12-18T00:51:28.9821471Z  2024-12-18T00:51:28.9821785Z  2024-12-18T00:51:28.9822119Z  2024-12-18T00:51:28.9822455Z  2024-12-18T00:51:28.9822784Z  2024-12-18T00:51:28.9823700Z [16,385 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:28.9824626Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:28.9825521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:51:28.9826523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:28.9827308Z Compiling xla/literal.cc; 15s local 2024-12-18T00:51:28.9827995Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2024-12-18T00:51:28.9828834Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:51:28.9829609Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 8s local 2024-12-18T00:51:28.9830411Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 8s local ... 2024-12-18T00:51:29.2253907Z 2024-12-18T00:51:29.2254900Z  2024-12-18T00:51:29.2255431Z  2024-12-18T00:51:29.2255859Z  2024-12-18T00:51:29.2256272Z  2024-12-18T00:51:29.2256776Z  2024-12-18T00:51:29.2257193Z  2024-12-18T00:51:29.2257579Z  2024-12-18T00:51:29.2257982Z  2024-12-18T00:51:29.2258928Z [16,387 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:29.2260324Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:29.2261505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:51:29.2262648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:29.2263528Z Compiling xla/literal.cc; 15s local 2024-12-18T00:51:29.2264395Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:51:29.2265470Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:51:29.2266476Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 8s local 2024-12-18T00:51:29.2267456Z Compiling llvm/lib/Analysis/MLInlineAdvisor.cpp; 8s local ... 2024-12-18T00:51:29.4300835Z 2024-12-18T00:51:29.4301882Z  2024-12-18T00:51:29.4302394Z  2024-12-18T00:51:29.4302848Z  2024-12-18T00:51:29.4303243Z  2024-12-18T00:51:29.4303643Z  2024-12-18T00:51:29.4304043Z  2024-12-18T00:51:29.4304497Z  2024-12-18T00:51:29.4304917Z  2024-12-18T00:51:29.4305791Z [16,388 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:29.4307048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:29.4308175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2024-12-18T00:51:29.4309285Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:29.4310184Z Compiling xla/literal.cc; 16s local 2024-12-18T00:51:29.4310989Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:51:29.4311916Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:51:29.4313048Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 8s local 2024-12-18T00:51:29.4314224Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local ... 2024-12-18T00:51:29.6621891Z 2024-12-18T00:51:29.6622818Z  2024-12-18T00:51:29.6623292Z  2024-12-18T00:51:29.6623673Z  2024-12-18T00:51:29.6624059Z  2024-12-18T00:51:29.6624443Z  2024-12-18T00:51:29.6624834Z  2024-12-18T00:51:29.6625202Z  2024-12-18T00:51:29.6625553Z  2024-12-18T00:51:29.6626472Z [16,392 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:29.6627888Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:29.6629021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:51:29.6630269Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2024-12-18T00:51:29.6631144Z Compiling xla/literal.cc; 16s local 2024-12-18T00:51:29.6631968Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:51:29.6633051Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 9s local 2024-12-18T00:51:29.6634252Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 9s local 2024-12-18T00:51:29.6635255Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local ... 2024-12-18T00:51:29.9274429Z 2024-12-18T00:51:29.9275439Z  2024-12-18T00:51:29.9275941Z  2024-12-18T00:51:29.9276359Z  2024-12-18T00:51:29.9276756Z  2024-12-18T00:51:29.9277131Z  2024-12-18T00:51:29.9277526Z  2024-12-18T00:51:29.9277932Z  2024-12-18T00:51:29.9278368Z  2024-12-18T00:51:29.9279223Z [16,393 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:29.9280387Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:29.9281561Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:51:29.9282739Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:51:29.9283660Z Compiling xla/literal.cc; 16s local 2024-12-18T00:51:29.9284596Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2024-12-18T00:51:29.9285696Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:51:29.9286712Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 9s local 2024-12-18T00:51:29.9287745Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local ... 2024-12-18T00:51:30.3247182Z 2024-12-18T00:51:30.3248233Z  2024-12-18T00:51:30.3248753Z  2024-12-18T00:51:30.3249196Z  2024-12-18T00:51:30.3249541Z  2024-12-18T00:51:30.3249922Z  2024-12-18T00:51:30.3250311Z  2024-12-18T00:51:30.3250717Z  2024-12-18T00:51:30.3251092Z  2024-12-18T00:51:30.3252017Z [16,396 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:30.3253242Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:30.3254380Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:51:30.3255589Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:51:30.3256565Z Compiling xla/literal.cc; 17s local 2024-12-18T00:51:30.3257387Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:51:30.3258458Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:51:30.3259399Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 9s local 2024-12-18T00:51:30.3260404Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local ... 2024-12-18T00:51:30.5281471Z 2024-12-18T00:51:30.5282374Z  2024-12-18T00:51:30.5282865Z  2024-12-18T00:51:30.5283241Z  2024-12-18T00:51:30.5283633Z  2024-12-18T00:51:30.5284020Z  2024-12-18T00:51:30.5284405Z  2024-12-18T00:51:30.5284775Z  2024-12-18T00:51:30.5285191Z  2024-12-18T00:51:30.5286135Z [16,399 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:30.5287352Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:30.5288507Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2024-12-18T00:51:30.5289656Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2024-12-18T00:51:30.5290507Z Compiling xla/literal.cc; 17s local 2024-12-18T00:51:30.5291645Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:51:30.5292733Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:51:30.5294001Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 9s local 2024-12-18T00:51:30.5295073Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local ... 2024-12-18T00:51:30.7286943Z 2024-12-18T00:51:30.7287909Z  2024-12-18T00:51:30.7288373Z  2024-12-18T00:51:30.7288761Z  2024-12-18T00:51:30.7289468Z  2024-12-18T00:51:30.7289963Z  2024-12-18T00:51:30.7290351Z  2024-12-18T00:51:30.7290758Z  2024-12-18T00:51:30.7291139Z  2024-12-18T00:51:30.7292098Z [16,402 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:30.7293273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:30.7294452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:51:30.7295596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:51:30.7296616Z Compiling xla/literal.cc; 17s local 2024-12-18T00:51:30.7297500Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:51:30.7298564Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local 2024-12-18T00:51:30.7299584Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 10s local 2024-12-18T00:51:30.7300681Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local ... 2024-12-18T00:51:31.1000715Z 2024-12-18T00:51:31.1001606Z  2024-12-18T00:51:31.1001997Z  2024-12-18T00:51:31.1002378Z  2024-12-18T00:51:31.1002767Z  2024-12-18T00:51:31.1003179Z  2024-12-18T00:51:31.1003575Z  2024-12-18T00:51:31.1003943Z  2024-12-18T00:51:31.1004325Z  2024-12-18T00:51:31.1005346Z [16,404 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:31.1006499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:31.1007559Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:51:31.1008587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:51:31.1009400Z Compiling xla/literal.cc; 17s local 2024-12-18T00:51:31.1010198Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2024-12-18T00:51:31.1011277Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 10s local 2024-12-18T00:51:31.1012284Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:51:31.1013258Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local ... 2024-12-18T00:51:31.3291256Z 2024-12-18T00:51:31.3292196Z  2024-12-18T00:51:31.3292683Z  2024-12-18T00:51:31.3293072Z  2024-12-18T00:51:31.3293520Z  2024-12-18T00:51:31.3293860Z  2024-12-18T00:51:31.3294282Z  2024-12-18T00:51:31.3294701Z  2024-12-18T00:51:31.3295089Z  2024-12-18T00:51:31.3295957Z [16,406 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:31.3297238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:31.3298279Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:51:31.3299268Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:51:31.3300036Z Compiling xla/literal.cc; 18s local 2024-12-18T00:51:31.3300797Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2024-12-18T00:51:31.3301776Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 10s local 2024-12-18T00:51:31.3302760Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:51:31.3304032Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local ... 2024-12-18T00:51:31.5294624Z 2024-12-18T00:51:31.5295584Z  2024-12-18T00:51:31.5296088Z  2024-12-18T00:51:31.5296610Z  2024-12-18T00:51:31.5297286Z  2024-12-18T00:51:31.5297696Z  2024-12-18T00:51:31.5298081Z  2024-12-18T00:51:31.5298521Z  2024-12-18T00:51:31.5299055Z  2024-12-18T00:51:31.5299967Z [16,409 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:51:31.5301312Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:31.5302506Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2024-12-18T00:51:31.5303533Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2024-12-18T00:51:31.5304319Z Compiling xla/literal.cc; 18s local 2024-12-18T00:51:31.5305100Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2024-12-18T00:51:31.5306122Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:51:31.5307075Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2024-12-18T00:51:31.5307812Z @llvm-project//llvm:Vectorize; 9s local ... 2024-12-18T00:51:31.9304921Z 2024-12-18T00:51:31.9305824Z  2024-12-18T00:51:31.9306280Z  2024-12-18T00:51:31.9306669Z  2024-12-18T00:51:31.9307058Z  2024-12-18T00:51:31.9307390Z  2024-12-18T00:51:31.9307743Z  2024-12-18T00:51:31.9308125Z  2024-12-18T00:51:31.9308575Z  2024-12-18T00:51:31.9309455Z [16,409 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:31.9310573Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:51:31.9311558Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:51:31.9312576Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:51:31.9313429Z Compiling xla/literal.cc; 18s local 2024-12-18T00:51:31.9314235Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2024-12-18T00:51:31.9315228Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:51:31.9316111Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2024-12-18T00:51:31.9316834Z @llvm-project//llvm:Vectorize; 9s local ... 2024-12-18T00:51:32.1593756Z 2024-12-18T00:51:32.1594720Z  2024-12-18T00:51:32.1595170Z  2024-12-18T00:51:32.1595599Z  2024-12-18T00:51:32.1595995Z  2024-12-18T00:51:32.1596387Z  2024-12-18T00:51:32.1596754Z  2024-12-18T00:51:32.1597134Z  2024-12-18T00:51:32.1597492Z  2024-12-18T00:51:32.1598352Z [16,410 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:32.1599582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:51:32.1600590Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:51:32.1601579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:51:32.1602384Z Compiling xla/literal.cc; 18s local 2024-12-18T00:51:32.1603132Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 15s local 2024-12-18T00:51:32.1604085Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:51:32.1605086Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2024-12-18T00:51:32.1605800Z @llvm-project//llvm:Vectorize; 9s local ... 2024-12-18T00:51:32.5306406Z 2024-12-18T00:51:32.5307280Z  2024-12-18T00:51:32.5307777Z  2024-12-18T00:51:32.5308175Z  2024-12-18T00:51:32.5308586Z  2024-12-18T00:51:32.5308965Z  2024-12-18T00:51:32.5309349Z  2024-12-18T00:51:32.5309742Z  2024-12-18T00:51:32.5310107Z  2024-12-18T00:51:32.5311053Z [16,412 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:32.5312241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:51:32.5313618Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2024-12-18T00:51:32.5314712Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2024-12-18T00:51:32.5315500Z Compiling xla/literal.cc; 19s local 2024-12-18T00:51:32.5316490Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 15s local 2024-12-18T00:51:32.5317638Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:51:32.5318608Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2024-12-18T00:51:32.5319566Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 9s local ... 2024-12-18T00:51:32.9311480Z 2024-12-18T00:51:32.9312354Z  2024-12-18T00:51:32.9312833Z  2024-12-18T00:51:32.9313232Z  2024-12-18T00:51:32.9313649Z  2024-12-18T00:51:32.9314035Z  2024-12-18T00:51:32.9314404Z  2024-12-18T00:51:32.9314785Z  2024-12-18T00:51:32.9315170Z  2024-12-18T00:51:32.9316123Z [16,415 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:32.9317256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:51:32.9318374Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:51:32.9319548Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:51:32.9320548Z Compiling xla/literal.cc; 19s local 2024-12-18T00:51:32.9321322Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:51:32.9322248Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2024-12-18T00:51:32.9323122Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2024-12-18T00:51:32.9324089Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 9s local ... 2024-12-18T00:51:33.2683280Z 2024-12-18T00:51:33.2685167Z  2024-12-18T00:51:33.2685678Z  2024-12-18T00:51:33.2686111Z  2024-12-18T00:51:33.2686522Z  2024-12-18T00:51:33.2686910Z  2024-12-18T00:51:33.2687265Z  2024-12-18T00:51:33.2687619Z  2024-12-18T00:51:33.2687979Z  2024-12-18T00:51:33.2688849Z [16,418 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:33.2690341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:51:33.2691467Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:51:33.2692566Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:51:33.2693437Z Compiling xla/literal.cc; 19s local 2024-12-18T00:51:33.2694258Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:51:33.2695354Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:51:33.2696550Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2024-12-18T00:51:33.2697632Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 10s local ... 2024-12-18T00:51:33.5202920Z 2024-12-18T00:51:33.5203827Z  2024-12-18T00:51:33.5204297Z  2024-12-18T00:51:33.5204664Z  2024-12-18T00:51:33.5205022Z  2024-12-18T00:51:33.5205416Z  2024-12-18T00:51:33.5205806Z  2024-12-18T00:51:33.5206194Z  2024-12-18T00:51:33.5206603Z  2024-12-18T00:51:33.5207467Z [16,420 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:33.5208604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:51:33.5209887Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2024-12-18T00:51:33.5210967Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2024-12-18T00:51:33.5211763Z Compiling xla/literal.cc; 20s local 2024-12-18T00:51:33.5212502Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:51:33.5213638Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:51:33.5214582Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2024-12-18T00:51:33.5215595Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 10s local ... 2024-12-18T00:51:33.7318057Z 2024-12-18T00:51:33.7319061Z  2024-12-18T00:51:33.7319854Z  2024-12-18T00:51:33.7320240Z  2024-12-18T00:51:33.7320618Z  2024-12-18T00:51:33.7320992Z  2024-12-18T00:51:33.7321342Z  2024-12-18T00:51:33.7321694Z  2024-12-18T00:51:33.7322061Z  2024-12-18T00:51:33.7322925Z [16,421 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:33.7324035Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:51:33.7325128Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:51:33.7326206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:51:33.7326965Z Compiling xla/literal.cc; 20s local 2024-12-18T00:51:33.7327697Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:51:33.7328651Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:51:33.7329581Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2024-12-18T00:51:33.7342307Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 10s local ... 2024-12-18T00:51:33.9324403Z 2024-12-18T00:51:33.9325257Z  2024-12-18T00:51:33.9325672Z  2024-12-18T00:51:33.9326018Z  2024-12-18T00:51:33.9326352Z  2024-12-18T00:51:33.9326692Z  2024-12-18T00:51:33.9327011Z  2024-12-18T00:51:33.9327342Z  2024-12-18T00:51:33.9327679Z  2024-12-18T00:51:33.9328487Z [16,423 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:33.9329515Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:51:33.9330468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:51:33.9331442Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:51:33.9332554Z Compiling xla/literal.cc; 20s local 2024-12-18T00:51:33.9333268Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:51:33.9334233Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2024-12-18T00:51:33.9335077Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2024-12-18T00:51:33.9335864Z Compiling mlir/lib/AsmParser/Parser.cpp; 9s local ... 2024-12-18T00:51:34.4949165Z 2024-12-18T00:51:34.4950030Z  2024-12-18T00:51:34.4950443Z  2024-12-18T00:51:34.4950771Z  2024-12-18T00:51:34.4951106Z  2024-12-18T00:51:34.4951443Z  2024-12-18T00:51:34.4951774Z  2024-12-18T00:51:34.4952096Z  2024-12-18T00:51:34.4952441Z  2024-12-18T00:51:34.4953255Z [16,424 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:34.4954245Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:51:34.4955217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2024-12-18T00:51:34.4956178Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2024-12-18T00:51:34.4956893Z Compiling xla/literal.cc; 21s local 2024-12-18T00:51:34.4957702Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:51:34.4958503Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:51:34.4959320Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2024-12-18T00:51:34.4960136Z Compiling mlir/lib/AsmParser/Parser.cpp; 9s local ... 2024-12-18T00:51:34.7332097Z 2024-12-18T00:51:34.7332989Z  2024-12-18T00:51:34.7333455Z  2024-12-18T00:51:34.7334183Z  2024-12-18T00:51:34.7334585Z  2024-12-18T00:51:34.7334966Z  2024-12-18T00:51:34.7335346Z  2024-12-18T00:51:34.7335745Z  2024-12-18T00:51:34.7336148Z  2024-12-18T00:51:34.7337235Z [16,427 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:34.7338758Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:34.7339901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:51:34.7340994Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:51:34.7341842Z Compiling xla/literal.cc; 21s local 2024-12-18T00:51:34.7342629Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:51:34.7343604Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:51:34.7345090Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2024-12-18T00:51:34.7346037Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local ... 2024-12-18T00:51:34.9336077Z 2024-12-18T00:51:34.9337138Z  2024-12-18T00:51:34.9337623Z  2024-12-18T00:51:34.9338003Z  2024-12-18T00:51:34.9338414Z  2024-12-18T00:51:34.9338795Z  2024-12-18T00:51:34.9339174Z  2024-12-18T00:51:34.9339592Z  2024-12-18T00:51:34.9339985Z  2024-12-18T00:51:34.9340912Z [16,430 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:34.9342035Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:34.9343156Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:51:34.9344516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:51:34.9345390Z Compiling xla/literal.cc; 21s local 2024-12-18T00:51:34.9346198Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:51:34.9347166Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2024-12-18T00:51:34.9348092Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2024-12-18T00:51:34.9349037Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local ... 2024-12-18T00:51:35.1972823Z 2024-12-18T00:51:35.1973712Z  2024-12-18T00:51:35.1974205Z  2024-12-18T00:51:35.1974586Z  2024-12-18T00:51:35.1974978Z  2024-12-18T00:51:35.1975357Z  2024-12-18T00:51:35.1975749Z  2024-12-18T00:51:35.1976144Z  2024-12-18T00:51:35.1976678Z  2024-12-18T00:51:35.1977638Z [16,432 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:35.1978965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:35.1980134Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:51:35.1981313Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:51:35.1982231Z Compiling xla/literal.cc; 21s local 2024-12-18T00:51:35.1983054Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:51:35.1984126Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2024-12-18T00:51:35.1985134Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local 2024-12-18T00:51:35.1985918Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local ... 2024-12-18T00:51:35.5341533Z 2024-12-18T00:51:35.5342409Z  2024-12-18T00:51:35.5342906Z  2024-12-18T00:51:35.5343308Z  2024-12-18T00:51:35.5343686Z  2024-12-18T00:51:35.5344065Z  2024-12-18T00:51:35.5344659Z  2024-12-18T00:51:35.5345041Z  2024-12-18T00:51:35.5345398Z  2024-12-18T00:51:35.5346323Z [16,432 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:35.5347821Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:35.5348963Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2024-12-18T00:51:35.5350081Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2024-12-18T00:51:35.5350998Z Compiling xla/literal.cc; 22s local 2024-12-18T00:51:35.5351993Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:51:35.5353210Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2024-12-18T00:51:35.5354185Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local 2024-12-18T00:51:35.5355008Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local ... 2024-12-18T00:51:35.8224374Z 2024-12-18T00:51:35.8225300Z  2024-12-18T00:51:35.8225796Z  2024-12-18T00:51:35.8226207Z  2024-12-18T00:51:35.8226610Z  2024-12-18T00:51:35.8227025Z  2024-12-18T00:51:35.8227406Z  2024-12-18T00:51:35.8227793Z  2024-12-18T00:51:35.8228203Z  2024-12-18T00:51:35.8229181Z [16,433 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:35.8230398Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:51:35.8231530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:51:35.8232718Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:51:35.8233613Z Compiling xla/literal.cc; 22s local 2024-12-18T00:51:35.8234485Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:51:35.8235578Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:51:35.8236575Z Compiling mlir/lib/AsmParser/Parser.cpp; 11s local 2024-12-18T00:51:35.8237384Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local ... 2024-12-18T00:51:36.1347668Z 2024-12-18T00:51:36.1348539Z  2024-12-18T00:51:36.1348980Z  2024-12-18T00:51:36.1349377Z  2024-12-18T00:51:36.1349952Z  2024-12-18T00:51:36.1350341Z  2024-12-18T00:51:36.1350720Z  2024-12-18T00:51:36.1351129Z  2024-12-18T00:51:36.1351546Z  2024-12-18T00:51:36.1352466Z [16,435 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:36.1354033Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:51:36.1355188Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:51:36.1356369Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:51:36.1357276Z Compiling xla/literal.cc; 22s local 2024-12-18T00:51:36.1358105Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:51:36.1359223Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:51:36.1360150Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2024-12-18T00:51:36.1361028Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local ... 2024-12-18T00:51:36.5024129Z 2024-12-18T00:51:36.5025041Z  2024-12-18T00:51:36.5025456Z  2024-12-18T00:51:36.5025790Z  2024-12-18T00:51:36.5026137Z  2024-12-18T00:51:36.5026454Z  2024-12-18T00:51:36.5026818Z  2024-12-18T00:51:36.5027146Z  2024-12-18T00:51:36.5027492Z  2024-12-18T00:51:36.5028307Z [16,438 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:36.5029294Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:51:36.5030249Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2024-12-18T00:51:36.5031393Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2024-12-18T00:51:36.5032348Z Compiling xla/literal.cc; 23s local 2024-12-18T00:51:36.5033063Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:51:36.5034337Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:51:36.5035163Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2024-12-18T00:51:36.5035972Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local ... 2024-12-18T00:51:36.7353630Z 2024-12-18T00:51:36.7354547Z  2024-12-18T00:51:36.7355318Z  2024-12-18T00:51:36.7355890Z  2024-12-18T00:51:36.7356360Z  2024-12-18T00:51:36.7356766Z  2024-12-18T00:51:36.7357159Z  2024-12-18T00:51:36.7357547Z  2024-12-18T00:51:36.7357966Z  2024-12-18T00:51:36.7358912Z [16,441 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:36.7360151Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:51:36.7361318Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:51:36.7362513Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:36.7363459Z Compiling xla/literal.cc; 23s local 2024-12-18T00:51:36.7364352Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:51:36.7365509Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:51:36.7366543Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:51:36.7367417Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:51:36.9362433Z 2024-12-18T00:51:36.9363320Z  2024-12-18T00:51:36.9363836Z  2024-12-18T00:51:36.9364219Z  2024-12-18T00:51:36.9364585Z  2024-12-18T00:51:36.9364948Z  2024-12-18T00:51:36.9365298Z  2024-12-18T00:51:36.9365814Z  2024-12-18T00:51:36.9366203Z  2024-12-18T00:51:36.9367114Z [16,444 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:36.9368357Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:51:36.9369493Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:51:36.9370656Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:36.9371484Z Compiling xla/literal.cc; 23s local 2024-12-18T00:51:36.9372791Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2024-12-18T00:51:36.9373768Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:51:36.9374567Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:51:36.9375359Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local ... 2024-12-18T00:51:37.1487213Z 2024-12-18T00:51:37.1488172Z  2024-12-18T00:51:37.1488660Z  2024-12-18T00:51:37.1489055Z  2024-12-18T00:51:37.1489530Z  2024-12-18T00:51:37.1489907Z  2024-12-18T00:51:37.1490284Z  2024-12-18T00:51:37.1490747Z  2024-12-18T00:51:37.1491155Z  2024-12-18T00:51:37.1492195Z [16,445 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:37.1493431Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:51:37.1494593Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:51:37.1495778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:37.1496811Z Compiling xla/literal.cc; 23s local 2024-12-18T00:51:37.1497715Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2024-12-18T00:51:37.1498737Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:51:37.1499602Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:51:37.1500350Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local ... 2024-12-18T00:51:37.3752025Z 2024-12-18T00:51:37.3752957Z  2024-12-18T00:51:37.3753435Z  2024-12-18T00:51:37.3753816Z  2024-12-18T00:51:37.3754208Z  2024-12-18T00:51:37.3754872Z  2024-12-18T00:51:37.3755302Z  2024-12-18T00:51:37.3755707Z  2024-12-18T00:51:37.3756092Z  2024-12-18T00:51:37.3756985Z [16,448 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:37.3758427Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:51:37.3759580Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2024-12-18T00:51:37.3760773Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:37.3761592Z Compiling xla/literal.cc; 24s local 2024-12-18T00:51:37.3762309Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:51:37.3763098Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:51:37.3763805Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2024-12-18T00:51:37.3764672Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local ... 2024-12-18T00:51:37.6631025Z 2024-12-18T00:51:37.6631932Z  2024-12-18T00:51:37.6632401Z  2024-12-18T00:51:37.6632808Z  2024-12-18T00:51:37.6633240Z  2024-12-18T00:51:37.6633633Z  2024-12-18T00:51:37.6634037Z  2024-12-18T00:51:37.6634447Z  2024-12-18T00:51:37.6634819Z  2024-12-18T00:51:37.6635788Z [16,452 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:37.6636897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:51:37.6638128Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:51:37.6639099Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2024-12-18T00:51:37.6639918Z Compiling xla/literal.cc; 24s local 2024-12-18T00:51:37.6640630Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:51:37.6641420Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:51:37.6642231Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:51:37.6643195Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 8s local ... 2024-12-18T00:51:37.9334039Z 2024-12-18T00:51:37.9334995Z  2024-12-18T00:51:37.9335819Z  2024-12-18T00:51:37.9336207Z  2024-12-18T00:51:37.9336829Z  2024-12-18T00:51:37.9337232Z  2024-12-18T00:51:37.9337600Z  2024-12-18T00:51:37.9337969Z  2024-12-18T00:51:37.9338336Z  2024-12-18T00:51:37.9339451Z [16,454 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:37.9340649Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:51:37.9341820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:51:37.9342938Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:51:37.9343859Z Compiling xla/literal.cc; 24s local 2024-12-18T00:51:37.9344864Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:51:37.9345665Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:51:37.9346606Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:51:37.9347785Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 8s local ... 2024-12-18T00:51:38.1362933Z 2024-12-18T00:51:38.1363815Z  2024-12-18T00:51:38.1364327Z  2024-12-18T00:51:38.1364737Z  2024-12-18T00:51:38.1365092Z  2024-12-18T00:51:38.1365477Z  2024-12-18T00:51:38.1365873Z  2024-12-18T00:51:38.1366333Z  2024-12-18T00:51:38.1366769Z  2024-12-18T00:51:38.1367767Z [16,454 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:38.1368934Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:51:38.1370417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:51:38.1371521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:51:38.1372431Z Compiling xla/literal.cc; 24s local 2024-12-18T00:51:38.1373232Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:51:38.1374229Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:51:38.1375130Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:51:38.1376193Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 8s local ... 2024-12-18T00:51:38.4906159Z 2024-12-18T00:51:38.4907002Z  2024-12-18T00:51:38.4907470Z  2024-12-18T00:51:38.4907846Z  2024-12-18T00:51:38.4908271Z  2024-12-18T00:51:38.4908649Z  2024-12-18T00:51:38.4909028Z  2024-12-18T00:51:38.4909395Z  2024-12-18T00:51:38.4909735Z  2024-12-18T00:51:38.4910646Z [16,456 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:38.4911902Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:51:38.4912976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2024-12-18T00:51:38.4914093Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2024-12-18T00:51:38.4914959Z Compiling xla/literal.cc; 25s local 2024-12-18T00:51:38.4915711Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:51:38.4916522Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:38.4917364Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:51:38.4918356Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 9s local ... 2024-12-18T00:51:38.7369095Z 2024-12-18T00:51:38.7369972Z  2024-12-18T00:51:38.7370450Z  2024-12-18T00:51:38.7370847Z  2024-12-18T00:51:38.7371245Z  2024-12-18T00:51:38.7371632Z  2024-12-18T00:51:38.7372016Z  2024-12-18T00:51:38.7372385Z  2024-12-18T00:51:38.7372747Z  2024-12-18T00:51:38.7373631Z [16,459 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:38.7374804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:51:38.7376308Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:51:38.7377521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:51:38.7378337Z Compiling xla/literal.cc; 25s local 2024-12-18T00:51:38.7379050Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:51:38.7379827Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:38.7380639Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:51:38.7381642Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 9s local ... 2024-12-18T00:51:38.9373237Z 2024-12-18T00:51:38.9374174Z  2024-12-18T00:51:38.9374676Z  2024-12-18T00:51:38.9375085Z  2024-12-18T00:51:38.9375479Z  2024-12-18T00:51:38.9375869Z  2024-12-18T00:51:38.9376262Z  2024-12-18T00:51:38.9376840Z  2024-12-18T00:51:38.9377225Z  2024-12-18T00:51:38.9378237Z [16,460 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:38.9379449Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:51:38.9380565Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:51:38.9381635Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:51:38.9382472Z Compiling xla/literal.cc; 25s local 2024-12-18T00:51:38.9383149Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:51:38.9383949Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:38.9385169Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:51:38.9386236Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 9s local ... 2024-12-18T00:51:39.3690851Z 2024-12-18T00:51:39.3691781Z  2024-12-18T00:51:39.3692284Z  2024-12-18T00:51:39.3692726Z  2024-12-18T00:51:39.3693108Z  2024-12-18T00:51:39.3693518Z  2024-12-18T00:51:39.3694245Z  2024-12-18T00:51:39.3694680Z  2024-12-18T00:51:39.3695066Z  2024-12-18T00:51:39.3695994Z [16,461 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:39.3697325Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:51:39.3698436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2024-12-18T00:51:39.3699568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2024-12-18T00:51:39.3700432Z Compiling xla/literal.cc; 26s local 2024-12-18T00:51:39.3701151Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:51:39.3701919Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:39.3702798Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:51:39.3703922Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 10s local ... 2024-12-18T00:51:39.7380762Z 2024-12-18T00:51:39.7381595Z  2024-12-18T00:51:39.7382015Z  2024-12-18T00:51:39.7382356Z  2024-12-18T00:51:39.7382849Z  2024-12-18T00:51:39.7383228Z  2024-12-18T00:51:39.7383585Z  2024-12-18T00:51:39.7383951Z  2024-12-18T00:51:39.7384319Z  2024-12-18T00:51:39.7385153Z [16,462 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:39.7386209Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:51:39.7387208Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:51:39.7388237Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:39.7389075Z Compiling xla/literal.cc; 26s local 2024-12-18T00:51:39.7389729Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:51:39.7390764Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:51:39.7391548Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:51:39.7392524Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 10s local ... 2024-12-18T00:51:39.9384133Z 2024-12-18T00:51:39.9384978Z  2024-12-18T00:51:39.9385405Z  2024-12-18T00:51:39.9385745Z  2024-12-18T00:51:39.9386095Z  2024-12-18T00:51:39.9386436Z  2024-12-18T00:51:39.9386815Z  2024-12-18T00:51:39.9387168Z  2024-12-18T00:51:39.9387493Z  2024-12-18T00:51:39.9388331Z [16,464 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:39.9389396Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:51:39.9390413Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:51:39.9391403Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:39.9392177Z Compiling xla/literal.cc; 26s local 2024-12-18T00:51:39.9392848Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:51:39.9393525Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:51:39.9394298Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:51:39.9395248Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 10s local ... 2024-12-18T00:51:40.2931822Z 2024-12-18T00:51:40.2932670Z  2024-12-18T00:51:40.2933155Z  2024-12-18T00:51:40.2933588Z  2024-12-18T00:51:40.2934005Z  2024-12-18T00:51:40.2934419Z  2024-12-18T00:51:40.2934824Z  2024-12-18T00:51:40.2935242Z  2024-12-18T00:51:40.2935915Z  2024-12-18T00:51:40.2937038Z [16,466 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:40.2938304Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:51:40.2939678Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:51:40.2941001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:40.2941963Z Compiling xla/literal.cc; 27s local 2024-12-18T00:51:40.2942746Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:51:40.2943600Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:51:40.2944716Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:40.2945914Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 11s local ... 2024-12-18T00:51:40.5391164Z 2024-12-18T00:51:40.5392052Z  2024-12-18T00:51:40.5392567Z  2024-12-18T00:51:40.5392987Z  2024-12-18T00:51:40.5393371Z  2024-12-18T00:51:40.5393784Z  2024-12-18T00:51:40.5394193Z  2024-12-18T00:51:40.5394570Z  2024-12-18T00:51:40.5394954Z  2024-12-18T00:51:40.5395944Z [16,468 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:40.5397226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:51:40.5398417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2024-12-18T00:51:40.5399599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2024-12-18T00:51:40.5400433Z Compiling xla/literal.cc; 27s local 2024-12-18T00:51:40.5401162Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:51:40.5402006Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:51:40.5402917Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:40.5404077Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 11s local ... 2024-12-18T00:51:40.7395219Z 2024-12-18T00:51:40.7396155Z  2024-12-18T00:51:40.7396651Z  2024-12-18T00:51:40.7397069Z  2024-12-18T00:51:40.7397718Z  2024-12-18T00:51:40.7398110Z  2024-12-18T00:51:40.7398525Z  2024-12-18T00:51:40.7398957Z  2024-12-18T00:51:40.7399370Z  2024-12-18T00:51:40.7400304Z [16,472 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:40.7401543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:51:40.7402773Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:51:40.7404012Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:51:40.7404958Z Compiling xla/literal.cc; 27s local 2024-12-18T00:51:40.7405721Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:51:40.7406526Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:51:40.7407415Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:40.7408570Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 11s local ... 2024-12-18T00:51:40.9980627Z 2024-12-18T00:51:40.9981581Z  2024-12-18T00:51:40.9982084Z  2024-12-18T00:51:40.9982498Z  2024-12-18T00:51:40.9982896Z  2024-12-18T00:51:40.9983308Z  2024-12-18T00:51:40.9983721Z  2024-12-18T00:51:40.9984129Z  2024-12-18T00:51:40.9984509Z  2024-12-18T00:51:40.9985451Z [16,475 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:40.9986662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:51:40.9987830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:51:40.9989328Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:51:40.9990214Z Compiling xla/literal.cc; 27s local 2024-12-18T00:51:40.9990870Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:51:40.9991839Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:51:40.9992870Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:40.9994033Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 11s local ... 2024-12-18T00:51:41.2495931Z 2024-12-18T00:51:41.2497014Z  2024-12-18T00:51:41.2497554Z  2024-12-18T00:51:41.2497938Z  2024-12-18T00:51:41.2498319Z  2024-12-18T00:51:41.2498713Z  2024-12-18T00:51:41.2499124Z  2024-12-18T00:51:41.2499536Z  2024-12-18T00:51:41.2499953Z  2024-12-18T00:51:41.2500938Z [16,479 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:41.2502199Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:51:41.2503384Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:51:41.2504513Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:51:41.2505430Z Compiling xla/literal.cc; 27s local 2024-12-18T00:51:41.2506134Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:51:41.2507026Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:41.2508094Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 12s local 2024-12-18T00:51:41.2509285Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 11s local ... 2024-12-18T00:51:41.5291238Z 2024-12-18T00:51:41.5292127Z  2024-12-18T00:51:41.5292620Z  2024-12-18T00:51:41.5293039Z  2024-12-18T00:51:41.5293425Z  2024-12-18T00:51:41.5293841Z  2024-12-18T00:51:41.5294241Z  2024-12-18T00:51:41.5294648Z  2024-12-18T00:51:41.5295067Z  2024-12-18T00:51:41.5296058Z [16,481 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:41.5297459Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:51:41.5298905Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2024-12-18T00:51:41.5300109Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2024-12-18T00:51:41.5301040Z Compiling xla/literal.cc; 28s local 2024-12-18T00:51:41.5301726Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:51:41.5302629Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:51:41.5303717Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 12s local 2024-12-18T00:51:41.5304890Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 11s local ... 2024-12-18T00:51:41.7403187Z 2024-12-18T00:51:41.7404129Z  2024-12-18T00:51:41.7404761Z  2024-12-18T00:51:41.7405284Z  2024-12-18T00:51:41.7405640Z  2024-12-18T00:51:41.7405990Z  2024-12-18T00:51:41.7406378Z  2024-12-18T00:51:41.7406771Z  2024-12-18T00:51:41.7407174Z  2024-12-18T00:51:41.7408123Z [16,482 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:41.7409334Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:51:41.7410502Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:51:41.7411662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:41.7412579Z Compiling xla/literal.cc; 28s local 2024-12-18T00:51:41.7413354Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:51:41.7414339Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 12s local 2024-12-18T00:51:41.7415885Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:51:41.7417189Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local ... 2024-12-18T00:51:42.1094443Z 2024-12-18T00:51:42.1095338Z  2024-12-18T00:51:42.1095841Z  2024-12-18T00:51:42.1096266Z  2024-12-18T00:51:42.1096841Z  2024-12-18T00:51:42.1097258Z  2024-12-18T00:51:42.1098028Z  2024-12-18T00:51:42.1098445Z  2024-12-18T00:51:42.1098843Z  2024-12-18T00:51:42.1099797Z [16,484 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:42.1100935Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:51:42.1102018Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:51:42.1103149Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:42.1104073Z Compiling xla/literal.cc; 28s local 2024-12-18T00:51:42.1104883Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:51:42.1105976Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 12s local 2024-12-18T00:51:42.1107131Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:51:42.1108278Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local ... 2024-12-18T00:51:42.3079144Z 2024-12-18T00:51:42.3080178Z  2024-12-18T00:51:42.3080675Z  2024-12-18T00:51:42.3081096Z  2024-12-18T00:51:42.3081532Z  2024-12-18T00:51:42.3081898Z  2024-12-18T00:51:42.3082239Z  2024-12-18T00:51:42.3082643Z  2024-12-18T00:51:42.3083033Z  2024-12-18T00:51:42.3084023Z [16,487 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:42.3085246Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:51:42.3086436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:51:42.3087579Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:42.3088586Z Compiling xla/literal.cc; 29s local 2024-12-18T00:51:42.3089531Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:51:42.3090873Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local 2024-12-18T00:51:42.3091950Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:51:42.3093059Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local ... 2024-12-18T00:51:42.5410430Z 2024-12-18T00:51:42.5411330Z  2024-12-18T00:51:42.5411802Z  2024-12-18T00:51:42.5412206Z  2024-12-18T00:51:42.5412595Z  2024-12-18T00:51:42.5412973Z  2024-12-18T00:51:42.5413450Z  2024-12-18T00:51:42.5413843Z  2024-12-18T00:51:42.5414202Z  2024-12-18T00:51:42.5415172Z [16,488 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:42.5416492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:51:42.5417598Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2024-12-18T00:51:42.5418646Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2024-12-18T00:51:42.5419487Z Compiling xla/literal.cc; 29s local 2024-12-18T00:51:42.5420223Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:51:42.5421211Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local 2024-12-18T00:51:42.5422307Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 12s local 2024-12-18T00:51:42.5423388Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local ... 2024-12-18T00:51:42.9398263Z 2024-12-18T00:51:42.9399157Z  2024-12-18T00:51:42.9399698Z  2024-12-18T00:51:42.9400149Z  2024-12-18T00:51:42.9400540Z  2024-12-18T00:51:42.9401179Z  2024-12-18T00:51:42.9401638Z  2024-12-18T00:51:42.9402074Z  2024-12-18T00:51:42.9402463Z  2024-12-18T00:51:42.9403406Z [16,489 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:42.9404852Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:42.9406146Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:51:42.9407363Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:42.9408245Z Compiling xla/literal.cc; 29s local 2024-12-18T00:51:42.9409022Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:51:42.9410106Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local 2024-12-18T00:51:42.9411248Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 13s local 2024-12-18T00:51:42.9412420Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local ... 2024-12-18T00:51:43.1416818Z 2024-12-18T00:51:43.1417718Z  2024-12-18T00:51:43.1418247Z  2024-12-18T00:51:43.1418605Z  2024-12-18T00:51:43.1418978Z  2024-12-18T00:51:43.1419392Z  2024-12-18T00:51:43.1419828Z  2024-12-18T00:51:43.1420224Z  2024-12-18T00:51:43.1420566Z  2024-12-18T00:51:43.1421463Z [16,490 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:43.1422587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:43.1423559Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:51:43.1424544Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:43.1425382Z Compiling xla/literal.cc; 29s local 2024-12-18T00:51:43.1426035Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:51:43.1426904Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local 2024-12-18T00:51:43.1427946Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 13s local 2024-12-18T00:51:43.1429038Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local ... 2024-12-18T00:51:43.3692545Z 2024-12-18T00:51:43.3693437Z  2024-12-18T00:51:43.3693932Z  2024-12-18T00:51:43.3694404Z  2024-12-18T00:51:43.3694802Z  2024-12-18T00:51:43.3695190Z  2024-12-18T00:51:43.3695571Z  2024-12-18T00:51:43.3695951Z  2024-12-18T00:51:43.3696508Z  2024-12-18T00:51:43.3697456Z [16,492 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:43.3698622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:43.3699742Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:51:43.3700869Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:43.3701767Z Compiling xla/literal.cc; 30s local 2024-12-18T00:51:43.3702579Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:51:43.3703606Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2024-12-18T00:51:43.3704731Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 13s local 2024-12-18T00:51:43.3705815Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local ... 2024-12-18T00:51:43.6118109Z 2024-12-18T00:51:43.6119050Z  2024-12-18T00:51:43.6119508Z  2024-12-18T00:51:43.6119946Z  2024-12-18T00:51:43.6120349Z  2024-12-18T00:51:43.6120751Z  2024-12-18T00:51:43.6121121Z  2024-12-18T00:51:43.6121517Z  2024-12-18T00:51:43.6121893Z  2024-12-18T00:51:43.6122837Z [16,495 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:43.6124231Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:43.6125360Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2024-12-18T00:51:43.6126466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2024-12-18T00:51:43.6127365Z Compiling xla/literal.cc; 30s local 2024-12-18T00:51:43.6128347Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:51:43.6129484Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2024-12-18T00:51:43.6130639Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 13s local 2024-12-18T00:51:43.6131728Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local ... 2024-12-18T00:51:43.9001630Z 2024-12-18T00:51:43.9002524Z  2024-12-18T00:51:43.9003065Z  2024-12-18T00:51:43.9003431Z  2024-12-18T00:51:43.9003796Z  2024-12-18T00:51:43.9004138Z  2024-12-18T00:51:43.9004470Z  2024-12-18T00:51:43.9004784Z  2024-12-18T00:51:43.9005167Z  2024-12-18T00:51:43.9005976Z [16,497 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:43.9006959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:43.9007916Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:51:43.9008901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:43.9009700Z Compiling xla/literal.cc; 30s local 2024-12-18T00:51:43.9010436Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:51:43.9011370Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2024-12-18T00:51:43.9012422Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:51:43.9013410Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local ... 2024-12-18T00:51:44.1401625Z 2024-12-18T00:51:44.1402506Z  2024-12-18T00:51:44.1403008Z  2024-12-18T00:51:44.1403409Z  2024-12-18T00:51:44.1403809Z  2024-12-18T00:51:44.1404207Z  2024-12-18T00:51:44.1404599Z  2024-12-18T00:51:44.1404998Z  2024-12-18T00:51:44.1405397Z  2024-12-18T00:51:44.1406600Z [16,499 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:44.1407792Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:44.1408897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:51:44.1410021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:44.1410886Z Compiling xla/literal.cc; 30s local 2024-12-18T00:51:44.1411677Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:51:44.1412714Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2024-12-18T00:51:44.1413838Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:51:44.1414977Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local ... 2024-12-18T00:51:44.3426249Z 2024-12-18T00:51:44.3427161Z  2024-12-18T00:51:44.3427632Z  2024-12-18T00:51:44.3428031Z  2024-12-18T00:51:44.3428399Z  2024-12-18T00:51:44.3428797Z  2024-12-18T00:51:44.3429200Z  2024-12-18T00:51:44.3429605Z  2024-12-18T00:51:44.3429991Z  2024-12-18T00:51:44.3430913Z [16,500 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:44.3432042Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:44.3433181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:51:44.3434269Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:44.3435130Z Compiling xla/literal.cc; 31s local 2024-12-18T00:51:44.3436177Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:44.3437232Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2024-12-18T00:51:44.3438327Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:51:44.3439570Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local ... 2024-12-18T00:51:44.5849201Z 2024-12-18T00:51:44.5850063Z  2024-12-18T00:51:44.5850552Z  2024-12-18T00:51:44.5850955Z  2024-12-18T00:51:44.5851339Z  2024-12-18T00:51:44.5851733Z  2024-12-18T00:51:44.5852116Z  2024-12-18T00:51:44.5852482Z  2024-12-18T00:51:44.5852827Z  2024-12-18T00:51:44.5853734Z [16,502 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:44.5854887Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:44.5856103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2024-12-18T00:51:44.5857444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2024-12-18T00:51:44.5858332Z Compiling xla/literal.cc; 31s local 2024-12-18T00:51:44.5859203Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:44.5860255Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2024-12-18T00:51:44.5861280Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 14s local 2024-12-18T00:51:44.5862307Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local ... 2024-12-18T00:51:44.9395042Z 2024-12-18T00:51:44.9395962Z  2024-12-18T00:51:44.9396454Z  2024-12-18T00:51:44.9396852Z  2024-12-18T00:51:44.9397271Z  2024-12-18T00:51:44.9397676Z  2024-12-18T00:51:44.9398057Z  2024-12-18T00:51:44.9398435Z  2024-12-18T00:51:44.9398809Z  2024-12-18T00:51:44.9399750Z [16,504 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:44.9400958Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:51:44.9402070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:51:44.9403605Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:51:44.9404462Z Compiling xla/literal.cc; 31s local 2024-12-18T00:51:44.9405253Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:44.9406311Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2024-12-18T00:51:44.9407543Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2024-12-18T00:51:44.9408616Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local ... 2024-12-18T00:51:45.1433684Z 2024-12-18T00:51:45.1434594Z  2024-12-18T00:51:45.1435013Z  2024-12-18T00:51:45.1435376Z  2024-12-18T00:51:45.1435730Z  2024-12-18T00:51:45.1436114Z  2024-12-18T00:51:45.1436462Z  2024-12-18T00:51:45.1436797Z  2024-12-18T00:51:45.1437145Z  2024-12-18T00:51:45.1437978Z [16,504 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:45.1439034Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:51:45.1440043Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:51:45.1441028Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:51:45.1441836Z Compiling xla/literal.cc; 31s local 2024-12-18T00:51:45.1442539Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:45.1443516Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2024-12-18T00:51:45.1444941Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2024-12-18T00:51:45.1446287Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local ... 2024-12-18T00:51:45.5439004Z 2024-12-18T00:51:45.5439847Z  2024-12-18T00:51:45.5440309Z  2024-12-18T00:51:45.5440698Z  2024-12-18T00:51:45.5441088Z  2024-12-18T00:51:45.5441480Z  2024-12-18T00:51:45.5441890Z  2024-12-18T00:51:45.5442285Z  2024-12-18T00:51:45.5443016Z  2024-12-18T00:51:45.5443992Z [16,508 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:45.5445424Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:51:45.5446569Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2024-12-18T00:51:45.5447707Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2024-12-18T00:51:45.5448605Z Compiling xla/literal.cc; 32s local 2024-12-18T00:51:45.5449374Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:51:45.5450454Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2024-12-18T00:51:45.5451605Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2024-12-18T00:51:45.5452771Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local ... 2024-12-18T00:51:45.7443164Z 2024-12-18T00:51:45.7444067Z  2024-12-18T00:51:45.7444915Z  2024-12-18T00:51:45.7445339Z  2024-12-18T00:51:45.7445764Z  2024-12-18T00:51:45.7446159Z  2024-12-18T00:51:45.7446532Z  2024-12-18T00:51:45.7446909Z  2024-12-18T00:51:45.7447272Z  2024-12-18T00:51:45.7448200Z [16,511 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:45.7449409Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2024-12-18T00:51:45.7450607Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:51:45.7451797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:51:45.7452748Z Compiling xla/literal.cc; 32s local 2024-12-18T00:51:45.7453575Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:51:45.7454640Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2024-12-18T00:51:45.7456184Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2024-12-18T00:51:45.7457533Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local ... 2024-12-18T00:51:46.1452040Z 2024-12-18T00:51:46.1452925Z  2024-12-18T00:51:46.1453416Z  2024-12-18T00:51:46.1453817Z  2024-12-18T00:51:46.1454235Z  2024-12-18T00:51:46.1454645Z  2024-12-18T00:51:46.1455045Z  2024-12-18T00:51:46.1455457Z  2024-12-18T00:51:46.1455852Z  2024-12-18T00:51:46.1456975Z [16,513 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:46.1458241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2024-12-18T00:51:46.1459456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:51:46.1460629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:51:46.1461558Z Compiling xla/literal.cc; 32s local 2024-12-18T00:51:46.1462554Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:51:46.1463685Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2024-12-18T00:51:46.1464870Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2024-12-18T00:51:46.1466071Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local ... 2024-12-18T00:51:46.3452351Z 2024-12-18T00:51:46.3453269Z  2024-12-18T00:51:46.3453735Z  2024-12-18T00:51:46.3454157Z  2024-12-18T00:51:46.3454563Z  2024-12-18T00:51:46.3464047Z  2024-12-18T00:51:46.3464770Z  2024-12-18T00:51:46.3465482Z  2024-12-18T00:51:46.3465910Z  2024-12-18T00:51:46.3466885Z [16,516 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:46.3468176Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2024-12-18T00:51:46.3469523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2024-12-18T00:51:46.3470762Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2024-12-18T00:51:46.3471654Z Compiling xla/literal.cc; 33s local 2024-12-18T00:51:46.3472486Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:51:46.3473573Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:51:46.3474505Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2024-12-18T00:51:46.3475681Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local ... 2024-12-18T00:51:46.7430516Z 2024-12-18T00:51:46.7431480Z  2024-12-18T00:51:46.7431971Z  2024-12-18T00:51:46.7432365Z  2024-12-18T00:51:46.7432776Z  2024-12-18T00:51:46.7433146Z  2024-12-18T00:51:46.7433537Z  2024-12-18T00:51:46.7433943Z  2024-12-18T00:51:46.7434361Z  2024-12-18T00:51:46.7435298Z [16,519 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:46.7436494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:51:46.7437517Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:51:46.7438280Z Compiling xla/literal.cc; 33s local 2024-12-18T00:51:46.7439014Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:51:46.7440005Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:51:46.7441061Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:51:46.7442146Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2024-12-18T00:51:46.7443212Z Compiling llvm/lib/Transforms/Utils/LoopUnrollRuntime.cpp; 10s local ... 2024-12-18T00:51:46.9458134Z 2024-12-18T00:51:46.9459081Z  2024-12-18T00:51:46.9459887Z  2024-12-18T00:51:46.9460277Z  2024-12-18T00:51:46.9460661Z  2024-12-18T00:51:46.9461095Z  2024-12-18T00:51:46.9461473Z  2024-12-18T00:51:46.9461802Z  2024-12-18T00:51:46.9462202Z  2024-12-18T00:51:46.9463155Z [16,522 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:46.9464384Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:51:46.9465666Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:51:46.9466715Z Compiling xla/literal.cc; 33s local 2024-12-18T00:51:46.9467568Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:51:46.9468620Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:51:46.9469807Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:51:46.9470923Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2024-12-18T00:51:46.9472085Z Compiling llvm/lib/Transforms/Utils/LoopUnrollRuntime.cpp; 10s local ... 2024-12-18T00:51:47.2551494Z 2024-12-18T00:51:47.2552392Z  2024-12-18T00:51:47.2552891Z  2024-12-18T00:51:47.2553314Z  2024-12-18T00:51:47.2553692Z  2024-12-18T00:51:47.2554070Z  2024-12-18T00:51:47.2554467Z  2024-12-18T00:51:47.2554860Z  2024-12-18T00:51:47.2555268Z  2024-12-18T00:51:47.2556230Z [16,525 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:47.2557439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:51:47.2558927Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:51:47.2559863Z Compiling xla/literal.cc; 33s local 2024-12-18T00:51:47.2560692Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:51:47.2561774Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:51:47.2563182Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:51:47.2564303Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2024-12-18T00:51:47.2565358Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local ... 2024-12-18T00:51:47.4949032Z 2024-12-18T00:51:47.4949935Z  2024-12-18T00:51:47.4950420Z  2024-12-18T00:51:47.4950825Z  2024-12-18T00:51:47.4951231Z  2024-12-18T00:51:47.4951611Z  2024-12-18T00:51:47.4952017Z  2024-12-18T00:51:47.4952418Z  2024-12-18T00:51:47.4952812Z  2024-12-18T00:51:47.4953792Z [16,528 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:47.4955004Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2024-12-18T00:51:47.4956135Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2024-12-18T00:51:47.4957005Z Compiling xla/literal.cc; 34s local 2024-12-18T00:51:47.4957781Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:51:47.4959022Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:51:47.4960374Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2024-12-18T00:51:47.4961563Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2024-12-18T00:51:47.4962617Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local ... 2024-12-18T00:51:47.7465893Z 2024-12-18T00:51:47.7466780Z  2024-12-18T00:51:47.7467233Z  2024-12-18T00:51:47.7467782Z  2024-12-18T00:51:47.7468162Z  2024-12-18T00:51:47.7468540Z  2024-12-18T00:51:47.7468865Z  2024-12-18T00:51:47.7469229Z  2024-12-18T00:51:47.7469620Z  2024-12-18T00:51:47.7470565Z [16,531 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:47.7472113Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:51:47.7473200Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:47.7474063Z Compiling xla/literal.cc; 34s local 2024-12-18T00:51:47.7474789Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:51:47.7475709Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:51:47.7476716Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2024-12-18T00:51:47.7477705Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2024-12-18T00:51:47.7478641Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local ... 2024-12-18T00:51:48.0643369Z 2024-12-18T00:51:48.0644520Z  2024-12-18T00:51:48.0645031Z  2024-12-18T00:51:48.0645431Z  2024-12-18T00:51:48.0645832Z  2024-12-18T00:51:48.0646200Z  2024-12-18T00:51:48.0646634Z  2024-12-18T00:51:48.0647017Z  2024-12-18T00:51:48.0647421Z  2024-12-18T00:51:48.0648269Z [16,532 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:48.0649365Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:51:48.0650563Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:48.0651450Z Compiling xla/literal.cc; 34s local 2024-12-18T00:51:48.0652273Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:51:48.0653266Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:51:48.0654619Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2024-12-18T00:51:48.0655649Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2024-12-18T00:51:48.0656864Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local ... 2024-12-18T00:51:48.3471456Z 2024-12-18T00:51:48.3472407Z  2024-12-18T00:51:48.3473493Z  2024-12-18T00:51:48.3474017Z  2024-12-18T00:51:48.3474555Z  2024-12-18T00:51:48.3474962Z  2024-12-18T00:51:48.3475372Z  2024-12-18T00:51:48.3475750Z  2024-12-18T00:51:48.3476131Z  2024-12-18T00:51:48.3477106Z [16,532 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:48.3478297Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:51:48.3479530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:48.3480377Z Compiling xla/literal.cc; 35s local 2024-12-18T00:51:48.3481178Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:51:48.3482227Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:51:48.3483302Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2024-12-18T00:51:48.3484531Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:51:48.3485533Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local ... 2024-12-18T00:51:48.5475864Z 2024-12-18T00:51:48.5476748Z  2024-12-18T00:51:48.5477203Z  2024-12-18T00:51:48.5477619Z  2024-12-18T00:51:48.5478038Z  2024-12-18T00:51:48.5478417Z  2024-12-18T00:51:48.5478777Z  2024-12-18T00:51:48.5479160Z  2024-12-18T00:51:48.5479564Z  2024-12-18T00:51:48.5480496Z [16,534 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:48.5481732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2024-12-18T00:51:48.5482853Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2024-12-18T00:51:48.5483917Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:51:48.5484886Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:51:48.5486340Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2024-12-18T00:51:48.5487477Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:51:48.5488413Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2024-12-18T00:51:48.5489263Z Compiling mlir/lib/AsmParser/Parser.cpp; 11s local ... 2024-12-18T00:51:48.8102475Z 2024-12-18T00:51:48.8103361Z  2024-12-18T00:51:48.8103863Z  2024-12-18T00:51:48.8104259Z  2024-12-18T00:51:48.8104663Z  2024-12-18T00:51:48.8105047Z  2024-12-18T00:51:48.8105443Z  2024-12-18T00:51:48.8105847Z  2024-12-18T00:51:48.8106259Z  2024-12-18T00:51:48.8107208Z [16,536 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:48.8108467Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:51:48.8109557Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:51:48.8110616Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:51:48.8111696Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:51:48.8112688Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:51:48.8113543Z Compiling mlir/lib/AsmParser/Parser.cpp; 11s local 2024-12-18T00:51:48.8114363Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:51:48.8115433Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 7s local ... 2024-12-18T00:51:49.1482111Z 2024-12-18T00:51:49.1482932Z  2024-12-18T00:51:49.1483605Z  2024-12-18T00:51:49.1484001Z  2024-12-18T00:51:49.1484364Z  2024-12-18T00:51:49.1484741Z  2024-12-18T00:51:49.1485077Z  2024-12-18T00:51:49.1485423Z  2024-12-18T00:51:49.1485759Z  2024-12-18T00:51:49.1486694Z [16,538 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:49.1487728Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:51:49.1488824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:51:49.1489714Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:51:49.1490598Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:51:49.1491483Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2024-12-18T00:51:49.1492333Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:51:49.1493188Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 8s local 2024-12-18T00:51:49.1493983Z @llvm-project//llvm:Instrumentation; 7s local ... 2024-12-18T00:51:49.4407526Z 2024-12-18T00:51:49.4408453Z  2024-12-18T00:51:49.4408948Z  2024-12-18T00:51:49.4409373Z  2024-12-18T00:51:49.4409775Z  2024-12-18T00:51:49.4410174Z  2024-12-18T00:51:49.4410580Z  2024-12-18T00:51:49.4410987Z  2024-12-18T00:51:49.4411373Z  2024-12-18T00:51:49.4412279Z [16,539 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:49.4413462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2024-12-18T00:51:49.4414612Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:51:49.4415687Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:51:49.4416947Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:51:49.4418007Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:51:49.4419025Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 10s local 2024-12-18T00:51:49.4420087Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 8s local 2024-12-18T00:51:49.4421351Z @llvm-project//llvm:Instrumentation; 7s local ... 2024-12-18T00:51:49.6525958Z 2024-12-18T00:51:49.6526885Z  2024-12-18T00:51:49.6527324Z  2024-12-18T00:51:49.6527699Z  2024-12-18T00:51:49.6528058Z  2024-12-18T00:51:49.6528439Z  2024-12-18T00:51:49.6528801Z  2024-12-18T00:51:49.6529193Z  2024-12-18T00:51:49.6529566Z  2024-12-18T00:51:49.6530481Z [16,540 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:49.6531585Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:51:49.6532712Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2024-12-18T00:51:49.6533743Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:51:49.6534763Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:51:49.6535781Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:51:49.6536949Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:51:49.6537912Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 8s local 2024-12-18T00:51:49.6538782Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:51:49.8993916Z 2024-12-18T00:51:49.8994796Z  2024-12-18T00:51:49.8995250Z  2024-12-18T00:51:49.8995610Z  2024-12-18T00:51:49.8995967Z  2024-12-18T00:51:49.8996329Z  2024-12-18T00:51:49.8996706Z  2024-12-18T00:51:49.8997089Z  2024-12-18T00:51:49.8997465Z  2024-12-18T00:51:49.8998612Z [16,545 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:49.8999732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:51:49.9000830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:51:49.9001896Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:51:49.9003237Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:51:49.9004239Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:51:49.9005180Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:51:49.9006133Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 8s local 2024-12-18T00:51:49.9007035Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:51:50.1491139Z 2024-12-18T00:51:50.1492050Z  2024-12-18T00:51:50.1492513Z  2024-12-18T00:51:50.1492891Z  2024-12-18T00:51:50.1493309Z  2024-12-18T00:51:50.1493706Z  2024-12-18T00:51:50.1494067Z  2024-12-18T00:51:50.1494431Z  2024-12-18T00:51:50.1494789Z  2024-12-18T00:51:50.1495699Z [16,546 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:50.1497086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:51:50.1498183Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:51:50.1499374Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:51:50.1500374Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:51:50.1501395Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2024-12-18T00:51:50.1502387Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:51:50.1503445Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 9s local 2024-12-18T00:51:50.1504400Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:51:50.3495497Z 2024-12-18T00:51:50.3496519Z  2024-12-18T00:51:50.3497041Z  2024-12-18T00:51:50.3497448Z  2024-12-18T00:51:50.3497832Z  2024-12-18T00:51:50.3498265Z  2024-12-18T00:51:50.3499142Z  2024-12-18T00:51:50.3499528Z  2024-12-18T00:51:50.3499989Z  2024-12-18T00:51:50.3500873Z [16,549 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:50.3501994Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2024-12-18T00:51:50.3503150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2024-12-18T00:51:50.3504168Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:51:50.3505211Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2024-12-18T00:51:50.3506155Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2024-12-18T00:51:50.3507124Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2024-12-18T00:51:50.3508156Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 9s local 2024-12-18T00:51:50.3509079Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:51:50.9305187Z 2024-12-18T00:51:50.9306051Z  2024-12-18T00:51:50.9306562Z  2024-12-18T00:51:50.9306970Z  2024-12-18T00:51:50.9307346Z  2024-12-18T00:51:50.9307733Z  2024-12-18T00:51:50.9308117Z  2024-12-18T00:51:50.9308516Z  2024-12-18T00:51:50.9308881Z  2024-12-18T00:51:50.9309813Z [16,550 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:50.9310988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:51:50.9312209Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:51:50.9313604Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:51:50.9314690Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2024-12-18T00:51:50.9315709Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:51:50.9316781Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local 2024-12-18T00:51:50.9317955Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:51:50.9318933Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 8s local ... 2024-12-18T00:51:51.1502725Z 2024-12-18T00:51:51.1503611Z  2024-12-18T00:51:51.1504106Z  2024-12-18T00:51:51.1504900Z  2024-12-18T00:51:51.1505299Z  2024-12-18T00:51:51.1505722Z  2024-12-18T00:51:51.1506144Z  2024-12-18T00:51:51.1506551Z  2024-12-18T00:51:51.1506956Z  2024-12-18T00:51:51.1507942Z [16,551 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:51.1509287Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:51:51.1510541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:51:51.1511640Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:51:51.1512731Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2024-12-18T00:51:51.1513848Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:51:51.1514899Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local 2024-12-18T00:51:51.1515838Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:51:51.1516719Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local ... 2024-12-18T00:51:51.5508212Z 2024-12-18T00:51:51.5509101Z  2024-12-18T00:51:51.5509576Z  2024-12-18T00:51:51.5509997Z  2024-12-18T00:51:51.5510389Z  2024-12-18T00:51:51.5510778Z  2024-12-18T00:51:51.5511181Z  2024-12-18T00:51:51.5511587Z  2024-12-18T00:51:51.5512021Z  2024-12-18T00:51:51.5513039Z [16,552 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:51.5514274Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2024-12-18T00:51:51.5515704Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2024-12-18T00:51:51.5516849Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:51:51.5517765Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2024-12-18T00:51:51.5518554Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2024-12-18T00:51:51.5519749Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local 2024-12-18T00:51:51.5520664Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:51:51.5521467Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local ... 2024-12-18T00:51:51.7695958Z 2024-12-18T00:51:51.7696911Z  2024-12-18T00:51:51.7697434Z  2024-12-18T00:51:51.7697834Z  2024-12-18T00:51:51.7698237Z  2024-12-18T00:51:51.7698634Z  2024-12-18T00:51:51.7699025Z  2024-12-18T00:51:51.7699428Z  2024-12-18T00:51:51.7699820Z  2024-12-18T00:51:51.7700779Z [16,557 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:51.7702014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:51.7703213Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:51:51.7704326Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:51:51.7705376Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2024-12-18T00:51:51.7706448Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:51.7707508Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local 2024-12-18T00:51:51.7708923Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:51:51.7709795Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local ... 2024-12-18T00:51:52.1155663Z 2024-12-18T00:51:52.1156548Z  2024-12-18T00:51:52.1157024Z  2024-12-18T00:51:52.1157438Z  2024-12-18T00:51:52.1157821Z  2024-12-18T00:51:52.1158578Z  2024-12-18T00:51:52.1158978Z  2024-12-18T00:51:52.1159337Z  2024-12-18T00:51:52.1159722Z  2024-12-18T00:51:52.1160639Z [16,559 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:52.1161771Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:52.1162861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:51:52.1163974Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:51:52.1164947Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2024-12-18T00:51:52.1165891Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:52.1166862Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:51:52.1167810Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:51:52.1168684Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local ... 2024-12-18T00:51:52.3321777Z 2024-12-18T00:51:52.3322674Z  2024-12-18T00:51:52.3323175Z  2024-12-18T00:51:52.3323549Z  2024-12-18T00:51:52.3323906Z  2024-12-18T00:51:52.3324286Z  2024-12-18T00:51:52.3324647Z  2024-12-18T00:51:52.3325028Z  2024-12-18T00:51:52.3325397Z  2024-12-18T00:51:52.3326266Z [16,560 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:52.3327331Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:52.3328402Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:51:52.3329372Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:51:52.3330300Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:51:52.3331218Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:52.3332449Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:51:52.3333316Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:51:52.3334120Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local ... 2024-12-18T00:51:52.5497905Z 2024-12-18T00:51:52.5498794Z  2024-12-18T00:51:52.5499207Z  2024-12-18T00:51:52.5499541Z  2024-12-18T00:51:52.5499875Z  2024-12-18T00:51:52.5500207Z  2024-12-18T00:51:52.5500538Z  2024-12-18T00:51:52.5500857Z  2024-12-18T00:51:52.5501195Z  2024-12-18T00:51:52.5502058Z [16,561 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:52.5503044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2024-12-18T00:51:52.5504204Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2024-12-18T00:51:52.5505270Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:51:52.5506331Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:51:52.5507226Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2024-12-18T00:51:52.5508217Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:51:52.5509152Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:51:52.5510029Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local ... 2024-12-18T00:51:52.7517159Z 2024-12-18T00:51:52.7518096Z  2024-12-18T00:51:52.7518638Z  2024-12-18T00:51:52.7519032Z  2024-12-18T00:51:52.7519452Z  2024-12-18T00:51:52.7520134Z  2024-12-18T00:51:52.7520632Z  2024-12-18T00:51:52.7521029Z  2024-12-18T00:51:52.7521443Z  2024-12-18T00:51:52.7522429Z [16,562 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:52.7523886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:51:52.7525344Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:51:52.7526432Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:51:52.7527474Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:51:52.7528479Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:51:52.7529546Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:51:52.7530511Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:51:52.7531423Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local ... 2024-12-18T00:51:52.9609853Z 2024-12-18T00:51:52.9610911Z  2024-12-18T00:51:52.9611388Z  2024-12-18T00:51:52.9611785Z  2024-12-18T00:51:52.9612160Z  2024-12-18T00:51:52.9612555Z  2024-12-18T00:51:52.9612972Z  2024-12-18T00:51:52.9613365Z  2024-12-18T00:51:52.9613722Z  2024-12-18T00:51:52.9614698Z [16,566 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:52.9615878Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:51:52.9617176Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:51:52.9618272Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:51:52.9619290Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2024-12-18T00:51:52.9620323Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:51:52.9621368Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:51:52.9622299Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:51:52.9623164Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local ... 2024-12-18T00:51:53.3523228Z 2024-12-18T00:51:53.3524164Z  2024-12-18T00:51:53.3524673Z  2024-12-18T00:51:53.3525130Z  2024-12-18T00:51:53.3525526Z  2024-12-18T00:51:53.3525889Z  2024-12-18T00:51:53.3526294Z  2024-12-18T00:51:53.3526694Z  2024-12-18T00:51:53.3527094Z  2024-12-18T00:51:53.3528034Z [16,566 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:53.3529237Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2024-12-18T00:51:53.3530449Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2024-12-18T00:51:53.3531516Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:51:53.3532513Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2024-12-18T00:51:53.3533504Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2024-12-18T00:51:53.3534577Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:51:53.3535541Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:51:53.3536581Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local ... 2024-12-18T00:51:53.7527912Z 2024-12-18T00:51:53.7528831Z  2024-12-18T00:51:53.7529290Z  2024-12-18T00:51:53.7529677Z  2024-12-18T00:51:53.7530087Z  2024-12-18T00:51:53.7530449Z  2024-12-18T00:51:53.7530774Z  2024-12-18T00:51:53.7531132Z  2024-12-18T00:51:53.7531500Z  2024-12-18T00:51:53.7532453Z [16,567 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:53.7533975Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:51:53.7535181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:51:53.7536480Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:51:53.7537543Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2024-12-18T00:51:53.7538828Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:51:53.7539968Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:51:53.7540972Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:53.7541912Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local ... 2024-12-18T00:51:53.9875248Z 2024-12-18T00:51:53.9876169Z  2024-12-18T00:51:53.9876629Z  2024-12-18T00:51:53.9877028Z  2024-12-18T00:51:53.9877430Z  2024-12-18T00:51:53.9877829Z  2024-12-18T00:51:53.9878228Z  2024-12-18T00:51:53.9878612Z  2024-12-18T00:51:53.9879047Z  2024-12-18T00:51:53.9880001Z [16,571 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:53.9881239Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:51:53.9882375Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:51:53.9883578Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:51:53.9884635Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2024-12-18T00:51:53.9885570Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:51:53.9886592Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:51:53.9887535Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:53.9888403Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local ... 2024-12-18T00:51:54.3532105Z 2024-12-18T00:51:54.3532986Z  2024-12-18T00:51:54.3533539Z  2024-12-18T00:51:54.3533939Z  2024-12-18T00:51:54.3534315Z  2024-12-18T00:51:54.3534714Z  2024-12-18T00:51:54.3535100Z  2024-12-18T00:51:54.3535507Z  2024-12-18T00:51:54.3535907Z  2024-12-18T00:51:54.3537022Z [16,572 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:54.3538544Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2024-12-18T00:51:54.3539711Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2024-12-18T00:51:54.3540703Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:51:54.3541692Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2024-12-18T00:51:54.3542703Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2024-12-18T00:51:54.3543736Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:51:54.3545020Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:51:54.3545959Z Compiling llvm/lib/CodeGen/WindowScheduler.cpp; 10s local ... 2024-12-18T00:51:54.7156160Z 2024-12-18T00:51:54.7157102Z  2024-12-18T00:51:54.7157594Z  2024-12-18T00:51:54.7158023Z  2024-12-18T00:51:54.7158441Z  2024-12-18T00:51:54.7158848Z  2024-12-18T00:51:54.7159289Z  2024-12-18T00:51:54.7159688Z  2024-12-18T00:51:54.7160084Z  2024-12-18T00:51:54.7161038Z [16,577 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:54.7162226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:51:54.7163426Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:51:54.7164558Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:51:54.7165563Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2024-12-18T00:51:54.7166893Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:51:54.7168018Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:51:54.7169050Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:51:54.7170311Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 9s local ... 2024-12-18T00:51:54.9540747Z 2024-12-18T00:51:54.9541658Z  2024-12-18T00:51:54.9542120Z  2024-12-18T00:51:54.9542525Z  2024-12-18T00:51:54.9542918Z  2024-12-18T00:51:54.9543299Z  2024-12-18T00:51:54.9543697Z  2024-12-18T00:51:54.9544077Z  2024-12-18T00:51:54.9544766Z  2024-12-18T00:51:54.9545730Z [16,577 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:54.9546953Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:51:54.9548159Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:51:54.9549268Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:51:54.9550276Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2024-12-18T00:51:54.9551239Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:51:54.9552233Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:51:54.9553179Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:51:54.9554152Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 9s local ... 2024-12-18T00:51:55.4095213Z 2024-12-18T00:51:55.4096104Z  2024-12-18T00:51:55.4096778Z  2024-12-18T00:51:55.4097169Z  2024-12-18T00:51:55.4097572Z  2024-12-18T00:51:55.4097956Z  2024-12-18T00:51:55.4098369Z  2024-12-18T00:51:55.4098760Z  2024-12-18T00:51:55.4099159Z  2024-12-18T00:51:55.4100085Z [16,578 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:55.4101200Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2024-12-18T00:51:55.4102314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2024-12-18T00:51:55.4103703Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:51:55.4104749Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:51:55.4105729Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2024-12-18T00:51:55.4106761Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:51:55.4107772Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:51:55.4108844Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 10s local ... 2024-12-18T00:51:55.7549300Z 2024-12-18T00:51:55.7550173Z  2024-12-18T00:51:55.7550639Z  2024-12-18T00:51:55.7551014Z  2024-12-18T00:51:55.7551430Z  2024-12-18T00:51:55.7551826Z  2024-12-18T00:51:55.7552209Z  2024-12-18T00:51:55.7552569Z  2024-12-18T00:51:55.7552907Z  2024-12-18T00:51:55.7553856Z [16,580 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:55.7555041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:55.7556170Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:55.7557196Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:51:55.7558203Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:51:55.7559203Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:55.7560261Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:51:55.7561320Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:51:55.7562638Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 10s local ... 2024-12-18T00:51:55.9651405Z 2024-12-18T00:51:55.9652283Z  2024-12-18T00:51:55.9652709Z  2024-12-18T00:51:55.9653068Z  2024-12-18T00:51:55.9653459Z  2024-12-18T00:51:55.9653850Z  2024-12-18T00:51:55.9654195Z  2024-12-18T00:51:55.9654862Z  2024-12-18T00:51:55.9655210Z  2024-12-18T00:51:55.9656017Z [16,584 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:55.9657169Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:55.9658124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:55.9659030Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:51:55.9659936Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:51:55.9660846Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:55.9661766Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:51:55.9662796Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:51:55.9663736Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 10s local ... 2024-12-18T00:51:56.1981121Z 2024-12-18T00:51:56.1982050Z  2024-12-18T00:51:56.1982556Z  2024-12-18T00:51:56.1982934Z  2024-12-18T00:51:56.1983309Z  2024-12-18T00:51:56.1983666Z  2024-12-18T00:51:56.1984048Z  2024-12-18T00:51:56.1984433Z  2024-12-18T00:51:56.1984811Z  2024-12-18T00:51:56.1985830Z [16,585 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:56.1987011Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:56.1988088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:56.1989188Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:51:56.1990180Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2024-12-18T00:51:56.1991190Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:56.1992564Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:51:56.1993580Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:51:56.1994607Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 10s local ... 2024-12-18T00:51:56.5071002Z 2024-12-18T00:51:56.5071878Z  2024-12-18T00:51:56.5072349Z  2024-12-18T00:51:56.5072744Z  2024-12-18T00:51:56.5073138Z  2024-12-18T00:51:56.5073539Z  2024-12-18T00:51:56.5073943Z  2024-12-18T00:51:56.5074333Z  2024-12-18T00:51:56.5074742Z  2024-12-18T00:51:56.5075695Z [16,589 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:56.5076983Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2024-12-18T00:51:56.5078203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2024-12-18T00:51:56.5079347Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:51:56.5080389Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2024-12-18T00:51:56.5081497Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:51:56.5082597Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:51:56.5083686Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local 2024-12-18T00:51:56.5084654Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:51:56.7516659Z 2024-12-18T00:51:56.7517587Z  2024-12-18T00:51:56.7518065Z  2024-12-18T00:51:56.7518460Z  2024-12-18T00:51:56.7518868Z  2024-12-18T00:51:56.7519272Z  2024-12-18T00:51:56.7519933Z  2024-12-18T00:51:56.7520332Z  2024-12-18T00:51:56.7520708Z  2024-12-18T00:51:56.7521644Z [16,591 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:56.7522833Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:56.7524226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:56.7525295Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:51:56.7526250Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:51:56.7527302Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:51:56.7528362Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:51:56.7529377Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local 2024-12-18T00:51:56.7530352Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:51:56.9559160Z 2024-12-18T00:51:56.9560010Z  2024-12-18T00:51:56.9560473Z  2024-12-18T00:51:56.9560876Z  2024-12-18T00:51:56.9561268Z  2024-12-18T00:51:56.9561661Z  2024-12-18T00:51:56.9562033Z  2024-12-18T00:51:56.9562457Z  2024-12-18T00:51:56.9562985Z  2024-12-18T00:51:56.9563984Z [16,598 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:56.9565278Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:56.9566482Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:56.9567601Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:51:56.9568647Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:51:56.9569701Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:51:56.9570710Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:51:56.9571767Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local 2024-12-18T00:51:56.9572740Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:51:57.2322718Z 2024-12-18T00:51:57.2323909Z  2024-12-18T00:51:57.2324418Z  2024-12-18T00:51:57.2324849Z  2024-12-18T00:51:57.2325244Z  2024-12-18T00:51:57.2325662Z  2024-12-18T00:51:57.2326070Z  2024-12-18T00:51:57.2326481Z  2024-12-18T00:51:57.2326842Z  2024-12-18T00:51:57.2327781Z [16,602 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:57.2329115Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:57.2330252Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:57.2331447Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:51:57.2332439Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:51:57.2333465Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:51:57.2334474Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:51:57.2335480Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 11s local 2024-12-18T00:51:57.2336584Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:51:57.5563741Z 2024-12-18T00:51:57.5564693Z  2024-12-18T00:51:57.5565163Z  2024-12-18T00:51:57.5565550Z  2024-12-18T00:51:57.5565950Z  2024-12-18T00:51:57.5566345Z  2024-12-18T00:51:57.5566710Z  2024-12-18T00:51:57.5567073Z  2024-12-18T00:51:57.5567463Z  2024-12-18T00:51:57.5568399Z [16,604 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:57.5569531Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2024-12-18T00:51:57.5571021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2024-12-18T00:51:57.5572066Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:51:57.5573163Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2024-12-18T00:51:57.5574478Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:51:57.5575603Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:51:57.5576782Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:51:57.5577743Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:51:57.8095380Z 2024-12-18T00:51:57.8096273Z  2024-12-18T00:51:57.8096948Z  2024-12-18T00:51:57.8097368Z  2024-12-18T00:51:57.8097736Z  2024-12-18T00:51:57.8098119Z  2024-12-18T00:51:57.8098516Z  2024-12-18T00:51:57.8098900Z  2024-12-18T00:51:57.8099264Z  2024-12-18T00:51:57.8100219Z [16,605 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:57.8101447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:51:57.8102585Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:51:57.8103709Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:51:57.8104698Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:51:57.8105759Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:51:57.8106808Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:51:57.8107773Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:51:57.8108696Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:51:58.1569877Z 2024-12-18T00:51:58.1570759Z  2024-12-18T00:51:58.1571230Z  2024-12-18T00:51:58.1571649Z  2024-12-18T00:51:58.1572039Z  2024-12-18T00:51:58.1572421Z  2024-12-18T00:51:58.1572825Z  2024-12-18T00:51:58.1573221Z  2024-12-18T00:51:58.1573615Z  2024-12-18T00:51:58.1574541Z [16,606 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:58.1576068Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:51:58.1577514Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:51:58.1578584Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:51:58.1579477Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:51:58.1580455Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:51:58.1581484Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:51:58.1582499Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:51:58.1583338Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:51:58.3730208Z 2024-12-18T00:51:58.3731082Z  2024-12-18T00:51:58.3731538Z  2024-12-18T00:51:58.3731946Z  2024-12-18T00:51:58.3732396Z  2024-12-18T00:51:58.3732795Z  2024-12-18T00:51:58.3733206Z  2024-12-18T00:51:58.3733604Z  2024-12-18T00:51:58.3734009Z  2024-12-18T00:51:58.3734968Z [16,607 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:58.3736147Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2024-12-18T00:51:58.3737495Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2024-12-18T00:51:58.3738548Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2024-12-18T00:51:58.3739466Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2024-12-18T00:51:58.3740897Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:51:58.3741972Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:51:58.3743056Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:51:58.3744014Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:51:58.7576046Z 2024-12-18T00:51:58.7577378Z  2024-12-18T00:51:58.7577830Z  2024-12-18T00:51:58.7578188Z  2024-12-18T00:51:58.7578528Z  2024-12-18T00:51:58.7578881Z  2024-12-18T00:51:58.7579238Z  2024-12-18T00:51:58.7579629Z  2024-12-18T00:51:58.7580010Z  2024-12-18T00:51:58.7580835Z [16,609 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:58.7581919Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:58.7582961Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2024-12-18T00:51:58.7583976Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2024-12-18T00:51:58.7584905Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:51:58.7585869Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:51:58.7586824Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:51:58.7587749Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:51:58.7588695Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:51:58.9920043Z 2024-12-18T00:51:58.9920963Z  2024-12-18T00:51:58.9921429Z  2024-12-18T00:51:58.9921798Z  2024-12-18T00:51:58.9922181Z  2024-12-18T00:51:58.9922595Z  2024-12-18T00:51:58.9922983Z  2024-12-18T00:51:58.9923382Z  2024-12-18T00:51:58.9923768Z  2024-12-18T00:51:58.9924725Z [16,613 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:58.9925973Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:58.9927030Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:51:58.9928063Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:51:58.9929292Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:51:58.9930278Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:51:58.9931225Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:58.9932056Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:51:58.9932867Z Compiling xla/literal.cc; 10s local ... 2024-12-18T00:51:59.2698393Z 2024-12-18T00:51:59.2699314Z  2024-12-18T00:51:59.2699819Z  2024-12-18T00:51:59.2700245Z  2024-12-18T00:51:59.2700663Z  2024-12-18T00:51:59.2701055Z  2024-12-18T00:51:59.2701463Z  2024-12-18T00:51:59.2701892Z  2024-12-18T00:51:59.2702293Z  2024-12-18T00:51:59.2712795Z [16,615 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:59.2714109Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:59.2715252Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:51:59.2716386Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:51:59.2717413Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:51:59.2718458Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:51:59.2719350Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:59.2720166Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:51:59.2720960Z Compiling xla/literal.cc; 10s local ... 2024-12-18T00:51:59.5583225Z 2024-12-18T00:51:59.5584126Z  2024-12-18T00:51:59.5584883Z  2024-12-18T00:51:59.5585323Z  2024-12-18T00:51:59.5585728Z  2024-12-18T00:51:59.5586141Z  2024-12-18T00:51:59.5586550Z  2024-12-18T00:51:59.5586966Z  2024-12-18T00:51:59.5587369Z  2024-12-18T00:51:59.5588467Z [16,618 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:51:59.5589804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2024-12-18T00:51:59.5590904Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2024-12-18T00:51:59.5591966Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:51:59.5592920Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:51:59.5593933Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:51:59.5594870Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:51:59.5595734Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2024-12-18T00:51:59.5596563Z Compiling xla/literal.cc; 11s local ... 2024-12-18T00:51:59.8916471Z 2024-12-18T00:51:59.8917372Z  2024-12-18T00:51:59.8917844Z  2024-12-18T00:51:59.8918254Z  2024-12-18T00:51:59.8918631Z  2024-12-18T00:51:59.8919048Z  2024-12-18T00:51:59.8919442Z  2024-12-18T00:51:59.8919868Z  2024-12-18T00:51:59.8920274Z  2024-12-18T00:51:59.8921214Z [16,619 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:51:59.8922483Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 131s local 2024-12-18T00:51:59.8923678Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:51:59.8924741Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:51:59.8925748Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:51:59.8926782Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:51:59.8927678Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:51:59.8928523Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:51:59.8929318Z Compiling xla/literal.cc; 11s local ... 2024-12-18T00:52:00.1590231Z 2024-12-18T00:52:00.1591129Z  2024-12-18T00:52:00.1591658Z  2024-12-18T00:52:00.1592051Z  2024-12-18T00:52:00.1592484Z  2024-12-18T00:52:00.1592882Z  2024-12-18T00:52:00.1593257Z  2024-12-18T00:52:00.1593648Z  2024-12-18T00:52:00.1594019Z  2024-12-18T00:52:00.1595021Z [16,622 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:00.1596130Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:52:00.1597221Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:52:00.1598229Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:52:00.1599210Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:52:00.1600168Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:00.1601046Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:52:00.1601855Z Compiling xla/literal.cc; 11s local 2024-12-18T00:52:00.1602674Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 9s local ... 2024-12-18T00:52:00.3595654Z 2024-12-18T00:52:00.3596596Z  2024-12-18T00:52:00.3597059Z  2024-12-18T00:52:00.3597461Z  2024-12-18T00:52:00.3597861Z  2024-12-18T00:52:00.3598260Z  2024-12-18T00:52:00.3598675Z  2024-12-18T00:52:00.3599058Z  2024-12-18T00:52:00.3599451Z  2024-12-18T00:52:00.3600381Z [16,624 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:00.3601474Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2024-12-18T00:52:00.3602764Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:52:00.3603763Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:00.3604768Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:52:00.3605891Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:00.3606814Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2024-12-18T00:52:00.3607614Z Compiling xla/literal.cc; 11s local 2024-12-18T00:52:00.3608394Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local ... 2024-12-18T00:52:00.7600344Z 2024-12-18T00:52:00.7601231Z  2024-12-18T00:52:00.7601685Z  2024-12-18T00:52:00.7602058Z  2024-12-18T00:52:00.7602511Z  2024-12-18T00:52:00.7602911Z  2024-12-18T00:52:00.7603300Z  2024-12-18T00:52:00.7603691Z  2024-12-18T00:52:00.7604083Z  2024-12-18T00:52:00.7605061Z [16,625 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:00.7606139Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:52:00.7607143Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:52:00.7608245Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:00.7609331Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:52:00.7610338Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:52:00.7611090Z Compiling xla/literal.cc; 12s local 2024-12-18T00:52:00.7611797Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local 2024-12-18T00:52:00.7612891Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2024-12-18T00:52:00.9980178Z 2024-12-18T00:52:00.9981100Z  2024-12-18T00:52:00.9981566Z  2024-12-18T00:52:00.9981956Z  2024-12-18T00:52:00.9982338Z  2024-12-18T00:52:00.9982756Z  2024-12-18T00:52:00.9983149Z  2024-12-18T00:52:00.9983521Z  2024-12-18T00:52:00.9983957Z  2024-12-18T00:52:00.9985004Z [16,626 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:00.9986426Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:52:00.9987494Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:52:00.9988457Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:00.9989452Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:52:00.9990466Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:52:00.9991262Z Compiling xla/literal.cc; 12s local 2024-12-18T00:52:00.9992074Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local 2024-12-18T00:52:00.9993109Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2024-12-18T00:52:01.2005525Z 2024-12-18T00:52:01.2006410Z  2024-12-18T00:52:01.2006906Z  2024-12-18T00:52:01.2007321Z  2024-12-18T00:52:01.2007702Z  2024-12-18T00:52:01.2008088Z  2024-12-18T00:52:01.2008479Z  2024-12-18T00:52:01.2008898Z  2024-12-18T00:52:01.2009284Z  2024-12-18T00:52:01.2010273Z [16,627 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:01.2011424Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:52:01.2012444Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:52:01.2013488Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:01.2014485Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:52:01.2015554Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:52:01.2016566Z Compiling xla/literal.cc; 12s local 2024-12-18T00:52:01.2017655Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local 2024-12-18T00:52:01.2018700Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2024-12-18T00:52:01.5248793Z 2024-12-18T00:52:01.5249673Z  2024-12-18T00:52:01.5250178Z  2024-12-18T00:52:01.5250556Z  2024-12-18T00:52:01.5251329Z  2024-12-18T00:52:01.5251730Z  2024-12-18T00:52:01.5252099Z  2024-12-18T00:52:01.5252486Z  2024-12-18T00:52:01.5252849Z  2024-12-18T00:52:01.5253745Z [16,629 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:01.5254813Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2024-12-18T00:52:01.5255829Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:52:01.5256966Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:52:01.5257964Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:52:01.5258963Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2024-12-18T00:52:01.5259754Z Compiling xla/literal.cc; 13s local 2024-12-18T00:52:01.5260463Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:52:01.5261421Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2024-12-18T00:52:01.7608707Z 2024-12-18T00:52:01.7609758Z  2024-12-18T00:52:01.7610230Z  2024-12-18T00:52:01.7610606Z  2024-12-18T00:52:01.7610983Z  2024-12-18T00:52:01.7611366Z  2024-12-18T00:52:01.7611734Z  2024-12-18T00:52:01.7612103Z  2024-12-18T00:52:01.7612500Z  2024-12-18T00:52:01.7613387Z [16,630 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:01.7614447Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:52:01.7615505Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:52:01.7616630Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:52:01.7617640Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:52:01.7618668Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:52:01.7619720Z Compiling xla/literal.cc; 13s local 2024-12-18T00:52:01.7620451Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:52:01.7621375Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2024-12-18T00:52:01.9685029Z 2024-12-18T00:52:01.9685927Z  2024-12-18T00:52:01.9686473Z  2024-12-18T00:52:01.9686863Z  2024-12-18T00:52:01.9687247Z  2024-12-18T00:52:01.9687633Z  2024-12-18T00:52:01.9688021Z  2024-12-18T00:52:01.9688410Z  2024-12-18T00:52:01.9688787Z  2024-12-18T00:52:01.9689773Z [16,631 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:01.9690906Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:52:01.9691929Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:52:01.9692933Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:52:01.9693972Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:52:01.9695016Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:52:01.9695907Z Compiling xla/literal.cc; 13s local 2024-12-18T00:52:01.9696775Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2024-12-18T00:52:01.9697698Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2024-12-18T00:52:02.3616204Z 2024-12-18T00:52:02.3617252Z  2024-12-18T00:52:02.3617725Z  2024-12-18T00:52:02.3618134Z  2024-12-18T00:52:02.3618528Z  2024-12-18T00:52:02.3618912Z  2024-12-18T00:52:02.3619312Z  2024-12-18T00:52:02.3619986Z  2024-12-18T00:52:02.3620380Z  2024-12-18T00:52:02.3621345Z [16,633 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:02.3622565Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2024-12-18T00:52:02.3623853Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:52:02.3625051Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:02.3626175Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:52:02.3627323Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2024-12-18T00:52:02.3628189Z Compiling xla/literal.cc; 13s local 2024-12-18T00:52:02.3628997Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:52:02.3630047Z .../rpc/coordination:grpc_coordination_service_impl; 11s local ... 2024-12-18T00:52:02.5952326Z 2024-12-18T00:52:02.5953246Z  2024-12-18T00:52:02.5953756Z  2024-12-18T00:52:02.5954156Z  2024-12-18T00:52:02.5954552Z  2024-12-18T00:52:02.5954935Z  2024-12-18T00:52:02.5955328Z  2024-12-18T00:52:02.5955683Z  2024-12-18T00:52:02.5956029Z  2024-12-18T00:52:02.5956823Z [16,635 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:02.5957846Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:52:02.5958866Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:52:02.5959837Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:02.5960822Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:52:02.5961796Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:52:02.5962570Z Compiling xla/literal.cc; 14s local 2024-12-18T00:52:02.5963287Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:52:02.5964253Z .../rpc/coordination:grpc_coordination_service_impl; 11s local ... 2024-12-18T00:52:02.9599610Z 2024-12-18T00:52:02.9600483Z  2024-12-18T00:52:02.9600918Z  2024-12-18T00:52:02.9601302Z  2024-12-18T00:52:02.9601985Z  2024-12-18T00:52:02.9602384Z  2024-12-18T00:52:02.9602791Z  2024-12-18T00:52:02.9603187Z  2024-12-18T00:52:02.9603591Z  2024-12-18T00:52:02.9604528Z [16,636 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:02.9605645Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:52:02.9606669Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:52:02.9607716Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:02.9608724Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:52:02.9609783Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:52:02.9610448Z Compiling xla/literal.cc; 14s local 2024-12-18T00:52:02.9611089Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:52:02.9611835Z .../rpc/coordination:grpc_coordination_service_impl; 11s local ... 2024-12-18T00:52:03.1623445Z 2024-12-18T00:52:03.1624379Z  2024-12-18T00:52:03.1624871Z  2024-12-18T00:52:03.1625292Z  2024-12-18T00:52:03.1625711Z  2024-12-18T00:52:03.1626100Z  2024-12-18T00:52:03.1626517Z  2024-12-18T00:52:03.1626929Z  2024-12-18T00:52:03.1627343Z  2024-12-18T00:52:03.1628319Z [16,637 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:03.1629546Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:52:03.1630696Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:52:03.1632244Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:03.1633275Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:52:03.1634375Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:52:03.1635182Z Compiling xla/literal.cc; 14s local 2024-12-18T00:52:03.1636112Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2024-12-18T00:52:03.1637191Z .../rpc/coordination:grpc_coordination_service_impl; 11s local ... 2024-12-18T00:52:03.3627742Z 2024-12-18T00:52:03.3628588Z  2024-12-18T00:52:03.3629070Z  2024-12-18T00:52:03.3629495Z  2024-12-18T00:52:03.3629906Z  2024-12-18T00:52:03.3630324Z  2024-12-18T00:52:03.3630733Z  2024-12-18T00:52:03.3631150Z  2024-12-18T00:52:03.3631554Z  2024-12-18T00:52:03.3632548Z [16,639 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:03.3633803Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2024-12-18T00:52:03.3634936Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:52:03.3635957Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:52:03.3636967Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:52:03.3638007Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2024-12-18T00:52:03.3638801Z Compiling xla/literal.cc; 14s local 2024-12-18T00:52:03.3639547Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:52:03.3640516Z .../rpc/coordination:grpc_coordination_service_impl; 12s local ... 2024-12-18T00:52:03.6996071Z 2024-12-18T00:52:03.6996956Z  2024-12-18T00:52:03.6997458Z  2024-12-18T00:52:03.6997864Z  2024-12-18T00:52:03.6998292Z  2024-12-18T00:52:03.6998680Z  2024-12-18T00:52:03.6999076Z  2024-12-18T00:52:03.6999475Z  2024-12-18T00:52:03.6999884Z  2024-12-18T00:52:03.7000857Z [16,641 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:03.7002019Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:52:03.7003083Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:52:03.7004439Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:52:03.7005487Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:52:03.7006531Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:52:03.7007342Z Compiling xla/literal.cc; 15s local 2024-12-18T00:52:03.7008131Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:52:03.7009114Z .../rpc/coordination:grpc_coordination_service_impl; 12s local ... 2024-12-18T00:52:03.9154842Z 2024-12-18T00:52:03.9155926Z  2024-12-18T00:52:03.9156473Z  2024-12-18T00:52:03.9156886Z  2024-12-18T00:52:03.9157345Z  2024-12-18T00:52:03.9157726Z  2024-12-18T00:52:03.9158120Z  2024-12-18T00:52:03.9158509Z  2024-12-18T00:52:03.9158862Z  2024-12-18T00:52:03.9159792Z [16,643 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:03.9160966Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:52:03.9162046Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:52:03.9163102Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:52:03.9164057Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:52:03.9164910Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:52:03.9165825Z Compiling xla/literal.cc; 15s local 2024-12-18T00:52:03.9166529Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:52:03.9167774Z .../rpc/coordination:grpc_coordination_service_impl; 12s local ... 2024-12-18T00:52:04.1635083Z 2024-12-18T00:52:04.1635975Z  2024-12-18T00:52:04.1636467Z  2024-12-18T00:52:04.1636864Z  2024-12-18T00:52:04.1637265Z  2024-12-18T00:52:04.1637648Z  2024-12-18T00:52:04.1638068Z  2024-12-18T00:52:04.1638465Z  2024-12-18T00:52:04.1639442Z  2024-12-18T00:52:04.1640413Z [16,644 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:04.1641605Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:52:04.1642695Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:52:04.1643717Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:52:04.1645082Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:52:04.1646094Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:52:04.1646893Z Compiling xla/literal.cc; 15s local 2024-12-18T00:52:04.1647620Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2024-12-18T00:52:04.1648564Z .../rpc/coordination:grpc_coordination_service_impl; 12s local ... 2024-12-18T00:52:04.4034530Z 2024-12-18T00:52:04.4035422Z  2024-12-18T00:52:04.4036061Z  2024-12-18T00:52:04.4036490Z  2024-12-18T00:52:04.4036829Z  2024-12-18T00:52:04.4037232Z  2024-12-18T00:52:04.4037620Z  2024-12-18T00:52:04.4038021Z  2024-12-18T00:52:04.4038390Z  2024-12-18T00:52:04.4039326Z [16,646 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:04.4040463Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2024-12-18T00:52:04.4041465Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:52:04.4042445Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:04.4043447Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:52:04.4044891Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2024-12-18T00:52:04.4045672Z Compiling xla/literal.cc; 15s local 2024-12-18T00:52:04.4046435Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:52:04.4047637Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:04.7601589Z 2024-12-18T00:52:04.7602541Z  2024-12-18T00:52:04.7603009Z  2024-12-18T00:52:04.7603398Z  2024-12-18T00:52:04.7603788Z  2024-12-18T00:52:04.7604183Z  2024-12-18T00:52:04.7604575Z  2024-12-18T00:52:04.7604925Z  2024-12-18T00:52:04.7605287Z  2024-12-18T00:52:04.7606163Z [16,647 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:04.7607285Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:52:04.7608343Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:52:04.7609335Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:04.7610339Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:52:04.7611391Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:52:04.7612215Z Compiling xla/literal.cc; 16s local 2024-12-18T00:52:04.7612927Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:52:04.7613739Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:04.9642167Z 2024-12-18T00:52:04.9643046Z  2024-12-18T00:52:04.9643478Z  2024-12-18T00:52:04.9643817Z  2024-12-18T00:52:04.9644411Z  2024-12-18T00:52:04.9644781Z  2024-12-18T00:52:04.9645163Z  2024-12-18T00:52:04.9645540Z  2024-12-18T00:52:04.9645893Z  2024-12-18T00:52:04.9647128Z [16,647 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:04.9648344Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:52:04.9649314Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:52:04.9650304Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:04.9651435Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:52:04.9652555Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:52:04.9653311Z Compiling xla/literal.cc; 16s local 2024-12-18T00:52:04.9654023Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:52:04.9654820Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:52:05.1646437Z 2024-12-18T00:52:05.1647329Z  2024-12-18T00:52:05.1647769Z  2024-12-18T00:52:05.1648168Z  2024-12-18T00:52:05.1648546Z  2024-12-18T00:52:05.1648936Z  2024-12-18T00:52:05.1649306Z  2024-12-18T00:52:05.1649719Z  2024-12-18T00:52:05.1650084Z  2024-12-18T00:52:05.1651002Z [16,648 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:05.1652110Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:52:05.1653346Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:52:05.1654376Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:05.1655383Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:52:05.1656537Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:52:05.1657274Z Compiling xla/literal.cc; 16s local 2024-12-18T00:52:05.1657977Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2024-12-18T00:52:05.1658782Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:52:05.3701049Z 2024-12-18T00:52:05.3701929Z  2024-12-18T00:52:05.3702449Z  2024-12-18T00:52:05.3702858Z  2024-12-18T00:52:05.3703257Z  2024-12-18T00:52:05.3703672Z  2024-12-18T00:52:05.3704080Z  2024-12-18T00:52:05.3704481Z  2024-12-18T00:52:05.3704864Z  2024-12-18T00:52:05.3705816Z [16,652 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:05.3707246Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2024-12-18T00:52:05.3708777Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:52:05.3709902Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:05.3711154Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:52:05.3712394Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2024-12-18T00:52:05.3713317Z Compiling xla/literal.cc; 16s local 2024-12-18T00:52:05.3714172Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:52:05.3715222Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:52:05.6375144Z 2024-12-18T00:52:05.6376072Z  2024-12-18T00:52:05.6376721Z  2024-12-18T00:52:05.6377123Z  2024-12-18T00:52:05.6377546Z  2024-12-18T00:52:05.6377985Z  2024-12-18T00:52:05.6378363Z  2024-12-18T00:52:05.6378771Z  2024-12-18T00:52:05.6379166Z  2024-12-18T00:52:05.6380121Z [16,654 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:05.6381309Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:52:05.6382425Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:52:05.6383500Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:05.6385058Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:52:05.6386462Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:52:05.6387489Z Compiling xla/literal.cc; 17s local 2024-12-18T00:52:05.6388353Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:52:05.6389357Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:52:05.8537236Z 2024-12-18T00:52:05.8538126Z  2024-12-18T00:52:05.8538597Z  2024-12-18T00:52:05.8539449Z  2024-12-18T00:52:05.8539875Z  2024-12-18T00:52:05.8540297Z  2024-12-18T00:52:05.8540694Z  2024-12-18T00:52:05.8541106Z  2024-12-18T00:52:05.8541504Z  2024-12-18T00:52:05.8542449Z [16,655 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:05.8543598Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:52:05.8544928Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:52:05.8546000Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:05.8547093Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:52:05.8548200Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:52:05.8549039Z Compiling xla/literal.cc; 17s local 2024-12-18T00:52:05.8549865Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:52:05.8550778Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:52:06.1629796Z 2024-12-18T00:52:06.1630740Z  2024-12-18T00:52:06.1631244Z  2024-12-18T00:52:06.1631636Z  2024-12-18T00:52:06.1632037Z  2024-12-18T00:52:06.1632577Z  2024-12-18T00:52:06.1632986Z  2024-12-18T00:52:06.1633376Z  2024-12-18T00:52:06.1633766Z  2024-12-18T00:52:06.1634769Z [16,657 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:06.1635989Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:52:06.1637164Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:52:06.1638259Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:06.1639344Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:52:06.1640631Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:52:06.1641443Z Compiling xla/literal.cc; 17s local 2024-12-18T00:52:06.1642215Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2024-12-18T00:52:06.1643073Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:52:06.3652508Z 2024-12-18T00:52:06.3653429Z  2024-12-18T00:52:06.3653900Z  2024-12-18T00:52:06.3654327Z  2024-12-18T00:52:06.3654737Z  2024-12-18T00:52:06.3655137Z  2024-12-18T00:52:06.3655721Z  2024-12-18T00:52:06.3656129Z  2024-12-18T00:52:06.3656704Z  2024-12-18T00:52:06.3657680Z [16,658 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:06.3658817Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2024-12-18T00:52:06.3659939Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:52:06.3660891Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:52:06.3661919Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:52:06.3662973Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2024-12-18T00:52:06.3663789Z Compiling xla/literal.cc; 17s local 2024-12-18T00:52:06.3664561Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:52:06.3665467Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:52:06.6397856Z 2024-12-18T00:52:06.6398740Z  2024-12-18T00:52:06.6399269Z  2024-12-18T00:52:06.6399654Z  2024-12-18T00:52:06.6400029Z  2024-12-18T00:52:06.6400402Z  2024-12-18T00:52:06.6401056Z  2024-12-18T00:52:06.6401610Z  2024-12-18T00:52:06.6402122Z  2024-12-18T00:52:06.6403255Z [16,660 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:06.6404380Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:52:06.6405644Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:52:06.6406751Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:52:06.6408253Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:52:06.6409493Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:52:06.6410461Z Compiling xla/literal.cc; 18s local 2024-12-18T00:52:06.6411362Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:52:06.6412361Z @llvm-project//llvm:Instrumentation; 12s local ... 2024-12-18T00:52:06.9658485Z 2024-12-18T00:52:06.9659340Z  2024-12-18T00:52:06.9659835Z  2024-12-18T00:52:06.9660229Z  2024-12-18T00:52:06.9660632Z  2024-12-18T00:52:06.9661032Z  2024-12-18T00:52:06.9661426Z  2024-12-18T00:52:06.9661822Z  2024-12-18T00:52:06.9662202Z  2024-12-18T00:52:06.9663186Z [16,661 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:06.9664314Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:52:06.9665374Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:52:06.9666393Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:52:06.9667394Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:52:06.9668431Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:52:06.9669237Z Compiling xla/literal.cc; 18s local 2024-12-18T00:52:06.9669991Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:52:06.9670860Z @llvm-project//llvm:Instrumentation; 13s local ... 2024-12-18T00:52:07.1662849Z 2024-12-18T00:52:07.1663730Z  2024-12-18T00:52:07.1664212Z  2024-12-18T00:52:07.1664627Z  2024-12-18T00:52:07.1665346Z  2024-12-18T00:52:07.1665727Z  2024-12-18T00:52:07.1666097Z  2024-12-18T00:52:07.1666488Z  2024-12-18T00:52:07.1666854Z  2024-12-18T00:52:07.1667726Z [16,664 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:07.1668858Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:52:07.1669860Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:52:07.1670862Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:52:07.1671878Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:52:07.1672939Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:52:07.1673681Z Compiling xla/literal.cc; 18s local 2024-12-18T00:52:07.1674398Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2024-12-18T00:52:07.1675446Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 10s local ... 2024-12-18T00:52:07.4288020Z 2024-12-18T00:52:07.4288825Z  2024-12-18T00:52:07.4289357Z  2024-12-18T00:52:07.4290095Z  2024-12-18T00:52:07.4290645Z  2024-12-18T00:52:07.4291164Z  2024-12-18T00:52:07.4291686Z  2024-12-18T00:52:07.4292198Z  2024-12-18T00:52:07.4292696Z  2024-12-18T00:52:07.4293747Z [16,668 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:07.4295015Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2024-12-18T00:52:07.4296198Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:52:07.4297729Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:52:07.4298896Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:52:07.4300073Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2024-12-18T00:52:07.4300972Z Compiling xla/literal.cc; 18s local 2024-12-18T00:52:07.4302043Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:07.4303327Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 10s local ... 2024-12-18T00:52:07.6535288Z 2024-12-18T00:52:07.6536469Z  2024-12-18T00:52:07.6537974Z  2024-12-18T00:52:07.6539918Z  2024-12-18T00:52:07.6540326Z  2024-12-18T00:52:07.6540713Z  2024-12-18T00:52:07.6541086Z  2024-12-18T00:52:07.6541476Z  2024-12-18T00:52:07.6541873Z  2024-12-18T00:52:07.6542864Z [16,670 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:07.6544053Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:52:07.6545401Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:52:07.6546449Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:52:07.6547695Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:52:07.6548796Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:52:07.6549606Z Compiling xla/literal.cc; 19s local 2024-12-18T00:52:07.6550397Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:07.6551447Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 10s local ... 2024-12-18T00:52:07.9669406Z 2024-12-18T00:52:07.9670283Z  2024-12-18T00:52:07.9670734Z  2024-12-18T00:52:07.9671100Z  2024-12-18T00:52:07.9671473Z  2024-12-18T00:52:07.9671836Z  2024-12-18T00:52:07.9672231Z  2024-12-18T00:52:07.9672579Z  2024-12-18T00:52:07.9673333Z  2024-12-18T00:52:07.9674543Z [16,671 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:07.9675837Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:52:07.9677088Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:52:07.9678559Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:52:07.9679726Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:52:07.9680931Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:52:07.9681852Z Compiling xla/literal.cc; 19s local 2024-12-18T00:52:07.9682754Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:07.9683876Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 10s local ... 2024-12-18T00:52:08.1674229Z 2024-12-18T00:52:08.1675200Z  2024-12-18T00:52:08.1676538Z  2024-12-18T00:52:08.1677290Z  2024-12-18T00:52:08.1678075Z  2024-12-18T00:52:08.1679218Z  2024-12-18T00:52:08.1679850Z  2024-12-18T00:52:08.1680538Z  2024-12-18T00:52:08.1681725Z  2024-12-18T00:52:08.1682831Z [16,673 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:08.1684030Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2024-12-18T00:52:08.1685169Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:52:08.1686261Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:52:08.1687327Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:52:08.1688421Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2024-12-18T00:52:08.1689325Z Compiling xla/literal.cc; 19s local 2024-12-18T00:52:08.1690438Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2024-12-18T00:52:08.1691737Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:52:08.7389158Z 2024-12-18T00:52:08.7389983Z  2024-12-18T00:52:08.7390475Z  2024-12-18T00:52:08.7390809Z  2024-12-18T00:52:08.7391174Z  2024-12-18T00:52:08.7391528Z  2024-12-18T00:52:08.7391913Z  2024-12-18T00:52:08.7392259Z  2024-12-18T00:52:08.7392965Z  2024-12-18T00:52:08.7393797Z [16,674 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:08.7394813Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:52:08.7395794Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:52:08.7396716Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:52:08.7397614Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:52:08.7398540Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:52:08.7399267Z Compiling xla/literal.cc; 20s local 2024-12-18T00:52:08.7399941Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:52:08.7400903Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:52:08.9681482Z 2024-12-18T00:52:08.9682411Z  2024-12-18T00:52:08.9682890Z  2024-12-18T00:52:08.9683313Z  2024-12-18T00:52:08.9683715Z  2024-12-18T00:52:08.9684097Z  2024-12-18T00:52:08.9684447Z  2024-12-18T00:52:08.9684827Z  2024-12-18T00:52:08.9685196Z  2024-12-18T00:52:08.9686102Z [16,675 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:08.9687177Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:52:08.9688279Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:52:08.9689203Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:52:08.9690238Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:52:08.9691277Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:52:08.9692123Z Compiling xla/literal.cc; 20s local 2024-12-18T00:52:08.9692833Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:52:08.9694232Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:52:09.2359164Z 2024-12-18T00:52:09.2360062Z  2024-12-18T00:52:09.2360532Z  2024-12-18T00:52:09.2360902Z  2024-12-18T00:52:09.2361392Z  2024-12-18T00:52:09.2361752Z  2024-12-18T00:52:09.2362113Z  2024-12-18T00:52:09.2362431Z  2024-12-18T00:52:09.2362775Z  2024-12-18T00:52:09.2363601Z [16,677 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:09.2364601Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:52:09.2365605Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:52:09.2366611Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:52:09.2367594Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:52:09.2368642Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:52:09.2369382Z Compiling xla/literal.cc; 20s local 2024-12-18T00:52:09.2370059Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2024-12-18T00:52:09.2370943Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local ... 2024-12-18T00:52:09.4807971Z 2024-12-18T00:52:09.4808886Z  2024-12-18T00:52:09.4809818Z  2024-12-18T00:52:09.4810341Z  2024-12-18T00:52:09.4810927Z  2024-12-18T00:52:09.4811544Z  2024-12-18T00:52:09.4812110Z  2024-12-18T00:52:09.4812642Z  2024-12-18T00:52:09.4813141Z  2024-12-18T00:52:09.4814454Z [16,678 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:09.4815712Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2024-12-18T00:52:09.4817050Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:52:09.4818224Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:09.4819674Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:52:09.4820913Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2024-12-18T00:52:09.4821889Z Compiling xla/literal.cc; 21s local 2024-12-18T00:52:09.4822794Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:09.4823909Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local ... 2024-12-18T00:52:09.7129025Z 2024-12-18T00:52:09.7129986Z  2024-12-18T00:52:09.7131525Z  2024-12-18T00:52:09.7132397Z  2024-12-18T00:52:09.7133254Z  2024-12-18T00:52:09.7134542Z  2024-12-18T00:52:09.7135346Z  2024-12-18T00:52:09.7136121Z  2024-12-18T00:52:09.7136695Z  2024-12-18T00:52:09.7137601Z [16,682 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:09.7138742Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2024-12-18T00:52:09.7139805Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:52:09.7140803Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:09.7141755Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:52:09.7142811Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:52:09.7143588Z Compiling xla/literal.cc; 21s local 2024-12-18T00:52:09.7144561Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:09.7145516Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local ... 2024-12-18T00:52:09.9689126Z 2024-12-18T00:52:09.9690460Z  2024-12-18T00:52:09.9690955Z  2024-12-18T00:52:09.9691371Z  2024-12-18T00:52:09.9691759Z  2024-12-18T00:52:09.9692161Z  2024-12-18T00:52:09.9692573Z  2024-12-18T00:52:09.9692971Z  2024-12-18T00:52:09.9693641Z  2024-12-18T00:52:09.9694606Z [16,684 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:09.9695767Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2024-12-18T00:52:09.9696995Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:52:09.9698056Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:09.9699087Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:52:09.9700124Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:52:09.9700931Z Compiling xla/literal.cc; 21s local 2024-12-18T00:52:09.9701710Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:09.9702652Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local ... 2024-12-18T00:52:10.1971434Z 2024-12-18T00:52:10.1972312Z  2024-12-18T00:52:10.1972852Z  2024-12-18T00:52:10.1973302Z  2024-12-18T00:52:10.1973714Z  2024-12-18T00:52:10.1974106Z  2024-12-18T00:52:10.1974521Z  2024-12-18T00:52:10.1974918Z  2024-12-18T00:52:10.1975295Z  2024-12-18T00:52:10.1976240Z [16,685 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:10.1977574Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2024-12-18T00:52:10.1978598Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:52:10.1979610Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:10.1980640Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:52:10.1982067Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:52:10.1982854Z Compiling xla/literal.cc; 21s local 2024-12-18T00:52:10.1983590Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2024-12-18T00:52:10.1984460Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local ... 2024-12-18T00:52:10.4673411Z 2024-12-18T00:52:10.4676425Z  2024-12-18T00:52:10.4678868Z  2024-12-18T00:52:10.4680954Z  2024-12-18T00:52:10.4683012Z  2024-12-18T00:52:10.4685083Z  2024-12-18T00:52:10.4687069Z  2024-12-18T00:52:10.4689200Z  2024-12-18T00:52:10.4691214Z  2024-12-18T00:52:10.4693756Z [16,688 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:10.4696620Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2024-12-18T00:52:10.4699396Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:52:10.4702022Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:52:10.4704626Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:52:10.4707303Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2024-12-18T00:52:10.4709705Z Compiling xla/literal.cc; 22s local 2024-12-18T00:52:10.4712063Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:52:10.4714812Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local ... 2024-12-18T00:52:10.7698309Z 2024-12-18T00:52:10.7700658Z  2024-12-18T00:52:10.7702549Z  2024-12-18T00:52:10.7704334Z  2024-12-18T00:52:10.7706134Z  2024-12-18T00:52:10.7707922Z  2024-12-18T00:52:10.7709712Z  2024-12-18T00:52:10.7711522Z  2024-12-18T00:52:10.7713341Z  2024-12-18T00:52:10.7715666Z [16,692 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:10.7718238Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:52:10.7720629Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:52:10.7722981Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:52:10.7725770Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:52:10.7727960Z Compiling xla/literal.cc; 22s local 2024-12-18T00:52:10.7730101Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:52:10.7732358Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2024-12-18T00:52:10.7734655Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local ... 2024-12-18T00:52:11.1460220Z 2024-12-18T00:52:11.1461073Z  2024-12-18T00:52:11.1461469Z  2024-12-18T00:52:11.1461803Z  2024-12-18T00:52:11.1462133Z  2024-12-18T00:52:11.1462441Z  2024-12-18T00:52:11.1462757Z  2024-12-18T00:52:11.1463079Z  2024-12-18T00:52:11.1463412Z  2024-12-18T00:52:11.1464244Z [16,693 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:11.1465191Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:52:11.1466004Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:52:11.1467010Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:52:11.1467855Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:52:11.1468511Z Compiling xla/literal.cc; 22s local 2024-12-18T00:52:11.1469121Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2024-12-18T00:52:11.1469859Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:52:11.1470717Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local ... 2024-12-18T00:52:11.3706450Z 2024-12-18T00:52:11.3707300Z  2024-12-18T00:52:11.3707772Z  2024-12-18T00:52:11.3708162Z  2024-12-18T00:52:11.3708835Z  2024-12-18T00:52:11.3709241Z  2024-12-18T00:52:11.3709630Z  2024-12-18T00:52:11.3709997Z  2024-12-18T00:52:11.3710341Z  2024-12-18T00:52:11.3711276Z [16,693 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:11.3712581Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:52:11.3713617Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:11.3714635Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:52:11.3715653Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2024-12-18T00:52:11.3716390Z Compiling xla/literal.cc; 22s local 2024-12-18T00:52:11.3726708Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:11.3727778Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:52:11.3728698Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local ... 2024-12-18T00:52:11.7712078Z 2024-12-18T00:52:11.7712973Z  2024-12-18T00:52:11.7713428Z  2024-12-18T00:52:11.7713812Z  2024-12-18T00:52:11.7714203Z  2024-12-18T00:52:11.7714553Z  2024-12-18T00:52:11.7714960Z  2024-12-18T00:52:11.7715339Z  2024-12-18T00:52:11.7715751Z  2024-12-18T00:52:11.7716637Z [16,694 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:11.7717735Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:52:11.7718668Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:11.7719633Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:52:11.7720549Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:52:11.7721280Z Compiling xla/literal.cc; 23s local 2024-12-18T00:52:11.7721952Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:11.7722788Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2024-12-18T00:52:11.7723677Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local ... 2024-12-18T00:52:11.9716298Z 2024-12-18T00:52:11.9717383Z  2024-12-18T00:52:11.9717796Z  2024-12-18T00:52:11.9718132Z  2024-12-18T00:52:11.9718480Z  2024-12-18T00:52:11.9718806Z  2024-12-18T00:52:11.9719135Z  2024-12-18T00:52:11.9719466Z  2024-12-18T00:52:11.9719774Z  2024-12-18T00:52:11.9720560Z [16,695 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:11.9721538Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:52:11.9722388Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:11.9723209Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:52:11.9724073Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2024-12-18T00:52:11.9724711Z Compiling xla/literal.cc; 23s local 2024-12-18T00:52:11.9725343Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:11.9726087Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:52:11.9726873Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local ... 2024-12-18T00:52:12.1796111Z 2024-12-18T00:52:12.1796984Z  2024-12-18T00:52:12.1797479Z  2024-12-18T00:52:12.1797862Z  2024-12-18T00:52:12.1798248Z  2024-12-18T00:52:12.1798604Z  2024-12-18T00:52:12.1798995Z  2024-12-18T00:52:12.1799517Z  2024-12-18T00:52:12.1799908Z  2024-12-18T00:52:12.1800836Z [16,697 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:12.1801984Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:52:12.1803409Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:12.1804422Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:52:12.1805261Z Compiling xla/literal.cc; 23s local 2024-12-18T00:52:12.1805995Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2024-12-18T00:52:12.1807088Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:52:12.1808207Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2024-12-18T00:52:12.1809052Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:52:12.5023647Z 2024-12-18T00:52:12.5024561Z  2024-12-18T00:52:12.5025173Z  2024-12-18T00:52:12.5025556Z  2024-12-18T00:52:12.5025941Z  2024-12-18T00:52:12.5026306Z  2024-12-18T00:52:12.5026689Z  2024-12-18T00:52:12.5027062Z  2024-12-18T00:52:12.5027449Z  2024-12-18T00:52:12.5028425Z [16,700 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:12.5029562Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:52:12.5030610Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:12.5031596Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:52:12.5032599Z Compiling xla/literal.cc; 24s local 2024-12-18T00:52:12.5033331Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:12.5034125Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:52:12.5034894Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:52:12.5035901Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local ... 2024-12-18T00:52:12.7722813Z 2024-12-18T00:52:12.7723708Z  2024-12-18T00:52:12.7724217Z  2024-12-18T00:52:12.7724643Z  2024-12-18T00:52:12.7725039Z  2024-12-18T00:52:12.7725412Z  2024-12-18T00:52:12.7725802Z  2024-12-18T00:52:12.7726244Z  2024-12-18T00:52:12.7726653Z  2024-12-18T00:52:12.7727578Z [16,701 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:12.7728839Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:52:12.7730193Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:12.7731287Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:52:12.7732197Z Compiling xla/literal.cc; 24s local 2024-12-18T00:52:12.7732966Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:12.7733893Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2024-12-18T00:52:12.7734901Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:52:12.7736071Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local ... 2024-12-18T00:52:13.0320039Z 2024-12-18T00:52:13.0320975Z  2024-12-18T00:52:13.0321472Z  2024-12-18T00:52:13.0321866Z  2024-12-18T00:52:13.0322289Z  2024-12-18T00:52:13.0322668Z  2024-12-18T00:52:13.0323065Z  2024-12-18T00:52:13.0323467Z  2024-12-18T00:52:13.0323819Z  2024-12-18T00:52:13.0324791Z [16,703 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:13.0325847Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:13.0326850Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:52:13.0327761Z Compiling xla/literal.cc; 24s local 2024-12-18T00:52:13.0328464Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:13.0329416Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:52:13.0330359Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:52:13.0331736Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local 2024-12-18T00:52:13.0332975Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2024-12-18T00:52:13.2597075Z 2024-12-18T00:52:13.2597958Z  2024-12-18T00:52:13.2598367Z  2024-12-18T00:52:13.2598748Z  2024-12-18T00:52:13.2599170Z  2024-12-18T00:52:13.2599524Z  2024-12-18T00:52:13.2600263Z  2024-12-18T00:52:13.2600662Z  2024-12-18T00:52:13.2600981Z  2024-12-18T00:52:13.2601737Z [16,706 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:13.2602623Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:13.2603521Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:52:13.2604285Z Compiling xla/literal.cc; 24s local 2024-12-18T00:52:13.2605170Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2024-12-18T00:52:13.2606200Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:52:13.2607295Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2024-12-18T00:52:13.2608569Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local 2024-12-18T00:52:13.2609929Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2024-12-18T00:52:13.5731382Z 2024-12-18T00:52:13.5732289Z  2024-12-18T00:52:13.5732792Z  2024-12-18T00:52:13.5733211Z  2024-12-18T00:52:13.5733602Z  2024-12-18T00:52:13.5734011Z  2024-12-18T00:52:13.5734428Z  2024-12-18T00:52:13.5734856Z  2024-12-18T00:52:13.5735242Z  2024-12-18T00:52:13.5736210Z [16,708 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:13.5737497Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:52:13.5738674Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:52:13.5739567Z Compiling xla/literal.cc; 25s local 2024-12-18T00:52:13.5740260Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:52:13.5741088Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:52:13.5741952Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:52:13.5743349Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 10s local 2024-12-18T00:52:13.5744618Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2024-12-18T00:52:13.7735052Z 2024-12-18T00:52:13.7735975Z  2024-12-18T00:52:13.7736631Z  2024-12-18T00:52:13.7737028Z  2024-12-18T00:52:13.7737422Z  2024-12-18T00:52:13.7737797Z  2024-12-18T00:52:13.7738183Z  2024-12-18T00:52:13.7738557Z  2024-12-18T00:52:13.7738945Z  2024-12-18T00:52:13.7739867Z [16,710 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:13.7740963Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:52:13.7741987Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:52:13.7742850Z Compiling xla/literal.cc; 25s local 2024-12-18T00:52:13.7743622Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:52:13.7744797Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2024-12-18T00:52:13.7745724Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:52:13.7746765Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 10s local 2024-12-18T00:52:13.7747887Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2024-12-18T00:52:14.2444113Z 2024-12-18T00:52:14.2445309Z  2024-12-18T00:52:14.2445810Z  2024-12-18T00:52:14.2446211Z  2024-12-18T00:52:14.2446625Z  2024-12-18T00:52:14.2447037Z  2024-12-18T00:52:14.2447435Z  2024-12-18T00:52:14.2447833Z  2024-12-18T00:52:14.2448513Z  2024-12-18T00:52:14.2449619Z [16,711 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:14.2450688Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:52:14.2451732Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:52:14.2452855Z Compiling xla/literal.cc; 25s local 2024-12-18T00:52:14.2453565Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2024-12-18T00:52:14.2454470Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:52:14.2455413Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2024-12-18T00:52:14.2456702Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 10s local 2024-12-18T00:52:14.2457890Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2024-12-18T00:52:14.5674445Z 2024-12-18T00:52:14.5675273Z  2024-12-18T00:52:14.5675721Z  2024-12-18T00:52:14.5676149Z  2024-12-18T00:52:14.5676526Z  2024-12-18T00:52:14.5676945Z  2024-12-18T00:52:14.5677368Z  2024-12-18T00:52:14.5677793Z  2024-12-18T00:52:14.5678188Z  2024-12-18T00:52:14.5679152Z [16,712 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:14.5680316Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2024-12-18T00:52:14.5681394Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:52:14.5682291Z Compiling xla/literal.cc; 26s local 2024-12-18T00:52:14.5683070Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:52:14.5684012Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:52:14.5685028Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:52:14.5686197Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 11s local 2024-12-18T00:52:14.5687510Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2024-12-18T00:52:14.7742897Z 2024-12-18T00:52:14.7743809Z  2024-12-18T00:52:14.7744508Z  2024-12-18T00:52:14.7744933Z  2024-12-18T00:52:14.7745337Z  2024-12-18T00:52:14.7745994Z  2024-12-18T00:52:14.7746402Z  2024-12-18T00:52:14.7746838Z  2024-12-18T00:52:14.7747236Z  2024-12-18T00:52:14.7748185Z [16,715 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:52:14.7749336Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2024-12-18T00:52:14.7750408Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:52:14.7751333Z Compiling xla/literal.cc; 26s local 2024-12-18T00:52:14.7752072Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:52:14.7752981Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2024-12-18T00:52:14.7753845Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:52:14.7754906Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 11s local 2024-12-18T00:52:14.7755981Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2024-12-18T00:52:15.0665429Z 2024-12-18T00:52:15.0666309Z  2024-12-18T00:52:15.0666865Z  2024-12-18T00:52:15.0667289Z  2024-12-18T00:52:15.0667667Z  2024-12-18T00:52:15.0668081Z  2024-12-18T00:52:15.0668477Z  2024-12-18T00:52:15.0668850Z  2024-12-18T00:52:15.0669222Z  2024-12-18T00:52:15.0670145Z [16,719 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:15.0671260Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:52:15.0672168Z Compiling xla/literal.cc; 26s local 2024-12-18T00:52:15.0672959Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2024-12-18T00:52:15.0674163Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:52:15.0675109Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:52:15.0676246Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 11s local 2024-12-18T00:52:15.0677698Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2024-12-18T00:52:15.0678752Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:52:15.3752454Z 2024-12-18T00:52:15.3753372Z  2024-12-18T00:52:15.3753857Z  2024-12-18T00:52:15.3754274Z  2024-12-18T00:52:15.3754686Z  2024-12-18T00:52:15.3755085Z  2024-12-18T00:52:15.3755457Z  2024-12-18T00:52:15.3755846Z  2024-12-18T00:52:15.3756231Z  2024-12-18T00:52:15.3757170Z [16,721 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:15.3758361Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:52:15.3759338Z Compiling xla/literal.cc; 26s local 2024-12-18T00:52:15.3760147Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:52:15.3761115Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:52:15.3762060Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2024-12-18T00:52:15.3763148Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:15.3764245Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2024-12-18T00:52:15.3765248Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:52:15.5753387Z 2024-12-18T00:52:15.5754286Z  2024-12-18T00:52:15.5754732Z  2024-12-18T00:52:15.5755098Z  2024-12-18T00:52:15.5755452Z  2024-12-18T00:52:15.5755965Z  2024-12-18T00:52:15.5756346Z  2024-12-18T00:52:15.5756726Z  2024-12-18T00:52:15.5757064Z  2024-12-18T00:52:15.5757944Z [16,723 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:15.5759021Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:52:15.5759863Z Compiling xla/literal.cc; 27s local 2024-12-18T00:52:15.5760897Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:52:15.5761857Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:52:15.5762745Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:52:15.5763780Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:15.5764860Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2024-12-18T00:52:15.5765795Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:52:15.8361090Z 2024-12-18T00:52:15.8361968Z  2024-12-18T00:52:15.8362441Z  2024-12-18T00:52:15.8362839Z  2024-12-18T00:52:15.8363250Z  2024-12-18T00:52:15.8363665Z  2024-12-18T00:52:15.8364032Z  2024-12-18T00:52:15.8364415Z  2024-12-18T00:52:15.8364795Z  2024-12-18T00:52:15.8365735Z [16,725 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:15.8366892Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:52:15.8367818Z Compiling xla/literal.cc; 27s local 2024-12-18T00:52:15.8368606Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:52:15.8369514Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2024-12-18T00:52:15.8370483Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:52:15.8371587Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:15.8372728Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2024-12-18T00:52:15.8373663Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:52:16.1237318Z 2024-12-18T00:52:16.1238215Z  2024-12-18T00:52:16.1238687Z  2024-12-18T00:52:16.1239058Z  2024-12-18T00:52:16.1239406Z  2024-12-18T00:52:16.1239788Z  2024-12-18T00:52:16.1240156Z  2024-12-18T00:52:16.1240542Z  2024-12-18T00:52:16.1240925Z  2024-12-18T00:52:16.1242031Z [16,726 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:16.1243340Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:52:16.1244460Z Compiling xla/literal.cc; 27s local 2024-12-18T00:52:16.1245232Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2024-12-18T00:52:16.1246099Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:52:16.1246988Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:52:16.1248087Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:16.1249262Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2024-12-18T00:52:16.1250199Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:52:16.3760527Z 2024-12-18T00:52:16.3761410Z  2024-12-18T00:52:16.3761837Z  2024-12-18T00:52:16.3762234Z  2024-12-18T00:52:16.3762584Z  2024-12-18T00:52:16.3762949Z  2024-12-18T00:52:16.3763316Z  2024-12-18T00:52:16.3763678Z  2024-12-18T00:52:16.3764048Z  2024-12-18T00:52:16.3764930Z [16,726 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:16.3766077Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:52:16.3766929Z Compiling xla/literal.cc; 27s local 2024-12-18T00:52:16.3767634Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:16.3768536Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2024-12-18T00:52:16.3769417Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2024-12-18T00:52:16.3770407Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:16.3771506Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2024-12-18T00:52:16.3772764Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:16.5764754Z 2024-12-18T00:52:16.5765651Z  2024-12-18T00:52:16.5766137Z  2024-12-18T00:52:16.5766560Z  2024-12-18T00:52:16.5766954Z  2024-12-18T00:52:16.5767365Z  2024-12-18T00:52:16.5767776Z  2024-12-18T00:52:16.5768196Z  2024-12-18T00:52:16.5768599Z  2024-12-18T00:52:16.5769585Z [16,728 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:16.5770784Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:52:16.5771669Z Compiling xla/literal.cc; 28s local 2024-12-18T00:52:16.5772474Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:16.5773498Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:52:16.5774596Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:16.5782949Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2024-12-18T00:52:16.5784180Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:16.5784942Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:52:16.8652272Z 2024-12-18T00:52:16.8653183Z  2024-12-18T00:52:16.8653716Z  2024-12-18T00:52:16.8654132Z  2024-12-18T00:52:16.8654540Z  2024-12-18T00:52:16.8654915Z  2024-12-18T00:52:16.8655329Z  2024-12-18T00:52:16.8655728Z  2024-12-18T00:52:16.8656128Z  2024-12-18T00:52:16.8657224Z [16,730 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:16.8658338Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:52:16.8659188Z Compiling xla/literal.cc; 28s local 2024-12-18T00:52:16.8659912Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:16.8660830Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:52:16.8662231Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:16.8663457Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2024-12-18T00:52:16.8664347Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:16.8665084Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:52:17.0922438Z 2024-12-18T00:52:17.0923344Z  2024-12-18T00:52:17.0923852Z  2024-12-18T00:52:17.0924265Z  2024-12-18T00:52:17.0924646Z  2024-12-18T00:52:17.0925054Z  2024-12-18T00:52:17.0925465Z  2024-12-18T00:52:17.0925880Z  2024-12-18T00:52:17.0926282Z  2024-12-18T00:52:17.0927220Z [16,734 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:17.0928419Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:52:17.0929372Z Compiling xla/literal.cc; 28s local 2024-12-18T00:52:17.0930192Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2024-12-18T00:52:17.0931163Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:52:17.0932286Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:17.0933373Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2024-12-18T00:52:17.0934290Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:17.0935022Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:17.3369436Z 2024-12-18T00:52:17.3370357Z  2024-12-18T00:52:17.3370836Z  2024-12-18T00:52:17.3371244Z  2024-12-18T00:52:17.3371662Z  2024-12-18T00:52:17.3372101Z  2024-12-18T00:52:17.3372466Z  2024-12-18T00:52:17.3372944Z  2024-12-18T00:52:17.3373460Z  2024-12-18T00:52:17.3374441Z [16,735 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:17.3375840Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:52:17.3376804Z Compiling xla/literal.cc; 28s local 2024-12-18T00:52:17.3377598Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:52:17.3378587Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2024-12-18T00:52:17.3379646Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:52:17.3380676Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2024-12-18T00:52:17.3381614Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:17.3382378Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:17.5773498Z 2024-12-18T00:52:17.5774402Z  2024-12-18T00:52:17.5774884Z  2024-12-18T00:52:17.5775296Z  2024-12-18T00:52:17.5775709Z  2024-12-18T00:52:17.5776093Z  2024-12-18T00:52:17.5776651Z  2024-12-18T00:52:17.5777107Z  2024-12-18T00:52:17.5777523Z  2024-12-18T00:52:17.5778804Z [16,736 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:17.5779999Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:52:17.5780924Z Compiling xla/literal.cc; 29s local 2024-12-18T00:52:17.5781694Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:52:17.5782714Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:52:17.5783815Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:52:17.5784950Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2024-12-18T00:52:17.5785884Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:17.5786635Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:17.8113583Z 2024-12-18T00:52:17.8114537Z  2024-12-18T00:52:17.8115049Z  2024-12-18T00:52:17.8115470Z  2024-12-18T00:52:17.8116247Z  2024-12-18T00:52:17.8116653Z  2024-12-18T00:52:17.8117025Z  2024-12-18T00:52:17.8117432Z  2024-12-18T00:52:17.8117856Z  2024-12-18T00:52:17.8118826Z [16,739 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:17.8120072Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:52:17.8120968Z Compiling xla/literal.cc; 29s local 2024-12-18T00:52:17.8121748Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:52:17.8122750Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:52:17.8123850Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:52:17.8124682Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:17.8125551Z Compiling llvm/lib/Transforms/Instrumentation/MemProfiler.cpp; 10s local 2024-12-18T00:52:17.8126563Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:52:18.1207190Z 2024-12-18T00:52:18.1208134Z  2024-12-18T00:52:18.1208642Z  2024-12-18T00:52:18.1209048Z  2024-12-18T00:52:18.1209450Z  2024-12-18T00:52:18.1209818Z  2024-12-18T00:52:18.1210199Z  2024-12-18T00:52:18.1210595Z  2024-12-18T00:52:18.1210997Z  2024-12-18T00:52:18.1211931Z [16,740 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:18.1213151Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:52:18.1214024Z Compiling xla/literal.cc; 29s local 2024-12-18T00:52:18.1215073Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2024-12-18T00:52:18.1216028Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:52:18.1217181Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:52:18.1218412Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:18.1219343Z Compiling llvm/lib/Transforms/Instrumentation/MemProfiler.cpp; 11s local 2024-12-18T00:52:18.1220206Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:52:18.3780081Z 2024-12-18T00:52:18.3780930Z  2024-12-18T00:52:18.3781345Z  2024-12-18T00:52:18.3781685Z  2024-12-18T00:52:18.3782036Z  2024-12-18T00:52:18.3782374Z  2024-12-18T00:52:18.3782711Z  2024-12-18T00:52:18.3783047Z  2024-12-18T00:52:18.3783401Z  2024-12-18T00:52:18.3784256Z [16,742 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:18.3785294Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:52:18.3786024Z Compiling xla/literal.cc; 29s local 2024-12-18T00:52:18.3786668Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:18.3787536Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2024-12-18T00:52:18.3788598Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:18.3789454Z Compiling llvm/lib/Transforms/Instrumentation/MemProfiler.cpp; 11s local 2024-12-18T00:52:18.3790297Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:18.3791206Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 9s local ... 2024-12-18T00:52:18.5783865Z 2024-12-18T00:52:18.5784727Z  2024-12-18T00:52:18.5785124Z  2024-12-18T00:52:18.5785446Z  2024-12-18T00:52:18.5785770Z  2024-12-18T00:52:18.5786084Z  2024-12-18T00:52:18.5786380Z  2024-12-18T00:52:18.5786695Z  2024-12-18T00:52:18.5787012Z  2024-12-18T00:52:18.5787784Z [16,745 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:18.5788700Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:52:18.5789395Z Compiling xla/literal.cc; 30s local 2024-12-18T00:52:18.5790393Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:18.5791143Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:52:18.5791825Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:18.5792577Z Compiling llvm/lib/Transforms/Instrumentation/MemProfiler.cpp; 11s local 2024-12-18T00:52:18.5793314Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:18.5794024Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 9s local ... 2024-12-18T00:52:18.9674032Z 2024-12-18T00:52:18.9674888Z  2024-12-18T00:52:18.9675291Z  2024-12-18T00:52:18.9675636Z  2024-12-18T00:52:18.9675970Z  2024-12-18T00:52:18.9676300Z  2024-12-18T00:52:18.9676630Z  2024-12-18T00:52:18.9676943Z  2024-12-18T00:52:18.9677278Z  2024-12-18T00:52:18.9678102Z [16,747 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:18.9679153Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:52:18.9679894Z Compiling xla/literal.cc; 30s local 2024-12-18T00:52:18.9680528Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:18.9681485Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:52:18.9682305Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:18.9683055Z Compiling llvm/lib/Transforms/Instrumentation/MemProfiler.cpp; 11s local 2024-12-18T00:52:18.9684001Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:18.9684705Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 9s local ... 2024-12-18T00:52:19.1789976Z 2024-12-18T00:52:19.1790885Z  2024-12-18T00:52:19.1791493Z  2024-12-18T00:52:19.1791907Z  2024-12-18T00:52:19.1792297Z  2024-12-18T00:52:19.1792675Z  2024-12-18T00:52:19.1793363Z  2024-12-18T00:52:19.1793749Z  2024-12-18T00:52:19.1794147Z  2024-12-18T00:52:19.1795118Z [16,747 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:19.1796329Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:52:19.1797240Z Compiling xla/literal.cc; 30s local 2024-12-18T00:52:19.1798019Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2024-12-18T00:52:19.1799002Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:52:19.1799894Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:19.1800856Z Compiling llvm/lib/Transforms/Instrumentation/MemProfiler.cpp; 12s local 2024-12-18T00:52:19.1801843Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:19.1802756Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 10s local ... 2024-12-18T00:52:19.4501321Z 2024-12-18T00:52:19.4502188Z  2024-12-18T00:52:19.4502712Z  2024-12-18T00:52:19.4503250Z  2024-12-18T00:52:19.4503922Z  2024-12-18T00:52:19.4504321Z  2024-12-18T00:52:19.4504722Z  2024-12-18T00:52:19.4505114Z  2024-12-18T00:52:19.4505540Z  2024-12-18T00:52:19.4506480Z [16,749 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:52:19.4507603Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:52:19.4508451Z Compiling xla/literal.cc; 31s local 2024-12-18T00:52:19.4509189Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:19.4510161Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2024-12-18T00:52:19.4511035Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:19.4511973Z Compiling llvm/lib/Transforms/Instrumentation/MemProfiler.cpp; 12s local 2024-12-18T00:52:19.4512955Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:19.4514302Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 10s local ... 2024-12-18T00:52:19.7017310Z 2024-12-18T00:52:19.7018193Z  2024-12-18T00:52:19.7018636Z  2024-12-18T00:52:19.7019035Z  2024-12-18T00:52:19.7019426Z  2024-12-18T00:52:19.7019816Z  2024-12-18T00:52:19.7020222Z  2024-12-18T00:52:19.7020595Z  2024-12-18T00:52:19.7020992Z  2024-12-18T00:52:19.7021925Z [16,751 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:52:19.7023024Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:52:19.7023908Z Compiling xla/literal.cc; 31s local 2024-12-18T00:52:19.7024632Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:19.7025571Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:52:19.7026383Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:19.7027125Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:19.7027950Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 10s local 2024-12-18T00:52:19.7028874Z Compiling mlir/lib/IR/AsmPrinter.cpp; 9s local ... 2024-12-18T00:52:19.9461915Z 2024-12-18T00:52:19.9462794Z  2024-12-18T00:52:19.9463276Z  2024-12-18T00:52:19.9463671Z  2024-12-18T00:52:19.9464063Z  2024-12-18T00:52:19.9464453Z  2024-12-18T00:52:19.9464814Z  2024-12-18T00:52:19.9465182Z  2024-12-18T00:52:19.9465569Z  2024-12-18T00:52:19.9466470Z [16,754 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:19.9467617Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:52:19.9468509Z Compiling xla/literal.cc; 31s local 2024-12-18T00:52:19.9469232Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:19.9470105Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:52:19.9471296Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:19.9472026Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:19.9472852Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 10s local 2024-12-18T00:52:19.9473761Z Compiling mlir/lib/IR/AsmPrinter.cpp; 9s local ... 2024-12-18T00:52:20.1798656Z 2024-12-18T00:52:20.1799529Z  2024-12-18T00:52:20.1799981Z  2024-12-18T00:52:20.1800392Z  2024-12-18T00:52:20.1800794Z  2024-12-18T00:52:20.1801196Z  2024-12-18T00:52:20.1801598Z  2024-12-18T00:52:20.1801977Z  2024-12-18T00:52:20.1802378Z  2024-12-18T00:52:20.1803441Z [16,756 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:20.1804607Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:52:20.1805478Z Compiling xla/literal.cc; 31s local 2024-12-18T00:52:20.1806501Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2024-12-18T00:52:20.1807456Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:52:20.1808298Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:20.1809010Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:20.1809868Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local 2024-12-18T00:52:20.1810739Z Compiling mlir/lib/IR/AsmPrinter.cpp; 9s local ... 2024-12-18T00:52:20.3802536Z 2024-12-18T00:52:20.3803473Z  2024-12-18T00:52:20.3803973Z  2024-12-18T00:52:20.3804389Z  2024-12-18T00:52:20.3804773Z  2024-12-18T00:52:20.3805160Z  2024-12-18T00:52:20.3805562Z  2024-12-18T00:52:20.3805957Z  2024-12-18T00:52:20.3806371Z  2024-12-18T00:52:20.3807413Z [16,758 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:20.3808594Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:52:20.3809885Z Compiling xla/literal.cc; 31s local 2024-12-18T00:52:20.3810667Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:52:20.3811613Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2024-12-18T00:52:20.3812543Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:20.3813329Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:20.3814228Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local 2024-12-18T00:52:20.3815192Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2024-12-18T00:52:20.6772048Z 2024-12-18T00:52:20.6772997Z  2024-12-18T00:52:20.6773517Z  2024-12-18T00:52:20.6773911Z  2024-12-18T00:52:20.6774291Z  2024-12-18T00:52:20.6774681Z  2024-12-18T00:52:20.6775077Z  2024-12-18T00:52:20.6775458Z  2024-12-18T00:52:20.6775858Z  2024-12-18T00:52:20.6777063Z [16,760 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:20.6778235Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:52:20.6779113Z Compiling xla/literal.cc; 32s local 2024-12-18T00:52:20.6779918Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:52:20.6780873Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:52:20.6781669Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:20.6782398Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:20.6783254Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local 2024-12-18T00:52:20.6784207Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2024-12-18T00:52:20.9808954Z 2024-12-18T00:52:20.9809852Z  2024-12-18T00:52:20.9810325Z  2024-12-18T00:52:20.9810754Z  2024-12-18T00:52:20.9811148Z  2024-12-18T00:52:20.9811879Z  2024-12-18T00:52:20.9812278Z  2024-12-18T00:52:20.9812691Z  2024-12-18T00:52:20.9813077Z  2024-12-18T00:52:20.9814041Z [16,762 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:20.9815216Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:52:20.9816094Z Compiling xla/literal.cc; 32s local 2024-12-18T00:52:20.9817032Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:52:20.9817995Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:52:20.9818814Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:20.9819578Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:20.9820449Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local 2024-12-18T00:52:20.9821357Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2024-12-18T00:52:21.1835428Z 2024-12-18T00:52:21.1836387Z  2024-12-18T00:52:21.1836875Z  2024-12-18T00:52:21.1837540Z  2024-12-18T00:52:21.1838023Z  2024-12-18T00:52:21.1838515Z  2024-12-18T00:52:21.1838896Z  2024-12-18T00:52:21.1839242Z  2024-12-18T00:52:21.1839619Z  2024-12-18T00:52:21.1840584Z [16,763 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:21.1841685Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:52:21.1842542Z Compiling xla/literal.cc; 32s local 2024-12-18T00:52:21.1843294Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2024-12-18T00:52:21.1844484Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2024-12-18T00:52:21.1845388Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:52:21.1846133Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:21.1846988Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 12s local 2024-12-18T00:52:21.1848095Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2024-12-18T00:52:21.5688257Z 2024-12-18T00:52:21.5689316Z  2024-12-18T00:52:21.5689840Z  2024-12-18T00:52:21.5690268Z  2024-12-18T00:52:21.5690642Z  2024-12-18T00:52:21.5691047Z  2024-12-18T00:52:21.5691411Z  2024-12-18T00:52:21.5691803Z  2024-12-18T00:52:21.5692198Z  2024-12-18T00:52:21.5693150Z [16,767 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:21.5694370Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:52:21.5695275Z Compiling xla/literal.cc; 33s local 2024-12-18T00:52:21.5696015Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2024-12-18T00:52:21.5697142Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:52:21.5698040Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:52:21.5698838Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:21.5699584Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2024-12-18T00:52:21.5700460Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local ... 2024-12-18T00:52:21.7815815Z 2024-12-18T00:52:21.7816792Z  2024-12-18T00:52:21.7817197Z  2024-12-18T00:52:21.7817555Z  2024-12-18T00:52:21.7817900Z  2024-12-18T00:52:21.7818245Z  2024-12-18T00:52:21.7818589Z  2024-12-18T00:52:21.7818915Z  2024-12-18T00:52:21.7819250Z  2024-12-18T00:52:21.7820092Z [16,767 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:21.7821162Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:52:21.7821927Z Compiling xla/literal.cc; 33s local 2024-12-18T00:52:21.7822577Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2024-12-18T00:52:21.7823604Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:52:21.7824765Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:52:21.7825439Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:21.7826103Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2024-12-18T00:52:21.7826849Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local ... 2024-12-18T00:52:22.1822967Z 2024-12-18T00:52:22.1823911Z  2024-12-18T00:52:22.1824395Z  2024-12-18T00:52:22.1824778Z  2024-12-18T00:52:22.1825147Z  2024-12-18T00:52:22.1825522Z  2024-12-18T00:52:22.1825907Z  2024-12-18T00:52:22.1826278Z  2024-12-18T00:52:22.1826642Z  2024-12-18T00:52:22.1827559Z [16,769 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:22.1828724Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:52:22.1829602Z Compiling xla/literal.cc; 33s local 2024-12-18T00:52:22.1830402Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:52:22.1831637Z @llvm-project//llvm:Instrumentation; 16s local 2024-12-18T00:52:22.1832358Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:22.1833227Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2024-12-18T00:52:22.1834065Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local 2024-12-18T00:52:22.1834967Z Compiling xla/service/hlo_module_config.cc; 9s local ... 2024-12-18T00:52:22.3826669Z 2024-12-18T00:52:22.3827611Z  2024-12-18T00:52:22.3828053Z  2024-12-18T00:52:22.3828458Z  2024-12-18T00:52:22.3828839Z  2024-12-18T00:52:22.3829241Z  2024-12-18T00:52:22.3829635Z  2024-12-18T00:52:22.3830259Z  2024-12-18T00:52:22.3830730Z  2024-12-18T00:52:22.3831692Z [16,771 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:22.3832795Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:52:22.3833991Z Compiling xla/literal.cc; 33s local 2024-12-18T00:52:22.3834775Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2024-12-18T00:52:22.3835609Z @llvm-project//llvm:Instrumentation; 16s local 2024-12-18T00:52:22.3836255Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:22.3836951Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:52:22.3837718Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2024-12-18T00:52:22.3838567Z Compiling xla/service/hlo_module_config.cc; 9s local ... 2024-12-18T00:52:22.6627513Z 2024-12-18T00:52:22.6628433Z  2024-12-18T00:52:22.6628898Z  2024-12-18T00:52:22.6629264Z  2024-12-18T00:52:22.6629654Z  2024-12-18T00:52:22.6630043Z  2024-12-18T00:52:22.6630415Z  2024-12-18T00:52:22.6630779Z  2024-12-18T00:52:22.6631148Z  2024-12-18T00:52:22.6632057Z [16,776 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:22.6633192Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:52:22.6634028Z Compiling xla/literal.cc; 34s local 2024-12-18T00:52:22.6634776Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:52:22.6635644Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:22.6636388Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:52:22.6637201Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2024-12-18T00:52:22.6638071Z Compiling xla/service/hlo_module_config.cc; 9s local 2024-12-18T00:52:22.6638912Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 9s local ... 2024-12-18T00:52:22.9007607Z 2024-12-18T00:52:22.9008523Z  2024-12-18T00:52:22.9008992Z  2024-12-18T00:52:22.9009363Z  2024-12-18T00:52:22.9009760Z  2024-12-18T00:52:22.9010128Z  2024-12-18T00:52:22.9010811Z  2024-12-18T00:52:22.9011190Z  2024-12-18T00:52:22.9011582Z  2024-12-18T00:52:22.9012493Z [16,777 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:22.9013549Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:52:22.9014372Z Compiling xla/literal.cc; 34s local 2024-12-18T00:52:22.9015124Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:52:22.9015968Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:22.9016809Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:52:22.9017621Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2024-12-18T00:52:22.9018454Z Compiling xla/service/hlo_module_config.cc; 10s local 2024-12-18T00:52:22.9019291Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 9s local ... 2024-12-18T00:52:23.1833828Z 2024-12-18T00:52:23.1834714Z  2024-12-18T00:52:23.1835216Z  2024-12-18T00:52:23.1835617Z  2024-12-18T00:52:23.1835999Z  2024-12-18T00:52:23.1836684Z  2024-12-18T00:52:23.1837087Z  2024-12-18T00:52:23.1837462Z  2024-12-18T00:52:23.1837851Z  2024-12-18T00:52:23.1838796Z [16,777 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:23.1839916Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:52:23.1840779Z Compiling xla/literal.cc; 34s local 2024-12-18T00:52:23.1841555Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:52:23.1842410Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:23.1843140Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:52:23.1843987Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2024-12-18T00:52:23.1845115Z Compiling xla/service/hlo_module_config.cc; 10s local 2024-12-18T00:52:23.1845962Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 9s local ... 2024-12-18T00:52:23.4064282Z 2024-12-18T00:52:23.4065771Z  2024-12-18T00:52:23.4066247Z  2024-12-18T00:52:23.4066645Z  2024-12-18T00:52:23.4067031Z  2024-12-18T00:52:23.4067415Z  2024-12-18T00:52:23.4079795Z  2024-12-18T00:52:23.4080504Z  2024-12-18T00:52:23.4080863Z  2024-12-18T00:52:23.4081726Z [16,780 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:23.4082802Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:52:23.4083626Z Compiling xla/literal.cc; 34s local 2024-12-18T00:52:23.4084356Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2024-12-18T00:52:23.4085153Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:52:23.4085923Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:23.4086720Z Compiling xla/service/hlo_module_config.cc; 10s local 2024-12-18T00:52:23.4087522Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 10s local 2024-12-18T00:52:23.4088361Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 8s local ... 2024-12-18T00:52:23.6851467Z 2024-12-18T00:52:23.6852348Z  2024-12-18T00:52:23.6852806Z  2024-12-18T00:52:23.6853184Z  2024-12-18T00:52:23.6853554Z  2024-12-18T00:52:23.6853948Z  2024-12-18T00:52:23.6854335Z  2024-12-18T00:52:23.6854718Z  2024-12-18T00:52:23.6855101Z  2024-12-18T00:52:23.6855925Z [16,783 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:23.6857195Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:52:23.6858134Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:52:23.6858969Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:23.6859823Z Compiling xla/service/hlo_module_config.cc; 10s local 2024-12-18T00:52:23.6860977Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 10s local 2024-12-18T00:52:23.6861834Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 8s local 2024-12-18T00:52:23.6862744Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local 2024-12-18T00:52:23.6863804Z Compiling llvm/lib/CodeGen/VLIWMachineScheduler.cpp; 6s local ... 2024-12-18T00:52:23.9839446Z 2024-12-18T00:52:23.9840430Z  2024-12-18T00:52:23.9840876Z  2024-12-18T00:52:23.9841230Z  2024-12-18T00:52:23.9841589Z  2024-12-18T00:52:23.9841939Z  2024-12-18T00:52:23.9842288Z  2024-12-18T00:52:23.9842637Z  2024-12-18T00:52:23.9843017Z  2024-12-18T00:52:23.9843806Z [16,784 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:23.9845027Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:52:23.9845848Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:52:23.9846858Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:23.9847624Z Compiling xla/service/hlo_module_config.cc; 11s local 2024-12-18T00:52:23.9848342Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 10s local 2024-12-18T00:52:23.9849037Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 9s local 2024-12-18T00:52:23.9849831Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local 2024-12-18T00:52:23.9850729Z Compiling llvm/lib/CodeGen/VLIWMachineScheduler.cpp; 6s local ... 2024-12-18T00:52:24.1843888Z 2024-12-18T00:52:24.1844943Z  2024-12-18T00:52:24.1845359Z  2024-12-18T00:52:24.1845695Z  2024-12-18T00:52:24.1846049Z  2024-12-18T00:52:24.1846375Z  2024-12-18T00:52:24.1846694Z  2024-12-18T00:52:24.1847025Z  2024-12-18T00:52:24.1847337Z  2024-12-18T00:52:24.1848145Z [16,785 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:24.1849442Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:52:24.1850393Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:24.1851179Z Compiling xla/service/hlo_module_config.cc; 11s local 2024-12-18T00:52:24.1851893Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 10s local 2024-12-18T00:52:24.1852622Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 9s local 2024-12-18T00:52:24.1853422Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local 2024-12-18T00:52:24.1854314Z Compiling llvm/lib/CodeGen/VLIWMachineScheduler.cpp; 7s local 2024-12-18T00:52:24.1855258Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 6s local ... 2024-12-18T00:52:24.4548000Z 2024-12-18T00:52:24.4548967Z  2024-12-18T00:52:24.4549356Z  2024-12-18T00:52:24.4549681Z  2024-12-18T00:52:24.4549999Z  2024-12-18T00:52:24.4550320Z  2024-12-18T00:52:24.4550632Z  2024-12-18T00:52:24.4550957Z  2024-12-18T00:52:24.4551281Z  2024-12-18T00:52:24.4552071Z [16,787 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:24.4552989Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:52:24.4553782Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:24.4554437Z Compiling xla/service/hlo_module_config.cc; 11s local 2024-12-18T00:52:24.4555092Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local 2024-12-18T00:52:24.4555757Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 9s local 2024-12-18T00:52:24.4556473Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:52:24.4557246Z Compiling llvm/lib/CodeGen/VLIWMachineScheduler.cpp; 7s local 2024-12-18T00:52:24.4558074Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 7s local ... 2024-12-18T00:52:24.6640508Z 2024-12-18T00:52:24.6641594Z  2024-12-18T00:52:24.6642412Z  2024-12-18T00:52:24.6642796Z  2024-12-18T00:52:24.6643215Z  2024-12-18T00:52:24.6643592Z  2024-12-18T00:52:24.6643966Z  2024-12-18T00:52:24.6644574Z  2024-12-18T00:52:24.6644943Z  2024-12-18T00:52:24.6645847Z [16,791 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:24.6646997Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:52:24.6648010Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:24.6648837Z Compiling xla/service/hlo_module_config.cc; 11s local 2024-12-18T00:52:24.6649663Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local 2024-12-18T00:52:24.6650471Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 9s local 2024-12-18T00:52:24.6651364Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:52:24.6652321Z Compiling llvm/lib/CodeGen/VLIWMachineScheduler.cpp; 7s local 2024-12-18T00:52:24.6653608Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 7s local ... 2024-12-18T00:52:24.8761260Z 2024-12-18T00:52:24.8762231Z  2024-12-18T00:52:24.8762750Z  2024-12-18T00:52:24.8763183Z  2024-12-18T00:52:24.8763633Z  2024-12-18T00:52:24.8764066Z  2024-12-18T00:52:24.8764501Z  2024-12-18T00:52:24.8764953Z  2024-12-18T00:52:24.8765391Z  2024-12-18T00:52:24.8766465Z [16,793 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:24.8767794Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:52:24.8768981Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:24.8770015Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local 2024-12-18T00:52:24.8770976Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2024-12-18T00:52:24.8772051Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:52:24.8773678Z Compiling llvm/lib/CodeGen/VLIWMachineScheduler.cpp; 7s local 2024-12-18T00:52:24.8775035Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 7s local 2024-12-18T00:52:24.8776216Z Compiling xla/service/hlo_module_config.cc; 7s local ... 2024-12-18T00:52:25.0835895Z 2024-12-18T00:52:25.0836856Z  2024-12-18T00:52:25.0837326Z  2024-12-18T00:52:25.0837715Z  2024-12-18T00:52:25.0838103Z  2024-12-18T00:52:25.0838518Z  2024-12-18T00:52:25.0838908Z  2024-12-18T00:52:25.0839248Z  2024-12-18T00:52:25.0839603Z  2024-12-18T00:52:25.0840504Z [16,795 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:25.0841643Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:52:25.0842625Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:25.0843502Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local 2024-12-18T00:52:25.0844595Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2024-12-18T00:52:25.0845496Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:52:25.0846572Z Compiling llvm/lib/CodeGen/VLIWMachineScheduler.cpp; 7s local 2024-12-18T00:52:25.0847623Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 7s local 2024-12-18T00:52:25.0848605Z Compiling xla/service/hlo_module_config.cc; 7s local ... 2024-12-18T00:52:25.3203524Z 2024-12-18T00:52:25.3204453Z  2024-12-18T00:52:25.3204918Z  2024-12-18T00:52:25.3205324Z  2024-12-18T00:52:25.3205721Z  2024-12-18T00:52:25.3206150Z  2024-12-18T00:52:25.3206530Z  2024-12-18T00:52:25.3206934Z  2024-12-18T00:52:25.3207326Z  2024-12-18T00:52:25.3208245Z [16,799 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:25.3209761Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:52:25.3210800Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:52:25.3211687Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:52:25.3212543Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2024-12-18T00:52:25.3213470Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2024-12-18T00:52:25.3214561Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 7s local 2024-12-18T00:52:25.3215540Z Compiling xla/service/hlo_module_config.cc; 7s local 2024-12-18T00:52:25.3216682Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local ... 2024-12-18T00:52:25.5857082Z 2024-12-18T00:52:25.5858071Z  2024-12-18T00:52:25.5858569Z  2024-12-18T00:52:25.5858963Z  2024-12-18T00:52:25.5859368Z  2024-12-18T00:52:25.5859746Z  2024-12-18T00:52:25.5860161Z  2024-12-18T00:52:25.5860565Z  2024-12-18T00:52:25.5860978Z  2024-12-18T00:52:25.5862201Z [16,802 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:25.5863407Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:52:25.5864444Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:52:25.5865287Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:52:25.5866068Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2024-12-18T00:52:25.5866955Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2024-12-18T00:52:25.5868024Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 8s local 2024-12-18T00:52:25.5868961Z Compiling xla/service/hlo_module_config.cc; 7s local 2024-12-18T00:52:25.5869898Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local ... 2024-12-18T00:52:25.7912572Z 2024-12-18T00:52:25.7913555Z  2024-12-18T00:52:25.7914068Z  2024-12-18T00:52:25.7914474Z  2024-12-18T00:52:25.7915104Z  2024-12-18T00:52:25.7915572Z  2024-12-18T00:52:25.7915937Z  2024-12-18T00:52:25.7916278Z  2024-12-18T00:52:25.7916632Z  2024-12-18T00:52:25.7917507Z [16,803 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:25.7918610Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:52:25.7919698Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:52:25.7920461Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:52:25.7921303Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2024-12-18T00:52:25.7922236Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2024-12-18T00:52:25.7923336Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 8s local 2024-12-18T00:52:25.7924270Z Compiling xla/service/hlo_module_config.cc; 8s local 2024-12-18T00:52:25.7925183Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local ... 2024-12-18T00:52:26.1862869Z 2024-12-18T00:52:26.1863791Z  2024-12-18T00:52:26.1864258Z  2024-12-18T00:52:26.1864648Z  2024-12-18T00:52:26.1865050Z  2024-12-18T00:52:26.1865472Z  2024-12-18T00:52:26.1865859Z  2024-12-18T00:52:26.1866263Z  2024-12-18T00:52:26.1866666Z  2024-12-18T00:52:26.1867627Z [16,804 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:26.1868873Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:52:26.1869968Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:52:26.1870880Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local 2024-12-18T00:52:26.1871794Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2024-12-18T00:52:26.1872835Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 8s local 2024-12-18T00:52:26.1874153Z Compiling xla/service/hlo_module_config.cc; 8s local 2024-12-18T00:52:26.1875092Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local 2024-12-18T00:52:26.1876135Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 7s local ... 2024-12-18T00:52:26.4079410Z 2024-12-18T00:52:26.4080382Z  2024-12-18T00:52:26.4080826Z  2024-12-18T00:52:26.4081203Z  2024-12-18T00:52:26.4081571Z  2024-12-18T00:52:26.4081931Z  2024-12-18T00:52:26.4082295Z  2024-12-18T00:52:26.4082667Z  2024-12-18T00:52:26.4083056Z  2024-12-18T00:52:26.4083933Z [16,807 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:26.4085120Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:52:26.4086189Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:26.4087162Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:52:26.4088242Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2024-12-18T00:52:26.4089192Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 9s local 2024-12-18T00:52:26.4090085Z Compiling xla/service/hlo_module_config.cc; 8s local 2024-12-18T00:52:26.4090892Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 7s local 2024-12-18T00:52:26.4091700Z Compiling mlir/lib/IR/BuiltinTypes.cpp; 6s local ... 2024-12-18T00:52:26.6092591Z 2024-12-18T00:52:26.6093519Z  2024-12-18T00:52:26.6093925Z  2024-12-18T00:52:26.6094250Z  2024-12-18T00:52:26.6094604Z  2024-12-18T00:52:26.6094985Z  2024-12-18T00:52:26.6095391Z  2024-12-18T00:52:26.6095741Z  2024-12-18T00:52:26.6096100Z  2024-12-18T00:52:26.6097140Z [16,809 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:26.6098248Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:52:26.6099718Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:26.6100676Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:52:26.6101545Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2024-12-18T00:52:26.6102472Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 9s local 2024-12-18T00:52:26.6103391Z Compiling xla/service/hlo_module_config.cc; 8s local 2024-12-18T00:52:26.6104235Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:52:26.6105082Z Compiling mlir/lib/IR/BuiltinTypes.cpp; 7s local ... 2024-12-18T00:52:26.9869561Z 2024-12-18T00:52:26.9870664Z  2024-12-18T00:52:26.9871178Z  2024-12-18T00:52:26.9871568Z  2024-12-18T00:52:26.9871966Z  2024-12-18T00:52:26.9872374Z  2024-12-18T00:52:26.9872767Z  2024-12-18T00:52:26.9873134Z  2024-12-18T00:52:26.9873498Z  2024-12-18T00:52:26.9874415Z [16,809 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:26.9875509Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:52:26.9876500Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:26.9877333Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:52:26.9878128Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:52:26.9879063Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 9s local 2024-12-18T00:52:26.9880050Z Compiling xla/service/hlo_module_config.cc; 9s local 2024-12-18T00:52:26.9880903Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:52:26.9881737Z Compiling mlir/lib/IR/BuiltinTypes.cpp; 7s local ... 2024-12-18T00:52:27.1873959Z 2024-12-18T00:52:27.1874900Z  2024-12-18T00:52:27.1875408Z  2024-12-18T00:52:27.1875785Z  2024-12-18T00:52:27.1876465Z  2024-12-18T00:52:27.1876863Z  2024-12-18T00:52:27.1877238Z  2024-12-18T00:52:27.1877642Z  2024-12-18T00:52:27.1878039Z  2024-12-18T00:52:27.1879089Z [16,810 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:52:27.1880164Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:52:27.1881121Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:27.1881975Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local 2024-12-18T00:52:27.1882763Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:52:27.1883744Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 9s local 2024-12-18T00:52:27.1884637Z Compiling xla/service/hlo_module_config.cc; 9s local 2024-12-18T00:52:27.1885478Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:52:27.1886318Z Compiling mlir/lib/IR/BuiltinTypes.cpp; 7s local ... 2024-12-18T00:52:27.4098415Z 2024-12-18T00:52:27.4099334Z  2024-12-18T00:52:27.4100092Z  2024-12-18T00:52:27.4100542Z  2024-12-18T00:52:27.4101086Z  2024-12-18T00:52:27.4101474Z  2024-12-18T00:52:27.4101866Z  2024-12-18T00:52:27.4102268Z  2024-12-18T00:52:27.4102681Z  2024-12-18T00:52:27.4103551Z [16,814 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:27.4104598Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:52:27.4105595Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:52:27.4106465Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2024-12-18T00:52:27.4107324Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:52:27.4108265Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 10s local 2024-12-18T00:52:27.4109187Z Compiling xla/service/hlo_module_config.cc; 9s local 2024-12-18T00:52:27.4110339Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 8s local 2024-12-18T00:52:27.4111246Z @llvm-project//llvm:Instrumentation; 7s local ... 2024-12-18T00:52:27.6273445Z 2024-12-18T00:52:27.6274474Z  2024-12-18T00:52:27.6274960Z  2024-12-18T00:52:27.6275328Z  2024-12-18T00:52:27.6275716Z  2024-12-18T00:52:27.6276117Z  2024-12-18T00:52:27.6276470Z  2024-12-18T00:52:27.6276843Z  2024-12-18T00:52:27.6277206Z  2024-12-18T00:52:27.6277979Z [16,815 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:27.6278887Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:52:27.6279701Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:52:27.6280399Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2024-12-18T00:52:27.6281072Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:52:27.6281902Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 10s local 2024-12-18T00:52:27.6282695Z Compiling xla/service/hlo_module_config.cc; 9s local 2024-12-18T00:52:27.6283398Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local 2024-12-18T00:52:27.6284082Z @llvm-project//llvm:Instrumentation; 7s local ... 2024-12-18T00:52:28.0795043Z 2024-12-18T00:52:28.0795998Z  2024-12-18T00:52:28.0796471Z  2024-12-18T00:52:28.0796852Z  2024-12-18T00:52:28.0797228Z  2024-12-18T00:52:28.0797621Z  2024-12-18T00:52:28.0797970Z  2024-12-18T00:52:28.0798356Z  2024-12-18T00:52:28.0798740Z  2024-12-18T00:52:28.0799642Z [16,816 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:28.0800772Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:52:28.0801740Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:52:28.0802993Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2024-12-18T00:52:28.0803793Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:52:28.0804766Z Compiling llvm/lib/Transforms/IPO/SampleProfileMatcher.cpp; 10s local 2024-12-18T00:52:28.0805728Z Compiling xla/service/hlo_module_config.cc; 10s local 2024-12-18T00:52:28.0806546Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local 2024-12-18T00:52:28.0807365Z @llvm-project//llvm:Instrumentation; 7s local ... 2024-12-18T00:52:28.4526618Z 2024-12-18T00:52:28.4527573Z  2024-12-18T00:52:28.4528032Z  2024-12-18T00:52:28.4528429Z  2024-12-18T00:52:28.4528843Z  2024-12-18T00:52:28.4529262Z  2024-12-18T00:52:28.4529686Z  2024-12-18T00:52:28.4530079Z  2024-12-18T00:52:28.4530496Z  2024-12-18T00:52:28.4531497Z [16,819 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:28.4533043Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:52:28.4534219Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:28.4535152Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2024-12-18T00:52:28.4536009Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:52:28.4536981Z Compiling xla/service/hlo_module_config.cc; 10s local 2024-12-18T00:52:28.4537748Z @llvm-project//llvm:Instrumentation; 8s local 2024-12-18T00:52:28.4538586Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local 2024-12-18T00:52:28.4539574Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 7s local ... 2024-12-18T00:52:28.6800133Z 2024-12-18T00:52:28.6801118Z  2024-12-18T00:52:28.6801584Z  2024-12-18T00:52:28.6801972Z  2024-12-18T00:52:28.6802348Z  2024-12-18T00:52:28.6802739Z  2024-12-18T00:52:28.6803126Z  2024-12-18T00:52:28.6803530Z  2024-12-18T00:52:28.6803968Z  2024-12-18T00:52:28.6805229Z [16,820 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:28.6808344Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:52:28.6809450Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:28.6810479Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2024-12-18T00:52:28.6811277Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:52:28.6812140Z Compiling xla/service/hlo_module_config.cc; 10s local 2024-12-18T00:52:28.6812927Z @llvm-project//llvm:Instrumentation; 8s local 2024-12-18T00:52:28.6813759Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local 2024-12-18T00:52:28.6814611Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 7s local ... 2024-12-18T00:52:28.8803649Z 2024-12-18T00:52:28.8804594Z  2024-12-18T00:52:28.8805061Z  2024-12-18T00:52:28.8805494Z  2024-12-18T00:52:28.8805899Z  2024-12-18T00:52:28.8806290Z  2024-12-18T00:52:28.8806724Z  2024-12-18T00:52:28.8807121Z  2024-12-18T00:52:28.8807524Z  2024-12-18T00:52:28.8808455Z [16,822 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:28.8809815Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:52:28.8810911Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:28.8811847Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2024-12-18T00:52:28.8812730Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:52:28.8813582Z Compiling xla/service/hlo_module_config.cc; 11s local 2024-12-18T00:52:28.8814358Z @llvm-project//llvm:Instrumentation; 8s local 2024-12-18T00:52:28.8815215Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local 2024-12-18T00:52:28.8816213Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 7s local ... 2024-12-18T00:52:29.2808561Z 2024-12-18T00:52:29.2809632Z  2024-12-18T00:52:29.2810067Z  2024-12-18T00:52:29.2810460Z  2024-12-18T00:52:29.2810812Z  2024-12-18T00:52:29.2811155Z  2024-12-18T00:52:29.2811476Z  2024-12-18T00:52:29.2811812Z  2024-12-18T00:52:29.2812154Z  2024-12-18T00:52:29.2813005Z [16,825 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:52:29.2813987Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:52:29.2814840Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:29.2815600Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 16s local 2024-12-18T00:52:29.2816338Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:52:29.2817158Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:29.2817848Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local 2024-12-18T00:52:29.2818915Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:52:29.2819677Z Compiling mlir/lib/IR/BuiltinTypes.cpp; 7s local ... 2024-12-18T00:52:29.4812579Z 2024-12-18T00:52:29.4813531Z  2024-12-18T00:52:29.4813973Z  2024-12-18T00:52:29.4814352Z  2024-12-18T00:52:29.4814732Z  2024-12-18T00:52:29.4815080Z  2024-12-18T00:52:29.4815455Z  2024-12-18T00:52:29.4815850Z  2024-12-18T00:52:29.4816236Z  2024-12-18T00:52:29.4817257Z [16,827 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:29.4818323Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:52:29.4819063Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:29.4819908Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 16s local 2024-12-18T00:52:29.4820753Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:52:29.4821904Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:29.4822766Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local 2024-12-18T00:52:29.4823684Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:52:29.4824542Z Compiling mlir/lib/IR/BuiltinTypes.cpp; 7s local ... 2024-12-18T00:52:29.7462224Z 2024-12-18T00:52:29.7463249Z  2024-12-18T00:52:29.7463715Z  2024-12-18T00:52:29.7464109Z  2024-12-18T00:52:29.7464490Z  2024-12-18T00:52:29.7464852Z  2024-12-18T00:52:29.7465251Z  2024-12-18T00:52:29.7465732Z  2024-12-18T00:52:29.7466126Z  2024-12-18T00:52:29.7467096Z [16,830 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:29.7468259Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:52:29.7469258Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:29.7470172Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:52:29.7470945Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:29.7471847Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local 2024-12-18T00:52:29.7472756Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:52:29.7473733Z Compiling llvm/lib/Transforms/Scalar/ConstantHoisting.cpp; 7s local 2024-12-18T00:52:29.7474603Z Compiling mlir/lib/IR/Dominance.cpp; 6s local ... 2024-12-18T00:52:29.9778188Z 2024-12-18T00:52:29.9779064Z  2024-12-18T00:52:29.9779576Z  2024-12-18T00:52:29.9779991Z  2024-12-18T00:52:29.9780392Z  2024-12-18T00:52:29.9780790Z  2024-12-18T00:52:29.9781177Z  2024-12-18T00:52:29.9781572Z  2024-12-18T00:52:29.9781948Z  2024-12-18T00:52:29.9782925Z [16,832 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:29.9784480Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:52:29.9785595Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:29.9786537Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:52:29.9787357Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:29.9788220Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local 2024-12-18T00:52:29.9789149Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 8s local 2024-12-18T00:52:29.9790153Z Compiling llvm/lib/Transforms/Scalar/ConstantHoisting.cpp; 7s local 2024-12-18T00:52:29.9791066Z Compiling mlir/lib/IR/Dominance.cpp; 6s local ... 2024-12-18T00:52:30.2818753Z 2024-12-18T00:52:30.2819623Z  2024-12-18T00:52:30.2820127Z  2024-12-18T00:52:30.2820518Z  2024-12-18T00:52:30.2820891Z  2024-12-18T00:52:30.2821242Z  2024-12-18T00:52:30.2821688Z  2024-12-18T00:52:30.2822046Z  2024-12-18T00:52:30.2822463Z  2024-12-18T00:52:30.2823600Z [16,834 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:30.2824786Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:52:30.2825805Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:30.2826645Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:52:30.2827418Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:30.2828290Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local 2024-12-18T00:52:30.2829200Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:52:30.2830031Z Compiling mlir/lib/IR/Dominance.cpp; 7s local 2024-12-18T00:52:30.2830735Z Compiling xla/literal_util.cc; 6s local ... 2024-12-18T00:52:30.4822926Z 2024-12-18T00:52:30.4823807Z  2024-12-18T00:52:30.4824283Z  2024-12-18T00:52:30.4824699Z  2024-12-18T00:52:30.4825125Z  2024-12-18T00:52:30.4825529Z  2024-12-18T00:52:30.4826278Z  2024-12-18T00:52:30.4826772Z  2024-12-18T00:52:30.4827179Z  2024-12-18T00:52:30.4828159Z [16,835 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:30.4829345Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:52:30.4830394Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:52:30.4831291Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:52:30.4832134Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:30.4832946Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:52:30.4833881Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:52:30.4834707Z Compiling mlir/lib/IR/Dominance.cpp; 7s local 2024-12-18T00:52:30.4835409Z Compiling xla/literal_util.cc; 6s local ... 2024-12-18T00:52:30.7892404Z 2024-12-18T00:52:30.7893389Z  2024-12-18T00:52:30.7893995Z  2024-12-18T00:52:30.7894403Z  2024-12-18T00:52:30.7894826Z  2024-12-18T00:52:30.7895312Z  2024-12-18T00:52:30.7895820Z  2024-12-18T00:52:30.7896209Z  2024-12-18T00:52:30.7896711Z  2024-12-18T00:52:30.7897617Z [16,836 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:30.7898760Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:52:30.7899787Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:52:30.7900597Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:52:30.7901297Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:30.7901994Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:52:30.7902826Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:52:30.7903944Z Compiling mlir/lib/IR/Dominance.cpp; 7s local 2024-12-18T00:52:30.7904706Z Compiling xla/literal_util.cc; 7s local ... 2024-12-18T00:52:31.0829782Z 2024-12-18T00:52:31.0830641Z  2024-12-18T00:52:31.0831188Z  2024-12-18T00:52:31.0831618Z  2024-12-18T00:52:31.0831991Z  2024-12-18T00:52:31.0832405Z  2024-12-18T00:52:31.0832813Z  2024-12-18T00:52:31.0833207Z  2024-12-18T00:52:31.0833559Z  2024-12-18T00:52:31.0834539Z [16,838 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:31.0835684Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:52:31.0836703Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:52:31.0837710Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:52:31.0838550Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:31.0839389Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:52:31.0840895Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 9s local 2024-12-18T00:52:31.0841682Z Compiling mlir/lib/IR/Dominance.cpp; 7s local 2024-12-18T00:52:31.0842368Z Compiling xla/literal_util.cc; 7s local ... 2024-12-18T00:52:31.5321362Z 2024-12-18T00:52:31.5322356Z  2024-12-18T00:52:31.5322931Z  2024-12-18T00:52:31.5323333Z  2024-12-18T00:52:31.5323706Z  2024-12-18T00:52:31.5324026Z  2024-12-18T00:52:31.5324400Z  2024-12-18T00:52:31.5324798Z  2024-12-18T00:52:31.5325171Z  2024-12-18T00:52:31.5326109Z [16,839 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:31.5327305Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:52:31.5328368Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:52:31.5329273Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:52:31.5330071Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:31.5331407Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:52:31.5332264Z Compiling mlir/lib/IR/Dominance.cpp; 8s local 2024-12-18T00:52:31.5332938Z Compiling xla/literal_util.cc; 7s local 2024-12-18T00:52:31.5333788Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 7s local ... 2024-12-18T00:52:31.8835802Z 2024-12-18T00:52:31.8837031Z  2024-12-18T00:52:31.8837522Z  2024-12-18T00:52:31.8837950Z  2024-12-18T00:52:31.8838318Z  2024-12-18T00:52:31.8838660Z  2024-12-18T00:52:31.8839018Z  2024-12-18T00:52:31.8839376Z  2024-12-18T00:52:31.8839744Z  2024-12-18T00:52:31.8840652Z [16,841 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:31.8841814Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:52:31.8842836Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:52:31.8843748Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:52:31.8844798Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:31.8845546Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:52:31.8846329Z Compiling mlir/lib/IR/Dominance.cpp; 8s local 2024-12-18T00:52:31.8846986Z Compiling xla/literal_util.cc; 8s local 2024-12-18T00:52:31.8847803Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 7s local ... 2024-12-18T00:52:32.8844854Z 2024-12-18T00:52:32.8845702Z  2024-12-18T00:52:32.8846198Z  2024-12-18T00:52:32.8846608Z  2024-12-18T00:52:32.8846994Z  2024-12-18T00:52:32.8847395Z  2024-12-18T00:52:32.8847806Z  2024-12-18T00:52:32.8848214Z  2024-12-18T00:52:32.8848577Z  2024-12-18T00:52:32.8849535Z [16,841 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:32.8851202Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:52:32.8852280Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:52:32.8853338Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:52:32.8854107Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:32.8854914Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:52:32.8855733Z Compiling mlir/lib/IR/Dominance.cpp; 9s local 2024-12-18T00:52:32.8856584Z Compiling xla/literal_util.cc; 9s local 2024-12-18T00:52:32.8857473Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local ... 2024-12-18T00:52:33.1156584Z 2024-12-18T00:52:33.1157720Z  2024-12-18T00:52:33.1158174Z  2024-12-18T00:52:33.1158521Z  2024-12-18T00:52:33.1158909Z  2024-12-18T00:52:33.1159437Z  2024-12-18T00:52:33.1159798Z  2024-12-18T00:52:33.1160187Z  2024-12-18T00:52:33.1160551Z  2024-12-18T00:52:33.1161832Z [16,843 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:33.1163091Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:52:33.1164124Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:52:33.1165061Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:52:33.1165873Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:33.1166723Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:52:33.1167573Z Compiling mlir/lib/IR/Dominance.cpp; 9s local 2024-12-18T00:52:33.1168293Z Compiling xla/literal_util.cc; 9s local 2024-12-18T00:52:33.1169202Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local ... 2024-12-18T00:52:33.3397807Z 2024-12-18T00:52:33.3398831Z  2024-12-18T00:52:33.3399330Z  2024-12-18T00:52:33.3399782Z  2024-12-18T00:52:33.3400141Z  2024-12-18T00:52:33.3400508Z  2024-12-18T00:52:33.3401255Z  2024-12-18T00:52:33.3401660Z  2024-12-18T00:52:33.3402059Z  2024-12-18T00:52:33.3402989Z [16,844 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:33.3404223Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:52:33.3405286Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:52:33.3406220Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:52:33.3407047Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:33.3407856Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:52:33.3408667Z Compiling mlir/lib/IR/Dominance.cpp; 10s local 2024-12-18T00:52:33.3409321Z Compiling xla/literal_util.cc; 9s local 2024-12-18T00:52:33.3410226Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local ... 2024-12-18T00:52:33.6126020Z 2024-12-18T00:52:33.6127028Z  2024-12-18T00:52:33.6127499Z  2024-12-18T00:52:33.6127891Z  2024-12-18T00:52:33.6128273Z  2024-12-18T00:52:33.6128661Z  2024-12-18T00:52:33.6129035Z  2024-12-18T00:52:33.6129399Z  2024-12-18T00:52:33.6129759Z  2024-12-18T00:52:33.6130699Z [16,845 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:33.6131884Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:52:33.6132951Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:52:33.6133765Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:52:33.6134561Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:33.6135414Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:52:33.6136214Z Compiling xla/literal_util.cc; 9s local 2024-12-18T00:52:33.6137543Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:52:33.6138529Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 8s local ... 2024-12-18T00:52:33.8854850Z 2024-12-18T00:52:33.8855760Z  2024-12-18T00:52:33.8856282Z  2024-12-18T00:52:33.8856802Z  2024-12-18T00:52:33.8857202Z  2024-12-18T00:52:33.8857608Z  2024-12-18T00:52:33.8858017Z  2024-12-18T00:52:33.8858433Z  2024-12-18T00:52:33.8858804Z  2024-12-18T00:52:33.8859756Z [16,849 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:33.8861001Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:52:33.8862096Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:52:33.8863023Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:52:33.8863831Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:33.8864957Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:52:33.8865810Z Compiling xla/literal_util.cc; 10s local 2024-12-18T00:52:33.8866674Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:52:33.8867747Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local ... 2024-12-18T00:52:34.0859682Z 2024-12-18T00:52:34.0860615Z  2024-12-18T00:52:34.0861065Z  2024-12-18T00:52:34.0861452Z  2024-12-18T00:52:34.0861885Z  2024-12-18T00:52:34.0862297Z  2024-12-18T00:52:34.0862649Z  2024-12-18T00:52:34.0863032Z  2024-12-18T00:52:34.0863424Z  2024-12-18T00:52:34.0864372Z [16,852 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:34.0865529Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:52:34.0866521Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:52:34.0867401Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:34.0868622Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:52:34.0869486Z Compiling xla/literal_util.cc; 10s local 2024-12-18T00:52:34.0870362Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:52:34.0871394Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2024-12-18T00:52:34.0872477Z Compiling llvm/lib/Transforms/Vectorize/VPlanAnalysis.cpp; 9s local ... 2024-12-18T00:52:34.3648300Z 2024-12-18T00:52:34.3649258Z  2024-12-18T00:52:34.3649760Z  2024-12-18T00:52:34.3650198Z  2024-12-18T00:52:34.3650586Z  2024-12-18T00:52:34.3650954Z  2024-12-18T00:52:34.3651334Z  2024-12-18T00:52:34.3651722Z  2024-12-18T00:52:34.3652127Z  2024-12-18T00:52:34.3653073Z [16,854 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:34.3654325Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:52:34.3655378Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:52:34.3656208Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:34.3657233Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:52:34.3658059Z Compiling xla/literal_util.cc; 10s local 2024-12-18T00:52:34.3658915Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2024-12-18T00:52:34.3659898Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2024-12-18T00:52:34.3660963Z Compiling llvm/lib/Transforms/Vectorize/VPlanAnalysis.cpp; 9s local ... 2024-12-18T00:52:34.5682591Z 2024-12-18T00:52:34.5683477Z  2024-12-18T00:52:34.5683956Z  2024-12-18T00:52:34.5684357Z  2024-12-18T00:52:34.5684755Z  2024-12-18T00:52:34.5685165Z  2024-12-18T00:52:34.5685559Z  2024-12-18T00:52:34.5686249Z  2024-12-18T00:52:34.5686612Z  2024-12-18T00:52:34.5687567Z [16,857 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:34.5688738Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:52:34.5689612Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:52:34.5690386Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:34.5691049Z Compiling xla/literal_util.cc; 10s local 2024-12-18T00:52:34.5691870Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:52:34.5692859Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2024-12-18T00:52:34.5694032Z Compiling llvm/lib/Transforms/Vectorize/VPlanAnalysis.cpp; 9s local 2024-12-18T00:52:34.5694933Z @llvm-project//llvm:Scalar; 9s local ... 2024-12-18T00:52:34.8866761Z 2024-12-18T00:52:34.8867643Z  2024-12-18T00:52:34.8868244Z  2024-12-18T00:52:34.8868680Z  2024-12-18T00:52:34.8869157Z  2024-12-18T00:52:34.8869880Z  2024-12-18T00:52:34.8870325Z  2024-12-18T00:52:34.8870725Z  2024-12-18T00:52:34.8871132Z  2024-12-18T00:52:34.8872149Z [16,859 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:34.8873384Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:52:34.8874426Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:52:34.8875242Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:34.8875929Z Compiling xla/literal_util.cc; 11s local 2024-12-18T00:52:34.8876781Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:52:34.8877773Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:34.8878939Z Compiling llvm/lib/Transforms/Vectorize/VPlanAnalysis.cpp; 9s local 2024-12-18T00:52:34.8879915Z @llvm-project//llvm:Scalar; 9s local ... 2024-12-18T00:52:35.0870937Z 2024-12-18T00:52:35.0872230Z  2024-12-18T00:52:35.0872743Z  2024-12-18T00:52:35.0873119Z  2024-12-18T00:52:35.0873530Z  2024-12-18T00:52:35.0873917Z  2024-12-18T00:52:35.0874307Z  2024-12-18T00:52:35.0874693Z  2024-12-18T00:52:35.0875060Z  2024-12-18T00:52:35.0875998Z [16,860 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:35.0877144Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:52:35.0878161Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:52:35.0878883Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:52:35.0879548Z Compiling xla/literal_util.cc; 11s local 2024-12-18T00:52:35.0880404Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:52:35.0881368Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:35.0882460Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 9s local 2024-12-18T00:52:35.0883615Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 9s local ... 2024-12-18T00:52:35.4446186Z 2024-12-18T00:52:35.4447117Z  2024-12-18T00:52:35.4447578Z  2024-12-18T00:52:35.4447955Z  2024-12-18T00:52:35.4448365Z  2024-12-18T00:52:35.4448709Z  2024-12-18T00:52:35.4449075Z  2024-12-18T00:52:35.4449457Z  2024-12-18T00:52:35.4449848Z  2024-12-18T00:52:35.4450801Z [16,861 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:35.4452042Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:52:35.4453070Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:52:35.4453889Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:52:35.4454607Z Compiling xla/literal_util.cc; 11s local 2024-12-18T00:52:35.4455818Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2024-12-18T00:52:35.4457005Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:35.4458134Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 9s local 2024-12-18T00:52:35.4459246Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 9s local ... 2024-12-18T00:52:35.6877330Z 2024-12-18T00:52:35.6878230Z  2024-12-18T00:52:35.6878709Z  2024-12-18T00:52:35.6879132Z  2024-12-18T00:52:35.6879596Z  2024-12-18T00:52:35.6879990Z  2024-12-18T00:52:35.6880371Z  2024-12-18T00:52:35.6880777Z  2024-12-18T00:52:35.6881121Z  2024-12-18T00:52:35.6882050Z [16,863 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:35.6883223Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:52:35.6884161Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:52:35.6885305Z @llvm-project//llvm:Instrumentation; 15s local 2024-12-18T00:52:35.6885973Z Compiling xla/literal_util.cc; 11s local 2024-12-18T00:52:35.6886838Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:52:35.6887836Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:35.6888948Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 10s local 2024-12-18T00:52:35.6890022Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 9s local ... 2024-12-18T00:52:36.0930300Z 2024-12-18T00:52:36.0931198Z  2024-12-18T00:52:36.0931667Z  2024-12-18T00:52:36.0932048Z  2024-12-18T00:52:36.0932428Z  2024-12-18T00:52:36.0932903Z  2024-12-18T00:52:36.0933341Z  2024-12-18T00:52:36.0933755Z  2024-12-18T00:52:36.0934136Z  2024-12-18T00:52:36.0935054Z [16,864 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:36.0936646Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:52:36.0937756Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:52:36.0938561Z @llvm-project//llvm:Instrumentation; 16s local 2024-12-18T00:52:36.0939264Z Compiling xla/literal_util.cc; 12s local 2024-12-18T00:52:36.0940160Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2024-12-18T00:52:36.0941122Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 11s local 2024-12-18T00:52:36.0942108Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 10s local 2024-12-18T00:52:36.0943311Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local ... 2024-12-18T00:52:36.4884461Z 2024-12-18T00:52:36.4885320Z  2024-12-18T00:52:36.4885825Z  2024-12-18T00:52:36.4886223Z  2024-12-18T00:52:36.4886637Z  2024-12-18T00:52:36.4887072Z  2024-12-18T00:52:36.4887516Z  2024-12-18T00:52:36.4887915Z  2024-12-18T00:52:36.4888359Z  2024-12-18T00:52:36.4889470Z [16,865 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:36.4890859Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:52:36.4902984Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:52:36.4903780Z @llvm-project//llvm:Instrumentation; 16s local 2024-12-18T00:52:36.4904410Z Compiling xla/literal_util.cc; 12s local 2024-12-18T00:52:36.4905238Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:52:36.4906189Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 11s local 2024-12-18T00:52:36.4907243Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 10s local 2024-12-18T00:52:36.4908310Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local ... 2024-12-18T00:52:36.7368457Z 2024-12-18T00:52:36.7369570Z  2024-12-18T00:52:36.7370025Z  2024-12-18T00:52:36.7370432Z  2024-12-18T00:52:36.7370859Z  2024-12-18T00:52:36.7371255Z  2024-12-18T00:52:36.7371643Z  2024-12-18T00:52:36.7372035Z  2024-12-18T00:52:36.7372425Z  2024-12-18T00:52:36.7373302Z [16,867 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:36.7374498Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:52:36.7375492Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2024-12-18T00:52:36.7376299Z @llvm-project//llvm:Instrumentation; 16s local 2024-12-18T00:52:36.7377182Z Compiling xla/literal_util.cc; 13s local 2024-12-18T00:52:36.7378045Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:52:36.7379078Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 11s local 2024-12-18T00:52:36.7380268Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 10s local 2024-12-18T00:52:36.7381651Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local ... 2024-12-18T00:52:36.9411233Z 2024-12-18T00:52:36.9412136Z  2024-12-18T00:52:36.9412602Z  2024-12-18T00:52:36.9412971Z  2024-12-18T00:52:36.9413359Z  2024-12-18T00:52:36.9413757Z  2024-12-18T00:52:36.9414133Z  2024-12-18T00:52:36.9414502Z  2024-12-18T00:52:36.9414911Z  2024-12-18T00:52:36.9415826Z [16,871 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:36.9417107Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:52:36.9418170Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2024-12-18T00:52:36.9418885Z Compiling xla/literal_util.cc; 13s local 2024-12-18T00:52:36.9419733Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:52:36.9420848Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 11s local 2024-12-18T00:52:36.9422221Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:52:36.9423240Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local 2024-12-18T00:52:36.9424176Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 9s local ... 2024-12-18T00:52:37.2069007Z 2024-12-18T00:52:37.2069899Z  2024-12-18T00:52:37.2070320Z  2024-12-18T00:52:37.2070663Z  2024-12-18T00:52:37.2071022Z  2024-12-18T00:52:37.2071384Z  2024-12-18T00:52:37.2071754Z  2024-12-18T00:52:37.2072146Z  2024-12-18T00:52:37.2072544Z  2024-12-18T00:52:37.2073572Z [16,873 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:37.2074788Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:52:37.2075834Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2024-12-18T00:52:37.2076619Z Compiling xla/literal_util.cc; 13s local 2024-12-18T00:52:37.2077527Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:52:37.2078687Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 11s local 2024-12-18T00:52:37.2079750Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:52:37.2080722Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local 2024-12-18T00:52:37.2081644Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 9s local ... 2024-12-18T00:52:37.4139382Z 2024-12-18T00:52:37.4140342Z  2024-12-18T00:52:37.4140888Z  2024-12-18T00:52:37.4141260Z  2024-12-18T00:52:37.4141655Z  2024-12-18T00:52:37.4142037Z  2024-12-18T00:52:37.4142431Z  2024-12-18T00:52:37.4142827Z  2024-12-18T00:52:37.4143220Z  2024-12-18T00:52:37.4144402Z [16,876 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:37.4145976Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:52:37.4146935Z Compiling xla/literal_util.cc; 13s local 2024-12-18T00:52:37.4147813Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2024-12-18T00:52:37.4148911Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 11s local 2024-12-18T00:52:37.4149932Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:52:37.4151134Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:37.4152350Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:52:37.4153335Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 8s local ... 2024-12-18T00:52:37.6893599Z 2024-12-18T00:52:37.6894502Z  2024-12-18T00:52:37.6894987Z  2024-12-18T00:52:37.6895394Z  2024-12-18T00:52:37.6895833Z  2024-12-18T00:52:37.6896233Z  2024-12-18T00:52:37.6896782Z  2024-12-18T00:52:37.6897163Z  2024-12-18T00:52:37.6897599Z  2024-12-18T00:52:37.6898745Z [16,877 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:37.6899941Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:52:37.6900808Z Compiling xla/literal_util.cc; 14s local 2024-12-18T00:52:37.6901634Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:52:37.6902785Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 12s local 2024-12-18T00:52:37.6904082Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2024-12-18T00:52:37.6905052Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:37.6906106Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:52:37.6907068Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 9s local ... 2024-12-18T00:52:37.9614348Z 2024-12-18T00:52:37.9615338Z  2024-12-18T00:52:37.9615857Z  2024-12-18T00:52:37.9616259Z  2024-12-18T00:52:37.9617234Z  2024-12-18T00:52:37.9617642Z  2024-12-18T00:52:37.9618025Z  2024-12-18T00:52:37.9618419Z  2024-12-18T00:52:37.9618797Z  2024-12-18T00:52:37.9619753Z [16,881 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:37.9620870Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:52:37.9621740Z Compiling xla/literal_util.cc; 14s local 2024-12-18T00:52:37.9622595Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:52:37.9623679Z Compiling llvm/lib/Transforms/Scalar/ConstraintElimination.cpp; 12s local 2024-12-18T00:52:37.9624715Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:52:37.9625677Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:37.9626609Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:52:37.9627583Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 9s local ... 2024-12-18T00:52:38.2899750Z 2024-12-18T00:52:38.2900628Z  2024-12-18T00:52:38.2901099Z  2024-12-18T00:52:38.2901535Z  2024-12-18T00:52:38.2901927Z  2024-12-18T00:52:38.2902292Z  2024-12-18T00:52:38.2902670Z  2024-12-18T00:52:38.2903066Z  2024-12-18T00:52:38.2903448Z  2024-12-18T00:52:38.2904321Z [16,884 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:38.2905437Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:52:38.2906211Z Compiling xla/literal_util.cc; 14s local 2024-12-18T00:52:38.2906972Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2024-12-18T00:52:38.2907824Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:52:38.2908760Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:38.2910026Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:52:38.2910961Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 9s local 2024-12-18T00:52:38.2911888Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 9s local ... 2024-12-18T00:52:38.4903890Z 2024-12-18T00:52:38.4904789Z  2024-12-18T00:52:38.4905291Z  2024-12-18T00:52:38.4905741Z  2024-12-18T00:52:38.4906144Z  2024-12-18T00:52:38.4906542Z  2024-12-18T00:52:38.4906953Z  2024-12-18T00:52:38.4907368Z  2024-12-18T00:52:38.4907795Z  2024-12-18T00:52:38.4908749Z [16,886 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:38.4909937Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:52:38.4910791Z Compiling xla/literal_util.cc; 14s local 2024-12-18T00:52:38.4911732Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:52:38.4913119Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:52:38.4914246Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local 2024-12-18T00:52:38.4915247Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:52:38.4916229Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 10s local 2024-12-18T00:52:38.4917304Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 9s local ... 2024-12-18T00:52:38.7067017Z 2024-12-18T00:52:38.7069698Z  2024-12-18T00:52:38.7070169Z  2024-12-18T00:52:38.7072235Z  2024-12-18T00:52:38.7073949Z  2024-12-18T00:52:38.7074343Z  2024-12-18T00:52:38.7074727Z  2024-12-18T00:52:38.7075095Z  2024-12-18T00:52:38.7075489Z  2024-12-18T00:52:38.7076396Z [16,887 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:38.7077489Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:52:38.7078906Z Compiling xla/literal_util.cc; 15s local 2024-12-18T00:52:38.7079800Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:52:38.7080829Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2024-12-18T00:52:38.7081718Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local 2024-12-18T00:52:38.7082690Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:52:38.7083618Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 10s local 2024-12-18T00:52:38.7084616Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 10s local ... 2024-12-18T00:52:39.0471970Z 2024-12-18T00:52:39.0472866Z  2024-12-18T00:52:39.0473342Z  2024-12-18T00:52:39.0473781Z  2024-12-18T00:52:39.0474210Z  2024-12-18T00:52:39.0474602Z  2024-12-18T00:52:39.0475014Z  2024-12-18T00:52:39.0475421Z  2024-12-18T00:52:39.0475849Z  2024-12-18T00:52:39.0476794Z [16,890 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:39.0477952Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:52:39.0478881Z Compiling xla/literal_util.cc; 15s local 2024-12-18T00:52:39.0479693Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:52:39.0480613Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:52:39.0481509Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:52:39.0482428Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 10s local 2024-12-18T00:52:39.0483436Z Compiling llvm/lib/Transforms/Utils/LoopUnroll.cpp; 10s local 2024-12-18T00:52:39.0484466Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 9s local ... 2024-12-18T00:52:39.2592529Z 2024-12-18T00:52:39.2593411Z  2024-12-18T00:52:39.2593914Z  2024-12-18T00:52:39.2594672Z  2024-12-18T00:52:39.2595101Z  2024-12-18T00:52:39.2595516Z  2024-12-18T00:52:39.2595965Z  2024-12-18T00:52:39.2596372Z  2024-12-18T00:52:39.2596778Z  2024-12-18T00:52:39.2597872Z [16,894 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:39.2599102Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:52:39.2600173Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2024-12-18T00:52:39.2601028Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:52:39.2601865Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:52:39.2602885Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 10s local 2024-12-18T00:52:39.2603906Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 9s local 2024-12-18T00:52:39.2604853Z Compiling llvm/lib/Transforms/Utils/LoopVersioning.cpp; 8s local 2024-12-18T00:52:39.2605777Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 8s local ... 2024-12-18T00:52:39.4843516Z 2024-12-18T00:52:39.4844651Z  2024-12-18T00:52:39.4845192Z  2024-12-18T00:52:39.4845581Z  2024-12-18T00:52:39.4845962Z  2024-12-18T00:52:39.4846306Z  2024-12-18T00:52:39.4846666Z  2024-12-18T00:52:39.4847068Z  2024-12-18T00:52:39.4847452Z  2024-12-18T00:52:39.4848364Z [16,899 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:39.4849486Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:52:39.4850647Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:52:39.4851639Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:52:39.4852550Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 11s local 2024-12-18T00:52:39.4853572Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 9s local 2024-12-18T00:52:39.4854464Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 8s local 2024-12-18T00:52:39.4857758Z @llvm-project//llvm:Instrumentation; 6s local 2024-12-18T00:52:39.4858705Z Compiling llvm/lib/Analysis/RegionInfo.cpp; 5s local ... 2024-12-18T00:52:39.6912147Z 2024-12-18T00:52:39.6913013Z  2024-12-18T00:52:39.6913422Z  2024-12-18T00:52:39.6913785Z  2024-12-18T00:52:39.6914168Z  2024-12-18T00:52:39.6914536Z  2024-12-18T00:52:39.6914886Z  2024-12-18T00:52:39.6915220Z  2024-12-18T00:52:39.6915582Z  2024-12-18T00:52:39.6916441Z [16,900 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:39.6917493Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:52:39.6918486Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:52:39.6919347Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2024-12-18T00:52:39.6920232Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 11s local 2024-12-18T00:52:39.6921131Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 9s local 2024-12-18T00:52:39.6921926Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 8s local 2024-12-18T00:52:39.6922639Z @llvm-project//llvm:Instrumentation; 6s local 2024-12-18T00:52:39.6923361Z Compiling llvm/lib/Analysis/RegionInfo.cpp; 5s local ... 2024-12-18T00:52:40.0917419Z 2024-12-18T00:52:40.0918296Z  2024-12-18T00:52:40.0918744Z  2024-12-18T00:52:40.0919131Z  2024-12-18T00:52:40.0919533Z  2024-12-18T00:52:40.0919916Z  2024-12-18T00:52:40.0920260Z  2024-12-18T00:52:40.0920623Z  2024-12-18T00:52:40.0920999Z  2024-12-18T00:52:40.0921913Z [16,901 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:40.0922922Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:52:40.0924238Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:52:40.0925169Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:52:40.0926106Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 11s local 2024-12-18T00:52:40.0927033Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:52:40.0927898Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 9s local 2024-12-18T00:52:40.0928717Z @llvm-project//llvm:Instrumentation; 6s local 2024-12-18T00:52:40.0929437Z Compiling llvm/lib/Analysis/RegionInfo.cpp; 6s local ... 2024-12-18T00:52:40.2921447Z 2024-12-18T00:52:40.2922338Z  2024-12-18T00:52:40.2922796Z  2024-12-18T00:52:40.2923198Z  2024-12-18T00:52:40.2923598Z  2024-12-18T00:52:40.2923998Z  2024-12-18T00:52:40.2924393Z  2024-12-18T00:52:40.2924783Z  2024-12-18T00:52:40.2925176Z  2024-12-18T00:52:40.2926156Z [16,903 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:40.2927700Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:52:40.2928827Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2024-12-18T00:52:40.2929779Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:52:40.2930723Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 11s local 2024-12-18T00:52:40.2931741Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:52:40.2932772Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 9s local 2024-12-18T00:52:40.2933538Z @llvm-project//llvm:Instrumentation; 7s local 2024-12-18T00:52:40.2934319Z Compiling llvm/lib/Analysis/RegionInfo.cpp; 6s local ... 2024-12-18T00:52:40.5393518Z 2024-12-18T00:52:40.5394379Z  2024-12-18T00:52:40.5394882Z  2024-12-18T00:52:40.5395273Z  2024-12-18T00:52:40.5395657Z  2024-12-18T00:52:40.5396008Z  2024-12-18T00:52:40.5396419Z  2024-12-18T00:52:40.5396754Z  2024-12-18T00:52:40.5397481Z  2024-12-18T00:52:40.5398328Z [16,905 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:40.5399394Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:52:40.5400421Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 16s local 2024-12-18T00:52:40.5401342Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:52:40.5402236Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 12s local 2024-12-18T00:52:40.5403211Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:52:40.5404098Z Compiling llvm/lib/CodeGen/TypePromotion.cpp; 9s local 2024-12-18T00:52:40.5404835Z @llvm-project//llvm:Instrumentation; 7s local 2024-12-18T00:52:40.5405539Z @llvm-project//llvm:Scalar; 6s local ... 2024-12-18T00:52:40.7870865Z 2024-12-18T00:52:40.7871854Z  2024-12-18T00:52:40.7872350Z  2024-12-18T00:52:40.7872727Z  2024-12-18T00:52:40.7873163Z  2024-12-18T00:52:40.7873561Z  2024-12-18T00:52:40.7873987Z  2024-12-18T00:52:40.7874366Z  2024-12-18T00:52:40.7874772Z  2024-12-18T00:52:40.7875707Z [16,908 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:40.7876865Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:52:40.7877834Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2024-12-18T00:52:40.7878918Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 12s local 2024-12-18T00:52:40.7879935Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2024-12-18T00:52:40.7881080Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 7s local 2024-12-18T00:52:40.7882316Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 6s local 2024-12-18T00:52:40.7883793Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 6s local 2024-12-18T00:52:40.7884962Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 6s local ... 2024-12-18T00:52:41.0394798Z 2024-12-18T00:52:41.0395691Z  2024-12-18T00:52:41.0396137Z  2024-12-18T00:52:41.0396503Z  2024-12-18T00:52:41.0396882Z  2024-12-18T00:52:41.0397239Z  2024-12-18T00:52:41.0397621Z  2024-12-18T00:52:41.0398004Z  2024-12-18T00:52:41.0398393Z  2024-12-18T00:52:41.0399349Z [16,911 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:41.0400506Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:52:41.0401559Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 12s local 2024-12-18T00:52:41.0402505Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2024-12-18T00:52:41.0403588Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 7s local 2024-12-18T00:52:41.0405041Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 6s local 2024-12-18T00:52:41.0406130Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 6s local 2024-12-18T00:52:41.0407162Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 6s local 2024-12-18T00:52:41.0408236Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 6s local ... 2024-12-18T00:52:41.2929456Z 2024-12-18T00:52:41.2930366Z  2024-12-18T00:52:41.2930827Z  2024-12-18T00:52:41.2931240Z  2024-12-18T00:52:41.2931641Z  2024-12-18T00:52:41.2932035Z  2024-12-18T00:52:41.2932425Z  2024-12-18T00:52:41.2932814Z  2024-12-18T00:52:41.2933173Z  2024-12-18T00:52:41.2934086Z [16,912 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:41.2935282Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:52:41.2936366Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 12s local 2024-12-18T00:52:41.2937874Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2024-12-18T00:52:41.2939078Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 7s local 2024-12-18T00:52:41.2940218Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 7s local 2024-12-18T00:52:41.2941216Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 6s local 2024-12-18T00:52:41.2942239Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 6s local 2024-12-18T00:52:41.2943306Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 6s local ... 2024-12-18T00:52:41.6027409Z 2024-12-18T00:52:41.6028328Z  2024-12-18T00:52:41.6028860Z  2024-12-18T00:52:41.6029253Z  2024-12-18T00:52:41.6029673Z  2024-12-18T00:52:41.6030074Z  2024-12-18T00:52:41.6030472Z  2024-12-18T00:52:41.6030872Z  2024-12-18T00:52:41.6031252Z  2024-12-18T00:52:41.6032224Z [16,914 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:41.6033472Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:52:41.6034717Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 13s local 2024-12-18T00:52:41.6035898Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 7s local 2024-12-18T00:52:41.6037107Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 7s local 2024-12-18T00:52:41.6038205Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local 2024-12-18T00:52:41.6039314Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:52:41.6040415Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 6s local 2024-12-18T00:52:41.6041505Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 5s local ... 2024-12-18T00:52:41.8936754Z 2024-12-18T00:52:41.8937636Z  2024-12-18T00:52:41.8938107Z  2024-12-18T00:52:41.8938772Z  2024-12-18T00:52:41.8939161Z  2024-12-18T00:52:41.8939538Z  2024-12-18T00:52:41.8939878Z  2024-12-18T00:52:41.8940218Z  2024-12-18T00:52:41.8940619Z  2024-12-18T00:52:41.8941559Z [16,917 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:41.8942724Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:52:41.8943751Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 13s local 2024-12-18T00:52:41.8945088Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 8s local 2024-12-18T00:52:41.8946319Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 7s local 2024-12-18T00:52:41.8947377Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local 2024-12-18T00:52:41.8948416Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:52:41.8949704Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 6s local 2024-12-18T00:52:41.8950994Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 5s local ... 2024-12-18T00:52:42.0941121Z 2024-12-18T00:52:42.0941989Z  2024-12-18T00:52:42.0942465Z  2024-12-18T00:52:42.0942835Z  2024-12-18T00:52:42.0943212Z  2024-12-18T00:52:42.0943610Z  2024-12-18T00:52:42.0944004Z  2024-12-18T00:52:42.0944644Z  2024-12-18T00:52:42.0945030Z  2024-12-18T00:52:42.0946029Z [16,918 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:42.0947305Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:52:42.0948461Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 13s local 2024-12-18T00:52:42.0949615Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 8s local 2024-12-18T00:52:42.0950842Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 7s local 2024-12-18T00:52:42.0951899Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local 2024-12-18T00:52:42.0953231Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:52:42.0954469Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 7s local 2024-12-18T00:52:42.0955497Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 5s local ... 2024-12-18T00:52:42.4946257Z 2024-12-18T00:52:42.4947142Z  2024-12-18T00:52:42.4947671Z  2024-12-18T00:52:42.4948088Z  2024-12-18T00:52:42.4948648Z  2024-12-18T00:52:42.4949068Z  2024-12-18T00:52:42.4949501Z  2024-12-18T00:52:42.4949915Z  2024-12-18T00:52:42.4950385Z  2024-12-18T00:52:42.4951385Z [16,919 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:42.4952614Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:52:42.4953774Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local 2024-12-18T00:52:42.4954980Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 8s local 2024-12-18T00:52:42.4956254Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 8s local 2024-12-18T00:52:42.4957367Z Compiling llvm/lib/Transforms/Vectorize/VPlanSLP.cpp; 7s local 2024-12-18T00:52:42.4958452Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 7s local 2024-12-18T00:52:42.4959621Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 7s local 2024-12-18T00:52:42.4960670Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 6s local ... 2024-12-18T00:52:42.6950125Z 2024-12-18T00:52:42.6951051Z  2024-12-18T00:52:42.6951529Z  2024-12-18T00:52:42.6951938Z  2024-12-18T00:52:42.6952324Z  2024-12-18T00:52:42.6952722Z  2024-12-18T00:52:42.6953115Z  2024-12-18T00:52:42.6953503Z  2024-12-18T00:52:42.6953881Z  2024-12-18T00:52:42.6954790Z [16,921 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:42.6956232Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:52:42.6957189Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local 2024-12-18T00:52:42.6958198Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 8s local 2024-12-18T00:52:42.6959305Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 8s local 2024-12-18T00:52:42.6960549Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 8s local 2024-12-18T00:52:42.6961704Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 7s local 2024-12-18T00:52:42.6962700Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 6s local 2024-12-18T00:52:42.6963598Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 5s local ... 2024-12-18T00:52:43.0955509Z 2024-12-18T00:52:43.0956361Z  2024-12-18T00:52:43.0956873Z  2024-12-18T00:52:43.0957286Z  2024-12-18T00:52:43.0957718Z  2024-12-18T00:52:43.0958089Z  2024-12-18T00:52:43.0958490Z  2024-12-18T00:52:43.0958885Z  2024-12-18T00:52:43.0959602Z  2024-12-18T00:52:43.0960589Z [16,922 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:43.0961743Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:52:43.0962825Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local 2024-12-18T00:52:43.0963978Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 9s local 2024-12-18T00:52:43.0965183Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 8s local 2024-12-18T00:52:43.0966299Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 8s local 2024-12-18T00:52:43.0967431Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 8s local 2024-12-18T00:52:43.0968451Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 6s local 2024-12-18T00:52:43.0969311Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 6s local ... 2024-12-18T00:52:43.3723764Z 2024-12-18T00:52:43.3724798Z  2024-12-18T00:52:43.3725739Z  2024-12-18T00:52:43.3726167Z  2024-12-18T00:52:43.3726578Z  2024-12-18T00:52:43.3726983Z  2024-12-18T00:52:43.3727380Z  2024-12-18T00:52:43.3727736Z  2024-12-18T00:52:43.3728117Z  2024-12-18T00:52:43.3729050Z [16,923 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:43.3730198Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:52:43.3731290Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local 2024-12-18T00:52:43.3732464Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 9s local 2024-12-18T00:52:43.3733678Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 9s local 2024-12-18T00:52:43.3734765Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 8s local 2024-12-18T00:52:43.3735878Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 8s local 2024-12-18T00:52:43.3737059Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 7s local 2024-12-18T00:52:43.3737960Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 6s local ... 2024-12-18T00:52:43.6961150Z 2024-12-18T00:52:43.6962054Z  2024-12-18T00:52:43.6962569Z  2024-12-18T00:52:43.6962998Z  2024-12-18T00:52:43.6963425Z  2024-12-18T00:52:43.6963847Z  2024-12-18T00:52:43.6964267Z  2024-12-18T00:52:43.6964662Z  2024-12-18T00:52:43.6965059Z  2024-12-18T00:52:43.6966007Z [16,925 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:43.6967192Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:52:43.6968160Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local 2024-12-18T00:52:43.6969188Z Compiling llvm/lib/Transforms/Scalar/RewriteStatepointsForGC.cpp; 9s local 2024-12-18T00:52:43.6970668Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 9s local 2024-12-18T00:52:43.6971666Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local 2024-12-18T00:52:43.6972581Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 8s local 2024-12-18T00:52:43.6973554Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 7s local 2024-12-18T00:52:43.6974499Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 6s local ... 2024-12-18T00:52:44.0966361Z 2024-12-18T00:52:44.0967235Z  2024-12-18T00:52:44.0967716Z  2024-12-18T00:52:44.0968123Z  2024-12-18T00:52:44.0968553Z  2024-12-18T00:52:44.0968944Z  2024-12-18T00:52:44.0969298Z  2024-12-18T00:52:44.0969668Z  2024-12-18T00:52:44.0970037Z  2024-12-18T00:52:44.0970942Z [16,927 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:44.0972268Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:52:44.0973720Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local 2024-12-18T00:52:44.0974648Z @llvm-project//llvm:Scalar; 10s local 2024-12-18T00:52:44.0975538Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 9s local 2024-12-18T00:52:44.0976785Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local 2024-12-18T00:52:44.0977899Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local 2024-12-18T00:52:44.0978815Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 7s local 2024-12-18T00:52:44.0979722Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 7s local ... 2024-12-18T00:52:44.2970157Z 2024-12-18T00:52:44.2971068Z  2024-12-18T00:52:44.2971564Z  2024-12-18T00:52:44.2971946Z  2024-12-18T00:52:44.2972325Z  2024-12-18T00:52:44.2972706Z  2024-12-18T00:52:44.2973080Z  2024-12-18T00:52:44.2973461Z  2024-12-18T00:52:44.2973858Z  2024-12-18T00:52:44.2975022Z [16,928 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:44.2976180Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:52:44.2977347Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local 2024-12-18T00:52:44.2978139Z @llvm-project//llvm:Scalar; 10s local 2024-12-18T00:52:44.2978921Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local 2024-12-18T00:52:44.2979935Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local 2024-12-18T00:52:44.2980953Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local 2024-12-18T00:52:44.2981884Z Compiling mlir/lib/IR/BuiltinDialect.cpp; 8s local 2024-12-18T00:52:44.2982738Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 7s local ... 2024-12-18T00:52:44.6975638Z 2024-12-18T00:52:44.6976669Z  2024-12-18T00:52:44.6977127Z  2024-12-18T00:52:44.6977530Z  2024-12-18T00:52:44.6977924Z  2024-12-18T00:52:44.6978336Z  2024-12-18T00:52:44.6978736Z  2024-12-18T00:52:44.6979117Z  2024-12-18T00:52:44.6979490Z  2024-12-18T00:52:44.6980458Z [16,929 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:44.6981675Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:52:44.6982784Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local 2024-12-18T00:52:44.6983563Z @llvm-project//llvm:Scalar; 10s local 2024-12-18T00:52:44.6984411Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local 2024-12-18T00:52:44.6985543Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 10s local 2024-12-18T00:52:44.6986614Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local 2024-12-18T00:52:44.6987651Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 7s local 2024-12-18T00:52:44.6988713Z @llvm-project//llvm:Instrumentation; 7s local ... 2024-12-18T00:52:45.0037084Z 2024-12-18T00:52:45.0037959Z  2024-12-18T00:52:45.0038385Z  2024-12-18T00:52:45.0038729Z  2024-12-18T00:52:45.0039081Z  2024-12-18T00:52:45.0039407Z  2024-12-18T00:52:45.0039755Z  2024-12-18T00:52:45.0040109Z  2024-12-18T00:52:45.0040447Z  2024-12-18T00:52:45.0041223Z [16,934 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:45.0042223Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:52:45.0043141Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local 2024-12-18T00:52:45.0043835Z @llvm-project//llvm:Scalar; 11s local 2024-12-18T00:52:45.0044846Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 10s local 2024-12-18T00:52:45.0045746Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 10s local 2024-12-18T00:52:45.0046691Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 9s local 2024-12-18T00:52:45.0048114Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 8s local 2024-12-18T00:52:45.0048847Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:52:45.2981338Z 2024-12-18T00:52:45.2982212Z  2024-12-18T00:52:45.2982584Z  2024-12-18T00:52:45.2982904Z  2024-12-18T00:52:45.2983222Z  2024-12-18T00:52:45.2983563Z  2024-12-18T00:52:45.2983860Z  2024-12-18T00:52:45.2984170Z  2024-12-18T00:52:45.2984481Z  2024-12-18T00:52:45.2985249Z [16,935 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:45.2986168Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:52:45.2986996Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local 2024-12-18T00:52:45.2987644Z @llvm-project//llvm:Scalar; 11s local 2024-12-18T00:52:45.2988340Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:45.2989616Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 10s local 2024-12-18T00:52:45.2990443Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 8s local 2024-12-18T00:52:45.2991109Z @llvm-project//llvm:Instrumentation; 8s local 2024-12-18T00:52:45.2991712Z Compiling xla/service/cpu/cpu_options.cc; 8s local ... 2024-12-18T00:52:45.5956667Z 2024-12-18T00:52:45.5957533Z  2024-12-18T00:52:45.5958006Z  2024-12-18T00:52:45.5958395Z  2024-12-18T00:52:45.5958777Z  2024-12-18T00:52:45.5959147Z  2024-12-18T00:52:45.5959555Z  2024-12-18T00:52:45.5959913Z  2024-12-18T00:52:45.5960284Z  2024-12-18T00:52:45.5961185Z [16,939 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:45.5962312Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:52:45.5963411Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:52:45.5964487Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:45.5965617Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 10s local 2024-12-18T00:52:45.5966671Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 8s local 2024-12-18T00:52:45.5967503Z @llvm-project//llvm:Instrumentation; 8s local 2024-12-18T00:52:45.5968408Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 7s local 2024-12-18T00:52:45.5969589Z Compiling llvm/lib/Transforms/Utils/MemoryTaggingSupport.cpp; 6s local ... 2024-12-18T00:52:45.8390046Z 2024-12-18T00:52:45.8390931Z  2024-12-18T00:52:45.8391430Z  2024-12-18T00:52:45.8391878Z  2024-12-18T00:52:45.8392401Z  2024-12-18T00:52:45.8392846Z  2024-12-18T00:52:45.8393311Z  2024-12-18T00:52:45.8393805Z  2024-12-18T00:52:45.8394178Z  2024-12-18T00:52:45.8395426Z [16,940 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:45.8396559Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:52:45.8397603Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:52:45.8398708Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:45.8399829Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 10s local 2024-12-18T00:52:45.8400907Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2024-12-18T00:52:45.8401690Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:45.8402509Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 7s local 2024-12-18T00:52:45.8403600Z Compiling llvm/lib/Transforms/Utils/MemoryTaggingSupport.cpp; 7s local ... 2024-12-18T00:52:46.0553016Z 2024-12-18T00:52:46.0553862Z  2024-12-18T00:52:46.0554294Z  2024-12-18T00:52:46.0554733Z  2024-12-18T00:52:46.0555110Z  2024-12-18T00:52:46.0555711Z  2024-12-18T00:52:46.0556134Z  2024-12-18T00:52:46.0556532Z  2024-12-18T00:52:46.0556933Z  2024-12-18T00:52:46.0557823Z [16,941 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:46.0558962Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:52:46.0560125Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:52:46.0561180Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local 2024-12-18T00:52:46.0562299Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 11s local 2024-12-18T00:52:46.0563318Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2024-12-18T00:52:46.0564122Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:46.0565049Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 7s local 2024-12-18T00:52:46.0566429Z Compiling llvm/lib/Transforms/Utils/MemoryTaggingSupport.cpp; 7s local ... 2024-12-18T00:52:46.2989544Z 2024-12-18T00:52:46.2991005Z  2024-12-18T00:52:46.2991614Z  2024-12-18T00:52:46.2992084Z  2024-12-18T00:52:46.2992511Z  2024-12-18T00:52:46.2992891Z  2024-12-18T00:52:46.2993274Z  2024-12-18T00:52:46.2993657Z  2024-12-18T00:52:46.2994168Z  2024-12-18T00:52:46.2995206Z [16,942 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:46.2996423Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:52:46.2997445Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:52:46.2998552Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local 2024-12-18T00:52:46.2999766Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 11s local 2024-12-18T00:52:46.3000864Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2024-12-18T00:52:46.3001837Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:46.3002674Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 8s local 2024-12-18T00:52:46.3003747Z Compiling llvm/lib/Transforms/Utils/MemoryTaggingSupport.cpp; 7s local ... 2024-12-18T00:52:46.5014996Z 2024-12-18T00:52:46.5016322Z  2024-12-18T00:52:46.5016930Z  2024-12-18T00:52:46.5017320Z  2024-12-18T00:52:46.5017714Z  2024-12-18T00:52:46.5018077Z  2024-12-18T00:52:46.5018462Z  2024-12-18T00:52:46.5018844Z  2024-12-18T00:52:46.5019208Z  2024-12-18T00:52:46.5020101Z [16,943 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:46.5021253Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:52:46.5022283Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:52:46.5023720Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local 2024-12-18T00:52:46.5024755Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 11s local 2024-12-18T00:52:46.5025791Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2024-12-18T00:52:46.5026633Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:52:46.5027560Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 8s local 2024-12-18T00:52:46.5028757Z Compiling llvm/lib/Transforms/Utils/MemoryTaggingSupport.cpp; 7s local ... 2024-12-18T00:52:46.8047273Z 2024-12-18T00:52:46.8048212Z  2024-12-18T00:52:46.8048695Z  2024-12-18T00:52:46.8049073Z  2024-12-18T00:52:46.8049472Z  2024-12-18T00:52:46.8049845Z  2024-12-18T00:52:46.8050249Z  2024-12-18T00:52:46.8050639Z  2024-12-18T00:52:46.8051030Z  2024-12-18T00:52:46.8051951Z [16,946 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:46.8053359Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:52:46.8054411Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:52:46.8055520Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 11s local 2024-12-18T00:52:46.8056752Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:46.8057590Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:46.8058515Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 8s local 2024-12-18T00:52:46.8059703Z Compiling llvm/lib/Transforms/Vectorize/VPlanHCFGBuilder.cpp; 7s local 2024-12-18T00:52:46.8060975Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 7s local ... 2024-12-18T00:52:47.0997170Z 2024-12-18T00:52:47.0998362Z  2024-12-18T00:52:47.0998890Z  2024-12-18T00:52:47.0999293Z  2024-12-18T00:52:47.0999667Z  2024-12-18T00:52:47.1000080Z  2024-12-18T00:52:47.1000477Z  2024-12-18T00:52:47.1000861Z  2024-12-18T00:52:47.1001652Z  2024-12-18T00:52:47.1002615Z [16,946 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:47.1003778Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:52:47.1004819Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:52:47.1005849Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:47.1006880Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:47.1007719Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:47.1008616Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 8s local 2024-12-18T00:52:47.1009778Z Compiling llvm/lib/Transforms/Vectorize/VPlanHCFGBuilder.cpp; 8s local 2024-12-18T00:52:47.1010923Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 7s local ... 2024-12-18T00:52:47.3094294Z 2024-12-18T00:52:47.3095772Z  2024-12-18T00:52:47.3096305Z  2024-12-18T00:52:47.3096801Z  2024-12-18T00:52:47.3097184Z  2024-12-18T00:52:47.3097583Z  2024-12-18T00:52:47.3097975Z  2024-12-18T00:52:47.3098354Z  2024-12-18T00:52:47.3098772Z  2024-12-18T00:52:47.3099731Z [16,947 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:47.3100917Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:52:47.3102052Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:52:47.3103168Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:47.3104228Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:47.3105119Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:47.3106105Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:52:47.3107544Z Compiling llvm/lib/Transforms/Vectorize/VPlanHCFGBuilder.cpp; 8s local 2024-12-18T00:52:47.3108721Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local ... 2024-12-18T00:52:47.6330202Z 2024-12-18T00:52:47.6331094Z  2024-12-18T00:52:47.6331614Z  2024-12-18T00:52:47.6331983Z  2024-12-18T00:52:47.6332381Z  2024-12-18T00:52:47.6332749Z  2024-12-18T00:52:47.6333122Z  2024-12-18T00:52:47.6333495Z  2024-12-18T00:52:47.6333838Z  2024-12-18T00:52:47.6334785Z [16,948 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:47.6335911Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:52:47.6337185Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 19s local 2024-12-18T00:52:47.6338433Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:47.6339772Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2024-12-18T00:52:47.6340657Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:47.6341543Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:52:47.6342682Z Compiling llvm/lib/Transforms/Vectorize/VPlanHCFGBuilder.cpp; 8s local 2024-12-18T00:52:47.6343842Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local ... 2024-12-18T00:52:47.8600263Z 2024-12-18T00:52:47.8601556Z  2024-12-18T00:52:47.8602002Z  2024-12-18T00:52:47.8602492Z  2024-12-18T00:52:47.8602836Z  2024-12-18T00:52:47.8603197Z  2024-12-18T00:52:47.8603540Z  2024-12-18T00:52:47.8603892Z  2024-12-18T00:52:47.8604230Z  2024-12-18T00:52:47.8605061Z [16,950 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:47.8606102Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:52:47.8607337Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 19s local 2024-12-18T00:52:47.8608392Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 12s local 2024-12-18T00:52:47.8609362Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 11s local 2024-12-18T00:52:47.8610149Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:47.8611012Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:52:47.8611982Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local 2024-12-18T00:52:47.8612846Z Compiling xla/literal_comparison.cc; 8s local ... 2024-12-18T00:52:48.1005763Z 2024-12-18T00:52:48.1007131Z  2024-12-18T00:52:48.1007528Z  2024-12-18T00:52:48.1007846Z  2024-12-18T00:52:48.1008158Z  2024-12-18T00:52:48.1008480Z  2024-12-18T00:52:48.1008791Z  2024-12-18T00:52:48.1009088Z  2024-12-18T00:52:48.1009397Z  2024-12-18T00:52:48.1010199Z [16,952 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:48.1011094Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:52:48.1011921Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 19s local 2024-12-18T00:52:48.1012722Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:48.1013539Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 11s local 2024-12-18T00:52:48.1014189Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:48.1014900Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 9s local 2024-12-18T00:52:48.1015735Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 8s local 2024-12-18T00:52:48.1016592Z Compiling xla/literal_comparison.cc; 8s local ... 2024-12-18T00:52:48.4762850Z 2024-12-18T00:52:48.4764053Z  2024-12-18T00:52:48.4764850Z  2024-12-18T00:52:48.4765784Z  2024-12-18T00:52:48.4766389Z  2024-12-18T00:52:48.4766973Z  2024-12-18T00:52:48.4767654Z  2024-12-18T00:52:48.4769229Z  2024-12-18T00:52:48.4769861Z  2024-12-18T00:52:48.4771001Z [16,953 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:48.4772347Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:52:48.4773586Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:52:48.4774884Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:48.4776041Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:48.4777392Z Compiling llvm/lib/Transforms/Scalar/DFAJumpThreading.cpp; 10s local 2024-12-18T00:52:48.4778704Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 9s local 2024-12-18T00:52:48.4779801Z Compiling xla/literal_comparison.cc; 9s local 2024-12-18T00:52:48.4781129Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 9s local ... 2024-12-18T00:52:48.7011884Z 2024-12-18T00:52:48.7013106Z  2024-12-18T00:52:48.7013902Z  2024-12-18T00:52:48.7014483Z  2024-12-18T00:52:48.7015065Z  2024-12-18T00:52:48.7015714Z  2024-12-18T00:52:48.7016217Z  2024-12-18T00:52:48.7016972Z  2024-12-18T00:52:48.7025867Z  2024-12-18T00:52:48.7026900Z [16,958 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:52:48.7028032Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:52:48.7029069Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:52:48.7030179Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:48.7031156Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:48.7041808Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 9s local 2024-12-18T00:52:48.7042787Z Compiling xla/literal_comparison.cc; 9s local 2024-12-18T00:52:48.7044117Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local 2024-12-18T00:52:48.7045428Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local ... 2024-12-18T00:52:48.9652732Z 2024-12-18T00:52:48.9653695Z  2024-12-18T00:52:48.9654199Z  2024-12-18T00:52:48.9654618Z  2024-12-18T00:52:48.9654997Z  2024-12-18T00:52:48.9655543Z  2024-12-18T00:52:48.9655912Z  2024-12-18T00:52:48.9656276Z  2024-12-18T00:52:48.9656835Z  2024-12-18T00:52:48.9657799Z [16,959 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:48.9658997Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:52:48.9660094Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:52:48.9661213Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local 2024-12-18T00:52:48.9662253Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:48.9663210Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 9s local 2024-12-18T00:52:48.9664103Z Compiling xla/literal_comparison.cc; 9s local 2024-12-18T00:52:48.9664898Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2024-12-18T00:52:48.9665852Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 9s local ... 2024-12-18T00:52:49.1811439Z 2024-12-18T00:52:49.1812423Z  2024-12-18T00:52:49.1812902Z  2024-12-18T00:52:49.1813265Z  2024-12-18T00:52:49.1813617Z  2024-12-18T00:52:49.1813977Z  2024-12-18T00:52:49.1814333Z  2024-12-18T00:52:49.1814688Z  2024-12-18T00:52:49.1815043Z  2024-12-18T00:52:49.1815930Z [16,960 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:49.1817198Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:52:49.1818516Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:52:49.1819511Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:52:49.1820385Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:49.1821242Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local 2024-12-18T00:52:49.1822122Z Compiling xla/literal_comparison.cc; 9s local 2024-12-18T00:52:49.1822868Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2024-12-18T00:52:49.1823701Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 9s local ... 2024-12-18T00:52:49.5019700Z 2024-12-18T00:52:49.5021179Z  2024-12-18T00:52:49.5021947Z  2024-12-18T00:52:49.5023129Z  2024-12-18T00:52:49.5023621Z  2024-12-18T00:52:49.5024056Z  2024-12-18T00:52:49.5024446Z  2024-12-18T00:52:49.5024816Z  2024-12-18T00:52:49.5025218Z  2024-12-18T00:52:49.5026498Z [16,961 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:49.5027853Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:52:49.5029054Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:52:49.5030267Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:52:49.5031265Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:49.5032205Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local 2024-12-18T00:52:49.5033162Z Compiling xla/literal_comparison.cc; 10s local 2024-12-18T00:52:49.5033951Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:52:49.5034875Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local ... 2024-12-18T00:52:49.7023056Z 2024-12-18T00:52:49.7023968Z  2024-12-18T00:52:49.7024473Z  2024-12-18T00:52:49.7024866Z  2024-12-18T00:52:49.7025240Z  2024-12-18T00:52:49.7025672Z  2024-12-18T00:52:49.7026064Z  2024-12-18T00:52:49.7026856Z  2024-12-18T00:52:49.7027289Z  2024-12-18T00:52:49.7028226Z [16,962 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:49.7029565Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:52:49.7030623Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:52:49.7031688Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local 2024-12-18T00:52:49.7032641Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:49.7033528Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local 2024-12-18T00:52:49.7034427Z Compiling xla/literal_comparison.cc; 10s local 2024-12-18T00:52:49.7035198Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:52:49.7036075Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local ... 2024-12-18T00:52:50.0669398Z 2024-12-18T00:52:50.0670248Z  2024-12-18T00:52:50.0670772Z  2024-12-18T00:52:50.0671148Z  2024-12-18T00:52:50.0671526Z  2024-12-18T00:52:50.0671856Z  2024-12-18T00:52:50.0672256Z  2024-12-18T00:52:50.0672671Z  2024-12-18T00:52:50.0673098Z  2024-12-18T00:52:50.0674029Z [16,965 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:50.0675221Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:52:50.0676246Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:52:50.0677118Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:50.0677952Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 10s local 2024-12-18T00:52:50.0678840Z Compiling xla/literal_comparison.cc; 10s local 2024-12-18T00:52:50.0679673Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:52:50.0680853Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:52:50.0681723Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2024-12-18T00:52:50.3029351Z 2024-12-18T00:52:50.3030223Z  2024-12-18T00:52:50.3030825Z  2024-12-18T00:52:50.3031342Z  2024-12-18T00:52:50.3031806Z  2024-12-18T00:52:50.3032161Z  2024-12-18T00:52:50.3032549Z  2024-12-18T00:52:50.3032937Z  2024-12-18T00:52:50.3033326Z  2024-12-18T00:52:50.3034143Z [16,966 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:50.3035412Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:52:50.3036540Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:52:50.3037383Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:50.3038258Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:52:50.3039185Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:52:50.3040234Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2024-12-18T00:52:50.3041111Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local 2024-12-18T00:52:50.3041884Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2024-12-18T00:52:50.5033677Z 2024-12-18T00:52:50.5034557Z  2024-12-18T00:52:50.5035225Z  2024-12-18T00:52:50.5035779Z  2024-12-18T00:52:50.5036266Z  2024-12-18T00:52:50.5036779Z  2024-12-18T00:52:50.5037311Z  2024-12-18T00:52:50.5037827Z  2024-12-18T00:52:50.5038380Z  2024-12-18T00:52:50.5039415Z [16,969 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:50.5040878Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:52:50.5042099Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:52:50.5043097Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:50.5044673Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:52:50.5045773Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:52:50.5046577Z Compiling llvm/lib/Analysis/InlineCost.cpp; 11s local 2024-12-18T00:52:50.5047462Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:52:50.5048332Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local ... 2024-12-18T00:52:50.9038529Z 2024-12-18T00:52:50.9039385Z  2024-12-18T00:52:50.9039921Z  2024-12-18T00:52:50.9040220Z  2024-12-18T00:52:50.9040531Z  2024-12-18T00:52:50.9040839Z  2024-12-18T00:52:50.9041144Z  2024-12-18T00:52:50.9041460Z  2024-12-18T00:52:50.9041754Z  2024-12-18T00:52:50.9042506Z [16,972 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:50.9043422Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:52:50.9044534Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:52:50.9045222Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:50.9045890Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:52:50.9046576Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:52:50.9047188Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:52:50.9047810Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2024-12-18T00:52:50.9048527Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 10s local ... 2024-12-18T00:52:51.1044978Z 2024-12-18T00:52:51.1045851Z  2024-12-18T00:52:51.1046313Z  2024-12-18T00:52:51.1046700Z  2024-12-18T00:52:51.1047102Z  2024-12-18T00:52:51.1047486Z  2024-12-18T00:52:51.1047872Z  2024-12-18T00:52:51.1048249Z  2024-12-18T00:52:51.1048621Z  2024-12-18T00:52:51.1049518Z [16,973 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:51.1051115Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:52:51.1052144Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:52:51.1052941Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:51.1053802Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 11s local 2024-12-18T00:52:51.1054681Z Compiling xla/literal_comparison.cc; 11s local 2024-12-18T00:52:51.1055418Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local 2024-12-18T00:52:51.1056202Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2024-12-18T00:52:51.1057290Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 10s local ... 2024-12-18T00:52:51.3350213Z 2024-12-18T00:52:51.3351031Z  2024-12-18T00:52:51.3351464Z  2024-12-18T00:52:51.3351807Z  2024-12-18T00:52:51.3352178Z  2024-12-18T00:52:51.3352548Z  2024-12-18T00:52:51.3352887Z  2024-12-18T00:52:51.3353467Z  2024-12-18T00:52:51.3353820Z  2024-12-18T00:52:51.3354648Z [16,974 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:51.3355672Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:52:51.3356608Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:52:51.3357390Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:51.3358182Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local 2024-12-18T00:52:51.3358977Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:52:51.3359695Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 12s local 2024-12-18T00:52:51.3360394Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2024-12-18T00:52:51.3361240Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 10s local ... 2024-12-18T00:52:51.7050236Z 2024-12-18T00:52:51.7052794Z  2024-12-18T00:52:51.7058035Z  2024-12-18T00:52:51.7058478Z  2024-12-18T00:52:51.7058863Z  2024-12-18T00:52:51.7059270Z  2024-12-18T00:52:51.7059677Z  2024-12-18T00:52:51.7060081Z  2024-12-18T00:52:51.7060483Z  2024-12-18T00:52:51.7061448Z [16,976 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:51.7062679Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:52:51.7063768Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:52:51.7064666Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:52:51.7065526Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local 2024-12-18T00:52:51.7066419Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:52:51.7067166Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:52:51.7068130Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 11s local 2024-12-18T00:52:51.7069211Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local ... 2024-12-18T00:52:51.9286509Z 2024-12-18T00:52:51.9287441Z  2024-12-18T00:52:51.9287887Z  2024-12-18T00:52:51.9288279Z  2024-12-18T00:52:51.9288637Z  2024-12-18T00:52:51.9289022Z  2024-12-18T00:52:51.9289412Z  2024-12-18T00:52:51.9289775Z  2024-12-18T00:52:51.9290178Z  2024-12-18T00:52:51.9291084Z [16,977 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:51.9292249Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:52:51.9293320Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:52:51.9294365Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local 2024-12-18T00:52:51.9295310Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:52:51.9296547Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:52:51.9297543Z Compiling llvm/lib/CodeGen/TwoAddressInstructionPass.cpp; 11s local 2024-12-18T00:52:51.9298603Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2024-12-18T00:52:51.9299403Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:52.1345936Z 2024-12-18T00:52:52.1346720Z  2024-12-18T00:52:52.1347173Z  2024-12-18T00:52:52.1347547Z  2024-12-18T00:52:52.1347898Z  2024-12-18T00:52:52.1348275Z  2024-12-18T00:52:52.1348638Z  2024-12-18T00:52:52.1348999Z  2024-12-18T00:52:52.1349345Z  2024-12-18T00:52:52.1350240Z [16,981 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:52.1351328Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:52:52.1352214Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:52:52.1353394Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2024-12-18T00:52:52.1354277Z Compiling xla/literal_comparison.cc; 12s local 2024-12-18T00:52:52.1354973Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2024-12-18T00:52:52.1355974Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2024-12-18T00:52:52.1356698Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:52.1357501Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local ... 2024-12-18T00:52:52.5060271Z 2024-12-18T00:52:52.5061144Z  2024-12-18T00:52:52.5061629Z  2024-12-18T00:52:52.5062063Z  2024-12-18T00:52:52.5062458Z  2024-12-18T00:52:52.5062883Z  2024-12-18T00:52:52.5063289Z  2024-12-18T00:52:52.5063681Z  2024-12-18T00:52:52.5064078Z  2024-12-18T00:52:52.5065031Z [16,983 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:52.5066297Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:52:52.5067904Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2024-12-18T00:52:52.5068847Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:52:52.5069620Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:52:52.5070463Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:52.5071318Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:52:52.5072207Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:52:52.5073320Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 10s local ... 2024-12-18T00:52:52.7064813Z 2024-12-18T00:52:52.7065652Z  2024-12-18T00:52:52.7066148Z  2024-12-18T00:52:52.7066541Z  2024-12-18T00:52:52.7066937Z  2024-12-18T00:52:52.7067346Z  2024-12-18T00:52:52.7067739Z  2024-12-18T00:52:52.7068124Z  2024-12-18T00:52:52.7068491Z  2024-12-18T00:52:52.7069523Z [16,985 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:52.7070742Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:52:52.7071883Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2024-12-18T00:52:52.7072787Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:52:52.7073544Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:52:52.7074426Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:52.7075316Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:52.7076231Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local 2024-12-18T00:52:52.7077295Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 10s local ... 2024-12-18T00:52:52.9170550Z 2024-12-18T00:52:52.9171428Z  2024-12-18T00:52:52.9171912Z  2024-12-18T00:52:52.9172394Z  2024-12-18T00:52:52.9173097Z  2024-12-18T00:52:52.9173545Z  2024-12-18T00:52:52.9173995Z  2024-12-18T00:52:52.9174352Z  2024-12-18T00:52:52.9174748Z  2024-12-18T00:52:52.9175658Z [16,986 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:52.9176995Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:52:52.9178032Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2024-12-18T00:52:52.9179009Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:52:52.9179703Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:52:52.9180506Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:52.9181289Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:52.9182102Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:52:52.9183057Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local ... 2024-12-18T00:52:53.2013760Z 2024-12-18T00:52:53.2014640Z  2024-12-18T00:52:53.2015457Z  2024-12-18T00:52:53.2015879Z  2024-12-18T00:52:53.2016256Z  2024-12-18T00:52:53.2016787Z  2024-12-18T00:52:53.2017184Z  2024-12-18T00:52:53.2017584Z  2024-12-18T00:52:53.2017981Z  2024-12-18T00:52:53.2018951Z [16,989 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:53.2020148Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:52:53.2021264Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2024-12-18T00:52:53.2022288Z Compiling xla/literal_comparison.cc; 13s local 2024-12-18T00:52:53.2023008Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2024-12-18T00:52:53.2023755Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2024-12-18T00:52:53.2024554Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:53.2025641Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:52:53.2026801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local ... 2024-12-18T00:52:53.5068699Z 2024-12-18T00:52:53.5069536Z  2024-12-18T00:52:53.5070015Z  2024-12-18T00:52:53.5070413Z  2024-12-18T00:52:53.5070828Z  2024-12-18T00:52:53.5071232Z  2024-12-18T00:52:53.5071639Z  2024-12-18T00:52:53.5072022Z  2024-12-18T00:52:53.5072419Z  2024-12-18T00:52:53.5073390Z [16,989 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:53.5074736Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:52:53.5075856Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2024-12-18T00:52:53.5076762Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:52:53.5077484Z Compiling mlir/lib/IR/AsmPrinter.cpp; 14s local 2024-12-18T00:52:53.5078353Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:53.5079189Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:53.5080017Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:52:53.5080895Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local ... 2024-12-18T00:52:53.7071187Z 2024-12-18T00:52:53.7072103Z  2024-12-18T00:52:53.7072607Z  2024-12-18T00:52:53.7072984Z  2024-12-18T00:52:53.7073377Z  2024-12-18T00:52:53.7073774Z  2024-12-18T00:52:53.7074182Z  2024-12-18T00:52:53.7074569Z  2024-12-18T00:52:53.7074945Z  2024-12-18T00:52:53.7075878Z [16,994 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:53.7077027Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:52:53.7078125Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2024-12-18T00:52:53.7079448Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:52:53.7080343Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:53.7081237Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:53.7082142Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2024-12-18T00:52:53.7083160Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local 2024-12-18T00:52:53.7083994Z @llvm-project//llvm:Scalar; 11s local ... 2024-12-18T00:52:53.9436257Z 2024-12-18T00:52:53.9437213Z  2024-12-18T00:52:53.9437663Z  2024-12-18T00:52:53.9438086Z  2024-12-18T00:52:53.9438479Z  2024-12-18T00:52:53.9438863Z  2024-12-18T00:52:53.9439256Z  2024-12-18T00:52:53.9439604Z  2024-12-18T00:52:53.9439984Z  2024-12-18T00:52:53.9440919Z [16,997 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:53.9442137Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:52:53.9443586Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2024-12-18T00:52:53.9444760Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:52:53.9445639Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:53.9446540Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:53.9447415Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:52:53.9448466Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:52:53.9449324Z @llvm-project//llvm:Scalar; 11s local ... 2024-12-18T00:52:54.1889574Z 2024-12-18T00:52:54.1890466Z  2024-12-18T00:52:54.1890906Z  2024-12-18T00:52:54.1891272Z  2024-12-18T00:52:54.1891629Z  2024-12-18T00:52:54.1891956Z  2024-12-18T00:52:54.1892303Z  2024-12-18T00:52:54.1892658Z  2024-12-18T00:52:54.1893006Z  2024-12-18T00:52:54.1894076Z [17,000 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:54.1895158Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:52:54.1896128Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:52:54.1897035Z Compiling xla/literal_comparison.cc; 14s local 2024-12-18T00:52:54.1897776Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2024-12-18T00:52:54.1898510Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:54.1899254Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:52:54.1900112Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:52:54.1900809Z @llvm-project//llvm:Scalar; 12s local ... 2024-12-18T00:52:54.4312390Z 2024-12-18T00:52:54.4313208Z  2024-12-18T00:52:54.4313628Z  2024-12-18T00:52:54.4313985Z  2024-12-18T00:52:54.4314350Z  2024-12-18T00:52:54.4314707Z  2024-12-18T00:52:54.4315057Z  2024-12-18T00:52:54.4315432Z  2024-12-18T00:52:54.4315769Z  2024-12-18T00:52:54.4316591Z [17,002 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:54.4317643Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:52:54.4318579Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:52:54.4319379Z Compiling xla/literal_comparison.cc; 15s local 2024-12-18T00:52:54.4320103Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:52:54.4320940Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:52:54.4321771Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:52:54.4322682Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 12s local 2024-12-18T00:52:54.4323537Z @llvm-project//llvm:Instrumentation; 10s local ... 2024-12-18T00:52:54.7080624Z 2024-12-18T00:52:54.7081634Z  2024-12-18T00:52:54.7082142Z  2024-12-18T00:52:54.7082588Z  2024-12-18T00:52:54.7083013Z  2024-12-18T00:52:54.7083416Z  2024-12-18T00:52:54.7083776Z  2024-12-18T00:52:54.7084141Z  2024-12-18T00:52:54.7084529Z  2024-12-18T00:52:54.7085466Z [17,003 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:54.7086569Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:52:54.7087701Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:52:54.7088629Z Compiling xla/literal_comparison.cc; 15s local 2024-12-18T00:52:54.7089489Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:52:54.7090435Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2024-12-18T00:52:54.7091385Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2024-12-18T00:52:54.7092816Z Compiling llvm/lib/Transforms/Scalar/DeadStoreElimination.cpp; 12s local 2024-12-18T00:52:54.7093904Z @llvm-project//llvm:Instrumentation; 11s local ... 2024-12-18T00:52:54.9083297Z 2024-12-18T00:52:54.9084612Z  2024-12-18T00:52:54.9085119Z  2024-12-18T00:52:54.9085570Z  2024-12-18T00:52:54.9085965Z  2024-12-18T00:52:54.9086367Z  2024-12-18T00:52:54.9086777Z  2024-12-18T00:52:54.9087196Z  2024-12-18T00:52:54.9087591Z  2024-12-18T00:52:54.9088592Z [17,005 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:54.9089901Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:52:54.9091108Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2024-12-18T00:52:54.9092115Z Compiling xla/literal_comparison.cc; 15s local 2024-12-18T00:52:54.9093027Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2024-12-18T00:52:54.9094367Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:52:54.9095495Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2024-12-18T00:52:54.9096376Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:54.9097349Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local ... 2024-12-18T00:52:55.4169263Z 2024-12-18T00:52:55.4170163Z  2024-12-18T00:52:55.4170654Z  2024-12-18T00:52:55.4171063Z  2024-12-18T00:52:55.4171458Z  2024-12-18T00:52:55.4171857Z  2024-12-18T00:52:55.4172234Z  2024-12-18T00:52:55.4172645Z  2024-12-18T00:52:55.4173056Z  2024-12-18T00:52:55.4173941Z [17,006 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:55.4175123Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:52:55.4176242Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2024-12-18T00:52:55.4177393Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:52:55.4178237Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:55.4179203Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:52:55.4180186Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2024-12-18T00:52:55.4181138Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:52:55.4181900Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local ... 2024-12-18T00:52:55.6665164Z 2024-12-18T00:52:55.6666160Z  2024-12-18T00:52:55.6666650Z  2024-12-18T00:52:55.6667043Z  2024-12-18T00:52:55.6667419Z  2024-12-18T00:52:55.6667803Z  2024-12-18T00:52:55.6668240Z  2024-12-18T00:52:55.6668613Z  2024-12-18T00:52:55.6668995Z  2024-12-18T00:52:55.6669932Z [17,007 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:55.6671469Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:52:55.6672782Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2024-12-18T00:52:55.6673754Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:52:55.6674588Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:55.6675576Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2024-12-18T00:52:55.6676544Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2024-12-18T00:52:55.6677364Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:55.6678193Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local ... 2024-12-18T00:52:55.9092589Z 2024-12-18T00:52:55.9093876Z  2024-12-18T00:52:55.9094363Z  2024-12-18T00:52:55.9094786Z  2024-12-18T00:52:55.9095199Z  2024-12-18T00:52:55.9095582Z  2024-12-18T00:52:55.9095953Z  2024-12-18T00:52:55.9096555Z  2024-12-18T00:52:55.9096969Z  2024-12-18T00:52:55.9098189Z [17,007 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:55.9099461Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:52:55.9100635Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2024-12-18T00:52:55.9101586Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:52:55.9102442Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:55.9103443Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:52:55.9104495Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2024-12-18T00:52:55.9105328Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:55.9106124Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local ... 2024-12-18T00:52:56.2194147Z 2024-12-18T00:52:56.2195100Z  2024-12-18T00:52:56.2195686Z  2024-12-18T00:52:56.2196071Z  2024-12-18T00:52:56.2196883Z  2024-12-18T00:52:56.2197275Z  2024-12-18T00:52:56.2197657Z  2024-12-18T00:52:56.2198040Z  2024-12-18T00:52:56.2198403Z  2024-12-18T00:52:56.2199339Z [17,009 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:56.2200480Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:52:56.2201584Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:52:56.2202426Z Compiling xla/literal_comparison.cc; 16s local 2024-12-18T00:52:56.2203239Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2024-12-18T00:52:56.2204185Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:52:56.2205194Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2024-12-18T00:52:56.2205984Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:52:56.2206809Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local ... 2024-12-18T00:52:56.5099744Z 2024-12-18T00:52:56.5100669Z  2024-12-18T00:52:56.5101159Z  2024-12-18T00:52:56.5101555Z  2024-12-18T00:52:56.5101939Z  2024-12-18T00:52:56.5102325Z  2024-12-18T00:52:56.5102712Z  2024-12-18T00:52:56.5103082Z  2024-12-18T00:52:56.5103485Z  2024-12-18T00:52:56.5104441Z [17,011 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:56.5105606Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:52:56.5106713Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:52:56.5107606Z Compiling xla/literal_comparison.cc; 17s local 2024-12-18T00:52:56.5108560Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:52:56.5109599Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:52:56.5110964Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2024-12-18T00:52:56.5111872Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:56.5112684Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local ... 2024-12-18T00:52:56.7102657Z 2024-12-18T00:52:56.7103996Z  2024-12-18T00:52:56.7104490Z  2024-12-18T00:52:56.7104884Z  2024-12-18T00:52:56.7105300Z  2024-12-18T00:52:56.7105765Z  2024-12-18T00:52:56.7106116Z  2024-12-18T00:52:56.7106485Z  2024-12-18T00:52:56.7106861Z  2024-12-18T00:52:56.7107811Z [17,014 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:56.7108965Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:52:56.7110097Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:52:56.7111027Z Compiling xla/literal_comparison.cc; 17s local 2024-12-18T00:52:56.7112175Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:52:56.7113179Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2024-12-18T00:52:56.7114119Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2024-12-18T00:52:56.7114953Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:56.7115805Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local ... 2024-12-18T00:52:57.1107782Z 2024-12-18T00:52:57.1109059Z  2024-12-18T00:52:57.1109591Z  2024-12-18T00:52:57.1109996Z  2024-12-18T00:52:57.1110409Z  2024-12-18T00:52:57.1110795Z  2024-12-18T00:52:57.1111187Z  2024-12-18T00:52:57.1111597Z  2024-12-18T00:52:57.1111990Z  2024-12-18T00:52:57.1112963Z [17,015 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:57.1114109Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:52:57.1115499Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2024-12-18T00:52:57.1116466Z Compiling xla/literal_comparison.cc; 17s local 2024-12-18T00:52:57.1117370Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2024-12-18T00:52:57.1118275Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2024-12-18T00:52:57.1119144Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:52:57.1119944Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:52:57.1120831Z @llvm-project//mlir:ControlFlowDialect; 11s local ... 2024-12-18T00:52:57.3112434Z 2024-12-18T00:52:57.3113330Z  2024-12-18T00:52:57.3113837Z  2024-12-18T00:52:57.3114227Z  2024-12-18T00:52:57.3114634Z  2024-12-18T00:52:57.3115037Z  2024-12-18T00:52:57.3115437Z  2024-12-18T00:52:57.3115817Z  2024-12-18T00:52:57.3116150Z  2024-12-18T00:52:57.3117062Z [17,016 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:57.3118312Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:52:57.3119409Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:52:57.3120298Z Compiling xla/literal_comparison.cc; 18s local 2024-12-18T00:52:57.3121237Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:57.3122150Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2024-12-18T00:52:57.3123024Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2024-12-18T00:52:57.3124071Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 11s local 2024-12-18T00:52:57.3125069Z @llvm-project//mlir:X86VectorDialect; 11s local ... 2024-12-18T00:52:57.6259445Z 2024-12-18T00:52:57.6260635Z  2024-12-18T00:52:57.6261128Z  2024-12-18T00:52:57.6261523Z  2024-12-18T00:52:57.6261947Z  2024-12-18T00:52:57.6262722Z  2024-12-18T00:52:57.6263133Z  2024-12-18T00:52:57.6263550Z  2024-12-18T00:52:57.6263987Z  2024-12-18T00:52:57.6264966Z [17,017 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:57.6266232Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:52:57.6267436Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:52:57.6268558Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:57.6269533Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2024-12-18T00:52:57.6270504Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:52:57.6271559Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2024-12-18T00:52:57.6272873Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 11s local 2024-12-18T00:52:57.6274163Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local ... 2024-12-18T00:52:57.8511478Z 2024-12-18T00:52:57.8512609Z  2024-12-18T00:52:57.8513089Z  2024-12-18T00:52:57.8513524Z  2024-12-18T00:52:57.8513925Z  2024-12-18T00:52:57.8514326Z  2024-12-18T00:52:57.8514727Z  2024-12-18T00:52:57.8515116Z  2024-12-18T00:52:57.8515494Z  2024-12-18T00:52:57.8516418Z [17,019 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:57.8517646Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:52:57.8518758Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:52:57.8519925Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:57.8520947Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2024-12-18T00:52:57.8521921Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:52:57.8523005Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2024-12-18T00:52:57.8524562Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 11s local 2024-12-18T00:52:57.8525712Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local ... 2024-12-18T00:52:58.0596084Z 2024-12-18T00:52:58.0596993Z  2024-12-18T00:52:58.0597475Z  2024-12-18T00:52:58.0597869Z  2024-12-18T00:52:58.0598251Z  2024-12-18T00:52:58.0598642Z  2024-12-18T00:52:58.0599020Z  2024-12-18T00:52:58.0599450Z  2024-12-18T00:52:58.0599862Z  2024-12-18T00:52:58.0600699Z [17,023 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:58.0601772Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:52:58.0602748Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2024-12-18T00:52:58.0603821Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2024-12-18T00:52:58.0604843Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2024-12-18T00:52:58.0605735Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:52:58.0606747Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2024-12-18T00:52:58.0607842Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:58.0608893Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local ... 2024-12-18T00:52:58.3121169Z 2024-12-18T00:52:58.3122047Z  2024-12-18T00:52:58.3122520Z  2024-12-18T00:52:58.3122950Z  2024-12-18T00:52:58.3123365Z  2024-12-18T00:52:58.3123798Z  2024-12-18T00:52:58.3124229Z  2024-12-18T00:52:58.3124640Z  2024-12-18T00:52:58.3125059Z  2024-12-18T00:52:58.3126058Z [17,024 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:58.3127311Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:52:58.3128800Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2024-12-18T00:52:58.3129871Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:58.3130875Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2024-12-18T00:52:58.3131835Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2024-12-18T00:52:58.3132901Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2024-12-18T00:52:58.3134134Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:58.3135324Z Compiling llvm/lib/Transforms/Coroutines/CoroFrame.cpp; 11s local ... 2024-12-18T00:52:58.6183783Z 2024-12-18T00:52:58.6184658Z  2024-12-18T00:52:58.6185160Z  2024-12-18T00:52:58.6185618Z  2024-12-18T00:52:58.6186029Z  2024-12-18T00:52:58.6186430Z  2024-12-18T00:52:58.6186757Z  2024-12-18T00:52:58.6187089Z  2024-12-18T00:52:58.6187515Z  2024-12-18T00:52:58.6188619Z [17,025 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:58.6189800Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:52:58.6190887Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2024-12-18T00:52:58.6191841Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:58.6192750Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2024-12-18T00:52:58.6193652Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:52:58.6194662Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2024-12-18T00:52:58.6195827Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:58.6196789Z @llvm-project//mlir:X86VectorDialect; 12s local ... 2024-12-18T00:52:58.9000302Z 2024-12-18T00:52:58.9001173Z  2024-12-18T00:52:58.9001683Z  2024-12-18T00:52:58.9002098Z  2024-12-18T00:52:58.9002884Z  2024-12-18T00:52:58.9003248Z  2024-12-18T00:52:58.9003657Z  2024-12-18T00:52:58.9004052Z  2024-12-18T00:52:58.9004434Z  2024-12-18T00:52:58.9005348Z [17,027 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:58.9006523Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:52:58.9007592Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2024-12-18T00:52:58.9008572Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:58.9009473Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:52:58.9010494Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2024-12-18T00:52:58.9011710Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:58.9012937Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:58.9014156Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:52:59.1128265Z 2024-12-18T00:52:59.1129198Z  2024-12-18T00:52:59.1129682Z  2024-12-18T00:52:59.1130077Z  2024-12-18T00:52:59.1130465Z  2024-12-18T00:52:59.1130868Z  2024-12-18T00:52:59.1131250Z  2024-12-18T00:52:59.1131668Z  2024-12-18T00:52:59.1132066Z  2024-12-18T00:52:59.1133032Z [17,028 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:59.1134137Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:52:59.1135140Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2024-12-18T00:52:59.1136161Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2024-12-18T00:52:59.1137173Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:52:59.1138509Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2024-12-18T00:52:59.1139699Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 13s local 2024-12-18T00:52:59.1140866Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:59.1141947Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local ... 2024-12-18T00:52:59.3132459Z 2024-12-18T00:52:59.3133384Z  2024-12-18T00:52:59.3133965Z  2024-12-18T00:52:59.3134449Z  2024-12-18T00:52:59.3134855Z  2024-12-18T00:52:59.3135311Z  2024-12-18T00:52:59.3135730Z  2024-12-18T00:52:59.3136213Z  2024-12-18T00:52:59.3136711Z  2024-12-18T00:52:59.3137607Z [17,029 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:52:59.3138691Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:52:59.3139778Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:52:59.3141046Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:52:59.3141959Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2024-12-18T00:52:59.3142949Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 13s local 2024-12-18T00:52:59.3144116Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:59.3145468Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local 2024-12-18T00:52:59.3146456Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local ... 2024-12-18T00:52:59.5199043Z 2024-12-18T00:52:59.5199935Z  2024-12-18T00:52:59.5200402Z  2024-12-18T00:52:59.5200792Z  2024-12-18T00:52:59.5201184Z  2024-12-18T00:52:59.5201600Z  2024-12-18T00:52:59.5201985Z  2024-12-18T00:52:59.5202387Z  2024-12-18T00:52:59.5202792Z  2024-12-18T00:52:59.5203713Z [17,032 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:59.5207232Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:52:59.5208634Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:52:59.5209646Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:52:59.5210508Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:52:59.5211557Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2024-12-18T00:52:59.5212695Z Compiling llvm/lib/Transforms/Coroutines/CoroSplit.cpp; 11s local 2024-12-18T00:52:59.5213647Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 11s local 2024-12-18T00:52:59.5214755Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local ... 2024-12-18T00:52:59.8677673Z 2024-12-18T00:52:59.8678592Z  2024-12-18T00:52:59.8679130Z  2024-12-18T00:52:59.8679582Z  2024-12-18T00:52:59.8679984Z  2024-12-18T00:52:59.8680347Z  2024-12-18T00:52:59.8680741Z  2024-12-18T00:52:59.8681163Z  2024-12-18T00:52:59.8681528Z  2024-12-18T00:52:59.8682404Z [17,034 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:52:59.8683505Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:52:59.8684577Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:52:59.8685487Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:52:59.8686374Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:52:59.8687326Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 13s local 2024-12-18T00:52:59.8688327Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 11s local 2024-12-18T00:52:59.8689062Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:52:59.8689856Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 9s local ... 2024-12-18T00:53:00.1140032Z 2024-12-18T00:53:00.1140997Z  2024-12-18T00:53:00.1141473Z  2024-12-18T00:53:00.1141883Z  2024-12-18T00:53:00.1142301Z  2024-12-18T00:53:00.1142704Z  2024-12-18T00:53:00.1143131Z  2024-12-18T00:53:00.1143524Z  2024-12-18T00:53:00.1143931Z  2024-12-18T00:53:00.1145104Z [17,037 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:00.1146358Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:53:00.1147404Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2024-12-18T00:53:00.1148347Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2024-12-18T00:53:00.1149193Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:53:00.1150099Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:53:00.1151073Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2024-12-18T00:53:00.1154304Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:53:00.1155453Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 8s local ... 2024-12-18T00:53:00.3144865Z 2024-12-18T00:53:00.3145784Z  2024-12-18T00:53:00.3146267Z  2024-12-18T00:53:00.3146625Z  2024-12-18T00:53:00.3147039Z  2024-12-18T00:53:00.3147438Z  2024-12-18T00:53:00.3147827Z  2024-12-18T00:53:00.3148233Z  2024-12-18T00:53:00.3148599Z  2024-12-18T00:53:00.3149509Z [17,038 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:00.3150583Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 75s local 2024-12-18T00:53:00.3151867Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 21s local 2024-12-18T00:53:00.3152792Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:53:00.3153570Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2024-12-18T00:53:00.3154788Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2024-12-18T00:53:00.3158147Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2024-12-18T00:53:00.3158986Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:53:00.3159822Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 8s local ... 2024-12-18T00:53:00.7838794Z 2024-12-18T00:53:00.7839734Z  2024-12-18T00:53:00.7840197Z  2024-12-18T00:53:00.7840603Z  2024-12-18T00:53:00.7840963Z  2024-12-18T00:53:00.7841343Z  2024-12-18T00:53:00.7841734Z  2024-12-18T00:53:00.7842113Z  2024-12-18T00:53:00.7842504Z  2024-12-18T00:53:00.7843439Z [17,039 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:00.7844839Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 75s local 2024-12-18T00:53:00.7845862Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:53:00.7846796Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:53:00.7847698Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:53:00.7848843Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2024-12-18T00:53:00.7849686Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:00.7850547Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 9s local 2024-12-18T00:53:00.7851414Z @llvm-project//llvm:Instrumentation; 8s local ... 2024-12-18T00:53:01.1151064Z 2024-12-18T00:53:01.1151917Z  2024-12-18T00:53:01.1162296Z  2024-12-18T00:53:01.1163078Z  2024-12-18T00:53:01.1163454Z  2024-12-18T00:53:01.1163853Z  2024-12-18T00:53:01.1164219Z  2024-12-18T00:53:01.1164582Z  2024-12-18T00:53:01.1164974Z  2024-12-18T00:53:01.1165851Z [17,039 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:01.1167254Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 75s local 2024-12-18T00:53:01.1168236Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2024-12-18T00:53:01.1169069Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2024-12-18T00:53:01.1169933Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2024-12-18T00:53:01.1170823Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2024-12-18T00:53:01.1171625Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:01.1172407Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 9s local 2024-12-18T00:53:01.1173224Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:53:01.5155929Z 2024-12-18T00:53:01.5156749Z  2024-12-18T00:53:01.5157221Z  2024-12-18T00:53:01.5157618Z  2024-12-18T00:53:01.5158003Z  2024-12-18T00:53:01.5158374Z  2024-12-18T00:53:01.5158778Z  2024-12-18T00:53:01.5159224Z  2024-12-18T00:53:01.5159610Z  2024-12-18T00:53:01.5160827Z [17,040 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:01.5161944Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:53:01.5162797Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:53:01.5163764Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:53:01.5164754Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2024-12-18T00:53:01.5165525Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:01.5166277Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 10s local 2024-12-18T00:53:01.5167077Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:53:01.5167869Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 9s local ... 2024-12-18T00:53:01.7159576Z 2024-12-18T00:53:01.7160438Z  2024-12-18T00:53:01.7160861Z  2024-12-18T00:53:01.7161243Z  2024-12-18T00:53:01.7161584Z  2024-12-18T00:53:01.7162281Z  2024-12-18T00:53:01.7162609Z  2024-12-18T00:53:01.7162946Z  2024-12-18T00:53:01.7163282Z  2024-12-18T00:53:01.7164100Z [17,041 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:01.7165028Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:53:01.7165774Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:53:01.7166542Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:53:01.7167323Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2024-12-18T00:53:01.7168434Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:01.7169130Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 10s local 2024-12-18T00:53:01.7169953Z @llvm-project//llvm:Instrumentation; 9s local 2024-12-18T00:53:01.7170762Z Compiling llvm/lib/Transforms/Scalar/EarlyCSE.cpp; 9s local ... 2024-12-18T00:53:02.0249035Z 2024-12-18T00:53:02.0250031Z  2024-12-18T00:53:02.0251315Z  2024-12-18T00:53:02.0252100Z  2024-12-18T00:53:02.0252877Z  2024-12-18T00:53:02.0253297Z  2024-12-18T00:53:02.0253671Z  2024-12-18T00:53:02.0254079Z  2024-12-18T00:53:02.0254475Z  2024-12-18T00:53:02.0255429Z [17,043 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:02.0256719Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:53:02.0257620Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:53:02.0258586Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:53:02.0259560Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2024-12-18T00:53:02.0260426Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:02.0261270Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 10s local 2024-12-18T00:53:02.0262422Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:02.0263225Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local ... 2024-12-18T00:53:02.2657794Z 2024-12-18T00:53:02.2660264Z  2024-12-18T00:53:02.2660904Z  2024-12-18T00:53:02.2662686Z  2024-12-18T00:53:02.2663226Z  2024-12-18T00:53:02.2664977Z  2024-12-18T00:53:02.2665531Z  2024-12-18T00:53:02.2667260Z  2024-12-18T00:53:02.2667815Z  2024-12-18T00:53:02.2670074Z [17,045 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:02.2671359Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2024-12-18T00:53:02.2673650Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2024-12-18T00:53:02.2674753Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2024-12-18T00:53:02.2677102Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2024-12-18T00:53:02.2680293Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:02.2682872Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 10s local 2024-12-18T00:53:02.2683855Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:02.2686075Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local ... 2024-12-18T00:53:02.5169873Z 2024-12-18T00:53:02.5170726Z  2024-12-18T00:53:02.5171197Z  2024-12-18T00:53:02.5171617Z  2024-12-18T00:53:02.5172045Z  2024-12-18T00:53:02.5172435Z  2024-12-18T00:53:02.5172809Z  2024-12-18T00:53:02.5173150Z  2024-12-18T00:53:02.5173517Z  2024-12-18T00:53:02.5174453Z [17,045 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:02.5175544Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:53:02.5176566Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:53:02.5177457Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 14s local 2024-12-18T00:53:02.5178848Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2024-12-18T00:53:02.5179714Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:53:02.5180533Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local 2024-12-18T00:53:02.5181338Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:02.5182113Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local ... 2024-12-18T00:53:02.7173742Z 2024-12-18T00:53:02.7174712Z  2024-12-18T00:53:02.7175207Z  2024-12-18T00:53:02.7175619Z  2024-12-18T00:53:02.7176005Z  2024-12-18T00:53:02.7176549Z  2024-12-18T00:53:02.7176960Z  2024-12-18T00:53:02.7177356Z  2024-12-18T00:53:02.7177738Z  2024-12-18T00:53:02.7178682Z [17,047 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:02.7179753Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:53:02.7180802Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:53:02.7181740Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 14s local 2024-12-18T00:53:02.7182733Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2024-12-18T00:53:02.7183561Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:53:02.7184401Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local 2024-12-18T00:53:02.7185237Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:02.7186020Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local ... 2024-12-18T00:53:03.0385361Z 2024-12-18T00:53:03.0386264Z  2024-12-18T00:53:03.0386760Z  2024-12-18T00:53:03.0387139Z  2024-12-18T00:53:03.0387553Z  2024-12-18T00:53:03.0387941Z  2024-12-18T00:53:03.0388352Z  2024-12-18T00:53:03.0388738Z  2024-12-18T00:53:03.0389128Z  2024-12-18T00:53:03.0390108Z [17,049 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:03.0392031Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2024-12-18T00:53:03.0392903Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:53:03.0393812Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 14s local 2024-12-18T00:53:03.0394778Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2024-12-18T00:53:03.0395603Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:53:03.0396415Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local 2024-12-18T00:53:03.0397285Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:03.0398069Z Compiling xla/hlo/ir/hlo_module_group.cc; 9s local ... 2024-12-18T00:53:03.3131458Z 2024-12-18T00:53:03.3132315Z  2024-12-18T00:53:03.3132817Z  2024-12-18T00:53:03.3133184Z  2024-12-18T00:53:03.3133547Z  2024-12-18T00:53:03.3133987Z  2024-12-18T00:53:03.3134378Z  2024-12-18T00:53:03.3134784Z  2024-12-18T00:53:03.3135476Z  2024-12-18T00:53:03.3136565Z [17,052 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:03.3137631Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2024-12-18T00:53:03.3138475Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2024-12-18T00:53:03.3139292Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:53:03.3140136Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local 2024-12-18T00:53:03.3140908Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:03.3141674Z Compiling xla/hlo/ir/hlo_module_group.cc; 9s local 2024-12-18T00:53:03.3142534Z @xla//xla/hlo/transforms:conditional_canonicalizer; 9s local 2024-12-18T00:53:03.3143502Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local ... 2024-12-18T00:53:03.5181303Z 2024-12-18T00:53:03.5182244Z  2024-12-18T00:53:03.5182756Z  2024-12-18T00:53:03.5183159Z  2024-12-18T00:53:03.5184076Z  2024-12-18T00:53:03.5184511Z  2024-12-18T00:53:03.5184904Z  2024-12-18T00:53:03.5185281Z  2024-12-18T00:53:03.5185655Z  2024-12-18T00:53:03.5186609Z [17,053 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:03.5187726Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:53:03.5188671Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2024-12-18T00:53:03.5189421Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:53:03.5190276Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local 2024-12-18T00:53:03.5191159Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:03.5191904Z Compiling xla/hlo/ir/hlo_module_group.cc; 9s local 2024-12-18T00:53:03.5192794Z @xla//xla/hlo/transforms:conditional_canonicalizer; 9s local 2024-12-18T00:53:03.5193908Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local ... 2024-12-18T00:53:03.8301595Z 2024-12-18T00:53:03.8302427Z  2024-12-18T00:53:03.8302914Z  2024-12-18T00:53:03.8303330Z  2024-12-18T00:53:03.8303718Z  2024-12-18T00:53:03.8304109Z  2024-12-18T00:53:03.8304502Z  2024-12-18T00:53:03.8304960Z  2024-12-18T00:53:03.8305336Z  2024-12-18T00:53:03.8306235Z [17,054 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:03.8307266Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:53:03.8308116Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2024-12-18T00:53:03.8308963Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:53:03.8309794Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local 2024-12-18T00:53:03.8310664Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:03.8311767Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2024-12-18T00:53:03.8312647Z @xla//xla/hlo/transforms:conditional_canonicalizer; 10s local 2024-12-18T00:53:03.8313620Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 9s local ... 2024-12-18T00:53:04.0364349Z 2024-12-18T00:53:04.0365247Z  2024-12-18T00:53:04.0365729Z  2024-12-18T00:53:04.0366109Z  2024-12-18T00:53:04.0366448Z  2024-12-18T00:53:04.0366816Z  2024-12-18T00:53:04.0367206Z  2024-12-18T00:53:04.0367606Z  2024-12-18T00:53:04.0367986Z  2024-12-18T00:53:04.0368889Z [17,055 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:04.0369910Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:53:04.0370795Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2024-12-18T00:53:04.0371560Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:53:04.0372304Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local 2024-12-18T00:53:04.0373599Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:53:04.0374413Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2024-12-18T00:53:04.0375310Z @xla//xla/hlo/transforms:conditional_canonicalizer; 10s local 2024-12-18T00:53:04.0376356Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 10s local ... 2024-12-18T00:53:04.3188575Z 2024-12-18T00:53:04.3189462Z  2024-12-18T00:53:04.3189987Z  2024-12-18T00:53:04.3190398Z  2024-12-18T00:53:04.3190781Z  2024-12-18T00:53:04.3191159Z  2024-12-18T00:53:04.3191546Z  2024-12-18T00:53:04.3191945Z  2024-12-18T00:53:04.3192334Z  2024-12-18T00:53:04.3193250Z [17,056 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:04.3194299Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2024-12-18T00:53:04.3195182Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2024-12-18T00:53:04.3196404Z @llvm-project//llvm:Instrumentation; 13s local 2024-12-18T00:53:04.3197383Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local 2024-12-18T00:53:04.3198214Z @llvm-project//llvm:Instrumentation; 12s local 2024-12-18T00:53:04.3198966Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2024-12-18T00:53:04.3199809Z @xla//xla/hlo/transforms:conditional_canonicalizer; 10s local 2024-12-18T00:53:04.3200800Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 10s local ... 2024-12-18T00:53:04.5856527Z 2024-12-18T00:53:04.5857378Z  2024-12-18T00:53:04.5857859Z  2024-12-18T00:53:04.5858293Z  2024-12-18T00:53:04.5858663Z  2024-12-18T00:53:04.5859044Z  2024-12-18T00:53:04.5859439Z  2024-12-18T00:53:04.5859829Z  2024-12-18T00:53:04.5860217Z  2024-12-18T00:53:04.5861181Z [17,058 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:04.5862432Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:53:04.5863334Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2024-12-18T00:53:04.5864136Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:53:04.5864950Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:53:04.5865783Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2024-12-18T00:53:04.5866636Z @xla//xla/hlo/transforms:conditional_canonicalizer; 10s local 2024-12-18T00:53:04.5867593Z Compiling llvm/lib/Passes/PassBuilderBindings.cpp; 10s local 2024-12-18T00:53:04.5868488Z Compiling xla/service/shape_inference.cc; 10s local ... 2024-12-18T00:53:04.9194917Z 2024-12-18T00:53:04.9195740Z  2024-12-18T00:53:04.9196171Z  2024-12-18T00:53:04.9196533Z  2024-12-18T00:53:04.9196886Z  2024-12-18T00:53:04.9197235Z  2024-12-18T00:53:04.9197604Z  2024-12-18T00:53:04.9197994Z  2024-12-18T00:53:04.9198630Z  2024-12-18T00:53:04.9199467Z [17,059 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:04.9200481Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:53:04.9201326Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2024-12-18T00:53:04.9202068Z @llvm-project//llvm:Instrumentation; 14s local 2024-12-18T00:53:04.9202826Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:53:04.9203663Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2024-12-18T00:53:04.9204426Z @xla//xla/hlo/transforms:conditional_canonicalizer; 11s local 2024-12-18T00:53:04.9205269Z Compiling xla/service/shape_inference.cc; 10s local 2024-12-18T00:53:04.9206185Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local ... 2024-12-18T00:53:05.1378120Z 2024-12-18T00:53:05.1378943Z  2024-12-18T00:53:05.1379314Z  2024-12-18T00:53:05.1379643Z  2024-12-18T00:53:05.1380013Z  2024-12-18T00:53:05.1380372Z  2024-12-18T00:53:05.1380967Z  2024-12-18T00:53:05.1381326Z  2024-12-18T00:53:05.1381672Z  2024-12-18T00:53:05.1382557Z [17,065 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:05.1383415Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2024-12-18T00:53:05.1384131Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2024-12-18T00:53:05.1384854Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:53:05.1385536Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:53:05.1386298Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2024-12-18T00:53:05.1387036Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:05.1387739Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 10s local 2024-12-18T00:53:05.1388476Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 10s local ... 2024-12-18T00:53:05.3842235Z 2024-12-18T00:53:05.3843534Z  2024-12-18T00:53:05.3844019Z  2024-12-18T00:53:05.3844655Z  2024-12-18T00:53:05.3845046Z  2024-12-18T00:53:05.3845419Z  2024-12-18T00:53:05.3845792Z  2024-12-18T00:53:05.3846182Z  2024-12-18T00:53:05.3846542Z  2024-12-18T00:53:05.3847399Z [17,068 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:05.3848526Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:53:05.3849446Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2024-12-18T00:53:05.3850444Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local 2024-12-18T00:53:05.3851290Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:53:05.3852182Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2024-12-18T00:53:05.3853326Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 10s local 2024-12-18T00:53:05.3854303Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 10s local 2024-12-18T00:53:05.3855223Z Compiling llvm/lib/Transforms/Scalar/GVNHoist.cpp; 8s local ... 2024-12-18T00:53:05.7202328Z 2024-12-18T00:53:05.7203235Z  2024-12-18T00:53:05.7203702Z  2024-12-18T00:53:05.7204082Z  2024-12-18T00:53:05.7204473Z  2024-12-18T00:53:05.7204856Z  2024-12-18T00:53:05.7205161Z  2024-12-18T00:53:05.7205513Z  2024-12-18T00:53:05.7205911Z  2024-12-18T00:53:05.7206847Z [17,069 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:05.7207825Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:53:05.7208673Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2024-12-18T00:53:05.7209571Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local 2024-12-18T00:53:05.7210405Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:53:05.7211707Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2024-12-18T00:53:05.7212777Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 11s local 2024-12-18T00:53:05.7213703Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 10s local 2024-12-18T00:53:05.7214654Z Compiling llvm/lib/Transforms/Scalar/GVNHoist.cpp; 9s local ... 2024-12-18T00:53:05.9206686Z 2024-12-18T00:53:05.9207524Z  2024-12-18T00:53:05.9207987Z  2024-12-18T00:53:05.9208398Z  2024-12-18T00:53:05.9208799Z  2024-12-18T00:53:05.9209196Z  2024-12-18T00:53:05.9209572Z  2024-12-18T00:53:05.9209958Z  2024-12-18T00:53:05.9210341Z  2024-12-18T00:53:05.9211302Z [17,070 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:05.9212342Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:53:05.9213229Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2024-12-18T00:53:05.9214499Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local 2024-12-18T00:53:05.9215387Z Compiling xla/service/shape_inference.cc; 11s local 2024-12-18T00:53:05.9216325Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2024-12-18T00:53:05.9217529Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 11s local 2024-12-18T00:53:05.9218458Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:53:05.9219345Z Compiling llvm/lib/Transforms/Scalar/GVNHoist.cpp; 9s local ... 2024-12-18T00:53:06.1443155Z 2024-12-18T00:53:06.1444032Z  2024-12-18T00:53:06.1444886Z  2024-12-18T00:53:06.1445274Z  2024-12-18T00:53:06.1445614Z  2024-12-18T00:53:06.1445984Z  2024-12-18T00:53:06.1446336Z  2024-12-18T00:53:06.1446731Z  2024-12-18T00:53:06.1447090Z  2024-12-18T00:53:06.1447992Z [17,071 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:06.1449221Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2024-12-18T00:53:06.1450168Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2024-12-18T00:53:06.1451032Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local 2024-12-18T00:53:06.1451790Z Compiling xla/service/shape_inference.cc; 12s local 2024-12-18T00:53:06.1452673Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2024-12-18T00:53:06.1453660Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 11s local 2024-12-18T00:53:06.1454499Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:53:06.1455355Z Compiling llvm/lib/Transforms/Scalar/GVNHoist.cpp; 9s local ... 2024-12-18T00:53:06.4045444Z 2024-12-18T00:53:06.4046277Z  2024-12-18T00:53:06.4046699Z  2024-12-18T00:53:06.4047059Z  2024-12-18T00:53:06.4047423Z  2024-12-18T00:53:06.4047773Z  2024-12-18T00:53:06.4048160Z  2024-12-18T00:53:06.4048492Z  2024-12-18T00:53:06.4048843Z  2024-12-18T00:53:06.4049826Z [17,073 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:06.4050745Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2024-12-18T00:53:06.4051561Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2024-12-18T00:53:06.4052405Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local 2024-12-18T00:53:06.4053176Z Compiling xla/service/shape_inference.cc; 12s local 2024-12-18T00:53:06.4053994Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2024-12-18T00:53:06.4054949Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 11s local 2024-12-18T00:53:06.4055777Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:53:06.4056647Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:53:06.7214068Z 2024-12-18T00:53:06.7214934Z  2024-12-18T00:53:06.7215779Z  2024-12-18T00:53:06.7216197Z  2024-12-18T00:53:06.7216753Z  2024-12-18T00:53:06.7217125Z  2024-12-18T00:53:06.7217509Z  2024-12-18T00:53:06.7217883Z  2024-12-18T00:53:06.7218245Z  2024-12-18T00:53:06.7219189Z [17,073 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:06.7220205Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2024-12-18T00:53:06.7221059Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2024-12-18T00:53:06.7221952Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local 2024-12-18T00:53:06.7222779Z Compiling xla/service/shape_inference.cc; 12s local 2024-12-18T00:53:06.7223666Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2024-12-18T00:53:06.7224678Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 12s local 2024-12-18T00:53:06.7225530Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 11s local 2024-12-18T00:53:06.7226413Z @llvm-project//llvm:Instrumentation; 9s local ... 2024-12-18T00:53:06.9348683Z 2024-12-18T00:53:06.9349567Z  2024-12-18T00:53:06.9350020Z  2024-12-18T00:53:06.9350390Z  2024-12-18T00:53:06.9350767Z  2024-12-18T00:53:06.9351146Z  2024-12-18T00:53:06.9351513Z  2024-12-18T00:53:06.9351862Z  2024-12-18T00:53:06.9352255Z  2024-12-18T00:53:06.9353211Z [17,074 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:06.9354271Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2024-12-18T00:53:06.9355136Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local 2024-12-18T00:53:06.9355950Z Compiling xla/service/shape_inference.cc; 12s local 2024-12-18T00:53:06.9356792Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2024-12-18T00:53:06.9357736Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 12s local 2024-12-18T00:53:06.9358936Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:53:06.9360059Z Compiling llvm/lib/Transforms/Instrumentation/InstrProfiling.cpp; 9s local 2024-12-18T00:53:06.9361134Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:53:07.1713973Z 2024-12-18T00:53:07.1714778Z  2024-12-18T00:53:07.1715178Z  2024-12-18T00:53:07.1715508Z  2024-12-18T00:53:07.1715815Z  2024-12-18T00:53:07.1716143Z  2024-12-18T00:53:07.1716491Z  2024-12-18T00:53:07.1716807Z  2024-12-18T00:53:07.1717125Z  2024-12-18T00:53:07.1717905Z [17,076 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:07.1718950Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2024-12-18T00:53:07.1719682Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local 2024-12-18T00:53:07.1720363Z Compiling xla/service/shape_inference.cc; 13s local 2024-12-18T00:53:07.1721256Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2024-12-18T00:53:07.1722105Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 12s local 2024-12-18T00:53:07.1722879Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:53:07.1723616Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:07.1724654Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:53:07.5221849Z 2024-12-18T00:53:07.5222696Z  2024-12-18T00:53:07.5223167Z  2024-12-18T00:53:07.5223551Z  2024-12-18T00:53:07.5223938Z  2024-12-18T00:53:07.5224324Z  2024-12-18T00:53:07.5224707Z  2024-12-18T00:53:07.5225079Z  2024-12-18T00:53:07.5225442Z  2024-12-18T00:53:07.5226360Z [17,077 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:07.5227390Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2024-12-18T00:53:07.5228663Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:53:07.5229521Z Compiling xla/service/shape_inference.cc; 13s local 2024-12-18T00:53:07.5230447Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:53:07.5231517Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2024-12-18T00:53:07.5232451Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:53:07.5233232Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:07.5234079Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:53:07.7225433Z 2024-12-18T00:53:07.7226309Z  2024-12-18T00:53:07.7226764Z  2024-12-18T00:53:07.7227142Z  2024-12-18T00:53:07.7227542Z  2024-12-18T00:53:07.7227881Z  2024-12-18T00:53:07.7228238Z  2024-12-18T00:53:07.7228600Z  2024-12-18T00:53:07.7228954Z  2024-12-18T00:53:07.7230089Z [17,080 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:07.7231097Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2024-12-18T00:53:07.7231947Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:53:07.7232761Z Compiling xla/service/shape_inference.cc; 13s local 2024-12-18T00:53:07.7233660Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:53:07.7234648Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2024-12-18T00:53:07.7235484Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 12s local 2024-12-18T00:53:07.7236221Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:07.7237048Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2024-12-18T00:53:08.1231258Z 2024-12-18T00:53:08.1232094Z  2024-12-18T00:53:08.1232566Z  2024-12-18T00:53:08.1232951Z  2024-12-18T00:53:08.1233373Z  2024-12-18T00:53:08.1233774Z  2024-12-18T00:53:08.1234166Z  2024-12-18T00:53:08.1235010Z  2024-12-18T00:53:08.1235399Z  2024-12-18T00:53:08.1236356Z [17,081 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:08.1237432Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:53:08.1238434Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:53:08.1239252Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:53:08.1240170Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2024-12-18T00:53:08.1241175Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2024-12-18T00:53:08.1242073Z Compiling llvm/lib/Transforms/Scalar/GVN.cpp; 13s local 2024-12-18T00:53:08.1242782Z @llvm-project//llvm:Instrumentation; 10s local 2024-12-18T00:53:08.1243632Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local ... 2024-12-18T00:53:08.3234940Z 2024-12-18T00:53:08.3235839Z  2024-12-18T00:53:08.3236405Z  2024-12-18T00:53:08.3236814Z  2024-12-18T00:53:08.3237230Z  2024-12-18T00:53:08.3237620Z  2024-12-18T00:53:08.3238025Z  2024-12-18T00:53:08.3238426Z  2024-12-18T00:53:08.3238834Z  2024-12-18T00:53:08.3239790Z [17,083 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:08.3240904Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:53:08.3241882Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:53:08.3242861Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:53:08.3243824Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2024-12-18T00:53:08.3245297Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2024-12-18T00:53:08.3246084Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:08.3247299Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:53:08.3248151Z @llvm-project//llvm:Vectorize; 10s local ... 2024-12-18T00:53:08.7240220Z 2024-12-18T00:53:08.7241142Z  2024-12-18T00:53:08.7241711Z  2024-12-18T00:53:08.7242223Z  2024-12-18T00:53:08.7242586Z  2024-12-18T00:53:08.7242927Z  2024-12-18T00:53:08.7243292Z  2024-12-18T00:53:08.7243649Z  2024-12-18T00:53:08.7244037Z  2024-12-18T00:53:08.7245203Z [17,086 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:08.7246283Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:53:08.7247235Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:53:08.7248094Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:53:08.7249051Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2024-12-18T00:53:08.7250134Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local 2024-12-18T00:53:08.7251388Z @llvm-project//llvm:Instrumentation; 11s local 2024-12-18T00:53:08.7252219Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2024-12-18T00:53:08.7253268Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local ... 2024-12-18T00:53:08.9243399Z 2024-12-18T00:53:08.9244510Z  2024-12-18T00:53:08.9245071Z  2024-12-18T00:53:08.9245479Z  2024-12-18T00:53:08.9245865Z  2024-12-18T00:53:08.9246263Z  2024-12-18T00:53:08.9246655Z  2024-12-18T00:53:08.9247070Z  2024-12-18T00:53:08.9247470Z  2024-12-18T00:53:08.9248434Z [17,088 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:08.9249522Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:53:08.9250565Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:53:08.9251448Z Compiling xla/service/shape_inference.cc; 14s local 2024-12-18T00:53:08.9252725Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local 2024-12-18T00:53:08.9253670Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:53:08.9254674Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 10s local 2024-12-18T00:53:08.9255701Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 10s local 2024-12-18T00:53:08.9256991Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 9s local ... 2024-12-18T00:53:09.6987633Z 2024-12-18T00:53:09.6988439Z  2024-12-18T00:53:09.6988922Z  2024-12-18T00:53:09.6989332Z  2024-12-18T00:53:09.6989724Z  2024-12-18T00:53:09.6990111Z  2024-12-18T00:53:09.6990490Z  2024-12-18T00:53:09.6990868Z  2024-12-18T00:53:09.6991232Z  2024-12-18T00:53:09.6992165Z [17,089 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:09.6993284Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2024-12-18T00:53:09.6994215Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:53:09.6995061Z Compiling xla/service/shape_inference.cc; 15s local 2024-12-18T00:53:09.6995907Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2024-12-18T00:53:09.6996747Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2024-12-18T00:53:09.6997737Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:53:09.6998814Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 10s local 2024-12-18T00:53:09.6999762Z @llvm-project//mlir:ControlFlowDialect; 10s local ... 2024-12-18T00:53:09.9251963Z 2024-12-18T00:53:09.9252836Z  2024-12-18T00:53:09.9253319Z  2024-12-18T00:53:09.9253705Z  2024-12-18T00:53:09.9254087Z  2024-12-18T00:53:09.9254486Z  2024-12-18T00:53:09.9254850Z  2024-12-18T00:53:09.9255621Z  2024-12-18T00:53:09.9256023Z  2024-12-18T00:53:09.9257158Z [17,090 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:09.9258237Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2024-12-18T00:53:09.9259091Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:53:09.9259919Z Compiling xla/service/shape_inference.cc; 15s local 2024-12-18T00:53:09.9260763Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2024-12-18T00:53:09.9261737Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:53:09.9262787Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:53:09.9263861Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 11s local 2024-12-18T00:53:09.9264912Z @llvm-project//mlir:ControlFlowDialect; 10s local ... 2024-12-18T00:53:10.1256502Z 2024-12-18T00:53:10.1257597Z  2024-12-18T00:53:10.1258054Z  2024-12-18T00:53:10.1258466Z  2024-12-18T00:53:10.1259113Z  2024-12-18T00:53:10.1259536Z  2024-12-18T00:53:10.1259901Z  2024-12-18T00:53:10.1260308Z  2024-12-18T00:53:10.1260700Z  2024-12-18T00:53:10.1261606Z [17,091 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:10.1262682Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:53:10.1263544Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:53:10.1264391Z Compiling xla/service/shape_inference.cc; 16s local 2024-12-18T00:53:10.1265301Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2024-12-18T00:53:10.1266273Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:53:10.1267317Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:53:10.1268418Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 11s local 2024-12-18T00:53:10.1269635Z @llvm-project//mlir:ControlFlowDialect; 10s local ... 2024-12-18T00:53:10.3279157Z 2024-12-18T00:53:10.3279980Z  2024-12-18T00:53:10.3280364Z  2024-12-18T00:53:10.3280717Z  2024-12-18T00:53:10.3281059Z  2024-12-18T00:53:10.3281408Z  2024-12-18T00:53:10.3281736Z  2024-12-18T00:53:10.3282101Z  2024-12-18T00:53:10.3282467Z  2024-12-18T00:53:10.3283332Z [17,092 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:10.3284350Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:53:10.3285161Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:53:10.3285925Z Compiling xla/service/shape_inference.cc; 16s local 2024-12-18T00:53:10.3286721Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2024-12-18T00:53:10.3287593Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:53:10.3288535Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:53:10.3289525Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 11s local 2024-12-18T00:53:10.3290371Z @llvm-project//mlir:ControlFlowDialect; 11s local ... 2024-12-18T00:53:10.5834130Z 2024-12-18T00:53:10.5835000Z  2024-12-18T00:53:10.5835464Z  2024-12-18T00:53:10.5835934Z  2024-12-18T00:53:10.5836322Z  2024-12-18T00:53:10.5836685Z  2024-12-18T00:53:10.5837096Z  2024-12-18T00:53:10.5837497Z  2024-12-18T00:53:10.5837876Z  2024-12-18T00:53:10.5838763Z [17,094 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:10.5839737Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:53:10.5840606Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:53:10.5841426Z Compiling xla/service/shape_inference.cc; 16s local 2024-12-18T00:53:10.5842584Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2024-12-18T00:53:10.5843516Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2024-12-18T00:53:10.5844774Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 11s local 2024-12-18T00:53:10.5845818Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 11s local 2024-12-18T00:53:10.5846744Z @llvm-project//mlir:ControlFlowDialect; 11s local ... 2024-12-18T00:53:10.8406538Z 2024-12-18T00:53:10.8407446Z  2024-12-18T00:53:10.8407904Z  2024-12-18T00:53:10.8408314Z  2024-12-18T00:53:10.8408714Z  2024-12-18T00:53:10.8409111Z  2024-12-18T00:53:10.8409467Z  2024-12-18T00:53:10.8409803Z  2024-12-18T00:53:10.8410192Z  2024-12-18T00:53:10.8411126Z [17,095 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:10.8412192Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:53:10.8413441Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:53:10.8414284Z Compiling xla/service/shape_inference.cc; 16s local 2024-12-18T00:53:10.8415169Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2024-12-18T00:53:10.8416164Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:53:10.8417439Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:53:10.8418485Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 11s local 2024-12-18T00:53:10.8419287Z @llvm-project//mlir:ControlFlowDialect; 11s local ... 2024-12-18T00:53:11.0719681Z 2024-12-18T00:53:11.0720564Z  2024-12-18T00:53:11.0721040Z  2024-12-18T00:53:11.0721444Z  2024-12-18T00:53:11.0721838Z  2024-12-18T00:53:11.0722250Z  2024-12-18T00:53:11.0722645Z  2024-12-18T00:53:11.0723009Z  2024-12-18T00:53:11.0723396Z  2024-12-18T00:53:11.0724549Z [17,097 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:11.0725686Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:53:11.0726569Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:53:11.0727398Z Compiling xla/service/shape_inference.cc; 17s local 2024-12-18T00:53:11.0728121Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2024-12-18T00:53:11.0729023Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2024-12-18T00:53:11.0729964Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:53:11.0730967Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 12s local 2024-12-18T00:53:11.0731852Z @llvm-project//mlir:ControlFlowDialect; 11s local ... 2024-12-18T00:53:11.2984038Z 2024-12-18T00:53:11.2984922Z  2024-12-18T00:53:11.2985387Z  2024-12-18T00:53:11.2985790Z  2024-12-18T00:53:11.2986193Z  2024-12-18T00:53:11.2986624Z  2024-12-18T00:53:11.2986997Z  2024-12-18T00:53:11.2987394Z  2024-12-18T00:53:11.2987792Z  2024-12-18T00:53:11.2988807Z [17,103 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:11.2989864Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:53:11.2990751Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:53:11.2991695Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2024-12-18T00:53:11.2992736Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:53:11.2993759Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 12s local 2024-12-18T00:53:11.2994850Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2024-12-18T00:53:11.2995944Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 11s local 2024-12-18T00:53:11.2997024Z Compiling xla/hlo/ir/hlo_schedule.cc; 11s local ... 2024-12-18T00:53:11.5265836Z 2024-12-18T00:53:11.5266727Z  2024-12-18T00:53:11.5267200Z  2024-12-18T00:53:11.5267572Z  2024-12-18T00:53:11.5267941Z  2024-12-18T00:53:11.5268333Z  2024-12-18T00:53:11.5268695Z  2024-12-18T00:53:11.5269094Z  2024-12-18T00:53:11.5269506Z  2024-12-18T00:53:11.5270420Z [17,104 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:53:11.5271472Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:53:11.5272367Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:53:11.5273326Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2024-12-18T00:53:11.5274369Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2024-12-18T00:53:11.5275304Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 12s local 2024-12-18T00:53:11.5276548Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2024-12-18T00:53:11.5277688Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2024-12-18T00:53:11.5278553Z Compiling xla/hlo/ir/hlo_schedule.cc; 11s local ... 2024-12-18T00:53:11.9270520Z 2024-12-18T00:53:11.9271365Z  2024-12-18T00:53:11.9271850Z  2024-12-18T00:53:11.9272239Z  2024-12-18T00:53:11.9272662Z  2024-12-18T00:53:11.9273064Z  2024-12-18T00:53:11.9273458Z  2024-12-18T00:53:11.9273842Z  2024-12-18T00:53:11.9274200Z  2024-12-18T00:53:11.9275123Z [17,105 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:11.9276208Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:53:11.9277140Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:53:11.9278129Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2024-12-18T00:53:11.9279467Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2024-12-18T00:53:11.9280737Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2024-12-18T00:53:11.9281831Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2024-12-18T00:53:11.9282744Z Compiling xla/hlo/ir/hlo_schedule.cc; 12s local 2024-12-18T00:53:11.9283622Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 11s local ... 2024-12-18T00:53:12.9279255Z 2024-12-18T00:53:12.9280082Z  2024-12-18T00:53:12.9280479Z  2024-12-18T00:53:12.9280836Z  2024-12-18T00:53:12.9281196Z  2024-12-18T00:53:12.9281545Z  2024-12-18T00:53:12.9281905Z  2024-12-18T00:53:12.9282272Z  2024-12-18T00:53:12.9282633Z  2024-12-18T00:53:12.9283485Z [17,105 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:12.9284426Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:53:12.9285293Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:53:12.9286129Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2024-12-18T00:53:12.9286988Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:53:12.9287935Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2024-12-18T00:53:12.9288889Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:53:12.9289682Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local 2024-12-18T00:53:12.9290511Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local ... 2024-12-18T00:53:13.1947917Z 2024-12-18T00:53:13.1948726Z  2024-12-18T00:53:13.1949134Z  2024-12-18T00:53:13.1949506Z  2024-12-18T00:53:13.1949870Z  2024-12-18T00:53:13.1950228Z  2024-12-18T00:53:13.1950564Z  2024-12-18T00:53:13.1951194Z  2024-12-18T00:53:13.1951581Z  2024-12-18T00:53:13.1952472Z [17,106 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:13.1953390Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:53:13.1954134Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:53:13.1954923Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2024-12-18T00:53:13.1955798Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:53:13.1956694Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:53:13.1957426Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local 2024-12-18T00:53:13.1958158Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:53:13.1959057Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local ... 2024-12-18T00:53:13.5285780Z 2024-12-18T00:53:13.5286631Z  2024-12-18T00:53:13.5287081Z  2024-12-18T00:53:13.5287472Z  2024-12-18T00:53:13.5288127Z  2024-12-18T00:53:13.5288512Z  2024-12-18T00:53:13.5288901Z  2024-12-18T00:53:13.5289437Z  2024-12-18T00:53:13.5289834Z  2024-12-18T00:53:13.5290744Z [17,107 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:53:13.5291852Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:53:13.5292827Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 22s local 2024-12-18T00:53:13.5293836Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2024-12-18T00:53:13.5294949Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2024-12-18T00:53:13.5295879Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:13.5296981Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local 2024-12-18T00:53:13.5297766Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:53:13.5299009Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local ... 2024-12-18T00:53:13.8497769Z 2024-12-18T00:53:13.8498637Z  2024-12-18T00:53:13.8499091Z  2024-12-18T00:53:13.8499499Z  2024-12-18T00:53:13.8499906Z  2024-12-18T00:53:13.8500301Z  2024-12-18T00:53:13.8500677Z  2024-12-18T00:53:13.8501021Z  2024-12-18T00:53:13.8501390Z  2024-12-18T00:53:13.8502329Z [17,108 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:13.8503345Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:53:13.8504101Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2024-12-18T00:53:13.8505117Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:53:13.8506165Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:13.8507026Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local 2024-12-18T00:53:13.8507868Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2024-12-18T00:53:13.8508871Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:53:13.8509885Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2024-12-18T00:53:14.1290264Z 2024-12-18T00:53:14.1290920Z  2024-12-18T00:53:14.1291355Z  2024-12-18T00:53:14.1291749Z  2024-12-18T00:53:14.1292106Z  2024-12-18T00:53:14.1292488Z  2024-12-18T00:53:14.1292860Z  2024-12-18T00:53:14.1293241Z  2024-12-18T00:53:14.1293633Z  2024-12-18T00:53:14.1294502Z [17,108 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:14.1295558Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:53:14.1296700Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2024-12-18T00:53:14.1298089Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:53:14.1299135Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:14.1299996Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local 2024-12-18T00:53:14.1300882Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:14.1301866Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 12s local 2024-12-18T00:53:14.1302901Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2024-12-18T00:53:14.3296124Z 2024-12-18T00:53:14.3297161Z  2024-12-18T00:53:14.3297672Z  2024-12-18T00:53:14.3298069Z  2024-12-18T00:53:14.3298441Z  2024-12-18T00:53:14.3298817Z  2024-12-18T00:53:14.3299199Z  2024-12-18T00:53:14.3314578Z  2024-12-18T00:53:14.3315042Z  2024-12-18T00:53:14.3315935Z [17,109 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:14.3317322Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:53:14.3318264Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2024-12-18T00:53:14.3319285Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:53:14.3320369Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:14.3321257Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local 2024-12-18T00:53:14.3322108Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:14.3323140Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:53:14.3324177Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2024-12-18T00:53:14.5494477Z 2024-12-18T00:53:14.5495297Z  2024-12-18T00:53:14.5495781Z  2024-12-18T00:53:14.5496207Z  2024-12-18T00:53:14.5496832Z  2024-12-18T00:53:14.5497237Z  2024-12-18T00:53:14.5497653Z  2024-12-18T00:53:14.5498048Z  2024-12-18T00:53:14.5498890Z  2024-12-18T00:53:14.5499834Z [17,111 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:14.5500857Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:53:14.5501791Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2024-12-18T00:53:14.5502798Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2024-12-18T00:53:14.5503906Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:14.5504766Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local 2024-12-18T00:53:14.5505553Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:14.5506557Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:53:14.5507580Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2024-12-18T00:53:14.7745447Z 2024-12-18T00:53:14.7746471Z  2024-12-18T00:53:14.7747063Z  2024-12-18T00:53:14.7747503Z  2024-12-18T00:53:14.7747874Z  2024-12-18T00:53:14.7748233Z  2024-12-18T00:53:14.7748597Z  2024-12-18T00:53:14.7748974Z  2024-12-18T00:53:14.7749350Z  2024-12-18T00:53:14.7750283Z [17,112 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:14.7751374Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:53:14.7752436Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2024-12-18T00:53:14.7753459Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:53:14.7754504Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:14.7755371Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local 2024-12-18T00:53:14.7756230Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2024-12-18T00:53:14.7757594Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:53:14.7758668Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2024-12-18T00:53:15.1299667Z 2024-12-18T00:53:15.1300586Z  2024-12-18T00:53:15.1301059Z  2024-12-18T00:53:15.1301453Z  2024-12-18T00:53:15.1301849Z  2024-12-18T00:53:15.1302226Z  2024-12-18T00:53:15.1302627Z  2024-12-18T00:53:15.1303026Z  2024-12-18T00:53:15.1303433Z  2024-12-18T00:53:15.1304368Z [17,115 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:15.1305333Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:53:15.1306222Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2024-12-18T00:53:15.1307250Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:53:15.1308331Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:15.1309506Z Compiling xla/hlo/ir/hlo_schedule.cc; 15s local 2024-12-18T00:53:15.1310353Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:15.1311524Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 13s local 2024-12-18T00:53:15.1312516Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local ... 2024-12-18T00:53:15.3303740Z 2024-12-18T00:53:15.3304728Z  2024-12-18T00:53:15.3305256Z  2024-12-18T00:53:15.3305671Z  2024-12-18T00:53:15.3306011Z  2024-12-18T00:53:15.3306380Z  2024-12-18T00:53:15.3306760Z  2024-12-18T00:53:15.3307158Z  2024-12-18T00:53:15.3307522Z  2024-12-18T00:53:15.3308448Z [17,117 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:15.3309460Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:53:15.3310416Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2024-12-18T00:53:15.3311833Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2024-12-18T00:53:15.3312877Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:15.3313841Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:15.3314725Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:53:15.3315724Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local 2024-12-18T00:53:15.3316808Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local ... 2024-12-18T00:53:15.7308238Z 2024-12-18T00:53:15.7309194Z  2024-12-18T00:53:15.7309725Z  2024-12-18T00:53:15.7310170Z  2024-12-18T00:53:15.7310571Z  2024-12-18T00:53:15.7311083Z  2024-12-18T00:53:15.7311582Z  2024-12-18T00:53:15.7311935Z  2024-12-18T00:53:15.7312310Z  2024-12-18T00:53:15.7313255Z [17,118 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:15.7314285Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:53:15.7315130Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2024-12-18T00:53:15.7316101Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:53:15.7317197Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:53:15.7318216Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:15.7319246Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:53:15.7320293Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local 2024-12-18T00:53:15.7321304Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local ... 2024-12-18T00:53:15.9311125Z 2024-12-18T00:53:15.9312027Z  2024-12-18T00:53:15.9312481Z  2024-12-18T00:53:15.9313168Z  2024-12-18T00:53:15.9313530Z  2024-12-18T00:53:15.9313899Z  2024-12-18T00:53:15.9314313Z  2024-12-18T00:53:15.9314698Z  2024-12-18T00:53:15.9315090Z  2024-12-18T00:53:15.9316173Z [17,120 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:15.9317188Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:53:15.9318143Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2024-12-18T00:53:15.9319558Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:53:15.9320646Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:53:15.9321835Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2024-12-18T00:53:15.9322972Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 14s local 2024-12-18T00:53:15.9324105Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:53:15.9325460Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local ... 2024-12-18T00:53:16.2367393Z 2024-12-18T00:53:16.2368297Z  2024-12-18T00:53:16.2368838Z  2024-12-18T00:53:16.2369265Z  2024-12-18T00:53:16.2369670Z  2024-12-18T00:53:16.2370079Z  2024-12-18T00:53:16.2370424Z  2024-12-18T00:53:16.2370811Z  2024-12-18T00:53:16.2371179Z  2024-12-18T00:53:16.2372192Z [17,121 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:16.2373248Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:53:16.2374216Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2024-12-18T00:53:16.2375272Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:53:16.2376513Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:53:16.2377561Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:53:16.2378892Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:53:16.2380106Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:53:16.2381191Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local ... 2024-12-18T00:53:16.4668473Z 2024-12-18T00:53:16.4669326Z  2024-12-18T00:53:16.4669857Z  2024-12-18T00:53:16.4670289Z  2024-12-18T00:53:16.4670694Z  2024-12-18T00:53:16.4671113Z  2024-12-18T00:53:16.4671482Z  2024-12-18T00:53:16.4671864Z  2024-12-18T00:53:16.4672246Z  2024-12-18T00:53:16.4673132Z [17,123 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:16.4674220Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:53:16.4675215Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2024-12-18T00:53:16.4676324Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2024-12-18T00:53:16.4677561Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:53:16.4678623Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:53:16.4679706Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:53:16.4680710Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:53:16.4681767Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local ... 2024-12-18T00:53:16.6970874Z 2024-12-18T00:53:16.6971825Z  2024-12-18T00:53:16.6972355Z  2024-12-18T00:53:16.6972776Z  2024-12-18T00:53:16.6973212Z  2024-12-18T00:53:16.6973627Z  2024-12-18T00:53:16.6973992Z  2024-12-18T00:53:16.6974331Z  2024-12-18T00:53:16.6974689Z  2024-12-18T00:53:16.6975591Z [17,126 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:16.6977065Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:53:16.6977994Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2024-12-18T00:53:16.6978962Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:53:16.6979983Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:53:16.6981175Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:53:16.6982227Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:53:16.6983255Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local 2024-12-18T00:53:16.6984349Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local ... 2024-12-18T00:53:16.9320141Z 2024-12-18T00:53:16.9321063Z  2024-12-18T00:53:16.9321580Z  2024-12-18T00:53:16.9322012Z  2024-12-18T00:53:16.9322432Z  2024-12-18T00:53:16.9322870Z  2024-12-18T00:53:16.9323230Z  2024-12-18T00:53:16.9323621Z  2024-12-18T00:53:16.9324263Z  2024-12-18T00:53:16.9325216Z [17,126 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:16.9326316Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:53:16.9327264Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2024-12-18T00:53:16.9328294Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:53:16.9329348Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:53:16.9330380Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2024-12-18T00:53:16.9331380Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 15s local 2024-12-18T00:53:16.9332379Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local 2024-12-18T00:53:16.9333453Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local ... 2024-12-18T00:53:17.1755626Z 2024-12-18T00:53:17.1757098Z  2024-12-18T00:53:17.1757655Z  2024-12-18T00:53:17.1758089Z  2024-12-18T00:53:17.1758509Z  2024-12-18T00:53:17.1758931Z  2024-12-18T00:53:17.1759307Z  2024-12-18T00:53:17.1759678Z  2024-12-18T00:53:17.1760081Z  2024-12-18T00:53:17.1761064Z [17,128 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:17.1762241Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:53:17.1763282Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2024-12-18T00:53:17.1764413Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:53:17.1765626Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:53:17.1766716Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:53:17.1767886Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:53:17.1769025Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local 2024-12-18T00:53:17.1770132Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local ... 2024-12-18T00:53:17.5326077Z 2024-12-18T00:53:17.5327036Z  2024-12-18T00:53:17.5327543Z  2024-12-18T00:53:17.5327983Z  2024-12-18T00:53:17.5328406Z  2024-12-18T00:53:17.5328802Z  2024-12-18T00:53:17.5329166Z  2024-12-18T00:53:17.5329514Z  2024-12-18T00:53:17.5329889Z  2024-12-18T00:53:17.5330818Z [17,129 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:17.5331838Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:53:17.5332819Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2024-12-18T00:53:17.5333856Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2024-12-18T00:53:17.5335307Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:53:17.5336325Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:53:17.5337553Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:53:17.5338603Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local 2024-12-18T00:53:17.5339663Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local ... 2024-12-18T00:53:17.9331292Z 2024-12-18T00:53:17.9332216Z  2024-12-18T00:53:17.9332748Z  2024-12-18T00:53:17.9333192Z  2024-12-18T00:53:17.9333632Z  2024-12-18T00:53:17.9334034Z  2024-12-18T00:53:17.9334408Z  2024-12-18T00:53:17.9334792Z  2024-12-18T00:53:17.9335210Z  2024-12-18T00:53:17.9336194Z [17,131 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:17.9337407Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:53:17.9338843Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2024-12-18T00:53:17.9339896Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:53:17.9340952Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:53:17.9341992Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2024-12-18T00:53:17.9343048Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local 2024-12-18T00:53:17.9344093Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local 2024-12-18T00:53:17.9345414Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local ... 2024-12-18T00:53:18.3336318Z 2024-12-18T00:53:18.3337398Z  2024-12-18T00:53:18.3337927Z  2024-12-18T00:53:18.3338378Z  2024-12-18T00:53:18.3338820Z  2024-12-18T00:53:18.3339220Z  2024-12-18T00:53:18.3339601Z  2024-12-18T00:53:18.3340014Z  2024-12-18T00:53:18.3340391Z  2024-12-18T00:53:18.3341616Z [17,132 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:18.3342833Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:53:18.3343886Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2024-12-18T00:53:18.3345232Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:53:18.3346338Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:53:18.3347381Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:53:18.3348530Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:53:18.3349678Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local 2024-12-18T00:53:18.3350835Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:53:18.5431110Z 2024-12-18T00:53:18.5432042Z  2024-12-18T00:53:18.5432560Z  2024-12-18T00:53:18.5433036Z  2024-12-18T00:53:18.5433462Z  2024-12-18T00:53:18.5433873Z  2024-12-18T00:53:18.5434275Z  2024-12-18T00:53:18.5434666Z  2024-12-18T00:53:18.5435073Z  2024-12-18T00:53:18.5436033Z [17,135 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:18.5437144Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:53:18.5438154Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2024-12-18T00:53:18.5439228Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2024-12-18T00:53:18.5440392Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:53:18.5441523Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:53:18.5442580Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:53:18.5443998Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local 2024-12-18T00:53:18.5445321Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:53:18.9255861Z 2024-12-18T00:53:18.9256924Z  2024-12-18T00:53:18.9257450Z  2024-12-18T00:53:18.9257877Z  2024-12-18T00:53:18.9258304Z  2024-12-18T00:53:18.9258686Z  2024-12-18T00:53:18.9259077Z  2024-12-18T00:53:18.9259464Z  2024-12-18T00:53:18.9259867Z  2024-12-18T00:53:18.9260815Z [17,139 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:18.9261847Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:53:18.9262806Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2024-12-18T00:53:18.9263843Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:53:18.9264904Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:53:18.9266307Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2024-12-18T00:53:18.9267412Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:53:18.9268471Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:53:18.9269626Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:53:19.1343772Z 2024-12-18T00:53:19.1344955Z  2024-12-18T00:53:19.1345501Z  2024-12-18T00:53:19.1345930Z  2024-12-18T00:53:19.1346362Z  2024-12-18T00:53:19.1346763Z  2024-12-18T00:53:19.1347137Z  2024-12-18T00:53:19.1347502Z  2024-12-18T00:53:19.1347881Z  2024-12-18T00:53:19.1348779Z [17,140 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:19.1349816Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:53:19.1350758Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2024-12-18T00:53:19.1352169Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:53:19.1353234Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:53:19.1354227Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:53:19.1355257Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local 2024-12-18T00:53:19.1356250Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:53:19.1357304Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:53:19.3766896Z 2024-12-18T00:53:19.3767823Z  2024-12-18T00:53:19.3768358Z  2024-12-18T00:53:19.3768829Z  2024-12-18T00:53:19.3769291Z  2024-12-18T00:53:19.3769752Z  2024-12-18T00:53:19.3770180Z  2024-12-18T00:53:19.3770559Z  2024-12-18T00:53:19.3770945Z  2024-12-18T00:53:19.3771877Z [17,141 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:19.3773104Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:53:19.3773881Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2024-12-18T00:53:19.3774707Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2024-12-18T00:53:19.3775566Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:53:19.3776565Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:53:19.3777421Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:53:19.3778263Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:53:19.3779174Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local ... 2024-12-18T00:53:19.7349197Z 2024-12-18T00:53:19.7350140Z  2024-12-18T00:53:19.7350685Z  2024-12-18T00:53:19.7351421Z  2024-12-18T00:53:19.7351864Z  2024-12-18T00:53:19.7352379Z  2024-12-18T00:53:19.7352720Z  2024-12-18T00:53:19.7353096Z  2024-12-18T00:53:19.7353487Z  2024-12-18T00:53:19.7354367Z [17,142 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:19.7355439Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:53:19.7356363Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:53:19.7357408Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:53:19.7358424Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:53:19.7359480Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:53:19.7360553Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:53:19.7361632Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2024-12-18T00:53:19.7362919Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local ... 2024-12-18T00:53:19.9353402Z 2024-12-18T00:53:19.9354315Z  2024-12-18T00:53:19.9354858Z  2024-12-18T00:53:19.9355290Z  2024-12-18T00:53:19.9355701Z  2024-12-18T00:53:19.9356115Z  2024-12-18T00:53:19.9356470Z  2024-12-18T00:53:19.9356828Z  2024-12-18T00:53:19.9357207Z  2024-12-18T00:53:19.9358147Z [17,143 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:19.9359192Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:53:19.9360161Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:53:19.9361197Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:53:19.9362275Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:53:19.9363324Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2024-12-18T00:53:19.9364771Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local 2024-12-18T00:53:19.9365942Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2024-12-18T00:53:19.9367013Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local ... 2024-12-18T00:53:20.5710982Z 2024-12-18T00:53:20.5712038Z  2024-12-18T00:53:20.5712587Z  2024-12-18T00:53:20.5713035Z  2024-12-18T00:53:20.5713458Z  2024-12-18T00:53:20.5713864Z  2024-12-18T00:53:20.5714254Z  2024-12-18T00:53:20.5714628Z  2024-12-18T00:53:20.5714984Z  2024-12-18T00:53:20.5715879Z [17,144 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:20.5716914Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:53:20.5717860Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2024-12-18T00:53:20.5718914Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2024-12-18T00:53:20.5719980Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:53:20.5721020Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:53:20.5722072Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:53:20.5723073Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2024-12-18T00:53:20.5724140Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local ... 2024-12-18T00:53:20.9360730Z 2024-12-18T00:53:20.9361682Z  2024-12-18T00:53:20.9362197Z  2024-12-18T00:53:20.9362608Z  2024-12-18T00:53:20.9363027Z  2024-12-18T00:53:20.9363448Z  2024-12-18T00:53:20.9363829Z  2024-12-18T00:53:20.9364164Z  2024-12-18T00:53:20.9364503Z  2024-12-18T00:53:20.9365284Z [17,146 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:20.9366447Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:53:20.9367263Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2024-12-18T00:53:20.9368127Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:53:20.9369006Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:53:20.9369876Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2024-12-18T00:53:20.9370760Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2024-12-18T00:53:20.9371768Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2024-12-18T00:53:20.9372685Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local ... 2024-12-18T00:53:21.3365498Z 2024-12-18T00:53:21.3366413Z  2024-12-18T00:53:21.3366920Z  2024-12-18T00:53:21.3367372Z  2024-12-18T00:53:21.3367809Z  2024-12-18T00:53:21.3368278Z  2024-12-18T00:53:21.3368717Z  2024-12-18T00:53:21.3369409Z  2024-12-18T00:53:21.3369858Z  2024-12-18T00:53:21.3370687Z [17,149 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:21.3371580Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:53:21.3372519Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2024-12-18T00:53:21.3373518Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2024-12-18T00:53:21.3374589Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:53:21.3375606Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:53:21.3376828Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:53:21.3377873Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2024-12-18T00:53:21.3378933Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local ... 2024-12-18T00:53:21.7089227Z 2024-12-18T00:53:21.7090636Z  2024-12-18T00:53:21.7091104Z  2024-12-18T00:53:21.7091503Z  2024-12-18T00:53:21.7091895Z  2024-12-18T00:53:21.7092287Z  2024-12-18T00:53:21.7092659Z  2024-12-18T00:53:21.7093078Z  2024-12-18T00:53:21.7093485Z  2024-12-18T00:53:21.7094431Z [17,152 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:21.7095512Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:53:21.7096689Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:53:21.7097780Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:53:21.7098843Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:53:21.7099948Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:53:21.7101141Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2024-12-18T00:53:21.7102216Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2024-12-18T00:53:21.7103153Z Compiling xla/literal_comparison.cc; 16s local ... 2024-12-18T00:53:21.9122928Z 2024-12-18T00:53:21.9123784Z  2024-12-18T00:53:21.9124323Z  2024-12-18T00:53:21.9124732Z  2024-12-18T00:53:21.9125104Z  2024-12-18T00:53:21.9125481Z  2024-12-18T00:53:21.9125871Z  2024-12-18T00:53:21.9126264Z  2024-12-18T00:53:21.9126646Z  2024-12-18T00:53:21.9127579Z [17,154 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:21.9128663Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:53:21.9129673Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:53:21.9130711Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:53:21.9132250Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2024-12-18T00:53:21.9133350Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:53:21.9134418Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:53:21.9135382Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2024-12-18T00:53:21.9136310Z Compiling xla/literal_comparison.cc; 16s local ... 2024-12-18T00:53:22.1372379Z 2024-12-18T00:53:22.1373369Z  2024-12-18T00:53:22.1373878Z  2024-12-18T00:53:22.1374318Z  2024-12-18T00:53:22.1374742Z  2024-12-18T00:53:22.1375131Z  2024-12-18T00:53:22.1375493Z  2024-12-18T00:53:22.1375841Z  2024-12-18T00:53:22.1376214Z  2024-12-18T00:53:22.1377228Z [17,154 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:22.1378264Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:53:22.1379531Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:53:22.1380570Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:53:22.1381689Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:53:22.1382725Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2024-12-18T00:53:22.1383729Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:53:22.1384777Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2024-12-18T00:53:22.1385749Z Compiling xla/literal_comparison.cc; 16s local ... 2024-12-18T00:53:22.5377389Z 2024-12-18T00:53:22.5378325Z  2024-12-18T00:53:22.5378855Z  2024-12-18T00:53:22.5379276Z  2024-12-18T00:53:22.5379694Z  2024-12-18T00:53:22.5380078Z  2024-12-18T00:53:22.5380436Z  2024-12-18T00:53:22.5380824Z  2024-12-18T00:53:22.5381247Z  2024-12-18T00:53:22.5382392Z [17,155 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:22.5383573Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:53:22.5384587Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2024-12-18T00:53:22.5385662Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:53:22.5386683Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:53:22.5387736Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:53:22.5388765Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:53:22.5389804Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:53:22.5390744Z Compiling xla/literal_comparison.cc; 17s local ... 2024-12-18T00:53:22.8049227Z 2024-12-18T00:53:22.8050146Z  2024-12-18T00:53:22.8050667Z  2024-12-18T00:53:22.8051140Z  2024-12-18T00:53:22.8051589Z  2024-12-18T00:53:22.8052048Z  2024-12-18T00:53:22.8052427Z  2024-12-18T00:53:22.8052814Z  2024-12-18T00:53:22.8053205Z  2024-12-18T00:53:22.8054121Z [17,156 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:22.8055195Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:53:22.8056328Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:53:22.8057503Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:53:22.8058538Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2024-12-18T00:53:22.8059682Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:53:22.8060666Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2024-12-18T00:53:22.8061651Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:53:22.8062629Z Compiling xla/literal_comparison.cc; 17s local ... 2024-12-18T00:53:23.1383183Z 2024-12-18T00:53:23.1384117Z  2024-12-18T00:53:23.1384660Z  2024-12-18T00:53:23.1385094Z  2024-12-18T00:53:23.1385521Z  2024-12-18T00:53:23.1385936Z  2024-12-18T00:53:23.1386310Z  2024-12-18T00:53:23.1386707Z  2024-12-18T00:53:23.1387106Z  2024-12-18T00:53:23.1388037Z [17,158 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:23.1389106Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:53:23.1390135Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2024-12-18T00:53:23.1391227Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:53:23.1392275Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:53:23.1393365Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2024-12-18T00:53:23.1394768Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2024-12-18T00:53:23.1395855Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:53:23.1396823Z Compiling xla/literal_comparison.cc; 17s local ... 2024-12-18T00:53:23.6366132Z 2024-12-18T00:53:23.6367016Z  2024-12-18T00:53:23.6367547Z  2024-12-18T00:53:23.6367981Z  2024-12-18T00:53:23.6368408Z  2024-12-18T00:53:23.6368808Z  2024-12-18T00:53:23.6369146Z  2024-12-18T00:53:23.6369483Z  2024-12-18T00:53:23.6369836Z  2024-12-18T00:53:23.6370659Z [17,159 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:23.6371582Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:53:23.6372466Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:53:23.6373444Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:53:23.6374842Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:53:23.6375811Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:53:23.6376890Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2024-12-18T00:53:23.6377862Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:53:23.6378821Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 12s local ... 2024-12-18T00:53:23.9391515Z 2024-12-18T00:53:23.9392436Z  2024-12-18T00:53:23.9392954Z  2024-12-18T00:53:23.9393421Z  2024-12-18T00:53:23.9393838Z  2024-12-18T00:53:23.9394165Z  2024-12-18T00:53:23.9394490Z  2024-12-18T00:53:23.9394953Z  2024-12-18T00:53:23.9395292Z  2024-12-18T00:53:23.9396066Z [17,159 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:23.9397108Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:53:23.9398054Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:53:23.9399068Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:53:23.9400005Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2024-12-18T00:53:23.9400966Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:53:23.9401894Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:53:23.9402888Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:53:23.9403891Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 12s local ... 2024-12-18T00:53:24.1394537Z 2024-12-18T00:53:24.1395405Z  2024-12-18T00:53:24.1395904Z  2024-12-18T00:53:24.1396362Z  2024-12-18T00:53:24.1396768Z  2024-12-18T00:53:24.1397185Z  2024-12-18T00:53:24.1397781Z  2024-12-18T00:53:24.1398084Z  2024-12-18T00:53:24.1398423Z  2024-12-18T00:53:24.1399137Z [17,160 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:24.1399932Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:53:24.1400683Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:53:24.1401487Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:53:24.1402248Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:53:24.1403021Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2024-12-18T00:53:24.1403795Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:53:24.1404563Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:53:24.1405337Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local ... 2024-12-18T00:53:24.5399074Z 2024-12-18T00:53:24.5400013Z  2024-12-18T00:53:24.5400840Z  2024-12-18T00:53:24.5401252Z  2024-12-18T00:53:24.5401657Z  2024-12-18T00:53:24.5402030Z  2024-12-18T00:53:24.5402562Z  2024-12-18T00:53:24.5402960Z  2024-12-18T00:53:24.5403329Z  2024-12-18T00:53:24.5404269Z [17,161 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:24.5405313Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:53:24.5406215Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2024-12-18T00:53:24.5407040Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:24.5407813Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:53:24.5408626Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:53:24.5409631Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:53:24.5410880Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:53:24.5412018Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local ... 2024-12-18T00:53:24.7403519Z 2024-12-18T00:53:24.7404479Z  2024-12-18T00:53:24.7405009Z  2024-12-18T00:53:24.7405434Z  2024-12-18T00:53:24.7405880Z  2024-12-18T00:53:24.7406307Z  2024-12-18T00:53:24.7406748Z  2024-12-18T00:53:24.7407123Z  2024-12-18T00:53:24.7407484Z  2024-12-18T00:53:24.7408413Z [17,163 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:24.7409519Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:53:24.7410553Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:53:24.7411653Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:24.7412705Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2024-12-18T00:53:24.7413705Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:53:24.7414915Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2024-12-18T00:53:24.7415919Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:53:24.7417082Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local ... 2024-12-18T00:53:25.1054935Z 2024-12-18T00:53:25.1055849Z  2024-12-18T00:53:25.1056501Z  2024-12-18T00:53:25.1056937Z  2024-12-18T00:53:25.1057359Z  2024-12-18T00:53:25.1057769Z  2024-12-18T00:53:25.1058090Z  2024-12-18T00:53:25.1058435Z  2024-12-18T00:53:25.1058796Z  2024-12-18T00:53:25.1059682Z [17,166 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:25.1060737Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:53:25.1062070Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:53:25.1063020Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:25.1064003Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:25.1065092Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2024-12-18T00:53:25.1066098Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2024-12-18T00:53:25.1067134Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:53:25.1068150Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local ... 2024-12-18T00:53:25.3408586Z 2024-12-18T00:53:25.3409475Z  2024-12-18T00:53:25.3409942Z  2024-12-18T00:53:25.3410338Z  2024-12-18T00:53:25.3410728Z  2024-12-18T00:53:25.3411101Z  2024-12-18T00:53:25.3411489Z  2024-12-18T00:53:25.3411892Z  2024-12-18T00:53:25.3412320Z  2024-12-18T00:53:25.3413660Z [17,167 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:25.3414744Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:53:25.3415719Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2024-12-18T00:53:25.3416912Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:25.3417910Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:25.3418972Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:53:25.3419987Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2024-12-18T00:53:25.3420983Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:53:25.3422006Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local ... 2024-12-18T00:53:25.6741201Z 2024-12-18T00:53:25.6742194Z  2024-12-18T00:53:25.6742780Z  2024-12-18T00:53:25.6743200Z  2024-12-18T00:53:25.6744049Z  2024-12-18T00:53:25.6744627Z  2024-12-18T00:53:25.6744981Z  2024-12-18T00:53:25.6745331Z  2024-12-18T00:53:25.6745669Z  2024-12-18T00:53:25.6746534Z [17,168 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:25.6747529Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:53:25.6748458Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:53:25.6749566Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:53:25.6750688Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:25.6751724Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:53:25.6752765Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2024-12-18T00:53:25.6753820Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:53:25.6754882Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local ... 2024-12-18T00:53:25.9415265Z 2024-12-18T00:53:25.9416524Z  2024-12-18T00:53:25.9417034Z  2024-12-18T00:53:25.9417471Z  2024-12-18T00:53:25.9417907Z  2024-12-18T00:53:25.9418276Z  2024-12-18T00:53:25.9418638Z  2024-12-18T00:53:25.9418987Z  2024-12-18T00:53:25.9419364Z  2024-12-18T00:53:25.9420314Z [17,170 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:25.9421431Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:53:25.9422471Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:53:25.9423505Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:53:25.9424533Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2024-12-18T00:53:25.9426047Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2024-12-18T00:53:25.9427170Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:25.9428240Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:53:25.9429302Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local ... 2024-12-18T00:53:26.1947797Z 2024-12-18T00:53:26.1948692Z  2024-12-18T00:53:26.1949184Z  2024-12-18T00:53:26.1949588Z  2024-12-18T00:53:26.1949965Z  2024-12-18T00:53:26.1950333Z  2024-12-18T00:53:26.1950711Z  2024-12-18T00:53:26.1951086Z  2024-12-18T00:53:26.1951484Z  2024-12-18T00:53:26.1952407Z [17,171 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:26.1953476Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:53:26.1954489Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:53:26.1955862Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:53:26.1956960Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:53:26.1958030Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:53:26.1959078Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:26.1960111Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:53:26.1961152Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local ... 2024-12-18T00:53:26.5421924Z 2024-12-18T00:53:26.5422825Z  2024-12-18T00:53:26.5423369Z  2024-12-18T00:53:26.5423818Z  2024-12-18T00:53:26.5424234Z  2024-12-18T00:53:26.5424658Z  2024-12-18T00:53:26.5425014Z  2024-12-18T00:53:26.5425429Z  2024-12-18T00:53:26.5425786Z  2024-12-18T00:53:26.5426674Z [17,171 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:26.5428171Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:53:26.5429170Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2024-12-18T00:53:26.5430237Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:26.5431243Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:53:26.5432268Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:53:26.5433341Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:26.5434265Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:53:26.5435229Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local ... 2024-12-18T00:53:26.7899672Z 2024-12-18T00:53:26.7900596Z  2024-12-18T00:53:26.7901122Z  2024-12-18T00:53:26.7901527Z  2024-12-18T00:53:26.7901948Z  2024-12-18T00:53:26.7902410Z  2024-12-18T00:53:26.7902761Z  2024-12-18T00:53:26.7903156Z  2024-12-18T00:53:26.7903551Z  2024-12-18T00:53:26.7904451Z [17,172 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:26.7905458Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:53:26.7906416Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:53:26.7907451Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:26.7908475Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2024-12-18T00:53:26.7909513Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:53:26.7910528Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:26.7911494Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:53:26.7912538Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local ... 2024-12-18T00:53:27.0862275Z 2024-12-18T00:53:27.0863199Z  2024-12-18T00:53:27.0863740Z  2024-12-18T00:53:27.0864185Z  2024-12-18T00:53:27.0864630Z  2024-12-18T00:53:27.0865052Z  2024-12-18T00:53:27.0865391Z  2024-12-18T00:53:27.0865793Z  2024-12-18T00:53:27.0866214Z  2024-12-18T00:53:27.0867164Z [17,174 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:27.0868276Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:53:27.0869243Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:53:27.0870242Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:27.0871243Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:27.0872261Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2024-12-18T00:53:27.0873370Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:53:27.0874821Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:53:27.0875844Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 16s local ... 2024-12-18T00:53:27.3261198Z 2024-12-18T00:53:27.3262122Z  2024-12-18T00:53:27.3262648Z  2024-12-18T00:53:27.3263074Z  2024-12-18T00:53:27.3263506Z  2024-12-18T00:53:27.3263902Z  2024-12-18T00:53:27.3264299Z  2024-12-18T00:53:27.3264648Z  2024-12-18T00:53:27.3265005Z  2024-12-18T00:53:27.3265856Z [17,176 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:27.3266862Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:53:27.3267868Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:53:27.3268902Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:27.3270229Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:27.3271367Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:53:27.3272331Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:53:27.3273286Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:53:27.3274145Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local ... 2024-12-18T00:53:27.5431225Z 2024-12-18T00:53:27.5432142Z  2024-12-18T00:53:27.5432665Z  2024-12-18T00:53:27.5433092Z  2024-12-18T00:53:27.5433501Z  2024-12-18T00:53:27.5433898Z  2024-12-18T00:53:27.5434381Z  2024-12-18T00:53:27.5434755Z  2024-12-18T00:53:27.5435111Z  2024-12-18T00:53:27.5436038Z [17,176 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:27.5437086Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:53:27.5438119Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2024-12-18T00:53:27.5439158Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:53:27.5440142Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:27.5441153Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:53:27.5442099Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:53:27.5443108Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:53:27.5444032Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local ... 2024-12-18T00:53:27.9435522Z 2024-12-18T00:53:27.9436396Z  2024-12-18T00:53:27.9436884Z  2024-12-18T00:53:27.9437302Z  2024-12-18T00:53:27.9437719Z  2024-12-18T00:53:27.9438077Z  2024-12-18T00:53:27.9438453Z  2024-12-18T00:53:27.9449144Z  2024-12-18T00:53:27.9449912Z  2024-12-18T00:53:27.9450861Z [17,177 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:27.9452090Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:53:27.9453065Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:53:27.9454092Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:53:27.9455046Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2024-12-18T00:53:27.9456073Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:53:27.9457253Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:53:27.9458240Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:53:27.9459152Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local ... 2024-12-18T00:53:28.1537190Z 2024-12-18T00:53:28.1538097Z  2024-12-18T00:53:28.1538661Z  2024-12-18T00:53:28.1539119Z  2024-12-18T00:53:28.1539863Z  2024-12-18T00:53:28.1540334Z  2024-12-18T00:53:28.1540798Z  2024-12-18T00:53:28.1541260Z  2024-12-18T00:53:28.1541707Z  2024-12-18T00:53:28.1542813Z [17,179 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:28.1544121Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:53:28.1545513Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:53:28.1546855Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:53:28.1548006Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:53:28.1549211Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2024-12-18T00:53:28.1550400Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:53:28.1551569Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:53:28.1552970Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local ... 2024-12-18T00:53:28.5442527Z 2024-12-18T00:53:28.5443392Z  2024-12-18T00:53:28.5443823Z  2024-12-18T00:53:28.5444378Z  2024-12-18T00:53:28.5444764Z  2024-12-18T00:53:28.5445215Z  2024-12-18T00:53:28.5445657Z  2024-12-18T00:53:28.5446074Z  2024-12-18T00:53:28.5446426Z  2024-12-18T00:53:28.5447305Z [17,179 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:28.5448370Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:53:28.5449371Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2024-12-18T00:53:28.5450545Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:28.5451588Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:53:28.5452712Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:53:28.5453793Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:53:28.5454950Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:53:28.5456031Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local ... 2024-12-18T00:53:28.8087562Z 2024-12-18T00:53:28.8089189Z  2024-12-18T00:53:28.8089706Z  2024-12-18T00:53:28.8091186Z  2024-12-18T00:53:28.8092218Z  2024-12-18T00:53:28.8093369Z  2024-12-18T00:53:28.8094755Z  2024-12-18T00:53:28.8096053Z  2024-12-18T00:53:28.8097426Z  2024-12-18T00:53:28.8099291Z [17,181 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:28.8100455Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:53:28.8101469Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:53:28.8102848Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:28.8103920Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2024-12-18T00:53:28.8105022Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:53:28.8106119Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:53:28.8107139Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:53:28.8108110Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local ... 2024-12-18T00:53:29.1447523Z 2024-12-18T00:53:29.1448651Z  2024-12-18T00:53:29.1449095Z  2024-12-18T00:53:29.1449462Z  2024-12-18T00:53:29.1449855Z  2024-12-18T00:53:29.1450237Z  2024-12-18T00:53:29.1450610Z  2024-12-18T00:53:29.1450957Z  2024-12-18T00:53:29.1451328Z  2024-12-18T00:53:29.1452262Z [17,181 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:29.1453703Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:53:29.1454797Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:53:29.1455893Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:29.1457105Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:29.1458162Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2024-12-18T00:53:29.1459179Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:53:29.1460232Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:53:29.1461194Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local ... 2024-12-18T00:53:29.3452822Z 2024-12-18T00:53:29.3454784Z  2024-12-18T00:53:29.3455299Z  2024-12-18T00:53:29.3455710Z  2024-12-18T00:53:29.3456132Z  2024-12-18T00:53:29.3456709Z  2024-12-18T00:53:29.3457113Z  2024-12-18T00:53:29.3457509Z  2024-12-18T00:53:29.3460480Z  2024-12-18T00:53:29.3461490Z [17,182 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:29.3462622Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:53:29.3463617Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2024-12-18T00:53:29.3464901Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:29.3465965Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:29.3467086Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:53:29.3468137Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:53:29.3469236Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:53:29.3470227Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local ... 2024-12-18T00:53:29.7456263Z 2024-12-18T00:53:29.7457683Z  2024-12-18T00:53:29.7458201Z  2024-12-18T00:53:29.7458583Z  2024-12-18T00:53:29.7458974Z  2024-12-18T00:53:29.7459359Z  2024-12-18T00:53:29.7459738Z  2024-12-18T00:53:29.7460118Z  2024-12-18T00:53:29.7460524Z  2024-12-18T00:53:29.7461477Z [17,183 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:29.7462599Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:53:29.7463604Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:53:29.7464857Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:53:29.7465907Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:29.7467020Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:53:29.7468106Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:53:29.7469537Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:53:29.7470538Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local ... 2024-12-18T00:53:29.9461400Z 2024-12-18T00:53:29.9462667Z  2024-12-18T00:53:29.9463178Z  2024-12-18T00:53:29.9463609Z  2024-12-18T00:53:29.9464041Z  2024-12-18T00:53:29.9464465Z  2024-12-18T00:53:29.9464989Z  2024-12-18T00:53:29.9465345Z  2024-12-18T00:53:29.9465689Z  2024-12-18T00:53:29.9466595Z [17,184 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:53:29.9467690Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:53:29.9468677Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:53:29.9469740Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:53:29.9470871Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2024-12-18T00:53:29.9472280Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:53:29.9473357Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:53:29.9474410Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:53:29.9475429Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local ... 2024-12-18T00:53:30.1649622Z 2024-12-18T00:53:30.1650885Z  2024-12-18T00:53:30.1651393Z  2024-12-18T00:53:30.1651796Z  2024-12-18T00:53:30.1652185Z  2024-12-18T00:53:30.1652535Z  2024-12-18T00:53:30.1652934Z  2024-12-18T00:53:30.1653340Z  2024-12-18T00:53:30.1653734Z  2024-12-18T00:53:30.1654685Z [17,185 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:30.1655816Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:53:30.1657486Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:53:30.1658709Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:53:30.1659770Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:53:30.1660844Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2024-12-18T00:53:30.1661929Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:53:30.1663069Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:53:30.1664107Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local ... 2024-12-18T00:53:30.5284605Z 2024-12-18T00:53:30.5286568Z  2024-12-18T00:53:30.5287043Z  2024-12-18T00:53:30.5287441Z  2024-12-18T00:53:30.5287818Z  2024-12-18T00:53:30.5288199Z  2024-12-18T00:53:30.5288558Z  2024-12-18T00:53:30.5288910Z  2024-12-18T00:53:30.5289265Z  2024-12-18T00:53:30.5290283Z [17,186 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:30.5291377Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:53:30.5292422Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2024-12-18T00:53:30.5293512Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:30.5294612Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:53:30.5295758Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:53:30.5297000Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:53:30.5298151Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:53:30.5299186Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local ... 2024-12-18T00:53:30.7311601Z 2024-12-18T00:53:30.7313297Z  2024-12-18T00:53:30.7313884Z  2024-12-18T00:53:30.7315551Z  2024-12-18T00:53:30.7316032Z  2024-12-18T00:53:30.7316487Z  2024-12-18T00:53:30.7316873Z  2024-12-18T00:53:30.7317264Z  2024-12-18T00:53:30.7317671Z  2024-12-18T00:53:30.7318609Z [17,189 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:30.7319642Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:53:30.7320635Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 32s local 2024-12-18T00:53:30.7321809Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:30.7322947Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:53:30.7324125Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:53:30.7325240Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:53:30.7326257Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:53:30.7327602Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local ... 2024-12-18T00:53:30.9469202Z 2024-12-18T00:53:30.9470330Z  2024-12-18T00:53:30.9470815Z  2024-12-18T00:53:30.9471228Z  2024-12-18T00:53:30.9471651Z  2024-12-18T00:53:30.9472043Z  2024-12-18T00:53:30.9472414Z  2024-12-18T00:53:30.9472972Z  2024-12-18T00:53:30.9473400Z  2024-12-18T00:53:30.9474329Z [17,190 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:30.9475485Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:53:30.9476580Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 32s local 2024-12-18T00:53:30.9477794Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:30.9478957Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2024-12-18T00:53:30.9480084Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:53:30.9481621Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2024-12-18T00:53:30.9482810Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:53:30.9483785Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local ... 2024-12-18T00:53:31.1472739Z 2024-12-18T00:53:31.1473720Z  2024-12-18T00:53:31.1474209Z  2024-12-18T00:53:31.1474571Z  2024-12-18T00:53:31.1474982Z  2024-12-18T00:53:31.1475714Z  2024-12-18T00:53:31.1476095Z  2024-12-18T00:53:31.1476650Z  2024-12-18T00:53:31.1477054Z  2024-12-18T00:53:31.1478228Z [17,191 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:31.1479470Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:53:31.1480611Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:31.1481855Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:31.1483086Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2024-12-18T00:53:31.1484291Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2024-12-18T00:53:31.1485473Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:53:31.1486567Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2024-12-18T00:53:31.1487547Z Compiling xla/service/shape_inference.cc; 16s local ... 2024-12-18T00:53:31.4939495Z 2024-12-18T00:53:31.4940866Z  2024-12-18T00:53:31.4941354Z  2024-12-18T00:53:31.4941772Z  2024-12-18T00:53:31.4942185Z  2024-12-18T00:53:31.4942573Z  2024-12-18T00:53:31.4942974Z  2024-12-18T00:53:31.4943362Z  2024-12-18T00:53:31.4943748Z  2024-12-18T00:53:31.4944989Z [17,193 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:31.4946354Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:53:31.4947360Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:53:31.4948430Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:31.4949516Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:53:31.4950659Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:53:31.4951719Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2024-12-18T00:53:31.4952491Z Compiling xla/service/shape_inference.cc; 16s local 2024-12-18T00:53:31.4953372Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local ... 2024-12-18T00:53:31.6999487Z 2024-12-18T00:53:31.7000847Z  2024-12-18T00:53:31.7001339Z  2024-12-18T00:53:31.7001724Z  2024-12-18T00:53:31.7002097Z  2024-12-18T00:53:31.7002491Z  2024-12-18T00:53:31.7002883Z  2024-12-18T00:53:31.7003316Z  2024-12-18T00:53:31.7003697Z  2024-12-18T00:53:31.7004925Z [17,194 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:31.7006019Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:53:31.7006996Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:53:31.7008043Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:31.7009144Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:53:31.7010292Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:53:31.7011211Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2024-12-18T00:53:31.7012056Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2024-12-18T00:53:31.7013027Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local ... 2024-12-18T00:53:31.9479387Z 2024-12-18T00:53:31.9480625Z  2024-12-18T00:53:31.9481061Z  2024-12-18T00:53:31.9481397Z  2024-12-18T00:53:31.9482053Z  2024-12-18T00:53:31.9482391Z  2024-12-18T00:53:31.9482717Z  2024-12-18T00:53:31.9483045Z  2024-12-18T00:53:31.9483359Z  2024-12-18T00:53:31.9484291Z [17,196 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:31.9485203Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:53:31.9486058Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:53:31.9486938Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2024-12-18T00:53:31.9487866Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:53:31.9488792Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:53:31.9489622Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2024-12-18T00:53:31.9490358Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2024-12-18T00:53:31.9491205Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local ... 2024-12-18T00:53:32.1483021Z 2024-12-18T00:53:32.1484236Z  2024-12-18T00:53:32.1484708Z  2024-12-18T00:53:32.1485261Z  2024-12-18T00:53:32.1485679Z  2024-12-18T00:53:32.1486095Z  2024-12-18T00:53:32.1486499Z  2024-12-18T00:53:32.1486896Z  2024-12-18T00:53:32.1487309Z  2024-12-18T00:53:32.1488278Z [17,198 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:32.1489424Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2024-12-18T00:53:32.1490472Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:53:32.1491910Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:53:32.1493211Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2024-12-18T00:53:32.1494817Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:53:32.1496010Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2024-12-18T00:53:32.1497152Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2024-12-18T00:53:32.1498302Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local ... 2024-12-18T00:53:32.4921943Z 2024-12-18T00:53:32.4923184Z  2024-12-18T00:53:32.4923658Z  2024-12-18T00:53:32.4924070Z  2024-12-18T00:53:32.4924455Z  2024-12-18T00:53:32.4924833Z  2024-12-18T00:53:32.4925227Z  2024-12-18T00:53:32.4925614Z  2024-12-18T00:53:32.4925996Z  2024-12-18T00:53:32.4926905Z [17,201 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:32.4928045Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:53:32.4929150Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:53:32.4930583Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:53:32.4931786Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:53:32.4932800Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2024-12-18T00:53:32.4933672Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2024-12-18T00:53:32.4934604Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:53:32.4935616Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2024-12-18T00:53:32.7489323Z 2024-12-18T00:53:32.7490569Z  2024-12-18T00:53:32.7491077Z  2024-12-18T00:53:32.7491487Z  2024-12-18T00:53:32.7491884Z  2024-12-18T00:53:32.7492303Z  2024-12-18T00:53:32.7492712Z  2024-12-18T00:53:32.7493125Z  2024-12-18T00:53:32.7493509Z  2024-12-18T00:53:32.7494464Z [17,202 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:32.7496019Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:53:32.7497393Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2024-12-18T00:53:32.7498512Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:53:32.7499661Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:53:32.7500805Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2024-12-18T00:53:32.7501689Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2024-12-18T00:53:32.7502668Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:53:32.7503647Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2024-12-18T00:53:33.1280007Z 2024-12-18T00:53:33.1280985Z  2024-12-18T00:53:33.1281445Z  2024-12-18T00:53:33.1281822Z  2024-12-18T00:53:33.1282175Z  2024-12-18T00:53:33.1282517Z  2024-12-18T00:53:33.1282897Z  2024-12-18T00:53:33.1283265Z  2024-12-18T00:53:33.1283672Z  2024-12-18T00:53:33.1284610Z [17,203 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:33.1285725Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:53:33.1286796Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:53:33.1287831Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2024-12-18T00:53:33.1288844Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:53:33.1289701Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2024-12-18T00:53:33.1290460Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2024-12-18T00:53:33.1291400Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:53:33.1292340Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2024-12-18T00:53:33.3495347Z 2024-12-18T00:53:33.3496601Z  2024-12-18T00:53:33.3497069Z  2024-12-18T00:53:33.3497519Z  2024-12-18T00:53:33.3498176Z  2024-12-18T00:53:33.3498632Z  2024-12-18T00:53:33.3499077Z  2024-12-18T00:53:33.3499627Z  2024-12-18T00:53:33.3500078Z  2024-12-18T00:53:33.3501160Z [17,205 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:33.3502509Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:53:33.3503765Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2024-12-18T00:53:33.3505062Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2024-12-18T00:53:33.3506377Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:53:33.3507516Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2024-12-18T00:53:33.3508531Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2024-12-18T00:53:33.3509992Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local 2024-12-18T00:53:33.3511176Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2024-12-18T00:53:34.2001910Z 2024-12-18T00:53:34.2002890Z  2024-12-18T00:53:34.2003369Z  2024-12-18T00:53:34.2005273Z  2024-12-18T00:53:34.2005666Z  2024-12-18T00:53:34.2007393Z  2024-12-18T00:53:34.2007814Z  2024-12-18T00:53:34.2009534Z  2024-12-18T00:53:34.2009946Z  2024-12-18T00:53:34.2012279Z [17,206 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:34.2013432Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2024-12-18T00:53:34.2014526Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2024-12-18T00:53:34.2015605Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:53:34.2016848Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:53:34.2018114Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2024-12-18T00:53:34.2018970Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2024-12-18T00:53:34.2019857Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local 2024-12-18T00:53:34.2020859Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2024-12-18T00:53:34.5505996Z 2024-12-18T00:53:34.5506995Z  2024-12-18T00:53:34.5507477Z  2024-12-18T00:53:34.5507886Z  2024-12-18T00:53:34.5508274Z  2024-12-18T00:53:34.5508656Z  2024-12-18T00:53:34.5509052Z  2024-12-18T00:53:34.5509448Z  2024-12-18T00:53:34.5509850Z  2024-12-18T00:53:34.5510815Z [17,206 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:34.5512042Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:53:34.5513085Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2024-12-18T00:53:34.5514249Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:53:34.5515416Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:53:34.5516414Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2024-12-18T00:53:34.5517245Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2024-12-18T00:53:34.5518215Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local 2024-12-18T00:53:34.5519255Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local ... 2024-12-18T00:53:34.9510118Z 2024-12-18T00:53:34.9511716Z  2024-12-18T00:53:34.9512877Z  2024-12-18T00:53:34.9513860Z  2024-12-18T00:53:34.9514287Z  2024-12-18T00:53:34.9514669Z  2024-12-18T00:53:34.9515048Z  2024-12-18T00:53:34.9515446Z  2024-12-18T00:53:34.9515810Z  2024-12-18T00:53:34.9516695Z [17,208 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:34.9518117Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:53:34.9519149Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2024-12-18T00:53:34.9520243Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:53:34.9521386Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:53:34.9522368Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2024-12-18T00:53:34.9523202Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2024-12-18T00:53:34.9524138Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local 2024-12-18T00:53:34.9525146Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local ... 2024-12-18T00:53:35.1621632Z 2024-12-18T00:53:35.1622784Z  2024-12-18T00:53:35.1623261Z  2024-12-18T00:53:35.1623661Z  2024-12-18T00:53:35.1624047Z  2024-12-18T00:53:35.1624481Z  2024-12-18T00:53:35.1624873Z  2024-12-18T00:53:35.1625532Z  2024-12-18T00:53:35.1625933Z  2024-12-18T00:53:35.1626756Z [17,209 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:35.1627877Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:53:35.1628971Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:53:35.1630051Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2024-12-18T00:53:35.1631159Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:53:35.1632158Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:53:35.1632990Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2024-12-18T00:53:35.1633932Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local 2024-12-18T00:53:35.1634934Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local ... 2024-12-18T00:53:35.5515929Z 2024-12-18T00:53:35.5517517Z  2024-12-18T00:53:35.5518200Z  2024-12-18T00:53:35.5518762Z  2024-12-18T00:53:35.5519140Z  2024-12-18T00:53:35.5519507Z  2024-12-18T00:53:35.5519913Z  2024-12-18T00:53:35.5520311Z  2024-12-18T00:53:35.5520831Z  2024-12-18T00:53:35.5521811Z [17,209 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:35.5523207Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:53:35.5524487Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:53:35.5525751Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:53:35.5527059Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:53:35.5528194Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:53:35.5529180Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:53:35.5530301Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:53:35.5531476Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local ... 2024-12-18T00:53:35.8601172Z 2024-12-18T00:53:35.8602419Z  2024-12-18T00:53:35.8602928Z  2024-12-18T00:53:35.8603343Z  2024-12-18T00:53:35.8603736Z  2024-12-18T00:53:35.8604115Z  2024-12-18T00:53:35.8604492Z  2024-12-18T00:53:35.8604889Z  2024-12-18T00:53:35.8605289Z  2024-12-18T00:53:35.8606254Z [17,210 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:35.8607445Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:53:35.8608535Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2024-12-18T00:53:35.8609683Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:53:35.8611319Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:53:35.8612322Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:53:35.8613122Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:53:35.8614064Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:53:35.8615124Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local ... 2024-12-18T00:53:36.1522302Z 2024-12-18T00:53:36.1523499Z  2024-12-18T00:53:36.1523941Z  2024-12-18T00:53:36.1524291Z  2024-12-18T00:53:36.1524635Z  2024-12-18T00:53:36.1524955Z  2024-12-18T00:53:36.1525297Z  2024-12-18T00:53:36.1525635Z  2024-12-18T00:53:36.1525964Z  2024-12-18T00:53:36.1526748Z [17,210 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:36.1527682Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:53:36.1528836Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:53:36.1529722Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2024-12-18T00:53:36.1530619Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:53:36.1531396Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2024-12-18T00:53:36.1532054Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:53:36.1532791Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:53:36.1533589Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local ... 2024-12-18T00:53:36.3954485Z 2024-12-18T00:53:36.3955677Z  2024-12-18T00:53:36.3956098Z  2024-12-18T00:53:36.3956421Z  2024-12-18T00:53:36.3956757Z  2024-12-18T00:53:36.3957094Z  2024-12-18T00:53:36.3957433Z  2024-12-18T00:53:36.3957768Z  2024-12-18T00:53:36.3958085Z  2024-12-18T00:53:36.3959143Z [17,211 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:36.3960174Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2024-12-18T00:53:36.3961046Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:53:36.3961941Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:53:36.3962873Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:53:36.3963673Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2024-12-18T00:53:36.3964374Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2024-12-18T00:53:36.3965150Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:53:36.3965977Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local ... 2024-12-18T00:53:36.7528885Z 2024-12-18T00:53:36.7529742Z  2024-12-18T00:53:36.7530134Z  2024-12-18T00:53:36.7530757Z  2024-12-18T00:53:36.7531084Z  2024-12-18T00:53:36.7531401Z  2024-12-18T00:53:36.7531855Z  2024-12-18T00:53:36.7532187Z  2024-12-18T00:53:36.7532607Z  2024-12-18T00:53:36.7533381Z [17,213 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:36.7534386Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2024-12-18T00:53:36.7535305Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2024-12-18T00:53:36.7536254Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2024-12-18T00:53:36.7537361Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:53:36.7538225Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2024-12-18T00:53:36.7538992Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2024-12-18T00:53:36.7539826Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:53:36.7540976Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local ... 2024-12-18T00:53:37.6763523Z 2024-12-18T00:53:37.6764393Z  2024-12-18T00:53:37.6764818Z  2024-12-18T00:53:37.6765165Z  2024-12-18T00:53:37.6765511Z  2024-12-18T00:53:37.6765865Z  2024-12-18T00:53:37.6766213Z  2024-12-18T00:53:37.6766580Z  2024-12-18T00:53:37.6766953Z  2024-12-18T00:53:37.6767857Z [17,214 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:37.6768921Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:53:37.6769899Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2024-12-18T00:53:37.6770950Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:53:37.6772099Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:53:37.6773107Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:53:37.6774337Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2024-12-18T00:53:37.6775354Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:53:37.6776298Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local ... 2024-12-18T00:53:37.9538932Z 2024-12-18T00:53:37.9540153Z  2024-12-18T00:53:37.9540530Z  2024-12-18T00:53:37.9540860Z  2024-12-18T00:53:37.9541179Z  2024-12-18T00:53:37.9541500Z  2024-12-18T00:53:37.9541820Z  2024-12-18T00:53:37.9542120Z  2024-12-18T00:53:37.9542447Z  2024-12-18T00:53:37.9543227Z [17,215 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:37.9544136Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:53:37.9545313Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2024-12-18T00:53:37.9546144Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:53:37.9547298Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:53:37.9548148Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:53:37.9548818Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2024-12-18T00:53:37.9549565Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:53:37.9550372Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local ... 2024-12-18T00:53:38.1542705Z 2024-12-18T00:53:38.1543946Z  2024-12-18T00:53:38.1544601Z  2024-12-18T00:53:38.1544922Z  2024-12-18T00:53:38.1545237Z  2024-12-18T00:53:38.1545548Z  2024-12-18T00:53:38.1545843Z  2024-12-18T00:53:38.1546154Z  2024-12-18T00:53:38.1546468Z  2024-12-18T00:53:38.1547256Z [17,219 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:53:38.1548236Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:53:38.1549151Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:53:38.1550064Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2024-12-18T00:53:38.1551008Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:53:38.1551825Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:53:38.1552523Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2024-12-18T00:53:38.1553295Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:53:38.1554154Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local ... 2024-12-18T00:53:38.5179620Z 2024-12-18T00:53:38.5180981Z  2024-12-18T00:53:38.5181404Z  2024-12-18T00:53:38.5181763Z  2024-12-18T00:53:38.5182087Z  2024-12-18T00:53:38.5182435Z  2024-12-18T00:53:38.5182780Z  2024-12-18T00:53:38.5183128Z  2024-12-18T00:53:38.5183747Z  2024-12-18T00:53:38.5184571Z [17,223 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:38.5185553Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:53:38.5186449Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:53:38.5187353Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:53:38.5188303Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:53:38.5189120Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:53:38.5189828Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2024-12-18T00:53:38.5190574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:53:38.5191381Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local ... 2024-12-18T00:53:38.7553055Z 2024-12-18T00:53:38.7554304Z  2024-12-18T00:53:38.7554792Z  2024-12-18T00:53:38.7555212Z  2024-12-18T00:53:38.7555906Z  2024-12-18T00:53:38.7556330Z  2024-12-18T00:53:38.7556731Z  2024-12-18T00:53:38.7557148Z  2024-12-18T00:53:38.7557566Z  2024-12-18T00:53:38.7558542Z [17,224 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:38.7559807Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:53:38.7560943Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2024-12-18T00:53:38.7562129Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2024-12-18T00:53:38.7563363Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:53:38.7564410Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:53:38.7565320Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2024-12-18T00:53:38.7566513Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:53:38.7567775Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local ... 2024-12-18T00:53:39.1983581Z 2024-12-18T00:53:39.1984805Z  2024-12-18T00:53:39.1985228Z  2024-12-18T00:53:39.1985565Z  2024-12-18T00:53:39.1985906Z  2024-12-18T00:53:39.1986227Z  2024-12-18T00:53:39.1986565Z  2024-12-18T00:53:39.1986899Z  2024-12-18T00:53:39.1987235Z  2024-12-18T00:53:39.1988028Z [17,225 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:39.1988926Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:53:39.1989775Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:53:39.1990654Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:53:39.1991572Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:53:39.1992382Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:53:39.1993096Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2024-12-18T00:53:39.1993856Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:53:39.1994676Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local ... 2024-12-18T00:53:39.5554568Z 2024-12-18T00:53:39.5555689Z  2024-12-18T00:53:39.5556098Z  2024-12-18T00:53:39.5556421Z  2024-12-18T00:53:39.5556731Z  2024-12-18T00:53:39.5557055Z  2024-12-18T00:53:39.5557382Z  2024-12-18T00:53:39.5557706Z  2024-12-18T00:53:39.5558011Z  2024-12-18T00:53:39.5558786Z [17,226 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:39.5559719Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:53:39.5560770Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:53:39.5562017Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:53:39.5563016Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:53:39.5563866Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:53:39.5564635Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2024-12-18T00:53:39.5565498Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:53:39.5566416Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local ... 2024-12-18T00:53:39.7679028Z 2024-12-18T00:53:39.7679902Z  2024-12-18T00:53:39.7680381Z  2024-12-18T00:53:39.7680774Z  2024-12-18T00:53:39.7681154Z  2024-12-18T00:53:39.7681534Z  2024-12-18T00:53:39.7681917Z  2024-12-18T00:53:39.7682274Z  2024-12-18T00:53:39.7682624Z  2024-12-18T00:53:39.7683552Z [17,228 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:39.7684966Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:53:39.7686062Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2024-12-18T00:53:39.7687051Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:53:39.7688185Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:53:39.7689149Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:53:39.7690006Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2024-12-18T00:53:39.7690941Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:53:39.7692025Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local ... 2024-12-18T00:53:40.1560994Z 2024-12-18T00:53:40.1561878Z  2024-12-18T00:53:40.1562380Z  2024-12-18T00:53:40.1562778Z  2024-12-18T00:53:40.1563318Z  2024-12-18T00:53:40.1563689Z  2024-12-18T00:53:40.1564088Z  2024-12-18T00:53:40.1564425Z  2024-12-18T00:53:40.1564827Z  2024-12-18T00:53:40.1566149Z [17,229 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:40.1567290Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:53:40.1568306Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2024-12-18T00:53:40.1569334Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2024-12-18T00:53:40.1570477Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:53:40.1571500Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:53:40.1572327Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2024-12-18T00:53:40.1573197Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:53:40.1574190Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local ... 2024-12-18T00:53:41.0742142Z 2024-12-18T00:53:41.0743242Z  2024-12-18T00:53:41.0743737Z  2024-12-18T00:53:41.0744412Z  2024-12-18T00:53:41.0744796Z  2024-12-18T00:53:41.0745199Z  2024-12-18T00:53:41.0745603Z  2024-12-18T00:53:41.0745996Z  2024-12-18T00:53:41.0746408Z  2024-12-18T00:53:41.0747653Z [17,230 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:41.0748800Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:53:41.0750002Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:53:41.0751257Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2024-12-18T00:53:41.0752518Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2024-12-18T00:53:41.0753615Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:53:41.0754599Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:53:41.0755989Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:53:41.0757179Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local ... 2024-12-18T00:53:41.3382566Z 2024-12-18T00:53:41.3383419Z  2024-12-18T00:53:41.3383930Z  2024-12-18T00:53:41.3384347Z  2024-12-18T00:53:41.3384762Z  2024-12-18T00:53:41.3385162Z  2024-12-18T00:53:41.3385569Z  2024-12-18T00:53:41.3385969Z  2024-12-18T00:53:41.3386392Z  2024-12-18T00:53:41.3387328Z [17,231 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:41.3388522Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:53:41.3389642Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:53:41.3390776Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:53:41.3391793Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:53:41.3392988Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:53:41.3394005Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:53:41.3395003Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:41.3395988Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local ... 2024-12-18T00:53:41.5570481Z 2024-12-18T00:53:41.5571360Z  2024-12-18T00:53:41.5571842Z  2024-12-18T00:53:41.5572250Z  2024-12-18T00:53:41.5572619Z  2024-12-18T00:53:41.5573001Z  2024-12-18T00:53:41.5573400Z  2024-12-18T00:53:41.5573785Z  2024-12-18T00:53:41.5574176Z  2024-12-18T00:53:41.5575130Z [17,231 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:41.5576776Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:53:41.5578008Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:53:41.5579569Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:53:41.5580729Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:53:41.5581622Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:53:41.5582594Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:53:41.5583625Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:41.5584604Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local ... 2024-12-18T00:53:41.8135088Z 2024-12-18T00:53:41.8136064Z  2024-12-18T00:53:41.8136707Z  2024-12-18T00:53:41.8137058Z  2024-12-18T00:53:41.8137408Z  2024-12-18T00:53:41.8137762Z  2024-12-18T00:53:41.8138118Z  2024-12-18T00:53:41.8138512Z  2024-12-18T00:53:41.8138885Z  2024-12-18T00:53:41.8139805Z [17,233 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:41.8140970Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:53:41.8142004Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2024-12-18T00:53:41.8143132Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:53:41.8144087Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:53:41.8145176Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:53:41.8146085Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:53:41.8147014Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:41.8147968Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local ... 2024-12-18T00:53:42.1576759Z 2024-12-18T00:53:42.1577634Z  2024-12-18T00:53:42.1578102Z  2024-12-18T00:53:42.1578501Z  2024-12-18T00:53:42.1578896Z  2024-12-18T00:53:42.1579449Z  2024-12-18T00:53:42.1580238Z  2024-12-18T00:53:42.1580629Z  2024-12-18T00:53:42.1581031Z  2024-12-18T00:53:42.1582022Z [17,233 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:42.1583190Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:53:42.1584252Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:53:42.1585240Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2024-12-18T00:53:42.1586659Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:53:42.1587465Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:53:42.1588564Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:53:42.1589701Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2024-12-18T00:53:42.1590796Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local ... 2024-12-18T00:53:42.3580696Z 2024-12-18T00:53:42.3581630Z  2024-12-18T00:53:42.3582107Z  2024-12-18T00:53:42.3582778Z  2024-12-18T00:53:42.3583203Z  2024-12-18T00:53:42.3583602Z  2024-12-18T00:53:42.3584007Z  2024-12-18T00:53:42.3584410Z  2024-12-18T00:53:42.3584807Z  2024-12-18T00:53:42.3585757Z [17,235 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:42.3586777Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:53:42.3587794Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:53:42.3588878Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:53:42.3589859Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2024-12-18T00:53:42.3590682Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:53:42.3591477Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:53:42.3592426Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:53:42.3593694Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local ... 2024-12-18T00:53:42.9150146Z 2024-12-18T00:53:42.9151091Z  2024-12-18T00:53:42.9151528Z  2024-12-18T00:53:42.9153613Z  2024-12-18T00:53:42.9166908Z  2024-12-18T00:53:42.9170293Z  2024-12-18T00:53:42.9173193Z  2024-12-18T00:53:42.9176185Z  2024-12-18T00:53:42.9179258Z  2024-12-18T00:53:42.9182705Z [17,236 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:42.9184270Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:53:42.9185584Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2024-12-18T00:53:42.9186884Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:53:42.9188060Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2024-12-18T00:53:42.9189176Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:53:42.9190464Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:53:42.9191691Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:53:42.9192867Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local ... 2024-12-18T00:53:43.1587001Z 2024-12-18T00:53:43.1588311Z  2024-12-18T00:53:43.1589092Z  2024-12-18T00:53:43.1590194Z  2024-12-18T00:53:43.1590614Z  2024-12-18T00:53:43.1590955Z  2024-12-18T00:53:43.1591318Z  2024-12-18T00:53:43.1591671Z  2024-12-18T00:53:43.1592022Z  2024-12-18T00:53:43.1592878Z [17,236 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:43.1593894Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:53:43.1595037Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:53:43.1596349Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2024-12-18T00:53:43.1597270Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:53:43.1598226Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:53:43.1599272Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:53:43.1600138Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2024-12-18T00:53:43.1601090Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:53:43.3591530Z 2024-12-18T00:53:43.3592412Z  2024-12-18T00:53:43.3592921Z  2024-12-18T00:53:43.3593295Z  2024-12-18T00:53:43.3593607Z  2024-12-18T00:53:43.3593942Z  2024-12-18T00:53:43.3594269Z  2024-12-18T00:53:43.3594596Z  2024-12-18T00:53:43.3594926Z  2024-12-18T00:53:43.3595708Z [17,237 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:43.3596683Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:53:43.3597859Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:53:43.3598716Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:53:43.3599507Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:53:43.3600213Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:53:43.3601421Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:53:43.3602448Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:53:43.3603291Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:53:43.7597594Z 2024-12-18T00:53:43.7598514Z  2024-12-18T00:53:43.7598977Z  2024-12-18T00:53:43.7599394Z  2024-12-18T00:53:43.7600043Z  2024-12-18T00:53:43.7600451Z  2024-12-18T00:53:43.7600976Z  2024-12-18T00:53:43.7601472Z  2024-12-18T00:53:43.7602001Z  2024-12-18T00:53:43.7603341Z [17,238 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:43.7604727Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:53:43.7605839Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:53:43.7606917Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:53:43.7607896Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:53:43.7608793Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:53:43.7609810Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:53:43.7610933Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:53:43.7611970Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:53:43.9601037Z 2024-12-18T00:53:43.9601865Z  2024-12-18T00:53:43.9602379Z  2024-12-18T00:53:43.9602782Z  2024-12-18T00:53:43.9603198Z  2024-12-18T00:53:43.9603578Z  2024-12-18T00:53:43.9603964Z  2024-12-18T00:53:43.9604336Z  2024-12-18T00:53:43.9604686Z  2024-12-18T00:53:43.9605570Z [17,239 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:43.9606726Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:53:43.9607756Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2024-12-18T00:53:43.9608805Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2024-12-18T00:53:43.9609744Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:53:43.9610580Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:53:43.9611487Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:53:43.9612450Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2024-12-18T00:53:43.9613735Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:53:44.3606920Z 2024-12-18T00:53:44.3607805Z  2024-12-18T00:53:44.3610305Z  2024-12-18T00:53:44.3613657Z  2024-12-18T00:53:44.3617394Z  2024-12-18T00:53:44.3620739Z  2024-12-18T00:53:44.3624067Z  2024-12-18T00:53:44.3627368Z  2024-12-18T00:53:44.3630521Z  2024-12-18T00:53:44.3634170Z [17,240 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:44.3637816Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:53:44.3641104Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:53:44.3644591Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:53:44.3647601Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:53:44.3650463Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:53:44.3653651Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:53:44.3656846Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:53:44.3659772Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local ... 2024-12-18T00:53:44.6539338Z 2024-12-18T00:53:44.6542591Z  2024-12-18T00:53:44.6545524Z  2024-12-18T00:53:44.6548153Z  2024-12-18T00:53:44.6550764Z  2024-12-18T00:53:44.6553390Z  2024-12-18T00:53:44.6555972Z  2024-12-18T00:53:44.6558240Z  2024-12-18T00:53:44.6558906Z  2024-12-18T00:53:44.6560653Z [17,241 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:44.6561846Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:53:44.6562927Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:53:44.6564048Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:53:44.6565925Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:53:44.6566848Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:53:44.6567872Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:53:44.6569058Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:53:44.6570009Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local ... 2024-12-18T00:53:44.9612032Z 2024-12-18T00:53:44.9613051Z  2024-12-18T00:53:44.9613524Z  2024-12-18T00:53:44.9613934Z  2024-12-18T00:53:44.9614340Z  2024-12-18T00:53:44.9614752Z  2024-12-18T00:53:44.9615140Z  2024-12-18T00:53:44.9615547Z  2024-12-18T00:53:44.9615955Z  2024-12-18T00:53:44.9617045Z [17,244 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:44.9618250Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:53:44.9619730Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2024-12-18T00:53:44.9620988Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2024-12-18T00:53:44.9622087Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:53:44.9623067Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:53:44.9624131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:53:44.9625233Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:53:44.9626324Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local ... 2024-12-18T00:53:45.2225634Z 2024-12-18T00:53:45.2226614Z  2024-12-18T00:53:45.2227071Z  2024-12-18T00:53:45.2227465Z  2024-12-18T00:53:45.2227835Z  2024-12-18T00:53:45.2228182Z  2024-12-18T00:53:45.2228584Z  2024-12-18T00:53:45.2228958Z  2024-12-18T00:53:45.2229588Z  2024-12-18T00:53:45.2230475Z [17,246 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:45.2231521Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:53:45.2232482Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:53:45.2233618Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:53:45.2234518Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:53:45.2235330Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:53:45.2236241Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2024-12-18T00:53:45.2237128Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2024-12-18T00:53:45.2238028Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local ... 2024-12-18T00:53:45.5618056Z 2024-12-18T00:53:45.5618930Z  2024-12-18T00:53:45.5619382Z  2024-12-18T00:53:45.5619820Z  2024-12-18T00:53:45.5620196Z  2024-12-18T00:53:45.5620848Z  2024-12-18T00:53:45.5621269Z  2024-12-18T00:53:45.5621682Z  2024-12-18T00:53:45.5622087Z  2024-12-18T00:53:45.5623043Z [17,247 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:45.5624208Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:53:45.5625240Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:53:45.5626299Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:53:45.5627248Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:53:45.5628067Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:53:45.5629036Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:53:45.5629920Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2024-12-18T00:53:45.5631368Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local ... 2024-12-18T00:53:45.7623130Z 2024-12-18T00:53:45.7624017Z  2024-12-18T00:53:45.7625640Z  2024-12-18T00:53:45.7626482Z  2024-12-18T00:53:45.7627286Z  2024-12-18T00:53:45.7627703Z  2024-12-18T00:53:45.7628107Z  2024-12-18T00:53:45.7628498Z  2024-12-18T00:53:45.7628900Z  2024-12-18T00:53:45.7629828Z [17,248 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:45.7630941Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:53:45.7631979Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2024-12-18T00:53:45.7633008Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:53:45.7633924Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:53:45.7634792Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:53:45.7635787Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:53:45.7636655Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2024-12-18T00:53:45.7637556Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local ... 2024-12-18T00:53:46.1147442Z 2024-12-18T00:53:46.1148761Z  2024-12-18T00:53:46.1149234Z  2024-12-18T00:53:46.1149667Z  2024-12-18T00:53:46.1150053Z  2024-12-18T00:53:46.1150445Z  2024-12-18T00:53:46.1150823Z  2024-12-18T00:53:46.1151198Z  2024-12-18T00:53:46.1151595Z  2024-12-18T00:53:46.1152538Z [17,249 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:46.1153653Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:53:46.1154702Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:53:46.1155781Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2024-12-18T00:53:46.1157054Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:53:46.1157913Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:53:46.1158893Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2024-12-18T00:53:46.1159793Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:53:46.1160748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local ... 2024-12-18T00:53:46.3627738Z 2024-12-18T00:53:46.3628631Z  2024-12-18T00:53:46.3629100Z  2024-12-18T00:53:46.3629487Z  2024-12-18T00:53:46.3630214Z  2024-12-18T00:53:46.3630586Z  2024-12-18T00:53:46.3631150Z  2024-12-18T00:53:46.3631672Z  2024-12-18T00:53:46.3632191Z  2024-12-18T00:53:46.3633239Z [17,249 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:46.3634520Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:46.3635976Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:53:46.3637254Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:53:46.3638308Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:53:46.3639286Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:53:46.3640362Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2024-12-18T00:53:46.3641373Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:53:46.3642401Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local ... 2024-12-18T00:53:46.6367339Z 2024-12-18T00:53:46.6368226Z  2024-12-18T00:53:46.6368689Z  2024-12-18T00:53:46.6369088Z  2024-12-18T00:53:46.6369516Z  2024-12-18T00:53:46.6369920Z  2024-12-18T00:53:46.6370323Z  2024-12-18T00:53:46.6370697Z  2024-12-18T00:53:46.6371079Z  2024-12-18T00:53:46.6372652Z [17,250 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:46.6373875Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:46.6375118Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:53:46.6376271Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:53:46.6377475Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:53:46.6378499Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:53:46.6379564Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2024-12-18T00:53:46.6380574Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:53:46.6381569Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local ... 2024-12-18T00:53:46.8384063Z 2024-12-18T00:53:46.8384955Z  2024-12-18T00:53:46.8385447Z  2024-12-18T00:53:46.8385866Z  2024-12-18T00:53:46.8386279Z  2024-12-18T00:53:46.8386722Z  2024-12-18T00:53:46.8387122Z  2024-12-18T00:53:46.8387505Z  2024-12-18T00:53:46.8387905Z  2024-12-18T00:53:46.8388828Z [17,253 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:46.8390082Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:46.8391557Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2024-12-18T00:53:46.8392777Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:53:46.8393822Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:53:46.8394826Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:53:46.8395881Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2024-12-18T00:53:46.8396883Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:53:46.8398220Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local ... 2024-12-18T00:53:47.0578737Z 2024-12-18T00:53:47.0579636Z  2024-12-18T00:53:47.0582314Z  2024-12-18T00:53:47.0585291Z  2024-12-18T00:53:47.0588683Z  2024-12-18T00:53:47.0591910Z  2024-12-18T00:53:47.0595140Z  2024-12-18T00:53:47.0598353Z  2024-12-18T00:53:47.0601461Z  2024-12-18T00:53:47.0604893Z [17,256 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:47.0608419Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:47.0612163Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:47.0615952Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2024-12-18T00:53:47.0619210Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:53:47.0622201Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:53:47.0625490Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:53:47.0628534Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2024-12-18T00:53:47.0631842Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local ... 2024-12-18T00:53:47.3635831Z 2024-12-18T00:53:47.3639281Z  2024-12-18T00:53:47.3642357Z  2024-12-18T00:53:47.3645541Z  2024-12-18T00:53:47.3648441Z  2024-12-18T00:53:47.3651350Z  2024-12-18T00:53:47.3653965Z  2024-12-18T00:53:47.3654559Z  2024-12-18T00:53:47.3655263Z  2024-12-18T00:53:47.3656629Z [17,256 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:47.3657913Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:53:47.3659081Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:47.3660289Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:53:47.3661748Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:53:47.3662852Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:53:47.3663831Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:53:47.3664866Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:53:47.3666061Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local ... 2024-12-18T00:53:47.5639606Z 2024-12-18T00:53:47.5640688Z  2024-12-18T00:53:47.5641483Z  2024-12-18T00:53:47.5642643Z  2024-12-18T00:53:47.5643092Z  2024-12-18T00:53:47.5643474Z  2024-12-18T00:53:47.5643863Z  2024-12-18T00:53:47.5644504Z  2024-12-18T00:53:47.5644930Z  2024-12-18T00:53:47.5645905Z [17,257 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:47.5647046Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:53:47.5648159Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:47.5649282Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:53:47.5650253Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:53:47.5651172Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:53:47.5652102Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:53:47.5653030Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:53:47.5654125Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local ... 2024-12-18T00:53:47.7704587Z 2024-12-18T00:53:47.7705497Z  2024-12-18T00:53:47.7706214Z  2024-12-18T00:53:47.7706746Z  2024-12-18T00:53:47.7707283Z  2024-12-18T00:53:47.7707781Z  2024-12-18T00:53:47.7708276Z  2024-12-18T00:53:47.7708807Z  2024-12-18T00:53:47.7709324Z  2024-12-18T00:53:47.7710714Z [17,258 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:47.7711967Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:53:47.7713183Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2024-12-18T00:53:47.7714413Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:53:47.7715514Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:53:47.7716510Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:53:47.7717552Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:53:47.7718602Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:53:47.7719780Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local ... 2024-12-18T00:53:48.1646735Z 2024-12-18T00:53:48.1647676Z  2024-12-18T00:53:48.1648148Z  2024-12-18T00:53:48.1648971Z  2024-12-18T00:53:48.1649556Z  2024-12-18T00:53:48.1650363Z  2024-12-18T00:53:48.1650917Z  2024-12-18T00:53:48.1651449Z  2024-12-18T00:53:48.1651984Z  2024-12-18T00:53:48.1653061Z [17,259 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:48.1654375Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:53:48.1655644Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:53:48.1657054Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2024-12-18T00:53:48.1658188Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:53:48.1659206Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:53:48.1660234Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:53:48.1661251Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2024-12-18T00:53:48.1662442Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local ... 2024-12-18T00:53:48.3650269Z 2024-12-18T00:53:48.3651157Z  2024-12-18T00:53:48.3651653Z  2024-12-18T00:53:48.3652065Z  2024-12-18T00:53:48.3652460Z  2024-12-18T00:53:48.3652828Z  2024-12-18T00:53:48.3653221Z  2024-12-18T00:53:48.3653603Z  2024-12-18T00:53:48.3654018Z  2024-12-18T00:53:48.3654956Z [17,260 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:48.3656107Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2024-12-18T00:53:48.3657457Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:53:48.3658542Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:53:48.3659463Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:53:48.3660220Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:53:48.3661662Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:53:48.3662578Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2024-12-18T00:53:48.3663837Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local ... 2024-12-18T00:53:48.7655776Z 2024-12-18T00:53:48.7656869Z  2024-12-18T00:53:48.7658582Z  2024-12-18T00:53:48.7660085Z  2024-12-18T00:53:48.7661465Z  2024-12-18T00:53:48.7662408Z  2024-12-18T00:53:48.7663253Z  2024-12-18T00:53:48.7663717Z  2024-12-18T00:53:48.7664124Z  2024-12-18T00:53:48.7664913Z [17,261 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:48.7666784Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2024-12-18T00:53:48.7667844Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2024-12-18T00:53:48.7668904Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2024-12-18T00:53:48.7670186Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:53:48.7671020Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2024-12-18T00:53:48.7671869Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:53:48.7672733Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2024-12-18T00:53:48.7673751Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local ... 2024-12-18T00:53:49.5874058Z 2024-12-18T00:53:49.5874925Z  2024-12-18T00:53:49.5875550Z  2024-12-18T00:53:49.5875956Z  2024-12-18T00:53:49.5876342Z  2024-12-18T00:53:49.5876766Z  2024-12-18T00:53:49.5877186Z  2024-12-18T00:53:49.5877607Z  2024-12-18T00:53:49.5877978Z  2024-12-18T00:53:49.5878950Z [17,262 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:49.5880181Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:53:49.5881679Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2024-12-18T00:53:49.5882851Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:53:49.5884112Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:53:49.5884920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:53:49.5885999Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:53:49.5887050Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2024-12-18T00:53:49.5888235Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local ... 2024-12-18T00:53:49.9345845Z 2024-12-18T00:53:49.9346780Z  2024-12-18T00:53:49.9347252Z  2024-12-18T00:53:49.9349940Z  2024-12-18T00:53:49.9352693Z  2024-12-18T00:53:49.9355450Z  2024-12-18T00:53:49.9358187Z  2024-12-18T00:53:49.9360995Z  2024-12-18T00:53:49.9363665Z  2024-12-18T00:53:49.9367151Z [17,266 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:49.9370814Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:53:49.9374026Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2024-12-18T00:53:49.9377518Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:53:49.9380735Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:53:49.9383802Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:53:49.9386862Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:53:49.9389919Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2024-12-18T00:53:49.9393093Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local ... 2024-12-18T00:53:50.1664421Z 2024-12-18T00:53:50.1667884Z  2024-12-18T00:53:50.1670862Z  2024-12-18T00:53:50.1673842Z  2024-12-18T00:53:50.1676688Z  2024-12-18T00:53:50.1679552Z  2024-12-18T00:53:50.1682337Z  2024-12-18T00:53:50.1682938Z  2024-12-18T00:53:50.1683480Z  2024-12-18T00:53:50.1684564Z [17,267 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:50.1685871Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:53:50.1687022Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:53:50.1688185Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2024-12-18T00:53:50.1689238Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:53:50.1690255Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:53:50.1691292Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:53:50.1692334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2024-12-18T00:53:50.1693771Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local ... 2024-12-18T00:53:50.5069224Z 2024-12-18T00:53:50.5070463Z  2024-12-18T00:53:50.5071319Z  2024-12-18T00:53:50.5071949Z  2024-12-18T00:53:50.5073091Z  2024-12-18T00:53:50.5073526Z  2024-12-18T00:53:50.5073927Z  2024-12-18T00:53:50.5074329Z  2024-12-18T00:53:50.5074728Z  2024-12-18T00:53:50.5075641Z [17,270 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:50.5076835Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:53:50.5077915Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:53:50.5079044Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:53:50.5079987Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:53:50.5080825Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:53:50.5082057Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:53:50.5083021Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2024-12-18T00:53:50.5084118Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local ... 2024-12-18T00:53:50.7670135Z 2024-12-18T00:53:50.7671353Z  2024-12-18T00:53:50.7671828Z  2024-12-18T00:53:50.7672317Z  2024-12-18T00:53:50.7672732Z  2024-12-18T00:53:50.7673140Z  2024-12-18T00:53:50.7673515Z  2024-12-18T00:53:50.7673914Z  2024-12-18T00:53:50.7674306Z  2024-12-18T00:53:50.7675242Z [17,270 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:50.7676394Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:53:50.7677454Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2024-12-18T00:53:50.7678450Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:53:50.7679681Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:53:50.7680687Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:53:50.7681425Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:53:50.7682262Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2024-12-18T00:53:50.7683268Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local ... 2024-12-18T00:53:51.1135511Z 2024-12-18T00:53:51.1136951Z  2024-12-18T00:53:51.1137455Z  2024-12-18T00:53:51.1137865Z  2024-12-18T00:53:51.1138215Z  2024-12-18T00:53:51.1138565Z  2024-12-18T00:53:51.1138943Z  2024-12-18T00:53:51.1139335Z  2024-12-18T00:53:51.1139717Z  2024-12-18T00:53:51.1140632Z [17,271 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:51.1141721Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:53:51.1142828Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:53:51.1143931Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2024-12-18T00:53:51.1145169Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:53:51.1146103Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:53:51.1147001Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2024-12-18T00:53:51.1148053Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:53:51.1148946Z Compiling xla/hlo/ir/hlo_module.cc; 20s local ... 2024-12-18T00:53:51.3676268Z 2024-12-18T00:53:51.3677541Z  2024-12-18T00:53:51.3678036Z  2024-12-18T00:53:51.3678439Z  2024-12-18T00:53:51.3678848Z  2024-12-18T00:53:51.3679230Z  2024-12-18T00:53:51.3679600Z  2024-12-18T00:53:51.3680035Z  2024-12-18T00:53:51.3680419Z  2024-12-18T00:53:51.3681664Z [17,272 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:51.3682840Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:51.3683828Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:53:51.3684869Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:53:51.3685898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:53:51.3686760Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:53:51.3687658Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:53:51.3688647Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:53:51.3689471Z Compiling xla/hlo/ir/hlo_module.cc; 20s local ... 2024-12-18T00:53:51.5680729Z 2024-12-18T00:53:51.5681591Z  2024-12-18T00:53:51.5682054Z  2024-12-18T00:53:51.5682463Z  2024-12-18T00:53:51.5682846Z  2024-12-18T00:53:51.5683215Z  2024-12-18T00:53:51.5683899Z  2024-12-18T00:53:51.5684295Z  2024-12-18T00:53:51.5684676Z  2024-12-18T00:53:51.5685559Z [17,274 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:51.5686718Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:51.5687668Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:53:51.5688649Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:53:51.5689571Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:53:51.5690386Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:53:51.5691263Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:53:51.5692212Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 21s local 2024-12-18T00:53:51.5693052Z Compiling xla/hlo/ir/hlo_module.cc; 20s local ... 2024-12-18T00:53:51.9234281Z 2024-12-18T00:53:51.9235173Z  2024-12-18T00:53:51.9235671Z  2024-12-18T00:53:51.9236079Z  2024-12-18T00:53:51.9236427Z  2024-12-18T00:53:51.9236817Z  2024-12-18T00:53:51.9237207Z  2024-12-18T00:53:51.9237555Z  2024-12-18T00:53:51.9237958Z  2024-12-18T00:53:51.9238827Z [17,276 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:51.9239866Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:51.9240902Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2024-12-18T00:53:51.9241950Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:53:51.9242937Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:53:51.9243860Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:53:51.9245062Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:53:51.9245963Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:53:51.9246878Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local ... 2024-12-18T00:53:52.1686793Z 2024-12-18T00:53:52.1687652Z  2024-12-18T00:53:52.1688109Z  2024-12-18T00:53:52.1688506Z  2024-12-18T00:53:52.1688906Z  2024-12-18T00:53:52.1689291Z  2024-12-18T00:53:52.1689687Z  2024-12-18T00:53:52.1690108Z  2024-12-18T00:53:52.1690503Z  2024-12-18T00:53:52.1691457Z [17,276 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:52.1692531Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:52.1693572Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:52.1695100Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2024-12-18T00:53:52.1696770Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:53:52.1697860Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:53:52.1698943Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:53:52.1699989Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:53:52.1701080Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local ... 2024-12-18T00:53:52.3691527Z 2024-12-18T00:53:52.3692454Z  2024-12-18T00:53:52.3692916Z  2024-12-18T00:53:52.3693830Z  2024-12-18T00:53:52.3694247Z  2024-12-18T00:53:52.3694665Z  2024-12-18T00:53:52.3695030Z  2024-12-18T00:53:52.3695620Z  2024-12-18T00:53:52.3696176Z  2024-12-18T00:53:52.3697393Z [17,278 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:52.3698735Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:53:52.3700235Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:52.3701630Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:53:52.3702807Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:53:52.3703818Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:53:52.3704823Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:52.3705767Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:53:52.3706830Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local ... 2024-12-18T00:53:52.5833738Z 2024-12-18T00:53:52.5834814Z  2024-12-18T00:53:52.5835462Z  2024-12-18T00:53:52.5836004Z  2024-12-18T00:53:52.5836539Z  2024-12-18T00:53:52.5837047Z  2024-12-18T00:53:52.5837573Z  2024-12-18T00:53:52.5838096Z  2024-12-18T00:53:52.5838613Z  2024-12-18T00:53:52.5839974Z [17,280 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:52.5841387Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:53:52.5842573Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:52.5843829Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:53:52.5845280Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:53:52.5846384Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:53:52.5847988Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:52.5849111Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:53:52.5850289Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local ... 2024-12-18T00:53:52.9698148Z 2024-12-18T00:53:52.9700494Z  2024-12-18T00:53:52.9702402Z  2024-12-18T00:53:52.9704272Z  2024-12-18T00:53:52.9706088Z  2024-12-18T00:53:52.9707929Z  2024-12-18T00:53:52.9709736Z  2024-12-18T00:53:52.9711511Z  2024-12-18T00:53:52.9713312Z  2024-12-18T00:53:52.9715763Z [17,280 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:52.9718314Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:53:52.9720778Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2024-12-18T00:53:52.9723262Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2024-12-18T00:53:52.9725759Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:53:52.9728052Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:53:52.9730389Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:52.9732719Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:53:52.9735471Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local ... 2024-12-18T00:53:53.1702437Z 2024-12-18T00:53:53.1705018Z  2024-12-18T00:53:53.1708795Z  2024-12-18T00:53:53.1709232Z  2024-12-18T00:53:53.1709635Z  2024-12-18T00:53:53.1710062Z  2024-12-18T00:53:53.1710468Z  2024-12-18T00:53:53.1710844Z  2024-12-18T00:53:53.1711239Z  2024-12-18T00:53:53.1712205Z [17,281 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:53.1713418Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:53:53.1714449Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:53:53.1715551Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:53:53.1716592Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:53:53.1717513Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:53:53.1718780Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:53.1719716Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:53:53.1720622Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local ... 2024-12-18T00:53:53.5682431Z 2024-12-18T00:53:53.5683331Z  2024-12-18T00:53:53.5683779Z  2024-12-18T00:53:53.5684180Z  2024-12-18T00:53:53.5684573Z  2024-12-18T00:53:53.5684954Z  2024-12-18T00:53:53.5685344Z  2024-12-18T00:53:53.5685719Z  2024-12-18T00:53:53.5686108Z  2024-12-18T00:53:53.5687013Z [17,282 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:53.5688154Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:53:53.5689176Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:53:53.5690235Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:53:53.5691521Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:53:53.5692504Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:53:53.5693368Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:53:53.5694228Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:53:53.5695107Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local ... 2024-12-18T00:53:53.7710160Z 2024-12-18T00:53:53.7711023Z  2024-12-18T00:53:53.7711476Z  2024-12-18T00:53:53.7711851Z  2024-12-18T00:53:53.7712227Z  2024-12-18T00:53:53.7712624Z  2024-12-18T00:53:53.7713024Z  2024-12-18T00:53:53.7713413Z  2024-12-18T00:53:53.7713798Z  2024-12-18T00:53:53.7714748Z [17,282 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:53.7715991Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:53:53.7717076Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2024-12-18T00:53:53.7718153Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2024-12-18T00:53:53.7719180Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:53:53.7720025Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:53:53.7720928Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:53:53.7721867Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:53:53.7722796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local ... 2024-12-18T00:53:54.2312479Z 2024-12-18T00:53:54.2313396Z  2024-12-18T00:53:54.2313892Z  2024-12-18T00:53:54.2314276Z  2024-12-18T00:53:54.2314691Z  2024-12-18T00:53:54.2315114Z  2024-12-18T00:53:54.2315522Z  2024-12-18T00:53:54.2315924Z  2024-12-18T00:53:54.2316632Z  2024-12-18T00:53:54.2317610Z [17,283 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:54.2318796Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:53:54.2319874Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:53:54.2320970Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:53:54.2322019Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:53:54.2323050Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:53:54.2323972Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:53:54.2324846Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:53:54.2325659Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local ... 2024-12-18T00:53:54.4378773Z 2024-12-18T00:53:54.4379686Z  2024-12-18T00:53:54.4380159Z  2024-12-18T00:53:54.4380587Z  2024-12-18T00:53:54.4380973Z  2024-12-18T00:53:54.4381556Z  2024-12-18T00:53:54.4381936Z  2024-12-18T00:53:54.4382329Z  2024-12-18T00:53:54.4382720Z  2024-12-18T00:53:54.4383703Z [17,285 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:54.4384887Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:53:54.4385990Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:53:54.4387144Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:53:54.4388252Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:53:54.4389189Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:53:54.4390135Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:53:54.4390875Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:53:54.4392045Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local ... 2024-12-18T00:53:54.7718669Z 2024-12-18T00:53:54.7719522Z  2024-12-18T00:53:54.7720023Z  2024-12-18T00:53:54.7720418Z  2024-12-18T00:53:54.7720813Z  2024-12-18T00:53:54.7721170Z  2024-12-18T00:53:54.7721541Z  2024-12-18T00:53:54.7721943Z  2024-12-18T00:53:54.7722472Z  2024-12-18T00:53:54.7723444Z [17,286 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:54.7724602Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:53:54.7725604Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:53:54.7726686Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:53:54.7727742Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:53:54.7728521Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:53:54.7729404Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:53:54.7730255Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:53:54.7731106Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local ... 2024-12-18T00:53:55.0023569Z 2024-12-18T00:53:55.0024428Z  2024-12-18T00:53:55.0024856Z  2024-12-18T00:53:55.0025199Z  2024-12-18T00:53:55.0025566Z  2024-12-18T00:53:55.0025933Z  2024-12-18T00:53:55.0026294Z  2024-12-18T00:53:55.0026660Z  2024-12-18T00:53:55.0027025Z  2024-12-18T00:53:55.0027897Z [17,287 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:55.0028934Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:53:55.0029842Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2024-12-18T00:53:55.0030784Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2024-12-18T00:53:55.0032108Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:53:55.0032875Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:53:55.0033673Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:53:55.0034452Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:53:55.0035279Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local ... 2024-12-18T00:53:55.3724441Z 2024-12-18T00:53:55.3725289Z  2024-12-18T00:53:55.3725781Z  2024-12-18T00:53:55.3726171Z  2024-12-18T00:53:55.3726576Z  2024-12-18T00:53:55.3726955Z  2024-12-18T00:53:55.3727331Z  2024-12-18T00:53:55.3727709Z  2024-12-18T00:53:55.3728079Z  2024-12-18T00:53:55.3729001Z [17,288 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:55.3730092Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:53:55.3731223Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:53:55.3732303Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:53:55.3733298Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:53:55.3734159Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:53:55.3735019Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:53:55.3735868Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:53:55.3736968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local ... 2024-12-18T00:53:55.6762098Z 2024-12-18T00:53:55.6762989Z  2024-12-18T00:53:55.6763467Z  2024-12-18T00:53:55.6763837Z  2024-12-18T00:53:55.6764211Z  2024-12-18T00:53:55.6764613Z  2024-12-18T00:53:55.6764996Z  2024-12-18T00:53:55.6765373Z  2024-12-18T00:53:55.6765781Z  2024-12-18T00:53:55.6766937Z [17,291 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:55.6768401Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:53:55.6769629Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:53:55.6770836Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:53:55.6771965Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:53:55.6772785Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:53:55.6773652Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:53:55.6774676Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:53:55.6775534Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local ... 2024-12-18T00:53:55.9436817Z 2024-12-18T00:53:55.9437717Z  2024-12-18T00:53:55.9438182Z  2024-12-18T00:53:55.9438627Z  2024-12-18T00:53:55.9439023Z  2024-12-18T00:53:55.9439468Z  2024-12-18T00:53:55.9439843Z  2024-12-18T00:53:55.9440226Z  2024-12-18T00:53:55.9440585Z  2024-12-18T00:53:55.9441561Z [17,293 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:55.9442675Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:53:55.9443747Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2024-12-18T00:53:55.9445043Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2024-12-18T00:53:55.9446093Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:53:55.9446990Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:53:55.9447890Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:53:55.9448816Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:53:55.9450111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local ... 2024-12-18T00:53:56.1731829Z 2024-12-18T00:53:56.1732644Z  2024-12-18T00:53:56.1733138Z  2024-12-18T00:53:56.1733549Z  2024-12-18T00:53:56.1744080Z  2024-12-18T00:53:56.1744790Z  2024-12-18T00:53:56.1745217Z  2024-12-18T00:53:56.1745638Z  2024-12-18T00:53:56.1746051Z  2024-12-18T00:53:56.1747032Z [17,295 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:56.1748226Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:53:56.1749278Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:53:56.1750417Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:53:56.1751501Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:53:56.1752419Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:53:56.1753666Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:53:56.1754538Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:53:56.1755393Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local ... 2024-12-18T00:53:56.3735710Z 2024-12-18T00:53:56.3736704Z  2024-12-18T00:53:56.3737175Z  2024-12-18T00:53:56.3737559Z  2024-12-18T00:53:56.3737937Z  2024-12-18T00:53:56.3738336Z  2024-12-18T00:53:56.3738700Z  2024-12-18T00:53:56.3739064Z  2024-12-18T00:53:56.3739428Z  2024-12-18T00:53:56.3740358Z [17,296 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:56.3741315Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:53:56.3742433Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:53:56.3743436Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:53:56.3745277Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:53:56.3746138Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:53:56.3747056Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:53:56.3747935Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:53:56.3748839Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local ... 2024-12-18T00:53:56.8536534Z 2024-12-18T00:53:56.8537425Z  2024-12-18T00:53:56.8538009Z  2024-12-18T00:53:56.8538425Z  2024-12-18T00:53:56.8538849Z  2024-12-18T00:53:56.8539262Z  2024-12-18T00:53:56.8539711Z  2024-12-18T00:53:56.8540133Z  2024-12-18T00:53:56.8540558Z  2024-12-18T00:53:56.8541517Z [17,297 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:56.8542576Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:53:56.8543697Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2024-12-18T00:53:56.8545006Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:53:56.8545978Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:53:56.8546860Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:53:56.8547721Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2024-12-18T00:53:56.8548437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:53:56.8549513Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local ... 2024-12-18T00:53:57.1687676Z 2024-12-18T00:53:57.1688523Z  2024-12-18T00:53:57.1689005Z  2024-12-18T00:53:57.1689378Z  2024-12-18T00:53:57.1689773Z  2024-12-18T00:53:57.1690156Z  2024-12-18T00:53:57.1690551Z  2024-12-18T00:53:57.1690924Z  2024-12-18T00:53:57.1691628Z  2024-12-18T00:53:57.1692533Z [17,299 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:57.1693619Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:53:57.1694630Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:53:57.1695580Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2024-12-18T00:53:57.1696559Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:53:57.1697269Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:53:57.1698086Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2024-12-18T00:53:57.1698924Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2024-12-18T00:53:57.1700058Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local ... 2024-12-18T00:53:57.3704001Z 2024-12-18T00:53:57.3704852Z  2024-12-18T00:53:57.3705305Z  2024-12-18T00:53:57.3705670Z  2024-12-18T00:53:57.3706271Z  2024-12-18T00:53:57.3706641Z  2024-12-18T00:53:57.3706969Z  2024-12-18T00:53:57.3707311Z  2024-12-18T00:53:57.3707658Z  2024-12-18T00:53:57.3708489Z [17,301 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:57.3709523Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:53:57.3710472Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:53:57.3711468Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:53:57.3712385Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:53:57.3713175Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:53:57.3713977Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2024-12-18T00:53:57.3714735Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:57.3715815Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local ... 2024-12-18T00:53:57.5744723Z 2024-12-18T00:53:57.5745560Z  2024-12-18T00:53:57.5745989Z  2024-12-18T00:53:57.5746349Z  2024-12-18T00:53:57.5746716Z  2024-12-18T00:53:57.5747071Z  2024-12-18T00:53:57.5747419Z  2024-12-18T00:53:57.5747777Z  2024-12-18T00:53:57.5748132Z  2024-12-18T00:53:57.5748980Z [17,301 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:57.5750040Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:53:57.5750984Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:53:57.5751950Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:53:57.5752843Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:53:57.5753624Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:53:57.5754460Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2024-12-18T00:53:57.5755249Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:57.5756152Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local ... 2024-12-18T00:53:57.8950709Z 2024-12-18T00:53:57.8951523Z  2024-12-18T00:53:57.8951891Z  2024-12-18T00:53:57.8952201Z  2024-12-18T00:53:57.8952504Z  2024-12-18T00:53:57.8952806Z  2024-12-18T00:53:57.8953105Z  2024-12-18T00:53:57.8953392Z  2024-12-18T00:53:57.8953690Z  2024-12-18T00:53:57.8954407Z [17,303 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:57.8955246Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:53:57.8956025Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2024-12-18T00:53:57.8957081Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2024-12-18T00:53:57.8957821Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:53:57.8958487Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:53:57.8959224Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:57.8959956Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:53:57.8960605Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local ... 2024-12-18T00:53:58.1756377Z 2024-12-18T00:53:58.1757276Z  2024-12-18T00:53:58.1757742Z  2024-12-18T00:53:58.1758136Z  2024-12-18T00:53:58.1758531Z  2024-12-18T00:53:58.1758903Z  2024-12-18T00:53:58.1759296Z  2024-12-18T00:53:58.1759686Z  2024-12-18T00:53:58.1760085Z  2024-12-18T00:53:58.1761133Z [17,303 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:58.1762289Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:53:58.1763601Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:53:58.1764580Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:53:58.1765687Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:53:58.1766586Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:53:58.1767587Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2024-12-18T00:53:58.1768604Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:53:58.1769504Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local ... 2024-12-18T00:53:58.3792245Z 2024-12-18T00:53:58.3793058Z  2024-12-18T00:53:58.3793544Z  2024-12-18T00:53:58.3793940Z  2024-12-18T00:53:58.3794324Z  2024-12-18T00:53:58.3794734Z  2024-12-18T00:53:58.3795145Z  2024-12-18T00:53:58.3795584Z  2024-12-18T00:53:58.3795969Z  2024-12-18T00:53:58.3797133Z [17,304 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:58.3798416Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:53:58.3799471Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:53:58.3800695Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:53:58.3801657Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:53:58.3802573Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:53:58.3803563Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:53:58.3804525Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2024-12-18T00:53:58.3805410Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local ... 2024-12-18T00:53:58.7756991Z 2024-12-18T00:53:58.7757895Z  2024-12-18T00:53:58.7758438Z  2024-12-18T00:53:58.7758807Z  2024-12-18T00:53:58.7759211Z  2024-12-18T00:53:58.7759592Z  2024-12-18T00:53:58.7760026Z  2024-12-18T00:53:58.7760401Z  2024-12-18T00:53:58.7760770Z  2024-12-18T00:53:58.7761707Z [17,304 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:58.7762789Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:53:58.7763807Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2024-12-18T00:53:58.7764883Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2024-12-18T00:53:58.7765796Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:53:58.7766654Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:53:58.7767631Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2024-12-18T00:53:58.7768551Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2024-12-18T00:53:58.7769731Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local ... 2024-12-18T00:53:59.2830612Z 2024-12-18T00:53:59.2831476Z  2024-12-18T00:53:59.2831938Z  2024-12-18T00:53:59.2832340Z  2024-12-18T00:53:59.2832729Z  2024-12-18T00:53:59.2833109Z  2024-12-18T00:53:59.2833472Z  2024-12-18T00:53:59.2833874Z  2024-12-18T00:53:59.2834198Z  2024-12-18T00:53:59.2835090Z [17,305 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:53:59.2836262Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:53:59.2837265Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:53:59.2838272Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:53:59.2839239Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:53:59.2840102Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:53:59.2841394Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:53:59.2842241Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2024-12-18T00:53:59.2843153Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 21s local ... 2024-12-18T00:53:59.5763531Z 2024-12-18T00:53:59.5764372Z  2024-12-18T00:53:59.5764858Z  2024-12-18T00:53:59.5765270Z  2024-12-18T00:53:59.5765680Z  2024-12-18T00:53:59.5766061Z  2024-12-18T00:53:59.5766447Z  2024-12-18T00:53:59.5766776Z  2024-12-18T00:53:59.5767124Z  2024-12-18T00:53:59.5768027Z [17,307 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:59.5769229Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:53:59.5770319Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:53:59.5771641Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:53:59.5772714Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:53:59.5773612Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:53:59.5774569Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:53:59.5775401Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2024-12-18T00:53:59.5776503Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 21s local ... 2024-12-18T00:53:59.9768243Z 2024-12-18T00:53:59.9769166Z  2024-12-18T00:53:59.9769733Z  2024-12-18T00:53:59.9770246Z  2024-12-18T00:53:59.9770669Z  2024-12-18T00:53:59.9771077Z  2024-12-18T00:53:59.9771413Z  2024-12-18T00:53:59.9771784Z  2024-12-18T00:53:59.9772139Z  2024-12-18T00:53:59.9773058Z [17,308 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:53:59.9774243Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:53:59.9775250Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2024-12-18T00:53:59.9776299Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2024-12-18T00:53:59.9777400Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:53:59.9778310Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:53:59.9779310Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2024-12-18T00:53:59.9780186Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2024-12-18T00:53:59.9780985Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local ... 2024-12-18T00:54:00.3773451Z 2024-12-18T00:54:00.3774269Z  2024-12-18T00:54:00.3774758Z  2024-12-18T00:54:00.3775161Z  2024-12-18T00:54:00.3775561Z  2024-12-18T00:54:00.3775896Z  2024-12-18T00:54:00.3776317Z  2024-12-18T00:54:00.3777259Z  2024-12-18T00:54:00.3777626Z  2024-12-18T00:54:00.3778596Z [17,309 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:00.3779736Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:00.3780807Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:54:00.3781754Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:54:00.3782798Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:54:00.3783636Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:54:00.3784579Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:54:00.3785442Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:54:00.3786295Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local ... 2024-12-18T00:54:00.6517902Z 2024-12-18T00:54:00.6518812Z  2024-12-18T00:54:00.6519353Z  2024-12-18T00:54:00.6519703Z  2024-12-18T00:54:00.6520341Z  2024-12-18T00:54:00.6520766Z  2024-12-18T00:54:00.6521125Z  2024-12-18T00:54:00.6521502Z  2024-12-18T00:54:00.6521863Z  2024-12-18T00:54:00.6522864Z [17,311 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:00.6523972Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:00.6524892Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:54:00.6525942Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:54:00.6526808Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:54:00.6527680Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:54:00.6528864Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:54:00.6529805Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:54:00.6530866Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local ... 2024-12-18T00:54:00.9779336Z 2024-12-18T00:54:00.9780266Z  2024-12-18T00:54:00.9780819Z  2024-12-18T00:54:00.9781331Z  2024-12-18T00:54:00.9781725Z  2024-12-18T00:54:00.9782222Z  2024-12-18T00:54:00.9782697Z  2024-12-18T00:54:00.9783161Z  2024-12-18T00:54:00.9783621Z  2024-12-18T00:54:00.9784552Z [17,311 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:00.9785754Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:00.9786973Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2024-12-18T00:54:00.9787943Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2024-12-18T00:54:00.9788864Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:54:00.9789726Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:54:00.9790748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:54:00.9791547Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:54:00.9792137Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2024-12-18T00:54:01.1783246Z 2024-12-18T00:54:01.1784094Z  2024-12-18T00:54:01.1784582Z  2024-12-18T00:54:01.1784992Z  2024-12-18T00:54:01.1785447Z  2024-12-18T00:54:01.1785928Z  2024-12-18T00:54:01.1786328Z  2024-12-18T00:54:01.1786710Z  2024-12-18T00:54:01.1787170Z  2024-12-18T00:54:01.1788148Z [17,313 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:01.1789284Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:01.1790264Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:01.1791370Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:54:01.1792795Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:54:01.1793664Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:54:01.1794652Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2024-12-18T00:54:01.1795496Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2024-12-18T00:54:01.1796316Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2024-12-18T00:54:01.4894812Z 2024-12-18T00:54:01.4895759Z  2024-12-18T00:54:01.4896299Z  2024-12-18T00:54:01.4896791Z  2024-12-18T00:54:01.4897175Z  2024-12-18T00:54:01.4897531Z  2024-12-18T00:54:01.4897912Z  2024-12-18T00:54:01.4898283Z  2024-12-18T00:54:01.4898658Z  2024-12-18T00:54:01.4899566Z [17,315 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:01.4900659Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:54:01.4901938Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:01.4902861Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:54:01.4903729Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:54:01.4904699Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:54:01.4905651Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:54:01.4906488Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:54:01.4907248Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2024-12-18T00:54:01.7164617Z 2024-12-18T00:54:01.7165598Z  2024-12-18T00:54:01.7166016Z  2024-12-18T00:54:01.7166389Z  2024-12-18T00:54:01.7166754Z  2024-12-18T00:54:01.7167168Z  2024-12-18T00:54:01.7167508Z  2024-12-18T00:54:01.7167839Z  2024-12-18T00:54:01.7168250Z  2024-12-18T00:54:01.7169361Z [17,316 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:01.7170711Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:54:01.7171730Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:01.7172814Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:54:01.7173792Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:54:01.7174681Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:54:01.7175670Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:54:01.7176688Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:54:01.7177425Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2024-12-18T00:54:01.9789738Z 2024-12-18T00:54:01.9790600Z  2024-12-18T00:54:01.9791022Z  2024-12-18T00:54:01.9791390Z  2024-12-18T00:54:01.9791724Z  2024-12-18T00:54:01.9792101Z  2024-12-18T00:54:01.9792437Z  2024-12-18T00:54:01.9792778Z  2024-12-18T00:54:01.9793112Z  2024-12-18T00:54:01.9793932Z [17,316 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:01.9794921Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:54:01.9795875Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2024-12-18T00:54:01.9796877Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2024-12-18T00:54:01.9797755Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:54:01.9798572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:54:01.9799639Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2024-12-18T00:54:01.9800515Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2024-12-18T00:54:01.9801558Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local ... 2024-12-18T00:54:02.8014761Z 2024-12-18T00:54:02.8015594Z  2024-12-18T00:54:02.8015980Z  2024-12-18T00:54:02.8016298Z  2024-12-18T00:54:02.8016725Z  2024-12-18T00:54:02.8017041Z  2024-12-18T00:54:02.8017350Z  2024-12-18T00:54:02.8017680Z  2024-12-18T00:54:02.8018005Z  2024-12-18T00:54:02.8018711Z [17,317 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:02.8019567Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:54:02.8020352Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2024-12-18T00:54:02.8021154Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:54:02.8021879Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:54:02.8022701Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2024-12-18T00:54:02.8023801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:54:02.8024499Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:54:02.8025135Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local ... 2024-12-18T00:54:03.0491352Z 2024-12-18T00:54:03.0492217Z  2024-12-18T00:54:03.0492664Z  2024-12-18T00:54:03.0493053Z  2024-12-18T00:54:03.0493399Z  2024-12-18T00:54:03.0493766Z  2024-12-18T00:54:03.0494121Z  2024-12-18T00:54:03.0494477Z  2024-12-18T00:54:03.0494816Z  2024-12-18T00:54:03.0495622Z [17,319 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:03.0496800Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:54:03.0497774Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:54:03.0498761Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2024-12-18T00:54:03.0499957Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:54:03.0501143Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2024-12-18T00:54:03.0502103Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2024-12-18T00:54:03.0502896Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2024-12-18T00:54:03.0503645Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local ... 2024-12-18T00:54:03.3510727Z 2024-12-18T00:54:03.3511570Z  2024-12-18T00:54:03.3512020Z  2024-12-18T00:54:03.3512409Z  2024-12-18T00:54:03.3512907Z  2024-12-18T00:54:03.3513269Z  2024-12-18T00:54:03.3513654Z  2024-12-18T00:54:03.3514040Z  2024-12-18T00:54:03.3514437Z  2024-12-18T00:54:03.3515355Z [17,321 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:03.3516503Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:54:03.3517586Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:54:03.3518640Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:54:03.3519600Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:54:03.3520503Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:03.3521496Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:54:03.3522385Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:54:03.3523200Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local ... 2024-12-18T00:54:03.5716856Z 2024-12-18T00:54:03.5717655Z  2024-12-18T00:54:03.5718056Z  2024-12-18T00:54:03.5718445Z  2024-12-18T00:54:03.5718775Z  2024-12-18T00:54:03.5719147Z  2024-12-18T00:54:03.5719463Z  2024-12-18T00:54:03.5719832Z  2024-12-18T00:54:03.5720202Z  2024-12-18T00:54:03.5721403Z [17,324 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:03.5722451Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:54:03.5723481Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:54:03.5724432Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:54:03.5725383Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:54:03.5726237Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:03.5727158Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:54:03.5727989Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:54:03.5728790Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local ... 2024-12-18T00:54:03.7801796Z 2024-12-18T00:54:03.7802677Z  2024-12-18T00:54:03.7803104Z  2024-12-18T00:54:03.7803459Z  2024-12-18T00:54:03.7803859Z  2024-12-18T00:54:03.7804218Z  2024-12-18T00:54:03.7804894Z  2024-12-18T00:54:03.7805341Z  2024-12-18T00:54:03.7805742Z  2024-12-18T00:54:03.7806595Z [17,326 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:03.7807821Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:54:03.7808919Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2024-12-18T00:54:03.7809958Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:54:03.7810941Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:54:03.7811900Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:03.7812876Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:54:03.7813747Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:54:03.7814544Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local ... 2024-12-18T00:54:04.1185995Z 2024-12-18T00:54:04.1187286Z  2024-12-18T00:54:04.1187786Z  2024-12-18T00:54:04.1188181Z  2024-12-18T00:54:04.1188551Z  2024-12-18T00:54:04.1188942Z  2024-12-18T00:54:04.1189323Z  2024-12-18T00:54:04.1189690Z  2024-12-18T00:54:04.1190075Z  2024-12-18T00:54:04.1190990Z [17,328 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:04.1192125Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:54:04.1193339Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:54:04.1194417Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2024-12-18T00:54:04.1195412Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:04.1196323Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:04.1197358Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2024-12-18T00:54:04.1198334Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2024-12-18T00:54:04.1199150Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local ... 2024-12-18T00:54:04.3807544Z 2024-12-18T00:54:04.3808323Z  2024-12-18T00:54:04.3808729Z  2024-12-18T00:54:04.3809074Z  2024-12-18T00:54:04.3809410Z  2024-12-18T00:54:04.3809731Z  2024-12-18T00:54:04.3810069Z  2024-12-18T00:54:04.3810543Z  2024-12-18T00:54:04.3810889Z  2024-12-18T00:54:04.3811712Z [17,328 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:04.3812708Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:54:04.3813603Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:54:04.3814520Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:54:04.3815632Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:04.3816574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:54:04.3817416Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:54:04.3818180Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:54:04.3818893Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local ... 2024-12-18T00:54:04.6129061Z 2024-12-18T00:54:04.6129897Z  2024-12-18T00:54:04.6130331Z  2024-12-18T00:54:04.6130707Z  2024-12-18T00:54:04.6131057Z  2024-12-18T00:54:04.6131423Z  2024-12-18T00:54:04.6131807Z  2024-12-18T00:54:04.6132198Z  2024-12-18T00:54:04.6132545Z  2024-12-18T00:54:04.6133551Z [17,330 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:04.6134466Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:54:04.6135402Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:54:04.6136894Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:54:04.6137902Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:04.6138691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:54:04.6139657Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:54:04.6140453Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:54:04.6141250Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local ... 2024-12-18T00:54:04.9253589Z 2024-12-18T00:54:04.9254426Z  2024-12-18T00:54:04.9254893Z  2024-12-18T00:54:04.9255295Z  2024-12-18T00:54:04.9255676Z  2024-12-18T00:54:04.9256045Z  2024-12-18T00:54:04.9256621Z  2024-12-18T00:54:04.9257035Z  2024-12-18T00:54:04.9257430Z  2024-12-18T00:54:04.9258380Z [17,333 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:04.9259986Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:54:04.9261039Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2024-12-18T00:54:04.9262089Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2024-12-18T00:54:04.9263030Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:04.9263907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:54:04.9264890Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:54:04.9265797Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:54:04.9266627Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local ... 2024-12-18T00:54:05.1817268Z 2024-12-18T00:54:05.1818182Z  2024-12-18T00:54:05.1818671Z  2024-12-18T00:54:05.1819067Z  2024-12-18T00:54:05.1819472Z  2024-12-18T00:54:05.1819909Z  2024-12-18T00:54:05.1820298Z  2024-12-18T00:54:05.1820714Z  2024-12-18T00:54:05.1821115Z  2024-12-18T00:54:05.1822191Z [17,333 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:05.1823352Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:54:05.1824413Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2024-12-18T00:54:05.1825501Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2024-12-18T00:54:05.1826475Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2024-12-18T00:54:05.1827392Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:54:05.1828406Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2024-12-18T00:54:05.1829277Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2024-12-18T00:54:05.1830261Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local ... 2024-12-18T00:54:06.1826088Z 2024-12-18T00:54:06.1826998Z  2024-12-18T00:54:06.1827530Z  2024-12-18T00:54:06.1827921Z  2024-12-18T00:54:06.1828273Z  2024-12-18T00:54:06.1828665Z  2024-12-18T00:54:06.1829075Z  2024-12-18T00:54:06.1829451Z  2024-12-18T00:54:06.1829822Z  2024-12-18T00:54:06.1830725Z [17,333 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:06.1831885Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:54:06.1832955Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:54:06.1833992Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:54:06.1834966Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:06.1835833Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2024-12-18T00:54:06.1836810Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2024-12-18T00:54:06.1838136Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2024-12-18T00:54:06.1839011Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local ... 2024-12-18T00:54:06.4638775Z 2024-12-18T00:54:06.4639569Z  2024-12-18T00:54:06.4640003Z  2024-12-18T00:54:06.4640371Z  2024-12-18T00:54:06.4640687Z  2024-12-18T00:54:06.4641038Z  2024-12-18T00:54:06.4641386Z  2024-12-18T00:54:06.4641766Z  2024-12-18T00:54:06.4642127Z  2024-12-18T00:54:06.4642934Z [17,334 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:06.4643888Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:54:06.4645066Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:54:06.4645946Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:54:06.4646768Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:06.4647897Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:54:06.4648896Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:54:06.4649653Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:54:06.4650364Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local ... 2024-12-18T00:54:06.7831510Z 2024-12-18T00:54:06.7832390Z  2024-12-18T00:54:06.7832861Z  2024-12-18T00:54:06.7833239Z  2024-12-18T00:54:06.7833608Z  2024-12-18T00:54:06.7833977Z  2024-12-18T00:54:06.7834424Z  2024-12-18T00:54:06.7834920Z  2024-12-18T00:54:06.7835360Z  2024-12-18T00:54:06.7836318Z [17,334 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:06.7837432Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:54:06.7838380Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:54:06.7839410Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:54:06.7840338Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:06.7841177Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:54:06.7842096Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:54:06.7842937Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:54:06.7843728Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local ... 2024-12-18T00:54:06.9835429Z 2024-12-18T00:54:06.9836357Z  2024-12-18T00:54:06.9836951Z  2024-12-18T00:54:06.9837401Z  2024-12-18T00:54:06.9837738Z  2024-12-18T00:54:06.9838228Z  2024-12-18T00:54:06.9838592Z  2024-12-18T00:54:06.9838954Z  2024-12-18T00:54:06.9839304Z  2024-12-18T00:54:06.9840155Z [17,335 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:06.9841452Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:54:06.9842457Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2024-12-18T00:54:06.9843257Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2024-12-18T00:54:06.9844440Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:06.9845284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:54:06.9846227Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:54:06.9847029Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2024-12-18T00:54:06.9847822Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:54:07.2373256Z 2024-12-18T00:54:07.2374155Z  2024-12-18T00:54:07.2374661Z  2024-12-18T00:54:07.2375082Z  2024-12-18T00:54:07.2375482Z  2024-12-18T00:54:07.2375861Z  2024-12-18T00:54:07.2376289Z  2024-12-18T00:54:07.2376849Z  2024-12-18T00:54:07.2377265Z  2024-12-18T00:54:07.2378440Z [17,338 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:07.2379617Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:54:07.2380724Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:54:07.2381794Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:54:07.2382780Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:54:07.2383722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:54:07.2384855Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2024-12-18T00:54:07.2385803Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:54:07.2386654Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:54:07.5648114Z 2024-12-18T00:54:07.5649076Z  2024-12-18T00:54:07.5649638Z  2024-12-18T00:54:07.5650531Z  2024-12-18T00:54:07.5650923Z  2024-12-18T00:54:07.5651388Z  2024-12-18T00:54:07.5651805Z  2024-12-18T00:54:07.5652175Z  2024-12-18T00:54:07.5652500Z  2024-12-18T00:54:07.5653376Z [17,340 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:07.5654573Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:54:07.5655639Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:54:07.5656883Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:54:07.5657855Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:54:07.5658723Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:54:07.5659716Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2024-12-18T00:54:07.5660654Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:54:07.5661485Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:54:07.7842481Z 2024-12-18T00:54:07.7843451Z  2024-12-18T00:54:07.7843920Z  2024-12-18T00:54:07.7844582Z  2024-12-18T00:54:07.7844984Z  2024-12-18T00:54:07.7845423Z  2024-12-18T00:54:07.7845795Z  2024-12-18T00:54:07.7846188Z  2024-12-18T00:54:07.7846589Z  2024-12-18T00:54:07.7847555Z [17,340 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:07.7848714Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:54:07.7849505Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2024-12-18T00:54:07.7850305Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2024-12-18T00:54:07.7851153Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:54:07.7852291Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:54:07.7853303Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2024-12-18T00:54:07.7854271Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2024-12-18T00:54:07.7855167Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local ... 2024-12-18T00:54:08.3135248Z 2024-12-18T00:54:08.3136157Z  2024-12-18T00:54:08.3136802Z  2024-12-18T00:54:08.3137172Z  2024-12-18T00:54:08.3137517Z  2024-12-18T00:54:08.3137890Z  2024-12-18T00:54:08.3138289Z  2024-12-18T00:54:08.3138654Z  2024-12-18T00:54:08.3139031Z  2024-12-18T00:54:08.3139957Z [17,341 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:08.3141096Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:54:08.3142249Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:54:08.3143295Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:54:08.3144819Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:54:08.3145746Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:54:08.3146758Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:08.3147630Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:54:08.3148464Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local ... 2024-12-18T00:54:08.5849028Z 2024-12-18T00:54:08.5849894Z  2024-12-18T00:54:08.5850401Z  2024-12-18T00:54:08.5850800Z  2024-12-18T00:54:08.5851186Z  2024-12-18T00:54:08.5851573Z  2024-12-18T00:54:08.5851945Z  2024-12-18T00:54:08.5852311Z  2024-12-18T00:54:08.5852686Z  2024-12-18T00:54:08.5853632Z [17,342 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:08.5854960Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:54:08.5856622Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:54:08.5857776Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:54:08.5858787Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:54:08.5859722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:54:08.5860936Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:08.5861976Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:54:08.5862721Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local ... 2024-12-18T00:54:08.9574912Z 2024-12-18T00:54:08.9575840Z  2024-12-18T00:54:08.9576481Z  2024-12-18T00:54:08.9576932Z  2024-12-18T00:54:08.9577332Z  2024-12-18T00:54:08.9577662Z  2024-12-18T00:54:08.9578004Z  2024-12-18T00:54:08.9578361Z  2024-12-18T00:54:08.9578689Z  2024-12-18T00:54:08.9579544Z [17,343 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:08.9580613Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:54:08.9581592Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2024-12-18T00:54:08.9582553Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2024-12-18T00:54:08.9583464Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:54:08.9584281Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:54:08.9585178Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:08.9585975Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:54:08.9586741Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local ... 2024-12-18T00:54:09.1854655Z 2024-12-18T00:54:09.1855521Z  2024-12-18T00:54:09.1856249Z  2024-12-18T00:54:09.1856749Z  2024-12-18T00:54:09.1857110Z  2024-12-18T00:54:09.1857510Z  2024-12-18T00:54:09.1857860Z  2024-12-18T00:54:09.1858195Z  2024-12-18T00:54:09.1858544Z  2024-12-18T00:54:09.1859397Z [17,345 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:09.1860420Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:54:09.1861363Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:54:09.1862323Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:54:09.1863217Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:54:09.1864009Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:54:09.1864866Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2024-12-18T00:54:09.1865637Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2024-12-18T00:54:09.1866618Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local ... 2024-12-18T00:54:09.6235076Z 2024-12-18T00:54:09.6235962Z  2024-12-18T00:54:09.6236417Z  2024-12-18T00:54:09.6236785Z  2024-12-18T00:54:09.6237133Z  2024-12-18T00:54:09.6237501Z  2024-12-18T00:54:09.6237853Z  2024-12-18T00:54:09.6238208Z  2024-12-18T00:54:09.6238598Z  2024-12-18T00:54:09.6239486Z [17,346 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:09.6240614Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2024-12-18T00:54:09.6241597Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:54:09.6242628Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:54:09.6243637Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:54:09.6244673Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:54:09.6245972Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:54:09.6246958Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:54:09.6247675Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local ... 2024-12-18T00:54:09.9858278Z 2024-12-18T00:54:09.9859290Z  2024-12-18T00:54:09.9859945Z  2024-12-18T00:54:09.9860499Z  2024-12-18T00:54:09.9861581Z  2024-12-18T00:54:09.9862059Z  2024-12-18T00:54:09.9862464Z  2024-12-18T00:54:09.9862866Z  2024-12-18T00:54:09.9863249Z  2024-12-18T00:54:09.9864223Z [17,347 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:09.9865430Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2024-12-18T00:54:09.9866527Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2024-12-18T00:54:09.9867627Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2024-12-18T00:54:09.9868724Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:54:09.9869722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:54:09.9870752Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:54:09.9871697Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:54:09.9872566Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local ... 2024-12-18T00:54:10.1862641Z 2024-12-18T00:54:10.1863461Z  2024-12-18T00:54:10.1863838Z  2024-12-18T00:54:10.1864161Z  2024-12-18T00:54:10.1864477Z  2024-12-18T00:54:10.1864773Z  2024-12-18T00:54:10.1865091Z  2024-12-18T00:54:10.1865400Z  2024-12-18T00:54:10.1865704Z  2024-12-18T00:54:10.1866438Z [17,348 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:10.1867297Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2024-12-18T00:54:10.1868484Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:54:10.1869229Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:10.1869918Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:54:10.1870669Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2024-12-18T00:54:10.1871317Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2024-12-18T00:54:10.1871916Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:54:10.1872537Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local ... 2024-12-18T00:54:10.4319514Z 2024-12-18T00:54:10.4320356Z  2024-12-18T00:54:10.4320798Z  2024-12-18T00:54:10.4321171Z  2024-12-18T00:54:10.4321532Z  2024-12-18T00:54:10.4321874Z  2024-12-18T00:54:10.4322234Z  2024-12-18T00:54:10.4322572Z  2024-12-18T00:54:10.4322920Z  2024-12-18T00:54:10.4324031Z [17,351 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:10.4325032Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2024-12-18T00:54:10.4326062Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:54:10.4326958Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:10.4327734Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:54:10.4328574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2024-12-18T00:54:10.4329340Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:54:10.4330001Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:54:10.7869294Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local ... 2024-12-18T00:54:10.7869855Z 2024-12-18T00:54:10.7870298Z  2024-12-18T00:54:10.7870676Z  2024-12-18T00:54:10.7871020Z  2024-12-18T00:54:10.7871432Z  2024-12-18T00:54:10.7871821Z  2024-12-18T00:54:10.7872195Z  2024-12-18T00:54:10.7872982Z  2024-12-18T00:54:10.7882706Z  2024-12-18T00:54:10.7884001Z [17,352 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:10.7885129Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2024-12-18T00:54:10.7886180Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:54:10.7887136Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:10.7888000Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:54:10.7888930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2024-12-18T00:54:10.7889772Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:54:10.7890511Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2024-12-18T00:54:10.7891186Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local ... 2024-12-18T00:54:10.9872398Z 2024-12-18T00:54:10.9873372Z  2024-12-18T00:54:10.9873902Z  2024-12-18T00:54:10.9874271Z  2024-12-18T00:54:10.9874652Z  2024-12-18T00:54:10.9874978Z  2024-12-18T00:54:10.9875328Z  2024-12-18T00:54:10.9875702Z  2024-12-18T00:54:10.9876079Z  2024-12-18T00:54:10.9877000Z [17,353 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:10.9878050Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2024-12-18T00:54:10.9879091Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2024-12-18T00:54:10.9880025Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:10.9880905Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:54:10.9881881Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2024-12-18T00:54:10.9882719Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2024-12-18T00:54:10.9883784Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:54:10.9884537Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local ... 2024-12-18T00:54:11.2607264Z 2024-12-18T00:54:11.2608240Z  2024-12-18T00:54:11.2608733Z  2024-12-18T00:54:11.2609135Z  2024-12-18T00:54:11.2609539Z  2024-12-18T00:54:11.2609938Z  2024-12-18T00:54:11.2610332Z  2024-12-18T00:54:11.2610709Z  2024-12-18T00:54:11.2611113Z  2024-12-18T00:54:11.2612042Z [17,355 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:11.2613163Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 71s local 2024-12-18T00:54:11.2614290Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:54:11.2615306Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:54:11.2616216Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:54:11.2617619Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:54:11.2618487Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:54:11.2619259Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:54:11.2620075Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local ... 2024-12-18T00:54:11.5876488Z 2024-12-18T00:54:11.5877724Z  2024-12-18T00:54:11.5878232Z  2024-12-18T00:54:11.5878659Z  2024-12-18T00:54:11.5879073Z  2024-12-18T00:54:11.5879473Z  2024-12-18T00:54:11.5879894Z  2024-12-18T00:54:11.5880323Z  2024-12-18T00:54:11.5880741Z  2024-12-18T00:54:11.5881730Z [17,356 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:11.5882949Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:54:11.5883918Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:54:11.5885186Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:54:11.5886255Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:54:11.5887125Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:54:11.5887897Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2024-12-18T00:54:11.5888642Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2024-12-18T00:54:11.5889441Z @llvm-project//mlir:SparseTensorDialect; 18s local ... 2024-12-18T00:54:12.0308849Z 2024-12-18T00:54:12.0309842Z  2024-12-18T00:54:12.0310291Z  2024-12-18T00:54:12.0310681Z  2024-12-18T00:54:12.0311087Z  2024-12-18T00:54:12.0311510Z  2024-12-18T00:54:12.0311911Z  2024-12-18T00:54:12.0312294Z  2024-12-18T00:54:12.0312684Z  2024-12-18T00:54:12.0313615Z [17,357 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:12.0314860Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2024-12-18T00:54:12.0315769Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:54:12.0316643Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:54:12.0317557Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2024-12-18T00:54:12.0318413Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2024-12-18T00:54:12.0319177Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:54:12.0319943Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:54:12.0320697Z @llvm-project//mlir:SparseTensorDialect; 18s local ... 2024-12-18T00:54:12.2712715Z 2024-12-18T00:54:12.2713609Z  2024-12-18T00:54:12.2714254Z  2024-12-18T00:54:12.2714659Z  2024-12-18T00:54:12.2715159Z  2024-12-18T00:54:12.2715625Z  2024-12-18T00:54:12.2715983Z  2024-12-18T00:54:12.2716347Z  2024-12-18T00:54:12.2717046Z  2024-12-18T00:54:12.2718057Z [17,359 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:12.2719226Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:54:12.2720135Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:54:12.2721016Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:12.2721955Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:54:12.2722860Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:54:12.2723639Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:54:12.2724396Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:54:12.2725229Z @llvm-project//mlir:SparseTensorDialect; 18s local ... 2024-12-18T00:54:12.5885477Z 2024-12-18T00:54:12.5886444Z  2024-12-18T00:54:12.5888097Z  2024-12-18T00:54:12.5888560Z  2024-12-18T00:54:12.5888997Z  2024-12-18T00:54:12.5889369Z  2024-12-18T00:54:12.5890000Z  2024-12-18T00:54:12.5890434Z  2024-12-18T00:54:12.5890828Z  2024-12-18T00:54:12.5891799Z [17,359 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:12.5892935Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:54:12.5893959Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:54:12.5894905Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:12.5895962Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:54:12.5897035Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:54:12.5897796Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:54:12.5898626Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:54:12.5899457Z @llvm-project//mlir:SparseTensorDialect; 19s local ... 2024-12-18T00:54:12.7963336Z 2024-12-18T00:54:12.7964632Z  2024-12-18T00:54:12.7965074Z  2024-12-18T00:54:12.7965465Z  2024-12-18T00:54:12.7965834Z  2024-12-18T00:54:12.7966211Z  2024-12-18T00:54:12.7966580Z  2024-12-18T00:54:12.7966944Z  2024-12-18T00:54:12.7967315Z  2024-12-18T00:54:12.7968204Z [17,360 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:12.7969291Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2024-12-18T00:54:12.7970226Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:54:12.7971087Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:12.7972026Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:54:12.7972871Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:54:12.7973629Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2024-12-18T00:54:12.7974403Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2024-12-18T00:54:12.7975157Z @llvm-project//mlir:SparseTensorDialect; 19s local ... 2024-12-18T00:54:13.1891335Z 2024-12-18T00:54:13.1892199Z  2024-12-18T00:54:13.1892670Z  2024-12-18T00:54:13.1893066Z  2024-12-18T00:54:13.1893449Z  2024-12-18T00:54:13.1893808Z  2024-12-18T00:54:13.1894187Z  2024-12-18T00:54:13.1894566Z  2024-12-18T00:54:13.1894947Z  2024-12-18T00:54:13.1895843Z [17,361 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:13.1897115Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:54:13.1898062Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:54:13.1898934Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:13.1899875Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2024-12-18T00:54:13.1901051Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2024-12-18T00:54:13.1901808Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:54:13.1902580Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2024-12-18T00:54:13.1903338Z @llvm-project//mlir:SparseTensorDialect; 19s local ... 2024-12-18T00:54:13.6989013Z 2024-12-18T00:54:13.6989904Z  2024-12-18T00:54:13.6990455Z  2024-12-18T00:54:13.6990844Z  2024-12-18T00:54:13.6991165Z  2024-12-18T00:54:13.6991497Z  2024-12-18T00:54:13.6991849Z  2024-12-18T00:54:13.6992177Z  2024-12-18T00:54:13.6992516Z  2024-12-18T00:54:13.6993398Z [17,362 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:13.6994483Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:54:13.6995406Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:54:13.6996583Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2024-12-18T00:54:13.6997643Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:54:13.6998397Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:54:13.6999074Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2024-12-18T00:54:13.6999779Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2024-12-18T00:54:13.7000556Z @llvm-project//mlir:SparseTensorDialect; 20s local ... 2024-12-18T00:54:13.9898726Z 2024-12-18T00:54:13.9899642Z  2024-12-18T00:54:13.9900113Z  2024-12-18T00:54:13.9900507Z  2024-12-18T00:54:13.9900915Z  2024-12-18T00:54:13.9901331Z  2024-12-18T00:54:13.9901728Z  2024-12-18T00:54:13.9902093Z  2024-12-18T00:54:13.9902472Z  2024-12-18T00:54:13.9903562Z [17,362 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:13.9904820Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2024-12-18T00:54:13.9906156Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:54:13.9907034Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2024-12-18T00:54:13.9907948Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:54:13.9908821Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:54:13.9909537Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:54:13.9910249Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2024-12-18T00:54:13.9911020Z @llvm-project//mlir:SparseTensorDialect; 20s local ... 2024-12-18T00:54:14.1903778Z 2024-12-18T00:54:14.1904654Z  2024-12-18T00:54:14.1905128Z  2024-12-18T00:54:14.1905529Z  2024-12-18T00:54:14.1905879Z  2024-12-18T00:54:14.1906273Z  2024-12-18T00:54:14.1906659Z  2024-12-18T00:54:14.1907048Z  2024-12-18T00:54:14.1907445Z  2024-12-18T00:54:14.1908446Z [17,364 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:14.1909621Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:54:14.1910555Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:54:14.1911458Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2024-12-18T00:54:14.1912453Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2024-12-18T00:54:14.1913310Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2024-12-18T00:54:14.1914053Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:54:14.1914851Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2024-12-18T00:54:14.1915815Z @llvm-project//mlir:SparseTensorDialect; 20s local ... 2024-12-18T00:54:14.5908356Z 2024-12-18T00:54:14.5909285Z  2024-12-18T00:54:14.5909774Z  2024-12-18T00:54:14.5910162Z  2024-12-18T00:54:14.5910862Z  2024-12-18T00:54:14.5911284Z  2024-12-18T00:54:14.5911704Z  2024-12-18T00:54:14.5912128Z  2024-12-18T00:54:14.5912511Z  2024-12-18T00:54:14.5913440Z [17,365 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:14.5914675Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:54:14.5915699Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:54:14.5916649Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:54:14.5917709Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:54:14.5918707Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2024-12-18T00:54:14.5919550Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2024-12-18T00:54:14.5920328Z @llvm-project//mlir:SparseTensorDialect; 21s local 2024-12-18T00:54:14.5921068Z @llvm-project//llvm:IPO; 18s local ... 2024-12-18T00:54:15.0708008Z 2024-12-18T00:54:15.0708886Z  2024-12-18T00:54:15.0709638Z  2024-12-18T00:54:15.0710048Z  2024-12-18T00:54:15.0710430Z  2024-12-18T00:54:15.0710798Z  2024-12-18T00:54:15.0711179Z  2024-12-18T00:54:15.0711573Z  2024-12-18T00:54:15.0711950Z  2024-12-18T00:54:15.0712801Z [17,366 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:15.0713940Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2024-12-18T00:54:15.0714955Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:54:15.0715847Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:54:15.0716884Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2024-12-18T00:54:15.0717821Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:54:15.0718615Z Compiling xla/hlo/ir/hlo_instructions.cc; 23s local 2024-12-18T00:54:15.0719447Z @llvm-project//mlir:SparseTensorDialect; 21s local 2024-12-18T00:54:15.0720481Z @llvm-project//llvm:IPO; 19s local ... 2024-12-18T00:54:15.3217823Z 2024-12-18T00:54:15.3218720Z  2024-12-18T00:54:15.3219177Z  2024-12-18T00:54:15.3219557Z  2024-12-18T00:54:15.3219903Z  2024-12-18T00:54:15.3220258Z  2024-12-18T00:54:15.3220649Z  2024-12-18T00:54:15.3221066Z  2024-12-18T00:54:15.3221411Z  2024-12-18T00:54:15.3222242Z [17,368 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:15.3223365Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:54:15.3224240Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:54:15.3225036Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:15.3226001Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:54:15.3226851Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:54:15.3227575Z @llvm-project//mlir:SparseTensorDialect; 21s local 2024-12-18T00:54:15.3228312Z @llvm-project//llvm:IPO; 19s local 2024-12-18T00:54:15.3229048Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2024-12-18T00:54:15.5915035Z 2024-12-18T00:54:15.5915980Z  2024-12-18T00:54:15.5916355Z  2024-12-18T00:54:15.5916742Z  2024-12-18T00:54:15.5917095Z  2024-12-18T00:54:15.5917479Z  2024-12-18T00:54:15.5917874Z  2024-12-18T00:54:15.5918253Z  2024-12-18T00:54:15.5918612Z  2024-12-18T00:54:15.5919563Z [17,369 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:15.5920790Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:54:15.5921800Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:54:15.5923140Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:15.5924413Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:54:15.5925690Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:54:15.5926692Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:54:15.5927578Z @llvm-project//llvm:IPO; 19s local 2024-12-18T00:54:15.5928578Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2024-12-18T00:54:15.7967663Z 2024-12-18T00:54:15.7968619Z  2024-12-18T00:54:15.7969121Z  2024-12-18T00:54:15.7969529Z  2024-12-18T00:54:15.7969882Z  2024-12-18T00:54:15.7970255Z  2024-12-18T00:54:15.7970751Z  2024-12-18T00:54:15.7971133Z  2024-12-18T00:54:15.7971476Z  2024-12-18T00:54:15.7972399Z [17,372 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:15.7973540Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:54:15.7974743Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:54:15.7975654Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:15.7976798Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:54:15.7977641Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2024-12-18T00:54:15.7978384Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:54:15.7979069Z @llvm-project//llvm:IPO; 19s local 2024-12-18T00:54:15.7979858Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2024-12-18T00:54:16.0226665Z 2024-12-18T00:54:16.0227566Z  2024-12-18T00:54:16.0228057Z  2024-12-18T00:54:16.0228477Z  2024-12-18T00:54:16.0228880Z  2024-12-18T00:54:16.0229275Z  2024-12-18T00:54:16.0229684Z  2024-12-18T00:54:16.0230097Z  2024-12-18T00:54:16.0230500Z  2024-12-18T00:54:16.0231422Z [17,374 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:16.0233088Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2024-12-18T00:54:16.0234066Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:54:16.0235022Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:16.0236080Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2024-12-18T00:54:16.0236992Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:54:16.0237814Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:54:16.0238557Z @llvm-project//llvm:IPO; 20s local 2024-12-18T00:54:16.0239381Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local ... 2024-12-18T00:54:16.3133282Z 2024-12-18T00:54:16.3134111Z  2024-12-18T00:54:16.3134591Z  2024-12-18T00:54:16.3134998Z  2024-12-18T00:54:16.3135396Z  2024-12-18T00:54:16.3135744Z  2024-12-18T00:54:16.3136140Z  2024-12-18T00:54:16.3136699Z  2024-12-18T00:54:16.3137109Z  2024-12-18T00:54:16.3138050Z [17,377 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:16.3139015Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:54:16.3139924Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:54:16.3140963Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:54:16.3141919Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:54:16.3142755Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:54:16.3143458Z @llvm-project//llvm:IPO; 20s local 2024-12-18T00:54:16.3144428Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:54:16.3145162Z @llvm-project//llvm:IPO; 16s local ... 2024-12-18T00:54:16.5922963Z 2024-12-18T00:54:16.5923902Z  2024-12-18T00:54:16.5924525Z  2024-12-18T00:54:16.5925369Z  2024-12-18T00:54:16.5926005Z  2024-12-18T00:54:16.5926566Z  2024-12-18T00:54:16.5927069Z  2024-12-18T00:54:16.5927563Z  2024-12-18T00:54:16.5928033Z  2024-12-18T00:54:16.5929021Z [17,377 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:16.5930121Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:54:16.5931103Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:54:16.5932196Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:54:16.5933224Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:54:16.5934110Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:54:16.5934921Z @llvm-project//llvm:IPO; 20s local 2024-12-18T00:54:16.5935777Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:54:16.5936800Z @llvm-project//llvm:IPO; 17s local ... 2024-12-18T00:54:16.7934870Z 2024-12-18T00:54:16.7936014Z  2024-12-18T00:54:16.7936716Z  2024-12-18T00:54:16.7937109Z  2024-12-18T00:54:16.7937500Z  2024-12-18T00:54:16.7937894Z  2024-12-18T00:54:16.7938283Z  2024-12-18T00:54:16.7938658Z  2024-12-18T00:54:16.7939058Z  2024-12-18T00:54:16.7939995Z [17,379 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:54:16.7940993Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:54:16.7941932Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:54:16.7942943Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:54:16.7943832Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2024-12-18T00:54:16.7944868Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:54:16.7945574Z @llvm-project//llvm:IPO; 20s local 2024-12-18T00:54:16.7946359Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local 2024-12-18T00:54:16.7947442Z @llvm-project//llvm:IPO; 17s local ... 2024-12-18T00:54:17.0613061Z 2024-12-18T00:54:17.0614080Z  2024-12-18T00:54:17.0614509Z  2024-12-18T00:54:17.0615120Z  2024-12-18T00:54:17.0615490Z  2024-12-18T00:54:17.0616010Z  2024-12-18T00:54:17.0616624Z  2024-12-18T00:54:17.0617132Z  2024-12-18T00:54:17.0617637Z  2024-12-18T00:54:17.0618683Z [17,380 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:17.0619845Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:54:17.0620891Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:54:17.0622070Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2024-12-18T00:54:17.0623101Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:54:17.0623969Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:54:17.0624841Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:54:17.0625750Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:54:17.0626671Z @llvm-project//llvm:IPO; 17s local ... 2024-12-18T00:54:17.3444391Z 2024-12-18T00:54:17.3445317Z  2024-12-18T00:54:17.3445776Z  2024-12-18T00:54:17.3446110Z  2024-12-18T00:54:17.3446436Z  2024-12-18T00:54:17.3446741Z  2024-12-18T00:54:17.3447057Z  2024-12-18T00:54:17.3447373Z  2024-12-18T00:54:17.3447696Z  2024-12-18T00:54:17.3448448Z [17,381 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:17.3449250Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:54:17.3449968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:54:17.3450885Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:17.3451929Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:54:17.3452601Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:54:17.3453142Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:54:17.3453747Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:54:17.3454374Z @llvm-project//llvm:IPO; 17s local ... 2024-12-18T00:54:17.5931588Z 2024-12-18T00:54:17.5932859Z  2024-12-18T00:54:17.5933638Z  2024-12-18T00:54:17.5934561Z  2024-12-18T00:54:17.5934968Z  2024-12-18T00:54:17.5935318Z  2024-12-18T00:54:17.5935647Z  2024-12-18T00:54:17.5935992Z  2024-12-18T00:54:17.5936499Z  2024-12-18T00:54:17.5937403Z [17,382 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:17.5938319Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:54:17.5939089Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:54:17.5940257Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:17.5941080Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2024-12-18T00:54:17.5941785Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:54:17.5942418Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:54:17.5943091Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local 2024-12-18T00:54:17.5943824Z @llvm-project//llvm:IPO; 18s local ... 2024-12-18T00:54:17.8735367Z 2024-12-18T00:54:17.8736955Z  2024-12-18T00:54:17.8737623Z  2024-12-18T00:54:17.8738101Z  2024-12-18T00:54:17.8738525Z  2024-12-18T00:54:17.8738991Z  2024-12-18T00:54:17.8739480Z  2024-12-18T00:54:17.8739958Z  2024-12-18T00:54:17.8740426Z  2024-12-18T00:54:17.8741505Z [17,383 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:17.8742686Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:54:17.8744078Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:54:17.8745395Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:17.8746305Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:54:17.8747092Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:54:17.8747839Z @llvm-project//llvm:IPO; 21s local 2024-12-18T00:54:17.8748719Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:54:17.8749621Z @llvm-project//llvm:IPO; 18s local ... 2024-12-18T00:54:18.1936788Z 2024-12-18T00:54:18.1938868Z  2024-12-18T00:54:18.1940188Z  2024-12-18T00:54:18.1941972Z  2024-12-18T00:54:18.1942460Z  2024-12-18T00:54:18.1942890Z  2024-12-18T00:54:18.1943317Z  2024-12-18T00:54:18.1943724Z  2024-12-18T00:54:18.1944108Z  2024-12-18T00:54:18.1945374Z [17,384 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:18.1946600Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:54:18.1947539Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:54:18.1948601Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2024-12-18T00:54:18.1949537Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:54:18.1950371Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:54:18.1951108Z @llvm-project//llvm:IPO; 22s local 2024-12-18T00:54:18.1951901Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:54:18.1952740Z @llvm-project//llvm:IPO; 18s local ... 2024-12-18T00:54:18.3942819Z 2024-12-18T00:54:18.3943774Z  2024-12-18T00:54:18.3944471Z  2024-12-18T00:54:18.3944889Z  2024-12-18T00:54:18.3945284Z  2024-12-18T00:54:18.3945681Z  2024-12-18T00:54:18.3946375Z  2024-12-18T00:54:18.3946761Z  2024-12-18T00:54:18.3947170Z  2024-12-18T00:54:18.3948115Z [17,385 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:18.3949145Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:54:18.3950045Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:54:18.3951009Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2024-12-18T00:54:18.3951915Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2024-12-18T00:54:18.3952711Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:54:18.3953419Z @llvm-project//llvm:IPO; 22s local 2024-12-18T00:54:18.3954165Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:54:18.3954983Z @llvm-project//llvm:IPO; 18s local ... 2024-12-18T00:54:18.8559990Z 2024-12-18T00:54:18.8560853Z  2024-12-18T00:54:18.8561327Z  2024-12-18T00:54:18.8561771Z  2024-12-18T00:54:18.8562292Z  2024-12-18T00:54:18.8562945Z  2024-12-18T00:54:18.8563359Z  2024-12-18T00:54:18.8563764Z  2024-12-18T00:54:18.8564161Z  2024-12-18T00:54:18.8565115Z [17,386 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:18.8566216Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:54:18.8567118Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:54:18.8568145Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2024-12-18T00:54:18.8569129Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:54:18.8570005Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:54:18.8570775Z @llvm-project//llvm:IPO; 22s local 2024-12-18T00:54:18.8571591Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2024-12-18T00:54:18.8572461Z @llvm-project//llvm:IPO; 19s local ... 2024-12-18T00:54:19.1950050Z 2024-12-18T00:54:19.1950915Z  2024-12-18T00:54:19.1951850Z  2024-12-18T00:54:19.1952228Z  2024-12-18T00:54:19.1952627Z  2024-12-18T00:54:19.1953013Z  2024-12-18T00:54:19.1953412Z  2024-12-18T00:54:19.1953812Z  2024-12-18T00:54:19.1954202Z  2024-12-18T00:54:19.1955119Z [17,386 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:19.1956326Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:54:19.1957215Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:54:19.1958205Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2024-12-18T00:54:19.1959075Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:54:19.1959871Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:54:19.1960581Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:54:19.1961399Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:54:19.1962244Z @llvm-project//llvm:IPO; 19s local ... 2024-12-18T00:54:19.4709982Z 2024-12-18T00:54:19.4710874Z  2024-12-18T00:54:19.4711332Z  2024-12-18T00:54:19.4711735Z  2024-12-18T00:54:19.4712112Z  2024-12-18T00:54:19.4712484Z  2024-12-18T00:54:19.4712811Z  2024-12-18T00:54:19.4713163Z  2024-12-18T00:54:19.4713486Z  2024-12-18T00:54:19.4714311Z [17,387 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:19.4715228Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:54:19.4716110Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:54:19.4717035Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:54:19.4717868Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:54:19.4718654Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:54:19.4719640Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:54:19.4720387Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:54:19.4721136Z @llvm-project//llvm:IPO; 19s local ... 2024-12-18T00:54:19.7954469Z 2024-12-18T00:54:19.7955491Z  2024-12-18T00:54:19.7955971Z  2024-12-18T00:54:19.7956352Z  2024-12-18T00:54:19.7956952Z  2024-12-18T00:54:19.7957509Z  2024-12-18T00:54:19.7958044Z  2024-12-18T00:54:19.7958590Z  2024-12-18T00:54:19.7959091Z  2024-12-18T00:54:19.7960135Z [17,387 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:19.7961308Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:54:19.7962338Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:54:19.7963467Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:54:19.7964539Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2024-12-18T00:54:19.7965728Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:54:19.7966592Z @llvm-project//llvm:IPO; 23s local 2024-12-18T00:54:19.7967478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2024-12-18T00:54:19.7968381Z @llvm-project//llvm:IPO; 20s local ... 2024-12-18T00:54:20.1853206Z 2024-12-18T00:54:20.1854139Z  2024-12-18T00:54:20.1854646Z  2024-12-18T00:54:20.1855070Z  2024-12-18T00:54:20.1855497Z  2024-12-18T00:54:20.1855875Z  2024-12-18T00:54:20.1856269Z  2024-12-18T00:54:20.1856830Z  2024-12-18T00:54:20.1857195Z  2024-12-18T00:54:20.1858123Z [17,389 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:20.1859077Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:20.1859961Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:54:20.1861229Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2024-12-18T00:54:20.1862201Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:54:20.1862923Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:54:20.1863688Z @llvm-project//llvm:IPO; 24s local 2024-12-18T00:54:20.1864340Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:54:20.1865168Z @llvm-project//llvm:IPO; 20s local ... 2024-12-18T00:54:20.3963224Z 2024-12-18T00:54:20.3964004Z  2024-12-18T00:54:20.3964395Z  2024-12-18T00:54:20.3964748Z  2024-12-18T00:54:20.3965071Z  2024-12-18T00:54:20.3965455Z  2024-12-18T00:54:20.3965796Z  2024-12-18T00:54:20.3966123Z  2024-12-18T00:54:20.3966428Z  2024-12-18T00:54:20.3967302Z [17,391 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:20.3968265Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:20.3969017Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:54:20.3969940Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:20.3970630Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:54:20.3971291Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:54:20.3971928Z @llvm-project//llvm:IPO; 24s local 2024-12-18T00:54:20.3972640Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:54:20.3973290Z @llvm-project//llvm:IPO; 20s local ... 2024-12-18T00:54:20.6703912Z 2024-12-18T00:54:20.6704753Z  2024-12-18T00:54:20.6705248Z  2024-12-18T00:54:20.6705665Z  2024-12-18T00:54:20.6706076Z  2024-12-18T00:54:20.6706472Z  2024-12-18T00:54:20.6706892Z  2024-12-18T00:54:20.6707288Z  2024-12-18T00:54:20.6707700Z  2024-12-18T00:54:20.6708664Z [17,394 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:20.6709934Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:20.6710844Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:54:20.6712010Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:20.6712910Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2024-12-18T00:54:20.6713725Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:54:20.6714421Z @llvm-project//llvm:IPO; 24s local 2024-12-18T00:54:20.6715184Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2024-12-18T00:54:20.6716004Z @llvm-project//llvm:IPO; 21s local ... 2024-12-18T00:54:20.9969385Z 2024-12-18T00:54:20.9970222Z  2024-12-18T00:54:20.9970721Z  2024-12-18T00:54:20.9971124Z  2024-12-18T00:54:20.9971535Z  2024-12-18T00:54:20.9971952Z  2024-12-18T00:54:20.9972377Z  2024-12-18T00:54:20.9972767Z  2024-12-18T00:54:20.9973475Z  2024-12-18T00:54:20.9974481Z [17,395 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:20.9975473Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:20.9976649Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:54:20.9977634Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:20.9978555Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:54:20.9979297Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:54:20.9979971Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:54:20.9980677Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:54:20.9981419Z @llvm-project//llvm:IPO; 21s local ... 2024-12-18T00:54:21.1974489Z 2024-12-18T00:54:21.1975384Z  2024-12-18T00:54:21.1975867Z  2024-12-18T00:54:21.1976325Z  2024-12-18T00:54:21.1976869Z  2024-12-18T00:54:21.1977750Z  2024-12-18T00:54:21.1978168Z  2024-12-18T00:54:21.1978587Z  2024-12-18T00:54:21.1979004Z  2024-12-18T00:54:21.1979950Z [17,396 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:21.1981038Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:54:21.1981990Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:54:21.1983022Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2024-12-18T00:54:21.1983998Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:54:21.1984808Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:54:21.1985479Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:54:21.1986261Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:54:21.1987052Z @llvm-project//llvm:IPO; 21s local ... 2024-12-18T00:54:21.5979558Z 2024-12-18T00:54:21.5980474Z  2024-12-18T00:54:21.5980982Z  2024-12-18T00:54:21.5981480Z  2024-12-18T00:54:21.5981929Z  2024-12-18T00:54:21.5982294Z  2024-12-18T00:54:21.5982657Z  2024-12-18T00:54:21.5983014Z  2024-12-18T00:54:21.5983376Z  2024-12-18T00:54:21.5984286Z [17,397 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:21.5985296Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:54:21.5986239Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:54:21.5987271Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:54:21.5988123Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2024-12-18T00:54:21.5988922Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:54:21.5989604Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:54:21.5990681Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2024-12-18T00:54:21.5991504Z @llvm-project//llvm:IPO; 22s local ... 2024-12-18T00:54:21.9457938Z 2024-12-18T00:54:21.9458899Z  2024-12-18T00:54:21.9459405Z  2024-12-18T00:54:21.9459811Z  2024-12-18T00:54:21.9460327Z  2024-12-18T00:54:21.9460714Z  2024-12-18T00:54:21.9461100Z  2024-12-18T00:54:21.9461487Z  2024-12-18T00:54:21.9461882Z  2024-12-18T00:54:21.9462795Z [17,398 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:21.9463828Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:54:21.9464713Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:54:21.9465749Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:54:21.9466693Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:54:21.9467474Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:54:21.9468436Z @llvm-project//llvm:IPO; 25s local 2024-12-18T00:54:21.9469243Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:54:21.9470035Z @llvm-project//llvm:IPO; 22s local ... 2024-12-18T00:54:22.1986125Z 2024-12-18T00:54:22.1987018Z  2024-12-18T00:54:22.1987487Z  2024-12-18T00:54:22.1987899Z  2024-12-18T00:54:22.1988286Z  2024-12-18T00:54:22.1988696Z  2024-12-18T00:54:22.1989077Z  2024-12-18T00:54:22.1989493Z  2024-12-18T00:54:22.1989911Z  2024-12-18T00:54:22.1990867Z [17,398 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:22.1991930Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:54:22.1992844Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:54:22.1993903Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2024-12-18T00:54:22.1994899Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:54:22.1996107Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:54:22.1996835Z @llvm-project//llvm:IPO; 26s local 2024-12-18T00:54:22.1997609Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:54:22.1998410Z @llvm-project//llvm:IPO; 22s local ... 2024-12-18T00:54:22.4425926Z 2024-12-18T00:54:22.4426879Z  2024-12-18T00:54:22.4427376Z  2024-12-18T00:54:22.4427761Z  2024-12-18T00:54:22.4428126Z  2024-12-18T00:54:22.4428496Z  2024-12-18T00:54:22.4428884Z  2024-12-18T00:54:22.4429279Z  2024-12-18T00:54:22.4429667Z  2024-12-18T00:54:22.4430666Z [17,399 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:22.4431695Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:54:22.4432594Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:54:22.4433779Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:54:22.4434765Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:54:22.4435537Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:54:22.4436276Z @llvm-project//llvm:IPO; 26s local 2024-12-18T00:54:22.4436995Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:54:22.4437710Z @llvm-project//llvm:IPO; 22s local ... 2024-12-18T00:54:22.7992525Z 2024-12-18T00:54:22.7993413Z  2024-12-18T00:54:22.7993909Z  2024-12-18T00:54:22.7994321Z  2024-12-18T00:54:22.7994729Z  2024-12-18T00:54:22.7995108Z  2024-12-18T00:54:22.7995500Z  2024-12-18T00:54:22.7995912Z  2024-12-18T00:54:22.7996329Z  2024-12-18T00:54:22.7997293Z [17,400 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:22.7998697Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:54:22.7999702Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:54:22.8000671Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:54:22.8001525Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2024-12-18T00:54:22.8002159Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:54:22.8002857Z @llvm-project//llvm:IPO; 26s local 2024-12-18T00:54:22.8003632Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2024-12-18T00:54:22.8004470Z @llvm-project//llvm:IPO; 23s local ... 2024-12-18T00:54:22.9996516Z 2024-12-18T00:54:22.9997401Z  2024-12-18T00:54:22.9998003Z  2024-12-18T00:54:22.9998435Z  2024-12-18T00:54:22.9998796Z  2024-12-18T00:54:22.9999178Z  2024-12-18T00:54:22.9999559Z  2024-12-18T00:54:22.9999950Z  2024-12-18T00:54:23.0000348Z  2024-12-18T00:54:23.0001528Z [17,402 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:23.0002677Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:54:23.0003548Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:54:23.0004580Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2024-12-18T00:54:23.0005444Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:54:23.0006237Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:54:23.0006957Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:54:23.0007748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:54:23.0008563Z @llvm-project//llvm:IPO; 23s local ... 2024-12-18T00:54:23.4001055Z 2024-12-18T00:54:23.4001899Z  2024-12-18T00:54:23.4002314Z  2024-12-18T00:54:23.4002668Z  2024-12-18T00:54:23.4003012Z  2024-12-18T00:54:23.4003342Z  2024-12-18T00:54:23.4003718Z  2024-12-18T00:54:23.4004066Z  2024-12-18T00:54:23.4004727Z  2024-12-18T00:54:23.4005710Z [17,404 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:23.4006645Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:54:23.4007485Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:54:23.4008439Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:54:23.4009287Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:54:23.4010062Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:54:23.4010743Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:54:23.4011497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:54:23.4012253Z @llvm-project//llvm:IPO; 23s local ... 2024-12-18T00:54:23.6005019Z 2024-12-18T00:54:23.6005848Z  2024-12-18T00:54:23.6006335Z  2024-12-18T00:54:23.6006843Z  2024-12-18T00:54:23.6007327Z  2024-12-18T00:54:23.6007871Z  2024-12-18T00:54:23.6008355Z  2024-12-18T00:54:23.6008843Z  2024-12-18T00:54:23.6009291Z  2024-12-18T00:54:23.6010213Z [17,406 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:23.6011265Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:54:23.6012250Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:54:23.6013334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:54:23.6014336Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2024-12-18T00:54:23.6015178Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:54:23.6015839Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:54:23.6016732Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2024-12-18T00:54:23.6017512Z @llvm-project//llvm:IPO; 24s local ... 2024-12-18T00:54:24.2269628Z 2024-12-18T00:54:24.2270526Z  2024-12-18T00:54:24.2271029Z  2024-12-18T00:54:24.2271423Z  2024-12-18T00:54:24.2271799Z  2024-12-18T00:54:24.2272174Z  2024-12-18T00:54:24.2272560Z  2024-12-18T00:54:24.2272944Z  2024-12-18T00:54:24.2273329Z  2024-12-18T00:54:24.2274234Z [17,407 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:24.2275262Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:54:24.2276151Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:54:24.2277055Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2024-12-18T00:54:24.2277884Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:54:24.2278671Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:54:24.2279304Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:54:24.2280056Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:54:24.2281142Z @llvm-project//llvm:IPO; 24s local ... 2024-12-18T00:54:24.6013260Z 2024-12-18T00:54:24.6014277Z  2024-12-18T00:54:24.6014761Z  2024-12-18T00:54:24.6015149Z  2024-12-18T00:54:24.6015513Z  2024-12-18T00:54:24.6015891Z  2024-12-18T00:54:24.6016277Z  2024-12-18T00:54:24.6016815Z  2024-12-18T00:54:24.6017166Z  2024-12-18T00:54:24.6018089Z [17,407 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:24.6019146Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:54:24.6030222Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:54:24.6031613Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:54:24.6032512Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:54:24.6033278Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:54:24.6034262Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:54:24.6035153Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:54:24.6035914Z @llvm-project//llvm:IPO; 25s local ... 2024-12-18T00:54:24.8017836Z 2024-12-18T00:54:24.8018705Z  2024-12-18T00:54:24.8019174Z  2024-12-18T00:54:24.8019558Z  2024-12-18T00:54:24.8019953Z  2024-12-18T00:54:24.8020314Z  2024-12-18T00:54:24.8020733Z  2024-12-18T00:54:24.8021103Z  2024-12-18T00:54:24.8021501Z  2024-12-18T00:54:24.8022428Z [17,409 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:24.8023462Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:54:24.8024358Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:54:24.8025375Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:54:24.8026324Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2024-12-18T00:54:24.8027137Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:54:24.8027781Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:54:24.8028492Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2024-12-18T00:54:24.8029236Z @llvm-project//llvm:IPO; 25s local ... 2024-12-18T00:54:25.1223753Z 2024-12-18T00:54:25.1224597Z  2024-12-18T00:54:25.1225102Z  2024-12-18T00:54:25.1225491Z  2024-12-18T00:54:25.1225858Z  2024-12-18T00:54:25.1226238Z  2024-12-18T00:54:25.1226635Z  2024-12-18T00:54:25.1226995Z  2024-12-18T00:54:25.1227361Z  2024-12-18T00:54:25.1228274Z [17,411 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:25.1229301Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:54:25.1230190Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:54:25.1231520Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2024-12-18T00:54:25.1232415Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:54:25.1233176Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:54:25.1233905Z @llvm-project//llvm:IPO; 29s local 2024-12-18T00:54:25.1234632Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:54:25.1235367Z @llvm-project//llvm:IPO; 25s local ... 2024-12-18T00:54:25.4024009Z 2024-12-18T00:54:25.4024833Z  2024-12-18T00:54:25.4025319Z  2024-12-18T00:54:25.4025742Z  2024-12-18T00:54:25.4026274Z  2024-12-18T00:54:25.4026659Z  2024-12-18T00:54:25.4027086Z  2024-12-18T00:54:25.4027481Z  2024-12-18T00:54:25.4027877Z  2024-12-18T00:54:25.4028783Z [17,411 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:25.4029788Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:54:25.4030972Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:54:25.4031982Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:54:25.4032877Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2024-12-18T00:54:25.4033612Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:54:25.4034254Z @llvm-project//llvm:IPO; 29s local 2024-12-18T00:54:25.4034977Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2024-12-18T00:54:25.4035735Z @llvm-project//llvm:IPO; 25s local ... 2024-12-18T00:54:26.0053769Z 2024-12-18T00:54:26.0054633Z  2024-12-18T00:54:26.0055023Z  2024-12-18T00:54:26.0055374Z  2024-12-18T00:54:26.0055733Z  2024-12-18T00:54:26.0056079Z  2024-12-18T00:54:26.0056583Z  2024-12-18T00:54:26.0056915Z  2024-12-18T00:54:26.0057255Z  2024-12-18T00:54:26.0058390Z [17,412 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:26.0059434Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:54:26.0060240Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:54:26.0061072Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2024-12-18T00:54:26.0061854Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:54:26.0062557Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:54:26.0063148Z @llvm-project//llvm:IPO; 30s local 2024-12-18T00:54:26.0063777Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:54:26.0064444Z @llvm-project//llvm:IPO; 26s local ... 2024-12-18T00:54:26.4031907Z 2024-12-18T00:54:26.4032747Z  2024-12-18T00:54:26.4033128Z  2024-12-18T00:54:26.4033449Z  2024-12-18T00:54:26.4033755Z  2024-12-18T00:54:26.4034070Z  2024-12-18T00:54:26.4034410Z  2024-12-18T00:54:26.4034721Z  2024-12-18T00:54:26.4035040Z  2024-12-18T00:54:26.4035783Z [17,414 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:26.4036565Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:54:26.4037249Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:26.4038012Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:54:26.4038682Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:54:26.4039259Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:54:26.4039800Z @llvm-project//llvm:IPO; 30s local 2024-12-18T00:54:26.4040381Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:54:26.4040978Z @llvm-project//llvm:IPO; 26s local ... 2024-12-18T00:54:26.6037836Z 2024-12-18T00:54:26.6038721Z  2024-12-18T00:54:26.6039169Z  2024-12-18T00:54:26.6042154Z  2024-12-18T00:54:26.6042550Z  2024-12-18T00:54:26.6042989Z  2024-12-18T00:54:26.6043367Z  2024-12-18T00:54:26.6043737Z  2024-12-18T00:54:26.6044085Z  2024-12-18T00:54:26.6045282Z [17,415 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:26.6046242Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:54:26.6047102Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:26.6048060Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:54:26.6048919Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2024-12-18T00:54:26.6049659Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:54:26.6050318Z @llvm-project//llvm:IPO; 30s local 2024-12-18T00:54:26.6051032Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2024-12-18T00:54:26.6051729Z @llvm-project//llvm:IPO; 27s local ... 2024-12-18T00:54:26.9281007Z 2024-12-18T00:54:26.9282032Z  2024-12-18T00:54:26.9282495Z  2024-12-18T00:54:26.9282843Z  2024-12-18T00:54:26.9283165Z  2024-12-18T00:54:26.9283515Z  2024-12-18T00:54:26.9283987Z  2024-12-18T00:54:26.9284341Z  2024-12-18T00:54:26.9284685Z  2024-12-18T00:54:26.9285516Z [17,418 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:26.9286489Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:54:26.9287299Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:26.9288195Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:54:26.9289057Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:54:26.9289774Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:54:26.9290600Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:54:26.9291301Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:54:26.9292246Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local ... 2024-12-18T00:54:27.2043747Z 2024-12-18T00:54:27.2044739Z  2024-12-18T00:54:27.2045193Z  2024-12-18T00:54:27.2045527Z  2024-12-18T00:54:27.2045893Z  2024-12-18T00:54:27.2046256Z  2024-12-18T00:54:27.2046598Z  2024-12-18T00:54:27.2046951Z  2024-12-18T00:54:27.2047329Z  2024-12-18T00:54:27.2048214Z [17,418 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:27.2049115Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:54:27.2049896Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:27.2050829Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2024-12-18T00:54:27.2051693Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:54:27.2052435Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:54:27.2053215Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:54:27.2053886Z @llvm-project//llvm:IPO; 27s local 2024-12-18T00:54:27.2054576Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local ... 2024-12-18T00:54:27.5801333Z 2024-12-18T00:54:27.5802196Z  2024-12-18T00:54:27.5802670Z  2024-12-18T00:54:27.5803063Z  2024-12-18T00:54:27.5803420Z  2024-12-18T00:54:27.5803814Z  2024-12-18T00:54:27.5804182Z  2024-12-18T00:54:27.5804563Z  2024-12-18T00:54:27.5804941Z  2024-12-18T00:54:27.5805841Z [17,419 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:27.5806807Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:54:27.5807671Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:54:27.5808607Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:54:27.5809856Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:54:27.5810660Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:54:27.5811485Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:54:27.5812263Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:54:27.5813020Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local ... 2024-12-18T00:54:27.8050163Z 2024-12-18T00:54:27.8051050Z  2024-12-18T00:54:27.8051546Z  2024-12-18T00:54:27.8051929Z  2024-12-18T00:54:27.8052301Z  2024-12-18T00:54:27.8052654Z  2024-12-18T00:54:27.8053184Z  2024-12-18T00:54:27.8053586Z  2024-12-18T00:54:27.8053988Z  2024-12-18T00:54:27.8054919Z [17,419 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:27.8055961Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:54:27.8057337Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:54:27.8058366Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:54:27.8059214Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2024-12-18T00:54:27.8060063Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:54:27.8060944Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2024-12-18T00:54:27.8061780Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:54:27.8062599Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local ... 2024-12-18T00:54:28.0298481Z 2024-12-18T00:54:28.0299296Z  2024-12-18T00:54:28.0299735Z  2024-12-18T00:54:28.0300124Z  2024-12-18T00:54:28.0300525Z  2024-12-18T00:54:28.0300891Z  2024-12-18T00:54:28.0301264Z  2024-12-18T00:54:28.0301645Z  2024-12-18T00:54:28.0302014Z  2024-12-18T00:54:28.0302926Z [17,422 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:28.0304377Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:54:28.0305275Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:54:28.0306248Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2024-12-18T00:54:28.0307156Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:28.0307938Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:54:28.0308750Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:54:28.0309536Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:54:28.0310330Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local ... 2024-12-18T00:54:28.2678056Z 2024-12-18T00:54:28.2678944Z  2024-12-18T00:54:28.2679387Z  2024-12-18T00:54:28.2679770Z  2024-12-18T00:54:28.2680158Z  2024-12-18T00:54:28.2680536Z  2024-12-18T00:54:28.2680945Z  2024-12-18T00:54:28.2681323Z  2024-12-18T00:54:28.2681709Z  2024-12-18T00:54:28.2682665Z [17,424 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:28.2683783Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:54:28.2684675Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:28.2685686Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:54:28.2686599Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:28.2687391Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:54:28.2688271Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:54:28.2689068Z @llvm-project//llvm:IPO; 28s local 2024-12-18T00:54:28.2689840Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local ... 2024-12-18T00:54:28.4730151Z 2024-12-18T00:54:28.4730996Z  2024-12-18T00:54:28.4731775Z  2024-12-18T00:54:28.4732168Z  2024-12-18T00:54:28.4732534Z  2024-12-18T00:54:28.4732935Z  2024-12-18T00:54:28.4733330Z  2024-12-18T00:54:28.4733714Z  2024-12-18T00:54:28.4734150Z  2024-12-18T00:54:28.4735062Z [17,426 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:28.4736074Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:54:28.4737134Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:28.4738170Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:54:28.4739065Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:28.4739887Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:54:28.4740675Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:54:28.4741544Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:54:28.4742431Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local ... 2024-12-18T00:54:28.8059105Z 2024-12-18T00:54:28.8060012Z  2024-12-18T00:54:28.8060481Z  2024-12-18T00:54:28.8060872Z  2024-12-18T00:54:28.8061255Z  2024-12-18T00:54:28.8061794Z  2024-12-18T00:54:28.8062170Z  2024-12-18T00:54:28.8062555Z  2024-12-18T00:54:28.8062929Z  2024-12-18T00:54:28.8063820Z [17,428 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:28.8064824Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:54:28.8065672Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:28.8066625Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:54:28.8067485Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2024-12-18T00:54:28.8068256Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:54:28.8069110Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2024-12-18T00:54:28.8070356Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2024-12-18T00:54:28.8071223Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local ... 2024-12-18T00:54:29.2064686Z 2024-12-18T00:54:29.2065573Z  2024-12-18T00:54:29.2066041Z  2024-12-18T00:54:29.2066562Z  2024-12-18T00:54:29.2066922Z  2024-12-18T00:54:29.2067304Z  2024-12-18T00:54:29.2067682Z  2024-12-18T00:54:29.2068061Z  2024-12-18T00:54:29.2068417Z  2024-12-18T00:54:29.2069318Z [17,429 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:29.2070319Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:54:29.2071193Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:29.2072130Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2024-12-18T00:54:29.2073065Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2024-12-18T00:54:29.2073855Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:54:29.2074697Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2024-12-18T00:54:29.2075598Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:54:29.2076410Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local ... 2024-12-18T00:54:29.4067592Z 2024-12-18T00:54:29.4068461Z  2024-12-18T00:54:29.4068931Z  2024-12-18T00:54:29.4069272Z  2024-12-18T00:54:29.4069644Z  2024-12-18T00:54:29.4070001Z  2024-12-18T00:54:29.4070381Z  2024-12-18T00:54:29.4070738Z  2024-12-18T00:54:29.4071268Z  2024-12-18T00:54:29.4072192Z [17,430 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:29.4073209Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:54:29.4074091Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:54:29.4075466Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:54:29.4076351Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2024-12-18T00:54:29.4077110Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:54:29.4077967Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2024-12-18T00:54:29.4078875Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:54:29.4079773Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local ... 2024-12-18T00:54:29.8596702Z 2024-12-18T00:54:29.8597537Z  2024-12-18T00:54:29.8598023Z  2024-12-18T00:54:29.8598429Z  2024-12-18T00:54:29.8598828Z  2024-12-18T00:54:29.8599235Z  2024-12-18T00:54:29.8599641Z  2024-12-18T00:54:29.8600045Z  2024-12-18T00:54:29.8600442Z  2024-12-18T00:54:29.8601376Z [17,431 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:29.8602858Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:54:29.8603849Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:54:29.8604858Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:54:29.8605806Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:29.8606614Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:54:29.8607540Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:54:29.8608468Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2024-12-18T00:54:29.8609178Z Compiling xla/pjrt/utils.cc; 15s local ... 2024-12-18T00:54:30.1521325Z 2024-12-18T00:54:30.1522206Z  2024-12-18T00:54:30.1522688Z  2024-12-18T00:54:30.1523107Z  2024-12-18T00:54:30.1523517Z  2024-12-18T00:54:30.1523929Z  2024-12-18T00:54:30.1524324Z  2024-12-18T00:54:30.1524770Z  2024-12-18T00:54:30.1525176Z  2024-12-18T00:54:30.1526516Z [17,433 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:30.1527625Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:54:30.1528548Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:54:30.1529598Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2024-12-18T00:54:30.1530537Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:30.1531381Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:54:30.1532303Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:54:30.1533294Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:54:30.1534129Z Compiling xla/pjrt/utils.cc; 15s local ... 2024-12-18T00:54:30.4074699Z 2024-12-18T00:54:30.4075514Z  2024-12-18T00:54:30.4075993Z  2024-12-18T00:54:30.4076446Z  2024-12-18T00:54:30.4076857Z  2024-12-18T00:54:30.4077282Z  2024-12-18T00:54:30.4077690Z  2024-12-18T00:54:30.4078110Z  2024-12-18T00:54:30.4078528Z  2024-12-18T00:54:30.4079488Z [17,434 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:30.4080494Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:54:30.4081426Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:54:30.4082502Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:54:30.4083313Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:30.4084109Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:54:30.4084987Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:54:30.4085986Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:54:30.4086796Z Compiling xla/pjrt/utils.cc; 16s local ... 2024-12-18T00:54:30.8080060Z 2024-12-18T00:54:30.8081024Z  2024-12-18T00:54:30.8081506Z  2024-12-18T00:54:30.8081907Z  2024-12-18T00:54:30.8082286Z  2024-12-18T00:54:30.8082678Z  2024-12-18T00:54:30.8083040Z  2024-12-18T00:54:30.8083427Z  2024-12-18T00:54:30.8083806Z  2024-12-18T00:54:30.8084687Z [17,435 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:30.8085694Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:54:30.8086614Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:54:30.8087520Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:54:30.8088424Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2024-12-18T00:54:30.8089227Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:54:30.8090086Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2024-12-18T00:54:30.8091345Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2024-12-18T00:54:30.8092149Z Compiling xla/pjrt/utils.cc; 16s local ... 2024-12-18T00:54:31.1940199Z 2024-12-18T00:54:31.1941035Z  2024-12-18T00:54:31.1941538Z  2024-12-18T00:54:31.1942095Z  2024-12-18T00:54:31.1942502Z  2024-12-18T00:54:31.1942929Z  2024-12-18T00:54:31.1943378Z  2024-12-18T00:54:31.1943794Z  2024-12-18T00:54:31.1944488Z  2024-12-18T00:54:31.1945486Z [17,436 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:31.1946570Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:31.1947527Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:54:31.1948560Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2024-12-18T00:54:31.1949440Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:54:31.1950261Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:54:31.1951512Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:54:31.1952510Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:54:31.1953383Z Compiling xla/pjrt/utils.cc; 16s local ... 2024-12-18T00:54:31.4085653Z 2024-12-18T00:54:31.4086556Z  2024-12-18T00:54:31.4087028Z  2024-12-18T00:54:31.4087424Z  2024-12-18T00:54:31.4087836Z  2024-12-18T00:54:31.4088207Z  2024-12-18T00:54:31.4088594Z  2024-12-18T00:54:31.4088957Z  2024-12-18T00:54:31.4089329Z  2024-12-18T00:54:31.4090255Z [17,437 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:31.4091306Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:31.4092232Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:31.4093272Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:31.4094227Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:54:31.4095042Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:54:31.4095912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:54:31.4097058Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:54:31.4097866Z Compiling xla/pjrt/utils.cc; 17s local ... 2024-12-18T00:54:31.6767577Z 2024-12-18T00:54:31.6768410Z  2024-12-18T00:54:31.6768904Z  2024-12-18T00:54:31.6769325Z  2024-12-18T00:54:31.6769730Z  2024-12-18T00:54:31.6770145Z  2024-12-18T00:54:31.6770549Z  2024-12-18T00:54:31.6770966Z  2024-12-18T00:54:31.6771333Z  2024-12-18T00:54:31.6772292Z [17,440 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:31.6773358Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:31.6774644Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:31.6775739Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:31.6776909Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2024-12-18T00:54:31.6777723Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:54:31.6778617Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2024-12-18T00:54:31.6779598Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:54:31.6780446Z Compiling xla/pjrt/utils.cc; 17s local ... 2024-12-18T00:54:32.0091458Z 2024-12-18T00:54:32.0092285Z  2024-12-18T00:54:32.0092755Z  2024-12-18T00:54:32.0093149Z  2024-12-18T00:54:32.0093562Z  2024-12-18T00:54:32.0093954Z  2024-12-18T00:54:32.0094350Z  2024-12-18T00:54:32.0094744Z  2024-12-18T00:54:32.0095155Z  2024-12-18T00:54:32.0096560Z [17,441 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:32.0097673Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:32.0098609Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:32.0099656Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:32.0100601Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:54:32.0101416Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:54:32.0102322Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:54:32.0103241Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2024-12-18T00:54:32.0104067Z Compiling xla/pjrt/utils.cc; 17s local ... 2024-12-18T00:54:32.2095960Z 2024-12-18T00:54:32.2096944Z  2024-12-18T00:54:32.2097434Z  2024-12-18T00:54:32.2097853Z  2024-12-18T00:54:32.2098274Z  2024-12-18T00:54:32.2098707Z  2024-12-18T00:54:32.2099118Z  2024-12-18T00:54:32.2099530Z  2024-12-18T00:54:32.2100303Z  2024-12-18T00:54:32.2101290Z [17,442 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:32.2102396Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:54:32.2103364Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:32.2104422Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2024-12-18T00:54:32.2105394Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:54:32.2106220Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:54:32.2107135Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:54:32.2108132Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:54:32.2108981Z Compiling xla/pjrt/utils.cc; 17s local ... 2024-12-18T00:54:32.6244763Z 2024-12-18T00:54:32.6245692Z  2024-12-18T00:54:32.6246111Z  2024-12-18T00:54:32.6246519Z  2024-12-18T00:54:32.6246877Z  2024-12-18T00:54:32.6247234Z  2024-12-18T00:54:32.6247593Z  2024-12-18T00:54:32.6247933Z  2024-12-18T00:54:32.6248297Z  2024-12-18T00:54:32.6249173Z [17,443 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:32.6250153Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:54:32.6251012Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2024-12-18T00:54:32.6251906Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:54:32.6252756Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2024-12-18T00:54:32.6253517Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:54:32.6254382Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:54:32.6255335Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:54:32.6256630Z Compiling xla/pjrt/utils.cc; 18s local ... 2024-12-18T00:54:32.8537472Z 2024-12-18T00:54:32.8538340Z  2024-12-18T00:54:32.8538828Z  2024-12-18T00:54:32.8539207Z  2024-12-18T00:54:32.8539599Z  2024-12-18T00:54:32.8539978Z  2024-12-18T00:54:32.8540368Z  2024-12-18T00:54:32.8540757Z  2024-12-18T00:54:32.8541137Z  2024-12-18T00:54:32.8542057Z [17,446 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:32.8543063Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:54:32.8543944Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2024-12-18T00:54:32.8545216Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:54:32.8546182Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:54:32.8546974Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:54:32.8548082Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2024-12-18T00:54:32.8549152Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2024-12-18T00:54:32.8549940Z Compiling xla/pjrt/utils.cc; 18s local ... 2024-12-18T00:54:33.0873461Z 2024-12-18T00:54:33.0874386Z  2024-12-18T00:54:33.0874845Z  2024-12-18T00:54:33.0875254Z  2024-12-18T00:54:33.0875669Z  2024-12-18T00:54:33.0876085Z  2024-12-18T00:54:33.0876480Z  2024-12-18T00:54:33.0876980Z  2024-12-18T00:54:33.0877348Z  2024-12-18T00:54:33.0878244Z [17,450 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:54:33.0879233Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:54:33.0880107Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2024-12-18T00:54:33.0881063Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2024-12-18T00:54:33.0881959Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:54:33.0883295Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:54:33.0884307Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:54:33.0885126Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:54:33.0886094Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 12s local ... 2024-12-18T00:54:33.4105689Z 2024-12-18T00:54:33.4106495Z  2024-12-18T00:54:33.4106963Z  2024-12-18T00:54:33.4107361Z  2024-12-18T00:54:33.4107765Z  2024-12-18T00:54:33.4108164Z  2024-12-18T00:54:33.4108539Z  2024-12-18T00:54:33.4108937Z  2024-12-18T00:54:33.4109309Z  2024-12-18T00:54:33.4110224Z [17,450 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:33.4111240Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:54:33.4112142Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:54:33.4113202Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:33.4114096Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:54:33.4114875Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:54:33.4115727Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:54:33.4116556Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:54:33.4117501Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 13s local ... 2024-12-18T00:54:33.7122525Z 2024-12-18T00:54:33.7123552Z  2024-12-18T00:54:33.7124027Z  2024-12-18T00:54:33.7124422Z  2024-12-18T00:54:33.7124822Z  2024-12-18T00:54:33.7125208Z  2024-12-18T00:54:33.7125605Z  2024-12-18T00:54:33.7126008Z  2024-12-18T00:54:33.7126386Z  2024-12-18T00:54:33.7127268Z [17,452 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:33.7128630Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:54:33.7129551Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:54:33.7130496Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:33.7131376Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2024-12-18T00:54:33.7132130Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:54:33.7132966Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2024-12-18T00:54:33.7133812Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:54:33.7134685Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 13s local ... 2024-12-18T00:54:34.0111227Z 2024-12-18T00:54:34.0112049Z  2024-12-18T00:54:34.0112558Z  2024-12-18T00:54:34.0112989Z  2024-12-18T00:54:34.0113415Z  2024-12-18T00:54:34.0113828Z  2024-12-18T00:54:34.0114246Z  2024-12-18T00:54:34.0114635Z  2024-12-18T00:54:34.0115054Z  2024-12-18T00:54:34.0116201Z [17,452 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:34.0117230Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:54:34.0118031Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:54:34.0118935Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:34.0119764Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:34.0120424Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:54:34.0121179Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:54:34.0122006Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:54:34.0122828Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 13s local ... 2024-12-18T00:54:34.2115126Z 2024-12-18T00:54:34.2115957Z  2024-12-18T00:54:34.2116485Z  2024-12-18T00:54:34.2116894Z  2024-12-18T00:54:34.2117617Z  2024-12-18T00:54:34.2118021Z  2024-12-18T00:54:34.2118412Z  2024-12-18T00:54:34.2118818Z  2024-12-18T00:54:34.2119215Z  2024-12-18T00:54:34.2120135Z [17,453 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:34.2121197Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:34.2122118Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:54:34.2123104Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2024-12-18T00:54:34.2124055Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:34.2124823Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:54:34.2125652Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:54:34.2126526Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:34.2127482Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local ... 2024-12-18T00:54:34.4883269Z 2024-12-18T00:54:34.4884117Z  2024-12-18T00:54:34.4884589Z  2024-12-18T00:54:34.4885000Z  2024-12-18T00:54:34.4885376Z  2024-12-18T00:54:34.4885742Z  2024-12-18T00:54:34.4886110Z  2024-12-18T00:54:34.4886485Z  2024-12-18T00:54:34.4886849Z  2024-12-18T00:54:34.4887760Z [17,454 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:34.4888888Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:34.4889740Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:54:34.4890696Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:54:34.4891586Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:34.4892370Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:54:34.4893574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:54:34.4894513Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:34.4895383Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local ... 2024-12-18T00:54:34.8121340Z 2024-12-18T00:54:34.8122186Z  2024-12-18T00:54:34.8122672Z  2024-12-18T00:54:34.8123078Z  2024-12-18T00:54:34.8123485Z  2024-12-18T00:54:34.8123855Z  2024-12-18T00:54:34.8124237Z  2024-12-18T00:54:34.8124612Z  2024-12-18T00:54:34.8124999Z  2024-12-18T00:54:34.8125920Z [17,454 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:34.8126986Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:34.8127906Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:54:34.8128908Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:54:34.8129864Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2024-12-18T00:54:34.8130971Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:54:34.8131999Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2024-12-18T00:54:34.8132912Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:34.8133849Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local ... 2024-12-18T00:54:35.0126204Z 2024-12-18T00:54:35.0127072Z  2024-12-18T00:54:35.0127545Z  2024-12-18T00:54:35.0127935Z  2024-12-18T00:54:35.0128320Z  2024-12-18T00:54:35.0128748Z  2024-12-18T00:54:35.0129130Z  2024-12-18T00:54:35.0129524Z  2024-12-18T00:54:35.0129888Z  2024-12-18T00:54:35.0130846Z [17,455 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:35.0131859Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:35.0132728Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:54:35.0134088Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2024-12-18T00:54:35.0134968Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:54:35.0135706Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:54:35.0136705Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:54:35.0137466Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:35.0138253Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 14s local ... 2024-12-18T00:54:35.5100128Z 2024-12-18T00:54:35.5101034Z  2024-12-18T00:54:35.5101487Z  2024-12-18T00:54:35.5101861Z  2024-12-18T00:54:35.5102251Z  2024-12-18T00:54:35.5102624Z  2024-12-18T00:54:35.5103001Z  2024-12-18T00:54:35.5103391Z  2024-12-18T00:54:35.5103785Z  2024-12-18T00:54:35.5104698Z [17,456 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:35.5105827Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:54:35.5106713Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:54:35.5107704Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:54:35.5108550Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:54:35.5109258Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:54:35.5110026Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:54:35.5110807Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:54:35.5111650Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local ... 2024-12-18T00:54:35.7482355Z 2024-12-18T00:54:35.7483237Z  2024-12-18T00:54:35.7483677Z  2024-12-18T00:54:35.7484054Z  2024-12-18T00:54:35.7484414Z  2024-12-18T00:54:35.7484833Z  2024-12-18T00:54:35.7485508Z  2024-12-18T00:54:35.7485861Z  2024-12-18T00:54:35.7486281Z  2024-12-18T00:54:35.7487184Z [17,459 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:35.7488368Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:54:35.7489314Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:54:35.7490347Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:54:35.7491280Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2024-12-18T00:54:35.7492039Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:54:35.7492935Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2024-12-18T00:54:35.7493773Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:54:35.7494678Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local ... 2024-12-18T00:54:36.0133560Z 2024-12-18T00:54:36.0134452Z  2024-12-18T00:54:36.0134987Z  2024-12-18T00:54:36.0135405Z  2024-12-18T00:54:36.0136091Z  2024-12-18T00:54:36.0136668Z  2024-12-18T00:54:36.0137062Z  2024-12-18T00:54:36.0137470Z  2024-12-18T00:54:36.0137874Z  2024-12-18T00:54:36.0138715Z [17,460 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:36.0139672Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:54:36.0140503Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:54:36.0141532Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2024-12-18T00:54:36.0142450Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:54:36.0143136Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:54:36.0143919Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:54:36.0145049Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:54:36.0146138Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 15s local ... 2024-12-18T00:54:36.2671560Z 2024-12-18T00:54:36.2672443Z  2024-12-18T00:54:36.2672924Z  2024-12-18T00:54:36.2673254Z  2024-12-18T00:54:36.2673583Z  2024-12-18T00:54:36.2673909Z  2024-12-18T00:54:36.2674314Z  2024-12-18T00:54:36.2674693Z  2024-12-18T00:54:36.2675108Z  2024-12-18T00:54:36.2676067Z [17,463 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:36.2677219Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:54:36.2678128Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:54:36.2679125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:36.2679999Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:54:36.2680826Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:54:36.2681757Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:54:36.2682601Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:54:36.2683441Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local ... 2024-12-18T00:54:36.6139399Z 2024-12-18T00:54:36.6140289Z  2024-12-18T00:54:36.6140759Z  2024-12-18T00:54:36.6141168Z  2024-12-18T00:54:36.6141564Z  2024-12-18T00:54:36.6141964Z  2024-12-18T00:54:36.6142349Z  2024-12-18T00:54:36.6142746Z  2024-12-18T00:54:36.6143147Z  2024-12-18T00:54:36.6144108Z [17,463 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:36.6145434Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:54:36.6146353Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:54:36.6147371Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:36.6148737Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2024-12-18T00:54:36.6149548Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:54:36.6150400Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2024-12-18T00:54:36.6151243Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:54:36.6152130Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local ... 2024-12-18T00:54:36.9503494Z 2024-12-18T00:54:36.9504375Z  2024-12-18T00:54:36.9504780Z  2024-12-18T00:54:36.9505096Z  2024-12-18T00:54:36.9505464Z  2024-12-18T00:54:36.9505784Z  2024-12-18T00:54:36.9506118Z  2024-12-18T00:54:36.9506442Z  2024-12-18T00:54:36.9506772Z  2024-12-18T00:54:36.9507539Z [17,464 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:36.9508373Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:54:36.9509157Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:54:36.9510264Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:36.9511032Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:54:36.9511684Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:54:36.9512373Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 40s local 2024-12-18T00:54:36.9513075Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:54:36.9513970Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 16s local ... 2024-12-18T00:54:37.2145158Z 2024-12-18T00:54:37.2146027Z  2024-12-18T00:54:37.2146478Z  2024-12-18T00:54:37.2146865Z  2024-12-18T00:54:37.2147243Z  2024-12-18T00:54:37.2147614Z  2024-12-18T00:54:37.2148015Z  2024-12-18T00:54:37.2148397Z  2024-12-18T00:54:37.2148778Z  2024-12-18T00:54:37.2149712Z [17,465 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:54:37.2151251Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:54:37.2152077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:37.2152971Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2024-12-18T00:54:37.2153861Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:54:37.2154713Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 40s local 2024-12-18T00:54:37.2155519Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:37.2156363Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:54:37.2157273Z Compiling xla/service/hlo_graph_dumper.cc; 14s local ... 2024-12-18T00:54:37.6150314Z 2024-12-18T00:54:37.6151191Z  2024-12-18T00:54:37.6151662Z  2024-12-18T00:54:37.6152041Z  2024-12-18T00:54:37.6152417Z  2024-12-18T00:54:37.6152792Z  2024-12-18T00:54:37.6153203Z  2024-12-18T00:54:37.6153593Z  2024-12-18T00:54:37.6154034Z  2024-12-18T00:54:37.6155096Z [17,466 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:37.6156344Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:54:37.6157256Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:37.6158223Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2024-12-18T00:54:37.6159157Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:54:37.6160065Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 40s local 2024-12-18T00:54:37.6160939Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:37.6161726Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:54:37.6162559Z Compiling xla/service/hlo_graph_dumper.cc; 14s local ... 2024-12-18T00:54:37.8154681Z 2024-12-18T00:54:37.8155870Z  2024-12-18T00:54:37.8156318Z  2024-12-18T00:54:37.8156686Z  2024-12-18T00:54:37.8157103Z  2024-12-18T00:54:37.8157483Z  2024-12-18T00:54:37.8157858Z  2024-12-18T00:54:37.8158229Z  2024-12-18T00:54:37.8158635Z  2024-12-18T00:54:37.8159583Z [17,469 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:37.8160519Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:54:37.8161383Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:37.8162314Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2024-12-18T00:54:37.8163223Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2024-12-18T00:54:37.8163947Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:37.8164767Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:54:37.8165629Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2024-12-18T00:54:37.8166816Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local ... 2024-12-18T00:54:38.0984023Z 2024-12-18T00:54:38.0985080Z  2024-12-18T00:54:38.0985521Z  2024-12-18T00:54:38.0985910Z  2024-12-18T00:54:38.0986316Z  2024-12-18T00:54:38.0986698Z  2024-12-18T00:54:38.0987044Z  2024-12-18T00:54:38.0987387Z  2024-12-18T00:54:38.0987753Z  2024-12-18T00:54:38.0988597Z [17,470 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:38.0989538Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:54:38.0990518Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:38.0991431Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2024-12-18T00:54:38.0992329Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:54:38.0993000Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:38.0994129Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 17s local 2024-12-18T00:54:38.0995052Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:54:38.0996005Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local ... 2024-12-18T00:54:38.3997784Z 2024-12-18T00:54:38.3998668Z  2024-12-18T00:54:38.3999103Z  2024-12-18T00:54:38.3999563Z  2024-12-18T00:54:38.3999936Z  2024-12-18T00:54:38.4000297Z  2024-12-18T00:54:38.4000678Z  2024-12-18T00:54:38.4001040Z  2024-12-18T00:54:38.4001431Z  2024-12-18T00:54:38.4002248Z [17,472 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:38.4003201Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:54:38.4004294Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:54:38.4005377Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:54:38.4006283Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:54:38.4007311Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:54:38.4008176Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:54:38.4009207Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:54:38.4010093Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local ... 2024-12-18T00:54:38.6158845Z 2024-12-18T00:54:38.6159721Z  2024-12-18T00:54:38.6160227Z  2024-12-18T00:54:38.6160640Z  2024-12-18T00:54:38.6161059Z  2024-12-18T00:54:38.6161453Z  2024-12-18T00:54:38.6161841Z  2024-12-18T00:54:38.6162248Z  2024-12-18T00:54:38.6162665Z  2024-12-18T00:54:38.6163656Z [17,472 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:38.6164747Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:54:38.6166011Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:54:38.6167172Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:54:38.6168063Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:54:38.6168862Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:54:38.6169754Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:54:38.6170673Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:54:38.6171609Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local ... 2024-12-18T00:54:38.8160876Z 2024-12-18T00:54:38.8161698Z  2024-12-18T00:54:38.8162121Z  2024-12-18T00:54:38.8162467Z  2024-12-18T00:54:38.8162788Z  2024-12-18T00:54:38.8163133Z  2024-12-18T00:54:38.8163486Z  2024-12-18T00:54:38.8163839Z  2024-12-18T00:54:38.8164182Z  2024-12-18T00:54:38.8165295Z [17,473 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:38.8166240Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:54:38.8167061Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:54:38.8167945Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:54:38.8168742Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2024-12-18T00:54:38.8169388Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:54:38.8170138Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:54:38.8170941Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2024-12-18T00:54:38.8171759Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local ... 2024-12-18T00:54:39.1881094Z 2024-12-18T00:54:39.1882014Z  2024-12-18T00:54:39.1882433Z  2024-12-18T00:54:39.1882732Z  2024-12-18T00:54:39.1883044Z  2024-12-18T00:54:39.1883382Z  2024-12-18T00:54:39.1883689Z  2024-12-18T00:54:39.1884304Z  2024-12-18T00:54:39.1884610Z  2024-12-18T00:54:39.1885348Z [17,474 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:39.1886116Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:54:39.1886818Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:54:39.1887557Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2024-12-18T00:54:39.1888247Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:54:39.1888830Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:54:39.1889494Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 18s local 2024-12-18T00:54:39.1890167Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:54:39.1890878Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local ... 2024-12-18T00:54:39.4167812Z 2024-12-18T00:54:39.4168786Z  2024-12-18T00:54:39.4169300Z  2024-12-18T00:54:39.4169748Z  2024-12-18T00:54:39.4170131Z  2024-12-18T00:54:39.4170549Z  2024-12-18T00:54:39.4170917Z  2024-12-18T00:54:39.4171292Z  2024-12-18T00:54:39.4171690Z  2024-12-18T00:54:39.4172719Z [17,475 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:39.4173689Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:54:39.4174582Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:54:39.4175539Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2024-12-18T00:54:39.4176328Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2024-12-18T00:54:39.4177202Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:54:39.4178051Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 19s local 2024-12-18T00:54:39.4179414Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:54:39.4180310Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local ... 2024-12-18T00:54:40.3200204Z 2024-12-18T00:54:40.3201138Z  2024-12-18T00:54:40.3201646Z  2024-12-18T00:54:40.3202055Z  2024-12-18T00:54:40.3202465Z  2024-12-18T00:54:40.3202935Z  2024-12-18T00:54:40.3203406Z  2024-12-18T00:54:40.3203871Z  2024-12-18T00:54:40.3204246Z  2024-12-18T00:54:40.3205220Z [17,476 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:40.3206195Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:54:40.3207072Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:54:40.3208083Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:54:40.3209062Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:54:40.3209921Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:54:40.3211144Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:54:40.3212075Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:54:40.3213074Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local ... 2024-12-18T00:54:40.6176667Z 2024-12-18T00:54:40.6177619Z  2024-12-18T00:54:40.6178091Z  2024-12-18T00:54:40.6178485Z  2024-12-18T00:54:40.6178875Z  2024-12-18T00:54:40.6179265Z  2024-12-18T00:54:40.6179657Z  2024-12-18T00:54:40.6180014Z  2024-12-18T00:54:40.6180395Z  2024-12-18T00:54:40.6181332Z [17,476 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:40.6182327Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:54:40.6183192Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:54:40.6184139Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2024-12-18T00:54:40.6185456Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2024-12-18T00:54:40.6186220Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:54:40.6187067Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2024-12-18T00:54:40.6187946Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:54:40.6188895Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local ... 2024-12-18T00:54:41.2646702Z 2024-12-18T00:54:41.2648021Z  2024-12-18T00:54:41.2648434Z  2024-12-18T00:54:41.2648793Z  2024-12-18T00:54:41.2649152Z  2024-12-18T00:54:41.2649480Z  2024-12-18T00:54:41.2649820Z  2024-12-18T00:54:41.2650182Z  2024-12-18T00:54:41.2650519Z  2024-12-18T00:54:41.2651405Z [17,477 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:41.2652337Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:54:41.2653253Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:54:41.2654279Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:54:41.2655151Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:54:41.2655967Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:54:41.2657062Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:54:41.2658001Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:54:41.2658872Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2024-12-18T00:54:41.4652806Z 2024-12-18T00:54:41.4653726Z  2024-12-18T00:54:41.4654210Z  2024-12-18T00:54:41.4654647Z  2024-12-18T00:54:41.4655058Z  2024-12-18T00:54:41.4655467Z  2024-12-18T00:54:41.4655840Z  2024-12-18T00:54:41.4656232Z  2024-12-18T00:54:41.4656783Z  2024-12-18T00:54:41.4657983Z [17,478 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:41.4658823Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:54:41.4659494Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:54:41.4660215Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:54:41.4660897Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2024-12-18T00:54:41.4661484Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:54:41.4662135Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:54:41.4662806Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:54:41.4663496Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2024-12-18T00:54:41.8186411Z 2024-12-18T00:54:41.8187304Z  2024-12-18T00:54:41.8187790Z  2024-12-18T00:54:41.8188211Z  2024-12-18T00:54:41.8188631Z  2024-12-18T00:54:41.8189031Z  2024-12-18T00:54:41.8189643Z  2024-12-18T00:54:41.8190096Z  2024-12-18T00:54:41.8190504Z  2024-12-18T00:54:41.8191448Z [17,480 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:41.8192428Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:54:41.8193321Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:54:41.8194304Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:54:41.8195209Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:54:41.8195973Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:54:41.8196961Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:54:41.8197832Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:54:41.8198745Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2024-12-18T00:54:42.1536197Z 2024-12-18T00:54:42.1537228Z  2024-12-18T00:54:42.1538126Z  2024-12-18T00:54:42.1539204Z  2024-12-18T00:54:42.1540060Z  2024-12-18T00:54:42.1540777Z  2024-12-18T00:54:42.1541219Z  2024-12-18T00:54:42.1541629Z  2024-12-18T00:54:42.1542045Z  2024-12-18T00:54:42.1543033Z [17,481 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:42.1544379Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2024-12-18T00:54:42.1545363Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:54:42.1546386Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2024-12-18T00:54:42.1547326Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:54:42.1548150Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:54:42.1549053Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2024-12-18T00:54:42.1549992Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:54:42.1550968Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:54:42.4193325Z 2024-12-18T00:54:42.4194204Z  2024-12-18T00:54:42.4194697Z  2024-12-18T00:54:42.4195063Z  2024-12-18T00:54:42.4195467Z  2024-12-18T00:54:42.4195820Z  2024-12-18T00:54:42.4196188Z  2024-12-18T00:54:42.4196581Z  2024-12-18T00:54:42.4196945Z  2024-12-18T00:54:42.4197805Z [17,481 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:42.4198799Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2024-12-18T00:54:42.4199681Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:54:42.4200670Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:42.4201549Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:54:42.4202655Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:54:42.4203531Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:54:42.4204448Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:54:42.4205374Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:54:42.7590188Z 2024-12-18T00:54:42.7591065Z  2024-12-18T00:54:42.7591549Z  2024-12-18T00:54:42.7591942Z  2024-12-18T00:54:42.7592345Z  2024-12-18T00:54:42.7592735Z  2024-12-18T00:54:42.7593134Z  2024-12-18T00:54:42.7593532Z  2024-12-18T00:54:42.7594053Z  2024-12-18T00:54:42.7594977Z [17,483 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:42.7595976Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2024-12-18T00:54:42.7596842Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:54:42.7598111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:42.7599068Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2024-12-18T00:54:42.7599772Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:54:42.7600635Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:54:42.7601487Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:54:42.7602335Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2024-12-18T00:54:42.9677198Z 2024-12-18T00:54:42.9678110Z  2024-12-18T00:54:42.9678575Z  2024-12-18T00:54:42.9679001Z  2024-12-18T00:54:42.9679411Z  2024-12-18T00:54:42.9679790Z  2024-12-18T00:54:42.9680190Z  2024-12-18T00:54:42.9680569Z  2024-12-18T00:54:42.9680988Z  2024-12-18T00:54:42.9681889Z [17,485 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:42.9683051Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:54:42.9684553Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:42.9685655Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:54:42.9686486Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:54:42.9687351Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2024-12-18T00:54:42.9688158Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:54:42.9689025Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local 2024-12-18T00:54:42.9689959Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local ... 2024-12-18T00:54:43.2199748Z 2024-12-18T00:54:43.2206244Z  2024-12-18T00:54:43.2206723Z  2024-12-18T00:54:43.2207108Z  2024-12-18T00:54:43.2207470Z  2024-12-18T00:54:43.2207850Z  2024-12-18T00:54:43.2208221Z  2024-12-18T00:54:43.2208585Z  2024-12-18T00:54:43.2208967Z  2024-12-18T00:54:43.2210042Z [17,486 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:43.2211114Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:54:43.2212111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2024-12-18T00:54:43.2213021Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:54:43.2213800Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:54:43.2214659Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:54:43.2215504Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:54:43.2216318Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:54:43.2217496Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local ... 2024-12-18T00:54:43.5157403Z 2024-12-18T00:54:43.5158332Z  2024-12-18T00:54:43.5158799Z  2024-12-18T00:54:43.5159525Z  2024-12-18T00:54:43.5159902Z  2024-12-18T00:54:43.5160320Z  2024-12-18T00:54:43.5160680Z  2024-12-18T00:54:43.5161062Z  2024-12-18T00:54:43.5161466Z  2024-12-18T00:54:43.5162339Z [17,487 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:43.5163458Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:54:43.5164443Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:54:43.5165352Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2024-12-18T00:54:43.5166152Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:54:43.5166979Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2024-12-18T00:54:43.5167842Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:54:43.5168697Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:54:43.5169746Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local ... 2024-12-18T00:54:43.8206602Z 2024-12-18T00:54:43.8207540Z  2024-12-18T00:54:43.8208028Z  2024-12-18T00:54:43.8208460Z  2024-12-18T00:54:43.8208873Z  2024-12-18T00:54:43.8209271Z  2024-12-18T00:54:43.8209649Z  2024-12-18T00:54:43.8210053Z  2024-12-18T00:54:43.8210456Z  2024-12-18T00:54:43.8211412Z [17,488 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:43.8212641Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:54:43.8213686Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:54:43.8214576Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:43.8215434Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:54:43.8216282Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:54:43.8217464Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:54:43.8218685Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2024-12-18T00:54:43.8219681Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local ... 2024-12-18T00:54:44.0635718Z 2024-12-18T00:54:44.0636553Z  2024-12-18T00:54:44.0637002Z  2024-12-18T00:54:44.0637393Z  2024-12-18T00:54:44.0637759Z  2024-12-18T00:54:44.0638146Z  2024-12-18T00:54:44.0638498Z  2024-12-18T00:54:44.0638867Z  2024-12-18T00:54:44.0639239Z  2024-12-18T00:54:44.0640100Z [17,489 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:44.0641157Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:54:44.0642085Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2024-12-18T00:54:44.0642955Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:44.0643719Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:54:44.0644676Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:54:44.0645631Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:54:44.0646458Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2024-12-18T00:54:44.0647417Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local ... 2024-12-18T00:54:44.3387414Z 2024-12-18T00:54:44.3388288Z  2024-12-18T00:54:44.3388790Z  2024-12-18T00:54:44.3389132Z  2024-12-18T00:54:44.3389579Z  2024-12-18T00:54:44.3390168Z  2024-12-18T00:54:44.3390750Z  2024-12-18T00:54:44.3391232Z  2024-12-18T00:54:44.3391759Z  2024-12-18T00:54:44.3392801Z [17,491 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:44.3393960Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:54:44.3395352Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:54:44.3396435Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:44.3397341Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:54:44.3398146Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:54:44.3399138Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:54:44.3400174Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:54:44.3401134Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local ... 2024-12-18T00:54:44.5853534Z 2024-12-18T00:54:44.5854408Z  2024-12-18T00:54:44.5854868Z  2024-12-18T00:54:44.5855231Z  2024-12-18T00:54:44.5855600Z  2024-12-18T00:54:44.5855959Z  2024-12-18T00:54:44.5856296Z  2024-12-18T00:54:44.5856794Z  2024-12-18T00:54:44.5857298Z  2024-12-18T00:54:44.5858143Z [17,492 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:44.5859390Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:54:44.5860249Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:54:44.5861060Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:44.5861751Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:54:44.5862443Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:54:44.5863197Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:54:44.5864042Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:54:44.5864935Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local ... 2024-12-18T00:54:44.8163156Z 2024-12-18T00:54:44.8164016Z  2024-12-18T00:54:44.8164419Z  2024-12-18T00:54:44.8164773Z  2024-12-18T00:54:44.8165108Z  2024-12-18T00:54:44.8165452Z  2024-12-18T00:54:44.8165830Z  2024-12-18T00:54:44.8166162Z  2024-12-18T00:54:44.8166943Z  2024-12-18T00:54:44.8167843Z [17,493 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:44.8168837Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:54:44.8169707Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:54:44.8170507Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2024-12-18T00:54:44.8171208Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:54:44.8171966Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:54:44.8172788Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:54:44.8173609Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2024-12-18T00:54:44.8174503Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local ... 2024-12-18T00:54:45.0214704Z 2024-12-18T00:54:45.0215612Z  2024-12-18T00:54:45.0216106Z  2024-12-18T00:54:45.0216773Z  2024-12-18T00:54:45.0217197Z  2024-12-18T00:54:45.0217604Z  2024-12-18T00:54:45.0218015Z  2024-12-18T00:54:45.0218443Z  2024-12-18T00:54:45.0218871Z  2024-12-18T00:54:45.0219847Z [17,493 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:45.0221028Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:54:45.0222091Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2024-12-18T00:54:45.0223181Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:54:45.0224012Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:54:45.0224958Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:54:45.0225975Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2024-12-18T00:54:45.0227255Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2024-12-18T00:54:45.0228366Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local ... 2024-12-18T00:54:45.2534315Z 2024-12-18T00:54:45.2535236Z  2024-12-18T00:54:45.2535620Z  2024-12-18T00:54:45.2535955Z  2024-12-18T00:54:45.2536296Z  2024-12-18T00:54:45.2536798Z  2024-12-18T00:54:45.2537106Z  2024-12-18T00:54:45.2537432Z  2024-12-18T00:54:45.2537752Z  2024-12-18T00:54:45.2538560Z [17,494 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:45.2539484Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:54:45.2540312Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:54:45.2541056Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:54:45.2541705Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:54:45.2542604Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:54:45.2543748Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2024-12-18T00:54:45.2545238Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2024-12-18T00:54:45.2546218Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local ... 2024-12-18T00:54:45.6171216Z 2024-12-18T00:54:45.6172117Z  2024-12-18T00:54:45.6172577Z  2024-12-18T00:54:45.6172965Z  2024-12-18T00:54:45.6173363Z  2024-12-18T00:54:45.6173767Z  2024-12-18T00:54:45.6174155Z  2024-12-18T00:54:45.6174564Z  2024-12-18T00:54:45.6174995Z  2024-12-18T00:54:45.6175983Z [17,496 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:45.6177322Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:54:45.6178381Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:54:45.6179494Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2024-12-18T00:54:45.6180698Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:54:45.6181614Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:54:45.6182549Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2024-12-18T00:54:45.6183461Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2024-12-18T00:54:45.6184487Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local ... 2024-12-18T00:54:45.8224223Z 2024-12-18T00:54:45.8226979Z  2024-12-18T00:54:45.8228790Z  2024-12-18T00:54:45.8229255Z  2024-12-18T00:54:45.8229645Z  2024-12-18T00:54:45.8230055Z  2024-12-18T00:54:45.8230473Z  2024-12-18T00:54:45.8230871Z  2024-12-18T00:54:45.8231271Z  2024-12-18T00:54:45.8232277Z [17,498 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:45.8233524Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:54:45.8234638Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:54:45.8235634Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:54:45.8236476Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:54:45.8237419Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:54:45.8238449Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2024-12-18T00:54:45.8239499Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2024-12-18T00:54:45.8240528Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local ... 2024-12-18T00:54:46.1981626Z 2024-12-18T00:54:46.1982473Z  2024-12-18T00:54:46.1982924Z  2024-12-18T00:54:46.1983332Z  2024-12-18T00:54:46.1983731Z  2024-12-18T00:54:46.1984134Z  2024-12-18T00:54:46.1984534Z  2024-12-18T00:54:46.1985165Z  2024-12-18T00:54:46.1985565Z  2024-12-18T00:54:46.1986548Z [17,500 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:46.1987705Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:54:46.1988703Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2024-12-18T00:54:46.1989646Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:54:46.1990453Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:54:46.1991304Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2024-12-18T00:54:46.1992319Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:54:46.1993344Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2024-12-18T00:54:46.1994325Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local ... 2024-12-18T00:54:46.4227619Z 2024-12-18T00:54:46.4228543Z  2024-12-18T00:54:46.4229034Z  2024-12-18T00:54:46.4229433Z  2024-12-18T00:54:46.4230237Z  2024-12-18T00:54:46.4230656Z  2024-12-18T00:54:46.4231034Z  2024-12-18T00:54:46.4231414Z  2024-12-18T00:54:46.4231808Z  2024-12-18T00:54:46.4232769Z [17,500 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:46.4233940Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:54:46.4234897Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:54:46.4235814Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2024-12-18T00:54:46.4236584Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:54:46.4237406Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2024-12-18T00:54:46.4238357Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:54:46.4239375Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2024-12-18T00:54:46.4240765Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local ... 2024-12-18T00:54:46.8617362Z 2024-12-18T00:54:46.8618340Z  2024-12-18T00:54:46.8619077Z  2024-12-18T00:54:46.8619696Z  2024-12-18T00:54:46.8620290Z  2024-12-18T00:54:46.8620772Z  2024-12-18T00:54:46.8622687Z  2024-12-18T00:54:46.8623083Z  2024-12-18T00:54:46.8623494Z  2024-12-18T00:54:46.8624484Z [17,501 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:46.8625641Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:54:46.8626692Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:54:46.8627645Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:54:46.8628474Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:54:46.8629380Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2024-12-18T00:54:46.8630456Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2024-12-18T00:54:46.8631516Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2024-12-18T00:54:46.8632606Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local ... 2024-12-18T00:54:47.2236809Z 2024-12-18T00:54:47.2237704Z  2024-12-18T00:54:47.2238208Z  2024-12-18T00:54:47.2238599Z  2024-12-18T00:54:47.2238992Z  2024-12-18T00:54:47.2239385Z  2024-12-18T00:54:47.2239805Z  2024-12-18T00:54:47.2240194Z  2024-12-18T00:54:47.2240592Z  2024-12-18T00:54:47.2241559Z [17,503 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:47.2242772Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:54:47.2243796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2024-12-18T00:54:47.2245086Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:54:47.2246254Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:54:47.2247281Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:54:47.2248272Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2024-12-18T00:54:47.2249297Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2024-12-18T00:54:47.2250337Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local ... 2024-12-18T00:54:47.7834085Z 2024-12-18T00:54:47.7834981Z  2024-12-18T00:54:47.7835453Z  2024-12-18T00:54:47.7835842Z  2024-12-18T00:54:47.7836233Z  2024-12-18T00:54:47.7836600Z  2024-12-18T00:54:47.7836960Z  2024-12-18T00:54:47.7837346Z  2024-12-18T00:54:47.7837674Z  2024-12-18T00:54:47.7838581Z [17,504 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:47.7839561Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:54:47.7840687Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:54:47.7841515Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2024-12-18T00:54:47.7842232Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:54:47.7842947Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:54:47.7843835Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local 2024-12-18T00:54:47.7845207Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2024-12-18T00:54:47.7846536Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local ... 2024-12-18T00:54:48.0064412Z 2024-12-18T00:54:48.0065421Z  2024-12-18T00:54:48.0065996Z  2024-12-18T00:54:48.0066352Z  2024-12-18T00:54:48.0066766Z  2024-12-18T00:54:48.0067160Z  2024-12-18T00:54:48.0067531Z  2024-12-18T00:54:48.0067907Z  2024-12-18T00:54:48.0068262Z  2024-12-18T00:54:48.0069434Z [17,506 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:48.0070640Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:54:48.0071607Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:54:48.0072511Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:54:48.0073271Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:54:48.0074056Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2024-12-18T00:54:48.0074943Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local 2024-12-18T00:54:48.0075798Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2024-12-18T00:54:48.0076775Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local ... 2024-12-18T00:54:48.2246014Z 2024-12-18T00:54:48.2246930Z  2024-12-18T00:54:48.2247408Z  2024-12-18T00:54:48.2247802Z  2024-12-18T00:54:48.2248227Z  2024-12-18T00:54:48.2248617Z  2024-12-18T00:54:48.2249023Z  2024-12-18T00:54:48.2249424Z  2024-12-18T00:54:48.2249811Z  2024-12-18T00:54:48.2250720Z [17,507 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:48.2251801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:54:48.2252776Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2024-12-18T00:54:48.2253688Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:54:48.2254462Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:54:48.2255313Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:54:48.2256267Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local 2024-12-18T00:54:48.2257400Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2024-12-18T00:54:48.2258389Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local ... 2024-12-18T00:54:48.6248421Z 2024-12-18T00:54:48.6249366Z  2024-12-18T00:54:48.6249823Z  2024-12-18T00:54:48.6250171Z  2024-12-18T00:54:48.6250609Z  2024-12-18T00:54:48.6251025Z  2024-12-18T00:54:48.6251397Z  2024-12-18T00:54:48.6251754Z  2024-12-18T00:54:48.6252106Z  2024-12-18T00:54:48.6252941Z [17,509 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:48.6253914Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:54:48.6254774Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:54:48.6255558Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2024-12-18T00:54:48.6256389Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:54:48.6257721Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:54:48.6258662Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2024-12-18T00:54:48.6259897Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2024-12-18T00:54:48.6260827Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local ... 2024-12-18T00:54:49.0115815Z 2024-12-18T00:54:49.0116700Z  2024-12-18T00:54:49.0117139Z  2024-12-18T00:54:49.0117514Z  2024-12-18T00:54:49.0117875Z  2024-12-18T00:54:49.0118214Z  2024-12-18T00:54:49.0118560Z  2024-12-18T00:54:49.0118905Z  2024-12-18T00:54:49.0119266Z  2024-12-18T00:54:49.0120126Z [17,510 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:49.0121776Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:54:49.0122691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:54:49.0123541Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:54:49.0124282Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:54:49.0125387Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2024-12-18T00:54:49.0126374Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 20s local 2024-12-18T00:54:49.0127255Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2024-12-18T00:54:49.0128121Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local ... 2024-12-18T00:54:49.2254431Z 2024-12-18T00:54:49.2255289Z  2024-12-18T00:54:49.2255680Z  2024-12-18T00:54:49.2255994Z  2024-12-18T00:54:49.2256319Z  2024-12-18T00:54:49.2256974Z  2024-12-18T00:54:49.2257290Z  2024-12-18T00:54:49.2257632Z  2024-12-18T00:54:49.2257932Z  2024-12-18T00:54:49.2258681Z [17,511 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:49.2259556Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:54:49.2260341Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2024-12-18T00:54:49.2261103Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:54:49.2261716Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:54:49.2262378Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:54:49.2263142Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2024-12-18T00:54:49.2263859Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2024-12-18T00:54:49.2264434Z Compiling xla/pjrt/utils.cc; 16s local ... 2024-12-18T00:54:49.4903713Z 2024-12-18T00:54:49.4904625Z  2024-12-18T00:54:49.4905093Z  2024-12-18T00:54:49.4905491Z  2024-12-18T00:54:49.4905887Z  2024-12-18T00:54:49.4906305Z  2024-12-18T00:54:49.4906689Z  2024-12-18T00:54:49.4907050Z  2024-12-18T00:54:49.4907423Z  2024-12-18T00:54:49.4908341Z [17,512 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:49.4909659Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:54:49.4910626Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:54:49.4911495Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2024-12-18T00:54:49.4912252Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:54:49.4913068Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:54:49.4913980Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2024-12-18T00:54:49.4914782Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2024-12-18T00:54:49.4915437Z Compiling xla/pjrt/utils.cc; 16s local ... 2024-12-18T00:54:49.8320725Z 2024-12-18T00:54:49.8321572Z  2024-12-18T00:54:49.8322025Z  2024-12-18T00:54:49.8322399Z  2024-12-18T00:54:49.8322802Z  2024-12-18T00:54:49.8323168Z  2024-12-18T00:54:49.8323538Z  2024-12-18T00:54:49.8323907Z  2024-12-18T00:54:49.8324295Z  2024-12-18T00:54:49.8325463Z [17,512 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:49.8326556Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:54:49.8327464Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:54:49.8328354Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:54:49.8329063Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:54:49.8329817Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2024-12-18T00:54:49.8330674Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2024-12-18T00:54:49.8331484Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2024-12-18T00:54:49.8332123Z Compiling xla/pjrt/utils.cc; 16s local ... 2024-12-18T00:54:50.2265657Z 2024-12-18T00:54:50.2266496Z  2024-12-18T00:54:50.2266956Z  2024-12-18T00:54:50.2267348Z  2024-12-18T00:54:50.2267782Z  2024-12-18T00:54:50.2268195Z  2024-12-18T00:54:50.2268978Z  2024-12-18T00:54:50.2269390Z  2024-12-18T00:54:50.2269765Z  2024-12-18T00:54:50.2270701Z [17,513 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:50.2271771Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:50.2272793Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2024-12-18T00:54:50.2273671Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:54:50.2274467Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:54:50.2275230Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:54:50.2276214Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2024-12-18T00:54:50.2277122Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2024-12-18T00:54:50.2277800Z Compiling xla/pjrt/utils.cc; 17s local ... 2024-12-18T00:54:50.4269973Z 2024-12-18T00:54:50.4270876Z  2024-12-18T00:54:50.4271394Z  2024-12-18T00:54:50.4271759Z  2024-12-18T00:54:50.4272143Z  2024-12-18T00:54:50.4272566Z  2024-12-18T00:54:50.4272949Z  2024-12-18T00:54:50.4273314Z  2024-12-18T00:54:50.4273702Z  2024-12-18T00:54:50.4274586Z [17,515 / 20,603] 4 / 17 tests; 48 actions, 46 running; last test: ...til_test 2024-12-18T00:54:50.4275695Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:50.4276634Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:54:50.4277514Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:54:50.4278230Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:54:50.4279025Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:54:50.4279970Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2024-12-18T00:54:50.4281094Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2024-12-18T00:54:50.4281833Z Compiling xla/pjrt/utils.cc; 17s local ... 2024-12-18T00:54:50.6886345Z 2024-12-18T00:54:50.6887762Z  2024-12-18T00:54:50.6888265Z  2024-12-18T00:54:50.6888666Z  2024-12-18T00:54:50.6889063Z  2024-12-18T00:54:50.6889451Z  2024-12-18T00:54:50.6889806Z  2024-12-18T00:54:50.6890184Z  2024-12-18T00:54:50.6890550Z  2024-12-18T00:54:50.6891483Z [17,516 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:50.6892660Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:50.6893587Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:54:50.6894349Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2024-12-18T00:54:50.6895091Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:54:50.6895891Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:54:50.6897366Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2024-12-18T00:54:50.6898160Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2024-12-18T00:54:50.6898857Z Compiling xla/pjrt/utils.cc; 17s local ... 2024-12-18T00:54:51.0271690Z 2024-12-18T00:54:51.0272552Z  2024-12-18T00:54:51.0273038Z  2024-12-18T00:54:51.0273410Z  2024-12-18T00:54:51.0273740Z  2024-12-18T00:54:51.0274189Z  2024-12-18T00:54:51.0274570Z  2024-12-18T00:54:51.0274960Z  2024-12-18T00:54:51.0275341Z  2024-12-18T00:54:51.0276382Z [17,519 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:51.0277511Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:51.0278535Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2024-12-18T00:54:51.0279423Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:54:51.0280490Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:54:51.0281277Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2024-12-18T00:54:51.0282226Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2024-12-18T00:54:51.0283131Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:54:51.0283790Z Compiling xla/pjrt/utils.cc; 18s local ... 2024-12-18T00:54:51.4139293Z 2024-12-18T00:54:51.4140177Z  2024-12-18T00:54:51.4140611Z  2024-12-18T00:54:51.4140995Z  2024-12-18T00:54:51.4141399Z  2024-12-18T00:54:51.4141782Z  2024-12-18T00:54:51.4142170Z  2024-12-18T00:54:51.4142536Z  2024-12-18T00:54:51.4142888Z  2024-12-18T00:54:51.4143767Z [17,521 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:51.4145025Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:54:51.4146001Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:54:51.4146889Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:54:51.4147615Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:54:51.4148607Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:54:51.4149580Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2024-12-18T00:54:51.4150465Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:54:51.4151129Z Compiling xla/pjrt/utils.cc; 18s local ... 2024-12-18T00:54:51.6278023Z 2024-12-18T00:54:51.6278837Z  2024-12-18T00:54:51.6279304Z  2024-12-18T00:54:51.6279734Z  2024-12-18T00:54:51.6280184Z  2024-12-18T00:54:51.6280608Z  2024-12-18T00:54:51.6280999Z  2024-12-18T00:54:51.6281358Z  2024-12-18T00:54:51.6281734Z  2024-12-18T00:54:51.6282632Z [17,522 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:51.6283935Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:54:51.6284909Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:54:51.6285763Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2024-12-18T00:54:51.6286621Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:54:51.6287456Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:54:51.6288380Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2024-12-18T00:54:51.6289348Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:54:51.6290105Z Compiling xla/pjrt/utils.cc; 18s local ... 2024-12-18T00:54:51.8281975Z 2024-12-18T00:54:51.8282892Z  2024-12-18T00:54:51.8283392Z  2024-12-18T00:54:51.8283806Z  2024-12-18T00:54:51.8284201Z  2024-12-18T00:54:51.8284602Z  2024-12-18T00:54:51.8285050Z  2024-12-18T00:54:51.8285459Z  2024-12-18T00:54:51.8286187Z  2024-12-18T00:54:51.8287181Z [17,527 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:51.8288321Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:54:51.8289313Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:54:51.8290234Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:54:51.8291050Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:54:51.8291938Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2024-12-18T00:54:51.8292876Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2024-12-18T00:54:51.8293707Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:54:51.8294508Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local ... 2024-12-18T00:54:52.1470307Z 2024-12-18T00:54:52.1471253Z  2024-12-18T00:54:52.1471718Z  2024-12-18T00:54:52.1472534Z  2024-12-18T00:54:52.1472926Z  2024-12-18T00:54:52.1473294Z  2024-12-18T00:54:52.1473675Z  2024-12-18T00:54:52.1474074Z  2024-12-18T00:54:52.1474453Z  2024-12-18T00:54:52.1475321Z [17,528 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:52.1476319Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:54:52.1477345Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2024-12-18T00:54:52.1478176Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:54:52.1478932Z Compiling xla/hlo/ir/hlo_instruction.cc; 37s local 2024-12-18T00:54:52.1479715Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:54:52.1480643Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2024-12-18T00:54:52.1481488Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:54:52.1482269Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local ... 2024-12-18T00:54:52.4288715Z 2024-12-18T00:54:52.4299949Z  2024-12-18T00:54:52.4300723Z  2024-12-18T00:54:52.4301087Z  2024-12-18T00:54:52.4301438Z  2024-12-18T00:54:52.4301774Z  2024-12-18T00:54:52.4302128Z  2024-12-18T00:54:52.4302490Z  2024-12-18T00:54:52.4302844Z  2024-12-18T00:54:52.4303676Z [17,529 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:52.4304735Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:54:52.4305644Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:54:52.4306429Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:54:52.4307203Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:54:52.4308028Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2024-12-18T00:54:52.4309143Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:54:52.4309843Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2024-12-18T00:54:52.4310739Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local ... 2024-12-18T00:54:52.7027215Z 2024-12-18T00:54:52.7028119Z  2024-12-18T00:54:52.7028601Z  2024-12-18T00:54:52.7029000Z  2024-12-18T00:54:52.7029392Z  2024-12-18T00:54:52.7029777Z  2024-12-18T00:54:52.7030151Z  2024-12-18T00:54:52.7030539Z  2024-12-18T00:54:52.7030933Z  2024-12-18T00:54:52.7031831Z [17,530 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:52.7032968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:54:52.7033981Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:54:52.7034928Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2024-12-18T00:54:52.7036166Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:54:52.7037157Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:54:52.7038056Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:54:52.7038836Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:54:52.7039799Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:54:53.0295107Z 2024-12-18T00:54:53.0295981Z  2024-12-18T00:54:53.0296645Z  2024-12-18T00:54:53.0297000Z  2024-12-18T00:54:53.0297336Z  2024-12-18T00:54:53.0297659Z  2024-12-18T00:54:53.0297997Z  2024-12-18T00:54:53.0298339Z  2024-12-18T00:54:53.0298686Z  2024-12-18T00:54:53.0299520Z [17,531 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:53.0300491Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:54:53.0301621Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2024-12-18T00:54:53.0302526Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:54:53.0303254Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2024-12-18T00:54:53.0304081Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:54:53.0304836Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:54:53.0305478Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:54:53.0306276Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:54:53.4285474Z 2024-12-18T00:54:53.4286363Z  2024-12-18T00:54:53.4286816Z  2024-12-18T00:54:53.4287245Z  2024-12-18T00:54:53.4287616Z  2024-12-18T00:54:53.4287992Z  2024-12-18T00:54:53.4288347Z  2024-12-18T00:54:53.4288686Z  2024-12-18T00:54:53.4289029Z  2024-12-18T00:54:53.4289915Z [17,535 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:53.4290924Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:54:53.4291876Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:54:53.4292719Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:54:53.4293523Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:54:53.4294424Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:54:53.4295271Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:54:53.4296044Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:54:53.4297124Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:54:53.6300267Z 2024-12-18T00:54:53.6301172Z  2024-12-18T00:54:53.6301647Z  2024-12-18T00:54:53.6302038Z  2024-12-18T00:54:53.6302736Z  2024-12-18T00:54:53.6303137Z  2024-12-18T00:54:53.6303558Z  2024-12-18T00:54:53.6303930Z  2024-12-18T00:54:53.6304316Z  2024-12-18T00:54:53.6305251Z [17,536 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:53.6306335Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:54:53.6307300Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:54:53.6308200Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2024-12-18T00:54:53.6309042Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:54:53.6309987Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:54:53.6310878Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:54:53.6311564Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2024-12-18T00:54:53.6312466Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2024-12-18T00:54:54.0305334Z 2024-12-18T00:54:54.0306456Z  2024-12-18T00:54:54.0306976Z  2024-12-18T00:54:54.0307393Z  2024-12-18T00:54:54.0307805Z  2024-12-18T00:54:54.0308174Z  2024-12-18T00:54:54.0308536Z  2024-12-18T00:54:54.0308939Z  2024-12-18T00:54:54.0309288Z  2024-12-18T00:54:54.0310229Z [17,537 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:54.0311341Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:54:54.0312375Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2024-12-18T00:54:54.0313293Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:54:54.0314179Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2024-12-18T00:54:54.0315140Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:54:54.0316042Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:54:54.0317038Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:54:54.0318096Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local ... 2024-12-18T00:54:54.4311110Z 2024-12-18T00:54:54.4312006Z  2024-12-18T00:54:54.4312517Z  2024-12-18T00:54:54.4312915Z  2024-12-18T00:54:54.4313292Z  2024-12-18T00:54:54.4313625Z  2024-12-18T00:54:54.4313986Z  2024-12-18T00:54:54.4314347Z  2024-12-18T00:54:54.4314728Z  2024-12-18T00:54:54.4315595Z [17,539 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:54.4316621Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:54:54.4317531Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:54:54.4318426Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:54:54.4319247Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:54:54.4320233Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:54:54.4321094Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:54:54.4322541Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:54:54.4323489Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local ... 2024-12-18T00:54:54.6596307Z 2024-12-18T00:54:54.6597202Z  2024-12-18T00:54:54.6597689Z  2024-12-18T00:54:54.6598077Z  2024-12-18T00:54:54.6598520Z  2024-12-18T00:54:54.6598904Z  2024-12-18T00:54:54.6599275Z  2024-12-18T00:54:54.6599635Z  2024-12-18T00:54:54.6599966Z  2024-12-18T00:54:54.6600906Z [17,542 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:54.6602029Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:54:54.6603061Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:54:54.6604283Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2024-12-18T00:54:54.6605139Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:54:54.6606163Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:54:54.6607222Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:54:54.6608006Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2024-12-18T00:54:54.6608953Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local ... 2024-12-18T00:54:54.8612227Z 2024-12-18T00:54:54.8613125Z  2024-12-18T00:54:54.8613585Z  2024-12-18T00:54:54.8613968Z  2024-12-18T00:54:54.8614330Z  2024-12-18T00:54:54.8614694Z  2024-12-18T00:54:54.8615068Z  2024-12-18T00:54:54.8615423Z  2024-12-18T00:54:54.8615801Z  2024-12-18T00:54:54.8616901Z [17,544 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:54.8618371Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:54:54.8619412Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:54:54.8620273Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:54.8621143Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:54:54.8622810Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:54:54.8623726Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:54.8624652Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:54:54.8625695Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local ... 2024-12-18T00:54:55.1070940Z 2024-12-18T00:54:55.1071800Z  2024-12-18T00:54:55.1072280Z  2024-12-18T00:54:55.1072682Z  2024-12-18T00:54:55.1073079Z  2024-12-18T00:54:55.1073459Z  2024-12-18T00:54:55.1073895Z  2024-12-18T00:54:55.1074269Z  2024-12-18T00:54:55.1075073Z  2024-12-18T00:54:55.1075999Z [17,546 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:55.1077125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:54:55.1078129Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2024-12-18T00:54:55.1079030Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:55.1079902Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2024-12-18T00:54:55.1080841Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:54:55.1081754Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:55.1082644Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:54:55.1083695Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local ... 2024-12-18T00:54:55.4318281Z 2024-12-18T00:54:55.4319183Z  2024-12-18T00:54:55.4319627Z  2024-12-18T00:54:55.4320070Z  2024-12-18T00:54:55.4320462Z  2024-12-18T00:54:55.4320876Z  2024-12-18T00:54:55.4321261Z  2024-12-18T00:54:55.4321643Z  2024-12-18T00:54:55.4322676Z  2024-12-18T00:54:55.4323599Z [17,546 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:55.4324718Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:54:55.4325697Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:55.4326629Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:55.4327503Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:54:55.4328563Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:54:55.4329488Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:55.4330435Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:54:55.4331856Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local ... 2024-12-18T00:54:55.6323264Z 2024-12-18T00:54:55.6324172Z  2024-12-18T00:54:55.6324642Z  2024-12-18T00:54:55.6325165Z  2024-12-18T00:54:55.6326984Z  2024-12-18T00:54:55.6329121Z  2024-12-18T00:54:55.6329622Z  2024-12-18T00:54:55.6330068Z  2024-12-18T00:54:55.6330503Z  2024-12-18T00:54:55.6331498Z [17,547 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:55.6332712Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:54:55.6333771Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:55.6334787Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2024-12-18T00:54:55.6335747Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:54:55.6336963Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:54:55.6338222Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2024-12-18T00:54:55.6339239Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2024-12-18T00:54:55.6340398Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 11s local ... 2024-12-18T00:54:56.0328917Z 2024-12-18T00:54:56.0329760Z  2024-12-18T00:54:56.0330217Z  2024-12-18T00:54:56.0330605Z  2024-12-18T00:54:56.0330985Z  2024-12-18T00:54:56.0331350Z  2024-12-18T00:54:56.0331718Z  2024-12-18T00:54:56.0332063Z  2024-12-18T00:54:56.0332447Z  2024-12-18T00:54:56.0333332Z [17,548 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:56.0334437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:54:56.0335401Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:56.0336309Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:54:56.0337709Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2024-12-18T00:54:56.0338650Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:54:56.0339498Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:54:56.0340394Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:54:56.0341372Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local ... 2024-12-18T00:54:56.2332481Z 2024-12-18T00:54:56.2333336Z  2024-12-18T00:54:56.2333824Z  2024-12-18T00:54:56.2334239Z  2024-12-18T00:54:56.2334629Z  2024-12-18T00:54:56.2335036Z  2024-12-18T00:54:56.2335433Z  2024-12-18T00:54:56.2335827Z  2024-12-18T00:54:56.2336245Z  2024-12-18T00:54:56.2337384Z [17,549 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:56.2338605Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:54:56.2339658Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2024-12-18T00:54:56.2340587Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:54:56.2341463Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:54:56.2342492Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:54:56.2343447Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:54:56.2344595Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:54:56.2345634Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local ... 2024-12-18T00:54:56.5070691Z 2024-12-18T00:54:56.5071484Z  2024-12-18T00:54:56.5071901Z  2024-12-18T00:54:56.5072240Z  2024-12-18T00:54:56.5072588Z  2024-12-18T00:54:56.5072939Z  2024-12-18T00:54:56.5073295Z  2024-12-18T00:54:56.5073895Z  2024-12-18T00:54:56.5074226Z  2024-12-18T00:54:56.5075068Z [17,551 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:56.5076054Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:54:56.5076943Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:54:56.5077914Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2024-12-18T00:54:56.5078605Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:54:56.5079440Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:54:56.5080235Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2024-12-18T00:54:56.5081072Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2024-12-18T00:54:56.5081995Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 12s local ... 2024-12-18T00:54:56.8338709Z 2024-12-18T00:54:56.8339498Z  2024-12-18T00:54:56.8339933Z  2024-12-18T00:54:56.8340277Z  2024-12-18T00:54:56.8340866Z  2024-12-18T00:54:56.8341208Z  2024-12-18T00:54:56.8341554Z  2024-12-18T00:54:56.8341891Z  2024-12-18T00:54:56.8342238Z  2024-12-18T00:54:56.8343079Z [17,554 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:56.8343982Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:54:56.8345045Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2024-12-18T00:54:56.8345802Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:54:56.8346565Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2024-12-18T00:54:56.8347391Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:54:56.8348114Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:54:56.8348928Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:54:56.8350037Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local ... 2024-12-18T00:54:57.2746262Z 2024-12-18T00:54:57.2747266Z  2024-12-18T00:54:57.2747772Z  2024-12-18T00:54:57.2748161Z  2024-12-18T00:54:57.2748560Z  2024-12-18T00:54:57.2748956Z  2024-12-18T00:54:57.2749358Z  2024-12-18T00:54:57.2749753Z  2024-12-18T00:54:57.2750151Z  2024-12-18T00:54:57.2751102Z [17,555 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:57.2752291Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:54:57.2753339Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:54:57.2754216Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:54:57.2755099Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:54:57.2756163Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:54:57.2757342Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:54:57.2758238Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:54:57.2759222Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local ... 2024-12-18T00:54:57.5669984Z 2024-12-18T00:54:57.5670867Z  2024-12-18T00:54:57.5671323Z  2024-12-18T00:54:57.5671718Z  2024-12-18T00:54:57.5672071Z  2024-12-18T00:54:57.5672444Z  2024-12-18T00:54:57.5672815Z  2024-12-18T00:54:57.5673148Z  2024-12-18T00:54:57.5673508Z  2024-12-18T00:54:57.5674446Z [17,557 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:54:57.5675476Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:54:57.5676421Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:54:57.5677301Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2024-12-18T00:54:57.5678864Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:54:57.5679972Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:54:57.5681022Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2024-12-18T00:54:57.5682073Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2024-12-18T00:54:57.5683274Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 13s local ... 2024-12-18T00:54:57.8346032Z 2024-12-18T00:54:57.8346898Z  2024-12-18T00:54:57.8347368Z  2024-12-18T00:54:57.8347740Z  2024-12-18T00:54:57.8348124Z  2024-12-18T00:54:57.8348501Z  2024-12-18T00:54:57.8348888Z  2024-12-18T00:54:57.8349280Z  2024-12-18T00:54:57.8349667Z  2024-12-18T00:54:57.8350561Z [17,557 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:57.8351549Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:54:57.8352756Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:54:57.8353620Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:57.8354872Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:54:57.8355798Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:54:57.8356841Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:57.8357899Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:54:57.8359074Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local ... 2024-12-18T00:54:58.0350712Z 2024-12-18T00:54:58.0351707Z  2024-12-18T00:54:58.0352202Z  2024-12-18T00:54:58.0352623Z  2024-12-18T00:54:58.0353005Z  2024-12-18T00:54:58.0353341Z  2024-12-18T00:54:58.0353698Z  2024-12-18T00:54:58.0354057Z  2024-12-18T00:54:58.0354456Z  2024-12-18T00:54:58.0355597Z [17,559 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:58.0356818Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:54:58.0357782Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2024-12-18T00:54:58.0358672Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:58.0359491Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2024-12-18T00:54:58.0360537Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:54:58.0361431Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:58.0362371Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:54:58.0363402Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local ... 2024-12-18T00:54:58.3484546Z 2024-12-18T00:54:58.3485430Z  2024-12-18T00:54:58.3485919Z  2024-12-18T00:54:58.3486350Z  2024-12-18T00:54:58.3486721Z  2024-12-18T00:54:58.3487134Z  2024-12-18T00:54:58.3487539Z  2024-12-18T00:54:58.3487909Z  2024-12-18T00:54:58.3488307Z  2024-12-18T00:54:58.3489219Z [17,562 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:58.3490340Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:54:58.3491334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:54:58.3492247Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:58.3493099Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:54:58.3494081Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:54:58.3494995Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:58.3496000Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:54:58.3497490Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local ... 2024-12-18T00:54:58.6354335Z 2024-12-18T00:54:58.6355236Z  2024-12-18T00:54:58.6355705Z  2024-12-18T00:54:58.6356059Z  2024-12-18T00:54:58.6356454Z  2024-12-18T00:54:58.6356824Z  2024-12-18T00:54:58.6357207Z  2024-12-18T00:54:58.6357568Z  2024-12-18T00:54:58.6357929Z  2024-12-18T00:54:58.6358837Z [17,562 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:58.6359988Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:54:58.6360975Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:54:58.6361913Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2024-12-18T00:54:58.6362799Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2024-12-18T00:54:58.6363787Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:54:58.6364718Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2024-12-18T00:54:58.6365911Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2024-12-18T00:54:58.6366957Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 14s local ... 2024-12-18T00:54:59.1832259Z 2024-12-18T00:54:59.1833154Z  2024-12-18T00:54:59.1833647Z  2024-12-18T00:54:59.1834002Z  2024-12-18T00:54:59.1834371Z  2024-12-18T00:54:59.1834859Z  2024-12-18T00:54:59.1835354Z  2024-12-18T00:54:59.1835874Z  2024-12-18T00:54:59.1836363Z  2024-12-18T00:54:59.1837406Z [17,563 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:59.1838549Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:54:59.1839559Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2024-12-18T00:54:59.1840480Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:54:59.1841358Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:54:59.1842720Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:54:59.1843654Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:54:59.1844827Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2024-12-18T00:54:59.1845891Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local ... 2024-12-18T00:54:59.4360960Z 2024-12-18T00:54:59.4361939Z  2024-12-18T00:54:59.4362525Z  2024-12-18T00:54:59.4362984Z  2024-12-18T00:54:59.4363386Z  2024-12-18T00:54:59.4363876Z  2024-12-18T00:54:59.4364300Z  2024-12-18T00:54:59.4364667Z  2024-12-18T00:54:59.4365058Z  2024-12-18T00:54:59.4366040Z [17,563 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:54:59.4367195Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2024-12-18T00:54:59.4368221Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:54:59.4369127Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:54:59.4369982Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:54:59.4371249Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:54:59.4372127Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2024-12-18T00:54:59.4373156Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2024-12-18T00:54:59.4374228Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local ... 2024-12-18T00:54:59.7333087Z 2024-12-18T00:54:59.7334489Z  2024-12-18T00:54:59.7334987Z  2024-12-18T00:54:59.7335411Z  2024-12-18T00:54:59.7335773Z  2024-12-18T00:54:59.7336149Z  2024-12-18T00:54:59.7336745Z  2024-12-18T00:54:59.7337165Z  2024-12-18T00:54:59.7337548Z  2024-12-18T00:54:59.7338541Z [17,566 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:54:59.7339987Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2024-12-18T00:54:59.7341004Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:54:59.7341902Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2024-12-18T00:54:59.7342724Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:54:59.7343634Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:54:59.7344650Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:54:59.7345528Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 22s local 2024-12-18T00:54:59.7346536Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local ... 2024-12-18T00:55:00.0367068Z 2024-12-18T00:55:00.0368352Z  2024-12-18T00:55:00.0368836Z  2024-12-18T00:55:00.0369248Z  2024-12-18T00:55:00.0369684Z  2024-12-18T00:55:00.0370093Z  2024-12-18T00:55:00.0370506Z  2024-12-18T00:55:00.0371155Z  2024-12-18T00:55:00.0371578Z  2024-12-18T00:55:00.0372553Z [17,566 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:00.0373735Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2024-12-18T00:55:00.0374806Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:55:00.0375769Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:55:00.0376863Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2024-12-18T00:55:00.0377899Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:55:00.0378862Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:55:00.0379843Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 22s local 2024-12-18T00:55:00.0380961Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local ... 2024-12-18T00:55:00.2371806Z 2024-12-18T00:55:00.2373019Z  2024-12-18T00:55:00.2373563Z  2024-12-18T00:55:00.2373956Z  2024-12-18T00:55:00.2374334Z  2024-12-18T00:55:00.2374691Z  2024-12-18T00:55:00.2375076Z  2024-12-18T00:55:00.2375476Z  2024-12-18T00:55:00.2375848Z  2024-12-18T00:55:00.2376956Z [17,568 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:00.2378101Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:55:00.2379097Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2024-12-18T00:55:00.2380043Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:55:00.2380946Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:55:00.2381954Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:55:00.2382912Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2024-12-18T00:55:00.2383841Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2024-12-18T00:55:00.2384799Z Compiling xla/service/hlo_graph_dumper.cc; 15s local ... 2024-12-18T00:55:00.7292167Z 2024-12-18T00:55:00.7293798Z  2024-12-18T00:55:00.7294285Z  2024-12-18T00:55:00.7295686Z  2024-12-18T00:55:00.7296686Z  2024-12-18T00:55:00.7297967Z  2024-12-18T00:55:00.7299246Z  2024-12-18T00:55:00.7300611Z  2024-12-18T00:55:00.7301803Z  2024-12-18T00:55:00.7303780Z [17,569 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:00.7304911Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:55:00.7305915Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:55:00.7306806Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2024-12-18T00:55:00.7307592Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:55:00.7308921Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 29s local 2024-12-18T00:55:00.7309936Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:55:00.7310838Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:55:00.7311720Z Compiling xla/service/hlo_graph_dumper.cc; 15s local ... 2024-12-18T00:55:00.9462068Z 2024-12-18T00:55:00.9463517Z  2024-12-18T00:55:00.9463942Z  2024-12-18T00:55:00.9465530Z  2024-12-18T00:55:00.9466445Z  2024-12-18T00:55:00.9467687Z  2024-12-18T00:55:00.9468874Z  2024-12-18T00:55:00.9470362Z  2024-12-18T00:55:00.9471483Z  2024-12-18T00:55:00.9473180Z [17,570 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:00.9474284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:55:00.9475256Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:55:00.9476393Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:55:00.9477262Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2024-12-18T00:55:00.9478238Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 29s local 2024-12-18T00:55:00.9479125Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:55:00.9479973Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:55:00.9480871Z Compiling xla/service/hlo_graph_dumper.cc; 16s local ... 2024-12-18T00:55:01.2378819Z 2024-12-18T00:55:01.2380342Z  2024-12-18T00:55:01.2380842Z  2024-12-18T00:55:01.2382258Z  2024-12-18T00:55:01.2383292Z  2024-12-18T00:55:01.2384626Z  2024-12-18T00:55:01.2385879Z  2024-12-18T00:55:01.2387184Z  2024-12-18T00:55:01.2388413Z  2024-12-18T00:55:01.2390310Z [17,573 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:01.2391681Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:01.2392812Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2024-12-18T00:55:01.2393716Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:55:01.2394569Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:55:01.2395406Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:55:01.2396245Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:55:01.2397080Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:55:01.2398026Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local ... 2024-12-18T00:55:01.5330115Z 2024-12-18T00:55:01.5330953Z  2024-12-18T00:55:01.5331446Z  2024-12-18T00:55:01.5331835Z  2024-12-18T00:55:01.5332208Z  2024-12-18T00:55:01.5332596Z  2024-12-18T00:55:01.5332979Z  2024-12-18T00:55:01.5333375Z  2024-12-18T00:55:01.5333793Z  2024-12-18T00:55:01.5334784Z [17,574 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:01.5335886Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:01.5337004Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:55:01.5337947Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:55:01.5338801Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:55:01.5339645Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2024-12-18T00:55:01.5340511Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2024-12-18T00:55:01.5341372Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:55:01.5342378Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local ... 2024-12-18T00:55:01.7537884Z 2024-12-18T00:55:01.7539304Z  2024-12-18T00:55:01.7540146Z  2024-12-18T00:55:01.7540552Z  2024-12-18T00:55:01.7541010Z  2024-12-18T00:55:01.7541413Z  2024-12-18T00:55:01.7541804Z  2024-12-18T00:55:01.7542206Z  2024-12-18T00:55:01.7542594Z  2024-12-18T00:55:01.7543540Z [17,576 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:01.7544968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:01.7546014Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:55:01.7546996Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2024-12-18T00:55:01.7547876Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:55:01.7548693Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:55:01.7549584Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:55:01.7550474Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2024-12-18T00:55:01.7551746Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:55:02.0109057Z 2024-12-18T00:55:02.0110574Z  2024-12-18T00:55:02.0111082Z  2024-12-18T00:55:02.0112556Z  2024-12-18T00:55:02.0113490Z  2024-12-18T00:55:02.0114751Z  2024-12-18T00:55:02.0116248Z  2024-12-18T00:55:02.0117517Z  2024-12-18T00:55:02.0118761Z  2024-12-18T00:55:02.0120649Z [17,577 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:02.0121815Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:02.0122796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:55:02.0124438Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:55:02.0125291Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2024-12-18T00:55:02.0126173Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:55:02.0127365Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:55:02.0128342Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:55:02.0129323Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:55:02.2387511Z 2024-12-18T00:55:02.2389073Z  2024-12-18T00:55:02.2389550Z  2024-12-18T00:55:02.2390968Z  2024-12-18T00:55:02.2391924Z  2024-12-18T00:55:02.2393055Z  2024-12-18T00:55:02.2394291Z  2024-12-18T00:55:02.2395632Z  2024-12-18T00:55:02.2397014Z  2024-12-18T00:55:02.2398920Z [17,578 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:02.2400163Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:55:02.2401228Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2024-12-18T00:55:02.2402161Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:55:02.2403090Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:55:02.2403977Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:55:02.2404841Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:55:02.2405714Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:55:02.2406733Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:55:02.4391287Z 2024-12-18T00:55:02.4392811Z  2024-12-18T00:55:02.4393387Z  2024-12-18T00:55:02.4393773Z  2024-12-18T00:55:02.4394145Z  2024-12-18T00:55:02.4394535Z  2024-12-18T00:55:02.4394950Z  2024-12-18T00:55:02.4395332Z  2024-12-18T00:55:02.4395718Z  2024-12-18T00:55:02.4396665Z [17,580 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:02.4397768Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:55:02.4399103Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:55:02.4399976Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:55:02.4400848Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:55:02.4401680Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2024-12-18T00:55:02.4402458Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2024-12-18T00:55:02.4403257Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:55:02.4404294Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2024-12-18T00:55:02.7383563Z 2024-12-18T00:55:02.7385073Z  2024-12-18T00:55:02.7385594Z  2024-12-18T00:55:02.7385999Z  2024-12-18T00:55:02.7386416Z  2024-12-18T00:55:02.7386832Z  2024-12-18T00:55:02.7387249Z  2024-12-18T00:55:02.7387663Z  2024-12-18T00:55:02.7388063Z  2024-12-18T00:55:02.7389283Z [17,583 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:02.7390402Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:55:02.7391412Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:55:02.7392277Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2024-12-18T00:55:02.7393076Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:55:02.7393896Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:55:02.7394729Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:55:02.7395558Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2024-12-18T00:55:02.7396570Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local ... 2024-12-18T00:55:02.9499038Z 2024-12-18T00:55:02.9500372Z  2024-12-18T00:55:02.9500877Z  2024-12-18T00:55:02.9501301Z  2024-12-18T00:55:02.9501729Z  2024-12-18T00:55:02.9502141Z  2024-12-18T00:55:02.9502521Z  2024-12-18T00:55:02.9505502Z  2024-12-18T00:55:02.9505893Z  2024-12-18T00:55:02.9506809Z [17,584 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:02.9507996Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:55:02.9508940Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:55:02.9509836Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:55:02.9510680Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2024-12-18T00:55:02.9511549Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:55:02.9512333Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:55:02.9513146Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:55:02.9514131Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local ... 2024-12-18T00:55:03.2398666Z 2024-12-18T00:55:03.2400098Z  2024-12-18T00:55:03.2400634Z  2024-12-18T00:55:03.2401041Z  2024-12-18T00:55:03.2401452Z  2024-12-18T00:55:03.2401853Z  2024-12-18T00:55:03.2402293Z  2024-12-18T00:55:03.2402733Z  2024-12-18T00:55:03.2403226Z  2024-12-18T00:55:03.2404181Z [17,584 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:03.2405194Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:03.2406128Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2024-12-18T00:55:03.2406967Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:55:03.2407818Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:55:03.2408604Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:55:03.2409441Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:55:03.2410666Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:55:03.2411624Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local ... 2024-12-18T00:55:03.6379209Z 2024-12-18T00:55:03.6380537Z  2024-12-18T00:55:03.6381031Z  2024-12-18T00:55:03.6381453Z  2024-12-18T00:55:03.6381827Z  2024-12-18T00:55:03.6382232Z  2024-12-18T00:55:03.6382617Z  2024-12-18T00:55:03.6383026Z  2024-12-18T00:55:03.6383419Z  2024-12-18T00:55:03.6384369Z [17,585 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:03.6385545Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:03.6386589Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:55:03.6387541Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2024-12-18T00:55:03.6388441Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:55:03.6389631Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2024-12-18T00:55:03.6390529Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2024-12-18T00:55:03.6391420Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2024-12-18T00:55:03.6392473Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local ... 2024-12-18T00:55:03.8404718Z 2024-12-18T00:55:03.8406072Z  2024-12-18T00:55:03.8406542Z  2024-12-18T00:55:03.8406908Z  2024-12-18T00:55:03.8407279Z  2024-12-18T00:55:03.8407649Z  2024-12-18T00:55:03.8408034Z  2024-12-18T00:55:03.8408428Z  2024-12-18T00:55:03.8408805Z  2024-12-18T00:55:03.8409746Z [17,586 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:03.8410917Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:03.8411989Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:55:03.8413192Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:55:03.8414239Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:55:03.8415151Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:55:03.8416046Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:55:03.8417192Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:55:03.8418172Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local ... 2024-12-18T00:55:04.0433187Z 2024-12-18T00:55:04.0434466Z  2024-12-18T00:55:04.0434895Z  2024-12-18T00:55:04.0435227Z  2024-12-18T00:55:04.0435556Z  2024-12-18T00:55:04.0435876Z  2024-12-18T00:55:04.0436208Z  2024-12-18T00:55:04.0436530Z  2024-12-18T00:55:04.0436861Z  2024-12-18T00:55:04.0437656Z [17,587 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:04.0438627Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:04.0439450Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2024-12-18T00:55:04.0440204Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:55:04.0440915Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2024-12-18T00:55:04.0441642Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:55:04.0442509Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:55:04.0443236Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:55:04.0444088Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local ... 2024-12-18T00:55:04.4410578Z 2024-12-18T00:55:04.4411941Z  2024-12-18T00:55:04.4412398Z  2024-12-18T00:55:04.4412738Z  2024-12-18T00:55:04.4413122Z  2024-12-18T00:55:04.4413496Z  2024-12-18T00:55:04.4413896Z  2024-12-18T00:55:04.4414574Z  2024-12-18T00:55:04.4414959Z  2024-12-18T00:55:04.4415968Z [17,587 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:04.4417348Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:55:04.4418441Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2024-12-18T00:55:04.4419361Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2024-12-18T00:55:04.4420222Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:55:04.4421055Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2024-12-18T00:55:04.4421941Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2024-12-18T00:55:04.4422821Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2024-12-18T00:55:04.4424573Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local ... 2024-12-18T00:55:04.8415588Z 2024-12-18T00:55:04.8417151Z  2024-12-18T00:55:04.8417719Z  2024-12-18T00:55:04.8418136Z  2024-12-18T00:55:04.8418797Z  2024-12-18T00:55:04.8419200Z  2024-12-18T00:55:04.8419588Z  2024-12-18T00:55:04.8419958Z  2024-12-18T00:55:04.8420390Z  2024-12-18T00:55:04.8421399Z [17,588 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:04.8422481Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:55:04.8423535Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2024-12-18T00:55:04.8424474Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:55:04.8425250Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:55:04.8426085Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:55:04.8426891Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:55:04.8427767Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:55:04.8428976Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local ... 2024-12-18T00:55:05.0871202Z 2024-12-18T00:55:05.0872059Z  2024-12-18T00:55:05.0872480Z  2024-12-18T00:55:05.0872859Z  2024-12-18T00:55:05.0873209Z  2024-12-18T00:55:05.0873565Z  2024-12-18T00:55:05.0873924Z  2024-12-18T00:55:05.0874259Z  2024-12-18T00:55:05.0874611Z  2024-12-18T00:55:05.0875482Z [17,589 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:05.0876482Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:55:05.0877405Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2024-12-18T00:55:05.0878217Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:55:05.0878998Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2024-12-18T00:55:05.0879807Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:55:05.0880649Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:55:05.0881443Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:55:05.0882340Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local ... 2024-12-18T00:55:05.4422024Z 2024-12-18T00:55:05.4423333Z  2024-12-18T00:55:05.4424463Z  2024-12-18T00:55:05.4424870Z  2024-12-18T00:55:05.4425284Z  2024-12-18T00:55:05.4425694Z  2024-12-18T00:55:05.4426106Z  2024-12-18T00:55:05.4426501Z  2024-12-18T00:55:05.4426910Z  2024-12-18T00:55:05.4427893Z [17,590 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:05.4429112Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:55:05.4430153Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:55:05.4430982Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:55:05.4432125Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:55:05.4432959Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:55:05.4433788Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:55:05.4434772Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:55:05.4435672Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local ... 2024-12-18T00:55:05.6683473Z 2024-12-18T00:55:05.6684826Z  2024-12-18T00:55:05.6685341Z  2024-12-18T00:55:05.6685743Z  2024-12-18T00:55:05.6698714Z  2024-12-18T00:55:05.6699162Z  2024-12-18T00:55:05.6699581Z  2024-12-18T00:55:05.6699967Z  2024-12-18T00:55:05.6700370Z  2024-12-18T00:55:05.6701309Z [17,594 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:05.6702494Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:55:05.6703931Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:55:05.6704880Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2024-12-18T00:55:05.6705804Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:55:05.6706663Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2024-12-18T00:55:05.6707542Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2024-12-18T00:55:05.6708330Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2024-12-18T00:55:05.6709273Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local ... 2024-12-18T00:55:05.9731465Z 2024-12-18T00:55:05.9732341Z  2024-12-18T00:55:05.9732837Z  2024-12-18T00:55:05.9733251Z  2024-12-18T00:55:05.9733642Z  2024-12-18T00:55:05.9734038Z  2024-12-18T00:55:05.9734401Z  2024-12-18T00:55:05.9734806Z  2024-12-18T00:55:05.9735202Z  2024-12-18T00:55:05.9736569Z [17,598 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:05.9737938Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:55:05.9738846Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:55:05.9739753Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2024-12-18T00:55:05.9740586Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:55:05.9741353Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:55:05.9742277Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:55:05.9743365Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2024-12-18T00:55:05.9744643Z Compiling xla/hlo/ir/hlo_module.cc; 17s local ... 2024-12-18T00:55:06.2427866Z 2024-12-18T00:55:06.2428773Z  2024-12-18T00:55:06.2429226Z  2024-12-18T00:55:06.2429597Z  2024-12-18T00:55:06.2430035Z  2024-12-18T00:55:06.2430407Z  2024-12-18T00:55:06.2430811Z  2024-12-18T00:55:06.2431202Z  2024-12-18T00:55:06.2431588Z  2024-12-18T00:55:06.2432512Z [17,599 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:06.2433591Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:55:06.2434672Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2024-12-18T00:55:06.2435611Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:55:06.2436437Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:55:06.2437230Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:55:06.2438186Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:55:06.2439355Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:55:06.2440292Z Compiling xla/hlo/ir/hlo_module.cc; 17s local ... 2024-12-18T00:55:06.4432829Z 2024-12-18T00:55:06.4434842Z  2024-12-18T00:55:06.4435387Z  2024-12-18T00:55:06.4435792Z  2024-12-18T00:55:06.4436191Z  2024-12-18T00:55:06.4436578Z  2024-12-18T00:55:06.4436942Z  2024-12-18T00:55:06.4437308Z  2024-12-18T00:55:06.4437672Z  2024-12-18T00:55:06.4438607Z [17,600 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:06.4439748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:55:06.4440795Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:06.4441771Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:55:06.4442597Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2024-12-18T00:55:06.4443399Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:55:06.4445160Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2024-12-18T00:55:06.4446595Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:55:06.4447521Z Compiling xla/hlo/ir/hlo_module.cc; 18s local ... 2024-12-18T00:55:06.7214254Z 2024-12-18T00:55:06.7215596Z  2024-12-18T00:55:06.7216341Z  2024-12-18T00:55:06.7217512Z  2024-12-18T00:55:06.7217971Z  2024-12-18T00:55:06.7218366Z  2024-12-18T00:55:06.7218760Z  2024-12-18T00:55:06.7219161Z  2024-12-18T00:55:06.7219569Z  2024-12-18T00:55:06.7220489Z [17,601 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:06.7221538Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:55:06.7222558Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:06.7223555Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:55:06.7225178Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:55:06.7226309Z Compiling xla/service/hlo_graph_dumper.cc; 21s local 2024-12-18T00:55:06.7227406Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:55:06.7228549Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:55:06.7229546Z Compiling xla/hlo/ir/hlo_module.cc; 18s local ... 2024-12-18T00:55:07.0437697Z 2024-12-18T00:55:07.0438593Z  2024-12-18T00:55:07.0439076Z  2024-12-18T00:55:07.0439468Z  2024-12-18T00:55:07.0439847Z  2024-12-18T00:55:07.0440181Z  2024-12-18T00:55:07.0440520Z  2024-12-18T00:55:07.0440880Z  2024-12-18T00:55:07.0441254Z  2024-12-18T00:55:07.0442138Z [17,603 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:07.0443232Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:55:07.0444644Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:07.0445705Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2024-12-18T00:55:07.0446571Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:55:07.0447564Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:55:07.0448771Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2024-12-18T00:55:07.0449679Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2024-12-18T00:55:07.0450487Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local ... 2024-12-18T00:55:07.2441804Z 2024-12-18T00:55:07.2442745Z  2024-12-18T00:55:07.2443217Z  2024-12-18T00:55:07.2443619Z  2024-12-18T00:55:07.2444548Z  2024-12-18T00:55:07.2444947Z  2024-12-18T00:55:07.2445530Z  2024-12-18T00:55:07.2446062Z  2024-12-18T00:55:07.2446581Z  2024-12-18T00:55:07.2447667Z [17,604 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:07.2449323Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:55:07.2450532Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2024-12-18T00:55:07.2451647Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:55:07.2452684Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:55:07.2453789Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:55:07.2455090Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 21s local 2024-12-18T00:55:07.2456134Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2024-12-18T00:55:07.2457227Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local ... 2024-12-18T00:55:07.6447118Z 2024-12-18T00:55:07.6448979Z  2024-12-18T00:55:07.6449444Z  2024-12-18T00:55:07.6451736Z  2024-12-18T00:55:07.6454896Z  2024-12-18T00:55:07.6458160Z  2024-12-18T00:55:07.6461237Z  2024-12-18T00:55:07.6464272Z  2024-12-18T00:55:07.6467738Z  2024-12-18T00:55:07.6471316Z [17,606 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:07.6472892Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:55:07.6474148Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2024-12-18T00:55:07.6475360Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2024-12-18T00:55:07.6476442Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2024-12-18T00:55:07.6477628Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2024-12-18T00:55:07.6478804Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2024-12-18T00:55:07.6479828Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:55:07.6480994Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local ... 2024-12-18T00:55:08.5067273Z 2024-12-18T00:55:08.5068700Z  2024-12-18T00:55:08.5069468Z  2024-12-18T00:55:08.5070558Z  2024-12-18T00:55:08.5071364Z  2024-12-18T00:55:08.5071756Z  2024-12-18T00:55:08.5072135Z  2024-12-18T00:55:08.5072529Z  2024-12-18T00:55:08.5072920Z  2024-12-18T00:55:08.5073806Z [17,607 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:08.5074856Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:55:08.5075865Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:08.5076801Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2024-12-18T00:55:08.5077609Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2024-12-18T00:55:08.5078552Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2024-12-18T00:55:08.5079445Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:55:08.5080205Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:55:08.5081118Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local ... 2024-12-18T00:55:08.7247454Z 2024-12-18T00:55:08.7248715Z  2024-12-18T00:55:08.7249201Z  2024-12-18T00:55:08.7249581Z  2024-12-18T00:55:08.7249939Z  2024-12-18T00:55:08.7250291Z  2024-12-18T00:55:08.7250678Z  2024-12-18T00:55:08.7251052Z  2024-12-18T00:55:08.7251426Z  2024-12-18T00:55:08.7252316Z [17,608 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:08.7253329Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:55:08.7254276Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:08.7255227Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2024-12-18T00:55:08.7256056Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:55:08.7257167Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:55:08.7258396Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:55:08.7259202Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:55:08.7260099Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local ... 2024-12-18T00:55:09.0456249Z 2024-12-18T00:55:09.0457317Z  2024-12-18T00:55:09.0457803Z  2024-12-18T00:55:09.0458217Z  2024-12-18T00:55:09.0458601Z  2024-12-18T00:55:09.0459042Z  2024-12-18T00:55:09.0459445Z  2024-12-18T00:55:09.0459850Z  2024-12-18T00:55:09.0460251Z  2024-12-18T00:55:09.0461230Z [17,610 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:09.0462371Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:55:09.0463381Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:09.0464297Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2024-12-18T00:55:09.0465557Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:55:09.0466503Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:55:09.0467378Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:55:09.0468113Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:55:09.0469521Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local ... 2024-12-18T00:55:09.2459853Z 2024-12-18T00:55:09.2460740Z  2024-12-18T00:55:09.2461209Z  2024-12-18T00:55:09.2461569Z  2024-12-18T00:55:09.2461942Z  2024-12-18T00:55:09.2462497Z  2024-12-18T00:55:09.2462896Z  2024-12-18T00:55:09.2463284Z  2024-12-18T00:55:09.2463683Z  2024-12-18T00:55:09.2464548Z [17,613 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:09.2465643Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:55:09.2466866Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2024-12-18T00:55:09.2467777Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:55:09.2468689Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:55:09.2469590Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2024-12-18T00:55:09.2470464Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:09.2471390Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2024-12-18T00:55:09.2472362Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 16s local ... 2024-12-18T00:55:09.5624788Z 2024-12-18T00:55:09.5625695Z  2024-12-18T00:55:09.5626136Z  2024-12-18T00:55:09.5626565Z  2024-12-18T00:55:09.5626966Z  2024-12-18T00:55:09.5627337Z  2024-12-18T00:55:09.5627817Z  2024-12-18T00:55:09.5628188Z  2024-12-18T00:55:09.5628557Z  2024-12-18T00:55:09.5629516Z [17,616 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:09.5630609Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:55:09.5631575Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:55:09.5632440Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2024-12-18T00:55:09.5633306Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2024-12-18T00:55:09.5634164Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2024-12-18T00:55:09.5634911Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:09.5635757Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2024-12-18T00:55:09.5636553Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2024-12-18T00:55:09.8467037Z 2024-12-18T00:55:09.8467992Z  2024-12-18T00:55:09.8468451Z  2024-12-18T00:55:09.8470465Z  2024-12-18T00:55:09.8473771Z  2024-12-18T00:55:09.8476709Z  2024-12-18T00:55:09.8479634Z  2024-12-18T00:55:09.8482589Z  2024-12-18T00:55:09.8485318Z  2024-12-18T00:55:09.8486518Z [17,617 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:09.8487960Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:55:09.8489312Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:55:09.8490459Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:55:09.8491585Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:55:09.8492741Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2024-12-18T00:55:09.8493745Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:09.8494855Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:55:09.8495931Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2024-12-18T00:55:10.0501356Z 2024-12-18T00:55:10.0502877Z  2024-12-18T00:55:10.0504104Z  2024-12-18T00:55:10.0504828Z  2024-12-18T00:55:10.0505886Z  2024-12-18T00:55:10.0506368Z  2024-12-18T00:55:10.0506755Z  2024-12-18T00:55:10.0507166Z  2024-12-18T00:55:10.0507563Z  2024-12-18T00:55:10.0508460Z [17,618 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:10.0509602Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:55:10.0510710Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2024-12-18T00:55:10.0511579Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:55:10.0512545Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:55:10.0513531Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2024-12-18T00:55:10.0514358Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:10.0515347Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:55:10.0516599Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2024-12-18T00:55:10.3621237Z 2024-12-18T00:55:10.3622509Z  2024-12-18T00:55:10.3622986Z  2024-12-18T00:55:10.3623377Z  2024-12-18T00:55:10.3623756Z  2024-12-18T00:55:10.3624816Z  2024-12-18T00:55:10.3625272Z  2024-12-18T00:55:10.3625681Z  2024-12-18T00:55:10.3626091Z  2024-12-18T00:55:10.3627029Z [17,621 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:10.3628101Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:55:10.3629204Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:55:10.3630006Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:55:10.3630847Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:55:10.3631818Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:10.3632634Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2024-12-18T00:55:10.3633400Z Compiling xla/hlo/ir/hlo_schedule.cc; 15s local 2024-12-18T00:55:10.3634159Z Compiling xla/service/host_offload_utils.cc; 12s local ... 2024-12-18T00:55:10.6472669Z 2024-12-18T00:55:10.6473571Z  2024-12-18T00:55:10.6474346Z  2024-12-18T00:55:10.6474850Z  2024-12-18T00:55:10.6475378Z  2024-12-18T00:55:10.6475861Z  2024-12-18T00:55:10.6476344Z  2024-12-18T00:55:10.6476866Z  2024-12-18T00:55:10.6477495Z  2024-12-18T00:55:10.6478464Z [17,622 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:10.6479682Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:55:10.6480735Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:55:10.6481997Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2024-12-18T00:55:10.6483089Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2024-12-18T00:55:10.6484208Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:10.6485183Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:55:10.6486087Z Compiling xla/service/host_offload_utils.cc; 12s local 2024-12-18T00:55:10.6487156Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 12s local ... 2024-12-18T00:55:10.8516350Z 2024-12-18T00:55:10.8517229Z  2024-12-18T00:55:10.8517717Z  2024-12-18T00:55:10.8518143Z  2024-12-18T00:55:10.8518547Z  2024-12-18T00:55:10.8518929Z  2024-12-18T00:55:10.8519312Z  2024-12-18T00:55:10.8519703Z  2024-12-18T00:55:10.8520077Z  2024-12-18T00:55:10.8520983Z [17,624 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:10.8522368Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:55:10.8523447Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:55:10.8525043Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:55:10.8525947Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:55:10.8526939Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:10.8527818Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:55:10.8528791Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 12s local 2024-12-18T00:55:10.8529760Z @llvm-project//mlir:SparseTensorDialect; 12s local ... 2024-12-18T00:55:11.1354077Z 2024-12-18T00:55:11.1355081Z  2024-12-18T00:55:11.1355602Z  2024-12-18T00:55:11.1357669Z  2024-12-18T00:55:11.1358449Z  2024-12-18T00:55:11.1359133Z  2024-12-18T00:55:11.1359553Z  2024-12-18T00:55:11.1359987Z  2024-12-18T00:55:11.1360389Z  2024-12-18T00:55:11.1361578Z [17,626 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:11.1362851Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:55:11.1363978Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2024-12-18T00:55:11.1364969Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:55:11.1366452Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:55:11.1367514Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:11.1368418Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:55:11.1369294Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 12s local 2024-12-18T00:55:11.1370281Z @llvm-project//mlir:SparseTensorDialect; 12s local ... 2024-12-18T00:55:11.4476764Z 2024-12-18T00:55:11.4477651Z  2024-12-18T00:55:11.4478184Z  2024-12-18T00:55:11.4478587Z  2024-12-18T00:55:11.4479007Z  2024-12-18T00:55:11.4479407Z  2024-12-18T00:55:11.4479777Z  2024-12-18T00:55:11.4480165Z  2024-12-18T00:55:11.4480549Z  2024-12-18T00:55:11.4481464Z [17,627 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:11.4482762Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:55:11.4483816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:55:11.4484677Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:55:11.4485590Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:55:11.4486625Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:55:11.4487536Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2024-12-18T00:55:11.4488402Z @llvm-project//mlir:SparseTensorDialect; 13s local 2024-12-18T00:55:11.4489569Z Compiling xla/service/layout_assignment.cc; 11s local ... 2024-12-18T00:55:11.6482029Z 2024-12-18T00:55:11.6482999Z  2024-12-18T00:55:11.6483449Z  2024-12-18T00:55:11.6486262Z  2024-12-18T00:55:11.6489558Z  2024-12-18T00:55:11.6492650Z  2024-12-18T00:55:11.6495842Z  2024-12-18T00:55:11.6499016Z  2024-12-18T00:55:11.6501947Z  2024-12-18T00:55:11.6505442Z [17,628 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:11.6509082Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:55:11.6512600Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:55:11.6516148Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2024-12-18T00:55:11.6519648Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2024-12-18T00:55:11.6523200Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:55:11.6526958Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:11.6530411Z @llvm-project//mlir:SparseTensorDialect; 13s local 2024-12-18T00:55:11.6533840Z Compiling xla/service/layout_assignment.cc; 12s local ... 2024-12-18T00:55:11.9085905Z 2024-12-18T00:55:11.9087156Z  2024-12-18T00:55:11.9087865Z  2024-12-18T00:55:11.9088512Z  2024-12-18T00:55:11.9089586Z  2024-12-18T00:55:11.9090049Z  2024-12-18T00:55:11.9090438Z  2024-12-18T00:55:11.9090817Z  2024-12-18T00:55:11.9091198Z  2024-12-18T00:55:11.9092155Z [17,629 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:11.9093229Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:55:11.9094166Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2024-12-18T00:55:11.9095010Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:55:11.9096370Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:55:11.9097687Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:55:11.9098547Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:11.9099409Z @llvm-project//mlir:SparseTensorDialect; 13s local 2024-12-18T00:55:11.9100225Z Compiling xla/service/layout_assignment.cc; 12s local ... 2024-12-18T00:55:12.2487575Z 2024-12-18T00:55:12.2488452Z  2024-12-18T00:55:12.2488917Z  2024-12-18T00:55:12.2489293Z  2024-12-18T00:55:12.2489686Z  2024-12-18T00:55:12.2490087Z  2024-12-18T00:55:12.2490475Z  2024-12-18T00:55:12.2490846Z  2024-12-18T00:55:12.2491241Z  2024-12-18T00:55:12.2492183Z [17,629 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:12.2493253Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:12.2494296Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:55:12.2495189Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2024-12-18T00:55:12.2496093Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:55:12.2497266Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:12.2498144Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:12.2499537Z @llvm-project//mlir:SparseTensorDialect; 13s local 2024-12-18T00:55:12.2500374Z Compiling xla/service/layout_assignment.cc; 12s local ... 2024-12-18T00:55:12.4491672Z 2024-12-18T00:55:12.4492560Z  2024-12-18T00:55:12.4493034Z  2024-12-18T00:55:12.4493428Z  2024-12-18T00:55:12.4493960Z  2024-12-18T00:55:12.4494357Z  2024-12-18T00:55:12.4494775Z  2024-12-18T00:55:12.4495184Z  2024-12-18T00:55:12.4495600Z  2024-12-18T00:55:12.4496764Z [17,631 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:12.4498599Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:12.4499748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:55:12.4500902Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:55:12.4501936Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:12.4502888Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2024-12-18T00:55:12.4503781Z @llvm-project//mlir:SparseTensorDialect; 14s local 2024-12-18T00:55:12.4504642Z Compiling xla/service/layout_assignment.cc; 12s local 2024-12-18T00:55:12.4505578Z Compiling xla/service/hlo_phi_graph.cc; 11s local ... 2024-12-18T00:55:12.6827216Z 2024-12-18T00:55:12.6828128Z  2024-12-18T00:55:12.6828621Z  2024-12-18T00:55:12.6830700Z  2024-12-18T00:55:12.6833749Z  2024-12-18T00:55:12.6836868Z  2024-12-18T00:55:12.6839962Z  2024-12-18T00:55:12.6843295Z  2024-12-18T00:55:12.6846740Z  2024-12-18T00:55:12.6850311Z [17,632 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:12.6854098Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:12.6857775Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:55:12.6861306Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2024-12-18T00:55:12.6864759Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:12.6868032Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:12.6871266Z @llvm-project//mlir:SparseTensorDialect; 14s local 2024-12-18T00:55:12.6874496Z Compiling xla/service/layout_assignment.cc; 13s local 2024-12-18T00:55:12.6877916Z Compiling xla/service/hlo_phi_graph.cc; 11s local ... 2024-12-18T00:55:13.0366221Z 2024-12-18T00:55:13.0367459Z  2024-12-18T00:55:13.0368619Z  2024-12-18T00:55:13.0369269Z  2024-12-18T00:55:13.0369843Z  2024-12-18T00:55:13.0370390Z  2024-12-18T00:55:13.0370913Z  2024-12-18T00:55:13.0371726Z  2024-12-18T00:55:13.0372837Z  2024-12-18T00:55:13.0373884Z [17,633 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:13.0375123Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:13.0376255Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2024-12-18T00:55:13.0377791Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:55:13.0378915Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:13.0379898Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:13.0380788Z @llvm-project//mlir:SparseTensorDialect; 14s local 2024-12-18T00:55:13.0381692Z Compiling xla/service/layout_assignment.cc; 13s local 2024-12-18T00:55:13.0382778Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local ... 2024-12-18T00:55:13.2498494Z 2024-12-18T00:55:13.2499396Z  2024-12-18T00:55:13.2499865Z  2024-12-18T00:55:13.2500273Z  2024-12-18T00:55:13.2500688Z  2024-12-18T00:55:13.2501096Z  2024-12-18T00:55:13.2501467Z  2024-12-18T00:55:13.2501856Z  2024-12-18T00:55:13.2502248Z  2024-12-18T00:55:13.2503177Z [17,635 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:13.2504347Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:55:13.2505392Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:55:13.2506862Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:55:13.2507912Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:55:13.2509287Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:13.2510263Z @llvm-project//mlir:SparseTensorDialect; 14s local 2024-12-18T00:55:13.2511153Z Compiling xla/service/layout_assignment.cc; 13s local 2024-12-18T00:55:13.2512180Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local ... 2024-12-18T00:55:13.4685943Z 2024-12-18T00:55:13.4686879Z  2024-12-18T00:55:13.4687349Z  2024-12-18T00:55:13.4687776Z  2024-12-18T00:55:13.4688186Z  2024-12-18T00:55:13.4688601Z  2024-12-18T00:55:13.4688979Z  2024-12-18T00:55:13.4689359Z  2024-12-18T00:55:13.4689758Z  2024-12-18T00:55:13.4690710Z [17,636 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:13.4691882Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:55:13.4692942Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:55:13.4694362Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2024-12-18T00:55:13.4695489Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:55:13.4696536Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2024-12-18T00:55:13.4697436Z @llvm-project//mlir:SparseTensorDialect; 15s local 2024-12-18T00:55:13.4698292Z Compiling xla/service/layout_assignment.cc; 13s local 2024-12-18T00:55:13.4699198Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local ... 2024-12-18T00:55:13.7877667Z 2024-12-18T00:55:13.7878543Z  2024-12-18T00:55:13.7879036Z  2024-12-18T00:55:13.7879420Z  2024-12-18T00:55:13.7879835Z  2024-12-18T00:55:13.7880221Z  2024-12-18T00:55:13.7880626Z  2024-12-18T00:55:13.7881004Z  2024-12-18T00:55:13.7881682Z  2024-12-18T00:55:13.7882859Z [17,638 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:13.7884583Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:55:13.7885926Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:55:13.7887230Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:55:13.7888451Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:55:13.7889503Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:55:13.7890468Z @llvm-project//mlir:SparseTensorDialect; 15s local 2024-12-18T00:55:13.7891413Z Compiling xla/service/layout_assignment.cc; 14s local 2024-12-18T00:55:13.7892549Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local ... 2024-12-18T00:55:14.0507088Z 2024-12-18T00:55:14.0508003Z  2024-12-18T00:55:14.0508468Z  2024-12-18T00:55:14.0509246Z  2024-12-18T00:55:14.0509610Z  2024-12-18T00:55:14.0509991Z  2024-12-18T00:55:14.0510396Z  2024-12-18T00:55:14.0510778Z  2024-12-18T00:55:14.0511142Z  2024-12-18T00:55:14.0512065Z [17,639 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:14.0513510Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:55:14.0514674Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2024-12-18T00:55:14.0515849Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:55:14.0516900Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:55:14.0517866Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:55:14.0518791Z @llvm-project//mlir:SparseTensorDialect; 15s local 2024-12-18T00:55:14.0519660Z Compiling xla/service/layout_assignment.cc; 14s local 2024-12-18T00:55:14.0520730Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local ... 2024-12-18T00:55:14.2852772Z 2024-12-18T00:55:14.2853869Z  2024-12-18T00:55:14.2854321Z  2024-12-18T00:55:14.2854766Z  2024-12-18T00:55:14.2855163Z  2024-12-18T00:55:14.2855552Z  2024-12-18T00:55:14.2855941Z  2024-12-18T00:55:14.2856325Z  2024-12-18T00:55:14.2856887Z  2024-12-18T00:55:14.2857810Z [17,640 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:14.2859335Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:55:14.2860557Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:55:14.2861830Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:55:14.2862916Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:55:14.2863895Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2024-12-18T00:55:14.2864832Z @llvm-project//mlir:SparseTensorDialect; 15s local 2024-12-18T00:55:14.2865725Z Compiling xla/service/layout_assignment.cc; 14s local 2024-12-18T00:55:14.2867025Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local ... 2024-12-18T00:55:14.6512880Z 2024-12-18T00:55:14.6513794Z  2024-12-18T00:55:14.6516118Z  2024-12-18T00:55:14.6518970Z  2024-12-18T00:55:14.6521775Z  2024-12-18T00:55:14.6524600Z  2024-12-18T00:55:14.6527373Z  2024-12-18T00:55:14.6530163Z  2024-12-18T00:55:14.6532875Z  2024-12-18T00:55:14.6536223Z [17,642 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:14.6539671Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:55:14.6542869Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:55:14.6546341Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2024-12-18T00:55:14.6549398Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:55:14.6552429Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:14.6555954Z @llvm-project//mlir:SparseTensorDialect; 16s local 2024-12-18T00:55:14.6559017Z Compiling xla/service/layout_assignment.cc; 15s local 2024-12-18T00:55:14.6562129Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local ... 2024-12-18T00:55:14.8553387Z 2024-12-18T00:55:14.8556598Z  2024-12-18T00:55:14.8559313Z  2024-12-18T00:55:14.8561774Z  2024-12-18T00:55:14.8564240Z  2024-12-18T00:55:14.8566651Z  2024-12-18T00:55:14.8569032Z  2024-12-18T00:55:14.8571439Z  2024-12-18T00:55:14.8573832Z  2024-12-18T00:55:14.8577121Z [17,644 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:14.8580797Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:55:14.8582656Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2024-12-18T00:55:14.8583978Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:55:14.8585249Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:55:14.8586393Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:14.8587434Z @llvm-project//mlir:SparseTensorDialect; 16s local 2024-12-18T00:55:14.8588428Z Compiling xla/service/layout_assignment.cc; 15s local 2024-12-18T00:55:14.8589603Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local ... 2024-12-18T00:55:15.2517742Z 2024-12-18T00:55:15.2519054Z  2024-12-18T00:55:15.2519791Z  2024-12-18T00:55:15.2520460Z  2024-12-18T00:55:15.2521553Z  2024-12-18T00:55:15.2521997Z  2024-12-18T00:55:15.2522441Z  2024-12-18T00:55:15.2522880Z  2024-12-18T00:55:15.2523278Z  2024-12-18T00:55:15.2524239Z [17,645 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:15.2526553Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:55:15.2527685Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:55:15.2528765Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:55:15.2529860Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:55:15.2530786Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:15.2531660Z @llvm-project//mlir:SparseTensorDialect; 16s local 2024-12-18T00:55:15.2532487Z Compiling xla/service/layout_assignment.cc; 15s local 2024-12-18T00:55:15.2533498Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local ... 2024-12-18T00:55:15.5725494Z 2024-12-18T00:55:15.5726620Z  2024-12-18T00:55:15.5727427Z  2024-12-18T00:55:15.5728126Z  2024-12-18T00:55:15.5729208Z  2024-12-18T00:55:15.5729667Z  2024-12-18T00:55:15.5730061Z  2024-12-18T00:55:15.5730452Z  2024-12-18T00:55:15.5730866Z  2024-12-18T00:55:15.5732052Z [17,646 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:15.5733264Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:55:15.5734247Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:55:15.5735278Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2024-12-18T00:55:15.5736317Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:55:15.5737296Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2024-12-18T00:55:15.5738100Z @llvm-project//mlir:SparseTensorDialect; 17s local 2024-12-18T00:55:15.5738893Z Compiling xla/service/layout_assignment.cc; 15s local 2024-12-18T00:55:15.5739842Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local ... 2024-12-18T00:55:15.8524204Z 2024-12-18T00:55:15.8525757Z  2024-12-18T00:55:15.8526364Z  2024-12-18T00:55:15.8526747Z  2024-12-18T00:55:15.8527144Z  2024-12-18T00:55:15.8527994Z  2024-12-18T00:55:15.8528349Z  2024-12-18T00:55:15.8528720Z  2024-12-18T00:55:15.8529087Z  2024-12-18T00:55:15.8530033Z [17,648 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:15.8531548Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:55:15.8532935Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2024-12-18T00:55:15.8534139Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:55:15.8535290Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:55:15.8536312Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:55:15.8537386Z @llvm-project//mlir:SparseTensorDialect; 17s local 2024-12-18T00:55:15.8538315Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:55:15.8539396Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local ... 2024-12-18T00:55:16.4295471Z 2024-12-18T00:55:16.4296604Z  2024-12-18T00:55:16.4297097Z  2024-12-18T00:55:16.4297507Z  2024-12-18T00:55:16.4297888Z  2024-12-18T00:55:16.4298295Z  2024-12-18T00:55:16.4298693Z  2024-12-18T00:55:16.4299107Z  2024-12-18T00:55:16.4299486Z  2024-12-18T00:55:16.4300447Z [17,649 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:16.4301563Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:55:16.4302564Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:55:16.4303717Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:55:16.4304916Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:55:16.4305851Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2024-12-18T00:55:16.4306994Z @llvm-project//mlir:SparseTensorDialect; 18s local 2024-12-18T00:55:16.4308292Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:55:16.4309415Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local ... 2024-12-18T00:55:16.6533167Z 2024-12-18T00:55:16.6534137Z  2024-12-18T00:55:16.6534612Z  2024-12-18T00:55:16.6536668Z  2024-12-18T00:55:16.6539836Z  2024-12-18T00:55:16.6542754Z  2024-12-18T00:55:16.6546083Z  2024-12-18T00:55:16.6549111Z  2024-12-18T00:55:16.6552185Z  2024-12-18T00:55:16.6555667Z [17,649 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:16.6559351Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:55:16.6562899Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:55:16.6566620Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2024-12-18T00:55:16.6570405Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:55:16.6573803Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:55:16.6577305Z @llvm-project//mlir:SparseTensorDialect; 18s local 2024-12-18T00:55:16.6580513Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:55:16.6583890Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local ... 2024-12-18T00:55:17.0883202Z 2024-12-18T00:55:17.0884460Z  2024-12-18T00:55:17.0885205Z  2024-12-18T00:55:17.0885845Z  2024-12-18T00:55:17.0886927Z  2024-12-18T00:55:17.0887369Z  2024-12-18T00:55:17.0887740Z  2024-12-18T00:55:17.0888110Z  2024-12-18T00:55:17.0888539Z  2024-12-18T00:55:17.0889450Z [17,650 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:17.0890501Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:55:17.0891778Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2024-12-18T00:55:17.0893066Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:55:17.0894240Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:55:17.0895145Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:55:17.0895985Z @llvm-project//mlir:SparseTensorDialect; 18s local 2024-12-18T00:55:17.0897049Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:55:17.0897984Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local ... 2024-12-18T00:55:17.3699935Z 2024-12-18T00:55:17.3701192Z  2024-12-18T00:55:17.3701690Z  2024-12-18T00:55:17.3702110Z  2024-12-18T00:55:17.3702503Z  2024-12-18T00:55:17.3702879Z  2024-12-18T00:55:17.3703296Z  2024-12-18T00:55:17.3703695Z  2024-12-18T00:55:17.3704094Z  2024-12-18T00:55:17.3705058Z [17,651 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:17.3706211Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:55:17.3707257Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:17.3708333Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:55:17.3709378Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:55:17.3710292Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2024-12-18T00:55:17.3711161Z @llvm-project//mlir:SparseTensorDialect; 19s local 2024-12-18T00:55:17.3711997Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:55:17.3713011Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local ... 2024-12-18T00:55:17.6539580Z 2024-12-18T00:55:17.6540527Z  2024-12-18T00:55:17.6541002Z  2024-12-18T00:55:17.6541658Z  2024-12-18T00:55:17.6542054Z  2024-12-18T00:55:17.6542457Z  2024-12-18T00:55:17.6542885Z  2024-12-18T00:55:17.6543285Z  2024-12-18T00:55:17.6543652Z  2024-12-18T00:55:17.6545204Z [17,653 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:17.6546505Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:55:17.6547653Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:17.6548811Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2024-12-18T00:55:17.6549889Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:55:17.6550900Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:55:17.6551887Z @llvm-project//mlir:SparseTensorDialect; 19s local 2024-12-18T00:55:17.6552813Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:17.6553911Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local ... 2024-12-18T00:55:17.9127002Z 2024-12-18T00:55:17.9127902Z  2024-12-18T00:55:17.9128391Z  2024-12-18T00:55:17.9128787Z  2024-12-18T00:55:17.9129195Z  2024-12-18T00:55:17.9129573Z  2024-12-18T00:55:17.9129952Z  2024-12-18T00:55:17.9130364Z  2024-12-18T00:55:17.9130739Z  2024-12-18T00:55:17.9131677Z [17,654 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:17.9132815Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:55:17.9133776Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:17.9134885Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:55:17.9135956Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:55:17.9137027Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:55:17.9137921Z @llvm-project//mlir:SparseTensorDialect; 19s local 2024-12-18T00:55:17.9139179Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:17.9140150Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local ... 2024-12-18T00:55:18.1562558Z 2024-12-18T00:55:18.1563449Z  2024-12-18T00:55:18.1563918Z  2024-12-18T00:55:18.1564288Z  2024-12-18T00:55:18.1564665Z  2024-12-18T00:55:18.1565055Z  2024-12-18T00:55:18.1565433Z  2024-12-18T00:55:18.1565834Z  2024-12-18T00:55:18.1566189Z  2024-12-18T00:55:18.1567047Z [17,656 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:18.1568170Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:55:18.1569112Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2024-12-18T00:55:18.1570077Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:55:18.1571506Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:18.1572464Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:55:18.1573354Z @llvm-project//mlir:SparseTensorDialect; 19s local 2024-12-18T00:55:18.1574242Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:18.1575285Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local ... 2024-12-18T00:55:18.4454297Z 2024-12-18T00:55:18.4455183Z  2024-12-18T00:55:18.4457159Z  2024-12-18T00:55:18.4457879Z  2024-12-18T00:55:18.4458687Z  2024-12-18T00:55:18.4459381Z  2024-12-18T00:55:18.4459989Z  2024-12-18T00:55:18.4460599Z  2024-12-18T00:55:18.4461479Z  2024-12-18T00:55:18.4462582Z [17,657 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:18.4463828Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:55:18.4465323Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:55:18.4466589Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:55:18.4467738Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:18.4468828Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2024-12-18T00:55:18.4469798Z @llvm-project//mlir:SparseTensorDialect; 20s local 2024-12-18T00:55:18.4470750Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:18.4471859Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local ... 2024-12-18T00:55:18.6560117Z 2024-12-18T00:55:18.6561392Z  2024-12-18T00:55:18.6561900Z  2024-12-18T00:55:18.6562320Z  2024-12-18T00:55:18.6562722Z  2024-12-18T00:55:18.6563118Z  2024-12-18T00:55:18.6563532Z  2024-12-18T00:55:18.6563910Z  2024-12-18T00:55:18.6564302Z  2024-12-18T00:55:18.6565517Z [17,659 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:18.6566723Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:55:18.6567701Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:55:18.6568783Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2024-12-18T00:55:18.6569836Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:18.6570733Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:55:18.6571582Z @llvm-project//mlir:SparseTensorDialect; 20s local 2024-12-18T00:55:18.6572380Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:55:18.6573373Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local ... 2024-12-18T00:55:18.8551371Z 2024-12-18T00:55:18.8552252Z  2024-12-18T00:55:18.8552736Z  2024-12-18T00:55:18.8553433Z  2024-12-18T00:55:18.8553976Z  2024-12-18T00:55:18.8554517Z  2024-12-18T00:55:18.8566401Z  2024-12-18T00:55:18.8567694Z  2024-12-18T00:55:18.8568305Z  2024-12-18T00:55:18.8569494Z [17,662 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:18.8570810Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:55:18.8572078Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2024-12-18T00:55:18.8573332Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:55:18.8574630Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:18.8575684Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:55:18.8576930Z @llvm-project//mlir:SparseTensorDialect; 20s local 2024-12-18T00:55:18.8577904Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:55:18.8579081Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local ... 2024-12-18T00:55:19.2555333Z 2024-12-18T00:55:19.2556685Z  2024-12-18T00:55:19.2557445Z  2024-12-18T00:55:19.2558567Z  2024-12-18T00:55:19.2559022Z  2024-12-18T00:55:19.2559426Z  2024-12-18T00:55:19.2559827Z  2024-12-18T00:55:19.2560237Z  2024-12-18T00:55:19.2560648Z  2024-12-18T00:55:19.2561607Z [17,664 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:19.2562769Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:19.2563841Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:55:19.2564955Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:55:19.2566004Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:55:19.2566944Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:55:19.2567812Z @llvm-project//mlir:SparseTensorDialect; 20s local 2024-12-18T00:55:19.2568976Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:55:19.2569970Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local ... 2024-12-18T00:55:19.4559544Z 2024-12-18T00:55:19.4560441Z  2024-12-18T00:55:19.4560921Z  2024-12-18T00:55:19.4561312Z  2024-12-18T00:55:19.4561658Z  2024-12-18T00:55:19.4562041Z  2024-12-18T00:55:19.4562441Z  2024-12-18T00:55:19.4562828Z  2024-12-18T00:55:19.4563207Z  2024-12-18T00:55:19.4564129Z [17,666 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:19.4565198Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:19.4566172Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:55:19.4567686Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2024-12-18T00:55:19.4568746Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:55:19.4570141Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2024-12-18T00:55:19.4571133Z @llvm-project//mlir:SparseTensorDialect; 21s local 2024-12-18T00:55:19.4572089Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:55:19.4573181Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local ... 2024-12-18T00:55:19.8564267Z 2024-12-18T00:55:19.8565181Z  2024-12-18T00:55:19.8565657Z  2024-12-18T00:55:19.8566052Z  2024-12-18T00:55:19.8566451Z  2024-12-18T00:55:19.8566838Z  2024-12-18T00:55:19.8567218Z  2024-12-18T00:55:19.8567584Z  2024-12-18T00:55:19.8567970Z  2024-12-18T00:55:19.8568933Z [17,667 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:19.8570080Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:19.8571067Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:55:19.8572582Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:55:19.8573614Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:55:19.8574486Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:55:19.8575314Z @llvm-project//mlir:SparseTensorDialect; 21s local 2024-12-18T00:55:19.8576102Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:55:19.8577213Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local ... 2024-12-18T00:55:20.0974040Z 2024-12-18T00:55:20.0974926Z  2024-12-18T00:55:20.0975385Z  2024-12-18T00:55:20.0975779Z  2024-12-18T00:55:20.0976149Z  2024-12-18T00:55:20.0976663Z  2024-12-18T00:55:20.0977034Z  2024-12-18T00:55:20.0977392Z  2024-12-18T00:55:20.0977784Z  2024-12-18T00:55:20.0978701Z [17,668 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:20.0979850Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:20.0980839Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2024-12-18T00:55:20.0981849Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:55:20.0982848Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:55:20.0983698Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:55:20.0984517Z @llvm-project//mlir:SparseTensorDialect; 21s local 2024-12-18T00:55:20.0985308Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:55:20.0986281Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local ... 2024-12-18T00:55:20.4569625Z 2024-12-18T00:55:20.4570492Z  2024-12-18T00:55:20.4570954Z  2024-12-18T00:55:20.4571322Z  2024-12-18T00:55:20.4571709Z  2024-12-18T00:55:20.4572388Z  2024-12-18T00:55:20.4572774Z  2024-12-18T00:55:20.4573491Z  2024-12-18T00:55:20.4574083Z  2024-12-18T00:55:20.4575142Z [17,668 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:20.4576547Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:55:20.4577717Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:55:20.4578903Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2024-12-18T00:55:20.4580072Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:55:20.4581085Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2024-12-18T00:55:20.4582027Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:55:20.4582946Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:55:20.4584138Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local ... 2024-12-18T00:55:20.7959926Z 2024-12-18T00:55:20.7960797Z  2024-12-18T00:55:20.7961530Z  2024-12-18T00:55:20.7961920Z  2024-12-18T00:55:20.7962303Z  2024-12-18T00:55:20.7962673Z  2024-12-18T00:55:20.7963058Z  2024-12-18T00:55:20.7963454Z  2024-12-18T00:55:20.7963833Z  2024-12-18T00:55:20.7964881Z [17,670 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:20.7965921Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:55:20.7966970Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:55:20.7968065Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:55:20.7969044Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:55:20.7969897Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:20.7970732Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:55:20.7971556Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:20.7972988Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local ... 2024-12-18T00:55:21.0577119Z 2024-12-18T00:55:21.0578115Z  2024-12-18T00:55:21.0578605Z  2024-12-18T00:55:21.0579016Z  2024-12-18T00:55:21.0579436Z  2024-12-18T00:55:21.0579833Z  2024-12-18T00:55:21.0580217Z  2024-12-18T00:55:21.0580606Z  2024-12-18T00:55:21.0580998Z  2024-12-18T00:55:21.0581925Z [17,672 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:21.0583100Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:55:21.0584198Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2024-12-18T00:55:21.0585293Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:55:21.0586312Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:55:21.0587237Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:21.0588063Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:55:21.0588904Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:21.0589858Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local ... 2024-12-18T00:55:21.3181110Z 2024-12-18T00:55:21.3182385Z  2024-12-18T00:55:21.3182887Z  2024-12-18T00:55:21.3183300Z  2024-12-18T00:55:21.3183687Z  2024-12-18T00:55:21.3184227Z  2024-12-18T00:55:21.3184621Z  2024-12-18T00:55:21.3185010Z  2024-12-18T00:55:21.3185365Z  2024-12-18T00:55:21.3186297Z [17,673 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:21.3187473Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:21.3188464Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:55:21.3189886Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:55:21.3190965Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:55:21.3191888Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:21.3192769Z @llvm-project//mlir:SparseTensorDialect; 22s local 2024-12-18T00:55:21.3193611Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:21.3194601Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local ... 2024-12-18T00:55:21.5899594Z 2024-12-18T00:55:21.5900497Z  2024-12-18T00:55:21.5900970Z  2024-12-18T00:55:21.5901376Z  2024-12-18T00:55:21.5901751Z  2024-12-18T00:55:21.5902123Z  2024-12-18T00:55:21.5902495Z  2024-12-18T00:55:21.5902856Z  2024-12-18T00:55:21.5903242Z  2024-12-18T00:55:21.5904311Z [17,675 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:21.5905712Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:21.5906732Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:55:21.5907762Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2024-12-18T00:55:21.5908712Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:55:21.5909630Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2024-12-18T00:55:21.5910496Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:55:21.5911739Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:21.5912734Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local ... 2024-12-18T00:55:21.8583021Z 2024-12-18T00:55:21.8583880Z  2024-12-18T00:55:21.8584610Z  2024-12-18T00:55:21.8585158Z  2024-12-18T00:55:21.8585670Z  2024-12-18T00:55:21.8586185Z  2024-12-18T00:55:21.8586729Z  2024-12-18T00:55:21.8587275Z  2024-12-18T00:55:21.8587769Z  2024-12-18T00:55:21.8589213Z [17,675 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:21.8590494Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:21.8591638Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:55:21.8592881Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:55:21.8593998Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:55:21.8594988Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:55:21.8595950Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:55:21.8596916Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:55:21.8598034Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local ... 2024-12-18T00:55:22.1298127Z 2024-12-18T00:55:22.1299033Z  2024-12-18T00:55:22.1299526Z  2024-12-18T00:55:22.1301650Z  2024-12-18T00:55:22.1304754Z  2024-12-18T00:55:22.1307888Z  2024-12-18T00:55:22.1311030Z  2024-12-18T00:55:22.1314004Z  2024-12-18T00:55:22.1317005Z  2024-12-18T00:55:22.1320507Z [17,678 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:22.1324194Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:22.1328577Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2024-12-18T00:55:22.1332222Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:55:22.1335958Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:55:22.1339552Z @llvm-project//mlir:SparseTensorDialect; 23s local 2024-12-18T00:55:22.1342848Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:55:22.1345054Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:55:22.1346188Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local ... 2024-12-18T00:55:22.4588534Z 2024-12-18T00:55:22.4589362Z  2024-12-18T00:55:22.4589841Z  2024-12-18T00:55:22.4590239Z  2024-12-18T00:55:22.4590609Z  2024-12-18T00:55:22.4591027Z  2024-12-18T00:55:22.4591434Z  2024-12-18T00:55:22.4591840Z  2024-12-18T00:55:22.4592224Z  2024-12-18T00:55:22.4593234Z [17,679 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:22.4594414Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:55:22.4595473Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:55:22.4596637Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:55:22.4597757Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2024-12-18T00:55:22.4598685Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:55:22.4599801Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:55:22.4600810Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:55:22.4601768Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local ... 2024-12-18T00:55:22.6593330Z 2024-12-18T00:55:22.6594350Z  2024-12-18T00:55:22.6594931Z  2024-12-18T00:55:22.6595443Z  2024-12-18T00:55:22.6597288Z  2024-12-18T00:55:22.6597747Z  2024-12-18T00:55:22.6599257Z  2024-12-18T00:55:22.6599707Z  2024-12-18T00:55:22.6600090Z  2024-12-18T00:55:22.6601133Z [17,681 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:22.6602316Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:55:22.6603369Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:55:22.6604500Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2024-12-18T00:55:22.6605923Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:55:22.6606698Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:55:22.6607508Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:55:22.6608398Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2024-12-18T00:55:22.6609280Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local ... 2024-12-18T00:55:23.0597624Z 2024-12-18T00:55:23.0599009Z  2024-12-18T00:55:23.0599486Z  2024-12-18T00:55:23.0599889Z  2024-12-18T00:55:23.0600246Z  2024-12-18T00:55:23.0600662Z  2024-12-18T00:55:23.0601034Z  2024-12-18T00:55:23.0601406Z  2024-12-18T00:55:23.0601791Z  2024-12-18T00:55:23.0602745Z [17,682 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:23.0603907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:55:23.0605157Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2024-12-18T00:55:23.0606209Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:55:23.0607215Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:55:23.0608014Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:55:23.0608712Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:55:23.0609541Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:55:23.0610432Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local ... 2024-12-18T00:55:23.2601168Z 2024-12-18T00:55:23.2602205Z  2024-12-18T00:55:23.2602696Z  2024-12-18T00:55:23.2603099Z  2024-12-18T00:55:23.2603489Z  2024-12-18T00:55:23.2603864Z  2024-12-18T00:55:23.2604206Z  2024-12-18T00:55:23.2604575Z  2024-12-18T00:55:23.2605225Z  2024-12-18T00:55:23.2606143Z [17,684 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:23.2607243Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:23.2608266Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:55:23.2609377Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:55:23.2610400Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:55:23.2611232Z @llvm-project//mlir:SparseTensorDialect; 24s local 2024-12-18T00:55:23.2612010Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:55:23.2612913Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:55:23.2613835Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local ... 2024-12-18T00:55:23.5485193Z 2024-12-18T00:55:23.5486086Z  2024-12-18T00:55:23.5486553Z  2024-12-18T00:55:23.5486974Z  2024-12-18T00:55:23.5487360Z  2024-12-18T00:55:23.5487975Z  2024-12-18T00:55:23.5488375Z  2024-12-18T00:55:23.5488763Z  2024-12-18T00:55:23.5489148Z  2024-12-18T00:55:23.5490069Z [17,686 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:23.5491224Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:23.5492197Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:55:23.5493307Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2024-12-18T00:55:23.5494321Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2024-12-18T00:55:23.5495116Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:55:23.5496003Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:55:23.5496894Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:55:23.5497652Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local ... 2024-12-18T00:55:23.8607726Z 2024-12-18T00:55:23.8608632Z  2024-12-18T00:55:23.8609100Z  2024-12-18T00:55:23.8609494Z  2024-12-18T00:55:23.8609870Z  2024-12-18T00:55:23.8610261Z  2024-12-18T00:55:23.8610647Z  2024-12-18T00:55:23.8611036Z  2024-12-18T00:55:23.8611429Z  2024-12-18T00:55:23.8612346Z [17,687 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:23.8613453Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:23.8614445Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:55:23.8615512Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2024-12-18T00:55:23.8616650Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:55:23.8617486Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:55:23.8618407Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2024-12-18T00:55:23.8619347Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:55:23.8620273Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local ... 2024-12-18T00:55:24.0611955Z 2024-12-18T00:55:24.0613461Z  2024-12-18T00:55:24.0613975Z  2024-12-18T00:55:24.0614376Z  2024-12-18T00:55:24.0614750Z  2024-12-18T00:55:24.0615133Z  2024-12-18T00:55:24.0615513Z  2024-12-18T00:55:24.0615913Z  2024-12-18T00:55:24.0616302Z  2024-12-18T00:55:24.0617374Z [17,689 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:24.0618437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:24.0619435Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2024-12-18T00:55:24.0620431Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2024-12-18T00:55:24.0621834Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2024-12-18T00:55:24.0622657Z @llvm-project//mlir:SparseTensorDialect; 25s local 2024-12-18T00:55:24.0623532Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:55:24.0624414Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2024-12-18T00:55:24.0625292Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local ... 2024-12-18T00:55:24.4147026Z 2024-12-18T00:55:24.4147892Z  2024-12-18T00:55:24.4148376Z  2024-12-18T00:55:24.4148749Z  2024-12-18T00:55:24.4149117Z  2024-12-18T00:55:24.4149485Z  2024-12-18T00:55:24.4149864Z  2024-12-18T00:55:24.4150255Z  2024-12-18T00:55:24.4150645Z  2024-12-18T00:55:24.4151553Z [17,691 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:24.4152709Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:55:24.4154104Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:24.4155046Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:55:24.4155993Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:55:24.4156902Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:55:24.4157715Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2024-12-18T00:55:24.4158570Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:55:24.4159355Z Compiling xla/service/layout_assignment.cc; 15s local ... 2024-12-18T00:55:24.6617734Z 2024-12-18T00:55:24.6619082Z  2024-12-18T00:55:24.6619588Z  2024-12-18T00:55:24.6619985Z  2024-12-18T00:55:24.6620370Z  2024-12-18T00:55:24.6620765Z  2024-12-18T00:55:24.6621152Z  2024-12-18T00:55:24.6621551Z  2024-12-18T00:55:24.6621935Z  2024-12-18T00:55:24.6623073Z [17,693 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:24.6624305Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:55:24.6625321Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:24.6626245Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:55:24.6627117Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:55:24.6628026Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:55:24.6628865Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2024-12-18T00:55:24.6629710Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:55:24.6630532Z Compiling xla/service/layout_assignment.cc; 15s local ... 2024-12-18T00:55:24.8622003Z 2024-12-18T00:55:24.8623398Z  2024-12-18T00:55:24.8623881Z  2024-12-18T00:55:24.8624264Z  2024-12-18T00:55:24.8624693Z  2024-12-18T00:55:24.8625132Z  2024-12-18T00:55:24.8625529Z  2024-12-18T00:55:24.8625936Z  2024-12-18T00:55:24.8626330Z  2024-12-18T00:55:24.8627287Z [17,695 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:24.8628433Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:55:24.8629456Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:24.8630359Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:55:24.8631266Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2024-12-18T00:55:24.8632165Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2024-12-18T00:55:24.8633050Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2024-12-18T00:55:24.8634027Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:55:24.8634868Z Compiling xla/service/layout_assignment.cc; 15s local ... 2024-12-18T00:55:25.1222618Z 2024-12-18T00:55:25.1223830Z  2024-12-18T00:55:25.1224344Z  2024-12-18T00:55:25.1224814Z  2024-12-18T00:55:25.1225221Z  2024-12-18T00:55:25.1225626Z  2024-12-18T00:55:25.1226019Z  2024-12-18T00:55:25.1226403Z  2024-12-18T00:55:25.1226804Z  2024-12-18T00:55:25.1227692Z [17,696 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:25.1228747Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:55:25.1229751Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2024-12-18T00:55:25.1230602Z @llvm-project//mlir:SparseTensorDialect; 26s local 2024-12-18T00:55:25.1231495Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:55:25.1232440Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:55:25.1233293Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2024-12-18T00:55:25.1234302Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:55:25.1235386Z Compiling xla/service/layout_assignment.cc; 15s local ... 2024-12-18T00:55:25.4628218Z 2024-12-18T00:55:25.4629114Z  2024-12-18T00:55:25.4629506Z  2024-12-18T00:55:25.4629817Z  2024-12-18T00:55:25.4630162Z  2024-12-18T00:55:25.4630485Z  2024-12-18T00:55:25.4630816Z  2024-12-18T00:55:25.4631130Z  2024-12-18T00:55:25.4631446Z  2024-12-18T00:55:25.4632230Z [17,697 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:25.4633153Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:55:25.4634131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:55:25.4634887Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:55:25.4635626Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2024-12-18T00:55:25.4636421Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2024-12-18T00:55:25.4637333Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:55:25.4638076Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:55:25.4638783Z Compiling xla/service/collective_ops_utils.cc; 14s local ... 2024-12-18T00:55:26.1204893Z 2024-12-18T00:55:26.1205887Z  2024-12-18T00:55:26.1206356Z  2024-12-18T00:55:26.1206749Z  2024-12-18T00:55:26.1207171Z  2024-12-18T00:55:26.1207568Z  2024-12-18T00:55:26.1207968Z  2024-12-18T00:55:26.1208386Z  2024-12-18T00:55:26.1208769Z  2024-12-18T00:55:26.1209706Z [17,698 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:26.1210897Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:55:26.1211968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2024-12-18T00:55:26.1212951Z @llvm-project//mlir:SparseTensorDialect; 27s local 2024-12-18T00:55:26.1214006Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:55:26.1215042Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:55:26.1215819Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:55:26.1216796Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:55:26.1217676Z Compiling xla/service/collective_ops_utils.cc; 15s local ... 2024-12-18T00:55:26.3753198Z 2024-12-18T00:55:26.3754113Z  2024-12-18T00:55:26.3754588Z  2024-12-18T00:55:26.3754986Z  2024-12-18T00:55:26.3755363Z  2024-12-18T00:55:26.3755743Z  2024-12-18T00:55:26.3756124Z  2024-12-18T00:55:26.3756495Z  2024-12-18T00:55:26.3756859Z  2024-12-18T00:55:26.3757792Z [17,701 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:26.3758965Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:26.3760306Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:26.3761212Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:55:26.3762148Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:55:26.3763049Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:55:26.3763813Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:55:26.3764649Z Compiling xla/service/layout_assignment.cc; 16s local 2024-12-18T00:55:26.3765527Z Compiling xla/service/collective_ops_utils.cc; 15s local ... 2024-12-18T00:55:26.6637366Z 2024-12-18T00:55:26.6638265Z  2024-12-18T00:55:26.6638754Z  2024-12-18T00:55:26.6639192Z  2024-12-18T00:55:26.6639607Z  2024-12-18T00:55:26.6639988Z  2024-12-18T00:55:26.6640404Z  2024-12-18T00:55:26.6640821Z  2024-12-18T00:55:26.6641199Z  2024-12-18T00:55:26.6642371Z [17,702 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:26.6643430Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:26.6644697Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:26.6645717Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:55:26.6646597Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:55:26.6647528Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:55:26.6648262Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:55:26.6649035Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:55:26.6649936Z Compiling xla/service/collective_ops_utils.cc; 15s local ... 2024-12-18T00:55:26.9236767Z 2024-12-18T00:55:26.9237614Z  2024-12-18T00:55:26.9238090Z  2024-12-18T00:55:26.9238625Z  2024-12-18T00:55:26.9239052Z  2024-12-18T00:55:26.9239469Z  2024-12-18T00:55:26.9239876Z  2024-12-18T00:55:26.9240278Z  2024-12-18T00:55:26.9240978Z  2024-12-18T00:55:26.9241928Z [17,703 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:26.9243111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:26.9244456Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:26.9245408Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:55:26.9246319Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2024-12-18T00:55:26.9247131Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2024-12-18T00:55:26.9247872Z Compiling xla/service/hlo_verifier.cc; 21s local 2024-12-18T00:55:26.9248636Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:55:26.9249514Z Compiling xla/service/collective_ops_utils.cc; 16s local ... 2024-12-18T00:55:27.1414167Z 2024-12-18T00:55:27.1415079Z  2024-12-18T00:55:27.1415514Z  2024-12-18T00:55:27.1415940Z  2024-12-18T00:55:27.1416301Z  2024-12-18T00:55:27.1416879Z  2024-12-18T00:55:27.1417265Z  2024-12-18T00:55:27.1417664Z  2024-12-18T00:55:27.1418034Z  2024-12-18T00:55:27.1418932Z [17,705 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:27.1420027Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:27.1421052Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2024-12-18T00:55:27.1421959Z @llvm-project//mlir:SparseTensorDialect; 28s local 2024-12-18T00:55:27.1422889Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:55:27.1423788Z Compiling xla/service/hlo_verifier.cc; 21s local 2024-12-18T00:55:27.1424545Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:55:27.1425403Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:55:27.1426532Z Compiling xla/hlo/builder/xla_builder.cc; 14s local ... 2024-12-18T00:55:27.3868105Z 2024-12-18T00:55:27.3868959Z  2024-12-18T00:55:27.3869427Z  2024-12-18T00:55:27.3869816Z  2024-12-18T00:55:27.3870205Z  2024-12-18T00:55:27.3870613Z  2024-12-18T00:55:27.3871008Z  2024-12-18T00:55:27.3871384Z  2024-12-18T00:55:27.3871754Z  2024-12-18T00:55:27.3872716Z [17,707 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:27.3873907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:27.3875074Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:55:27.3875960Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:55:27.3876899Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:55:27.3877814Z Compiling xla/service/layout_assignment.cc; 17s local 2024-12-18T00:55:27.3878997Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:55:27.3879896Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2024-12-18T00:55:27.3880671Z Compiling xla/service/hlo_domain_isolator.cc; 10s local ... 2024-12-18T00:55:27.5933756Z 2024-12-18T00:55:27.5934642Z  2024-12-18T00:55:27.5935070Z  2024-12-18T00:55:27.5935450Z  2024-12-18T00:55:27.5935778Z  2024-12-18T00:55:27.5936158Z  2024-12-18T00:55:27.5936649Z  2024-12-18T00:55:27.5937038Z  2024-12-18T00:55:27.5937403Z  2024-12-18T00:55:27.5938324Z [17,710 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:27.5939381Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:27.5940391Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:55:27.5941292Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:55:27.5942553Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:55:27.5943609Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:27.5944689Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:55:27.5945500Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2024-12-18T00:55:27.5946344Z Compiling xla/service/hlo_domain_isolator.cc; 10s local ... 2024-12-18T00:55:27.8646070Z 2024-12-18T00:55:27.8646992Z  2024-12-18T00:55:27.8647491Z  2024-12-18T00:55:27.8647900Z  2024-12-18T00:55:27.8648274Z  2024-12-18T00:55:27.8648650Z  2024-12-18T00:55:27.8649000Z  2024-12-18T00:55:27.8649408Z  2024-12-18T00:55:27.8649800Z  2024-12-18T00:55:27.8650770Z [17,710 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:27.8651886Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:27.8652962Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:55:27.8653898Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:55:27.8654931Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2024-12-18T00:55:27.8655878Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:27.8656864Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:55:27.8657691Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2024-12-18T00:55:27.8658462Z Compiling xla/service/hlo_domain_isolator.cc; 10s local ... 2024-12-18T00:55:28.0649690Z 2024-12-18T00:55:28.0650766Z  2024-12-18T00:55:28.0651263Z  2024-12-18T00:55:28.0651689Z  2024-12-18T00:55:28.0652105Z  2024-12-18T00:55:28.0652493Z  2024-12-18T00:55:28.0652934Z  2024-12-18T00:55:28.0653356Z  2024-12-18T00:55:28.0653760Z  2024-12-18T00:55:28.0655064Z [17,712 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:28.0656301Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:28.0657543Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2024-12-18T00:55:28.0658436Z @llvm-project//mlir:SparseTensorDialect; 29s local 2024-12-18T00:55:28.0659393Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:55:28.0660240Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:28.0661043Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:55:28.0661879Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:55:28.0662769Z Compiling xla/service/hlo_domain_isolator.cc; 10s local ... 2024-12-18T00:55:28.3523896Z 2024-12-18T00:55:28.3524777Z  2024-12-18T00:55:28.3525247Z  2024-12-18T00:55:28.3525664Z  2024-12-18T00:55:28.3526083Z  2024-12-18T00:55:28.3526526Z  2024-12-18T00:55:28.3527574Z  2024-12-18T00:55:28.3528289Z  2024-12-18T00:55:28.3528721Z  2024-12-18T00:55:28.3529704Z [17,713 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:28.3530911Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:28.3531955Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:28.3532940Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:55:28.3533923Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:55:28.3534938Z Compiling xla/service/layout_assignment.cc; 18s local 2024-12-18T00:55:28.3535866Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:55:28.3536877Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:55:28.3537782Z Compiling xla/service/hlo_domain_isolator.cc; 10s local ... 2024-12-18T00:55:28.5619241Z 2024-12-18T00:55:28.5620075Z  2024-12-18T00:55:28.5620933Z  2024-12-18T00:55:28.5621315Z  2024-12-18T00:55:28.5621713Z  2024-12-18T00:55:28.5622102Z  2024-12-18T00:55:28.5622471Z  2024-12-18T00:55:28.5622856Z  2024-12-18T00:55:28.5623229Z  2024-12-18T00:55:28.5624120Z [17,716 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:28.5625218Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:28.5626284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:28.5627846Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:55:28.5628767Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:55:28.5629735Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:55:28.5630648Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:55:28.5631463Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:55:28.5632340Z Compiling xla/service/hlo_domain_isolator.cc; 11s local ... 2024-12-18T00:55:28.8656250Z 2024-12-18T00:55:28.8657292Z  2024-12-18T00:55:28.8657758Z  2024-12-18T00:55:28.8658154Z  2024-12-18T00:55:28.8658605Z  2024-12-18T00:55:28.8659008Z  2024-12-18T00:55:28.8659418Z  2024-12-18T00:55:28.8659800Z  2024-12-18T00:55:28.8660193Z  2024-12-18T00:55:28.8661179Z [17,718 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:28.8662383Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:28.8663470Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:28.8664367Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:55:28.8665337Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2024-12-18T00:55:28.8666631Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:55:28.8667542Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:55:28.8668439Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2024-12-18T00:55:28.8669366Z Compiling llvm/lib/ExecutionEngine/Orc/ELFNixPlatform.cpp; 11s local ... 2024-12-18T00:55:29.1596700Z 2024-12-18T00:55:29.1597603Z  2024-12-18T00:55:29.1598195Z  2024-12-18T00:55:29.1598540Z  2024-12-18T00:55:29.1598918Z  2024-12-18T00:55:29.1599264Z  2024-12-18T00:55:29.1599669Z  2024-12-18T00:55:29.1600044Z  2024-12-18T00:55:29.1600443Z  2024-12-18T00:55:29.1601328Z [17,719 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:29.1602390Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:29.1603405Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2024-12-18T00:55:29.1604557Z @llvm-project//mlir:SparseTensorDialect; 30s local 2024-12-18T00:55:29.1605533Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:55:29.1606464Z Compiling xla/service/layout_assignment.cc; 19s local 2024-12-18T00:55:29.1607309Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:55:29.1608115Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2024-12-18T00:55:29.1609194Z Compiling llvm/lib/ExecutionEngine/Orc/ELFNixPlatform.cpp; 11s local ... 2024-12-18T00:55:29.4662446Z 2024-12-18T00:55:29.4663546Z  2024-12-18T00:55:29.4664030Z  2024-12-18T00:55:29.4664552Z  2024-12-18T00:55:29.4664902Z  2024-12-18T00:55:29.4665278Z  2024-12-18T00:55:29.4665688Z  2024-12-18T00:55:29.4666061Z  2024-12-18T00:55:29.4666414Z  2024-12-18T00:55:29.4667259Z [17,721 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:29.4668660Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:55:29.4669763Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:55:29.4670706Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:55:29.4671583Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:55:29.4672517Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:55:29.4673333Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2024-12-18T00:55:29.4674432Z Compiling llvm/lib/ExecutionEngine/Orc/ELFNixPlatform.cpp; 12s local 2024-12-18T00:55:29.4675455Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 11s local ... 2024-12-18T00:55:29.8666994Z 2024-12-18T00:55:29.8667898Z  2024-12-18T00:55:29.8668409Z  2024-12-18T00:55:29.8668859Z  2024-12-18T00:55:29.8669258Z  2024-12-18T00:55:29.8669673Z  2024-12-18T00:55:29.8670060Z  2024-12-18T00:55:29.8670483Z  2024-12-18T00:55:29.8670882Z  2024-12-18T00:55:29.8671851Z [17,723 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:29.8673036Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:55:29.8674107Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:55:29.8675055Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:55:29.8676001Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2024-12-18T00:55:29.8676851Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:55:29.8677640Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2024-12-18T00:55:29.8678563Z Compiling llvm/lib/ExecutionEngine/Orc/ELFNixPlatform.cpp; 12s local 2024-12-18T00:55:29.8679559Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 11s local ... 2024-12-18T00:55:30.0671124Z 2024-12-18T00:55:30.0673020Z  2024-12-18T00:55:30.0673922Z  2024-12-18T00:55:30.0674308Z  2024-12-18T00:55:30.0674713Z  2024-12-18T00:55:30.0675147Z  2024-12-18T00:55:30.0675539Z  2024-12-18T00:55:30.0675939Z  2024-12-18T00:55:30.0676332Z  2024-12-18T00:55:30.0677281Z [17,724 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:30.0678433Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:55:30.0679471Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2024-12-18T00:55:30.0680421Z @llvm-project//mlir:SparseTensorDialect; 31s local 2024-12-18T00:55:30.0681295Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 29s local 2024-12-18T00:55:30.0682238Z Compiling xla/service/layout_assignment.cc; 20s local 2024-12-18T00:55:30.0683029Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:55:30.0683906Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 11s local 2024-12-18T00:55:30.0684828Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local ... 2024-12-18T00:55:30.4676330Z 2024-12-18T00:55:30.4677245Z  2024-12-18T00:55:30.4677712Z  2024-12-18T00:55:30.4678112Z  2024-12-18T00:55:30.4678533Z  2024-12-18T00:55:30.4678911Z  2024-12-18T00:55:30.4679300Z  2024-12-18T00:55:30.4679685Z  2024-12-18T00:55:30.4680096Z  2024-12-18T00:55:30.4681018Z [17,725 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:30.4682191Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:55:30.4683251Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:55:30.4684167Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:55:30.4685032Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:30.4685832Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:55:30.4686683Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 12s local 2024-12-18T00:55:30.4687931Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2024-12-18T00:55:30.4688875Z Compiling xla/service/call_inliner.cc; 11s local ... 2024-12-18T00:55:30.7167525Z 2024-12-18T00:55:30.7168429Z  2024-12-18T00:55:30.7168825Z  2024-12-18T00:55:30.7169122Z  2024-12-18T00:55:30.7169492Z  2024-12-18T00:55:30.7169880Z  2024-12-18T00:55:30.7170252Z  2024-12-18T00:55:30.7170643Z  2024-12-18T00:55:30.7171013Z  2024-12-18T00:55:30.7171797Z [17,726 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:30.7172630Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:55:30.7173444Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:55:30.7174220Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:55:30.7174977Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:30.7175806Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:55:30.7176698Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 12s local 2024-12-18T00:55:30.7177520Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2024-12-18T00:55:30.7178337Z Compiling xla/service/call_inliner.cc; 11s local ... 2024-12-18T00:55:30.9961894Z 2024-12-18T00:55:30.9962757Z  2024-12-18T00:55:30.9963362Z  2024-12-18T00:55:30.9963768Z  2024-12-18T00:55:30.9964192Z  2024-12-18T00:55:30.9964566Z  2024-12-18T00:55:30.9964943Z  2024-12-18T00:55:30.9965325Z  2024-12-18T00:55:30.9965699Z  2024-12-18T00:55:30.9966630Z [17,727 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:30.9967804Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:55:30.9968902Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2024-12-18T00:55:30.9970142Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:55:30.9971012Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:30.9971857Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2024-12-18T00:55:30.9972608Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 12s local 2024-12-18T00:55:30.9973517Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2024-12-18T00:55:30.9974421Z Compiling xla/service/call_inliner.cc; 12s local ... 2024-12-18T00:55:31.2683043Z 2024-12-18T00:55:31.2683948Z  2024-12-18T00:55:31.2684407Z  2024-12-18T00:55:31.2684828Z  2024-12-18T00:55:31.2685243Z  2024-12-18T00:55:31.2685644Z  2024-12-18T00:55:31.2686019Z  2024-12-18T00:55:31.2686419Z  2024-12-18T00:55:31.2686856Z  2024-12-18T00:55:31.2687855Z [17,728 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:31.2689386Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:55:31.2690492Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:31.2691472Z @llvm-project//mlir:SparseTensorDialect; 32s local 2024-12-18T00:55:31.2692389Z Compiling xla/service/layout_assignment.cc; 21s local 2024-12-18T00:55:31.2693216Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2024-12-18T00:55:31.2694043Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:31.2694907Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2024-12-18T00:55:31.2695812Z Compiling xla/service/call_inliner.cc; 12s local ... 2024-12-18T00:55:31.5077146Z 2024-12-18T00:55:31.5078310Z  2024-12-18T00:55:31.5078775Z  2024-12-18T00:55:31.5079190Z  2024-12-18T00:55:31.5079583Z  2024-12-18T00:55:31.5079994Z  2024-12-18T00:55:31.5080404Z  2024-12-18T00:55:31.5080799Z  2024-12-18T00:55:31.5081210Z  2024-12-18T00:55:31.5082342Z [17,729 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:31.5083471Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:55:31.5084410Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:31.5085298Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:55:31.5086011Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:55:31.5086743Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2024-12-18T00:55:31.5087474Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:31.5088403Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2024-12-18T00:55:31.5089275Z Compiling xla/service/call_inliner.cc; 12s local ... 2024-12-18T00:55:31.8580813Z 2024-12-18T00:55:31.8581726Z  2024-12-18T00:55:31.8582341Z  2024-12-18T00:55:31.8582731Z  2024-12-18T00:55:31.8583171Z  2024-12-18T00:55:31.8583584Z  2024-12-18T00:55:31.8583992Z  2024-12-18T00:55:31.8584382Z  2024-12-18T00:55:31.8584775Z  2024-12-18T00:55:31.8595342Z [17,730 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:31.8596695Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:55:31.8597762Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:31.8598707Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:55:31.8599531Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:55:31.8600341Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2024-12-18T00:55:31.8601166Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:31.8602051Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2024-12-18T00:55:32.0690490Z Compiling xla/service/call_inliner.cc; 13s local ... 2024-12-18T00:55:32.0691340Z 2024-12-18T00:55:32.0691782Z  2024-12-18T00:55:32.0692232Z  2024-12-18T00:55:32.0692610Z  2024-12-18T00:55:32.0692979Z  2024-12-18T00:55:32.0693342Z  2024-12-18T00:55:32.0693703Z  2024-12-18T00:55:32.0694067Z  2024-12-18T00:55:32.0694427Z  2024-12-18T00:55:32.0695266Z [17,731 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:32.0696321Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:55:32.0697519Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2024-12-18T00:55:32.0698397Z @llvm-project//mlir:SparseTensorDialect; 33s local 2024-12-18T00:55:32.0699198Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:55:32.0699966Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:55:32.0700685Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:32.0701797Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2024-12-18T00:55:32.0702692Z Compiling xla/service/call_inliner.cc; 13s local ... 2024-12-18T00:55:32.3582299Z 2024-12-18T00:55:32.3583165Z  2024-12-18T00:55:32.3583648Z  2024-12-18T00:55:32.3584060Z  2024-12-18T00:55:32.3584468Z  2024-12-18T00:55:32.3584858Z  2024-12-18T00:55:32.3585252Z  2024-12-18T00:55:32.3585659Z  2024-12-18T00:55:32.3586060Z  2024-12-18T00:55:32.3587006Z [17,735 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:32.3588108Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:55:32.3589111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:32.3590070Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:55:32.3590908Z Compiling xla/service/layout_assignment.cc; 22s local 2024-12-18T00:55:32.3591732Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:55:32.3592954Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:55:32.3593851Z Compiling xla/service/call_inliner.cc; 13s local 2024-12-18T00:55:32.3594719Z Compiling xla/service/hlo_creation_utils.cc; 13s local ... 2024-12-18T00:55:32.6695988Z 2024-12-18T00:55:32.6697068Z  2024-12-18T00:55:32.6697541Z  2024-12-18T00:55:32.6697933Z  2024-12-18T00:55:32.6698362Z  2024-12-18T00:55:32.6698774Z  2024-12-18T00:55:32.6699131Z  2024-12-18T00:55:32.6699522Z  2024-12-18T00:55:32.6699936Z  2024-12-18T00:55:32.6700907Z [17,737 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:32.6702150Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:55:32.6703198Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:32.6704168Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:55:32.6704954Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:55:32.6705743Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:55:32.6706615Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:55:32.6707516Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:55:32.6708336Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 12s local ... 2024-12-18T00:55:32.8699772Z 2024-12-18T00:55:32.8700774Z  2024-12-18T00:55:32.8701260Z  2024-12-18T00:55:32.8701648Z  2024-12-18T00:55:32.8702024Z  2024-12-18T00:55:32.8702413Z  2024-12-18T00:55:32.8702776Z  2024-12-18T00:55:32.8703182Z  2024-12-18T00:55:32.8703550Z  2024-12-18T00:55:32.8704468Z [17,739 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:32.8705588Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:55:32.8706927Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:32.8707859Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:55:32.8708652Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:55:32.8709436Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2024-12-18T00:55:32.8710301Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:55:32.8711186Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:55:32.8712024Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 12s local ... 2024-12-18T00:55:33.1275809Z 2024-12-18T00:55:33.1276734Z  2024-12-18T00:55:33.1277145Z  2024-12-18T00:55:33.1277493Z  2024-12-18T00:55:33.1277847Z  2024-12-18T00:55:33.1278232Z  2024-12-18T00:55:33.1278585Z  2024-12-18T00:55:33.1278966Z  2024-12-18T00:55:33.1279312Z  2024-12-18T00:55:33.1280339Z [17,741 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:33.1281374Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:55:33.1282284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2024-12-18T00:55:33.1283123Z @llvm-project//mlir:SparseTensorDialect; 34s local 2024-12-18T00:55:33.1283813Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:55:33.1284472Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:55:33.1285216Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2024-12-18T00:55:33.1285952Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:33.1286721Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 11s local ... 2024-12-18T00:55:33.3951724Z 2024-12-18T00:55:33.3952612Z  2024-12-18T00:55:33.3953168Z  2024-12-18T00:55:33.3953655Z  2024-12-18T00:55:33.3954116Z  2024-12-18T00:55:33.3954541Z  2024-12-18T00:55:33.3955068Z  2024-12-18T00:55:33.3955854Z  2024-12-18T00:55:33.3956240Z  2024-12-18T00:55:33.3957093Z [17,744 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:33.3958160Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:33.3959127Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:33.3960013Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:55:33.3960725Z Compiling xla/service/layout_assignment.cc; 23s local 2024-12-18T00:55:33.3961470Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:55:33.3962295Z Compiling xla/service/cpu/conv_canonicalization.cc; 15s local 2024-12-18T00:55:33.3963159Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:33.3964104Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local ... 2024-12-18T00:55:33.6138810Z 2024-12-18T00:55:33.6139730Z  2024-12-18T00:55:33.6140225Z  2024-12-18T00:55:33.6140713Z  2024-12-18T00:55:33.6141038Z  2024-12-18T00:55:33.6141348Z  2024-12-18T00:55:33.6141716Z  2024-12-18T00:55:33.6142063Z  2024-12-18T00:55:33.6142400Z  2024-12-18T00:55:33.6143385Z [17,746 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:33.6144714Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:33.6145636Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:33.6146434Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:55:33.6147189Z Compiling xla/service/layout_assignment.cc; 24s local 2024-12-18T00:55:33.6147908Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:55:33.6148611Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:33.6149754Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2024-12-18T00:55:33.6150687Z Compiling xla/service/call_inliner.cc; 11s local ... 2024-12-18T00:55:33.8707462Z 2024-12-18T00:55:33.8708350Z  2024-12-18T00:55:33.8708830Z  2024-12-18T00:55:33.8709230Z  2024-12-18T00:55:33.8709634Z  2024-12-18T00:55:33.8710047Z  2024-12-18T00:55:33.8710443Z  2024-12-18T00:55:33.8710853Z  2024-12-18T00:55:33.8711250Z  2024-12-18T00:55:33.8712116Z [17,749 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:33.8713292Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:33.8714521Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:33.8715520Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:55:33.8716369Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2024-12-18T00:55:33.8717144Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:33.8718305Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2024-12-18T00:55:33.8719167Z Compiling xla/service/call_inliner.cc; 11s local 2024-12-18T00:55:33.8719924Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local ... 2024-12-18T00:55:34.0711301Z 2024-12-18T00:55:34.0712207Z  2024-12-18T00:55:34.0712704Z  2024-12-18T00:55:34.0713126Z  2024-12-18T00:55:34.0713542Z  2024-12-18T00:55:34.0713944Z  2024-12-18T00:55:34.0714355Z  2024-12-18T00:55:34.0714845Z  2024-12-18T00:55:34.0715214Z  2024-12-18T00:55:34.0716148Z [17,751 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:34.0717249Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:34.0718257Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2024-12-18T00:55:34.0719197Z @llvm-project//mlir:SparseTensorDialect; 35s local 2024-12-18T00:55:34.0720337Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:55:34.0721232Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local 2024-12-18T00:55:34.0722070Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2024-12-18T00:55:34.0722902Z Compiling xla/service/call_inliner.cc; 11s local 2024-12-18T00:55:34.0723606Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local ... 2024-12-18T00:55:34.3822131Z 2024-12-18T00:55:34.3823059Z  2024-12-18T00:55:34.3823535Z  2024-12-18T00:55:34.3823920Z  2024-12-18T00:55:34.3824328Z  2024-12-18T00:55:34.3824707Z  2024-12-18T00:55:34.3825069Z  2024-12-18T00:55:34.3825450Z  2024-12-18T00:55:34.3825839Z  2024-12-18T00:55:34.3826774Z [17,752 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:34.3828099Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:55:34.3829238Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:55:34.3830101Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:55:34.3830898Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:55:34.3831710Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 14s local 2024-12-18T00:55:34.3832633Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2024-12-18T00:55:34.3833534Z Compiling xla/service/call_inliner.cc; 12s local 2024-12-18T00:55:34.3834474Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2024-12-18T00:55:34.6717693Z 2024-12-18T00:55:34.6718582Z  2024-12-18T00:55:34.6719025Z  2024-12-18T00:55:34.6719457Z  2024-12-18T00:55:34.6719829Z  2024-12-18T00:55:34.6720212Z  2024-12-18T00:55:34.6720605Z  2024-12-18T00:55:34.6720982Z  2024-12-18T00:55:34.6721367Z  2024-12-18T00:55:34.6722309Z [17,753 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:34.6723943Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:55:34.6724988Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:55:34.6725926Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:55:34.6726743Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:55:34.6727465Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 14s local 2024-12-18T00:55:34.6728318Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2024-12-18T00:55:34.6729361Z Compiling xla/service/call_inliner.cc; 12s local 2024-12-18T00:55:34.6730188Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2024-12-18T00:55:35.0149482Z 2024-12-18T00:55:35.0150387Z  2024-12-18T00:55:35.0150848Z  2024-12-18T00:55:35.0151251Z  2024-12-18T00:55:35.0151675Z  2024-12-18T00:55:35.0152064Z  2024-12-18T00:55:35.0152439Z  2024-12-18T00:55:35.0152795Z  2024-12-18T00:55:35.0153469Z  2024-12-18T00:55:35.0154475Z [17,754 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:35.0155540Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:55:35.0156545Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2024-12-18T00:55:35.0157468Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:55:35.0158168Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2024-12-18T00:55:35.0158951Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 14s local 2024-12-18T00:55:35.0159764Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2024-12-18T00:55:35.0160567Z Compiling xla/service/call_inliner.cc; 12s local 2024-12-18T00:55:35.0161449Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2024-12-18T00:55:35.2723982Z 2024-12-18T00:55:35.2724930Z  2024-12-18T00:55:35.2725369Z  2024-12-18T00:55:35.2725804Z  2024-12-18T00:55:35.2726673Z  2024-12-18T00:55:35.2727128Z  2024-12-18T00:55:35.2727516Z  2024-12-18T00:55:35.2727867Z  2024-12-18T00:55:35.2728249Z  2024-12-18T00:55:35.2729202Z [17,756 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:35.2730338Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:55:35.2731362Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:55:35.2732263Z @llvm-project//mlir:SparseTensorDialect; 36s local 2024-12-18T00:55:35.2733041Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:55:35.2733968Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2024-12-18T00:55:35.2734824Z Compiling xla/service/call_inliner.cc; 13s local 2024-12-18T00:55:35.2735646Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2024-12-18T00:55:35.2736715Z Compiling xla/service/cpu/cpu_runtime.cc; 8s local ... 2024-12-18T00:55:35.5929421Z 2024-12-18T00:55:35.5930340Z  2024-12-18T00:55:35.5930791Z  2024-12-18T00:55:35.5931126Z  2024-12-18T00:55:35.5931508Z  2024-12-18T00:55:35.5931872Z  2024-12-18T00:55:35.5932294Z  2024-12-18T00:55:35.5932654Z  2024-12-18T00:55:35.5933022Z  2024-12-18T00:55:35.5933922Z [17,758 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:35.5934825Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:55:35.5935763Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:55:35.5936793Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:55:35.5937403Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:55:35.5938128Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2024-12-18T00:55:35.5939160Z Compiling xla/service/call_inliner.cc; 13s local 2024-12-18T00:55:35.5939811Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2024-12-18T00:55:35.5940614Z Compiling xla/service/cpu/cpu_runtime.cc; 8s local ... 2024-12-18T00:55:35.8729985Z 2024-12-18T00:55:35.8730905Z  2024-12-18T00:55:35.8731386Z  2024-12-18T00:55:35.8731792Z  2024-12-18T00:55:35.8732221Z  2024-12-18T00:55:35.8732606Z  2024-12-18T00:55:35.8732972Z  2024-12-18T00:55:35.8733351Z  2024-12-18T00:55:35.8733734Z  2024-12-18T00:55:35.8734610Z [17,758 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:35.8735741Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:55:35.8736920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2024-12-18T00:55:35.8737825Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:55:35.8738951Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2024-12-18T00:55:35.8739865Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2024-12-18T00:55:35.8740708Z Compiling xla/service/call_inliner.cc; 13s local 2024-12-18T00:55:35.8741559Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2024-12-18T00:55:35.8742479Z Compiling xla/service/cpu/cpu_runtime.cc; 8s local ... 2024-12-18T00:55:36.2735897Z 2024-12-18T00:55:36.2737007Z  2024-12-18T00:55:36.2737475Z  2024-12-18T00:55:36.2739140Z  2024-12-18T00:55:36.2739574Z  2024-12-18T00:55:36.2741579Z  2024-12-18T00:55:36.2742044Z  2024-12-18T00:55:36.2743927Z  2024-12-18T00:55:36.2744522Z  2024-12-18T00:55:36.2747586Z [17,759 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:36.2748630Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:55:36.2749690Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:55:36.2750951Z @llvm-project//mlir:SparseTensorDialect; 37s local 2024-12-18T00:55:36.2751747Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:55:36.2752592Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2024-12-18T00:55:36.2753539Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2024-12-18T00:55:36.2754395Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2024-12-18T00:55:36.2755212Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 9s local ... 2024-12-18T00:55:36.5567332Z 2024-12-18T00:55:36.5568333Z  2024-12-18T00:55:36.5568794Z  2024-12-18T00:55:36.5570437Z  2024-12-18T00:55:36.5570817Z  2024-12-18T00:55:36.5572444Z  2024-12-18T00:55:36.5572817Z  2024-12-18T00:55:36.5574520Z  2024-12-18T00:55:36.5574888Z  2024-12-18T00:55:36.5577134Z [17,760 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:36.5578194Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:55:36.5579102Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:55:36.5579905Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:55:36.5580610Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:55:36.5581345Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2024-12-18T00:55:36.5582185Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2024-12-18T00:55:36.5582956Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2024-12-18T00:55:36.5583691Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 9s local ... 2024-12-18T00:55:36.8741532Z 2024-12-18T00:55:36.8742445Z  2024-12-18T00:55:36.8742939Z  2024-12-18T00:55:36.8743376Z  2024-12-18T00:55:36.8743771Z  2024-12-18T00:55:36.8744129Z  2024-12-18T00:55:36.8745091Z  2024-12-18T00:55:36.8745607Z  2024-12-18T00:55:36.8746048Z  2024-12-18T00:55:36.8746995Z [17,760 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:36.8748162Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:55:36.8749194Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2024-12-18T00:55:36.8750092Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:55:36.8750883Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2024-12-18T00:55:36.8751723Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2024-12-18T00:55:36.8752689Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2024-12-18T00:55:36.8753493Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2024-12-18T00:55:36.8754470Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 9s local ... 2024-12-18T00:55:37.2746138Z 2024-12-18T00:55:37.2747052Z  2024-12-18T00:55:37.2747534Z  2024-12-18T00:55:37.2748241Z  2024-12-18T00:55:37.2748679Z  2024-12-18T00:55:37.2749098Z  2024-12-18T00:55:37.2749504Z  2024-12-18T00:55:37.2749890Z  2024-12-18T00:55:37.2750294Z  2024-12-18T00:55:37.2751252Z [17,762 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:37.2752398Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:55:37.2753449Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:55:37.2754372Z @llvm-project//mlir:SparseTensorDialect; 38s local 2024-12-18T00:55:37.2755196Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:55:37.2756097Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2024-12-18T00:55:37.2757091Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2024-12-18T00:55:37.2757993Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2024-12-18T00:55:37.2759206Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local ... 2024-12-18T00:55:37.6554368Z 2024-12-18T00:55:37.6555287Z  2024-12-18T00:55:37.6555851Z  2024-12-18T00:55:37.6556420Z  2024-12-18T00:55:37.6556871Z  2024-12-18T00:55:37.6557352Z  2024-12-18T00:55:37.6557840Z  2024-12-18T00:55:37.6558283Z  2024-12-18T00:55:37.6558758Z  2024-12-18T00:55:37.6559838Z [17,763 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:37.6561079Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:55:37.6562247Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:55:37.6563272Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:55:37.6564174Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:55:37.6565091Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2024-12-18T00:55:37.6566125Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2024-12-18T00:55:37.6566969Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2024-12-18T00:55:37.6567800Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local ... 2024-12-18T00:55:37.8752571Z 2024-12-18T00:55:37.8753466Z  2024-12-18T00:55:37.8753994Z  2024-12-18T00:55:37.8754381Z  2024-12-18T00:55:37.8754781Z  2024-12-18T00:55:37.8755167Z  2024-12-18T00:55:37.8755537Z  2024-12-18T00:55:37.8755924Z  2024-12-18T00:55:37.8756294Z  2024-12-18T00:55:37.8757173Z [17,766 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:37.8758286Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:55:37.8759258Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2024-12-18T00:55:37.8760149Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:55:37.8761273Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2024-12-18T00:55:37.8762121Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2024-12-18T00:55:37.8763076Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2024-12-18T00:55:37.8763941Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2024-12-18T00:55:37.8764712Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local ... 2024-12-18T00:55:38.2757421Z 2024-12-18T00:55:38.2758274Z  2024-12-18T00:55:38.2758784Z  2024-12-18T00:55:38.2759160Z  2024-12-18T00:55:38.2759555Z  2024-12-18T00:55:38.2759958Z  2024-12-18T00:55:38.2760370Z  2024-12-18T00:55:38.2760783Z  2024-12-18T00:55:38.2761162Z  2024-12-18T00:55:38.2762136Z [17,769 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:38.2763253Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:55:38.2764578Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:38.2765533Z @llvm-project//mlir:SparseTensorDialect; 39s local 2024-12-18T00:55:38.2766325Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2024-12-18T00:55:38.2767178Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2024-12-18T00:55:38.2768099Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:55:38.2768944Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:55:38.2769786Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local ... 2024-12-18T00:55:38.4760306Z 2024-12-18T00:55:38.4761190Z  2024-12-18T00:55:38.4761641Z  2024-12-18T00:55:38.4762025Z  2024-12-18T00:55:38.4762415Z  2024-12-18T00:55:38.4762827Z  2024-12-18T00:55:38.4763210Z  2024-12-18T00:55:38.4763591Z  2024-12-18T00:55:38.4763979Z  2024-12-18T00:55:38.4765133Z [17,771 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:38.4766407Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:55:38.4767483Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:38.4768373Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:55:38.4769124Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2024-12-18T00:55:38.4769987Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:55:38.4770936Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:55:38.4771828Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:55:38.4772657Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local ... 2024-12-18T00:55:38.6977318Z 2024-12-18T00:55:38.6978280Z  2024-12-18T00:55:38.6978781Z  2024-12-18T00:55:38.6979196Z  2024-12-18T00:55:38.6979588Z  2024-12-18T00:55:38.6980045Z  2024-12-18T00:55:38.6980472Z  2024-12-18T00:55:38.6980933Z  2024-12-18T00:55:38.6981289Z  2024-12-18T00:55:38.6982122Z [17,772 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:38.6983212Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:55:38.6984360Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:38.6985251Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:55:38.6986032Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2024-12-18T00:55:38.6986835Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:55:38.6987770Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:55:38.6988675Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:55:38.6989487Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local ... 2024-12-18T00:55:38.9854902Z 2024-12-18T00:55:38.9855739Z  2024-12-18T00:55:38.9856288Z  2024-12-18T00:55:38.9856828Z  2024-12-18T00:55:38.9857363Z  2024-12-18T00:55:38.9857811Z  2024-12-18T00:55:38.9858167Z  2024-12-18T00:55:38.9858526Z  2024-12-18T00:55:38.9858886Z  2024-12-18T00:55:38.9859774Z [17,774 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:38.9860801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:55:38.9861751Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:38.9862597Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:55:38.9863437Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:55:38.9864387Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2024-12-18T00:55:38.9865081Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2024-12-18T00:55:38.9865766Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2024-12-18T00:55:38.9866707Z Compiling xla/service/hlo_verifier.cc; 11s local ... 2024-12-18T00:55:39.2290831Z 2024-12-18T00:55:39.2291743Z  2024-12-18T00:55:39.2292200Z  2024-12-18T00:55:39.2292603Z  2024-12-18T00:55:39.2293004Z  2024-12-18T00:55:39.2293400Z  2024-12-18T00:55:39.2293779Z  2024-12-18T00:55:39.2294192Z  2024-12-18T00:55:39.2294596Z  2024-12-18T00:55:39.2295540Z [17,777 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:39.2296801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:39.2297843Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2024-12-18T00:55:39.2298751Z @llvm-project//mlir:SparseTensorDialect; 40s local 2024-12-18T00:55:39.2299659Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:55:39.2300708Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:55:39.2302002Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2024-12-18T00:55:39.2302777Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:55:39.2303554Z Compiling xla/service/hlo_verifier.cc; 12s local ... 2024-12-18T00:55:39.4308247Z 2024-12-18T00:55:39.4309163Z  2024-12-18T00:55:39.4309638Z  2024-12-18T00:55:39.4309998Z  2024-12-18T00:55:39.4310354Z  2024-12-18T00:55:39.4310731Z  2024-12-18T00:55:39.4311148Z  2024-12-18T00:55:39.4311518Z  2024-12-18T00:55:39.4311883Z  2024-12-18T00:55:39.4312792Z [17,781 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:39.4313841Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:39.4314852Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:55:39.4315738Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:55:39.4316617Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:55:39.4317560Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:55:39.4318445Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2024-12-18T00:55:39.4319252Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:55:39.4320072Z Compiling xla/service/hlo_verifier.cc; 12s local ... 2024-12-18T00:55:39.6768665Z 2024-12-18T00:55:39.6769550Z  2024-12-18T00:55:39.6770035Z  2024-12-18T00:55:39.6770459Z  2024-12-18T00:55:39.6770857Z  2024-12-18T00:55:39.6771303Z  2024-12-18T00:55:39.6771721Z  2024-12-18T00:55:39.6772109Z  2024-12-18T00:55:39.6772522Z  2024-12-18T00:55:39.6773483Z [17,782 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:39.6774659Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:39.6776070Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:55:39.6777202Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:55:39.6778120Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:55:39.6779119Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:55:39.6780013Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2024-12-18T00:55:39.6780817Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:55:39.6781659Z Compiling xla/service/hlo_verifier.cc; 12s local ... 2024-12-18T00:55:39.8771943Z 2024-12-18T00:55:39.8772774Z  2024-12-18T00:55:39.8773243Z  2024-12-18T00:55:39.8773646Z  2024-12-18T00:55:39.8774034Z  2024-12-18T00:55:39.8774438Z  2024-12-18T00:55:39.8774829Z  2024-12-18T00:55:39.8775215Z  2024-12-18T00:55:39.8775592Z  2024-12-18T00:55:39.8776982Z [17,783 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:39.8778149Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:39.8779159Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2024-12-18T00:55:39.8780066Z @llvm-project//mlir:SparseTensorDialect; 41s local 2024-12-18T00:55:39.8780942Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:55:39.8781887Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2024-12-18T00:55:39.8782762Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2024-12-18T00:55:39.8783570Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:55:39.8784389Z Compiling xla/service/hlo_verifier.cc; 12s local ... 2024-12-18T00:55:40.4271060Z 2024-12-18T00:55:40.4272533Z  2024-12-18T00:55:40.4273060Z  2024-12-18T00:55:40.4273442Z  2024-12-18T00:55:40.4273862Z  2024-12-18T00:55:40.4274242Z  2024-12-18T00:55:40.4274669Z  2024-12-18T00:55:40.4275464Z  2024-12-18T00:55:40.4275874Z  2024-12-18T00:55:40.4276817Z [17,784 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:40.4277965Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:40.4279009Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:55:40.4279925Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:55:40.4280800Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:55:40.4281802Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2024-12-18T00:55:40.4282668Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2024-12-18T00:55:40.4283415Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:55:40.4284210Z Compiling xla/service/hlo_verifier.cc; 13s local ... 2024-12-18T00:55:40.6779909Z 2024-12-18T00:55:40.6780807Z  2024-12-18T00:55:40.6781867Z  2024-12-18T00:55:40.6783297Z  2024-12-18T00:55:40.6784615Z  2024-12-18T00:55:40.6785925Z  2024-12-18T00:55:40.6787254Z  2024-12-18T00:55:40.6788739Z  2024-12-18T00:55:40.6790052Z  2024-12-18T00:55:40.6791875Z [17,784 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:40.6793866Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:40.6795705Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:55:40.6797457Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:55:40.6799205Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:55:40.6800988Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2024-12-18T00:55:40.6802907Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2024-12-18T00:55:40.6805094Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:55:40.6807131Z Compiling xla/service/hlo_verifier.cc; 13s local ... 2024-12-18T00:55:40.8879925Z 2024-12-18T00:55:40.8883202Z  2024-12-18T00:55:40.8884943Z  2024-12-18T00:55:40.8886437Z  2024-12-18T00:55:40.8888405Z  2024-12-18T00:55:40.8890227Z  2024-12-18T00:55:40.8892022Z  2024-12-18T00:55:40.8894031Z  2024-12-18T00:55:40.8895768Z  2024-12-18T00:55:40.8898247Z [17,785 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:40.8900759Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:40.8903118Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:55:40.8905403Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:55:40.8907691Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:55:40.8910273Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2024-12-18T00:55:40.8912532Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2024-12-18T00:55:40.8914814Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:55:40.8917091Z Compiling xla/service/hlo_verifier.cc; 13s local ... 2024-12-18T00:55:41.1744786Z 2024-12-18T00:55:41.1747105Z  2024-12-18T00:55:41.1749299Z  2024-12-18T00:55:41.1751202Z  2024-12-18T00:55:41.1753023Z  2024-12-18T00:55:41.1754861Z  2024-12-18T00:55:41.1756617Z  2024-12-18T00:55:41.1758387Z  2024-12-18T00:55:41.1760144Z  2024-12-18T00:55:41.1762450Z [17,788 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:41.1764988Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:41.1767400Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2024-12-18T00:55:41.1769746Z @llvm-project//mlir:SparseTensorDialect; 42s local 2024-12-18T00:55:41.1772367Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:55:41.1774735Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:55:41.1777186Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:55:41.1779399Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:55:41.1781763Z Compiling xla/service/hlo_verifier.cc; 14s local ... 2024-12-18T00:55:41.4784193Z 2024-12-18T00:55:41.4786864Z  2024-12-18T00:55:41.4789203Z  2024-12-18T00:55:41.4791404Z  2024-12-18T00:55:41.4793604Z  2024-12-18T00:55:41.4795795Z  2024-12-18T00:55:41.4797914Z  2024-12-18T00:55:41.4800034Z  2024-12-18T00:55:41.4802150Z  2024-12-18T00:55:41.4804823Z [17,790 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:41.4807736Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:55:41.4810497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:55:41.4814387Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:55:41.4815273Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:55:41.4816220Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:55:41.4817274Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:55:41.4818074Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:55:41.4818869Z Compiling xla/service/hlo_verifier.cc; 14s local ... 2024-12-18T00:55:41.6795071Z 2024-12-18T00:55:41.6795957Z  2024-12-18T00:55:41.6796414Z  2024-12-18T00:55:41.6796795Z  2024-12-18T00:55:41.6797170Z  2024-12-18T00:55:41.6797557Z  2024-12-18T00:55:41.6797954Z  2024-12-18T00:55:41.6798340Z  2024-12-18T00:55:41.6799001Z  2024-12-18T00:55:41.6799867Z [17,791 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:41.6800968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:55:41.6801968Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:55:41.6802863Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:55:41.6803701Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:55:41.6804641Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:55:41.6805493Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:55:41.6806294Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:55:41.6807100Z Compiling xla/service/hlo_verifier.cc; 14s local ... 2024-12-18T00:55:42.0146774Z 2024-12-18T00:55:42.0147546Z  2024-12-18T00:55:42.0147966Z  2024-12-18T00:55:42.0148324Z  2024-12-18T00:55:42.0148694Z  2024-12-18T00:55:42.0149042Z  2024-12-18T00:55:42.0149639Z  2024-12-18T00:55:42.0150007Z  2024-12-18T00:55:42.0150375Z  2024-12-18T00:55:42.0151307Z [17,792 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:42.0152313Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:55:42.0153211Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2024-12-18T00:55:42.0154001Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:55:42.0154764Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:55:42.0155590Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2024-12-18T00:55:42.0156361Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2024-12-18T00:55:42.0157051Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:55:42.0157774Z Compiling xla/service/hlo_verifier.cc; 14s local ... 2024-12-18T00:55:42.2792108Z 2024-12-18T00:55:42.2793240Z  2024-12-18T00:55:42.2793645Z  2024-12-18T00:55:42.2793965Z  2024-12-18T00:55:42.2794298Z  2024-12-18T00:55:42.2794626Z  2024-12-18T00:55:42.2794951Z  2024-12-18T00:55:42.2795273Z  2024-12-18T00:55:42.2795593Z  2024-12-18T00:55:42.2796338Z [17,794 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:42.2797362Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:42.2798280Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:55:42.2799097Z @llvm-project//mlir:SparseTensorDialect; 43s local 2024-12-18T00:55:42.2799865Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:55:42.2800656Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:55:42.2801385Z Compiling xla/service/cpu/cpu_runtime.cc; 15s local 2024-12-18T00:55:42.2802091Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:55:42.2802780Z Compiling xla/service/hlo_verifier.cc; 15s local ... 2024-12-18T00:55:42.4841559Z 2024-12-18T00:55:42.4842477Z  2024-12-18T00:55:42.4842945Z  2024-12-18T00:55:42.4843339Z  2024-12-18T00:55:42.4843712Z  2024-12-18T00:55:42.4844093Z  2024-12-18T00:55:42.4844701Z  2024-12-18T00:55:42.4845086Z  2024-12-18T00:55:42.4845587Z  2024-12-18T00:55:42.4846632Z [17,796 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:42.4847745Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:42.4848761Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:55:42.4849681Z @llvm-project//mlir:SparseTensorDialect; 44s local 2024-12-18T00:55:42.4850549Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:55:42.4851881Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:55:42.4852754Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:55:42.4853514Z Compiling xla/service/hlo_verifier.cc; 15s local 2024-12-18T00:55:42.4854537Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local ... 2024-12-18T00:55:42.8798663Z 2024-12-18T00:55:42.8799558Z  2024-12-18T00:55:42.8800093Z  2024-12-18T00:55:42.8800478Z  2024-12-18T00:55:42.8800829Z  2024-12-18T00:55:42.8801187Z  2024-12-18T00:55:42.8801562Z  2024-12-18T00:55:42.8801948Z  2024-12-18T00:55:42.8802444Z  2024-12-18T00:55:42.8803347Z [17,798 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:42.8804484Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:42.8805516Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:55:42.8806830Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:55:42.8807801Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:55:42.8808704Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:55:42.8809485Z Compiling xla/service/hlo_verifier.cc; 15s local 2024-12-18T00:55:42.8810493Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local 2024-12-18T00:55:42.8811554Z Compiling xla/service/conditional_simplifier.cc; 10s local ... 2024-12-18T00:55:43.0803076Z 2024-12-18T00:55:43.0803877Z  2024-12-18T00:55:43.0804336Z  2024-12-18T00:55:43.0804785Z  2024-12-18T00:55:43.0805262Z  2024-12-18T00:55:43.0805658Z  2024-12-18T00:55:43.0806029Z  2024-12-18T00:55:43.0806424Z  2024-12-18T00:55:43.0806846Z  2024-12-18T00:55:43.0807849Z [17,799 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:43.0809269Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:43.0810432Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2024-12-18T00:55:43.0811389Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:55:43.0812341Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2024-12-18T00:55:43.0813239Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:55:43.0814037Z Compiling xla/service/hlo_verifier.cc; 15s local 2024-12-18T00:55:43.0814962Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:55:43.0816084Z Compiling xla/service/conditional_simplifier.cc; 10s local ... 2024-12-18T00:55:43.6361217Z 2024-12-18T00:55:43.6362116Z  2024-12-18T00:55:43.6362618Z  2024-12-18T00:55:43.6363049Z  2024-12-18T00:55:43.6363433Z  2024-12-18T00:55:43.6363792Z  2024-12-18T00:55:43.6364227Z  2024-12-18T00:55:43.6364622Z  2024-12-18T00:55:43.6365052Z  2024-12-18T00:55:43.6365942Z [17,800 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:43.6367023Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:55:43.6368010Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:55:43.6369039Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:55:43.6369970Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2024-12-18T00:55:43.6370848Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:55:43.6371637Z Compiling xla/service/hlo_verifier.cc; 16s local 2024-12-18T00:55:43.6372570Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:55:43.6373656Z Compiling xla/service/conditional_simplifier.cc; 11s local ... 2024-12-18T00:55:43.8810154Z 2024-12-18T00:55:43.8811044Z  2024-12-18T00:55:43.8811498Z  2024-12-18T00:55:43.8811984Z  2024-12-18T00:55:43.8812392Z  2024-12-18T00:55:43.8812818Z  2024-12-18T00:55:43.8813200Z  2024-12-18T00:55:43.8813576Z  2024-12-18T00:55:43.8813965Z  2024-12-18T00:55:43.8814871Z [17,801 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:43.8815978Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:55:43.8817081Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:55:43.8817993Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:55:43.8819054Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2024-12-18T00:55:43.8819918Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:55:43.8820662Z Compiling xla/service/hlo_verifier.cc; 16s local 2024-12-18T00:55:43.8821614Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:55:43.8822983Z Compiling xla/service/conditional_simplifier.cc; 11s local ... 2024-12-18T00:55:44.0899740Z 2024-12-18T00:55:44.0900525Z  2024-12-18T00:55:44.0901018Z  2024-12-18T00:55:44.0901399Z  2024-12-18T00:55:44.0901814Z  2024-12-18T00:55:44.0902215Z  2024-12-18T00:55:44.0902616Z  2024-12-18T00:55:44.0902991Z  2024-12-18T00:55:44.0903359Z  2024-12-18T00:55:44.0904277Z [17,802 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:44.0905426Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:55:44.0906459Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2024-12-18T00:55:44.0907461Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:55:44.0908541Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2024-12-18T00:55:44.0909723Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:55:44.0910602Z Compiling xla/service/hlo_verifier.cc; 16s local 2024-12-18T00:55:44.0911470Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:55:44.0912490Z Compiling xla/service/conditional_simplifier.cc; 11s local ... 2024-12-18T00:55:44.3420511Z 2024-12-18T00:55:44.3421343Z  2024-12-18T00:55:44.3421817Z  2024-12-18T00:55:44.3422201Z  2024-12-18T00:55:44.3422565Z  2024-12-18T00:55:44.3422953Z  2024-12-18T00:55:44.3423291Z  2024-12-18T00:55:44.3423667Z  2024-12-18T00:55:44.3424044Z  2024-12-18T00:55:44.3424923Z [17,803 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:44.3426077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:55:44.3426954Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:44.3427873Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:55:44.3428723Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2024-12-18T00:55:44.3429546Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:55:44.3430335Z Compiling xla/service/hlo_verifier.cc; 17s local 2024-12-18T00:55:44.3431232Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:55:44.3432241Z Compiling xla/service/conditional_simplifier.cc; 11s local ... 2024-12-18T00:55:44.6211028Z 2024-12-18T00:55:44.6211785Z  2024-12-18T00:55:44.6212201Z  2024-12-18T00:55:44.6212531Z  2024-12-18T00:55:44.6212869Z  2024-12-18T00:55:44.6213219Z  2024-12-18T00:55:44.6213559Z  2024-12-18T00:55:44.6213904Z  2024-12-18T00:55:44.6214219Z  2024-12-18T00:55:44.6215015Z [17,806 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:44.6216265Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:55:44.6217420Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:44.6218306Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:55:44.6230694Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:55:44.6231565Z Compiling xla/service/hlo_verifier.cc; 17s local 2024-12-18T00:55:44.6232414Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:55:44.6233366Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:55:44.6234193Z @xla//xla/hlo/transforms:batch_dot_simplification; 11s local ... 2024-12-18T00:55:44.8818187Z 2024-12-18T00:55:44.8819007Z  2024-12-18T00:55:44.8819418Z  2024-12-18T00:55:44.8819764Z  2024-12-18T00:55:44.8820098Z  2024-12-18T00:55:44.8820417Z  2024-12-18T00:55:44.8820776Z  2024-12-18T00:55:44.8821106Z  2024-12-18T00:55:44.8821429Z  2024-12-18T00:55:44.8822515Z [17,807 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:44.8823478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:55:44.8824311Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:44.8825164Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:55:44.8825918Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:55:44.8826603Z Compiling xla/service/hlo_verifier.cc; 17s local 2024-12-18T00:55:44.8827452Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:55:44.8828330Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:55:44.8829197Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local ... 2024-12-18T00:55:45.2290842Z 2024-12-18T00:55:45.2291665Z  2024-12-18T00:55:45.2292053Z  2024-12-18T00:55:45.2292677Z  2024-12-18T00:55:45.2293003Z  2024-12-18T00:55:45.2293311Z  2024-12-18T00:55:45.2293620Z  2024-12-18T00:55:45.2293929Z  2024-12-18T00:55:45.2294222Z  2024-12-18T00:55:45.2294954Z [17,808 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:45.2295805Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:45.2296747Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2024-12-18T00:55:45.2297494Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:55:45.2298154Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:55:45.2298759Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:55:45.2299475Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 15s local 2024-12-18T00:55:45.2300256Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:55:45.2301022Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local ... 2024-12-18T00:55:45.4311876Z 2024-12-18T00:55:45.4312695Z  2024-12-18T00:55:45.4313181Z  2024-12-18T00:55:45.4313574Z  2024-12-18T00:55:45.4313941Z  2024-12-18T00:55:45.4314339Z  2024-12-18T00:55:45.4314758Z  2024-12-18T00:55:45.4315159Z  2024-12-18T00:55:45.4315555Z  2024-12-18T00:55:45.4316518Z [17,810 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:45.4317702Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:45.4318765Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:45.4319780Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:55:45.4320744Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:55:45.4321980Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:55:45.4323011Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 15s local 2024-12-18T00:55:45.4324106Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:55:45.4325122Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local ... 2024-12-18T00:55:45.6822613Z 2024-12-18T00:55:45.6823560Z  2024-12-18T00:55:45.6824047Z  2024-12-18T00:55:45.6824729Z  2024-12-18T00:55:45.6825158Z  2024-12-18T00:55:45.6825662Z  2024-12-18T00:55:45.6826084Z  2024-12-18T00:55:45.6826481Z  2024-12-18T00:55:45.6827003Z  2024-12-18T00:55:45.6828105Z [17,811 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:45.6829369Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:45.6831228Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:45.6832477Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:55:45.6833402Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:55:45.6834161Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:55:45.6835108Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 15s local 2024-12-18T00:55:45.6836153Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:55:45.6837161Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local ... 2024-12-18T00:55:45.9813596Z 2024-12-18T00:55:45.9814461Z  2024-12-18T00:55:45.9814955Z  2024-12-18T00:55:45.9815343Z  2024-12-18T00:55:45.9815754Z  2024-12-18T00:55:45.9816139Z  2024-12-18T00:55:45.9816750Z  2024-12-18T00:55:45.9817139Z  2024-12-18T00:55:45.9817524Z  2024-12-18T00:55:45.9818485Z [17,813 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:45.9819981Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:45.9821145Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:45.9822163Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:55:45.9823106Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:55:45.9823922Z Compiling xla/service/hlo_verifier.cc; 18s local 2024-12-18T00:55:45.9824801Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:55:45.9825792Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local 2024-12-18T00:55:45.9826860Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 12s local ... 2024-12-18T00:55:46.2157014Z 2024-12-18T00:55:46.2157898Z  2024-12-18T00:55:46.2158387Z  2024-12-18T00:55:46.2158822Z  2024-12-18T00:55:46.2159240Z  2024-12-18T00:55:46.2159635Z  2024-12-18T00:55:46.2160034Z  2024-12-18T00:55:46.2160470Z  2024-12-18T00:55:46.2160861Z  2024-12-18T00:55:46.2161856Z [17,814 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:46.2163019Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:55:46.2164107Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2024-12-18T00:55:46.2165130Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:55:46.2166085Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:55:46.2166937Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:55:46.2167841Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:55:46.2168848Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2024-12-18T00:55:46.2169873Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 12s local ... 2024-12-18T00:55:46.4830536Z 2024-12-18T00:55:46.4831443Z  2024-12-18T00:55:46.4832197Z  2024-12-18T00:55:46.4832622Z  2024-12-18T00:55:46.4833035Z  2024-12-18T00:55:46.4833507Z  2024-12-18T00:55:46.4833902Z  2024-12-18T00:55:46.4834309Z  2024-12-18T00:55:46.4834734Z  2024-12-18T00:55:46.4835732Z [17,815 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:46.4836954Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:55:46.4838046Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:55:46.4839108Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:55:46.4840087Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:55:46.4840928Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:55:46.4841832Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:55:46.4842788Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2024-12-18T00:55:46.4844066Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 13s local ... 2024-12-18T00:55:46.7707269Z 2024-12-18T00:55:46.7708105Z  2024-12-18T00:55:46.7708536Z  2024-12-18T00:55:46.7708873Z  2024-12-18T00:55:46.7709225Z  2024-12-18T00:55:46.7709568Z  2024-12-18T00:55:46.7709907Z  2024-12-18T00:55:46.7710233Z  2024-12-18T00:55:46.7710583Z  2024-12-18T00:55:46.7711394Z [17,818 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:46.7712444Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:55:46.7713290Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:55:46.7714106Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:55:46.7714839Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:55:46.7715490Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:55:46.7716516Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:55:46.7717369Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2024-12-18T00:55:46.7718169Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 13s local ... 2024-12-18T00:55:47.0382529Z 2024-12-18T00:55:47.0383467Z  2024-12-18T00:55:47.0384004Z  2024-12-18T00:55:47.0384364Z  2024-12-18T00:55:47.0384733Z  2024-12-18T00:55:47.0385100Z  2024-12-18T00:55:47.0385438Z  2024-12-18T00:55:47.0385796Z  2024-12-18T00:55:47.0386148Z  2024-12-18T00:55:47.0387072Z [17,819 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:47.0388256Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:55:47.0389303Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2024-12-18T00:55:47.0390303Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:55:47.0391284Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:55:47.0392035Z Compiling xla/service/hlo_verifier.cc; 19s local 2024-12-18T00:55:47.0392831Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:55:47.0393810Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2024-12-18T00:55:47.0394563Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 13s local ... 2024-12-18T00:55:47.2838693Z 2024-12-18T00:55:47.2839607Z  2024-12-18T00:55:47.2840091Z  2024-12-18T00:55:47.2840446Z  2024-12-18T00:55:47.2840837Z  2024-12-18T00:55:47.2841220Z  2024-12-18T00:55:47.2841632Z  2024-12-18T00:55:47.2842167Z  2024-12-18T00:55:47.2842563Z  2024-12-18T00:55:47.2843486Z [17,820 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:47.2844814Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:55:47.2846050Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:47.2847041Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:55:47.2847893Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:55:47.2848601Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:55:47.2849423Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:55:47.2850380Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:47.2851337Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 13s local ... 2024-12-18T00:55:47.4842996Z 2024-12-18T00:55:47.4843850Z  2024-12-18T00:55:47.4844611Z  2024-12-18T00:55:47.4845031Z  2024-12-18T00:55:47.4845424Z  2024-12-18T00:55:47.4845830Z  2024-12-18T00:55:47.4846231Z  2024-12-18T00:55:47.4846566Z  2024-12-18T00:55:47.4846916Z  2024-12-18T00:55:47.4848096Z [17,822 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:47.4849253Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:55:47.4850274Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:47.4851224Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:55:47.4852075Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:55:47.4852860Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:55:47.4853701Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:55:47.4854663Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:47.4855608Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local ... 2024-12-18T00:55:47.8849720Z 2024-12-18T00:55:47.8850591Z  2024-12-18T00:55:47.8851082Z  2024-12-18T00:55:47.8851507Z  2024-12-18T00:55:47.8851967Z  2024-12-18T00:55:47.8852365Z  2024-12-18T00:55:47.8852743Z  2024-12-18T00:55:47.8853547Z  2024-12-18T00:55:47.8853947Z  2024-12-18T00:55:47.8854898Z [17,823 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:47.8856104Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:55:47.8857352Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:47.8858379Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:55:47.8859275Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:55:47.8860046Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:55:47.8860851Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:55:47.8861871Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:47.8862890Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local ... 2024-12-18T00:55:48.0854527Z 2024-12-18T00:55:48.0855385Z  2024-12-18T00:55:48.0855930Z  2024-12-18T00:55:48.0856500Z  2024-12-18T00:55:48.0856882Z  2024-12-18T00:55:48.0857325Z  2024-12-18T00:55:48.0857934Z  2024-12-18T00:55:48.0858407Z  2024-12-18T00:55:48.0858854Z  2024-12-18T00:55:48.0859911Z [17,825 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:48.0861000Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:55:48.0861947Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2024-12-18T00:55:48.0862900Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:55:48.0863795Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:55:48.0864595Z Compiling xla/service/hlo_verifier.cc; 20s local 2024-12-18T00:55:48.0865350Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:55:48.0866559Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:48.0867484Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local ... 2024-12-18T00:55:48.3303807Z 2024-12-18T00:55:48.3304684Z  2024-12-18T00:55:48.3305184Z  2024-12-18T00:55:48.3305572Z  2024-12-18T00:55:48.3305967Z  2024-12-18T00:55:48.3306320Z  2024-12-18T00:55:48.3306695Z  2024-12-18T00:55:48.3307100Z  2024-12-18T00:55:48.3307495Z  2024-12-18T00:55:48.3308389Z [17,831 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:48.3309478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:55:48.3310487Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:55:48.3311498Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:55:48.3312390Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:55:48.3313707Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:48.3314671Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local 2024-12-18T00:55:48.3315623Z Compiling xla/service/select_and_scatter_expander.cc; 12s local 2024-12-18T00:55:48.3316491Z Compiling xla/hlo/builder/lib/loops.cc; 10s local ... 2024-12-18T00:55:48.5424788Z 2024-12-18T00:55:48.5425685Z  2024-12-18T00:55:48.5426084Z  2024-12-18T00:55:48.5426426Z  2024-12-18T00:55:48.5426737Z  2024-12-18T00:55:48.5427066Z  2024-12-18T00:55:48.5427396Z  2024-12-18T00:55:48.5427727Z  2024-12-18T00:55:48.5428038Z  2024-12-18T00:55:48.5428815Z [17,833 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:48.5429766Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:55:48.5430646Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:55:48.5431858Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:55:48.5432963Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:55:48.5433775Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:48.5434603Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 15s local 2024-12-18T00:55:48.5435445Z Compiling xla/hlo/builder/lib/constants.cc; 9s local 2024-12-18T00:55:48.5436172Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 9s local ... 2024-12-18T00:55:48.8863781Z 2024-12-18T00:55:48.8864667Z  2024-12-18T00:55:48.8865157Z  2024-12-18T00:55:48.8865570Z  2024-12-18T00:55:48.8865995Z  2024-12-18T00:55:48.8866382Z  2024-12-18T00:55:48.8866767Z  2024-12-18T00:55:48.8867130Z  2024-12-18T00:55:48.8867575Z  2024-12-18T00:55:48.8868555Z [17,834 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:48.8869665Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:55:48.8870642Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:55:48.8871595Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:55:48.8872394Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:55:48.8873356Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:48.8874392Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 15s local 2024-12-18T00:55:48.8875305Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 9s local 2024-12-18T00:55:48.8876058Z Compiling mlir/lib/Transforms/Mem2Reg.cpp; 9s local ... 2024-12-18T00:55:49.0868195Z 2024-12-18T00:55:49.0869065Z  2024-12-18T00:55:49.0869569Z  2024-12-18T00:55:49.0869998Z  2024-12-18T00:55:49.0870388Z  2024-12-18T00:55:49.0870808Z  2024-12-18T00:55:49.0871486Z  2024-12-18T00:55:49.0871906Z  2024-12-18T00:55:49.0872312Z  2024-12-18T00:55:49.0873343Z [17,835 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:49.0874576Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:55:49.0875672Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2024-12-18T00:55:49.0876731Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:55:49.0877711Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:55:49.0878668Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:49.0879689Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 15s local 2024-12-18T00:55:49.0880641Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 10s local 2024-12-18T00:55:49.0881476Z Compiling mlir/lib/Transforms/Mem2Reg.cpp; 9s local ... 2024-12-18T00:55:49.4787527Z 2024-12-18T00:55:49.4788424Z  2024-12-18T00:55:49.4788888Z  2024-12-18T00:55:49.4789583Z  2024-12-18T00:55:49.4790052Z  2024-12-18T00:55:49.4790449Z  2024-12-18T00:55:49.4790848Z  2024-12-18T00:55:49.4791226Z  2024-12-18T00:55:49.4791617Z  2024-12-18T00:55:49.4792536Z [17,838 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:49.4793699Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:55:49.4794743Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:55:49.4795774Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:55:49.4796686Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:55:49.4797613Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2024-12-18T00:55:49.4798534Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:55:49.4799481Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 10s local 2024-12-18T00:55:49.4800685Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 10s local ... 2024-12-18T00:55:49.6874046Z 2024-12-18T00:55:49.6874931Z  2024-12-18T00:55:49.6875434Z  2024-12-18T00:55:49.6875817Z  2024-12-18T00:55:49.6876163Z  2024-12-18T00:55:49.6876534Z  2024-12-18T00:55:49.6876910Z  2024-12-18T00:55:49.6877303Z  2024-12-18T00:55:49.6877671Z  2024-12-18T00:55:49.6878593Z [17,839 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:49.6879739Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:55:49.6880864Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:55:49.6881788Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:55:49.6882651Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:55:49.6883589Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2024-12-18T00:55:49.6884564Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:55:49.6885481Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 10s local 2024-12-18T00:55:49.6886512Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 10s local ... 2024-12-18T00:55:50.0878907Z 2024-12-18T00:55:50.0879815Z  2024-12-18T00:55:50.0880253Z  2024-12-18T00:55:50.0880650Z  2024-12-18T00:55:50.0881046Z  2024-12-18T00:55:50.0881434Z  2024-12-18T00:55:50.0881825Z  2024-12-18T00:55:50.0882194Z  2024-12-18T00:55:50.0882583Z  2024-12-18T00:55:50.0883521Z [17,841 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:50.0884625Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:55:50.0885623Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2024-12-18T00:55:50.0886884Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:55:50.0887768Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:55:50.0888636Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2024-12-18T00:55:50.0889546Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:55:50.0890420Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 11s local 2024-12-18T00:55:50.0891426Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 10s local ... 2024-12-18T00:55:50.4679973Z 2024-12-18T00:55:50.4680834Z  2024-12-18T00:55:50.4681277Z  2024-12-18T00:55:50.4681683Z  2024-12-18T00:55:50.4682081Z  2024-12-18T00:55:50.4682475Z  2024-12-18T00:55:50.4682860Z  2024-12-18T00:55:50.4683271Z  2024-12-18T00:55:50.4683675Z  2024-12-18T00:55:50.4684554Z [17,842 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:50.4685966Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:50.4687007Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:50.4687961Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:55:50.4688816Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 23s local 2024-12-18T00:55:50.4689707Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2024-12-18T00:55:50.4690582Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 17s local 2024-12-18T00:55:50.4691432Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 11s local 2024-12-18T00:55:50.4692401Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local ... 2024-12-18T00:55:50.6885298Z 2024-12-18T00:55:50.6886241Z  2024-12-18T00:55:50.6886839Z  2024-12-18T00:55:50.6887369Z  2024-12-18T00:55:50.6887894Z  2024-12-18T00:55:50.6888389Z  2024-12-18T00:55:50.6888891Z  2024-12-18T00:55:50.6889450Z  2024-12-18T00:55:50.6889941Z  2024-12-18T00:55:50.6891438Z [17,843 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:55:50.6892703Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:50.6893739Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:50.6894681Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:55:50.6895580Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 23s local 2024-12-18T00:55:50.6896324Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2024-12-18T00:55:50.6897246Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 11s local 2024-12-18T00:55:50.6898290Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local 2024-12-18T00:55:50.6899273Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 9s local ... 2024-12-18T00:55:50.9015238Z 2024-12-18T00:55:50.9016123Z  2024-12-18T00:55:50.9016819Z  2024-12-18T00:55:50.9017260Z  2024-12-18T00:55:50.9017639Z  2024-12-18T00:55:50.9018038Z  2024-12-18T00:55:50.9018435Z  2024-12-18T00:55:50.9018835Z  2024-12-18T00:55:50.9019223Z  2024-12-18T00:55:50.9020151Z [17,845 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:50.9021192Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:50.9022109Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:50.9023037Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:55:50.9024000Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2024-12-18T00:55:50.9024873Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 11s local 2024-12-18T00:55:50.9025862Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local 2024-12-18T00:55:50.9027182Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 9s local 2024-12-18T00:55:50.9028038Z Compiling xla/service/while_util.cc; 9s local ... 2024-12-18T00:55:51.1599327Z 2024-12-18T00:55:51.1600197Z  2024-12-18T00:55:51.1600677Z  2024-12-18T00:55:51.1601067Z  2024-12-18T00:55:51.1601451Z  2024-12-18T00:55:51.1601792Z  2024-12-18T00:55:51.1602168Z  2024-12-18T00:55:51.1602546Z  2024-12-18T00:55:51.1602931Z  2024-12-18T00:55:51.1603793Z [17,847 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:51.1604939Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:51.1605937Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2024-12-18T00:55:51.1606877Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:55:51.1607769Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2024-12-18T00:55:51.1608688Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local 2024-12-18T00:55:51.1609980Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local 2024-12-18T00:55:51.1610983Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 10s local 2024-12-18T00:55:51.1611797Z Compiling xla/service/while_util.cc; 9s local ... 2024-12-18T00:55:51.4892607Z 2024-12-18T00:55:51.4893518Z  2024-12-18T00:55:51.4894024Z  2024-12-18T00:55:51.4894415Z  2024-12-18T00:55:51.4894814Z  2024-12-18T00:55:51.4895211Z  2024-12-18T00:55:51.4895610Z  2024-12-18T00:55:51.4895975Z  2024-12-18T00:55:51.4896496Z  2024-12-18T00:55:51.4897473Z [17,847 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:51.4898538Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:55:51.4899576Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:55:51.4900578Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2024-12-18T00:55:51.4901937Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2024-12-18T00:55:51.4902818Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local 2024-12-18T00:55:51.4903762Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:55:51.4904729Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 10s local 2024-12-18T00:55:51.4905557Z Compiling xla/service/while_util.cc; 9s local ... 2024-12-18T00:55:51.6896939Z 2024-12-18T00:55:51.6897765Z  2024-12-18T00:55:51.6898331Z  2024-12-18T00:55:51.6898689Z  2024-12-18T00:55:51.6899036Z  2024-12-18T00:55:51.6899378Z  2024-12-18T00:55:51.6899717Z  2024-12-18T00:55:51.6900055Z  2024-12-18T00:55:51.6900397Z  2024-12-18T00:55:51.6901207Z [17,848 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:51.6902216Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:55:51.6903101Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:55:51.6903935Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2024-12-18T00:55:51.6904744Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2024-12-18T00:55:51.6905521Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local 2024-12-18T00:55:51.6906346Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:55:51.6907218Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 10s local 2024-12-18T00:55:51.6907946Z Compiling xla/service/while_util.cc; 10s local ... 2024-12-18T00:55:52.0901801Z 2024-12-18T00:55:52.0902681Z  2024-12-18T00:55:52.0903144Z  2024-12-18T00:55:52.0903602Z  2024-12-18T00:55:52.0903975Z  2024-12-18T00:55:52.0904350Z  2024-12-18T00:55:52.0904727Z  2024-12-18T00:55:52.0905454Z  2024-12-18T00:55:52.0905836Z  2024-12-18T00:55:52.0906814Z [17,850 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:52.0907973Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:55:52.0908953Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2024-12-18T00:55:52.0909891Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2024-12-18T00:55:52.0910832Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2024-12-18T00:55:52.0911708Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:55:52.0912684Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:55:52.0913658Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2024-12-18T00:55:52.0914463Z Compiling xla/service/while_util.cc; 10s local ... 2024-12-18T00:55:52.3259943Z 2024-12-18T00:55:52.3260808Z  2024-12-18T00:55:52.3261298Z  2024-12-18T00:55:52.3261656Z  2024-12-18T00:55:52.3262381Z  2024-12-18T00:55:52.3262844Z  2024-12-18T00:55:52.3263229Z  2024-12-18T00:55:52.3263639Z  2024-12-18T00:55:52.3264008Z  2024-12-18T00:55:52.3264917Z [17,851 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:52.3265906Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:55:52.3266867Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:55:52.3267902Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2024-12-18T00:55:52.3268843Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:55:52.3269810Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:55:52.3270820Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2024-12-18T00:55:52.3271661Z Compiling xla/service/while_util.cc; 10s local 2024-12-18T00:55:52.3272932Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 10s local ... 2024-12-18T00:55:52.6908015Z 2024-12-18T00:55:52.6908890Z  2024-12-18T00:55:52.6909348Z  2024-12-18T00:55:52.6909725Z  2024-12-18T00:55:52.6910106Z  2024-12-18T00:55:52.6910473Z  2024-12-18T00:55:52.6910859Z  2024-12-18T00:55:52.6911208Z  2024-12-18T00:55:52.6911587Z  2024-12-18T00:55:52.6912493Z [17,851 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:52.6913561Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:55:52.6914530Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:55:52.6915446Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2024-12-18T00:55:52.6916336Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:55:52.6917279Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:55:52.6918192Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2024-12-18T00:55:52.6918966Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:55:52.6919849Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 10s local ... 2024-12-18T00:55:52.9297096Z 2024-12-18T00:55:52.9297971Z  2024-12-18T00:55:52.9298394Z  2024-12-18T00:55:52.9298767Z  2024-12-18T00:55:52.9299137Z  2024-12-18T00:55:52.9299503Z  2024-12-18T00:55:52.9299893Z  2024-12-18T00:55:52.9300258Z  2024-12-18T00:55:52.9300711Z  2024-12-18T00:55:52.9301495Z [17,854 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:52.9302399Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:55:52.9303209Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2024-12-18T00:55:52.9304284Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2024-12-18T00:55:52.9305102Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:55:52.9305933Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:55:52.9306841Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2024-12-18T00:55:52.9307673Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:55:52.9308761Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 10s local ... 2024-12-18T00:55:53.2512164Z 2024-12-18T00:55:53.2512995Z  2024-12-18T00:55:53.2513483Z  2024-12-18T00:55:53.2513868Z  2024-12-18T00:55:53.2514265Z  2024-12-18T00:55:53.2514633Z  2024-12-18T00:55:53.2515017Z  2024-12-18T00:55:53.2515381Z  2024-12-18T00:55:53.2515725Z  2024-12-18T00:55:53.2516615Z [17,857 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:53.2517693Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:55:53.2519003Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:55:53.2519952Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2024-12-18T00:55:53.2520790Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:55:53.2521698Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:55:53.2522694Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local 2024-12-18T00:55:53.2523508Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:55:53.2524419Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 11s local ... 2024-12-18T00:55:53.4914050Z 2024-12-18T00:55:53.4914928Z  2024-12-18T00:55:53.4915406Z  2024-12-18T00:55:53.4915816Z  2024-12-18T00:55:53.4916171Z  2024-12-18T00:55:53.4916528Z  2024-12-18T00:55:53.4916945Z  2024-12-18T00:55:53.4917322Z  2024-12-18T00:55:53.4917744Z  2024-12-18T00:55:53.4918979Z [17,857 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:53.4920221Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:55:53.4921190Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:55:53.4922163Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2024-12-18T00:55:53.4923059Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:55:53.4924037Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local 2024-12-18T00:55:53.4925045Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local 2024-12-18T00:55:53.4925806Z Compiling xla/service/while_util.cc; 11s local 2024-12-18T00:55:53.4926740Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 11s local ... 2024-12-18T00:55:54.1502459Z 2024-12-18T00:55:54.1503317Z  2024-12-18T00:55:54.1503860Z  2024-12-18T00:55:54.1504252Z  2024-12-18T00:55:54.1504660Z  2024-12-18T00:55:54.1505003Z  2024-12-18T00:55:54.1505374Z  2024-12-18T00:55:54.1505733Z  2024-12-18T00:55:54.1506106Z  2024-12-18T00:55:54.1506982Z [17,858 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:54.1507992Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:55:54.1508922Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2024-12-18T00:55:54.1509757Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2024-12-18T00:55:54.1510629Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:55:54.1511586Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local 2024-12-18T00:55:54.1512565Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2024-12-18T00:55:54.1513317Z Compiling xla/service/while_util.cc; 12s local 2024-12-18T00:55:54.1514529Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local ... 2024-12-18T00:55:54.4922162Z 2024-12-18T00:55:54.4923023Z  2024-12-18T00:55:54.4923455Z  2024-12-18T00:55:54.4923819Z  2024-12-18T00:55:54.4924172Z  2024-12-18T00:55:54.4924525Z  2024-12-18T00:55:54.4924863Z  2024-12-18T00:55:54.4925218Z  2024-12-18T00:55:54.4925568Z  2024-12-18T00:55:54.4926357Z [17,859 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:54.4927348Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:55:54.4928236Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:55:54.4929098Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2024-12-18T00:55:54.4929895Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:55:54.4930737Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 15s local 2024-12-18T00:55:54.4931917Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2024-12-18T00:55:54.4932715Z Compiling xla/service/while_util.cc; 12s local 2024-12-18T00:55:54.4933569Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local ... 2024-12-18T00:55:54.6925465Z 2024-12-18T00:55:54.6926271Z  2024-12-18T00:55:54.6926693Z  2024-12-18T00:55:54.6927059Z  2024-12-18T00:55:54.6927407Z  2024-12-18T00:55:54.6927734Z  2024-12-18T00:55:54.6928087Z  2024-12-18T00:55:54.6928437Z  2024-12-18T00:55:54.6928782Z  2024-12-18T00:55:54.6929574Z [17,860 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:54.6930569Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:55:54.6931456Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:55:54.6932314Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2024-12-18T00:55:54.6933519Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:55:54.6934298Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2024-12-18T00:55:54.6934979Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:55:54.6935721Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local 2024-12-18T00:55:54.6936692Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local ... 2024-12-18T00:55:55.0000455Z 2024-12-18T00:55:55.0001247Z  2024-12-18T00:55:55.0001670Z  2024-12-18T00:55:55.0002043Z  2024-12-18T00:55:55.0002387Z  2024-12-18T00:55:55.0002728Z  2024-12-18T00:55:55.0003057Z  2024-12-18T00:55:55.0003395Z  2024-12-18T00:55:55.0003724Z  2024-12-18T00:55:55.0004552Z [17,864 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:55.0005552Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:55:55.0006517Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2024-12-18T00:55:55.0007361Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2024-12-18T00:55:55.0008197Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:55:55.0008982Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:55.0009706Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:55:55.0010497Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local 2024-12-18T00:55:55.0011347Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local ... 2024-12-18T00:55:55.2752771Z 2024-12-18T00:55:55.2753612Z  2024-12-18T00:55:55.2754003Z  2024-12-18T00:55:55.2754322Z  2024-12-18T00:55:55.2754630Z  2024-12-18T00:55:55.2754924Z  2024-12-18T00:55:55.2755223Z  2024-12-18T00:55:55.2755528Z  2024-12-18T00:55:55.2756131Z  2024-12-18T00:55:55.2756884Z [17,865 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:55.2757731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:55:55.2758493Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:55.2759203Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2024-12-18T00:55:55.2759880Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:55:55.2760564Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:55.2761176Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:55:55.2761863Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local 2024-12-18T00:55:55.2762612Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local ... 2024-12-18T00:55:55.4931793Z 2024-12-18T00:55:55.4932647Z  2024-12-18T00:55:55.4933073Z  2024-12-18T00:55:55.4933460Z  2024-12-18T00:55:55.4933791Z  2024-12-18T00:55:55.4934141Z  2024-12-18T00:55:55.4934771Z  2024-12-18T00:55:55.4935127Z  2024-12-18T00:55:55.4935451Z  2024-12-18T00:55:55.4936298Z [17,865 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:55.4937436Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:55:55.4938319Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:55.4939159Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2024-12-18T00:55:55.4939956Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:55:55.4940724Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:55.4941433Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:55:55.4942223Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local 2024-12-18T00:55:55.4943071Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local ... 2024-12-18T00:55:55.6936749Z 2024-12-18T00:55:55.6937879Z  2024-12-18T00:55:55.6938437Z  2024-12-18T00:55:55.6938893Z  2024-12-18T00:55:55.6939276Z  2024-12-18T00:55:55.6939645Z  2024-12-18T00:55:55.6940020Z  2024-12-18T00:55:55.6940399Z  2024-12-18T00:55:55.6940778Z  2024-12-18T00:55:55.6941704Z [17,866 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:55.6942862Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:55:55.6943902Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:55.6945092Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2024-12-18T00:55:55.6945996Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:55:55.6946882Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:55.6947772Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:55:55.6948715Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local 2024-12-18T00:55:55.6949738Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local ... 2024-12-18T00:55:55.9575110Z 2024-12-18T00:55:55.9575992Z  2024-12-18T00:55:55.9576578Z  2024-12-18T00:55:55.9576976Z  2024-12-18T00:55:55.9577334Z  2024-12-18T00:55:55.9577711Z  2024-12-18T00:55:55.9578097Z  2024-12-18T00:55:55.9578490Z  2024-12-18T00:55:55.9578839Z  2024-12-18T00:55:55.9579755Z [17,868 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:55.9580838Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:55:55.9581844Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:55.9582841Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2024-12-18T00:55:55.9584065Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:55:55.9584966Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2024-12-18T00:55:55.9585818Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:55:55.9586672Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local 2024-12-18T00:55:55.9587705Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local ... 2024-12-18T00:55:56.2286232Z 2024-12-18T00:55:56.2287068Z  2024-12-18T00:55:56.2287551Z  2024-12-18T00:55:56.2287952Z  2024-12-18T00:55:56.2288351Z  2024-12-18T00:55:56.2288770Z  2024-12-18T00:55:56.2289152Z  2024-12-18T00:55:56.2289561Z  2024-12-18T00:55:56.2289952Z  2024-12-18T00:55:56.2290901Z [17,869 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:56.2292168Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:55:56.2293252Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2024-12-18T00:55:56.2294495Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:55:56.2295415Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:55:56.2296322Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:56.2297455Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:55:56.2298333Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:55:56.2299279Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local ... 2024-12-18T00:55:56.4943184Z 2024-12-18T00:55:56.4944071Z  2024-12-18T00:55:56.4944865Z  2024-12-18T00:55:56.4945394Z  2024-12-18T00:55:56.4945800Z  2024-12-18T00:55:56.4946192Z  2024-12-18T00:55:56.4946584Z  2024-12-18T00:55:56.4946973Z  2024-12-18T00:55:56.4947332Z  2024-12-18T00:55:56.4948228Z [17,872 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:56.4949818Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:55:56.4950851Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:55:56.4951641Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:55:56.4952544Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:55:56.4953482Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:56.4954365Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:55:56.4955317Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:55:56.4956315Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local ... 2024-12-18T00:55:56.7026393Z 2024-12-18T00:55:56.7027262Z  2024-12-18T00:55:56.7027724Z  2024-12-18T00:55:56.7028113Z  2024-12-18T00:55:56.7028490Z  2024-12-18T00:55:56.7028913Z  2024-12-18T00:55:56.7029297Z  2024-12-18T00:55:56.7029696Z  2024-12-18T00:55:56.7030101Z  2024-12-18T00:55:56.7031056Z [17,876 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:56.7032204Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:55:56.7033279Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:55:56.7034303Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:55:56.7035270Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:55:56.7036197Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:56.7036993Z Compiling xla/service/while_util.cc; 15s local 2024-12-18T00:55:56.7037900Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:55:56.7038895Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local ... 2024-12-18T00:55:56.9050916Z 2024-12-18T00:55:56.9051827Z  2024-12-18T00:55:56.9052405Z  2024-12-18T00:55:56.9052804Z  2024-12-18T00:55:56.9053218Z  2024-12-18T00:55:56.9053639Z  2024-12-18T00:55:56.9054036Z  2024-12-18T00:55:56.9054442Z  2024-12-18T00:55:56.9054824Z  2024-12-18T00:55:56.9055789Z [17,877 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:56.9057076Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:55:56.9058175Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:55:56.9059174Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:55:56.9060086Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:55:56.9060966Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2024-12-18T00:55:56.9061778Z Compiling xla/service/while_util.cc; 15s local 2024-12-18T00:55:56.9062686Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:55:56.9063942Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local ... 2024-12-18T00:55:57.1107924Z 2024-12-18T00:55:57.1108838Z  2024-12-18T00:55:57.1109286Z  2024-12-18T00:55:57.1109711Z  2024-12-18T00:55:57.1110117Z  2024-12-18T00:55:57.1110501Z  2024-12-18T00:55:57.1110900Z  2024-12-18T00:55:57.1111282Z  2024-12-18T00:55:57.1111669Z  2024-12-18T00:55:57.1112586Z [17,880 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:57.1113738Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:55:57.1114797Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2024-12-18T00:55:57.1115960Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:55:57.1116931Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T00:55:57.1118167Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2024-12-18T00:55:57.1119353Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:55:57.1120396Z Compiling xla/service/instruction_fusion.cc; 12s local 2024-12-18T00:55:57.1121432Z Compiling llvm/lib/ExecutionEngine/Orc/OrcV2CBindings.cpp; 10s local ... 2024-12-18T00:55:57.4951477Z 2024-12-18T00:55:57.4952355Z  2024-12-18T00:55:57.4964746Z  2024-12-18T00:55:57.4965186Z  2024-12-18T00:55:57.4965587Z  2024-12-18T00:55:57.4965999Z  2024-12-18T00:55:57.4966412Z  2024-12-18T00:55:57.4966798Z  2024-12-18T00:55:57.4967215Z  2024-12-18T00:55:57.4968157Z [17,880 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:57.4969287Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:55:57.4970318Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:55:57.4971343Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:55:57.4972249Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T00:55:57.4973146Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2024-12-18T00:55:57.4974171Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:55:57.4975157Z Compiling xla/service/instruction_fusion.cc; 12s local 2024-12-18T00:55:57.4976150Z Compiling llvm/lib/ExecutionEngine/Orc/OrcV2CBindings.cpp; 10s local ... 2024-12-18T00:55:57.6955180Z 2024-12-18T00:55:57.6956018Z  2024-12-18T00:55:57.6956501Z  2024-12-18T00:55:57.6956897Z  2024-12-18T00:55:57.6957295Z  2024-12-18T00:55:57.6957689Z  2024-12-18T00:55:57.6958045Z  2024-12-18T00:55:57.6958431Z  2024-12-18T00:55:57.6958832Z  2024-12-18T00:55:57.6959878Z [17,882 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:57.6961323Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:55:57.6962340Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:55:57.6963466Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:55:57.6964417Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T00:55:57.6965346Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2024-12-18T00:55:57.6966441Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:55:57.6967428Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:55:57.6968491Z Compiling llvm/lib/ExecutionEngine/Orc/OrcV2CBindings.cpp; 10s local ... 2024-12-18T00:55:58.0955933Z 2024-12-18T00:55:58.0956840Z  2024-12-18T00:55:58.0957347Z  2024-12-18T00:55:58.0957737Z  2024-12-18T00:55:58.0958124Z  2024-12-18T00:55:58.0958539Z  2024-12-18T00:55:58.0959034Z  2024-12-18T00:55:58.0959423Z  2024-12-18T00:55:58.0960086Z  2024-12-18T00:55:58.0961063Z [17,885 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:58.0962203Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:55:58.0963206Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2024-12-18T00:55:58.0964203Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:55:58.0965137Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:55:58.0966046Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2024-12-18T00:55:58.0967086Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:55:58.0968029Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:55:58.0969041Z Compiling llvm/lib/ExecutionEngine/Orc/OrcV2CBindings.cpp; 11s local ... 2024-12-18T00:55:58.2961325Z 2024-12-18T00:55:58.2962176Z  2024-12-18T00:55:58.2963029Z  2024-12-18T00:55:58.2963423Z  2024-12-18T00:55:58.2963821Z  2024-12-18T00:55:58.2964206Z  2024-12-18T00:55:58.2964615Z  2024-12-18T00:55:58.2965008Z  2024-12-18T00:55:58.2965434Z  2024-12-18T00:55:58.2966448Z [17,887 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:58.2967649Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:55:58.2968750Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:55:58.2969806Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:55:58.2970793Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:55:58.2971708Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2024-12-18T00:55:58.2972746Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2024-12-18T00:55:58.2973768Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:55:58.2974811Z Compiling llvm/lib/ExecutionEngine/Orc/OrcV2CBindings.cpp; 11s local ... 2024-12-18T00:55:58.5018147Z 2024-12-18T00:55:58.5019001Z  2024-12-18T00:55:58.5019472Z  2024-12-18T00:55:58.5019874Z  2024-12-18T00:55:58.5020277Z  2024-12-18T00:55:58.5020686Z  2024-12-18T00:55:58.5021076Z  2024-12-18T00:55:58.5021490Z  2024-12-18T00:55:58.5021899Z  2024-12-18T00:55:58.5022853Z [17,888 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:58.5023982Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:55:58.5024957Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:55:58.5025909Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:55:58.5026757Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:55:58.5028066Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2024-12-18T00:55:58.5029018Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2024-12-18T00:55:58.5029877Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:55:58.5030794Z Compiling llvm/lib/ExecutionEngine/Orc/OrcV2CBindings.cpp; 11s local ... 2024-12-18T00:55:58.8952678Z 2024-12-18T00:55:58.8953538Z  2024-12-18T00:55:58.8954071Z  2024-12-18T00:55:58.8954462Z  2024-12-18T00:55:58.8954915Z  2024-12-18T00:55:58.8955383Z  2024-12-18T00:55:58.8955764Z  2024-12-18T00:55:58.8956135Z  2024-12-18T00:55:58.8956529Z  2024-12-18T00:55:58.8957542Z [17,890 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:58.8958629Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:55:58.8959706Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:55:58.8960972Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:55:58.8962048Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T00:55:58.8962999Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2024-12-18T00:55:58.8963939Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:55:58.8964919Z Compiling llvm/lib/ExecutionEngine/Orc/OrcV2CBindings.cpp; 12s local 2024-12-18T00:55:58.8965991Z Compiling xla/service/select_and_scatter_expander.cc; 11s local ... 2024-12-18T00:55:59.0969953Z 2024-12-18T00:55:59.0970829Z  2024-12-18T00:55:59.0971312Z  2024-12-18T00:55:59.0971704Z  2024-12-18T00:55:59.0972135Z  2024-12-18T00:55:59.0972573Z  2024-12-18T00:55:59.0973001Z  2024-12-18T00:55:59.0973384Z  2024-12-18T00:55:59.0973795Z  2024-12-18T00:55:59.0974794Z [17,891 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:59.0976638Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:55:59.0977679Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2024-12-18T00:55:59.0978638Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:55:59.0979554Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T00:55:59.0980464Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2024-12-18T00:55:59.0981353Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:55:59.0982260Z Compiling xla/service/select_and_scatter_expander.cc; 11s local 2024-12-18T00:55:59.0983187Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local ... 2024-12-18T00:55:59.5062833Z 2024-12-18T00:55:59.5063712Z  2024-12-18T00:55:59.5064194Z  2024-12-18T00:55:59.5064602Z  2024-12-18T00:55:59.5064960Z  2024-12-18T00:55:59.5065382Z  2024-12-18T00:55:59.5065751Z  2024-12-18T00:55:59.5066178Z  2024-12-18T00:55:59.5066553Z  2024-12-18T00:55:59.5067409Z [17,892 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:55:59.5068524Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:55:59.5069515Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:55:59.5070509Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:55:59.5071379Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T00:55:59.5072248Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2024-12-18T00:55:59.5073070Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:55:59.5073840Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2024-12-18T00:55:59.5074756Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 11s local ... 2024-12-18T00:55:59.8975408Z 2024-12-18T00:55:59.8976303Z  2024-12-18T00:55:59.8977026Z  2024-12-18T00:55:59.8977456Z  2024-12-18T00:55:59.8977873Z  2024-12-18T00:55:59.8978280Z  2024-12-18T00:55:59.8978816Z  2024-12-18T00:55:59.8979226Z  2024-12-18T00:55:59.8979610Z  2024-12-18T00:55:59.8980585Z [17,894 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:55:59.8981624Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:55:59.8982484Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2024-12-18T00:55:59.8983305Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:55:59.8984235Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T00:55:59.8985094Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2024-12-18T00:55:59.8985949Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:55:59.8987082Z Compiling xla/hlo/builder/lib/matrix.cc; 12s local 2024-12-18T00:55:59.8987931Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 11s local ... 2024-12-18T00:56:00.2768830Z 2024-12-18T00:56:00.2769748Z  2024-12-18T00:56:00.2770256Z  2024-12-18T00:56:00.2770638Z  2024-12-18T00:56:00.2770974Z  2024-12-18T00:56:00.2771334Z  2024-12-18T00:56:00.2771679Z  2024-12-18T00:56:00.2772058Z  2024-12-18T00:56:00.2772411Z  2024-12-18T00:56:00.2773294Z [17,897 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:00.2774377Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:56:00.2775277Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:56:00.2776253Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:00.2777324Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T00:56:00.2778560Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2024-12-18T00:56:00.2779570Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:56:00.2780464Z Compiling xla/service/conditional_simplifier.cc; 11s local 2024-12-18T00:56:00.2781327Z Compiling xla/service/sharding_propagation.cc; 9s local ... 2024-12-18T00:56:00.4982152Z 2024-12-18T00:56:00.4983053Z  2024-12-18T00:56:00.4983532Z  2024-12-18T00:56:00.4983967Z  2024-12-18T00:56:00.4984348Z  2024-12-18T00:56:00.4984709Z  2024-12-18T00:56:00.4985092Z  2024-12-18T00:56:00.4985490Z  2024-12-18T00:56:00.4985882Z  2024-12-18T00:56:00.4986844Z [17,898 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:00.4988131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:56:00.4989204Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:56:00.4990245Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:00.4991136Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T00:56:00.4992075Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2024-12-18T00:56:00.4993015Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:56:00.4993894Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:56:00.4994848Z Compiling xla/service/sharding_propagation.cc; 9s local ... 2024-12-18T00:56:00.6986117Z 2024-12-18T00:56:00.6986970Z  2024-12-18T00:56:00.6987446Z  2024-12-18T00:56:00.6987841Z  2024-12-18T00:56:00.6988225Z  2024-12-18T00:56:00.6988594Z  2024-12-18T00:56:00.6988974Z  2024-12-18T00:56:00.6989352Z  2024-12-18T00:56:00.6989725Z  2024-12-18T00:56:00.6990632Z [17,900 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:00.6992020Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:56:00.6993022Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:56:00.6993963Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:00.6994862Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T00:56:00.6995759Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2024-12-18T00:56:00.6996597Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:56:00.6997433Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:56:00.6998322Z Compiling xla/service/sharding_propagation.cc; 9s local ... 2024-12-18T00:56:01.0990163Z 2024-12-18T00:56:01.0990923Z  2024-12-18T00:56:01.0991336Z  2024-12-18T00:56:01.0991675Z  2024-12-18T00:56:01.0992000Z  2024-12-18T00:56:01.0992332Z  2024-12-18T00:56:01.0992690Z  2024-12-18T00:56:01.0993062Z  2024-12-18T00:56:01.0993383Z  2024-12-18T00:56:01.0994624Z [17,901 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:01.0995549Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:56:01.0996379Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2024-12-18T00:56:01.0997178Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:01.0997926Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T00:56:01.0998650Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2024-12-18T00:56:01.0999387Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:56:01.1000123Z Compiling xla/service/conditional_simplifier.cc; 12s local 2024-12-18T00:56:01.1000906Z Compiling xla/service/sharding_propagation.cc; 10s local ... 2024-12-18T00:56:01.3650778Z 2024-12-18T00:56:01.3651625Z  2024-12-18T00:56:01.3652150Z  2024-12-18T00:56:01.3652525Z  2024-12-18T00:56:01.3653328Z  2024-12-18T00:56:01.3653697Z  2024-12-18T00:56:01.3654070Z  2024-12-18T00:56:01.3654440Z  2024-12-18T00:56:01.3654802Z  2024-12-18T00:56:01.3655679Z [17,902 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:01.3656925Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:56:01.3657873Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:56:01.3658713Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:56:01.3659559Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T00:56:01.3660287Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2024-12-18T00:56:01.3661171Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:56:01.3661973Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:56:01.3662904Z Compiling xla/service/sharding_propagation.cc; 10s local ... 2024-12-18T00:56:01.5794730Z 2024-12-18T00:56:01.5795597Z  2024-12-18T00:56:01.5796050Z  2024-12-18T00:56:01.5796440Z  2024-12-18T00:56:01.5796815Z  2024-12-18T00:56:01.5797199Z  2024-12-18T00:56:01.5797588Z  2024-12-18T00:56:01.5797962Z  2024-12-18T00:56:01.5798333Z  2024-12-18T00:56:01.5799267Z [17,903 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:01.5800365Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:56:01.5801379Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:56:01.5802366Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:56:01.5803251Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T00:56:01.5804131Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2024-12-18T00:56:01.5805432Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:01.5806313Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:56:01.5807237Z Compiling xla/service/sharding_propagation.cc; 10s local ... 2024-12-18T00:56:01.7821728Z 2024-12-18T00:56:01.7822659Z  2024-12-18T00:56:01.7823159Z  2024-12-18T00:56:01.7823576Z  2024-12-18T00:56:01.7823963Z  2024-12-18T00:56:01.7824348Z  2024-12-18T00:56:01.7824771Z  2024-12-18T00:56:01.7825288Z  2024-12-18T00:56:01.7825632Z  2024-12-18T00:56:01.7826456Z [17,905 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:01.7827301Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:56:01.7828107Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:56:01.7829030Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:56:01.7830326Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T00:56:01.7831283Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2024-12-18T00:56:01.7832126Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:01.7833010Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:56:01.7833950Z Compiling xla/service/sharding_propagation.cc; 10s local ... 2024-12-18T00:56:02.0998881Z 2024-12-18T00:56:02.0999738Z  2024-12-18T00:56:02.1000214Z  2024-12-18T00:56:02.1000579Z  2024-12-18T00:56:02.1000957Z  2024-12-18T00:56:02.1001304Z  2024-12-18T00:56:02.1001685Z  2024-12-18T00:56:02.1002048Z  2024-12-18T00:56:02.1002425Z  2024-12-18T00:56:02.1003331Z [17,905 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:02.1004405Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:56:02.1005660Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2024-12-18T00:56:02.1006732Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:56:02.1007635Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T00:56:02.1008491Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2024-12-18T00:56:02.1009322Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:02.1010141Z Compiling xla/service/conditional_simplifier.cc; 13s local 2024-12-18T00:56:02.1010954Z Compiling xla/service/sharding_propagation.cc; 11s local ... 2024-12-18T00:56:02.5003616Z 2024-12-18T00:56:02.5004470Z  2024-12-18T00:56:02.5004934Z  2024-12-18T00:56:02.5005317Z  2024-12-18T00:56:02.5005695Z  2024-12-18T00:56:02.5006072Z  2024-12-18T00:56:02.5006463Z  2024-12-18T00:56:02.5006835Z  2024-12-18T00:56:02.5007182Z  2024-12-18T00:56:02.5008161Z [17,907 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:02.5009279Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:56:02.5010273Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:56:02.5011191Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:56:02.5012105Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T00:56:02.5012978Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2024-12-18T00:56:02.5013862Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:02.5014754Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:56:02.5015661Z Compiling xla/service/sharding_propagation.cc; 11s local ... 2024-12-18T00:56:02.9007867Z 2024-12-18T00:56:02.9008703Z  2024-12-18T00:56:02.9009133Z  2024-12-18T00:56:02.9009726Z  2024-12-18T00:56:02.9010088Z  2024-12-18T00:56:02.9010448Z  2024-12-18T00:56:02.9010836Z  2024-12-18T00:56:02.9011178Z  2024-12-18T00:56:02.9011537Z  2024-12-18T00:56:02.9012392Z [17,908 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:02.9013465Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:56:02.9014475Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2024-12-18T00:56:02.9015495Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:56:02.9016277Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T00:56:02.9017238Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2024-12-18T00:56:02.9018006Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:56:02.9018745Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:56:02.9019601Z Compiling xla/service/sharding_propagation.cc; 12s local ... 2024-12-18T00:56:03.2647818Z 2024-12-18T00:56:03.2648743Z  2024-12-18T00:56:03.2649204Z  2024-12-18T00:56:03.2649597Z  2024-12-18T00:56:03.2649965Z  2024-12-18T00:56:03.2650328Z  2024-12-18T00:56:03.2650696Z  2024-12-18T00:56:03.2651064Z  2024-12-18T00:56:03.2651446Z  2024-12-18T00:56:03.2652325Z [17,909 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:03.2653418Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:56:03.2654322Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:56:03.2655222Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:03.2656120Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T00:56:03.2657114Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2024-12-18T00:56:03.2657965Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:56:03.2659140Z Compiling xla/service/conditional_simplifier.cc; 14s local 2024-12-18T00:56:03.2659999Z Compiling xla/service/sharding_propagation.cc; 12s local ... 2024-12-18T00:56:03.5013654Z 2024-12-18T00:56:03.5014517Z  2024-12-18T00:56:03.5015012Z  2024-12-18T00:56:03.5015406Z  2024-12-18T00:56:03.5015778Z  2024-12-18T00:56:03.5016186Z  2024-12-18T00:56:03.5016834Z  2024-12-18T00:56:03.5017229Z  2024-12-18T00:56:03.5017616Z  2024-12-18T00:56:03.5018574Z [17,909 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:03.5019677Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:56:03.5020718Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:56:03.5021642Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:03.5022584Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T00:56:03.5023523Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2024-12-18T00:56:03.5024407Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:56:03.5025283Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:56:03.5026178Z Compiling xla/service/sharding_propagation.cc; 12s local ... 2024-12-18T00:56:03.8092380Z 2024-12-18T00:56:03.8093211Z  2024-12-18T00:56:03.8093685Z  2024-12-18T00:56:03.8094072Z  2024-12-18T00:56:03.8094451Z  2024-12-18T00:56:03.8094865Z  2024-12-18T00:56:03.8095264Z  2024-12-18T00:56:03.8095657Z  2024-12-18T00:56:03.8096010Z  2024-12-18T00:56:03.8097266Z [17,912 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:03.8098419Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:56:03.8099723Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:56:03.8100709Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:03.8101599Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T00:56:03.8102485Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2024-12-18T00:56:03.8103363Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:56:03.8104227Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:56:03.8105231Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 12s local ... 2024-12-18T00:56:04.0983151Z 2024-12-18T00:56:04.0984020Z  2024-12-18T00:56:04.0984470Z  2024-12-18T00:56:04.0984886Z  2024-12-18T00:56:04.0985282Z  2024-12-18T00:56:04.0985692Z  2024-12-18T00:56:04.0986094Z  2024-12-18T00:56:04.0986485Z  2024-12-18T00:56:04.0986866Z  2024-12-18T00:56:04.0988126Z [17,917 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:04.0989360Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:56:04.0990427Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2024-12-18T00:56:04.0991435Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:04.0992391Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:56:04.0993334Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:56:04.0994289Z Compiling xla/service/conditional_simplifier.cc; 15s local 2024-12-18T00:56:04.0995224Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:56:04.0996244Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 12s local ... 2024-12-18T00:56:04.3021286Z 2024-12-18T00:56:04.3022124Z  2024-12-18T00:56:04.3022598Z  2024-12-18T00:56:04.3022992Z  2024-12-18T00:56:04.3023425Z  2024-12-18T00:56:04.3023830Z  2024-12-18T00:56:04.3024679Z  2024-12-18T00:56:04.3025086Z  2024-12-18T00:56:04.3025472Z  2024-12-18T00:56:04.3026452Z [17,918 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:04.3027621Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:56:04.3028670Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:56:04.3029673Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:56:04.3030598Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:56:04.3031479Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:56:04.3032399Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:56:04.3033387Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 13s local 2024-12-18T00:56:04.3034638Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local ... 2024-12-18T00:56:04.5024958Z 2024-12-18T00:56:04.5025880Z  2024-12-18T00:56:04.5026364Z  2024-12-18T00:56:04.5026743Z  2024-12-18T00:56:04.5027139Z  2024-12-18T00:56:04.5027532Z  2024-12-18T00:56:04.5027945Z  2024-12-18T00:56:04.5028329Z  2024-12-18T00:56:04.5028718Z  2024-12-18T00:56:04.5029668Z [17,919 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:04.5030814Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:56:04.5031848Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:56:04.5032946Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:56:04.5033865Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:56:04.5034774Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:56:04.5036030Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:56:04.5037046Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 13s local 2024-12-18T00:56:04.5038186Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local ... 2024-12-18T00:56:04.9329082Z 2024-12-18T00:56:04.9329945Z  2024-12-18T00:56:04.9330411Z  2024-12-18T00:56:04.9330757Z  2024-12-18T00:56:04.9331136Z  2024-12-18T00:56:04.9331495Z  2024-12-18T00:56:04.9331887Z  2024-12-18T00:56:04.9332273Z  2024-12-18T00:56:04.9332604Z  2024-12-18T00:56:04.9333416Z [17,920 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:04.9334498Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:56:04.9335466Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:56:04.9336566Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:56:04.9337816Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T00:56:04.9338739Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2024-12-18T00:56:04.9339619Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:56:04.9340618Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 13s local 2024-12-18T00:56:04.9341783Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local ... 2024-12-18T00:56:05.2463752Z 2024-12-18T00:56:05.2464587Z  2024-12-18T00:56:05.2465041Z  2024-12-18T00:56:05.2465445Z  2024-12-18T00:56:05.2465850Z  2024-12-18T00:56:05.2466256Z  2024-12-18T00:56:05.2466648Z  2024-12-18T00:56:05.2467161Z  2024-12-18T00:56:05.2467550Z  2024-12-18T00:56:05.2468487Z [17,921 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:05.2469614Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:56:05.2470990Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2024-12-18T00:56:05.2472070Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:56:05.2472968Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T00:56:05.2473899Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:56:05.2474761Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:56:05.2475740Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local 2024-12-18T00:56:05.2476908Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local ... 2024-12-18T00:56:05.5032273Z 2024-12-18T00:56:05.5033185Z  2024-12-18T00:56:05.5033636Z  2024-12-18T00:56:05.5034036Z  2024-12-18T00:56:05.5034445Z  2024-12-18T00:56:05.5034853Z  2024-12-18T00:56:05.5035236Z  2024-12-18T00:56:05.5035637Z  2024-12-18T00:56:05.5036062Z  2024-12-18T00:56:05.5037067Z [17,921 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:05.5038194Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:56:05.5039241Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:56:05.5040187Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:56:05.5041128Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T00:56:05.5042059Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:56:05.5042979Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:56:05.5044042Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local 2024-12-18T00:56:05.5045481Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local ... 2024-12-18T00:56:05.9037895Z 2024-12-18T00:56:05.9038782Z  2024-12-18T00:56:05.9039580Z  2024-12-18T00:56:05.9039997Z  2024-12-18T00:56:05.9040386Z  2024-12-18T00:56:05.9040828Z  2024-12-18T00:56:05.9041200Z  2024-12-18T00:56:05.9041562Z  2024-12-18T00:56:05.9041970Z  2024-12-18T00:56:05.9042886Z [17,925 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:05.9044034Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:56:05.9045325Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:56:05.9046329Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:56:05.9047274Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T00:56:05.9048136Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2024-12-18T00:56:05.9049015Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:05.9050097Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local 2024-12-18T00:56:05.9051513Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local ... 2024-12-18T00:56:06.2250830Z 2024-12-18T00:56:06.2251741Z  2024-12-18T00:56:06.2252234Z  2024-12-18T00:56:06.2252591Z  2024-12-18T00:56:06.2252968Z  2024-12-18T00:56:06.2253355Z  2024-12-18T00:56:06.2253753Z  2024-12-18T00:56:06.2254098Z  2024-12-18T00:56:06.2254498Z  2024-12-18T00:56:06.2255440Z [17,927 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:06.2256771Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:56:06.2257746Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2024-12-18T00:56:06.2258687Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:06.2259536Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T00:56:06.2260419Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:56:06.2261658Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:06.2262723Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:56:06.2263815Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local ... 2024-12-18T00:56:06.5042544Z 2024-12-18T00:56:06.5043425Z  2024-12-18T00:56:06.5043904Z  2024-12-18T00:56:06.5044579Z  2024-12-18T00:56:06.5045009Z  2024-12-18T00:56:06.5045541Z  2024-12-18T00:56:06.5045915Z  2024-12-18T00:56:06.5046314Z  2024-12-18T00:56:06.5046715Z  2024-12-18T00:56:06.5047653Z [17,928 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:06.5048732Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:56:06.5049741Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:56:06.5050690Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:06.5051595Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T00:56:06.5052484Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:56:06.5053382Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:06.5054319Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:56:06.5055402Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local ... 2024-12-18T00:56:06.7375906Z 2024-12-18T00:56:06.7376842Z  2024-12-18T00:56:06.7377278Z  2024-12-18T00:56:06.7377624Z  2024-12-18T00:56:06.7377948Z  2024-12-18T00:56:06.7378286Z  2024-12-18T00:56:06.7378614Z  2024-12-18T00:56:06.7378949Z  2024-12-18T00:56:06.7379278Z  2024-12-18T00:56:06.7380058Z [17,930 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:06.7381261Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:56:06.7382123Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:56:06.7382933Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:06.7383681Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T00:56:06.7384428Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2024-12-18T00:56:06.7385165Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:06.7385966Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:56:06.7386814Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 10s local ... 2024-12-18T00:56:07.0444577Z 2024-12-18T00:56:07.0445447Z  2024-12-18T00:56:07.0445914Z  2024-12-18T00:56:07.0446306Z  2024-12-18T00:56:07.0446718Z  2024-12-18T00:56:07.0447121Z  2024-12-18T00:56:07.0447517Z  2024-12-18T00:56:07.0447962Z  2024-12-18T00:56:07.0448337Z  2024-12-18T00:56:07.0449558Z [17,932 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:07.0450426Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:56:07.0451483Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2024-12-18T00:56:07.0452516Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:07.0453362Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T00:56:07.0454059Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:56:07.0454820Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:56:07.0455893Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2024-12-18T00:56:07.0457122Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 10s local ... 2024-12-18T00:56:07.3049435Z 2024-12-18T00:56:07.3050306Z  2024-12-18T00:56:07.3050785Z  2024-12-18T00:56:07.3051502Z  2024-12-18T00:56:07.3051907Z  2024-12-18T00:56:07.3052294Z  2024-12-18T00:56:07.3052681Z  2024-12-18T00:56:07.3053077Z  2024-12-18T00:56:07.3053482Z  2024-12-18T00:56:07.3054430Z [17,932 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:07.3055683Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:56:07.3056833Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:56:07.3057783Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:56:07.3058684Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T00:56:07.3059578Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:56:07.3060439Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:56:07.3061412Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2024-12-18T00:56:07.3062475Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 10s local ... 2024-12-18T00:56:07.9046175Z 2024-12-18T00:56:07.9047020Z  2024-12-18T00:56:07.9047506Z  2024-12-18T00:56:07.9047904Z  2024-12-18T00:56:07.9048317Z  2024-12-18T00:56:07.9048718Z  2024-12-18T00:56:07.9049097Z  2024-12-18T00:56:07.9049502Z  2024-12-18T00:56:07.9049898Z  2024-12-18T00:56:07.9050837Z [17,933 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:07.9051993Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:56:07.9053057Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:56:07.9054034Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:56:07.9054802Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T00:56:07.9055886Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2024-12-18T00:56:07.9057116Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:07.9058064Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2024-12-18T00:56:07.9059250Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local ... 2024-12-18T00:56:08.1057141Z 2024-12-18T00:56:08.1058043Z  2024-12-18T00:56:08.1058520Z  2024-12-18T00:56:08.1058919Z  2024-12-18T00:56:08.1059304Z  2024-12-18T00:56:08.1059710Z  2024-12-18T00:56:08.1060098Z  2024-12-18T00:56:08.1060467Z  2024-12-18T00:56:08.1060817Z  2024-12-18T00:56:08.1061669Z [17,934 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:08.1062766Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:56:08.1063706Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2024-12-18T00:56:08.1065074Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:56:08.1066084Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:08.1067089Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:08.1068175Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2024-12-18T00:56:08.1069188Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2024-12-18T00:56:08.1070175Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 11s local ... 2024-12-18T00:56:08.3628306Z 2024-12-18T00:56:08.3629274Z  2024-12-18T00:56:08.3629762Z  2024-12-18T00:56:08.3630178Z  2024-12-18T00:56:08.3630581Z  2024-12-18T00:56:08.3630966Z  2024-12-18T00:56:08.3631369Z  2024-12-18T00:56:08.3631765Z  2024-12-18T00:56:08.3632120Z  2024-12-18T00:56:08.3633032Z [17,938 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:08.3634483Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:56:08.3635645Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:56:08.3636632Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:56:08.3637514Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:08.3638386Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:08.3639414Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2024-12-18T00:56:08.3640463Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2024-12-18T00:56:08.3641546Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 11s local ... 2024-12-18T00:56:08.7064457Z 2024-12-18T00:56:08.7065350Z  2024-12-18T00:56:08.7065813Z  2024-12-18T00:56:08.7066178Z  2024-12-18T00:56:08.7066569Z  2024-12-18T00:56:08.7066951Z  2024-12-18T00:56:08.7067366Z  2024-12-18T00:56:08.7067721Z  2024-12-18T00:56:08.7068133Z  2024-12-18T00:56:08.7069079Z [17,940 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:08.7070198Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:56:08.7071225Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:56:08.7072147Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:56:08.7073010Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:08.7073868Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:08.7074843Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2024-12-18T00:56:08.7075866Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2024-12-18T00:56:08.7076864Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 11s local ... 2024-12-18T00:56:08.9213122Z 2024-12-18T00:56:08.9213943Z  2024-12-18T00:56:08.9214394Z  2024-12-18T00:56:08.9214740Z  2024-12-18T00:56:08.9215076Z  2024-12-18T00:56:08.9215423Z  2024-12-18T00:56:08.9215776Z  2024-12-18T00:56:08.9216102Z  2024-12-18T00:56:08.9216597Z  2024-12-18T00:56:08.9217397Z [17,943 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:08.9218351Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:56:08.9219240Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2024-12-18T00:56:08.9220118Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:56:08.9220968Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2024-12-18T00:56:08.9221763Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:08.9222597Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2024-12-18T00:56:08.9223746Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2024-12-18T00:56:08.9224635Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 11s local ... 2024-12-18T00:56:09.2969777Z 2024-12-18T00:56:09.2970531Z  2024-12-18T00:56:09.2970955Z  2024-12-18T00:56:09.2971301Z  2024-12-18T00:56:09.2971634Z  2024-12-18T00:56:09.2971983Z  2024-12-18T00:56:09.2972323Z  2024-12-18T00:56:09.2972667Z  2024-12-18T00:56:09.2972988Z  2024-12-18T00:56:09.2973789Z [17,946 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:09.2974737Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:56:09.2975603Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:56:09.2976668Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:56:09.2977447Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:09.2978554Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2024-12-18T00:56:09.2979524Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2024-12-18T00:56:09.2980366Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 12s local 2024-12-18T00:56:09.2981323Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local ... 2024-12-18T00:56:09.5070220Z 2024-12-18T00:56:09.5071065Z  2024-12-18T00:56:09.5071459Z  2024-12-18T00:56:09.5071765Z  2024-12-18T00:56:09.5072079Z  2024-12-18T00:56:09.5072395Z  2024-12-18T00:56:09.5072707Z  2024-12-18T00:56:09.5072997Z  2024-12-18T00:56:09.5073302Z  2024-12-18T00:56:09.5074031Z [17,947 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:09.5074911Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:56:09.5075721Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:56:09.5076504Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:56:09.5077184Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:09.5077944Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2024-12-18T00:56:09.5078729Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2024-12-18T00:56:09.5079485Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 12s local 2024-12-18T00:56:09.5080332Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local ... 2024-12-18T00:56:09.7073975Z 2024-12-18T00:56:09.7074823Z  2024-12-18T00:56:09.7075312Z  2024-12-18T00:56:09.7075688Z  2024-12-18T00:56:09.7076178Z  2024-12-18T00:56:09.7076543Z  2024-12-18T00:56:09.7076917Z  2024-12-18T00:56:09.7077288Z  2024-12-18T00:56:09.7077670Z  2024-12-18T00:56:09.7078926Z [17,948 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:09.7080075Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:56:09.7081078Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:56:09.7082093Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2024-12-18T00:56:09.7082970Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:09.7083866Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2024-12-18T00:56:09.7084797Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2024-12-18T00:56:09.7085836Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 12s local 2024-12-18T00:56:09.7086859Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local ... 2024-12-18T00:56:10.0309474Z 2024-12-18T00:56:10.0310318Z  2024-12-18T00:56:10.0310748Z  2024-12-18T00:56:10.0311127Z  2024-12-18T00:56:10.0311462Z  2024-12-18T00:56:10.0312045Z  2024-12-18T00:56:10.0312387Z  2024-12-18T00:56:10.0312731Z  2024-12-18T00:56:10.0313042Z  2024-12-18T00:56:10.0313845Z [17,949 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:10.0314777Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:56:10.0315625Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2024-12-18T00:56:10.0316469Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:56:10.0317231Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:56:10.0318076Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2024-12-18T00:56:10.0318934Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:56:10.0319794Z Compiling llvm/lib/ExecutionEngine/Orc/COFFPlatform.cpp; 12s local 2024-12-18T00:56:10.0320961Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local ... 2024-12-18T00:56:10.3079240Z 2024-12-18T00:56:10.3080059Z  2024-12-18T00:56:10.3080529Z  2024-12-18T00:56:10.3080915Z  2024-12-18T00:56:10.3081295Z  2024-12-18T00:56:10.3081671Z  2024-12-18T00:56:10.3082084Z  2024-12-18T00:56:10.3082500Z  2024-12-18T00:56:10.3082865Z  2024-12-18T00:56:10.3083818Z [17,951 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:10.3084897Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:10.3085906Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:56:10.3086889Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:56:10.3087824Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:56:10.3088782Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:56:10.3089863Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:56:10.3090882Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2024-12-18T00:56:10.3091886Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 11s local ... 2024-12-18T00:56:10.5082370Z 2024-12-18T00:56:10.5083220Z  2024-12-18T00:56:10.5083740Z  2024-12-18T00:56:10.5084171Z  2024-12-18T00:56:10.5084561Z  2024-12-18T00:56:10.5084967Z  2024-12-18T00:56:10.5085346Z  2024-12-18T00:56:10.5085741Z  2024-12-18T00:56:10.5086134Z  2024-12-18T00:56:10.5087104Z [17,954 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:10.5088212Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:10.5089260Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:56:10.5090325Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:56:10.5091595Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:56:10.5092634Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:56:10.5093611Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:56:10.5094610Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2024-12-18T00:56:10.5095640Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 11s local ... 2024-12-18T00:56:10.7756000Z 2024-12-18T00:56:10.7756888Z  2024-12-18T00:56:10.7757407Z  2024-12-18T00:56:10.7757840Z  2024-12-18T00:56:10.7758300Z  2024-12-18T00:56:10.7758744Z  2024-12-18T00:56:10.7768232Z  2024-12-18T00:56:10.7768878Z  2024-12-18T00:56:10.7769293Z  2024-12-18T00:56:10.7770114Z [17,955 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:10.7771184Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:10.7772336Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:56:10.7773327Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2024-12-18T00:56:10.7774287Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:56:10.7775233Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:56:10.7776166Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:56:10.7777277Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2024-12-18T00:56:10.7778313Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 11s local ... 2024-12-18T00:56:11.1087965Z 2024-12-18T00:56:11.1088845Z  2024-12-18T00:56:11.1089298Z  2024-12-18T00:56:11.1089688Z  2024-12-18T00:56:11.1090078Z  2024-12-18T00:56:11.1090467Z  2024-12-18T00:56:11.1090877Z  2024-12-18T00:56:11.1091312Z  2024-12-18T00:56:11.1091716Z  2024-12-18T00:56:11.1093027Z [17,955 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:11.1094355Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:11.1095395Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2024-12-18T00:56:11.1096537Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:11.1097465Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:56:11.1098424Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2024-12-18T00:56:11.1099457Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:56:11.1100463Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2024-12-18T00:56:11.1101544Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local ... 2024-12-18T00:56:11.4128205Z 2024-12-18T00:56:11.4129225Z  2024-12-18T00:56:11.4129693Z  2024-12-18T00:56:11.4130127Z  2024-12-18T00:56:11.4130487Z  2024-12-18T00:56:11.4130872Z  2024-12-18T00:56:11.4131274Z  2024-12-18T00:56:11.4131620Z  2024-12-18T00:56:11.4132022Z  2024-12-18T00:56:11.4132891Z [17,956 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:11.4133938Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:56:11.4134869Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:56:11.4135785Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:11.4136780Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:56:11.4137665Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2024-12-18T00:56:11.4138644Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:56:11.4139856Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2024-12-18T00:56:11.4140838Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local ... 2024-12-18T00:56:11.7092858Z 2024-12-18T00:56:11.7093744Z  2024-12-18T00:56:11.7094234Z  2024-12-18T00:56:11.7094592Z  2024-12-18T00:56:11.7095017Z  2024-12-18T00:56:11.7095426Z  2024-12-18T00:56:11.7095814Z  2024-12-18T00:56:11.7096202Z  2024-12-18T00:56:11.7096723Z  2024-12-18T00:56:11.7097630Z [17,957 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:11.7098760Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:56:11.7099779Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:56:11.7100742Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:11.7101645Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:56:11.7102970Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2024-12-18T00:56:11.7104069Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:56:11.7105073Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2024-12-18T00:56:11.7106106Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local ... 2024-12-18T00:56:11.9433504Z 2024-12-18T00:56:11.9434381Z  2024-12-18T00:56:11.9434849Z  2024-12-18T00:56:11.9435253Z  2024-12-18T00:56:11.9435780Z  2024-12-18T00:56:11.9436185Z  2024-12-18T00:56:11.9436596Z  2024-12-18T00:56:11.9436978Z  2024-12-18T00:56:11.9437383Z  2024-12-18T00:56:11.9438316Z [17,958 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:11.9439477Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:56:11.9440521Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2024-12-18T00:56:11.9441805Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2024-12-18T00:56:11.9442864Z Compiling xla/service/sharding_propagation.cc; 21s local 2024-12-18T00:56:11.9443882Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2024-12-18T00:56:11.9445179Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:56:11.9446172Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2024-12-18T00:56:11.9447250Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 12s local ... 2024-12-18T00:56:12.3099157Z 2024-12-18T00:56:12.3100022Z  2024-12-18T00:56:12.3100510Z  2024-12-18T00:56:12.3100927Z  2024-12-18T00:56:12.3101320Z  2024-12-18T00:56:12.3101724Z  2024-12-18T00:56:12.3102133Z  2024-12-18T00:56:12.3102535Z  2024-12-18T00:56:12.3102929Z  2024-12-18T00:56:12.3103898Z [17,959 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:12.3105117Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:12.3106179Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:56:12.3107178Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:56:12.3108113Z Compiling xla/service/sharding_propagation.cc; 21s local 2024-12-18T00:56:12.3109094Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:56:12.3110048Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2024-12-18T00:56:12.3110988Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2024-12-18T00:56:12.3112113Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local ... 2024-12-18T00:56:12.5759419Z 2024-12-18T00:56:12.5760236Z  2024-12-18T00:56:12.5760630Z  2024-12-18T00:56:12.5761019Z  2024-12-18T00:56:12.5761449Z  2024-12-18T00:56:12.5762137Z  2024-12-18T00:56:12.5762532Z  2024-12-18T00:56:12.5762913Z  2024-12-18T00:56:12.5763324Z  2024-12-18T00:56:12.5764238Z [17,961 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:12.5765229Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:12.5766238Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:56:12.5767188Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:56:12.5768126Z Compiling xla/service/sharding_propagation.cc; 21s local 2024-12-18T00:56:12.5769133Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:56:12.5770182Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2024-12-18T00:56:12.5771215Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2024-12-18T00:56:12.5772279Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local ... 2024-12-18T00:56:12.8223450Z 2024-12-18T00:56:12.8224261Z  2024-12-18T00:56:12.8225006Z  2024-12-18T00:56:12.8225440Z  2024-12-18T00:56:12.8225842Z  2024-12-18T00:56:12.8226251Z  2024-12-18T00:56:12.8226668Z  2024-12-18T00:56:12.8227075Z  2024-12-18T00:56:12.8227456Z  2024-12-18T00:56:12.8228495Z [17,964 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:12.8229668Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:12.8230744Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:56:12.8231770Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2024-12-18T00:56:12.8232721Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:12.8233742Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:56:12.8234868Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2024-12-18T00:56:12.8236090Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local 2024-12-18T00:56:12.8237123Z Compiling xla/service/instruction_fusion.cc; 13s local ... 2024-12-18T00:56:13.0580731Z 2024-12-18T00:56:13.0581574Z  2024-12-18T00:56:13.0582050Z  2024-12-18T00:56:13.0582408Z  2024-12-18T00:56:13.0582794Z  2024-12-18T00:56:13.0583187Z  2024-12-18T00:56:13.0583591Z  2024-12-18T00:56:13.0583957Z  2024-12-18T00:56:13.0584337Z  2024-12-18T00:56:13.0585287Z [17,965 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:13.0586592Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:13.0587619Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2024-12-18T00:56:13.0588614Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:56:13.0589523Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:13.0590623Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2024-12-18T00:56:13.0591785Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2024-12-18T00:56:13.0592797Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:56:13.0593749Z Compiling xla/service/instruction_fusion.cc; 13s local ... 2024-12-18T00:56:13.3107074Z 2024-12-18T00:56:13.3107981Z  2024-12-18T00:56:13.3108488Z  2024-12-18T00:56:13.3108884Z  2024-12-18T00:56:13.3109280Z  2024-12-18T00:56:13.3109696Z  2024-12-18T00:56:13.3110016Z  2024-12-18T00:56:13.3110311Z  2024-12-18T00:56:13.3110602Z  2024-12-18T00:56:13.3111922Z [17,967 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:13.3113039Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:56:13.3114343Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:56:13.3115379Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:56:13.3116307Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:13.3117330Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2024-12-18T00:56:13.3118461Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 15s local 2024-12-18T00:56:13.3119659Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:56:13.3120614Z Compiling xla/service/instruction_fusion.cc; 13s local ... 2024-12-18T00:56:13.5509273Z 2024-12-18T00:56:13.5510056Z  2024-12-18T00:56:13.5510499Z  2024-12-18T00:56:13.5510844Z  2024-12-18T00:56:13.5511208Z  2024-12-18T00:56:13.5511562Z  2024-12-18T00:56:13.5511920Z  2024-12-18T00:56:13.5512286Z  2024-12-18T00:56:13.5512633Z  2024-12-18T00:56:13.5513749Z [17,970 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:13.5514773Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:56:13.5515671Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:56:13.5516534Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:56:13.5517326Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:13.5518195Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2024-12-18T00:56:13.5519120Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:56:13.5519906Z Compiling xla/service/instruction_fusion.cc; 13s local 2024-12-18T00:56:13.5520795Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local ... 2024-12-18T00:56:13.9111885Z 2024-12-18T00:56:13.9112774Z  2024-12-18T00:56:13.9113253Z  2024-12-18T00:56:13.9113662Z  2024-12-18T00:56:13.9114083Z  2024-12-18T00:56:13.9114459Z  2024-12-18T00:56:13.9115240Z  2024-12-18T00:56:13.9115645Z  2024-12-18T00:56:13.9116024Z  2024-12-18T00:56:13.9116947Z [17,971 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:13.9118046Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:56:13.9119039Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:56:13.9119942Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2024-12-18T00:56:13.9120722Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:56:13.9121768Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2024-12-18T00:56:13.9122739Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2024-12-18T00:56:13.9123551Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:56:13.9124507Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local ... 2024-12-18T00:56:14.1115492Z 2024-12-18T00:56:14.1116420Z  2024-12-18T00:56:14.1116910Z  2024-12-18T00:56:14.1117319Z  2024-12-18T00:56:14.1117693Z  2024-12-18T00:56:14.1118098Z  2024-12-18T00:56:14.1118501Z  2024-12-18T00:56:14.1118900Z  2024-12-18T00:56:14.1119276Z  2024-12-18T00:56:14.1120228Z [17,972 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:14.1121368Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:56:14.1122397Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2024-12-18T00:56:14.1123380Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:14.1124298Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:56:14.1125280Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2024-12-18T00:56:14.1126601Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:56:14.1127514Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:56:14.1128515Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local ... 2024-12-18T00:56:14.4955711Z 2024-12-18T00:56:14.4956571Z  2024-12-18T00:56:14.4957046Z  2024-12-18T00:56:14.4957456Z  2024-12-18T00:56:14.4957816Z  2024-12-18T00:56:14.4958181Z  2024-12-18T00:56:14.4958557Z  2024-12-18T00:56:14.4958941Z  2024-12-18T00:56:14.4959319Z  2024-12-18T00:56:14.4960252Z [17,975 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:14.4961365Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:56:14.4962372Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:56:14.4963305Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:14.4964503Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:56:14.4965507Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2024-12-18T00:56:14.4966478Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:56:14.4967401Z Compiling xla/service/instruction_fusion.cc; 14s local 2024-12-18T00:56:14.4968306Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local ... 2024-12-18T00:56:14.7120961Z 2024-12-18T00:56:14.7121862Z  2024-12-18T00:56:14.7122342Z  2024-12-18T00:56:14.7122746Z  2024-12-18T00:56:14.7123163Z  2024-12-18T00:56:14.7123570Z  2024-12-18T00:56:14.7123964Z  2024-12-18T00:56:14.7124328Z  2024-12-18T00:56:14.7124705Z  2024-12-18T00:56:14.7125620Z [17,977 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:14.7126798Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:56:14.7128238Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:56:14.7129308Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:14.7130195Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:56:14.7131240Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2024-12-18T00:56:14.7132321Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:56:14.7133140Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:56:14.7134107Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local ... 2024-12-18T00:56:14.9124065Z 2024-12-18T00:56:14.9124929Z  2024-12-18T00:56:14.9125397Z  2024-12-18T00:56:14.9125804Z  2024-12-18T00:56:14.9126210Z  2024-12-18T00:56:14.9126598Z  2024-12-18T00:56:14.9126982Z  2024-12-18T00:56:14.9127355Z  2024-12-18T00:56:14.9127756Z  2024-12-18T00:56:14.9128769Z [17,980 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:14.9129920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:56:14.9130946Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2024-12-18T00:56:14.9131891Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2024-12-18T00:56:14.9132935Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2024-12-18T00:56:14.9133979Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2024-12-18T00:56:14.9134875Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:56:14.9135803Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2024-12-18T00:56:14.9137080Z Compiling llvm/lib/ExecutionEngine/JITLink/ELF_riscv.cpp; 9s local ... 2024-12-18T00:56:15.4455912Z 2024-12-18T00:56:15.4456961Z  2024-12-18T00:56:15.4457456Z  2024-12-18T00:56:15.4458127Z  2024-12-18T00:56:15.4458513Z  2024-12-18T00:56:15.4458940Z  2024-12-18T00:56:15.4459345Z  2024-12-18T00:56:15.4459780Z  2024-12-18T00:56:15.4460207Z  2024-12-18T00:56:15.4461122Z [17,981 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:15.4462224Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:15.4463238Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:15.4464203Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:56:15.4465230Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:56:15.4466224Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:56:15.4467095Z Compiling xla/service/instruction_fusion.cc; 15s local 2024-12-18T00:56:15.4468031Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2024-12-18T00:56:15.4469310Z Compiling llvm/lib/ExecutionEngine/JITLink/ELF_riscv.cpp; 9s local ... 2024-12-18T00:56:15.7130875Z 2024-12-18T00:56:15.7131794Z  2024-12-18T00:56:15.7132254Z  2024-12-18T00:56:15.7132635Z  2024-12-18T00:56:15.7133029Z  2024-12-18T00:56:15.7133399Z  2024-12-18T00:56:15.7133754Z  2024-12-18T00:56:15.7134144Z  2024-12-18T00:56:15.7134561Z  2024-12-18T00:56:15.7135515Z [17,981 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:15.7136815Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:15.7137852Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:15.7138863Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:56:15.7139909Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:56:15.7140949Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:56:15.7142143Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:56:15.7143187Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:56:15.7144529Z Compiling llvm/lib/ExecutionEngine/JITLink/ELF_riscv.cpp; 10s local ... 2024-12-18T00:56:15.9133818Z 2024-12-18T00:56:15.9134692Z  2024-12-18T00:56:15.9135145Z  2024-12-18T00:56:15.9135512Z  2024-12-18T00:56:15.9135883Z  2024-12-18T00:56:15.9136315Z  2024-12-18T00:56:15.9136860Z  2024-12-18T00:56:15.9137199Z  2024-12-18T00:56:15.9137580Z  2024-12-18T00:56:15.9138475Z [17,982 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:15.9139547Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:15.9140503Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:15.9141395Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2024-12-18T00:56:15.9142506Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:56:15.9143674Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2024-12-18T00:56:15.9144836Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:56:15.9145760Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:56:15.9146829Z Compiling llvm/lib/ExecutionEngine/JITLink/ELF_riscv.cpp; 10s local ... 2024-12-18T00:56:16.1659229Z 2024-12-18T00:56:16.1660011Z  2024-12-18T00:56:16.1660422Z  2024-12-18T00:56:16.1660773Z  2024-12-18T00:56:16.1661110Z  2024-12-18T00:56:16.1661464Z  2024-12-18T00:56:16.1661799Z  2024-12-18T00:56:16.1662140Z  2024-12-18T00:56:16.1662476Z  2024-12-18T00:56:16.1663294Z [17,983 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:16.1664511Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:16.1665406Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2024-12-18T00:56:16.1666240Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:56:16.1667110Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2024-12-18T00:56:16.1668000Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:56:16.1668742Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:56:16.1669556Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:56:16.1670474Z Compiling llvm/lib/ExecutionEngine/JITLink/ELF_riscv.cpp; 10s local ... 2024-12-18T00:56:16.3794029Z 2024-12-18T00:56:16.3794810Z  2024-12-18T00:56:16.3795240Z  2024-12-18T00:56:16.3795598Z  2024-12-18T00:56:16.3796084Z  2024-12-18T00:56:16.3796432Z  2024-12-18T00:56:16.3796775Z  2024-12-18T00:56:16.3797136Z  2024-12-18T00:56:16.3797476Z  2024-12-18T00:56:16.3798525Z [17,985 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:16.3799515Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:56:16.3800484Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:56:16.3801364Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:56:16.3802335Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2024-12-18T00:56:16.3803263Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:56:16.3804060Z Compiling xla/service/instruction_fusion.cc; 16s local 2024-12-18T00:56:16.3804909Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:56:16.3805853Z Compiling llvm/lib/ExecutionEngine/Orc/ExecutionUtils.cpp; 10s local ... 2024-12-18T00:56:16.7142048Z 2024-12-18T00:56:16.7142954Z  2024-12-18T00:56:16.7143420Z  2024-12-18T00:56:16.7144438Z  2024-12-18T00:56:16.7144840Z  2024-12-18T00:56:16.7145195Z  2024-12-18T00:56:16.7145590Z  2024-12-18T00:56:16.7145951Z  2024-12-18T00:56:16.7146406Z  2024-12-18T00:56:16.7147163Z [17,985 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:16.7148022Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:56:16.7148991Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:56:16.7149924Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:56:16.7150881Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2024-12-18T00:56:16.7151827Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2024-12-18T00:56:16.7152626Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:16.7153561Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:16.7154606Z Compiling llvm/lib/ExecutionEngine/Orc/ExecutionUtils.cpp; 11s local ... 2024-12-18T00:56:16.9145559Z 2024-12-18T00:56:16.9146369Z  2024-12-18T00:56:16.9146752Z  2024-12-18T00:56:16.9147087Z  2024-12-18T00:56:16.9147477Z  2024-12-18T00:56:16.9147843Z  2024-12-18T00:56:16.9148205Z  2024-12-18T00:56:16.9148691Z  2024-12-18T00:56:16.9149069Z  2024-12-18T00:56:16.9149980Z [17,986 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:16.9151083Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:56:16.9152091Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:56:16.9153061Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2024-12-18T00:56:16.9154066Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2024-12-18T00:56:16.9155374Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:16.9156509Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:16.9157620Z Compiling llvm/lib/ExecutionEngine/Orc/ExecutionUtils.cpp; 11s local 2024-12-18T00:56:16.9158541Z @llvm-project//llvm:OrcJIT; 10s local ... 2024-12-18T00:56:17.1721958Z 2024-12-18T00:56:17.1722794Z  2024-12-18T00:56:17.1723273Z  2024-12-18T00:56:17.1723676Z  2024-12-18T00:56:17.1724063Z  2024-12-18T00:56:17.1724439Z  2024-12-18T00:56:17.1724824Z  2024-12-18T00:56:17.1725278Z  2024-12-18T00:56:17.1725703Z  2024-12-18T00:56:17.1726620Z [17,988 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:17.1727865Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:56:17.1728911Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2024-12-18T00:56:17.1730310Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2024-12-18T00:56:17.1731359Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:17.1732304Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:17.1733356Z Compiling llvm/lib/ExecutionEngine/Orc/ExecutionUtils.cpp; 11s local 2024-12-18T00:56:17.1734587Z Compiling llvm/lib/ExecutionEngine/Orc/ObjectLinkingLayer.cpp; 10s local 2024-12-18T00:56:17.1735691Z @llvm-project//mlir:TransformDialectInterfaces; 10s local ... 2024-12-18T00:56:17.3769481Z 2024-12-18T00:56:17.3770365Z  2024-12-18T00:56:17.3770837Z  2024-12-18T00:56:17.3771232Z  2024-12-18T00:56:17.3771622Z  2024-12-18T00:56:17.3772017Z  2024-12-18T00:56:17.3772375Z  2024-12-18T00:56:17.3772742Z  2024-12-18T00:56:17.3773084Z  2024-12-18T00:56:17.3774074Z [17,990 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:56:17.3775604Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2024-12-18T00:56:17.3776736Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:17.3777737Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2024-12-18T00:56:17.3778647Z Compiling xla/service/instruction_fusion.cc; 17s local 2024-12-18T00:56:17.3779566Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:17.3780597Z Compiling llvm/lib/ExecutionEngine/Orc/ExecutionUtils.cpp; 11s local 2024-12-18T00:56:17.3781540Z @llvm-project//mlir:TransformDialectInterfaces; 10s local 2024-12-18T00:56:17.3782457Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 9s local ... 2024-12-18T00:56:17.6682498Z 2024-12-18T00:56:17.6683347Z  2024-12-18T00:56:17.6683815Z  2024-12-18T00:56:17.6684229Z  2024-12-18T00:56:17.6684626Z  2024-12-18T00:56:17.6685020Z  2024-12-18T00:56:17.6685414Z  2024-12-18T00:56:17.6685824Z  2024-12-18T00:56:17.6686335Z  2024-12-18T00:56:17.6687265Z [17,992 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:17.6688360Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2024-12-18T00:56:17.6689385Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:17.6690410Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2024-12-18T00:56:17.6691381Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:56:17.6692267Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:17.6693245Z Compiling llvm/lib/ExecutionEngine/Orc/ExecutionUtils.cpp; 12s local 2024-12-18T00:56:17.6694193Z @llvm-project//mlir:TransformDialectInterfaces; 10s local 2024-12-18T00:56:17.6695079Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 9s local ... 2024-12-18T00:56:17.9152108Z 2024-12-18T00:56:17.9153049Z  2024-12-18T00:56:17.9153537Z  2024-12-18T00:56:17.9153918Z  2024-12-18T00:56:17.9154264Z  2024-12-18T00:56:17.9154652Z  2024-12-18T00:56:17.9155041Z  2024-12-18T00:56:17.9155381Z  2024-12-18T00:56:17.9155761Z  2024-12-18T00:56:17.9156697Z [17,993 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:17.9157716Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2024-12-18T00:56:17.9158729Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:17.9159805Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2024-12-18T00:56:17.9160776Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:56:17.9161724Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:17.9162606Z @llvm-project//mlir:TransformDialectInterfaces; 11s local 2024-12-18T00:56:17.9163882Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2024-12-18T00:56:17.9164960Z Compiling xla/service/dynamic_dimension_inference.cc; 9s local ... 2024-12-18T00:56:18.2168629Z 2024-12-18T00:56:18.2169493Z  2024-12-18T00:56:18.2169994Z  2024-12-18T00:56:18.2170402Z  2024-12-18T00:56:18.2170805Z  2024-12-18T00:56:18.2171196Z  2024-12-18T00:56:18.2171606Z  2024-12-18T00:56:18.2172007Z  2024-12-18T00:56:18.2172410Z  2024-12-18T00:56:18.2173352Z [17,996 / 20,603] 4 / 17 tests; 48 actions, 46 running; last test: ...til_test 2024-12-18T00:56:18.2174468Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 171s local 2024-12-18T00:56:18.2175516Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2024-12-18T00:56:18.2176760Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:56:18.2177809Z Compiling xla/service/instruction_fusion.cc; 18s local 2024-12-18T00:56:18.2179142Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:18.2180112Z @llvm-project//mlir:TransformDialectInterfaces; 11s local 2024-12-18T00:56:18.2181162Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2024-12-18T00:56:18.2182236Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local ... 2024-12-18T00:56:18.6172984Z 2024-12-18T00:56:18.6173806Z  2024-12-18T00:56:18.6174265Z  2024-12-18T00:56:18.6174663Z  2024-12-18T00:56:18.6175048Z  2024-12-18T00:56:18.6175447Z  2024-12-18T00:56:18.6175829Z  2024-12-18T00:56:18.6176229Z  2024-12-18T00:56:18.6176778Z  2024-12-18T00:56:18.6177701Z [17,996 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:18.6178792Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 171s local 2024-12-18T00:56:18.6179840Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:56:18.6180855Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:56:18.6181791Z Compiling xla/service/instruction_fusion.cc; 19s local 2024-12-18T00:56:18.6182705Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:18.6183776Z @llvm-project//mlir:TransformDialectInterfaces; 11s local 2024-12-18T00:56:18.6184766Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2024-12-18T00:56:18.6185847Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local ... 2024-12-18T00:56:18.8744997Z 2024-12-18T00:56:18.8745891Z  2024-12-18T00:56:18.8746389Z  2024-12-18T00:56:18.8746783Z  2024-12-18T00:56:18.8747143Z  2024-12-18T00:56:18.8747511Z  2024-12-18T00:56:18.8747902Z  2024-12-18T00:56:18.8748303Z  2024-12-18T00:56:18.8748982Z  2024-12-18T00:56:18.8749926Z [17,999 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:18.8751008Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:56:18.8752025Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:56:18.8753068Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2024-12-18T00:56:18.8754081Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2024-12-18T00:56:18.8755058Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2024-12-18T00:56:18.8756092Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local 2024-12-18T00:56:18.8757115Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 10s local 2024-12-18T00:56:18.8758089Z Compiling xla/service/gather_expander.cc; 9s local ... 2024-12-18T00:56:19.1220858Z 2024-12-18T00:56:19.1221684Z  2024-12-18T00:56:19.1222221Z  2024-12-18T00:56:19.1222584Z  2024-12-18T00:56:19.1223161Z  2024-12-18T00:56:19.1223558Z  2024-12-18T00:56:19.1223952Z  2024-12-18T00:56:19.1224310Z  2024-12-18T00:56:19.1224687Z  2024-12-18T00:56:19.1225538Z [18,000 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:19.1226571Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2024-12-18T00:56:19.1227528Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2024-12-18T00:56:19.1228538Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2024-12-18T00:56:19.1229454Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2024-12-18T00:56:19.1230402Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2024-12-18T00:56:19.1231489Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local 2024-12-18T00:56:19.1232457Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 10s local 2024-12-18T00:56:19.1233787Z Compiling xla/service/gather_expander.cc; 10s local ... 2024-12-18T00:56:19.4178720Z 2024-12-18T00:56:19.4179557Z  2024-12-18T00:56:19.4180018Z  2024-12-18T00:56:19.4180382Z  2024-12-18T00:56:19.4180749Z  2024-12-18T00:56:19.4181115Z  2024-12-18T00:56:19.4181482Z  2024-12-18T00:56:19.4182086Z  2024-12-18T00:56:19.4182436Z  2024-12-18T00:56:19.4183350Z [18,001 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:19.4184370Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:56:19.4185423Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2024-12-18T00:56:19.4186401Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2024-12-18T00:56:19.4187351Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2024-12-18T00:56:19.4188472Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2024-12-18T00:56:19.4189561Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 11s local 2024-12-18T00:56:19.4190427Z Compiling xla/service/gather_expander.cc; 10s local 2024-12-18T00:56:19.4191218Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local ... 2024-12-18T00:56:19.7788119Z 2024-12-18T00:56:19.7789002Z  2024-12-18T00:56:19.7789450Z  2024-12-18T00:56:19.7789835Z  2024-12-18T00:56:19.7790197Z  2024-12-18T00:56:19.7790567Z  2024-12-18T00:56:19.7790923Z  2024-12-18T00:56:19.7791308Z  2024-12-18T00:56:19.7791684Z  2024-12-18T00:56:19.7792579Z [18,004 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:19.7793664Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:56:19.7794713Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2024-12-18T00:56:19.7796064Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2024-12-18T00:56:19.7797111Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 11s local 2024-12-18T00:56:19.7798082Z Compiling xla/service/gather_expander.cc; 10s local 2024-12-18T00:56:19.7798825Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local 2024-12-18T00:56:19.7799697Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 10s local 2024-12-18T00:56:19.7800660Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local ... 2024-12-18T00:56:20.0184231Z 2024-12-18T00:56:20.0185088Z  2024-12-18T00:56:20.0185576Z  2024-12-18T00:56:20.0185981Z  2024-12-18T00:56:20.0186376Z  2024-12-18T00:56:20.0186734Z  2024-12-18T00:56:20.0187113Z  2024-12-18T00:56:20.0187484Z  2024-12-18T00:56:20.0187876Z  2024-12-18T00:56:20.0188802Z [18,004 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:20.0190215Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2024-12-18T00:56:20.0191255Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2024-12-18T00:56:20.0192270Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2024-12-18T00:56:20.0193287Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 11s local 2024-12-18T00:56:20.0194231Z Compiling xla/service/gather_expander.cc; 10s local 2024-12-18T00:56:20.0195036Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local 2024-12-18T00:56:20.0195882Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 10s local 2024-12-18T00:56:20.0196861Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local ... 2024-12-18T00:56:20.4188317Z 2024-12-18T00:56:20.4189156Z  2024-12-18T00:56:20.4189627Z  2024-12-18T00:56:20.4190021Z  2024-12-18T00:56:20.4190391Z  2024-12-18T00:56:20.4190768Z  2024-12-18T00:56:20.4191136Z  2024-12-18T00:56:20.4191514Z  2024-12-18T00:56:20.4192301Z  2024-12-18T00:56:20.4193257Z [18,005 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:20.4194323Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:20.4195365Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 29s local 2024-12-18T00:56:20.4196388Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2024-12-18T00:56:20.4197436Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local 2024-12-18T00:56:20.4198418Z Compiling xla/service/gather_expander.cc; 11s local 2024-12-18T00:56:20.4199236Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2024-12-18T00:56:20.4200123Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 10s local 2024-12-18T00:56:20.4201058Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local ... 2024-12-18T00:56:20.6978645Z 2024-12-18T00:56:20.6979521Z  2024-12-18T00:56:20.6980084Z  2024-12-18T00:56:20.6980517Z  2024-12-18T00:56:20.6980950Z  2024-12-18T00:56:20.6981379Z  2024-12-18T00:56:20.6981768Z  2024-12-18T00:56:20.6982139Z  2024-12-18T00:56:20.6982483Z  2024-12-18T00:56:20.6983358Z [18,006 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:20.6984437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:20.6985418Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2024-12-18T00:56:20.6986351Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local 2024-12-18T00:56:20.6987284Z Compiling xla/service/gather_expander.cc; 11s local 2024-12-18T00:56:20.6988037Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2024-12-18T00:56:20.6988866Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 11s local 2024-12-18T00:56:20.6990283Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local 2024-12-18T00:56:20.6991238Z Compiling xla/hlo/builder/lib/math.cc; 9s local ... 2024-12-18T00:56:20.9668285Z 2024-12-18T00:56:20.9669159Z  2024-12-18T00:56:20.9669539Z  2024-12-18T00:56:20.9669845Z  2024-12-18T00:56:20.9670184Z  2024-12-18T00:56:20.9670483Z  2024-12-18T00:56:20.9670786Z  2024-12-18T00:56:20.9671089Z  2024-12-18T00:56:20.9671388Z  2024-12-18T00:56:20.9672114Z [18,008 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:20.9672994Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:20.9673972Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2024-12-18T00:56:20.9674964Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local 2024-12-18T00:56:20.9675990Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2024-12-18T00:56:20.9677147Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 11s local 2024-12-18T00:56:20.9678077Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2024-12-18T00:56:20.9678889Z Compiling xla/hlo/builder/lib/math.cc; 9s local 2024-12-18T00:56:20.9679729Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 9s local ... 2024-12-18T00:56:21.2194713Z 2024-12-18T00:56:21.2195548Z  2024-12-18T00:56:21.2195958Z  2024-12-18T00:56:21.2196322Z  2024-12-18T00:56:21.2196680Z  2024-12-18T00:56:21.2197031Z  2024-12-18T00:56:21.2197396Z  2024-12-18T00:56:21.2197727Z  2024-12-18T00:56:21.2198199Z  2024-12-18T00:56:21.2199048Z [18,008 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:21.2200084Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2024-12-18T00:56:21.2201030Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2024-12-18T00:56:21.2202385Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 12s local 2024-12-18T00:56:21.2203260Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2024-12-18T00:56:21.2204100Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 11s local 2024-12-18T00:56:21.2204930Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2024-12-18T00:56:21.2205669Z Compiling xla/hlo/builder/lib/math.cc; 9s local 2024-12-18T00:56:21.2206423Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 9s local ... 2024-12-18T00:56:21.6997282Z 2024-12-18T00:56:21.6998065Z  2024-12-18T00:56:21.6998485Z  2024-12-18T00:56:21.6998841Z  2024-12-18T00:56:21.6999197Z  2024-12-18T00:56:21.6999547Z  2024-12-18T00:56:21.6999901Z  2024-12-18T00:56:21.7000254Z  2024-12-18T00:56:21.7000608Z  2024-12-18T00:56:21.7001487Z [18,009 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:21.7002521Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:56:21.7003491Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2024-12-18T00:56:21.7004506Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:56:21.7005358Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:56:21.7006096Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 12s local 2024-12-18T00:56:21.7006923Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2024-12-18T00:56:21.7007624Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2024-12-18T00:56:21.7008380Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 9s local ... 2024-12-18T00:56:21.9020783Z 2024-12-18T00:56:21.9021604Z  2024-12-18T00:56:21.9021984Z  2024-12-18T00:56:21.9022291Z  2024-12-18T00:56:21.9022594Z  2024-12-18T00:56:21.9023150Z  2024-12-18T00:56:21.9023458Z  2024-12-18T00:56:21.9023790Z  2024-12-18T00:56:21.9024098Z  2024-12-18T00:56:21.9024838Z [18,010 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:21.9025804Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2024-12-18T00:56:21.9026622Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2024-12-18T00:56:21.9027462Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:56:21.9028272Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:56:21.9029041Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 12s local 2024-12-18T00:56:21.9029892Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2024-12-18T00:56:21.9030600Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2024-12-18T00:56:21.9031389Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 9s local ... 2024-12-18T00:56:22.1102199Z 2024-12-18T00:56:22.1103274Z  2024-12-18T00:56:22.1103677Z  2024-12-18T00:56:22.1104003Z  2024-12-18T00:56:22.1104313Z  2024-12-18T00:56:22.1104636Z  2024-12-18T00:56:22.1104960Z  2024-12-18T00:56:22.1105283Z  2024-12-18T00:56:22.1105583Z  2024-12-18T00:56:22.1106351Z [18,012 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:22.1107245Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2024-12-18T00:56:22.1108127Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 13s local 2024-12-18T00:56:22.1108916Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2024-12-18T00:56:22.1109604Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 12s local 2024-12-18T00:56:22.1110370Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2024-12-18T00:56:22.1111106Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2024-12-18T00:56:22.1112014Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 10s local 2024-12-18T00:56:22.1113115Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 9s local ... 2024-12-18T00:56:22.3920185Z 2024-12-18T00:56:22.3921065Z  2024-12-18T00:56:22.3921510Z  2024-12-18T00:56:22.3921901Z  2024-12-18T00:56:22.3922286Z  2024-12-18T00:56:22.3922706Z  2024-12-18T00:56:22.3923071Z  2024-12-18T00:56:22.3923422Z  2024-12-18T00:56:22.3923779Z  2024-12-18T00:56:22.3924634Z [18,013 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:22.3925664Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:56:22.3926688Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:56:22.3927624Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:56:22.3928461Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 12s local 2024-12-18T00:56:22.3929458Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2024-12-18T00:56:22.3930305Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2024-12-18T00:56:22.3931104Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 10s local 2024-12-18T00:56:22.3932082Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 9s local ... 2024-12-18T00:56:22.6203734Z 2024-12-18T00:56:22.6204545Z  2024-12-18T00:56:22.6205021Z  2024-12-18T00:56:22.6205410Z  2024-12-18T00:56:22.6205778Z  2024-12-18T00:56:22.6206154Z  2024-12-18T00:56:22.6206540Z  2024-12-18T00:56:22.6206930Z  2024-12-18T00:56:22.6207301Z  2024-12-18T00:56:22.6208185Z [18,014 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:22.6209250Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:56:22.6210549Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 14s local 2024-12-18T00:56:22.6211480Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2024-12-18T00:56:22.6212311Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 12s local 2024-12-18T00:56:22.6213206Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2024-12-18T00:56:22.6214057Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2024-12-18T00:56:22.6214902Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 10s local 2024-12-18T00:56:22.6215943Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 10s local ... 2024-12-18T00:56:23.3283557Z 2024-12-18T00:56:23.3284362Z  2024-12-18T00:56:23.3284767Z  2024-12-18T00:56:23.3285102Z  2024-12-18T00:56:23.3285429Z  2024-12-18T00:56:23.3285746Z  2024-12-18T00:56:23.3286084Z  2024-12-18T00:56:23.3286412Z  2024-12-18T00:56:23.3286794Z  2024-12-18T00:56:23.3288010Z [18,015 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:23.3289054Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2024-12-18T00:56:23.3289905Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 15s local 2024-12-18T00:56:23.3290711Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:56:23.3291435Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 13s local 2024-12-18T00:56:23.3292236Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 12s local 2024-12-18T00:56:23.3292973Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2024-12-18T00:56:23.3293673Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2024-12-18T00:56:23.3294582Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 10s local ... 2024-12-18T00:56:23.6211630Z 2024-12-18T00:56:23.6212495Z  2024-12-18T00:56:23.6212962Z  2024-12-18T00:56:23.6213393Z  2024-12-18T00:56:23.6213770Z  2024-12-18T00:56:23.6214587Z  2024-12-18T00:56:23.6214992Z  2024-12-18T00:56:23.6215358Z  2024-12-18T00:56:23.6215727Z  2024-12-18T00:56:23.6216773Z [18,015 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:23.6217840Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2024-12-18T00:56:23.6218856Z Compiling llvm/lib/ExecutionEngine/Orc/IndirectionUtils.cpp; 15s local 2024-12-18T00:56:23.6219814Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:56:23.6220633Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 13s local 2024-12-18T00:56:23.6221602Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 12s local 2024-12-18T00:56:23.6222462Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:56:23.6223290Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2024-12-18T00:56:23.6224369Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local ... 2024-12-18T00:56:23.9363361Z 2024-12-18T00:56:23.9364194Z  2024-12-18T00:56:23.9364569Z  2024-12-18T00:56:23.9364887Z  2024-12-18T00:56:23.9365208Z  2024-12-18T00:56:23.9365522Z  2024-12-18T00:56:23.9365846Z  2024-12-18T00:56:23.9366153Z  2024-12-18T00:56:23.9366474Z  2024-12-18T00:56:23.9367276Z [18,016 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:23.9376741Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2024-12-18T00:56:23.9377659Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:56:23.9378387Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local 2024-12-18T00:56:23.9379199Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2024-12-18T00:56:23.9380030Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:56:23.9384333Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2024-12-18T00:56:23.9385471Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local 2024-12-18T00:56:23.9386591Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local ... 2024-12-18T00:56:24.2218096Z 2024-12-18T00:56:24.2218956Z  2024-12-18T00:56:24.2219439Z  2024-12-18T00:56:24.2219833Z  2024-12-18T00:56:24.2220250Z  2024-12-18T00:56:24.2220639Z  2024-12-18T00:56:24.2221038Z  2024-12-18T00:56:24.2221443Z  2024-12-18T00:56:24.2221832Z  2024-12-18T00:56:24.2222757Z [18,017 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:24.2223920Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:56:24.2224867Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2024-12-18T00:56:24.2225762Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 14s local 2024-12-18T00:56:24.2227126Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2024-12-18T00:56:24.2228070Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:56:24.2228943Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2024-12-18T00:56:24.2229989Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 11s local 2024-12-18T00:56:24.2231090Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local ... 2024-12-18T00:56:25.2225535Z 2024-12-18T00:56:25.2226349Z  2024-12-18T00:56:25.2226822Z  2024-12-18T00:56:25.2227235Z  2024-12-18T00:56:25.2227574Z  2024-12-18T00:56:25.2227939Z  2024-12-18T00:56:25.2228317Z  2024-12-18T00:56:25.2228823Z  2024-12-18T00:56:25.2229210Z  2024-12-18T00:56:25.2230144Z [18,017 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:25.2231257Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:56:25.2232509Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2024-12-18T00:56:25.2233508Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 15s local 2024-12-18T00:56:25.2234523Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2024-12-18T00:56:25.2235427Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:56:25.2236359Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2024-12-18T00:56:25.2237413Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:56:25.2238499Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local ... 2024-12-18T00:56:25.5081051Z 2024-12-18T00:56:25.5081885Z  2024-12-18T00:56:25.5082381Z  2024-12-18T00:56:25.5082783Z  2024-12-18T00:56:25.5083195Z  2024-12-18T00:56:25.5083581Z  2024-12-18T00:56:25.5083949Z  2024-12-18T00:56:25.5084291Z  2024-12-18T00:56:25.5084706Z  2024-12-18T00:56:25.5085666Z [18,018 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:25.5086784Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:56:25.5087746Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:56:25.5088651Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 15s local 2024-12-18T00:56:25.5089750Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2024-12-18T00:56:25.5090642Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2024-12-18T00:56:25.5091537Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2024-12-18T00:56:25.5092660Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 12s local 2024-12-18T00:56:25.5093730Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local ... 2024-12-18T00:56:25.8230430Z 2024-12-18T00:56:25.8231312Z  2024-12-18T00:56:25.8231782Z  2024-12-18T00:56:25.8232466Z  2024-12-18T00:56:25.8232843Z  2024-12-18T00:56:25.8233279Z  2024-12-18T00:56:25.8233684Z  2024-12-18T00:56:25.8234099Z  2024-12-18T00:56:25.8234631Z  2024-12-18T00:56:25.8235524Z [18,018 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:25.8236630Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:56:25.8237550Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:56:25.8238470Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:56:25.8239519Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2024-12-18T00:56:25.8240430Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2024-12-18T00:56:25.8241310Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2024-12-18T00:56:25.8242404Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:56:25.8243744Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local ... 2024-12-18T00:56:26.2617624Z 2024-12-18T00:56:26.2618500Z  2024-12-18T00:56:26.2618990Z  2024-12-18T00:56:26.2619395Z  2024-12-18T00:56:26.2619770Z  2024-12-18T00:56:26.2620102Z  2024-12-18T00:56:26.2620458Z  2024-12-18T00:56:26.2620789Z  2024-12-18T00:56:26.2621248Z  2024-12-18T00:56:26.2621989Z [18,019 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:26.2622949Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:56:26.2623751Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2024-12-18T00:56:26.2624446Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:56:26.2625137Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2024-12-18T00:56:26.2625913Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2024-12-18T00:56:26.2627164Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 13s local 2024-12-18T00:56:26.2628067Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:56:26.2628988Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2024-12-18T00:56:26.6184447Z 2024-12-18T00:56:26.6185308Z  2024-12-18T00:56:26.6185702Z  2024-12-18T00:56:26.6186048Z  2024-12-18T00:56:26.6186384Z  2024-12-18T00:56:26.6186727Z  2024-12-18T00:56:26.6187065Z  2024-12-18T00:56:26.6187393Z  2024-12-18T00:56:26.6187741Z  2024-12-18T00:56:26.6188570Z [18,020 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:26.6189550Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:56:26.6190381Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:56:26.6191104Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 16s local 2024-12-18T00:56:26.6191932Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2024-12-18T00:56:26.6192784Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2024-12-18T00:56:26.6193792Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local 2024-12-18T00:56:26.6194898Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2024-12-18T00:56:26.6195809Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2024-12-18T00:56:26.8239406Z 2024-12-18T00:56:26.8240229Z  2024-12-18T00:56:26.8240722Z  2024-12-18T00:56:26.8241149Z  2024-12-18T00:56:26.8241552Z  2024-12-18T00:56:26.8241961Z  2024-12-18T00:56:26.8242370Z  2024-12-18T00:56:26.8242778Z  2024-12-18T00:56:26.8243173Z  2024-12-18T00:56:26.8244135Z [18,020 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:26.8245554Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:56:26.8246822Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:56:26.8247757Z Compiling llvm/lib/ExecutionEngine/Orc/LLJIT.cpp; 17s local 2024-12-18T00:56:26.8248633Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2024-12-18T00:56:26.8249550Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2024-12-18T00:56:26.8250673Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local 2024-12-18T00:56:26.8251737Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:56:26.8252742Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2024-12-18T00:56:27.2243730Z 2024-12-18T00:56:27.2244799Z  2024-12-18T00:56:27.2245237Z  2024-12-18T00:56:27.2245604Z  2024-12-18T00:56:27.2246006Z  2024-12-18T00:56:27.2246382Z  2024-12-18T00:56:27.2246774Z  2024-12-18T00:56:27.2247155Z  2024-12-18T00:56:27.2247553Z  2024-12-18T00:56:27.2248768Z [18,023 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:27.2249911Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:56:27.2250802Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2024-12-18T00:56:27.2251763Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:56:27.2252894Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local 2024-12-18T00:56:27.2253942Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:56:27.2254915Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2024-12-18T00:56:27.2255785Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:56:27.2256736Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local ... 2024-12-18T00:56:27.6248329Z 2024-12-18T00:56:27.6249221Z  2024-12-18T00:56:27.6249695Z  2024-12-18T00:56:27.6250093Z  2024-12-18T00:56:27.6250524Z  2024-12-18T00:56:27.6250913Z  2024-12-18T00:56:27.6251722Z  2024-12-18T00:56:27.6252109Z  2024-12-18T00:56:27.6252510Z  2024-12-18T00:56:27.6253454Z [18,025 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:27.6254564Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:56:27.6255447Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:56:27.6256537Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2024-12-18T00:56:27.6257622Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 15s local 2024-12-18T00:56:27.6258620Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2024-12-18T00:56:27.6259536Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2024-12-18T00:56:27.6260344Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:56:27.6260995Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local ... 2024-12-18T00:56:28.0252415Z 2024-12-18T00:56:28.0253324Z  2024-12-18T00:56:28.0253795Z  2024-12-18T00:56:28.0254187Z  2024-12-18T00:56:28.0254591Z  2024-12-18T00:56:28.0254964Z  2024-12-18T00:56:28.0255329Z  2024-12-18T00:56:28.0255725Z  2024-12-18T00:56:28.0256090Z  2024-12-18T00:56:28.0257175Z [18,027 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:28.0258288Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:56:28.0259163Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:56:28.0260093Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:28.0261081Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2024-12-18T00:56:28.0261986Z Compiling xla/service/triangular_solve_expander.cc; 14s local 2024-12-18T00:56:28.0262767Z Compiling xla/service/while_util.cc; 13s local 2024-12-18T00:56:28.0263886Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2024-12-18T00:56:28.0264690Z Compiling xla/service/sharding_propagation.cc; 13s local ... 2024-12-18T00:56:28.2255232Z 2024-12-18T00:56:28.2256085Z  2024-12-18T00:56:28.2256676Z  2024-12-18T00:56:28.2257076Z  2024-12-18T00:56:28.2257465Z  2024-12-18T00:56:28.2257864Z  2024-12-18T00:56:28.2258247Z  2024-12-18T00:56:28.2258626Z  2024-12-18T00:56:28.2258971Z  2024-12-18T00:56:28.2259891Z [18,029 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:28.2261006Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:56:28.2261819Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2024-12-18T00:56:28.2262661Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:28.2263553Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2024-12-18T00:56:28.2264800Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:56:28.2265640Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2024-12-18T00:56:28.2266442Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:56:28.2267541Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local ... 2024-12-18T00:56:28.5258831Z 2024-12-18T00:56:28.5259696Z  2024-12-18T00:56:28.5260166Z  2024-12-18T00:56:28.5260563Z  2024-12-18T00:56:28.5260937Z  2024-12-18T00:56:28.5261329Z  2024-12-18T00:56:28.5261707Z  2024-12-18T00:56:28.5262094Z  2024-12-18T00:56:28.5262493Z  2024-12-18T00:56:28.5263399Z [18,032 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:56:28.5264500Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:56:28.5265372Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:56:28.5266745Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:28.5267758Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:56:28.5268482Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2024-12-18T00:56:28.5269322Z Compiling xla/service/sharding_propagation.cc; 13s local 2024-12-18T00:56:28.5270326Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:56:28.5271492Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local ... 2024-12-18T00:56:28.8260539Z 2024-12-18T00:56:28.8261387Z  2024-12-18T00:56:28.8261853Z  2024-12-18T00:56:28.8262246Z  2024-12-18T00:56:28.8262642Z  2024-12-18T00:56:28.8263136Z  2024-12-18T00:56:28.8263575Z  2024-12-18T00:56:28.8263947Z  2024-12-18T00:56:28.8264430Z  2024-12-18T00:56:28.8265355Z [18,032 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:28.8266512Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:56:28.8267402Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:56:28.8268313Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2024-12-18T00:56:28.8269253Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:56:28.8269982Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:56:28.8270787Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:56:28.8271777Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:56:28.8272936Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local ... 2024-12-18T00:56:29.1007651Z 2024-12-18T00:56:29.1008542Z  2024-12-18T00:56:29.1009021Z  2024-12-18T00:56:29.1009442Z  2024-12-18T00:56:29.1009863Z  2024-12-18T00:56:29.1010260Z  2024-12-18T00:56:29.1010946Z  2024-12-18T00:56:29.1011332Z  2024-12-18T00:56:29.1011723Z  2024-12-18T00:56:29.1012718Z [18,033 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:29.1013773Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:56:29.1014782Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2024-12-18T00:56:29.1015697Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:29.1016748Z Compiling xla/service/while_util.cc; 14s local 2024-12-18T00:56:29.1017489Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:56:29.1018302Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:56:29.1019289Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2024-12-18T00:56:29.1020351Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local ... 2024-12-18T00:56:29.3079098Z 2024-12-18T00:56:29.3079971Z  2024-12-18T00:56:29.3080408Z  2024-12-18T00:56:29.3080789Z  2024-12-18T00:56:29.3081417Z  2024-12-18T00:56:29.3081787Z  2024-12-18T00:56:29.3082150Z  2024-12-18T00:56:29.3082540Z  2024-12-18T00:56:29.3082901Z  2024-12-18T00:56:29.3083766Z [18,036 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:29.3084794Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2024-12-18T00:56:29.3085666Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:56:29.3086556Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:29.3087342Z Compiling xla/service/while_util.cc; 15s local 2024-12-18T00:56:29.3088069Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:56:29.3088802Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:56:29.3089676Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2024-12-18T00:56:29.3090854Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local ... 2024-12-18T00:56:29.5863859Z 2024-12-18T00:56:29.5864689Z  2024-12-18T00:56:29.5865133Z  2024-12-18T00:56:29.5865540Z  2024-12-18T00:56:29.5865934Z  2024-12-18T00:56:29.5866309Z  2024-12-18T00:56:29.5866671Z  2024-12-18T00:56:29.5867040Z  2024-12-18T00:56:29.5867431Z  2024-12-18T00:56:29.5868326Z [18,039 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:29.5869370Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2024-12-18T00:56:29.5870253Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:56:29.5871158Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:29.5872062Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:56:29.5872884Z Compiling xla/service/sharding_propagation.cc; 14s local 2024-12-18T00:56:29.5873828Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 14s local 2024-12-18T00:56:29.5874753Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2024-12-18T00:56:29.5875660Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local ... 2024-12-18T00:56:29.8267505Z 2024-12-18T00:56:29.8268282Z  2024-12-18T00:56:29.8268728Z  2024-12-18T00:56:29.8269128Z  2024-12-18T00:56:29.8269503Z  2024-12-18T00:56:29.8269890Z  2024-12-18T00:56:29.8270279Z  2024-12-18T00:56:29.8270657Z  2024-12-18T00:56:29.8271045Z  2024-12-18T00:56:29.8271951Z [18,041 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:29.8273001Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2024-12-18T00:56:29.8273819Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:56:29.8274601Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2024-12-18T00:56:29.8275891Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:29.8276695Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:56:29.8277498Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2024-12-18T00:56:29.8278320Z Compiling xla/service/topk_rewriter.cc; 12s local 2024-12-18T00:56:29.8279184Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local ... 2024-12-18T00:56:30.0701779Z 2024-12-18T00:56:30.0702626Z  2024-12-18T00:56:30.0703105Z  2024-12-18T00:56:30.0703473Z  2024-12-18T00:56:30.0703855Z  2024-12-18T00:56:30.0704255Z  2024-12-18T00:56:30.0704716Z  2024-12-18T00:56:30.0705110Z  2024-12-18T00:56:30.0705508Z  2024-12-18T00:56:30.0706468Z [18,043 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:30.0707479Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2024-12-18T00:56:30.0708741Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2024-12-18T00:56:30.0709695Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:30.0710548Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:56:30.0711458Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2024-12-18T00:56:30.0712323Z Compiling xla/service/topk_rewriter.cc; 12s local 2024-12-18T00:56:30.0713321Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2024-12-18T00:56:30.0714213Z @xla//xla/hlo/transforms:algebraic_simplifier; 12s local ... 2024-12-18T00:56:30.4272371Z 2024-12-18T00:56:30.4273228Z  2024-12-18T00:56:30.4273727Z  2024-12-18T00:56:30.4274133Z  2024-12-18T00:56:30.4274535Z  2024-12-18T00:56:30.4274911Z  2024-12-18T00:56:30.4275293Z  2024-12-18T00:56:30.4275675Z  2024-12-18T00:56:30.4276047Z  2024-12-18T00:56:30.4277332Z [18,044 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:30.4278556Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:56:30.4279502Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2024-12-18T00:56:30.4280403Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:30.4281258Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2024-12-18T00:56:30.4282117Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2024-12-18T00:56:30.4282978Z Compiling xla/service/topk_rewriter.cc; 13s local 2024-12-18T00:56:30.4283853Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2024-12-18T00:56:30.4284836Z @xla//xla/hlo/transforms:algebraic_simplifier; 12s local ... 2024-12-18T00:56:30.6633315Z 2024-12-18T00:56:30.6634192Z  2024-12-18T00:56:30.6634661Z  2024-12-18T00:56:30.6635039Z  2024-12-18T00:56:30.6635451Z  2024-12-18T00:56:30.6635834Z  2024-12-18T00:56:30.6636241Z  2024-12-18T00:56:30.6636612Z  2024-12-18T00:56:30.6636999Z  2024-12-18T00:56:30.6637935Z [18,046 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:30.6638933Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:56:30.6639687Z Compiling xla/service/sharding_propagation.cc; 15s local 2024-12-18T00:56:30.6640516Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2024-12-18T00:56:30.6641364Z Compiling xla/service/topk_rewriter.cc; 13s local 2024-12-18T00:56:30.6642203Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2024-12-18T00:56:30.6643204Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 12s local 2024-12-18T00:56:30.6644376Z Compiling xla/tools/hlo_extractor.cc; 12s local 2024-12-18T00:56:30.6645125Z @llvm-project//mlir:AMXTransforms; 12s local ... 2024-12-18T00:56:31.0278026Z 2024-12-18T00:56:31.0278840Z  2024-12-18T00:56:31.0279369Z  2024-12-18T00:56:31.0279774Z  2024-12-18T00:56:31.0280137Z  2024-12-18T00:56:31.0280461Z  2024-12-18T00:56:31.0280806Z  2024-12-18T00:56:31.0281148Z  2024-12-18T00:56:31.0281509Z  2024-12-18T00:56:31.0282325Z [18,047 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:31.0283281Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2024-12-18T00:56:31.0284065Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:56:31.0285023Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2024-12-18T00:56:31.0285836Z Compiling xla/service/topk_rewriter.cc; 13s local 2024-12-18T00:56:31.0286619Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2024-12-18T00:56:31.0287613Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2024-12-18T00:56:31.0289015Z Compiling xla/tools/hlo_extractor.cc; 13s local 2024-12-18T00:56:31.0289810Z @llvm-project//mlir:AMXTransforms; 12s local ... 2024-12-18T00:56:31.3312252Z 2024-12-18T00:56:31.3313112Z  2024-12-18T00:56:31.3313590Z  2024-12-18T00:56:31.3313969Z  2024-12-18T00:56:31.3314406Z  2024-12-18T00:56:31.3314748Z  2024-12-18T00:56:31.3315105Z  2024-12-18T00:56:31.3315471Z  2024-12-18T00:56:31.3315832Z  2024-12-18T00:56:31.3316766Z [18,049 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:31.3317766Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:56:31.3318651Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:56:31.3319513Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2024-12-18T00:56:31.3320333Z Compiling xla/service/topk_rewriter.cc; 14s local 2024-12-18T00:56:31.3321245Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2024-12-18T00:56:31.3322614Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2024-12-18T00:56:31.3323531Z Compiling xla/tools/hlo_extractor.cc; 13s local 2024-12-18T00:56:31.3324255Z @llvm-project//mlir:AMXTransforms; 12s local ... 2024-12-18T00:56:31.5313741Z 2024-12-18T00:56:31.5314571Z  2024-12-18T00:56:31.5315023Z  2024-12-18T00:56:31.5315394Z  2024-12-18T00:56:31.5315770Z  2024-12-18T00:56:31.5316177Z  2024-12-18T00:56:31.5316547Z  2024-12-18T00:56:31.5316943Z  2024-12-18T00:56:31.5317347Z  2024-12-18T00:56:31.5318291Z [18,051 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:31.5319258Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:56:31.5320123Z Compiling xla/service/sharding_propagation.cc; 16s local 2024-12-18T00:56:31.5321090Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2024-12-18T00:56:31.5322054Z Compiling xla/service/topk_rewriter.cc; 14s local 2024-12-18T00:56:31.5322949Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 14s local 2024-12-18T00:56:31.5324028Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2024-12-18T00:56:31.5324980Z Compiling xla/tools/hlo_extractor.cc; 13s local 2024-12-18T00:56:31.5325850Z @llvm-project//mlir:AMXTransforms; 12s local ... 2024-12-18T00:56:31.8284039Z 2024-12-18T00:56:31.8284860Z  2024-12-18T00:56:31.8285352Z  2024-12-18T00:56:31.8285728Z  2024-12-18T00:56:31.8286180Z  2024-12-18T00:56:31.8286571Z  2024-12-18T00:56:31.8286957Z  2024-12-18T00:56:31.8287339Z  2024-12-18T00:56:31.8287702Z  2024-12-18T00:56:31.8288646Z [18,051 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:31.8289698Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:56:31.8290939Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:31.8291890Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2024-12-18T00:56:31.8292721Z Compiling xla/service/topk_rewriter.cc; 14s local 2024-12-18T00:56:31.8293631Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 14s local 2024-12-18T00:56:31.8294693Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:56:31.8295573Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:56:31.8296537Z @llvm-project//mlir:AMXTransforms; 13s local ... 2024-12-18T00:56:32.2230777Z 2024-12-18T00:56:32.2231606Z  2024-12-18T00:56:32.2232032Z  2024-12-18T00:56:32.2232379Z  2024-12-18T00:56:32.2232727Z  2024-12-18T00:56:32.2233063Z  2024-12-18T00:56:32.2233419Z  2024-12-18T00:56:32.2233764Z  2024-12-18T00:56:32.2234120Z  2024-12-18T00:56:32.2235259Z [18,054 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:32.2236264Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2024-12-18T00:56:32.2236990Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:32.2237794Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2024-12-18T00:56:32.2238488Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:56:32.2239250Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:56:32.2240011Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:56:32.2240599Z @llvm-project//mlir:AMXTransforms; 13s local 2024-12-18T00:56:32.2241400Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 13s local ... 2024-12-18T00:56:32.4289043Z 2024-12-18T00:56:32.4289828Z  2024-12-18T00:56:32.4290270Z  2024-12-18T00:56:32.4290626Z  2024-12-18T00:56:32.4290997Z  2024-12-18T00:56:32.4291380Z  2024-12-18T00:56:32.4291735Z  2024-12-18T00:56:32.4292457Z  2024-12-18T00:56:32.4292818Z  2024-12-18T00:56:32.4293676Z [18,055 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:32.4294591Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 23s local 2024-12-18T00:56:32.4295319Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:32.4296102Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2024-12-18T00:56:32.4296987Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:56:32.4297806Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:56:32.4298625Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:56:32.4299372Z @llvm-project//mlir:AMXTransforms; 13s local 2024-12-18T00:56:32.4300189Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 13s local ... 2024-12-18T00:56:32.6347431Z 2024-12-18T00:56:32.6348278Z  2024-12-18T00:56:32.6348726Z  2024-12-18T00:56:32.6349065Z  2024-12-18T00:56:32.6349367Z  2024-12-18T00:56:32.6349692Z  2024-12-18T00:56:32.6350016Z  2024-12-18T00:56:32.6350338Z  2024-12-18T00:56:32.6350653Z  2024-12-18T00:56:32.6351408Z [18,057 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:32.6352248Z Compiling xla/service/sharding_propagation.cc; 17s local 2024-12-18T00:56:32.6352996Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2024-12-18T00:56:32.6353694Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:56:32.6354442Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:56:32.6355187Z Compiling xla/tools/hlo_extractor.cc; 14s local 2024-12-18T00:56:32.6355751Z @llvm-project//mlir:AMXTransforms; 13s local 2024-12-18T00:56:32.6356463Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 13s local 2024-12-18T00:56:32.6357599Z @xla//xla/hlo/transforms:algebraic_simplifier; 13s local ... 2024-12-18T00:56:32.8405646Z 2024-12-18T00:56:32.8406476Z  2024-12-18T00:56:32.8406926Z  2024-12-18T00:56:32.8407295Z  2024-12-18T00:56:32.8407649Z  2024-12-18T00:56:32.8408023Z  2024-12-18T00:56:32.8408399Z  2024-12-18T00:56:32.8408774Z  2024-12-18T00:56:32.8409124Z  2024-12-18T00:56:32.8410016Z [18,059 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:32.8411004Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:32.8411882Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2024-12-18T00:56:32.8412666Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:56:32.8413356Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:32.8414164Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:56:32.8415161Z @llvm-project//mlir:AMXTransforms; 14s local 2024-12-18T00:56:32.8416122Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:56:32.8417220Z @xla//xla/hlo/transforms:algebraic_simplifier; 13s local ... 2024-12-18T00:56:33.1630757Z 2024-12-18T00:56:33.1631612Z  2024-12-18T00:56:33.1632082Z  2024-12-18T00:56:33.1632456Z  2024-12-18T00:56:33.1632841Z  2024-12-18T00:56:33.1633216Z  2024-12-18T00:56:33.1633596Z  2024-12-18T00:56:33.1633977Z  2024-12-18T00:56:33.1634368Z  2024-12-18T00:56:33.1635239Z [18,061 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:33.1636243Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:33.1637147Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2024-12-18T00:56:33.1637983Z Compiling xla/service/topk_rewriter.cc; 15s local 2024-12-18T00:56:33.1639165Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:33.1640191Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:56:33.1641067Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:56:33.1642136Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:56:33.1643056Z @llvm-project//mlir:AMXTransforms; 12s local ... 2024-12-18T00:56:33.4112146Z 2024-12-18T00:56:33.4112964Z  2024-12-18T00:56:33.4113418Z  2024-12-18T00:56:33.4113803Z  2024-12-18T00:56:33.4114171Z  2024-12-18T00:56:33.4114557Z  2024-12-18T00:56:33.4114924Z  2024-12-18T00:56:33.4115232Z  2024-12-18T00:56:33.4115517Z  2024-12-18T00:56:33.4116270Z [18,062 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:33.4117178Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:33.4118134Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2024-12-18T00:56:33.4118846Z Compiling xla/service/topk_rewriter.cc; 16s local 2024-12-18T00:56:33.4119516Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:33.4120236Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:56:33.4121063Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:56:33.4122117Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:56:33.4123035Z @llvm-project//mlir:AMXTransforms; 13s local ... 2024-12-18T00:56:33.6297263Z 2024-12-18T00:56:33.6298045Z  2024-12-18T00:56:33.6298462Z  2024-12-18T00:56:33.6298838Z  2024-12-18T00:56:33.6299219Z  2024-12-18T00:56:33.6299649Z  2024-12-18T00:56:33.6300012Z  2024-12-18T00:56:33.6300405Z  2024-12-18T00:56:33.6300794Z  2024-12-18T00:56:33.6301979Z [18,062 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:33.6303104Z Compiling xla/service/sharding_propagation.cc; 18s local 2024-12-18T00:56:33.6304048Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2024-12-18T00:56:33.6304941Z Compiling xla/service/topk_rewriter.cc; 16s local 2024-12-18T00:56:33.6305906Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:33.6306734Z Compiling xla/tools/hlo_extractor.cc; 15s local 2024-12-18T00:56:33.6307526Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local 2024-12-18T00:56:33.6308431Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2024-12-18T00:56:33.6309231Z @llvm-project//mlir:AMXTransforms; 13s local ... 2024-12-18T00:56:34.0301469Z 2024-12-18T00:56:34.0302397Z  2024-12-18T00:56:34.0302908Z  2024-12-18T00:56:34.0303276Z  2024-12-18T00:56:34.0303664Z  2024-12-18T00:56:34.0304042Z  2024-12-18T00:56:34.0304735Z  2024-12-18T00:56:34.0305145Z  2024-12-18T00:56:34.0305521Z  2024-12-18T00:56:34.0306448Z [18,063 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:34.0307507Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:56:34.0308432Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:56:34.0309248Z Compiling xla/service/topk_rewriter.cc; 16s local 2024-12-18T00:56:34.0310254Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:56:34.0311186Z Compiling xla/tools/hlo_extractor.cc; 16s local 2024-12-18T00:56:34.0312027Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local 2024-12-18T00:56:34.0313136Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:34.0314103Z @llvm-project//mlir:AMXTransforms; 13s local ... 2024-12-18T00:56:34.2304738Z 2024-12-18T00:56:34.2306094Z  2024-12-18T00:56:34.2306626Z  2024-12-18T00:56:34.2306994Z  2024-12-18T00:56:34.2307375Z  2024-12-18T00:56:34.2307694Z  2024-12-18T00:56:34.2308012Z  2024-12-18T00:56:34.2308361Z  2024-12-18T00:56:34.2308715Z  2024-12-18T00:56:34.2309639Z [18,064 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:34.2310625Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:56:34.2311422Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:56:34.2312207Z Compiling xla/service/topk_rewriter.cc; 17s local 2024-12-18T00:56:34.2313062Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:56:34.2313958Z Compiling xla/tools/hlo_extractor.cc; 16s local 2024-12-18T00:56:34.2314812Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local 2024-12-18T00:56:34.2315815Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:34.2316706Z @llvm-project//mlir:AMXTransforms; 14s local ... 2024-12-18T00:56:34.6027181Z 2024-12-18T00:56:34.6028050Z  2024-12-18T00:56:34.6028509Z  2024-12-18T00:56:34.6028880Z  2024-12-18T00:56:34.6029233Z  2024-12-18T00:56:34.6029601Z  2024-12-18T00:56:34.6029977Z  2024-12-18T00:56:34.6030336Z  2024-12-18T00:56:34.6030697Z  2024-12-18T00:56:34.6031559Z [18,065 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:34.6032508Z Compiling xla/service/sharding_propagation.cc; 19s local 2024-12-18T00:56:34.6033393Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:56:34.6034231Z Compiling xla/service/topk_rewriter.cc; 17s local 2024-12-18T00:56:34.6035066Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:56:34.6036255Z Compiling xla/tools/hlo_extractor.cc; 16s local 2024-12-18T00:56:34.6037124Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local 2024-12-18T00:56:34.6038169Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:34.6039203Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local ... 2024-12-18T00:56:34.8295509Z 2024-12-18T00:56:34.8296567Z  2024-12-18T00:56:34.8297129Z  2024-12-18T00:56:34.8297546Z  2024-12-18T00:56:34.8297964Z  2024-12-18T00:56:34.8298363Z  2024-12-18T00:56:34.8298795Z  2024-12-18T00:56:34.8299221Z  2024-12-18T00:56:34.8299635Z  2024-12-18T00:56:34.8300638Z [18,066 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:34.8301801Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:56:34.8302826Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2024-12-18T00:56:34.8304016Z Compiling xla/service/topk_rewriter.cc; 17s local 2024-12-18T00:56:34.8305052Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:56:34.8306052Z Compiling xla/tools/hlo_extractor.cc; 17s local 2024-12-18T00:56:34.8307056Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:56:34.8308042Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2024-12-18T00:56:34.8308975Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local ... 2024-12-18T00:56:35.0310484Z 2024-12-18T00:56:35.0311312Z  2024-12-18T00:56:35.0311771Z  2024-12-18T00:56:35.0312169Z  2024-12-18T00:56:35.0312556Z  2024-12-18T00:56:35.0312961Z  2024-12-18T00:56:35.0313364Z  2024-12-18T00:56:35.0313747Z  2024-12-18T00:56:35.0314114Z  2024-12-18T00:56:35.0315048Z [18,067 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:35.0316615Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:56:35.0317565Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:56:35.0318452Z Compiling xla/service/topk_rewriter.cc; 17s local 2024-12-18T00:56:35.0319360Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:56:35.0320231Z Compiling xla/tools/hlo_extractor.cc; 17s local 2024-12-18T00:56:35.0321134Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:56:35.0322109Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:56:35.0323085Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local ... 2024-12-18T00:56:35.2313444Z 2024-12-18T00:56:35.2314298Z  2024-12-18T00:56:35.2314771Z  2024-12-18T00:56:35.2315146Z  2024-12-18T00:56:35.2315527Z  2024-12-18T00:56:35.2315947Z  2024-12-18T00:56:35.2316350Z  2024-12-18T00:56:35.2316755Z  2024-12-18T00:56:35.2317162Z  2024-12-18T00:56:35.2318070Z [18,068 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:35.2319268Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:56:35.2320152Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:56:35.2320998Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:56:35.2321909Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:56:35.2322884Z Compiling xla/tools/hlo_extractor.cc; 17s local 2024-12-18T00:56:35.2323805Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:56:35.2324949Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:56:35.2326010Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local ... 2024-12-18T00:56:35.4901920Z 2024-12-18T00:56:35.4902805Z  2024-12-18T00:56:35.4903320Z  2024-12-18T00:56:35.4903707Z  2024-12-18T00:56:35.4904083Z  2024-12-18T00:56:35.4904489Z  2024-12-18T00:56:35.4904874Z  2024-12-18T00:56:35.4905387Z  2024-12-18T00:56:35.4905752Z  2024-12-18T00:56:35.4906642Z [18,069 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:35.4907669Z Compiling xla/service/sharding_propagation.cc; 20s local 2024-12-18T00:56:35.4908606Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:56:35.4909410Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:56:35.4910330Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:56:35.4911166Z Compiling xla/tools/hlo_extractor.cc; 17s local 2024-12-18T00:56:35.4911995Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2024-12-18T00:56:35.4913409Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:56:35.4914421Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local ... 2024-12-18T00:56:35.8318848Z 2024-12-18T00:56:35.8319704Z  2024-12-18T00:56:35.8320155Z  2024-12-18T00:56:35.8320535Z  2024-12-18T00:56:35.8320931Z  2024-12-18T00:56:35.8321313Z  2024-12-18T00:56:35.8321683Z  2024-12-18T00:56:35.8322021Z  2024-12-18T00:56:35.8322390Z  2024-12-18T00:56:35.8323311Z [18,072 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:35.8324325Z Compiling xla/service/sharding_propagation.cc; 21s local 2024-12-18T00:56:35.8325181Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2024-12-18T00:56:35.8326033Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:56:35.8326925Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2024-12-18T00:56:35.8328367Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2024-12-18T00:56:35.8329419Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2024-12-18T00:56:35.8330395Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2024-12-18T00:56:35.8331206Z @xla//xla/hlo/evaluator:hlo_evaluator; 9s local ... 2024-12-18T00:56:36.8326281Z 2024-12-18T00:56:36.8327090Z  2024-12-18T00:56:36.8327573Z  2024-12-18T00:56:36.8327988Z  2024-12-18T00:56:36.8328373Z  2024-12-18T00:56:36.8328757Z  2024-12-18T00:56:36.8329115Z  2024-12-18T00:56:36.8329481Z  2024-12-18T00:56:36.8329860Z  2024-12-18T00:56:36.8330745Z [18,072 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:36.8331713Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:36.8332578Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2024-12-18T00:56:36.8333475Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:56:36.8334345Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:56:36.8335366Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2024-12-18T00:56:36.8336672Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2024-12-18T00:56:36.8337663Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2024-12-18T00:56:36.8338532Z @xla//xla/hlo/evaluator:hlo_evaluator; 10s local ... 2024-12-18T00:56:37.0931824Z 2024-12-18T00:56:37.0932735Z  2024-12-18T00:56:37.0933195Z  2024-12-18T00:56:37.0933592Z  2024-12-18T00:56:37.0933968Z  2024-12-18T00:56:37.0934330Z  2024-12-18T00:56:37.0934699Z  2024-12-18T00:56:37.0935075Z  2024-12-18T00:56:37.0935455Z  2024-12-18T00:56:37.0936333Z [18,073 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:37.0937805Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:37.0938636Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:56:37.0939450Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:56:37.0940360Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:56:37.0941475Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2024-12-18T00:56:37.0942600Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2024-12-18T00:56:37.0943629Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2024-12-18T00:56:37.0944717Z @xla//xla/hlo/evaluator:hlo_evaluator; 10s local ... 2024-12-18T00:56:37.4330731Z 2024-12-18T00:56:37.4331566Z  2024-12-18T00:56:37.4331983Z  2024-12-18T00:56:37.4332338Z  2024-12-18T00:56:37.4332690Z  2024-12-18T00:56:37.4333069Z  2024-12-18T00:56:37.4333424Z  2024-12-18T00:56:37.4333746Z  2024-12-18T00:56:37.4334349Z  2024-12-18T00:56:37.4335181Z [18,073 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:37.4336105Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:37.4337056Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:56:37.4337806Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:56:37.4338628Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:56:37.4339619Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2024-12-18T00:56:37.4340601Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2024-12-18T00:56:37.4341505Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2024-12-18T00:56:37.4342237Z @xla//xla/hlo/evaluator:hlo_evaluator; 11s local ... 2024-12-18T00:56:37.7406268Z 2024-12-18T00:56:37.7407146Z  2024-12-18T00:56:37.7407922Z  2024-12-18T00:56:37.7408278Z  2024-12-18T00:56:37.7408643Z  2024-12-18T00:56:37.7409003Z  2024-12-18T00:56:37.7409337Z  2024-12-18T00:56:37.7409689Z  2024-12-18T00:56:37.7410059Z  2024-12-18T00:56:37.7410916Z [18,074 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:37.7411781Z Compiling xla/service/sharding_propagation.cc; 22s local 2024-12-18T00:56:37.7412533Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2024-12-18T00:56:37.7413229Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:56:37.7414013Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:56:37.7414893Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:56:37.7415768Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2024-12-18T00:56:37.7416796Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2024-12-18T00:56:37.7417501Z @xla//xla/hlo/evaluator:hlo_evaluator; 11s local ... 2024-12-18T00:56:38.0335922Z 2024-12-18T00:56:38.0337022Z  2024-12-18T00:56:38.0337457Z  2024-12-18T00:56:38.0337806Z  2024-12-18T00:56:38.0338146Z  2024-12-18T00:56:38.0338464Z  2024-12-18T00:56:38.0338795Z  2024-12-18T00:56:38.0339136Z  2024-12-18T00:56:38.0339487Z  2024-12-18T00:56:38.0340299Z [18,074 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:38.0341178Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:56:38.0341964Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:56:38.0342687Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:56:38.0343437Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:56:38.0344878Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:56:38.0345794Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:56:38.0346670Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2024-12-18T00:56:38.0347414Z @xla//xla/hlo/evaluator:hlo_evaluator; 11s local ... 2024-12-18T00:56:38.3501617Z 2024-12-18T00:56:38.3502468Z  2024-12-18T00:56:38.3502821Z  2024-12-18T00:56:38.3503135Z  2024-12-18T00:56:38.3503444Z  2024-12-18T00:56:38.3503738Z  2024-12-18T00:56:38.3504036Z  2024-12-18T00:56:38.3504325Z  2024-12-18T00:56:38.3504620Z  2024-12-18T00:56:38.3505342Z [18,075 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:38.3506108Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:56:38.3506786Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:56:38.3507726Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:56:38.3508418Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:56:38.3509211Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:56:38.3518078Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:56:38.3519039Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2024-12-18T00:56:38.3519677Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2024-12-18T00:56:38.6011141Z 2024-12-18T00:56:38.6012011Z  2024-12-18T00:56:38.6012510Z  2024-12-18T00:56:38.6012944Z  2024-12-18T00:56:38.6013317Z  2024-12-18T00:56:38.6013819Z  2024-12-18T00:56:38.6014203Z  2024-12-18T00:56:38.6014594Z  2024-12-18T00:56:38.6015001Z  2024-12-18T00:56:38.6015966Z [18,078 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:38.6017482Z Compiling xla/service/sharding_propagation.cc; 23s local 2024-12-18T00:56:38.6018451Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:56:38.6019306Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:56:38.6020229Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:56:38.6021337Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2024-12-18T00:56:38.6022548Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:56:38.6023586Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2024-12-18T00:56:38.6024490Z Compiling xla/hlo/builder/lib/math.cc; 11s local ... 2024-12-18T00:56:38.8124566Z 2024-12-18T00:56:38.8125467Z  2024-12-18T00:56:38.8125929Z  2024-12-18T00:56:38.8126307Z  2024-12-18T00:56:38.8126703Z  2024-12-18T00:56:38.8127104Z  2024-12-18T00:56:38.8127512Z  2024-12-18T00:56:38.8127879Z  2024-12-18T00:56:38.8128261Z  2024-12-18T00:56:38.8129116Z [18,081 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:38.8130106Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2024-12-18T00:56:38.8130863Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:56:38.8131651Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:56:38.8132686Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local 2024-12-18T00:56:38.8133664Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2024-12-18T00:56:38.8134608Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2024-12-18T00:56:38.8135473Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2024-12-18T00:56:38.8136231Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 11s local ... 2024-12-18T00:56:39.0343658Z 2024-12-18T00:56:39.0344708Z  2024-12-18T00:56:39.0345206Z  2024-12-18T00:56:39.0345552Z  2024-12-18T00:56:39.0345895Z  2024-12-18T00:56:39.0346239Z  2024-12-18T00:56:39.0346570Z  2024-12-18T00:56:39.0346916Z  2024-12-18T00:56:39.0347263Z  2024-12-18T00:56:39.0348113Z [18,081 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:39.0349093Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:56:39.0349785Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:56:39.0350573Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:56:39.0351494Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local 2024-12-18T00:56:39.0352435Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:56:39.0353357Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2024-12-18T00:56:39.0354461Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:56:39.0355174Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local ... 2024-12-18T00:56:39.8452176Z 2024-12-18T00:56:39.8453020Z  2024-12-18T00:56:39.8453495Z  2024-12-18T00:56:39.8453909Z  2024-12-18T00:56:39.8454270Z  2024-12-18T00:56:39.8454656Z  2024-12-18T00:56:39.8455051Z  2024-12-18T00:56:39.8455435Z  2024-12-18T00:56:39.8455781Z  2024-12-18T00:56:39.8456851Z [18,082 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:39.8457860Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2024-12-18T00:56:39.8458661Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:56:39.8459540Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:56:39.8460606Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2024-12-18T00:56:39.8462074Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2024-12-18T00:56:39.8463246Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2024-12-18T00:56:39.8464159Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2024-12-18T00:56:39.8464958Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local ... 2024-12-18T00:56:40.1953867Z 2024-12-18T00:56:40.1954697Z  2024-12-18T00:56:40.1955149Z  2024-12-18T00:56:40.1955549Z  2024-12-18T00:56:40.1955935Z  2024-12-18T00:56:40.1956329Z  2024-12-18T00:56:40.1956715Z  2024-12-18T00:56:40.1957083Z  2024-12-18T00:56:40.1957463Z  2024-12-18T00:56:40.1958379Z [18,086 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:56:40.1959525Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:56:40.1960502Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:56:40.1961581Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2024-12-18T00:56:40.1962620Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:56:40.1963640Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2024-12-18T00:56:40.1964519Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:56:40.1965279Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2024-12-18T00:56:40.1966154Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2024-12-18T00:56:40.4351979Z 2024-12-18T00:56:40.4352824Z  2024-12-18T00:56:40.4353292Z  2024-12-18T00:56:40.4353712Z  2024-12-18T00:56:40.4354118Z  2024-12-18T00:56:40.4354523Z  2024-12-18T00:56:40.4354900Z  2024-12-18T00:56:40.4355289Z  2024-12-18T00:56:40.4355804Z  2024-12-18T00:56:40.4356773Z [18,086 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:40.4358198Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:56:40.4359210Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:56:40.4360317Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2024-12-18T00:56:40.4361440Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:56:40.4362553Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2024-12-18T00:56:40.4363464Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:56:40.4364263Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2024-12-18T00:56:40.4365198Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2024-12-18T00:56:40.8356193Z 2024-12-18T00:56:40.8357064Z  2024-12-18T00:56:40.8357566Z  2024-12-18T00:56:40.8357979Z  2024-12-18T00:56:40.8358427Z  2024-12-18T00:56:40.8358848Z  2024-12-18T00:56:40.8359502Z  2024-12-18T00:56:40.8359910Z  2024-12-18T00:56:40.8360302Z  2024-12-18T00:56:40.8361285Z [18,088 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:40.8362424Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2024-12-18T00:56:40.8363472Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:40.8364633Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2024-12-18T00:56:40.8365611Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2024-12-18T00:56:40.8366712Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2024-12-18T00:56:40.8367662Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2024-12-18T00:56:40.8368465Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2024-12-18T00:56:40.8369449Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2024-12-18T00:56:41.0952686Z 2024-12-18T00:56:41.0953549Z  2024-12-18T00:56:41.0954000Z  2024-12-18T00:56:41.0954396Z  2024-12-18T00:56:41.0954805Z  2024-12-18T00:56:41.0955190Z  2024-12-18T00:56:41.0955585Z  2024-12-18T00:56:41.0955971Z  2024-12-18T00:56:41.0956367Z  2024-12-18T00:56:41.0957294Z [18,089 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:41.0958354Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:56:41.0959394Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:41.0960565Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2024-12-18T00:56:41.0961663Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:56:41.0962782Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2024-12-18T00:56:41.0963800Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2024-12-18T00:56:41.0964655Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2024-12-18T00:56:41.0965560Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2024-12-18T00:56:41.3035705Z 2024-12-18T00:56:41.3036593Z  2024-12-18T00:56:41.3037092Z  2024-12-18T00:56:41.3037506Z  2024-12-18T00:56:41.3037899Z  2024-12-18T00:56:41.3038319Z  2024-12-18T00:56:41.3038722Z  2024-12-18T00:56:41.3039124Z  2024-12-18T00:56:41.3039497Z  2024-12-18T00:56:41.3040442Z [18,092 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:41.3041524Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:56:41.3042632Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:41.3043732Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2024-12-18T00:56:41.3045417Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:56:41.3046471Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2024-12-18T00:56:41.3047382Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2024-12-18T00:56:41.3048175Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2024-12-18T00:56:41.3049163Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2024-12-18T00:56:41.6361849Z 2024-12-18T00:56:41.6362657Z  2024-12-18T00:56:41.6363135Z  2024-12-18T00:56:41.6363520Z  2024-12-18T00:56:41.6363913Z  2024-12-18T00:56:41.6364309Z  2024-12-18T00:56:41.6364701Z  2024-12-18T00:56:41.6365082Z  2024-12-18T00:56:41.6365485Z  2024-12-18T00:56:41.6366430Z [18,095 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:41.6367574Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2024-12-18T00:56:41.6368860Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:41.6369999Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2024-12-18T00:56:41.6371132Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2024-12-18T00:56:41.6372259Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2024-12-18T00:56:41.6373133Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2024-12-18T00:56:41.6373928Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2024-12-18T00:56:41.6374891Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2024-12-18T00:56:42.1027625Z 2024-12-18T00:56:42.1028503Z  2024-12-18T00:56:42.1028952Z  2024-12-18T00:56:42.1029363Z  2024-12-18T00:56:42.1029780Z  2024-12-18T00:56:42.1030141Z  2024-12-18T00:56:42.1030505Z  2024-12-18T00:56:42.1030925Z  2024-12-18T00:56:42.1031334Z  2024-12-18T00:56:42.1032683Z [18,096 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:42.1033821Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:56:42.1035015Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2024-12-18T00:56:42.1036113Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 23s local 2024-12-18T00:56:42.1037178Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:42.1038265Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2024-12-18T00:56:42.1039214Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:56:42.1040093Z Compiling xla/service/triangular_solve_expander.cc; 14s local 2024-12-18T00:56:42.1040972Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:56:42.3576673Z 2024-12-18T00:56:42.3577554Z  2024-12-18T00:56:42.3578024Z  2024-12-18T00:56:42.3578447Z  2024-12-18T00:56:42.3578831Z  2024-12-18T00:56:42.3579209Z  2024-12-18T00:56:42.3579605Z  2024-12-18T00:56:42.3579989Z  2024-12-18T00:56:42.3580350Z  2024-12-18T00:56:42.3581250Z [18,097 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:42.3582282Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:56:42.3583354Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2024-12-18T00:56:42.3584457Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:42.3585428Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 16s local 2024-12-18T00:56:42.3586212Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:56:42.3587027Z Compiling xla/service/triangular_solve_expander.cc; 14s local 2024-12-18T00:56:42.3588225Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2024-12-18T00:56:42.3589149Z @llvm-project//mlir:TransformDialect; 13s local ... 2024-12-18T00:56:42.5578901Z 2024-12-18T00:56:42.5582220Z  2024-12-18T00:56:42.5582848Z  2024-12-18T00:56:42.5583402Z  2024-12-18T00:56:42.5584136Z  2024-12-18T00:56:42.5584518Z  2024-12-18T00:56:42.5584878Z  2024-12-18T00:56:42.5585212Z  2024-12-18T00:56:42.5585573Z  2024-12-18T00:56:42.5586767Z [18,101 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:42.5588231Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:56:42.5589607Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2024-12-18T00:56:42.5591061Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:42.5592358Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:56:42.5594042Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2024-12-18T00:56:42.5595593Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2024-12-18T00:56:42.5597056Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local 2024-12-18T00:56:42.5598351Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local ... 2024-12-18T00:56:42.8366599Z 2024-12-18T00:56:42.8367488Z  2024-12-18T00:56:42.8367977Z  2024-12-18T00:56:42.8368395Z  2024-12-18T00:56:42.8368808Z  2024-12-18T00:56:42.8369199Z  2024-12-18T00:56:42.8369603Z  2024-12-18T00:56:42.8370008Z  2024-12-18T00:56:42.8370408Z  2024-12-18T00:56:42.8371380Z [18,101 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:42.8372481Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2024-12-18T00:56:42.8373489Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:56:42.8375051Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2024-12-18T00:56:42.8376071Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2024-12-18T00:56:42.8377255Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2024-12-18T00:56:42.8378384Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2024-12-18T00:56:42.8379358Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2024-12-18T00:56:42.8380311Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local ... 2024-12-18T00:56:43.6043761Z 2024-12-18T00:56:43.6044836Z  2024-12-18T00:56:43.6045328Z  2024-12-18T00:56:43.6045761Z  2024-12-18T00:56:43.6046154Z  2024-12-18T00:56:43.6046503Z  2024-12-18T00:56:43.6046870Z  2024-12-18T00:56:43.6047251Z  2024-12-18T00:56:43.6047599Z  2024-12-18T00:56:43.6048564Z [18,102 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:43.6049641Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:56:43.6050666Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:56:43.6051760Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2024-12-18T00:56:43.6052715Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2024-12-18T00:56:43.6053621Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2024-12-18T00:56:43.6054743Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:56:43.6055798Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2024-12-18T00:56:43.6056880Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local ... 2024-12-18T00:56:43.8376707Z 2024-12-18T00:56:43.8377585Z  2024-12-18T00:56:43.8378059Z  2024-12-18T00:56:43.8378846Z  2024-12-18T00:56:43.8379244Z  2024-12-18T00:56:43.8379654Z  2024-12-18T00:56:43.8380017Z  2024-12-18T00:56:43.8380378Z  2024-12-18T00:56:43.8380754Z  2024-12-18T00:56:43.8381678Z [18,102 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:43.8382772Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2024-12-18T00:56:43.8383969Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:43.8385106Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2024-12-18T00:56:43.8386021Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2024-12-18T00:56:43.8387017Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2024-12-18T00:56:43.8388112Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:56:43.8389108Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:56:43.8390347Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local ... 2024-12-18T00:56:44.0731814Z 2024-12-18T00:56:44.0732743Z  2024-12-18T00:56:44.0733222Z  2024-12-18T00:56:44.0733652Z  2024-12-18T00:56:44.0734061Z  2024-12-18T00:56:44.0734466Z  2024-12-18T00:56:44.0734862Z  2024-12-18T00:56:44.0735276Z  2024-12-18T00:56:44.0735804Z  2024-12-18T00:56:44.0736901Z [18,104 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:44.0737957Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:56:44.0738943Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:44.0740095Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:56:44.0741087Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:56:44.0742124Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2024-12-18T00:56:44.0743762Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:56:44.0745012Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:56:44.0745997Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local ... 2024-12-18T00:56:44.4382459Z 2024-12-18T00:56:44.4383313Z  2024-12-18T00:56:44.4383791Z  2024-12-18T00:56:44.4384180Z  2024-12-18T00:56:44.4384537Z  2024-12-18T00:56:44.4384900Z  2024-12-18T00:56:44.4385283Z  2024-12-18T00:56:44.4385659Z  2024-12-18T00:56:44.4386022Z  2024-12-18T00:56:44.4386886Z [18,104 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:44.4387935Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:56:44.4388913Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:44.4390055Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:56:44.4390941Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:56:44.4391864Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 16s local 2024-12-18T00:56:44.4392909Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:56:44.4393846Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2024-12-18T00:56:44.4394827Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local ... 2024-12-18T00:56:44.6608854Z 2024-12-18T00:56:44.6609721Z  2024-12-18T00:56:44.6610232Z  2024-12-18T00:56:44.6610643Z  2024-12-18T00:56:44.6611069Z  2024-12-18T00:56:44.6611484Z  2024-12-18T00:56:44.6611899Z  2024-12-18T00:56:44.6612284Z  2024-12-18T00:56:44.6612693Z  2024-12-18T00:56:44.6613691Z [18,106 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:44.6615111Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:56:44.6616094Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:44.6617363Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2024-12-18T00:56:44.6618299Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:56:44.6619306Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:56:44.6620419Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2024-12-18T00:56:44.6621321Z Compiling xla/service/dynamic_padder.cc; 14s local 2024-12-18T00:56:44.6622208Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 13s local ... 2024-12-18T00:56:44.9819694Z 2024-12-18T00:56:44.9820525Z  2024-12-18T00:56:44.9820979Z  2024-12-18T00:56:44.9821363Z  2024-12-18T00:56:44.9821766Z  2024-12-18T00:56:44.9822198Z  2024-12-18T00:56:44.9822596Z  2024-12-18T00:56:44.9823240Z  2024-12-18T00:56:44.9823648Z  2024-12-18T00:56:44.9824611Z [18,110 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:44.9825732Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2024-12-18T00:56:44.9826789Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:56:44.9827922Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:44.9828931Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:56:44.9829948Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:56:44.9831092Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2024-12-18T00:56:44.9832033Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:56:44.9833021Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local ... 2024-12-18T00:56:45.2388717Z 2024-12-18T00:56:45.2390032Z  2024-12-18T00:56:45.2390548Z  2024-12-18T00:56:45.2390949Z  2024-12-18T00:56:45.2391312Z  2024-12-18T00:56:45.2391705Z  2024-12-18T00:56:45.2392090Z  2024-12-18T00:56:45.2392577Z  2024-12-18T00:56:45.2392939Z  2024-12-18T00:56:45.2393904Z [18,111 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:45.2395022Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:56:45.2396050Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:56:45.2397132Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:45.2398089Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:56:45.2399078Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:56:45.2400279Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2024-12-18T00:56:45.2401265Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:56:45.2402236Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local ... 2024-12-18T00:56:45.4506848Z 2024-12-18T00:56:45.4507746Z  2024-12-18T00:56:45.4508233Z  2024-12-18T00:56:45.4508667Z  2024-12-18T00:56:45.4509030Z  2024-12-18T00:56:45.4509434Z  2024-12-18T00:56:45.4509810Z  2024-12-18T00:56:45.4510330Z  2024-12-18T00:56:45.4510704Z  2024-12-18T00:56:45.4511629Z [18,113 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:45.4512679Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:56:45.4513701Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:56:45.4514772Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:45.4515950Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:56:45.4516845Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:56:45.4517933Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2024-12-18T00:56:45.4518768Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:56:45.4519691Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local ... 2024-12-18T00:56:45.7157094Z 2024-12-18T00:56:45.7157851Z  2024-12-18T00:56:45.7158301Z  2024-12-18T00:56:45.7158668Z  2024-12-18T00:56:45.7159032Z  2024-12-18T00:56:45.7159402Z  2024-12-18T00:56:45.7159770Z  2024-12-18T00:56:45.7160136Z  2024-12-18T00:56:45.7160496Z  2024-12-18T00:56:45.7161329Z [18,115 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:45.7162306Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2024-12-18T00:56:45.7163544Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:56:45.7164531Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2024-12-18T00:56:45.7165404Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:56:45.7166312Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:56:45.7167217Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:56:45.7167990Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 14s local 2024-12-18T00:56:45.7168896Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 13s local ... 2024-12-18T00:56:46.0396004Z 2024-12-18T00:56:46.0396870Z  2024-12-18T00:56:46.0397343Z  2024-12-18T00:56:46.0397724Z  2024-12-18T00:56:46.0398103Z  2024-12-18T00:56:46.0398489Z  2024-12-18T00:56:46.0398870Z  2024-12-18T00:56:46.0399246Z  2024-12-18T00:56:46.0399669Z  2024-12-18T00:56:46.0400867Z [18,115 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:46.0402066Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:56:46.0402992Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:56:46.0403977Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:56:46.0404934Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:56:46.0405884Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:56:46.0406933Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:56:46.0407836Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local 2024-12-18T00:56:46.0408811Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local ... 2024-12-18T00:56:46.2731464Z 2024-12-18T00:56:46.2732302Z  2024-12-18T00:56:46.2732850Z  2024-12-18T00:56:46.2733246Z  2024-12-18T00:56:46.2733681Z  2024-12-18T00:56:46.2734050Z  2024-12-18T00:56:46.2734449Z  2024-12-18T00:56:46.2734842Z  2024-12-18T00:56:46.2735239Z  2024-12-18T00:56:46.2736161Z [18,117 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:46.2737395Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:56:46.2738381Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:56:46.2739493Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:56:46.2740464Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:56:46.2741462Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:56:46.2742346Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:56:46.2743193Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local 2024-12-18T00:56:46.2744751Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local ... 2024-12-18T00:56:46.6400243Z 2024-12-18T00:56:46.6401078Z  2024-12-18T00:56:46.6401503Z  2024-12-18T00:56:46.6401879Z  2024-12-18T00:56:46.6402274Z  2024-12-18T00:56:46.6402646Z  2024-12-18T00:56:46.6403029Z  2024-12-18T00:56:46.6403410Z  2024-12-18T00:56:46.6403795Z  2024-12-18T00:56:46.6404691Z [18,117 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:46.6405783Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:56:46.6406721Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:56:46.6407666Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:56:46.6408489Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:56:46.6409389Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:56:46.6410668Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:56:46.6411558Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local 2024-12-18T00:56:46.6412721Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local ... 2024-12-18T00:56:46.8403793Z 2024-12-18T00:56:46.8404625Z  2024-12-18T00:56:46.8405088Z  2024-12-18T00:56:46.8405513Z  2024-12-18T00:56:46.8405912Z  2024-12-18T00:56:46.8406313Z  2024-12-18T00:56:46.8406722Z  2024-12-18T00:56:46.8407040Z  2024-12-18T00:56:46.8407397Z  2024-12-18T00:56:46.8408314Z [18,118 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:46.8409396Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2024-12-18T00:56:46.8410431Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:56:46.8411860Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2024-12-18T00:56:46.8412974Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:56:46.8413960Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:56:46.8414930Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:56:46.8415760Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local 2024-12-18T00:56:46.8416876Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local ... 2024-12-18T00:56:47.4974690Z 2024-12-18T00:56:47.4975538Z  2024-12-18T00:56:47.4976003Z  2024-12-18T00:56:47.4976561Z  2024-12-18T00:56:47.4976961Z  2024-12-18T00:56:47.4977377Z  2024-12-18T00:56:47.4977779Z  2024-12-18T00:56:47.4978204Z  2024-12-18T00:56:47.4978604Z  2024-12-18T00:56:47.4979555Z [18,119 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:47.4980734Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2024-12-18T00:56:47.4981808Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:56:47.4982938Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:56:47.4983945Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2024-12-18T00:56:47.4984940Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:56:47.4985881Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:56:47.4986853Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local 2024-12-18T00:56:47.4987894Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local ... 2024-12-18T00:56:47.8410988Z 2024-12-18T00:56:47.8411865Z  2024-12-18T00:56:47.8412330Z  2024-12-18T00:56:47.8412695Z  2024-12-18T00:56:47.8413080Z  2024-12-18T00:56:47.8413465Z  2024-12-18T00:56:47.8414236Z  2024-12-18T00:56:47.8414620Z  2024-12-18T00:56:47.8415018Z  2024-12-18T00:56:47.8415918Z [18,120 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:47.8417135Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2024-12-18T00:56:47.8418148Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:56:47.8419116Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2024-12-18T00:56:47.8419980Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2024-12-18T00:56:47.8420918Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:56:47.8421851Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:56:47.8422727Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:56:47.8423733Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local ... 2024-12-18T00:56:48.0414692Z 2024-12-18T00:56:48.0415687Z  2024-12-18T00:56:48.0416641Z  2024-12-18T00:56:48.0417088Z  2024-12-18T00:56:48.0417467Z  2024-12-18T00:56:48.0417826Z  2024-12-18T00:56:48.0418214Z  2024-12-18T00:56:48.0418590Z  2024-12-18T00:56:48.0418977Z  2024-12-18T00:56:48.0419883Z [18,121 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:48.0421034Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:56:48.0422101Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:56:48.0423025Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:56:48.0423966Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:56:48.0424938Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:56:48.0425826Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:56:48.0427044Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2024-12-18T00:56:48.0428134Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local ... 2024-12-18T00:56:48.4418922Z 2024-12-18T00:56:48.4419727Z  2024-12-18T00:56:48.4420183Z  2024-12-18T00:56:48.4420542Z  2024-12-18T00:56:48.4420900Z  2024-12-18T00:56:48.4421230Z  2024-12-18T00:56:48.4421590Z  2024-12-18T00:56:48.4421936Z  2024-12-18T00:56:48.4422288Z  2024-12-18T00:56:48.4423124Z [18,122 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:48.4424147Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:56:48.4425100Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:56:48.4425935Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:56:48.4426850Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:56:48.4427736Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:56:48.4428512Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:56:48.4429344Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2024-12-18T00:56:48.4430190Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local ... 2024-12-18T00:56:48.6422006Z 2024-12-18T00:56:48.6422783Z  2024-12-18T00:56:48.6423192Z  2024-12-18T00:56:48.6423542Z  2024-12-18T00:56:48.6423894Z  2024-12-18T00:56:48.6424224Z  2024-12-18T00:56:48.6424570Z  2024-12-18T00:56:48.6424906Z  2024-12-18T00:56:48.6425253Z  2024-12-18T00:56:48.6426065Z [18,123 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:48.6427037Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:56:48.6428245Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2024-12-18T00:56:48.6429087Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:56:48.6429973Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:56:48.6430821Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:56:48.6431551Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local 2024-12-18T00:56:48.6432373Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2024-12-18T00:56:48.6433216Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local ... 2024-12-18T00:56:49.3902641Z 2024-12-18T00:56:49.3903511Z  2024-12-18T00:56:49.3904003Z  2024-12-18T00:56:49.3904397Z  2024-12-18T00:56:49.3904800Z  2024-12-18T00:56:49.3905191Z  2024-12-18T00:56:49.3905592Z  2024-12-18T00:56:49.3906109Z  2024-12-18T00:56:49.3906450Z  2024-12-18T00:56:49.3907676Z [18,124 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:49.3908756Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:56:49.3909857Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:56:49.3910795Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:56:49.3911779Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:56:49.3912693Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:56:49.3913595Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2024-12-18T00:56:49.3914516Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2024-12-18T00:56:49.3915337Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local ... 2024-12-18T00:56:49.6430040Z 2024-12-18T00:56:49.6430905Z  2024-12-18T00:56:49.6431407Z  2024-12-18T00:56:49.6431779Z  2024-12-18T00:56:49.6432166Z  2024-12-18T00:56:49.6432925Z  2024-12-18T00:56:49.6433320Z  2024-12-18T00:56:49.6433754Z  2024-12-18T00:56:49.6434169Z  2024-12-18T00:56:49.6435113Z [18,124 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:49.6436241Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:56:49.6437229Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:56:49.6438252Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:56:49.6439191Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:56:49.6440165Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:56:49.6441031Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2024-12-18T00:56:49.6441985Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2024-12-18T00:56:49.6442940Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local ... 2024-12-18T00:56:49.8433625Z 2024-12-18T00:56:49.8434488Z  2024-12-18T00:56:49.8434928Z  2024-12-18T00:56:49.8435290Z  2024-12-18T00:56:49.8435665Z  2024-12-18T00:56:49.8436049Z  2024-12-18T00:56:49.8436397Z  2024-12-18T00:56:49.8436815Z  2024-12-18T00:56:49.8437239Z  2024-12-18T00:56:49.8438166Z [18,125 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:49.8439342Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:49.8440516Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2024-12-18T00:56:49.8441470Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:56:49.8442459Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:56:49.8443632Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:56:49.8444600Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2024-12-18T00:56:49.8445360Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2024-12-18T00:56:49.8446312Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local ... 2024-12-18T00:56:50.0686356Z 2024-12-18T00:56:50.0687235Z  2024-12-18T00:56:50.0687703Z  2024-12-18T00:56:50.0688097Z  2024-12-18T00:56:50.0688475Z  2024-12-18T00:56:50.0688857Z  2024-12-18T00:56:50.0689244Z  2024-12-18T00:56:50.0689638Z  2024-12-18T00:56:50.0690000Z  2024-12-18T00:56:50.0690711Z [18,126 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:50.0691695Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:50.0692586Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:56:50.0693849Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:56:50.0694597Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:56:50.0695330Z Compiling xla/service/dynamic_padder.cc; 20s local 2024-12-18T00:56:50.0695984Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2024-12-18T00:56:50.0696999Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2024-12-18T00:56:50.0697961Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local ... 2024-12-18T00:56:50.2913709Z 2024-12-18T00:56:50.2914580Z  2024-12-18T00:56:50.2915047Z  2024-12-18T00:56:50.2915430Z  2024-12-18T00:56:50.2915827Z  2024-12-18T00:56:50.2916219Z  2024-12-18T00:56:50.2916610Z  2024-12-18T00:56:50.2916962Z  2024-12-18T00:56:50.2917332Z  2024-12-18T00:56:50.2918373Z [18,129 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:50.2919834Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:50.2921015Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:56:50.2921963Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:56:50.2922900Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2024-12-18T00:56:50.2923882Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2024-12-18T00:56:50.2924870Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:56:50.2925927Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:50.2927020Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 15s local ... 2024-12-18T00:56:50.6439724Z 2024-12-18T00:56:50.6440568Z  2024-12-18T00:56:50.6441051Z  2024-12-18T00:56:50.6441416Z  2024-12-18T00:56:50.6441798Z  2024-12-18T00:56:50.6442225Z  2024-12-18T00:56:50.6442590Z  2024-12-18T00:56:50.6442970Z  2024-12-18T00:56:50.6443353Z  2024-12-18T00:56:50.6444467Z [18,129 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:50.6445560Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:50.6446608Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:56:50.6447555Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:56:50.6448429Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2024-12-18T00:56:50.6449386Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2024-12-18T00:56:50.6450305Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:56:50.6451271Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:50.6452346Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local ... 2024-12-18T00:56:50.8443084Z 2024-12-18T00:56:50.8444017Z  2024-12-18T00:56:50.8444783Z  2024-12-18T00:56:50.8445182Z  2024-12-18T00:56:50.8445556Z  2024-12-18T00:56:50.8445900Z  2024-12-18T00:56:50.8446409Z  2024-12-18T00:56:50.8446768Z  2024-12-18T00:56:50.8447167Z  2024-12-18T00:56:50.8448077Z [18,130 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:50.8449252Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:56:50.8450335Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2024-12-18T00:56:50.8451296Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:56:50.8452242Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 20s local 2024-12-18T00:56:50.8453202Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2024-12-18T00:56:50.8454186Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:56:50.8455578Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:50.8456862Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local ... 2024-12-18T00:56:51.0800489Z 2024-12-18T00:56:51.0801340Z  2024-12-18T00:56:51.0801838Z  2024-12-18T00:56:51.0802233Z  2024-12-18T00:56:51.0802604Z  2024-12-18T00:56:51.0802924Z  2024-12-18T00:56:51.0803266Z  2024-12-18T00:56:51.0803635Z  2024-12-18T00:56:51.0803990Z  2024-12-18T00:56:51.0804878Z [18,133 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:51.0806018Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:56:51.0807137Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:51.0808036Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:56:51.0809275Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:56:51.0810391Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:56:51.0811388Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:51.0812476Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local 2024-12-18T00:56:51.0813572Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local ... 2024-12-18T00:56:51.3635639Z 2024-12-18T00:56:51.3636520Z  2024-12-18T00:56:51.3636972Z  2024-12-18T00:56:51.3637351Z  2024-12-18T00:56:51.3637741Z  2024-12-18T00:56:51.3638129Z  2024-12-18T00:56:51.3638499Z  2024-12-18T00:56:51.3638886Z  2024-12-18T00:56:51.3639268Z  2024-12-18T00:56:51.3640113Z [18,134 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:51.3641260Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:56:51.3642353Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:51.3643351Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:56:51.3644511Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:56:51.3645500Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:56:51.3646565Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:56:51.3647532Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local 2024-12-18T00:56:51.3648609Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local ... 2024-12-18T00:56:51.6450297Z 2024-12-18T00:56:51.6451218Z  2024-12-18T00:56:51.6451678Z  2024-12-18T00:56:51.6452074Z  2024-12-18T00:56:51.6452461Z  2024-12-18T00:56:51.6452826Z  2024-12-18T00:56:51.6453210Z  2024-12-18T00:56:51.6453910Z  2024-12-18T00:56:51.6454295Z  2024-12-18T00:56:51.6455263Z [18,135 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:51.6456541Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:56:51.6457611Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:51.6458567Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:56:51.6459439Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:56:51.6460402Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:56:51.6461405Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:56:51.6462419Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:51.6463503Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local ... 2024-12-18T00:56:51.8453630Z 2024-12-18T00:56:51.8454473Z  2024-12-18T00:56:51.8454961Z  2024-12-18T00:56:51.8455628Z  2024-12-18T00:56:51.8456020Z  2024-12-18T00:56:51.8456331Z  2024-12-18T00:56:51.8456882Z  2024-12-18T00:56:51.8457267Z  2024-12-18T00:56:51.8457642Z  2024-12-18T00:56:51.8458525Z [18,136 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:51.8459734Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:56:51.8460806Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2024-12-18T00:56:51.8461721Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:56:51.8462579Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:56:51.8463542Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:56:51.8464541Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:56:51.8465839Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:51.8466753Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local ... 2024-12-18T00:56:52.1976171Z 2024-12-18T00:56:52.1977416Z  2024-12-18T00:56:52.1977899Z  2024-12-18T00:56:52.1978323Z  2024-12-18T00:56:52.1978704Z  2024-12-18T00:56:52.1979090Z  2024-12-18T00:56:52.1979480Z  2024-12-18T00:56:52.1979859Z  2024-12-18T00:56:52.1980234Z  2024-12-18T00:56:52.1981138Z [18,137 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:52.1982309Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:56:52.1983487Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:56:52.1984544Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:56:52.1985366Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:56:52.1986350Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:56:52.1987347Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:56:52.1988349Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:52.1989404Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local ... 2024-12-18T00:56:52.4459157Z 2024-12-18T00:56:52.4460002Z  2024-12-18T00:56:52.4460422Z  2024-12-18T00:56:52.4460810Z  2024-12-18T00:56:52.4461178Z  2024-12-18T00:56:52.4461562Z  2024-12-18T00:56:52.4461927Z  2024-12-18T00:56:52.4462317Z  2024-12-18T00:56:52.4462699Z  2024-12-18T00:56:52.4463631Z [18,138 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:52.4464767Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:56:52.4466130Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:56:52.4467100Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:56:52.4467990Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:56:52.4468904Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:56:52.4469857Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:56:52.4480918Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2024-12-18T00:56:52.4482040Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local ... 2024-12-18T00:56:52.6586873Z 2024-12-18T00:56:52.6587759Z  2024-12-18T00:56:52.6588264Z  2024-12-18T00:56:52.6588661Z  2024-12-18T00:56:52.6589041Z  2024-12-18T00:56:52.6589442Z  2024-12-18T00:56:52.6589805Z  2024-12-18T00:56:52.6590186Z  2024-12-18T00:56:52.6590559Z  2024-12-18T00:56:52.6591740Z [18,139 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:52.6592913Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:56:52.6593983Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2024-12-18T00:56:52.6594919Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:56:52.6595796Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:56:52.6596784Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:56:52.6597783Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:56:52.6598822Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:56:52.6599909Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local ... 2024-12-18T00:56:53.0464208Z 2024-12-18T00:56:53.0465077Z  2024-12-18T00:56:53.0465718Z  2024-12-18T00:56:53.0466117Z  2024-12-18T00:56:53.0466897Z  2024-12-18T00:56:53.0467252Z  2024-12-18T00:56:53.0467610Z  2024-12-18T00:56:53.0467970Z  2024-12-18T00:56:53.0468339Z  2024-12-18T00:56:53.0469189Z [18,139 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:53.0470272Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2024-12-18T00:56:53.0471298Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:56:53.0472214Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:56:53.0473049Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2024-12-18T00:56:53.0473978Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:56:53.0474964Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:56:53.0476138Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2024-12-18T00:56:53.0477336Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local ... 2024-12-18T00:56:53.8634152Z 2024-12-18T00:56:53.8634985Z  2024-12-18T00:56:53.8635414Z  2024-12-18T00:56:53.8635769Z  2024-12-18T00:56:53.8636124Z  2024-12-18T00:56:53.8636458Z  2024-12-18T00:56:53.8636802Z  2024-12-18T00:56:53.8637145Z  2024-12-18T00:56:53.8637479Z  2024-12-18T00:56:53.8638407Z [18,140 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:53.8639330Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:56:53.8640216Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2024-12-18T00:56:53.8641035Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:56:53.8641785Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2024-12-18T00:56:53.8642982Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2024-12-18T00:56:53.8643956Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:56:53.8645159Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:56:53.8646136Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local ... 2024-12-18T00:56:54.1221090Z 2024-12-18T00:56:54.1221955Z  2024-12-18T00:56:54.1222370Z  2024-12-18T00:56:54.1222704Z  2024-12-18T00:56:54.1223048Z  2024-12-18T00:56:54.1223386Z  2024-12-18T00:56:54.1223719Z  2024-12-18T00:56:54.1224052Z  2024-12-18T00:56:54.1224400Z  2024-12-18T00:56:54.1225187Z [18,143 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:54.1226163Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:56:54.1227088Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2024-12-18T00:56:54.1228189Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:56:54.1228970Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:56:54.1229783Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2024-12-18T00:56:54.1230645Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:56:54.1231524Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:56:54.1232440Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local ... 2024-12-18T00:56:54.4472826Z 2024-12-18T00:56:54.4473620Z  2024-12-18T00:56:54.4474006Z  2024-12-18T00:56:54.4474315Z  2024-12-18T00:56:54.4474623Z  2024-12-18T00:56:54.4474916Z  2024-12-18T00:56:54.4475225Z  2024-12-18T00:56:54.4475533Z  2024-12-18T00:56:54.4475835Z  2024-12-18T00:56:54.4476569Z [18,144 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:54.4477807Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:56:54.4478617Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2024-12-18T00:56:54.4479333Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:56:54.4479992Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:56:54.4480705Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2024-12-18T00:56:54.4481442Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:56:54.4482217Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2024-12-18T00:56:54.4483016Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local ... 2024-12-18T00:56:54.7890737Z 2024-12-18T00:56:54.7891559Z  2024-12-18T00:56:54.7892011Z  2024-12-18T00:56:54.7892369Z  2024-12-18T00:56:54.7892727Z  2024-12-18T00:56:54.7893062Z  2024-12-18T00:56:54.7893492Z  2024-12-18T00:56:54.7893864Z  2024-12-18T00:56:54.7894216Z  2024-12-18T00:56:54.7895117Z [18,147 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:54.7896494Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:56:54.7897624Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2024-12-18T00:56:54.7898531Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:56:54.7899369Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:56:54.7900311Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:56:54.7901340Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:56:54.7902371Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:56:54.7903858Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local ... 2024-12-18T00:56:55.0011801Z 2024-12-18T00:56:55.0012646Z  2024-12-18T00:56:55.0013075Z  2024-12-18T00:56:55.0013412Z  2024-12-18T00:56:55.0013762Z  2024-12-18T00:56:55.0014109Z  2024-12-18T00:56:55.0014446Z  2024-12-18T00:56:55.0014778Z  2024-12-18T00:56:55.0015125Z  2024-12-18T00:56:55.0015942Z [18,148 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:55.0017149Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:56:55.0018085Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:56:55.0018887Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:56:55.0019667Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:56:55.0020507Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:56:55.0021697Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:56:55.0022647Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:56:55.0023618Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local ... 2024-12-18T00:56:55.2479038Z 2024-12-18T00:56:55.2479870Z  2024-12-18T00:56:55.2480350Z  2024-12-18T00:56:55.2480723Z  2024-12-18T00:56:55.2481096Z  2024-12-18T00:56:55.2481457Z  2024-12-18T00:56:55.2481836Z  2024-12-18T00:56:55.2482227Z  2024-12-18T00:56:55.2482597Z  2024-12-18T00:56:55.2483504Z [18,148 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:55.2484623Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:56:55.2485686Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:56:55.2486656Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:56:55.2487987Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:56:55.2488928Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:56:55.2489895Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:56:55.2491031Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2024-12-18T00:56:55.2492138Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local ... 2024-12-18T00:56:55.6456114Z 2024-12-18T00:56:55.6457186Z  2024-12-18T00:56:55.6457674Z  2024-12-18T00:56:55.6458053Z  2024-12-18T00:56:55.6458440Z  2024-12-18T00:56:55.6458830Z  2024-12-18T00:56:55.6459340Z  2024-12-18T00:56:55.6459716Z  2024-12-18T00:56:55.6460067Z  2024-12-18T00:56:55.6460969Z [18,149 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:55.6462072Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:56:55.6463165Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:56:55.6464090Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:56:55.6464902Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:56:55.6465872Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:56:55.6466843Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:56:55.6467842Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:56:55.6468912Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local ... 2024-12-18T00:56:55.8484472Z 2024-12-18T00:56:55.8485340Z  2024-12-18T00:56:55.8485841Z  2024-12-18T00:56:55.8486218Z  2024-12-18T00:56:55.8486606Z  2024-12-18T00:56:55.8487324Z  2024-12-18T00:56:55.8487700Z  2024-12-18T00:56:55.8488063Z  2024-12-18T00:56:55.8488492Z  2024-12-18T00:56:55.8489422Z [18,150 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:55.8490575Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:56:55.8491656Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2024-12-18T00:56:55.8492612Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:56:55.8493494Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:56:55.8494467Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:56:55.8495518Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:56:55.8496731Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:56:55.8497944Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local ... 2024-12-18T00:56:56.5545240Z 2024-12-18T00:56:56.5546416Z  2024-12-18T00:56:56.5546885Z  2024-12-18T00:56:56.5547246Z  2024-12-18T00:56:56.5547608Z  2024-12-18T00:56:56.5547984Z  2024-12-18T00:56:56.5548352Z  2024-12-18T00:56:56.5548702Z  2024-12-18T00:56:56.5549061Z  2024-12-18T00:56:56.5549918Z [18,151 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:56.5551061Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:56:56.5552183Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:56:56.5552998Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:56:56.5553926Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:56:56.5554978Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:56:56.5555994Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2024-12-18T00:56:56.5557293Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2024-12-18T00:56:56.5558180Z Compiling xla/service/topk_rewriter.cc; 16s local ... 2024-12-18T00:56:56.8489230Z 2024-12-18T00:56:56.8490151Z  2024-12-18T00:56:56.8490659Z  2024-12-18T00:56:56.8491087Z  2024-12-18T00:56:56.8491527Z  2024-12-18T00:56:56.8491936Z  2024-12-18T00:56:56.8492276Z  2024-12-18T00:56:56.8492626Z  2024-12-18T00:56:56.8492980Z  2024-12-18T00:56:56.8493850Z [18,152 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:56.8494975Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:56:56.8496040Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2024-12-18T00:56:56.8497243Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:56:56.8498215Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:56:56.8499217Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2024-12-18T00:56:56.8500296Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:56:56.8501205Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2024-12-18T00:56:56.8501992Z Compiling xla/service/topk_rewriter.cc; 16s local ... 2024-12-18T00:56:57.2040236Z 2024-12-18T00:56:57.2041118Z  2024-12-18T00:56:57.2041656Z  2024-12-18T00:56:57.2042090Z  2024-12-18T00:56:57.2042517Z  2024-12-18T00:56:57.2042922Z  2024-12-18T00:56:57.2043275Z  2024-12-18T00:56:57.2043613Z  2024-12-18T00:56:57.2043956Z  2024-12-18T00:56:57.2044982Z [18,153 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:57.2045963Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:56:57.2047223Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:56:57.2048194Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:56:57.2048965Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:56:57.2049813Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2024-12-18T00:56:57.2050708Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:56:57.2051611Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:56:57.2052429Z Compiling xla/service/topk_rewriter.cc; 17s local ... 2024-12-18T00:56:57.4495007Z 2024-12-18T00:56:57.4496027Z  2024-12-18T00:56:57.4496694Z  2024-12-18T00:56:57.4497137Z  2024-12-18T00:56:57.4497549Z  2024-12-18T00:56:57.4497966Z  2024-12-18T00:56:57.4498315Z  2024-12-18T00:56:57.4498673Z  2024-12-18T00:56:57.4499052Z  2024-12-18T00:56:57.4500116Z [18,155 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:57.4501147Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:56:57.4502084Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:56:57.4502948Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:56:57.4503742Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:56:57.4504591Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2024-12-18T00:56:57.4505502Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2024-12-18T00:56:57.4506466Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:56:57.4507306Z Compiling xla/service/topk_rewriter.cc; 17s local ... 2024-12-18T00:56:57.7386553Z 2024-12-18T00:56:57.7387437Z  2024-12-18T00:56:57.7388002Z  2024-12-18T00:56:57.7388462Z  2024-12-18T00:56:57.7388906Z  2024-12-18T00:56:57.7389611Z  2024-12-18T00:56:57.7389942Z  2024-12-18T00:56:57.7390292Z  2024-12-18T00:56:57.7390755Z  2024-12-18T00:56:57.7391601Z [18,157 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:57.7392645Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:56:57.7393714Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2024-12-18T00:56:57.7394780Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:56:57.7395735Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:56:57.7396652Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:56:57.7397604Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2024-12-18T00:56:57.7398612Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:56:57.7399496Z Compiling xla/service/topk_rewriter.cc; 17s local ... 2024-12-18T00:56:57.9511266Z 2024-12-18T00:56:57.9512193Z  2024-12-18T00:56:57.9512730Z  2024-12-18T00:56:57.9513158Z  2024-12-18T00:56:57.9513577Z  2024-12-18T00:56:57.9513974Z  2024-12-18T00:56:57.9514334Z  2024-12-18T00:56:57.9514729Z  2024-12-18T00:56:57.9515121Z  2024-12-18T00:56:57.9516025Z [18,158 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:57.9517190Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:56:57.9518323Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:56:57.9519351Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:56:57.9520263Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:56:57.9521601Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:56:57.9522703Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2024-12-18T00:56:57.9523597Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:56:57.9524454Z Compiling xla/service/topk_rewriter.cc; 17s local ... 2024-12-18T00:56:58.2501824Z 2024-12-18T00:56:58.2502759Z  2024-12-18T00:56:58.2503279Z  2024-12-18T00:56:58.2503717Z  2024-12-18T00:56:58.2504154Z  2024-12-18T00:56:58.2504558Z  2024-12-18T00:56:58.2504941Z  2024-12-18T00:56:58.2505313Z  2024-12-18T00:56:58.2505699Z  2024-12-18T00:56:58.2506611Z [18,159 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:58.2507801Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:56:58.2508888Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:56:58.2510134Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:56:58.2511109Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:56:58.2512080Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:56:58.2513071Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:56:58.2514022Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:56:58.2514758Z @llvm-project//llvm:CodeGen; 18s local ... 2024-12-18T00:56:58.6333478Z 2024-12-18T00:56:58.6334318Z  2024-12-18T00:56:58.6334863Z  2024-12-18T00:56:58.6335311Z  2024-12-18T00:56:58.6335760Z  2024-12-18T00:56:58.6336202Z  2024-12-18T00:56:58.6336670Z  2024-12-18T00:56:58.6337048Z  2024-12-18T00:56:58.6337434Z  2024-12-18T00:56:58.6338343Z [18,161 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:58.6339823Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:56:58.6343181Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:56:58.6344106Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:56:58.6345228Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:56:58.6346167Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:56:58.6347174Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:56:58.6348082Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:56:58.6348806Z @llvm-project//llvm:CodeGen; 18s local ... 2024-12-18T00:56:58.8507133Z 2024-12-18T00:56:58.8508066Z  2024-12-18T00:56:58.8508598Z  2024-12-18T00:56:58.8509034Z  2024-12-18T00:56:58.8509470Z  2024-12-18T00:56:58.8509872Z  2024-12-18T00:56:58.8510229Z  2024-12-18T00:56:58.8510607Z  2024-12-18T00:56:58.8510966Z  2024-12-18T00:56:58.8511830Z [18,161 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:58.8512904Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:56:58.8513988Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2024-12-18T00:56:58.8514867Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:56:58.8515713Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:56:58.8516656Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:56:58.8517654Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:56:58.8518560Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:56:58.8519251Z @llvm-project//llvm:CodeGen; 18s local ... 2024-12-18T00:56:59.0756466Z 2024-12-18T00:56:59.0757335Z  2024-12-18T00:56:59.0758153Z  2024-12-18T00:56:59.0758603Z  2024-12-18T00:56:59.0759071Z  2024-12-18T00:56:59.0759452Z  2024-12-18T00:56:59.0759826Z  2024-12-18T00:56:59.0760188Z  2024-12-18T00:56:59.0760562Z  2024-12-18T00:56:59.0761441Z [18,162 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:59.0762455Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:56:59.0763568Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:56:59.0764479Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:56:59.0765234Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:56:59.0766006Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:56:59.0766932Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:56:59.0767884Z Compiling xla/service/topk_rewriter.cc; 18s local 2024-12-18T00:56:59.0768838Z @llvm-project//llvm:CodeGen; 18s local ... 2024-12-18T00:56:59.4512134Z 2024-12-18T00:56:59.4513053Z  2024-12-18T00:56:59.4513615Z  2024-12-18T00:56:59.4514066Z  2024-12-18T00:56:59.4514503Z  2024-12-18T00:56:59.4514926Z  2024-12-18T00:56:59.4515284Z  2024-12-18T00:56:59.4515647Z  2024-12-18T00:56:59.4516015Z  2024-12-18T00:56:59.4516896Z [18,162 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:56:59.4518000Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:56:59.4519029Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:56:59.4520073Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:56:59.4521007Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:56:59.4522028Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:56:59.4523534Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:56:59.4524503Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:56:59.4525277Z @llvm-project//llvm:CodeGen; 19s local ... 2024-12-18T00:56:59.6533581Z 2024-12-18T00:56:59.6534480Z  2024-12-18T00:56:59.6535032Z  2024-12-18T00:56:59.6535477Z  2024-12-18T00:56:59.6535919Z  2024-12-18T00:56:59.6536482Z  2024-12-18T00:56:59.6536878Z  2024-12-18T00:56:59.6537278Z  2024-12-18T00:56:59.6537638Z  2024-12-18T00:56:59.6538611Z [18,163 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:59.6539847Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:56:59.6541211Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2024-12-18T00:56:59.6542321Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:56:59.6543346Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:56:59.6544598Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:56:59.6545728Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:56:59.6546662Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:56:59.6547387Z @llvm-project//llvm:CodeGen; 19s local ... 2024-12-18T00:56:59.9421522Z 2024-12-18T00:56:59.9422400Z  2024-12-18T00:56:59.9422938Z  2024-12-18T00:56:59.9423379Z  2024-12-18T00:56:59.9423791Z  2024-12-18T00:56:59.9424221Z  2024-12-18T00:56:59.9424650Z  2024-12-18T00:56:59.9425077Z  2024-12-18T00:56:59.9425667Z  2024-12-18T00:56:59.9426581Z [18,166 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:56:59.9427766Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:56:59.9429227Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:56:59.9430260Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:56:59.9431220Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:56:59.9432232Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:56:59.9433302Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:56:59.9434245Z Compiling xla/service/topk_rewriter.cc; 19s local 2024-12-18T00:56:59.9435256Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2024-12-18T00:57:00.2518823Z 2024-12-18T00:57:00.2519843Z  2024-12-18T00:57:00.2520360Z  2024-12-18T00:57:00.2520793Z  2024-12-18T00:57:00.2521226Z  2024-12-18T00:57:00.2521640Z  2024-12-18T00:57:00.2522034Z  2024-12-18T00:57:00.2522480Z  2024-12-18T00:57:00.2522947Z  2024-12-18T00:57:00.2524264Z [18,166 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:00.2525467Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:57:00.2526536Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:57:00.2527661Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:57:00.2528593Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:57:00.2529570Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:57:00.2530584Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:57:00.2531504Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:57:00.2532461Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2024-12-18T00:57:00.4522102Z 2024-12-18T00:57:00.4523084Z  2024-12-18T00:57:00.4523611Z  2024-12-18T00:57:00.4525373Z  2024-12-18T00:57:00.4526528Z  2024-12-18T00:57:00.4527180Z  2024-12-18T00:57:00.4527756Z  2024-12-18T00:57:00.4528288Z  2024-12-18T00:57:00.4528828Z  2024-12-18T00:57:00.4529933Z [18,167 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:00.4531309Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:57:00.4532640Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:57:00.4533779Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:57:00.4534883Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:57:00.4536090Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:57:00.4537481Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:57:00.4538590Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:57:00.4539727Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2024-12-18T00:57:00.8529759Z 2024-12-18T00:57:00.8530613Z  2024-12-18T00:57:00.8531092Z  2024-12-18T00:57:00.8531484Z  2024-12-18T00:57:00.8531821Z  2024-12-18T00:57:00.8532149Z  2024-12-18T00:57:00.8532532Z  2024-12-18T00:57:00.8532924Z  2024-12-18T00:57:00.8533323Z  2024-12-18T00:57:00.8534279Z [18,168 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:00.8535478Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:57:00.8536753Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2024-12-18T00:57:00.8537723Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:57:00.8538650Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:57:00.8539980Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:57:00.8540955Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:57:00.8541912Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2024-12-18T00:57:00.8542890Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:57:01.0533380Z 2024-12-18T00:57:01.0534277Z  2024-12-18T00:57:01.0534720Z  2024-12-18T00:57:01.0535099Z  2024-12-18T00:57:01.0535472Z  2024-12-18T00:57:01.0535978Z  2024-12-18T00:57:01.0536336Z  2024-12-18T00:57:01.0536833Z  2024-12-18T00:57:01.0537221Z  2024-12-18T00:57:01.0538136Z [18,169 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:01.0539196Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:57:01.0540270Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:57:01.0541573Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:57:01.0542478Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2024-12-18T00:57:01.0543463Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:57:01.0544577Z Compiling xla/service/topk_rewriter.cc; 20s local 2024-12-18T00:57:01.0545511Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2024-12-18T00:57:01.0546454Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:57:01.2711930Z 2024-12-18T00:57:01.2712783Z  2024-12-18T00:57:01.2713284Z  2024-12-18T00:57:01.2713698Z  2024-12-18T00:57:01.2714079Z  2024-12-18T00:57:01.2714480Z  2024-12-18T00:57:01.2714877Z  2024-12-18T00:57:01.2715281Z  2024-12-18T00:57:01.2715660Z  2024-12-18T00:57:01.2716496Z [18,171 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:01.2717881Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:57:01.2719125Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:57:01.2720056Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:57:01.2720950Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2024-12-18T00:57:01.2721934Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:57:01.2722817Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:57:01.2723735Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2024-12-18T00:57:01.2724853Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local ... 2024-12-18T00:57:01.6539537Z 2024-12-18T00:57:01.6540339Z  2024-12-18T00:57:01.6540813Z  2024-12-18T00:57:01.6541200Z  2024-12-18T00:57:01.6541622Z  2024-12-18T00:57:01.6542014Z  2024-12-18T00:57:01.6542458Z  2024-12-18T00:57:01.6542861Z  2024-12-18T00:57:01.6543285Z  2024-12-18T00:57:01.6544494Z [18,174 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:01.6545763Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:57:01.6546976Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2024-12-18T00:57:01.6548028Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:57:01.6548979Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2024-12-18T00:57:01.6550072Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:57:01.6551089Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:57:01.6552095Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2024-12-18T00:57:01.6553334Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local ... 2024-12-18T00:57:02.0749563Z 2024-12-18T00:57:02.0750429Z  2024-12-18T00:57:02.0751013Z  2024-12-18T00:57:02.0751387Z  2024-12-18T00:57:02.0751782Z  2024-12-18T00:57:02.0752182Z  2024-12-18T00:57:02.0752542Z  2024-12-18T00:57:02.0752929Z  2024-12-18T00:57:02.0753336Z  2024-12-18T00:57:02.0754252Z [18,175 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:02.0755430Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:57:02.0756523Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:57:02.0757453Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:57:02.0758341Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:57:02.0759377Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:57:02.0760306Z Compiling xla/service/topk_rewriter.cc; 21s local 2024-12-18T00:57:02.0761614Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2024-12-18T00:57:02.0762719Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local ... 2024-12-18T00:57:02.4546200Z 2024-12-18T00:57:02.4547030Z  2024-12-18T00:57:02.4547506Z  2024-12-18T00:57:02.4547911Z  2024-12-18T00:57:02.4548320Z  2024-12-18T00:57:02.4548706Z  2024-12-18T00:57:02.4549110Z  2024-12-18T00:57:02.4549511Z  2024-12-18T00:57:02.4549911Z  2024-12-18T00:57:02.4550953Z [18,175 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:02.4552105Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:57:02.4553188Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:57:02.4554153Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:57:02.4555056Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:57:02.4556439Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:57:02.4557340Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:57:02.4558234Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2024-12-18T00:57:02.4559304Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local ... 2024-12-18T00:57:02.7489636Z 2024-12-18T00:57:02.7490525Z  2024-12-18T00:57:02.7491026Z  2024-12-18T00:57:02.7491409Z  2024-12-18T00:57:02.7491790Z  2024-12-18T00:57:02.7492143Z  2024-12-18T00:57:02.7492477Z  2024-12-18T00:57:02.7492843Z  2024-12-18T00:57:02.7493203Z  2024-12-18T00:57:02.7494121Z [18,176 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:02.7495373Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:57:02.7496616Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2024-12-18T00:57:02.7497658Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:57:02.7498514Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:57:02.7499429Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:57:02.7500295Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:57:02.7501182Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2024-12-18T00:57:02.7502303Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local ... 2024-12-18T00:57:03.0552206Z 2024-12-18T00:57:03.0553046Z  2024-12-18T00:57:03.0553481Z  2024-12-18T00:57:03.0553895Z  2024-12-18T00:57:03.0554279Z  2024-12-18T00:57:03.0554673Z  2024-12-18T00:57:03.0555072Z  2024-12-18T00:57:03.0555443Z  2024-12-18T00:57:03.0556174Z  2024-12-18T00:57:03.0557246Z [18,177 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:03.0558404Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:57:03.0559470Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:57:03.0560435Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:03.0561296Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:57:03.0562156Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:57:03.0562899Z Compiling xla/service/topk_rewriter.cc; 22s local 2024-12-18T00:57:03.0563609Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2024-12-18T00:57:03.0564513Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local ... 2024-12-18T00:57:03.2554516Z 2024-12-18T00:57:03.2555407Z  2024-12-18T00:57:03.2555878Z  2024-12-18T00:57:03.2556237Z  2024-12-18T00:57:03.2556835Z  2024-12-18T00:57:03.2557189Z  2024-12-18T00:57:03.2557535Z  2024-12-18T00:57:03.2557865Z  2024-12-18T00:57:03.2558188Z  2024-12-18T00:57:03.2558977Z [18,179 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:03.2559896Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:57:03.2560797Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:57:03.2561596Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:03.2562320Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:57:03.2563171Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:57:03.2564055Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2024-12-18T00:57:03.2564964Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local 2024-12-18T00:57:03.2568328Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 15s local ... 2024-12-18T00:57:03.6272481Z 2024-12-18T00:57:03.6273098Z  2024-12-18T00:57:03.6273538Z  2024-12-18T00:57:03.6273933Z  2024-12-18T00:57:03.6274295Z  2024-12-18T00:57:03.6274694Z  2024-12-18T00:57:03.6275106Z  2024-12-18T00:57:03.6275491Z  2024-12-18T00:57:03.6275844Z  2024-12-18T00:57:03.6276817Z [18,180 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:03.6277926Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:57:03.6278970Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:57:03.6279827Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:03.6280520Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:57:03.6281435Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:57:03.6282473Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2024-12-18T00:57:03.6283264Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 16s local 2024-12-18T00:57:03.6284114Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 15s local ... 2024-12-18T00:57:03.8560002Z 2024-12-18T00:57:03.8560893Z  2024-12-18T00:57:03.8561345Z  2024-12-18T00:57:03.8561736Z  2024-12-18T00:57:03.8562111Z  2024-12-18T00:57:03.8562497Z  2024-12-18T00:57:03.8562888Z  2024-12-18T00:57:03.8563268Z  2024-12-18T00:57:03.8563628Z  2024-12-18T00:57:03.8564539Z [18,182 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:03.8565715Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:57:03.8567060Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2024-12-18T00:57:03.8568007Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:03.8568875Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:57:03.8569862Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:57:03.8570934Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2024-12-18T00:57:03.8572001Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 16s local 2024-12-18T00:57:03.8572979Z Compiling xla/service/dynamic_padder.cc; 13s local ... 2024-12-18T00:57:04.0906051Z 2024-12-18T00:57:04.0906924Z  2024-12-18T00:57:04.0907373Z  2024-12-18T00:57:04.0907773Z  2024-12-18T00:57:04.0908154Z  2024-12-18T00:57:04.0908538Z  2024-12-18T00:57:04.0908925Z  2024-12-18T00:57:04.0909300Z  2024-12-18T00:57:04.0909690Z  2024-12-18T00:57:04.0910985Z [18,183 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:04.0912166Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:57:04.0913243Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:57:04.0914182Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:57:04.0915064Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:57:04.0916055Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:57:04.0917111Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2024-12-18T00:57:04.0918204Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 16s local 2024-12-18T00:57:04.0919153Z Compiling xla/service/dynamic_padder.cc; 13s local ... 2024-12-18T00:57:04.4565147Z 2024-12-18T00:57:04.4565979Z  2024-12-18T00:57:04.4566502Z  2024-12-18T00:57:04.4566876Z  2024-12-18T00:57:04.4567228Z  2024-12-18T00:57:04.4567584Z  2024-12-18T00:57:04.4568305Z  2024-12-18T00:57:04.4568629Z  2024-12-18T00:57:04.4568961Z  2024-12-18T00:57:04.4569798Z [18,184 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:04.4570822Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:57:04.4571795Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:57:04.4572659Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:57:04.4573427Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:57:04.4574295Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:57:04.4575214Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2024-12-18T00:57:04.4576041Z Compiling xla/service/dynamic_padder.cc; 14s local 2024-12-18T00:57:04.4577040Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local ... 2024-12-18T00:57:04.8569749Z 2024-12-18T00:57:04.8570653Z  2024-12-18T00:57:04.8571159Z  2024-12-18T00:57:04.8571666Z  2024-12-18T00:57:04.8572155Z  2024-12-18T00:57:04.8572644Z  2024-12-18T00:57:04.8573113Z  2024-12-18T00:57:04.8573483Z  2024-12-18T00:57:04.8573955Z  2024-12-18T00:57:04.8574917Z [18,185 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:04.8575998Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:57:04.8577444Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2024-12-18T00:57:04.8578325Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:57:04.8579302Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:57:04.8580183Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:57:04.8581507Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:57:04.8582357Z Compiling xla/service/dynamic_padder.cc; 14s local 2024-12-18T00:57:04.8583289Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local ... 2024-12-18T00:57:05.0572720Z 2024-12-18T00:57:05.0573579Z  2024-12-18T00:57:05.0574042Z  2024-12-18T00:57:05.0574415Z  2024-12-18T00:57:05.0574779Z  2024-12-18T00:57:05.0575152Z  2024-12-18T00:57:05.0575616Z  2024-12-18T00:57:05.0575963Z  2024-12-18T00:57:05.0576319Z  2024-12-18T00:57:05.0577439Z [18,186 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:05.0578535Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:57:05.0579601Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:57:05.0580584Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:57:05.0581758Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:57:05.0582744Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2024-12-18T00:57:05.0583779Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:57:05.0584683Z Compiling xla/service/dynamic_padder.cc; 14s local 2024-12-18T00:57:05.0585755Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local ... 2024-12-18T00:57:05.4714918Z 2024-12-18T00:57:05.4715768Z  2024-12-18T00:57:05.4716176Z  2024-12-18T00:57:05.4716499Z  2024-12-18T00:57:05.4716782Z  2024-12-18T00:57:05.4717122Z  2024-12-18T00:57:05.4717421Z  2024-12-18T00:57:05.4717743Z  2024-12-18T00:57:05.4718114Z  2024-12-18T00:57:05.4718958Z [18,187 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:05.4720184Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:57:05.4721115Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:57:05.4721935Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:57:05.4722765Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:57:05.4723704Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2024-12-18T00:57:05.4724715Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:57:05.4725610Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:57:05.4726544Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local ... 2024-12-18T00:57:05.6732906Z 2024-12-18T00:57:05.6733772Z  2024-12-18T00:57:05.6734174Z  2024-12-18T00:57:05.6734492Z  2024-12-18T00:57:05.6734821Z  2024-12-18T00:57:05.6735153Z  2024-12-18T00:57:05.6735518Z  2024-12-18T00:57:05.6735839Z  2024-12-18T00:57:05.6736183Z  2024-12-18T00:57:05.6737148Z [18,188 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:05.6738077Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:57:05.6738957Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2024-12-18T00:57:05.6739736Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:57:05.6740451Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:57:05.6741279Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2024-12-18T00:57:05.6742160Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2024-12-18T00:57:05.6742909Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:57:05.6743699Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local ... 2024-12-18T00:57:06.0580794Z 2024-12-18T00:57:06.0581641Z  2024-12-18T00:57:06.0582100Z  2024-12-18T00:57:06.0582503Z  2024-12-18T00:57:06.0582869Z  2024-12-18T00:57:06.0583241Z  2024-12-18T00:57:06.0583627Z  2024-12-18T00:57:06.0583989Z  2024-12-18T00:57:06.0584343Z  2024-12-18T00:57:06.0585180Z [18,190 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:06.0586116Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:57:06.0587007Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:57:06.0587753Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:57:06.0588438Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:57:06.0589362Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2024-12-18T00:57:06.0590319Z Compiling xla/service/dynamic_padder.cc; 15s local 2024-12-18T00:57:06.0591609Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2024-12-18T00:57:06.0592763Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 12s local ... 2024-12-18T00:57:06.2583928Z 2024-12-18T00:57:06.2584834Z  2024-12-18T00:57:06.2585305Z  2024-12-18T00:57:06.2585706Z  2024-12-18T00:57:06.2586101Z  2024-12-18T00:57:06.2586479Z  2024-12-18T00:57:06.2586875Z  2024-12-18T00:57:06.2587250Z  2024-12-18T00:57:06.2587623Z  2024-12-18T00:57:06.2588538Z [18,193 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:06.2589659Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:57:06.2590753Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:57:06.2591727Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:57:06.2592640Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:57:06.2594105Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2024-12-18T00:57:06.2595005Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:57:06.2596083Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2024-12-18T00:57:06.2597207Z Compiling mlir/lib/Conversion/LLVMCommon/Pattern.cpp; 12s local ... 2024-12-18T00:57:06.6587924Z 2024-12-18T00:57:06.6588763Z  2024-12-18T00:57:06.6589207Z  2024-12-18T00:57:06.6589574Z  2024-12-18T00:57:06.6589958Z  2024-12-18T00:57:06.6590358Z  2024-12-18T00:57:06.6590739Z  2024-12-18T00:57:06.6591126Z  2024-12-18T00:57:06.6591487Z  2024-12-18T00:57:06.6592420Z [18,194 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:06.6593645Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:57:06.6594773Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2024-12-18T00:57:06.6595765Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:57:06.6596620Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:57:06.6597664Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2024-12-18T00:57:06.6598622Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:57:06.6609238Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2024-12-18T00:57:06.6610538Z Compiling mlir/lib/Conversion/LLVMCommon/Pattern.cpp; 12s local ... 2024-12-18T00:57:07.0257148Z 2024-12-18T00:57:07.0258019Z  2024-12-18T00:57:07.0258510Z  2024-12-18T00:57:07.0258945Z  2024-12-18T00:57:07.0259330Z  2024-12-18T00:57:07.0259750Z  2024-12-18T00:57:07.0260162Z  2024-12-18T00:57:07.0260585Z  2024-12-18T00:57:07.0260968Z  2024-12-18T00:57:07.0262292Z [18,195 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:07.0263520Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:57:07.0264670Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:57:07.0265690Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:57:07.0266577Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:57:07.0267560Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2024-12-18T00:57:07.0268494Z Compiling xla/service/dynamic_padder.cc; 16s local 2024-12-18T00:57:07.0269455Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2024-12-18T00:57:07.0270510Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 12s local ... 2024-12-18T00:57:07.2592712Z 2024-12-18T00:57:07.2593710Z  2024-12-18T00:57:07.2594208Z  2024-12-18T00:57:07.2594639Z  2024-12-18T00:57:07.2594998Z  2024-12-18T00:57:07.2595629Z  2024-12-18T00:57:07.2596036Z  2024-12-18T00:57:07.2596433Z  2024-12-18T00:57:07.2596827Z  2024-12-18T00:57:07.2597787Z [18,195 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:07.2598980Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:57:07.2600034Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:57:07.2600974Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:57:07.2601774Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:57:07.2602732Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2024-12-18T00:57:07.2603646Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:57:07.2604590Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2024-12-18T00:57:07.2605879Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 12s local ... 2024-12-18T00:57:07.8492970Z 2024-12-18T00:57:07.8493791Z  2024-12-18T00:57:07.8494293Z  2024-12-18T00:57:07.8494704Z  2024-12-18T00:57:07.8495091Z  2024-12-18T00:57:07.8495501Z  2024-12-18T00:57:07.8495893Z  2024-12-18T00:57:07.8496294Z  2024-12-18T00:57:07.8496847Z  2024-12-18T00:57:07.8497760Z [18,196 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:07.8498890Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:07.8500023Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2024-12-18T00:57:07.8501029Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:57:07.8502093Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:57:07.8503126Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:57:07.8504142Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:57:07.8505136Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2024-12-18T00:57:07.8506329Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 13s local ... 2024-12-18T00:57:08.0598739Z 2024-12-18T00:57:08.0599596Z  2024-12-18T00:57:08.0600085Z  2024-12-18T00:57:08.0600473Z  2024-12-18T00:57:08.0600849Z  2024-12-18T00:57:08.0601245Z  2024-12-18T00:57:08.0601611Z  2024-12-18T00:57:08.0601987Z  2024-12-18T00:57:08.0602372Z  2024-12-18T00:57:08.0603261Z [18,196 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:08.0604367Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:08.0605436Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:57:08.0606699Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:57:08.0607607Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:57:08.0608549Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:57:08.0609422Z Compiling xla/service/dynamic_padder.cc; 17s local 2024-12-18T00:57:08.0610294Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2024-12-18T00:57:08.0611236Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 13s local ... 2024-12-18T00:57:08.2602278Z 2024-12-18T00:57:08.2603139Z  2024-12-18T00:57:08.2603625Z  2024-12-18T00:57:08.2604038Z  2024-12-18T00:57:08.2604401Z  2024-12-18T00:57:08.2604780Z  2024-12-18T00:57:08.2605162Z  2024-12-18T00:57:08.2605541Z  2024-12-18T00:57:08.2605898Z  2024-12-18T00:57:08.2606830Z [18,198 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:08.2608300Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:08.2609398Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:57:08.2610308Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:57:08.2611293Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:57:08.2612300Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:57:08.2613289Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:57:08.2614206Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2024-12-18T00:57:08.2615324Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2024-12-18T00:57:08.5349576Z 2024-12-18T00:57:08.5350450Z  2024-12-18T00:57:08.5350934Z  2024-12-18T00:57:08.5351293Z  2024-12-18T00:57:08.5351653Z  2024-12-18T00:57:08.5352017Z  2024-12-18T00:57:08.5352410Z  2024-12-18T00:57:08.5352823Z  2024-12-18T00:57:08.5353188Z  2024-12-18T00:57:08.5354553Z [18,200 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:08.5355678Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:08.5356676Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:57:08.5357629Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:57:08.5358477Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:57:08.5359459Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2024-12-18T00:57:08.5360344Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:57:08.5361210Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2024-12-18T00:57:08.5362111Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2024-12-18T00:57:08.7878408Z 2024-12-18T00:57:08.7879286Z  2024-12-18T00:57:08.7879763Z  2024-12-18T00:57:08.7880199Z  2024-12-18T00:57:08.7880617Z  2024-12-18T00:57:08.7880974Z  2024-12-18T00:57:08.7881345Z  2024-12-18T00:57:08.7881727Z  2024-12-18T00:57:08.7882094Z  2024-12-18T00:57:08.7883042Z [18,201 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:08.7884183Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:57:08.7885246Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2024-12-18T00:57:08.7886201Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:57:08.7887091Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:57:08.7888077Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:57:08.7889103Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:57:08.7890391Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 13s local 2024-12-18T00:57:08.7891348Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2024-12-18T00:57:09.0609283Z 2024-12-18T00:57:09.0610142Z  2024-12-18T00:57:09.0610606Z  2024-12-18T00:57:09.0611007Z  2024-12-18T00:57:09.0611390Z  2024-12-18T00:57:09.0611773Z  2024-12-18T00:57:09.0612162Z  2024-12-18T00:57:09.0612547Z  2024-12-18T00:57:09.0612937Z  2024-12-18T00:57:09.0613900Z [18,201 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:09.0615101Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:57:09.0616233Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:09.0617369Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:57:09.0618245Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:57:09.0619619Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:57:09.0620629Z Compiling xla/service/dynamic_padder.cc; 18s local 2024-12-18T00:57:09.0621530Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 13s local 2024-12-18T00:57:09.0622422Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2024-12-18T00:57:09.2612126Z 2024-12-18T00:57:09.2613023Z  2024-12-18T00:57:09.2613511Z  2024-12-18T00:57:09.2613897Z  2024-12-18T00:57:09.2614277Z  2024-12-18T00:57:09.2614628Z  2024-12-18T00:57:09.2615009Z  2024-12-18T00:57:09.2615414Z  2024-12-18T00:57:09.2615799Z  2024-12-18T00:57:09.2616901Z [18,202 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:09.2617982Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:57:09.2618912Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:09.2620325Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:57:09.2621232Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:57:09.2622234Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:57:09.2623039Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:57:09.2623882Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 13s local 2024-12-18T00:57:09.2624743Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2024-12-18T00:57:09.6063297Z 2024-12-18T00:57:09.6064081Z  2024-12-18T00:57:09.6064480Z  2024-12-18T00:57:09.6064821Z  2024-12-18T00:57:09.6065152Z  2024-12-18T00:57:09.6065496Z  2024-12-18T00:57:09.6065839Z  2024-12-18T00:57:09.6066183Z  2024-12-18T00:57:09.6066664Z  2024-12-18T00:57:09.6067462Z [18,204 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:09.6068516Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:57:09.6069457Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:09.6070291Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:57:09.6071054Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:57:09.6071915Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2024-12-18T00:57:09.6072724Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:57:09.6073488Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 13s local 2024-12-18T00:57:09.6074298Z @llvm-project//mlir:ControlFlowToLLVM; 13s local ... 2024-12-18T00:57:09.8619444Z 2024-12-18T00:57:09.8620318Z  2024-12-18T00:57:09.8620741Z  2024-12-18T00:57:09.8621083Z  2024-12-18T00:57:09.8621402Z  2024-12-18T00:57:09.8621988Z  2024-12-18T00:57:09.8622326Z  2024-12-18T00:57:09.8622675Z  2024-12-18T00:57:09.8623017Z  2024-12-18T00:57:09.8623822Z [18,204 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:09.8624841Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:57:09.8625810Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2024-12-18T00:57:09.8626672Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:57:09.8627480Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:57:09.8628393Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:57:09.8629164Z Compiling xla/service/dynamic_padder.cc; 19s local 2024-12-18T00:57:09.8629924Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 14s local 2024-12-18T00:57:09.8630713Z @llvm-project//mlir:ControlFlowToLLVM; 13s local ... 2024-12-18T00:57:10.0666097Z 2024-12-18T00:57:10.0666935Z  2024-12-18T00:57:10.0667617Z  2024-12-18T00:57:10.0667943Z  2024-12-18T00:57:10.0668294Z  2024-12-18T00:57:10.0668632Z  2024-12-18T00:57:10.0668964Z  2024-12-18T00:57:10.0669281Z  2024-12-18T00:57:10.0669600Z  2024-12-18T00:57:10.0670343Z [18,205 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:10.0671280Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:57:10.0672176Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:57:10.0672930Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:57:10.0673645Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 38s local 2024-12-18T00:57:10.0674474Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:57:10.0675365Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 14s local 2024-12-18T00:57:10.0676516Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2024-12-18T00:57:10.0677169Z @llvm-project//mlir:TransformDialect; 12s local ... 2024-12-18T00:57:10.4624645Z 2024-12-18T00:57:10.4625459Z  2024-12-18T00:57:10.4625842Z  2024-12-18T00:57:10.4626168Z  2024-12-18T00:57:10.4626475Z  2024-12-18T00:57:10.4626794Z  2024-12-18T00:57:10.4627109Z  2024-12-18T00:57:10.4627431Z  2024-12-18T00:57:10.4627739Z  2024-12-18T00:57:10.4628482Z [18,206 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:10.4629377Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:57:10.4630338Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:57:10.4631073Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:57:10.4631766Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 38s local 2024-12-18T00:57:10.4632568Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2024-12-18T00:57:10.4633368Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 14s local 2024-12-18T00:57:10.4634049Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2024-12-18T00:57:10.4634633Z @llvm-project//mlir:TransformDialect; 12s local ... 2024-12-18T00:57:10.8629562Z 2024-12-18T00:57:10.8630408Z  2024-12-18T00:57:10.8630845Z  2024-12-18T00:57:10.8631187Z  2024-12-18T00:57:10.8631566Z  2024-12-18T00:57:10.8631932Z  2024-12-18T00:57:10.8632293Z  2024-12-18T00:57:10.8632663Z  2024-12-18T00:57:10.8633013Z  2024-12-18T00:57:10.8633868Z [18,207 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:10.8634977Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:57:10.8636291Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2024-12-18T00:57:10.8637249Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:57:10.8638129Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:57:10.8639193Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 15s local 2024-12-18T00:57:10.8640011Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:57:10.8641040Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2024-12-18T00:57:10.8641961Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2024-12-18T00:57:11.0633216Z 2024-12-18T00:57:11.0634050Z  2024-12-18T00:57:11.0634470Z  2024-12-18T00:57:11.0634819Z  2024-12-18T00:57:11.0635171Z  2024-12-18T00:57:11.0635517Z  2024-12-18T00:57:11.0635858Z  2024-12-18T00:57:11.0636188Z  2024-12-18T00:57:11.0636554Z  2024-12-18T00:57:11.0637733Z [18,208 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:11.0638827Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:57:11.0639949Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:57:11.0640776Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:57:11.0641660Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:57:11.0642582Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 15s local 2024-12-18T00:57:11.0643353Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:57:11.0644423Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2024-12-18T00:57:11.0645342Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2024-12-18T00:57:11.4637651Z 2024-12-18T00:57:11.4638475Z  2024-12-18T00:57:11.4638930Z  2024-12-18T00:57:11.4639317Z  2024-12-18T00:57:11.4639684Z  2024-12-18T00:57:11.4640045Z  2024-12-18T00:57:11.4640789Z  2024-12-18T00:57:11.4641159Z  2024-12-18T00:57:11.4641492Z  2024-12-18T00:57:11.4642350Z [18,209 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:11.4643405Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:57:11.4644761Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:57:11.4645666Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:57:11.4646566Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2024-12-18T00:57:11.4647549Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 15s local 2024-12-18T00:57:11.4648388Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:57:11.4649259Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2024-12-18T00:57:11.4650196Z @llvm-project//mlir:ControlFlowToLLVM; 13s local ... 2024-12-18T00:57:11.8345178Z 2024-12-18T00:57:11.8346065Z  2024-12-18T00:57:11.8346534Z  2024-12-18T00:57:11.8346917Z  2024-12-18T00:57:11.8347292Z  2024-12-18T00:57:11.8347661Z  2024-12-18T00:57:11.8348020Z  2024-12-18T00:57:11.8348362Z  2024-12-18T00:57:11.8348743Z  2024-12-18T00:57:11.8349641Z [18,211 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:11.8350750Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:57:11.8351821Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2024-12-18T00:57:11.8352743Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:57:11.8353628Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:57:11.8354611Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int16.cc; 16s local 2024-12-18T00:57:11.8355832Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2024-12-18T00:57:11.8356763Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:57:11.8357701Z @llvm-project//mlir:ControlFlowToLLVM; 13s local ... 2024-12-18T00:57:12.0643141Z 2024-12-18T00:57:12.0643974Z  2024-12-18T00:57:12.0644663Z  2024-12-18T00:57:12.0645044Z  2024-12-18T00:57:12.0645505Z  2024-12-18T00:57:12.0645916Z  2024-12-18T00:57:12.0646277Z  2024-12-18T00:57:12.0646770Z  2024-12-18T00:57:12.0647173Z  2024-12-18T00:57:12.0648046Z [18,214 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:12.0649168Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:57:12.0650149Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:57:12.0651001Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:57:12.0652189Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:57:12.0653084Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2024-12-18T00:57:12.0654015Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:57:12.0654998Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2024-12-18T00:57:12.0655739Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:57:12.2678174Z 2024-12-18T00:57:12.2678976Z  2024-12-18T00:57:12.2679445Z  2024-12-18T00:57:12.2679864Z  2024-12-18T00:57:12.2680220Z  2024-12-18T00:57:12.2680592Z  2024-12-18T00:57:12.2681004Z  2024-12-18T00:57:12.2681360Z  2024-12-18T00:57:12.2681685Z  2024-12-18T00:57:12.2682523Z [18,215 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:12.2683584Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:57:12.2684845Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:57:12.2685872Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:57:12.2686746Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2024-12-18T00:57:12.2687680Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2024-12-18T00:57:12.2688652Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:57:12.2689549Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 13s local 2024-12-18T00:57:12.2690414Z @llvm-project//mlir:ComplexToLLVM; 12s local ... 2024-12-18T00:57:12.6649077Z 2024-12-18T00:57:12.6649939Z  2024-12-18T00:57:12.6650415Z  2024-12-18T00:57:12.6650827Z  2024-12-18T00:57:12.6651220Z  2024-12-18T00:57:12.6651590Z  2024-12-18T00:57:12.6651926Z  2024-12-18T00:57:12.6652311Z  2024-12-18T00:57:12.6652695Z  2024-12-18T00:57:12.6653676Z [18,216 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:12.6654889Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2024-12-18T00:57:12.6655877Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:57:12.6656974Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2024-12-18T00:57:12.6658077Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:57:12.6658984Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:57:12.6659863Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2024-12-18T00:57:12.6660977Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 13s local 2024-12-18T00:57:12.6662100Z @llvm-project//mlir:TransformDialectInterfaces; 12s local ... 2024-12-18T00:57:13.0102162Z 2024-12-18T00:57:13.0103048Z  2024-12-18T00:57:13.0103553Z  2024-12-18T00:57:13.0104297Z  2024-12-18T00:57:13.0104673Z  2024-12-18T00:57:13.0105083Z  2024-12-18T00:57:13.0105460Z  2024-12-18T00:57:13.0105836Z  2024-12-18T00:57:13.0106225Z  2024-12-18T00:57:13.0107165Z [18,218 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:13.0108290Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:57:13.0109295Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:57:13.0110291Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:57:13.0111410Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:57:13.0112413Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2024-12-18T00:57:13.0113224Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2024-12-18T00:57:13.0114340Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 13s local 2024-12-18T00:57:13.0115752Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local ... 2024-12-18T00:57:13.2654317Z 2024-12-18T00:57:13.2655215Z  2024-12-18T00:57:13.2655692Z  2024-12-18T00:57:13.2656070Z  2024-12-18T00:57:13.2656576Z  2024-12-18T00:57:13.2656947Z  2024-12-18T00:57:13.2657322Z  2024-12-18T00:57:13.2657691Z  2024-12-18T00:57:13.2658063Z  2024-12-18T00:57:13.2658963Z [18,218 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:13.2660135Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2024-12-18T00:57:13.2661100Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:57:13.2662049Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:57:13.2663298Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2024-12-18T00:57:13.2664295Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2024-12-18T00:57:13.2665593Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2024-12-18T00:57:13.2666712Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 13s local 2024-12-18T00:57:13.2667805Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local ... 2024-12-18T00:57:13.6658545Z 2024-12-18T00:57:13.6659371Z  2024-12-18T00:57:13.6659857Z  2024-12-18T00:57:13.6660252Z  2024-12-18T00:57:13.6660673Z  2024-12-18T00:57:13.6661059Z  2024-12-18T00:57:13.6661420Z  2024-12-18T00:57:13.6661814Z  2024-12-18T00:57:13.6662201Z  2024-12-18T00:57:13.6663149Z [18,219 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:13.6664124Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:57:13.6665031Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2024-12-18T00:57:13.6666101Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:57:13.6667072Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2024-12-18T00:57:13.6667993Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2024-12-18T00:57:13.6669102Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:57:13.6670187Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2024-12-18T00:57:13.6671264Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 12s local ... 2024-12-18T00:57:14.0662338Z 2024-12-18T00:57:14.0663183Z  2024-12-18T00:57:14.0663649Z  2024-12-18T00:57:14.0664022Z  2024-12-18T00:57:14.0664446Z  2024-12-18T00:57:14.0664851Z  2024-12-18T00:57:14.0665247Z  2024-12-18T00:57:14.0665634Z  2024-12-18T00:57:14.0666035Z  2024-12-18T00:57:14.0667007Z [18,222 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:14.0668446Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:57:14.0669501Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:57:14.0670635Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2024-12-18T00:57:14.0671709Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2024-12-18T00:57:14.0672745Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:57:14.0673792Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2024-12-18T00:57:14.0674829Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 12s local 2024-12-18T00:57:14.0675998Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 12s local ... 2024-12-18T00:57:14.5131773Z 2024-12-18T00:57:14.5132594Z  2024-12-18T00:57:14.5133029Z  2024-12-18T00:57:14.5133412Z  2024-12-18T00:57:14.5133800Z  2024-12-18T00:57:14.5134145Z  2024-12-18T00:57:14.5134804Z  2024-12-18T00:57:14.5135166Z  2024-12-18T00:57:14.5135527Z  2024-12-18T00:57:14.5136614Z [18,223 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:14.5137606Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:57:14.5138371Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2024-12-18T00:57:14.5139266Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:57:14.5140194Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:57:14.5141072Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2024-12-18T00:57:14.5141980Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 13s local 2024-12-18T00:57:14.5142885Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 13s local 2024-12-18T00:57:14.5144047Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2024-12-18T00:57:14.8668944Z 2024-12-18T00:57:14.8669759Z  2024-12-18T00:57:14.8670232Z  2024-12-18T00:57:14.8670617Z  2024-12-18T00:57:14.8671010Z  2024-12-18T00:57:14.8671409Z  2024-12-18T00:57:14.8671794Z  2024-12-18T00:57:14.8672131Z  2024-12-18T00:57:14.8672477Z  2024-12-18T00:57:14.8673333Z [18,225 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:14.8674290Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:57:14.8675210Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:57:14.8676299Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:57:14.8677449Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:57:14.8678497Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2024-12-18T00:57:14.8679456Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 13s local 2024-12-18T00:57:14.8680587Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 13s local 2024-12-18T00:57:14.8681738Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2024-12-18T00:57:15.2154340Z 2024-12-18T00:57:15.2155183Z  2024-12-18T00:57:15.2155604Z  2024-12-18T00:57:15.2155942Z  2024-12-18T00:57:15.2156295Z  2024-12-18T00:57:15.2156651Z  2024-12-18T00:57:15.2156991Z  2024-12-18T00:57:15.2157326Z  2024-12-18T00:57:15.2157674Z  2024-12-18T00:57:15.2158503Z [18,227 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:15.2159400Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:57:15.2160259Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:57:15.2161535Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:57:15.2162587Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:57:15.2163530Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2024-12-18T00:57:15.2164465Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 14s local 2024-12-18T00:57:15.2165461Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 13s local 2024-12-18T00:57:15.2166409Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2024-12-18T00:57:15.4321615Z 2024-12-18T00:57:15.4322485Z  2024-12-18T00:57:15.4322959Z  2024-12-18T00:57:15.4323355Z  2024-12-18T00:57:15.4323765Z  2024-12-18T00:57:15.4324162Z  2024-12-18T00:57:15.4324552Z  2024-12-18T00:57:15.4324943Z  2024-12-18T00:57:15.4325338Z  2024-12-18T00:57:15.4326240Z [18,228 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:15.4327578Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:57:15.4328537Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:57:15.4329675Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2024-12-18T00:57:15.4330863Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:57:15.4331966Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2024-12-18T00:57:15.4333048Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 14s local 2024-12-18T00:57:15.4334166Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 14s local 2024-12-18T00:57:15.4335274Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2024-12-18T00:57:15.6674995Z 2024-12-18T00:57:15.6675836Z  2024-12-18T00:57:15.6676286Z  2024-12-18T00:57:15.6676698Z  2024-12-18T00:57:15.6677071Z  2024-12-18T00:57:15.6677864Z  2024-12-18T00:57:15.6678245Z  2024-12-18T00:57:15.6678618Z  2024-12-18T00:57:15.6678995Z  2024-12-18T00:57:15.6680032Z [18,229 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:15.6681238Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:57:15.6682244Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2024-12-18T00:57:15.6683303Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:57:15.6684422Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:57:15.6685527Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2024-12-18T00:57:15.6686617Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 14s local 2024-12-18T00:57:15.6687866Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 14s local 2024-12-18T00:57:15.6689109Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 12s local ... 2024-12-18T00:57:16.0679570Z 2024-12-18T00:57:16.0680405Z  2024-12-18T00:57:16.0680996Z  2024-12-18T00:57:16.0681404Z  2024-12-18T00:57:16.0681816Z  2024-12-18T00:57:16.0682267Z  2024-12-18T00:57:16.0682635Z  2024-12-18T00:57:16.0683030Z  2024-12-18T00:57:16.0683436Z  2024-12-18T00:57:16.0684410Z [18,230 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:16.0685535Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:57:16.0686644Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2024-12-18T00:57:16.0687790Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:57:16.0688943Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:57:16.0690370Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2024-12-18T00:57:16.0691571Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 14s local 2024-12-18T00:57:16.0692794Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 14s local 2024-12-18T00:57:16.0693853Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 12s local ... 2024-12-18T00:57:16.3738053Z 2024-12-18T00:57:16.3738972Z  2024-12-18T00:57:16.3739479Z  2024-12-18T00:57:16.3739908Z  2024-12-18T00:57:16.3740340Z  2024-12-18T00:57:16.3740757Z  2024-12-18T00:57:16.3741185Z  2024-12-18T00:57:16.3741614Z  2024-12-18T00:57:16.3742009Z  2024-12-18T00:57:16.3742985Z [18,231 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:16.3744022Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:57:16.3745263Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2024-12-18T00:57:16.3746721Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2024-12-18T00:57:16.3747935Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:57:16.3749053Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2024-12-18T00:57:16.3750142Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 15s local 2024-12-18T00:57:16.3751334Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2024-12-18T00:57:16.3752459Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local ... 2024-12-18T00:57:16.6685222Z 2024-12-18T00:57:16.6686088Z  2024-12-18T00:57:16.6686555Z  2024-12-18T00:57:16.6686910Z  2024-12-18T00:57:16.6687297Z  2024-12-18T00:57:16.6687685Z  2024-12-18T00:57:16.6688065Z  2024-12-18T00:57:16.6688430Z  2024-12-18T00:57:16.6688800Z  2024-12-18T00:57:16.6690044Z [18,233 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:16.6691214Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:57:16.6692151Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:57:16.6693262Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 17s local 2024-12-18T00:57:16.6694328Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2024-12-18T00:57:16.6695380Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 15s local 2024-12-18T00:57:16.6696701Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2024-12-18T00:57:16.6697826Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local 2024-12-18T00:57:16.6698940Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local ... 2024-12-18T00:57:16.8811584Z 2024-12-18T00:57:16.8812473Z  2024-12-18T00:57:16.8812983Z  2024-12-18T00:57:16.8813410Z  2024-12-18T00:57:16.8813850Z  2024-12-18T00:57:16.8814269Z  2024-12-18T00:57:16.8814657Z  2024-12-18T00:57:16.8815056Z  2024-12-18T00:57:16.8815463Z  2024-12-18T00:57:16.8816568Z [18,234 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:16.8817601Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:57:16.8818596Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:57:16.8819671Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2024-12-18T00:57:16.8820774Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 15s local 2024-12-18T00:57:16.8821902Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2024-12-18T00:57:16.8823034Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local 2024-12-18T00:57:16.8824388Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 13s local 2024-12-18T00:57:16.8825483Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:57:17.2690594Z 2024-12-18T00:57:17.2691455Z  2024-12-18T00:57:17.2691925Z  2024-12-18T00:57:17.2692307Z  2024-12-18T00:57:17.2692694Z  2024-12-18T00:57:17.2693055Z  2024-12-18T00:57:17.2693466Z  2024-12-18T00:57:17.2693858Z  2024-12-18T00:57:17.2694241Z  2024-12-18T00:57:17.2695081Z [18,234 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:17.2696082Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:57:17.2697246Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2024-12-18T00:57:17.2698331Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2024-12-18T00:57:17.2699400Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:57:17.2700938Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2024-12-18T00:57:17.2702148Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:57:17.2703313Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:57:17.2704287Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:57:17.8062028Z 2024-12-18T00:57:17.8062822Z  2024-12-18T00:57:17.8063202Z  2024-12-18T00:57:17.8063493Z  2024-12-18T00:57:17.8063801Z  2024-12-18T00:57:17.8064101Z  2024-12-18T00:57:17.8064405Z  2024-12-18T00:57:17.8064706Z  2024-12-18T00:57:17.8064991Z  2024-12-18T00:57:17.8065701Z [18,235 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:17.8066452Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:57:17.8067196Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:57:17.8068284Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:57:17.8069140Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:57:17.8069966Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local 2024-12-18T00:57:17.8070787Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:57:17.8071601Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:57:17.8072425Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:18.0697753Z 2024-12-18T00:57:18.0698629Z  2024-12-18T00:57:18.0699127Z  2024-12-18T00:57:18.0699513Z  2024-12-18T00:57:18.0699908Z  2024-12-18T00:57:18.0700314Z  2024-12-18T00:57:18.0700718Z  2024-12-18T00:57:18.0701100Z  2024-12-18T00:57:18.0701503Z  2024-12-18T00:57:18.0702464Z [18,235 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:18.0703586Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:57:18.0704631Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:57:18.0705750Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:57:18.0706779Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:57:18.0707922Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local 2024-12-18T00:57:18.0709029Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:57:18.0710105Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 14s local 2024-12-18T00:57:18.0711048Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:18.4702122Z 2024-12-18T00:57:18.4702987Z  2024-12-18T00:57:18.4703463Z  2024-12-18T00:57:18.4703978Z  2024-12-18T00:57:18.4704605Z  2024-12-18T00:57:18.4704965Z  2024-12-18T00:57:18.4705364Z  2024-12-18T00:57:18.4705737Z  2024-12-18T00:57:18.4706134Z  2024-12-18T00:57:18.4707068Z [18,236 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:18.4708035Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:57:18.4709024Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2024-12-18T00:57:18.4710116Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2024-12-18T00:57:18.4711081Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:57:18.4712165Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:57:18.4713367Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:57:18.4714428Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:57:18.4715664Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:18.6705545Z 2024-12-18T00:57:18.6706413Z  2024-12-18T00:57:18.6706912Z  2024-12-18T00:57:18.6707325Z  2024-12-18T00:57:18.6707735Z  2024-12-18T00:57:18.6708155Z  2024-12-18T00:57:18.6708577Z  2024-12-18T00:57:18.6708946Z  2024-12-18T00:57:18.6709330Z  2024-12-18T00:57:18.6710145Z [18,237 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:18.6710980Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:57:18.6711971Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 21s local 2024-12-18T00:57:18.6713101Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:57:18.6714245Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:57:18.6715464Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:57:18.6717101Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:57:18.6718185Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:57:18.6719073Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:18.8846472Z 2024-12-18T00:57:18.8847369Z  2024-12-18T00:57:18.8847839Z  2024-12-18T00:57:18.8848219Z  2024-12-18T00:57:18.8848620Z  2024-12-18T00:57:18.8849035Z  2024-12-18T00:57:18.8849430Z  2024-12-18T00:57:18.8849790Z  2024-12-18T00:57:18.8850136Z  2024-12-18T00:57:18.8851070Z [18,239 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:18.8852063Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:57:18.8853058Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 21s local 2024-12-18T00:57:18.8854165Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:57:18.8855291Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:57:18.8856605Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:57:18.8857756Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:57:18.8858903Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local 2024-12-18T00:57:18.8859778Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:19.2345830Z 2024-12-18T00:57:19.2346757Z  2024-12-18T00:57:19.2347279Z  2024-12-18T00:57:19.2347698Z  2024-12-18T00:57:19.2348061Z  2024-12-18T00:57:19.2348417Z  2024-12-18T00:57:19.2348778Z  2024-12-18T00:57:19.2349168Z  2024-12-18T00:57:19.2349554Z  2024-12-18T00:57:19.2350489Z [18,240 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:19.2351768Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:57:19.2352709Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 21s local 2024-12-18T00:57:19.2353755Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:57:19.2354707Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 18s local 2024-12-18T00:57:19.2355824Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:57:19.2356877Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.2357961Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.2358841Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:19.4708794Z 2024-12-18T00:57:19.4709724Z  2024-12-18T00:57:19.4710229Z  2024-12-18T00:57:19.4710653Z  2024-12-18T00:57:19.4711040Z  2024-12-18T00:57:19.4711518Z  2024-12-18T00:57:19.4711905Z  2024-12-18T00:57:19.4712568Z  2024-12-18T00:57:19.4712967Z  2024-12-18T00:57:19.4713912Z [18,241 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:19.4715015Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:57:19.4715888Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2024-12-18T00:57:19.4716917Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 18s local 2024-12-18T00:57:19.4718034Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 18s local 2024-12-18T00:57:19.4719294Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.4720388Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.4721456Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 15s local 2024-12-18T00:57:19.4722386Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 15s local ... 2024-12-18T00:57:19.6712260Z 2024-12-18T00:57:19.6713610Z  2024-12-18T00:57:19.6714114Z  2024-12-18T00:57:19.6714529Z  2024-12-18T00:57:19.6714979Z  2024-12-18T00:57:19.6715353Z  2024-12-18T00:57:19.6715702Z  2024-12-18T00:57:19.6716069Z  2024-12-18T00:57:19.6716422Z  2024-12-18T00:57:19.6717301Z [18,242 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:19.6718259Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:57:19.6719182Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:57:19.6720261Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 18s local 2024-12-18T00:57:19.6721379Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 18s local 2024-12-18T00:57:19.6722500Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.6723636Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.6724644Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 15s local 2024-12-18T00:57:19.6725515Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:19.9412395Z 2024-12-18T00:57:19.9413344Z  2024-12-18T00:57:19.9413844Z  2024-12-18T00:57:19.9414267Z  2024-12-18T00:57:19.9414653Z  2024-12-18T00:57:19.9415101Z  2024-12-18T00:57:19.9415506Z  2024-12-18T00:57:19.9415896Z  2024-12-18T00:57:19.9416303Z  2024-12-18T00:57:19.9417382Z [18,246 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:19.9418461Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:57:19.9419426Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:57:19.9420484Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.9421797Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local 2024-12-18T00:57:19.9422737Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local 2024-12-18T00:57:19.9423624Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2024-12-18T00:57:19.9424602Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2024-12-18T00:57:19.9425528Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 11s local ... 2024-12-18T00:57:20.2718114Z 2024-12-18T00:57:20.2719085Z  2024-12-18T00:57:20.2719595Z  2024-12-18T00:57:20.2720043Z  2024-12-18T00:57:20.2720463Z  2024-12-18T00:57:20.2720900Z  2024-12-18T00:57:20.2721309Z  2024-12-18T00:57:20.2721720Z  2024-12-18T00:57:20.2722110Z  2024-12-18T00:57:20.2723117Z [18,247 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:20.2724170Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2024-12-18T00:57:20.2725483Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:57:20.2726661Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.2727884Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.2729013Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local 2024-12-18T00:57:20.2730047Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:57:20.2731023Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local 2024-12-18T00:57:20.2731917Z @llvm-project//mlir:LLVMCommonConversion; 11s local ... 2024-12-18T00:57:20.4721531Z 2024-12-18T00:57:20.4722457Z  2024-12-18T00:57:20.4722960Z  2024-12-18T00:57:20.4723388Z  2024-12-18T00:57:20.4723769Z  2024-12-18T00:57:20.4724218Z  2024-12-18T00:57:20.4724602Z  2024-12-18T00:57:20.4724976Z  2024-12-18T00:57:20.4725364Z  2024-12-18T00:57:20.4726612Z [18,248 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:20.4727784Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2024-12-18T00:57:20.4728709Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2024-12-18T00:57:20.4729743Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.4730809Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.4731780Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local 2024-12-18T00:57:20.4732748Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:57:20.4733659Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local 2024-12-18T00:57:20.4734499Z @llvm-project//mlir:LLVMCommonConversion; 12s local ... 2024-12-18T00:57:20.7498038Z 2024-12-18T00:57:20.7499018Z  2024-12-18T00:57:20.7499550Z  2024-12-18T00:57:20.7500015Z  2024-12-18T00:57:20.7500443Z  2024-12-18T00:57:20.7500938Z  2024-12-18T00:57:20.7501317Z  2024-12-18T00:57:20.7501698Z  2024-12-18T00:57:20.7502074Z  2024-12-18T00:57:20.7503021Z [18,251 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:20.7504106Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2024-12-18T00:57:20.7505118Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:57:20.7506157Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.7507291Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.7508390Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local 2024-12-18T00:57:20.7509412Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:57:20.7510324Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local 2024-12-18T00:57:20.7511528Z Compiling .../memory_space_assignment/cost_analysis.cc; 12s local ... 2024-12-18T00:57:20.9721670Z 2024-12-18T00:57:20.9722638Z  2024-12-18T00:57:20.9723152Z  2024-12-18T00:57:20.9723585Z  2024-12-18T00:57:20.9724011Z  2024-12-18T00:57:20.9724430Z  2024-12-18T00:57:20.9724752Z  2024-12-18T00:57:20.9725068Z  2024-12-18T00:57:20.9725417Z  2024-12-18T00:57:20.9726400Z [18,254 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:20.9727386Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:57:20.9728355Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.9729375Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2024-12-18T00:57:20.9730299Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local 2024-12-18T00:57:20.9731182Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2024-12-18T00:57:20.9732365Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local 2024-12-18T00:57:20.9733463Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 12s local 2024-12-18T00:57:20.9734217Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:57:21.2728505Z 2024-12-18T00:57:21.2729413Z  2024-12-18T00:57:21.2729850Z  2024-12-18T00:57:21.2730221Z  2024-12-18T00:57:21.2730605Z  2024-12-18T00:57:21.2730988Z  2024-12-18T00:57:21.2731416Z  2024-12-18T00:57:21.2731774Z  2024-12-18T00:57:21.2732160Z  2024-12-18T00:57:21.2733081Z [18,254 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:21.2734170Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2024-12-18T00:57:21.2735236Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2024-12-18T00:57:21.2736358Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2024-12-18T00:57:21.2738054Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local 2024-12-18T00:57:21.2739009Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2024-12-18T00:57:21.2739880Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 13s local 2024-12-18T00:57:21.2740845Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 12s local 2024-12-18T00:57:21.2741759Z @llvm-project//llvm:CodeGen; 11s local ... 2024-12-18T00:57:22.2737335Z 2024-12-18T00:57:22.2738276Z  2024-12-18T00:57:22.2738773Z  2024-12-18T00:57:22.2739178Z  2024-12-18T00:57:22.2739573Z  2024-12-18T00:57:22.2740086Z  2024-12-18T00:57:22.2740440Z  2024-12-18T00:57:22.2740820Z  2024-12-18T00:57:22.2741184Z  2024-12-18T00:57:22.2742073Z [18,254 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:22.2743193Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2024-12-18T00:57:22.2744561Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:57:22.2745657Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:57:22.2746631Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 18s local 2024-12-18T00:57:22.2747511Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:57:22.2748353Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local 2024-12-18T00:57:22.2749313Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 13s local 2024-12-18T00:57:22.2750238Z @llvm-project//llvm:CodeGen; 12s local ... 2024-12-18T00:57:22.8730195Z 2024-12-18T00:57:22.8731112Z  2024-12-18T00:57:22.8731629Z  2024-12-18T00:57:22.8732034Z  2024-12-18T00:57:22.8732452Z  2024-12-18T00:57:22.8732905Z  2024-12-18T00:57:22.8733292Z  2024-12-18T00:57:22.8733637Z  2024-12-18T00:57:22.8734224Z  2024-12-18T00:57:22.8735062Z [18,255 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:22.8736147Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:57:22.8737314Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:57:22.8738355Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:57:22.8739344Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2024-12-18T00:57:22.8740257Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:57:22.8741141Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local 2024-12-18T00:57:22.8742062Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2024-12-18T00:57:22.8742964Z @llvm-project//llvm:CodeGen; 13s local ... 2024-12-18T00:57:23.0742765Z 2024-12-18T00:57:23.0743691Z  2024-12-18T00:57:23.0744412Z  2024-12-18T00:57:23.0744866Z  2024-12-18T00:57:23.0745648Z  2024-12-18T00:57:23.0746127Z  2024-12-18T00:57:23.0746523Z  2024-12-18T00:57:23.0746882Z  2024-12-18T00:57:23.0747290Z  2024-12-18T00:57:23.0748274Z [18,255 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:23.0749480Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:57:23.0750539Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:57:23.0751680Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2024-12-18T00:57:23.0752671Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2024-12-18T00:57:23.0753664Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2024-12-18T00:57:23.0754576Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local 2024-12-18T00:57:23.0755544Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2024-12-18T00:57:23.0756739Z @llvm-project//llvm:CodeGen; 13s local ... 2024-12-18T00:57:23.4542269Z 2024-12-18T00:57:23.4543075Z  2024-12-18T00:57:23.4543581Z  2024-12-18T00:57:23.4543970Z  2024-12-18T00:57:23.4544608Z  2024-12-18T00:57:23.4545068Z  2024-12-18T00:57:23.4545438Z  2024-12-18T00:57:23.4545797Z  2024-12-18T00:57:23.4546164Z  2024-12-18T00:57:23.4547170Z [18,256 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:23.4548392Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2024-12-18T00:57:23.4549438Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2024-12-18T00:57:23.4550496Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2024-12-18T00:57:23.4551511Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2024-12-18T00:57:23.4552392Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:57:23.4553337Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local 2024-12-18T00:57:23.4554279Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2024-12-18T00:57:23.4555127Z @llvm-project//llvm:CodeGen; 14s local ... 2024-12-18T00:57:23.6749898Z 2024-12-18T00:57:23.6750765Z  2024-12-18T00:57:23.6751200Z  2024-12-18T00:57:23.6751571Z  2024-12-18T00:57:23.6751921Z  2024-12-18T00:57:23.6752271Z  2024-12-18T00:57:23.6752632Z  2024-12-18T00:57:23.6752996Z  2024-12-18T00:57:23.6753345Z  2024-12-18T00:57:23.6754167Z [18,259 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:23.6755146Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:57:23.6756077Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2024-12-18T00:57:23.6757340Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2024-12-18T00:57:23.6758274Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2024-12-18T00:57:23.6759118Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:57:23.6759864Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local 2024-12-18T00:57:23.6760625Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 15s local 2024-12-18T00:57:23.6761368Z @llvm-project//llvm:CodeGen; 14s local ... 2024-12-18T00:57:23.8755760Z 2024-12-18T00:57:23.8756618Z  2024-12-18T00:57:23.8757048Z  2024-12-18T00:57:23.8757435Z  2024-12-18T00:57:23.8757808Z  2024-12-18T00:57:23.8758201Z  2024-12-18T00:57:23.8758545Z  2024-12-18T00:57:23.8758883Z  2024-12-18T00:57:23.8759207Z  2024-12-18T00:57:23.8760019Z [18,261 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:23.8761005Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2024-12-18T00:57:23.8762218Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2024-12-18T00:57:23.8763203Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2024-12-18T00:57:23.8764076Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 20s local 2024-12-18T00:57:23.8764905Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2024-12-18T00:57:23.8765679Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local 2024-12-18T00:57:23.8766533Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 14s local 2024-12-18T00:57:23.8767369Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:25.0762010Z 2024-12-18T00:57:25.0762882Z  2024-12-18T00:57:25.0763370Z  2024-12-18T00:57:25.0763771Z  2024-12-18T00:57:25.0764150Z  2024-12-18T00:57:25.0764539Z  2024-12-18T00:57:25.0764902Z  2024-12-18T00:57:25.0765319Z  2024-12-18T00:57:25.0765705Z  2024-12-18T00:57:25.0766928Z [18,261 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:25.0768122Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2024-12-18T00:57:25.0769143Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2024-12-18T00:57:25.0770179Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2024-12-18T00:57:25.0771327Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2024-12-18T00:57:25.0772295Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2024-12-18T00:57:25.0773174Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local 2024-12-18T00:57:25.0774153Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2024-12-18T00:57:25.0775165Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:25.4766621Z 2024-12-18T00:57:25.4767525Z  2024-12-18T00:57:25.4768003Z  2024-12-18T00:57:25.4768388Z  2024-12-18T00:57:25.4768821Z  2024-12-18T00:57:25.4769203Z  2024-12-18T00:57:25.4769608Z  2024-12-18T00:57:25.4769963Z  2024-12-18T00:57:25.4770348Z  2024-12-18T00:57:25.4771296Z [18,262 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:25.4772313Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2024-12-18T00:57:25.4773323Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:57:25.4774367Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:57:25.4775291Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2024-12-18T00:57:25.4776245Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:57:25.4777281Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local 2024-12-18T00:57:25.4778584Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2024-12-18T00:57:25.4779575Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:25.6772830Z 2024-12-18T00:57:25.6773791Z  2024-12-18T00:57:25.6774250Z  2024-12-18T00:57:25.6774637Z  2024-12-18T00:57:25.6775029Z  2024-12-18T00:57:25.6775397Z  2024-12-18T00:57:25.6775748Z  2024-12-18T00:57:25.6776123Z  2024-12-18T00:57:25.6776637Z  2024-12-18T00:57:25.6777584Z [18,265 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:25.6778667Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:57:25.6779746Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:57:25.6780856Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:57:25.6781944Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2024-12-18T00:57:25.6783255Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:57:25.6784169Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local 2024-12-18T00:57:25.6785186Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2024-12-18T00:57:25.6786182Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:26.0771937Z 2024-12-18T00:57:26.0772821Z  2024-12-18T00:57:26.0773314Z  2024-12-18T00:57:26.0773714Z  2024-12-18T00:57:26.0774106Z  2024-12-18T00:57:26.0774494Z  2024-12-18T00:57:26.0774895Z  2024-12-18T00:57:26.0775284Z  2024-12-18T00:57:26.0775660Z  2024-12-18T00:57:26.0776750Z [18,266 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:26.0777903Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:57:26.0778960Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:57:26.0780535Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2024-12-18T00:57:26.0781795Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2024-12-18T00:57:26.0782712Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2024-12-18T00:57:26.0783554Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local 2024-12-18T00:57:26.0784440Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2024-12-18T00:57:26.0785427Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:57:26.5548661Z 2024-12-18T00:57:26.5549589Z  2024-12-18T00:57:26.5550059Z  2024-12-18T00:57:26.5550450Z  2024-12-18T00:57:26.5550844Z  2024-12-18T00:57:26.5551227Z  2024-12-18T00:57:26.5551606Z  2024-12-18T00:57:26.5551940Z  2024-12-18T00:57:26.5552335Z  2024-12-18T00:57:26.5553250Z [18,267 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:26.5554430Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2024-12-18T00:57:26.5555478Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2024-12-18T00:57:26.5556534Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2024-12-18T00:57:26.5557514Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2024-12-18T00:57:26.5558467Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:57:26.5559391Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:57:26.5560406Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2024-12-18T00:57:26.5561402Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:57:26.8778463Z 2024-12-18T00:57:26.8779331Z  2024-12-18T00:57:26.8779838Z  2024-12-18T00:57:26.8780276Z  2024-12-18T00:57:26.8780698Z  2024-12-18T00:57:26.8781382Z  2024-12-18T00:57:26.8781792Z  2024-12-18T00:57:26.8782210Z  2024-12-18T00:57:26.8782674Z  2024-12-18T00:57:26.8783663Z [18,267 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:26.8784902Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2024-12-18T00:57:26.8786030Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2024-12-18T00:57:26.8787222Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2024-12-18T00:57:26.8788354Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2024-12-18T00:57:26.8789382Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2024-12-18T00:57:26.8790345Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:57:26.8791425Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2024-12-18T00:57:26.8792526Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:57:27.7219990Z 2024-12-18T00:57:27.7220910Z  2024-12-18T00:57:27.7221675Z  2024-12-18T00:57:27.7222101Z  2024-12-18T00:57:27.7222501Z  2024-12-18T00:57:27.7222800Z  2024-12-18T00:57:27.7223154Z  2024-12-18T00:57:27.7223521Z  2024-12-18T00:57:27.7223898Z  2024-12-18T00:57:27.7224810Z [18,268 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:27.7225750Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:57:27.7226751Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2024-12-18T00:57:27.7227834Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2024-12-18T00:57:27.7228873Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2024-12-18T00:57:27.7229716Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2024-12-18T00:57:27.7230738Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2024-12-18T00:57:27.7232293Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2024-12-18T00:57:27.7233336Z @llvm-project//mlir:BufferizationDialect; 17s local ... 2024-12-18T00:57:28.0787729Z 2024-12-18T00:57:28.0788635Z  2024-12-18T00:57:28.0789139Z  2024-12-18T00:57:28.0789534Z  2024-12-18T00:57:28.0789942Z  2024-12-18T00:57:28.0790318Z  2024-12-18T00:57:28.0790730Z  2024-12-18T00:57:28.0791143Z  2024-12-18T00:57:28.0791532Z  2024-12-18T00:57:28.0792407Z [18,271 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:28.0793550Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2024-12-18T00:57:28.0794639Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2024-12-18T00:57:28.0795786Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2024-12-18T00:57:28.0796935Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2024-12-18T00:57:28.0797821Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2024-12-18T00:57:28.0798804Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2024-12-18T00:57:28.0799910Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:28.0800799Z @llvm-project//mlir:BufferizationDialect; 17s local ... 2024-12-18T00:57:28.3520246Z 2024-12-18T00:57:28.3521114Z  2024-12-18T00:57:28.3521583Z  2024-12-18T00:57:28.3521950Z  2024-12-18T00:57:28.3522352Z  2024-12-18T00:57:28.3522762Z  2024-12-18T00:57:28.3523154Z  2024-12-18T00:57:28.3523543Z  2024-12-18T00:57:28.3523955Z  2024-12-18T00:57:28.3524904Z [18,274 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:28.3526090Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:57:28.3527506Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:57:28.3528585Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2024-12-18T00:57:28.3529447Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:57:28.3530353Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2024-12-18T00:57:28.3531458Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:28.3532438Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 17s local 2024-12-18T00:57:28.3533331Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:57:28.6792024Z 2024-12-18T00:57:28.6792880Z  2024-12-18T00:57:28.6793245Z  2024-12-18T00:57:28.6793566Z  2024-12-18T00:57:28.6793880Z  2024-12-18T00:57:28.6794195Z  2024-12-18T00:57:28.6794493Z  2024-12-18T00:57:28.6794812Z  2024-12-18T00:57:28.6795119Z  2024-12-18T00:57:28.6796156Z [18,276 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:28.6797187Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:57:28.6798080Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:57:28.6798917Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2024-12-18T00:57:28.6799639Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:57:28.6800479Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2024-12-18T00:57:28.6801474Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:28.6802387Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 15s local 2024-12-18T00:57:28.6803045Z @llvm-project//llvm:CodeGen; 14s local ... 2024-12-18T00:57:28.9108043Z 2024-12-18T00:57:28.9108904Z  2024-12-18T00:57:28.9109382Z  2024-12-18T00:57:28.9109811Z  2024-12-18T00:57:28.9110194Z  2024-12-18T00:57:28.9113301Z  2024-12-18T00:57:28.9113695Z  2024-12-18T00:57:28.9114081Z  2024-12-18T00:57:28.9114478Z  2024-12-18T00:57:28.9115422Z [18,278 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:28.9116548Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:57:28.9117677Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2024-12-18T00:57:28.9118704Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2024-12-18T00:57:28.9119576Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:57:28.9120600Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2024-12-18T00:57:28.9121712Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:28.9122592Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 15s local 2024-12-18T00:57:28.9123463Z @llvm-project//llvm:CodeGen; 15s local ... 2024-12-18T00:57:29.2797415Z 2024-12-18T00:57:29.2798275Z  2024-12-18T00:57:29.2798763Z  2024-12-18T00:57:29.2799158Z  2024-12-18T00:57:29.2799588Z  2024-12-18T00:57:29.2800075Z  2024-12-18T00:57:29.2800568Z  2024-12-18T00:57:29.2800940Z  2024-12-18T00:57:29.2801286Z  2024-12-18T00:57:29.2802170Z [18,278 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:29.2803320Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2024-12-18T00:57:29.2804422Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2024-12-18T00:57:29.2805684Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2024-12-18T00:57:29.2806544Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:57:29.2807538Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2024-12-18T00:57:29.2809198Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:57:29.2810275Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 16s local 2024-12-18T00:57:29.2811131Z @llvm-project//llvm:CodeGen; 15s local ... 2024-12-18T00:57:29.6801733Z 2024-12-18T00:57:29.6802634Z  2024-12-18T00:57:29.6803079Z  2024-12-18T00:57:29.6803464Z  2024-12-18T00:57:29.6803858Z  2024-12-18T00:57:29.6804228Z  2024-12-18T00:57:29.6804611Z  2024-12-18T00:57:29.6804974Z  2024-12-18T00:57:29.6805368Z  2024-12-18T00:57:29.6806317Z [18,279 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:29.6807465Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2024-12-18T00:57:29.6808606Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2024-12-18T00:57:29.6809669Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2024-12-18T00:57:29.6810967Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:57:29.6811894Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2024-12-18T00:57:29.6812969Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:57:29.6814000Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 16s local 2024-12-18T00:57:29.6814866Z @llvm-project//llvm:CodeGen; 15s local ... 2024-12-18T00:57:30.2605952Z 2024-12-18T00:57:30.2606842Z  2024-12-18T00:57:30.2607322Z  2024-12-18T00:57:30.2607714Z  2024-12-18T00:57:30.2608102Z  2024-12-18T00:57:30.2608499Z  2024-12-18T00:57:30.2608876Z  2024-12-18T00:57:30.2609270Z  2024-12-18T00:57:30.2609655Z  2024-12-18T00:57:30.2610559Z [18,281 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:57:30.2611713Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2024-12-18T00:57:30.2613172Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2024-12-18T00:57:30.2614232Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2024-12-18T00:57:30.2615042Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:57:30.2616021Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2024-12-18T00:57:30.2617253Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:57:30.2618296Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 17s local 2024-12-18T00:57:30.2619095Z @llvm-project//llvm:CodeGen; 16s local ... 2024-12-18T00:57:30.4860104Z 2024-12-18T00:57:30.4860983Z  2024-12-18T00:57:30.4861488Z  2024-12-18T00:57:30.4861906Z  2024-12-18T00:57:30.4862309Z  2024-12-18T00:57:30.4862716Z  2024-12-18T00:57:30.4863104Z  2024-12-18T00:57:30.4863527Z  2024-12-18T00:57:30.4863933Z  2024-12-18T00:57:30.4864856Z [18,283 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:57:30.4866019Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2024-12-18T00:57:30.4867117Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2024-12-18T00:57:30.4868134Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2024-12-18T00:57:30.4869116Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:57:30.4869911Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2024-12-18T00:57:30.4871015Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:57:30.4871998Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 17s local 2024-12-18T00:57:30.4873020Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local ... 2024-12-18T00:57:30.6863849Z 2024-12-18T00:57:30.6864758Z  2024-12-18T00:57:30.6865220Z  2024-12-18T00:57:30.6865650Z  2024-12-18T00:57:30.6866047Z  2024-12-18T00:57:30.6866406Z  2024-12-18T00:57:30.6866786Z  2024-12-18T00:57:30.6867166Z  2024-12-18T00:57:30.6867554Z  2024-12-18T00:57:30.6868450Z [18,284 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:30.6869593Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2024-12-18T00:57:30.6870660Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2024-12-18T00:57:30.6871641Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2024-12-18T00:57:30.6872509Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:57:30.6873478Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2024-12-18T00:57:30.6874577Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:57:30.6875951Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 17s local 2024-12-18T00:57:30.6877102Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local ... 2024-12-18T00:57:31.0867916Z 2024-12-18T00:57:31.0868797Z  2024-12-18T00:57:31.0869284Z  2024-12-18T00:57:31.0869686Z  2024-12-18T00:57:31.0870052Z  2024-12-18T00:57:31.0870428Z  2024-12-18T00:57:31.0870817Z  2024-12-18T00:57:31.0871177Z  2024-12-18T00:57:31.0871556Z  2024-12-18T00:57:31.0872464Z [18,286 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:31.0873556Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2024-12-18T00:57:31.0874453Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:57:31.0875420Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2024-12-18T00:57:31.0876498Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:57:31.0877942Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 18s local 2024-12-18T00:57:31.0879048Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2024-12-18T00:57:31.0879971Z @llvm-project//llvm:CodeGen; 14s local 2024-12-18T00:57:31.0880677Z @llvm-project//mlir:ComplexToLLVM; 14s local ... 2024-12-18T00:57:31.4872194Z 2024-12-18T00:57:31.4873125Z  2024-12-18T00:57:31.4873585Z  2024-12-18T00:57:31.4873988Z  2024-12-18T00:57:31.4874374Z  2024-12-18T00:57:31.4874752Z  2024-12-18T00:57:31.4875138Z  2024-12-18T00:57:31.4875516Z  2024-12-18T00:57:31.4875851Z  2024-12-18T00:57:31.4876784Z [18,287 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:31.4877880Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2024-12-18T00:57:31.4878777Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:57:31.4879884Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2024-12-18T00:57:31.4881110Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:57:31.4882284Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2024-12-18T00:57:31.4883196Z @llvm-project//llvm:CodeGen; 15s local 2024-12-18T00:57:31.4884085Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:57:31.4885197Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local ... 2024-12-18T00:57:31.8686144Z 2024-12-18T00:57:31.8686948Z  2024-12-18T00:57:31.8687360Z  2024-12-18T00:57:31.8687674Z  2024-12-18T00:57:31.8688005Z  2024-12-18T00:57:31.8688331Z  2024-12-18T00:57:31.8688689Z  2024-12-18T00:57:31.8689021Z  2024-12-18T00:57:31.8689331Z  2024-12-18T00:57:31.8690127Z [18,288 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:31.8691282Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2024-12-18T00:57:31.8691988Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:57:31.8692808Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2024-12-18T00:57:31.8693806Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:57:31.8694748Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2024-12-18T00:57:31.8695556Z @llvm-project//llvm:CodeGen; 15s local 2024-12-18T00:57:31.8696722Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 14s local 2024-12-18T00:57:31.8697887Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local ... 2024-12-18T00:57:32.0877491Z 2024-12-18T00:57:32.0878384Z  2024-12-18T00:57:32.0878832Z  2024-12-18T00:57:32.0879229Z  2024-12-18T00:57:32.0879644Z  2024-12-18T00:57:32.0880031Z  2024-12-18T00:57:32.0880792Z  2024-12-18T00:57:32.0881196Z  2024-12-18T00:57:32.0881600Z  2024-12-18T00:57:32.0882581Z [18,288 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:32.0883755Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2024-12-18T00:57:32.0884713Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:57:32.0885777Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2024-12-18T00:57:32.0887050Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:57:32.0888252Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2024-12-18T00:57:32.0889191Z @llvm-project//llvm:CodeGen; 15s local 2024-12-18T00:57:32.0890111Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:57:32.0891238Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local ... 2024-12-18T00:57:32.5553056Z 2024-12-18T00:57:32.5553942Z  2024-12-18T00:57:32.5554430Z  2024-12-18T00:57:32.5554802Z  2024-12-18T00:57:32.5555312Z  2024-12-18T00:57:32.5555683Z  2024-12-18T00:57:32.5556122Z  2024-12-18T00:57:32.5556566Z  2024-12-18T00:57:32.5556930Z  2024-12-18T00:57:32.5557938Z [18,289 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:32.5559024Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2024-12-18T00:57:32.5559869Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:57:32.5560860Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2024-12-18T00:57:32.5562013Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:57:32.5563155Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2024-12-18T00:57:32.5564138Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:57:32.5565099Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:57:32.5566279Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local ... 2024-12-18T00:57:32.8212304Z 2024-12-18T00:57:32.8213117Z  2024-12-18T00:57:32.8213581Z  2024-12-18T00:57:32.8213955Z  2024-12-18T00:57:32.8214346Z  2024-12-18T00:57:32.8214728Z  2024-12-18T00:57:32.8215118Z  2024-12-18T00:57:32.8215505Z  2024-12-18T00:57:32.8215880Z  2024-12-18T00:57:32.8216942Z [18,290 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:32.8217998Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2024-12-18T00:57:32.8218854Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:57:32.8219824Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2024-12-18T00:57:32.8221453Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:57:32.8222567Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2024-12-18T00:57:32.8223467Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:57:32.8224395Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 15s local 2024-12-18T00:57:32.8225507Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local ... 2024-12-18T00:57:33.0885359Z 2024-12-18T00:57:33.0886288Z  2024-12-18T00:57:33.0886743Z  2024-12-18T00:57:33.0887137Z  2024-12-18T00:57:33.0887536Z  2024-12-18T00:57:33.0887943Z  2024-12-18T00:57:33.0888349Z  2024-12-18T00:57:33.0888721Z  2024-12-18T00:57:33.0889108Z  2024-12-18T00:57:33.0890046Z [18,291 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:33.0891120Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2024-12-18T00:57:33.0892300Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:57:33.0893265Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2024-12-18T00:57:33.0894388Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:33.0895468Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2024-12-18T00:57:33.0896332Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:57:33.0897368Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:57:33.0898487Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local ... 2024-12-18T00:57:33.3831051Z 2024-12-18T00:57:33.3831924Z  2024-12-18T00:57:33.3832412Z  2024-12-18T00:57:33.3832786Z  2024-12-18T00:57:33.3833132Z  2024-12-18T00:57:33.3833514Z  2024-12-18T00:57:33.3833910Z  2024-12-18T00:57:33.3834281Z  2024-12-18T00:57:33.3834684Z  2024-12-18T00:57:33.3835845Z [18,292 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:33.3837030Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2024-12-18T00:57:33.3837850Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:57:33.3838862Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2024-12-18T00:57:33.3839941Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:33.3841170Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2024-12-18T00:57:33.3842025Z @llvm-project//llvm:CodeGen; 16s local 2024-12-18T00:57:33.3842897Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:57:33.3843937Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local ... 2024-12-18T00:57:33.6890976Z 2024-12-18T00:57:33.6891899Z  2024-12-18T00:57:33.6892401Z  2024-12-18T00:57:33.6892790Z  2024-12-18T00:57:33.6893216Z  2024-12-18T00:57:33.6893612Z  2024-12-18T00:57:33.6894009Z  2024-12-18T00:57:33.6894408Z  2024-12-18T00:57:33.6894796Z  2024-12-18T00:57:33.6895733Z [18,293 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:33.6896967Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2024-12-18T00:57:33.6897843Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:57:33.6898843Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2024-12-18T00:57:33.6899994Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:33.6901124Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2024-12-18T00:57:33.6902016Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:57:33.6902915Z Compiling mlir/lib/Conversion/ComplexToLLVM/ComplexToLLVM.cpp; 16s local 2024-12-18T00:57:33.6904326Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local ... 2024-12-18T00:57:33.9224101Z 2024-12-18T00:57:33.9224961Z  2024-12-18T00:57:33.9225420Z  2024-12-18T00:57:33.9225857Z  2024-12-18T00:57:33.9226265Z  2024-12-18T00:57:33.9226668Z  2024-12-18T00:57:33.9227046Z  2024-12-18T00:57:33.9227525Z  2024-12-18T00:57:33.9227921Z  2024-12-18T00:57:33.9228866Z [18,294 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:33.9230058Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2024-12-18T00:57:33.9230900Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:57:33.9231834Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2024-12-18T00:57:33.9232878Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:33.9234230Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2024-12-18T00:57:33.9235128Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:57:33.9235890Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local 2024-12-18T00:57:33.9236873Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local ... 2024-12-18T00:57:34.1594451Z 2024-12-18T00:57:34.1595304Z  2024-12-18T00:57:34.1595759Z  2024-12-18T00:57:34.1596133Z  2024-12-18T00:57:34.1596488Z  2024-12-18T00:57:34.1596856Z  2024-12-18T00:57:34.1597237Z  2024-12-18T00:57:34.1597601Z  2024-12-18T00:57:34.1597945Z  2024-12-18T00:57:34.1598842Z [18,296 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:34.1599860Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2024-12-18T00:57:34.1600666Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:57:34.1601683Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2024-12-18T00:57:34.1603122Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:57:34.1604159Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2024-12-18T00:57:34.1605026Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:57:34.1605792Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:57:34.1606769Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local ... 2024-12-18T00:57:34.4118136Z 2024-12-18T00:57:34.4119040Z  2024-12-18T00:57:34.4119506Z  2024-12-18T00:57:34.4119880Z  2024-12-18T00:57:34.4120263Z  2024-12-18T00:57:34.4120640Z  2024-12-18T00:57:34.4121022Z  2024-12-18T00:57:34.4121402Z  2024-12-18T00:57:34.4121708Z  2024-12-18T00:57:34.4122450Z [18,298 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:34.4123551Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2024-12-18T00:57:34.4124425Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:57:34.4125368Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2024-12-18T00:57:34.4126484Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:57:34.4127524Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2024-12-18T00:57:34.4128386Z @llvm-project//llvm:CodeGen; 17s local 2024-12-18T00:57:34.4129162Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:57:34.4130146Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local ... 2024-12-18T00:57:34.6898589Z 2024-12-18T00:57:34.6899416Z  2024-12-18T00:57:34.6899850Z  2024-12-18T00:57:34.6900220Z  2024-12-18T00:57:34.6900573Z  2024-12-18T00:57:34.6900946Z  2024-12-18T00:57:34.6901559Z  2024-12-18T00:57:34.6901913Z  2024-12-18T00:57:34.6902270Z  2024-12-18T00:57:34.6903117Z [18,299 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:34.6904219Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2024-12-18T00:57:34.6904999Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:57:34.6905930Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2024-12-18T00:57:34.6906995Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:57:34.6908053Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local 2024-12-18T00:57:34.6908871Z @llvm-project//llvm:CodeGen; 18s local 2024-12-18T00:57:34.6909602Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:57:34.6910596Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local ... 2024-12-18T00:57:35.4443326Z 2024-12-18T00:57:35.4444483Z  2024-12-18T00:57:35.4444984Z  2024-12-18T00:57:35.4445674Z  2024-12-18T00:57:35.4446070Z  2024-12-18T00:57:35.4446454Z  2024-12-18T00:57:35.4446834Z  2024-12-18T00:57:35.4447220Z  2024-12-18T00:57:35.4447567Z  2024-12-18T00:57:35.4448540Z [18,300 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:35.4449578Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:57:35.4450451Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:57:35.4451435Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2024-12-18T00:57:35.4452476Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:57:35.4453533Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local 2024-12-18T00:57:35.4454407Z @llvm-project//llvm:CodeGen; 18s local 2024-12-18T00:57:35.4455206Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 17s local 2024-12-18T00:57:35.4456705Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local ... 2024-12-18T00:57:35.6906584Z 2024-12-18T00:57:35.6907591Z  2024-12-18T00:57:35.6908100Z  2024-12-18T00:57:35.6908568Z  2024-12-18T00:57:35.6909021Z  2024-12-18T00:57:35.6909476Z  2024-12-18T00:57:35.6909922Z  2024-12-18T00:57:35.6910357Z  2024-12-18T00:57:35.6910812Z  2024-12-18T00:57:35.6911911Z [18,303 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:35.6913188Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:57:35.6914202Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:57:35.6915346Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2024-12-18T00:57:35.6916700Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:57:35.6918043Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2024-12-18T00:57:35.6919081Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:57:35.6919998Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:57:35.6920990Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:36.0317458Z 2024-12-18T00:57:36.0318445Z  2024-12-18T00:57:36.0318914Z  2024-12-18T00:57:36.0319369Z  2024-12-18T00:57:36.0319773Z  2024-12-18T00:57:36.0320162Z  2024-12-18T00:57:36.0320509Z  2024-12-18T00:57:36.0320953Z  2024-12-18T00:57:36.0321394Z  2024-12-18T00:57:36.0322334Z [18,307 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:36.0323433Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:57:36.0324268Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:57:36.0325537Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2024-12-18T00:57:36.0326662Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:57:36.0327725Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2024-12-18T00:57:36.0328726Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:57:36.0329483Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2024-12-18T00:57:36.0330422Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local ... 2024-12-18T00:57:36.2911342Z 2024-12-18T00:57:36.2912180Z  2024-12-18T00:57:36.2912638Z  2024-12-18T00:57:36.2913024Z  2024-12-18T00:57:36.2913425Z  2024-12-18T00:57:36.2913813Z  2024-12-18T00:57:36.2914206Z  2024-12-18T00:57:36.2914588Z  2024-12-18T00:57:36.2914915Z  2024-12-18T00:57:36.2915819Z [18,307 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:36.2917207Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:57:36.2918033Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:57:36.2918953Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2024-12-18T00:57:36.2920080Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:57:36.2921144Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2024-12-18T00:57:36.2922043Z @llvm-project//llvm:CodeGen; 19s local 2024-12-18T00:57:36.2922852Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 17s local 2024-12-18T00:57:36.2923782Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local ... 2024-12-18T00:57:36.5578205Z 2024-12-18T00:57:36.5579068Z  2024-12-18T00:57:36.5579550Z  2024-12-18T00:57:36.5579944Z  2024-12-18T00:57:36.5580345Z  2024-12-18T00:57:36.5580729Z  2024-12-18T00:57:36.5581144Z  2024-12-18T00:57:36.5581514Z  2024-12-18T00:57:36.5581922Z  2024-12-18T00:57:36.5583235Z [18,308 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:36.5584367Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:57:36.5585270Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:57:36.5586254Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2024-12-18T00:57:36.5587394Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:57:36.5588487Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2024-12-18T00:57:36.5589364Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:57:36.5590110Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2024-12-18T00:57:36.5590954Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2024-12-18T00:57:36.8453149Z 2024-12-18T00:57:36.8454103Z  2024-12-18T00:57:36.8454591Z  2024-12-18T00:57:36.8455034Z  2024-12-18T00:57:36.8455428Z  2024-12-18T00:57:36.8455866Z  2024-12-18T00:57:36.8456273Z  2024-12-18T00:57:36.8456866Z  2024-12-18T00:57:36.8457290Z  2024-12-18T00:57:36.8458231Z [18,310 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:36.8459369Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:57:36.8460287Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:57:36.8461437Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2024-12-18T00:57:36.8462665Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:57:36.8463787Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:57:36.8464749Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:57:36.8465511Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:57:36.8466898Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2024-12-18T00:57:37.0917956Z 2024-12-18T00:57:37.0918814Z  2024-12-18T00:57:37.0919297Z  2024-12-18T00:57:37.0919703Z  2024-12-18T00:57:37.0920083Z  2024-12-18T00:57:37.0920597Z  2024-12-18T00:57:37.0920989Z  2024-12-18T00:57:37.0921380Z  2024-12-18T00:57:37.0921767Z  2024-12-18T00:57:37.0922749Z [18,310 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:37.0923746Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:57:37.0924663Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:57:37.0925726Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2024-12-18T00:57:37.0926889Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:57:37.0928380Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:57:37.0929331Z @llvm-project//llvm:CodeGen; 20s local 2024-12-18T00:57:37.0940370Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:57:37.0941616Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2024-12-18T00:57:37.4922053Z 2024-12-18T00:57:37.4922930Z  2024-12-18T00:57:37.4923420Z  2024-12-18T00:57:37.4923835Z  2024-12-18T00:57:37.4924226Z  2024-12-18T00:57:37.4924624Z  2024-12-18T00:57:37.4925139Z  2024-12-18T00:57:37.4925516Z  2024-12-18T00:57:37.4925924Z  2024-12-18T00:57:37.4926822Z [18,311 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:37.4927865Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:57:37.4928667Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:57:37.4929914Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2024-12-18T00:57:37.4931166Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:57:37.4932256Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:57:37.4933175Z @llvm-project//llvm:CodeGen; 21s local 2024-12-18T00:57:37.4933921Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:57:37.4934924Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2024-12-18T00:57:37.7484493Z 2024-12-18T00:57:37.7485380Z  2024-12-18T00:57:37.7485873Z  2024-12-18T00:57:37.7486269Z  2024-12-18T00:57:37.7486679Z  2024-12-18T00:57:37.7487090Z  2024-12-18T00:57:37.7487478Z  2024-12-18T00:57:37.7487850Z  2024-12-18T00:57:37.7488242Z  2024-12-18T00:57:37.7489144Z [18,313 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:37.7490233Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:57:37.7491288Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:57:37.7492267Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2024-12-18T00:57:37.7493419Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:57:37.7494542Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:57:37.7495434Z @llvm-project//llvm:CodeGen; 21s local 2024-12-18T00:57:37.7496179Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2024-12-18T00:57:37.7497276Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2024-12-18T00:57:38.0928028Z 2024-12-18T00:57:38.0928904Z  2024-12-18T00:57:38.0929373Z  2024-12-18T00:57:38.0929796Z  2024-12-18T00:57:38.0930198Z  2024-12-18T00:57:38.0930600Z  2024-12-18T00:57:38.0931281Z  2024-12-18T00:57:38.0931679Z  2024-12-18T00:57:38.0932087Z  2024-12-18T00:57:38.0933111Z [18,314 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:38.0934214Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:57:38.0935133Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:57:38.0936108Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2024-12-18T00:57:38.0937544Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:57:38.0938681Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:57:38.0939645Z @llvm-project//llvm:CodeGen; 21s local 2024-12-18T00:57:38.0940403Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:57:38.0941392Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2024-12-18T00:57:38.4932711Z 2024-12-18T00:57:38.4933609Z  2024-12-18T00:57:38.4934088Z  2024-12-18T00:57:38.4934729Z  2024-12-18T00:57:38.4935131Z  2024-12-18T00:57:38.4935527Z  2024-12-18T00:57:38.4935935Z  2024-12-18T00:57:38.4936334Z  2024-12-18T00:57:38.4936902Z  2024-12-18T00:57:38.4937992Z [18,315 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:38.4939066Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:57:38.4939933Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:57:38.4940936Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:57:38.4942117Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:57:38.4943232Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:57:38.4944120Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:57:38.4944987Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:57:38.4946076Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2024-12-18T00:57:38.7096791Z 2024-12-18T00:57:38.7097689Z  2024-12-18T00:57:38.7098177Z  2024-12-18T00:57:38.7098592Z  2024-12-18T00:57:38.7099008Z  2024-12-18T00:57:38.7099407Z  2024-12-18T00:57:38.7099820Z  2024-12-18T00:57:38.7100220Z  2024-12-18T00:57:38.7100633Z  2024-12-18T00:57:38.7101598Z [18,316 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:38.7102737Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:57:38.7103724Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:57:38.7104840Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:57:38.7106003Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:57:38.7107218Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:57:38.7108176Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:57:38.7108930Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2024-12-18T00:57:38.7109977Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2024-12-18T00:57:39.0348713Z 2024-12-18T00:57:39.0349597Z  2024-12-18T00:57:39.0349974Z  2024-12-18T00:57:39.0350292Z  2024-12-18T00:57:39.0350609Z  2024-12-18T00:57:39.0350921Z  2024-12-18T00:57:39.0351215Z  2024-12-18T00:57:39.0351534Z  2024-12-18T00:57:39.0351851Z  2024-12-18T00:57:39.0352594Z [18,317 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:39.0353412Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:57:39.0354052Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:57:39.0355104Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:57:39.0355962Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:57:39.0356765Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:57:39.0357427Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:57:39.0357975Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:57:39.0358667Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2024-12-18T00:57:39.2939370Z 2024-12-18T00:57:39.2940304Z  2024-12-18T00:57:39.2940747Z  2024-12-18T00:57:39.2941156Z  2024-12-18T00:57:39.2941613Z  2024-12-18T00:57:39.2941969Z  2024-12-18T00:57:39.2942327Z  2024-12-18T00:57:39.2942707Z  2024-12-18T00:57:39.2943065Z  2024-12-18T00:57:39.2943995Z [18,318 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:39.2945636Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:57:39.2946492Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:57:39.2947458Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2024-12-18T00:57:39.2948571Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:57:39.2949634Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:57:39.2950520Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T00:57:39.2951217Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:57:39.2952184Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2024-12-18T00:57:39.5398470Z 2024-12-18T00:57:39.5399385Z  2024-12-18T00:57:39.5399836Z  2024-12-18T00:57:39.5400225Z  2024-12-18T00:57:39.5400607Z  2024-12-18T00:57:39.5400998Z  2024-12-18T00:57:39.5401427Z  2024-12-18T00:57:39.5401786Z  2024-12-18T00:57:39.5402163Z  2024-12-18T00:57:39.5403600Z [18,319 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:39.5404672Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:57:39.5405513Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:57:39.5406511Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2024-12-18T00:57:39.5407667Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:57:39.5408751Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:57:39.5409779Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T00:57:39.5410478Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2024-12-18T00:57:39.5411382Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2024-12-18T00:57:39.8945259Z 2024-12-18T00:57:39.8946196Z  2024-12-18T00:57:39.8946678Z  2024-12-18T00:57:39.8947114Z  2024-12-18T00:57:39.8947487Z  2024-12-18T00:57:39.8947863Z  2024-12-18T00:57:39.8948245Z  2024-12-18T00:57:39.8948624Z  2024-12-18T00:57:39.8948994Z  2024-12-18T00:57:39.8949918Z [18,320 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:39.8951018Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:57:39.8951918Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:57:39.8952892Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2024-12-18T00:57:39.8954043Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:57:39.8955140Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2024-12-18T00:57:39.8956038Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T00:57:39.8956995Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2024-12-18T00:57:39.8957897Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local ... 2024-12-18T00:57:40.7704550Z 2024-12-18T00:57:40.7705497Z  2024-12-18T00:57:40.7706041Z  2024-12-18T00:57:40.7706493Z  2024-12-18T00:57:40.7706953Z  2024-12-18T00:57:40.7707415Z  2024-12-18T00:57:40.7707875Z  2024-12-18T00:57:40.7708343Z  2024-12-18T00:57:40.7708780Z  2024-12-18T00:57:40.7709869Z [18,321 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:40.7711152Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:57:40.7712178Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:57:40.7713360Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2024-12-18T00:57:40.7714731Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2024-12-18T00:57:40.7716475Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:57:40.7717547Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T00:57:40.7718374Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2024-12-18T00:57:40.7719488Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2024-12-18T00:57:41.0667432Z 2024-12-18T00:57:41.0668299Z  2024-12-18T00:57:41.0668784Z  2024-12-18T00:57:41.0669212Z  2024-12-18T00:57:41.0669627Z  2024-12-18T00:57:41.0670037Z  2024-12-18T00:57:41.0670442Z  2024-12-18T00:57:41.0670780Z  2024-12-18T00:57:41.0671177Z  2024-12-18T00:57:41.0672051Z [18,322 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:41.0673041Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:57:41.0673888Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:57:41.0675005Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2024-12-18T00:57:41.0676193Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2024-12-18T00:57:41.0677278Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:57:41.0678071Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T00:57:41.0678727Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:57:41.0679631Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2024-12-18T00:57:41.2955008Z 2024-12-18T00:57:41.2955810Z  2024-12-18T00:57:41.2956243Z  2024-12-18T00:57:41.2956611Z  2024-12-18T00:57:41.2956975Z  2024-12-18T00:57:41.2957311Z  2024-12-18T00:57:41.2957629Z  2024-12-18T00:57:41.2957955Z  2024-12-18T00:57:41.2958281Z  2024-12-18T00:57:41.2959178Z [18,325 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:41.2960137Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:57:41.2960975Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:57:41.2961901Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2024-12-18T00:57:41.2962943Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:57:41.2963707Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T00:57:41.2964293Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:57:41.2965058Z @llvm-project//mlir:BufferizationDialect; 17s local 2024-12-18T00:57:41.2965827Z Compiling xla/service/while_loop_simplifier.cc; 16s local ... 2024-12-18T00:57:41.6788590Z 2024-12-18T00:57:41.6789429Z  2024-12-18T00:57:41.6789881Z  2024-12-18T00:57:41.6790256Z  2024-12-18T00:57:41.6790641Z  2024-12-18T00:57:41.6791012Z  2024-12-18T00:57:41.6791385Z  2024-12-18T00:57:41.6792049Z  2024-12-18T00:57:41.6792437Z  2024-12-18T00:57:41.6793362Z [18,329 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:41.6794420Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:57:41.6795274Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:57:41.6796281Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2024-12-18T00:57:41.6797286Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T00:57:41.6798035Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2024-12-18T00:57:41.6798857Z @llvm-project//mlir:BufferizationDialect; 18s local 2024-12-18T00:57:41.6799670Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2024-12-18T00:57:41.6800505Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:41.8868532Z 2024-12-18T00:57:41.8869471Z  2024-12-18T00:57:41.8869914Z  2024-12-18T00:57:41.8870321Z  2024-12-18T00:57:41.8870718Z  2024-12-18T00:57:41.8871436Z  2024-12-18T00:57:41.8871789Z  2024-12-18T00:57:41.8872147Z  2024-12-18T00:57:41.8872515Z  2024-12-18T00:57:41.8873432Z [18,331 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:41.8874472Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2024-12-18T00:57:41.8875221Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:57:41.8876105Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2024-12-18T00:57:41.8877136Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T00:57:41.8877800Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:57:41.8878625Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2024-12-18T00:57:41.8879583Z Compiling .../evaluator/hlo_evaluator_typed_visitor_double.cc; 14s local 2024-12-18T00:57:41.8880564Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 13s local ... 2024-12-18T00:57:42.0963517Z 2024-12-18T00:57:42.0964466Z  2024-12-18T00:57:42.0964999Z  2024-12-18T00:57:42.0965419Z  2024-12-18T00:57:42.0965815Z  2024-12-18T00:57:42.0966221Z  2024-12-18T00:57:42.0966640Z  2024-12-18T00:57:42.0967058Z  2024-12-18T00:57:42.0967448Z  2024-12-18T00:57:42.0968438Z [18,331 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:42.0969527Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2024-12-18T00:57:42.0970381Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:57:42.0971369Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2024-12-18T00:57:42.0972326Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T00:57:42.0973056Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:57:42.0974085Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2024-12-18T00:57:42.0975035Z Compiling .../evaluator/hlo_evaluator_typed_visitor_double.cc; 14s local 2024-12-18T00:57:42.0975921Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 13s local ... 2024-12-18T00:57:42.8052857Z 2024-12-18T00:57:42.8053746Z  2024-12-18T00:57:42.8054208Z  2024-12-18T00:57:42.8054618Z  2024-12-18T00:57:42.8055026Z  2024-12-18T00:57:42.8055398Z  2024-12-18T00:57:42.8055756Z  2024-12-18T00:57:42.8056129Z  2024-12-18T00:57:42.8056662Z  2024-12-18T00:57:42.8057566Z [18,332 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:42.8058672Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:57:42.8059518Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:57:42.8060523Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2024-12-18T00:57:42.8061844Z @llvm-project//llvm:CodeGen; 26s local 2024-12-18T00:57:42.8062554Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2024-12-18T00:57:42.8063379Z Compiling xla/service/while_loop_simplifier.cc; 17s local 2024-12-18T00:57:42.8064297Z Compiling .../evaluator/hlo_evaluator_typed_visitor_double.cc; 15s local 2024-12-18T00:57:42.8065245Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 14s local ... 2024-12-18T00:57:43.0967094Z 2024-12-18T00:57:43.0967981Z  2024-12-18T00:57:43.0968440Z  2024-12-18T00:57:43.0968825Z  2024-12-18T00:57:43.0969204Z  2024-12-18T00:57:43.0969558Z  2024-12-18T00:57:43.0969931Z  2024-12-18T00:57:43.0970294Z  2024-12-18T00:57:43.0970671Z  2024-12-18T00:57:43.0971562Z [18,334 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:43.0972623Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:57:43.0974063Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2024-12-18T00:57:43.0975132Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:57:43.0975983Z Compiling xla/service/while_loop_simplifier.cc; 17s local 2024-12-18T00:57:43.0977124Z Compiling .../evaluator/hlo_evaluator_typed_visitor_double.cc; 15s local 2024-12-18T00:57:43.0978337Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2024-12-18T00:57:43.0979416Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float.cc; 14s local 2024-12-18T00:57:43.0980404Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local ... 2024-12-18T00:57:43.4482582Z 2024-12-18T00:57:43.4483465Z  2024-12-18T00:57:43.4483943Z  2024-12-18T00:57:43.4484357Z  2024-12-18T00:57:43.4484760Z  2024-12-18T00:57:43.4485168Z  2024-12-18T00:57:43.4485537Z  2024-12-18T00:57:43.4485884Z  2024-12-18T00:57:43.4486266Z  2024-12-18T00:57:43.4487522Z [18,335 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:43.4488747Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:57:43.4489827Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:57:43.4490973Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:57:43.4491839Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2024-12-18T00:57:43.4492799Z Compiling .../evaluator/hlo_evaluator_typed_visitor_double.cc; 15s local 2024-12-18T00:57:43.4493941Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2024-12-18T00:57:43.4495066Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float.cc; 15s local 2024-12-18T00:57:43.4496034Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local ... 2024-12-18T00:57:43.6972666Z 2024-12-18T00:57:43.6973529Z  2024-12-18T00:57:43.6974009Z  2024-12-18T00:57:43.6974439Z  2024-12-18T00:57:43.6974832Z  2024-12-18T00:57:43.6975268Z  2024-12-18T00:57:43.6975647Z  2024-12-18T00:57:43.6976034Z  2024-12-18T00:57:43.6976548Z  2024-12-18T00:57:43.6977489Z [18,336 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:43.6978564Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:57:43.6979623Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:57:43.6980651Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2024-12-18T00:57:43.6981497Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2024-12-18T00:57:43.6982451Z Compiling .../evaluator/hlo_evaluator_typed_visitor_double.cc; 15s local 2024-12-18T00:57:43.6983511Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2024-12-18T00:57:43.6984555Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float.cc; 15s local 2024-12-18T00:57:43.6985952Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local ... 2024-12-18T00:57:43.9719638Z 2024-12-18T00:57:43.9720559Z  2024-12-18T00:57:43.9721037Z  2024-12-18T00:57:43.9721452Z  2024-12-18T00:57:43.9721841Z  2024-12-18T00:57:43.9722238Z  2024-12-18T00:57:43.9722603Z  2024-12-18T00:57:43.9722966Z  2024-12-18T00:57:43.9723327Z  2024-12-18T00:57:43.9724272Z [18,337 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:43.9725266Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:57:43.9726359Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:57:43.9727345Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:57:43.9728178Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2024-12-18T00:57:43.9729148Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2024-12-18T00:57:43.9730598Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float.cc; 15s local 2024-12-18T00:57:43.9731578Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local 2024-12-18T00:57:43.9732556Z Compiling xla/service/memory_space_assignment/simulator.cc; 13s local ... 2024-12-18T00:57:44.2978441Z 2024-12-18T00:57:44.2979285Z  2024-12-18T00:57:44.2979757Z  2024-12-18T00:57:44.2980139Z  2024-12-18T00:57:44.2980521Z  2024-12-18T00:57:44.2980920Z  2024-12-18T00:57:44.2981307Z  2024-12-18T00:57:44.2981683Z  2024-12-18T00:57:44.2982019Z  2024-12-18T00:57:44.2982911Z [18,338 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:44.2983939Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:57:44.2984999Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:57:44.2986415Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:57:44.2987348Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:57:44.2988323Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2024-12-18T00:57:44.2989379Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float.cc; 15s local 2024-12-18T00:57:44.2990245Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local 2024-12-18T00:57:44.2991208Z Compiling xla/service/memory_space_assignment/simulator.cc; 13s local ... 2024-12-18T00:57:44.6938707Z 2024-12-18T00:57:44.6939580Z  2024-12-18T00:57:44.6940044Z  2024-12-18T00:57:44.6940434Z  2024-12-18T00:57:44.6940965Z  2024-12-18T00:57:44.6941379Z  2024-12-18T00:57:44.6941785Z  2024-12-18T00:57:44.6942193Z  2024-12-18T00:57:44.6942578Z  2024-12-18T00:57:44.6943529Z [18,339 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:44.6944894Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:57:44.6946018Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2024-12-18T00:57:44.6947083Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2024-12-18T00:57:44.6947930Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:57:44.6948934Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2024-12-18T00:57:44.6949908Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2024-12-18T00:57:44.6950890Z Compiling xla/service/memory_space_assignment/simulator.cc; 14s local 2024-12-18T00:57:44.6951832Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:44.8983483Z 2024-12-18T00:57:44.8984368Z  2024-12-18T00:57:44.8984840Z  2024-12-18T00:57:44.8985237Z  2024-12-18T00:57:44.8985620Z  2024-12-18T00:57:44.8986015Z  2024-12-18T00:57:44.8986704Z  2024-12-18T00:57:44.8987062Z  2024-12-18T00:57:44.8987462Z  2024-12-18T00:57:44.8988412Z [18,339 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:44.8989489Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2024-12-18T00:57:44.8990567Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2024-12-18T00:57:44.8991555Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:57:44.8992419Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:57:44.8993371Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2024-12-18T00:57:44.8994461Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2024-12-18T00:57:44.8995422Z Compiling xla/service/memory_space_assignment/simulator.cc; 14s local 2024-12-18T00:57:44.8996327Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:45.2987939Z 2024-12-18T00:57:45.2988863Z  2024-12-18T00:57:45.2989682Z  2024-12-18T00:57:45.2990062Z  2024-12-18T00:57:45.2990427Z  2024-12-18T00:57:45.2990784Z  2024-12-18T00:57:45.2991145Z  2024-12-18T00:57:45.2991519Z  2024-12-18T00:57:45.2991864Z  2024-12-18T00:57:45.2992784Z [18,340 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:45.2993811Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2024-12-18T00:57:45.2994720Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:57:45.2995593Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:57:45.2996721Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2024-12-18T00:57:45.2997710Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2024-12-18T00:57:45.2998615Z Compiling xla/service/memory_space_assignment/simulator.cc; 14s local 2024-12-18T00:57:45.2999966Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 14s local 2024-12-18T00:57:45.3001000Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:45.5729026Z 2024-12-18T00:57:45.5729945Z  2024-12-18T00:57:45.5730421Z  2024-12-18T00:57:45.5730785Z  2024-12-18T00:57:45.5731176Z  2024-12-18T00:57:45.5731558Z  2024-12-18T00:57:45.5731969Z  2024-12-18T00:57:45.5732360Z  2024-12-18T00:57:45.5732739Z  2024-12-18T00:57:45.5733647Z [18,342 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:45.5734732Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2024-12-18T00:57:45.5735633Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2024-12-18T00:57:45.5736664Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:57:45.5737583Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 17s local 2024-12-18T00:57:45.5738615Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2024-12-18T00:57:45.5739595Z Compiling xla/service/memory_space_assignment/simulator.cc; 15s local 2024-12-18T00:57:45.5740649Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 15s local 2024-12-18T00:57:45.5741720Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:45.8993392Z 2024-12-18T00:57:45.8994288Z  2024-12-18T00:57:45.8994781Z  2024-12-18T00:57:45.8995213Z  2024-12-18T00:57:45.8995628Z  2024-12-18T00:57:45.8996035Z  2024-12-18T00:57:45.8996440Z  2024-12-18T00:57:45.8996812Z  2024-12-18T00:57:45.8997326Z  2024-12-18T00:57:45.8998235Z [18,343 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:45.8999241Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:57:45.9000043Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:57:45.9001194Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:57:45.9002136Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 17s local 2024-12-18T00:57:45.9003101Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2024-12-18T00:57:45.9003987Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 15s local 2024-12-18T00:57:45.9004943Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 15s local 2024-12-18T00:57:45.9005950Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local ... 2024-12-18T00:57:46.1727307Z 2024-12-18T00:57:46.1728213Z  2024-12-18T00:57:46.1728657Z  2024-12-18T00:57:46.1729050Z  2024-12-18T00:57:46.1729426Z  2024-12-18T00:57:46.1729800Z  2024-12-18T00:57:46.1730207Z  2024-12-18T00:57:46.1730587Z  2024-12-18T00:57:46.1730971Z  2024-12-18T00:57:46.1731900Z [18,345 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:46.1733303Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:57:46.1734223Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:57:46.1735080Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2024-12-18T00:57:46.1736016Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 15s local 2024-12-18T00:57:46.1737268Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 15s local 2024-12-18T00:57:46.1738399Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local 2024-12-18T00:57:46.1739384Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 12s local 2024-12-18T00:57:46.1740422Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local ... 2024-12-18T00:57:46.4998826Z 2024-12-18T00:57:46.4999641Z  2024-12-18T00:57:46.5000054Z  2024-12-18T00:57:46.5000416Z  2024-12-18T00:57:46.5000795Z  2024-12-18T00:57:46.5001141Z  2024-12-18T00:57:46.5001485Z  2024-12-18T00:57:46.5002132Z  2024-12-18T00:57:46.5002475Z  2024-12-18T00:57:46.5003327Z [18,345 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:46.5004272Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:57:46.5005060Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:57:46.5005779Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2024-12-18T00:57:46.5006603Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 15s local 2024-12-18T00:57:46.5007542Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 15s local 2024-12-18T00:57:46.5008466Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local 2024-12-18T00:57:46.5009361Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 13s local 2024-12-18T00:57:46.5010471Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local ... 2024-12-18T00:57:46.7221864Z 2024-12-18T00:57:46.7222713Z  2024-12-18T00:57:46.7223120Z  2024-12-18T00:57:46.7223467Z  2024-12-18T00:57:46.7223826Z  2024-12-18T00:57:46.7224180Z  2024-12-18T00:57:46.7224524Z  2024-12-18T00:57:46.7224867Z  2024-12-18T00:57:46.7225218Z  2024-12-18T00:57:46.7226023Z [18,349 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:46.7226996Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:57:46.7227796Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2024-12-18T00:57:46.7228541Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2024-12-18T00:57:46.7229384Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 15s local 2024-12-18T00:57:46.7230265Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local 2024-12-18T00:57:46.7231435Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 13s local 2024-12-18T00:57:46.7232392Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2024-12-18T00:57:46.7233271Z @llvm-project//mlir:BufferizationDialect; 12s local ... 2024-12-18T00:57:47.0335545Z 2024-12-18T00:57:47.0336534Z  2024-12-18T00:57:47.0336973Z  2024-12-18T00:57:47.0337315Z  2024-12-18T00:57:47.0337657Z  2024-12-18T00:57:47.0337998Z  2024-12-18T00:57:47.0338335Z  2024-12-18T00:57:47.0338715Z  2024-12-18T00:57:47.0339047Z  2024-12-18T00:57:47.0339819Z [18,351 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:47.0340744Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2024-12-18T00:57:47.0341507Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:57:47.0342219Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2024-12-18T00:57:47.0343337Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 16s local 2024-12-18T00:57:47.0344416Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local 2024-12-18T00:57:47.0345247Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 13s local 2024-12-18T00:57:47.0346106Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:57:47.0346936Z @llvm-project//mlir:BufferizationTransforms; 12s local ... 2024-12-18T00:57:47.3004655Z 2024-12-18T00:57:47.3005461Z  2024-12-18T00:57:47.3005855Z  2024-12-18T00:57:47.3006176Z  2024-12-18T00:57:47.3006539Z  2024-12-18T00:57:47.3006865Z  2024-12-18T00:57:47.3007169Z  2024-12-18T00:57:47.3007489Z  2024-12-18T00:57:47.3007803Z  2024-12-18T00:57:47.3008663Z [18,352 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:47.3009533Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2024-12-18T00:57:47.3010562Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:57:47.3011321Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2024-12-18T00:57:47.3012093Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 16s local 2024-12-18T00:57:47.3012887Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2024-12-18T00:57:47.3013676Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 13s local 2024-12-18T00:57:47.3014496Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:57:47.3015310Z @llvm-project//mlir:BufferizationTransforms; 12s local ... 2024-12-18T00:57:47.7858109Z 2024-12-18T00:57:47.7859003Z  2024-12-18T00:57:47.7859477Z  2024-12-18T00:57:47.7859872Z  2024-12-18T00:57:47.7860233Z  2024-12-18T00:57:47.7860610Z  2024-12-18T00:57:47.7860964Z  2024-12-18T00:57:47.7861348Z  2024-12-18T00:57:47.7861692Z  2024-12-18T00:57:47.7862631Z [18,353 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:47.7863616Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2024-12-18T00:57:47.7864492Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2024-12-18T00:57:47.7865252Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2024-12-18T00:57:47.7866133Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2024-12-18T00:57:47.7867074Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2024-12-18T00:57:47.7867962Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 14s local 2024-12-18T00:57:47.7868974Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2024-12-18T00:57:47.7869941Z @llvm-project//mlir:BufferizationTransforms; 13s local ... 2024-12-18T00:57:48.1008776Z 2024-12-18T00:57:48.1009601Z  2024-12-18T00:57:48.1010032Z  2024-12-18T00:57:48.1010680Z  2024-12-18T00:57:48.1011008Z  2024-12-18T00:57:48.1011392Z  2024-12-18T00:57:48.1011736Z  2024-12-18T00:57:48.1012087Z  2024-12-18T00:57:48.1012420Z  2024-12-18T00:57:48.1013265Z [18,353 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:48.1014230Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:57:48.1015034Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:57:48.1015792Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2024-12-18T00:57:48.1016790Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2024-12-18T00:57:48.1017687Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2024-12-18T00:57:48.1018566Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 14s local 2024-12-18T00:57:48.1019510Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2024-12-18T00:57:48.1020656Z @llvm-project//mlir:BufferizationTransforms; 13s local ... 2024-12-18T00:57:48.5185014Z 2024-12-18T00:57:48.5186062Z  2024-12-18T00:57:48.5186541Z  2024-12-18T00:57:48.5186935Z  2024-12-18T00:57:48.5187336Z  2024-12-18T00:57:48.5187742Z  2024-12-18T00:57:48.5188153Z  2024-12-18T00:57:48.5188546Z  2024-12-18T00:57:48.5188956Z  2024-12-18T00:57:48.5189883Z [18,354 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:48.5191083Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:57:48.5192065Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:57:48.5192994Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:57:48.5193997Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2024-12-18T00:57:48.5195046Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2024-12-18T00:57:48.5196423Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local 2024-12-18T00:57:48.5197813Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2024-12-18T00:57:48.5198930Z Compiling .../evaluator/hlo_evaluator_typed_visitor_half.cc; 12s local ... 2024-12-18T00:57:48.7556811Z 2024-12-18T00:57:48.7557752Z  2024-12-18T00:57:48.7558232Z  2024-12-18T00:57:48.7558654Z  2024-12-18T00:57:48.7559042Z  2024-12-18T00:57:48.7559409Z  2024-12-18T00:57:48.7559792Z  2024-12-18T00:57:48.7560184Z  2024-12-18T00:57:48.7560585Z  2024-12-18T00:57:48.7561493Z [18,355 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:48.7562586Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:57:48.7563474Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2024-12-18T00:57:48.7564330Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:57:48.7565363Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:48.7566395Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2024-12-18T00:57:48.7567365Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local 2024-12-18T00:57:48.7568627Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 13s local 2024-12-18T00:57:48.7569617Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:57:49.1016592Z 2024-12-18T00:57:49.1017450Z  2024-12-18T00:57:49.1017873Z  2024-12-18T00:57:49.1018233Z  2024-12-18T00:57:49.1018598Z  2024-12-18T00:57:49.1018958Z  2024-12-18T00:57:49.1019322Z  2024-12-18T00:57:49.1019662Z  2024-12-18T00:57:49.1020055Z  2024-12-18T00:57:49.1021002Z [18,355 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:49.1022388Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:57:49.1023228Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:57:49.1023929Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:57:49.1024754Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:49.1025650Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2024-12-18T00:57:49.1026496Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local 2024-12-18T00:57:49.1027415Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 13s local 2024-12-18T00:57:49.1028263Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:57:49.3951808Z 2024-12-18T00:57:49.3952639Z  2024-12-18T00:57:49.3953106Z  2024-12-18T00:57:49.3953487Z  2024-12-18T00:57:49.3953878Z  2024-12-18T00:57:49.3954254Z  2024-12-18T00:57:49.3954642Z  2024-12-18T00:57:49.3955058Z  2024-12-18T00:57:49.3955447Z  2024-12-18T00:57:49.3956656Z [18,356 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:49.3957779Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:57:49.3958636Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:57:49.3959498Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:57:49.3960466Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:49.3961502Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2024-12-18T00:57:49.3962554Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local 2024-12-18T00:57:49.3963661Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 13s local 2024-12-18T00:57:49.3964772Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2024-12-18T00:57:49.7021669Z 2024-12-18T00:57:49.7022501Z  2024-12-18T00:57:49.7022999Z  2024-12-18T00:57:49.7023405Z  2024-12-18T00:57:49.7024114Z  2024-12-18T00:57:49.7024511Z  2024-12-18T00:57:49.7024882Z  2024-12-18T00:57:49.7025253Z  2024-12-18T00:57:49.7025615Z  2024-12-18T00:57:49.7026541Z [18,356 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:49.7027601Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:57:49.7028460Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2024-12-18T00:57:49.7029267Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:57:49.7030245Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2024-12-18T00:57:49.7031212Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2024-12-18T00:57:49.7032201Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local 2024-12-18T00:57:49.7033219Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local 2024-12-18T00:57:49.7034234Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:50.1026175Z 2024-12-18T00:57:50.1027054Z  2024-12-18T00:57:50.1027535Z  2024-12-18T00:57:50.1027929Z  2024-12-18T00:57:50.1028333Z  2024-12-18T00:57:50.1028721Z  2024-12-18T00:57:50.1029122Z  2024-12-18T00:57:50.1029496Z  2024-12-18T00:57:50.1029899Z  2024-12-18T00:57:50.1030827Z [18,357 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:50.1031915Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:57:50.1032826Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:57:50.1033711Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:57:50.1034664Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:57:50.1035658Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2024-12-18T00:57:50.1036996Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local 2024-12-18T00:57:50.1038125Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local 2024-12-18T00:57:50.1039121Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:50.3399926Z 2024-12-18T00:57:50.3400833Z  2024-12-18T00:57:50.3401296Z  2024-12-18T00:57:50.3401805Z  2024-12-18T00:57:50.3402192Z  2024-12-18T00:57:50.3402563Z  2024-12-18T00:57:50.3402954Z  2024-12-18T00:57:50.3403316Z  2024-12-18T00:57:50.3403692Z  2024-12-18T00:57:50.3404604Z [18,358 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:50.3405688Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:57:50.3406606Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:57:50.3407446Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:57:50.3408722Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:57:50.3409762Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:57:50.3410783Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local 2024-12-18T00:57:50.3411856Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 14s local 2024-12-18T00:57:50.3412793Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2024-12-18T00:57:50.5955424Z 2024-12-18T00:57:50.5956266Z  2024-12-18T00:57:50.5956757Z  2024-12-18T00:57:50.5957309Z  2024-12-18T00:57:50.5957735Z  2024-12-18T00:57:50.5958159Z  2024-12-18T00:57:50.5958542Z  2024-12-18T00:57:50.5958946Z  2024-12-18T00:57:50.5959359Z  2024-12-18T00:57:50.5960324Z [18,360 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:50.5961763Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:57:50.5962814Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2024-12-18T00:57:50.5963721Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:57:50.5964733Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2024-12-18T00:57:50.5965798Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:57:50.5966853Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2024-12-18T00:57:50.5967990Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local 2024-12-18T00:57:50.5968987Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:50.9036740Z 2024-12-18T00:57:50.9037528Z  2024-12-18T00:57:50.9037981Z  2024-12-18T00:57:50.9038349Z  2024-12-18T00:57:50.9038722Z  2024-12-18T00:57:50.9039102Z  2024-12-18T00:57:50.9039471Z  2024-12-18T00:57:50.9039894Z  2024-12-18T00:57:50.9040267Z  2024-12-18T00:57:50.9041243Z [18,360 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:50.9042385Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:57:50.9043223Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:57:50.9044047Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:57:50.9045220Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:57:50.9046153Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2024-12-18T00:57:50.9046999Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2024-12-18T00:57:50.9047955Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local 2024-12-18T00:57:50.9048780Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:51.1628326Z 2024-12-18T00:57:51.1629386Z  2024-12-18T00:57:51.1629764Z  2024-12-18T00:57:51.1630125Z  2024-12-18T00:57:51.1630449Z  2024-12-18T00:57:51.1630775Z  2024-12-18T00:57:51.1631097Z  2024-12-18T00:57:51.1631407Z  2024-12-18T00:57:51.1631730Z  2024-12-18T00:57:51.1632553Z [18,361 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:51.1633448Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:57:51.1634219Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:57:51.1634943Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:57:51.1635832Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:57:51.1636941Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:57:51.1637888Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2024-12-18T00:57:51.1638886Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local 2024-12-18T00:57:51.1640058Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2024-12-18T00:57:51.4170715Z 2024-12-18T00:57:51.4171587Z  2024-12-18T00:57:51.4172092Z  2024-12-18T00:57:51.4172500Z  2024-12-18T00:57:51.4172914Z  2024-12-18T00:57:51.4173286Z  2024-12-18T00:57:51.4173653Z  2024-12-18T00:57:51.4174022Z  2024-12-18T00:57:51.4174432Z  2024-12-18T00:57:51.4175338Z [18,362 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:51.4176554Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:57:51.4177428Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:57:51.4178264Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:57:51.4179172Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:57:51.4180207Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:57:51.4181610Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2024-12-18T00:57:51.4182716Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 15s local 2024-12-18T00:57:51.4183779Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 15s local ... 2024-12-18T00:57:51.7042050Z 2024-12-18T00:57:51.7042923Z  2024-12-18T00:57:51.7043403Z  2024-12-18T00:57:51.7043792Z  2024-12-18T00:57:51.7044430Z  2024-12-18T00:57:51.7044841Z  2024-12-18T00:57:51.7045227Z  2024-12-18T00:57:51.7045630Z  2024-12-18T00:57:51.7046001Z  2024-12-18T00:57:51.7046909Z [18,363 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:51.7048011Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:57:51.7048932Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2024-12-18T00:57:51.7049688Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2024-12-18T00:57:51.7050578Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2024-12-18T00:57:51.7051598Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:57:51.7052606Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2024-12-18T00:57:51.7053730Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 16s local 2024-12-18T00:57:51.7054878Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local ... 2024-12-18T00:57:51.9171183Z 2024-12-18T00:57:51.9182069Z  2024-12-18T00:57:51.9182801Z  2024-12-18T00:57:51.9183224Z  2024-12-18T00:57:51.9183622Z  2024-12-18T00:57:51.9183998Z  2024-12-18T00:57:51.9184377Z  2024-12-18T00:57:51.9184788Z  2024-12-18T00:57:51.9185184Z  2024-12-18T00:57:51.9186099Z [18,364 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:51.9187505Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:57:51.9188402Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:57:51.9189248Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2024-12-18T00:57:51.9190220Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:57:51.9191256Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2024-12-18T00:57:51.9192256Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2024-12-18T00:57:51.9193365Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_half.cc; 16s local 2024-12-18T00:57:51.9194411Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local ... 2024-12-18T00:57:52.3048230Z 2024-12-18T00:57:52.3049084Z  2024-12-18T00:57:52.3049571Z  2024-12-18T00:57:52.3049993Z  2024-12-18T00:57:52.3050440Z  2024-12-18T00:57:52.3050837Z  2024-12-18T00:57:52.3051520Z  2024-12-18T00:57:52.3051933Z  2024-12-18T00:57:52.3052339Z  2024-12-18T00:57:52.3053303Z [18,365 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:52.3054451Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:57:52.3055361Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:57:52.3056247Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2024-12-18T00:57:52.3057387Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:57:52.3058454Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2024-12-18T00:57:52.3059470Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2024-12-18T00:57:52.3060580Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:57:52.3061753Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local ... 2024-12-18T00:57:52.5544023Z 2024-12-18T00:57:52.5545134Z  2024-12-18T00:57:52.5545628Z  2024-12-18T00:57:52.5546037Z  2024-12-18T00:57:52.5546436Z  2024-12-18T00:57:52.5546839Z  2024-12-18T00:57:52.5547245Z  2024-12-18T00:57:52.5547652Z  2024-12-18T00:57:52.5548048Z  2024-12-18T00:57:52.5549093Z [18,369 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:52.5550199Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:57:52.5551112Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:57:52.5551977Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:57:52.5552927Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2024-12-18T00:57:52.5553932Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2024-12-18T00:57:52.5554972Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2024-12-18T00:57:52.5556080Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local 2024-12-18T00:57:52.5557163Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local ... 2024-12-18T00:57:52.7819861Z 2024-12-18T00:57:52.7820697Z  2024-12-18T00:57:52.7821252Z  2024-12-18T00:57:52.7821770Z  2024-12-18T00:57:52.7822187Z  2024-12-18T00:57:52.7822559Z  2024-12-18T00:57:52.7822954Z  2024-12-18T00:57:52.7823324Z  2024-12-18T00:57:52.7823711Z  2024-12-18T00:57:52.7824650Z [18,371 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:52.7825749Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:57:52.7826766Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2024-12-18T00:57:52.7827595Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:57:52.7828882Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:57:52.7829910Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2024-12-18T00:57:52.7830904Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2024-12-18T00:57:52.7832050Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:57:52.7833358Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local ... 2024-12-18T00:57:53.1054298Z 2024-12-18T00:57:53.1055218Z  2024-12-18T00:57:53.1055683Z  2024-12-18T00:57:53.1056087Z  2024-12-18T00:57:53.1056652Z  2024-12-18T00:57:53.1057032Z  2024-12-18T00:57:53.1057396Z  2024-12-18T00:57:53.1057981Z  2024-12-18T00:57:53.1058370Z  2024-12-18T00:57:53.1059296Z [18,371 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:53.1060440Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:57:53.1061686Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:57:53.1062512Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:57:53.1063484Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2024-12-18T00:57:53.1064480Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2024-12-18T00:57:53.1065506Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2024-12-18T00:57:53.1066509Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2024-12-18T00:57:53.1067576Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local ... 2024-12-18T00:57:53.7490486Z 2024-12-18T00:57:53.7491340Z  2024-12-18T00:57:53.7491795Z  2024-12-18T00:57:53.7492190Z  2024-12-18T00:57:53.7492566Z  2024-12-18T00:57:53.7492945Z  2024-12-18T00:57:53.7493329Z  2024-12-18T00:57:53.7493687Z  2024-12-18T00:57:53.7494070Z  2024-12-18T00:57:53.7495410Z [18,372 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:53.7496659Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:57:53.7497486Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2024-12-18T00:57:53.7498275Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:57:53.7499206Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:53.7500166Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:57:53.7501106Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2024-12-18T00:57:53.7502115Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 18s local 2024-12-18T00:57:53.7503178Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local ... 2024-12-18T00:57:54.1012455Z 2024-12-18T00:57:54.1013319Z  2024-12-18T00:57:54.1013809Z  2024-12-18T00:57:54.1014196Z  2024-12-18T00:57:54.1014557Z  2024-12-18T00:57:54.1014942Z  2024-12-18T00:57:54.1015325Z  2024-12-18T00:57:54.1015697Z  2024-12-18T00:57:54.1016049Z  2024-12-18T00:57:54.1017113Z [18,374 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:54.1018108Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:57:54.1018941Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:57:54.1019743Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:57:54.1020621Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:54.1021562Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2024-12-18T00:57:54.1022513Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2024-12-18T00:57:54.1023807Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:57:54.1024786Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local ... 2024-12-18T00:57:54.3062250Z 2024-12-18T00:57:54.3063093Z  2024-12-18T00:57:54.3063579Z  2024-12-18T00:57:54.3063974Z  2024-12-18T00:57:54.3064329Z  2024-12-18T00:57:54.3064706Z  2024-12-18T00:57:54.3065079Z  2024-12-18T00:57:54.3065465Z  2024-12-18T00:57:54.3065859Z  2024-12-18T00:57:54.3066774Z [18,378 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:57:54.3067792Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:57:54.3068653Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:57:54.3069484Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:57:54.3070403Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:54.3071713Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:57:54.3072705Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2024-12-18T00:57:54.3073751Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2024-12-18T00:57:54.3074938Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local ... 2024-12-18T00:57:54.7066151Z 2024-12-18T00:57:54.7066972Z  2024-12-18T00:57:54.7067372Z  2024-12-18T00:57:54.7067690Z  2024-12-18T00:57:54.7068029Z  2024-12-18T00:57:54.7068361Z  2024-12-18T00:57:54.7068819Z  2024-12-18T00:57:54.7069154Z  2024-12-18T00:57:54.7069476Z  2024-12-18T00:57:54.7070298Z [18,378 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:54.7071225Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:57:54.7072031Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2024-12-18T00:57:54.7073138Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:57:54.7073973Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2024-12-18T00:57:54.7074852Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:57:54.7075715Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2024-12-18T00:57:54.7076706Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 18s local 2024-12-18T00:57:54.7077633Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local ... 2024-12-18T00:57:54.9984177Z 2024-12-18T00:57:54.9985034Z  2024-12-18T00:57:54.9985504Z  2024-12-18T00:57:54.9985887Z  2024-12-18T00:57:54.9986259Z  2024-12-18T00:57:54.9986654Z  2024-12-18T00:57:54.9987044Z  2024-12-18T00:57:54.9987424Z  2024-12-18T00:57:54.9987809Z  2024-12-18T00:57:54.9988754Z [18,379 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:54.9989851Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2024-12-18T00:57:54.9990786Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:57:54.9991662Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:57:54.9992682Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:57:54.9993760Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2024-12-18T00:57:54.9994740Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2024-12-18T00:57:54.9995632Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2024-12-18T00:57:54.9996563Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local ... 2024-12-18T00:57:55.3071352Z 2024-12-18T00:57:55.3072214Z  2024-12-18T00:57:55.3072680Z  2024-12-18T00:57:55.3073079Z  2024-12-18T00:57:55.3073756Z  2024-12-18T00:57:55.3074145Z  2024-12-18T00:57:55.3074552Z  2024-12-18T00:57:55.3074940Z  2024-12-18T00:57:55.3075350Z  2024-12-18T00:57:55.3076276Z [18,379 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:55.3077391Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2024-12-18T00:57:55.3078366Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:57:55.3079229Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:57:55.3080149Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:57:55.3081317Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:57:55.3082271Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2024-12-18T00:57:55.3083220Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2024-12-18T00:57:55.3084170Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local ... 2024-12-18T00:57:55.5073746Z 2024-12-18T00:57:55.5074876Z  2024-12-18T00:57:55.5075388Z  2024-12-18T00:57:55.5075772Z  2024-12-18T00:57:55.5076153Z  2024-12-18T00:57:55.5076516Z  2024-12-18T00:57:55.5076909Z  2024-12-18T00:57:55.5077309Z  2024-12-18T00:57:55.5077708Z  2024-12-18T00:57:55.5078629Z [18,381 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:55.5079698Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2024-12-18T00:57:55.5080608Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2024-12-18T00:57:55.5081625Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2024-12-18T00:57:55.5082626Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2024-12-18T00:57:55.5083707Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:57:55.5084752Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2024-12-18T00:57:55.5086030Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2024-12-18T00:57:55.5086974Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local ... 2024-12-18T00:57:55.9078375Z 2024-12-18T00:57:55.9079226Z  2024-12-18T00:57:55.9079679Z  2024-12-18T00:57:55.9080091Z  2024-12-18T00:57:55.9080473Z  2024-12-18T00:57:55.9080850Z  2024-12-18T00:57:55.9081336Z  2024-12-18T00:57:55.9081668Z  2024-12-18T00:57:55.9082029Z  2024-12-18T00:57:55.9082961Z [18,383 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:55.9084028Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:57:55.9084904Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:55.9085714Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2024-12-18T00:57:55.9086696Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:57:55.9087715Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2024-12-18T00:57:55.9088720Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2024-12-18T00:57:55.9089604Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 18s local 2024-12-18T00:57:55.9090581Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local ... 2024-12-18T00:57:56.2685586Z 2024-12-18T00:57:56.2686396Z  2024-12-18T00:57:56.2686865Z  2024-12-18T00:57:56.2687241Z  2024-12-18T00:57:56.2687604Z  2024-12-18T00:57:56.2687970Z  2024-12-18T00:57:56.2688320Z  2024-12-18T00:57:56.2688682Z  2024-12-18T00:57:56.2689048Z  2024-12-18T00:57:56.2689964Z [18,386 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:56.2691039Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:57:56.2692057Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:56.2692776Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2024-12-18T00:57:56.2693575Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:57:56.2694474Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:57:56.2695304Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2024-12-18T00:57:56.2696201Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 18s local 2024-12-18T00:57:56.2697262Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local ... 2024-12-18T00:57:56.4893475Z 2024-12-18T00:57:56.4894332Z  2024-12-18T00:57:56.4894784Z  2024-12-18T00:57:56.4895131Z  2024-12-18T00:57:56.4895523Z  2024-12-18T00:57:56.4895885Z  2024-12-18T00:57:56.4896277Z  2024-12-18T00:57:56.4896842Z  2024-12-18T00:57:56.4897246Z  2024-12-18T00:57:56.4898542Z [18,387 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:56.4899622Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:57:56.4900543Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:56.4901426Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:57:56.4902412Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:57:56.4903404Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:57:56.4904381Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2024-12-18T00:57:56.4905358Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 18s local 2024-12-18T00:57:56.4906316Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local ... 2024-12-18T00:57:56.7084588Z 2024-12-18T00:57:56.7085475Z  2024-12-18T00:57:56.7085946Z  2024-12-18T00:57:56.7086371Z  2024-12-18T00:57:56.7086764Z  2024-12-18T00:57:56.7087172Z  2024-12-18T00:57:56.7087911Z  2024-12-18T00:57:56.7088445Z  2024-12-18T00:57:56.7088837Z  2024-12-18T00:57:56.7089762Z [18,389 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:56.7090874Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:57:56.7091795Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2024-12-18T00:57:56.7092676Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:57:56.7093685Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2024-12-18T00:57:56.7094742Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2024-12-18T00:57:56.7095772Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2024-12-18T00:57:56.7096968Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2024-12-18T00:57:56.7098023Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 15s local ... 2024-12-18T00:57:57.3451554Z 2024-12-18T00:57:57.3452448Z  2024-12-18T00:57:57.3452944Z  2024-12-18T00:57:57.3453331Z  2024-12-18T00:57:57.3453701Z  2024-12-18T00:57:57.3454055Z  2024-12-18T00:57:57.3454449Z  2024-12-18T00:57:57.3454843Z  2024-12-18T00:57:57.3455246Z  2024-12-18T00:57:57.3456164Z [18,390 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:57.3457413Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2024-12-18T00:57:57.3458310Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:57:57.3459124Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:57:57.3460222Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:57:57.3461242Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:57:57.3462551Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2024-12-18T00:57:57.3463561Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2024-12-18T00:57:57.3464589Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2024-12-18T00:57:57.7092159Z 2024-12-18T00:57:57.7093045Z  2024-12-18T00:57:57.7093522Z  2024-12-18T00:57:57.7094009Z  2024-12-18T00:57:57.7094436Z  2024-12-18T00:57:57.7094817Z  2024-12-18T00:57:57.7095235Z  2024-12-18T00:57:57.7095636Z  2024-12-18T00:57:57.7096047Z  2024-12-18T00:57:57.7097186Z [18,392 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:57.7098304Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2024-12-18T00:57:57.7099164Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2024-12-18T00:57:57.7100131Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:57:57.7101423Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2024-12-18T00:57:57.7102511Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:57:57.7103473Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2024-12-18T00:57:57.7104472Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2024-12-18T00:57:57.7105535Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2024-12-18T00:57:57.9095187Z 2024-12-18T00:57:57.9096023Z  2024-12-18T00:57:57.9096672Z  2024-12-18T00:57:57.9097071Z  2024-12-18T00:57:57.9097455Z  2024-12-18T00:57:57.9097856Z  2024-12-18T00:57:57.9098260Z  2024-12-18T00:57:57.9098651Z  2024-12-18T00:57:57.9099015Z  2024-12-18T00:57:57.9099965Z [18,394 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:57.9101054Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2024-12-18T00:57:57.9102244Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:57:57.9103157Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:57:57.9104100Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:57:57.9105065Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2024-12-18T00:57:57.9106046Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2024-12-18T00:57:57.9107038Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2024-12-18T00:57:57.9108039Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2024-12-18T00:57:58.2125375Z 2024-12-18T00:57:58.2126232Z  2024-12-18T00:57:58.2126769Z  2024-12-18T00:57:58.2127224Z  2024-12-18T00:57:58.2127630Z  2024-12-18T00:57:58.2128039Z  2024-12-18T00:57:58.2128505Z  2024-12-18T00:57:58.2128906Z  2024-12-18T00:57:58.2129328Z  2024-12-18T00:57:58.2130214Z [18,395 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:58.2131298Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2024-12-18T00:57:58.2132155Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:57:58.2133103Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:57:58.2134063Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:57:58.2135039Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:57:58.2136017Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2024-12-18T00:57:58.2137212Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2024-12-18T00:57:58.2138250Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2024-12-18T00:57:58.5100480Z 2024-12-18T00:57:58.5101331Z  2024-12-18T00:57:58.5102109Z  2024-12-18T00:57:58.5102518Z  2024-12-18T00:57:58.5102945Z  2024-12-18T00:57:58.5103382Z  2024-12-18T00:57:58.5103792Z  2024-12-18T00:57:58.5104185Z  2024-12-18T00:57:58.5104550Z  2024-12-18T00:57:58.5105496Z [18,396 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:58.5106683Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2024-12-18T00:57:58.5107589Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2024-12-18T00:57:58.5108473Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:57:58.5109290Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2024-12-18T00:57:58.5110336Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2024-12-18T00:57:58.5111318Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2024-12-18T00:57:58.5112230Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2024-12-18T00:57:58.5113426Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2024-12-18T00:57:59.5108553Z 2024-12-18T00:57:59.5109386Z  2024-12-18T00:57:59.5109877Z  2024-12-18T00:57:59.5110259Z  2024-12-18T00:57:59.5110633Z  2024-12-18T00:57:59.5111007Z  2024-12-18T00:57:59.5111470Z  2024-12-18T00:57:59.5111858Z  2024-12-18T00:57:59.5112207Z  2024-12-18T00:57:59.5113203Z [18,396 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:57:59.5114136Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:57:59.5114956Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:57:59.5115738Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:57:59.5116800Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2024-12-18T00:57:59.5117698Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:57:59.5118868Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2024-12-18T00:57:59.5120026Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2024-12-18T00:57:59.5120925Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2024-12-18T00:57:59.7838666Z 2024-12-18T00:57:59.7839582Z  2024-12-18T00:57:59.7840056Z  2024-12-18T00:57:59.7840437Z  2024-12-18T00:57:59.7840812Z  2024-12-18T00:57:59.7841220Z  2024-12-18T00:57:59.7841599Z  2024-12-18T00:57:59.7841988Z  2024-12-18T00:57:59.7842374Z  2024-12-18T00:57:59.7843298Z [18,398 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:57:59.7844655Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:57:59.7845436Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2024-12-18T00:57:59.7846210Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:57:59.7847084Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:57:59.7848049Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:57:59.7848907Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2024-12-18T00:57:59.7849794Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2024-12-18T00:57:59.7850753Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2024-12-18T00:58:00.1114364Z 2024-12-18T00:58:00.1115239Z  2024-12-18T00:58:00.1115692Z  2024-12-18T00:58:00.1116062Z  2024-12-18T00:58:00.1116453Z  2024-12-18T00:58:00.1116862Z  2024-12-18T00:58:00.1117269Z  2024-12-18T00:58:00.1117642Z  2024-12-18T00:58:00.1118039Z  2024-12-18T00:58:00.1118991Z [18,399 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:00.1120435Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2024-12-18T00:58:00.1121300Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:58:00.1122139Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:58:00.1123069Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:58:00.1124027Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2024-12-18T00:58:00.1125164Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2024-12-18T00:58:00.1126151Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2024-12-18T00:58:00.1127180Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2024-12-18T00:58:00.5118105Z 2024-12-18T00:58:00.5118911Z  2024-12-18T00:58:00.5119384Z  2024-12-18T00:58:00.5119808Z  2024-12-18T00:58:00.5120179Z  2024-12-18T00:58:00.5120559Z  2024-12-18T00:58:00.5120955Z  2024-12-18T00:58:00.5121283Z  2024-12-18T00:58:00.5121637Z  2024-12-18T00:58:00.5122874Z [18,400 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:00.5123948Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2024-12-18T00:58:00.5124856Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2024-12-18T00:58:00.5125647Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:58:00.5126583Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2024-12-18T00:58:00.5127539Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2024-12-18T00:58:00.5128520Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2024-12-18T00:58:00.5129548Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2024-12-18T00:58:00.5130541Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local ... 2024-12-18T00:58:01.0007527Z 2024-12-18T00:58:01.0008380Z  2024-12-18T00:58:01.0008844Z  2024-12-18T00:58:01.0009636Z  2024-12-18T00:58:01.0010039Z  2024-12-18T00:58:01.0010411Z  2024-12-18T00:58:01.0010800Z  2024-12-18T00:58:01.0011167Z  2024-12-18T00:58:01.0011535Z  2024-12-18T00:58:01.0012412Z [18,401 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:01.0013442Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:58:01.0014323Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:58:01.0015154Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:58:01.0016067Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2024-12-18T00:58:01.0017235Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2024-12-18T00:58:01.0018116Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2024-12-18T00:58:01.0019065Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2024-12-18T00:58:01.0020079Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local ... 2024-12-18T00:58:01.3124901Z 2024-12-18T00:58:01.3125813Z  2024-12-18T00:58:01.3126262Z  2024-12-18T00:58:01.3126671Z  2024-12-18T00:58:01.3127067Z  2024-12-18T00:58:01.3127461Z  2024-12-18T00:58:01.3127833Z  2024-12-18T00:58:01.3128222Z  2024-12-18T00:58:01.3128593Z  2024-12-18T00:58:01.3129517Z [18,402 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:01.3130644Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:58:01.3131678Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:58:01.3132489Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:58:01.3133469Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2024-12-18T00:58:01.3134941Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:58:01.3135999Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2024-12-18T00:58:01.3137234Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2024-12-18T00:58:01.3138194Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2024-12-18T00:58:01.7571423Z 2024-12-18T00:58:01.7572262Z  2024-12-18T00:58:01.7572661Z  2024-12-18T00:58:01.7573004Z  2024-12-18T00:58:01.7573346Z  2024-12-18T00:58:01.7573675Z  2024-12-18T00:58:01.7573987Z  2024-12-18T00:58:01.7574313Z  2024-12-18T00:58:01.7574638Z  2024-12-18T00:58:01.7575472Z [18,403 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:01.7576317Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:58:01.7577334Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2024-12-18T00:58:01.7578326Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:01.7579133Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2024-12-18T00:58:01.7580091Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:58:01.7580931Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2024-12-18T00:58:01.7581824Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2024-12-18T00:58:01.7582681Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2024-12-18T00:58:01.9952267Z 2024-12-18T00:58:01.9953075Z  2024-12-18T00:58:01.9953551Z  2024-12-18T00:58:01.9953971Z  2024-12-18T00:58:01.9954384Z  2024-12-18T00:58:01.9954777Z  2024-12-18T00:58:01.9955189Z  2024-12-18T00:58:01.9955597Z  2024-12-18T00:58:01.9956008Z  2024-12-18T00:58:01.9956962Z [18,406 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:01.9958523Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:58:01.9959498Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:58:01.9960421Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:01.9961602Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2024-12-18T00:58:01.9962730Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2024-12-18T00:58:01.9963821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2024-12-18T00:58:01.9964924Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:01.9966012Z .../memory_space_assignment:memory_bound_loop_optimizer; 19s local ... 2024-12-18T00:58:02.2150762Z 2024-12-18T00:58:02.2151632Z  2024-12-18T00:58:02.2152085Z  2024-12-18T00:58:02.2152469Z  2024-12-18T00:58:02.2152851Z  2024-12-18T00:58:02.2153264Z  2024-12-18T00:58:02.2153618Z  2024-12-18T00:58:02.2154030Z  2024-12-18T00:58:02.2154400Z  2024-12-18T00:58:02.2155292Z [18,408 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:02.2156325Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:58:02.2157153Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:58:02.2157970Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:02.2158827Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:58:02.2159759Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2024-12-18T00:58:02.2160700Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:02.2161665Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:58:02.2162540Z @llvm-project//mlir:MathTransforms; 18s local ... 2024-12-18T00:58:02.4333218Z 2024-12-18T00:58:02.4334019Z  2024-12-18T00:58:02.4334558Z  2024-12-18T00:58:02.4334996Z  2024-12-18T00:58:02.4335412Z  2024-12-18T00:58:02.4335807Z  2024-12-18T00:58:02.4336218Z  2024-12-18T00:58:02.4336797Z  2024-12-18T00:58:02.4337320Z  2024-12-18T00:58:02.4338274Z [18,410 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:02.4339363Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:58:02.4340279Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:58:02.4341144Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:02.4342069Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:58:02.4343091Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:02.4344088Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:02.4345751Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:58:02.4346803Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 16s local ... 2024-12-18T00:58:02.7136049Z 2024-12-18T00:58:02.7137100Z  2024-12-18T00:58:02.7137607Z  2024-12-18T00:58:02.7138014Z  2024-12-18T00:58:02.7138404Z  2024-12-18T00:58:02.7138805Z  2024-12-18T00:58:02.7139202Z  2024-12-18T00:58:02.7139614Z  2024-12-18T00:58:02.7140016Z  2024-12-18T00:58:02.7140994Z [18,411 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:02.7142117Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:58:02.7143048Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2024-12-18T00:58:02.7143937Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:58:02.7145129Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:58:02.7146449Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:02.7147575Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:02.7148618Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:58:02.7149668Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 16s local ... 2024-12-18T00:58:02.9170142Z 2024-12-18T00:58:02.9170966Z  2024-12-18T00:58:02.9171447Z  2024-12-18T00:58:02.9171931Z  2024-12-18T00:58:02.9172385Z  2024-12-18T00:58:02.9172776Z  2024-12-18T00:58:02.9173176Z  2024-12-18T00:58:02.9173567Z  2024-12-18T00:58:02.9174041Z  2024-12-18T00:58:02.9175015Z [18,413 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:02.9176075Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:58:02.9177174Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:58:02.9178094Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:58:02.9179067Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2024-12-18T00:58:02.9180080Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:02.9181081Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2024-12-18T00:58:02.9182170Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:58:02.9183178Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 16s local ... 2024-12-18T00:58:03.3141112Z 2024-12-18T00:58:03.3142095Z  2024-12-18T00:58:03.3142560Z  2024-12-18T00:58:03.3142951Z  2024-12-18T00:58:03.3143374Z  2024-12-18T00:58:03.3143713Z  2024-12-18T00:58:03.3144085Z  2024-12-18T00:58:03.3144736Z  2024-12-18T00:58:03.3145133Z  2024-12-18T00:58:03.3146043Z [18,413 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:03.3147479Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:58:03.3148374Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:58:03.3149186Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:58:03.3150080Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:58:03.3151201Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:03.3152158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2024-12-18T00:58:03.3153191Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:58:03.3154203Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 17s local ... 2024-12-18T00:58:03.7320676Z 2024-12-18T00:58:03.7321533Z  2024-12-18T00:58:03.7322038Z  2024-12-18T00:58:03.7322452Z  2024-12-18T00:58:03.7322837Z  2024-12-18T00:58:03.7323269Z  2024-12-18T00:58:03.7323654Z  2024-12-18T00:58:03.7324292Z  2024-12-18T00:58:03.7324757Z  2024-12-18T00:58:03.7325659Z [18,414 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:03.7326661Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:58:03.7327594Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2024-12-18T00:58:03.7328437Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2024-12-18T00:58:03.7329324Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:58:03.7330426Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2024-12-18T00:58:03.7331441Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2024-12-18T00:58:03.7332501Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:58:03.7333559Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 17s local ... 2024-12-18T00:58:04.1148973Z 2024-12-18T00:58:04.1149813Z  2024-12-18T00:58:04.1150677Z  2024-12-18T00:58:04.1151082Z  2024-12-18T00:58:04.1151477Z  2024-12-18T00:58:04.1151884Z  2024-12-18T00:58:04.1152260Z  2024-12-18T00:58:04.1152673Z  2024-12-18T00:58:04.1153056Z  2024-12-18T00:58:04.1153994Z [18,417 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:04.1154972Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:58:04.1155894Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:58:04.1156922Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2024-12-18T00:58:04.1157791Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2024-12-18T00:58:04.1158840Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2024-12-18T00:58:04.1159818Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2024-12-18T00:58:04.1160912Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 18s local 2024-12-18T00:58:04.1161979Z Compiling xla/service/while_loop_simplifier.cc; 17s local ... 2024-12-18T00:58:04.4981492Z 2024-12-18T00:58:04.4982336Z  2024-12-18T00:58:04.4982809Z  2024-12-18T00:58:04.4983225Z  2024-12-18T00:58:04.4983645Z  2024-12-18T00:58:04.4984037Z  2024-12-18T00:58:04.4984442Z  2024-12-18T00:58:04.4984845Z  2024-12-18T00:58:04.4985251Z  2024-12-18T00:58:04.4986200Z [18,420 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:04.4987362Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:58:04.4988320Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:58:04.4989225Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:58:04.4990197Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:58:04.4991532Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:58:04.4992721Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2024-12-18T00:58:04.4993723Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2024-12-18T00:58:04.4994717Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local ... 2024-12-18T00:58:04.7076302Z 2024-12-18T00:58:04.7076993Z  2024-12-18T00:58:04.7077305Z  2024-12-18T00:58:04.7077556Z  2024-12-18T00:58:04.7077787Z  2024-12-18T00:58:04.7078032Z  2024-12-18T00:58:04.7078279Z  2024-12-18T00:58:04.7078524Z  2024-12-18T00:58:04.7078752Z  2024-12-18T00:58:04.7079302Z [18,422 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:04.7079932Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:58:04.7080454Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2024-12-18T00:58:04.7081167Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:58:04.7081704Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:58:04.7082259Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:58:04.7082832Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2024-12-18T00:58:04.7083355Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2024-12-18T00:58:04.7083881Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local ... 2024-12-18T00:58:04.9154786Z 2024-12-18T00:58:04.9155610Z  2024-12-18T00:58:04.9156092Z  2024-12-18T00:58:04.9156496Z  2024-12-18T00:58:04.9156919Z  2024-12-18T00:58:04.9157337Z  2024-12-18T00:58:04.9157752Z  2024-12-18T00:58:04.9158155Z  2024-12-18T00:58:04.9158572Z  2024-12-18T00:58:04.9159541Z [18,422 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:04.9161002Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2024-12-18T00:58:04.9162046Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:58:04.9162963Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:58:04.9163924Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2024-12-18T00:58:04.9164985Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:58:04.9166059Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2024-12-18T00:58:04.9167048Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2024-12-18T00:58:04.9168019Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local ... 2024-12-18T00:58:05.2279175Z 2024-12-18T00:58:05.2280119Z  2024-12-18T00:58:05.2280590Z  2024-12-18T00:58:05.2281008Z  2024-12-18T00:58:05.2281395Z  2024-12-18T00:58:05.2281783Z  2024-12-18T00:58:05.2282236Z  2024-12-18T00:58:05.2282633Z  2024-12-18T00:58:05.2283054Z  2024-12-18T00:58:05.2283926Z [18,423 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:05.2284944Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2024-12-18T00:58:05.2285799Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:58:05.2286623Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:58:05.2287504Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:58:05.2288422Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:58:05.2289344Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2024-12-18T00:58:05.2290231Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:58:05.2291077Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local ... 2024-12-18T00:58:05.5159509Z 2024-12-18T00:58:05.5160626Z  2024-12-18T00:58:05.5161060Z  2024-12-18T00:58:05.5161452Z  2024-12-18T00:58:05.5161804Z  2024-12-18T00:58:05.5162151Z  2024-12-18T00:58:05.5162525Z  2024-12-18T00:58:05.5162880Z  2024-12-18T00:58:05.5163231Z  2024-12-18T00:58:05.5164039Z [18,424 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:05.5164940Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:58:05.5165689Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:58:05.5166484Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:58:05.5167358Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2024-12-18T00:58:05.5168210Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2024-12-18T00:58:05.5169014Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:58:05.5169794Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2024-12-18T00:58:05.5170906Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local ... 2024-12-18T00:58:05.7162754Z 2024-12-18T00:58:05.7163581Z  2024-12-18T00:58:05.7164074Z  2024-12-18T00:58:05.7164478Z  2024-12-18T00:58:05.7164872Z  2024-12-18T00:58:05.7165281Z  2024-12-18T00:58:05.7165679Z  2024-12-18T00:58:05.7166089Z  2024-12-18T00:58:05.7166477Z  2024-12-18T00:58:05.7167423Z [18,426 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:05.7168471Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2024-12-18T00:58:05.7169338Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:58:05.7170274Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2024-12-18T00:58:05.7171261Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2024-12-18T00:58:05.7172286Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2024-12-18T00:58:05.7173655Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2024-12-18T00:58:05.7174548Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2024-12-18T00:58:05.7175551Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local ... 2024-12-18T00:58:06.5316118Z 2024-12-18T00:58:06.5317013Z  2024-12-18T00:58:06.5317484Z  2024-12-18T00:58:06.5317877Z  2024-12-18T00:58:06.5318270Z  2024-12-18T00:58:06.5318670Z  2024-12-18T00:58:06.5319046Z  2024-12-18T00:58:06.5319397Z  2024-12-18T00:58:06.5319773Z  2024-12-18T00:58:06.5320663Z [18,427 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:06.5321632Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:58:06.5322457Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:06.5323365Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:58:06.5324373Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:58:06.5325349Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2024-12-18T00:58:06.5326239Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:58:06.5327070Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2024-12-18T00:58:06.5328110Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local ... 2024-12-18T00:58:06.7650752Z 2024-12-18T00:58:06.7651606Z  2024-12-18T00:58:06.7652062Z  2024-12-18T00:58:06.7652461Z  2024-12-18T00:58:06.7652861Z  2024-12-18T00:58:06.7653231Z  2024-12-18T00:58:06.7653629Z  2024-12-18T00:58:06.7654035Z  2024-12-18T00:58:06.7654431Z  2024-12-18T00:58:06.7655312Z [18,429 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:06.7656826Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2024-12-18T00:58:06.7657629Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:06.7658463Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:58:06.7659407Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:58:06.7660329Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2024-12-18T00:58:06.7661199Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:58:06.7662054Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2024-12-18T00:58:06.7662980Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local ... 2024-12-18T00:58:07.0400170Z 2024-12-18T00:58:07.0401043Z  2024-12-18T00:58:07.0401631Z  2024-12-18T00:58:07.0402045Z  2024-12-18T00:58:07.0402457Z  2024-12-18T00:58:07.0402851Z  2024-12-18T00:58:07.0403257Z  2024-12-18T00:58:07.0403702Z  2024-12-18T00:58:07.0404113Z  2024-12-18T00:58:07.0405373Z [18,431 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:07.0406449Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:58:07.0407327Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:07.0408207Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2024-12-18T00:58:07.0409193Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:58:07.0410171Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2024-12-18T00:58:07.0411082Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2024-12-18T00:58:07.0411960Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2024-12-18T00:58:07.0412927Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local ... 2024-12-18T00:58:07.3036009Z 2024-12-18T00:58:07.3046902Z  2024-12-18T00:58:07.3047694Z  2024-12-18T00:58:07.3048107Z  2024-12-18T00:58:07.3048897Z  2024-12-18T00:58:07.3049297Z  2024-12-18T00:58:07.3049649Z  2024-12-18T00:58:07.3050030Z  2024-12-18T00:58:07.3050393Z  2024-12-18T00:58:07.3051279Z [18,433 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:07.3052265Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:58:07.3053049Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:07.3053924Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:58:07.3054840Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:58:07.3055780Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2024-12-18T00:58:07.3056912Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2024-12-18T00:58:07.3057890Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2024-12-18T00:58:07.3058906Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local ... 2024-12-18T00:58:07.5174362Z 2024-12-18T00:58:07.5175204Z  2024-12-18T00:58:07.5175655Z  2024-12-18T00:58:07.5176054Z  2024-12-18T00:58:07.5176589Z  2024-12-18T00:58:07.5176982Z  2024-12-18T00:58:07.5177364Z  2024-12-18T00:58:07.5177758Z  2024-12-18T00:58:07.5178129Z  2024-12-18T00:58:07.5179176Z [18,433 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:07.5180175Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2024-12-18T00:58:07.5180997Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:58:07.5181943Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:58:07.5182934Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:58:07.5183899Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2024-12-18T00:58:07.5185128Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2024-12-18T00:58:07.5186045Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2024-12-18T00:58:07.5186961Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local ... 2024-12-18T00:58:07.9178734Z 2024-12-18T00:58:07.9179730Z  2024-12-18T00:58:07.9180224Z  2024-12-18T00:58:07.9180629Z  2024-12-18T00:58:07.9181032Z  2024-12-18T00:58:07.9181413Z  2024-12-18T00:58:07.9181811Z  2024-12-18T00:58:07.9182203Z  2024-12-18T00:58:07.9182595Z  2024-12-18T00:58:07.9183541Z [18,434 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:07.9184534Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:58:07.9185410Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:58:07.9186125Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2024-12-18T00:58:07.9187220Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:58:07.9188184Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2024-12-18T00:58:07.9189043Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:58:07.9189929Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2024-12-18T00:58:07.9190915Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local ... 2024-12-18T00:58:08.3183352Z 2024-12-18T00:58:08.3184186Z  2024-12-18T00:58:08.3184662Z  2024-12-18T00:58:08.3185054Z  2024-12-18T00:58:08.3185443Z  2024-12-18T00:58:08.3185841Z  2024-12-18T00:58:08.3186233Z  2024-12-18T00:58:08.3186636Z  2024-12-18T00:58:08.3187001Z  2024-12-18T00:58:08.3188068Z [18,435 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:08.3189131Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:58:08.3190307Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:58:08.3191338Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:58:08.3192316Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:58:08.3193322Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2024-12-18T00:58:08.3194196Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:58:08.3195158Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2024-12-18T00:58:08.3196179Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local ... 2024-12-18T00:58:08.6888779Z 2024-12-18T00:58:08.6889656Z  2024-12-18T00:58:08.6890139Z  2024-12-18T00:58:08.6890543Z  2024-12-18T00:58:08.6890937Z  2024-12-18T00:58:08.6891339Z  2024-12-18T00:58:08.6891734Z  2024-12-18T00:58:08.6892126Z  2024-12-18T00:58:08.6892532Z  2024-12-18T00:58:08.6893537Z [18,437 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:08.6894632Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2024-12-18T00:58:08.6895511Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:08.6896617Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:58:08.6897656Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:58:08.6898688Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2024-12-18T00:58:08.6899641Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2024-12-18T00:58:08.6900615Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:58:08.6901607Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local ... 2024-12-18T00:58:08.9188286Z 2024-12-18T00:58:08.9189155Z  2024-12-18T00:58:08.9189655Z  2024-12-18T00:58:08.9190371Z  2024-12-18T00:58:08.9190790Z  2024-12-18T00:58:08.9191190Z  2024-12-18T00:58:08.9191629Z  2024-12-18T00:58:08.9192048Z  2024-12-18T00:58:08.9192455Z  2024-12-18T00:58:08.9193447Z [18,438 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:08.9194575Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:58:08.9195427Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:08.9196395Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2024-12-18T00:58:08.9197420Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:58:08.9198458Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:08.9199415Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:58:08.9200417Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:58:08.9201456Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local ... 2024-12-18T00:58:09.1852703Z 2024-12-18T00:58:09.1853832Z  2024-12-18T00:58:09.1854330Z  2024-12-18T00:58:09.1854719Z  2024-12-18T00:58:09.1855123Z  2024-12-18T00:58:09.1855521Z  2024-12-18T00:58:09.1855912Z  2024-12-18T00:58:09.1856295Z  2024-12-18T00:58:09.1856845Z  2024-12-18T00:58:09.1857805Z [18,442 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:09.1858842Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:58:09.1859727Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:09.1860674Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 38s local 2024-12-18T00:58:09.1861619Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:58:09.1862549Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:09.1863399Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:58:09.1864723Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2024-12-18T00:58:09.1865684Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local ... 2024-12-18T00:58:09.4404547Z 2024-12-18T00:58:09.4405465Z  2024-12-18T00:58:09.4405959Z  2024-12-18T00:58:09.4406458Z  2024-12-18T00:58:09.4406943Z  2024-12-18T00:58:09.4407441Z  2024-12-18T00:58:09.4407866Z  2024-12-18T00:58:09.4408337Z  2024-12-18T00:58:09.4408791Z  2024-12-18T00:58:09.4409713Z [18,443 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:09.4410723Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:58:09.4411664Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:09.4412627Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 38s local 2024-12-18T00:58:09.4413534Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:58:09.4414562Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:09.4415450Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:58:09.4416620Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2024-12-18T00:58:09.4417596Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local ... 2024-12-18T00:58:09.6560925Z 2024-12-18T00:58:09.6561729Z  2024-12-18T00:58:09.6562159Z  2024-12-18T00:58:09.6562511Z  2024-12-18T00:58:09.6562867Z  2024-12-18T00:58:09.6563199Z  2024-12-18T00:58:09.6563551Z  2024-12-18T00:58:09.6563890Z  2024-12-18T00:58:09.6564215Z  2024-12-18T00:58:09.6565009Z [18,446 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:09.6565862Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2024-12-18T00:58:09.6566867Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2024-12-18T00:58:09.6567721Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:58:09.6568604Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:09.6569371Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2024-12-18T00:58:09.6570188Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2024-12-18T00:58:09.6571005Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local 2024-12-18T00:58:09.6571828Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 15s local ... 2024-12-18T00:58:09.9195484Z 2024-12-18T00:58:09.9196439Z  2024-12-18T00:58:09.9197017Z  2024-12-18T00:58:09.9197368Z  2024-12-18T00:58:09.9197862Z  2024-12-18T00:58:09.9198360Z  2024-12-18T00:58:09.9198742Z  2024-12-18T00:58:09.9199225Z  2024-12-18T00:58:09.9199603Z  2024-12-18T00:58:09.9200692Z [18,448 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:09.9202046Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:58:09.9203161Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:58:09.9204146Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2024-12-18T00:58:09.9205064Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:58:09.9206156Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2024-12-18T00:58:09.9206938Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local 2024-12-18T00:58:09.9207731Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 15s local 2024-12-18T00:58:09.9208534Z @llvm-project//mlir:MathTransforms; 13s local ... 2024-12-18T00:58:10.3200269Z 2024-12-18T00:58:10.3201080Z  2024-12-18T00:58:10.3201465Z  2024-12-18T00:58:10.3201785Z  2024-12-18T00:58:10.3202100Z  2024-12-18T00:58:10.3202436Z  2024-12-18T00:58:10.3202741Z  2024-12-18T00:58:10.3203393Z  2024-12-18T00:58:10.3203693Z  2024-12-18T00:58:10.3204424Z [18,450 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:10.3205203Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:58:10.3205912Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:58:10.3206649Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2024-12-18T00:58:10.3207324Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:58:10.3208031Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2024-12-18T00:58:10.3208736Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local 2024-12-18T00:58:10.3209437Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2024-12-18T00:58:10.3210154Z @llvm-project//mlir:MathTransforms; 14s local ... 2024-12-18T00:58:10.7019320Z 2024-12-18T00:58:10.7020155Z  2024-12-18T00:58:10.7020685Z  2024-12-18T00:58:10.7021060Z  2024-12-18T00:58:10.7021447Z  2024-12-18T00:58:10.7021811Z  2024-12-18T00:58:10.7022192Z  2024-12-18T00:58:10.7022555Z  2024-12-18T00:58:10.7022932Z  2024-12-18T00:58:10.7023849Z [18,451 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:10.7024833Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2024-12-18T00:58:10.7025718Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:58:10.7026670Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2024-12-18T00:58:10.7027673Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2024-12-18T00:58:10.7028594Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2024-12-18T00:58:10.7029481Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:58:10.7030771Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2024-12-18T00:58:10.7031677Z @llvm-project//mlir:MathTransforms; 14s local ... 2024-12-18T00:58:10.9204587Z 2024-12-18T00:58:10.9205470Z  2024-12-18T00:58:10.9205908Z  2024-12-18T00:58:10.9206275Z  2024-12-18T00:58:10.9206661Z  2024-12-18T00:58:10.9207025Z  2024-12-18T00:58:10.9207368Z  2024-12-18T00:58:10.9207748Z  2024-12-18T00:58:10.9208127Z  2024-12-18T00:58:10.9209058Z [18,451 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:10.9210094Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:58:10.9211039Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:58:10.9212053Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:58:10.9212949Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2024-12-18T00:58:10.9214197Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2024-12-18T00:58:10.9215165Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:58:10.9216098Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2024-12-18T00:58:10.9217103Z @llvm-project//mlir:MathTransforms; 14s local ... 2024-12-18T00:58:11.3209097Z 2024-12-18T00:58:11.3210018Z  2024-12-18T00:58:11.3210510Z  2024-12-18T00:58:11.3210916Z  2024-12-18T00:58:11.3211321Z  2024-12-18T00:58:11.3211694Z  2024-12-18T00:58:11.3212090Z  2024-12-18T00:58:11.3212498Z  2024-12-18T00:58:11.3212886Z  2024-12-18T00:58:11.3213806Z [18,453 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:11.3214749Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:58:11.3215723Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:58:11.3217360Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:58:11.3218366Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2024-12-18T00:58:11.3219292Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2024-12-18T00:58:11.3220175Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2024-12-18T00:58:11.3221060Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2024-12-18T00:58:11.3221977Z @llvm-project//mlir:MathTransforms; 15s local ... 2024-12-18T00:58:11.7803015Z 2024-12-18T00:58:11.7803897Z  2024-12-18T00:58:11.7804384Z  2024-12-18T00:58:11.7804786Z  2024-12-18T00:58:11.7805182Z  2024-12-18T00:58:11.7805584Z  2024-12-18T00:58:11.7805968Z  2024-12-18T00:58:11.7806364Z  2024-12-18T00:58:11.7806755Z  2024-12-18T00:58:11.7807684Z [18,454 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:11.7808788Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2024-12-18T00:58:11.7809745Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2024-12-18T00:58:11.7810632Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:58:11.7811460Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2024-12-18T00:58:11.7812339Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2024-12-18T00:58:11.7813242Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2024-12-18T00:58:11.7814139Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2024-12-18T00:58:11.7815144Z @llvm-project//mlir:MathTransforms; 15s local ... 2024-12-18T00:58:12.0505412Z 2024-12-18T00:58:12.0506298Z  2024-12-18T00:58:12.0506740Z  2024-12-18T00:58:12.0507098Z  2024-12-18T00:58:12.0507472Z  2024-12-18T00:58:12.0507857Z  2024-12-18T00:58:12.0508244Z  2024-12-18T00:58:12.0508902Z  2024-12-18T00:58:12.0509290Z  2024-12-18T00:58:12.0510411Z [18,457 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:12.0511396Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:58:12.0512319Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2024-12-18T00:58:12.0513251Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:12.0514091Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:58:12.0515066Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2024-12-18T00:58:12.0515995Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2024-12-18T00:58:12.0516880Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2024-12-18T00:58:12.0517866Z @llvm-project//mlir:MathTransforms; 16s local ... 2024-12-18T00:58:12.3217152Z 2024-12-18T00:58:12.3218001Z  2024-12-18T00:58:12.3218452Z  2024-12-18T00:58:12.3218796Z  2024-12-18T00:58:12.3219424Z  2024-12-18T00:58:12.3219769Z  2024-12-18T00:58:12.3220122Z  2024-12-18T00:58:12.3220477Z  2024-12-18T00:58:12.3220832Z  2024-12-18T00:58:12.3221689Z [18,458 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:12.3222566Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:58:12.3223367Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2024-12-18T00:58:12.3224237Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:12.3225040Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:58:12.3225914Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2024-12-18T00:58:12.3226766Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2024-12-18T00:58:12.3227574Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2024-12-18T00:58:12.3228677Z @llvm-project//mlir:MathTransforms; 16s local ... 2024-12-18T00:58:12.6292358Z 2024-12-18T00:58:12.6293238Z  2024-12-18T00:58:12.6293718Z  2024-12-18T00:58:12.6294128Z  2024-12-18T00:58:12.6294528Z  2024-12-18T00:58:12.6294864Z  2024-12-18T00:58:12.6295220Z  2024-12-18T00:58:12.6295577Z  2024-12-18T00:58:12.6295943Z  2024-12-18T00:58:12.6297006Z [18,459 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:12.6297821Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2024-12-18T00:58:12.6298894Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:58:12.6299808Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:12.6300643Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2024-12-18T00:58:12.6301587Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2024-12-18T00:58:12.6302561Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2024-12-18T00:58:12.6303460Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2024-12-18T00:58:12.6304351Z @llvm-project//mlir:MathTransforms; 16s local ... 2024-12-18T00:58:12.8657405Z 2024-12-18T00:58:12.8658294Z  2024-12-18T00:58:12.8658755Z  2024-12-18T00:58:12.8659187Z  2024-12-18T00:58:12.8659581Z  2024-12-18T00:58:12.8659972Z  2024-12-18T00:58:12.8660355Z  2024-12-18T00:58:12.8660728Z  2024-12-18T00:58:12.8661124Z  2024-12-18T00:58:12.8662034Z [18,462 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:12.8663061Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2024-12-18T00:58:12.8664158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:58:12.8665082Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:12.8666271Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:58:12.8667213Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2024-12-18T00:58:12.8668142Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:58:12.8669111Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2024-12-18T00:58:12.8670065Z @llvm-project//mlir:MathTransforms; 16s local ... 2024-12-18T00:58:13.1223696Z 2024-12-18T00:58:13.1224600Z  2024-12-18T00:58:13.1225100Z  2024-12-18T00:58:13.1225506Z  2024-12-18T00:58:13.1225917Z  2024-12-18T00:58:13.1226312Z  2024-12-18T00:58:13.1226698Z  2024-12-18T00:58:13.1227078Z  2024-12-18T00:58:13.1227468Z  2024-12-18T00:58:13.1228431Z [18,462 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:13.1229472Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2024-12-18T00:58:13.1230695Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:58:13.1231749Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:58:13.1232644Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:58:13.1233631Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2024-12-18T00:58:13.1234710Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:58:13.1235631Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2024-12-18T00:58:13.1236575Z @llvm-project//mlir:MathTransforms; 17s local ... 2024-12-18T00:58:13.5228072Z 2024-12-18T00:58:13.5228950Z  2024-12-18T00:58:13.5229433Z  2024-12-18T00:58:13.5229846Z  2024-12-18T00:58:13.5230250Z  2024-12-18T00:58:13.5230680Z  2024-12-18T00:58:13.5231142Z  2024-12-18T00:58:13.5231518Z  2024-12-18T00:58:13.5231906Z  2024-12-18T00:58:13.5233255Z [18,464 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:13.5234493Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2024-12-18T00:58:13.5235503Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:13.5236496Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:58:13.5237458Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2024-12-18T00:58:13.5238441Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2024-12-18T00:58:13.5239436Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2024-12-18T00:58:13.5240371Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2024-12-18T00:58:13.5241354Z @llvm-project//mlir:MathTransforms; 17s local ... 2024-12-18T00:58:13.8500068Z 2024-12-18T00:58:13.8500914Z  2024-12-18T00:58:13.8501409Z  2024-12-18T00:58:13.8501800Z  2024-12-18T00:58:13.8502205Z  2024-12-18T00:58:13.8502555Z  2024-12-18T00:58:13.8502970Z  2024-12-18T00:58:13.8503370Z  2024-12-18T00:58:13.8503759Z  2024-12-18T00:58:13.8504667Z [18,467 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:13.8505622Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 54s local 2024-12-18T00:58:13.8506586Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:13.8507554Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:58:13.8508455Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:58:13.8509428Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2024-12-18T00:58:13.8510365Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:58:13.8511255Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2024-12-18T00:58:13.8512157Z @llvm-project//mlir:MathTransforms; 17s local ... 2024-12-18T00:58:14.0474585Z 2024-12-18T00:58:14.0475540Z  2024-12-18T00:58:14.0476024Z  2024-12-18T00:58:14.0476438Z  2024-12-18T00:58:14.0476808Z  2024-12-18T00:58:14.0477205Z  2024-12-18T00:58:14.0477616Z  2024-12-18T00:58:14.0478018Z  2024-12-18T00:58:14.0478404Z  2024-12-18T00:58:14.0479328Z [18,469 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:14.0480512Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:14.0481460Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:58:14.0482301Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:58:14.0483217Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2024-12-18T00:58:14.0484090Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:58:14.0485037Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2024-12-18T00:58:14.0486254Z @llvm-project//mlir:MathTransforms; 18s local 2024-12-18T00:58:14.0487128Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local ... 2024-12-18T00:58:14.3233940Z 2024-12-18T00:58:14.3234752Z  2024-12-18T00:58:14.3235237Z  2024-12-18T00:58:14.3235660Z  2024-12-18T00:58:14.3236068Z  2024-12-18T00:58:14.3236448Z  2024-12-18T00:58:14.3236835Z  2024-12-18T00:58:14.3237227Z  2024-12-18T00:58:14.3237633Z  2024-12-18T00:58:14.3238594Z [18,471 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:14.3239765Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:14.3240819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:58:14.3241799Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:58:14.3242831Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2024-12-18T00:58:14.3244529Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2024-12-18T00:58:14.3245589Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local 2024-12-18T00:58:14.3246512Z @llvm-project//mlir:MathTransforms; 18s local 2024-12-18T00:58:14.3247326Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local ... 2024-12-18T00:58:14.7580906Z 2024-12-18T00:58:14.7581802Z  2024-12-18T00:58:14.7582259Z  2024-12-18T00:58:14.7582661Z  2024-12-18T00:58:14.7583058Z  2024-12-18T00:58:14.7583462Z  2024-12-18T00:58:14.7583835Z  2024-12-18T00:58:14.7584194Z  2024-12-18T00:58:14.7584540Z  2024-12-18T00:58:14.7585388Z [18,472 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:14.7586444Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:58:14.7587425Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:58:14.7588289Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2024-12-18T00:58:14.7589210Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2024-12-18T00:58:14.7590141Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:58:14.7591033Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local 2024-12-18T00:58:14.7592021Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2024-12-18T00:58:14.7592901Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local ... 2024-12-18T00:58:15.1240126Z 2024-12-18T00:58:15.1241004Z  2024-12-18T00:58:15.1241506Z  2024-12-18T00:58:15.1241909Z  2024-12-18T00:58:15.1242305Z  2024-12-18T00:58:15.1242679Z  2024-12-18T00:58:15.1243036Z  2024-12-18T00:58:15.1243389Z  2024-12-18T00:58:15.1243750Z  2024-12-18T00:58:15.1245011Z [18,473 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:15.1246463Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:58:15.1247364Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:58:15.1248169Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2024-12-18T00:58:15.1249072Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2024-12-18T00:58:15.1250022Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:58:15.1250964Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local 2024-12-18T00:58:15.1252048Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2024-12-18T00:58:15.1252986Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local ... 2024-12-18T00:58:15.3243714Z 2024-12-18T00:58:15.3244760Z  2024-12-18T00:58:15.3245284Z  2024-12-18T00:58:15.3245725Z  2024-12-18T00:58:15.3246158Z  2024-12-18T00:58:15.3246591Z  2024-12-18T00:58:15.3247025Z  2024-12-18T00:58:15.3247702Z  2024-12-18T00:58:15.3248125Z  2024-12-18T00:58:15.3249067Z [18,474 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:15.3250415Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:58:15.3251478Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:58:15.3252354Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2024-12-18T00:58:15.3253302Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2024-12-18T00:58:15.3254254Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2024-12-18T00:58:15.3255219Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2024-12-18T00:58:15.3256104Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2024-12-18T00:58:15.3257117Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local ... 2024-12-18T00:58:16.0347539Z 2024-12-18T00:58:16.0348706Z  2024-12-18T00:58:16.0349214Z  2024-12-18T00:58:16.0349622Z  2024-12-18T00:58:16.0350035Z  2024-12-18T00:58:16.0350442Z  2024-12-18T00:58:16.0350852Z  2024-12-18T00:58:16.0351261Z  2024-12-18T00:58:16.0351659Z  2024-12-18T00:58:16.0352620Z [18,475 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:16.0353821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:58:16.0354846Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:16.0355738Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:58:16.0356723Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2024-12-18T00:58:16.0357686Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:58:16.0358680Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2024-12-18T00:58:16.0359808Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2024-12-18T00:58:16.0360792Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local ... 2024-12-18T00:58:16.2780160Z 2024-12-18T00:58:16.2781067Z  2024-12-18T00:58:16.2781684Z  2024-12-18T00:58:16.2782119Z  2024-12-18T00:58:16.2782477Z  2024-12-18T00:58:16.2782889Z  2024-12-18T00:58:16.2783335Z  2024-12-18T00:58:16.2783719Z  2024-12-18T00:58:16.2784124Z  2024-12-18T00:58:16.2785045Z [18,476 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:16.2786138Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:58:16.2787162Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:16.2788028Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:58:16.2789000Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2024-12-18T00:58:16.2790302Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:58:16.2791275Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:58:16.2792378Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2024-12-18T00:58:16.2793393Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local ... 2024-12-18T00:58:16.5249190Z 2024-12-18T00:58:16.5250149Z  2024-12-18T00:58:16.5250686Z  2024-12-18T00:58:16.5251096Z  2024-12-18T00:58:16.5251512Z  2024-12-18T00:58:16.5251916Z  2024-12-18T00:58:16.5252311Z  2024-12-18T00:58:16.5252696Z  2024-12-18T00:58:16.5253083Z  2024-12-18T00:58:16.5253989Z [18,476 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:16.5255051Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:16.5256155Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:16.5257505Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:58:16.5258556Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:58:16.5259539Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2024-12-18T00:58:16.5260495Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:58:16.5261723Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2024-12-18T00:58:16.5262612Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local ... 2024-12-18T00:58:16.7251657Z 2024-12-18T00:58:16.7253812Z  2024-12-18T00:58:16.7254276Z  2024-12-18T00:58:16.7254699Z  2024-12-18T00:58:16.7255067Z  2024-12-18T00:58:16.7255441Z  2024-12-18T00:58:16.7255846Z  2024-12-18T00:58:16.7256236Z  2024-12-18T00:58:16.7256763Z  2024-12-18T00:58:16.7257955Z [18,477 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:16.7259166Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:16.7260098Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:16.7261013Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2024-12-18T00:58:16.7261977Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:58:16.7262877Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:58:16.7263847Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:58:16.7264823Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2024-12-18T00:58:16.7265729Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local ... 2024-12-18T00:58:16.9382325Z 2024-12-18T00:58:16.9383097Z  2024-12-18T00:58:16.9383508Z  2024-12-18T00:58:16.9383872Z  2024-12-18T00:58:16.9384238Z  2024-12-18T00:58:16.9384578Z  2024-12-18T00:58:16.9384939Z  2024-12-18T00:58:16.9385288Z  2024-12-18T00:58:16.9385615Z  2024-12-18T00:58:16.9386432Z [18,479 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:16.9387406Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:16.9388256Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:58:16.9389048Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:58:16.9389888Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:58:16.9390660Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:58:16.9391462Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:58:16.9392387Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2024-12-18T00:58:16.9393197Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local ... 2024-12-18T00:58:17.1696778Z 2024-12-18T00:58:17.1697753Z  2024-12-18T00:58:17.1698245Z  2024-12-18T00:58:17.1698630Z  2024-12-18T00:58:17.1698997Z  2024-12-18T00:58:17.1699390Z  2024-12-18T00:58:17.1699799Z  2024-12-18T00:58:17.1700196Z  2024-12-18T00:58:17.1700712Z  2024-12-18T00:58:17.1701609Z [18,480 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:17.1702727Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:17.1703656Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:58:17.1704536Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:58:17.1705461Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2024-12-18T00:58:17.1706361Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:58:17.1707314Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2024-12-18T00:58:17.1708578Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2024-12-18T00:58:17.1709510Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local ... 2024-12-18T00:58:17.5260099Z 2024-12-18T00:58:17.5260975Z  2024-12-18T00:58:17.5261497Z  2024-12-18T00:58:17.5261850Z  2024-12-18T00:58:17.5262237Z  2024-12-18T00:58:17.5262611Z  2024-12-18T00:58:17.5263016Z  2024-12-18T00:58:17.5263451Z  2024-12-18T00:58:17.5263814Z  2024-12-18T00:58:17.5264793Z [18,481 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:17.5265862Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:58:17.5266874Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:58:17.5267792Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2024-12-18T00:58:17.5268737Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2024-12-18T00:58:17.5270040Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2024-12-18T00:58:17.5270989Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:58:17.5272041Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2024-12-18T00:58:17.5273049Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local ... 2024-12-18T00:58:17.8825428Z 2024-12-18T00:58:17.8826332Z  2024-12-18T00:58:17.8826828Z  2024-12-18T00:58:17.8827231Z  2024-12-18T00:58:17.8827623Z  2024-12-18T00:58:17.8828007Z  2024-12-18T00:58:17.8828413Z  2024-12-18T00:58:17.8828924Z  2024-12-18T00:58:17.8829311Z  2024-12-18T00:58:17.8830221Z [18,484 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:17.8831351Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:58:17.8832360Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:58:17.8833189Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:58:17.8834158Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2024-12-18T00:58:17.8835139Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:58:17.8836075Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:58:17.8837073Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2024-12-18T00:58:17.8838040Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local ... 2024-12-18T00:58:18.1266321Z 2024-12-18T00:58:18.1267220Z  2024-12-18T00:58:18.1267686Z  2024-12-18T00:58:18.1268096Z  2024-12-18T00:58:18.1268483Z  2024-12-18T00:58:18.1268889Z  2024-12-18T00:58:18.1269265Z  2024-12-18T00:58:18.1269650Z  2024-12-18T00:58:18.1270018Z  2024-12-18T00:58:18.1271228Z [18,485 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:18.1272396Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:58:18.1273363Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:58:18.1274287Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:58:18.1275272Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2024-12-18T00:58:18.1276176Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:58:18.1277149Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2024-12-18T00:58:18.1278167Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2024-12-18T00:58:18.1279086Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local ... 2024-12-18T00:58:18.3319186Z 2024-12-18T00:58:18.3320014Z  2024-12-18T00:58:18.3320474Z  2024-12-18T00:58:18.3320861Z  2024-12-18T00:58:18.3321282Z  2024-12-18T00:58:18.3321658Z  2024-12-18T00:58:18.3322312Z  2024-12-18T00:58:18.3322735Z  2024-12-18T00:58:18.3323116Z  2024-12-18T00:58:18.3324019Z [18,487 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:18.3325133Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:58:18.3326106Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:58:18.3326951Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:58:18.3328039Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2024-12-18T00:58:18.3329008Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2024-12-18T00:58:18.3329951Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:58:18.3331031Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2024-12-18T00:58:18.3332092Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local ... 2024-12-18T00:58:18.7271591Z 2024-12-18T00:58:18.7272483Z  2024-12-18T00:58:18.7272961Z  2024-12-18T00:58:18.7273349Z  2024-12-18T00:58:18.7273729Z  2024-12-18T00:58:18.7274147Z  2024-12-18T00:58:18.7274541Z  2024-12-18T00:58:18.7274940Z  2024-12-18T00:58:18.7275347Z  2024-12-18T00:58:18.7276303Z [18,487 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:18.7277516Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2024-12-18T00:58:18.7278465Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:58:18.7279326Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2024-12-18T00:58:18.7280294Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2024-12-18T00:58:18.7281220Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:58:18.7282177Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:58:18.7283232Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2024-12-18T00:58:18.7284252Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local ... 2024-12-18T00:58:19.1275174Z 2024-12-18T00:58:19.1276013Z  2024-12-18T00:58:19.1276474Z  2024-12-18T00:58:19.1276876Z  2024-12-18T00:58:19.1277298Z  2024-12-18T00:58:19.1277696Z  2024-12-18T00:58:19.1278088Z  2024-12-18T00:58:19.1278487Z  2024-12-18T00:58:19.1278868Z  2024-12-18T00:58:19.1279861Z [18,488 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:19.1281152Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2024-12-18T00:58:19.1282346Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:58:19.1283430Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:58:19.1285077Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2024-12-18T00:58:19.1286014Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:58:19.1287007Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2024-12-18T00:58:19.1288022Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2024-12-18T00:58:19.1288964Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local ... 2024-12-18T00:58:19.4103496Z 2024-12-18T00:58:19.4104377Z  2024-12-18T00:58:19.4104788Z  2024-12-18T00:58:19.4105136Z  2024-12-18T00:58:19.4105470Z  2024-12-18T00:58:19.4105775Z  2024-12-18T00:58:19.4106087Z  2024-12-18T00:58:19.4106467Z  2024-12-18T00:58:19.4106838Z  2024-12-18T00:58:19.4107739Z [18,489 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:19.4108821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2024-12-18T00:58:19.4110093Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:58:19.4111013Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:58:19.4111923Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2024-12-18T00:58:19.4112840Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2024-12-18T00:58:19.4113769Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2024-12-18T00:58:19.4114788Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2024-12-18T00:58:19.4115732Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local ... 2024-12-18T00:58:19.7280723Z 2024-12-18T00:58:19.7281567Z  2024-12-18T00:58:19.7282052Z  2024-12-18T00:58:19.7282467Z  2024-12-18T00:58:19.7282857Z  2024-12-18T00:58:19.7283247Z  2024-12-18T00:58:19.7283604Z  2024-12-18T00:58:19.7284001Z  2024-12-18T00:58:19.7284432Z  2024-12-18T00:58:19.7285673Z [18,489 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:19.7286950Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:58:19.7287932Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:58:19.7288913Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2024-12-18T00:58:19.7289881Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2024-12-18T00:58:19.7290800Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:58:19.7291766Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2024-12-18T00:58:19.7292802Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2024-12-18T00:58:19.7293781Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local ... 2024-12-18T00:58:19.9283721Z 2024-12-18T00:58:19.9284536Z  2024-12-18T00:58:19.9284949Z  2024-12-18T00:58:19.9285356Z  2024-12-18T00:58:19.9285886Z  2024-12-18T00:58:19.9286264Z  2024-12-18T00:58:19.9286603Z  2024-12-18T00:58:19.9286971Z  2024-12-18T00:58:19.9287322Z  2024-12-18T00:58:19.9288154Z [18,490 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:19.9289167Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:58:19.9290037Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:58:19.9290865Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:58:19.9291757Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2024-12-18T00:58:19.9292603Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:58:19.9293458Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2024-12-18T00:58:19.9294445Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2024-12-18T00:58:19.9295567Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local ... 2024-12-18T00:58:20.2561673Z 2024-12-18T00:58:20.2562682Z  2024-12-18T00:58:20.2563128Z  2024-12-18T00:58:20.2563500Z  2024-12-18T00:58:20.2563878Z  2024-12-18T00:58:20.2564252Z  2024-12-18T00:58:20.2564619Z  2024-12-18T00:58:20.2564966Z  2024-12-18T00:58:20.2565345Z  2024-12-18T00:58:20.2566216Z [18,495 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:58:20.2567282Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:58:20.2568217Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:58:20.2569054Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:58:20.2569993Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2024-12-18T00:58:20.2570851Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:58:20.2572399Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:58:20.2573502Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2024-12-18T00:58:20.2575031Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local ... 2024-12-18T00:58:20.4830303Z 2024-12-18T00:58:20.4831193Z  2024-12-18T00:58:20.4831664Z  2024-12-18T00:58:20.4832030Z  2024-12-18T00:58:20.4832371Z  2024-12-18T00:58:20.4832725Z  2024-12-18T00:58:20.4833081Z  2024-12-18T00:58:20.4833430Z  2024-12-18T00:58:20.4833768Z  2024-12-18T00:58:20.4834635Z [18,497 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:20.4835810Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:58:20.4836704Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:58:20.4837588Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:58:20.4838738Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2024-12-18T00:58:20.4839768Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:58:20.4840771Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2024-12-18T00:58:20.4841642Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T00:58:20.4842519Z .../memory_space_assignment:memory_bound_loop_optimizer; 16s local ... 2024-12-18T00:58:20.7287523Z 2024-12-18T00:58:20.7288378Z  2024-12-18T00:58:20.7288831Z  2024-12-18T00:58:20.7289235Z  2024-12-18T00:58:20.7289602Z  2024-12-18T00:58:20.7289990Z  2024-12-18T00:58:20.7290398Z  2024-12-18T00:58:20.7290806Z  2024-12-18T00:58:20.7291206Z  2024-12-18T00:58:20.7292100Z [18,497 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:20.7293279Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:58:20.7294292Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:58:20.7295250Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2024-12-18T00:58:20.7296010Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:58:20.7297170Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:58:20.7298206Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:20.7299083Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T00:58:20.7300164Z .../memory_space_assignment:memory_bound_loop_optimizer; 16s local ... 2024-12-18T00:58:20.9564951Z 2024-12-18T00:58:20.9565952Z  2024-12-18T00:58:20.9566465Z  2024-12-18T00:58:20.9566905Z  2024-12-18T00:58:20.9567315Z  2024-12-18T00:58:20.9577133Z  2024-12-18T00:58:20.9577782Z  2024-12-18T00:58:20.9578182Z  2024-12-18T00:58:20.9578748Z  2024-12-18T00:58:20.9579598Z [18,498 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:20.9580640Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:58:20.9581543Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:58:20.9582569Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:20.9583302Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:58:20.9584171Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2024-12-18T00:58:20.9585173Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:20.9585999Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T00:58:20.9586958Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2024-12-18T00:58:21.2397971Z 2024-12-18T00:58:21.2398922Z  2024-12-18T00:58:21.2401437Z  2024-12-18T00:58:21.2401922Z  2024-12-18T00:58:21.2402283Z  2024-12-18T00:58:21.2402885Z  2024-12-18T00:58:21.2403309Z  2024-12-18T00:58:21.2403687Z  2024-12-18T00:58:21.2404055Z  2024-12-18T00:58:21.2404915Z [18,502 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:21.2405974Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:58:21.2406924Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:58:21.2407813Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:21.2408831Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:58:21.2409705Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:21.2410635Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T00:58:21.2411609Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 17s local 2024-12-18T00:58:21.2412936Z @llvm-project//mlir:BufferizationTransforms; 12s local ... 2024-12-18T00:58:21.5294782Z 2024-12-18T00:58:21.5295661Z  2024-12-18T00:58:21.5296087Z  2024-12-18T00:58:21.5296541Z  2024-12-18T00:58:21.5296898Z  2024-12-18T00:58:21.5297259Z  2024-12-18T00:58:21.5297607Z  2024-12-18T00:58:21.5297956Z  2024-12-18T00:58:21.5298294Z  2024-12-18T00:58:21.5299149Z [18,503 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T00:58:21.5300151Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:58:21.5301051Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:58:21.5301832Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:21.5302637Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2024-12-18T00:58:21.5303460Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2024-12-18T00:58:21.5304308Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T00:58:21.5305168Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 17s local 2024-12-18T00:58:21.5306035Z @llvm-project//mlir:BufferizationTransforms; 12s local ... 2024-12-18T00:58:21.7330207Z 2024-12-18T00:58:21.7331054Z  2024-12-18T00:58:21.7331511Z  2024-12-18T00:58:21.7331903Z  2024-12-18T00:58:21.7332276Z  2024-12-18T00:58:21.7332676Z  2024-12-18T00:58:21.7333069Z  2024-12-18T00:58:21.7333479Z  2024-12-18T00:58:21.7333850Z  2024-12-18T00:58:21.7334795Z [18,506 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:21.7335986Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:58:21.7337185Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:58:21.7338142Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2024-12-18T00:58:21.7339392Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:58:21.7340308Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2024-12-18T00:58:21.7341791Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T00:58:21.7342906Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 17s local 2024-12-18T00:58:21.7344116Z Compiling xla/service/memory_space_assignment/algorithm.cc; 12s local ... 2024-12-18T00:58:22.1300281Z 2024-12-18T00:58:22.1301055Z  2024-12-18T00:58:22.1301525Z  2024-12-18T00:58:22.1301930Z  2024-12-18T00:58:22.1302339Z  2024-12-18T00:58:22.1302756Z  2024-12-18T00:58:22.1303175Z  2024-12-18T00:58:22.1303571Z  2024-12-18T00:58:22.1303981Z  2024-12-18T00:58:22.1304940Z [18,506 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:22.1306165Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:58:22.1307434Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:58:22.1308332Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:58:22.1309129Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:58:22.1310036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2024-12-18T00:58:22.1310969Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:58:22.1312005Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2024-12-18T00:58:22.1313163Z Compiling xla/service/memory_space_assignment/algorithm.cc; 13s local ... 2024-12-18T00:58:22.3880844Z 2024-12-18T00:58:22.3881668Z  2024-12-18T00:58:22.3882133Z  2024-12-18T00:58:22.3882507Z  2024-12-18T00:58:22.3882871Z  2024-12-18T00:58:22.3883233Z  2024-12-18T00:58:22.3883583Z  2024-12-18T00:58:22.3883941Z  2024-12-18T00:58:22.3884337Z  2024-12-18T00:58:22.3885593Z [18,508 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:22.3886640Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:58:22.3887448Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:58:22.3888201Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:58:22.3888885Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2024-12-18T00:58:22.3889596Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2024-12-18T00:58:22.3890443Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:58:22.3891357Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2024-12-18T00:58:22.3892531Z Compiling xla/service/memory_space_assignment/algorithm.cc; 13s local ... 2024-12-18T00:58:22.6866175Z 2024-12-18T00:58:22.6867042Z  2024-12-18T00:58:22.6867567Z  2024-12-18T00:58:22.6867969Z  2024-12-18T00:58:22.6868419Z  2024-12-18T00:58:22.6868834Z  2024-12-18T00:58:22.6869370Z  2024-12-18T00:58:22.6869755Z  2024-12-18T00:58:22.6870142Z  2024-12-18T00:58:22.6871108Z [18,511 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:22.6872247Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:58:22.6873303Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:58:22.6874288Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2024-12-18T00:58:22.6875152Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:58:22.6875978Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2024-12-18T00:58:22.6876859Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:58:22.6877880Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2024-12-18T00:58:22.6879284Z Compiling xla/service/memory_space_assignment/algorithm.cc; 13s local ... 2024-12-18T00:58:22.9053783Z 2024-12-18T00:58:22.9054685Z  2024-12-18T00:58:22.9055166Z  2024-12-18T00:58:22.9055575Z  2024-12-18T00:58:22.9055972Z  2024-12-18T00:58:22.9056376Z  2024-12-18T00:58:22.9056874Z  2024-12-18T00:58:22.9057254Z  2024-12-18T00:58:22.9057648Z  2024-12-18T00:58:22.9058572Z [18,512 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:22.9059727Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:58:22.9060714Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:58:22.9061611Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2024-12-18T00:58:22.9062454Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:58:22.9063309Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2024-12-18T00:58:22.9064709Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T00:58:22.9065779Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:58:22.9066945Z Compiling xla/service/memory_space_assignment/algorithm.cc; 14s local ... 2024-12-18T00:58:23.1310233Z 2024-12-18T00:58:23.1311059Z  2024-12-18T00:58:23.1311534Z  2024-12-18T00:58:23.1311954Z  2024-12-18T00:58:23.1312353Z  2024-12-18T00:58:23.1312755Z  2024-12-18T00:58:23.1313145Z  2024-12-18T00:58:23.1313544Z  2024-12-18T00:58:23.1313942Z  2024-12-18T00:58:23.1314887Z [18,512 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:23.1316064Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:58:23.1317008Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:58:23.1317930Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2024-12-18T00:58:23.1319111Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2024-12-18T00:58:23.1319993Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2024-12-18T00:58:23.1320938Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T00:58:23.1321961Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2024-12-18T00:58:23.1323080Z Compiling xla/service/memory_space_assignment/algorithm.cc; 14s local ... 2024-12-18T00:58:23.8745764Z 2024-12-18T00:58:23.8746665Z  2024-12-18T00:58:23.8747138Z  2024-12-18T00:58:23.8747522Z  2024-12-18T00:58:23.8747921Z  2024-12-18T00:58:23.8748308Z  2024-12-18T00:58:23.8748690Z  2024-12-18T00:58:23.8749085Z  2024-12-18T00:58:23.8749452Z  2024-12-18T00:58:23.8750448Z [18,513 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:23.8751781Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:58:23.8752771Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:58:23.8753619Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:58:23.8754377Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:58:23.8755182Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2024-12-18T00:58:23.8756070Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T00:58:23.8757034Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:58:23.8758213Z Compiling xla/service/memory_space_assignment/algorithm.cc; 15s local ... 2024-12-18T00:58:24.1317195Z 2024-12-18T00:58:24.1317998Z  2024-12-18T00:58:24.1318455Z  2024-12-18T00:58:24.1318881Z  2024-12-18T00:58:24.1319274Z  2024-12-18T00:58:24.1319668Z  2024-12-18T00:58:24.1320283Z  2024-12-18T00:58:24.1320655Z  2024-12-18T00:58:24.1321042Z  2024-12-18T00:58:24.1322031Z [18,516 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:24.1323104Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:58:24.1324169Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:58:24.1325078Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2024-12-18T00:58:24.1325893Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2024-12-18T00:58:24.1326758Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2024-12-18T00:58:24.1327746Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2024-12-18T00:58:24.1328884Z Compiling xla/service/memory_space_assignment/algorithm.cc; 15s local 2024-12-18T00:58:24.1329866Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local ... 2024-12-18T00:58:24.8683205Z 2024-12-18T00:58:24.8684085Z  2024-12-18T00:58:24.8684580Z  2024-12-18T00:58:24.8685247Z  2024-12-18T00:58:24.8685728Z  2024-12-18T00:58:24.8686125Z  2024-12-18T00:58:24.8686529Z  2024-12-18T00:58:24.8686917Z  2024-12-18T00:58:24.8687364Z  2024-12-18T00:58:24.8688408Z [18,517 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:24.8689596Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:58:24.8690486Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:58:24.8691368Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:58:24.8692198Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:58:24.8693124Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2024-12-18T00:58:24.8694214Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 21s local 2024-12-18T00:58:24.8695381Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local 2024-12-18T00:58:24.8696991Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local ... 2024-12-18T00:58:25.0863914Z 2024-12-18T00:58:25.0864887Z  2024-12-18T00:58:25.0865293Z  2024-12-18T00:58:25.0865647Z  2024-12-18T00:58:25.0866001Z  2024-12-18T00:58:25.0866344Z  2024-12-18T00:58:25.0866672Z  2024-12-18T00:58:25.0867012Z  2024-12-18T00:58:25.0867346Z  2024-12-18T00:58:25.0868124Z [18,518 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:25.0869094Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:58:25.0869927Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2024-12-18T00:58:25.0870734Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:58:25.0871448Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:58:25.0872252Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2024-12-18T00:58:25.0873073Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local 2024-12-18T00:58:25.0873855Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 16s local 2024-12-18T00:58:25.0874610Z .../service/memory_space_assignment:memory_space_assignment; 15s local ... 2024-12-18T00:58:25.3325114Z 2024-12-18T00:58:25.3325879Z  2024-12-18T00:58:25.3326297Z  2024-12-18T00:58:25.3326664Z  2024-12-18T00:58:25.3327032Z  2024-12-18T00:58:25.3327424Z  2024-12-18T00:58:25.3327764Z  2024-12-18T00:58:25.3328119Z  2024-12-18T00:58:25.3328454Z  2024-12-18T00:58:25.3329270Z [18,519 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:25.3330301Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:58:25.3331216Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2024-12-18T00:58:25.3332300Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2024-12-18T00:58:25.3333021Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2024-12-18T00:58:25.3333750Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2024-12-18T00:58:25.3334620Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local 2024-12-18T00:58:25.3335540Z .../xla/service/memory_space_assignment:memory_space_assignment; 15s local 2024-12-18T00:58:25.3336649Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 14s local ... 2024-12-18T00:58:25.8226088Z 2024-12-18T00:58:25.8226954Z  2024-12-18T00:58:25.8227430Z  2024-12-18T00:58:25.8227827Z  2024-12-18T00:58:25.8228210Z  2024-12-18T00:58:25.8228578Z  2024-12-18T00:58:25.8228958Z  2024-12-18T00:58:25.8229335Z  2024-12-18T00:58:25.8229707Z  2024-12-18T00:58:25.8230571Z [18,520 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:25.8231967Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2024-12-18T00:58:25.8233133Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2024-12-18T00:58:25.8234060Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:25.8234888Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:58:25.8235700Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2024-12-18T00:58:25.8236637Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:58:25.8237728Z .../xla/service/memory_space_assignment:memory_space_assignment; 15s local 2024-12-18T00:58:25.8238838Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 14s local ... 2024-12-18T00:58:26.1261053Z 2024-12-18T00:58:26.1261860Z  2024-12-18T00:58:26.1262300Z  2024-12-18T00:58:26.1262646Z  2024-12-18T00:58:26.1262938Z  2024-12-18T00:58:26.1263277Z  2024-12-18T00:58:26.1263658Z  2024-12-18T00:58:26.1264513Z  2024-12-18T00:58:26.1264892Z  2024-12-18T00:58:26.1265789Z [18,522 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:26.1266764Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2024-12-18T00:58:26.1267689Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:58:26.1268521Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:26.1269243Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:58:26.1269878Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2024-12-18T00:58:26.1270720Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:58:26.1271571Z .../xla/service/memory_space_assignment:memory_space_assignment; 16s local 2024-12-18T00:58:26.1272697Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local ... 2024-12-18T00:58:26.3330672Z 2024-12-18T00:58:26.3331651Z  2024-12-18T00:58:26.3332139Z  2024-12-18T00:58:26.3332528Z  2024-12-18T00:58:26.3332903Z  2024-12-18T00:58:26.3333297Z  2024-12-18T00:58:26.3333699Z  2024-12-18T00:58:26.3334183Z  2024-12-18T00:58:26.3334689Z  2024-12-18T00:58:26.3335711Z [18,523 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:26.3336975Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2024-12-18T00:58:26.3337956Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:58:26.3338851Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:26.3339864Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:58:26.3340700Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2024-12-18T00:58:26.3341793Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:58:26.3343297Z .../xla/service/memory_space_assignment:memory_space_assignment; 16s local 2024-12-18T00:58:26.3344593Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local ... 2024-12-18T00:58:26.6046699Z 2024-12-18T00:58:26.6047516Z  2024-12-18T00:58:26.6047977Z  2024-12-18T00:58:26.6048363Z  2024-12-18T00:58:26.6048770Z  2024-12-18T00:58:26.6049290Z  2024-12-18T00:58:26.6049708Z  2024-12-18T00:58:26.6050121Z  2024-12-18T00:58:26.6050477Z  2024-12-18T00:58:26.6051471Z [18,524 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:26.6052606Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:58:26.6053716Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:58:26.6054632Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2024-12-18T00:58:26.6055472Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2024-12-18T00:58:26.6056807Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2024-12-18T00:58:26.6057782Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:58:26.6058789Z .../xla/service/memory_space_assignment:memory_space_assignment; 16s local 2024-12-18T00:58:26.6059623Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local ... 2024-12-18T00:58:26.9336070Z 2024-12-18T00:58:26.9337078Z  2024-12-18T00:58:26.9337553Z  2024-12-18T00:58:26.9337911Z  2024-12-18T00:58:26.9338273Z  2024-12-18T00:58:26.9338620Z  2024-12-18T00:58:26.9338974Z  2024-12-18T00:58:26.9339434Z  2024-12-18T00:58:26.9339938Z  2024-12-18T00:58:26.9341041Z [18,524 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:26.9342312Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:58:26.9343802Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:58:26.9345053Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:58:26.9345784Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:58:26.9346585Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2024-12-18T00:58:26.9347518Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:58:26.9348522Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2024-12-18T00:58:26.9349599Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 15s local ... 2024-12-18T00:58:27.1339130Z 2024-12-18T00:58:27.1339947Z  2024-12-18T00:58:27.1340417Z  2024-12-18T00:58:27.1340822Z  2024-12-18T00:58:27.1341250Z  2024-12-18T00:58:27.1341753Z  2024-12-18T00:58:27.1342056Z  2024-12-18T00:58:27.1342359Z  2024-12-18T00:58:27.1342674Z  2024-12-18T00:58:27.1343584Z [18,525 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:27.1344903Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:58:27.1345741Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:58:27.1346480Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:58:27.1347165Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:58:27.1347825Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2024-12-18T00:58:27.1348653Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:58:27.1349532Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2024-12-18T00:58:27.1350397Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local ... 2024-12-18T00:58:27.3808669Z 2024-12-18T00:58:27.3809470Z  2024-12-18T00:58:27.3810159Z  2024-12-18T00:58:27.3810515Z  2024-12-18T00:58:27.3810870Z  2024-12-18T00:58:27.3811250Z  2024-12-18T00:58:27.3811595Z  2024-12-18T00:58:27.3811954Z  2024-12-18T00:58:27.3812317Z  2024-12-18T00:58:27.3813144Z [18,526 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:27.3814131Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:58:27.3815039Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:58:27.3815870Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:58:27.3816738Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:58:27.3817517Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2024-12-18T00:58:27.3818386Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:58:27.3819357Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2024-12-18T00:58:27.3820721Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local ... 2024-12-18T00:58:27.5931902Z 2024-12-18T00:58:27.5932884Z  2024-12-18T00:58:27.5933307Z  2024-12-18T00:58:27.5933679Z  2024-12-18T00:58:27.5934027Z  2024-12-18T00:58:27.5934407Z  2024-12-18T00:58:27.5934796Z  2024-12-18T00:58:27.5935169Z  2024-12-18T00:58:27.5935566Z  2024-12-18T00:58:27.5936548Z [18,527 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:27.5937565Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:58:27.5938447Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:58:27.5939254Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2024-12-18T00:58:27.5940028Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2024-12-18T00:58:27.5940831Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:27.5941993Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:58:27.5943013Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2024-12-18T00:58:27.5943954Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local ... 2024-12-18T00:58:27.8491985Z 2024-12-18T00:58:27.8492793Z  2024-12-18T00:58:27.8493260Z  2024-12-18T00:58:27.8493628Z  2024-12-18T00:58:27.8494032Z  2024-12-18T00:58:27.8494413Z  2024-12-18T00:58:27.8494768Z  2024-12-18T00:58:27.8495152Z  2024-12-18T00:58:27.8495548Z  2024-12-18T00:58:27.8496589Z [18,529 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T00:58:27.8497725Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:58:27.8498732Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:58:27.8499659Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:27.8500571Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:27.8501557Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:27.8502666Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:58:27.8503735Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local 2024-12-18T00:58:27.8504841Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgInterfaces.cpp; 15s local ... 2024-12-18T00:58:28.0817138Z 2024-12-18T00:58:28.0818120Z  2024-12-18T00:58:28.0818779Z  2024-12-18T00:58:28.0820063Z  2024-12-18T00:58:28.0820439Z  2024-12-18T00:58:28.0820796Z  2024-12-18T00:58:28.0821120Z  2024-12-18T00:58:28.0821443Z  2024-12-18T00:58:28.0821783Z  2024-12-18T00:58:28.0822651Z [18,530 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:28.0824055Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:58:28.0825006Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:58:28.0825870Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:28.0826782Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:28.0827743Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:28.0828865Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:58:28.0829792Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2024-12-18T00:58:28.0830776Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgInterfaces.cpp; 16s local ... 2024-12-18T00:58:28.3347025Z 2024-12-18T00:58:28.3347846Z  2024-12-18T00:58:28.3348327Z  2024-12-18T00:58:28.3348743Z  2024-12-18T00:58:28.3349156Z  2024-12-18T00:58:28.3349578Z  2024-12-18T00:58:28.3349988Z  2024-12-18T00:58:28.3350392Z  2024-12-18T00:58:28.3351060Z  2024-12-18T00:58:28.3352047Z [18,533 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:28.3353274Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:58:28.3354344Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:58:28.3355327Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:28.3356301Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2024-12-18T00:58:28.3357380Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:28.3358557Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:58:28.3359719Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2024-12-18T00:58:28.3361028Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 14s local ... 2024-12-18T00:58:28.7370969Z 2024-12-18T00:58:28.7372277Z  2024-12-18T00:58:28.7372804Z  2024-12-18T00:58:28.7373210Z  2024-12-18T00:58:28.7373637Z  2024-12-18T00:58:28.7374030Z  2024-12-18T00:58:28.7374451Z  2024-12-18T00:58:28.7374882Z  2024-12-18T00:58:28.7375282Z  2024-12-18T00:58:28.7376193Z [18,534 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:28.7377441Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:58:28.7378398Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:58:28.7379282Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2024-12-18T00:58:28.7380113Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2024-12-18T00:58:28.7381123Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:28.7382157Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2024-12-18T00:58:28.7383257Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2024-12-18T00:58:28.7384286Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 14s local ... 2024-12-18T00:58:29.0932281Z 2024-12-18T00:58:29.0933184Z  2024-12-18T00:58:29.0933673Z  2024-12-18T00:58:29.0934071Z  2024-12-18T00:58:29.0934483Z  2024-12-18T00:58:29.0934898Z  2024-12-18T00:58:29.0935298Z  2024-12-18T00:58:29.0935682Z  2024-12-18T00:58:29.0936090Z  2024-12-18T00:58:29.0937199Z [18,536 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:29.0938350Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:58:29.0939346Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:58:29.0940222Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2024-12-18T00:58:29.0941437Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2024-12-18T00:58:29.0942482Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:58:29.0943581Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2024-12-18T00:58:29.0950414Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2024-12-18T00:58:29.0951541Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 15s local ... 2024-12-18T00:58:29.3355205Z 2024-12-18T00:58:29.3356073Z  2024-12-18T00:58:29.3356556Z  2024-12-18T00:58:29.3356961Z  2024-12-18T00:58:29.3357334Z  2024-12-18T00:58:29.3357658Z  2024-12-18T00:58:29.3358062Z  2024-12-18T00:58:29.3358581Z  2024-12-18T00:58:29.3359099Z  2024-12-18T00:58:29.3360159Z [18,536 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:29.3361356Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:58:29.3362692Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:58:29.3363633Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2024-12-18T00:58:29.3364565Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2024-12-18T00:58:29.3365641Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:58:29.3366802Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2024-12-18T00:58:29.3367804Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2024-12-18T00:58:29.3368937Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 15s local ... 2024-12-18T00:58:29.6129706Z 2024-12-18T00:58:29.6130548Z  2024-12-18T00:58:29.6130946Z  2024-12-18T00:58:29.6131276Z  2024-12-18T00:58:29.6131583Z  2024-12-18T00:58:29.6131908Z  2024-12-18T00:58:29.6132387Z  2024-12-18T00:58:29.6132729Z  2024-12-18T00:58:29.6133045Z  2024-12-18T00:58:29.6134049Z [18,540 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:29.6135001Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:58:29.6135761Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:58:29.6136581Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2024-12-18T00:58:29.6137274Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:58:29.6138020Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:58:29.6138849Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2024-12-18T00:58:29.6139664Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2024-12-18T00:58:29.6140473Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 15s local ... 2024-12-18T00:58:29.8965441Z 2024-12-18T00:58:29.8966302Z  2024-12-18T00:58:29.8966755Z  2024-12-18T00:58:29.8967183Z  2024-12-18T00:58:29.8967561Z  2024-12-18T00:58:29.8967956Z  2024-12-18T00:58:29.8968340Z  2024-12-18T00:58:29.8968737Z  2024-12-18T00:58:29.8969110Z  2024-12-18T00:58:29.8970039Z [18,542 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:29.8971154Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:58:29.8972139Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:58:29.8973114Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:58:29.8974154Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:58:29.8975261Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2024-12-18T00:58:29.8976368Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2024-12-18T00:58:29.8977925Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local 2024-12-18T00:58:29.8978865Z @llvm-project//mlir:ArmSVETransforms; 15s local ... 2024-12-18T00:58:30.1360263Z 2024-12-18T00:58:30.1361143Z  2024-12-18T00:58:30.1361590Z  2024-12-18T00:58:30.1361972Z  2024-12-18T00:58:30.1362356Z  2024-12-18T00:58:30.1362742Z  2024-12-18T00:58:30.1363129Z  2024-12-18T00:58:30.1363483Z  2024-12-18T00:58:30.1363899Z  2024-12-18T00:58:30.1364801Z [18,542 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:30.1365959Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:58:30.1366901Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2024-12-18T00:58:30.1367772Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:58:30.1368709Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:58:30.1370095Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2024-12-18T00:58:30.1371158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2024-12-18T00:58:30.1372137Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local 2024-12-18T00:58:30.1373052Z @llvm-project//mlir:ArmSVETransforms; 16s local ... 2024-12-18T00:58:30.5352344Z 2024-12-18T00:58:30.5353658Z  2024-12-18T00:58:30.5354126Z  2024-12-18T00:58:30.5354479Z  2024-12-18T00:58:30.5354852Z  2024-12-18T00:58:30.5355225Z  2024-12-18T00:58:30.5355600Z  2024-12-18T00:58:30.5355975Z  2024-12-18T00:58:30.5356345Z  2024-12-18T00:58:30.5357273Z [18,545 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:30.5358367Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:58:30.5359334Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2024-12-18T00:58:30.5360566Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2024-12-18T00:58:30.5361625Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:58:30.5362649Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2024-12-18T00:58:30.5363680Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2024-12-18T00:58:30.5364726Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local 2024-12-18T00:58:30.5365645Z @llvm-project//mlir:ArmSVETransforms; 16s local ... 2024-12-18T00:58:30.7363688Z 2024-12-18T00:58:30.7364929Z  2024-12-18T00:58:30.7365401Z  2024-12-18T00:58:30.7365817Z  2024-12-18T00:58:30.7366219Z  2024-12-18T00:58:30.7366631Z  2024-12-18T00:58:30.7367041Z  2024-12-18T00:58:30.7367438Z  2024-12-18T00:58:30.7367849Z  2024-12-18T00:58:30.7368816Z [18,546 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:30.7370107Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:58:30.7371181Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2024-12-18T00:58:30.7372187Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:30.7373272Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:58:30.7374453Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2024-12-18T00:58:30.7375604Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2024-12-18T00:58:30.7376897Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local 2024-12-18T00:58:30.7377903Z @llvm-project//mlir:ArmSVETransforms; 16s local ... 2024-12-18T00:58:30.9781417Z 2024-12-18T00:58:30.9782733Z  2024-12-18T00:58:30.9783250Z  2024-12-18T00:58:30.9783645Z  2024-12-18T00:58:30.9784320Z  2024-12-18T00:58:30.9784709Z  2024-12-18T00:58:30.9785102Z  2024-12-18T00:58:30.9785676Z  2024-12-18T00:58:30.9786078Z  2024-12-18T00:58:30.9786967Z [18,547 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:30.9788111Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:58:30.9789068Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:30.9790020Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:30.9791074Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:58:30.9792203Z .../xla/service/memory_space_assignment:memory_space_assignment; 21s local 2024-12-18T00:58:30.9793266Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2024-12-18T00:58:30.9794294Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local 2024-12-18T00:58:30.9795243Z @llvm-project//mlir:ArmSVETransforms; 16s local ... 2024-12-18T00:58:31.2964634Z 2024-12-18T00:58:31.2965497Z  2024-12-18T00:58:31.2965936Z  2024-12-18T00:58:31.2966286Z  2024-12-18T00:58:31.2966652Z  2024-12-18T00:58:31.2967017Z  2024-12-18T00:58:31.2967396Z  2024-12-18T00:58:31.2967762Z  2024-12-18T00:58:31.2968091Z  2024-12-18T00:58:31.2968940Z [18,548 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:31.2969970Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:58:31.2970861Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:31.2971719Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:31.2972583Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:58:31.2973539Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2024-12-18T00:58:31.2974845Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local 2024-12-18T00:58:31.2975715Z @llvm-project//mlir:ArmSVETransforms; 17s local 2024-12-18T00:58:31.2976640Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 14s local ... 2024-12-18T00:58:31.5370544Z 2024-12-18T00:58:31.5371768Z  2024-12-18T00:58:31.5372530Z  2024-12-18T00:58:31.5373178Z  2024-12-18T00:58:31.5374150Z  2024-12-18T00:58:31.5374558Z  2024-12-18T00:58:31.5374906Z  2024-12-18T00:58:31.5375264Z  2024-12-18T00:58:31.5375620Z  2024-12-18T00:58:31.5376584Z [18,548 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:31.5377554Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:58:31.5378462Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:31.5379342Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2024-12-18T00:58:31.5380346Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:58:31.5381519Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2024-12-18T00:58:31.5382534Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local 2024-12-18T00:58:31.5383363Z @llvm-project//mlir:ArmSVETransforms; 17s local 2024-12-18T00:58:31.5384229Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 14s local ... 2024-12-18T00:58:31.8831931Z 2024-12-18T00:58:31.8832861Z  2024-12-18T00:58:31.8833285Z  2024-12-18T00:58:31.8833605Z  2024-12-18T00:58:31.8833941Z  2024-12-18T00:58:31.8834278Z  2024-12-18T00:58:31.8834598Z  2024-12-18T00:58:31.8834913Z  2024-12-18T00:58:31.8835236Z  2024-12-18T00:58:31.8836008Z [18,549 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:31.8836920Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:58:31.8837991Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:31.8838736Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:58:31.8839535Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:31.8840370Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2024-12-18T00:58:31.8841204Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2024-12-18T00:58:31.8841930Z @llvm-project//mlir:ArmSVETransforms; 17s local 2024-12-18T00:58:31.8842620Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 14s local ... 2024-12-18T00:58:32.1374837Z 2024-12-18T00:58:32.1376082Z  2024-12-18T00:58:32.1376639Z  2024-12-18T00:58:32.1376974Z  2024-12-18T00:58:32.1377300Z  2024-12-18T00:58:32.1377631Z  2024-12-18T00:58:32.1377940Z  2024-12-18T00:58:32.1378271Z  2024-12-18T00:58:32.1378604Z  2024-12-18T00:58:32.1379698Z [18,551 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:32.1380659Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:58:32.1381455Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:58:32.1382234Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:58:32.1383054Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:32.1383947Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2024-12-18T00:58:32.1384782Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2024-12-18T00:58:32.1385535Z @llvm-project//mlir:ArmSVETransforms; 18s local 2024-12-18T00:58:32.1386246Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 15s local ... 2024-12-18T00:58:32.3379500Z 2024-12-18T00:58:32.3380413Z  2024-12-18T00:58:32.3380883Z  2024-12-18T00:58:32.3381292Z  2024-12-18T00:58:32.3381648Z  2024-12-18T00:58:32.3382352Z  2024-12-18T00:58:32.3382753Z  2024-12-18T00:58:32.3383142Z  2024-12-18T00:58:32.3383533Z  2024-12-18T00:58:32.3384453Z [18,552 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:32.3385556Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:58:32.3386562Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:58:32.3387513Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2024-12-18T00:58:32.3388529Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:32.3389542Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2024-12-18T00:58:32.3390560Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2024-12-18T00:58:32.3391504Z @llvm-project//mlir:ArmSVETransforms; 18s local 2024-12-18T00:58:32.3392452Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 15s local ... 2024-12-18T00:58:32.6904854Z 2024-12-18T00:58:32.6905785Z  2024-12-18T00:58:32.6906292Z  2024-12-18T00:58:32.6906679Z  2024-12-18T00:58:32.6907058Z  2024-12-18T00:58:32.6907460Z  2024-12-18T00:58:32.6907861Z  2024-12-18T00:58:32.6908270Z  2024-12-18T00:58:32.6908672Z  2024-12-18T00:58:32.6909610Z [18,554 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:32.6910877Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:58:32.6911865Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:58:32.6912812Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:58:32.6913777Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:32.6914871Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2024-12-18T00:58:32.6916239Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2024-12-18T00:58:32.6917167Z @llvm-project//mlir:ArmSVETransforms; 18s local 2024-12-18T00:58:32.6917994Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 15s local ... 2024-12-18T00:58:32.9387573Z 2024-12-18T00:58:32.9388413Z  2024-12-18T00:58:32.9388902Z  2024-12-18T00:58:32.9389318Z  2024-12-18T00:58:32.9389703Z  2024-12-18T00:58:32.9390093Z  2024-12-18T00:58:32.9390484Z  2024-12-18T00:58:32.9390884Z  2024-12-18T00:58:32.9391278Z  2024-12-18T00:58:32.9392191Z [18,554 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:32.9393328Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:58:32.9394329Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:32.9395272Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:58:32.9396512Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:58:32.9397613Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2024-12-18T00:58:32.9398625Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 19s local 2024-12-18T00:58:32.9399540Z @llvm-project//mlir:ArmSVETransforms; 18s local 2024-12-18T00:58:32.9400398Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 15s local ... 2024-12-18T00:58:33.2405696Z 2024-12-18T00:58:33.2406488Z  2024-12-18T00:58:33.2406918Z  2024-12-18T00:58:33.2407286Z  2024-12-18T00:58:33.2407616Z  2024-12-18T00:58:33.2407961Z  2024-12-18T00:58:33.2408315Z  2024-12-18T00:58:33.2408658Z  2024-12-18T00:58:33.2408993Z  2024-12-18T00:58:33.2409804Z [18,556 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:33.2410780Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:58:33.2411994Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:33.2412819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:58:33.2413686Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:58:33.2414573Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2024-12-18T00:58:33.2415343Z @llvm-project//mlir:ArmSVETransforms; 19s local 2024-12-18T00:58:33.2416098Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 16s local 2024-12-18T00:58:33.2417162Z Compiling xla/service/memory_space_assignment/algorithm.cc; 15s local ... 2024-12-18T00:58:33.5391737Z 2024-12-18T00:58:33.5392627Z  2024-12-18T00:58:33.5393058Z  2024-12-18T00:58:33.5393409Z  2024-12-18T00:58:33.5393778Z  2024-12-18T00:58:33.5394131Z  2024-12-18T00:58:33.5394484Z  2024-12-18T00:58:33.5394818Z  2024-12-18T00:58:33.5395209Z  2024-12-18T00:58:33.5396055Z [18,558 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:33.5397054Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:58:33.5397925Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:33.5398737Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2024-12-18T00:58:33.5399782Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:58:33.5400744Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2024-12-18T00:58:33.5401547Z @llvm-project//mlir:ArmSVETransforms; 19s local 2024-12-18T00:58:33.5402302Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 16s local 2024-12-18T00:58:33.5403198Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:58:33.8102624Z 2024-12-18T00:58:33.8103460Z  2024-12-18T00:58:33.8104105Z  2024-12-18T00:58:33.8104429Z  2024-12-18T00:58:33.8104788Z  2024-12-18T00:58:33.8105108Z  2024-12-18T00:58:33.8105431Z  2024-12-18T00:58:33.8105734Z  2024-12-18T00:58:33.8106048Z  2024-12-18T00:58:33.8106804Z [18,560 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:33.8107686Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:58:33.8108470Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:33.8109192Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:58:33.8109983Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:33.8110800Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2024-12-18T00:58:33.8111502Z @llvm-project//mlir:ArmSVETransforms; 19s local 2024-12-18T00:58:33.8112147Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 16s local 2024-12-18T00:58:33.8113143Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:58:34.0383709Z 2024-12-18T00:58:34.0384572Z  2024-12-18T00:58:34.0385033Z  2024-12-18T00:58:34.0385428Z  2024-12-18T00:58:34.0385828Z  2024-12-18T00:58:34.0386195Z  2024-12-18T00:58:34.0386545Z  2024-12-18T00:58:34.0386932Z  2024-12-18T00:58:34.0387329Z  2024-12-18T00:58:34.0388255Z [18,564 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:34.0389568Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:58:34.0390560Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:58:34.0391503Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:58:34.0392498Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:34.0393504Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2024-12-18T00:58:34.0394741Z @llvm-project//mlir:ArmSVETransforms; 19s local 2024-12-18T00:58:34.0395541Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2024-12-18T00:58:34.0396528Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:58:34.2781678Z 2024-12-18T00:58:34.2782564Z  2024-12-18T00:58:34.2783053Z  2024-12-18T00:58:34.2783451Z  2024-12-18T00:58:34.2783856Z  2024-12-18T00:58:34.2784269Z  2024-12-18T00:58:34.2794204Z  2024-12-18T00:58:34.2794632Z  2024-12-18T00:58:34.2795021Z  2024-12-18T00:58:34.2795925Z [18,566 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:34.2797027Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:58:34.2797991Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:58:34.2798958Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:58:34.2799945Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:34.2800997Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2024-12-18T00:58:34.2801872Z @llvm-project//mlir:ArmSVETransforms; 20s local 2024-12-18T00:58:34.2802699Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2024-12-18T00:58:34.2803687Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2024-12-18T00:58:34.5399825Z 2024-12-18T00:58:34.5400852Z  2024-12-18T00:58:34.5401280Z  2024-12-18T00:58:34.5401617Z  2024-12-18T00:58:34.5401975Z  2024-12-18T00:58:34.5402341Z  2024-12-18T00:58:34.5402669Z  2024-12-18T00:58:34.5403023Z  2024-12-18T00:58:34.5403383Z  2024-12-18T00:58:34.5404277Z [18,566 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:34.5405681Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:58:34.5406625Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:58:34.5407465Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2024-12-18T00:58:34.5408426Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:34.5409473Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2024-12-18T00:58:34.5410347Z @llvm-project//mlir:ArmSVETransforms; 20s local 2024-12-18T00:58:34.5411152Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2024-12-18T00:58:34.5412170Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local ... 2024-12-18T00:58:34.7402738Z 2024-12-18T00:58:34.7403643Z  2024-12-18T00:58:34.7404134Z  2024-12-18T00:58:34.7404530Z  2024-12-18T00:58:34.7404934Z  2024-12-18T00:58:34.7405320Z  2024-12-18T00:58:34.7405747Z  2024-12-18T00:58:34.7406147Z  2024-12-18T00:58:34.7406807Z  2024-12-18T00:58:34.7407783Z [18,567 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:34.7408887Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:58:34.7409854Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:58:34.7410824Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:34.7411811Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:34.7412865Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2024-12-18T00:58:34.7413857Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2024-12-18T00:58:34.7414869Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:58:34.7415819Z Compiling xla/service/buffer_assignment.cc; 15s local ... 2024-12-18T00:58:34.9411699Z 2024-12-18T00:58:34.9412583Z  2024-12-18T00:58:34.9413391Z  2024-12-18T00:58:34.9413878Z  2024-12-18T00:58:34.9414274Z  2024-12-18T00:58:34.9414648Z  2024-12-18T00:58:34.9415078Z  2024-12-18T00:58:34.9415589Z  2024-12-18T00:58:34.9416095Z  2024-12-18T00:58:34.9417267Z [18,571 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:34.9418295Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:58:34.9419278Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:58:34.9420218Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:34.9421222Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2024-12-18T00:58:34.9422218Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2024-12-18T00:58:34.9423350Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2024-12-18T00:58:34.9424342Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:58:34.9425304Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2024-12-18T00:58:35.3337836Z 2024-12-18T00:58:35.3338728Z  2024-12-18T00:58:35.3339174Z  2024-12-18T00:58:35.3339569Z  2024-12-18T00:58:35.3339962Z  2024-12-18T00:58:35.3340343Z  2024-12-18T00:58:35.3340706Z  2024-12-18T00:58:35.3341059Z  2024-12-18T00:58:35.3341440Z  2024-12-18T00:58:35.3342341Z [18,572 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:35.3343439Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:58:35.3344679Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:58:35.3345592Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:35.3346616Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2024-12-18T00:58:35.3348005Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2024-12-18T00:58:35.3348971Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 18s local 2024-12-18T00:58:35.3349890Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2024-12-18T00:58:35.3350829Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2024-12-18T00:58:35.5409177Z 2024-12-18T00:58:35.5410038Z  2024-12-18T00:58:35.5410520Z  2024-12-18T00:58:35.5410927Z  2024-12-18T00:58:35.5411329Z  2024-12-18T00:58:35.5411732Z  2024-12-18T00:58:35.5412095Z  2024-12-18T00:58:35.5412485Z  2024-12-18T00:58:35.5412876Z  2024-12-18T00:58:35.5413812Z [18,573 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:35.5415082Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:58:35.5416090Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:58:35.5417436Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2024-12-18T00:58:35.5418474Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2024-12-18T00:58:35.5419478Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2024-12-18T00:58:35.5420595Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 18s local 2024-12-18T00:58:35.5421507Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:58:35.5422422Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2024-12-18T00:58:35.8073966Z 2024-12-18T00:58:35.8074872Z  2024-12-18T00:58:35.8075382Z  2024-12-18T00:58:35.8075830Z  2024-12-18T00:58:35.8076268Z  2024-12-18T00:58:35.8076686Z  2024-12-18T00:58:35.8077141Z  2024-12-18T00:58:35.8077575Z  2024-12-18T00:58:35.8078023Z  2024-12-18T00:58:35.8079382Z [18,574 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:35.8080746Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:58:35.8081881Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:58:35.8082944Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:58:35.8084092Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:58:35.8085292Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2024-12-18T00:58:35.8086405Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 18s local 2024-12-18T00:58:35.8087519Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:58:35.8088623Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2024-12-18T00:58:36.1414561Z 2024-12-18T00:58:36.1415482Z  2024-12-18T00:58:36.1415892Z  2024-12-18T00:58:36.1416225Z  2024-12-18T00:58:36.1416756Z  2024-12-18T00:58:36.1417099Z  2024-12-18T00:58:36.1417468Z  2024-12-18T00:58:36.1417810Z  2024-12-18T00:58:36.1418257Z  2024-12-18T00:58:36.1419036Z [18,574 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:36.1419944Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:58:36.1420752Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:58:36.1421522Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:58:36.1422312Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:58:36.1423157Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2024-12-18T00:58:36.1423965Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 19s local 2024-12-18T00:58:36.1424785Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2024-12-18T00:58:36.1425943Z Compiling xla/service/buffer_assignment.cc; 17s local ... 2024-12-18T00:58:36.5419418Z 2024-12-18T00:58:36.5420358Z  2024-12-18T00:58:36.5420814Z  2024-12-18T00:58:36.5421193Z  2024-12-18T00:58:36.5421589Z  2024-12-18T00:58:36.5421985Z  2024-12-18T00:58:36.5422371Z  2024-12-18T00:58:36.5422748Z  2024-12-18T00:58:36.5423147Z  2024-12-18T00:58:36.5424104Z [18,575 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:36.5425252Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:58:36.5426383Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:58:36.5427284Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2024-12-18T00:58:36.5428267Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:58:36.5429296Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2024-12-18T00:58:36.5430671Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 19s local 2024-12-18T00:58:36.5431697Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:36.5432643Z Compiling xla/service/buffer_assignment.cc; 17s local ... 2024-12-18T00:58:36.7422006Z 2024-12-18T00:58:36.7422925Z  2024-12-18T00:58:36.7423390Z  2024-12-18T00:58:36.7423790Z  2024-12-18T00:58:36.7424175Z  2024-12-18T00:58:36.7424572Z  2024-12-18T00:58:36.7424944Z  2024-12-18T00:58:36.7425337Z  2024-12-18T00:58:36.7425740Z  2024-12-18T00:58:36.7426678Z [18,576 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:36.7427844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:58:36.7428798Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:58:36.7429826Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:58:36.7431132Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:58:36.7432263Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2024-12-18T00:58:36.7433215Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 19s local 2024-12-18T00:58:36.7434183Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:36.7435111Z Compiling xla/service/buffer_assignment.cc; 17s local ... 2024-12-18T00:58:36.9657440Z 2024-12-18T00:58:36.9658341Z  2024-12-18T00:58:36.9658824Z  2024-12-18T00:58:36.9659236Z  2024-12-18T00:58:36.9659624Z  2024-12-18T00:58:36.9659993Z  2024-12-18T00:58:36.9660394Z  2024-12-18T00:58:36.9660792Z  2024-12-18T00:58:36.9661172Z  2024-12-18T00:58:36.9662120Z [18,577 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:36.9663236Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:58:36.9664290Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:58:36.9665235Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:58:36.9666253Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:58:36.9667282Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2024-12-18T00:58:36.9668280Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local 2024-12-18T00:58:36.9669262Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:36.9670244Z Compiling xla/service/buffer_assignment.cc; 18s local ... 2024-12-18T00:58:37.1730008Z 2024-12-18T00:58:37.1730918Z  2024-12-18T00:58:37.1731393Z  2024-12-18T00:58:37.1731767Z  2024-12-18T00:58:37.1732135Z  2024-12-18T00:58:37.1732502Z  2024-12-18T00:58:37.1732884Z  2024-12-18T00:58:37.1733262Z  2024-12-18T00:58:37.1733925Z  2024-12-18T00:58:37.1734865Z [18,578 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:37.1736011Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:58:37.1737157Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:58:37.1738100Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:58:37.1739078Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:58:37.1740103Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2024-12-18T00:58:37.1741061Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local 2024-12-18T00:58:37.1742025Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2024-12-18T00:58:37.1743001Z Compiling xla/service/buffer_assignment.cc; 18s local ... 2024-12-18T00:58:37.5428563Z 2024-12-18T00:58:37.5429493Z  2024-12-18T00:58:37.5430006Z  2024-12-18T00:58:37.5430405Z  2024-12-18T00:58:37.5431119Z  2024-12-18T00:58:37.5431543Z  2024-12-18T00:58:37.5431935Z  2024-12-18T00:58:37.5432315Z  2024-12-18T00:58:37.5432694Z  2024-12-18T00:58:37.5433630Z [18,579 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:37.5434765Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:58:37.5435811Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:58:37.5436730Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2024-12-18T00:58:37.5437738Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:58:37.5438781Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2024-12-18T00:58:37.5439764Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local 2024-12-18T00:58:37.5440747Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:58:37.5442217Z Compiling xla/service/buffer_assignment.cc; 18s local ... 2024-12-18T00:58:37.7431619Z 2024-12-18T00:58:37.7432604Z  2024-12-18T00:58:37.7433104Z  2024-12-18T00:58:37.7433488Z  2024-12-18T00:58:37.7433867Z  2024-12-18T00:58:37.7434246Z  2024-12-18T00:58:37.7434590Z  2024-12-18T00:58:37.7434956Z  2024-12-18T00:58:37.7435327Z  2024-12-18T00:58:37.7436202Z [18,580 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:37.7437210Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:58:37.7438058Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:58:37.7438902Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:58:37.7439736Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:37.7440764Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2024-12-18T00:58:37.7441733Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local 2024-12-18T00:58:37.7442616Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:58:37.7443527Z Compiling xla/service/buffer_assignment.cc; 18s local ... 2024-12-18T00:58:38.0357360Z 2024-12-18T00:58:38.0358232Z  2024-12-18T00:58:38.0358710Z  2024-12-18T00:58:38.0359084Z  2024-12-18T00:58:38.0359465Z  2024-12-18T00:58:38.0359816Z  2024-12-18T00:58:38.0360198Z  2024-12-18T00:58:38.0360578Z  2024-12-18T00:58:38.0360948Z  2024-12-18T00:58:38.0361855Z [18,581 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:38.0363107Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:58:38.0364051Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:58:38.0365281Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:58:38.0366302Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:38.0367378Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2024-12-18T00:58:38.0368381Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local 2024-12-18T00:58:38.0369386Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:58:38.0370332Z Compiling xla/service/buffer_assignment.cc; 19s local ... 2024-12-18T00:58:38.3290365Z 2024-12-18T00:58:38.3291368Z  2024-12-18T00:58:38.3291837Z  2024-12-18T00:58:38.3292230Z  2024-12-18T00:58:38.3292615Z  2024-12-18T00:58:38.3293019Z  2024-12-18T00:58:38.3293423Z  2024-12-18T00:58:38.3293805Z  2024-12-18T00:58:38.3294176Z  2024-12-18T00:58:38.3295130Z [18,582 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:38.3296709Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:58:38.3297778Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:58:38.3298756Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:58:38.3299803Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:38.3300819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2024-12-18T00:58:38.3301750Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local 2024-12-18T00:58:38.3302651Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2024-12-18T00:58:38.3303509Z Compiling xla/service/buffer_assignment.cc; 19s local ... 2024-12-18T00:58:38.5438173Z 2024-12-18T00:58:38.5439085Z  2024-12-18T00:58:38.5439560Z  2024-12-18T00:58:38.5439979Z  2024-12-18T00:58:38.5440392Z  2024-12-18T00:58:38.5440782Z  2024-12-18T00:58:38.5441194Z  2024-12-18T00:58:38.5441598Z  2024-12-18T00:58:38.5442407Z  2024-12-18T00:58:38.5443396Z [18,583 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:38.5444793Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:58:38.5445735Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:58:38.5446715Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2024-12-18T00:58:38.5447794Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:38.5448890Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2024-12-18T00:58:38.5449819Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local 2024-12-18T00:58:38.5450739Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:58:38.5451691Z Compiling xla/service/buffer_assignment.cc; 19s local ... 2024-12-18T00:58:38.7441599Z 2024-12-18T00:58:38.7442526Z  2024-12-18T00:58:38.7443059Z  2024-12-18T00:58:38.7443451Z  2024-12-18T00:58:38.7443847Z  2024-12-18T00:58:38.7444466Z  2024-12-18T00:58:38.7444842Z  2024-12-18T00:58:38.7445222Z  2024-12-18T00:58:38.7445580Z  2024-12-18T00:58:38.7446476Z [18,584 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:38.7447545Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:58:38.7448513Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:58:38.7449474Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:58:38.7450474Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:58:38.7451549Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2024-12-18T00:58:38.7452526Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local 2024-12-18T00:58:38.7453847Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:58:38.7454868Z Compiling xla/service/buffer_assignment.cc; 19s local ... 2024-12-18T00:58:39.3186947Z 2024-12-18T00:58:39.3187812Z  2024-12-18T00:58:39.3188244Z  2024-12-18T00:58:39.3188615Z  2024-12-18T00:58:39.3189020Z  2024-12-18T00:58:39.3189427Z  2024-12-18T00:58:39.3189809Z  2024-12-18T00:58:39.3190129Z  2024-12-18T00:58:39.3190428Z  2024-12-18T00:58:39.3191280Z [18,585 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:39.3192456Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:58:39.3193504Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:58:39.3194431Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:58:39.3195500Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:58:39.3196900Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2024-12-18T00:58:39.3197978Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local 2024-12-18T00:58:39.3199004Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2024-12-18T00:58:39.3200040Z Compiling xla/service/buffer_assignment.cc; 20s local ... 2024-12-18T00:58:39.5447909Z 2024-12-18T00:58:39.5448828Z  2024-12-18T00:58:39.5449265Z  2024-12-18T00:58:39.5449676Z  2024-12-18T00:58:39.5450192Z  2024-12-18T00:58:39.5450553Z  2024-12-18T00:58:39.5450930Z  2024-12-18T00:58:39.5451296Z  2024-12-18T00:58:39.5451701Z  2024-12-18T00:58:39.5452654Z [18,586 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:39.5453871Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:58:39.5454973Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:58:39.5456289Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2024-12-18T00:58:39.5457560Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:58:39.5458605Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2024-12-18T00:58:39.5459502Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local 2024-12-18T00:58:39.5460475Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:58:39.5461358Z Compiling xla/service/buffer_assignment.cc; 20s local ... 2024-12-18T00:58:39.7450620Z 2024-12-18T00:58:39.7451524Z  2024-12-18T00:58:39.7451979Z  2024-12-18T00:58:39.7452396Z  2024-12-18T00:58:39.7452910Z  2024-12-18T00:58:39.7453296Z  2024-12-18T00:58:39.7453659Z  2024-12-18T00:58:39.7454036Z  2024-12-18T00:58:39.7454409Z  2024-12-18T00:58:39.7455394Z [18,588 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:39.7456607Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:58:39.7457556Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:58:39.7458530Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:58:39.7459514Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2024-12-18T00:58:39.7460601Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2024-12-18T00:58:39.7461570Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local 2024-12-18T00:58:39.7462606Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:58:39.7463591Z Compiling xla/service/buffer_assignment.cc; 20s local ... 2024-12-18T00:58:40.1454750Z 2024-12-18T00:58:40.1455673Z  2024-12-18T00:58:40.1456116Z  2024-12-18T00:58:40.1456977Z  2024-12-18T00:58:40.1457367Z  2024-12-18T00:58:40.1457748Z  2024-12-18T00:58:40.1458166Z  2024-12-18T00:58:40.1458543Z  2024-12-18T00:58:40.1458935Z  2024-12-18T00:58:40.1459850Z [18,590 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:40.1461053Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:58:40.1462067Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:58:40.1463002Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:58:40.1463978Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2024-12-18T00:58:40.1465057Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:40.1466060Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2024-12-18T00:58:40.1467007Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2024-12-18T00:58:40.1468213Z Compiling xla/service/buffer_assignment.cc; 21s local ... 2024-12-18T00:58:40.5459064Z 2024-12-18T00:58:40.5459946Z  2024-12-18T00:58:40.5460431Z  2024-12-18T00:58:40.5460846Z  2024-12-18T00:58:40.5461251Z  2024-12-18T00:58:40.5461656Z  2024-12-18T00:58:40.5462048Z  2024-12-18T00:58:40.5462438Z  2024-12-18T00:58:40.5462789Z  2024-12-18T00:58:40.5463737Z [18,591 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:40.5464925Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:58:40.5465944Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:58:40.5466960Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2024-12-18T00:58:40.5467993Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2024-12-18T00:58:40.5468989Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:40.5470419Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2024-12-18T00:58:40.5471545Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:40.5472595Z Compiling xla/service/buffer_assignment.cc; 21s local ... 2024-12-18T00:58:40.7462771Z 2024-12-18T00:58:40.7463653Z  2024-12-18T00:58:40.7464143Z  2024-12-18T00:58:40.7464531Z  2024-12-18T00:58:40.7464928Z  2024-12-18T00:58:40.7465294Z  2024-12-18T00:58:40.7465700Z  2024-12-18T00:58:40.7466095Z  2024-12-18T00:58:40.7466478Z  2024-12-18T00:58:40.7467399Z [18,592 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:40.7468571Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:58:40.7469612Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:58:40.7470585Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:58:40.7471614Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:58:40.7472739Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:40.7473741Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2024-12-18T00:58:40.7474822Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:40.7475866Z Compiling xla/service/buffer_assignment.cc; 21s local ... 2024-12-18T00:58:40.9869467Z 2024-12-18T00:58:40.9870345Z  2024-12-18T00:58:40.9870807Z  2024-12-18T00:58:40.9871223Z  2024-12-18T00:58:40.9871619Z  2024-12-18T00:58:40.9872023Z  2024-12-18T00:58:40.9872405Z  2024-12-18T00:58:40.9872811Z  2024-12-18T00:58:40.9873211Z  2024-12-18T00:58:40.9874150Z [18,593 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:40.9875586Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:58:40.9876644Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:58:40.9877645Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:58:40.9878676Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:58:40.9879751Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2024-12-18T00:58:40.9880789Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2024-12-18T00:58:40.9881846Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:40.9882856Z Compiling xla/service/buffer_assignment.cc; 22s local ... 2024-12-18T00:58:41.3469151Z 2024-12-18T00:58:41.3470032Z  2024-12-18T00:58:41.3470546Z  2024-12-18T00:58:41.3470974Z  2024-12-18T00:58:41.3471396Z  2024-12-18T00:58:41.3471800Z  2024-12-18T00:58:41.3472221Z  2024-12-18T00:58:41.3472678Z  2024-12-18T00:58:41.3473084Z  2024-12-18T00:58:41.3474340Z [18,593 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:41.3475581Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:58:41.3476656Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:58:41.3477625Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2024-12-18T00:58:41.3478713Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:58:41.3479846Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2024-12-18T00:58:41.3480874Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2024-12-18T00:58:41.3481924Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2024-12-18T00:58:41.3482983Z Compiling xla/service/buffer_assignment.cc; 22s local ... 2024-12-18T00:58:41.7472769Z 2024-12-18T00:58:41.7473709Z  2024-12-18T00:58:41.7474189Z  2024-12-18T00:58:41.7474840Z  2024-12-18T00:58:41.7475325Z  2024-12-18T00:58:41.7475728Z  2024-12-18T00:58:41.7476129Z  2024-12-18T00:58:41.7476521Z  2024-12-18T00:58:41.7476917Z  2024-12-18T00:58:41.7477866Z [18,595 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:41.7479033Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2024-12-18T00:58:41.7480048Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:58:41.7481030Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:58:41.7482104Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:58:41.7483188Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2024-12-18T00:58:41.7484207Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2024-12-18T00:58:41.7485268Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:58:41.7486322Z Compiling xla/service/buffer_assignment.cc; 22s local ... 2024-12-18T00:58:42.1476556Z 2024-12-18T00:58:42.1477399Z  2024-12-18T00:58:42.1477829Z  2024-12-18T00:58:42.1478193Z  2024-12-18T00:58:42.1478536Z  2024-12-18T00:58:42.1478896Z  2024-12-18T00:58:42.1479257Z  2024-12-18T00:58:42.1479631Z  2024-12-18T00:58:42.1479979Z  2024-12-18T00:58:42.1480857Z [18,597 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:42.1481965Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2024-12-18T00:58:42.1482885Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:58:42.1483751Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:58:42.1484708Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:58:42.1485993Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:58:42.1487015Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2024-12-18T00:58:42.1487907Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2024-12-18T00:58:42.1488780Z Compiling xla/service/buffer_assignment.cc; 23s local ... 2024-12-18T00:58:42.5479960Z 2024-12-18T00:58:42.5480865Z  2024-12-18T00:58:42.5481251Z  2024-12-18T00:58:42.5481576Z  2024-12-18T00:58:42.5481896Z  2024-12-18T00:58:42.5482217Z  2024-12-18T00:58:42.5482517Z  2024-12-18T00:58:42.5482833Z  2024-12-18T00:58:42.5483156Z  2024-12-18T00:58:42.5483925Z [18,599 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:42.5484804Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:58:42.5485559Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:58:42.5486629Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2024-12-18T00:58:42.5487435Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:58:42.5488249Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:58:42.5488999Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2024-12-18T00:58:42.5489766Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:42.5490501Z Compiling xla/service/buffer_assignment.cc; 23s local ... 2024-12-18T00:58:42.7483897Z 2024-12-18T00:58:42.7484833Z  2024-12-18T00:58:42.7485320Z  2024-12-18T00:58:42.7485732Z  2024-12-18T00:58:42.7486156Z  2024-12-18T00:58:42.7486570Z  2024-12-18T00:58:42.7486988Z  2024-12-18T00:58:42.7487401Z  2024-12-18T00:58:42.7487790Z  2024-12-18T00:58:42.7488778Z [18,600 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:42.7490388Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:58:42.7491479Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:58:42.7492509Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:58:42.7493569Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:58:42.7494696Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2024-12-18T00:58:42.7495866Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2024-12-18T00:58:42.7497088Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:42.7498099Z Compiling xla/service/buffer_assignment.cc; 23s local ... 2024-12-18T00:58:43.1488076Z 2024-12-18T00:58:43.1488986Z  2024-12-18T00:58:43.1489471Z  2024-12-18T00:58:43.1489846Z  2024-12-18T00:58:43.1490247Z  2024-12-18T00:58:43.1490638Z  2024-12-18T00:58:43.1491016Z  2024-12-18T00:58:43.1491431Z  2024-12-18T00:58:43.1491839Z  2024-12-18T00:58:43.1492784Z [18,601 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:43.1493941Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:58:43.1494963Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2024-12-18T00:58:43.1495901Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:58:43.1497110Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:58:43.1498204Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2024-12-18T00:58:43.1499237Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2024-12-18T00:58:43.1500286Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:43.1501280Z Compiling xla/service/buffer_assignment.cc; 24s local ... 2024-12-18T00:58:43.4739049Z 2024-12-18T00:58:43.4740031Z  2024-12-18T00:58:43.4740479Z  2024-12-18T00:58:43.4740866Z  2024-12-18T00:58:43.4741264Z  2024-12-18T00:58:43.4741653Z  2024-12-18T00:58:43.4742057Z  2024-12-18T00:58:43.4742435Z  2024-12-18T00:58:43.4742795Z  2024-12-18T00:58:43.4743744Z [18,602 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:43.4745089Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2024-12-18T00:58:43.4746083Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2024-12-18T00:58:43.4747014Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2024-12-18T00:58:43.4748037Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:58:43.4749111Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2024-12-18T00:58:43.4750109Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2024-12-18T00:58:43.4751469Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2024-12-18T00:58:43.4752487Z Compiling xla/service/buffer_assignment.cc; 24s local ... 2024-12-18T00:58:43.7492879Z 2024-12-18T00:58:43.7493804Z  2024-12-18T00:58:43.7494291Z  2024-12-18T00:58:43.7494686Z  2024-12-18T00:58:43.7495077Z  2024-12-18T00:58:43.7495481Z  2024-12-18T00:58:43.7495867Z  2024-12-18T00:58:43.7496239Z  2024-12-18T00:58:43.7496781Z  2024-12-18T00:58:43.7497734Z [18,602 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:43.7498829Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2024-12-18T00:58:43.7499783Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2024-12-18T00:58:43.7500700Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2024-12-18T00:58:43.7501723Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:58:43.7503153Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2024-12-18T00:58:43.7504133Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2024-12-18T00:58:43.7505094Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2024-12-18T00:58:43.7506101Z Compiling xla/service/buffer_assignment.cc; 24s local ... 2024-12-18T00:58:44.6312399Z 2024-12-18T00:58:44.6313262Z  2024-12-18T00:58:44.6313746Z  2024-12-18T00:58:44.6314160Z  2024-12-18T00:58:44.6314561Z  2024-12-18T00:58:44.6314967Z  2024-12-18T00:58:44.6315344Z  2024-12-18T00:58:44.6315718Z  2024-12-18T00:58:44.6316083Z  2024-12-18T00:58:44.6316956Z [18,603 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:44.6318110Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:58:44.6319124Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2024-12-18T00:58:44.6320093Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:58:44.6321271Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:58:44.6322313Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:58:44.6323252Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2024-12-18T00:58:44.6324228Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:58:44.6325224Z Compiling xla/service/buffer_assignment.cc; 25s local ... 2024-12-18T00:58:44.9502314Z 2024-12-18T00:58:44.9503239Z  2024-12-18T00:58:44.9503812Z  2024-12-18T00:58:44.9504218Z  2024-12-18T00:58:44.9504574Z  2024-12-18T00:58:44.9504902Z  2024-12-18T00:58:44.9505243Z  2024-12-18T00:58:44.9505592Z  2024-12-18T00:58:44.9505933Z  2024-12-18T00:58:44.9507255Z [18,603 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:44.9508393Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:58:44.9509517Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2024-12-18T00:58:44.9510465Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:58:44.9511511Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:58:44.9512645Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2024-12-18T00:58:44.9513623Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2024-12-18T00:58:44.9514673Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:58:44.9515613Z Compiling xla/service/buffer_assignment.cc; 26s local ... 2024-12-18T00:58:45.1604050Z 2024-12-18T00:58:45.1604985Z  2024-12-18T00:58:45.1605468Z  2024-12-18T00:58:45.1605979Z  2024-12-18T00:58:45.1606387Z  2024-12-18T00:58:45.1607069Z  2024-12-18T00:58:45.1607550Z  2024-12-18T00:58:45.1607980Z  2024-12-18T00:58:45.1608398Z  2024-12-18T00:58:45.1609290Z [18,604 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:45.1610389Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:58:45.1611396Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2024-12-18T00:58:45.1612333Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:58:45.1613329Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:58:45.1614370Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:58:45.1615370Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2024-12-18T00:58:45.1616340Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:58:45.1617770Z Compiling xla/service/buffer_assignment.cc; 26s local ... 2024-12-18T00:58:45.4796058Z 2024-12-18T00:58:45.4796920Z  2024-12-18T00:58:45.4797342Z  2024-12-18T00:58:45.4797689Z  2024-12-18T00:58:45.4798048Z  2024-12-18T00:58:45.4798418Z  2024-12-18T00:58:45.4798755Z  2024-12-18T00:58:45.4799133Z  2024-12-18T00:58:45.4799491Z  2024-12-18T00:58:45.4800340Z [18,606 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:45.4801345Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:58:45.4802228Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2024-12-18T00:58:45.4803081Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2024-12-18T00:58:45.4804029Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:58:45.4804944Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:58:45.4806028Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2024-12-18T00:58:45.4806888Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2024-12-18T00:58:45.4807762Z Compiling xla/service/buffer_assignment.cc; 26s local ... 2024-12-18T00:58:45.7508664Z 2024-12-18T00:58:45.7509546Z  2024-12-18T00:58:45.7509942Z  2024-12-18T00:58:45.7510250Z  2024-12-18T00:58:45.7510576Z  2024-12-18T00:58:45.7510899Z  2024-12-18T00:58:45.7511218Z  2024-12-18T00:58:45.7511525Z  2024-12-18T00:58:45.7511852Z  2024-12-18T00:58:45.7512629Z [18,609 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:45.7513518Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:58:45.7514307Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2024-12-18T00:58:45.7515330Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:58:45.7516147Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:58:45.7516975Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2024-12-18T00:58:45.7517740Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2024-12-18T00:58:45.7518528Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:58:45.7519296Z Compiling xla/service/buffer_assignment.cc; 26s local ... 2024-12-18T00:58:46.1513040Z 2024-12-18T00:58:46.1513927Z  2024-12-18T00:58:46.1514392Z  2024-12-18T00:58:46.1514794Z  2024-12-18T00:58:46.1515184Z  2024-12-18T00:58:46.1515568Z  2024-12-18T00:58:46.1515952Z  2024-12-18T00:58:46.1516345Z  2024-12-18T00:58:46.1516708Z  2024-12-18T00:58:46.1517638Z [18,610 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:46.1519110Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:58:46.1520135Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2024-12-18T00:58:46.1521099Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2024-12-18T00:58:46.1522099Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:58:46.1523188Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:58:46.1524194Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2024-12-18T00:58:46.1525151Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2024-12-18T00:58:46.1526350Z Compiling xla/service/buffer_assignment.cc; 27s local ... 2024-12-18T00:58:46.6186609Z 2024-12-18T00:58:46.6187502Z  2024-12-18T00:58:46.6188013Z  2024-12-18T00:58:46.6188459Z  2024-12-18T00:58:46.6188853Z  2024-12-18T00:58:46.6189235Z  2024-12-18T00:58:46.6189734Z  2024-12-18T00:58:46.6190285Z  2024-12-18T00:58:46.6190808Z  2024-12-18T00:58:46.6192231Z [18,611 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:46.6193372Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:58:46.6194353Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2024-12-18T00:58:46.6195297Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:58:46.6196280Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:58:46.6197330Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:58:46.6198334Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2024-12-18T00:58:46.6199294Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:46.6200354Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local ... 2024-12-18T00:58:46.9518984Z 2024-12-18T00:58:46.9519886Z  2024-12-18T00:58:46.9520359Z  2024-12-18T00:58:46.9520767Z  2024-12-18T00:58:46.9521143Z  2024-12-18T00:58:46.9521503Z  2024-12-18T00:58:46.9521885Z  2024-12-18T00:58:46.9522269Z  2024-12-18T00:58:46.9522696Z  2024-12-18T00:58:46.9523758Z [18,612 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:46.9524824Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:58:46.9525951Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:58:46.9526845Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:58:46.9527799Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:58:46.9528887Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2024-12-18T00:58:46.9529848Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:58:46.9531193Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:46.9532244Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local ... 2024-12-18T00:58:47.1522794Z 2024-12-18T00:58:47.1523875Z  2024-12-18T00:58:47.1524490Z  2024-12-18T00:58:47.1524904Z  2024-12-18T00:58:47.1525295Z  2024-12-18T00:58:47.1525669Z  2024-12-18T00:58:47.1526065Z  2024-12-18T00:58:47.1526513Z  2024-12-18T00:58:47.1527010Z  2024-12-18T00:58:47.1527999Z [18,613 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:47.1529163Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:58:47.1530129Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:58:47.1531033Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:58:47.1532046Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:58:47.1533431Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:58:47.1534435Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:58:47.1535442Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:47.1536643Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local ... 2024-12-18T00:58:47.4122834Z 2024-12-18T00:58:47.4123753Z  2024-12-18T00:58:47.4124227Z  2024-12-18T00:58:47.4124624Z  2024-12-18T00:58:47.4125013Z  2024-12-18T00:58:47.4125379Z  2024-12-18T00:58:47.4125734Z  2024-12-18T00:58:47.4126128Z  2024-12-18T00:58:47.4126529Z  2024-12-18T00:58:47.4127417Z [18,615 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:47.4128547Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:58:47.4129579Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:58:47.4130965Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2024-12-18T00:58:47.4131980Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:58:47.4133068Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:58:47.4134041Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:58:47.4134973Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2024-12-18T00:58:47.4136124Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local ... 2024-12-18T00:58:47.7528394Z 2024-12-18T00:58:47.7529280Z  2024-12-18T00:58:47.7529774Z  2024-12-18T00:58:47.7530185Z  2024-12-18T00:58:47.7530606Z  2024-12-18T00:58:47.7531002Z  2024-12-18T00:58:47.7531394Z  2024-12-18T00:58:47.7531817Z  2024-12-18T00:58:47.7532211Z  2024-12-18T00:58:47.7533247Z [18,615 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:47.7534399Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:58:47.7535439Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:58:47.7536397Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:58:47.7537484Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:58:47.7538463Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2024-12-18T00:58:47.7539407Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:58:47.7540516Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:58:47.7541532Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local ... 2024-12-18T00:58:48.1349282Z 2024-12-18T00:58:48.1350199Z  2024-12-18T00:58:48.1350677Z  2024-12-18T00:58:48.1351389Z  2024-12-18T00:58:48.1351773Z  2024-12-18T00:58:48.1352163Z  2024-12-18T00:58:48.1352609Z  2024-12-18T00:58:48.1353015Z  2024-12-18T00:58:48.1353365Z  2024-12-18T00:58:48.1354302Z [18,616 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:48.1355422Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:58:48.1356395Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:58:48.1357359Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:58:48.1358347Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:58:48.1359383Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:58:48.1360384Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:58:48.1361354Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:58:48.1362685Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local ... 2024-12-18T00:58:48.3532946Z 2024-12-18T00:58:48.3533777Z  2024-12-18T00:58:48.3534190Z  2024-12-18T00:58:48.3534547Z  2024-12-18T00:58:48.3534890Z  2024-12-18T00:58:48.3535229Z  2024-12-18T00:58:48.3535542Z  2024-12-18T00:58:48.3535877Z  2024-12-18T00:58:48.3536213Z  2024-12-18T00:58:48.3537173Z [18,616 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:48.3548318Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:58:48.3549218Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:58:48.3550220Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2024-12-18T00:58:48.3551111Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:58:48.3552073Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:58:48.3553268Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:58:48.3554224Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2024-12-18T00:58:48.3555173Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local ... 2024-12-18T00:58:48.7537419Z 2024-12-18T00:58:48.7538258Z  2024-12-18T00:58:48.7538675Z  2024-12-18T00:58:48.7539022Z  2024-12-18T00:58:48.7539392Z  2024-12-18T00:58:48.7539752Z  2024-12-18T00:58:48.7540109Z  2024-12-18T00:58:48.7540441Z  2024-12-18T00:58:48.7540791Z  2024-12-18T00:58:48.7541641Z [18,617 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:48.7542656Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:58:48.7543495Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:58:48.7544495Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2024-12-18T00:58:48.7545387Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2024-12-18T00:58:48.7546260Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2024-12-18T00:58:48.7547115Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:58:48.7547961Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2024-12-18T00:58:48.7548834Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local ... 2024-12-18T00:58:49.7545477Z 2024-12-18T00:58:49.7546375Z  2024-12-18T00:58:49.7546844Z  2024-12-18T00:58:49.7547256Z  2024-12-18T00:58:49.7547593Z  2024-12-18T00:58:49.7547938Z  2024-12-18T00:58:49.7548324Z  2024-12-18T00:58:49.7548701Z  2024-12-18T00:58:49.7549091Z  2024-12-18T00:58:49.7549979Z [18,617 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:49.7551428Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:58:49.7552422Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2024-12-18T00:58:49.7553354Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:49.7554363Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2024-12-18T00:58:49.7555445Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2024-12-18T00:58:49.7556373Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2024-12-18T00:58:49.7557358Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:58:49.7558449Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local ... 2024-12-18T00:58:50.0000301Z 2024-12-18T00:58:50.0001172Z  2024-12-18T00:58:50.0001614Z  2024-12-18T00:58:50.0001997Z  2024-12-18T00:58:50.0002362Z  2024-12-18T00:58:50.0002731Z  2024-12-18T00:58:50.0003105Z  2024-12-18T00:58:50.0003477Z  2024-12-18T00:58:50.0004109Z  2024-12-18T00:58:50.0005122Z [18,618 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:50.0006031Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:58:50.0006834Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:58:50.0007601Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:50.0008470Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2024-12-18T00:58:50.0009348Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2024-12-18T00:58:50.0010221Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:58:50.0011125Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:58:50.0012274Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local ... 2024-12-18T00:58:50.2321264Z 2024-12-18T00:58:50.2322287Z  2024-12-18T00:58:50.2323111Z  2024-12-18T00:58:50.2323521Z  2024-12-18T00:58:50.2323922Z  2024-12-18T00:58:50.2324301Z  2024-12-18T00:58:50.2324706Z  2024-12-18T00:58:50.2325108Z  2024-12-18T00:58:50.2325503Z  2024-12-18T00:58:50.2326429Z [18,619 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:50.2327609Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:58:50.2328650Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:58:50.2329591Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:50.2330619Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2024-12-18T00:58:50.2331694Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:58:50.2332697Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:58:50.2333730Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2024-12-18T00:58:50.2334809Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local ... 2024-12-18T00:58:50.5550996Z 2024-12-18T00:58:50.5551897Z  2024-12-18T00:58:50.5552387Z  2024-12-18T00:58:50.5552811Z  2024-12-18T00:58:50.5553189Z  2024-12-18T00:58:50.5553492Z  2024-12-18T00:58:50.5553842Z  2024-12-18T00:58:50.5554214Z  2024-12-18T00:58:50.5554597Z  2024-12-18T00:58:50.5555496Z [18,619 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:50.5556618Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:58:50.5557635Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:58:50.5558611Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2024-12-18T00:58:50.5559634Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2024-12-18T00:58:50.5561064Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:58:50.5562028Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:58:50.5563050Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:58:50.5564112Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local ... 2024-12-18T00:58:50.7552577Z 2024-12-18T00:58:50.7553488Z  2024-12-18T00:58:50.7553976Z  2024-12-18T00:58:50.7554386Z  2024-12-18T00:58:50.7554791Z  2024-12-18T00:58:50.7555171Z  2024-12-18T00:58:50.7555580Z  2024-12-18T00:58:50.7555979Z  2024-12-18T00:58:50.7556363Z  2024-12-18T00:58:50.7557267Z [18,620 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:50.7558388Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:58:50.7559724Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:58:50.7560685Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:58:50.7561726Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:58:50.7562826Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2024-12-18T00:58:50.7563805Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:58:50.7564802Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:58:50.7565883Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local ... 2024-12-18T00:58:51.1259108Z 2024-12-18T00:58:51.1259953Z  2024-12-18T00:58:51.1260413Z  2024-12-18T00:58:51.1260788Z  2024-12-18T00:58:51.1261151Z  2024-12-18T00:58:51.1261548Z  2024-12-18T00:58:51.1261969Z  2024-12-18T00:58:51.1262330Z  2024-12-18T00:58:51.1262693Z  2024-12-18T00:58:51.1263925Z [18,621 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:51.1265166Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:58:51.1266108Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:58:51.1267043Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:58:51.1268095Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:58:51.1269207Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:51.1270215Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:58:51.1271221Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:58:51.1272231Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local ... 2024-12-18T00:58:51.3555086Z 2024-12-18T00:58:51.3556010Z  2024-12-18T00:58:51.3556521Z  2024-12-18T00:58:51.3556958Z  2024-12-18T00:58:51.3557373Z  2024-12-18T00:58:51.3557802Z  2024-12-18T00:58:51.3558194Z  2024-12-18T00:58:51.3558608Z  2024-12-18T00:58:51.3559003Z  2024-12-18T00:58:51.3559961Z [18,622 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:51.3561162Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:58:51.3562223Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:58:51.3563202Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2024-12-18T00:58:51.3564242Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:58:51.3565315Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:51.3566292Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:58:51.3567205Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2024-12-18T00:58:51.3568571Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local ... 2024-12-18T00:58:51.6963623Z 2024-12-18T00:58:51.6964581Z  2024-12-18T00:58:51.6965011Z  2024-12-18T00:58:51.6965345Z  2024-12-18T00:58:51.6965734Z  2024-12-18T00:58:51.6966114Z  2024-12-18T00:58:51.6966452Z  2024-12-18T00:58:51.6966810Z  2024-12-18T00:58:51.6967158Z  2024-12-18T00:58:51.6968055Z [18,624 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:51.6969166Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:58:51.9560137Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:58:51.9561160Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:51.9562177Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:51.9563182Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:58:51.9564457Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:58:51.9565540Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:58:51.9566612Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local ... 2024-12-18T00:58:51.9567240Z 2024-12-18T00:58:51.9570399Z  2024-12-18T00:58:51.9570861Z  2024-12-18T00:58:51.9571266Z  2024-12-18T00:58:51.9571649Z  2024-12-18T00:58:51.9572063Z  2024-12-18T00:58:51.9572471Z  2024-12-18T00:58:51.9572872Z  2024-12-18T00:58:51.9573283Z  2024-12-18T00:58:51.9574195Z [18,624 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:51.9575393Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:58:51.9576428Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:58:51.9577618Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:51.9578977Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2024-12-18T00:58:51.9580157Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:58:51.9581111Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:58:51.9582167Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2024-12-18T00:58:51.9583246Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local ... 2024-12-18T00:58:52.3135576Z 2024-12-18T00:58:52.3136775Z  2024-12-18T00:58:52.3137229Z  2024-12-18T00:58:52.3137638Z  2024-12-18T00:58:52.3138025Z  2024-12-18T00:58:52.3138393Z  2024-12-18T00:58:52.3138779Z  2024-12-18T00:58:52.3139185Z  2024-12-18T00:58:52.3139581Z  2024-12-18T00:58:52.3140448Z [18,627 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:52.3141582Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:58:52.3142526Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:58:52.3143464Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:52.3144784Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:58:52.3145742Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:58:52.3146684Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2024-12-18T00:58:52.3147652Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:58:52.3148613Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local ... 2024-12-18T00:58:52.5566599Z 2024-12-18T00:58:52.5567506Z  2024-12-18T00:58:52.5567994Z  2024-12-18T00:58:52.5568373Z  2024-12-18T00:58:52.5568762Z  2024-12-18T00:58:52.5569183Z  2024-12-18T00:58:52.5569873Z  2024-12-18T00:58:52.5570253Z  2024-12-18T00:58:52.5570686Z  2024-12-18T00:58:52.5571648Z [18,627 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:52.5572783Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:58:52.5573769Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:58:52.5574739Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2024-12-18T00:58:52.5575716Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:58:52.5576882Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:58:52.5578121Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:58:52.5579178Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:58:52.5580438Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local ... 2024-12-18T00:58:52.7749019Z 2024-12-18T00:58:52.7749822Z  2024-12-18T00:58:52.7750565Z  2024-12-18T00:58:52.7750975Z  2024-12-18T00:58:52.7751360Z  2024-12-18T00:58:52.7751732Z  2024-12-18T00:58:52.7752116Z  2024-12-18T00:58:52.7752502Z  2024-12-18T00:58:52.7752894Z  2024-12-18T00:58:52.7753824Z [18,628 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:52.7754853Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:58:52.7755676Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:58:52.7756512Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:58:52.7757369Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2024-12-18T00:58:52.7758214Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:58:52.7759051Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:58:52.7760138Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:58:52.7761108Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local ... 2024-12-18T00:58:53.1572235Z 2024-12-18T00:58:53.1573126Z  2024-12-18T00:58:53.1573585Z  2024-12-18T00:58:53.1573967Z  2024-12-18T00:58:53.1574352Z  2024-12-18T00:58:53.1574732Z  2024-12-18T00:58:53.1575118Z  2024-12-18T00:58:53.1575514Z  2024-12-18T00:58:53.1575862Z  2024-12-18T00:58:53.1576991Z [18,629 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:53.1578117Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:58:53.1579106Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2024-12-18T00:58:53.1580066Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:58:53.1581058Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:58:53.1582137Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:58:53.1583143Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2024-12-18T00:58:53.1584119Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2024-12-18T00:58:53.1585116Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local ... 2024-12-18T00:58:53.5576319Z 2024-12-18T00:58:53.5577309Z  2024-12-18T00:58:53.5577756Z  2024-12-18T00:58:53.5578154Z  2024-12-18T00:58:53.5578526Z  2024-12-18T00:58:53.5578896Z  2024-12-18T00:58:53.5579382Z  2024-12-18T00:58:53.5579750Z  2024-12-18T00:58:53.5580128Z  2024-12-18T00:58:53.5580966Z [18,630 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:53.5582095Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:58:53.5585172Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2024-12-18T00:58:53.5586149Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2024-12-18T00:58:53.5587116Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:58:53.5588098Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:58:53.5589034Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:58:53.5590040Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:58:53.5591068Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local ... 2024-12-18T00:58:53.8237932Z 2024-12-18T00:58:53.8238845Z  2024-12-18T00:58:53.8239350Z  2024-12-18T00:58:53.8239774Z  2024-12-18T00:58:53.8240200Z  2024-12-18T00:58:53.8240588Z  2024-12-18T00:58:53.8241009Z  2024-12-18T00:58:53.8241408Z  2024-12-18T00:58:53.8241807Z  2024-12-18T00:58:53.8243061Z [18,632 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:53.8244511Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:58:53.8245527Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2024-12-18T00:58:53.8246522Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:58:53.8247564Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2024-12-18T00:58:53.8248647Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:58:53.8249789Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:58:53.8250832Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:58:53.8251840Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local ... 2024-12-18T00:58:54.1240487Z 2024-12-18T00:58:54.1241367Z  2024-12-18T00:58:54.1241819Z  2024-12-18T00:58:54.1242194Z  2024-12-18T00:58:54.1242594Z  2024-12-18T00:58:54.1243007Z  2024-12-18T00:58:54.1243797Z  2024-12-18T00:58:54.1244444Z  2024-12-18T00:58:54.1244858Z  2024-12-18T00:58:54.1245756Z [18,634 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:54.1246925Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:58:54.1247993Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:58:54.1249013Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:58:54.1250089Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:54.1251148Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:58:54.1252238Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:58:54.1253300Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2024-12-18T00:58:54.1254332Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local ... 2024-12-18T00:58:54.3580646Z 2024-12-18T00:58:54.3581492Z  2024-12-18T00:58:54.3581985Z  2024-12-18T00:58:54.3582370Z  2024-12-18T00:58:54.3582757Z  2024-12-18T00:58:54.3583163Z  2024-12-18T00:58:54.3583532Z  2024-12-18T00:58:54.3583919Z  2024-12-18T00:58:54.3584290Z  2024-12-18T00:58:54.3585253Z [18,634 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:54.3586420Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:58:54.3587450Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:58:54.3588367Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2024-12-18T00:58:54.3589469Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:54.3590438Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:58:54.3591737Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2024-12-18T00:58:54.3592725Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:58:54.3593659Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local ... 2024-12-18T00:58:54.6619221Z 2024-12-18T00:58:54.6620149Z  2024-12-18T00:58:54.6620619Z  2024-12-18T00:58:54.6621025Z  2024-12-18T00:58:54.6621444Z  2024-12-18T00:58:54.6621871Z  2024-12-18T00:58:54.6622266Z  2024-12-18T00:58:54.6622670Z  2024-12-18T00:58:54.6623059Z  2024-12-18T00:58:54.6624009Z [18,636 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:54.6625164Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:58:54.6626255Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:58:54.6627246Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:58:54.6628574Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:54.6629650Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:58:54.6630680Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:58:54.6631794Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:58:54.6632876Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local ... 2024-12-18T00:58:54.9585246Z 2024-12-18T00:58:54.9586252Z  2024-12-18T00:58:54.9586716Z  2024-12-18T00:58:54.9587124Z  2024-12-18T00:58:54.9587536Z  2024-12-18T00:58:54.9587941Z  2024-12-18T00:58:54.9588351Z  2024-12-18T00:58:54.9588744Z  2024-12-18T00:58:54.9589137Z  2024-12-18T00:58:54.9590090Z [18,637 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:54.9591574Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:58:54.9592716Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:58:54.9593711Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:58:54.9594721Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2024-12-18T00:58:54.9595748Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:58:54.9596986Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:58:54.9598605Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:58:54.9599675Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local ... 2024-12-18T00:58:55.1588552Z 2024-12-18T00:58:55.1589484Z  2024-12-18T00:58:55.1589958Z  2024-12-18T00:58:55.1590354Z  2024-12-18T00:58:55.1590774Z  2024-12-18T00:58:55.1591165Z  2024-12-18T00:58:55.1591593Z  2024-12-18T00:58:55.1591997Z  2024-12-18T00:58:55.1592416Z  2024-12-18T00:58:55.1593387Z [18,638 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:55.1594549Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:58:55.1595580Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:58:55.1596542Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:58:55.1597510Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:58:55.1598511Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:58:55.1599525Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:58:55.1600571Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2024-12-18T00:58:55.1601549Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local ... 2024-12-18T00:58:55.3931889Z 2024-12-18T00:58:55.3932970Z  2024-12-18T00:58:55.3933435Z  2024-12-18T00:58:55.3933883Z  2024-12-18T00:58:55.3934291Z  2024-12-18T00:58:55.3934684Z  2024-12-18T00:58:55.3935048Z  2024-12-18T00:58:55.3935450Z  2024-12-18T00:58:55.3935849Z  2024-12-18T00:58:55.3936954Z [18,639 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:55.3938084Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:58:55.3939105Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:58:55.3940057Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2024-12-18T00:58:55.3941128Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:58:55.3942165Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:58:55.3943199Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2024-12-18T00:58:55.3944836Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:58:55.3945991Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local ... 2024-12-18T00:58:55.7593317Z 2024-12-18T00:58:55.7594170Z  2024-12-18T00:58:55.7594651Z  2024-12-18T00:58:55.7595071Z  2024-12-18T00:58:55.7595443Z  2024-12-18T00:58:55.7595833Z  2024-12-18T00:58:55.7596221Z  2024-12-18T00:58:55.7596598Z  2024-12-18T00:58:55.7597002Z  2024-12-18T00:58:55.7597923Z [18,640 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:55.7599099Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2024-12-18T00:58:55.7600065Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:58:55.7601083Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:58:55.7602164Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2024-12-18T00:58:55.7603544Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:58:55.7604814Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:58:55.7606421Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:58:55.7607505Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local ... 2024-12-18T00:58:56.0707684Z 2024-12-18T00:58:56.0708552Z  2024-12-18T00:58:56.0708998Z  2024-12-18T00:58:56.0709392Z  2024-12-18T00:58:56.0709798Z  2024-12-18T00:58:56.0710193Z  2024-12-18T00:58:56.0710537Z  2024-12-18T00:58:56.0710932Z  2024-12-18T00:58:56.0711312Z  2024-12-18T00:58:56.0712174Z [18,641 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:56.0713273Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2024-12-18T00:58:56.0714317Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2024-12-18T00:58:56.0715321Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:58:56.0716243Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2024-12-18T00:58:56.0717111Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2024-12-18T00:58:56.0718026Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:58:56.0718989Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2024-12-18T00:58:56.0719973Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local ... 2024-12-18T00:58:56.3598477Z 2024-12-18T00:58:56.3599346Z  2024-12-18T00:58:56.3599829Z  2024-12-18T00:58:56.3600243Z  2024-12-18T00:58:56.3600632Z  2024-12-18T00:58:56.3601035Z  2024-12-18T00:58:56.3601434Z  2024-12-18T00:58:56.3601837Z  2024-12-18T00:58:56.3602230Z  2024-12-18T00:58:56.3603224Z [18,642 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:56.3604692Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2024-12-18T00:58:56.3605764Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2024-12-18T00:58:56.3606773Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2024-12-18T00:58:56.3607817Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2024-12-18T00:58:56.3608843Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2024-12-18T00:58:56.3609903Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2024-12-18T00:58:56.3611000Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:58:56.3612099Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local ... 2024-12-18T00:58:56.9114465Z 2024-12-18T00:58:56.9115371Z  2024-12-18T00:58:56.9115870Z  2024-12-18T00:58:56.9116284Z  2024-12-18T00:58:56.9116721Z  2024-12-18T00:58:56.9117113Z  2024-12-18T00:58:56.9117784Z  2024-12-18T00:58:56.9118199Z  2024-12-18T00:58:56.9118625Z  2024-12-18T00:58:56.9119598Z [18,643 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:56.9120806Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:58:56.9122002Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:58:56.9123008Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:58:56.9124036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2024-12-18T00:58:56.9125073Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2024-12-18T00:58:56.9126034Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:58:56.9127005Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:58:56.9128050Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local ... 2024-12-18T00:58:57.1604998Z 2024-12-18T00:58:57.1605839Z  2024-12-18T00:58:57.1606327Z  2024-12-18T00:58:57.1606734Z  2024-12-18T00:58:57.1607132Z  2024-12-18T00:58:57.1607548Z  2024-12-18T00:58:57.1607938Z  2024-12-18T00:58:57.1608334Z  2024-12-18T00:58:57.1608735Z  2024-12-18T00:58:57.1609744Z [18,643 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:57.1610961Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:58:57.1611958Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:58:57.1612963Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:58:57.1613935Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:58:57.1614977Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:58:57.1616080Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:58:57.1617345Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2024-12-18T00:58:57.1618415Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local ... 2024-12-18T00:58:57.4000245Z 2024-12-18T00:58:57.4001114Z  2024-12-18T00:58:57.4001558Z  2024-12-18T00:58:57.4001964Z  2024-12-18T00:58:57.4002363Z  2024-12-18T00:58:57.4002773Z  2024-12-18T00:58:57.4003166Z  2024-12-18T00:58:57.4003567Z  2024-12-18T00:58:57.4004324Z  2024-12-18T00:58:57.4005292Z [18,644 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:57.4006612Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:58:57.4007793Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:58:57.4008931Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2024-12-18T00:58:57.4010559Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:58:57.4011725Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:58:57.4012894Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2024-12-18T00:58:57.4014105Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:58:57.4015352Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local ... 2024-12-18T00:58:57.7610896Z 2024-12-18T00:58:57.7611821Z  2024-12-18T00:58:57.7612293Z  2024-12-18T00:58:57.7612706Z  2024-12-18T00:58:57.7613124Z  2024-12-18T00:58:57.7613534Z  2024-12-18T00:58:57.7613927Z  2024-12-18T00:58:57.7614334Z  2024-12-18T00:58:57.7614757Z  2024-12-18T00:58:57.7615722Z [18,644 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:57.7617059Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:58:57.7618366Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:58:57.7619322Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:58:57.7620312Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2024-12-18T00:58:57.7621338Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:58:57.7622405Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2024-12-18T00:58:57.7623522Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:58:57.7624625Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local ... 2024-12-18T00:58:58.1614554Z 2024-12-18T00:58:58.1615425Z  2024-12-18T00:58:58.1615924Z  2024-12-18T00:58:58.1616318Z  2024-12-18T00:58:58.1616811Z  2024-12-18T00:58:58.1617155Z  2024-12-18T00:58:58.1617520Z  2024-12-18T00:58:58.1617902Z  2024-12-18T00:58:58.1618261Z  2024-12-18T00:58:58.1619538Z [18,645 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:58.1620591Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:58:58.1621629Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2024-12-18T00:58:58.1622998Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:58:58.1624057Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:58:58.1625018Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:58:58.1626136Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2024-12-18T00:58:58.1627269Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2024-12-18T00:58:58.1628395Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local ... 2024-12-18T00:58:58.3865490Z 2024-12-18T00:58:58.3866445Z  2024-12-18T00:58:58.3867035Z  2024-12-18T00:58:58.3867500Z  2024-12-18T00:58:58.3867929Z  2024-12-18T00:58:58.3868349Z  2024-12-18T00:58:58.3868759Z  2024-12-18T00:58:58.3869177Z  2024-12-18T00:58:58.3869587Z  2024-12-18T00:58:58.3870585Z [18,646 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:58.3871779Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:58:58.3872855Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2024-12-18T00:58:58.3873849Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2024-12-18T00:58:58.3874922Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:58:58.3875988Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:58:58.3877101Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2024-12-18T00:58:58.3878454Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2024-12-18T00:58:58.3879573Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local ... 2024-12-18T00:58:58.7619134Z 2024-12-18T00:58:58.7620008Z  2024-12-18T00:58:58.7620458Z  2024-12-18T00:58:58.7620837Z  2024-12-18T00:58:58.7621218Z  2024-12-18T00:58:58.7621609Z  2024-12-18T00:58:58.7622002Z  2024-12-18T00:58:58.7622373Z  2024-12-18T00:58:58.7622734Z  2024-12-18T00:58:58.7623648Z [18,647 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:58.7624830Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2024-12-18T00:58:58.7625749Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2024-12-18T00:58:58.7626495Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:58:58.7627236Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2024-12-18T00:58:58.7628370Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:58:58.7629280Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2024-12-18T00:58:58.7630127Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2024-12-18T00:58:58.7631390Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local ... 2024-12-18T00:58:59.4610115Z 2024-12-18T00:58:59.4611033Z  2024-12-18T00:58:59.4611527Z  2024-12-18T00:58:59.4611940Z  2024-12-18T00:58:59.4612337Z  2024-12-18T00:58:59.4612739Z  2024-12-18T00:58:59.4613160Z  2024-12-18T00:58:59.4613559Z  2024-12-18T00:58:59.4613929Z  2024-12-18T00:58:59.4614891Z [18,648 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:58:59.4616142Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:58:59.4617350Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2024-12-18T00:58:59.4618774Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2024-12-18T00:58:59.4619921Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:58:59.4620939Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2024-12-18T00:58:59.4621990Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2024-12-18T00:58:59.4623063Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:58:59.4624151Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local ... 2024-12-18T00:58:59.7627789Z 2024-12-18T00:58:59.7628721Z  2024-12-18T00:58:59.7629209Z  2024-12-18T00:58:59.7629619Z  2024-12-18T00:58:59.7629995Z  2024-12-18T00:58:59.7630395Z  2024-12-18T00:58:59.7630788Z  2024-12-18T00:58:59.7631170Z  2024-12-18T00:58:59.7631569Z  2024-12-18T00:58:59.7632529Z [18,648 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:58:59.7633791Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:58:59.7634851Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2024-12-18T00:58:59.7635870Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:58:59.7636886Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:58:59.7637915Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2024-12-18T00:58:59.7638970Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:58:59.7640043Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:58:59.7641139Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local ... 2024-12-18T00:59:00.0047250Z 2024-12-18T00:59:00.0048123Z  2024-12-18T00:59:00.0048606Z  2024-12-18T00:59:00.0048998Z  2024-12-18T00:59:00.0049659Z  2024-12-18T00:59:00.0050069Z  2024-12-18T00:59:00.0050520Z  2024-12-18T00:59:00.0050917Z  2024-12-18T00:59:00.0051315Z  2024-12-18T00:59:00.0052632Z [18,649 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:00.0053906Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:59:00.0055069Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2024-12-18T00:59:00.0056190Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:59:00.0057487Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2024-12-18T00:59:00.0058576Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:59:00.0059720Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2024-12-18T00:59:00.0061002Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2024-12-18T00:59:00.0062169Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 36s local ... 2024-12-18T00:59:00.3632510Z 2024-12-18T00:59:00.3633379Z  2024-12-18T00:59:00.3633861Z  2024-12-18T00:59:00.3634251Z  2024-12-18T00:59:00.3634670Z  2024-12-18T00:59:00.3635079Z  2024-12-18T00:59:00.3635481Z  2024-12-18T00:59:00.3635891Z  2024-12-18T00:59:00.3636278Z  2024-12-18T00:59:00.3637213Z [18,653 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:00.3638340Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:59:00.3639381Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2024-12-18T00:59:00.3640362Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2024-12-18T00:59:00.3641341Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:59:00.3642301Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:59:00.3643334Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:59:00.3644980Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2024-12-18T00:59:00.3646069Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local ... 2024-12-18T00:59:00.6067270Z 2024-12-18T00:59:00.6068172Z  2024-12-18T00:59:00.6068603Z  2024-12-18T00:59:00.6068995Z  2024-12-18T00:59:00.6069379Z  2024-12-18T00:59:00.6069765Z  2024-12-18T00:59:00.6070141Z  2024-12-18T00:59:00.6070503Z  2024-12-18T00:59:00.6070870Z  2024-12-18T00:59:00.6071749Z [18,654 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:00.6072829Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:00.6074123Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2024-12-18T00:59:00.6075016Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:59:00.6076141Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:59:00.6077212Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:59:00.6078215Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:59:00.6079241Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:00.6080317Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local ... 2024-12-18T00:59:00.8452613Z 2024-12-18T00:59:00.8453486Z  2024-12-18T00:59:00.8454106Z  2024-12-18T00:59:00.8454537Z  2024-12-18T00:59:00.8454957Z  2024-12-18T00:59:00.8455340Z  2024-12-18T00:59:00.8455707Z  2024-12-18T00:59:00.8456095Z  2024-12-18T00:59:00.8456620Z  2024-12-18T00:59:00.8457548Z [18,657 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:00.8458668Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:00.8459969Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2024-12-18T00:59:00.8460933Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:59:00.8461785Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2024-12-18T00:59:00.8462793Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:59:00.8463793Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:59:00.8464693Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:00.8465527Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local ... 2024-12-18T00:59:01.0935384Z 2024-12-18T00:59:01.0936257Z  2024-12-18T00:59:01.0936809Z  2024-12-18T00:59:01.0937175Z  2024-12-18T00:59:01.0937524Z  2024-12-18T00:59:01.0937862Z  2024-12-18T00:59:01.0938217Z  2024-12-18T00:59:01.0938574Z  2024-12-18T00:59:01.0938954Z  2024-12-18T00:59:01.0940184Z [18,658 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:01.0941217Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:01.0942135Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 83s local 2024-12-18T00:59:01.0942954Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:59:01.0943798Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:59:01.0944907Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:59:01.0945772Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2024-12-18T00:59:01.0946595Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:01.0947458Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local ... 2024-12-18T00:59:01.3640552Z 2024-12-18T00:59:01.3641321Z  2024-12-18T00:59:01.3641724Z  2024-12-18T00:59:01.3642104Z  2024-12-18T00:59:01.3642460Z  2024-12-18T00:59:01.3643167Z  2024-12-18T00:59:01.3643544Z  2024-12-18T00:59:01.3643868Z  2024-12-18T00:59:01.3644816Z  2024-12-18T00:59:01.3645703Z [18,660 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:01.3646670Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:01.3647527Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 83s local 2024-12-18T00:59:01.3648298Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2024-12-18T00:59:01.3649126Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2024-12-18T00:59:01.3649980Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:59:01.3650836Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2024-12-18T00:59:01.3651672Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:01.3652561Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local ... 2024-12-18T00:59:02.4245782Z 2024-12-18T00:59:02.4246800Z  2024-12-18T00:59:02.4247239Z  2024-12-18T00:59:02.4247606Z  2024-12-18T00:59:02.4247939Z  2024-12-18T00:59:02.4248294Z  2024-12-18T00:59:02.4248650Z  2024-12-18T00:59:02.4249001Z  2024-12-18T00:59:02.4249354Z  2024-12-18T00:59:02.4250218Z [18,661 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:02.4251322Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:59:02.4252173Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2024-12-18T00:59:02.4252999Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:59:02.4253817Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2024-12-18T00:59:02.4254580Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:59:02.4255679Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2024-12-18T00:59:02.4256643Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:59:02.4257497Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local ... 2024-12-18T00:59:02.7661939Z 2024-12-18T00:59:02.7662792Z  2024-12-18T00:59:02.7663180Z  2024-12-18T00:59:02.7663517Z  2024-12-18T00:59:02.7663838Z  2024-12-18T00:59:02.7664176Z  2024-12-18T00:59:02.7664490Z  2024-12-18T00:59:02.7664822Z  2024-12-18T00:59:02.7665153Z  2024-12-18T00:59:02.7665938Z [18,661 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:02.7666946Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:59:02.7667881Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2024-12-18T00:59:02.7669285Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:59:02.7670648Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2024-12-18T00:59:02.7671701Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:59:02.7672742Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:59:02.7673798Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2024-12-18T00:59:02.7674898Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local ... 2024-12-18T00:59:03.0497382Z 2024-12-18T00:59:03.0498255Z  2024-12-18T00:59:03.0498705Z  2024-12-18T00:59:03.0499151Z  2024-12-18T00:59:03.0499566Z  2024-12-18T00:59:03.0499979Z  2024-12-18T00:59:03.0500392Z  2024-12-18T00:59:03.0500768Z  2024-12-18T00:59:03.0501165Z  2024-12-18T00:59:03.0502135Z [18,662 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:03.0503403Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:59:03.0504826Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2024-12-18T00:59:03.0505905Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2024-12-18T00:59:03.0506960Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2024-12-18T00:59:03.0507965Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2024-12-18T00:59:03.0508986Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:59:03.0509931Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:59:03.0510900Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local ... 2024-12-18T00:59:03.3654566Z 2024-12-18T00:59:03.3655465Z  2024-12-18T00:59:03.3655921Z  2024-12-18T00:59:03.3656336Z  2024-12-18T00:59:03.3656896Z  2024-12-18T00:59:03.3657282Z  2024-12-18T00:59:03.3657678Z  2024-12-18T00:59:03.3658101Z  2024-12-18T00:59:03.3658502Z  2024-12-18T00:59:03.3659478Z [18,663 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:03.3660626Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:59:03.3661687Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2024-12-18T00:59:03.3662728Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2024-12-18T00:59:03.3663665Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2024-12-18T00:59:03.3664645Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2024-12-18T00:59:03.3665755Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:59:03.3666631Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2024-12-18T00:59:03.3667568Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local ... 2024-12-18T00:59:04.2188004Z 2024-12-18T00:59:04.2189004Z  2024-12-18T00:59:04.2189408Z  2024-12-18T00:59:04.2189899Z  2024-12-18T00:59:04.2190235Z  2024-12-18T00:59:04.2190584Z  2024-12-18T00:59:04.2190923Z  2024-12-18T00:59:04.2191277Z  2024-12-18T00:59:04.2200036Z  2024-12-18T00:59:04.2201267Z [18,664 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:04.2202282Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2024-12-18T00:59:04.2203182Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2024-12-18T00:59:04.2204071Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:59:04.2204985Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:59:04.2205950Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2024-12-18T00:59:04.2206950Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:59:04.2207846Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2024-12-18T00:59:04.2208999Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local ... 2024-12-18T00:59:04.5663448Z 2024-12-18T00:59:04.5664271Z  2024-12-18T00:59:04.5664751Z  2024-12-18T00:59:04.5665138Z  2024-12-18T00:59:04.5665541Z  2024-12-18T00:59:04.5665953Z  2024-12-18T00:59:04.5666387Z  2024-12-18T00:59:04.5666793Z  2024-12-18T00:59:04.5667171Z  2024-12-18T00:59:04.5668230Z [18,665 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:04.5669365Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:59:04.5670422Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2024-12-18T00:59:04.5671421Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:59:04.5672324Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:59:04.5673512Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:59:04.5674581Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:59:04.5675500Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2024-12-18T00:59:04.5676554Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local ... 2024-12-18T00:59:04.9447476Z 2024-12-18T00:59:04.9448371Z  2024-12-18T00:59:04.9448872Z  2024-12-18T00:59:04.9449279Z  2024-12-18T00:59:04.9449665Z  2024-12-18T00:59:04.9450164Z  2024-12-18T00:59:04.9450562Z  2024-12-18T00:59:04.9450975Z  2024-12-18T00:59:04.9451375Z  2024-12-18T00:59:04.9452319Z [18,667 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:04.9453475Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:59:04.9454476Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2024-12-18T00:59:04.9455497Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2024-12-18T00:59:04.9456666Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:59:04.9457635Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:59:04.9458663Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:59:04.9459655Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:59:04.9460777Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local ... 2024-12-18T00:59:05.1669481Z 2024-12-18T00:59:05.1670328Z  2024-12-18T00:59:05.1670791Z  2024-12-18T00:59:05.1671145Z  2024-12-18T00:59:05.1671513Z  2024-12-18T00:59:05.1671856Z  2024-12-18T00:59:05.1672226Z  2024-12-18T00:59:05.1672632Z  2024-12-18T00:59:05.1672981Z  2024-12-18T00:59:05.1673848Z [18,667 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:05.1675229Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:59:05.1676190Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2024-12-18T00:59:05.1677097Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:59:05.1677952Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:59:05.1678831Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2024-12-18T00:59:05.1679733Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:59:05.1680632Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:59:05.1681788Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local ... 2024-12-18T00:59:05.3672353Z 2024-12-18T00:59:05.3673250Z  2024-12-18T00:59:05.3673707Z  2024-12-18T00:59:05.3674104Z  2024-12-18T00:59:05.3674504Z  2024-12-18T00:59:05.3674944Z  2024-12-18T00:59:05.3675340Z  2024-12-18T00:59:05.3675989Z  2024-12-18T00:59:05.3676372Z  2024-12-18T00:59:05.3677347Z [18,668 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:05.3678524Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:59:05.3679582Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2024-12-18T00:59:05.3680613Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:59:05.3681532Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:59:05.3682447Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:59:05.3683449Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:59:05.3684428Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:59:05.3685497Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local ... 2024-12-18T00:59:05.6232202Z 2024-12-18T00:59:05.6233407Z  2024-12-18T00:59:05.6233898Z  2024-12-18T00:59:05.6234308Z  2024-12-18T00:59:05.6234711Z  2024-12-18T00:59:05.6235121Z  2024-12-18T00:59:05.6235517Z  2024-12-18T00:59:05.6235918Z  2024-12-18T00:59:05.6236323Z  2024-12-18T00:59:05.6237283Z [18,671 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:05.6238452Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:59:05.6239480Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:59:05.6240539Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:59:05.6241637Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:59:05.6242542Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:59:05.6243531Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2024-12-18T00:59:05.6244836Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2024-12-18T00:59:05.6245923Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local ... 2024-12-18T00:59:05.9454813Z 2024-12-18T00:59:05.9455656Z  2024-12-18T00:59:05.9456121Z  2024-12-18T00:59:05.9456655Z  2024-12-18T00:59:05.9457053Z  2024-12-18T00:59:05.9457453Z  2024-12-18T00:59:05.9457858Z  2024-12-18T00:59:05.9458270Z  2024-12-18T00:59:05.9458670Z  2024-12-18T00:59:05.9459621Z [18,675 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:05.9460772Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:59:05.9461799Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:59:05.9462809Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2024-12-18T00:59:05.9464117Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:59:05.9465093Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:59:05.9466067Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2024-12-18T00:59:05.9467017Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:59:05.9468099Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local ... 2024-12-18T00:59:06.1679076Z 2024-12-18T00:59:06.1679981Z  2024-12-18T00:59:06.1680463Z  2024-12-18T00:59:06.1680850Z  2024-12-18T00:59:06.1681219Z  2024-12-18T00:59:06.1681613Z  2024-12-18T00:59:06.1682022Z  2024-12-18T00:59:06.1682427Z  2024-12-18T00:59:06.1682829Z  2024-12-18T00:59:06.1683828Z [18,675 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:06.1685028Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:59:06.1686406Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:59:06.1687432Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:59:06.1688456Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:59:06.1689447Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2024-12-18T00:59:06.1690501Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2024-12-18T00:59:06.1691524Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:59:06.1692578Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local ... 2024-12-18T00:59:06.3682125Z 2024-12-18T00:59:06.3682959Z  2024-12-18T00:59:06.3683367Z  2024-12-18T00:59:06.3683729Z  2024-12-18T00:59:06.3684096Z  2024-12-18T00:59:06.3684454Z  2024-12-18T00:59:06.3684836Z  2024-12-18T00:59:06.3685176Z  2024-12-18T00:59:06.3685556Z  2024-12-18T00:59:06.3686745Z [18,676 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:06.3688063Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:59:06.3688952Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2024-12-18T00:59:06.3689830Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:59:06.3690788Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:59:06.3691488Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:59:06.3692252Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2024-12-18T00:59:06.3693031Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:59:06.3693907Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local ... 2024-12-18T00:59:06.7096336Z 2024-12-18T00:59:06.7097347Z  2024-12-18T00:59:06.7097801Z  2024-12-18T00:59:06.7098241Z  2024-12-18T00:59:06.7098629Z  2024-12-18T00:59:06.7099021Z  2024-12-18T00:59:06.7099403Z  2024-12-18T00:59:06.7099798Z  2024-12-18T00:59:06.7100198Z  2024-12-18T00:59:06.7101144Z [18,677 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:06.7102286Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2024-12-18T00:59:06.7103291Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:59:06.7104321Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:59:06.7105316Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:59:06.7106246Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:59:06.7107283Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:59:06.7108288Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2024-12-18T00:59:06.7109618Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local ... 2024-12-18T00:59:06.9687787Z 2024-12-18T00:59:06.9688585Z  2024-12-18T00:59:06.9688989Z  2024-12-18T00:59:06.9689474Z  2024-12-18T00:59:06.9689825Z  2024-12-18T00:59:06.9690180Z  2024-12-18T00:59:06.9690556Z  2024-12-18T00:59:06.9690926Z  2024-12-18T00:59:06.9691295Z  2024-12-18T00:59:06.9692195Z [18,677 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:06.9693280Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2024-12-18T00:59:06.9694268Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:59:06.9695253Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2024-12-18T00:59:06.9696237Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:06.9697238Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:59:06.9700307Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:59:06.9701442Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:59:06.9702374Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local ... 2024-12-18T00:59:07.1690580Z 2024-12-18T00:59:07.1691451Z  2024-12-18T00:59:07.1691910Z  2024-12-18T00:59:07.1692293Z  2024-12-18T00:59:07.1692674Z  2024-12-18T00:59:07.1693029Z  2024-12-18T00:59:07.1693406Z  2024-12-18T00:59:07.1693790Z  2024-12-18T00:59:07.1694168Z  2024-12-18T00:59:07.1695080Z [18,678 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:07.1696236Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2024-12-18T00:59:07.1697443Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:59:07.1698425Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:59:07.1699708Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:07.1700733Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2024-12-18T00:59:07.1701697Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:59:07.1702627Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:59:07.1703611Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local ... 2024-12-18T00:59:07.4005832Z 2024-12-18T00:59:07.4006720Z  2024-12-18T00:59:07.4007247Z  2024-12-18T00:59:07.4007633Z  2024-12-18T00:59:07.4008023Z  2024-12-18T00:59:07.4008433Z  2024-12-18T00:59:07.4008847Z  2024-12-18T00:59:07.4009276Z  2024-12-18T00:59:07.4009635Z  2024-12-18T00:59:07.4010603Z [18,679 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:07.4011746Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2024-12-18T00:59:07.4012786Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2024-12-18T00:59:07.4013780Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:59:07.4014783Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:07.4015745Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:59:07.4016867Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T00:59:07.4017835Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:59:07.4018854Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local ... 2024-12-18T00:59:07.7696111Z 2024-12-18T00:59:07.7697150Z  2024-12-18T00:59:07.7697631Z  2024-12-18T00:59:07.7697988Z  2024-12-18T00:59:07.7698385Z  2024-12-18T00:59:07.7698773Z  2024-12-18T00:59:07.7699177Z  2024-12-18T00:59:07.7699874Z  2024-12-18T00:59:07.7700256Z  2024-12-18T00:59:07.7701247Z [18,679 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:07.7702431Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2024-12-18T00:59:07.7703453Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2024-12-18T00:59:07.7704483Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:59:07.7705486Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:07.7706453Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:59:07.7707472Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T00:59:07.7708452Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2024-12-18T00:59:07.7709552Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local ... 2024-12-18T00:59:08.0258577Z 2024-12-18T00:59:08.0259459Z  2024-12-18T00:59:08.0259901Z  2024-12-18T00:59:08.0260286Z  2024-12-18T00:59:08.0260967Z  2024-12-18T00:59:08.0261338Z  2024-12-18T00:59:08.0261709Z  2024-12-18T00:59:08.0262095Z  2024-12-18T00:59:08.0262479Z  2024-12-18T00:59:08.0264995Z [18,680 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:08.0266087Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2024-12-18T00:59:08.0267066Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2024-12-18T00:59:08.0268036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2024-12-18T00:59:08.0268988Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:59:08.0269907Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2024-12-18T00:59:08.0270903Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T00:59:08.0271851Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:59:08.0273267Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local ... 2024-12-18T00:59:08.3700449Z 2024-12-18T00:59:08.3701256Z  2024-12-18T00:59:08.3701742Z  2024-12-18T00:59:08.3702150Z  2024-12-18T00:59:08.3702546Z  2024-12-18T00:59:08.3702941Z  2024-12-18T00:59:08.3703343Z  2024-12-18T00:59:08.3703723Z  2024-12-18T00:59:08.3704091Z  2024-12-18T00:59:08.3705014Z [18,681 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:08.3706196Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2024-12-18T00:59:08.3707253Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2024-12-18T00:59:08.3708314Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:59:08.3709263Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:59:08.3710240Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:59:08.3711271Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T00:59:08.3712286Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:59:08.3713365Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local ... 2024-12-18T00:59:08.7034830Z 2024-12-18T00:59:08.7035699Z  2024-12-18T00:59:08.7036166Z  2024-12-18T00:59:08.7036566Z  2024-12-18T00:59:08.7036966Z  2024-12-18T00:59:08.7037365Z  2024-12-18T00:59:08.7037749Z  2024-12-18T00:59:08.7038116Z  2024-12-18T00:59:08.7038507Z  2024-12-18T00:59:08.7039422Z [18,684 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:08.7040513Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:59:08.7041577Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:59:08.7042806Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:59:08.7043759Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:59:08.7045038Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T00:59:08.7045943Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2024-12-18T00:59:08.7046886Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T00:59:08.7047826Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local ... 2024-12-18T00:59:08.9706101Z 2024-12-18T00:59:08.9706939Z  2024-12-18T00:59:08.9707322Z  2024-12-18T00:59:08.9707667Z  2024-12-18T00:59:08.9708013Z  2024-12-18T00:59:08.9708364Z  2024-12-18T00:59:08.9708678Z  2024-12-18T00:59:08.9709006Z  2024-12-18T00:59:08.9709338Z  2024-12-18T00:59:08.9710130Z [18,684 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:08.9711447Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:59:08.9712365Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2024-12-18T00:59:08.9713292Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:59:08.9714296Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:59:08.9715183Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T00:59:08.9716070Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:59:08.9717020Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:59:08.9717916Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local ... 2024-12-18T00:59:09.1708588Z 2024-12-18T00:59:09.1709468Z  2024-12-18T00:59:09.1709916Z  2024-12-18T00:59:09.1710317Z  2024-12-18T00:59:09.1710687Z  2024-12-18T00:59:09.1711063Z  2024-12-18T00:59:09.1711446Z  2024-12-18T00:59:09.1711814Z  2024-12-18T00:59:09.1712208Z  2024-12-18T00:59:09.1713455Z [18,685 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:09.1714969Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:59:09.1716124Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:59:09.1717158Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:59:09.1718274Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2024-12-18T00:59:09.1719316Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T00:59:09.1720400Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:59:09.1721520Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:59:09.1722764Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local ... 2024-12-18T00:59:09.4111026Z 2024-12-18T00:59:09.4111954Z  2024-12-18T00:59:09.4112430Z  2024-12-18T00:59:09.4112844Z  2024-12-18T00:59:09.4113287Z  2024-12-18T00:59:09.4113718Z  2024-12-18T00:59:09.4114137Z  2024-12-18T00:59:09.4114541Z  2024-12-18T00:59:09.4114959Z  2024-12-18T00:59:09.4115923Z [18,686 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:09.4117088Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2024-12-18T00:59:09.4118170Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:59:09.4119353Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:59:09.4120389Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:59:09.4121467Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T00:59:09.4122536Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:59:09.4123890Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:59:09.4124963Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local ... 2024-12-18T00:59:09.6837282Z 2024-12-18T00:59:09.6838136Z  2024-12-18T00:59:09.6838632Z  2024-12-18T00:59:09.6839053Z  2024-12-18T00:59:09.6839453Z  2024-12-18T00:59:09.6839866Z  2024-12-18T00:59:09.6840277Z  2024-12-18T00:59:09.6840676Z  2024-12-18T00:59:09.6841087Z  2024-12-18T00:59:09.6842039Z [18,689 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:09.6843198Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:59:09.6844596Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:59:09.6845456Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:59:09.6846287Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:59:09.6847137Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T00:59:09.6848215Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2024-12-18T00:59:09.6849097Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T00:59:09.6850042Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local ... 2024-12-18T00:59:09.9717998Z 2024-12-18T00:59:09.9718849Z  2024-12-18T00:59:09.9719354Z  2024-12-18T00:59:09.9719761Z  2024-12-18T00:59:09.9720309Z  2024-12-18T00:59:09.9720692Z  2024-12-18T00:59:09.9721094Z  2024-12-18T00:59:09.9721508Z  2024-12-18T00:59:09.9721883Z  2024-12-18T00:59:09.9722867Z [18,689 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:09.9724005Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:59:09.9725025Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2024-12-18T00:59:09.9726310Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:59:09.9727314Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:59:09.9728284Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T00:59:09.9729227Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:59:09.9730354Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2024-12-18T00:59:09.9731341Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local ... 2024-12-18T00:59:10.1721278Z 2024-12-18T00:59:10.1722208Z  2024-12-18T00:59:10.1722711Z  2024-12-18T00:59:10.1723118Z  2024-12-18T00:59:10.1723493Z  2024-12-18T00:59:10.1723868Z  2024-12-18T00:59:10.1724539Z  2024-12-18T00:59:10.1724931Z  2024-12-18T00:59:10.1725317Z  2024-12-18T00:59:10.1726240Z [18,690 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:10.1727326Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:59:10.1728333Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:59:10.1729294Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:59:10.1730250Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2024-12-18T00:59:10.1731270Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T00:59:10.1732287Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:59:10.1733259Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2024-12-18T00:59:10.1734230Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local ... 2024-12-18T00:59:10.5726514Z 2024-12-18T00:59:10.5727380Z  2024-12-18T00:59:10.5727875Z  2024-12-18T00:59:10.5728405Z  2024-12-18T00:59:10.5728821Z  2024-12-18T00:59:10.5729213Z  2024-12-18T00:59:10.5729621Z  2024-12-18T00:59:10.5730316Z  2024-12-18T00:59:10.5730699Z  2024-12-18T00:59:10.5731754Z [18,691 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:10.5732852Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2024-12-18T00:59:10.5733824Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:59:10.5734912Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:59:10.5735843Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:59:10.5736986Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2024-12-18T00:59:10.5737912Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2024-12-18T00:59:10.5738899Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2024-12-18T00:59:10.5739855Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local ... 2024-12-18T00:59:10.9730205Z 2024-12-18T00:59:10.9731151Z  2024-12-18T00:59:10.9731646Z  2024-12-18T00:59:10.9732322Z  2024-12-18T00:59:10.9732755Z  2024-12-18T00:59:10.9733171Z  2024-12-18T00:59:10.9733591Z  2024-12-18T00:59:10.9734009Z  2024-12-18T00:59:10.9734412Z  2024-12-18T00:59:10.9735384Z [18,692 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:10.9736690Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2024-12-18T00:59:10.9737738Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2024-12-18T00:59:10.9738776Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2024-12-18T00:59:10.9739738Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2024-12-18T00:59:10.9740887Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2024-12-18T00:59:10.9741923Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2024-12-18T00:59:10.9742998Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T00:59:10.9744706Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local ... 2024-12-18T00:59:11.9530338Z 2024-12-18T00:59:11.9531250Z  2024-12-18T00:59:11.9531697Z  2024-12-18T00:59:11.9532066Z  2024-12-18T00:59:11.9532473Z  2024-12-18T00:59:11.9532873Z  2024-12-18T00:59:11.9533265Z  2024-12-18T00:59:11.9533577Z  2024-12-18T00:59:11.9533956Z  2024-12-18T00:59:11.9534820Z [18,693 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:11.9535925Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2024-12-18T00:59:11.9537096Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2024-12-18T00:59:11.9538066Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:59:11.9539047Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2024-12-18T00:59:11.9540008Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T00:59:11.9540952Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:59:11.9542019Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:59:11.9542886Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local ... 2024-12-18T00:59:12.1739720Z 2024-12-18T00:59:12.1740655Z  2024-12-18T00:59:12.1741240Z  2024-12-18T00:59:12.1741657Z  2024-12-18T00:59:12.1742029Z  2024-12-18T00:59:12.1742392Z  2024-12-18T00:59:12.1742755Z  2024-12-18T00:59:12.1743117Z  2024-12-18T00:59:12.1743480Z  2024-12-18T00:59:12.1744650Z [18,693 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:12.1745689Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2024-12-18T00:59:12.1746588Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:59:12.1747994Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:59:12.1748913Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2024-12-18T00:59:12.1749833Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T00:59:12.1750739Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:59:12.1751706Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:59:12.1752510Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local ... 2024-12-18T00:59:12.3742446Z 2024-12-18T00:59:12.3743238Z  2024-12-18T00:59:12.3743647Z  2024-12-18T00:59:12.3743975Z  2024-12-18T00:59:12.3744524Z  2024-12-18T00:59:12.3744878Z  2024-12-18T00:59:12.3745226Z  2024-12-18T00:59:12.3745577Z  2024-12-18T00:59:12.3745927Z  2024-12-18T00:59:12.3746795Z [18,694 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:12.3748063Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2024-12-18T00:59:12.3749000Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:59:12.3749885Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:59:12.3750699Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:59:12.3751588Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T00:59:12.3752488Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:59:12.3753419Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:59:12.3754311Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local ... 2024-12-18T00:59:12.6104063Z 2024-12-18T00:59:12.6104903Z  2024-12-18T00:59:12.6105353Z  2024-12-18T00:59:12.6105726Z  2024-12-18T00:59:12.6106080Z  2024-12-18T00:59:12.6106441Z  2024-12-18T00:59:12.6106804Z  2024-12-18T00:59:12.6107197Z  2024-12-18T00:59:12.6107573Z  2024-12-18T00:59:12.6108777Z [18,695 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:12.6109800Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:59:12.6110684Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:59:12.6111617Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:59:12.6112512Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:59:12.6113455Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T00:59:12.6114360Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2024-12-18T00:59:12.6115273Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T00:59:12.6116149Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local ... 2024-12-18T00:59:12.9575398Z 2024-12-18T00:59:12.9576359Z  2024-12-18T00:59:12.9576965Z  2024-12-18T00:59:12.9577374Z  2024-12-18T00:59:12.9577794Z  2024-12-18T00:59:12.9578186Z  2024-12-18T00:59:12.9578525Z  2024-12-18T00:59:12.9578875Z  2024-12-18T00:59:12.9579224Z  2024-12-18T00:59:12.9580088Z [18,697 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:12.9581068Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:59:12.9582005Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2024-12-18T00:59:12.9582926Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:59:12.9583780Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:59:12.9584715Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T00:59:12.9585615Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:59:12.9586587Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T00:59:12.9587793Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local ... 2024-12-18T00:59:13.1748912Z 2024-12-18T00:59:13.1749759Z  2024-12-18T00:59:13.1750221Z  2024-12-18T00:59:13.1750625Z  2024-12-18T00:59:13.1751031Z  2024-12-18T00:59:13.1751422Z  2024-12-18T00:59:13.1751824Z  2024-12-18T00:59:13.1752229Z  2024-12-18T00:59:13.1752630Z  2024-12-18T00:59:13.1753723Z [18,697 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:13.1754788Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2024-12-18T00:59:13.1755786Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:59:13.1756758Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:59:13.1757686Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2024-12-18T00:59:13.1758713Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T00:59:13.1759948Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2024-12-18T00:59:13.1760945Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T00:59:13.1761892Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local ... 2024-12-18T00:59:14.0028860Z 2024-12-18T00:59:14.0029754Z  2024-12-18T00:59:14.0030200Z  2024-12-18T00:59:14.0030565Z  2024-12-18T00:59:14.0030918Z  2024-12-18T00:59:14.0031298Z  2024-12-18T00:59:14.0031662Z  2024-12-18T00:59:14.0032028Z  2024-12-18T00:59:14.0032392Z  2024-12-18T00:59:14.0033245Z [18,698 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:14.0034286Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:59:14.0035197Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2024-12-18T00:59:14.0036144Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:59:14.0037357Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2024-12-18T00:59:14.0038253Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T00:59:14.0039201Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2024-12-18T00:59:14.0040152Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T00:59:14.0041137Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local ... 2024-12-18T00:59:14.3755763Z 2024-12-18T00:59:14.3756668Z  2024-12-18T00:59:14.3757133Z  2024-12-18T00:59:14.3757514Z  2024-12-18T00:59:14.3757917Z  2024-12-18T00:59:14.3758323Z  2024-12-18T00:59:14.3758702Z  2024-12-18T00:59:14.3759090Z  2024-12-18T00:59:14.3759470Z  2024-12-18T00:59:14.3760410Z [18,698 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:14.3761542Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2024-12-18T00:59:14.3762574Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2024-12-18T00:59:14.3763470Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:59:14.3764325Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2024-12-18T00:59:14.3765230Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T00:59:14.3766167Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2024-12-18T00:59:14.3767147Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T00:59:14.3768100Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local ... 2024-12-18T00:59:15.3761445Z 2024-12-18T00:59:15.3762840Z  2024-12-18T00:59:15.3763433Z  2024-12-18T00:59:15.3764033Z  2024-12-18T00:59:15.3765232Z  2024-12-18T00:59:15.3765707Z  2024-12-18T00:59:15.3766134Z  2024-12-18T00:59:15.3766833Z  2024-12-18T00:59:15.3767238Z  2024-12-18T00:59:15.3768266Z [18,698 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:15.3769448Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2024-12-18T00:59:15.3770558Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:59:15.3771656Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2024-12-18T00:59:15.3772717Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:59:15.3773723Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2024-12-18T00:59:15.3774734Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:59:15.3775817Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T00:59:15.3776883Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local ... 2024-12-18T00:59:15.5771697Z 2024-12-18T00:59:15.5772919Z  2024-12-18T00:59:15.5773668Z  2024-12-18T00:59:15.5774337Z  2024-12-18T00:59:15.5777407Z  2024-12-18T00:59:15.5778633Z  2024-12-18T00:59:15.5867604Z  2024-12-18T00:59:15.5868102Z  2024-12-18T00:59:15.5868489Z  2024-12-18T00:59:15.5869449Z [18,700 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:15.5870526Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:59:15.5871560Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:59:15.5872552Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2024-12-18T00:59:15.5873513Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:59:15.5874454Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T00:59:15.5875430Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:59:15.5876414Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T00:59:15.5877639Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local ... 2024-12-18T00:59:15.7947504Z 2024-12-18T00:59:15.7948371Z  2024-12-18T00:59:15.7948847Z  2024-12-18T00:59:15.7949254Z  2024-12-18T00:59:15.7949656Z  2024-12-18T00:59:15.7950069Z  2024-12-18T00:59:15.7950469Z  2024-12-18T00:59:15.7950854Z  2024-12-18T00:59:15.7951193Z  2024-12-18T00:59:15.7952137Z [18,703 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:15.7953276Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:59:15.7954333Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:59:15.7955345Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2024-12-18T00:59:15.7956254Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:59:15.7957155Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T00:59:15.7958079Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2024-12-18T00:59:15.7958915Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:59:15.7959715Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local ... 2024-12-18T00:59:16.0672931Z 2024-12-18T00:59:16.0673817Z  2024-12-18T00:59:16.0674454Z  2024-12-18T00:59:16.0674859Z  2024-12-18T00:59:16.0675277Z  2024-12-18T00:59:16.0675684Z  2024-12-18T00:59:16.0676090Z  2024-12-18T00:59:16.0676475Z  2024-12-18T00:59:16.0676870Z  2024-12-18T00:59:16.0677799Z [18,705 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:16.0678907Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:59:16.0679934Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2024-12-18T00:59:16.0681251Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:59:16.0682119Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2024-12-18T00:59:16.0683196Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T00:59:16.0684294Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:59:16.0685456Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:59:16.0686382Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local ... 2024-12-18T00:59:16.3773389Z 2024-12-18T00:59:16.3774314Z  2024-12-18T00:59:16.3774844Z  2024-12-18T00:59:16.3775316Z  2024-12-18T00:59:16.3775696Z  2024-12-18T00:59:16.3776076Z  2024-12-18T00:59:16.3776443Z  2024-12-18T00:59:16.3777084Z  2024-12-18T00:59:16.3777451Z  2024-12-18T00:59:16.3778434Z [18,706 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:16.3779592Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2024-12-18T00:59:16.3780948Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:59:16.3781983Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:59:16.3782949Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2024-12-18T00:59:16.3784087Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T00:59:16.3785023Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:59:16.3786023Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:59:16.3786915Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local ... 2024-12-18T00:59:16.7776437Z 2024-12-18T00:59:16.7777282Z  2024-12-18T00:59:16.7777710Z  2024-12-18T00:59:16.7778061Z  2024-12-18T00:59:16.7778427Z  2024-12-18T00:59:16.7778777Z  2024-12-18T00:59:16.7779148Z  2024-12-18T00:59:16.7779536Z  2024-12-18T00:59:16.7779877Z  2024-12-18T00:59:16.7780988Z [18,707 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:16.7782051Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2024-12-18T00:59:16.7782941Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2024-12-18T00:59:16.7783924Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:59:16.7784723Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2024-12-18T00:59:16.7785572Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2024-12-18T00:59:16.7786421Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2024-12-18T00:59:16.7787287Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T00:59:16.7788111Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local ... 2024-12-18T00:59:17.5464729Z 2024-12-18T00:59:17.5465590Z  2024-12-18T00:59:17.5466065Z  2024-12-18T00:59:17.5466430Z  2024-12-18T00:59:17.5466820Z  2024-12-18T00:59:17.5467184Z  2024-12-18T00:59:17.5467540Z  2024-12-18T00:59:17.5467891Z  2024-12-18T00:59:17.5468267Z  2024-12-18T00:59:17.5469168Z [18,708 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:17.5470385Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2024-12-18T00:59:17.5471341Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:59:17.5472282Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:59:17.5473134Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:59:17.5474104Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:59:17.5475042Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2024-12-18T00:59:17.5476003Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T00:59:17.5477267Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local ... 2024-12-18T00:59:17.7781394Z 2024-12-18T00:59:17.7782253Z  2024-12-18T00:59:17.7782749Z  2024-12-18T00:59:17.7783135Z  2024-12-18T00:59:17.7783515Z  2024-12-18T00:59:17.7783883Z  2024-12-18T00:59:17.7784261Z  2024-12-18T00:59:17.7784660Z  2024-12-18T00:59:17.7785048Z  2024-12-18T00:59:17.7785987Z [18,708 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:17.7787069Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2024-12-18T00:59:17.7788040Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2024-12-18T00:59:17.7789090Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:59:17.7790056Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:59:17.7791073Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:59:17.7792394Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2024-12-18T00:59:17.7793437Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T00:59:17.7794395Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local ... 2024-12-18T00:59:18.0807381Z 2024-12-18T00:59:18.0808259Z  2024-12-18T00:59:18.0808757Z  2024-12-18T00:59:18.0809148Z  2024-12-18T00:59:18.0809526Z  2024-12-18T00:59:18.0809893Z  2024-12-18T00:59:18.0810280Z  2024-12-18T00:59:18.0810624Z  2024-12-18T00:59:18.0810923Z  2024-12-18T00:59:18.0811790Z [18,709 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:18.0812876Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2024-12-18T00:59:18.0813909Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:59:18.0815131Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:59:18.0816681Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2024-12-18T00:59:18.0817735Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:59:18.0818745Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2024-12-18T00:59:18.0819631Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T00:59:18.0820616Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local ... 2024-12-18T00:59:18.3785706Z 2024-12-18T00:59:18.3786592Z  2024-12-18T00:59:18.3787043Z  2024-12-18T00:59:18.3787436Z  2024-12-18T00:59:18.3787825Z  2024-12-18T00:59:18.3788211Z  2024-12-18T00:59:18.3788592Z  2024-12-18T00:59:18.3788998Z  2024-12-18T00:59:18.3789387Z  2024-12-18T00:59:18.3790326Z [18,709 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:18.3791452Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2024-12-18T00:59:18.3792454Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:59:18.3793571Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:59:18.3794479Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:59:18.3795408Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T00:59:18.3796388Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2024-12-18T00:59:18.3797387Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T00:59:18.3798335Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local ... 2024-12-18T00:59:18.6887159Z 2024-12-18T00:59:18.6888391Z  2024-12-18T00:59:18.6888861Z  2024-12-18T00:59:18.6889262Z  2024-12-18T00:59:18.6889668Z  2024-12-18T00:59:18.6890052Z  2024-12-18T00:59:18.6890436Z  2024-12-18T00:59:18.6890786Z  2024-12-18T00:59:18.6891443Z  2024-12-18T00:59:18.6892431Z [18,710 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:18.6893620Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:59:18.6894654Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:59:18.6895626Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:59:18.6896764Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2024-12-18T00:59:18.6897724Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2024-12-18T00:59:18.6898767Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T00:59:18.6899728Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:59:18.6900489Z @llvm-project//llvm:CodeGen; 31s local ... 2024-12-18T00:59:18.9705334Z 2024-12-18T00:59:18.9706271Z  2024-12-18T00:59:18.9706868Z  2024-12-18T00:59:18.9707291Z  2024-12-18T00:59:18.9707718Z  2024-12-18T00:59:18.9708450Z  2024-12-18T00:59:18.9708862Z  2024-12-18T00:59:18.9709244Z  2024-12-18T00:59:18.9709666Z  2024-12-18T00:59:18.9710697Z [18,711 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:18.9711882Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2024-12-18T00:59:18.9712811Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:18.9713861Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:59:18.9714906Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2024-12-18T00:59:18.9715823Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:59:18.9716912Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:59:18.9717870Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:59:18.9718602Z @llvm-project//llvm:CodeGen; 31s local ... 2024-12-18T00:59:19.1795941Z 2024-12-18T00:59:19.1796920Z  2024-12-18T00:59:19.1797650Z  2024-12-18T00:59:19.1798232Z  2024-12-18T00:59:19.1798749Z  2024-12-18T00:59:19.1799214Z  2024-12-18T00:59:19.1799805Z  2024-12-18T00:59:19.1800401Z  2024-12-18T00:59:19.1800815Z  2024-12-18T00:59:19.1801788Z [18,713 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:19.1812415Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2024-12-18T00:59:19.1813475Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:19.1814452Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2024-12-18T00:59:19.1815465Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2024-12-18T00:59:19.1816599Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:59:19.1817666Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:59:19.1818643Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:59:19.1819385Z @llvm-project//llvm:CodeGen; 31s local ... 2024-12-18T00:59:19.5800108Z 2024-12-18T00:59:19.5800941Z  2024-12-18T00:59:19.5801391Z  2024-12-18T00:59:19.5801797Z  2024-12-18T00:59:19.5802179Z  2024-12-18T00:59:19.5802562Z  2024-12-18T00:59:19.5802960Z  2024-12-18T00:59:19.5803360Z  2024-12-18T00:59:19.5803768Z  2024-12-18T00:59:19.5804726Z [18,714 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:19.5805873Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2024-12-18T00:59:19.5806776Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:19.5807735Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:59:19.5808984Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T00:59:19.5809968Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:59:19.5810964Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:59:19.5811868Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:59:19.5812602Z @llvm-project//llvm:CodeGen; 32s local ... 2024-12-18T00:59:19.7804522Z 2024-12-18T00:59:19.7805405Z  2024-12-18T00:59:19.7805881Z  2024-12-18T00:59:19.7806282Z  2024-12-18T00:59:19.7806768Z  2024-12-18T00:59:19.7807145Z  2024-12-18T00:59:19.7807579Z  2024-12-18T00:59:19.7807974Z  2024-12-18T00:59:19.7808357Z  2024-12-18T00:59:19.7809365Z [18,716 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:19.7810500Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2024-12-18T00:59:19.7811478Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:19.7812789Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:59:19.7813773Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T00:59:19.7814713Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2024-12-18T00:59:19.7815705Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T00:59:19.7816793Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:59:19.7817546Z @llvm-project//llvm:CodeGen; 32s local ... 2024-12-18T00:59:20.1808522Z 2024-12-18T00:59:20.1809495Z  2024-12-18T00:59:20.1809997Z  2024-12-18T00:59:20.1810383Z  2024-12-18T00:59:20.1810769Z  2024-12-18T00:59:20.1811178Z  2024-12-18T00:59:20.1811555Z  2024-12-18T00:59:20.1811964Z  2024-12-18T00:59:20.1812369Z  2024-12-18T00:59:20.1813338Z [18,718 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:20.1814981Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:59:20.1815981Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:59:20.1817145Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2024-12-18T00:59:20.1818167Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T00:59:20.1819161Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:59:20.1820217Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T00:59:20.1821191Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:20.1821864Z @llvm-project//llvm:CodeGen; 32s local ... 2024-12-18T00:59:20.3813457Z 2024-12-18T00:59:20.3814305Z  2024-12-18T00:59:20.3814930Z  2024-12-18T00:59:20.3815342Z  2024-12-18T00:59:20.3815758Z  2024-12-18T00:59:20.3816139Z  2024-12-18T00:59:20.3816715Z  2024-12-18T00:59:20.3817138Z  2024-12-18T00:59:20.3817580Z  2024-12-18T00:59:20.3818494Z [18,720 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:20.3819556Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:59:20.3820583Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:59:20.3821570Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:59:20.3822584Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T00:59:20.3823609Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:59:20.3824676Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T00:59:20.3825655Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:20.3826423Z @llvm-project//llvm:CodeGen; 32s local ... 2024-12-18T00:59:20.6331672Z 2024-12-18T00:59:20.6332764Z  2024-12-18T00:59:20.6333238Z  2024-12-18T00:59:20.6333683Z  2024-12-18T00:59:20.6334107Z  2024-12-18T00:59:20.6334515Z  2024-12-18T00:59:20.6334925Z  2024-12-18T00:59:20.6335308Z  2024-12-18T00:59:20.6335712Z  2024-12-18T00:59:20.6336816Z [18,723 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:20.6337921Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:59:20.6338936Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:59:20.6339865Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:59:20.6340843Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T00:59:20.6341827Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2024-12-18T00:59:20.6342832Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T00:59:20.6343940Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:20.6345089Z @llvm-project//llvm:CodeGen; 33s local ... 2024-12-18T00:59:20.9816231Z 2024-12-18T00:59:20.9817256Z  2024-12-18T00:59:20.9817726Z  2024-12-18T00:59:20.9818125Z  2024-12-18T00:59:20.9818521Z  2024-12-18T00:59:20.9818927Z  2024-12-18T00:59:20.9819304Z  2024-12-18T00:59:20.9819703Z  2024-12-18T00:59:20.9820171Z  2024-12-18T00:59:20.9821126Z [18,723 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:20.9822268Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2024-12-18T00:59:20.9823252Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:59:20.9824197Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2024-12-18T00:59:20.9825203Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T00:59:20.9826159Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:59:20.9827561Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T00:59:20.9828598Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:20.9829342Z @llvm-project//llvm:CodeGen; 33s local ... 2024-12-18T00:59:21.5090759Z 2024-12-18T00:59:21.5091636Z  2024-12-18T00:59:21.5092020Z  2024-12-18T00:59:21.5092409Z  2024-12-18T00:59:21.5092806Z  2024-12-18T00:59:21.5093218Z  2024-12-18T00:59:21.5093618Z  2024-12-18T00:59:21.5094029Z  2024-12-18T00:59:21.5094460Z  2024-12-18T00:59:21.5095525Z [18,724 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:21.5096865Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2024-12-18T00:59:21.5097803Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:59:21.5098715Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T00:59:21.5099714Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:59:21.5100522Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T00:59:21.5101405Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2024-12-18T00:59:21.5102411Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:59:21.5103424Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local ... 2024-12-18T00:59:21.7225073Z 2024-12-18T00:59:21.7225909Z  2024-12-18T00:59:21.7226360Z  2024-12-18T00:59:21.7226742Z  2024-12-18T00:59:21.7227129Z  2024-12-18T00:59:21.7227542Z  2024-12-18T00:59:21.7227950Z  2024-12-18T00:59:21.7228343Z  2024-12-18T00:59:21.7228709Z  2024-12-18T00:59:21.7229785Z [18,727 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:21.7230896Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2024-12-18T00:59:21.7232173Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:59:21.7233112Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T00:59:21.7234006Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2024-12-18T00:59:21.7234942Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T00:59:21.7235838Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2024-12-18T00:59:21.7236756Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:59:21.7237786Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local ... 2024-12-18T00:59:21.9822285Z 2024-12-18T00:59:21.9823110Z  2024-12-18T00:59:21.9823505Z  2024-12-18T00:59:21.9823843Z  2024-12-18T00:59:21.9824177Z  2024-12-18T00:59:21.9824507Z  2024-12-18T00:59:21.9824833Z  2024-12-18T00:59:21.9825148Z  2024-12-18T00:59:21.9825512Z  2024-12-18T00:59:21.9826619Z [18,727 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:21.9827558Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2024-12-18T00:59:21.9828460Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:21.9829296Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T00:59:21.9830084Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:21.9830876Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T00:59:21.9831633Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2024-12-18T00:59:21.9832454Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:59:21.9833451Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local ... 2024-12-18T00:59:22.3827934Z 2024-12-18T00:59:22.3828789Z  2024-12-18T00:59:22.3829322Z  2024-12-18T00:59:22.3829708Z  2024-12-18T00:59:22.3830088Z  2024-12-18T00:59:22.3830986Z  2024-12-18T00:59:22.3831379Z  2024-12-18T00:59:22.3831781Z  2024-12-18T00:59:22.3832159Z  2024-12-18T00:59:22.3833044Z [18,728 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:22.3834191Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:59:22.3835178Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:22.3836111Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T00:59:22.3837074Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:22.3838077Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T00:59:22.3839032Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2024-12-18T00:59:22.3840031Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2024-12-18T00:59:22.3841058Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local ... 2024-12-18T00:59:22.5975465Z 2024-12-18T00:59:22.5976312Z  2024-12-18T00:59:22.5976952Z  2024-12-18T00:59:22.5977358Z  2024-12-18T00:59:22.5977755Z  2024-12-18T00:59:22.5978119Z  2024-12-18T00:59:22.5978465Z  2024-12-18T00:59:22.5978835Z  2024-12-18T00:59:22.5979225Z  2024-12-18T00:59:22.5980178Z [18,729 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:22.5981292Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:59:22.5982285Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:22.5983188Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2024-12-18T00:59:22.5984257Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:22.5985240Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T00:59:22.5986495Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2024-12-18T00:59:22.5987283Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2024-12-18T00:59:22.5988134Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local ... 2024-12-18T00:59:22.8243746Z 2024-12-18T00:59:22.8244915Z  2024-12-18T00:59:22.8245430Z  2024-12-18T00:59:22.8245815Z  2024-12-18T00:59:22.8246209Z  2024-12-18T00:59:22.8246609Z  2024-12-18T00:59:22.8247006Z  2024-12-18T00:59:22.8247364Z  2024-12-18T00:59:22.8247726Z  2024-12-18T00:59:22.8248578Z [18,730 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:22.8249596Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2024-12-18T00:59:22.8250522Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:22.8251418Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2024-12-18T00:59:22.8252599Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2024-12-18T00:59:22.8253546Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T00:59:22.8254407Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2024-12-18T00:59:22.8255182Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2024-12-18T00:59:22.8255956Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local ... 2024-12-18T00:59:23.1834432Z 2024-12-18T00:59:23.1835266Z  2024-12-18T00:59:23.1835878Z  2024-12-18T00:59:23.1836296Z  2024-12-18T00:59:23.1836724Z  2024-12-18T00:59:23.1837143Z  2024-12-18T00:59:23.1837538Z  2024-12-18T00:59:23.1837947Z  2024-12-18T00:59:23.1838363Z  2024-12-18T00:59:23.1839374Z [18,730 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:23.1840642Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:59:23.1842066Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:59:23.1843218Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2024-12-18T00:59:23.1844591Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:59:23.1845678Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T00:59:23.1846663Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2024-12-18T00:59:23.1847558Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2024-12-18T00:59:23.1848469Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local ... 2024-12-18T00:59:23.5570448Z 2024-12-18T00:59:23.5571326Z  2024-12-18T00:59:23.5571788Z  2024-12-18T00:59:23.5572162Z  2024-12-18T00:59:23.5572529Z  2024-12-18T00:59:23.5572877Z  2024-12-18T00:59:23.5573246Z  2024-12-18T00:59:23.5573642Z  2024-12-18T00:59:23.5574000Z  2024-12-18T00:59:23.5575075Z [18,732 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:23.5576003Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:59:23.5576964Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:59:23.5577749Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:59:23.5578590Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:59:23.5579388Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T00:59:23.5580134Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2024-12-18T00:59:23.5580819Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2024-12-18T00:59:23.5581574Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2024-12-18T00:59:23.7836643Z 2024-12-18T00:59:23.7837535Z  2024-12-18T00:59:23.7837998Z  2024-12-18T00:59:23.7838429Z  2024-12-18T00:59:23.7838850Z  2024-12-18T00:59:23.7839544Z  2024-12-18T00:59:23.7839939Z  2024-12-18T00:59:23.7840395Z  2024-12-18T00:59:23.7840808Z  2024-12-18T00:59:23.7841779Z [18,733 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:23.7842972Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:59:23.7844028Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:59:23.7845320Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:59:23.7846323Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2024-12-18T00:59:23.7847424Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T00:59:23.7848421Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:59:23.7849290Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2024-12-18T00:59:23.7850185Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2024-12-18T00:59:23.9839166Z 2024-12-18T00:59:23.9840474Z  2024-12-18T00:59:23.9841814Z  2024-12-18T00:59:23.9842939Z  2024-12-18T00:59:23.9843403Z  2024-12-18T00:59:23.9843755Z  2024-12-18T00:59:23.9844143Z  2024-12-18T00:59:23.9844822Z  2024-12-18T00:59:23.9845220Z  2024-12-18T00:59:23.9846158Z [18,734 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:23.9847314Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2024-12-18T00:59:23.9848308Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:59:23.9849417Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:59:23.9850346Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:59:23.9851312Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T00:59:23.9852226Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:59:23.9853376Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2024-12-18T00:59:23.9854321Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2024-12-18T00:59:24.1952911Z 2024-12-18T00:59:24.1953844Z  2024-12-18T00:59:24.1954264Z  2024-12-18T00:59:24.1954628Z  2024-12-18T00:59:24.1954975Z  2024-12-18T00:59:24.1955330Z  2024-12-18T00:59:24.1955662Z  2024-12-18T00:59:24.1956000Z  2024-12-18T00:59:24.1956359Z  2024-12-18T00:59:24.1957157Z [18,735 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:24.1958121Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:59:24.1958963Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:59:24.1959811Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T00:59:24.1960770Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:59:24.1961843Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T00:59:24.1962661Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:59:24.1963434Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2024-12-18T00:59:24.1964204Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2024-12-18T00:59:24.5845434Z 2024-12-18T00:59:24.5849799Z  2024-12-18T00:59:24.5850300Z  2024-12-18T00:59:24.5850730Z  2024-12-18T00:59:24.5851152Z  2024-12-18T00:59:24.5851578Z  2024-12-18T00:59:24.5851989Z  2024-12-18T00:59:24.5852414Z  2024-12-18T00:59:24.5852844Z  2024-12-18T00:59:24.5853838Z [18,736 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:24.5855109Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:59:24.5856193Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:59:24.5859543Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T00:59:24.5860618Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2024-12-18T00:59:24.5861719Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T00:59:24.5862735Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2024-12-18T00:59:24.5863641Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2024-12-18T00:59:24.5864568Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local ... 2024-12-18T00:59:24.9849547Z 2024-12-18T00:59:24.9850406Z  2024-12-18T00:59:24.9850922Z  2024-12-18T00:59:24.9851329Z  2024-12-18T00:59:24.9851741Z  2024-12-18T00:59:24.9852151Z  2024-12-18T00:59:24.9852555Z  2024-12-18T00:59:24.9853061Z  2024-12-18T00:59:24.9853435Z  2024-12-18T00:59:24.9854357Z [18,737 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:24.9855767Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2024-12-18T00:59:24.9856954Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 68s local 2024-12-18T00:59:24.9857799Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T00:59:24.9858653Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:59:24.9859492Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T00:59:24.9860389Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2024-12-18T00:59:24.9861115Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2024-12-18T00:59:24.9861914Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local ... 2024-12-18T00:59:25.3757916Z 2024-12-18T00:59:25.3758883Z  2024-12-18T00:59:25.3759381Z  2024-12-18T00:59:25.3759735Z  2024-12-18T00:59:25.3760105Z  2024-12-18T00:59:25.3760464Z  2024-12-18T00:59:25.3760803Z  2024-12-18T00:59:25.3761215Z  2024-12-18T00:59:25.3761573Z  2024-12-18T00:59:25.3762845Z [18,739 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:25.3763954Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:59:25.3764886Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 68s local 2024-12-18T00:59:25.3765866Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T00:59:25.3766811Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:59:25.3767782Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T00:59:25.3768758Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2024-12-18T00:59:25.3769561Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2024-12-18T00:59:25.3770514Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local ... 2024-12-18T00:59:25.5854750Z 2024-12-18T00:59:25.5855697Z  2024-12-18T00:59:25.5856191Z  2024-12-18T00:59:25.5856749Z  2024-12-18T00:59:25.5857186Z  2024-12-18T00:59:25.5857603Z  2024-12-18T00:59:25.5858010Z  2024-12-18T00:59:25.5858411Z  2024-12-18T00:59:25.5858785Z  2024-12-18T00:59:25.5859737Z [18,741 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:25.5860837Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:59:25.5861807Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T00:59:25.5862771Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2024-12-18T00:59:25.5863778Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T00:59:25.5864696Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2024-12-18T00:59:25.5865497Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2024-12-18T00:59:25.5866378Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:59:25.5867548Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local ... 2024-12-18T00:59:25.9858799Z 2024-12-18T00:59:25.9859717Z  2024-12-18T00:59:25.9860197Z  2024-12-18T00:59:25.9860599Z  2024-12-18T00:59:25.9860985Z  2024-12-18T00:59:25.9861375Z  2024-12-18T00:59:25.9861764Z  2024-12-18T00:59:25.9862147Z  2024-12-18T00:59:25.9862537Z  2024-12-18T00:59:25.9863507Z [18,743 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:25.9864642Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2024-12-18T00:59:25.9865679Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T00:59:25.9866645Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2024-12-18T00:59:25.9867647Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T00:59:25.9868597Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2024-12-18T00:59:25.9869924Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2024-12-18T00:59:25.9870803Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:59:25.9871667Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local ... 2024-12-18T00:59:26.2912957Z 2024-12-18T00:59:26.2913871Z  2024-12-18T00:59:26.2914363Z  2024-12-18T00:59:26.2914702Z  2024-12-18T00:59:26.2915059Z  2024-12-18T00:59:26.2915442Z  2024-12-18T00:59:26.2915818Z  2024-12-18T00:59:26.2916204Z  2024-12-18T00:59:26.2916588Z  2024-12-18T00:59:26.2917485Z [18,744 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:26.2918614Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:59:26.2919642Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T00:59:26.2920612Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2024-12-18T00:59:26.2921953Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T00:59:26.2922973Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2024-12-18T00:59:26.2923750Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2024-12-18T00:59:26.2924499Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:59:26.2925287Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2024-12-18T00:59:26.5862820Z 2024-12-18T00:59:26.5864064Z  2024-12-18T00:59:26.5864551Z  2024-12-18T00:59:26.5864945Z  2024-12-18T00:59:26.5865331Z  2024-12-18T00:59:26.5865695Z  2024-12-18T00:59:26.5866091Z  2024-12-18T00:59:26.5866459Z  2024-12-18T00:59:26.5866854Z  2024-12-18T00:59:26.5867730Z [18,744 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:26.5868904Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:59:26.5869980Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T00:59:26.5870966Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2024-12-18T00:59:26.5871947Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T00:59:26.5872887Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2024-12-18T00:59:26.5873700Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2024-12-18T00:59:26.5874539Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:59:26.5875403Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2024-12-18T00:59:27.0130970Z 2024-12-18T00:59:27.0131850Z  2024-12-18T00:59:27.0132367Z  2024-12-18T00:59:27.0132784Z  2024-12-18T00:59:27.0133175Z  2024-12-18T00:59:27.0133562Z  2024-12-18T00:59:27.0134119Z  2024-12-18T00:59:27.0134566Z  2024-12-18T00:59:27.0134978Z  2024-12-18T00:59:27.0135971Z [18,745 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:27.0137705Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2024-12-18T00:59:27.0138836Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T00:59:27.0139904Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:59:27.0140890Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T00:59:27.0141834Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:59:27.0142634Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2024-12-18T00:59:27.0143387Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:59:27.0144505Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2024-12-18T00:59:27.3870944Z 2024-12-18T00:59:27.3871903Z  2024-12-18T00:59:27.3872356Z  2024-12-18T00:59:27.3872745Z  2024-12-18T00:59:27.3873118Z  2024-12-18T00:59:27.3873556Z  2024-12-18T00:59:27.3873951Z  2024-12-18T00:59:27.3874607Z  2024-12-18T00:59:27.3874998Z  2024-12-18T00:59:27.3875937Z [18,745 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:27.3877042Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:59:27.3878061Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T00:59:27.3879012Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:59:27.3879981Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T00:59:27.3880873Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:59:27.3881614Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2024-12-18T00:59:27.3882374Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:59:27.3883144Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local ... 2024-12-18T00:59:27.6930933Z 2024-12-18T00:59:27.6931850Z  2024-12-18T00:59:27.6932299Z  2024-12-18T00:59:27.6934688Z  2024-12-18T00:59:27.6935465Z  2024-12-18T00:59:27.6936272Z  2024-12-18T00:59:27.6936884Z  2024-12-18T00:59:27.6938755Z  2024-12-18T00:59:27.6939460Z  2024-12-18T00:59:27.6940640Z [18,746 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:27.6942031Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:59:27.6943328Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T00:59:27.6944751Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2024-12-18T00:59:27.6946003Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T00:59:27.6947142Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2024-12-18T00:59:27.6948207Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2024-12-18T00:59:27.6949222Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:59:27.6950315Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local ... 2024-12-18T00:59:27.9140839Z 2024-12-18T00:59:27.9142095Z  2024-12-18T00:59:27.9142885Z  2024-12-18T00:59:27.9144005Z  2024-12-18T00:59:27.9144748Z  2024-12-18T00:59:27.9145165Z  2024-12-18T00:59:27.9145577Z  2024-12-18T00:59:27.9145998Z  2024-12-18T00:59:27.9146400Z  2024-12-18T00:59:27.9147370Z [18,748 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:27.9148474Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2024-12-18T00:59:27.9149535Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T00:59:27.9150520Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:59:27.9151365Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:59:27.9152451Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2024-12-18T00:59:27.9153284Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:59:27.9154114Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2024-12-18T00:59:27.9155067Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local ... 2024-12-18T00:59:28.1876684Z 2024-12-18T00:59:28.1877560Z  2024-12-18T00:59:28.1878069Z  2024-12-18T00:59:28.1878476Z  2024-12-18T00:59:28.1878878Z  2024-12-18T00:59:28.1879287Z  2024-12-18T00:59:28.1879680Z  2024-12-18T00:59:28.1880063Z  2024-12-18T00:59:28.1880418Z  2024-12-18T00:59:28.1881374Z [18,748 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:28.1882507Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:59:28.1883538Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T00:59:28.1884550Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:59:28.1885758Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:59:28.1886588Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2024-12-18T00:59:28.1887565Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:59:28.1888374Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:28.1889253Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local ... 2024-12-18T00:59:28.5901332Z 2024-12-18T00:59:28.5902271Z  2024-12-18T00:59:28.5902761Z  2024-12-18T00:59:28.5903149Z  2024-12-18T00:59:28.5903569Z  2024-12-18T00:59:28.5903969Z  2024-12-18T00:59:28.5904372Z  2024-12-18T00:59:28.5904767Z  2024-12-18T00:59:28.5905152Z  2024-12-18T00:59:28.5906058Z [18,749 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:28.5907206Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:59:28.5908676Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T00:59:28.5909675Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:59:28.5910490Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2024-12-18T00:59:28.5911299Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2024-12-18T00:59:28.5912133Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:59:28.5912995Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:28.5914107Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local ... 2024-12-18T00:59:28.7919692Z 2024-12-18T00:59:28.7920543Z  2024-12-18T00:59:28.7921047Z  2024-12-18T00:59:28.7921474Z  2024-12-18T00:59:28.7921899Z  2024-12-18T00:59:28.7922310Z  2024-12-18T00:59:28.7922731Z  2024-12-18T00:59:28.7923132Z  2024-12-18T00:59:28.7923529Z  2024-12-18T00:59:28.7924571Z [18,750 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:28.7925893Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:59:28.7926970Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T00:59:28.7927865Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2024-12-18T00:59:28.7928692Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:28.7929453Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2024-12-18T00:59:28.7930252Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:59:28.7931050Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:28.7931998Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local ... 2024-12-18T00:59:29.0286081Z 2024-12-18T00:59:29.0286938Z  2024-12-18T00:59:29.0287427Z  2024-12-18T00:59:29.0287827Z  2024-12-18T00:59:29.0288495Z  2024-12-18T00:59:29.0288873Z  2024-12-18T00:59:29.0289300Z  2024-12-18T00:59:29.0289696Z  2024-12-18T00:59:29.0290085Z  2024-12-18T00:59:29.0291013Z [18,752 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:29.0292135Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2024-12-18T00:59:29.0293207Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T00:59:29.0294239Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:59:29.0295143Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:29.0295945Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2024-12-18T00:59:29.0296867Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:59:29.0297700Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:29.0298683Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local ... 2024-12-18T00:59:29.3574329Z 2024-12-18T00:59:29.3575580Z  2024-12-18T00:59:29.3576050Z  2024-12-18T00:59:29.3576726Z  2024-12-18T00:59:29.3577122Z  2024-12-18T00:59:29.3577637Z  2024-12-18T00:59:29.3578140Z  2024-12-18T00:59:29.3578611Z  2024-12-18T00:59:29.3579113Z  2024-12-18T00:59:29.3580315Z [18,753 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:29.3581587Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:59:29.3582755Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T00:59:29.3583853Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:59:29.3584846Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:29.3585783Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2024-12-18T00:59:29.3586713Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:59:29.3587875Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:59:29.3589225Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local ... 2024-12-18T00:59:29.5885678Z 2024-12-18T00:59:29.5886571Z  2024-12-18T00:59:29.5887068Z  2024-12-18T00:59:29.5889196Z  2024-12-18T00:59:29.5892391Z  2024-12-18T00:59:29.5895276Z  2024-12-18T00:59:29.5895964Z  2024-12-18T00:59:29.5896727Z  2024-12-18T00:59:29.5897334Z  2024-12-18T00:59:29.5898502Z [18,753 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:29.5899893Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:59:29.5901147Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T00:59:29.5902340Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:59:29.5903446Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2024-12-18T00:59:29.5904522Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2024-12-18T00:59:29.5905589Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:59:29.5906601Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:59:29.5907809Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local ... 2024-12-18T00:59:29.7891832Z 2024-12-18T00:59:29.7892743Z  2024-12-18T00:59:29.7893226Z  2024-12-18T00:59:29.7893638Z  2024-12-18T00:59:29.7894031Z  2024-12-18T00:59:29.7894440Z  2024-12-18T00:59:29.7894862Z  2024-12-18T00:59:29.7895282Z  2024-12-18T00:59:29.7895696Z  2024-12-18T00:59:29.7896795Z [18,754 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:29.7897940Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2024-12-18T00:59:29.7898974Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T00:59:29.7900342Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2024-12-18T00:59:29.7901218Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2024-12-18T00:59:29.7902051Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2024-12-18T00:59:29.7902916Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:59:29.7903864Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:59:29.7904879Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local ... 2024-12-18T00:59:30.1896952Z 2024-12-18T00:59:30.1897867Z  2024-12-18T00:59:30.1898332Z  2024-12-18T00:59:30.1898712Z  2024-12-18T00:59:30.1899118Z  2024-12-18T00:59:30.1899531Z  2024-12-18T00:59:30.1899924Z  2024-12-18T00:59:30.1900308Z  2024-12-18T00:59:30.1900710Z  2024-12-18T00:59:30.1901630Z [18,755 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:30.1903269Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:59:30.1904322Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T00:59:30.1905266Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2024-12-18T00:59:30.1906107Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2024-12-18T00:59:30.1906924Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2024-12-18T00:59:30.1907738Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:59:30.1908539Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:59:30.1909524Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local ... 2024-12-18T00:59:30.7261699Z 2024-12-18T00:59:30.7262574Z  2024-12-18T00:59:30.7262989Z  2024-12-18T00:59:30.7263340Z  2024-12-18T00:59:30.7263705Z  2024-12-18T00:59:30.7264083Z  2024-12-18T00:59:30.7264426Z  2024-12-18T00:59:30.7264850Z  2024-12-18T00:59:30.7265219Z  2024-12-18T00:59:30.7266341Z [18,756 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:30.7267326Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:59:30.7268204Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T00:59:30.7269062Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2024-12-18T00:59:30.7269775Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2024-12-18T00:59:30.7270495Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2024-12-18T00:59:30.7271242Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:59:30.7271910Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:59:30.7272749Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2024-12-18T00:59:30.9906226Z 2024-12-18T00:59:30.9907080Z  2024-12-18T00:59:30.9907606Z  2024-12-18T00:59:30.9907990Z  2024-12-18T00:59:30.9908380Z  2024-12-18T00:59:30.9908749Z  2024-12-18T00:59:30.9909131Z  2024-12-18T00:59:30.9909522Z  2024-12-18T00:59:30.9909907Z  2024-12-18T00:59:30.9910806Z [18,757 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:30.9911873Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2024-12-18T00:59:30.9912828Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T00:59:30.9913745Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:59:30.9914556Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2024-12-18T00:59:30.9915328Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T00:59:30.9916099Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:59:30.9916837Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:59:30.9918040Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2024-12-18T00:59:31.2623704Z 2024-12-18T00:59:31.2624673Z  2024-12-18T00:59:31.2625228Z  2024-12-18T00:59:31.2625616Z  2024-12-18T00:59:31.2626091Z  2024-12-18T00:59:31.2626472Z  2024-12-18T00:59:31.2626877Z  2024-12-18T00:59:31.2627308Z  2024-12-18T00:59:31.2627797Z  2024-12-18T00:59:31.2628747Z [18,761 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:31.2629887Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:59:31.2630904Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T00:59:31.2632026Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:59:31.2632804Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2024-12-18T00:59:31.2633592Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T00:59:31.2634385Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:59:31.2635435Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:31.2636399Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2024-12-18T00:59:31.5909357Z 2024-12-18T00:59:31.5910273Z  2024-12-18T00:59:31.5910745Z  2024-12-18T00:59:31.5911143Z  2024-12-18T00:59:31.5911535Z  2024-12-18T00:59:31.5911925Z  2024-12-18T00:59:31.5912311Z  2024-12-18T00:59:31.5912700Z  2024-12-18T00:59:31.5913093Z  2024-12-18T00:59:31.5914029Z [18,761 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:31.5915153Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:59:31.5916146Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T00:59:31.5917100Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:59:31.5917983Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2024-12-18T00:59:31.5919206Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T00:59:31.5920031Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:31.5920820Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:31.5921777Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local ... 2024-12-18T00:59:31.7938633Z 2024-12-18T00:59:31.7939490Z  2024-12-18T00:59:31.7939923Z  2024-12-18T00:59:31.7940268Z  2024-12-18T00:59:31.7940648Z  2024-12-18T00:59:31.7940961Z  2024-12-18T00:59:31.7941286Z  2024-12-18T00:59:31.7941617Z  2024-12-18T00:59:31.7942037Z  2024-12-18T00:59:31.7942976Z [18,762 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:31.7944060Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:59:31.7945472Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T00:59:31.7946447Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2024-12-18T00:59:31.7947256Z Compiling stablehlo/dialect/ChloOps.cpp; 41s local 2024-12-18T00:59:31.7948065Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T00:59:31.7948835Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:31.7949582Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:31.7950516Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local ... 2024-12-18T00:59:32.0641744Z 2024-12-18T00:59:32.0642657Z  2024-12-18T00:59:32.0643121Z  2024-12-18T00:59:32.0643528Z  2024-12-18T00:59:32.0643895Z  2024-12-18T00:59:32.0644508Z  2024-12-18T00:59:32.0644898Z  2024-12-18T00:59:32.0645292Z  2024-12-18T00:59:32.0645659Z  2024-12-18T00:59:32.0646663Z [18,763 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:32.0648096Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2024-12-18T00:59:32.0649131Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T00:59:32.0650099Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:59:32.0650991Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T00:59:32.0651700Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:32.0652470Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:32.0653390Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2024-12-18T00:59:32.0654244Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2024-12-18T00:59:32.2655783Z 2024-12-18T00:59:32.2656895Z  2024-12-18T00:59:32.2657380Z  2024-12-18T00:59:32.2657832Z  2024-12-18T00:59:32.2658305Z  2024-12-18T00:59:32.2658802Z  2024-12-18T00:59:32.2659269Z  2024-12-18T00:59:32.2659685Z  2024-12-18T00:59:32.2660392Z  2024-12-18T00:59:32.2661328Z [18,765 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:32.2662444Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:59:32.2663401Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T00:59:32.2664279Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:59:32.2665285Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T00:59:32.2666196Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:32.2667037Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:59:32.2667920Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2024-12-18T00:59:32.2668891Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2024-12-18T00:59:32.4955026Z 2024-12-18T00:59:32.4955910Z  2024-12-18T00:59:32.4956348Z  2024-12-18T00:59:32.4957187Z  2024-12-18T00:59:32.4957585Z  2024-12-18T00:59:32.4957958Z  2024-12-18T00:59:32.4958326Z  2024-12-18T00:59:32.4958691Z  2024-12-18T00:59:32.4959051Z  2024-12-18T00:59:32.4959962Z [18,766 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:32.4960861Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:59:32.4961839Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T00:59:32.4962820Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:59:32.4963678Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T00:59:32.4964490Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:32.4965286Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:59:32.4966139Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 28s local 2024-12-18T00:59:32.4967089Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2024-12-18T00:59:32.7917783Z 2024-12-18T00:59:32.7918749Z  2024-12-18T00:59:32.7919286Z  2024-12-18T00:59:32.7919746Z  2024-12-18T00:59:32.7920178Z  2024-12-18T00:59:32.7920560Z  2024-12-18T00:59:32.7920984Z  2024-12-18T00:59:32.7921341Z  2024-12-18T00:59:32.7921713Z  2024-12-18T00:59:32.7922591Z [18,766 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:32.7923690Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2024-12-18T00:59:32.7924654Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T00:59:32.7935369Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2024-12-18T00:59:32.7936258Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T00:59:32.7937506Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:59:32.7938239Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:59:32.7939130Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 28s local 2024-12-18T00:59:32.7940056Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2024-12-18T00:59:33.1922369Z 2024-12-18T00:59:33.1923227Z  2024-12-18T00:59:33.1923641Z  2024-12-18T00:59:33.1923996Z  2024-12-18T00:59:33.1924306Z  2024-12-18T00:59:33.1924606Z  2024-12-18T00:59:33.1924948Z  2024-12-18T00:59:33.1925275Z  2024-12-18T00:59:33.1925632Z  2024-12-18T00:59:33.1926509Z [18,767 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:33.1927480Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2024-12-18T00:59:33.1928403Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T00:59:33.1929261Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:59:33.1930298Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T00:59:33.1931011Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:59:33.1931682Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:59:33.1932361Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2024-12-18T00:59:33.1933036Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local ... 2024-12-18T00:59:33.6704101Z 2024-12-18T00:59:33.6705013Z  2024-12-18T00:59:33.6705592Z  2024-12-18T00:59:33.6706104Z  2024-12-18T00:59:33.6706587Z  2024-12-18T00:59:33.6707076Z  2024-12-18T00:59:33.6707458Z  2024-12-18T00:59:33.6707826Z  2024-12-18T00:59:33.6708247Z  2024-12-18T00:59:33.6709267Z [18,768 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:33.6710426Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2024-12-18T00:59:33.6711865Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:59:33.6712823Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2024-12-18T00:59:33.6713728Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T00:59:33.6714477Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:59:33.6715277Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:59:33.6716075Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2024-12-18T00:59:33.6716873Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local ... 2024-12-18T00:59:33.9928662Z 2024-12-18T00:59:33.9929545Z  2024-12-18T00:59:33.9930017Z  2024-12-18T00:59:33.9930404Z  2024-12-18T00:59:33.9930790Z  2024-12-18T00:59:33.9931179Z  2024-12-18T00:59:33.9931553Z  2024-12-18T00:59:33.9931921Z  2024-12-18T00:59:33.9932304Z  2024-12-18T00:59:33.9933292Z [18,768 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:33.9934614Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2024-12-18T00:59:33.9935631Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:59:33.9936732Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:33.9937603Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T00:59:33.9938360Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:59:33.9938998Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:59:33.9939676Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:33.9940570Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local ... 2024-12-18T00:59:34.1932040Z 2024-12-18T00:59:34.1932932Z  2024-12-18T00:59:34.1933426Z  2024-12-18T00:59:34.1933813Z  2024-12-18T00:59:34.1934512Z  2024-12-18T00:59:34.1934905Z  2024-12-18T00:59:34.1935310Z  2024-12-18T00:59:34.1935719Z  2024-12-18T00:59:34.1936117Z  2024-12-18T00:59:34.1937264Z [18,770 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:34.1938479Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:59:34.1939455Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:59:34.1940385Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:34.1941287Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T00:59:34.1942081Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:59:34.1942670Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:59:34.1943400Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:34.1944480Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local ... 2024-12-18T00:59:34.4429696Z 2024-12-18T00:59:34.4430559Z  2024-12-18T00:59:34.4431345Z  2024-12-18T00:59:34.4431747Z  2024-12-18T00:59:34.4432246Z  2024-12-18T00:59:34.4432624Z  2024-12-18T00:59:34.4432995Z  2024-12-18T00:59:34.4433402Z  2024-12-18T00:59:34.4433781Z  2024-12-18T00:59:34.4434687Z [18,771 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:34.4435726Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:59:34.4436729Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T00:59:34.4437663Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:34.4438543Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T00:59:34.4439435Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:59:34.4440220Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:59:34.4441177Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:34.4442331Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local ... 2024-12-18T00:59:34.7937968Z 2024-12-18T00:59:34.7938851Z  2024-12-18T00:59:34.7939332Z  2024-12-18T00:59:34.7939671Z  2024-12-18T00:59:34.7940147Z  2024-12-18T00:59:34.7940510Z  2024-12-18T00:59:34.7940882Z  2024-12-18T00:59:34.7941234Z  2024-12-18T00:59:34.7941609Z  2024-12-18T00:59:34.7942513Z [18,772 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:34.7943626Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2024-12-18T00:59:34.7944889Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T00:59:34.7945825Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2024-12-18T00:59:34.7946699Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T00:59:34.7947500Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:59:34.7948346Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:59:34.7949178Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2024-12-18T00:59:34.7949982Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local ... 2024-12-18T00:59:35.1428340Z 2024-12-18T00:59:35.1429208Z  2024-12-18T00:59:35.1429678Z  2024-12-18T00:59:35.1430079Z  2024-12-18T00:59:35.1430452Z  2024-12-18T00:59:35.1430852Z  2024-12-18T00:59:35.1431254Z  2024-12-18T00:59:35.1431648Z  2024-12-18T00:59:35.1432002Z  2024-12-18T00:59:35.1433088Z [18,774 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:35.1434158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:59:35.1435173Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T00:59:35.1436509Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:59:35.1437447Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2024-12-18T00:59:35.1438275Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:59:35.1439010Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:59:35.1439817Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:59:35.1440627Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local ... 2024-12-18T00:59:35.3944094Z 2024-12-18T00:59:35.3945191Z  2024-12-18T00:59:35.3945655Z  2024-12-18T00:59:35.3946040Z  2024-12-18T00:59:35.3946418Z  2024-12-18T00:59:35.3946787Z  2024-12-18T00:59:35.3947178Z  2024-12-18T00:59:35.3947575Z  2024-12-18T00:59:35.3947955Z  2024-12-18T00:59:35.3948883Z [18,776 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:35.3949966Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:59:35.3951250Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T00:59:35.3952279Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:59:35.3953102Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2024-12-18T00:59:35.3953880Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:59:35.3954711Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 35s local 2024-12-18T00:59:35.3955492Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:59:35.3956264Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local ... 2024-12-18T00:59:35.7948446Z 2024-12-18T00:59:35.7949377Z  2024-12-18T00:59:35.7949852Z  2024-12-18T00:59:35.7950219Z  2024-12-18T00:59:35.7950628Z  2024-12-18T00:59:35.7951034Z  2024-12-18T00:59:35.7951448Z  2024-12-18T00:59:35.7951818Z  2024-12-18T00:59:35.7952192Z  2024-12-18T00:59:35.7953477Z [18,777 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:35.7954717Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:59:35.7955723Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T00:59:35.7956667Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2024-12-18T00:59:35.7957560Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2024-12-18T00:59:35.7958384Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:59:35.7959209Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2024-12-18T00:59:35.7960067Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2024-12-18T00:59:35.7961039Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local ... 2024-12-18T00:59:36.0127176Z 2024-12-18T00:59:36.0128137Z  2024-12-18T00:59:36.0128634Z  2024-12-18T00:59:36.0129093Z  2024-12-18T00:59:36.0129584Z  2024-12-18T00:59:36.0130039Z  2024-12-18T00:59:36.0130467Z  2024-12-18T00:59:36.0130961Z  2024-12-18T00:59:36.0131406Z  2024-12-18T00:59:36.0132465Z [18,780 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:36.0133732Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2024-12-18T00:59:36.0134873Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T00:59:36.0136125Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:59:36.0137309Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T00:59:36.0138262Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:59:36.0139201Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:59:36.0140116Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2024-12-18T00:59:36.0140996Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local ... 2024-12-18T00:59:36.3956185Z 2024-12-18T00:59:36.3957022Z  2024-12-18T00:59:36.3957571Z  2024-12-18T00:59:36.3958003Z  2024-12-18T00:59:36.3958394Z  2024-12-18T00:59:36.3958816Z  2024-12-18T00:59:36.3959377Z  2024-12-18T00:59:36.3959795Z  2024-12-18T00:59:36.3960189Z  2024-12-18T00:59:36.3961159Z [18,781 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:36.3962387Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2024-12-18T00:59:36.3963493Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T00:59:36.3964538Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:59:36.3965494Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T00:59:36.3966353Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:59:36.3967216Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:59:36.3968080Z Compiling stablehlo/dialect/VhloOps.cpp; 24s local 2024-12-18T00:59:36.3969342Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local ... 2024-12-18T00:59:36.7377012Z 2024-12-18T00:59:36.7377927Z  2024-12-18T00:59:36.7378410Z  2024-12-18T00:59:36.7378792Z  2024-12-18T00:59:36.7379182Z  2024-12-18T00:59:36.7379571Z  2024-12-18T00:59:36.7379952Z  2024-12-18T00:59:36.7380327Z  2024-12-18T00:59:36.7380725Z  2024-12-18T00:59:36.7381666Z [18,783 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:36.7382784Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2024-12-18T00:59:36.7383830Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T00:59:36.7384768Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2024-12-18T00:59:36.7385627Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T00:59:36.7386499Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:59:36.7387730Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2024-12-18T00:59:36.7388530Z Compiling stablehlo/dialect/VhloOps.cpp; 24s local 2024-12-18T00:59:36.7389427Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local ... 2024-12-18T00:59:36.9958884Z 2024-12-18T00:59:36.9959747Z  2024-12-18T00:59:36.9960190Z  2024-12-18T00:59:36.9960583Z  2024-12-18T00:59:36.9961084Z  2024-12-18T00:59:36.9961472Z  2024-12-18T00:59:36.9961838Z  2024-12-18T00:59:36.9962243Z  2024-12-18T00:59:36.9962635Z  2024-12-18T00:59:36.9963574Z [18,784 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:36.9964735Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2024-12-18T00:59:36.9965764Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T00:59:36.9966775Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:36.9967687Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T00:59:36.9968492Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:59:36.9969285Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:36.9970248Z Compiling stablehlo/dialect/VhloOps.cpp; 24s local 2024-12-18T00:59:36.9971200Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local ... 2024-12-18T00:59:37.2465930Z 2024-12-18T00:59:37.2466839Z  2024-12-18T00:59:37.2467263Z  2024-12-18T00:59:37.2467629Z  2024-12-18T00:59:37.2468075Z  2024-12-18T00:59:37.2468425Z  2024-12-18T00:59:37.2468790Z  2024-12-18T00:59:37.2469157Z  2024-12-18T00:59:37.2469525Z  2024-12-18T00:59:37.2470427Z [18,785 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:37.2471738Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:59:37.2472767Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T00:59:37.2473744Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:37.2474639Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T00:59:37.2475418Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:59:37.2476248Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:37.2477063Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2024-12-18T00:59:37.2478012Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local ... 2024-12-18T00:59:37.5963457Z 2024-12-18T00:59:37.5964318Z  2024-12-18T00:59:37.5964821Z  2024-12-18T00:59:37.5965244Z  2024-12-18T00:59:37.5965636Z  2024-12-18T00:59:37.5966050Z  2024-12-18T00:59:37.5966444Z  2024-12-18T00:59:37.5966839Z  2024-12-18T00:59:37.5967266Z  2024-12-18T00:59:37.5968558Z [18,786 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:37.5969758Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:59:37.5970797Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:59:37.5971815Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:37.5972759Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T00:59:37.5973587Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:37.5974392Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:37.5975203Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2024-12-18T00:59:37.5976179Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local ... 2024-12-18T00:59:37.8079828Z 2024-12-18T00:59:37.8080814Z  2024-12-18T00:59:37.8081294Z  2024-12-18T00:59:37.8081747Z  2024-12-18T00:59:37.8082163Z  2024-12-18T00:59:37.8082558Z  2024-12-18T00:59:37.8083362Z  2024-12-18T00:59:37.8083769Z  2024-12-18T00:59:37.8084163Z  2024-12-18T00:59:37.8085096Z [18,788 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:37.8086291Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2024-12-18T00:59:37.8087401Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:59:37.8088393Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2024-12-18T00:59:37.8089342Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T00:59:37.8090160Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:37.8090979Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2024-12-18T00:59:37.8091825Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2024-12-18T00:59:37.8092769Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local ... 2024-12-18T00:59:38.1968481Z 2024-12-18T00:59:38.1969490Z  2024-12-18T00:59:38.1969980Z  2024-12-18T00:59:38.1970387Z  2024-12-18T00:59:38.1970782Z  2024-12-18T00:59:38.1971148Z  2024-12-18T00:59:38.1971554Z  2024-12-18T00:59:38.1971964Z  2024-12-18T00:59:38.1972345Z  2024-12-18T00:59:38.1973284Z [18,788 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:38.1974475Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:38.1975346Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:59:38.1976128Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:59:38.1977215Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T00:59:38.1977929Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:38.1978652Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:59:38.1979701Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2024-12-18T00:59:38.1980700Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local ... 2024-12-18T00:59:38.4589582Z 2024-12-18T00:59:38.4590435Z  2024-12-18T00:59:38.4590921Z  2024-12-18T00:59:38.4591315Z  2024-12-18T00:59:38.4591727Z  2024-12-18T00:59:38.4592118Z  2024-12-18T00:59:38.4592496Z  2024-12-18T00:59:38.4592873Z  2024-12-18T00:59:38.4593261Z  2024-12-18T00:59:38.4594186Z [18,789 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:38.4595289Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:38.4596352Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T00:59:38.4597302Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:59:38.4598115Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T00:59:38.4599220Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:38.4600058Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:59:38.4600868Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2024-12-18T00:59:38.4601821Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local ... 2024-12-18T00:59:38.7389548Z 2024-12-18T00:59:38.7390415Z  2024-12-18T00:59:38.7390866Z  2024-12-18T00:59:38.7391246Z  2024-12-18T00:59:38.7391597Z  2024-12-18T00:59:38.7391964Z  2024-12-18T00:59:38.7392337Z  2024-12-18T00:59:38.7392722Z  2024-12-18T00:59:38.7393111Z  2024-12-18T00:59:38.7393970Z [18,790 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:38.7395075Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:38.7395914Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T00:59:38.7397002Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2024-12-18T00:59:38.7397932Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T00:59:38.7398584Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:59:38.7399259Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2024-12-18T00:59:38.7400114Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2024-12-18T00:59:38.7401087Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local ... 2024-12-18T00:59:38.9974649Z 2024-12-18T00:59:38.9975578Z  2024-12-18T00:59:38.9976050Z  2024-12-18T00:59:38.9976617Z  2024-12-18T00:59:38.9977018Z  2024-12-18T00:59:38.9977395Z  2024-12-18T00:59:38.9977780Z  2024-12-18T00:59:38.9978166Z  2024-12-18T00:59:38.9978528Z  2024-12-18T00:59:38.9979468Z [18,790 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:38.9980661Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2024-12-18T00:59:38.9981732Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T00:59:38.9982717Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:59:38.9983631Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2024-12-18T00:59:38.9984484Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:59:38.9985330Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:59:38.9986163Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2024-12-18T00:59:38.9987137Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local ... 2024-12-18T00:59:39.2996657Z 2024-12-18T00:59:39.2997556Z  2024-12-18T00:59:39.2998029Z  2024-12-18T00:59:39.2998417Z  2024-12-18T00:59:39.2998813Z  2024-12-18T00:59:39.2999210Z  2024-12-18T00:59:39.2999574Z  2024-12-18T00:59:39.3000248Z  2024-12-18T00:59:39.3000606Z  2024-12-18T00:59:39.3001659Z [18,791 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:39.3002947Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2024-12-18T00:59:39.3003970Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T00:59:39.3004934Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:59:39.3005803Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2024-12-18T00:59:39.3006618Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:59:39.3007439Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:59:39.3008225Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2024-12-18T00:59:39.3009135Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local ... 2024-12-18T00:59:39.5979625Z 2024-12-18T00:59:39.5980573Z  2024-12-18T00:59:39.5981081Z  2024-12-18T00:59:39.5981499Z  2024-12-18T00:59:39.5982174Z  2024-12-18T00:59:39.5982591Z  2024-12-18T00:59:39.5982957Z  2024-12-18T00:59:39.5983336Z  2024-12-18T00:59:39.5983733Z  2024-12-18T00:59:39.5984673Z [18,791 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:39.5985939Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2024-12-18T00:59:39.5986977Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2024-12-18T00:59:39.5987942Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2024-12-18T00:59:39.5988836Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2024-12-18T00:59:39.5989675Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:59:39.5990450Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2024-12-18T00:59:39.5991217Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2024-12-18T00:59:39.5992380Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local ... 2024-12-18T00:59:40.3975456Z 2024-12-18T00:59:40.3976330Z  2024-12-18T00:59:40.3977011Z  2024-12-18T00:59:40.3977409Z  2024-12-18T00:59:40.3977805Z  2024-12-18T00:59:40.3978200Z  2024-12-18T00:59:40.3978603Z  2024-12-18T00:59:40.3979003Z  2024-12-18T00:59:40.3979391Z  2024-12-18T00:59:40.3980329Z [18,792 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:40.3981473Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:59:40.3982538Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2024-12-18T00:59:40.3983504Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T00:59:40.3984327Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:59:40.3985128Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:59:40.3985988Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2024-12-18T00:59:40.3986866Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:59:40.3987895Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local ... 2024-12-18T00:59:40.5986897Z 2024-12-18T00:59:40.5987823Z  2024-12-18T00:59:40.5988290Z  2024-12-18T00:59:40.5988668Z  2024-12-18T00:59:40.5989050Z  2024-12-18T00:59:40.5989446Z  2024-12-18T00:59:40.5989835Z  2024-12-18T00:59:40.5990191Z  2024-12-18T00:59:40.5990576Z  2024-12-18T00:59:40.5991469Z [18,792 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:40.5992787Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:59:40.5993852Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:59:40.5994837Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T00:59:40.5995948Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:40.5996735Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:59:40.5997539Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2024-12-18T00:59:40.5998394Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2024-12-18T00:59:40.5999615Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local ... 2024-12-18T00:59:40.9019915Z 2024-12-18T00:59:40.9020853Z  2024-12-18T00:59:40.9021372Z  2024-12-18T00:59:40.9021759Z  2024-12-18T00:59:40.9022122Z  2024-12-18T00:59:40.9022523Z  2024-12-18T00:59:40.9022902Z  2024-12-18T00:59:40.9023300Z  2024-12-18T00:59:40.9023661Z  2024-12-18T00:59:40.9024532Z [18,795 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:40.9025617Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2024-12-18T00:59:40.9026785Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:59:40.9027616Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T00:59:40.9028415Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:40.9029182Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2024-12-18T00:59:40.9029972Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2024-12-18T00:59:40.9030815Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local 2024-12-18T00:59:40.9031718Z Compiling xla/service/copy_insertion.cc; 15s local ... 2024-12-18T00:59:41.1595865Z 2024-12-18T00:59:41.1596751Z  2024-12-18T00:59:41.1597235Z  2024-12-18T00:59:41.1597732Z  2024-12-18T00:59:41.1598118Z  2024-12-18T00:59:41.1598496Z  2024-12-18T00:59:41.1598898Z  2024-12-18T00:59:41.1599269Z  2024-12-18T00:59:41.1599634Z  2024-12-18T00:59:41.1600597Z [18,797 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:41.1602120Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2024-12-18T00:59:41.1603152Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:59:41.1604014Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T00:59:41.1604783Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:41.1605593Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 35s local 2024-12-18T00:59:41.1606374Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2024-12-18T00:59:41.1607239Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local 2024-12-18T00:59:41.1608142Z Compiling xla/service/copy_insertion.cc; 15s local ... 2024-12-18T00:59:41.3993038Z 2024-12-18T00:59:41.3994010Z  2024-12-18T00:59:41.3994520Z  2024-12-18T00:59:41.3994903Z  2024-12-18T00:59:41.3995307Z  2024-12-18T00:59:41.3995682Z  2024-12-18T00:59:41.3996086Z  2024-12-18T00:59:41.3996470Z  2024-12-18T00:59:41.3996944Z  2024-12-18T00:59:41.3997969Z [18,798 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:41.3999089Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2024-12-18T00:59:41.4000122Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T00:59:41.4001046Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T00:59:41.4001989Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:41.4002808Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 35s local 2024-12-18T00:59:41.4003602Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2024-12-18T00:59:41.4004589Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local 2024-12-18T00:59:41.4005482Z Compiling xla/service/copy_insertion.cc; 16s local ... 2024-12-18T00:59:41.8321041Z 2024-12-18T00:59:41.8322113Z  2024-12-18T00:59:41.8322498Z  2024-12-18T00:59:41.8322801Z  2024-12-18T00:59:41.8323145Z  2024-12-18T00:59:41.8323458Z  2024-12-18T00:59:41.8323769Z  2024-12-18T00:59:41.8324083Z  2024-12-18T00:59:41.8324375Z  2024-12-18T00:59:41.8325106Z [18,799 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:41.8325965Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2024-12-18T00:59:41.8326764Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T00:59:41.8327482Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T00:59:41.8328095Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:59:41.8328728Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 35s local 2024-12-18T00:59:41.8329352Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2024-12-18T00:59:41.8330031Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local 2024-12-18T00:59:41.8331125Z Compiling xla/service/copy_insertion.cc; 16s local ... 2024-12-18T00:59:42.1999867Z 2024-12-18T00:59:42.2000772Z  2024-12-18T00:59:42.2001226Z  2024-12-18T00:59:42.2001667Z  2024-12-18T00:59:42.2002106Z  2024-12-18T00:59:42.2002604Z  2024-12-18T00:59:42.2003111Z  2024-12-18T00:59:42.2003546Z  2024-12-18T00:59:42.2003897Z  2024-12-18T00:59:42.2004768Z [18,800 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:42.2005852Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:59:42.2006712Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T00:59:42.2007584Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T00:59:42.2008414Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:59:42.2009178Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 36s local 2024-12-18T00:59:42.2010276Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2024-12-18T00:59:42.2011192Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local 2024-12-18T00:59:42.2012209Z Compiling xla/service/copy_insertion.cc; 17s local ... 2024-12-18T00:59:42.5995693Z 2024-12-18T00:59:42.5996561Z  2024-12-18T00:59:42.5996953Z  2024-12-18T00:59:42.5997268Z  2024-12-18T00:59:42.5997769Z  2024-12-18T00:59:42.5998194Z  2024-12-18T00:59:42.5998529Z  2024-12-18T00:59:42.5998878Z  2024-12-18T00:59:42.5999208Z  2024-12-18T00:59:42.5999979Z [18,801 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:42.6001200Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:59:42.6002333Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T00:59:42.6003194Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T00:59:42.6004019Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T00:59:42.6004864Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 36s local 2024-12-18T00:59:42.6005775Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2024-12-18T00:59:42.6006607Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local 2024-12-18T00:59:42.6007430Z Compiling xla/service/copy_insertion.cc; 17s local ... 2024-12-18T00:59:42.8004593Z 2024-12-18T00:59:42.8005494Z  2024-12-18T00:59:42.8006038Z  2024-12-18T00:59:42.8006410Z  2024-12-18T00:59:42.8006777Z  2024-12-18T00:59:42.8007152Z  2024-12-18T00:59:42.8007541Z  2024-12-18T00:59:42.8007907Z  2024-12-18T00:59:42.8008304Z  2024-12-18T00:59:42.8009205Z [18,804 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:42.8010324Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2024-12-18T00:59:42.8011632Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T00:59:42.8012552Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T00:59:42.8013336Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T00:59:42.8014076Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2024-12-18T00:59:42.8014979Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local 2024-12-18T00:59:42.8015868Z Compiling xla/service/copy_insertion.cc; 17s local 2024-12-18T00:59:42.8016925Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 17s local ... 2024-12-18T00:59:43.0722596Z 2024-12-18T00:59:43.0723541Z  2024-12-18T00:59:43.0724011Z  2024-12-18T00:59:43.0724413Z  2024-12-18T00:59:43.0724802Z  2024-12-18T00:59:43.0725165Z  2024-12-18T00:59:43.0725552Z  2024-12-18T00:59:43.0725930Z  2024-12-18T00:59:43.0726290Z  2024-12-18T00:59:43.0727141Z [18,807 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:43.0728507Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:59:43.0729598Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T00:59:43.0730463Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T00:59:43.0731240Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T00:59:43.0731984Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2024-12-18T00:59:43.0732855Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local 2024-12-18T00:59:43.0733707Z Compiling xla/service/copy_insertion.cc; 17s local 2024-12-18T00:59:43.0734594Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 17s local ... 2024-12-18T00:59:43.2741265Z 2024-12-18T00:59:43.2742115Z  2024-12-18T00:59:43.2742596Z  2024-12-18T00:59:43.2742978Z  2024-12-18T00:59:43.2743350Z  2024-12-18T00:59:43.2743714Z  2024-12-18T00:59:43.2744128Z  2024-12-18T00:59:43.2745079Z  2024-12-18T00:59:43.2745954Z  2024-12-18T00:59:43.2746897Z [18,809 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:43.2748004Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:59:43.2749059Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T00:59:43.2749981Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T00:59:43.2750799Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T00:59:43.2751534Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:59:43.2752376Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local 2024-12-18T00:59:43.2753270Z Compiling xla/service/copy_insertion.cc; 18s local 2024-12-18T00:59:43.2754271Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 17s local ... 2024-12-18T00:59:43.6011060Z 2024-12-18T00:59:43.6011930Z  2024-12-18T00:59:43.6012404Z  2024-12-18T00:59:43.6012810Z  2024-12-18T00:59:43.6013162Z  2024-12-18T00:59:43.6013529Z  2024-12-18T00:59:43.6013893Z  2024-12-18T00:59:43.6014269Z  2024-12-18T00:59:43.6014614Z  2024-12-18T00:59:43.6015478Z [18,810 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:43.6016709Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2024-12-18T00:59:43.6017693Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T00:59:43.6018535Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T00:59:43.6019324Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2024-12-18T00:59:43.6020042Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2024-12-18T00:59:43.6021040Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local 2024-12-18T00:59:43.6021884Z Compiling xla/service/copy_insertion.cc; 18s local 2024-12-18T00:59:43.6023170Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local ... 2024-12-18T00:59:44.5233291Z 2024-12-18T00:59:44.5234174Z  2024-12-18T00:59:44.5234649Z  2024-12-18T00:59:44.5235062Z  2024-12-18T00:59:44.5235470Z  2024-12-18T00:59:44.5235863Z  2024-12-18T00:59:44.5236263Z  2024-12-18T00:59:44.5236672Z  2024-12-18T00:59:44.5237083Z  2024-12-18T00:59:44.5238036Z [18,811 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:44.5239243Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2024-12-18T00:59:44.5240494Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T00:59:44.5241524Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2024-12-18T00:59:44.5242429Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T00:59:44.5243276Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:59:44.5244828Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local 2024-12-18T00:59:44.5245830Z Compiling xla/service/copy_insertion.cc; 19s local 2024-12-18T00:59:44.5246857Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local ... 2024-12-18T00:59:44.7738791Z 2024-12-18T00:59:44.7739641Z  2024-12-18T00:59:44.7740110Z  2024-12-18T00:59:44.7740436Z  2024-12-18T00:59:44.7740808Z  2024-12-18T00:59:44.7741152Z  2024-12-18T00:59:44.7741532Z  2024-12-18T00:59:44.7741889Z  2024-12-18T00:59:44.7742234Z  2024-12-18T00:59:44.7743143Z [18,812 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:44.7744487Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2024-12-18T00:59:44.7745537Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:59:44.7746369Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2024-12-18T00:59:44.7747403Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T00:59:44.7748289Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:59:44.7749179Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:59:44.7750023Z Compiling xla/service/copy_insertion.cc; 19s local 2024-12-18T00:59:44.7750913Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local ... 2024-12-18T00:59:45.0020799Z 2024-12-18T00:59:45.0021743Z  2024-12-18T00:59:45.0022193Z  2024-12-18T00:59:45.0022581Z  2024-12-18T00:59:45.0022974Z  2024-12-18T00:59:45.0023361Z  2024-12-18T00:59:45.0023748Z  2024-12-18T00:59:45.0024128Z  2024-12-18T00:59:45.0024509Z  2024-12-18T00:59:45.0025455Z [18,813 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:45.0026600Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2024-12-18T00:59:45.0027674Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:59:45.0028584Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T00:59:45.0029327Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T00:59:45.0030039Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:59:45.0030865Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:59:45.0031727Z Compiling xla/service/copy_insertion.cc; 19s local 2024-12-18T00:59:45.0032619Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local ... 2024-12-18T00:59:45.2023483Z 2024-12-18T00:59:45.2024335Z  2024-12-18T00:59:45.2024753Z  2024-12-18T00:59:45.2025111Z  2024-12-18T00:59:45.2025485Z  2024-12-18T00:59:45.2025848Z  2024-12-18T00:59:45.2026191Z  2024-12-18T00:59:45.2026567Z  2024-12-18T00:59:45.2026930Z  2024-12-18T00:59:45.2028091Z [18,814 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:45.2029109Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2024-12-18T00:59:45.2030013Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:59:45.2030818Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T00:59:45.2031528Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T00:59:45.2032217Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2024-12-18T00:59:45.2033018Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:59:45.2033821Z Compiling xla/service/copy_insertion.cc; 20s local 2024-12-18T00:59:45.2034645Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local ... 2024-12-18T00:59:45.5299774Z 2024-12-18T00:59:45.5300603Z  2024-12-18T00:59:45.5301012Z  2024-12-18T00:59:45.5301354Z  2024-12-18T00:59:45.5301720Z  2024-12-18T00:59:45.5302041Z  2024-12-18T00:59:45.5302370Z  2024-12-18T00:59:45.5302925Z  2024-12-18T00:59:45.5303264Z  2024-12-18T00:59:45.5304037Z [18,815 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:45.5304960Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2024-12-18T00:59:45.5305784Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T00:59:45.5306545Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T00:59:45.5307224Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T00:59:45.5307857Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:59:45.5308564Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2024-12-18T00:59:45.5309291Z Compiling xla/service/copy_insertion.cc; 20s local 2024-12-18T00:59:45.5310025Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local ... 2024-12-18T00:59:45.7311537Z 2024-12-18T00:59:45.7312429Z  2024-12-18T00:59:45.7313266Z  2024-12-18T00:59:45.7313674Z  2024-12-18T00:59:45.7314071Z  2024-12-18T00:59:45.7314468Z  2024-12-18T00:59:45.7314856Z  2024-12-18T00:59:45.7315252Z  2024-12-18T00:59:45.7315656Z  2024-12-18T00:59:45.7316599Z [18,817 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:45.7317724Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2024-12-18T00:59:45.7318744Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2024-12-18T00:59:45.7319683Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T00:59:45.7320472Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T00:59:45.7321228Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:59:45.7322095Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:59:45.7322964Z Compiling xla/service/copy_insertion.cc; 20s local 2024-12-18T00:59:45.7323855Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local ... 2024-12-18T00:59:46.0029924Z 2024-12-18T00:59:46.0030926Z  2024-12-18T00:59:46.0031412Z  2024-12-18T00:59:46.0031826Z  2024-12-18T00:59:46.0032261Z  2024-12-18T00:59:46.0032680Z  2024-12-18T00:59:46.0033108Z  2024-12-18T00:59:46.0033480Z  2024-12-18T00:59:46.0033877Z  2024-12-18T00:59:46.0034869Z [18,818 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:46.0036076Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2024-12-18T00:59:46.0037188Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2024-12-18T00:59:46.0038190Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T00:59:46.0039080Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T00:59:46.0040219Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2024-12-18T00:59:46.0041204Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:59:46.0042114Z Compiling xla/service/copy_insertion.cc; 20s local 2024-12-18T00:59:46.0043072Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local ... 2024-12-18T00:59:46.2716179Z 2024-12-18T00:59:46.2717120Z  2024-12-18T00:59:46.2717592Z  2024-12-18T00:59:46.2717994Z  2024-12-18T00:59:46.2718395Z  2024-12-18T00:59:46.2718795Z  2024-12-18T00:59:46.2719158Z  2024-12-18T00:59:46.2719561Z  2024-12-18T00:59:46.2719988Z  2024-12-18T00:59:46.2720961Z [18,819 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:46.2722104Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2024-12-18T00:59:46.2723156Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T00:59:46.2724136Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T00:59:46.2725161Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:59:46.2726061Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:59:46.2726958Z Compiling xla/service/copy_insertion.cc; 21s local 2024-12-18T00:59:46.2727764Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local 2024-12-18T00:59:46.2728744Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local ... 2024-12-18T00:59:46.6035497Z 2024-12-18T00:59:46.6036431Z  2024-12-18T00:59:46.6036923Z  2024-12-18T00:59:46.6037341Z  2024-12-18T00:59:46.6037750Z  2024-12-18T00:59:46.6038134Z  2024-12-18T00:59:46.6038542Z  2024-12-18T00:59:46.6038958Z  2024-12-18T00:59:46.6039367Z  2024-12-18T00:59:46.6040319Z [18,821 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:46.6041475Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T00:59:46.6042895Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T00:59:46.6043739Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T00:59:46.6044818Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:59:46.6045740Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2024-12-18T00:59:46.6046651Z Compiling xla/service/copy_insertion.cc; 21s local 2024-12-18T00:59:46.6047553Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2024-12-18T00:59:46.6048595Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local ... 2024-12-18T00:59:47.0039891Z 2024-12-18T00:59:47.0040774Z  2024-12-18T00:59:47.0041250Z  2024-12-18T00:59:47.0041648Z  2024-12-18T00:59:47.0042051Z  2024-12-18T00:59:47.0042425Z  2024-12-18T00:59:47.0042828Z  2024-12-18T00:59:47.0043189Z  2024-12-18T00:59:47.0043602Z  2024-12-18T00:59:47.0044855Z [18,822 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:47.0046016Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T00:59:47.0046920Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T00:59:47.0047751Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T00:59:47.0048526Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2024-12-18T00:59:47.0049381Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:59:47.0050226Z Compiling xla/service/copy_insertion.cc; 21s local 2024-12-18T00:59:47.0051053Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2024-12-18T00:59:47.0051997Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local ... 2024-12-18T00:59:47.2733370Z 2024-12-18T00:59:47.2734273Z  2024-12-18T00:59:47.2734759Z  2024-12-18T00:59:47.2735173Z  2024-12-18T00:59:47.2735817Z  2024-12-18T00:59:47.2736177Z  2024-12-18T00:59:47.2736774Z  2024-12-18T00:59:47.2737139Z  2024-12-18T00:59:47.2737510Z  2024-12-18T00:59:47.2738382Z [18,823 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:47.2739464Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T00:59:47.2740416Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T00:59:47.2741195Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T00:59:47.2741970Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:59:47.2742844Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2024-12-18T00:59:47.2743722Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:59:47.2744829Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2024-12-18T00:59:47.2755501Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local ... 2024-12-18T00:59:47.5316644Z 2024-12-18T00:59:47.5317768Z  2024-12-18T00:59:47.5318286Z  2024-12-18T00:59:47.5318676Z  2024-12-18T00:59:47.5319083Z  2024-12-18T00:59:47.5319485Z  2024-12-18T00:59:47.5319884Z  2024-12-18T00:59:47.5320265Z  2024-12-18T00:59:47.5320621Z  2024-12-18T00:59:47.5321552Z [18,825 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:47.5322653Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T00:59:47.5323615Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T00:59:47.5324420Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T00:59:47.5325112Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:59:47.5325993Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:59:47.5326869Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2024-12-18T00:59:47.5328028Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2024-12-18T00:59:47.5328952Z @llvm-project//mlir:ArithTransforms; 16s local ... 2024-12-18T00:59:47.7788928Z 2024-12-18T00:59:47.7789851Z  2024-12-18T00:59:47.7790343Z  2024-12-18T00:59:47.7790769Z  2024-12-18T00:59:47.7791161Z  2024-12-18T00:59:47.7791552Z  2024-12-18T00:59:47.7791950Z  2024-12-18T00:59:47.7792342Z  2024-12-18T00:59:47.7792731Z  2024-12-18T00:59:47.7793655Z [18,828 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:47.7794786Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2024-12-18T00:59:47.7795758Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T00:59:47.7796621Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T00:59:47.7797340Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:59:47.7798101Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:59:47.7798962Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2024-12-18T00:59:47.7799927Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T00:59:47.7800722Z @llvm-project//mlir:ArithTransforms; 16s local ... 2024-12-18T00:59:48.0047620Z 2024-12-18T00:59:48.0048468Z  2024-12-18T00:59:48.0048928Z  2024-12-18T00:59:48.0049325Z  2024-12-18T00:59:48.0049634Z  2024-12-18T00:59:48.0049988Z  2024-12-18T00:59:48.0050370Z  2024-12-18T00:59:48.0050745Z  2024-12-18T00:59:48.0051125Z  2024-12-18T00:59:48.0052083Z [18,828 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:48.0053208Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2024-12-18T00:59:48.0054136Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:59:48.0054923Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T00:59:48.0056031Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2024-12-18T00:59:48.0056976Z Compiling xla/service/copy_insertion.cc; 22s local 2024-12-18T00:59:48.0057791Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2024-12-18T00:59:48.0058680Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T00:59:48.0059441Z @llvm-project//mlir:ArithTransforms; 17s local ... 2024-12-18T00:59:48.3015588Z 2024-12-18T00:59:48.3016680Z  2024-12-18T00:59:48.3017224Z  2024-12-18T00:59:48.3017724Z  2024-12-18T00:59:48.3018108Z  2024-12-18T00:59:48.3018506Z  2024-12-18T00:59:48.3018886Z  2024-12-18T00:59:48.3019250Z  2024-12-18T00:59:48.3019632Z  2024-12-18T00:59:48.3020569Z [18,830 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:48.3021671Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2024-12-18T00:59:48.3022914Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:59:48.3023870Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T00:59:48.3024714Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:59:48.3025420Z Compiling xla/service/copy_insertion.cc; 23s local 2024-12-18T00:59:48.3026244Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2024-12-18T00:59:48.3027249Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T00:59:48.3028170Z @llvm-project//mlir:ArithTransforms; 17s local ... 2024-12-18T00:59:48.6059108Z 2024-12-18T00:59:48.6060032Z  2024-12-18T00:59:48.6060505Z  2024-12-18T00:59:48.6060905Z  2024-12-18T00:59:48.6061301Z  2024-12-18T00:59:48.6061685Z  2024-12-18T00:59:48.6062060Z  2024-12-18T00:59:48.6062449Z  2024-12-18T00:59:48.6062829Z  2024-12-18T00:59:48.6063775Z [18,830 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:48.6065224Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T00:59:48.6066115Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:59:48.6066918Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T00:59:48.6067686Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:59:48.6068457Z Compiling xla/service/copy_insertion.cc; 23s local 2024-12-18T00:59:48.6069343Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2024-12-18T00:59:48.6070313Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T00:59:48.6071120Z @llvm-project//mlir:ArithTransforms; 17s local ... 2024-12-18T00:59:48.8123279Z 2024-12-18T00:59:48.8124159Z  2024-12-18T00:59:48.8124645Z  2024-12-18T00:59:48.8125024Z  2024-12-18T00:59:48.8125399Z  2024-12-18T00:59:48.8125751Z  2024-12-18T00:59:48.8126145Z  2024-12-18T00:59:48.8126486Z  2024-12-18T00:59:48.8126888Z  2024-12-18T00:59:48.8127771Z [18,831 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:48.8128809Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T00:59:48.8129699Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T00:59:48.8130515Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T00:59:48.8131279Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:59:48.8132161Z Compiling xla/service/copy_insertion.cc; 23s local 2024-12-18T00:59:48.8133028Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2024-12-18T00:59:48.8133965Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T00:59:48.8134888Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T00:59:49.2057525Z 2024-12-18T00:59:49.2058664Z  2024-12-18T00:59:49.2059050Z  2024-12-18T00:59:49.2059381Z  2024-12-18T00:59:49.2059737Z  2024-12-18T00:59:49.2060054Z  2024-12-18T00:59:49.2060352Z  2024-12-18T00:59:49.2060674Z  2024-12-18T00:59:49.2061145Z  2024-12-18T00:59:49.2061887Z [18,831 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:49.2062763Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T00:59:49.2063475Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T00:59:49.2064085Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T00:59:49.2064684Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2024-12-18T00:59:49.2065273Z Compiling xla/service/copy_insertion.cc; 24s local 2024-12-18T00:59:49.2065950Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2024-12-18T00:59:49.2066687Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T00:59:49.2067573Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T00:59:49.4334749Z 2024-12-18T00:59:49.4335599Z  2024-12-18T00:59:49.4336046Z  2024-12-18T00:59:49.4336579Z  2024-12-18T00:59:49.4336947Z  2024-12-18T00:59:49.4337317Z  2024-12-18T00:59:49.4337701Z  2024-12-18T00:59:49.4338061Z  2024-12-18T00:59:49.4338431Z  2024-12-18T00:59:49.4339277Z [18,832 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:49.4340326Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T00:59:49.4341211Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T00:59:49.4342012Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T00:59:49.4342719Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:49.4343506Z Compiling xla/service/copy_insertion.cc; 24s local 2024-12-18T00:59:49.4344641Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2024-12-18T00:59:49.4345944Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T00:59:49.4346816Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T00:59:49.7109611Z 2024-12-18T00:59:49.7110501Z  2024-12-18T00:59:49.7110954Z  2024-12-18T00:59:49.7111330Z  2024-12-18T00:59:49.7111696Z  2024-12-18T00:59:49.7112095Z  2024-12-18T00:59:49.7112472Z  2024-12-18T00:59:49.7112867Z  2024-12-18T00:59:49.7113237Z  2024-12-18T00:59:49.7114139Z [18,833 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:49.7115252Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T00:59:49.7116201Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T00:59:49.7116969Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T00:59:49.7117776Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:49.7118604Z Compiling xla/service/copy_insertion.cc; 24s local 2024-12-18T00:59:49.7119492Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2024-12-18T00:59:49.7120382Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T00:59:49.7121230Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2024-12-18T00:59:49.9125544Z 2024-12-18T00:59:49.9126384Z  2024-12-18T00:59:49.9126701Z  2024-12-18T00:59:49.9126961Z  2024-12-18T00:59:49.9127217Z  2024-12-18T00:59:49.9127455Z  2024-12-18T00:59:49.9127708Z  2024-12-18T00:59:49.9127957Z  2024-12-18T00:59:49.9128213Z  2024-12-18T00:59:49.9128787Z [18,834 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:49.9129441Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T00:59:49.9130205Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T00:59:49.9130722Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T00:59:49.9131188Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:49.9131711Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2024-12-18T00:59:49.9132276Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T00:59:49.9132786Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local 2024-12-18T00:59:49.9133289Z Compiling xla/service/llvm_ir/llvm_util.cc; 14s local ... 2024-12-18T00:59:50.2064047Z 2024-12-18T00:59:50.2064884Z  2024-12-18T00:59:50.2065386Z  2024-12-18T00:59:50.2065789Z  2024-12-18T00:59:50.2066199Z  2024-12-18T00:59:50.2066583Z  2024-12-18T00:59:50.2066987Z  2024-12-18T00:59:50.2067397Z  2024-12-18T00:59:50.2067802Z  2024-12-18T00:59:50.2068743Z [18,836 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:50.2070190Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T00:59:50.2071197Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T00:59:50.2072064Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T00:59:50.2072869Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2024-12-18T00:59:50.2073761Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2024-12-18T00:59:50.2074730Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T00:59:50.2075652Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local 2024-12-18T00:59:50.2076532Z Compiling xla/service/llvm_ir/llvm_util.cc; 15s local ... 2024-12-18T00:59:50.8670480Z 2024-12-18T00:59:50.8671437Z  2024-12-18T00:59:50.8671885Z  2024-12-18T00:59:50.8672262Z  2024-12-18T00:59:50.8672657Z  2024-12-18T00:59:50.8673040Z  2024-12-18T00:59:50.8673470Z  2024-12-18T00:59:50.8673962Z  2024-12-18T00:59:50.8674321Z  2024-12-18T00:59:50.8675572Z [18,837 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:50.8676619Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T00:59:50.8677537Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:59:50.8678352Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T00:59:50.8679139Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:59:50.8680026Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2024-12-18T00:59:50.8680936Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T00:59:50.8681614Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2024-12-18T00:59:50.8682401Z Compiling xla/service/llvm_ir/llvm_util.cc; 15s local ... 2024-12-18T00:59:51.1050426Z 2024-12-18T00:59:51.1051472Z  2024-12-18T00:59:51.1051995Z  2024-12-18T00:59:51.1052398Z  2024-12-18T00:59:51.1052797Z  2024-12-18T00:59:51.1053196Z  2024-12-18T00:59:51.1053550Z  2024-12-18T00:59:51.1053913Z  2024-12-18T00:59:51.1054282Z  2024-12-18T00:59:51.1055182Z [18,839 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:51.1056294Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T00:59:51.1057352Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:59:51.1058185Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T00:59:51.1058969Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2024-12-18T00:59:51.1059858Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2024-12-18T00:59:51.1060803Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T00:59:51.1061666Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2024-12-18T00:59:51.1062868Z Compiling xla/service/llvm_ir/llvm_util.cc; 16s local ... 2024-12-18T00:59:51.4073464Z 2024-12-18T00:59:51.4074356Z  2024-12-18T00:59:51.4074853Z  2024-12-18T00:59:51.4075239Z  2024-12-18T00:59:51.4075653Z  2024-12-18T00:59:51.4076057Z  2024-12-18T00:59:51.4076450Z  2024-12-18T00:59:51.4076846Z  2024-12-18T00:59:51.4077249Z  2024-12-18T00:59:51.4078206Z [18,839 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:51.4079377Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T00:59:51.4080382Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:59:51.4081235Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T00:59:51.4081955Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:59:51.4082847Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2024-12-18T00:59:51.4083930Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T00:59:51.4085097Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2024-12-18T00:59:51.4085905Z Compiling xla/service/llvm_ir/llvm_util.cc; 16s local ... 2024-12-18T00:59:51.7885669Z 2024-12-18T00:59:51.7886561Z  2024-12-18T00:59:51.7887052Z  2024-12-18T00:59:51.7887443Z  2024-12-18T00:59:51.7887794Z  2024-12-18T00:59:51.7888172Z  2024-12-18T00:59:51.7888533Z  2024-12-18T00:59:51.7888906Z  2024-12-18T00:59:51.7889262Z  2024-12-18T00:59:51.7890181Z [18,841 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:51.7891361Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T00:59:51.7892273Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T00:59:51.7893054Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T00:59:51.7893794Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:59:51.7894854Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2024-12-18T00:59:51.7895940Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T00:59:51.7896979Z Compiling xla/service/llvm_ir/llvm_util.cc; 16s local 2024-12-18T00:59:51.7897757Z Compiling xla/service/compilation_cache.cc; 15s local ... 2024-12-18T00:59:52.0078022Z 2024-12-18T00:59:52.0078911Z  2024-12-18T00:59:52.0079398Z  2024-12-18T00:59:52.0079778Z  2024-12-18T00:59:52.0080173Z  2024-12-18T00:59:52.0080565Z  2024-12-18T00:59:52.0080940Z  2024-12-18T00:59:52.0081325Z  2024-12-18T00:59:52.0081706Z  2024-12-18T00:59:52.0082615Z [18,841 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:52.0083671Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T00:59:52.0084543Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2024-12-18T00:59:52.0085487Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T00:59:52.0086142Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2024-12-18T00:59:52.0086953Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2024-12-18T00:59:52.0087938Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T00:59:52.0088774Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local 2024-12-18T00:59:52.0089616Z Compiling xla/service/compilation_cache.cc; 15s local ... 2024-12-18T00:59:52.4081753Z 2024-12-18T00:59:52.4082638Z  2024-12-18T00:59:52.4083116Z  2024-12-18T00:59:52.4083517Z  2024-12-18T00:59:52.4083893Z  2024-12-18T00:59:52.4084248Z  2024-12-18T00:59:52.4084633Z  2024-12-18T00:59:52.4085030Z  2024-12-18T00:59:52.4085424Z  2024-12-18T00:59:52.4086340Z [18,842 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:52.4087694Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T00:59:52.4088605Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2024-12-18T00:59:52.4089389Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T00:59:52.4090130Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:59:52.4090940Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2024-12-18T00:59:52.4091898Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T00:59:52.4092729Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local 2024-12-18T00:59:52.4093519Z Compiling xla/service/compilation_cache.cc; 15s local ... 2024-12-18T00:59:52.6454688Z 2024-12-18T00:59:52.6455517Z  2024-12-18T00:59:52.6455914Z  2024-12-18T00:59:52.6456237Z  2024-12-18T00:59:52.6456735Z  2024-12-18T00:59:52.6457085Z  2024-12-18T00:59:52.6457419Z  2024-12-18T00:59:52.6457731Z  2024-12-18T00:59:52.6458085Z  2024-12-18T00:59:52.6459139Z [18,843 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:52.6460080Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T00:59:52.6460907Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2024-12-18T00:59:52.6461514Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T00:59:52.6462110Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:59:52.6462935Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2024-12-18T00:59:52.6463711Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T00:59:52.6464514Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local 2024-12-18T00:59:52.6465176Z @llvm-project//llvm:X86CodeGen; 14s local ... 2024-12-18T00:59:52.9691511Z 2024-12-18T00:59:52.9692635Z  2024-12-18T00:59:52.9693126Z  2024-12-18T00:59:52.9693540Z  2024-12-18T00:59:52.9693984Z  2024-12-18T00:59:52.9694393Z  2024-12-18T00:59:52.9695133Z  2024-12-18T00:59:52.9695551Z  2024-12-18T00:59:52.9695955Z  2024-12-18T00:59:52.9697173Z [18,845 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:52.9698372Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T00:59:52.9699375Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T00:59:52.9700267Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T00:59:52.9701055Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:59:52.9701979Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2024-12-18T00:59:52.9703019Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T00:59:52.9704166Z Compiling llvm/lib/Target/X86/X86SpeculativeLoadHardening.cpp; 14s local 2024-12-18T00:59:52.9705335Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 13s local ... 2024-12-18T00:59:53.2088098Z 2024-12-18T00:59:53.2089032Z  2024-12-18T00:59:53.2089530Z  2024-12-18T00:59:53.2089949Z  2024-12-18T00:59:53.2090359Z  2024-12-18T00:59:53.2090758Z  2024-12-18T00:59:53.2091178Z  2024-12-18T00:59:53.2091591Z  2024-12-18T00:59:53.2092000Z  2024-12-18T00:59:53.2092959Z [18,846 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:53.2094117Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T00:59:53.2095118Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T00:59:53.2095963Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T00:59:53.2096921Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2024-12-18T00:59:53.2097879Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2024-12-18T00:59:53.2098877Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T00:59:53.2100233Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 13s local 2024-12-18T00:59:53.2101166Z Compiling xla/service/llvm_ir/ir_array.cc; 12s local ... 2024-12-18T00:59:53.6092320Z 2024-12-18T00:59:53.6093151Z  2024-12-18T00:59:53.6093582Z  2024-12-18T00:59:53.6093933Z  2024-12-18T00:59:53.6094319Z  2024-12-18T00:59:53.6094813Z  2024-12-18T00:59:53.6095164Z  2024-12-18T00:59:53.6095529Z  2024-12-18T00:59:53.6096068Z  2024-12-18T00:59:53.6097107Z [18,847 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:53.6098098Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2024-12-18T00:59:53.6098912Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T00:59:53.6099638Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2024-12-18T00:59:53.6100312Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:59:53.6101462Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2024-12-18T00:59:53.6102333Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T00:59:53.6103107Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 14s local 2024-12-18T00:59:53.6103941Z Compiling xla/service/llvm_ir/ir_array.cc; 13s local ... 2024-12-18T00:59:53.9173746Z 2024-12-18T00:59:53.9174626Z  2024-12-18T00:59:53.9174986Z  2024-12-18T00:59:53.9175295Z  2024-12-18T00:59:53.9175603Z  2024-12-18T00:59:53.9175918Z  2024-12-18T00:59:53.9176221Z  2024-12-18T00:59:53.9176664Z  2024-12-18T00:59:53.9176975Z  2024-12-18T00:59:53.9177678Z [18,850 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:53.9178504Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2024-12-18T00:59:53.9179181Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T00:59:53.9180118Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2024-12-18T00:59:53.9180734Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:59:53.9181620Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2024-12-18T00:59:53.9182297Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2024-12-18T00:59:53.9182970Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 14s local 2024-12-18T00:59:53.9183623Z Compiling xla/service/llvm_ir/ir_array.cc; 13s local ... 2024-12-18T00:59:54.2097649Z 2024-12-18T00:59:54.2098563Z  2024-12-18T00:59:54.2099059Z  2024-12-18T00:59:54.2099483Z  2024-12-18T00:59:54.2099887Z  2024-12-18T00:59:54.2100291Z  2024-12-18T00:59:54.2100678Z  2024-12-18T00:59:54.2101096Z  2024-12-18T00:59:54.2101502Z  2024-12-18T00:59:54.2102466Z [18,852 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:54.2103616Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T00:59:54.2104501Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2024-12-18T00:59:54.2105329Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2024-12-18T00:59:54.2106274Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2024-12-18T00:59:54.2107275Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2024-12-18T00:59:54.2108345Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 14s local 2024-12-18T00:59:54.2109202Z Compiling xla/service/llvm_ir/ir_array.cc; 13s local 2024-12-18T00:59:54.2110099Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 11s local ... 2024-12-18T00:59:54.6838543Z 2024-12-18T00:59:54.6839404Z  2024-12-18T00:59:54.6839838Z  2024-12-18T00:59:54.6840311Z  2024-12-18T00:59:54.6840679Z  2024-12-18T00:59:54.6841046Z  2024-12-18T00:59:54.6841415Z  2024-12-18T00:59:54.6841780Z  2024-12-18T00:59:54.6842415Z  2024-12-18T00:59:54.6843320Z [18,853 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:54.6844522Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T00:59:54.6845294Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T00:59:54.6846031Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:59:54.6846822Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2024-12-18T00:59:54.6847692Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2024-12-18T00:59:54.6848553Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 15s local 2024-12-18T00:59:54.6849308Z Compiling xla/service/llvm_ir/ir_array.cc; 14s local 2024-12-18T00:59:54.6850097Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local ... 2024-12-18T00:59:55.0104110Z 2024-12-18T00:59:55.0105021Z  2024-12-18T00:59:55.0105440Z  2024-12-18T00:59:55.0105808Z  2024-12-18T00:59:55.0106211Z  2024-12-18T00:59:55.0106576Z  2024-12-18T00:59:55.0107238Z  2024-12-18T00:59:55.0107601Z  2024-12-18T00:59:55.0107963Z  2024-12-18T00:59:55.0108848Z [18,854 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:55.0109764Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T00:59:55.0110506Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T00:59:55.0111245Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2024-12-18T00:59:55.0112021Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2024-12-18T00:59:55.0112954Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T00:59:55.0113780Z Compiling xla/service/llvm_ir/ir_array.cc; 14s local 2024-12-18T00:59:55.0114575Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local 2024-12-18T00:59:55.0115418Z @llvm-project//mlir:BuiltinToLLVMIRTranslation; 12s local ... 2024-12-18T00:59:55.2428503Z 2024-12-18T00:59:55.2429433Z  2024-12-18T00:59:55.2430419Z  2024-12-18T00:59:55.2430884Z  2024-12-18T00:59:55.2431298Z  2024-12-18T00:59:55.2431680Z  2024-12-18T00:59:55.2432066Z  2024-12-18T00:59:55.2432471Z  2024-12-18T00:59:55.2432880Z  2024-12-18T00:59:55.2433878Z [18,857 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:55.2434937Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T00:59:55.2435771Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T00:59:55.2436610Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:55.2437571Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2024-12-18T00:59:55.2438548Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T00:59:55.2439445Z Compiling xla/service/llvm_ir/ir_array.cc; 14s local 2024-12-18T00:59:55.2440301Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 12s local 2024-12-18T00:59:55.2441341Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local ... 2024-12-18T00:59:55.6109865Z 2024-12-18T00:59:55.6110799Z  2024-12-18T00:59:55.6111309Z  2024-12-18T00:59:55.6111703Z  2024-12-18T00:59:55.6112130Z  2024-12-18T00:59:55.6112573Z  2024-12-18T00:59:55.6112991Z  2024-12-18T00:59:55.6113370Z  2024-12-18T00:59:55.6113724Z  2024-12-18T00:59:55.6114740Z [18,857 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:55.6115777Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T00:59:55.6116683Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T00:59:55.6117541Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:55.6118413Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:55.6119737Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T00:59:55.6120561Z Compiling xla/service/llvm_ir/ir_array.cc; 15s local 2024-12-18T00:59:55.6121478Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:59:55.6122535Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 12s local ... 2024-12-18T00:59:55.8112953Z 2024-12-18T00:59:55.8113873Z  2024-12-18T00:59:55.8114334Z  2024-12-18T00:59:55.8114773Z  2024-12-18T00:59:55.8115177Z  2024-12-18T00:59:55.8115598Z  2024-12-18T00:59:55.8115988Z  2024-12-18T00:59:55.8116399Z  2024-12-18T00:59:55.8116817Z  2024-12-18T00:59:55.8117794Z [18,858 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:55.8118895Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T00:59:55.8119846Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T00:59:55.8120690Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:55.8121866Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:55.8122881Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T00:59:55.8123775Z Compiling xla/service/llvm_ir/ir_array.cc; 15s local 2024-12-18T00:59:55.8124608Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:59:55.8125667Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local ... 2024-12-18T00:59:56.0763906Z 2024-12-18T00:59:56.0764816Z  2024-12-18T00:59:56.0765321Z  2024-12-18T00:59:56.0765752Z  2024-12-18T00:59:56.0766163Z  2024-12-18T00:59:56.0766556Z  2024-12-18T00:59:56.0766950Z  2024-12-18T00:59:56.0767356Z  2024-12-18T00:59:56.0767777Z  2024-12-18T00:59:56.0768866Z [18,860 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:56.0769922Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:59:56.0771142Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T00:59:56.0771934Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2024-12-18T00:59:56.0772834Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:56.0773786Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T00:59:56.0774593Z Compiling xla/service/llvm_ir/ir_array.cc; 15s local 2024-12-18T00:59:56.0775418Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:59:56.0776573Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local ... 2024-12-18T00:59:56.3180144Z 2024-12-18T00:59:56.3181048Z  2024-12-18T00:59:56.3181533Z  2024-12-18T00:59:56.3182004Z  2024-12-18T00:59:56.3182422Z  2024-12-18T00:59:56.3182846Z  2024-12-18T00:59:56.3183231Z  2024-12-18T00:59:56.3183619Z  2024-12-18T00:59:56.3184027Z  2024-12-18T00:59:56.3185065Z [18,862 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:56.3186058Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:59:56.3186893Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T00:59:56.3187663Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:59:56.3188479Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2024-12-18T00:59:56.3189385Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T00:59:56.3190182Z Compiling xla/service/llvm_ir/ir_array.cc; 15s local 2024-12-18T00:59:56.3190972Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 13s local 2024-12-18T00:59:56.3191972Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local ... 2024-12-18T00:59:56.6119200Z 2024-12-18T00:59:56.6120135Z  2024-12-18T00:59:56.6120612Z  2024-12-18T00:59:56.6120996Z  2024-12-18T00:59:56.6121823Z  2024-12-18T00:59:56.6122212Z  2024-12-18T00:59:56.6122643Z  2024-12-18T00:59:56.6123076Z  2024-12-18T00:59:56.6123488Z  2024-12-18T00:59:56.6124462Z [18,863 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:56.6125496Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:59:56.6126317Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T00:59:56.6127076Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:59:56.6127936Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2024-12-18T00:59:56.6128910Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T00:59:56.6129856Z Compiling xla/service/llvm_ir/ir_array.cc; 16s local 2024-12-18T00:59:56.6130722Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:59:56.6131770Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local ... 2024-12-18T00:59:56.8122248Z 2024-12-18T00:59:56.8123087Z  2024-12-18T00:59:56.8123765Z  2024-12-18T00:59:56.8124152Z  2024-12-18T00:59:56.8124523Z  2024-12-18T00:59:56.8124890Z  2024-12-18T00:59:56.8125250Z  2024-12-18T00:59:56.8125621Z  2024-12-18T00:59:56.8125990Z  2024-12-18T00:59:56.8126849Z [18,864 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:56.8127782Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T00:59:56.8128516Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T00:59:56.8129240Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:59:56.8130073Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2024-12-18T00:59:56.8130924Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:59:56.8131810Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:59:56.8134738Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:59:56.8135948Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 13s local ... 2024-12-18T00:59:57.0256225Z 2024-12-18T00:59:57.0257258Z  2024-12-18T00:59:57.0257698Z  2024-12-18T00:59:57.0258154Z  2024-12-18T00:59:57.0258635Z  2024-12-18T00:59:57.0259111Z  2024-12-18T00:59:57.0259574Z  2024-12-18T00:59:57.0260016Z  2024-12-18T00:59:57.0260393Z  2024-12-18T00:59:57.0261273Z [18,867 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:57.0262296Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T00:59:57.0263107Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T00:59:57.0263942Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2024-12-18T00:59:57.0264828Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2024-12-18T00:59:57.0265841Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:59:57.0266749Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:59:57.0267730Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:59:57.0268793Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local ... 2024-12-18T00:59:57.3833671Z 2024-12-18T00:59:57.3834591Z  2024-12-18T00:59:57.3835040Z  2024-12-18T00:59:57.3835434Z  2024-12-18T00:59:57.3835810Z  2024-12-18T00:59:57.3836194Z  2024-12-18T00:59:57.3836572Z  2024-12-18T00:59:57.3836951Z  2024-12-18T00:59:57.3837334Z  2024-12-18T00:59:57.3838265Z [18,868 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:57.3839305Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T00:59:57.3840063Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T00:59:57.3841075Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:59:57.3841972Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2024-12-18T00:59:57.3842880Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:59:57.3843741Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:59:57.3844906Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:59:57.3845930Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local ... 2024-12-18T00:59:57.5960817Z 2024-12-18T00:59:57.5961744Z  2024-12-18T00:59:57.5962291Z  2024-12-18T00:59:57.5962740Z  2024-12-18T00:59:57.5963200Z  2024-12-18T00:59:57.5963630Z  2024-12-18T00:59:57.5963978Z  2024-12-18T00:59:57.5964385Z  2024-12-18T00:59:57.5964825Z  2024-12-18T00:59:57.5965917Z [18,870 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:57.5967462Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T00:59:57.5968132Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T00:59:57.5968795Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:59:57.5969577Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:59:57.5970444Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T00:59:57.5971309Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 14s local 2024-12-18T00:59:57.5972202Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2024-12-18T00:59:57.5973270Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local ... 2024-12-18T00:59:57.8130146Z 2024-12-18T00:59:57.8131019Z  2024-12-18T00:59:57.8131493Z  2024-12-18T00:59:57.8131856Z  2024-12-18T00:59:57.8132241Z  2024-12-18T00:59:57.8132637Z  2024-12-18T00:59:57.8133036Z  2024-12-18T00:59:57.8133434Z  2024-12-18T00:59:57.8133851Z  2024-12-18T00:59:57.8135060Z [18,870 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:57.8136245Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T00:59:57.8137228Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T00:59:57.8137970Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:59:57.8138881Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:59:57.8139859Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T00:59:57.8140922Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:59:57.8141935Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:59:57.8143020Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local ... 2024-12-18T00:59:58.0133280Z 2024-12-18T00:59:58.0134178Z  2024-12-18T00:59:58.0134695Z  2024-12-18T00:59:58.0135106Z  2024-12-18T00:59:58.0135476Z  2024-12-18T00:59:58.0135909Z  2024-12-18T00:59:58.0136260Z  2024-12-18T00:59:58.0136784Z  2024-12-18T00:59:58.0137161Z  2024-12-18T00:59:58.0138079Z [18,872 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:58.0139091Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T00:59:58.0139897Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T00:59:58.0140648Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2024-12-18T00:59:58.0141540Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:59:58.0142438Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T00:59:58.0143215Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:59:58.0144544Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:59:58.0145866Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 15s local ... 2024-12-18T00:59:58.3169386Z 2024-12-18T00:59:58.3170342Z  2024-12-18T00:59:58.3170945Z  2024-12-18T00:59:58.3171471Z  2024-12-18T00:59:58.3171894Z  2024-12-18T00:59:58.3172243Z  2024-12-18T00:59:58.3172620Z  2024-12-18T00:59:58.3173002Z  2024-12-18T00:59:58.3173391Z  2024-12-18T00:59:58.3174298Z [18,874 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:58.3175344Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T00:59:58.3176161Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T00:59:58.3177149Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:58.3178077Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2024-12-18T00:59:58.3179051Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T00:59:58.3180014Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:59:58.3181293Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:59:58.3182432Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 15s local ... 2024-12-18T00:59:58.5290296Z 2024-12-18T00:59:58.5291184Z  2024-12-18T00:59:58.5291666Z  2024-12-18T00:59:58.5292038Z  2024-12-18T00:59:58.5292382Z  2024-12-18T00:59:58.5292738Z  2024-12-18T00:59:58.5293112Z  2024-12-18T00:59:58.5293614Z  2024-12-18T00:59:58.5294107Z  2024-12-18T00:59:58.5295073Z [18,875 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:58.5296072Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T00:59:58.5297037Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T00:59:58.5297824Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:58.5298692Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:59:58.5300255Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T00:59:58.5301282Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 15s local 2024-12-18T00:59:58.5302306Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2024-12-18T00:59:58.5303574Z Compiling xla/service/cpu/onednn_memory_util.cc; 15s local ... 2024-12-18T00:59:58.8140826Z 2024-12-18T00:59:58.8141703Z  2024-12-18T00:59:58.8142250Z  2024-12-18T00:59:58.8142771Z  2024-12-18T00:59:58.8143282Z  2024-12-18T00:59:58.8143730Z  2024-12-18T00:59:58.8144365Z  2024-12-18T00:59:58.8144784Z  2024-12-18T00:59:58.8145151Z  2024-12-18T00:59:58.8146049Z [18,876 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:58.8147102Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T00:59:58.8147958Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T00:59:58.8148766Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:58.8149638Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:59:58.8150676Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T00:59:58.8151596Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:59:58.8152575Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2024-12-18T00:59:58.8153593Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 13s local ... 2024-12-18T00:59:59.0145478Z 2024-12-18T00:59:59.0146342Z  2024-12-18T00:59:59.0146807Z  2024-12-18T00:59:59.0147225Z  2024-12-18T00:59:59.0147605Z  2024-12-18T00:59:59.0148020Z  2024-12-18T00:59:59.0148429Z  2024-12-18T00:59:59.0148830Z  2024-12-18T00:59:59.0149226Z  2024-12-18T00:59:59.0150204Z [18,877 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:59.0151591Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:59:59.0152433Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T00:59:59.0153178Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2024-12-18T00:59:59.0154080Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:59:59.0155062Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T00:59:59.0155902Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:59:59.0156943Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2024-12-18T00:59:59.0157899Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 13s local ... 2024-12-18T00:59:59.2443958Z 2024-12-18T00:59:59.2445011Z  2024-12-18T00:59:59.2445488Z  2024-12-18T00:59:59.2445863Z  2024-12-18T00:59:59.2446246Z  2024-12-18T00:59:59.2446622Z  2024-12-18T00:59:59.2447012Z  2024-12-18T00:59:59.2447406Z  2024-12-18T00:59:59.2447778Z  2024-12-18T00:59:59.2448951Z [18,878 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:59.2449892Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:59:59.2450821Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T00:59:59.2451594Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:59:59.2452398Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:59:59.2453256Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T00:59:59.2454160Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:59:59.2454996Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2024-12-18T00:59:59.2455869Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 14s local ... 2024-12-18T00:59:59.4561968Z 2024-12-18T00:59:59.4562879Z  2024-12-18T00:59:59.4563376Z  2024-12-18T00:59:59.4563823Z  2024-12-18T00:59:59.4564677Z  2024-12-18T00:59:59.4565050Z  2024-12-18T00:59:59.4565421Z  2024-12-18T00:59:59.4565764Z  2024-12-18T00:59:59.4566174Z  2024-12-18T00:59:59.4567198Z [18,880 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T00:59:59.4568223Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:59:59.4568930Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T00:59:59.4569622Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:59:59.4570603Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2024-12-18T00:59:59.4571671Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T00:59:59.4572544Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 16s local 2024-12-18T00:59:59.4573400Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 14s local 2024-12-18T00:59:59.4574291Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 12s local ... 2024-12-18T00:59:59.8151300Z 2024-12-18T00:59:59.8152174Z  2024-12-18T00:59:59.8152571Z  2024-12-18T00:59:59.8152902Z  2024-12-18T00:59:59.8153249Z  2024-12-18T00:59:59.8153638Z  2024-12-18T00:59:59.8154025Z  2024-12-18T00:59:59.8154444Z  2024-12-18T00:59:59.8154766Z  2024-12-18T00:59:59.8155624Z [18,880 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T00:59:59.8156710Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T00:59:59.8157671Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T00:59:59.8158544Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T00:59:59.8159415Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T00:59:59.8160402Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T00:59:59.8161662Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T00:59:59.8162535Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 14s local 2024-12-18T00:59:59.8163325Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 12s local ... 2024-12-18T01:00:00.0154097Z 2024-12-18T01:00:00.0155006Z  2024-12-18T01:00:00.0155477Z  2024-12-18T01:00:00.0155843Z  2024-12-18T01:00:00.0156218Z  2024-12-18T01:00:00.0156606Z  2024-12-18T01:00:00.0156990Z  2024-12-18T01:00:00.0157366Z  2024-12-18T01:00:00.0157761Z  2024-12-18T01:00:00.0158670Z [18,881 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:00.0159725Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T01:00:00.0160553Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T01:00:00.0161311Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2024-12-18T01:00:00.0162187Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T01:00:00.0163417Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T01:00:00.0164167Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T01:00:00.0164923Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 14s local 2024-12-18T01:00:00.0165722Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 12s local ... 2024-12-18T01:00:00.4437624Z 2024-12-18T01:00:00.4438459Z  2024-12-18T01:00:00.4438878Z  2024-12-18T01:00:00.4439253Z  2024-12-18T01:00:00.4439636Z  2024-12-18T01:00:00.4439994Z  2024-12-18T01:00:00.4448706Z  2024-12-18T01:00:00.4449303Z  2024-12-18T01:00:00.4449673Z  2024-12-18T01:00:00.4450495Z [18,882 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:00.4451377Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T01:00:00.4452085Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T01:00:00.4453074Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T01:00:00.4453922Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2024-12-18T01:00:00.4454765Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T01:00:00.4455540Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2024-12-18T01:00:00.4456246Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 15s local 2024-12-18T01:00:00.4457170Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 13s local ... 2024-12-18T01:00:00.8159197Z 2024-12-18T01:00:00.8160048Z  2024-12-18T01:00:00.8160452Z  2024-12-18T01:00:00.8160798Z  2024-12-18T01:00:00.8161161Z  2024-12-18T01:00:00.8161533Z  2024-12-18T01:00:00.8161899Z  2024-12-18T01:00:00.8162252Z  2024-12-18T01:00:00.8162579Z  2024-12-18T01:00:00.8163415Z [18,883 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:00.8164417Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T01:00:00.8165189Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2024-12-18T01:00:00.8165903Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2024-12-18T01:00:00.8166700Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2024-12-18T01:00:00.8167520Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2024-12-18T01:00:00.8168321Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2024-12-18T01:00:00.8169079Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 15s local 2024-12-18T01:00:00.8169851Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 13s local ... 2024-12-18T01:00:01.8166579Z 2024-12-18T01:00:01.8167518Z  2024-12-18T01:00:01.8167991Z  2024-12-18T01:00:01.8168351Z  2024-12-18T01:00:01.8168684Z  2024-12-18T01:00:01.8169025Z  2024-12-18T01:00:01.8169410Z  2024-12-18T01:00:01.8170083Z  2024-12-18T01:00:01.8170452Z  2024-12-18T01:00:01.8171361Z [18,883 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:01.8172382Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2024-12-18T01:00:01.8173185Z Compiling stablehlo/dialect/VhloOps.cpp; 67s local 2024-12-18T01:00:01.8173909Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2024-12-18T01:00:01.8174738Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T01:00:01.8175634Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T01:00:01.8176606Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T01:00:01.8177378Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 16s local 2024-12-18T01:00:01.8178194Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local ... 2024-12-18T01:00:02.0734301Z 2024-12-18T01:00:02.0735165Z  2024-12-18T01:00:02.0735670Z  2024-12-18T01:00:02.0736088Z  2024-12-18T01:00:02.0736612Z  2024-12-18T01:00:02.0737258Z  2024-12-18T01:00:02.0737646Z  2024-12-18T01:00:02.0738028Z  2024-12-18T01:00:02.0738430Z  2024-12-18T01:00:02.0739351Z [18,885 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:02.0740278Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T01:00:02.0741067Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2024-12-18T01:00:02.0741947Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T01:00:02.0742898Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T01:00:02.0743757Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T01:00:02.0744863Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 16s local 2024-12-18T01:00:02.0745659Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2024-12-18T01:00:02.0746692Z Compiling mlir/lib/Target/LLVMIR/DebugTranslation.cpp; 14s local ... 2024-12-18T01:00:02.4169925Z 2024-12-18T01:00:02.4171125Z  2024-12-18T01:00:02.4171599Z  2024-12-18T01:00:02.4171954Z  2024-12-18T01:00:02.4172315Z  2024-12-18T01:00:02.4172662Z  2024-12-18T01:00:02.4173008Z  2024-12-18T01:00:02.4173374Z  2024-12-18T01:00:02.4173734Z  2024-12-18T01:00:02.4174562Z [18,886 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:02.4175570Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T01:00:02.4176344Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T01:00:02.4177323Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2024-12-18T01:00:02.4178257Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T01:00:02.4179262Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2024-12-18T01:00:02.4180035Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 17s local 2024-12-18T01:00:02.4180899Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2024-12-18T01:00:02.4181883Z Compiling mlir/lib/Target/LLVMIR/DebugTranslation.cpp; 14s local ... 2024-12-18T01:00:02.6170441Z 2024-12-18T01:00:02.6171951Z  2024-12-18T01:00:02.6172621Z  2024-12-18T01:00:02.6173257Z  2024-12-18T01:00:02.6174334Z  2024-12-18T01:00:02.6174752Z  2024-12-18T01:00:02.6175122Z  2024-12-18T01:00:02.6175491Z  2024-12-18T01:00:02.6175880Z  2024-12-18T01:00:02.6176968Z [18,887 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:02.6178000Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T01:00:02.6178803Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T01:00:02.6179677Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T01:00:02.6180601Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T01:00:02.6181974Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T01:00:02.6182781Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 17s local 2024-12-18T01:00:02.6183594Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2024-12-18T01:00:02.6184654Z Compiling mlir/lib/Target/LLVMIR/DebugTranslation.cpp; 14s local ... 2024-12-18T01:00:02.8614361Z 2024-12-18T01:00:02.8615206Z  2024-12-18T01:00:02.8615668Z  2024-12-18T01:00:02.8616055Z  2024-12-18T01:00:02.8616542Z  2024-12-18T01:00:02.8616879Z  2024-12-18T01:00:02.8617229Z  2024-12-18T01:00:02.8617579Z  2024-12-18T01:00:02.8617929Z  2024-12-18T01:00:02.8618764Z [18,888 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:02.8619690Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:00:02.8620423Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T01:00:02.8621504Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T01:00:02.8622380Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:02.8623166Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T01:00:02.8623898Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 17s local 2024-12-18T01:00:02.8624621Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2024-12-18T01:00:02.8625507Z Compiling mlir/lib/Target/LLVMIR/DebugTranslation.cpp; 15s local ... 2024-12-18T01:00:03.0674361Z 2024-12-18T01:00:03.0675280Z  2024-12-18T01:00:03.0675720Z  2024-12-18T01:00:03.0676088Z  2024-12-18T01:00:03.0676558Z  2024-12-18T01:00:03.0676913Z  2024-12-18T01:00:03.0677266Z  2024-12-18T01:00:03.0677618Z  2024-12-18T01:00:03.0678004Z  2024-12-18T01:00:03.0678833Z [18,890 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:03.0680004Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:00:03.0680892Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2024-12-18T01:00:03.0681688Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T01:00:03.0682545Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:03.0683316Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T01:00:03.0684049Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 17s local 2024-12-18T01:00:03.0684788Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2024-12-18T01:00:03.0685678Z Compiling mlir/lib/Target/LLVMIR/DebugTranslation.cpp; 15s local ... 2024-12-18T01:00:03.3704284Z 2024-12-18T01:00:03.3705172Z  2024-12-18T01:00:03.3705712Z  2024-12-18T01:00:03.3706097Z  2024-12-18T01:00:03.3706481Z  2024-12-18T01:00:03.3706845Z  2024-12-18T01:00:03.3707225Z  2024-12-18T01:00:03.3707746Z  2024-12-18T01:00:03.3708123Z  2024-12-18T01:00:03.3709057Z [18,892 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:03.3710058Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:00:03.3710857Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T01:00:03.3711832Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2024-12-18T01:00:03.3712795Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:03.3713655Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2024-12-18T01:00:03.3714460Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 18s local 2024-12-18T01:00:03.3715323Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2024-12-18T01:00:03.3716174Z @llvm-project//mlir:LLVMIRTransforms; 12s local ... 2024-12-18T01:00:03.6182495Z 2024-12-18T01:00:03.6183362Z  2024-12-18T01:00:03.6184365Z  2024-12-18T01:00:03.6184832Z  2024-12-18T01:00:03.6185207Z  2024-12-18T01:00:03.6185627Z  2024-12-18T01:00:03.6185957Z  2024-12-18T01:00:03.6186321Z  2024-12-18T01:00:03.6186665Z  2024-12-18T01:00:03.6187546Z [18,893 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:03.6188573Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:00:03.6189485Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T01:00:03.6190381Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T01:00:03.6191235Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:03.6192089Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T01:00:03.6192922Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 18s local 2024-12-18T01:00:03.6193768Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2024-12-18T01:00:03.6194662Z @llvm-project//mlir:LLVMIRTransforms; 12s local ... 2024-12-18T01:00:03.8185607Z 2024-12-18T01:00:03.8186518Z  2024-12-18T01:00:03.8186996Z  2024-12-18T01:00:03.8187374Z  2024-12-18T01:00:03.8187762Z  2024-12-18T01:00:03.8188144Z  2024-12-18T01:00:03.8188528Z  2024-12-18T01:00:03.8188931Z  2024-12-18T01:00:03.8189298Z  2024-12-18T01:00:03.8190232Z [18,895 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:03.8191267Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:00:03.8192085Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2024-12-18T01:00:03.8192963Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T01:00:03.8193911Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T01:00:03.8194788Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T01:00:03.8195604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 18s local 2024-12-18T01:00:03.8196647Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2024-12-18T01:00:03.8197632Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 12s local ... 2024-12-18T01:00:04.2372673Z 2024-12-18T01:00:04.2374655Z  2024-12-18T01:00:04.2378208Z  2024-12-18T01:00:04.2378911Z  2024-12-18T01:00:04.2379526Z  2024-12-18T01:00:04.2380643Z  2024-12-18T01:00:04.2381112Z  2024-12-18T01:00:04.2381521Z  2024-12-18T01:00:04.2381939Z  2024-12-18T01:00:04.2382868Z [18,896 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:04.2383962Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T01:00:04.2384940Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T01:00:04.2385852Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T01:00:04.2386777Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T01:00:04.2387716Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T01:00:04.2388482Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:04.2389313Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2024-12-18T01:00:04.2390205Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 12s local ... 2024-12-18T01:00:04.4496896Z 2024-12-18T01:00:04.4497784Z  2024-12-18T01:00:04.4498234Z  2024-12-18T01:00:04.4498648Z  2024-12-18T01:00:04.4499021Z  2024-12-18T01:00:04.4499414Z  2024-12-18T01:00:04.4499795Z  2024-12-18T01:00:04.4500187Z  2024-12-18T01:00:04.4500716Z  2024-12-18T01:00:04.4501629Z [18,897 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:04.4502636Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T01:00:04.4503474Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T01:00:04.4504606Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2024-12-18T01:00:04.4505573Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T01:00:04.4506428Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2024-12-18T01:00:04.4507270Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:04.4508107Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2024-12-18T01:00:04.4508996Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 12s local ... 2024-12-18T01:00:04.8189050Z 2024-12-18T01:00:04.8189870Z  2024-12-18T01:00:04.8190361Z  2024-12-18T01:00:04.8190764Z  2024-12-18T01:00:04.8191155Z  2024-12-18T01:00:04.8191539Z  2024-12-18T01:00:04.8191902Z  2024-12-18T01:00:04.8192295Z  2024-12-18T01:00:04.8192688Z  2024-12-18T01:00:04.8193601Z [18,899 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:00:04.8194980Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T01:00:04.8195811Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T01:00:04.8196663Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T01:00:04.8197639Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T01:00:04.8198556Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T01:00:04.8199360Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:04.8200192Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2024-12-18T01:00:04.8201089Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 13s local ... 2024-12-18T01:00:05.0192073Z 2024-12-18T01:00:05.0192874Z  2024-12-18T01:00:05.0193297Z  2024-12-18T01:00:05.0193646Z  2024-12-18T01:00:05.0193991Z  2024-12-18T01:00:05.0194336Z  2024-12-18T01:00:05.0194694Z  2024-12-18T01:00:05.0195058Z  2024-12-18T01:00:05.0195431Z  2024-12-18T01:00:05.0196548Z [18,900 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:05.0197547Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2024-12-18T01:00:05.0198249Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2024-12-18T01:00:05.0199035Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T01:00:05.0199906Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T01:00:05.0200688Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T01:00:05.0201391Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:05.0202128Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2024-12-18T01:00:05.0202883Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 13s local ... 2024-12-18T01:00:05.4019469Z 2024-12-18T01:00:05.4020303Z  2024-12-18T01:00:05.4020705Z  2024-12-18T01:00:05.4021079Z  2024-12-18T01:00:05.4021412Z  2024-12-18T01:00:05.4021744Z  2024-12-18T01:00:05.4022087Z  2024-12-18T01:00:05.4022417Z  2024-12-18T01:00:05.4022757Z  2024-12-18T01:00:05.4023527Z [18,901 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:05.4024367Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2024-12-18T01:00:05.4025051Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T01:00:05.4025799Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2024-12-18T01:00:05.4026586Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T01:00:05.4027327Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2024-12-18T01:00:05.4027987Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 20s local 2024-12-18T01:00:05.4028673Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2024-12-18T01:00:05.4029426Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 13s local ... 2024-12-18T01:00:05.6198752Z 2024-12-18T01:00:05.6199664Z  2024-12-18T01:00:05.6200120Z  2024-12-18T01:00:05.6200489Z  2024-12-18T01:00:05.6200843Z  2024-12-18T01:00:05.6201207Z  2024-12-18T01:00:05.6201563Z  2024-12-18T01:00:05.6201941Z  2024-12-18T01:00:05.6202326Z  2024-12-18T01:00:05.6203218Z [18,903 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:05.6204195Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2024-12-18T01:00:05.6204984Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2024-12-18T01:00:05.6205819Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2024-12-18T01:00:05.6206753Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T01:00:05.6207641Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T01:00:05.6208420Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 20s local 2024-12-18T01:00:05.6209521Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2024-12-18T01:00:05.6210424Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 14s local ... 2024-12-18T01:00:06.4252641Z 2024-12-18T01:00:06.4253539Z  2024-12-18T01:00:06.4253987Z  2024-12-18T01:00:06.4254381Z  2024-12-18T01:00:06.4254765Z  2024-12-18T01:00:06.4255150Z  2024-12-18T01:00:06.4255472Z  2024-12-18T01:00:06.4255790Z  2024-12-18T01:00:06.4256145Z  2024-12-18T01:00:06.4257204Z [18,904 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:06.4258101Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T01:00:06.4258809Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T01:00:06.4259655Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2024-12-18T01:00:06.4260602Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2024-12-18T01:00:06.4261822Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2024-12-18T01:00:06.4262729Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 21s local 2024-12-18T01:00:06.4263547Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2024-12-18T01:00:06.4264430Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 14s local ... 2024-12-18T01:00:06.6231938Z 2024-12-18T01:00:06.6232814Z  2024-12-18T01:00:06.6233294Z  2024-12-18T01:00:06.6233688Z  2024-12-18T01:00:06.6234070Z  2024-12-18T01:00:06.6234443Z  2024-12-18T01:00:06.6234806Z  2024-12-18T01:00:06.6235193Z  2024-12-18T01:00:06.6235575Z  2024-12-18T01:00:06.6236500Z [18,905 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:06.6237615Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T01:00:06.6238617Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T01:00:06.6239761Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T01:00:06.6240732Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2024-12-18T01:00:06.6241591Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T01:00:06.6242370Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 21s local 2024-12-18T01:00:06.6243725Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2024-12-18T01:00:06.6245169Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 15s local ... 2024-12-18T01:00:07.0205901Z 2024-12-18T01:00:07.0206802Z  2024-12-18T01:00:07.0207283Z  2024-12-18T01:00:07.0207680Z  2024-12-18T01:00:07.0208100Z  2024-12-18T01:00:07.0208493Z  2024-12-18T01:00:07.0208899Z  2024-12-18T01:00:07.0209289Z  2024-12-18T01:00:07.0209700Z  2024-12-18T01:00:07.0210749Z [18,907 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:07.0212273Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2024-12-18T01:00:07.0213121Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T01:00:07.0214021Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T01:00:07.0214938Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T01:00:07.0215887Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T01:00:07.0216856Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 21s local 2024-12-18T01:00:07.0217679Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2024-12-18T01:00:07.0218588Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 15s local ... 2024-12-18T01:00:07.2209336Z 2024-12-18T01:00:07.2210243Z  2024-12-18T01:00:07.2210765Z  2024-12-18T01:00:07.2211194Z  2024-12-18T01:00:07.2211615Z  2024-12-18T01:00:07.2212039Z  2024-12-18T01:00:07.2212434Z  2024-12-18T01:00:07.2212829Z  2024-12-18T01:00:07.2213243Z  2024-12-18T01:00:07.2214513Z [18,908 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:07.2215591Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2024-12-18T01:00:07.2216549Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2024-12-18T01:00:07.2217418Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2024-12-18T01:00:07.2218333Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T01:00:07.2219218Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2024-12-18T01:00:07.2220076Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local 2024-12-18T01:00:07.2221455Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2024-12-18T01:00:07.2222402Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 15s local ... 2024-12-18T01:00:07.6213670Z 2024-12-18T01:00:07.6214566Z  2024-12-18T01:00:07.6215064Z  2024-12-18T01:00:07.6215465Z  2024-12-18T01:00:07.6215923Z  2024-12-18T01:00:07.6216328Z  2024-12-18T01:00:07.6217248Z  2024-12-18T01:00:07.6217681Z  2024-12-18T01:00:07.6218060Z  2024-12-18T01:00:07.6219209Z [18,909 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:07.6220420Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2024-12-18T01:00:07.6221366Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T01:00:07.6222362Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T01:00:07.6223420Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T01:00:07.6224436Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T01:00:07.6225382Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local 2024-12-18T01:00:07.6226332Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2024-12-18T01:00:07.6227217Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T01:00:08.0341272Z 2024-12-18T01:00:08.0342167Z  2024-12-18T01:00:08.0342682Z  2024-12-18T01:00:08.0345203Z  2024-12-18T01:00:08.0347987Z  2024-12-18T01:00:08.0350765Z  2024-12-18T01:00:08.0353501Z  2024-12-18T01:00:08.0356205Z  2024-12-18T01:00:08.0356882Z  2024-12-18T01:00:08.0358429Z [18,910 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:08.0359505Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2024-12-18T01:00:08.0360352Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2024-12-18T01:00:08.0361273Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T01:00:08.0362253Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T01:00:08.0363178Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T01:00:08.0364016Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local 2024-12-18T01:00:08.0365273Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2024-12-18T01:00:08.0366216Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T01:00:08.2732300Z 2024-12-18T01:00:08.2733216Z  2024-12-18T01:00:08.2733990Z  2024-12-18T01:00:08.2734384Z  2024-12-18T01:00:08.2734747Z  2024-12-18T01:00:08.2735320Z  2024-12-18T01:00:08.2735848Z  2024-12-18T01:00:08.2736376Z  2024-12-18T01:00:08.2737022Z  2024-12-18T01:00:08.2738082Z [18,912 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:08.2739240Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2024-12-18T01:00:08.2740491Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T01:00:08.2741677Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2024-12-18T01:00:08.2742933Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T01:00:08.2744008Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2024-12-18T01:00:08.2745662Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local 2024-12-18T01:00:08.2746499Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2024-12-18T01:00:08.2747320Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2024-12-18T01:00:08.6221414Z 2024-12-18T01:00:08.6222357Z  2024-12-18T01:00:08.6222909Z  2024-12-18T01:00:08.6223387Z  2024-12-18T01:00:08.6223809Z  2024-12-18T01:00:08.6224158Z  2024-12-18T01:00:08.6224539Z  2024-12-18T01:00:08.6224911Z  2024-12-18T01:00:08.6225283Z  2024-12-18T01:00:08.6226211Z [18,914 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:08.6227259Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2024-12-18T01:00:08.6228072Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T01:00:08.6229011Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T01:00:08.6230432Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T01:00:08.6231285Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T01:00:08.6232086Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local 2024-12-18T01:00:08.6232846Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2024-12-18T01:00:08.6233741Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2024-12-18T01:00:09.2133093Z 2024-12-18T01:00:09.2134085Z  2024-12-18T01:00:09.2134640Z  2024-12-18T01:00:09.2135078Z  2024-12-18T01:00:09.2135536Z  2024-12-18T01:00:09.2135980Z  2024-12-18T01:00:09.2136554Z  2024-12-18T01:00:09.2136913Z  2024-12-18T01:00:09.2137310Z  2024-12-18T01:00:09.2138234Z [18,915 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:09.2139294Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T01:00:09.2140168Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2024-12-18T01:00:09.2141056Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T01:00:09.2141959Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T01:00:09.2142879Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T01:00:09.2143671Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2024-12-18T01:00:09.2144795Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2024-12-18T01:00:09.2145752Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2024-12-18T01:00:09.4227683Z 2024-12-18T01:00:09.4228601Z  2024-12-18T01:00:09.4229102Z  2024-12-18T01:00:09.4229522Z  2024-12-18T01:00:09.4229950Z  2024-12-18T01:00:09.4230344Z  2024-12-18T01:00:09.4230804Z  2024-12-18T01:00:09.4231192Z  2024-12-18T01:00:09.4231555Z  2024-12-18T01:00:09.4232755Z [18,917 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:09.4233883Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T01:00:09.4234651Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T01:00:09.4235531Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2024-12-18T01:00:09.4236439Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T01:00:09.4237307Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2024-12-18T01:00:09.4238120Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2024-12-18T01:00:09.4238916Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T01:00:09.4239866Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2024-12-18T01:00:09.9726809Z 2024-12-18T01:00:09.9727920Z  2024-12-18T01:00:09.9728445Z  2024-12-18T01:00:09.9728895Z  2024-12-18T01:00:09.9729381Z  2024-12-18T01:00:09.9729790Z  2024-12-18T01:00:09.9730255Z  2024-12-18T01:00:09.9731027Z  2024-12-18T01:00:09.9731532Z  2024-12-18T01:00:09.9732398Z [18,919 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:00:09.9733450Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T01:00:09.9734256Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T01:00:09.9735291Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2024-12-18T01:00:09.9736218Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T01:00:09.9737258Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T01:00:09.9738047Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2024-12-18T01:00:09.9738877Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T01:00:09.9739698Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local ... 2024-12-18T01:00:10.1867398Z 2024-12-18T01:00:10.1868338Z  2024-12-18T01:00:10.1869249Z  2024-12-18T01:00:10.1869685Z  2024-12-18T01:00:10.1870094Z  2024-12-18T01:00:10.1870494Z  2024-12-18T01:00:10.1871074Z  2024-12-18T01:00:10.1871448Z  2024-12-18T01:00:10.1871832Z  2024-12-18T01:00:10.1872754Z [18,920 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:10.1873787Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T01:00:10.1874585Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2024-12-18T01:00:10.1875542Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2024-12-18T01:00:10.1876519Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T01:00:10.1877415Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T01:00:10.1878223Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2024-12-18T01:00:10.1879124Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2024-12-18T01:00:10.1880015Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local ... 2024-12-18T01:00:10.4234753Z 2024-12-18T01:00:10.4235600Z  2024-12-18T01:00:10.4236024Z  2024-12-18T01:00:10.4236427Z  2024-12-18T01:00:10.4236854Z  2024-12-18T01:00:10.4237266Z  2024-12-18T01:00:10.4237683Z  2024-12-18T01:00:10.4238114Z  2024-12-18T01:00:10.4238510Z  2024-12-18T01:00:10.4239573Z [18,922 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:10.4240607Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T01:00:10.4241425Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T01:00:10.4242314Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2024-12-18T01:00:10.4243251Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T01:00:10.4244688Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2024-12-18T01:00:10.4245463Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2024-12-18T01:00:10.4246250Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T01:00:10.4247108Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local ... 2024-12-18T01:00:10.8239223Z 2024-12-18T01:00:10.8240207Z  2024-12-18T01:00:10.8240700Z  2024-12-18T01:00:10.8241125Z  2024-12-18T01:00:10.8241560Z  2024-12-18T01:00:10.8241972Z  2024-12-18T01:00:10.8242432Z  2024-12-18T01:00:10.8242769Z  2024-12-18T01:00:10.8243160Z  2024-12-18T01:00:10.8244023Z [18,924 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:10.8245210Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T01:00:10.8246152Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T01:00:10.8247023Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T01:00:10.8248322Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:10.8249279Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T01:00:10.8250140Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2024-12-18T01:00:10.8251020Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T01:00:10.8251930Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2024-12-18T01:00:11.2032787Z 2024-12-18T01:00:11.2033711Z  2024-12-18T01:00:11.2034246Z  2024-12-18T01:00:11.2034686Z  2024-12-18T01:00:11.2035117Z  2024-12-18T01:00:11.2035516Z  2024-12-18T01:00:11.2035964Z  2024-12-18T01:00:11.2036399Z  2024-12-18T01:00:11.2036847Z  2024-12-18T01:00:11.2037774Z [18,925 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:11.2038824Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T01:00:11.2039936Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2024-12-18T01:00:11.2040989Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T01:00:11.2041955Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:11.2042884Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T01:00:11.2043707Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2024-12-18T01:00:11.2044816Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2024-12-18T01:00:11.2045691Z Compiling xla/service/llvm_ir/llvm_util.cc; 18s local ... 2024-12-18T01:00:11.4214846Z 2024-12-18T01:00:11.4215803Z  2024-12-18T01:00:11.4216309Z  2024-12-18T01:00:11.4216841Z  2024-12-18T01:00:11.4217248Z  2024-12-18T01:00:11.4217651Z  2024-12-18T01:00:11.4218100Z  2024-12-18T01:00:11.4218461Z  2024-12-18T01:00:11.4218867Z  2024-12-18T01:00:11.4219825Z [18,929 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:11.4220783Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T01:00:11.4221542Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2024-12-18T01:00:11.4222353Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2024-12-18T01:00:11.4223191Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:11.4223988Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2024-12-18T01:00:11.4224910Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2024-12-18T01:00:11.4225781Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T01:00:11.4226655Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 16s local ... 2024-12-18T01:00:11.6245340Z 2024-12-18T01:00:11.6246280Z  2024-12-18T01:00:11.6246785Z  2024-12-18T01:00:11.6247197Z  2024-12-18T01:00:11.6247642Z  2024-12-18T01:00:11.6248413Z  2024-12-18T01:00:11.6248817Z  2024-12-18T01:00:11.6249209Z  2024-12-18T01:00:11.6249544Z  2024-12-18T01:00:11.6250462Z [18,930 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:11.6251546Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T01:00:11.6252321Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2024-12-18T01:00:11.6253064Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2024-12-18T01:00:11.6254065Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:11.6255143Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2024-12-18T01:00:11.6255934Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T01:00:11.6256786Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 16s local 2024-12-18T01:00:11.6257556Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local ... 2024-12-18T01:00:12.2124022Z 2024-12-18T01:00:12.2124918Z  2024-12-18T01:00:12.2125355Z  2024-12-18T01:00:12.2126134Z  2024-12-18T01:00:12.2126569Z  2024-12-18T01:00:12.2126993Z  2024-12-18T01:00:12.2127415Z  2024-12-18T01:00:12.2127827Z  2024-12-18T01:00:12.2128279Z  2024-12-18T01:00:12.2129255Z [18,931 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:12.2130167Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T01:00:12.2130932Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2024-12-18T01:00:12.2131787Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2024-12-18T01:00:12.2132781Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T01:00:12.2133784Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2024-12-18T01:00:12.2134553Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2024-12-18T01:00:12.2135384Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 16s local 2024-12-18T01:00:12.2136785Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local ... 2024-12-18T01:00:12.4251079Z 2024-12-18T01:00:12.4251970Z  2024-12-18T01:00:12.4252462Z  2024-12-18T01:00:12.4252879Z  2024-12-18T01:00:12.4253279Z  2024-12-18T01:00:12.4253672Z  2024-12-18T01:00:12.4254210Z  2024-12-18T01:00:12.4254581Z  2024-12-18T01:00:12.4254976Z  2024-12-18T01:00:12.4255889Z [18,931 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:12.4257050Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T01:00:12.4257863Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T01:00:12.4258745Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2024-12-18T01:00:12.4259671Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T01:00:12.4260501Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2024-12-18T01:00:12.4261341Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T01:00:12.4262213Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 17s local 2024-12-18T01:00:12.4263179Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local ... 2024-12-18T01:00:12.8255104Z 2024-12-18T01:00:12.8255964Z  2024-12-18T01:00:12.8256574Z  2024-12-18T01:00:12.8256984Z  2024-12-18T01:00:12.8257367Z  2024-12-18T01:00:12.8257711Z  2024-12-18T01:00:12.8258090Z  2024-12-18T01:00:12.8258479Z  2024-12-18T01:00:12.8258873Z  2024-12-18T01:00:12.8259801Z [18,932 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:12.8260842Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T01:00:12.8261664Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T01:00:12.8262550Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T01:00:12.8263910Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T01:00:12.8264746Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2024-12-18T01:00:12.8265475Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T01:00:12.8266267Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 17s local 2024-12-18T01:00:12.8267226Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local ... 2024-12-18T01:00:13.1711487Z 2024-12-18T01:00:13.1712398Z  2024-12-18T01:00:13.1712868Z  2024-12-18T01:00:13.1713229Z  2024-12-18T01:00:13.1713598Z  2024-12-18T01:00:13.1713976Z  2024-12-18T01:00:13.1714335Z  2024-12-18T01:00:13.1714715Z  2024-12-18T01:00:13.1715064Z  2024-12-18T01:00:13.1715953Z [18,933 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:13.1716963Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T01:00:13.1718062Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2024-12-18T01:00:13.1718948Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T01:00:13.1719869Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T01:00:13.1720674Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2024-12-18T01:00:13.1721475Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2024-12-18T01:00:13.1722297Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 17s local 2024-12-18T01:00:13.1723238Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local ... 2024-12-18T01:00:13.4261423Z 2024-12-18T01:00:13.4262335Z  2024-12-18T01:00:13.4262849Z  2024-12-18T01:00:13.4263284Z  2024-12-18T01:00:13.4263726Z  2024-12-18T01:00:13.4264153Z  2024-12-18T01:00:13.4264591Z  2024-12-18T01:00:13.4265000Z  2024-12-18T01:00:13.4265452Z  2024-12-18T01:00:13.4266728Z [18,933 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:13.4267936Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T01:00:13.4268768Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2024-12-18T01:00:13.4269676Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2024-12-18T01:00:13.4270656Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T01:00:13.4271565Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2024-12-18T01:00:13.4272360Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2024-12-18T01:00:13.4273142Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 18s local 2024-12-18T01:00:13.4274043Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local ... 2024-12-18T01:00:14.2807888Z 2024-12-18T01:00:14.2808819Z  2024-12-18T01:00:14.2809364Z  2024-12-18T01:00:14.2809803Z  2024-12-18T01:00:14.2810265Z  2024-12-18T01:00:14.2810639Z  2024-12-18T01:00:14.2811006Z  2024-12-18T01:00:14.2811383Z  2024-12-18T01:00:14.2811742Z  2024-12-18T01:00:14.2812769Z [18,934 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:14.2813752Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2024-12-18T01:00:14.2814535Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T01:00:14.2815363Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2024-12-18T01:00:14.2816337Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T01:00:14.2817315Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2024-12-18T01:00:14.2818140Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T01:00:14.2818973Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:14.2819887Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local ... 2024-12-18T01:00:14.6268366Z 2024-12-18T01:00:14.6269264Z  2024-12-18T01:00:14.6269780Z  2024-12-18T01:00:14.6270184Z  2024-12-18T01:00:14.6270544Z  2024-12-18T01:00:14.6270887Z  2024-12-18T01:00:14.6271242Z  2024-12-18T01:00:14.6271604Z  2024-12-18T01:00:14.6271969Z  2024-12-18T01:00:14.6272904Z [18,935 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:14.6273853Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2024-12-18T01:00:14.6274636Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T01:00:14.6275464Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T01:00:14.6276391Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T01:00:14.6277174Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2024-12-18T01:00:14.6277954Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T01:00:14.6278796Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:14.6279995Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local ... 2024-12-18T01:00:14.9177786Z 2024-12-18T01:00:14.9178714Z  2024-12-18T01:00:14.9179270Z  2024-12-18T01:00:14.9179694Z  2024-12-18T01:00:14.9180135Z  2024-12-18T01:00:14.9180571Z  2024-12-18T01:00:14.9180988Z  2024-12-18T01:00:14.9181569Z  2024-12-18T01:00:14.9181972Z  2024-12-18T01:00:14.9182963Z [18,936 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:14.9183871Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T01:00:14.9184628Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T01:00:14.9185474Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T01:00:14.9186371Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T01:00:14.9187186Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2024-12-18T01:00:14.9188432Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T01:00:14.9189270Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:14.9190178Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local ... 2024-12-18T01:00:15.1667341Z 2024-12-18T01:00:15.1668190Z  2024-12-18T01:00:15.1668628Z  2024-12-18T01:00:15.1669016Z  2024-12-18T01:00:15.1669411Z  2024-12-18T01:00:15.1669804Z  2024-12-18T01:00:15.1670190Z  2024-12-18T01:00:15.1670584Z  2024-12-18T01:00:15.1670993Z  2024-12-18T01:00:15.1671894Z [18,937 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:15.1673084Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T01:00:15.1673874Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2024-12-18T01:00:15.1674799Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T01:00:15.1675773Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T01:00:15.1676593Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2024-12-18T01:00:15.1677405Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2024-12-18T01:00:15.1678261Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 19s local 2024-12-18T01:00:15.1679245Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local ... 2024-12-18T01:00:15.3679038Z 2024-12-18T01:00:15.3679788Z  2024-12-18T01:00:15.3680203Z  2024-12-18T01:00:15.3680549Z  2024-12-18T01:00:15.3680932Z  2024-12-18T01:00:15.3681288Z  2024-12-18T01:00:15.3681661Z  2024-12-18T01:00:15.3682011Z  2024-12-18T01:00:15.3682338Z  2024-12-18T01:00:15.3683167Z [18,939 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:15.3686273Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T01:00:15.3687056Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T01:00:15.3687870Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2024-12-18T01:00:15.3688762Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T01:00:15.3689563Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2024-12-18T01:00:15.3690281Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2024-12-18T01:00:15.3691077Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 20s local 2024-12-18T01:00:15.3691938Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local ... 2024-12-18T01:00:15.6274414Z 2024-12-18T01:00:15.6275508Z  2024-12-18T01:00:15.6276080Z  2024-12-18T01:00:15.6276659Z  2024-12-18T01:00:15.6277304Z  2024-12-18T01:00:15.6277733Z  2024-12-18T01:00:15.6278157Z  2024-12-18T01:00:15.6278580Z  2024-12-18T01:00:15.6279017Z  2024-12-18T01:00:15.6280224Z [18,939 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:15.6281180Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T01:00:15.6281911Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T01:00:15.6282719Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T01:00:15.6283600Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T01:00:15.6284370Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2024-12-18T01:00:15.6285324Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2024-12-18T01:00:15.6286200Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 20s local 2024-12-18T01:00:15.6287232Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local ... 2024-12-18T01:00:15.8278362Z 2024-12-18T01:00:15.8279255Z  2024-12-18T01:00:15.8279726Z  2024-12-18T01:00:15.8280174Z  2024-12-18T01:00:15.8280550Z  2024-12-18T01:00:15.8280935Z  2024-12-18T01:00:15.8281764Z  2024-12-18T01:00:15.8282160Z  2024-12-18T01:00:15.8293498Z  2024-12-18T01:00:15.8294486Z [18,940 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:15.8295526Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T01:00:15.8296491Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2024-12-18T01:00:15.8297378Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T01:00:15.8298332Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2024-12-18T01:00:15.8299188Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2024-12-18T01:00:15.8300017Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2024-12-18T01:00:15.8300860Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 20s local 2024-12-18T01:00:15.8301806Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local ... 2024-12-18T01:00:16.3626308Z 2024-12-18T01:00:16.3627279Z  2024-12-18T01:00:16.3627813Z  2024-12-18T01:00:16.3628250Z  2024-12-18T01:00:16.3628680Z  2024-12-18T01:00:16.3629092Z  2024-12-18T01:00:16.3629481Z  2024-12-18T01:00:16.3629831Z  2024-12-18T01:00:16.3630182Z  2024-12-18T01:00:16.3631054Z [18,941 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:16.3632069Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T01:00:16.3632907Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T01:00:16.3633748Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2024-12-18T01:00:16.3634656Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2024-12-18T01:00:16.3635466Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2024-12-18T01:00:16.3636265Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T01:00:16.3637375Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 21s local 2024-12-18T01:00:16.3638221Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local ... 2024-12-18T01:00:16.6284022Z 2024-12-18T01:00:16.6284809Z  2024-12-18T01:00:16.6285300Z  2024-12-18T01:00:16.6285667Z  2024-12-18T01:00:16.6286059Z  2024-12-18T01:00:16.6286451Z  2024-12-18T01:00:16.6286831Z  2024-12-18T01:00:16.6287212Z  2024-12-18T01:00:16.6287592Z  2024-12-18T01:00:16.6288527Z [18,942 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:16.6289586Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T01:00:16.6290435Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T01:00:16.6291327Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T01:00:16.6292246Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2024-12-18T01:00:16.6293328Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2024-12-18T01:00:16.6294101Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T01:00:16.6294802Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 21s local 2024-12-18T01:00:16.6295653Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local ... 2024-12-18T01:00:16.9256749Z 2024-12-18T01:00:16.9257648Z  2024-12-18T01:00:16.9258170Z  2024-12-18T01:00:16.9258590Z  2024-12-18T01:00:16.9259010Z  2024-12-18T01:00:16.9259423Z  2024-12-18T01:00:16.9259832Z  2024-12-18T01:00:16.9260195Z  2024-12-18T01:00:16.9260583Z  2024-12-18T01:00:16.9261670Z [18,944 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:16.9262695Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T01:00:16.9263491Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T01:00:16.9264589Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T01:00:16.9265661Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T01:00:16.9266512Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2024-12-18T01:00:16.9267374Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T01:00:16.9268253Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 21s local 2024-12-18T01:00:16.9269231Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local ... 2024-12-18T01:00:17.2291078Z 2024-12-18T01:00:17.2291997Z  2024-12-18T01:00:17.2292551Z  2024-12-18T01:00:17.2292974Z  2024-12-18T01:00:17.2293409Z  2024-12-18T01:00:17.2293843Z  2024-12-18T01:00:17.2294255Z  2024-12-18T01:00:17.2294646Z  2024-12-18T01:00:17.2295016Z  2024-12-18T01:00:17.2295936Z [18,946 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:17.2297205Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T01:00:17.2298070Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2024-12-18T01:00:17.2299009Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T01:00:17.2299947Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T01:00:17.2300829Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:17.2301695Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2024-12-18T01:00:17.2302447Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 21s local 2024-12-18T01:00:17.2303498Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local ... 2024-12-18T01:00:17.4473814Z 2024-12-18T01:00:17.4474774Z  2024-12-18T01:00:17.4475306Z  2024-12-18T01:00:17.4475764Z  2024-12-18T01:00:17.4476221Z  2024-12-18T01:00:17.4476673Z  2024-12-18T01:00:17.4477065Z  2024-12-18T01:00:17.4477685Z  2024-12-18T01:00:17.4478079Z  2024-12-18T01:00:17.4478991Z [18,947 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:17.4480009Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T01:00:17.4480816Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T01:00:17.4481695Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2024-12-18T01:00:17.4482585Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T01:00:17.4483477Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:17.4484332Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T01:00:17.4485074Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local 2024-12-18T01:00:17.4485957Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local ... 2024-12-18T01:00:17.8296042Z 2024-12-18T01:00:17.8297026Z  2024-12-18T01:00:17.8297540Z  2024-12-18T01:00:17.8297957Z  2024-12-18T01:00:17.8298339Z  2024-12-18T01:00:17.8299002Z  2024-12-18T01:00:17.8299435Z  2024-12-18T01:00:17.8299842Z  2024-12-18T01:00:17.8300244Z  2024-12-18T01:00:17.8301132Z [18,949 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:17.8302119Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T01:00:17.8302823Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T01:00:17.8303678Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2024-12-18T01:00:17.8304662Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T01:00:17.8305536Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:17.8306356Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T01:00:17.8307238Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local 2024-12-18T01:00:17.8308237Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local ... 2024-12-18T01:00:18.0301034Z 2024-12-18T01:00:18.0302005Z  2024-12-18T01:00:18.0302564Z  2024-12-18T01:00:18.0303009Z  2024-12-18T01:00:18.0303451Z  2024-12-18T01:00:18.0303878Z  2024-12-18T01:00:18.0304246Z  2024-12-18T01:00:18.0304610Z  2024-12-18T01:00:18.0305062Z  2024-12-18T01:00:18.0306022Z [18,950 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:18.0307192Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T01:00:18.0307957Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2024-12-18T01:00:18.0308756Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2024-12-18T01:00:18.0309727Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T01:00:18.0310617Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:18.0311536Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2024-12-18T01:00:18.0312544Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local 2024-12-18T01:00:18.0313460Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local ... 2024-12-18T01:00:18.4714559Z 2024-12-18T01:00:18.4715417Z  2024-12-18T01:00:18.4715938Z  2024-12-18T01:00:18.4716397Z  2024-12-18T01:00:18.4716825Z  2024-12-18T01:00:18.4717265Z  2024-12-18T01:00:18.4717656Z  2024-12-18T01:00:18.4717976Z  2024-12-18T01:00:18.4718285Z  2024-12-18T01:00:18.4719039Z [18,951 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:18.4719959Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T01:00:18.4720706Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2024-12-18T01:00:18.4721518Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2024-12-18T01:00:18.4722645Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T01:00:18.4723504Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2024-12-18T01:00:18.4724481Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T01:00:18.4725259Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local 2024-12-18T01:00:18.4726173Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local ... 2024-12-18T01:00:18.6879843Z 2024-12-18T01:00:18.6880747Z  2024-12-18T01:00:18.6881193Z  2024-12-18T01:00:18.6881628Z  2024-12-18T01:00:18.6882040Z  2024-12-18T01:00:18.6882448Z  2024-12-18T01:00:18.6882840Z  2024-12-18T01:00:18.6883218Z  2024-12-18T01:00:18.6883598Z  2024-12-18T01:00:18.6884523Z [18,952 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:18.6885572Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T01:00:18.6886398Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2024-12-18T01:00:18.6887541Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T01:00:18.6888514Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T01:00:18.6889392Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2024-12-18T01:00:18.6890224Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T01:00:18.6891074Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local 2024-12-18T01:00:18.6892031Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local ... 2024-12-18T01:00:19.0307513Z 2024-12-18T01:00:19.0308442Z  2024-12-18T01:00:19.0308996Z  2024-12-18T01:00:19.0309446Z  2024-12-18T01:00:19.0309885Z  2024-12-18T01:00:19.0310324Z  2024-12-18T01:00:19.0310708Z  2024-12-18T01:00:19.0311062Z  2024-12-18T01:00:19.0311425Z  2024-12-18T01:00:19.0312295Z [18,954 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:19.0313583Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T01:00:19.0314486Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2024-12-18T01:00:19.0315306Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T01:00:19.0316243Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T01:00:19.0317049Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2024-12-18T01:00:19.0317827Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2024-12-18T01:00:19.0318625Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local 2024-12-18T01:00:19.0319537Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local ... 2024-12-18T01:00:19.3447752Z 2024-12-18T01:00:19.3448612Z  2024-12-18T01:00:19.3449150Z  2024-12-18T01:00:19.3449599Z  2024-12-18T01:00:19.3450024Z  2024-12-18T01:00:19.3450468Z  2024-12-18T01:00:19.3450912Z  2024-12-18T01:00:19.3451247Z  2024-12-18T01:00:19.3451569Z  2024-12-18T01:00:19.3452530Z [18,955 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:19.3453401Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T01:00:19.3454103Z Compiling stablehlo/dialect/VhloOps.cpp; 67s local 2024-12-18T01:00:19.3454862Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2024-12-18T01:00:19.3455673Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T01:00:19.3456528Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2024-12-18T01:00:19.3457265Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T01:00:19.3457976Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2024-12-18T01:00:19.3458786Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local ... 2024-12-18T01:00:19.5490734Z 2024-12-18T01:00:19.5491836Z  2024-12-18T01:00:19.5492676Z  2024-12-18T01:00:19.5493086Z  2024-12-18T01:00:19.5493539Z  2024-12-18T01:00:19.5493942Z  2024-12-18T01:00:19.5494311Z  2024-12-18T01:00:19.5494683Z  2024-12-18T01:00:19.5495057Z  2024-12-18T01:00:19.5495956Z [18,957 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:19.5497135Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T01:00:19.5497973Z Compiling stablehlo/dialect/VhloOps.cpp; 67s local 2024-12-18T01:00:19.5498855Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T01:00:19.5499840Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T01:00:19.5500729Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2024-12-18T01:00:19.5501566Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T01:00:19.5502403Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2024-12-18T01:00:19.5503612Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local ... 2024-12-18T01:00:19.8312238Z 2024-12-18T01:00:19.8313055Z  2024-12-18T01:00:19.8313487Z  2024-12-18T01:00:19.8313851Z  2024-12-18T01:00:19.8314192Z  2024-12-18T01:00:19.8314535Z  2024-12-18T01:00:19.8314894Z  2024-12-18T01:00:19.8315252Z  2024-12-18T01:00:19.8315588Z  2024-12-18T01:00:19.8316453Z [18,957 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:19.8317395Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:00:19.8318134Z Compiling stablehlo/dialect/VhloOps.cpp; 67s local 2024-12-18T01:00:19.8318924Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T01:00:19.8320236Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T01:00:19.8321143Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2024-12-18T01:00:19.8322397Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T01:00:19.8323393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2024-12-18T01:00:19.8324330Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local ... 2024-12-18T01:00:20.2317260Z 2024-12-18T01:00:20.2318182Z  2024-12-18T01:00:20.2318726Z  2024-12-18T01:00:20.2319144Z  2024-12-18T01:00:20.2319582Z  2024-12-18T01:00:20.2320021Z  2024-12-18T01:00:20.2320431Z  2024-12-18T01:00:20.2320856Z  2024-12-18T01:00:20.2321270Z  2024-12-18T01:00:20.2322277Z [18,958 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:20.2323291Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:00:20.2324044Z Compiling stablehlo/dialect/VhloOps.cpp; 67s local 2024-12-18T01:00:20.2324851Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T01:00:20.2325704Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T01:00:20.2326421Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:20.2327101Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2024-12-18T01:00:20.2327773Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2024-12-18T01:00:20.2328530Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 23s local ... 2024-12-18T01:00:20.4320424Z 2024-12-18T01:00:20.4321353Z  2024-12-18T01:00:20.4321879Z  2024-12-18T01:00:20.4322324Z  2024-12-18T01:00:20.4322775Z  2024-12-18T01:00:20.4323203Z  2024-12-18T01:00:20.4323624Z  2024-12-18T01:00:20.4324040Z  2024-12-18T01:00:20.4324472Z  2024-12-18T01:00:20.4325490Z [18,959 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:20.4326430Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:00:20.4327397Z Compiling stablehlo/dialect/VhloOps.cpp; 68s local 2024-12-18T01:00:20.4328201Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2024-12-18T01:00:20.4329044Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T01:00:20.4329800Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:20.4330519Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T01:00:20.4331236Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2024-12-18T01:00:20.4331976Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 21s local ... 2024-12-18T01:00:20.7339784Z 2024-12-18T01:00:20.7340629Z  2024-12-18T01:00:20.7341087Z  2024-12-18T01:00:20.7341457Z  2024-12-18T01:00:20.7341845Z  2024-12-18T01:00:20.7342221Z  2024-12-18T01:00:20.7342594Z  2024-12-18T01:00:20.7342941Z  2024-12-18T01:00:20.7343308Z  2024-12-18T01:00:20.7344452Z [18,961 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:20.7345781Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:00:20.7346627Z Compiling stablehlo/dialect/VhloOps.cpp; 68s local 2024-12-18T01:00:20.7347483Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T01:00:20.7348388Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T01:00:20.7349163Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:20.7349999Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T01:00:20.7350812Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2024-12-18T01:00:20.7351670Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 22s local ... 2024-12-18T01:00:21.0326352Z 2024-12-18T01:00:21.0327236Z  2024-12-18T01:00:21.0327709Z  2024-12-18T01:00:21.0328123Z  2024-12-18T01:00:21.0328539Z  2024-12-18T01:00:21.0328947Z  2024-12-18T01:00:21.0329369Z  2024-12-18T01:00:21.0329743Z  2024-12-18T01:00:21.0330487Z  2024-12-18T01:00:21.0331358Z [18,961 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:21.0332397Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T01:00:21.0332999Z Compiling stablehlo/dialect/VhloOps.cpp; 68s local 2024-12-18T01:00:21.0333719Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T01:00:21.0334541Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T01:00:21.0335387Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:21.0336149Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2024-12-18T01:00:21.0336934Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2024-12-18T01:00:21.0337613Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 22s local ... 2024-12-18T01:00:21.4329873Z 2024-12-18T01:00:21.4330736Z  2024-12-18T01:00:21.4331254Z  2024-12-18T01:00:21.4331709Z  2024-12-18T01:00:21.4332196Z  2024-12-18T01:00:21.4332623Z  2024-12-18T01:00:21.4333062Z  2024-12-18T01:00:21.4333499Z  2024-12-18T01:00:21.4333931Z  2024-12-18T01:00:21.4335291Z [18,963 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:21.4336604Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T01:00:21.4337560Z Compiling stablehlo/dialect/VhloOps.cpp; 69s local 2024-12-18T01:00:21.4338581Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2024-12-18T01:00:21.4339684Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T01:00:21.4340809Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2024-12-18T01:00:21.4341747Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T01:00:21.4342676Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2024-12-18T01:00:21.4343928Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 22s local ... 2024-12-18T01:00:21.8190685Z 2024-12-18T01:00:21.8191491Z  2024-12-18T01:00:21.8191943Z  2024-12-18T01:00:21.8192333Z  2024-12-18T01:00:21.8192710Z  2024-12-18T01:00:21.8193084Z  2024-12-18T01:00:21.8193466Z  2024-12-18T01:00:21.8193831Z  2024-12-18T01:00:21.8194225Z  2024-12-18T01:00:21.8195109Z [18,965 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:21.8196133Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T01:00:21.8197060Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T01:00:21.8197971Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T01:00:21.8198693Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2024-12-18T01:00:21.8199438Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T01:00:21.8200515Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2024-12-18T01:00:21.8201347Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local 2024-12-18T01:00:21.8202322Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 16s local ... 2024-12-18T01:00:22.0336555Z 2024-12-18T01:00:22.0337363Z  2024-12-18T01:00:22.0337846Z  2024-12-18T01:00:22.0338243Z  2024-12-18T01:00:22.0338648Z  2024-12-18T01:00:22.0339055Z  2024-12-18T01:00:22.0339463Z  2024-12-18T01:00:22.0339871Z  2024-12-18T01:00:22.0340254Z  2024-12-18T01:00:22.0341226Z [18,965 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:22.0342223Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2024-12-18T01:00:22.0343171Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T01:00:22.0344029Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T01:00:22.0345302Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2024-12-18T01:00:22.0346164Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2024-12-18T01:00:22.0351117Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2024-12-18T01:00:22.0351972Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local 2024-12-18T01:00:22.0353002Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local ... 2024-12-18T01:00:22.4035183Z 2024-12-18T01:00:22.4035998Z  2024-12-18T01:00:22.4036475Z  2024-12-18T01:00:22.4036867Z  2024-12-18T01:00:22.4045091Z  2024-12-18T01:00:22.4045438Z  2024-12-18T01:00:22.4045777Z  2024-12-18T01:00:22.4046104Z  2024-12-18T01:00:22.4046434Z  2024-12-18T01:00:22.4047233Z [18,967 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:00:22.4048193Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2024-12-18T01:00:22.4049120Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2024-12-18T01:00:22.4050032Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T01:00:22.4050877Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2024-12-18T01:00:22.4051662Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2024-12-18T01:00:22.4052455Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2024-12-18T01:00:22.4053225Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local 2024-12-18T01:00:22.4054126Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local ... 2024-12-18T01:00:22.6445755Z 2024-12-18T01:00:22.6447034Z  2024-12-18T01:00:22.6447830Z  2024-12-18T01:00:22.6448872Z  2024-12-18T01:00:22.6449359Z  2024-12-18T01:00:22.6449793Z  2024-12-18T01:00:22.6450215Z  2024-12-18T01:00:22.6450615Z  2024-12-18T01:00:22.6451014Z  2024-12-18T01:00:22.6451989Z [18,968 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:22.6453120Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2024-12-18T01:00:22.6454136Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T01:00:22.6455159Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T01:00:22.6456213Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2024-12-18T01:00:22.6457380Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2024-12-18T01:00:22.6458335Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2024-12-18T01:00:22.6459244Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local 2024-12-18T01:00:22.6460417Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local ... 2024-12-18T01:00:22.9981341Z 2024-12-18T01:00:22.9983586Z  2024-12-18T01:00:22.9984039Z  2024-12-18T01:00:22.9984397Z  2024-12-18T01:00:22.9984770Z  2024-12-18T01:00:22.9985183Z  2024-12-18T01:00:22.9985550Z  2024-12-18T01:00:22.9986244Z  2024-12-18T01:00:22.9986628Z  2024-12-18T01:00:22.9987567Z [18,968 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:22.9988547Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T01:00:22.9989431Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T01:00:22.9990325Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T01:00:22.9991117Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2024-12-18T01:00:22.9991891Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2024-12-18T01:00:22.9992734Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2024-12-18T01:00:22.9993505Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local 2024-12-18T01:00:22.9994447Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local ... 2024-12-18T01:00:23.4578266Z 2024-12-18T01:00:23.4579694Z  2024-12-18T01:00:23.4580598Z  2024-12-18T01:00:23.4580946Z  2024-12-18T01:00:23.4581324Z  2024-12-18T01:00:23.4581706Z  2024-12-18T01:00:23.4582301Z  2024-12-18T01:00:23.4582688Z  2024-12-18T01:00:23.4583054Z  2024-12-18T01:00:23.4583959Z [18,969 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:23.4584961Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T01:00:23.4585877Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2024-12-18T01:00:23.4586973Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T01:00:23.4587790Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2024-12-18T01:00:23.4588623Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T01:00:23.4589466Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2024-12-18T01:00:23.4590317Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local 2024-12-18T01:00:23.4591341Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local ... 2024-12-18T01:00:23.7986881Z 2024-12-18T01:00:23.7988414Z  2024-12-18T01:00:23.7988932Z  2024-12-18T01:00:23.7989417Z  2024-12-18T01:00:23.7989775Z  2024-12-18T01:00:23.7990151Z  2024-12-18T01:00:23.7990532Z  2024-12-18T01:00:23.7990893Z  2024-12-18T01:00:23.7991274Z  2024-12-18T01:00:23.7992235Z [18,971 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:23.7993302Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T01:00:23.7994236Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T01:00:23.7995152Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T01:00:23.7996010Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2024-12-18T01:00:23.7996882Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T01:00:23.7997724Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2024-12-18T01:00:23.7998568Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local 2024-12-18T01:00:23.7999762Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local ... 2024-12-18T01:00:24.1650501Z 2024-12-18T01:00:24.1652836Z  2024-12-18T01:00:24.1653328Z  2024-12-18T01:00:24.1653740Z  2024-12-18T01:00:24.1654146Z  2024-12-18T01:00:24.1654520Z  2024-12-18T01:00:24.1655050Z  2024-12-18T01:00:24.1655456Z  2024-12-18T01:00:24.1655846Z  2024-12-18T01:00:24.1656908Z [18,972 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:24.1657929Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T01:00:24.1658866Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T01:00:24.1660038Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T01:00:24.1660897Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2024-12-18T01:00:24.1661702Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2024-12-18T01:00:24.1662560Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2024-12-18T01:00:24.1663403Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local 2024-12-18T01:00:24.1664441Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2024-12-18T01:00:24.3991621Z 2024-12-18T01:00:24.3992617Z  2024-12-18T01:00:24.3993354Z  2024-12-18T01:00:24.3993762Z  2024-12-18T01:00:24.3994146Z  2024-12-18T01:00:24.3994512Z  2024-12-18T01:00:24.3994898Z  2024-12-18T01:00:24.3995331Z  2024-12-18T01:00:24.3995719Z  2024-12-18T01:00:24.3996711Z [18,973 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:24.3998006Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T01:00:24.3999110Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2024-12-18T01:00:24.4000231Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T01:00:24.4001062Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2024-12-18T01:00:24.4001830Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:24.4002646Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2024-12-18T01:00:24.4003459Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local 2024-12-18T01:00:24.4004734Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2024-12-18T01:00:24.7995632Z 2024-12-18T01:00:24.7996880Z  2024-12-18T01:00:24.7997361Z  2024-12-18T01:00:24.7997769Z  2024-12-18T01:00:24.7998162Z  2024-12-18T01:00:24.7998556Z  2024-12-18T01:00:24.7998977Z  2024-12-18T01:00:24.7999370Z  2024-12-18T01:00:24.7999787Z  2024-12-18T01:00:24.8000801Z [18,974 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:24.8001913Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T01:00:24.8002857Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T01:00:24.8003800Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:24.8004708Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2024-12-18T01:00:24.8005547Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:24.8006460Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2024-12-18T01:00:24.8007265Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2024-12-18T01:00:24.8008352Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2024-12-18T01:00:24.9998813Z 2024-12-18T01:00:25.0000104Z  2024-12-18T01:00:25.0000604Z  2024-12-18T01:00:25.0000979Z  2024-12-18T01:00:25.0001411Z  2024-12-18T01:00:25.0001833Z  2024-12-18T01:00:25.0002265Z  2024-12-18T01:00:25.0002670Z  2024-12-18T01:00:25.0003047Z  2024-12-18T01:00:25.0003929Z [18,975 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:25.0004936Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T01:00:25.0005841Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T01:00:25.0006797Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:25.0007665Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2024-12-18T01:00:25.0008505Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:25.0009360Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2024-12-18T01:00:25.0010169Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2024-12-18T01:00:25.0011542Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local ... 2024-12-18T01:00:25.2449451Z 2024-12-18T01:00:25.2450466Z  2024-12-18T01:00:25.2450931Z  2024-12-18T01:00:25.2451380Z  2024-12-18T01:00:25.2451779Z  2024-12-18T01:00:25.2452173Z  2024-12-18T01:00:25.2452593Z  2024-12-18T01:00:25.2452989Z  2024-12-18T01:00:25.2453374Z  2024-12-18T01:00:25.2454278Z [18,976 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:25.2455341Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T01:00:25.2456446Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2024-12-18T01:00:25.2457432Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:25.2458298Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:25.2459149Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2024-12-18T01:00:25.2460228Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2024-12-18T01:00:25.2461099Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2024-12-18T01:00:25.2462178Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local ... 2024-12-18T01:00:25.5536828Z 2024-12-18T01:00:25.5538051Z  2024-12-18T01:00:25.5538543Z  2024-12-18T01:00:25.5538953Z  2024-12-18T01:00:25.5539349Z  2024-12-18T01:00:25.5539765Z  2024-12-18T01:00:25.5540154Z  2024-12-18T01:00:25.5540524Z  2024-12-18T01:00:25.5540957Z  2024-12-18T01:00:25.5541934Z [18,979 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:25.5543261Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T01:00:25.5544467Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T01:00:25.5545517Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:25.5546450Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:25.5547340Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T01:00:25.5548243Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2024-12-18T01:00:25.5549156Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2024-12-18T01:00:25.5550380Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local ... 2024-12-18T01:00:25.8006122Z 2024-12-18T01:00:25.8007073Z  2024-12-18T01:00:25.8007538Z  2024-12-18T01:00:25.8007905Z  2024-12-18T01:00:25.8008265Z  2024-12-18T01:00:25.8008651Z  2024-12-18T01:00:25.8009015Z  2024-12-18T01:00:25.8009365Z  2024-12-18T01:00:25.8009710Z  2024-12-18T01:00:25.8010561Z [18,979 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:25.8011513Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T01:00:25.8012378Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T01:00:25.8013251Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:25.8014036Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:25.8014819Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T01:00:25.8015569Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2024-12-18T01:00:25.8016469Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2024-12-18T01:00:25.8017536Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local ... 2024-12-18T01:00:26.0051620Z 2024-12-18T01:00:26.0052569Z  2024-12-18T01:00:26.0053069Z  2024-12-18T01:00:26.0053489Z  2024-12-18T01:00:26.0053902Z  2024-12-18T01:00:26.0054319Z  2024-12-18T01:00:26.0054721Z  2024-12-18T01:00:26.0055121Z  2024-12-18T01:00:26.0055533Z  2024-12-18T01:00:26.0057051Z [18,982 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:26.0058200Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T01:00:26.0059215Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T01:00:26.0060214Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:26.0061120Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:26.0061989Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T01:00:26.0062855Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2024-12-18T01:00:26.0063845Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2024-12-18T01:00:26.0064903Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local ... 2024-12-18T01:00:26.2540092Z 2024-12-18T01:00:26.2541202Z  2024-12-18T01:00:26.2541957Z  2024-12-18T01:00:26.2542613Z  2024-12-18T01:00:26.2543571Z  2024-12-18T01:00:26.2544345Z  2024-12-18T01:00:26.2544772Z  2024-12-18T01:00:26.2545410Z  2024-12-18T01:00:26.2545847Z  2024-12-18T01:00:26.2546750Z [18,984 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:26.2547971Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T01:00:26.2548942Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2024-12-18T01:00:26.2549883Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:26.2550743Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2024-12-18T01:00:26.2551796Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2024-12-18T01:00:26.2552869Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2024-12-18T01:00:26.2553868Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2024-12-18T01:00:26.2554823Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local ... 2024-12-18T01:00:26.5160250Z 2024-12-18T01:00:26.5161355Z  2024-12-18T01:00:26.5162202Z  2024-12-18T01:00:26.5162904Z  2024-12-18T01:00:26.5163904Z  2024-12-18T01:00:26.5164493Z  2024-12-18T01:00:26.5164916Z  2024-12-18T01:00:26.5165303Z  2024-12-18T01:00:26.5165677Z  2024-12-18T01:00:26.5166584Z [18,986 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:26.5167581Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T01:00:26.5168548Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T01:00:26.5169595Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:26.5170497Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2024-12-18T01:00:26.5171392Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T01:00:26.5172270Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2024-12-18T01:00:26.5173133Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2024-12-18T01:00:26.5174211Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local ... 2024-12-18T01:00:26.8013539Z 2024-12-18T01:00:26.8014492Z  2024-12-18T01:00:26.8015006Z  2024-12-18T01:00:26.8015398Z  2024-12-18T01:00:26.8015793Z  2024-12-18T01:00:26.8016146Z  2024-12-18T01:00:26.8016674Z  2024-12-18T01:00:26.8017045Z  2024-12-18T01:00:26.8017446Z  2024-12-18T01:00:26.8018350Z [18,988 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:26.8019301Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T01:00:26.8020219Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T01:00:26.8021025Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T01:00:26.8021790Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2024-12-18T01:00:26.8022830Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T01:00:26.8023645Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2024-12-18T01:00:26.8024446Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:26.8025508Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local ... 2024-12-18T01:00:27.2017323Z 2024-12-18T01:00:27.2018290Z  2024-12-18T01:00:27.2018764Z  2024-12-18T01:00:27.2020451Z  2024-12-18T01:00:27.2020966Z  2024-12-18T01:00:27.2021680Z  2024-12-18T01:00:27.2022096Z  2024-12-18T01:00:27.2022509Z  2024-12-18T01:00:27.2022890Z  2024-12-18T01:00:27.2023783Z [18,990 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:00:27.2024830Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2024-12-18T01:00:27.2025757Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T01:00:27.2026950Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T01:00:27.2027794Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T01:00:27.2028655Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2024-12-18T01:00:27.2029630Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2024-12-18T01:00:27.2030464Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:27.2031473Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 19s local ... 2024-12-18T01:00:27.4020909Z 2024-12-18T01:00:27.4021838Z  2024-12-18T01:00:27.4022664Z  2024-12-18T01:00:27.4023054Z  2024-12-18T01:00:27.4023450Z  2024-12-18T01:00:27.4023946Z  2024-12-18T01:00:27.4024334Z  2024-12-18T01:00:27.4024724Z  2024-12-18T01:00:27.4026975Z  2024-12-18T01:00:27.4030464Z [18,991 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:27.4034045Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2024-12-18T01:00:27.4037568Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2024-12-18T01:00:27.4041042Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T01:00:27.4044647Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T01:00:27.4047851Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2024-12-18T01:00:27.4049839Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:27.4050800Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:27.4051946Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 19s local ... 2024-12-18T01:00:27.6198212Z 2024-12-18T01:00:27.6199327Z  2024-12-18T01:00:27.6200108Z  2024-12-18T01:00:27.6201211Z  2024-12-18T01:00:27.6201692Z  2024-12-18T01:00:27.6202109Z  2024-12-18T01:00:27.6202560Z  2024-12-18T01:00:27.6203004Z  2024-12-18T01:00:27.6203442Z  2024-12-18T01:00:27.6204571Z [18,992 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:27.6205540Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2024-12-18T01:00:27.6206528Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T01:00:27.6207503Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T01:00:27.6208511Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T01:00:27.6209383Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2024-12-18T01:00:27.6210216Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:27.6211062Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:27.6212148Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 19s local ... 2024-12-18T01:00:28.0024521Z 2024-12-18T01:00:28.0025722Z  2024-12-18T01:00:28.0026160Z  2024-12-18T01:00:28.0026540Z  2024-12-18T01:00:28.0027176Z  2024-12-18T01:00:28.0027553Z  2024-12-18T01:00:28.0027926Z  2024-12-18T01:00:28.0028289Z  2024-12-18T01:00:28.0028664Z  2024-12-18T01:00:28.0029554Z [18,993 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:28.0030577Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:00:28.0031423Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T01:00:28.0032308Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T01:00:28.0033110Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T01:00:28.0033883Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2024-12-18T01:00:28.0053525Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:28.0054348Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2024-12-18T01:00:28.0055616Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 19s local ... 2024-12-18T01:00:28.2029813Z 2024-12-18T01:00:28.2030648Z  2024-12-18T01:00:28.2031123Z  2024-12-18T01:00:28.2032026Z  2024-12-18T01:00:28.2032433Z  2024-12-18T01:00:28.2032860Z  2024-12-18T01:00:28.2033272Z  2024-12-18T01:00:28.2033688Z  2024-12-18T01:00:28.2034085Z  2024-12-18T01:00:28.2035086Z [18,994 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:28.2036206Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:00:28.2037514Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T01:00:28.2038449Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T01:00:28.2039335Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:28.2040215Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2024-12-18T01:00:28.2041104Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2024-12-18T01:00:28.2041968Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2024-12-18T01:00:28.2043145Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 20s local ... 2024-12-18T01:00:28.4059952Z 2024-12-18T01:00:28.4060859Z  2024-12-18T01:00:28.4061345Z  2024-12-18T01:00:28.4061733Z  2024-12-18T01:00:28.4062122Z  2024-12-18T01:00:28.4062481Z  2024-12-18T01:00:28.4062847Z  2024-12-18T01:00:28.4063207Z  2024-12-18T01:00:28.4063603Z  2024-12-18T01:00:28.4064515Z [18,997 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:28.4065593Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:00:28.4066518Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2024-12-18T01:00:28.4067463Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T01:00:28.4068299Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:28.4069190Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T01:00:28.4070019Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2024-12-18T01:00:28.4070864Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2024-12-18T01:00:28.4071861Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 20s local ... 2024-12-18T01:00:28.6293840Z 2024-12-18T01:00:28.6294733Z  2024-12-18T01:00:28.6295227Z  2024-12-18T01:00:28.6295635Z  2024-12-18T01:00:28.6296012Z  2024-12-18T01:00:28.6296572Z  2024-12-18T01:00:28.6296959Z  2024-12-18T01:00:28.6297374Z  2024-12-18T01:00:28.6297758Z  2024-12-18T01:00:28.6298708Z [18,998 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:28.6299747Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:00:28.6300916Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T01:00:28.6301951Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T01:00:28.6302831Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:28.6303701Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T01:00:28.6304558Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2024-12-18T01:00:28.6305396Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2024-12-18T01:00:28.6306449Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 20s local ... 2024-12-18T01:00:29.0035112Z 2024-12-18T01:00:29.0036521Z  2024-12-18T01:00:29.0037035Z  2024-12-18T01:00:29.0037450Z  2024-12-18T01:00:29.0037827Z  2024-12-18T01:00:29.0038249Z  2024-12-18T01:00:29.0038639Z  2024-12-18T01:00:29.0039036Z  2024-12-18T01:00:29.0039415Z  2024-12-18T01:00:29.0040344Z [18,998 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:29.0041733Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T01:00:29.0042713Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T01:00:29.0043900Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T01:00:29.0045006Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:29.0045882Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T01:00:29.0046724Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2024-12-18T01:00:29.0047753Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2024-12-18T01:00:29.0048775Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 20s local ... 2024-12-18T01:00:29.2054779Z 2024-12-18T01:00:29.2055678Z  2024-12-18T01:00:29.2056122Z  2024-12-18T01:00:29.2056618Z  2024-12-18T01:00:29.2057017Z  2024-12-18T01:00:29.2057368Z  2024-12-18T01:00:29.2057736Z  2024-12-18T01:00:29.2058143Z  2024-12-18T01:00:29.2058534Z  2024-12-18T01:00:29.2059365Z [18,999 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:29.2060351Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T01:00:29.2061353Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T01:00:29.2062257Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T01:00:29.2063000Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T01:00:29.2063842Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2024-12-18T01:00:29.2064688Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2024-12-18T01:00:29.2065564Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2024-12-18T01:00:29.2066515Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 21s local ... 2024-12-18T01:00:29.4701250Z 2024-12-18T01:00:29.4702052Z  2024-12-18T01:00:29.4702552Z  2024-12-18T01:00:29.4702950Z  2024-12-18T01:00:29.4703358Z  2024-12-18T01:00:29.4703771Z  2024-12-18T01:00:29.4704231Z  2024-12-18T01:00:29.4704596Z  2024-12-18T01:00:29.4704971Z  2024-12-18T01:00:29.4705884Z [19,003 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:29.4706934Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T01:00:29.4707908Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2024-12-18T01:00:29.4708888Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T01:00:29.4709761Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T01:00:29.4710578Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T01:00:29.4711411Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2024-12-18T01:00:29.4712254Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2024-12-18T01:00:29.4713574Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 21s local ... 2024-12-18T01:00:29.8041342Z 2024-12-18T01:00:29.8042243Z  2024-12-18T01:00:29.8042867Z  2024-12-18T01:00:29.8043230Z  2024-12-18T01:00:29.8043598Z  2024-12-18T01:00:29.8043954Z  2024-12-18T01:00:29.8044698Z  2024-12-18T01:00:29.8045084Z  2024-12-18T01:00:29.8045460Z  2024-12-18T01:00:29.8046403Z [19,003 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:29.8047440Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T01:00:29.8048301Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T01:00:29.8049217Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T01:00:29.8050013Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T01:00:29.8050906Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2024-12-18T01:00:29.8051956Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2024-12-18T01:00:29.8052791Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2024-12-18T01:00:29.8054015Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 21s local ... 2024-12-18T01:00:30.3336015Z 2024-12-18T01:00:30.3337058Z  2024-12-18T01:00:30.3337557Z  2024-12-18T01:00:30.3338015Z  2024-12-18T01:00:30.3338452Z  2024-12-18T01:00:30.3338868Z  2024-12-18T01:00:30.3339234Z  2024-12-18T01:00:30.3339650Z  2024-12-18T01:00:30.3340326Z  2024-12-18T01:00:30.3341184Z [19,004 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:30.3342212Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T01:00:30.3343163Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2024-12-18T01:00:30.3344365Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T01:00:30.3345256Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T01:00:30.3346116Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T01:00:30.3346939Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:30.3347721Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2024-12-18T01:00:30.3348767Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 22s local ... 2024-12-18T01:00:30.6048043Z 2024-12-18T01:00:30.6048938Z  2024-12-18T01:00:30.6049368Z  2024-12-18T01:00:30.6049815Z  2024-12-18T01:00:30.6050218Z  2024-12-18T01:00:30.6050663Z  2024-12-18T01:00:30.6051071Z  2024-12-18T01:00:30.6051478Z  2024-12-18T01:00:30.6051898Z  2024-12-18T01:00:30.6052834Z [19,007 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:30.6053905Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T01:00:30.6054917Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T01:00:30.6055910Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T01:00:30.6056976Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T01:00:30.6057870Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T01:00:30.6058760Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:30.6059619Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2024-12-18T01:00:30.6060675Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 22s local ... 2024-12-18T01:00:30.8050791Z 2024-12-18T01:00:30.8051681Z  2024-12-18T01:00:30.8052177Z  2024-12-18T01:00:30.8052605Z  2024-12-18T01:00:30.8053006Z  2024-12-18T01:00:30.8053417Z  2024-12-18T01:00:30.8053817Z  2024-12-18T01:00:30.8054219Z  2024-12-18T01:00:30.8054606Z  2024-12-18T01:00:30.8055832Z [19,009 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:30.8057085Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T01:00:30.8058084Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T01:00:30.8059076Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T01:00:30.8059955Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T01:00:30.8060763Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T01:00:30.8061513Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:30.8062383Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T01:00:30.8063447Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 22s local ... 2024-12-18T01:00:31.1120351Z 2024-12-18T01:00:31.1121250Z  2024-12-18T01:00:31.1121715Z  2024-12-18T01:00:31.1122107Z  2024-12-18T01:00:31.1122471Z  2024-12-18T01:00:31.1122894Z  2024-12-18T01:00:31.1123516Z  2024-12-18T01:00:31.1123952Z  2024-12-18T01:00:31.1124358Z  2024-12-18T01:00:31.1125402Z [19,010 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:31.1126363Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2024-12-18T01:00:31.1127248Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T01:00:31.1128177Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T01:00:31.1128986Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T01:00:31.1130045Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2024-12-18T01:00:31.1130837Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2024-12-18T01:00:31.1131631Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T01:00:31.1132631Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 22s local ... 2024-12-18T01:00:31.4055707Z 2024-12-18T01:00:31.4056697Z  2024-12-18T01:00:31.4057167Z  2024-12-18T01:00:31.4057607Z  2024-12-18T01:00:31.4058024Z  2024-12-18T01:00:31.4058499Z  2024-12-18T01:00:31.4058892Z  2024-12-18T01:00:31.4059272Z  2024-12-18T01:00:31.4059671Z  2024-12-18T01:00:31.4060658Z [19,011 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:31.4061602Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2024-12-18T01:00:31.4062541Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2024-12-18T01:00:31.4063520Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T01:00:31.4064267Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2024-12-18T01:00:31.4065122Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T01:00:31.4065849Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2024-12-18T01:00:31.4066703Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T01:00:31.4067721Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local ... 2024-12-18T01:00:32.1324765Z 2024-12-18T01:00:32.1325765Z  2024-12-18T01:00:32.1326245Z  2024-12-18T01:00:32.1326669Z  2024-12-18T01:00:32.1327066Z  2024-12-18T01:00:32.1327464Z  2024-12-18T01:00:32.1327864Z  2024-12-18T01:00:32.1328264Z  2024-12-18T01:00:32.1328671Z  2024-12-18T01:00:32.1329553Z [19,012 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:32.1330631Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T01:00:32.1331591Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T01:00:32.1332475Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T01:00:32.1333109Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T01:00:32.1334223Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2024-12-18T01:00:32.1335140Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2024-12-18T01:00:32.1335951Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T01:00:32.1337100Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local ... 2024-12-18T01:00:32.3765001Z 2024-12-18T01:00:32.3765847Z  2024-12-18T01:00:32.3766445Z  2024-12-18T01:00:32.3766860Z  2024-12-18T01:00:32.3767269Z  2024-12-18T01:00:32.3767679Z  2024-12-18T01:00:32.3768116Z  2024-12-18T01:00:32.3768514Z  2024-12-18T01:00:32.3768892Z  2024-12-18T01:00:32.3769873Z [19,013 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:32.3770927Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T01:00:32.3771893Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2024-12-18T01:00:32.3773149Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T01:00:32.3774045Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T01:00:32.3775030Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:32.3775928Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2024-12-18T01:00:32.3776936Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T01:00:32.3777963Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local ... 2024-12-18T01:00:32.6064998Z 2024-12-18T01:00:32.6066160Z  2024-12-18T01:00:32.6066680Z  2024-12-18T01:00:32.6067085Z  2024-12-18T01:00:32.6067485Z  2024-12-18T01:00:32.6067911Z  2024-12-18T01:00:32.6068290Z  2024-12-18T01:00:32.6068749Z  2024-12-18T01:00:32.6069170Z  2024-12-18T01:00:32.6070146Z [19,014 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:32.6071237Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T01:00:32.6072193Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T01:00:32.6073214Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T01:00:32.6074054Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T01:00:32.6074950Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:32.6075729Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2024-12-18T01:00:32.6076778Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T01:00:32.6077864Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local ... 2024-12-18T01:00:32.8672743Z 2024-12-18T01:00:32.8673942Z  2024-12-18T01:00:32.8674463Z  2024-12-18T01:00:32.8674873Z  2024-12-18T01:00:32.8675266Z  2024-12-18T01:00:32.8675637Z  2024-12-18T01:00:32.8676034Z  2024-12-18T01:00:32.8676437Z  2024-12-18T01:00:32.8676875Z  2024-12-18T01:00:32.8677942Z [19,017 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:32.8679051Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T01:00:32.8680036Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T01:00:32.8681056Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T01:00:32.8681989Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T01:00:32.8682892Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:32.8683827Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2024-12-18T01:00:32.8684699Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T01:00:32.8685730Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local ... 2024-12-18T01:00:33.2069173Z 2024-12-18T01:00:33.2070113Z  2024-12-18T01:00:33.2070717Z  2024-12-18T01:00:33.2071318Z  2024-12-18T01:00:33.2071756Z  2024-12-18T01:00:33.2072116Z  2024-12-18T01:00:33.2072469Z  2024-12-18T01:00:33.2072870Z  2024-12-18T01:00:33.2073213Z  2024-12-18T01:00:33.2074058Z [19,017 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:33.2075024Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T01:00:33.2075882Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2024-12-18T01:00:33.2076862Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T01:00:33.2077698Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T01:00:33.2078538Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2024-12-18T01:00:33.2079346Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2024-12-18T01:00:33.2080147Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T01:00:33.2081329Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local ... 2024-12-18T01:00:33.6073783Z 2024-12-18T01:00:33.6074628Z  2024-12-18T01:00:33.6075411Z  2024-12-18T01:00:33.6075774Z  2024-12-18T01:00:33.6076185Z  2024-12-18T01:00:33.6076598Z  2024-12-18T01:00:33.6076999Z  2024-12-18T01:00:33.6077394Z  2024-12-18T01:00:33.6077804Z  2024-12-18T01:00:33.6078769Z [19,018 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:33.6079850Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T01:00:33.6081178Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T01:00:33.6082205Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T01:00:33.6083088Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T01:00:33.6083980Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T01:00:33.6084897Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2024-12-18T01:00:33.6085807Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T01:00:33.6086885Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local ... 2024-12-18T01:00:33.8414134Z 2024-12-18T01:00:33.8415036Z  2024-12-18T01:00:33.8415489Z  2024-12-18T01:00:33.8415887Z  2024-12-18T01:00:33.8416301Z  2024-12-18T01:00:33.8416846Z  2024-12-18T01:00:33.8417262Z  2024-12-18T01:00:33.8417672Z  2024-12-18T01:00:33.8418071Z  2024-12-18T01:00:33.8419046Z [19,020 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:33.8420115Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T01:00:33.8421156Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T01:00:33.8422049Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T01:00:33.8422901Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T01:00:33.8423754Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T01:00:33.8424523Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2024-12-18T01:00:33.8425310Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T01:00:33.8426288Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local ... 2024-12-18T01:00:34.1920386Z 2024-12-18T01:00:34.1921266Z  2024-12-18T01:00:34.1921698Z  2024-12-18T01:00:34.1922175Z  2024-12-18T01:00:34.1922719Z  2024-12-18T01:00:34.1923157Z  2024-12-18T01:00:34.1923509Z  2024-12-18T01:00:34.1923873Z  2024-12-18T01:00:34.1924248Z  2024-12-18T01:00:34.1925169Z [19,021 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:34.1926126Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T01:00:34.1927325Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T01:00:34.1928321Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T01:00:34.1929041Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T01:00:34.1929840Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2024-12-18T01:00:34.1930742Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2024-12-18T01:00:34.1931573Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T01:00:34.1932657Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2024-12-18T01:00:34.4079405Z 2024-12-18T01:00:34.4080286Z  2024-12-18T01:00:34.4080738Z  2024-12-18T01:00:34.4081146Z  2024-12-18T01:00:34.4081760Z  2024-12-18T01:00:34.4082292Z  2024-12-18T01:00:34.4082787Z  2024-12-18T01:00:34.4083283Z  2024-12-18T01:00:34.4083785Z  2024-12-18T01:00:34.4085155Z [19,021 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:34.4086374Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T01:00:34.4087578Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2024-12-18T01:00:34.4088669Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T01:00:34.4089637Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T01:00:34.4090553Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T01:00:34.4091515Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2024-12-18T01:00:34.4092603Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T01:00:34.4093727Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2024-12-18T01:00:34.7950672Z 2024-12-18T01:00:34.7951587Z  2024-12-18T01:00:34.7952129Z  2024-12-18T01:00:34.7952708Z  2024-12-18T01:00:34.7953088Z  2024-12-18T01:00:34.7953458Z  2024-12-18T01:00:34.7953884Z  2024-12-18T01:00:34.7954279Z  2024-12-18T01:00:34.7954666Z  2024-12-18T01:00:34.7955585Z [19,022 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:34.7956633Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T01:00:34.7957541Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2024-12-18T01:00:34.7958506Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:34.7959311Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T01:00:34.7960102Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T01:00:34.7960971Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2024-12-18T01:00:34.7961933Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T01:00:34.7962916Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2024-12-18T01:00:35.0085459Z 2024-12-18T01:00:35.0086383Z  2024-12-18T01:00:35.0086927Z  2024-12-18T01:00:35.0087313Z  2024-12-18T01:00:35.0087657Z  2024-12-18T01:00:35.0088068Z  2024-12-18T01:00:35.0088434Z  2024-12-18T01:00:35.0088825Z  2024-12-18T01:00:35.0089178Z  2024-12-18T01:00:35.0090111Z [19,025 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:35.0091202Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T01:00:35.0092195Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2024-12-18T01:00:35.0093139Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:35.0093992Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T01:00:35.0094779Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2024-12-18T01:00:35.0095578Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2024-12-18T01:00:35.0096853Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T01:00:35.0097888Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2024-12-18T01:00:35.4089374Z 2024-12-18T01:00:35.4090222Z  2024-12-18T01:00:35.4090634Z  2024-12-18T01:00:35.4090995Z  2024-12-18T01:00:35.4091367Z  2024-12-18T01:00:35.4091735Z  2024-12-18T01:00:35.4092105Z  2024-12-18T01:00:35.4092491Z  2024-12-18T01:00:35.4092887Z  2024-12-18T01:00:35.4093642Z [19,026 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:35.4094439Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T01:00:35.4095338Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2024-12-18T01:00:35.4096046Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:35.4096975Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T01:00:35.4098092Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T01:00:35.4098854Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:35.4099769Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T01:00:35.4100736Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local ... 2024-12-18T01:00:35.6731905Z 2024-12-18T01:00:35.6732752Z  2024-12-18T01:00:35.6733287Z  2024-12-18T01:00:35.6733682Z  2024-12-18T01:00:35.6734112Z  2024-12-18T01:00:35.6734551Z  2024-12-18T01:00:35.6734940Z  2024-12-18T01:00:35.6735685Z  2024-12-18T01:00:35.6736069Z  2024-12-18T01:00:35.6737276Z [19,029 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:35.6738309Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T01:00:35.6739281Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T01:00:35.6740237Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:35.6741037Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T01:00:35.6741700Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T01:00:35.6742419Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:35.6743298Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2024-12-18T01:00:35.6744533Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local ... 2024-12-18T01:00:36.0018343Z 2024-12-18T01:00:36.0019240Z  2024-12-18T01:00:36.0019765Z  2024-12-18T01:00:36.0020175Z  2024-12-18T01:00:36.0020552Z  2024-12-18T01:00:36.0020940Z  2024-12-18T01:00:36.0021323Z  2024-12-18T01:00:36.0021705Z  2024-12-18T01:00:36.0022075Z  2024-12-18T01:00:36.0023002Z [19,031 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:36.0024195Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:00:36.0025160Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T01:00:36.0026084Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T01:00:36.0026977Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T01:00:36.0027807Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T01:00:36.0028642Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:36.0029421Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2024-12-18T01:00:36.0030387Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local ... 2024-12-18T01:00:36.2095019Z 2024-12-18T01:00:36.2095853Z  2024-12-18T01:00:36.2096260Z  2024-12-18T01:00:36.2096702Z  2024-12-18T01:00:36.2097048Z  2024-12-18T01:00:36.2097362Z  2024-12-18T01:00:36.2097710Z  2024-12-18T01:00:36.2098057Z  2024-12-18T01:00:36.2098396Z  2024-12-18T01:00:36.2099462Z [19,032 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:36.2100373Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:00:36.2101225Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T01:00:36.2102038Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T01:00:36.2102812Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:36.2103522Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2024-12-18T01:00:36.2104212Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2024-12-18T01:00:36.2104990Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 28s local 2024-12-18T01:00:36.2105898Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local ... 2024-12-18T01:00:36.4674617Z 2024-12-18T01:00:36.4676646Z  2024-12-18T01:00:36.4677063Z  2024-12-18T01:00:36.4677410Z  2024-12-18T01:00:36.4678082Z  2024-12-18T01:00:36.4678449Z  2024-12-18T01:00:36.4678823Z  2024-12-18T01:00:36.4679150Z  2024-12-18T01:00:36.4679609Z  2024-12-18T01:00:36.4680454Z [19,033 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:36.4681429Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:00:36.4682302Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2024-12-18T01:00:36.4683145Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T01:00:36.4684052Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:36.4684752Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T01:00:36.4685468Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2024-12-18T01:00:36.4686257Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 28s local 2024-12-18T01:00:36.4687202Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local ... 2024-12-18T01:00:36.7005610Z 2024-12-18T01:00:36.7006531Z  2024-12-18T01:00:36.7006897Z  2024-12-18T01:00:36.7007277Z  2024-12-18T01:00:36.7007596Z  2024-12-18T01:00:36.7007915Z  2024-12-18T01:00:36.7008237Z  2024-12-18T01:00:36.7008545Z  2024-12-18T01:00:36.7008874Z  2024-12-18T01:00:36.7009655Z [19,034 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:36.7010485Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:00:36.7011266Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T01:00:36.7012022Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T01:00:36.7012733Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:36.7013430Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T01:00:36.7014149Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2024-12-18T01:00:36.7014862Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local 2024-12-18T01:00:36.7015630Z @llvm-project//mlir:VectorTransforms; 20s local ... 2024-12-18T01:00:37.0101774Z 2024-12-18T01:00:37.0102628Z  2024-12-18T01:00:37.0103123Z  2024-12-18T01:00:37.0103522Z  2024-12-18T01:00:37.0103904Z  2024-12-18T01:00:37.0104277Z  2024-12-18T01:00:37.0104633Z  2024-12-18T01:00:37.0105004Z  2024-12-18T01:00:37.0105380Z  2024-12-18T01:00:37.0106353Z [19,035 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:37.0107376Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2024-12-18T01:00:37.0108301Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2024-12-18T01:00:37.0109282Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T01:00:37.0112193Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:37.0113290Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2024-12-18T01:00:37.0114214Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2024-12-18T01:00:37.0115120Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local 2024-12-18T01:00:37.0115993Z @llvm-project//mlir:VectorTransforms; 20s local ... 2024-12-18T01:00:37.6380529Z 2024-12-18T01:00:37.6381420Z  2024-12-18T01:00:37.6381873Z  2024-12-18T01:00:37.6382288Z  2024-12-18T01:00:37.6382665Z  2024-12-18T01:00:37.6383054Z  2024-12-18T01:00:37.6383430Z  2024-12-18T01:00:37.6383804Z  2024-12-18T01:00:37.6384200Z  2024-12-18T01:00:37.6385080Z [19,036 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:37.6386137Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2024-12-18T01:00:37.6387335Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T01:00:37.6388254Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T01:00:37.6389294Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T01:00:37.6390159Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2024-12-18T01:00:37.6390858Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T01:00:37.6391541Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2024-12-18T01:00:37.6392189Z @llvm-project//llvm:CodeGen; 18s local ... 2024-12-18T01:00:38.0108060Z 2024-12-18T01:00:38.0108904Z  2024-12-18T01:00:38.0109352Z  2024-12-18T01:00:38.0109760Z  2024-12-18T01:00:38.0110154Z  2024-12-18T01:00:38.0110535Z  2024-12-18T01:00:38.0110926Z  2024-12-18T01:00:38.0111319Z  2024-12-18T01:00:38.0111717Z  2024-12-18T01:00:38.0112625Z [19,036 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:38.0113727Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T01:00:38.0114611Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T01:00:38.0115544Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T01:00:38.0116359Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T01:00:38.0117197Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2024-12-18T01:00:38.0118013Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2024-12-18T01:00:38.0118853Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2024-12-18T01:00:38.0119679Z @llvm-project//llvm:CodeGen; 19s local ... 2024-12-18T01:00:38.3515446Z 2024-12-18T01:00:38.3516288Z  2024-12-18T01:00:38.3516770Z  2024-12-18T01:00:38.3517176Z  2024-12-18T01:00:38.3517579Z  2024-12-18T01:00:38.3517962Z  2024-12-18T01:00:38.3518370Z  2024-12-18T01:00:38.3518771Z  2024-12-18T01:00:38.3519213Z  2024-12-18T01:00:38.3520068Z [19,037 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:38.3521015Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T01:00:38.3521928Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2024-12-18T01:00:38.3522793Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T01:00:38.3523562Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T01:00:38.3524369Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T01:00:38.3525178Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:38.3526079Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2024-12-18T01:00:38.3526899Z @llvm-project//llvm:CodeGen; 19s local ... 2024-12-18T01:00:38.6114889Z 2024-12-18T01:00:38.6115783Z  2024-12-18T01:00:38.6116266Z  2024-12-18T01:00:38.6116944Z  2024-12-18T01:00:38.6117344Z  2024-12-18T01:00:38.6117735Z  2024-12-18T01:00:38.6118124Z  2024-12-18T01:00:38.6118528Z  2024-12-18T01:00:38.6118896Z  2024-12-18T01:00:38.6119827Z [19,037 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:38.6120872Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T01:00:38.6121836Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T01:00:38.6122754Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T01:00:38.6123590Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T01:00:38.6124403Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T01:00:38.6125243Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:38.6126166Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2024-12-18T01:00:38.6129157Z @llvm-project//llvm:CodeGen; 19s local ... 2024-12-18T01:00:39.0117723Z 2024-12-18T01:00:39.0118631Z  2024-12-18T01:00:39.0119158Z  2024-12-18T01:00:39.0119861Z  2024-12-18T01:00:39.0120240Z  2024-12-18T01:00:39.0120601Z  2024-12-18T01:00:39.0121012Z  2024-12-18T01:00:39.0121409Z  2024-12-18T01:00:39.0121811Z  2024-12-18T01:00:39.0122767Z [19,038 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:39.0123816Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2024-12-18T01:00:39.0125074Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T01:00:39.0126001Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T01:00:39.0126848Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T01:00:39.0127647Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T01:00:39.0128458Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:39.0129301Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2024-12-18T01:00:39.0130167Z @llvm-project//llvm:CodeGen; 20s local ... 2024-12-18T01:00:39.2121100Z 2024-12-18T01:00:39.2121986Z  2024-12-18T01:00:39.2122462Z  2024-12-18T01:00:39.2122856Z  2024-12-18T01:00:39.2123239Z  2024-12-18T01:00:39.2123601Z  2024-12-18T01:00:39.2123966Z  2024-12-18T01:00:39.2124312Z  2024-12-18T01:00:39.2124691Z  2024-12-18T01:00:39.2125582Z [19,039 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:39.2126581Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2024-12-18T01:00:39.2127481Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2024-12-18T01:00:39.2128382Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T01:00:39.2129181Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T01:00:39.2129994Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2024-12-18T01:00:39.2130768Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2024-12-18T01:00:39.2131625Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2024-12-18T01:00:39.2132389Z @llvm-project//llvm:CodeGen; 20s local ... 2024-12-18T01:00:39.6653569Z 2024-12-18T01:00:39.6654446Z  2024-12-18T01:00:39.6654986Z  2024-12-18T01:00:39.6655371Z  2024-12-18T01:00:39.6655750Z  2024-12-18T01:00:39.6656123Z  2024-12-18T01:00:39.6656669Z  2024-12-18T01:00:39.6657045Z  2024-12-18T01:00:39.6657432Z  2024-12-18T01:00:39.6658329Z [19,040 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:39.6659353Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2024-12-18T01:00:39.6660278Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T01:00:39.6661635Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T01:00:39.6662514Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T01:00:39.6663372Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T01:00:39.6664167Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T01:00:39.6665089Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T01:00:39.6665942Z @llvm-project//llvm:CodeGen; 20s local ... 2024-12-18T01:00:40.0072229Z 2024-12-18T01:00:40.0073105Z  2024-12-18T01:00:40.0073626Z  2024-12-18T01:00:40.0074003Z  2024-12-18T01:00:40.0074391Z  2024-12-18T01:00:40.0074768Z  2024-12-18T01:00:40.0075143Z  2024-12-18T01:00:40.0075511Z  2024-12-18T01:00:40.0075872Z  2024-12-18T01:00:40.0076782Z [19,041 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:40.0078184Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2024-12-18T01:00:40.0079104Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T01:00:40.0080166Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T01:00:40.0080960Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T01:00:40.0081788Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T01:00:40.0082653Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T01:00:40.0083534Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T01:00:40.0084599Z @llvm-project//llvm:CodeGen; 21s local ... 2024-12-18T01:00:40.2099303Z 2024-12-18T01:00:40.2100175Z  2024-12-18T01:00:40.2100656Z  2024-12-18T01:00:40.2101049Z  2024-12-18T01:00:40.2101447Z  2024-12-18T01:00:40.2101821Z  2024-12-18T01:00:40.2102194Z  2024-12-18T01:00:40.2102564Z  2024-12-18T01:00:40.2102937Z  2024-12-18T01:00:40.2103895Z [19,043 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:40.2104979Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2024-12-18T01:00:40.2105912Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T01:00:40.2106841Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T01:00:40.2107812Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T01:00:40.2108638Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2024-12-18T01:00:40.2109523Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2024-12-18T01:00:40.2110439Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T01:00:40.2111306Z @llvm-project//llvm:CodeGen; 21s local ... 2024-12-18T01:00:40.4129315Z 2024-12-18T01:00:40.4130392Z  2024-12-18T01:00:40.4130847Z  2024-12-18T01:00:40.4131220Z  2024-12-18T01:00:40.4131639Z  2024-12-18T01:00:40.4132017Z  2024-12-18T01:00:40.4132385Z  2024-12-18T01:00:40.4132767Z  2024-12-18T01:00:40.4133152Z  2024-12-18T01:00:40.4134047Z [19,043 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:40.4135098Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2024-12-18T01:00:40.4136011Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2024-12-18T01:00:40.4137060Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T01:00:40.4137892Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T01:00:40.4138654Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T01:00:40.4139390Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T01:00:40.4140252Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2024-12-18T01:00:40.4141049Z @llvm-project//llvm:CodeGen; 21s local ... 2024-12-18T01:00:41.0735873Z 2024-12-18T01:00:41.0737725Z  2024-12-18T01:00:41.0738155Z  2024-12-18T01:00:41.0738521Z  2024-12-18T01:00:41.0738912Z  2024-12-18T01:00:41.0739307Z  2024-12-18T01:00:41.0739712Z  2024-12-18T01:00:41.0740139Z  2024-12-18T01:00:41.0740538Z  2024-12-18T01:00:41.0741463Z [19,044 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:41.0742560Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2024-12-18T01:00:41.0743545Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T01:00:41.0744613Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T01:00:41.0745483Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2024-12-18T01:00:41.0746321Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2024-12-18T01:00:41.0747236Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2024-12-18T01:00:41.0748350Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T01:00:41.0749169Z Compiling xla/service/llvm_ir/alias_analysis.cc; 15s local ... 2024-12-18T01:00:41.4079543Z 2024-12-18T01:00:41.4080435Z  2024-12-18T01:00:41.4080890Z  2024-12-18T01:00:41.4081260Z  2024-12-18T01:00:41.4081624Z  2024-12-18T01:00:41.4082020Z  2024-12-18T01:00:41.4082410Z  2024-12-18T01:00:41.4082790Z  2024-12-18T01:00:41.4083198Z  2024-12-18T01:00:41.4084123Z [19,046 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:41.4085486Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2024-12-18T01:00:41.4086418Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T01:00:41.4087213Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T01:00:41.4088030Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T01:00:41.4088873Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2024-12-18T01:00:41.4089757Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2024-12-18T01:00:41.4090618Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T01:00:41.4091363Z Compiling xla/service/llvm_ir/alias_analysis.cc; 15s local ... 2024-12-18T01:00:41.6137483Z 2024-12-18T01:00:41.6138346Z  2024-12-18T01:00:41.6138822Z  2024-12-18T01:00:41.6139215Z  2024-12-18T01:00:41.6139617Z  2024-12-18T01:00:41.6139991Z  2024-12-18T01:00:41.6140554Z  2024-12-18T01:00:41.6140935Z  2024-12-18T01:00:41.6141324Z  2024-12-18T01:00:41.6142257Z [19,046 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:41.6143311Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T01:00:41.6144518Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T01:00:41.6145368Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T01:00:41.6146316Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T01:00:41.6147141Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2024-12-18T01:00:41.6147995Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2024-12-18T01:00:41.6148797Z @llvm-project//llvm:CodeGen; 22s local 2024-12-18T01:00:41.6149528Z Compiling xla/service/llvm_ir/alias_analysis.cc; 15s local ... 2024-12-18T01:00:41.8447848Z 2024-12-18T01:00:41.8448774Z  2024-12-18T01:00:41.8449326Z  2024-12-18T01:00:41.8449733Z  2024-12-18T01:00:41.8450100Z  2024-12-18T01:00:41.8450451Z  2024-12-18T01:00:41.8450790Z  2024-12-18T01:00:41.8451174Z  2024-12-18T01:00:41.8451557Z  2024-12-18T01:00:41.8452470Z [19,047 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:41.8453815Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T01:00:41.8454737Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T01:00:41.8455659Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T01:00:41.8456615Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T01:00:41.8457414Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2024-12-18T01:00:41.8458286Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2024-12-18T01:00:41.8459128Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T01:00:41.8459900Z Compiling xla/service/llvm_ir/alias_analysis.cc; 15s local ... 2024-12-18T01:00:42.1408036Z 2024-12-18T01:00:42.1408893Z  2024-12-18T01:00:42.1409370Z  2024-12-18T01:00:42.1409738Z  2024-12-18T01:00:42.1410125Z  2024-12-18T01:00:42.1410505Z  2024-12-18T01:00:42.1410894Z  2024-12-18T01:00:42.1411291Z  2024-12-18T01:00:42.1411654Z  2024-12-18T01:00:42.1412879Z [19,050 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:42.1414053Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T01:00:42.1415127Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T01:00:42.1416012Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T01:00:42.1417033Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2024-12-18T01:00:42.1417895Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2024-12-18T01:00:42.1418963Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2024-12-18T01:00:42.1419838Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T01:00:42.1420624Z Compiling xla/service/llvm_ir/alias_analysis.cc; 16s local ... 2024-12-18T01:00:42.4143403Z 2024-12-18T01:00:42.4144559Z  2024-12-18T01:00:42.4145045Z  2024-12-18T01:00:42.4145446Z  2024-12-18T01:00:42.4145846Z  2024-12-18T01:00:42.4146286Z  2024-12-18T01:00:42.4146657Z  2024-12-18T01:00:42.4147032Z  2024-12-18T01:00:42.4147444Z  2024-12-18T01:00:42.4148426Z [19,051 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:42.4149532Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2024-12-18T01:00:42.4150533Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T01:00:42.4151424Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T01:00:42.4152344Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T01:00:42.4153247Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T01:00:42.4154158Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2024-12-18T01:00:42.4155063Z @llvm-project//llvm:CodeGen; 23s local 2024-12-18T01:00:42.4155836Z Compiling xla/service/llvm_ir/alias_analysis.cc; 16s local ... 2024-12-18T01:00:42.7690211Z 2024-12-18T01:00:42.7691696Z  2024-12-18T01:00:42.7692173Z  2024-12-18T01:00:42.7692532Z  2024-12-18T01:00:42.7692891Z  2024-12-18T01:00:42.7693261Z  2024-12-18T01:00:42.7693616Z  2024-12-18T01:00:42.7693956Z  2024-12-18T01:00:42.7694283Z  2024-12-18T01:00:42.7695154Z [19,053 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:42.7696111Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2024-12-18T01:00:42.7697079Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:00:42.7697843Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T01:00:42.7698723Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T01:00:42.7699464Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T01:00:42.7700285Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2024-12-18T01:00:42.7701353Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T01:00:42.7702142Z Compiling xla/backends/cpu/runtime/conditional_thunk.cc; 16s local ... 2024-12-18T01:00:43.0149286Z 2024-12-18T01:00:43.0150176Z  2024-12-18T01:00:43.0150704Z  2024-12-18T01:00:43.0151149Z  2024-12-18T01:00:43.0151601Z  2024-12-18T01:00:43.0152058Z  2024-12-18T01:00:43.0152514Z  2024-12-18T01:00:43.0152964Z  2024-12-18T01:00:43.0153417Z  2024-12-18T01:00:43.0154488Z [19,054 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:43.0155819Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2024-12-18T01:00:43.0157102Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:00:43.0158117Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T01:00:43.0159103Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2024-12-18T01:00:43.0160387Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2024-12-18T01:00:43.0161450Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2024-12-18T01:00:43.0162611Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T01:00:43.0163476Z Compiling xla/service/hlo_module_util.cc; 15s local ... 2024-12-18T01:00:43.3338650Z 2024-12-18T01:00:43.3339461Z  2024-12-18T01:00:43.3339882Z  2024-12-18T01:00:43.3340226Z  2024-12-18T01:00:43.3340546Z  2024-12-18T01:00:43.3340886Z  2024-12-18T01:00:43.3341225Z  2024-12-18T01:00:43.3341836Z  2024-12-18T01:00:43.3342154Z  2024-12-18T01:00:43.3342951Z [19,058 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:43.3343875Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2024-12-18T01:00:43.3344924Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:00:43.3345659Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T01:00:43.3346370Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T01:00:43.3347052Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T01:00:43.3347783Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2024-12-18T01:00:43.3348476Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T01:00:43.3349076Z Compiling xla/service/hlo_module_util.cc; 15s local ... 2024-12-18T01:00:43.6154210Z 2024-12-18T01:00:43.6155097Z  2024-12-18T01:00:43.6155525Z  2024-12-18T01:00:43.6155895Z  2024-12-18T01:00:43.6156241Z  2024-12-18T01:00:43.6156587Z  2024-12-18T01:00:43.6156932Z  2024-12-18T01:00:43.6157258Z  2024-12-18T01:00:43.6157607Z  2024-12-18T01:00:43.6158439Z [19,059 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:43.6159445Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T01:00:43.6160280Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:00:43.6161006Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T01:00:43.6161808Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T01:00:43.6162639Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T01:00:43.6163544Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2024-12-18T01:00:43.6164361Z @llvm-project//llvm:CodeGen; 24s local 2024-12-18T01:00:43.6165191Z Compiling xla/service/hlo_module_util.cc; 15s local ... 2024-12-18T01:00:44.0158537Z 2024-12-18T01:00:44.0159375Z  2024-12-18T01:00:44.0159892Z  2024-12-18T01:00:44.0160311Z  2024-12-18T01:00:44.0160699Z  2024-12-18T01:00:44.0161117Z  2024-12-18T01:00:44.0161522Z  2024-12-18T01:00:44.0161939Z  2024-12-18T01:00:44.0162307Z  2024-12-18T01:00:44.0163596Z [19,060 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:44.0164770Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2024-12-18T01:00:44.0165808Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T01:00:44.0166713Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T01:00:44.0167572Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2024-12-18T01:00:44.0168354Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2024-12-18T01:00:44.0169293Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2024-12-18T01:00:44.0170223Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T01:00:44.0170953Z Compiling xla/service/hlo_module_util.cc; 16s local ... 2024-12-18T01:00:44.6102726Z 2024-12-18T01:00:44.6103589Z  2024-12-18T01:00:44.6104059Z  2024-12-18T01:00:44.6104446Z  2024-12-18T01:00:44.6104810Z  2024-12-18T01:00:44.6105210Z  2024-12-18T01:00:44.6105863Z  2024-12-18T01:00:44.6106268Z  2024-12-18T01:00:44.6106643Z  2024-12-18T01:00:44.6107562Z [19,061 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:44.6108774Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T01:00:44.6109669Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T01:00:44.6110455Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T01:00:44.6111312Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T01:00:44.6112294Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T01:00:44.6113114Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2024-12-18T01:00:44.6113950Z @llvm-project//llvm:CodeGen; 25s local 2024-12-18T01:00:44.6114623Z Compiling xla/service/hlo_module_util.cc; 16s local ... 2024-12-18T01:00:44.8163545Z 2024-12-18T01:00:44.8165079Z  2024-12-18T01:00:44.8165575Z  2024-12-18T01:00:44.8165966Z  2024-12-18T01:00:44.8166315Z  2024-12-18T01:00:44.8166684Z  2024-12-18T01:00:44.8167069Z  2024-12-18T01:00:44.8167432Z  2024-12-18T01:00:44.8167777Z  2024-12-18T01:00:44.8168679Z [19,062 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:44.8169761Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T01:00:44.8170694Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T01:00:44.8171517Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T01:00:44.8172494Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T01:00:44.8173343Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T01:00:44.8174202Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2024-12-18T01:00:44.8174886Z @llvm-project//llvm:CodeGen; 26s local 2024-12-18T01:00:44.8175500Z Compiling xla/service/hlo_module_util.cc; 17s local ... 2024-12-18T01:00:45.1138457Z 2024-12-18T01:00:45.1139803Z  2024-12-18T01:00:45.1140313Z  2024-12-18T01:00:45.1140673Z  2024-12-18T01:00:45.1141069Z  2024-12-18T01:00:45.1141503Z  2024-12-18T01:00:45.1141916Z  2024-12-18T01:00:45.1142342Z  2024-12-18T01:00:45.1142736Z  2024-12-18T01:00:45.1143659Z [19,063 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:45.1144949Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T01:00:45.1145773Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T01:00:45.1146615Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T01:00:45.1147495Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2024-12-18T01:00:45.1148321Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2024-12-18T01:00:45.1149605Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2024-12-18T01:00:45.1150517Z @llvm-project//llvm:CodeGen; 26s local 2024-12-18T01:00:45.1151277Z Compiling xla/service/hlo_module_util.cc; 17s local ... 2024-12-18T01:00:45.3300631Z 2024-12-18T01:00:45.3301489Z  2024-12-18T01:00:45.3302101Z  2024-12-18T01:00:45.3302507Z  2024-12-18T01:00:45.3302926Z  2024-12-18T01:00:45.3303330Z  2024-12-18T01:00:45.3303738Z  2024-12-18T01:00:45.3304157Z  2024-12-18T01:00:45.3304561Z  2024-12-18T01:00:45.3305477Z [19,067 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:45.3306562Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2024-12-18T01:00:45.3307482Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T01:00:45.3308352Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:45.3309506Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T01:00:45.3310396Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T01:00:45.3311435Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2024-12-18T01:00:45.3312395Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 14s local 2024-12-18T01:00:45.3313356Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 14s local ... 2024-12-18T01:00:45.5641967Z 2024-12-18T01:00:45.5642775Z  2024-12-18T01:00:45.5643247Z  2024-12-18T01:00:45.5643905Z  2024-12-18T01:00:45.5647167Z  2024-12-18T01:00:45.5647640Z  2024-12-18T01:00:45.5648039Z  2024-12-18T01:00:45.5648450Z  2024-12-18T01:00:45.5648835Z  2024-12-18T01:00:45.5649780Z [19,069 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:45.5650897Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T01:00:45.5651913Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T01:00:45.5652730Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:45.5653587Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T01:00:45.5654424Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T01:00:45.5655344Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2024-12-18T01:00:45.5656656Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2024-12-18T01:00:45.5657646Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 14s local ... 2024-12-18T01:00:45.7812843Z 2024-12-18T01:00:45.7813664Z  2024-12-18T01:00:45.7814083Z  2024-12-18T01:00:45.7814422Z  2024-12-18T01:00:45.7814771Z  2024-12-18T01:00:45.7815105Z  2024-12-18T01:00:45.7815434Z  2024-12-18T01:00:45.7815761Z  2024-12-18T01:00:45.7816103Z  2024-12-18T01:00:45.7817083Z [19,070 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:45.7818042Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T01:00:45.7818869Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:00:45.7819560Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:45.7820259Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T01:00:45.7820950Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T01:00:45.7821678Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T01:00:45.7822562Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2024-12-18T01:00:45.7823389Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 15s local ... 2024-12-18T01:00:46.0171813Z 2024-12-18T01:00:46.0173110Z  2024-12-18T01:00:46.0173548Z  2024-12-18T01:00:46.0174012Z  2024-12-18T01:00:46.0174381Z  2024-12-18T01:00:46.0175147Z  2024-12-18T01:00:46.0175624Z  2024-12-18T01:00:46.0176010Z  2024-12-18T01:00:46.0176477Z  2024-12-18T01:00:46.0177349Z [19,070 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:46.0178346Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T01:00:46.0179208Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:00:46.0179951Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:46.0180677Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2024-12-18T01:00:46.0181398Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2024-12-18T01:00:46.0182170Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T01:00:46.0183009Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2024-12-18T01:00:46.0183806Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 15s local ... 2024-12-18T01:00:46.3055382Z 2024-12-18T01:00:46.3056529Z  2024-12-18T01:00:46.3057021Z  2024-12-18T01:00:46.3057408Z  2024-12-18T01:00:46.3057995Z  2024-12-18T01:00:46.3058373Z  2024-12-18T01:00:46.3058769Z  2024-12-18T01:00:46.3059176Z  2024-12-18T01:00:46.3059564Z  2024-12-18T01:00:46.3060530Z [19,071 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:46.3061678Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2024-12-18T01:00:46.3062838Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:00:46.3063730Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T01:00:46.3064602Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:46.3065541Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:46.3066496Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T01:00:46.3067552Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2024-12-18T01:00:46.3068492Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 15s local ... 2024-12-18T01:00:46.6177500Z 2024-12-18T01:00:46.6178674Z  2024-12-18T01:00:46.6179123Z  2024-12-18T01:00:46.6179488Z  2024-12-18T01:00:46.6179870Z  2024-12-18T01:00:46.6180247Z  2024-12-18T01:00:46.6180587Z  2024-12-18T01:00:46.6181022Z  2024-12-18T01:00:46.6181369Z  2024-12-18T01:00:46.6182282Z [19,072 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:46.6183424Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T01:00:46.6184391Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:00:46.6185213Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T01:00:46.6186066Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:46.6186887Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:46.6187777Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2024-12-18T01:00:46.6188797Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2024-12-18T01:00:46.6189745Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 15s local ... 2024-12-18T01:00:46.8736214Z 2024-12-18T01:00:46.8737276Z  2024-12-18T01:00:46.8737800Z  2024-12-18T01:00:46.8738200Z  2024-12-18T01:00:46.8738587Z  2024-12-18T01:00:46.8738974Z  2024-12-18T01:00:46.8739354Z  2024-12-18T01:00:46.8739741Z  2024-12-18T01:00:46.8740134Z  2024-12-18T01:00:46.8740971Z [19,073 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:46.8741803Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T01:00:46.8742671Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2024-12-18T01:00:46.8743695Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T01:00:46.8744811Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:46.8745629Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:46.8746465Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2024-12-18T01:00:46.8747444Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2024-12-18T01:00:46.8748271Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 16s local ... 2024-12-18T01:00:47.2182953Z 2024-12-18T01:00:47.2183883Z  2024-12-18T01:00:47.2184346Z  2024-12-18T01:00:47.2184750Z  2024-12-18T01:00:47.2185139Z  2024-12-18T01:00:47.2185519Z  2024-12-18T01:00:47.2185888Z  2024-12-18T01:00:47.2186246Z  2024-12-18T01:00:47.2186643Z  2024-12-18T01:00:47.2187532Z [19,073 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:47.2188933Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T01:00:47.2189898Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2024-12-18T01:00:47.2190873Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T01:00:47.2191694Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2024-12-18T01:00:47.2192657Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2024-12-18T01:00:47.2193555Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2024-12-18T01:00:47.2194737Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2024-12-18T01:00:47.2195753Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 16s local ... 2024-12-18T01:00:47.4721361Z 2024-12-18T01:00:47.4722187Z  2024-12-18T01:00:47.4722651Z  2024-12-18T01:00:47.4723049Z  2024-12-18T01:00:47.4723426Z  2024-12-18T01:00:47.4723838Z  2024-12-18T01:00:47.4724242Z  2024-12-18T01:00:47.4724701Z  2024-12-18T01:00:47.4725096Z  2024-12-18T01:00:47.4726195Z [19,074 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:47.4727315Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2024-12-18T01:00:47.4728260Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2024-12-18T01:00:47.4729064Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T01:00:47.4729896Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:47.4730726Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T01:00:47.4731581Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2024-12-18T01:00:47.4732552Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2024-12-18T01:00:47.4733524Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 16s local ... 2024-12-18T01:00:47.7363817Z 2024-12-18T01:00:47.7364697Z  2024-12-18T01:00:47.7365225Z  2024-12-18T01:00:47.7365644Z  2024-12-18T01:00:47.7366049Z  2024-12-18T01:00:47.7366437Z  2024-12-18T01:00:47.7366849Z  2024-12-18T01:00:47.7367221Z  2024-12-18T01:00:47.7367609Z  2024-12-18T01:00:47.7368559Z [19,076 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:47.7369726Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T01:00:47.7370722Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:00:47.7371579Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T01:00:47.7372370Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:47.7373176Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T01:00:47.7374042Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2024-12-18T01:00:47.7375263Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2024-12-18T01:00:47.7376265Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 17s local ... 2024-12-18T01:00:47.9830068Z 2024-12-18T01:00:47.9831131Z  2024-12-18T01:00:47.9831740Z  2024-12-18T01:00:47.9832229Z  2024-12-18T01:00:47.9832590Z  2024-12-18T01:00:47.9832978Z  2024-12-18T01:00:47.9833382Z  2024-12-18T01:00:47.9833767Z  2024-12-18T01:00:47.9834118Z  2024-12-18T01:00:47.9835001Z [19,077 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:47.9836110Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T01:00:47.9837060Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:00:47.9837757Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T01:00:47.9838601Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:47.9839430Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T01:00:47.9840586Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2024-12-18T01:00:47.9841825Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2024-12-18T01:00:47.9842899Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 17s local ... 2024-12-18T01:00:48.2191074Z 2024-12-18T01:00:48.2191936Z  2024-12-18T01:00:48.2192361Z  2024-12-18T01:00:48.2192733Z  2024-12-18T01:00:48.2193077Z  2024-12-18T01:00:48.2193448Z  2024-12-18T01:00:48.2193808Z  2024-12-18T01:00:48.2194399Z  2024-12-18T01:00:48.2194723Z  2024-12-18T01:00:48.2195531Z [19,078 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:48.2196507Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2024-12-18T01:00:48.2197338Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:00:48.2198109Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T01:00:48.2198801Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2024-12-18T01:00:48.2199493Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2024-12-18T01:00:48.2200272Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2024-12-18T01:00:48.2201116Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2024-12-18T01:00:48.2201927Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 17s local ... 2024-12-18T01:00:48.6195486Z 2024-12-18T01:00:48.6196335Z  2024-12-18T01:00:48.6196752Z  2024-12-18T01:00:48.6197067Z  2024-12-18T01:00:48.6197361Z  2024-12-18T01:00:48.6197673Z  2024-12-18T01:00:48.6197981Z  2024-12-18T01:00:48.6198290Z  2024-12-18T01:00:48.6198580Z  2024-12-18T01:00:48.6199320Z [19,081 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:48.6200203Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2024-12-18T01:00:48.6200933Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:00:48.6201718Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T01:00:48.6202336Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T01:00:48.6202941Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T01:00:48.6203568Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2024-12-18T01:00:48.6204252Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 17s local 2024-12-18T01:00:48.6204969Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local ... 2024-12-18T01:00:49.0003892Z 2024-12-18T01:00:49.0004768Z  2024-12-18T01:00:49.0005205Z  2024-12-18T01:00:49.0005571Z  2024-12-18T01:00:49.0005937Z  2024-12-18T01:00:49.0006288Z  2024-12-18T01:00:49.0006646Z  2024-12-18T01:00:49.0007008Z  2024-12-18T01:00:49.0007368Z  2024-12-18T01:00:49.0008462Z [19,082 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:49.0009446Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2024-12-18T01:00:49.0010283Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T01:00:49.0011066Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T01:00:49.0012245Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T01:00:49.0013110Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T01:00:49.0013995Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2024-12-18T01:00:49.0014867Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 18s local 2024-12-18T01:00:49.0015786Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local ... 2024-12-18T01:00:49.2200841Z 2024-12-18T01:00:49.2202663Z  2024-12-18T01:00:49.2203108Z  2024-12-18T01:00:49.2203487Z  2024-12-18T01:00:49.2204130Z  2024-12-18T01:00:49.2204498Z  2024-12-18T01:00:49.2204848Z  2024-12-18T01:00:49.2205220Z  2024-12-18T01:00:49.2205667Z  2024-12-18T01:00:49.2206501Z [19,083 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:49.2207451Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T01:00:49.2208186Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T01:00:49.2208908Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2024-12-18T01:00:49.2209746Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2024-12-18T01:00:49.2210462Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2024-12-18T01:00:49.2211310Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 18s local 2024-12-18T01:00:49.2212089Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2024-12-18T01:00:49.2212956Z Compiling shardy/dialect/sdy/ir/dialect.cc; 15s local ... 2024-12-18T01:00:49.6205023Z 2024-12-18T01:00:49.6205938Z  2024-12-18T01:00:49.6206403Z  2024-12-18T01:00:49.6206838Z  2024-12-18T01:00:49.6207229Z  2024-12-18T01:00:49.6207604Z  2024-12-18T01:00:49.6207999Z  2024-12-18T01:00:49.6208393Z  2024-12-18T01:00:49.6208787Z  2024-12-18T01:00:49.6209760Z [19,084 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:49.6210802Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T01:00:49.6211653Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T01:00:49.6212504Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T01:00:49.6213377Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T01:00:49.6214204Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 18s local 2024-12-18T01:00:49.6215040Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2024-12-18T01:00:49.6215902Z Compiling shardy/dialect/sdy/ir/dialect.cc; 15s local 2024-12-18T01:00:49.6216972Z Compiling xla/service/llvm_ir/alias_analysis.cc; 14s local ... 2024-12-18T01:00:49.8209855Z 2024-12-18T01:00:49.8210732Z  2024-12-18T01:00:49.8211153Z  2024-12-18T01:00:49.8211535Z  2024-12-18T01:00:49.8211887Z  2024-12-18T01:00:49.8212252Z  2024-12-18T01:00:49.8212612Z  2024-12-18T01:00:49.8212948Z  2024-12-18T01:00:49.8213310Z  2024-12-18T01:00:49.8214236Z [19,085 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:49.8215275Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T01:00:49.8216047Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T01:00:49.8217005Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T01:00:49.8217832Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T01:00:49.8218979Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 19s local 2024-12-18T01:00:49.8219856Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2024-12-18T01:00:49.8220695Z Compiling shardy/dialect/sdy/ir/dialect.cc; 15s local 2024-12-18T01:00:49.8221666Z Compiling xla/service/llvm_ir/alias_analysis.cc; 14s local ... 2024-12-18T01:00:50.2214364Z 2024-12-18T01:00:50.2215221Z  2024-12-18T01:00:50.2215690Z  2024-12-18T01:00:50.2216098Z  2024-12-18T01:00:50.2216587Z  2024-12-18T01:00:50.2216972Z  2024-12-18T01:00:50.2217391Z  2024-12-18T01:00:50.2217765Z  2024-12-18T01:00:50.2218128Z  2024-12-18T01:00:50.2219054Z [19,086 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:50.2220123Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T01:00:50.2220971Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T01:00:50.2222060Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2024-12-18T01:00:50.2222933Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2024-12-18T01:00:50.2223859Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 19s local 2024-12-18T01:00:50.2224772Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2024-12-18T01:00:50.2225653Z Compiling shardy/dialect/sdy/ir/dialect.cc; 16s local 2024-12-18T01:00:50.2226520Z Compiling xla/service/llvm_ir/alias_analysis.cc; 14s local ... 2024-12-18T01:00:50.6218412Z 2024-12-18T01:00:50.6219481Z  2024-12-18T01:00:50.6219912Z  2024-12-18T01:00:50.6220253Z  2024-12-18T01:00:50.6220601Z  2024-12-18T01:00:50.6220959Z  2024-12-18T01:00:50.6221320Z  2024-12-18T01:00:50.6221652Z  2024-12-18T01:00:50.6222004Z  2024-12-18T01:00:50.6222840Z [19,088 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:50.6223824Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T01:00:50.6224564Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T01:00:50.6225324Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T01:00:50.6226052Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T01:00:50.6226763Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 19s local 2024-12-18T01:00:50.6227547Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2024-12-18T01:00:50.6228326Z Compiling shardy/dialect/sdy/ir/dialect.cc; 16s local 2024-12-18T01:00:50.6229088Z Compiling xla/service/llvm_ir/alias_analysis.cc; 15s local ... 2024-12-18T01:00:50.8221908Z 2024-12-18T01:00:50.8222782Z  2024-12-18T01:00:50.8223236Z  2024-12-18T01:00:50.8223640Z  2024-12-18T01:00:50.8224009Z  2024-12-18T01:00:50.8224414Z  2024-12-18T01:00:50.8224808Z  2024-12-18T01:00:50.8225220Z  2024-12-18T01:00:50.8225629Z  2024-12-18T01:00:50.8226551Z [19,089 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:50.8227501Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T01:00:50.8228360Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T01:00:50.8229171Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T01:00:50.8229994Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2024-12-18T01:00:50.8230738Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 20s local 2024-12-18T01:00:50.8231599Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2024-12-18T01:00:50.8232406Z Compiling shardy/dialect/sdy/ir/dialect.cc; 16s local 2024-12-18T01:00:50.8233212Z Compiling xla/service/llvm_ir/alias_analysis.cc; 15s local ... 2024-12-18T01:00:51.2490031Z 2024-12-18T01:00:51.2490914Z  2024-12-18T01:00:51.2491345Z  2024-12-18T01:00:51.2491717Z  2024-12-18T01:00:51.2492342Z  2024-12-18T01:00:51.2492721Z  2024-12-18T01:00:51.2493066Z  2024-12-18T01:00:51.2493427Z  2024-12-18T01:00:51.2493799Z  2024-12-18T01:00:51.2494650Z [19,090 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:51.2495616Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T01:00:51.2496528Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T01:00:51.2497291Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2024-12-18T01:00:51.2498059Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T01:00:51.2498815Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 20s local 2024-12-18T01:00:51.2499650Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2024-12-18T01:00:51.2500462Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local 2024-12-18T01:00:51.2501463Z Compiling xla/service/llvm_ir/alias_analysis.cc; 15s local ... 2024-12-18T01:00:51.5458375Z 2024-12-18T01:00:51.5459194Z  2024-12-18T01:00:51.5459764Z  2024-12-18T01:00:51.5460398Z  2024-12-18T01:00:51.5460765Z  2024-12-18T01:00:51.5461108Z  2024-12-18T01:00:51.5461474Z  2024-12-18T01:00:51.5461838Z  2024-12-18T01:00:51.5462218Z  2024-12-18T01:00:51.5463112Z [19,094 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:51.5464094Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T01:00:51.5465012Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T01:00:51.5465830Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T01:00:51.5466676Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T01:00:51.5467369Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 20s local 2024-12-18T01:00:51.5468083Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local 2024-12-18T01:00:51.5468800Z Compiling xla/service/llvm_ir/alias_analysis.cc; 16s local 2024-12-18T01:00:51.5469565Z Compiling xla/service/spmd/spmd_partitioner.cc; 15s local ... 2024-12-18T01:00:51.8228814Z 2024-12-18T01:00:51.8229725Z  2024-12-18T01:00:51.8230191Z  2024-12-18T01:00:51.8230607Z  2024-12-18T01:00:51.8231019Z  2024-12-18T01:00:51.8231431Z  2024-12-18T01:00:51.8231847Z  2024-12-18T01:00:51.8232251Z  2024-12-18T01:00:51.8232654Z  2024-12-18T01:00:51.8233635Z [19,095 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:51.8234806Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T01:00:51.8235726Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T01:00:51.8236594Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T01:00:51.8237480Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T01:00:51.8238380Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 21s local 2024-12-18T01:00:51.8239278Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local 2024-12-18T01:00:51.8240165Z Compiling xla/service/llvm_ir/alias_analysis.cc; 16s local 2024-12-18T01:00:51.8241106Z Compiling xla/service/spmd/spmd_partitioner.cc; 15s local ... 2024-12-18T01:00:52.1397170Z 2024-12-18T01:00:52.1398205Z  2024-12-18T01:00:52.1398654Z  2024-12-18T01:00:52.1399047Z  2024-12-18T01:00:52.1399426Z  2024-12-18T01:00:52.1399805Z  2024-12-18T01:00:52.1400222Z  2024-12-18T01:00:52.1400612Z  2024-12-18T01:00:52.1400969Z  2024-12-18T01:00:52.1401901Z [19,097 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:52.1402943Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T01:00:52.1403795Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T01:00:52.1404968Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2024-12-18T01:00:52.1405817Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2024-12-18T01:00:52.1407148Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 21s local 2024-12-18T01:00:52.1408121Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local 2024-12-18T01:00:52.1409130Z Compiling xla/service/llvm_ir/alias_analysis.cc; 16s local 2024-12-18T01:00:52.1410186Z Compiling xla/service/spmd/spmd_partitioner.cc; 15s local ... 2024-12-18T01:00:52.4032423Z 2024-12-18T01:00:52.4033346Z  2024-12-18T01:00:52.4033831Z  2024-12-18T01:00:52.4034231Z  2024-12-18T01:00:52.4034691Z  2024-12-18T01:00:52.4035197Z  2024-12-18T01:00:52.4035698Z  2024-12-18T01:00:52.4036181Z  2024-12-18T01:00:52.4036647Z  2024-12-18T01:00:52.4037561Z [19,099 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:52.4039055Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T01:00:52.4039937Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T01:00:52.4040892Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T01:00:52.4041879Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T01:00:52.4042731Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 21s local 2024-12-18T01:00:52.4043612Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local 2024-12-18T01:00:52.4044713Z Compiling xla/service/spmd/spmd_partitioner.cc; 16s local 2024-12-18T01:00:52.4045917Z @llvm-project//mlir:VectorTransforms; 14s local ... 2024-12-18T01:00:52.6234428Z 2024-12-18T01:00:52.6235300Z  2024-12-18T01:00:52.6235808Z  2024-12-18T01:00:52.6236219Z  2024-12-18T01:00:52.6236633Z  2024-12-18T01:00:52.6237024Z  2024-12-18T01:00:52.6237399Z  2024-12-18T01:00:52.6237787Z  2024-12-18T01:00:52.6238181Z  2024-12-18T01:00:52.6239175Z [19,100 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:52.6240186Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T01:00:52.6240973Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T01:00:52.6241783Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T01:00:52.6242603Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T01:00:52.6243392Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 21s local 2024-12-18T01:00:52.6244661Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local 2024-12-18T01:00:52.6246004Z Compiling xla/service/spmd/spmd_partitioner.cc; 16s local 2024-12-18T01:00:52.6246828Z @llvm-project//mlir:VectorTransforms; 13s local ... 2024-12-18T01:00:53.0239022Z 2024-12-18T01:00:53.0240015Z  2024-12-18T01:00:53.0240486Z  2024-12-18T01:00:53.0240857Z  2024-12-18T01:00:53.0241253Z  2024-12-18T01:00:53.0241696Z  2024-12-18T01:00:53.0242073Z  2024-12-18T01:00:53.0242455Z  2024-12-18T01:00:53.0242858Z  2024-12-18T01:00:53.0243815Z [19,102 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:53.0245168Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T01:00:53.0246024Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T01:00:53.0246868Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2024-12-18T01:00:53.0247678Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2024-12-18T01:00:53.0248514Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 22s local 2024-12-18T01:00:53.0249393Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local 2024-12-18T01:00:53.0250254Z Compiling xla/service/spmd/spmd_partitioner.cc; 16s local 2024-12-18T01:00:53.0251102Z @llvm-project//mlir:VectorTransforms; 14s local ... 2024-12-18T01:00:53.4243336Z 2024-12-18T01:00:53.4244747Z  2024-12-18T01:00:53.4245419Z  2024-12-18T01:00:53.4245791Z  2024-12-18T01:00:53.4246156Z  2024-12-18T01:00:53.4246527Z  2024-12-18T01:00:53.4246917Z  2024-12-18T01:00:53.4247287Z  2024-12-18T01:00:53.4247679Z  2024-12-18T01:00:53.4248656Z [19,103 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:53.4249792Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T01:00:53.4250639Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2024-12-18T01:00:53.4251442Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T01:00:53.4252253Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T01:00:53.4253082Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 22s local 2024-12-18T01:00:53.4253931Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local 2024-12-18T01:00:53.4255005Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local 2024-12-18T01:00:53.4255832Z @llvm-project//mlir:VectorTransforms; 14s local ... 2024-12-18T01:00:53.7153399Z 2024-12-18T01:00:53.7154287Z  2024-12-18T01:00:53.7154839Z  2024-12-18T01:00:53.7155225Z  2024-12-18T01:00:53.7155611Z  2024-12-18T01:00:53.7156044Z  2024-12-18T01:00:53.7156430Z  2024-12-18T01:00:53.7156802Z  2024-12-18T01:00:53.7157196Z  2024-12-18T01:00:53.7158091Z [19,104 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:53.7159422Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T01:00:53.7160306Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2024-12-18T01:00:53.7161173Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T01:00:53.7162028Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T01:00:53.7162875Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local 2024-12-18T01:00:53.7163719Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local 2024-12-18T01:00:53.7164577Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local 2024-12-18T01:00:53.7165436Z @llvm-project//mlir:VectorTransforms; 14s local ... 2024-12-18T01:00:54.0249476Z 2024-12-18T01:00:54.0250234Z  2024-12-18T01:00:54.0250641Z  2024-12-18T01:00:54.0250978Z  2024-12-18T01:00:54.0251296Z  2024-12-18T01:00:54.0251632Z  2024-12-18T01:00:54.0251987Z  2024-12-18T01:00:54.0252330Z  2024-12-18T01:00:54.0252685Z  2024-12-18T01:00:54.0253508Z [19,105 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:54.0254476Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T01:00:54.0255238Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2024-12-18T01:00:54.0255990Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2024-12-18T01:00:54.0256886Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2024-12-18T01:00:54.0257627Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local 2024-12-18T01:00:54.0258400Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local 2024-12-18T01:00:54.0259143Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local 2024-12-18T01:00:54.0259889Z @llvm-project//mlir:VectorTransforms; 15s local ... 2024-12-18T01:00:54.4840864Z 2024-12-18T01:00:54.4841870Z  2024-12-18T01:00:54.4842334Z  2024-12-18T01:00:54.4842786Z  2024-12-18T01:00:54.4843216Z  2024-12-18T01:00:54.4843576Z  2024-12-18T01:00:54.4843937Z  2024-12-18T01:00:54.4844531Z  2024-12-18T01:00:54.4844897Z  2024-12-18T01:00:54.4845814Z [19,106 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:54.4846870Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T01:00:54.4848004Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T01:00:54.4848844Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T01:00:54.4849648Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T01:00:54.4850521Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local 2024-12-18T01:00:54.4851347Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2024-12-18T01:00:54.4852177Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local 2024-12-18T01:00:54.4853033Z @llvm-project//mlir:VectorTransforms; 15s local ... 2024-12-18T01:00:54.8254694Z 2024-12-18T01:00:54.8255698Z  2024-12-18T01:00:54.8256211Z  2024-12-18T01:00:54.8256777Z  2024-12-18T01:00:54.8257155Z  2024-12-18T01:00:54.8257545Z  2024-12-18T01:00:54.8257922Z  2024-12-18T01:00:54.8258279Z  2024-12-18T01:00:54.8258693Z  2024-12-18T01:00:54.8259936Z [19,106 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:54.8260975Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T01:00:54.8262027Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T01:00:54.8262901Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T01:00:54.8263730Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T01:00:54.8264561Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local 2024-12-18T01:00:54.8265364Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2024-12-18T01:00:54.8266373Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local 2024-12-18T01:00:54.8267132Z @llvm-project//mlir:VectorTransforms; 16s local ... 2024-12-18T01:00:55.0731285Z 2024-12-18T01:00:55.0732320Z  2024-12-18T01:00:55.0732848Z  2024-12-18T01:00:55.0733240Z  2024-12-18T01:00:55.0733635Z  2024-12-18T01:00:55.0734017Z  2024-12-18T01:00:55.0734378Z  2024-12-18T01:00:55.0734781Z  2024-12-18T01:00:55.0735166Z  2024-12-18T01:00:55.0736109Z [19,107 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:55.0737367Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T01:00:55.0738316Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T01:00:55.0739009Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2024-12-18T01:00:55.0739630Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2024-12-18T01:00:55.0740267Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local 2024-12-18T01:00:55.0740900Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2024-12-18T01:00:55.0741523Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local 2024-12-18T01:00:55.0742261Z @llvm-project//mlir:VectorTransforms; 16s local ... 2024-12-18T01:00:55.4259376Z 2024-12-18T01:00:55.4260350Z  2024-12-18T01:00:55.4260882Z  2024-12-18T01:00:55.4261306Z  2024-12-18T01:00:55.4261637Z  2024-12-18T01:00:55.4262009Z  2024-12-18T01:00:55.4262377Z  2024-12-18T01:00:55.4262739Z  2024-12-18T01:00:55.4263088Z  2024-12-18T01:00:55.4264007Z [19,108 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:55.4264934Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T01:00:55.4265701Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T01:00:55.4266514Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T01:00:55.4267387Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:55.4268127Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local 2024-12-18T01:00:55.4268960Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2024-12-18T01:00:55.4269777Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2024-12-18T01:00:55.6474393Z Compiling xla/service/cpu/ir_function.cc; 14s local ... 2024-12-18T01:00:55.6475024Z 2024-12-18T01:00:55.6475448Z  2024-12-18T01:00:55.6475863Z  2024-12-18T01:00:55.6476271Z  2024-12-18T01:00:55.6476648Z  2024-12-18T01:00:55.6477000Z  2024-12-18T01:00:55.6477373Z  2024-12-18T01:00:55.6477764Z  2024-12-18T01:00:55.6478129Z  2024-12-18T01:00:55.6479087Z [19,109 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:55.6480105Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T01:00:55.6480900Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T01:00:55.6481725Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T01:00:55.6482572Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:55.6483362Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local 2024-12-18T01:00:55.6484397Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2024-12-18T01:00:55.6485251Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2024-12-18T01:00:55.6486209Z Compiling xla/service/cpu/ir_function.cc; 14s local ... 2024-12-18T01:00:55.8481475Z 2024-12-18T01:00:55.8482383Z  2024-12-18T01:00:55.8482947Z  2024-12-18T01:00:55.8483332Z  2024-12-18T01:00:55.8483721Z  2024-12-18T01:00:55.8484141Z  2024-12-18T01:00:55.8484526Z  2024-12-18T01:00:55.8484921Z  2024-12-18T01:00:55.8485313Z  2024-12-18T01:00:55.8486278Z [19,110 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:55.8487762Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T01:00:55.8488584Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T01:00:55.8489335Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T01:00:55.8490165Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:55.8490933Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local 2024-12-18T01:00:55.8491686Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2024-12-18T01:00:55.8492437Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2024-12-18T01:00:55.8493198Z Compiling xla/service/cpu/ir_function.cc; 14s local ... 2024-12-18T01:00:56.1235463Z 2024-12-18T01:00:56.1236310Z  2024-12-18T01:00:56.1236919Z  2024-12-18T01:00:56.1237357Z  2024-12-18T01:00:56.1237803Z  2024-12-18T01:00:56.1248734Z  2024-12-18T01:00:56.1249479Z  2024-12-18T01:00:56.1249912Z  2024-12-18T01:00:56.1250307Z  2024-12-18T01:00:56.1251260Z [19,112 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:56.1252350Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T01:00:56.1253235Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T01:00:56.1254155Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2024-12-18T01:00:56.1255020Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2024-12-18T01:00:56.1255855Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local 2024-12-18T01:00:56.1256798Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2024-12-18T01:00:56.1257582Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2024-12-18T01:00:56.1258451Z Compiling xla/service/cpu/ir_function.cc; 14s local ... 2024-12-18T01:00:56.4266677Z 2024-12-18T01:00:56.4267545Z  2024-12-18T01:00:56.4268026Z  2024-12-18T01:00:56.4268427Z  2024-12-18T01:00:56.4268809Z  2024-12-18T01:00:56.4269189Z  2024-12-18T01:00:56.4269573Z  2024-12-18T01:00:56.4269924Z  2024-12-18T01:00:56.4270268Z  2024-12-18T01:00:56.4271289Z [19,113 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:56.4272487Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T01:00:56.4273300Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T01:00:56.4274119Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:56.4274969Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T01:00:56.4275796Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local 2024-12-18T01:00:56.4276614Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local 2024-12-18T01:00:56.4277393Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2024-12-18T01:00:56.4278257Z Compiling xla/service/cpu/ir_function.cc; 15s local ... 2024-12-18T01:00:56.6269088Z 2024-12-18T01:00:56.6269839Z  2024-12-18T01:00:56.6270275Z  2024-12-18T01:00:56.6270673Z  2024-12-18T01:00:56.6271110Z  2024-12-18T01:00:56.6271493Z  2024-12-18T01:00:56.6271883Z  2024-12-18T01:00:56.6272256Z  2024-12-18T01:00:56.6272768Z  2024-12-18T01:00:56.6273954Z [19,114 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:56.6275199Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T01:00:56.6276072Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T01:00:56.6276901Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:56.6277761Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T01:00:56.6278632Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local 2024-12-18T01:00:56.6279625Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local 2024-12-18T01:00:56.6280476Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2024-12-18T01:00:56.6281354Z Compiling xla/service/cpu/ir_function.cc; 15s local ... 2024-12-18T01:00:56.9285796Z 2024-12-18T01:00:56.9286608Z  2024-12-18T01:00:56.9287033Z  2024-12-18T01:00:56.9287534Z  2024-12-18T01:00:56.9287936Z  2024-12-18T01:00:56.9288288Z  2024-12-18T01:00:56.9288656Z  2024-12-18T01:00:56.9289010Z  2024-12-18T01:00:56.9289390Z  2024-12-18T01:00:56.9290267Z [19,116 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:56.9291287Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T01:00:56.9292169Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T01:00:56.9292965Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:56.9293771Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T01:00:56.9294577Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2024-12-18T01:00:56.9295341Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local 2024-12-18T01:00:56.9296109Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2024-12-18T01:00:56.9297054Z Compiling xla/service/cpu/ir_function.cc; 15s local ... 2024-12-18T01:00:57.1841485Z 2024-12-18T01:00:57.1842328Z  2024-12-18T01:00:57.1842758Z  2024-12-18T01:00:57.1843126Z  2024-12-18T01:00:57.1843525Z  2024-12-18T01:00:57.1843907Z  2024-12-18T01:00:57.1844470Z  2024-12-18T01:00:57.1844836Z  2024-12-18T01:00:57.1845225Z  2024-12-18T01:00:57.1846082Z [19,119 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:57.1847093Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T01:00:57.1847871Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T01:00:57.1848657Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2024-12-18T01:00:57.1849448Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2024-12-18T01:00:57.1850215Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2024-12-18T01:00:57.1851002Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local 2024-12-18T01:00:57.1852046Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2024-12-18T01:00:57.1852856Z Compiling xla/service/cpu/ir_function.cc; 15s local ... 2024-12-18T01:00:57.4275864Z 2024-12-18T01:00:57.4276890Z  2024-12-18T01:00:57.4277358Z  2024-12-18T01:00:57.4277754Z  2024-12-18T01:00:57.4278165Z  2024-12-18T01:00:57.4278535Z  2024-12-18T01:00:57.4278896Z  2024-12-18T01:00:57.4279278Z  2024-12-18T01:00:57.4279627Z  2024-12-18T01:00:57.4280556Z [19,121 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:57.4281670Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T01:00:57.4282461Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T01:00:57.4283371Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T01:00:57.4284234Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T01:00:57.4285326Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2024-12-18T01:00:57.4286179Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2024-12-18T01:00:57.4287163Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2024-12-18T01:00:57.4287939Z Compiling xla/service/llvm_ir/kernel_support_library.cc; 15s local ... 2024-12-18T01:00:57.8388299Z 2024-12-18T01:00:57.8389227Z  2024-12-18T01:00:57.8389699Z  2024-12-18T01:00:57.8390115Z  2024-12-18T01:00:57.8390505Z  2024-12-18T01:00:57.8390916Z  2024-12-18T01:00:57.8391576Z  2024-12-18T01:00:57.8391967Z  2024-12-18T01:00:57.8392361Z  2024-12-18T01:00:57.8393298Z [19,122 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:57.8394473Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2024-12-18T01:00:57.8395302Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T01:00:57.8396117Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T01:00:57.8396873Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T01:00:57.8397640Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2024-12-18T01:00:57.8398481Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2024-12-18T01:00:57.8399265Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2024-12-18T01:00:57.8400232Z Compiling xla/service/llvm_ir/kernel_support_library.cc; 15s local ... 2024-12-18T01:00:58.1286321Z 2024-12-18T01:00:58.1287048Z  2024-12-18T01:00:58.1287530Z  2024-12-18T01:00:58.1287880Z  2024-12-18T01:00:58.1288262Z  2024-12-18T01:00:58.1288626Z  2024-12-18T01:00:58.1288985Z  2024-12-18T01:00:58.1289348Z  2024-12-18T01:00:58.1289728Z  2024-12-18T01:00:58.1290609Z [19,124 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:58.1291625Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2024-12-18T01:00:58.1292421Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T01:00:58.1293222Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2024-12-18T01:00:58.1293960Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2024-12-18T01:00:58.1294768Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2024-12-18T01:00:58.1295570Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2024-12-18T01:00:58.1296508Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2024-12-18T01:00:58.1297424Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local ... 2024-12-18T01:00:58.4282864Z 2024-12-18T01:00:58.4283746Z  2024-12-18T01:00:58.4284174Z  2024-12-18T01:00:58.4284542Z  2024-12-18T01:00:58.4284914Z  2024-12-18T01:00:58.4285282Z  2024-12-18T01:00:58.4285662Z  2024-12-18T01:00:58.4286004Z  2024-12-18T01:00:58.4286381Z  2024-12-18T01:00:58.4287521Z [19,124 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:58.4288537Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2024-12-18T01:00:58.4289391Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T01:00:58.4290243Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T01:00:58.4291062Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T01:00:58.4291849Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2024-12-18T01:00:58.4292703Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2024-12-18T01:00:58.4293471Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2024-12-18T01:00:58.4294388Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local ... 2024-12-18T01:00:58.8286995Z 2024-12-18T01:00:58.8287911Z  2024-12-18T01:00:58.8288386Z  2024-12-18T01:00:58.8288770Z  2024-12-18T01:00:58.8289420Z  2024-12-18T01:00:58.8289844Z  2024-12-18T01:00:58.8290227Z  2024-12-18T01:00:58.8290621Z  2024-12-18T01:00:58.8291133Z  2024-12-18T01:00:58.8292039Z [19,125 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:58.8293042Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2024-12-18T01:00:58.8293871Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T01:00:58.8294662Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T01:00:58.8295671Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T01:00:58.8296566Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:58.8297361Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2024-12-18T01:00:58.8298092Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2024-12-18T01:00:58.8299023Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2024-12-18T01:00:59.0290156Z 2024-12-18T01:00:59.0291189Z  2024-12-18T01:00:59.0291671Z  2024-12-18T01:00:59.0292063Z  2024-12-18T01:00:59.0292507Z  2024-12-18T01:00:59.0292901Z  2024-12-18T01:00:59.0293302Z  2024-12-18T01:00:59.0293665Z  2024-12-18T01:00:59.0294101Z  2024-12-18T01:00:59.0295059Z [19,126 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:59.0296256Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2024-12-18T01:00:59.0297253Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T01:00:59.0298077Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2024-12-18T01:00:59.0298927Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2024-12-18T01:00:59.0299796Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:59.0300707Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2024-12-18T01:00:59.0301594Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2024-12-18T01:00:59.0302559Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2024-12-18T01:00:59.2981458Z 2024-12-18T01:00:59.2982319Z  2024-12-18T01:00:59.2982826Z  2024-12-18T01:00:59.2983203Z  2024-12-18T01:00:59.2983592Z  2024-12-18T01:00:59.2983967Z  2024-12-18T01:00:59.2984355Z  2024-12-18T01:00:59.2984736Z  2024-12-18T01:00:59.2985117Z  2024-12-18T01:00:59.2986026Z [19,128 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:00:59.2987004Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T01:00:59.2987815Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T01:00:59.2988633Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T01:00:59.2989489Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:59.2990784Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2024-12-18T01:00:59.2991553Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T01:00:59.2992448Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local 2024-12-18T01:00:59.2993407Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local ... 2024-12-18T01:00:59.6295430Z 2024-12-18T01:00:59.6296388Z  2024-12-18T01:00:59.6296870Z  2024-12-18T01:00:59.6297220Z  2024-12-18T01:00:59.6297615Z  2024-12-18T01:00:59.6298005Z  2024-12-18T01:00:59.6298406Z  2024-12-18T01:00:59.6298761Z  2024-12-18T01:00:59.6299107Z  2024-12-18T01:00:59.6300016Z [19,129 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:59.6301002Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T01:00:59.6301989Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T01:00:59.6303081Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T01:00:59.6303917Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2024-12-18T01:00:59.6304900Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2024-12-18T01:00:59.6305764Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T01:00:59.6306740Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local 2024-12-18T01:00:59.6307792Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local ... 2024-12-18T01:00:59.8298395Z 2024-12-18T01:00:59.8299516Z  2024-12-18T01:00:59.8299952Z  2024-12-18T01:00:59.8300349Z  2024-12-18T01:00:59.8300737Z  2024-12-18T01:00:59.8301121Z  2024-12-18T01:00:59.8301537Z  2024-12-18T01:00:59.8301911Z  2024-12-18T01:00:59.8302303Z  2024-12-18T01:00:59.8303231Z [19,131 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:00:59.8304270Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T01:00:59.8305125Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T01:00:59.8305953Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T01:00:59.8306777Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2024-12-18T01:00:59.8307621Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2024-12-18T01:00:59.8308445Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T01:00:59.8309396Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 17s local 2024-12-18T01:00:59.8310406Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local ... 2024-12-18T01:01:00.1250006Z 2024-12-18T01:01:00.1250887Z  2024-12-18T01:01:00.1251350Z  2024-12-18T01:01:00.1251736Z  2024-12-18T01:01:00.1252128Z  2024-12-18T01:01:00.1252504Z  2024-12-18T01:01:00.1252888Z  2024-12-18T01:01:00.1253238Z  2024-12-18T01:01:00.1253697Z  2024-12-18T01:01:00.1254657Z [19,133 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:00.1255566Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:00.1256555Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2024-12-18T01:01:00.1257415Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2024-12-18T01:01:00.1258258Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2024-12-18T01:01:00.1259170Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2024-12-18T01:01:00.1260029Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T01:01:00.1260920Z Compiling xla/service/hlo_module_util.cc; 14s local 2024-12-18T01:01:00.1261769Z Compiling xla/service/cpu/ir_function.cc; 12s local ... 2024-12-18T01:01:00.4303547Z 2024-12-18T01:01:00.4304399Z  2024-12-18T01:01:00.4304821Z  2024-12-18T01:01:00.4305210Z  2024-12-18T01:01:00.4305836Z  2024-12-18T01:01:00.4306216Z  2024-12-18T01:01:00.4306580Z  2024-12-18T01:01:00.4306916Z  2024-12-18T01:01:00.4307276Z  2024-12-18T01:01:00.4308132Z [19,134 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:00.4308997Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:00.4309768Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T01:01:00.4310478Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T01:01:00.4311249Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2024-12-18T01:01:00.4312020Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2024-12-18T01:01:00.4312800Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T01:01:00.4313547Z Compiling xla/service/hlo_module_util.cc; 15s local 2024-12-18T01:01:00.4314221Z Compiling xla/service/cpu/ir_function.cc; 12s local ... 2024-12-18T01:01:00.8307539Z 2024-12-18T01:01:00.8308759Z  2024-12-18T01:01:00.8309164Z  2024-12-18T01:01:00.8309496Z  2024-12-18T01:01:00.8310051Z  2024-12-18T01:01:00.8310366Z  2024-12-18T01:01:00.8310692Z  2024-12-18T01:01:00.8311055Z  2024-12-18T01:01:00.8311382Z  2024-12-18T01:01:00.8312176Z [19,136 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:00.8312978Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:00.8313824Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T01:01:00.8314541Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T01:01:00.8315237Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2024-12-18T01:01:00.8315952Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2024-12-18T01:01:00.8316638Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T01:01:00.8317333Z Compiling xla/service/hlo_module_util.cc; 15s local 2024-12-18T01:01:00.8317999Z Compiling xla/service/cpu/ir_function.cc; 13s local ... 2024-12-18T01:01:01.0310225Z 2024-12-18T01:01:01.0311509Z  2024-12-18T01:01:01.0312018Z  2024-12-18T01:01:01.0312418Z  2024-12-18T01:01:01.0312788Z  2024-12-18T01:01:01.0313173Z  2024-12-18T01:01:01.0313554Z  2024-12-18T01:01:01.0313954Z  2024-12-18T01:01:01.0314336Z  2024-12-18T01:01:01.0315252Z [19,138 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:01.0316311Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:01.0317134Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2024-12-18T01:01:01.0318084Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2024-12-18T01:01:01.0318916Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2024-12-18T01:01:01.0319817Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T01:01:01.0320624Z Compiling xla/service/hlo_module_util.cc; 15s local 2024-12-18T01:01:01.0321388Z Compiling xla/service/cpu/ir_function.cc; 13s local 2024-12-18T01:01:01.0322126Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local ... 2024-12-18T01:01:01.5651054Z 2024-12-18T01:01:01.5652309Z  2024-12-18T01:01:01.5652942Z  2024-12-18T01:01:01.5653335Z  2024-12-18T01:01:01.5653688Z  2024-12-18T01:01:01.5654025Z  2024-12-18T01:01:01.5654407Z  2024-12-18T01:01:01.5654818Z  2024-12-18T01:01:01.5655189Z  2024-12-18T01:01:01.5656081Z [19,139 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:01.5657235Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T01:01:01.5658015Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T01:01:01.5659137Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T01:01:01.5659986Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2024-12-18T01:01:01.5660892Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2024-12-18T01:01:01.5661686Z Compiling xla/service/hlo_module_util.cc; 16s local 2024-12-18T01:01:01.5662464Z Compiling xla/service/cpu/ir_function.cc; 13s local 2024-12-18T01:01:01.5663314Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local ... 2024-12-18T01:01:01.8138549Z 2024-12-18T01:01:01.8139821Z  2024-12-18T01:01:01.8140304Z  2024-12-18T01:01:01.8140752Z  2024-12-18T01:01:01.8141146Z  2024-12-18T01:01:01.8141525Z  2024-12-18T01:01:01.8141912Z  2024-12-18T01:01:01.8142335Z  2024-12-18T01:01:01.8142739Z  2024-12-18T01:01:01.8143709Z [19,141 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:01.8145026Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T01:01:01.8146222Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T01:01:01.8147126Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T01:01:01.8148238Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2024-12-18T01:01:01.8149174Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2024-12-18T01:01:01.8150050Z Compiling xla/service/hlo_module_util.cc; 16s local 2024-12-18T01:01:01.8150838Z Compiling xla/service/cpu/ir_function.cc; 14s local 2024-12-18T01:01:01.8151727Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local ... 2024-12-18T01:01:02.0284634Z 2024-12-18T01:01:02.0285635Z  2024-12-18T01:01:02.0286134Z  2024-12-18T01:01:02.0286549Z  2024-12-18T01:01:02.0286947Z  2024-12-18T01:01:02.0287347Z  2024-12-18T01:01:02.0287707Z  2024-12-18T01:01:02.0288097Z  2024-12-18T01:01:02.0288486Z  2024-12-18T01:01:02.0289449Z [19,143 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:02.0290495Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T01:01:02.0291367Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T01:01:02.0292232Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T01:01:02.0293050Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2024-12-18T01:01:02.0293969Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2024-12-18T01:01:02.0294768Z Compiling xla/service/hlo_module_util.cc; 16s local 2024-12-18T01:01:02.0295516Z Compiling xla/service/cpu/ir_function.cc; 14s local 2024-12-18T01:01:02.0296528Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local ... 2024-12-18T01:01:02.2318435Z 2024-12-18T01:01:02.2319285Z  2024-12-18T01:01:02.2319773Z  2024-12-18T01:01:02.2321352Z  2024-12-18T01:01:02.2322110Z  2024-12-18T01:01:02.2322907Z  2024-12-18T01:01:02.2323784Z  2024-12-18T01:01:02.2324462Z  2024-12-18T01:01:02.2325128Z  2024-12-18T01:01:02.2326824Z [19,143 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:02.2328291Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T01:01:02.2329340Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2024-12-18T01:01:02.2330394Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2024-12-18T01:01:02.2331434Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2024-12-18T01:01:02.2332514Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T01:01:02.2333543Z Compiling xla/service/hlo_module_util.cc; 17s local 2024-12-18T01:01:02.2334644Z Compiling xla/service/cpu/ir_function.cc; 14s local 2024-12-18T01:01:02.2335755Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local ... 2024-12-18T01:01:02.4320271Z 2024-12-18T01:01:02.4321502Z  2024-12-18T01:01:02.4322216Z  2024-12-18T01:01:02.4322629Z  2024-12-18T01:01:02.4323024Z  2024-12-18T01:01:02.4323421Z  2024-12-18T01:01:02.4323899Z  2024-12-18T01:01:02.4324275Z  2024-12-18T01:01:02.4324666Z  2024-12-18T01:01:02.4325490Z [19,144 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:02.4326383Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T01:01:02.4327144Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T01:01:02.4327911Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T01:01:02.4328649Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2024-12-18T01:01:02.4329439Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T01:01:02.4330148Z Compiling xla/service/hlo_module_util.cc; 17s local 2024-12-18T01:01:02.4330932Z Compiling xla/service/cpu/ir_function.cc; 14s local 2024-12-18T01:01:02.4332017Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local ... 2024-12-18T01:01:02.8599089Z 2024-12-18T01:01:02.8600453Z  2024-12-18T01:01:02.8601132Z  2024-12-18T01:01:02.8601477Z  2024-12-18T01:01:02.8601844Z  2024-12-18T01:01:02.8602194Z  2024-12-18T01:01:02.8602551Z  2024-12-18T01:01:02.8602905Z  2024-12-18T01:01:02.8603270Z  2024-12-18T01:01:02.8604075Z [19,145 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:02.8604976Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T01:01:02.8605853Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T01:01:02.8606604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T01:01:02.8607335Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T01:01:02.8608136Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T01:01:02.8608885Z Compiling xla/service/cpu/ir_function.cc; 15s local 2024-12-18T01:01:02.8609618Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2024-12-18T01:01:02.8610432Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local ... 2024-12-18T01:01:03.2326855Z 2024-12-18T01:01:03.2327668Z  2024-12-18T01:01:03.2328101Z  2024-12-18T01:01:03.2328476Z  2024-12-18T01:01:03.2328838Z  2024-12-18T01:01:03.2329194Z  2024-12-18T01:01:03.2329766Z  2024-12-18T01:01:03.2330243Z  2024-12-18T01:01:03.2330707Z  2024-12-18T01:01:03.2331658Z [19,145 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:03.2332660Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T01:01:03.2333512Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2024-12-18T01:01:03.2334339Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2024-12-18T01:01:03.2335159Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2024-12-18T01:01:03.2336048Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T01:01:03.2337025Z Compiling xla/service/cpu/ir_function.cc; 15s local 2024-12-18T01:01:03.2337889Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local 2024-12-18T01:01:03.2338822Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local ... 2024-12-18T01:01:03.8333719Z 2024-12-18T01:01:03.8334620Z  2024-12-18T01:01:03.8335101Z  2024-12-18T01:01:03.8335513Z  2024-12-18T01:01:03.8336424Z  2024-12-18T01:01:03.8337330Z  2024-12-18T01:01:03.8338893Z  2024-12-18T01:01:03.8339606Z  2024-12-18T01:01:03.8340287Z  2024-12-18T01:01:03.8341284Z [19,146 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:01:03.8342347Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T01:01:03.8343476Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T01:01:03.8344603Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2024-12-18T01:01:03.8345486Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T01:01:03.8346426Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T01:01:03.8347310Z Compiling xla/service/cpu/ir_function.cc; 16s local 2024-12-18T01:01:03.8348205Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2024-12-18T01:01:03.8349205Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local ... 2024-12-18T01:01:04.1535828Z 2024-12-18T01:01:04.1537168Z  2024-12-18T01:01:04.1537639Z  2024-12-18T01:01:04.1538039Z  2024-12-18T01:01:04.1538435Z  2024-12-18T01:01:04.1538802Z  2024-12-18T01:01:04.1539175Z  2024-12-18T01:01:04.1539552Z  2024-12-18T01:01:04.1539938Z  2024-12-18T01:01:04.1540895Z [19,147 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:04.1542152Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T01:01:04.1543032Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2024-12-18T01:01:04.1543953Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2024-12-18T01:01:04.1545115Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T01:01:04.1546009Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T01:01:04.1546871Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T01:01:04.1547949Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local 2024-12-18T01:01:04.1548820Z Compiling stablehlo/dialect/StablehloOps.cpp; 14s local ... 2024-12-18T01:01:04.3570225Z 2024-12-18T01:01:04.3571101Z  2024-12-18T01:01:04.3571563Z  2024-12-18T01:01:04.3571943Z  2024-12-18T01:01:04.3572321Z  2024-12-18T01:01:04.3572706Z  2024-12-18T01:01:04.3573073Z  2024-12-18T01:01:04.3573454Z  2024-12-18T01:01:04.3573854Z  2024-12-18T01:01:04.3574783Z [19,148 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:04.3575735Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T01:01:04.3576681Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:01:04.3577933Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T01:01:04.3578763Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T01:01:04.3579819Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T01:01:04.3580862Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T01:01:04.3581932Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2024-12-18T01:01:04.3583118Z Compiling stablehlo/dialect/StablehloOps.cpp; 14s local ... 2024-12-18T01:01:04.6343391Z 2024-12-18T01:01:04.6344571Z  2024-12-18T01:01:04.6345070Z  2024-12-18T01:01:04.6345509Z  2024-12-18T01:01:04.6346030Z  2024-12-18T01:01:04.6346436Z  2024-12-18T01:01:04.6346922Z  2024-12-18T01:01:04.6347410Z  2024-12-18T01:01:04.6347769Z  2024-12-18T01:01:04.6348827Z [19,149 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:04.6349924Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T01:01:04.6350846Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:01:04.6351777Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T01:01:04.6352716Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2024-12-18T01:01:04.6353690Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T01:01:04.6354568Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T01:01:04.6355668Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2024-12-18T01:01:04.6356758Z Compiling stablehlo/dialect/StablehloOps.cpp; 14s local ... 2024-12-18T01:01:04.9729287Z 2024-12-18T01:01:04.9730136Z  2024-12-18T01:01:04.9730681Z  2024-12-18T01:01:04.9731108Z  2024-12-18T01:01:04.9731473Z  2024-12-18T01:01:04.9731879Z  2024-12-18T01:01:04.9732271Z  2024-12-18T01:01:04.9732654Z  2024-12-18T01:01:04.9733032Z  2024-12-18T01:01:04.9733956Z [19,150 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:04.9734984Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T01:01:04.9735841Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:01:04.9736793Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T01:01:04.9737613Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T01:01:04.9738439Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T01:01:04.9739624Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2024-12-18T01:01:04.9740573Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2024-12-18T01:01:04.9741629Z Compiling stablehlo/dialect/StablehloOps.cpp; 15s local ... 2024-12-18T01:01:05.2347867Z 2024-12-18T01:01:05.2348743Z  2024-12-18T01:01:05.2349169Z  2024-12-18T01:01:05.2349524Z  2024-12-18T01:01:05.2349884Z  2024-12-18T01:01:05.2350248Z  2024-12-18T01:01:05.2350608Z  2024-12-18T01:01:05.2350948Z  2024-12-18T01:01:05.2351286Z  2024-12-18T01:01:05.2352362Z [19,151 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:05.2353297Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:05.2354024Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2024-12-18T01:01:05.2354767Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2024-12-18T01:01:05.2355520Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T01:01:05.2356330Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T01:01:05.2357132Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2024-12-18T01:01:05.2357924Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2024-12-18T01:01:05.2358720Z Compiling stablehlo/dialect/StablehloOps.cpp; 15s local ... 2024-12-18T01:01:05.4352223Z 2024-12-18T01:01:05.4353094Z  2024-12-18T01:01:05.4353548Z  2024-12-18T01:01:05.4353907Z  2024-12-18T01:01:05.4354305Z  2024-12-18T01:01:05.4354658Z  2024-12-18T01:01:05.4355011Z  2024-12-18T01:01:05.4355354Z  2024-12-18T01:01:05.4355695Z  2024-12-18T01:01:05.4356605Z [19,154 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:05.4357561Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:05.4358362Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T01:01:05.4359183Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T01:01:05.4359943Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2024-12-18T01:01:05.4360762Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T01:01:05.4361571Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2024-12-18T01:01:05.4362322Z Compiling stablehlo/dialect/StablehloOps.cpp; 15s local 2024-12-18T01:01:05.4363213Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local ... 2024-12-18T01:01:05.8356288Z 2024-12-18T01:01:05.8357175Z  2024-12-18T01:01:05.8357586Z  2024-12-18T01:01:05.8357896Z  2024-12-18T01:01:05.8358206Z  2024-12-18T01:01:05.8358499Z  2024-12-18T01:01:05.8358805Z  2024-12-18T01:01:05.8359108Z  2024-12-18T01:01:05.8359410Z  2024-12-18T01:01:05.8360687Z [19,155 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:05.8361716Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:05.8362581Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T01:01:05.8363382Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T01:01:05.8364204Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T01:01:05.8365069Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T01:01:05.8365777Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2024-12-18T01:01:05.8366601Z Compiling stablehlo/dialect/StablehloOps.cpp; 16s local 2024-12-18T01:01:05.8367480Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local ... 2024-12-18T01:01:06.0359376Z 2024-12-18T01:01:06.0360559Z  2024-12-18T01:01:06.0361053Z  2024-12-18T01:01:06.0361425Z  2024-12-18T01:01:06.0361786Z  2024-12-18T01:01:06.0362177Z  2024-12-18T01:01:06.0362539Z  2024-12-18T01:01:06.0363170Z  2024-12-18T01:01:06.0363582Z  2024-12-18T01:01:06.0364507Z [19,156 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:06.0365631Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:06.0366465Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2024-12-18T01:01:06.0367285Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2024-12-18T01:01:06.0368109Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T01:01:06.0369144Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T01:01:06.0370016Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2024-12-18T01:01:06.0370889Z Compiling stablehlo/dialect/StablehloOps.cpp; 16s local 2024-12-18T01:01:06.0371786Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local ... 2024-12-18T01:01:06.5100167Z 2024-12-18T01:01:06.5101057Z  2024-12-18T01:01:06.5101467Z  2024-12-18T01:01:06.5101830Z  2024-12-18T01:01:06.5102191Z  2024-12-18T01:01:06.5102529Z  2024-12-18T01:01:06.5102862Z  2024-12-18T01:01:06.5103203Z  2024-12-18T01:01:06.5103532Z  2024-12-18T01:01:06.5104333Z [19,157 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:06.5105153Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T01:01:06.5105991Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T01:01:06.5106655Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T01:01:06.5107322Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2024-12-18T01:01:06.5108032Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T01:01:06.5108754Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2024-12-18T01:01:06.5109462Z Compiling stablehlo/dialect/StablehloOps.cpp; 16s local 2024-12-18T01:01:06.5110212Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local ... 2024-12-18T01:01:06.8365048Z 2024-12-18T01:01:06.8366284Z  2024-12-18T01:01:06.8366792Z  2024-12-18T01:01:06.8367163Z  2024-12-18T01:01:06.8367557Z  2024-12-18T01:01:06.8367901Z  2024-12-18T01:01:06.8368236Z  2024-12-18T01:01:06.8368552Z  2024-12-18T01:01:06.8368858Z  2024-12-18T01:01:06.8369691Z [19,158 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:06.8370630Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T01:01:06.8371467Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T01:01:06.8372273Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T01:01:06.8373072Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T01:01:06.8373924Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T01:01:06.8375045Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2024-12-18T01:01:06.8376054Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local 2024-12-18T01:01:06.8377146Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local ... 2024-12-18T01:01:07.0368556Z 2024-12-18T01:01:07.0370038Z  2024-12-18T01:01:07.0370530Z  2024-12-18T01:01:07.0370954Z  2024-12-18T01:01:07.0371387Z  2024-12-18T01:01:07.0371843Z  2024-12-18T01:01:07.0372195Z  2024-12-18T01:01:07.0372628Z  2024-12-18T01:01:07.0372948Z  2024-12-18T01:01:07.0373745Z [19,159 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:07.0374825Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T01:01:07.0375685Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2024-12-18T01:01:07.0376630Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2024-12-18T01:01:07.0377796Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T01:01:07.0378695Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T01:01:07.0379662Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T01:01:07.0380540Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local 2024-12-18T01:01:07.0381450Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local ... 2024-12-18T01:01:07.4374306Z 2024-12-18T01:01:07.4375698Z  2024-12-18T01:01:07.4376205Z  2024-12-18T01:01:07.4376729Z  2024-12-18T01:01:07.4377379Z  2024-12-18T01:01:07.4377785Z  2024-12-18T01:01:07.4378179Z  2024-12-18T01:01:07.4378487Z  2024-12-18T01:01:07.4378785Z  2024-12-18T01:01:07.4379598Z [19,161 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:07.4380548Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T01:01:07.4381371Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:01:07.4382165Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T01:01:07.4382987Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2024-12-18T01:01:07.4383785Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T01:01:07.4384650Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T01:01:07.4385473Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local 2024-12-18T01:01:07.4386377Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 16s local ... 2024-12-18T01:01:07.6383746Z 2024-12-18T01:01:07.6385209Z  2024-12-18T01:01:07.6385756Z  2024-12-18T01:01:07.6386164Z  2024-12-18T01:01:07.6386583Z  2024-12-18T01:01:07.6387009Z  2024-12-18T01:01:07.6387367Z  2024-12-18T01:01:07.6387718Z  2024-12-18T01:01:07.6388085Z  2024-12-18T01:01:07.6389095Z [19,164 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:07.6390173Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T01:01:07.6390999Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:01:07.6391860Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T01:01:07.6392657Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T01:01:07.6393519Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2024-12-18T01:01:07.6394389Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local 2024-12-18T01:01:07.6395319Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2024-12-18T01:01:07.6396304Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 15s local ... 2024-12-18T01:01:08.0379966Z 2024-12-18T01:01:08.0381188Z  2024-12-18T01:01:08.0381687Z  2024-12-18T01:01:08.0382082Z  2024-12-18T01:01:08.0382472Z  2024-12-18T01:01:08.0382862Z  2024-12-18T01:01:08.0383266Z  2024-12-18T01:01:08.0383980Z  2024-12-18T01:01:08.0384393Z  2024-12-18T01:01:08.0385319Z [19,165 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:08.0386322Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T01:01:08.0387080Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:01:08.0387909Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2024-12-18T01:01:08.0388771Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T01:01:08.0389678Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T01:01:08.0390561Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local 2024-12-18T01:01:08.0391469Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2024-12-18T01:01:08.0392499Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 15s local ... 2024-12-18T01:01:08.2535697Z 2024-12-18T01:01:08.2536917Z  2024-12-18T01:01:08.2537623Z  2024-12-18T01:01:08.2537976Z  2024-12-18T01:01:08.2538333Z  2024-12-18T01:01:08.2538650Z  2024-12-18T01:01:08.2539101Z  2024-12-18T01:01:08.2539429Z  2024-12-18T01:01:08.2539776Z  2024-12-18T01:01:08.2540606Z [19,167 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:08.2541447Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T01:01:08.2542130Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2024-12-18T01:01:08.2542972Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T01:01:08.2543703Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2024-12-18T01:01:08.2544670Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T01:01:08.2545438Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local 2024-12-18T01:01:08.2546233Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2024-12-18T01:01:08.2547060Z @xla//xla/mlir_hlo:shape_component_analysis; 14s local ... 2024-12-18T01:01:08.6385512Z 2024-12-18T01:01:08.6386352Z  2024-12-18T01:01:08.6386844Z  2024-12-18T01:01:08.6387233Z  2024-12-18T01:01:08.6387586Z  2024-12-18T01:01:08.6387948Z  2024-12-18T01:01:08.6388340Z  2024-12-18T01:01:08.6388707Z  2024-12-18T01:01:08.6389064Z  2024-12-18T01:01:08.6389917Z [19,168 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:08.6390849Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T01:01:08.6391743Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2024-12-18T01:01:08.6392526Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T01:01:08.6393297Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2024-12-18T01:01:08.6394141Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T01:01:08.6394976Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local 2024-12-18T01:01:08.6395874Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2024-12-18T01:01:08.6396732Z @llvm-project//mlir:VectorTransforms; 13s local ... 2024-12-18T01:01:08.8388689Z 2024-12-18T01:01:08.8389532Z  2024-12-18T01:01:08.8389953Z  2024-12-18T01:01:08.8390318Z  2024-12-18T01:01:08.8390669Z  2024-12-18T01:01:08.8391038Z  2024-12-18T01:01:08.8391409Z  2024-12-18T01:01:08.8391777Z  2024-12-18T01:01:08.8392146Z  2024-12-18T01:01:08.8393106Z [19,169 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:08.8394158Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T01:01:08.8395038Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2024-12-18T01:01:08.8395920Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2024-12-18T01:01:08.8397107Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2024-12-18T01:01:08.8398047Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2024-12-18T01:01:08.8398979Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local 2024-12-18T01:01:08.8399994Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2024-12-18T01:01:08.8401038Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local ... 2024-12-18T01:01:09.3258571Z 2024-12-18T01:01:09.3259446Z  2024-12-18T01:01:09.3259925Z  2024-12-18T01:01:09.3260322Z  2024-12-18T01:01:09.3260745Z  2024-12-18T01:01:09.3261111Z  2024-12-18T01:01:09.3261492Z  2024-12-18T01:01:09.3261869Z  2024-12-18T01:01:09.3262246Z  2024-12-18T01:01:09.3263135Z [19,170 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:09.3264107Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T01:01:09.3265201Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:01:09.3266047Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T01:01:09.3267102Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2024-12-18T01:01:09.3267982Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T01:01:09.3268812Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local 2024-12-18T01:01:09.3269713Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2024-12-18T01:01:09.3270696Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local ... 2024-12-18T01:01:09.5949932Z 2024-12-18T01:01:09.5951107Z  2024-12-18T01:01:09.5951587Z  2024-12-18T01:01:09.5951987Z  2024-12-18T01:01:09.5952342Z  2024-12-18T01:01:09.5952703Z  2024-12-18T01:01:09.5953066Z  2024-12-18T01:01:09.5953420Z  2024-12-18T01:01:09.5953761Z  2024-12-18T01:01:09.5954659Z [19,172 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:09.5955642Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T01:01:09.5956442Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:01:09.5957230Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T01:01:09.5958033Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2024-12-18T01:01:09.5958898Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T01:01:09.5959757Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local 2024-12-18T01:01:09.5960720Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T01:01:09.5961708Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local ... 2024-12-18T01:01:09.8246739Z 2024-12-18T01:01:09.8247669Z  2024-12-18T01:01:09.8248156Z  2024-12-18T01:01:09.8248581Z  2024-12-18T01:01:09.8248976Z  2024-12-18T01:01:09.8249373Z  2024-12-18T01:01:09.8249756Z  2024-12-18T01:01:09.8250159Z  2024-12-18T01:01:09.8260394Z  2024-12-18T01:01:09.8261642Z [19,173 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:09.8262678Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T01:01:09.8263538Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:01:09.8264378Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T01:01:09.8265235Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2024-12-18T01:01:09.8266151Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local 2024-12-18T01:01:09.8267116Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T01:01:09.8268120Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2024-12-18T01:01:09.8269060Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 12s local ... 2024-12-18T01:01:10.0398467Z 2024-12-18T01:01:10.0399353Z  2024-12-18T01:01:10.0400170Z  2024-12-18T01:01:10.0400649Z  2024-12-18T01:01:10.0401066Z  2024-12-18T01:01:10.0401464Z  2024-12-18T01:01:10.0401863Z  2024-12-18T01:01:10.0402257Z  2024-12-18T01:01:10.0402657Z  2024-12-18T01:01:10.0403610Z [19,173 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:10.0404646Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T01:01:10.0405505Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2024-12-18T01:01:10.0406396Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2024-12-18T01:01:10.0407248Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T01:01:10.0408100Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local 2024-12-18T01:01:10.0409036Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T01:01:10.0410010Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2024-12-18T01:01:10.0411282Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 12s local ... 2024-12-18T01:01:10.4350630Z 2024-12-18T01:01:10.4351836Z  2024-12-18T01:01:10.4352333Z  2024-12-18T01:01:10.4352702Z  2024-12-18T01:01:10.4353076Z  2024-12-18T01:01:10.4353466Z  2024-12-18T01:01:10.4353858Z  2024-12-18T01:01:10.4354206Z  2024-12-18T01:01:10.4354565Z  2024-12-18T01:01:10.4355462Z [19,174 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:10.4356655Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T01:01:10.4357503Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T01:01:10.4358304Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:10.4359064Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T01:01:10.4359931Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local 2024-12-18T01:01:10.4360858Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T01:01:10.4361838Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2024-12-18T01:01:10.4362801Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 13s local ... 2024-12-18T01:01:10.6405711Z 2024-12-18T01:01:10.6406588Z  2024-12-18T01:01:10.6407042Z  2024-12-18T01:01:10.6407398Z  2024-12-18T01:01:10.6407772Z  2024-12-18T01:01:10.6408149Z  2024-12-18T01:01:10.6408548Z  2024-12-18T01:01:10.6408921Z  2024-12-18T01:01:10.6409320Z  2024-12-18T01:01:10.6410249Z [19,174 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:10.6411235Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T01:01:10.6412107Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T01:01:10.6412938Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:10.6413804Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T01:01:10.6414722Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local 2024-12-18T01:01:10.6415695Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:01:10.6416863Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2024-12-18T01:01:10.6417820Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 13s local ... 2024-12-18T01:01:10.8409135Z 2024-12-18T01:01:10.8410464Z  2024-12-18T01:01:10.8410947Z  2024-12-18T01:01:10.8411377Z  2024-12-18T01:01:10.8411793Z  2024-12-18T01:01:10.8412193Z  2024-12-18T01:01:10.8412582Z  2024-12-18T01:01:10.8412974Z  2024-12-18T01:01:10.8413379Z  2024-12-18T01:01:10.8414363Z [19,175 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:10.8415416Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T01:01:10.8416902Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T01:01:10.8417748Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:10.8418627Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2024-12-18T01:01:10.8419511Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local 2024-12-18T01:01:10.8420535Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:01:10.8421551Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2024-12-18T01:01:10.8422421Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 13s local ... 2024-12-18T01:01:11.2084516Z 2024-12-18T01:01:11.2085434Z  2024-12-18T01:01:11.2085891Z  2024-12-18T01:01:11.2086309Z  2024-12-18T01:01:11.2086706Z  2024-12-18T01:01:11.2087104Z  2024-12-18T01:01:11.2087454Z  2024-12-18T01:01:11.2087844Z  2024-12-18T01:01:11.2088219Z  2024-12-18T01:01:11.2089390Z [19,180 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:11.2090370Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T01:01:11.2091321Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2024-12-18T01:01:11.2092175Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2024-12-18T01:01:11.2092987Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local 2024-12-18T01:01:11.2093957Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:01:11.2094924Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2024-12-18T01:01:11.2096026Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 13s local 2024-12-18T01:01:11.4418374Z Compiling xla/service/llvm_ir/llvm_loop.cc; 13s local ... 2024-12-18T01:01:11.4418943Z 2024-12-18T01:01:11.4419384Z  2024-12-18T01:01:11.4419788Z  2024-12-18T01:01:11.4420171Z  2024-12-18T01:01:11.4420547Z  2024-12-18T01:01:11.4420927Z  2024-12-18T01:01:11.4421325Z  2024-12-18T01:01:11.4421845Z  2024-12-18T01:01:11.4422230Z  2024-12-18T01:01:11.4423185Z [19,180 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:11.4424255Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T01:01:11.4425127Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T01:01:11.4425947Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T01:01:11.4426813Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local 2024-12-18T01:01:11.4427866Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:01:11.4428853Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2024-12-18T01:01:11.4429845Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 14s local 2024-12-18T01:01:11.4430757Z Compiling xla/service/llvm_ir/llvm_loop.cc; 13s local ... 2024-12-18T01:01:11.6419805Z 2024-12-18T01:01:11.6420719Z  2024-12-18T01:01:11.6421158Z  2024-12-18T01:01:11.6421533Z  2024-12-18T01:01:11.6421922Z  2024-12-18T01:01:11.6422294Z  2024-12-18T01:01:11.6422688Z  2024-12-18T01:01:11.6423076Z  2024-12-18T01:01:11.6423470Z  2024-12-18T01:01:11.6424373Z [19,181 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:11.6425422Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T01:01:11.6426254Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T01:01:11.6427120Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T01:01:11.6427906Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local 2024-12-18T01:01:11.6428841Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T01:01:11.6429746Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2024-12-18T01:01:11.6430887Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 14s local 2024-12-18T01:01:11.6431780Z Compiling xla/service/llvm_ir/llvm_loop.cc; 13s local ... 2024-12-18T01:01:11.8514191Z 2024-12-18T01:01:11.8515380Z  2024-12-18T01:01:11.8515863Z  2024-12-18T01:01:11.8516250Z  2024-12-18T01:01:11.8516597Z  2024-12-18T01:01:11.8516974Z  2024-12-18T01:01:11.8517358Z  2024-12-18T01:01:11.8517735Z  2024-12-18T01:01:11.8518092Z  2024-12-18T01:01:11.8519011Z [19,183 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:11.8520041Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T01:01:11.8520877Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T01:01:11.8521746Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T01:01:11.8522528Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2024-12-18T01:01:11.8523889Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T01:01:11.8524890Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 16s local 2024-12-18T01:01:11.8525919Z Compiling xla/service/gpu/parallel_loop_emitter.cc; 14s local 2024-12-18T01:01:11.8526842Z Compiling xla/service/llvm_ir/llvm_loop.cc; 13s local ... 2024-12-18T01:01:12.0889493Z 2024-12-18T01:01:12.0890378Z  2024-12-18T01:01:12.0890867Z  2024-12-18T01:01:12.0891270Z  2024-12-18T01:01:12.0891666Z  2024-12-18T01:01:12.0892083Z  2024-12-18T01:01:12.0892498Z  2024-12-18T01:01:12.0893185Z  2024-12-18T01:01:12.0893600Z  2024-12-18T01:01:12.0894564Z [19,185 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:12.0895625Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T01:01:12.0896663Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2024-12-18T01:01:12.0897488Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2024-12-18T01:01:12.0898371Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2024-12-18T01:01:12.0899395Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T01:01:12.0904472Z Compiling xla/service/llvm_ir/llvm_loop.cc; 13s local 2024-12-18T01:01:12.0905405Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 12s local 2024-12-18T01:01:12.0906342Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local ... 2024-12-18T01:01:12.3200111Z 2024-12-18T01:01:12.3201010Z  2024-12-18T01:01:12.3201485Z  2024-12-18T01:01:12.3201872Z  2024-12-18T01:01:12.3202251Z  2024-12-18T01:01:12.3202634Z  2024-12-18T01:01:12.3207021Z  2024-12-18T01:01:12.3207668Z  2024-12-18T01:01:12.3208037Z  2024-12-18T01:01:12.3209021Z [19,189 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:12.3209947Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T01:01:12.3210786Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T01:01:12.3211535Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T01:01:12.3212268Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2024-12-18T01:01:12.3213200Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T01:01:12.3214000Z Compiling xla/service/llvm_ir/llvm_loop.cc; 14s local 2024-12-18T01:01:12.3214758Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2024-12-18T01:01:12.3215631Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local ... 2024-12-18T01:01:12.6396565Z 2024-12-18T01:01:12.6397872Z  2024-12-18T01:01:12.6398488Z  2024-12-18T01:01:12.6398932Z  2024-12-18T01:01:12.6399440Z  2024-12-18T01:01:12.6399854Z  2024-12-18T01:01:12.6400245Z  2024-12-18T01:01:12.6400606Z  2024-12-18T01:01:12.6400980Z  2024-12-18T01:01:12.6401904Z [19,192 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:12.6402827Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T01:01:12.6403699Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T01:01:12.6404581Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T01:01:12.6405364Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2024-12-18T01:01:12.6406458Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T01:01:12.6407403Z Compiling xla/service/llvm_ir/llvm_loop.cc; 14s local 2024-12-18T01:01:12.6408246Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2024-12-18T01:01:12.6409227Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local ... 2024-12-18T01:01:12.8429662Z 2024-12-18T01:01:12.8430548Z  2024-12-18T01:01:12.8431022Z  2024-12-18T01:01:12.8431430Z  2024-12-18T01:01:12.8431852Z  2024-12-18T01:01:12.8432263Z  2024-12-18T01:01:12.8432678Z  2024-12-18T01:01:12.8433049Z  2024-12-18T01:01:12.8433730Z  2024-12-18T01:01:12.8434738Z [19,192 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:12.8435857Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T01:01:12.8436792Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2024-12-18T01:01:12.8437703Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2024-12-18T01:01:12.8438749Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2024-12-18T01:01:12.8439810Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T01:01:12.8440811Z Compiling xla/service/llvm_ir/llvm_loop.cc; 14s local 2024-12-18T01:01:12.8441723Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2024-12-18T01:01:12.8442739Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local ... 2024-12-18T01:01:13.5244959Z 2024-12-18T01:01:13.5245792Z  2024-12-18T01:01:13.5246207Z  2024-12-18T01:01:13.5246544Z  2024-12-18T01:01:13.5246896Z  2024-12-18T01:01:13.5247248Z  2024-12-18T01:01:13.5247576Z  2024-12-18T01:01:13.5248185Z  2024-12-18T01:01:13.5248518Z  2024-12-18T01:01:13.5249263Z [19,193 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:13.5250071Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T01:01:13.5250768Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T01:01:13.5251450Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T01:01:13.5252298Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2024-12-18T01:01:13.5253061Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T01:01:13.5253814Z Compiling xla/service/llvm_ir/llvm_loop.cc; 15s local 2024-12-18T01:01:13.5254494Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2024-12-18T01:01:13.5255306Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local ... 2024-12-18T01:01:13.8440922Z 2024-12-18T01:01:13.8441789Z  2024-12-18T01:01:13.8442209Z  2024-12-18T01:01:13.8442631Z  2024-12-18T01:01:13.8442962Z  2024-12-18T01:01:13.8443292Z  2024-12-18T01:01:13.8443632Z  2024-12-18T01:01:13.8443959Z  2024-12-18T01:01:13.8444496Z  2024-12-18T01:01:13.8445327Z [19,193 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:13.8446162Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T01:01:13.8446905Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T01:01:13.8447625Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T01:01:13.8448336Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2024-12-18T01:01:13.8449165Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 22s local 2024-12-18T01:01:13.8449986Z Compiling xla/service/llvm_ir/llvm_loop.cc; 15s local 2024-12-18T01:01:13.8450718Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2024-12-18T01:01:13.8451577Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local ... 2024-12-18T01:01:14.1292690Z 2024-12-18T01:01:14.1293447Z  2024-12-18T01:01:14.1293893Z  2024-12-18T01:01:14.1294325Z  2024-12-18T01:01:14.1294744Z  2024-12-18T01:01:14.1295188Z  2024-12-18T01:01:14.1295558Z  2024-12-18T01:01:14.1295980Z  2024-12-18T01:01:14.1296564Z  2024-12-18T01:01:14.1297490Z [19,196 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:14.1298433Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T01:01:14.1299226Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2024-12-18T01:01:14.1300042Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2024-12-18T01:01:14.1300844Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2024-12-18T01:01:14.1301957Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2024-12-18T01:01:14.1302930Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local 2024-12-18T01:01:14.1304035Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 14s local 2024-12-18T01:01:14.1305047Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 13s local ... 2024-12-18T01:01:14.3403627Z 2024-12-18T01:01:14.3404515Z  2024-12-18T01:01:14.3404946Z  2024-12-18T01:01:14.3405311Z  2024-12-18T01:01:14.3405673Z  2024-12-18T01:01:14.3406038Z  2024-12-18T01:01:14.3406396Z  2024-12-18T01:01:14.3406756Z  2024-12-18T01:01:14.3407105Z  2024-12-18T01:01:14.3407963Z [19,197 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:14.3408862Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T01:01:14.3409644Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T01:01:14.3410413Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T01:01:14.3411556Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2024-12-18T01:01:14.3412375Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2024-12-18T01:01:14.3413275Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2024-12-18T01:01:14.3414337Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 14s local 2024-12-18T01:01:14.3415594Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 14s local ... 2024-12-18T01:01:14.6427363Z 2024-12-18T01:01:14.6428333Z  2024-12-18T01:01:14.6428826Z  2024-12-18T01:01:14.6429269Z  2024-12-18T01:01:14.6429713Z  2024-12-18T01:01:14.6430103Z  2024-12-18T01:01:14.6430548Z  2024-12-18T01:01:14.6430957Z  2024-12-18T01:01:14.6431389Z  2024-12-18T01:01:14.6432324Z [19,198 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:14.6433356Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T01:01:14.6434199Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T01:01:14.6435039Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T01:01:14.6435855Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2024-12-18T01:01:14.6436725Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2024-12-18T01:01:14.6437702Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2024-12-18T01:01:14.6438821Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 14s local 2024-12-18T01:01:14.6439902Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 14s local ... 2024-12-18T01:01:14.8450679Z 2024-12-18T01:01:14.8451540Z  2024-12-18T01:01:14.8452007Z  2024-12-18T01:01:14.8452370Z  2024-12-18T01:01:14.8452751Z  2024-12-18T01:01:14.8453120Z  2024-12-18T01:01:14.8453480Z  2024-12-18T01:01:14.8453824Z  2024-12-18T01:01:14.8454185Z  2024-12-18T01:01:14.8455059Z [19,198 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:14.8455925Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T01:01:14.8456939Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2024-12-18T01:01:14.8457815Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2024-12-18T01:01:14.8458668Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2024-12-18T01:01:14.8459479Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2024-12-18T01:01:14.8460345Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2024-12-18T01:01:14.8461316Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 14s local 2024-12-18T01:01:14.8462276Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 14s local ... 2024-12-18T01:01:15.4110399Z 2024-12-18T01:01:15.4111324Z  2024-12-18T01:01:15.4111736Z  2024-12-18T01:01:15.4112075Z  2024-12-18T01:01:15.4112466Z  2024-12-18T01:01:15.4112818Z  2024-12-18T01:01:15.4113116Z  2024-12-18T01:01:15.4113434Z  2024-12-18T01:01:15.4113749Z  2024-12-18T01:01:15.4114540Z [19,199 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:15.4115646Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T01:01:15.4116331Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T01:01:15.4116992Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:15.4117638Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2024-12-18T01:01:15.4118323Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 16s local 2024-12-18T01:01:15.4119113Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T01:01:15.4120067Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 15s local 2024-12-18T01:01:15.4121120Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 15s local ... 2024-12-18T01:01:15.6410991Z 2024-12-18T01:01:15.6411855Z  2024-12-18T01:01:15.6412280Z  2024-12-18T01:01:15.6412628Z  2024-12-18T01:01:15.6412991Z  2024-12-18T01:01:15.6413317Z  2024-12-18T01:01:15.6413658Z  2024-12-18T01:01:15.6414058Z  2024-12-18T01:01:15.6414398Z  2024-12-18T01:01:15.6415461Z [19,202 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:15.6416524Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T01:01:15.6417266Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T01:01:15.6417998Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:15.6418718Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2024-12-18T01:01:15.6419600Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T01:01:15.6420611Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 15s local 2024-12-18T01:01:15.6421564Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 15s local 2024-12-18T01:01:15.6422320Z @llvm-project//mlir:VectorTransforms; 13s local ... 2024-12-18T01:01:15.8458850Z 2024-12-18T01:01:15.8459687Z  2024-12-18T01:01:15.8460157Z  2024-12-18T01:01:15.8460494Z  2024-12-18T01:01:15.8460807Z  2024-12-18T01:01:15.8461137Z  2024-12-18T01:01:15.8461478Z  2024-12-18T01:01:15.8461944Z  2024-12-18T01:01:15.8462284Z  2024-12-18T01:01:15.8463099Z [19,203 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:15.8463963Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T01:01:15.8464695Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T01:01:15.8465428Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:15.8466141Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2024-12-18T01:01:15.8466949Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T01:01:15.8467929Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 15s local 2024-12-18T01:01:15.8468850Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 15s local 2024-12-18T01:01:15.8469631Z Compiling xla/service/transfer_manager.cc; 12s local ... 2024-12-18T01:01:16.2463350Z 2024-12-18T01:01:16.2464286Z  2024-12-18T01:01:16.2464721Z  2024-12-18T01:01:16.2465059Z  2024-12-18T01:01:16.2465416Z  2024-12-18T01:01:16.2465756Z  2024-12-18T01:01:16.2466104Z  2024-12-18T01:01:16.2466446Z  2024-12-18T01:01:16.2466776Z  2024-12-18T01:01:16.2467593Z [19,204 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:16.2468750Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T01:01:16.2469497Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2024-12-18T01:01:16.2470225Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2024-12-18T01:01:16.2470911Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2024-12-18T01:01:16.2471731Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2024-12-18T01:01:16.2472847Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 16s local 2024-12-18T01:01:16.2473755Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local 2024-12-18T01:01:16.2474506Z Compiling xla/service/transfer_manager.cc; 13s local ... 2024-12-18T01:01:16.6467428Z 2024-12-18T01:01:16.6468293Z  2024-12-18T01:01:16.6468666Z  2024-12-18T01:01:16.6468992Z  2024-12-18T01:01:16.6469311Z  2024-12-18T01:01:16.6469632Z  2024-12-18T01:01:16.6469933Z  2024-12-18T01:01:16.6470254Z  2024-12-18T01:01:16.6470610Z  2024-12-18T01:01:16.6471627Z [19,205 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:16.6472408Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T01:01:16.6473046Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T01:01:16.6473732Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T01:01:16.6474372Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2024-12-18T01:01:16.6475255Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2024-12-18T01:01:16.6476169Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 16s local 2024-12-18T01:01:16.6476986Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local 2024-12-18T01:01:16.6477653Z Compiling xla/service/transfer_manager.cc; 13s local ... 2024-12-18T01:01:16.8470080Z 2024-12-18T01:01:16.8470962Z  2024-12-18T01:01:16.8471400Z  2024-12-18T01:01:16.8471810Z  2024-12-18T01:01:16.8472173Z  2024-12-18T01:01:16.8472535Z  2024-12-18T01:01:16.8472903Z  2024-12-18T01:01:16.8473254Z  2024-12-18T01:01:16.8473618Z  2024-12-18T01:01:16.8474472Z [19,207 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:16.8475383Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T01:01:16.8476159Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T01:01:16.8476928Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T01:01:16.8477667Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2024-12-18T01:01:16.8478535Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2024-12-18T01:01:16.8479438Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local 2024-12-18T01:01:16.8480204Z Compiling xla/service/transfer_manager.cc; 13s local 2024-12-18T01:01:16.8481000Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 12s local ... 2024-12-18T01:01:17.1363603Z 2024-12-18T01:01:17.1364465Z  2024-12-18T01:01:17.1364940Z  2024-12-18T01:01:17.1365331Z  2024-12-18T01:01:17.1365716Z  2024-12-18T01:01:17.1366090Z  2024-12-18T01:01:17.1366453Z  2024-12-18T01:01:17.1366804Z  2024-12-18T01:01:17.1367186Z  2024-12-18T01:01:17.1368108Z [19,209 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:17.1369080Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T01:01:17.1369922Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2024-12-18T01:01:17.1370702Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2024-12-18T01:01:17.1371486Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2024-12-18T01:01:17.1372418Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2024-12-18T01:01:17.1373635Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 17s local 2024-12-18T01:01:17.1374531Z Compiling xla/service/transfer_manager.cc; 14s local 2024-12-18T01:01:17.1375393Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 12s local ... 2024-12-18T01:01:17.4475050Z 2024-12-18T01:01:17.4475930Z  2024-12-18T01:01:17.4476419Z  2024-12-18T01:01:17.4476810Z  2024-12-18T01:01:17.4477233Z  2024-12-18T01:01:17.4477904Z  2024-12-18T01:01:17.4478297Z  2024-12-18T01:01:17.4478676Z  2024-12-18T01:01:17.4479059Z  2024-12-18T01:01:17.4479949Z [19,211 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:17.4480956Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T01:01:17.4481844Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T01:01:17.4482652Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T01:01:17.4483431Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2024-12-18T01:01:17.4484380Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2024-12-18T01:01:17.4485591Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 17s local 2024-12-18T01:01:17.4486437Z Compiling xla/service/transfer_manager.cc; 14s local 2024-12-18T01:01:17.4487333Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local ... 2024-12-18T01:01:17.8479331Z 2024-12-18T01:01:17.8480221Z  2024-12-18T01:01:17.8480705Z  2024-12-18T01:01:17.8481140Z  2024-12-18T01:01:17.8481539Z  2024-12-18T01:01:17.8482145Z  2024-12-18T01:01:17.8482567Z  2024-12-18T01:01:17.8482953Z  2024-12-18T01:01:17.8483364Z  2024-12-18T01:01:17.8484260Z [19,212 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:17.8485230Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T01:01:17.8486034Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T01:01:17.8486923Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T01:01:17.8487770Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2024-12-18T01:01:17.8488730Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2024-12-18T01:01:17.8489656Z Compiling xla/service/transfer_manager.cc; 14s local 2024-12-18T01:01:17.8490517Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2024-12-18T01:01:17.8491508Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 12s local ... 2024-12-18T01:01:18.2187338Z 2024-12-18T01:01:18.2188148Z  2024-12-18T01:01:18.2188562Z  2024-12-18T01:01:18.2188934Z  2024-12-18T01:01:18.2189299Z  2024-12-18T01:01:18.2189643Z  2024-12-18T01:01:18.2189984Z  2024-12-18T01:01:18.2190307Z  2024-12-18T01:01:18.2190641Z  2024-12-18T01:01:18.2191489Z [19,214 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:18.2192343Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T01:01:18.2193109Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2024-12-18T01:01:18.2193864Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2024-12-18T01:01:18.2194567Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2024-12-18T01:01:18.2195430Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2024-12-18T01:01:18.2196263Z Compiling xla/service/transfer_manager.cc; 15s local 2024-12-18T01:01:18.2197076Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2024-12-18T01:01:18.2197970Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 12s local ... 2024-12-18T01:01:18.4484092Z 2024-12-18T01:01:18.4484957Z  2024-12-18T01:01:18.4485378Z  2024-12-18T01:01:18.4485734Z  2024-12-18T01:01:18.4486087Z  2024-12-18T01:01:18.4486453Z  2024-12-18T01:01:18.4486792Z  2024-12-18T01:01:18.4488270Z  2024-12-18T01:01:18.4488589Z  2024-12-18T01:01:18.4489383Z [19,215 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:18.4490293Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T01:01:18.4491011Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T01:01:18.4491733Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T01:01:18.4492575Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2024-12-18T01:01:18.4493434Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2024-12-18T01:01:18.4494256Z Compiling xla/service/transfer_manager.cc; 15s local 2024-12-18T01:01:18.4494956Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2024-12-18T01:01:18.4495763Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 13s local ... 2024-12-18T01:01:18.8488458Z 2024-12-18T01:01:18.8489340Z  2024-12-18T01:01:18.8489782Z  2024-12-18T01:01:18.8490140Z  2024-12-18T01:01:18.8490472Z  2024-12-18T01:01:18.8490790Z  2024-12-18T01:01:18.8491373Z  2024-12-18T01:01:18.8491725Z  2024-12-18T01:01:18.8492065Z  2024-12-18T01:01:18.8492849Z [19,216 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:18.8493666Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T01:01:18.8494390Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T01:01:18.8495222Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T01:01:18.8495890Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2024-12-18T01:01:18.8496829Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2024-12-18T01:01:18.8497581Z Compiling xla/service/transfer_manager.cc; 15s local 2024-12-18T01:01:18.8498265Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2024-12-18T01:01:18.8499073Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 13s local ... 2024-12-18T01:01:19.0892977Z 2024-12-18T01:01:19.0893888Z  2024-12-18T01:01:19.0894313Z  2024-12-18T01:01:19.0894674Z  2024-12-18T01:01:19.0894999Z  2024-12-18T01:01:19.0895334Z  2024-12-18T01:01:19.0895801Z  2024-12-18T01:01:19.0896128Z  2024-12-18T01:01:19.0896613Z  2024-12-18T01:01:19.0897384Z [19,218 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:19.0898201Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T01:01:19.0898896Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2024-12-18T01:01:19.0899592Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2024-12-18T01:01:19.0900275Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2024-12-18T01:01:19.0901045Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2024-12-18T01:01:19.0901820Z Compiling xla/service/transfer_manager.cc; 16s local 2024-12-18T01:01:19.0902513Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2024-12-18T01:01:19.0903303Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 13s local ... 2024-12-18T01:01:19.3353265Z 2024-12-18T01:01:19.3354170Z  2024-12-18T01:01:19.3354645Z  2024-12-18T01:01:19.3355039Z  2024-12-18T01:01:19.3355446Z  2024-12-18T01:01:19.3355831Z  2024-12-18T01:01:19.3356207Z  2024-12-18T01:01:19.3356582Z  2024-12-18T01:01:19.3356988Z  2024-12-18T01:01:19.3357934Z [19,220 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:19.3358897Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T01:01:19.3359745Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2024-12-18T01:01:19.3360637Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T01:01:19.3361656Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2024-12-18T01:01:19.3362602Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2024-12-18T01:01:19.3363478Z Compiling xla/service/transfer_manager.cc; 16s local 2024-12-18T01:01:19.3364298Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2024-12-18T01:01:19.3365398Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 14s local ... 2024-12-18T01:01:19.6494629Z 2024-12-18T01:01:19.6495501Z  2024-12-18T01:01:19.6495987Z  2024-12-18T01:01:19.6496499Z  2024-12-18T01:01:19.6496930Z  2024-12-18T01:01:19.6497287Z  2024-12-18T01:01:19.6497675Z  2024-12-18T01:01:19.6498050Z  2024-12-18T01:01:19.6498419Z  2024-12-18T01:01:19.6499323Z [19,220 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:19.6500249Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T01:01:19.6501081Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2024-12-18T01:01:19.6502142Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2024-12-18T01:01:19.6502946Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2024-12-18T01:01:19.6503853Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2024-12-18T01:01:19.6504770Z Compiling xla/service/transfer_manager.cc; 16s local 2024-12-18T01:01:19.6505619Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2024-12-18T01:01:19.6506835Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 14s local ... 2024-12-18T01:01:20.2935756Z 2024-12-18T01:01:20.2936803Z  2024-12-18T01:01:20.2937265Z  2024-12-18T01:01:20.2937681Z  2024-12-18T01:01:20.2938097Z  2024-12-18T01:01:20.2938491Z  2024-12-18T01:01:20.2938835Z  2024-12-18T01:01:20.2939126Z  2024-12-18T01:01:20.2939427Z  2024-12-18T01:01:20.2940156Z [19,221 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:20.2940932Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T01:01:20.2941586Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2024-12-18T01:01:20.2942402Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T01:01:20.2943206Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2024-12-18T01:01:20.2944127Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2024-12-18T01:01:20.2945371Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 16s local 2024-12-18T01:01:20.2946283Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2024-12-18T01:01:20.2947341Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 12s local ... 2024-12-18T01:01:20.5425035Z 2024-12-18T01:01:20.5426055Z  2024-12-18T01:01:20.5426567Z  2024-12-18T01:01:20.5426970Z  2024-12-18T01:01:20.5427324Z  2024-12-18T01:01:20.5427670Z  2024-12-18T01:01:20.5428077Z  2024-12-18T01:01:20.5428430Z  2024-12-18T01:01:20.5428800Z  2024-12-18T01:01:20.5429712Z [19,222 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:20.5430687Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T01:01:20.5431530Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2024-12-18T01:01:20.5432324Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T01:01:20.5433127Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2024-12-18T01:01:20.5434030Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2024-12-18T01:01:20.5435016Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 16s local 2024-12-18T01:01:20.5435906Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2024-12-18T01:01:20.5436824Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 13s local ... 2024-12-18T01:01:20.8115104Z 2024-12-18T01:01:20.8116247Z  2024-12-18T01:01:20.8116719Z  2024-12-18T01:01:20.8117155Z  2024-12-18T01:01:20.8117559Z  2024-12-18T01:01:20.8117981Z  2024-12-18T01:01:20.8118377Z  2024-12-18T01:01:20.8118774Z  2024-12-18T01:01:20.8119147Z  2024-12-18T01:01:20.8120079Z [19,224 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:20.8121348Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T01:01:20.8122183Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2024-12-18T01:01:20.8123216Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T01:01:20.8123947Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2024-12-18T01:01:20.8124767Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2024-12-18T01:01:20.8125761Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2024-12-18T01:01:20.8126691Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 13s local 2024-12-18T01:01:20.8127627Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 13s local ... 2024-12-18T01:01:21.0503922Z 2024-12-18T01:01:21.0504793Z  2024-12-18T01:01:21.0505233Z  2024-12-18T01:01:21.0505615Z  2024-12-18T01:01:21.0505997Z  2024-12-18T01:01:21.0506357Z  2024-12-18T01:01:21.0506746Z  2024-12-18T01:01:21.0507120Z  2024-12-18T01:01:21.0507509Z  2024-12-18T01:01:21.0508653Z [19,225 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:21.0509641Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T01:01:21.0510478Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2024-12-18T01:01:21.0511197Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2024-12-18T01:01:21.0512105Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2024-12-18T01:01:21.0513045Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2024-12-18T01:01:21.0513969Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 13s local 2024-12-18T01:01:21.0514774Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 13s local 2024-12-18T01:01:21.0515629Z Compiling xla/service/cpu/dot_op_emitter.cc; 12s local ... 2024-12-18T01:01:21.4507608Z 2024-12-18T01:01:21.4508466Z  2024-12-18T01:01:21.4508888Z  2024-12-18T01:01:21.4509298Z  2024-12-18T01:01:21.4509656Z  2024-12-18T01:01:21.4510027Z  2024-12-18T01:01:21.4510368Z  2024-12-18T01:01:21.4510747Z  2024-12-18T01:01:21.4511119Z  2024-12-18T01:01:21.4511961Z [19,228 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:21.4512842Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T01:01:21.4513539Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2024-12-18T01:01:21.4514314Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2024-12-18T01:01:21.4515157Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2024-12-18T01:01:21.4516028Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 16s local 2024-12-18T01:01:21.4516830Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 13s local 2024-12-18T01:01:21.4517622Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 13s local 2024-12-18T01:01:21.4518431Z Compiling xla/service/cpu/dot_op_emitter.cc; 13s local ... 2024-12-18T01:01:22.3902656Z 2024-12-18T01:01:22.3904151Z  2024-12-18T01:01:22.3904620Z  2024-12-18T01:01:22.3905046Z  2024-12-18T01:01:22.3905436Z  2024-12-18T01:01:22.3905799Z  2024-12-18T01:01:22.3906184Z  2024-12-18T01:01:22.3906569Z  2024-12-18T01:01:22.3907006Z  2024-12-18T01:01:22.3907887Z [19,229 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:22.3908852Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T01:01:22.3909862Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T01:01:22.3910649Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2024-12-18T01:01:22.3911640Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T01:01:22.3912594Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 17s local 2024-12-18T01:01:22.3913467Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 14s local 2024-12-18T01:01:22.3914487Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 14s local 2024-12-18T01:01:22.3915348Z Compiling xla/service/cpu/dot_op_emitter.cc; 14s local ... 2024-12-18T01:01:22.6516113Z 2024-12-18T01:01:22.6517438Z  2024-12-18T01:01:22.6517953Z  2024-12-18T01:01:22.6518375Z  2024-12-18T01:01:22.6518784Z  2024-12-18T01:01:22.6519210Z  2024-12-18T01:01:22.6519611Z  2024-12-18T01:01:22.6520006Z  2024-12-18T01:01:22.6520435Z  2024-12-18T01:01:22.6521386Z [19,229 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:22.6522866Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T01:01:22.6523665Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T01:01:22.6524486Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2024-12-18T01:01:22.6525451Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T01:01:22.6526480Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 17s local 2024-12-18T01:01:22.6527507Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 15s local 2024-12-18T01:01:22.6528382Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 15s local 2024-12-18T01:01:22.6529264Z Compiling xla/service/cpu/dot_op_emitter.cc; 14s local ... 2024-12-18T01:01:22.9197503Z 2024-12-18T01:01:22.9198997Z  2024-12-18T01:01:22.9199466Z  2024-12-18T01:01:22.9199867Z  2024-12-18T01:01:22.9200258Z  2024-12-18T01:01:22.9200674Z  2024-12-18T01:01:22.9201036Z  2024-12-18T01:01:22.9201438Z  2024-12-18T01:01:22.9201837Z  2024-12-18T01:01:22.9202759Z [19,230 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:22.9203769Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T01:01:22.9204564Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2024-12-18T01:01:22.9205323Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2024-12-18T01:01:22.9206264Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T01:01:22.9207331Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 17s local 2024-12-18T01:01:22.9208244Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 15s local 2024-12-18T01:01:22.9209131Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 15s local 2024-12-18T01:01:22.9210039Z Compiling xla/service/cpu/dot_op_emitter.cc; 14s local ... 2024-12-18T01:01:23.2521669Z 2024-12-18T01:01:23.2522694Z  2024-12-18T01:01:23.2523193Z  2024-12-18T01:01:23.2523571Z  2024-12-18T01:01:23.2523959Z  2024-12-18T01:01:23.2524323Z  2024-12-18T01:01:23.2524686Z  2024-12-18T01:01:23.2525062Z  2024-12-18T01:01:23.2525450Z  2024-12-18T01:01:23.2526378Z [19,231 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:23.2527417Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:23.2528192Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T01:01:23.2529013Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2024-12-18T01:01:23.2529976Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2024-12-18T01:01:23.2530946Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 17s local 2024-12-18T01:01:23.2531874Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 15s local 2024-12-18T01:01:23.2533189Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 15s local 2024-12-18T01:01:23.2534083Z Compiling xla/service/cpu/dot_op_emitter.cc; 14s local ... 2024-12-18T01:01:23.5207773Z 2024-12-18T01:01:23.5209155Z  2024-12-18T01:01:23.5209655Z  2024-12-18T01:01:23.5210058Z  2024-12-18T01:01:23.5210435Z  2024-12-18T01:01:23.5210826Z  2024-12-18T01:01:23.5211223Z  2024-12-18T01:01:23.5211875Z  2024-12-18T01:01:23.5212266Z  2024-12-18T01:01:23.5213214Z [19,232 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:23.5214204Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:23.5214975Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T01:01:23.5215787Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2024-12-18T01:01:23.5216891Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2024-12-18T01:01:23.5217895Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 18s local 2024-12-18T01:01:23.5219041Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local 2024-12-18T01:01:23.5219921Z Compiling xla/service/cpu/tiled_dot_emitter.cc; 15s local 2024-12-18T01:01:23.5220800Z Compiling xla/service/cpu/dot_op_emitter.cc; 15s local ... 2024-12-18T01:01:23.8510730Z 2024-12-18T01:01:23.8511576Z  2024-12-18T01:01:23.8522456Z  2024-12-18T01:01:23.8522840Z  2024-12-18T01:01:23.8523221Z  2024-12-18T01:01:23.8523743Z  2024-12-18T01:01:23.8524135Z  2024-12-18T01:01:23.8524764Z  2024-12-18T01:01:23.8525144Z  2024-12-18T01:01:23.8525985Z [19,234 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:23.8526904Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:23.8527649Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T01:01:23.8528419Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2024-12-18T01:01:23.8529327Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2024-12-18T01:01:23.8530266Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 18s local 2024-12-18T01:01:23.8531144Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local 2024-12-18T01:01:23.8531940Z Compiling xla/service/cpu/dot_op_emitter.cc; 15s local 2024-12-18T01:01:23.8532753Z Compiling xla/service/spmd/gather_scatter_handler.cc; 14s local ... 2024-12-18T01:01:24.0527838Z 2024-12-18T01:01:24.0529373Z  2024-12-18T01:01:24.0529818Z  2024-12-18T01:01:24.0530202Z  2024-12-18T01:01:24.0530556Z  2024-12-18T01:01:24.0530909Z  2024-12-18T01:01:24.0531280Z  2024-12-18T01:01:24.0531642Z  2024-12-18T01:01:24.0531982Z  2024-12-18T01:01:24.0532868Z [19,234 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:24.0533850Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:24.0534604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2024-12-18T01:01:24.0535438Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2024-12-18T01:01:24.0536344Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2024-12-18T01:01:24.0537464Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 18s local 2024-12-18T01:01:24.0538353Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local 2024-12-18T01:01:24.0539187Z Compiling xla/service/cpu/dot_op_emitter.cc; 15s local 2024-12-18T01:01:24.0540008Z Compiling xla/service/spmd/gather_scatter_handler.cc; 14s local ... 2024-12-18T01:01:24.8533939Z 2024-12-18T01:01:24.8535445Z  2024-12-18T01:01:24.8535891Z  2024-12-18T01:01:24.8536249Z  2024-12-18T01:01:24.8536711Z  2024-12-18T01:01:24.8537054Z  2024-12-18T01:01:24.8537404Z  2024-12-18T01:01:24.8537742Z  2024-12-18T01:01:24.8538056Z  2024-12-18T01:01:24.8539172Z [19,235 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:01:24.8540079Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2024-12-18T01:01:24.8540782Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T01:01:24.8541487Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2024-12-18T01:01:24.8542455Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2024-12-18T01:01:24.8543331Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local 2024-12-18T01:01:24.8544139Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 17s local 2024-12-18T01:01:24.8545156Z Compiling xla/service/cpu/dot_op_emitter.cc; 16s local 2024-12-18T01:01:24.8545989Z Compiling xla/service/spmd/gather_scatter_handler.cc; 15s local ... 2024-12-18T01:01:25.0678723Z 2024-12-18T01:01:25.0680060Z  2024-12-18T01:01:25.0680594Z  2024-12-18T01:01:25.0680996Z  2024-12-18T01:01:25.0681417Z  2024-12-18T01:01:25.0681805Z  2024-12-18T01:01:25.0682177Z  2024-12-18T01:01:25.0682553Z  2024-12-18T01:01:25.0683208Z  2024-12-18T01:01:25.0684130Z [19,236 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:25.0685115Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2024-12-18T01:01:25.0685867Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2024-12-18T01:01:25.0686671Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2024-12-18T01:01:25.0687865Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2024-12-18T01:01:25.0688969Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local 2024-12-18T01:01:25.0689849Z Compiling xla/service/cpu/dot_op_emitter.cc; 16s local 2024-12-18T01:01:25.0690688Z Compiling xla/service/spmd/gather_scatter_handler.cc; 15s local 2024-12-18T01:01:25.0691552Z @llvm-project//mlir:VectorTransforms; 14s local ... 2024-12-18T01:01:25.3350369Z 2024-12-18T01:01:25.3351869Z  2024-12-18T01:01:25.3352370Z  2024-12-18T01:01:25.3352778Z  2024-12-18T01:01:25.3353167Z  2024-12-18T01:01:25.3353557Z  2024-12-18T01:01:25.3353933Z  2024-12-18T01:01:25.3354309Z  2024-12-18T01:01:25.3354688Z  2024-12-18T01:01:25.3355600Z [19,238 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:25.3356626Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T01:01:25.3357444Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T01:01:25.3358265Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2024-12-18T01:01:25.3359227Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2024-12-18T01:01:25.3360246Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2024-12-18T01:01:25.3361151Z Compiling xla/service/cpu/dot_op_emitter.cc; 17s local 2024-12-18T01:01:25.3362236Z Compiling xla/service/spmd/gather_scatter_handler.cc; 15s local 2024-12-18T01:01:25.3363158Z @llvm-project//mlir:VectorTransforms; 14s local ... 2024-12-18T01:01:25.6540334Z 2024-12-18T01:01:25.6541672Z  2024-12-18T01:01:25.6542191Z  2024-12-18T01:01:25.6542586Z  2024-12-18T01:01:25.6542968Z  2024-12-18T01:01:25.6543353Z  2024-12-18T01:01:25.6543770Z  2024-12-18T01:01:25.6544373Z  2024-12-18T01:01:25.6544776Z  2024-12-18T01:01:25.6545696Z [19,238 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:25.6546655Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T01:01:25.6547422Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T01:01:25.6548213Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2024-12-18T01:01:25.6549154Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2024-12-18T01:01:25.6550419Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2024-12-18T01:01:25.6551263Z Compiling xla/service/cpu/dot_op_emitter.cc; 17s local 2024-12-18T01:01:25.6552156Z Compiling xla/service/spmd/gather_scatter_handler.cc; 15s local 2024-12-18T01:01:25.6552993Z @llvm-project//mlir:VectorTransforms; 14s local ... 2024-12-18T01:01:26.1085572Z 2024-12-18T01:01:26.1086834Z  2024-12-18T01:01:26.1087355Z  2024-12-18T01:01:26.1087766Z  2024-12-18T01:01:26.1088154Z  2024-12-18T01:01:26.1088569Z  2024-12-18T01:01:26.1089009Z  2024-12-18T01:01:26.1089427Z  2024-12-18T01:01:26.1089834Z  2024-12-18T01:01:26.1090819Z [19,239 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:26.1091883Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T01:01:26.1092616Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2024-12-18T01:01:26.1093442Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2024-12-18T01:01:26.1094678Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2024-12-18T01:01:26.1095751Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2024-12-18T01:01:26.1096793Z Compiling xla/service/cpu/dot_op_emitter.cc; 17s local 2024-12-18T01:01:26.1097894Z Compiling xla/service/spmd/gather_scatter_handler.cc; 16s local 2024-12-18T01:01:26.1098997Z @llvm-project//mlir:VectorTransforms; 15s local ... 2024-12-18T01:01:26.4546125Z 2024-12-18T01:01:26.4547473Z  2024-12-18T01:01:26.4547910Z  2024-12-18T01:01:26.4548239Z  2024-12-18T01:01:26.4548574Z  2024-12-18T01:01:26.4548912Z  2024-12-18T01:01:26.4549227Z  2024-12-18T01:01:26.4549557Z  2024-12-18T01:01:26.4549890Z  2024-12-18T01:01:26.4550679Z [19,239 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:26.4551487Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T01:01:26.4552148Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T01:01:26.4552814Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2024-12-18T01:01:26.4553622Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T01:01:26.4554434Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2024-12-18T01:01:26.4555163Z Compiling xla/service/cpu/dot_op_emitter.cc; 18s local 2024-12-18T01:01:26.4555889Z Compiling xla/service/spmd/gather_scatter_handler.cc; 16s local 2024-12-18T01:01:26.4556630Z @llvm-project//mlir:VectorTransforms; 15s local ... 2024-12-18T01:01:26.6553769Z 2024-12-18T01:01:26.6555107Z  2024-12-18T01:01:26.6555571Z  2024-12-18T01:01:26.6555922Z  2024-12-18T01:01:26.6556326Z  2024-12-18T01:01:26.6556723Z  2024-12-18T01:01:26.6557108Z  2024-12-18T01:01:26.6557475Z  2024-12-18T01:01:26.6557830Z  2024-12-18T01:01:26.6558715Z [19,240 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:26.6559700Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T01:01:26.6560437Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T01:01:26.6561244Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T01:01:26.6562138Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T01:01:26.6563127Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2024-12-18T01:01:26.6563990Z Compiling xla/service/cpu/dot_op_emitter.cc; 18s local 2024-12-18T01:01:26.6564859Z Compiling xla/service/spmd/gather_scatter_handler.cc; 16s local 2024-12-18T01:01:26.6565759Z @llvm-project//mlir:VectorTransforms; 15s local ... 2024-12-18T01:01:26.9581073Z 2024-12-18T01:01:26.9582627Z  2024-12-18T01:01:26.9583113Z  2024-12-18T01:01:26.9583487Z  2024-12-18T01:01:26.9584141Z  2024-12-18T01:01:26.9584532Z  2024-12-18T01:01:26.9584919Z  2024-12-18T01:01:26.9585284Z  2024-12-18T01:01:26.9585680Z  2024-12-18T01:01:26.9586593Z [19,242 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:26.9587581Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T01:01:26.9588572Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2024-12-18T01:01:26.9589377Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T01:01:26.9590231Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T01:01:26.9591006Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2024-12-18T01:01:26.9591776Z Compiling xla/service/cpu/dot_op_emitter.cc; 18s local 2024-12-18T01:01:26.9592706Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local 2024-12-18T01:01:26.9593575Z @llvm-project//mlir:VectorTransforms; 16s local ... 2024-12-18T01:01:27.2553956Z 2024-12-18T01:01:27.2555052Z  2024-12-18T01:01:27.2555469Z  2024-12-18T01:01:27.2556104Z  2024-12-18T01:01:27.2556511Z  2024-12-18T01:01:27.2556908Z  2024-12-18T01:01:27.2557277Z  2024-12-18T01:01:27.2557677Z  2024-12-18T01:01:27.2558069Z  2024-12-18T01:01:27.2558948Z [19,243 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:27.2559859Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T01:01:27.2560785Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T01:01:27.2561591Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T01:01:27.2562444Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2024-12-18T01:01:27.2563448Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2024-12-18T01:01:27.2564298Z Compiling xla/service/cpu/dot_op_emitter.cc; 18s local 2024-12-18T01:01:27.2565204Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local 2024-12-18T01:01:27.2566225Z @llvm-project//mlir:VectorTransforms; 16s local ... 2024-12-18T01:01:27.5103941Z 2024-12-18T01:01:27.5105393Z  2024-12-18T01:01:27.5105874Z  2024-12-18T01:01:27.5106258Z  2024-12-18T01:01:27.5106638Z  2024-12-18T01:01:27.5107041Z  2024-12-18T01:01:27.5107440Z  2024-12-18T01:01:27.5107809Z  2024-12-18T01:01:27.5108186Z  2024-12-18T01:01:27.5109117Z [19,244 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:27.5110038Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T01:01:27.5110820Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T01:01:27.5111584Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2024-12-18T01:01:27.5112565Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2024-12-18T01:01:27.5113586Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2024-12-18T01:01:27.5114513Z Compiling xla/service/cpu/dot_op_emitter.cc; 19s local 2024-12-18T01:01:27.5115424Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local 2024-12-18T01:01:27.5116274Z @llvm-project//mlir:VectorTransforms; 16s local ... 2024-12-18T01:01:27.8558865Z 2024-12-18T01:01:27.8560310Z  2024-12-18T01:01:27.8560864Z  2024-12-18T01:01:27.8561251Z  2024-12-18T01:01:27.8561636Z  2024-12-18T01:01:27.8562176Z  2024-12-18T01:01:27.8562603Z  2024-12-18T01:01:27.8562993Z  2024-12-18T01:01:27.8563388Z  2024-12-18T01:01:27.8564345Z [19,244 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:27.8565410Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T01:01:27.8566185Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2024-12-18T01:01:27.8567295Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T01:01:27.8568243Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2024-12-18T01:01:27.8569222Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2024-12-18T01:01:27.8570097Z Compiling xla/service/cpu/dot_op_emitter.cc; 19s local 2024-12-18T01:01:27.8570951Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2024-12-18T01:01:27.8572058Z @llvm-project//mlir:VectorTransforms; 16s local ... 2024-12-18T01:01:28.2563070Z 2024-12-18T01:01:28.2564489Z  2024-12-18T01:01:28.2565028Z  2024-12-18T01:01:28.2565453Z  2024-12-18T01:01:28.2565846Z  2024-12-18T01:01:28.2566260Z  2024-12-18T01:01:28.2566689Z  2024-12-18T01:01:28.2567084Z  2024-12-18T01:01:28.2567450Z  2024-12-18T01:01:28.2568367Z [19,245 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:28.2569401Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T01:01:28.2570467Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T01:01:28.2571342Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2024-12-18T01:01:28.2572294Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2024-12-18T01:01:28.2573315Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2024-12-18T01:01:28.2574189Z Compiling xla/service/cpu/dot_op_emitter.cc; 19s local 2024-12-18T01:01:28.2575288Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2024-12-18T01:01:28.2576221Z @llvm-project//mlir:VectorTransforms; 17s local ... 2024-12-18T01:01:28.6567069Z 2024-12-18T01:01:28.6568373Z  2024-12-18T01:01:28.6568961Z  2024-12-18T01:01:28.6569359Z  2024-12-18T01:01:28.6569767Z  2024-12-18T01:01:28.6570184Z  2024-12-18T01:01:28.6570534Z  2024-12-18T01:01:28.6570906Z  2024-12-18T01:01:28.6571274Z  2024-12-18T01:01:28.6572224Z [19,246 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:28.6573225Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T01:01:28.6573975Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T01:01:28.6574785Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T01:01:28.6575828Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2024-12-18T01:01:28.6576939Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2024-12-18T01:01:28.6577862Z Compiling xla/service/cpu/dot_op_emitter.cc; 20s local 2024-12-18T01:01:28.6578795Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2024-12-18T01:01:28.6579648Z @llvm-project//mlir:VectorTransforms; 17s local ... 2024-12-18T01:01:28.8570289Z 2024-12-18T01:01:28.8571636Z  2024-12-18T01:01:28.8572021Z  2024-12-18T01:01:28.8572322Z  2024-12-18T01:01:28.8572674Z  2024-12-18T01:01:28.8572990Z  2024-12-18T01:01:28.8573302Z  2024-12-18T01:01:28.8573614Z  2024-12-18T01:01:28.8573927Z  2024-12-18T01:01:28.8574661Z [19,247 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:28.8575429Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T01:01:28.8576038Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2024-12-18T01:01:28.8576812Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T01:01:28.8577532Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2024-12-18T01:01:28.8578294Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2024-12-18T01:01:28.8579021Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local 2024-12-18T01:01:28.8579680Z @llvm-project//mlir:VectorTransforms; 17s local 2024-12-18T01:01:28.8580376Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 14s local ... 2024-12-18T01:01:29.5067791Z 2024-12-18T01:01:29.5069195Z  2024-12-18T01:01:29.5069693Z  2024-12-18T01:01:29.5070096Z  2024-12-18T01:01:29.5070508Z  2024-12-18T01:01:29.5070878Z  2024-12-18T01:01:29.5071251Z  2024-12-18T01:01:29.5071731Z  2024-12-18T01:01:29.5072085Z  2024-12-18T01:01:29.5073000Z [19,248 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:29.5074276Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2024-12-18T01:01:29.5075058Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T01:01:29.5075763Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2024-12-18T01:01:29.5076671Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2024-12-18T01:01:29.5077611Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2024-12-18T01:01:29.5078522Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local 2024-12-18T01:01:29.5079394Z @llvm-project//mlir:VectorTransforms; 18s local 2024-12-18T01:01:29.5080433Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local ... 2024-12-18T01:01:29.8577817Z 2024-12-18T01:01:29.8579183Z  2024-12-18T01:01:29.8579683Z  2024-12-18T01:01:29.8580058Z  2024-12-18T01:01:29.8580423Z  2024-12-18T01:01:29.8580813Z  2024-12-18T01:01:29.8581156Z  2024-12-18T01:01:29.8581534Z  2024-12-18T01:01:29.8581919Z  2024-12-18T01:01:29.8583119Z [19,248 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:29.8584131Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2024-12-18T01:01:29.8584891Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T01:01:29.8585624Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T01:01:29.8586515Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2024-12-18T01:01:29.8587495Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2024-12-18T01:01:29.8588445Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T01:01:29.8589274Z @llvm-project//mlir:VectorTransforms; 18s local 2024-12-18T01:01:29.8590100Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local ... 2024-12-18T01:01:30.0580480Z 2024-12-18T01:01:30.0581832Z  2024-12-18T01:01:30.0582376Z  2024-12-18T01:01:30.0582771Z  2024-12-18T01:01:30.0583145Z  2024-12-18T01:01:30.0583553Z  2024-12-18T01:01:30.0583939Z  2024-12-18T01:01:30.0584330Z  2024-12-18T01:01:30.0584714Z  2024-12-18T01:01:30.0585634Z [19,249 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:30.0586530Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2024-12-18T01:01:30.0587267Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2024-12-18T01:01:30.0588107Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T01:01:30.0589090Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2024-12-18T01:01:30.0590048Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2024-12-18T01:01:30.0590972Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T01:01:30.0591963Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local 2024-12-18T01:01:30.0592956Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local ... 2024-12-18T01:01:30.4584700Z 2024-12-18T01:01:30.4586022Z  2024-12-18T01:01:30.4586529Z  2024-12-18T01:01:30.4586930Z  2024-12-18T01:01:30.4587324Z  2024-12-18T01:01:30.4587709Z  2024-12-18T01:01:30.4588103Z  2024-12-18T01:01:30.4588510Z  2024-12-18T01:01:30.4588910Z  2024-12-18T01:01:30.4589795Z [19,250 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:30.4591149Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2024-12-18T01:01:30.4591936Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T01:01:30.4592699Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2024-12-18T01:01:30.4593583Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2024-12-18T01:01:30.4594746Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2024-12-18T01:01:30.4595715Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T01:01:30.4596652Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local 2024-12-18T01:01:30.4597630Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local ... 2024-12-18T01:01:31.0574283Z 2024-12-18T01:01:31.0575606Z  2024-12-18T01:01:31.0576051Z  2024-12-18T01:01:31.0576518Z  2024-12-18T01:01:31.0576887Z  2024-12-18T01:01:31.0577249Z  2024-12-18T01:01:31.0577646Z  2024-12-18T01:01:31.0577996Z  2024-12-18T01:01:31.0578346Z  2024-12-18T01:01:31.0579487Z [19,251 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:31.0580454Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2024-12-18T01:01:31.0581165Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2024-12-18T01:01:31.0581933Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2024-12-18T01:01:31.0582911Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2024-12-18T01:01:31.0583800Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2024-12-18T01:01:31.0584649Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T01:01:31.0585554Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local 2024-12-18T01:01:31.0586459Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local ... 2024-12-18T01:01:31.2590871Z 2024-12-18T01:01:31.2592286Z  2024-12-18T01:01:31.2592824Z  2024-12-18T01:01:31.2593215Z  2024-12-18T01:01:31.2593616Z  2024-12-18T01:01:31.2594058Z  2024-12-18T01:01:31.2594434Z  2024-12-18T01:01:31.2594840Z  2024-12-18T01:01:31.2595224Z  2024-12-18T01:01:31.2596158Z [19,251 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:31.2597212Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T01:01:31.2598017Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T01:01:31.2598820Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2024-12-18T01:01:31.2599792Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2024-12-18T01:01:31.2600785Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2024-12-18T01:01:31.2601751Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T01:01:31.2602764Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 17s local 2024-12-18T01:01:31.2603766Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local ... 2024-12-18T01:01:31.8083266Z 2024-12-18T01:01:31.8084657Z  2024-12-18T01:01:31.8085131Z  2024-12-18T01:01:31.8085502Z  2024-12-18T01:01:31.8085855Z  2024-12-18T01:01:31.8086215Z  2024-12-18T01:01:31.8086583Z  2024-12-18T01:01:31.8087048Z  2024-12-18T01:01:31.8087397Z  2024-12-18T01:01:31.8088229Z [19,252 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:31.8089121Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T01:01:31.8089826Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T01:01:31.8090553Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T01:01:31.8091407Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2024-12-18T01:01:31.8092684Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2024-12-18T01:01:31.8093641Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T01:01:31.8094568Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 17s local 2024-12-18T01:01:31.8095495Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local ... 2024-12-18T01:01:32.0597237Z 2024-12-18T01:01:32.0598547Z  2024-12-18T01:01:32.0599487Z  2024-12-18T01:01:32.0599867Z  2024-12-18T01:01:32.0600243Z  2024-12-18T01:01:32.0600625Z  2024-12-18T01:01:32.0601046Z  2024-12-18T01:01:32.0601377Z  2024-12-18T01:01:32.0601733Z  2024-12-18T01:01:32.0602610Z [19,252 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:32.0603531Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T01:01:32.0604285Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2024-12-18T01:01:32.0605053Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T01:01:32.0606254Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2024-12-18T01:01:32.0607273Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2024-12-18T01:01:32.0608232Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T01:01:32.0609237Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 17s local 2024-12-18T01:01:32.0610181Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local ... 2024-12-18T01:01:32.2600493Z 2024-12-18T01:01:32.2602164Z  2024-12-18T01:01:32.2602704Z  2024-12-18T01:01:32.2603105Z  2024-12-18T01:01:32.2603488Z  2024-12-18T01:01:32.2603885Z  2024-12-18T01:01:32.2604283Z  2024-12-18T01:01:32.2604649Z  2024-12-18T01:01:32.2605041Z  2024-12-18T01:01:32.2605976Z [19,254 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:32.2607005Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T01:01:32.2607833Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T01:01:32.2608679Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T01:01:32.2609620Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2024-12-18T01:01:32.2610574Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2024-12-18T01:01:32.2611496Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T01:01:32.2612521Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 18s local 2024-12-18T01:01:32.2613538Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local ... 2024-12-18T01:01:32.4666430Z 2024-12-18T01:01:32.4667960Z  2024-12-18T01:01:32.4668457Z  2024-12-18T01:01:32.4668848Z  2024-12-18T01:01:32.4669242Z  2024-12-18T01:01:32.4669657Z  2024-12-18T01:01:32.4670054Z  2024-12-18T01:01:32.4670478Z  2024-12-18T01:01:32.4670868Z  2024-12-18T01:01:32.4671726Z [19,256 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:32.4672734Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T01:01:32.4673549Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T01:01:32.4674334Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2024-12-18T01:01:32.4675305Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T01:01:32.4676249Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2024-12-18T01:01:32.4677201Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T01:01:32.4678163Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2024-12-18T01:01:32.4679162Z Compiling .../cpu/codegen/polynomial_approximations.cc; 15s local ... 2024-12-18T01:01:32.7920143Z 2024-12-18T01:01:32.7921576Z  2024-12-18T01:01:32.7922364Z  2024-12-18T01:01:32.7922782Z  2024-12-18T01:01:32.7923164Z  2024-12-18T01:01:32.7923591Z  2024-12-18T01:01:32.7924026Z  2024-12-18T01:01:32.7924408Z  2024-12-18T01:01:32.7924791Z  2024-12-18T01:01:32.7925758Z [19,257 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:32.7926777Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T01:01:32.7927728Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T01:01:32.7928580Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T01:01:32.7929592Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T01:01:32.7930599Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2024-12-18T01:01:32.7931538Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T01:01:32.7932492Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2024-12-18T01:01:32.7933515Z Compiling .../cpu/codegen/polynomial_approximations.cc; 16s local ... 2024-12-18T01:01:33.0607138Z 2024-12-18T01:01:33.0608915Z  2024-12-18T01:01:33.0609462Z  2024-12-18T01:01:33.0609867Z  2024-12-18T01:01:33.0610239Z  2024-12-18T01:01:33.0610617Z  2024-12-18T01:01:33.0611021Z  2024-12-18T01:01:33.0611408Z  2024-12-18T01:01:33.0611823Z  2024-12-18T01:01:33.0612679Z [19,257 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:33.0613761Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T01:01:33.0614630Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2024-12-18T01:01:33.0615448Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T01:01:33.0616531Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T01:01:33.0617494Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2024-12-18T01:01:33.0618441Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2024-12-18T01:01:33.0619385Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2024-12-18T01:01:33.0620300Z Compiling .../cpu/codegen/polynomial_approximations.cc; 16s local ... 2024-12-18T01:01:33.2610082Z 2024-12-18T01:01:33.2611402Z  2024-12-18T01:01:33.2611871Z  2024-12-18T01:01:33.2612421Z  2024-12-18T01:01:33.2612791Z  2024-12-18T01:01:33.2613139Z  2024-12-18T01:01:33.2613512Z  2024-12-18T01:01:33.2613868Z  2024-12-18T01:01:33.2614257Z  2024-12-18T01:01:33.2615199Z [19,258 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:33.2616233Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T01:01:33.2617181Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:33.2618007Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T01:01:33.2618925Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2024-12-18T01:01:33.2619903Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2024-12-18T01:01:33.2620847Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2024-12-18T01:01:33.2621948Z Compiling xla/backends/cpu/codegen/polynomial_approximations.cc; 16s local 2024-12-18T01:01:33.2623017Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local ... 2024-12-18T01:01:33.5407395Z 2024-12-18T01:01:33.5408509Z  2024-12-18T01:01:33.5408994Z  2024-12-18T01:01:33.5409335Z  2024-12-18T01:01:33.5409698Z  2024-12-18T01:01:33.5410052Z  2024-12-18T01:01:33.5410414Z  2024-12-18T01:01:33.5410772Z  2024-12-18T01:01:33.5411123Z  2024-12-18T01:01:33.5411976Z [19,260 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:33.5412924Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T01:01:33.5413992Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:33.5414776Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2024-12-18T01:01:33.5415717Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T01:01:33.5417091Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2024-12-18T01:01:33.5418243Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2024-12-18T01:01:33.5419176Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local 2024-12-18T01:01:33.5420186Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local ... 2024-12-18T01:01:33.8615301Z 2024-12-18T01:01:33.8616908Z  2024-12-18T01:01:33.8617396Z  2024-12-18T01:01:33.8617770Z  2024-12-18T01:01:33.8618086Z  2024-12-18T01:01:33.8618458Z  2024-12-18T01:01:33.8618844Z  2024-12-18T01:01:33.8619211Z  2024-12-18T01:01:33.8619649Z  2024-12-18T01:01:33.8620808Z [19,261 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:33.8621872Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T01:01:33.8622687Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:33.8623520Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T01:01:33.8624532Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T01:01:33.8625802Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2024-12-18T01:01:33.8626808Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local 2024-12-18T01:01:33.8627844Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local 2024-12-18T01:01:33.8628907Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2024-12-18T01:01:34.1692108Z 2024-12-18T01:01:34.1693236Z  2024-12-18T01:01:34.1693731Z  2024-12-18T01:01:34.1694104Z  2024-12-18T01:01:34.1694433Z  2024-12-18T01:01:34.1694751Z  2024-12-18T01:01:34.1695074Z  2024-12-18T01:01:34.1695415Z  2024-12-18T01:01:34.1695738Z  2024-12-18T01:01:34.1696636Z [19,262 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:34.1697431Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2024-12-18T01:01:34.1698081Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2024-12-18T01:01:34.1698757Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T01:01:34.1699532Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2024-12-18T01:01:34.1700339Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2024-12-18T01:01:34.1701090Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local 2024-12-18T01:01:34.1701906Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local 2024-12-18T01:01:34.1702855Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2024-12-18T01:01:34.4620894Z 2024-12-18T01:01:34.4622170Z  2024-12-18T01:01:34.4622725Z  2024-12-18T01:01:34.4623265Z  2024-12-18T01:01:34.4623769Z  2024-12-18T01:01:34.4624201Z  2024-12-18T01:01:34.4624577Z  2024-12-18T01:01:34.4624949Z  2024-12-18T01:01:34.4625325Z  2024-12-18T01:01:34.4626278Z [19,262 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:34.4627279Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2024-12-18T01:01:34.4628102Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2024-12-18T01:01:34.4628955Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2024-12-18T01:01:34.4629959Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2024-12-18T01:01:34.4630989Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2024-12-18T01:01:34.4632241Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local 2024-12-18T01:01:34.4633351Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local 2024-12-18T01:01:34.4634440Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2024-12-18T01:01:35.3854593Z 2024-12-18T01:01:35.3856050Z  2024-12-18T01:01:35.3856673Z  2024-12-18T01:01:35.3857087Z  2024-12-18T01:01:35.3857757Z  2024-12-18T01:01:35.3858159Z  2024-12-18T01:01:35.3858547Z  2024-12-18T01:01:35.3858943Z  2024-12-18T01:01:35.3859327Z  2024-12-18T01:01:35.3860263Z [19,263 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:35.3861244Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T01:01:35.3862163Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T01:01:35.3862988Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2024-12-18T01:01:35.3863935Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T01:01:35.3865171Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2024-12-18T01:01:35.3866187Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2024-12-18T01:01:35.3867117Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local 2024-12-18T01:01:35.3868018Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local ... 2024-12-18T01:01:35.6629602Z 2024-12-18T01:01:35.6630989Z  2024-12-18T01:01:35.6631501Z  2024-12-18T01:01:35.6632169Z  2024-12-18T01:01:35.6632589Z  2024-12-18T01:01:35.6632937Z  2024-12-18T01:01:35.6633309Z  2024-12-18T01:01:35.6633683Z  2024-12-18T01:01:35.6634074Z  2024-12-18T01:01:35.6635001Z [19,263 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:35.6635974Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T01:01:35.6636803Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T01:01:35.6637624Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T01:01:35.6638575Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T01:01:35.6639586Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2024-12-18T01:01:35.6640569Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2024-12-18T01:01:35.6641525Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local 2024-12-18T01:01:35.6642452Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local ... 2024-12-18T01:01:36.0633752Z 2024-12-18T01:01:36.0635160Z  2024-12-18T01:01:36.0635683Z  2024-12-18T01:01:36.0636079Z  2024-12-18T01:01:36.0636447Z  2024-12-18T01:01:36.0636841Z  2024-12-18T01:01:36.0637223Z  2024-12-18T01:01:36.0637622Z  2024-12-18T01:01:36.0638001Z  2024-12-18T01:01:36.0638911Z [19,265 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:01:36.0639967Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T01:01:36.0640725Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2024-12-18T01:01:36.0641541Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T01:01:36.0642643Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2024-12-18T01:01:36.0643679Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2024-12-18T01:01:36.0644917Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2024-12-18T01:01:36.0645869Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local 2024-12-18T01:01:36.0646787Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local ... 2024-12-18T01:01:36.4638178Z 2024-12-18T01:01:36.4639701Z  2024-12-18T01:01:36.4640186Z  2024-12-18T01:01:36.4640573Z  2024-12-18T01:01:36.4640933Z  2024-12-18T01:01:36.4641587Z  2024-12-18T01:01:36.4641974Z  2024-12-18T01:01:36.4642341Z  2024-12-18T01:01:36.4642707Z  2024-12-18T01:01:36.4643675Z [19,265 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:36.4644959Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T01:01:36.4645723Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T01:01:36.4646796Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2024-12-18T01:01:36.4647809Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T01:01:36.4648799Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2024-12-18T01:01:36.4649765Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2024-12-18T01:01:36.4650870Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local 2024-12-18T01:01:36.4651852Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local ... 2024-12-18T01:01:36.7196845Z 2024-12-18T01:01:36.7197884Z  2024-12-18T01:01:36.7198327Z  2024-12-18T01:01:36.7198726Z  2024-12-18T01:01:36.7199368Z  2024-12-18T01:01:36.7199779Z  2024-12-18T01:01:36.7200192Z  2024-12-18T01:01:36.7200565Z  2024-12-18T01:01:36.7200946Z  2024-12-18T01:01:36.7201894Z [19,266 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:36.7202880Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T01:01:36.7203853Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T01:01:36.7204569Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T01:01:36.7205538Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T01:01:36.7206541Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2024-12-18T01:01:36.7207541Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2024-12-18T01:01:36.7208546Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local 2024-12-18T01:01:36.7209416Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local ... 2024-12-18T01:01:37.0644763Z 2024-12-18T01:01:37.0645662Z  2024-12-18T01:01:37.0646143Z  2024-12-18T01:01:37.0646528Z  2024-12-18T01:01:37.0646927Z  2024-12-18T01:01:37.0647299Z  2024-12-18T01:01:37.0647686Z  2024-12-18T01:01:37.0648116Z  2024-12-18T01:01:37.0648499Z  2024-12-18T01:01:37.0649435Z [19,266 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:37.0650372Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T01:01:37.0651078Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2024-12-18T01:01:37.0651891Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T01:01:37.0652825Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2024-12-18T01:01:37.0653800Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2024-12-18T01:01:37.0654780Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2024-12-18T01:01:37.0655722Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local 2024-12-18T01:01:37.0656783Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local ... 2024-12-18T01:01:37.4648953Z 2024-12-18T01:01:37.4649873Z  2024-12-18T01:01:37.4650347Z  2024-12-18T01:01:37.4650749Z  2024-12-18T01:01:37.4651154Z  2024-12-18T01:01:37.4651550Z  2024-12-18T01:01:37.4651950Z  2024-12-18T01:01:37.4652309Z  2024-12-18T01:01:37.4652695Z  2024-12-18T01:01:37.4653639Z [19,267 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:37.4654663Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2024-12-18T01:01:37.4655444Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T01:01:37.4656701Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2024-12-18T01:01:37.4657693Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T01:01:37.4658699Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2024-12-18T01:01:37.4659679Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2024-12-18T01:01:37.4660627Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2024-12-18T01:01:37.4661721Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local ... 2024-12-18T01:01:37.6659564Z 2024-12-18T01:01:37.6660495Z  2024-12-18T01:01:37.6660960Z  2024-12-18T01:01:37.6661339Z  2024-12-18T01:01:37.6661688Z  2024-12-18T01:01:37.6662042Z  2024-12-18T01:01:37.6662421Z  2024-12-18T01:01:37.6662811Z  2024-12-18T01:01:37.6663211Z  2024-12-18T01:01:37.6664148Z [19,268 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:37.6665126Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2024-12-18T01:01:37.6666200Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T01:01:37.6667022Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T01:01:37.6667851Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T01:01:37.6668866Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2024-12-18T01:01:37.6669782Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2024-12-18T01:01:37.6670750Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2024-12-18T01:01:37.6671651Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local ... 2024-12-18T01:01:38.0653380Z 2024-12-18T01:01:38.0654303Z  2024-12-18T01:01:38.0654810Z  2024-12-18T01:01:38.0655208Z  2024-12-18T01:01:38.0655584Z  2024-12-18T01:01:38.0655961Z  2024-12-18T01:01:38.0656361Z  2024-12-18T01:01:38.0656907Z  2024-12-18T01:01:38.0657346Z  2024-12-18T01:01:38.0658299Z [19,268 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:38.0659260Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2024-12-18T01:01:38.0660079Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2024-12-18T01:01:38.0660960Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T01:01:38.0661879Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2024-12-18T01:01:38.0662878Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2024-12-18T01:01:38.0663817Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2024-12-18T01:01:38.0664729Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2024-12-18T01:01:38.0665580Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local ... 2024-12-18T01:01:38.4657542Z 2024-12-18T01:01:38.4658471Z  2024-12-18T01:01:38.4658958Z  2024-12-18T01:01:38.4659413Z  2024-12-18T01:01:38.4659827Z  2024-12-18T01:01:38.4660260Z  2024-12-18T01:01:38.4660684Z  2024-12-18T01:01:38.4661088Z  2024-12-18T01:01:38.4661517Z  2024-12-18T01:01:38.4662515Z [19,270 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:38.4663453Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2024-12-18T01:01:38.4664295Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T01:01:38.4665108Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2024-12-18T01:01:38.4666100Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T01:01:38.4667108Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2024-12-18T01:01:38.4668090Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2024-12-18T01:01:38.4669030Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2024-12-18T01:01:38.4670209Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local ... 2024-12-18T01:01:39.2227322Z 2024-12-18T01:01:39.2228332Z  2024-12-18T01:01:39.2228865Z  2024-12-18T01:01:39.2229347Z  2024-12-18T01:01:39.2229814Z  2024-12-18T01:01:39.2230223Z  2024-12-18T01:01:39.2230671Z  2024-12-18T01:01:39.2231108Z  2024-12-18T01:01:39.2231494Z  2024-12-18T01:01:39.2232789Z [19,271 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:39.2233755Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T01:01:39.2234507Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2024-12-18T01:01:39.2235282Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T01:01:39.2236155Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2024-12-18T01:01:39.2237024Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2024-12-18T01:01:39.2237956Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2024-12-18T01:01:39.2239070Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2024-12-18T01:01:39.2239965Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local ... 2024-12-18T01:01:39.4664355Z 2024-12-18T01:01:39.4665222Z  2024-12-18T01:01:39.4665732Z  2024-12-18T01:01:39.4666149Z  2024-12-18T01:01:39.4666513Z  2024-12-18T01:01:39.4666860Z  2024-12-18T01:01:39.4667199Z  2024-12-18T01:01:39.4667607Z  2024-12-18T01:01:39.4668008Z  2024-12-18T01:01:39.4669207Z [19,272 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:39.4670396Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T01:01:39.4671128Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2024-12-18T01:01:39.4672097Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2024-12-18T01:01:39.4673073Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T01:01:39.4674142Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2024-12-18T01:01:39.4675157Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2024-12-18T01:01:39.4676275Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2024-12-18T01:01:39.4677224Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local ... 2024-12-18T01:01:39.8668614Z 2024-12-18T01:01:39.8669576Z  2024-12-18T01:01:39.8670078Z  2024-12-18T01:01:39.8670488Z  2024-12-18T01:01:39.8684147Z  2024-12-18T01:01:39.8684595Z  2024-12-18T01:01:39.8684981Z  2024-12-18T01:01:39.8685372Z  2024-12-18T01:01:39.8685738Z  2024-12-18T01:01:39.8686654Z [19,274 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:39.8687666Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T01:01:39.8688494Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2024-12-18T01:01:39.8689319Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2024-12-18T01:01:39.8690288Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T01:01:39.8691233Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2024-12-18T01:01:39.8692303Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2024-12-18T01:01:39.8693284Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2024-12-18T01:01:39.8694090Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local ... 2024-12-18T01:01:40.1894216Z 2024-12-18T01:01:40.1895116Z  2024-12-18T01:01:40.1895603Z  2024-12-18T01:01:40.1896010Z  2024-12-18T01:01:40.1896536Z  2024-12-18T01:01:40.1896987Z  2024-12-18T01:01:40.1897392Z  2024-12-18T01:01:40.1897764Z  2024-12-18T01:01:40.1898146Z  2024-12-18T01:01:40.1899115Z [19,275 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:40.1900418Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T01:01:40.1901176Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2024-12-18T01:01:40.1902148Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2024-12-18T01:01:40.1903109Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2024-12-18T01:01:40.1904290Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2024-12-18T01:01:40.1905230Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:01:40.1906159Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2024-12-18T01:01:40.1907112Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local ... 2024-12-18T01:01:40.4035536Z 2024-12-18T01:01:40.4036476Z  2024-12-18T01:01:40.4036967Z  2024-12-18T01:01:40.4037347Z  2024-12-18T01:01:40.4037742Z  2024-12-18T01:01:40.4038167Z  2024-12-18T01:01:40.4038587Z  2024-12-18T01:01:40.4038995Z  2024-12-18T01:01:40.4039397Z  2024-12-18T01:01:40.4040507Z [19,276 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:40.4041538Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T01:01:40.4042322Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2024-12-18T01:01:40.4043195Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2024-12-18T01:01:40.4044702Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T01:01:40.4045696Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T01:01:40.4046646Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:01:40.4047658Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2024-12-18T01:01:40.4048596Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local ... 2024-12-18T01:01:40.6453302Z 2024-12-18T01:01:40.6454174Z  2024-12-18T01:01:40.6454655Z  2024-12-18T01:01:40.6455068Z  2024-12-18T01:01:40.6455504Z  2024-12-18T01:01:40.6455883Z  2024-12-18T01:01:40.6456275Z  2024-12-18T01:01:40.6456819Z  2024-12-18T01:01:40.6457203Z  2024-12-18T01:01:40.6458044Z [19,277 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:40.6459027Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T01:01:40.6459811Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2024-12-18T01:01:40.6460630Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2024-12-18T01:01:40.6461527Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T01:01:40.6462533Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T01:01:40.6463473Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:01:40.6464413Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2024-12-18T01:01:40.6465288Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local ... 2024-12-18T01:01:40.8675504Z 2024-12-18T01:01:40.8676383Z  2024-12-18T01:01:40.8676876Z  2024-12-18T01:01:40.8677295Z  2024-12-18T01:01:40.8677672Z  2024-12-18T01:01:40.8678048Z  2024-12-18T01:01:40.8678429Z  2024-12-18T01:01:40.8678844Z  2024-12-18T01:01:40.8679195Z  2024-12-18T01:01:40.8680130Z [19,277 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:40.8681124Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T01:01:40.8681903Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2024-12-18T01:01:40.8682663Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T01:01:40.8683641Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T01:01:40.8684840Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T01:01:40.8685853Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:01:40.8686778Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2024-12-18T01:01:40.8687624Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local ... 2024-12-18T01:01:41.0678465Z 2024-12-18T01:01:41.0679369Z  2024-12-18T01:01:41.0680196Z  2024-12-18T01:01:41.0680635Z  2024-12-18T01:01:41.0681017Z  2024-12-18T01:01:41.0681417Z  2024-12-18T01:01:41.0681826Z  2024-12-18T01:01:41.0682208Z  2024-12-18T01:01:41.0682589Z  2024-12-18T01:01:41.0683494Z [19,278 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:41.0684502Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T01:01:41.0685271Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2024-12-18T01:01:41.0686220Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T01:01:41.0687396Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2024-12-18T01:01:41.0688406Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2024-12-18T01:01:41.0689361Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:01:41.0690338Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2024-12-18T01:01:41.0691266Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local ... 2024-12-18T01:01:41.5523331Z 2024-12-18T01:01:41.5524461Z  2024-12-18T01:01:41.5524931Z  2024-12-18T01:01:41.5525288Z  2024-12-18T01:01:41.5525674Z  2024-12-18T01:01:41.5526046Z  2024-12-18T01:01:41.5526401Z  2024-12-18T01:01:41.5526725Z  2024-12-18T01:01:41.5527076Z  2024-12-18T01:01:41.5527943Z [19,279 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:41.5528874Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2024-12-18T01:01:41.5529595Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T01:01:41.5530424Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2024-12-18T01:01:41.5531420Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T01:01:41.5532472Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2024-12-18T01:01:41.5533470Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2024-12-18T01:01:41.5534408Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2024-12-18T01:01:41.5535304Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local ... 2024-12-18T01:01:41.8685190Z 2024-12-18T01:01:41.8686026Z  2024-12-18T01:01:41.8686412Z  2024-12-18T01:01:41.8686730Z  2024-12-18T01:01:41.8687069Z  2024-12-18T01:01:41.8687367Z  2024-12-18T01:01:41.8687673Z  2024-12-18T01:01:41.8687988Z  2024-12-18T01:01:41.8688334Z  2024-12-18T01:01:41.8689069Z [19,280 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:41.8689841Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2024-12-18T01:01:41.8690440Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T01:01:41.8691067Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T01:01:41.8691814Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T01:01:41.8692579Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2024-12-18T01:01:41.8693286Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2024-12-18T01:01:41.8694018Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2024-12-18T01:01:41.8694699Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local ... 2024-12-18T01:01:42.0690385Z 2024-12-18T01:01:42.0691190Z  2024-12-18T01:01:42.0691647Z  2024-12-18T01:01:42.0692308Z  2024-12-18T01:01:42.0692714Z  2024-12-18T01:01:42.0693109Z  2024-12-18T01:01:42.0693506Z  2024-12-18T01:01:42.0693917Z  2024-12-18T01:01:42.0694306Z  2024-12-18T01:01:42.0695239Z [19,283 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:42.0696295Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2024-12-18T01:01:42.0699537Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2024-12-18T01:01:42.0700396Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T01:01:42.0701410Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2024-12-18T01:01:42.0702439Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2024-12-18T01:01:42.0703445Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2024-12-18T01:01:42.0704437Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2024-12-18T01:01:42.0705347Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local ... 2024-12-18T01:01:42.4694490Z 2024-12-18T01:01:42.4695363Z  2024-12-18T01:01:42.4696092Z  2024-12-18T01:01:42.4696635Z  2024-12-18T01:01:42.4697007Z  2024-12-18T01:01:42.4697398Z  2024-12-18T01:01:42.4697801Z  2024-12-18T01:01:42.4698198Z  2024-12-18T01:01:42.4698602Z  2024-12-18T01:01:42.4699554Z [19,284 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:42.4700760Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2024-12-18T01:01:42.4701537Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T01:01:42.4702361Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2024-12-18T01:01:42.4703339Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T01:01:42.4704361Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2024-12-18T01:01:42.4705410Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2024-12-18T01:01:42.4706405Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2024-12-18T01:01:42.4707373Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local ... 2024-12-18T01:01:42.7457853Z 2024-12-18T01:01:42.7458778Z  2024-12-18T01:01:42.7459272Z  2024-12-18T01:01:42.7459696Z  2024-12-18T01:01:42.7460179Z  2024-12-18T01:01:42.7460590Z  2024-12-18T01:01:42.7461037Z  2024-12-18T01:01:42.7461437Z  2024-12-18T01:01:42.7461823Z  2024-12-18T01:01:42.7462707Z [19,285 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:42.7463717Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2024-12-18T01:01:42.7464505Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T01:01:42.7465338Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T01:01:42.7466240Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T01:01:42.7467125Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2024-12-18T01:01:42.7468151Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2024-12-18T01:01:42.7469091Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2024-12-18T01:01:42.7469978Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local ... 2024-12-18T01:01:43.0699470Z 2024-12-18T01:01:43.0700368Z  2024-12-18T01:01:43.0700866Z  2024-12-18T01:01:43.0701258Z  2024-12-18T01:01:43.0701682Z  2024-12-18T01:01:43.0702062Z  2024-12-18T01:01:43.0702454Z  2024-12-18T01:01:43.0702820Z  2024-12-18T01:01:43.0703205Z  2024-12-18T01:01:43.0704110Z [19,285 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:43.0705113Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2024-12-18T01:01:43.0706202Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2024-12-18T01:01:43.0707001Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T01:01:43.0707900Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2024-12-18T01:01:43.0708842Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2024-12-18T01:01:43.0709821Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2024-12-18T01:01:43.0710935Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2024-12-18T01:01:43.0711847Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local ... 2024-12-18T01:01:43.3204124Z 2024-12-18T01:01:43.3205577Z  2024-12-18T01:01:43.3206046Z  2024-12-18T01:01:43.3206455Z  2024-12-18T01:01:43.3206836Z  2024-12-18T01:01:43.3207229Z  2024-12-18T01:01:43.3207640Z  2024-12-18T01:01:43.3208040Z  2024-12-18T01:01:43.3208392Z  2024-12-18T01:01:43.3209320Z [19,286 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:43.3212789Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2024-12-18T01:01:43.3213808Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T01:01:43.3214639Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2024-12-18T01:01:43.3215609Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T01:01:43.3216725Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2024-12-18T01:01:43.3217882Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T01:01:43.3218841Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2024-12-18T01:01:43.3219745Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local ... 2024-12-18T01:01:43.6704479Z 2024-12-18T01:01:43.6705324Z  2024-12-18T01:01:43.6705724Z  2024-12-18T01:01:43.6706098Z  2024-12-18T01:01:43.6706486Z  2024-12-18T01:01:43.6706876Z  2024-12-18T01:01:43.6707269Z  2024-12-18T01:01:43.6707622Z  2024-12-18T01:01:43.6707972Z  2024-12-18T01:01:43.6708808Z [19,286 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:43.6709687Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2024-12-18T01:01:43.6710410Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T01:01:43.6711148Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T01:01:43.6712126Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T01:01:43.6713115Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2024-12-18T01:01:43.6713979Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T01:01:43.6714834Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2024-12-18T01:01:43.6715664Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local ... 2024-12-18T01:01:43.9080092Z 2024-12-18T01:01:43.9081079Z  2024-12-18T01:01:43.9081527Z  2024-12-18T01:01:43.9081933Z  2024-12-18T01:01:43.9082521Z  2024-12-18T01:01:43.9082917Z  2024-12-18T01:01:43.9083290Z  2024-12-18T01:01:43.9083705Z  2024-12-18T01:01:43.9084106Z  2024-12-18T01:01:43.9085062Z [19,287 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:43.9086108Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2024-12-18T01:01:43.9086857Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T01:01:43.9087666Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T01:01:43.9088561Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T01:01:43.9089575Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2024-12-18T01:01:43.9090542Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T01:01:43.9091779Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2024-12-18T01:01:43.9092665Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local ... 2024-12-18T01:01:44.1252062Z 2024-12-18T01:01:44.1252963Z  2024-12-18T01:01:44.1253449Z  2024-12-18T01:01:44.1253875Z  2024-12-18T01:01:44.1254402Z  2024-12-18T01:01:44.1254931Z  2024-12-18T01:01:44.1255454Z  2024-12-18T01:01:44.1256351Z  2024-12-18T01:01:44.1256950Z  2024-12-18T01:01:44.1258011Z [19,288 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:44.1258970Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T01:01:44.1259681Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2024-12-18T01:01:44.1260493Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T01:01:44.1261420Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2024-12-18T01:01:44.1262432Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2024-12-18T01:01:44.1263546Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T01:01:44.1264474Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2024-12-18T01:01:44.1265372Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local ... 2024-12-18T01:01:44.4714209Z 2024-12-18T01:01:44.4715115Z  2024-12-18T01:01:44.4715696Z  2024-12-18T01:01:44.4716089Z  2024-12-18T01:01:44.4716473Z  2024-12-18T01:01:44.4716851Z  2024-12-18T01:01:44.4717575Z  2024-12-18T01:01:44.4718045Z  2024-12-18T01:01:44.4718409Z  2024-12-18T01:01:44.4719285Z [19,288 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:44.4720226Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T01:01:44.4720934Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2024-12-18T01:01:44.4721719Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2024-12-18T01:01:44.4722703Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T01:01:44.4723637Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T01:01:44.4724503Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T01:01:44.4725478Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2024-12-18T01:01:44.4726419Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local ... 2024-12-18T01:01:44.8316410Z 2024-12-18T01:01:44.8317319Z  2024-12-18T01:01:44.8317754Z  2024-12-18T01:01:44.8318122Z  2024-12-18T01:01:44.8318497Z  2024-12-18T01:01:44.8318857Z  2024-12-18T01:01:44.8319179Z  2024-12-18T01:01:44.8319527Z  2024-12-18T01:01:44.8319869Z  2024-12-18T01:01:44.8320656Z [19,289 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:44.8321535Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T01:01:44.8322175Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2024-12-18T01:01:44.8322867Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T01:01:44.8323711Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T01:01:44.8324580Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T01:01:44.8325400Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T01:01:44.8326201Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2024-12-18T01:01:44.8326979Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local ... 2024-12-18T01:01:45.0332328Z 2024-12-18T01:01:45.0333193Z  2024-12-18T01:01:45.0333664Z  2024-12-18T01:01:45.0334061Z  2024-12-18T01:01:45.0334451Z  2024-12-18T01:01:45.0334816Z  2024-12-18T01:01:45.0335187Z  2024-12-18T01:01:45.0335552Z  2024-12-18T01:01:45.0336234Z  2024-12-18T01:01:45.0337298Z [19,291 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:45.0338254Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T01:01:45.0338986Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2024-12-18T01:01:45.0339777Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T01:01:45.0340918Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T01:01:45.0341931Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T01:01:45.0342838Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T01:01:45.0343769Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2024-12-18T01:01:45.0344917Z Compiling stablehlo/reference/Ops.cpp; 26s local ... 2024-12-18T01:01:45.2720037Z 2024-12-18T01:01:45.2720932Z  2024-12-18T01:01:45.2721403Z  2024-12-18T01:01:45.2721838Z  2024-12-18T01:01:45.2722249Z  2024-12-18T01:01:45.2722643Z  2024-12-18T01:01:45.2723037Z  2024-12-18T01:01:45.2723679Z  2024-12-18T01:01:45.2724087Z  2024-12-18T01:01:45.2725036Z [19,291 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:45.2726044Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T01:01:45.2726879Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T01:01:45.2727838Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T01:01:45.2728808Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2024-12-18T01:01:45.2729865Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T01:01:45.2730815Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2024-12-18T01:01:45.2731788Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:01:45.2732640Z Compiling stablehlo/reference/Ops.cpp; 26s local ... 2024-12-18T01:01:45.6239491Z 2024-12-18T01:01:45.6240369Z  2024-12-18T01:01:45.6240870Z  2024-12-18T01:01:45.6241279Z  2024-12-18T01:01:45.6241713Z  2024-12-18T01:01:45.6242064Z  2024-12-18T01:01:45.6242463Z  2024-12-18T01:01:45.6242888Z  2024-12-18T01:01:45.6243293Z  2024-12-18T01:01:45.6244658Z [19,293 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:45.6245695Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T01:01:45.6246464Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T01:01:45.6247293Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2024-12-18T01:01:45.6248226Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T01:01:45.6249248Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T01:01:45.6250268Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2024-12-18T01:01:45.6251248Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:01:45.6252125Z Compiling stablehlo/reference/Ops.cpp; 26s local ... 2024-12-18T01:01:45.8726971Z 2024-12-18T01:01:45.8727803Z  2024-12-18T01:01:45.8728237Z  2024-12-18T01:01:45.8728551Z  2024-12-18T01:01:45.8728884Z  2024-12-18T01:01:45.8729241Z  2024-12-18T01:01:45.8729566Z  2024-12-18T01:01:45.8729873Z  2024-12-18T01:01:45.8730194Z  2024-12-18T01:01:45.8730962Z [19,293 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:45.8731780Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T01:01:45.8732433Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T01:01:45.8733128Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T01:01:45.8734036Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T01:01:45.8735099Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T01:01:45.8736000Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2024-12-18T01:01:45.8736944Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:01:45.8737758Z Compiling stablehlo/reference/Ops.cpp; 26s local ... 2024-12-18T01:01:46.0730017Z 2024-12-18T01:01:46.0730930Z  2024-12-18T01:01:46.0731417Z  2024-12-18T01:01:46.0731816Z  2024-12-18T01:01:46.0732274Z  2024-12-18T01:01:46.0732675Z  2024-12-18T01:01:46.0733059Z  2024-12-18T01:01:46.0733459Z  2024-12-18T01:01:46.0733855Z  2024-12-18T01:01:46.0734783Z [19,294 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:46.0735858Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T01:01:46.0736810Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2024-12-18T01:01:46.0737694Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T01:01:46.0738960Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2024-12-18T01:01:46.0740006Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T01:01:46.0740975Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2024-12-18T01:01:46.0741955Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:01:46.0743119Z Compiling stablehlo/reference/Ops.cpp; 27s local ... 2024-12-18T01:01:46.4736005Z 2024-12-18T01:01:46.4736953Z  2024-12-18T01:01:46.4737395Z  2024-12-18T01:01:46.4737750Z  2024-12-18T01:01:46.4738128Z  2024-12-18T01:01:46.4738484Z  2024-12-18T01:01:46.4738830Z  2024-12-18T01:01:46.4739168Z  2024-12-18T01:01:46.4739508Z  2024-12-18T01:01:46.4740379Z [19,296 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:46.4741309Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2024-12-18T01:01:46.4742026Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T01:01:46.4742775Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2024-12-18T01:01:46.4743629Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T01:01:46.4744750Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T01:01:46.4745630Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2024-12-18T01:01:46.4746510Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T01:01:46.4747295Z Compiling stablehlo/reference/Ops.cpp; 27s local ... 2024-12-18T01:01:46.8466857Z 2024-12-18T01:01:46.8467757Z  2024-12-18T01:01:46.8468244Z  2024-12-18T01:01:46.8468653Z  2024-12-18T01:01:46.8469034Z  2024-12-18T01:01:46.8469451Z  2024-12-18T01:01:46.8469872Z  2024-12-18T01:01:46.8470237Z  2024-12-18T01:01:46.8470640Z  2024-12-18T01:01:46.8471587Z [19,297 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:46.8472591Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2024-12-18T01:01:46.8473364Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T01:01:46.8474212Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T01:01:46.8475176Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T01:01:46.8476180Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T01:01:46.8477150Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2024-12-18T01:01:46.8478097Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T01:01:46.8478958Z Compiling stablehlo/reference/Ops.cpp; 27s local ... 2024-12-18T01:01:47.0741598Z 2024-12-18T01:01:47.0742727Z  2024-12-18T01:01:47.0743227Z  2024-12-18T01:01:47.0743723Z  2024-12-18T01:01:47.0744467Z  2024-12-18T01:01:47.0744928Z  2024-12-18T01:01:47.0745294Z  2024-12-18T01:01:47.0745745Z  2024-12-18T01:01:47.0746224Z  2024-12-18T01:01:47.0747176Z [19,299 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:47.0748566Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2024-12-18T01:01:47.0749398Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2024-12-18T01:01:47.0750270Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2024-12-18T01:01:47.0751310Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2024-12-18T01:01:47.0752416Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T01:01:47.0753387Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2024-12-18T01:01:47.0754396Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T01:01:47.0755432Z Compiling stablehlo/reference/Ops.cpp; 28s local ... 2024-12-18T01:01:47.7345590Z 2024-12-18T01:01:47.7346467Z  2024-12-18T01:01:47.7346948Z  2024-12-18T01:01:47.7347345Z  2024-12-18T01:01:47.7347801Z  2024-12-18T01:01:47.7348183Z  2024-12-18T01:01:47.7348675Z  2024-12-18T01:01:47.7349067Z  2024-12-18T01:01:47.7349504Z  2024-12-18T01:01:47.7350660Z [19,300 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:47.7351760Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T01:01:47.7352762Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2024-12-18T01:01:47.7353808Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2024-12-18T01:01:47.7354900Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T01:01:47.7355859Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T01:01:47.7356799Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2024-12-18T01:01:47.7357760Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T01:01:47.7358620Z Compiling stablehlo/reference/Ops.cpp; 28s local ... 2024-12-18T01:01:48.0408989Z 2024-12-18T01:01:48.0409891Z  2024-12-18T01:01:48.0410369Z  2024-12-18T01:01:48.0410821Z  2024-12-18T01:01:48.0411214Z  2024-12-18T01:01:48.0411617Z  2024-12-18T01:01:48.0412008Z  2024-12-18T01:01:48.0412549Z  2024-12-18T01:01:48.0412910Z  2024-12-18T01:01:48.0413806Z [19,302 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:48.0414797Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T01:01:48.0415578Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2024-12-18T01:01:48.0416517Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2024-12-18T01:01:48.0417499Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T01:01:48.0418519Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T01:01:48.0419486Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2024-12-18T01:01:48.0420417Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T01:01:48.0421290Z Compiling stablehlo/reference/Ops.cpp; 29s local ... 2024-12-18T01:01:48.2751567Z 2024-12-18T01:01:48.2752815Z  2024-12-18T01:01:48.2753276Z  2024-12-18T01:01:48.2753722Z  2024-12-18T01:01:48.2754121Z  2024-12-18T01:01:48.2754488Z  2024-12-18T01:01:48.2754816Z  2024-12-18T01:01:48.2755137Z  2024-12-18T01:01:48.2755494Z  2024-12-18T01:01:48.2756425Z [19,302 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:48.2757448Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T01:01:48.2758448Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2024-12-18T01:01:48.2759258Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2024-12-18T01:01:48.2760259Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2024-12-18T01:01:48.2761298Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T01:01:48.2762419Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T01:01:48.2763374Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T01:01:48.2764271Z Compiling stablehlo/reference/Ops.cpp; 29s local ... 2024-12-18T01:01:48.6759355Z 2024-12-18T01:01:48.6760260Z  2024-12-18T01:01:48.6760748Z  2024-12-18T01:01:48.6761158Z  2024-12-18T01:01:48.6761575Z  2024-12-18T01:01:48.6761921Z  2024-12-18T01:01:48.6762309Z  2024-12-18T01:01:48.6762695Z  2024-12-18T01:01:48.6763088Z  2024-12-18T01:01:48.6764033Z [19,303 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:48.6765304Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T01:01:48.6766133Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2024-12-18T01:01:48.6766957Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T01:01:48.6767957Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T01:01:48.6768918Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T01:01:48.6770012Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T01:01:48.6770973Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T01:01:48.6771884Z Compiling stablehlo/reference/Ops.cpp; 29s local ... 2024-12-18T01:01:48.9360292Z 2024-12-18T01:01:48.9361131Z  2024-12-18T01:01:48.9361547Z  2024-12-18T01:01:48.9361921Z  2024-12-18T01:01:48.9362293Z  2024-12-18T01:01:48.9362642Z  2024-12-18T01:01:48.9363011Z  2024-12-18T01:01:48.9363355Z  2024-12-18T01:01:48.9363706Z  2024-12-18T01:01:48.9364493Z [19,305 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:48.9365393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T01:01:48.9366086Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2024-12-18T01:01:48.9366803Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T01:01:48.9367665Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T01:01:48.9368559Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T01:01:48.9369373Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T01:01:48.9370205Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T01:01:48.9370949Z Compiling stablehlo/reference/Ops.cpp; 30s local ... 2024-12-18T01:01:49.1820409Z 2024-12-18T01:01:49.1821333Z  2024-12-18T01:01:49.1821813Z  2024-12-18T01:01:49.1822367Z  2024-12-18T01:01:49.1822798Z  2024-12-18T01:01:49.1823194Z  2024-12-18T01:01:49.1823585Z  2024-12-18T01:01:49.1823963Z  2024-12-18T01:01:49.1824368Z  2024-12-18T01:01:49.1825244Z [19,307 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:49.1826261Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T01:01:49.1827054Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2024-12-18T01:01:49.1827897Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T01:01:49.1828878Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2024-12-18T01:01:49.1829897Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T01:01:49.1830858Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T01:01:49.1832098Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T01:01:49.1832972Z Compiling stablehlo/reference/Ops.cpp; 30s local ... 2024-12-18T01:01:49.4768664Z 2024-12-18T01:01:49.4770146Z  2024-12-18T01:01:49.4770636Z  2024-12-18T01:01:49.4771003Z  2024-12-18T01:01:49.4771389Z  2024-12-18T01:01:49.4771773Z  2024-12-18T01:01:49.4772511Z  2024-12-18T01:01:49.4772908Z  2024-12-18T01:01:49.4773239Z  2024-12-18T01:01:49.4774132Z [19,307 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:49.4775213Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T01:01:49.4776039Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T01:01:49.4776963Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2024-12-18T01:01:49.4777906Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T01:01:49.4778914Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2024-12-18T01:01:49.4780156Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T01:01:49.4781162Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T01:01:49.4782040Z Compiling stablehlo/reference/Ops.cpp; 30s local ... 2024-12-18T01:01:49.7497372Z 2024-12-18T01:01:49.7498762Z  2024-12-18T01:01:49.7499258Z  2024-12-18T01:01:49.7499676Z  2024-12-18T01:01:49.7500071Z  2024-12-18T01:01:49.7500445Z  2024-12-18T01:01:49.7501061Z  2024-12-18T01:01:49.7501479Z  2024-12-18T01:01:49.7501868Z  2024-12-18T01:01:49.7502778Z [19,309 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:49.7503744Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T01:01:49.7504507Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T01:01:49.7505337Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T01:01:49.7506345Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T01:01:49.7507381Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2024-12-18T01:01:49.7508351Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T01:01:49.7509227Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T01:01:49.7510205Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local ... 2024-12-18T01:01:50.0773647Z 2024-12-18T01:01:50.0774986Z  2024-12-18T01:01:50.0775506Z  2024-12-18T01:01:50.0775899Z  2024-12-18T01:01:50.0776560Z  2024-12-18T01:01:50.0776935Z  2024-12-18T01:01:50.0777327Z  2024-12-18T01:01:50.0777700Z  2024-12-18T01:01:50.0778089Z  2024-12-18T01:01:50.0779008Z [19,309 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:50.0780025Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T01:01:50.0780813Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2024-12-18T01:01:50.0781634Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2024-12-18T01:01:50.0782589Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2024-12-18T01:01:50.0783584Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2024-12-18T01:01:50.0784528Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T01:01:50.0785574Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T01:01:50.0786608Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2024-12-18T01:01:50.7732476Z 2024-12-18T01:01:50.7733919Z  2024-12-18T01:01:50.7734394Z  2024-12-18T01:01:50.7734795Z  2024-12-18T01:01:50.7735181Z  2024-12-18T01:01:50.7735603Z  2024-12-18T01:01:50.7736005Z  2024-12-18T01:01:50.7736881Z  2024-12-18T01:01:50.7737284Z  2024-12-18T01:01:50.7738260Z [19,310 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:50.7739269Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2024-12-18T01:01:50.7740063Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T01:01:50.7740885Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T01:01:50.7742001Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T01:01:50.7742990Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2024-12-18T01:01:50.7743974Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T01:01:50.7745202Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2024-12-18T01:01:50.7746359Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2024-12-18T01:01:51.0782426Z 2024-12-18T01:01:51.0783770Z  2024-12-18T01:01:51.0784349Z  2024-12-18T01:01:51.0784760Z  2024-12-18T01:01:51.0785173Z  2024-12-18T01:01:51.0785858Z  2024-12-18T01:01:51.0786270Z  2024-12-18T01:01:51.0786674Z  2024-12-18T01:01:51.0787088Z  2024-12-18T01:01:51.0788037Z [19,311 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:51.0789079Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2024-12-18T01:01:51.0789891Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2024-12-18T01:01:51.0790863Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T01:01:51.0791829Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2024-12-18T01:01:51.0792831Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2024-12-18T01:01:51.0793798Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T01:01:51.0794775Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2024-12-18T01:01:51.0795791Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local ... 2024-12-18T01:01:51.3750799Z 2024-12-18T01:01:51.3752404Z  2024-12-18T01:01:51.3752828Z  2024-12-18T01:01:51.3753161Z  2024-12-18T01:01:51.3753467Z  2024-12-18T01:01:51.3753796Z  2024-12-18T01:01:51.3754117Z  2024-12-18T01:01:51.3754433Z  2024-12-18T01:01:51.3754757Z  2024-12-18T01:01:51.3755520Z [19,312 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:51.3756344Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T01:01:51.3756979Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2024-12-18T01:01:51.3757657Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2024-12-18T01:01:51.3758432Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T01:01:51.3759220Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T01:01:51.3760003Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T01:01:51.3760801Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2024-12-18T01:01:51.3761611Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local ... 2024-12-18T01:01:51.6791219Z 2024-12-18T01:01:51.6792681Z  2024-12-18T01:01:51.6793227Z  2024-12-18T01:01:51.6793656Z  2024-12-18T01:01:51.6794067Z  2024-12-18T01:01:51.6794466Z  2024-12-18T01:01:51.6794886Z  2024-12-18T01:01:51.6795283Z  2024-12-18T01:01:51.6795678Z  2024-12-18T01:01:51.6796637Z [19,312 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:51.6797620Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T01:01:51.6798398Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2024-12-18T01:01:51.6799213Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T01:01:51.6800459Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T01:01:51.6801519Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T01:01:51.6802498Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T01:01:51.6803503Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2024-12-18T01:01:51.6804682Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local ... 2024-12-18T01:01:52.0795223Z 2024-12-18T01:01:52.0796520Z  2024-12-18T01:01:52.0796989Z  2024-12-18T01:01:52.0797338Z  2024-12-18T01:01:52.0797682Z  2024-12-18T01:01:52.0798025Z  2024-12-18T01:01:52.0798352Z  2024-12-18T01:01:52.0798704Z  2024-12-18T01:01:52.0799056Z  2024-12-18T01:01:52.0799859Z [19,313 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:52.0800719Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T01:01:52.0801391Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2024-12-18T01:01:52.0802369Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T01:01:52.0803174Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2024-12-18T01:01:52.0804186Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T01:01:52.0804984Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T01:01:52.0805889Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2024-12-18T01:01:52.0806682Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local ... 2024-12-18T01:01:52.3227773Z 2024-12-18T01:01:52.3228634Z  2024-12-18T01:01:52.3229045Z  2024-12-18T01:01:52.3229429Z  2024-12-18T01:01:52.3229792Z  2024-12-18T01:01:52.3230155Z  2024-12-18T01:01:52.3230567Z  2024-12-18T01:01:52.3230935Z  2024-12-18T01:01:52.3231357Z  2024-12-18T01:01:52.3232271Z [19,314 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:52.3233191Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2024-12-18T01:01:52.3233989Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2024-12-18T01:01:52.3234753Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2024-12-18T01:01:52.3235628Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:01:52.3236555Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T01:01:52.3237495Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T01:01:52.3238381Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2024-12-18T01:01:52.3239287Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2024-12-18T01:01:52.6803235Z 2024-12-18T01:01:52.6804181Z  2024-12-18T01:01:52.6804686Z  2024-12-18T01:01:52.6806595Z  2024-12-18T01:01:52.6807021Z  2024-12-18T01:01:52.6808817Z  2024-12-18T01:01:52.6809203Z  2024-12-18T01:01:52.6811010Z  2024-12-18T01:01:52.6811433Z  2024-12-18T01:01:52.6812347Z [19,314 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:52.6813418Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2024-12-18T01:01:52.6814189Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2024-12-18T01:01:52.6814932Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T01:01:52.6815804Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:01:52.6816875Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T01:01:52.6817819Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T01:01:52.6818756Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2024-12-18T01:01:52.6819962Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2024-12-18T01:01:52.9867855Z 2024-12-18T01:01:52.9869401Z  2024-12-18T01:01:52.9869967Z  2024-12-18T01:01:52.9870365Z  2024-12-18T01:01:52.9870746Z  2024-12-18T01:01:52.9871105Z  2024-12-18T01:01:52.9871458Z  2024-12-18T01:01:52.9871812Z  2024-12-18T01:01:52.9872191Z  2024-12-18T01:01:52.9873398Z [19,316 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:52.9874396Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2024-12-18T01:01:52.9875183Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2024-12-18T01:01:52.9875988Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T01:01:52.9876853Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:01:52.9877796Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T01:01:52.9878742Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T01:01:52.9879874Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2024-12-18T01:01:52.9880848Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2024-12-18T01:01:53.2807750Z 2024-12-18T01:01:53.2808911Z  2024-12-18T01:01:53.2809422Z  2024-12-18T01:01:53.2809842Z  2024-12-18T01:01:53.2810323Z  2024-12-18T01:01:53.2810759Z  2024-12-18T01:01:53.2811201Z  2024-12-18T01:01:53.2811624Z  2024-12-18T01:01:53.2812062Z  2024-12-18T01:01:53.2813443Z [19,316 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:53.2814573Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2024-12-18T01:01:53.2815358Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2024-12-18T01:01:53.2816106Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T01:01:53.2817151Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:01:53.2818059Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T01:01:53.2818901Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T01:01:53.2819747Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2024-12-18T01:01:53.2820630Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2024-12-18T01:01:53.4815144Z 2024-12-18T01:01:53.4816055Z  2024-12-18T01:01:53.4816630Z  2024-12-18T01:01:53.4816981Z  2024-12-18T01:01:53.4817360Z  2024-12-18T01:01:53.4817708Z  2024-12-18T01:01:53.4818031Z  2024-12-18T01:01:53.4818365Z  2024-12-18T01:01:53.4818704Z  2024-12-18T01:01:53.4819525Z [19,317 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:53.4820395Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2024-12-18T01:01:53.4821054Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2024-12-18T01:01:53.4821759Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2024-12-18T01:01:53.4822534Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T01:01:53.4823334Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T01:01:53.4824180Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T01:01:53.4825070Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2024-12-18T01:01:53.4826001Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2024-12-18T01:01:53.8818981Z 2024-12-18T01:01:53.8820305Z  2024-12-18T01:01:53.8820805Z  2024-12-18T01:01:53.8821206Z  2024-12-18T01:01:53.8821616Z  2024-12-18T01:01:53.8822013Z  2024-12-18T01:01:53.8832828Z  2024-12-18T01:01:53.8833243Z  2024-12-18T01:01:53.8833618Z  2024-12-18T01:01:53.8834510Z [19,318 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:53.8835797Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2024-12-18T01:01:53.8836575Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2024-12-18T01:01:53.8837382Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T01:01:53.8838299Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T01:01:53.8839446Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T01:01:53.8840444Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T01:01:53.8841429Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T01:01:53.8842390Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2024-12-18T01:01:54.2823046Z 2024-12-18T01:01:54.2823900Z  2024-12-18T01:01:54.2824312Z  2024-12-18T01:01:54.2824623Z  2024-12-18T01:01:54.2824954Z  2024-12-18T01:01:54.2825340Z  2024-12-18T01:01:54.2825699Z  2024-12-18T01:01:54.2826058Z  2024-12-18T01:01:54.2826391Z  2024-12-18T01:01:54.2827377Z [19,319 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:54.2828314Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T01:01:54.2829042Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T01:01:54.2829693Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2024-12-18T01:01:54.2830538Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T01:01:54.2831386Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2024-12-18T01:01:54.2832176Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T01:01:54.2833040Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T01:01:54.2833947Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local ... 2024-12-18T01:01:54.6826830Z 2024-12-18T01:01:54.6827730Z  2024-12-18T01:01:54.6828196Z  2024-12-18T01:01:54.6828593Z  2024-12-18T01:01:54.6829052Z  2024-12-18T01:01:54.6829466Z  2024-12-18T01:01:54.6829871Z  2024-12-18T01:01:54.6830282Z  2024-12-18T01:01:54.6830695Z  2024-12-18T01:01:54.6831699Z [19,320 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:54.6832793Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T01:01:54.6833626Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2024-12-18T01:01:54.6834436Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T01:01:54.6835346Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T01:01:54.6836342Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2024-12-18T01:01:54.6837369Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T01:01:54.6838395Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T01:01:54.6839367Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local ... 2024-12-18T01:01:55.6088744Z 2024-12-18T01:01:55.6089676Z  2024-12-18T01:01:55.6090303Z  2024-12-18T01:01:55.6090739Z  2024-12-18T01:01:55.6091145Z  2024-12-18T01:01:55.6091533Z  2024-12-18T01:01:55.6091939Z  2024-12-18T01:01:55.6092334Z  2024-12-18T01:01:55.6092743Z  2024-12-18T01:01:55.6093657Z [19,321 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:55.6094650Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T01:01:55.6095438Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T01:01:55.6096263Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2024-12-18T01:01:55.6097321Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T01:01:55.6098558Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T01:01:55.6099545Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T01:01:55.6100495Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T01:01:55.6101468Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local ... 2024-12-18T01:01:55.8837256Z 2024-12-18T01:01:55.8838415Z  2024-12-18T01:01:55.8838914Z  2024-12-18T01:01:55.8839321Z  2024-12-18T01:01:55.8839701Z  2024-12-18T01:01:55.8840120Z  2024-12-18T01:01:55.8840504Z  2024-12-18T01:01:55.8840858Z  2024-12-18T01:01:55.8841236Z  2024-12-18T01:01:55.8842185Z [19,321 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:55.8843216Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T01:01:55.8844017Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T01:01:55.8845079Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T01:01:55.8846206Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T01:01:55.8847148Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T01:01:55.8848130Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T01:01:55.8848977Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T01:01:55.8849881Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local ... 2024-12-18T01:01:56.0841181Z 2024-12-18T01:01:56.0842057Z  2024-12-18T01:01:56.0842563Z  2024-12-18T01:01:56.0842937Z  2024-12-18T01:01:56.0843313Z  2024-12-18T01:01:56.0843687Z  2024-12-18T01:01:56.0844081Z  2024-12-18T01:01:56.0844727Z  2024-12-18T01:01:56.0845090Z  2024-12-18T01:01:56.0845973Z [19,322 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:56.0847020Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T01:01:56.0847841Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2024-12-18T01:01:56.0848618Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T01:01:56.0849479Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T01:01:56.0850502Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T01:01:56.0851481Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T01:01:56.0852437Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T01:01:56.0853447Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local ... 2024-12-18T01:01:56.6059345Z 2024-12-18T01:01:56.6060204Z  2024-12-18T01:01:56.6060673Z  2024-12-18T01:01:56.6061063Z  2024-12-18T01:01:56.6061507Z  2024-12-18T01:01:56.6061882Z  2024-12-18T01:01:56.6062271Z  2024-12-18T01:01:56.6062701Z  2024-12-18T01:01:56.6063087Z  2024-12-18T01:01:56.6064000Z [19,323 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:56.6064973Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2024-12-18T01:01:56.6065790Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2024-12-18T01:01:56.6066608Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2024-12-18T01:01:56.6067574Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T01:01:56.6068500Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T01:01:56.6069408Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T01:01:56.6070341Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T01:01:56.6071297Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local ... 2024-12-18T01:01:56.8851122Z 2024-12-18T01:01:56.8854734Z  2024-12-18T01:01:56.8855495Z  2024-12-18T01:01:56.8857347Z  2024-12-18T01:01:56.8860206Z  2024-12-18T01:01:56.8862137Z  2024-12-18T01:01:56.8862568Z  2024-12-18T01:01:56.8864301Z  2024-12-18T01:01:56.8866403Z  2024-12-18T01:01:56.8869112Z [19,324 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:56.8870389Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2024-12-18T01:01:56.8871142Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2024-12-18T01:01:56.8872019Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2024-12-18T01:01:56.8872931Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T01:01:56.8873927Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T01:01:56.8874877Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T01:01:56.8875950Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T01:01:56.8876917Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local ... 2024-12-18T01:01:57.1227555Z 2024-12-18T01:01:57.1229812Z  2024-12-18T01:01:57.1231351Z  2024-12-18T01:01:57.1232771Z  2024-12-18T01:01:57.1234177Z  2024-12-18T01:01:57.1235587Z  2024-12-18T01:01:57.1236770Z  2024-12-18T01:01:57.1237239Z  2024-12-18T01:01:57.1237685Z  2024-12-18T01:01:57.1238637Z [19,327 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:57.1239900Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T01:01:57.1240730Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2024-12-18T01:01:57.1241596Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2024-12-18T01:01:57.1242542Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T01:01:57.1243569Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T01:01:57.1244956Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T01:01:57.1245973Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T01:01:57.1247017Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local ... 2024-12-18T01:01:57.3297727Z 2024-12-18T01:01:57.3298985Z  2024-12-18T01:01:57.3299429Z  2024-12-18T01:01:57.3299824Z  2024-12-18T01:01:57.3300194Z  2024-12-18T01:01:57.3300531Z  2024-12-18T01:01:57.3300898Z  2024-12-18T01:01:57.3301278Z  2024-12-18T01:01:57.3301642Z  2024-12-18T01:01:57.3302476Z [19,328 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:57.3303369Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T01:01:57.3304077Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T01:01:57.3304829Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2024-12-18T01:01:57.3305650Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2024-12-18T01:01:57.3306545Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T01:01:57.3307350Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T01:01:57.3308208Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T01:01:57.3309258Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local ... 2024-12-18T01:01:57.6858584Z 2024-12-18T01:01:57.6859850Z  2024-12-18T01:01:57.6860334Z  2024-12-18T01:01:57.6860663Z  2024-12-18T01:01:57.6861036Z  2024-12-18T01:01:57.6861434Z  2024-12-18T01:01:57.6861816Z  2024-12-18T01:01:57.6862193Z  2024-12-18T01:01:57.6862574Z  2024-12-18T01:01:57.6863471Z [19,328 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:57.6864437Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T01:01:57.6865499Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T01:01:57.6866333Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T01:01:57.6867214Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2024-12-18T01:01:57.6868172Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T01:01:57.6869321Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T01:01:57.6870263Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T01:01:57.6871250Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local ... 2024-12-18T01:01:58.0862558Z 2024-12-18T01:01:58.0863863Z  2024-12-18T01:01:58.0864325Z  2024-12-18T01:01:58.0864718Z  2024-12-18T01:01:58.0865116Z  2024-12-18T01:01:58.0865485Z  2024-12-18T01:01:58.0865885Z  2024-12-18T01:01:58.0866295Z  2024-12-18T01:01:58.0866692Z  2024-12-18T01:01:58.0867601Z [19,330 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:58.0870711Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T01:01:58.0871549Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2024-12-18T01:01:58.0872344Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T01:01:58.0873066Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2024-12-18T01:01:58.0874162Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T01:01:58.0875047Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T01:01:58.0875912Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2024-12-18T01:01:58.0876922Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local ... 2024-12-18T01:01:58.5767375Z 2024-12-18T01:01:58.5768757Z  2024-12-18T01:01:58.5769373Z  2024-12-18T01:01:58.5769826Z  2024-12-18T01:01:58.5770226Z  2024-12-18T01:01:58.5770645Z  2024-12-18T01:01:58.5771039Z  2024-12-18T01:01:58.5771463Z  2024-12-18T01:01:58.5771884Z  2024-12-18T01:01:58.5772753Z [19,331 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:58.5773505Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T01:01:58.5774243Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T01:01:58.5775094Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2024-12-18T01:01:58.5776051Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2024-12-18T01:01:58.5777088Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T01:01:58.5777832Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2024-12-18T01:01:58.5778690Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2024-12-18T01:01:58.5779649Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local ... 2024-12-18T01:01:58.8034657Z 2024-12-18T01:01:58.8035517Z  2024-12-18T01:01:58.8036087Z  2024-12-18T01:01:58.8036427Z  2024-12-18T01:01:58.8036757Z  2024-12-18T01:01:58.8037068Z  2024-12-18T01:01:58.8037400Z  2024-12-18T01:01:58.8037732Z  2024-12-18T01:01:58.8038062Z  2024-12-18T01:01:58.8038847Z [19,332 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:58.8039661Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T01:01:58.8040301Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T01:01:58.8040967Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:01:58.8041704Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2024-12-18T01:01:58.8042481Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T01:01:58.8043223Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2024-12-18T01:01:58.8044668Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2024-12-18T01:01:58.8045467Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local ... 2024-12-18T01:01:59.0872362Z 2024-12-18T01:01:59.0873838Z  2024-12-18T01:01:59.0874799Z  2024-12-18T01:01:59.0875927Z  2024-12-18T01:01:59.0876412Z  2024-12-18T01:01:59.0877120Z  2024-12-18T01:01:59.0877492Z  2024-12-18T01:01:59.0877892Z  2024-12-18T01:01:59.0878295Z  2024-12-18T01:01:59.0879269Z [19,333 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:59.0880366Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T01:01:59.0881220Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2024-12-18T01:01:59.0882134Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:01:59.0883140Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2024-12-18T01:01:59.0884196Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T01:01:59.0885464Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2024-12-18T01:01:59.0886530Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2024-12-18T01:01:59.0887622Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local ... 2024-12-18T01:01:59.6394467Z 2024-12-18T01:01:59.6395323Z  2024-12-18T01:01:59.6395763Z  2024-12-18T01:01:59.6396110Z  2024-12-18T01:01:59.6396698Z  2024-12-18T01:01:59.6397078Z  2024-12-18T01:01:59.6397440Z  2024-12-18T01:01:59.6397790Z  2024-12-18T01:01:59.6398158Z  2024-12-18T01:01:59.6399001Z [19,334 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:01:59.6399909Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2024-12-18T01:01:59.6400610Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T01:01:59.6401376Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2024-12-18T01:01:59.6402202Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T01:01:59.6403121Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2024-12-18T01:01:59.6404198Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T01:01:59.6405136Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2024-12-18T01:01:59.6406029Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local ... 2024-12-18T01:01:59.8882261Z 2024-12-18T01:01:59.8883100Z  2024-12-18T01:01:59.8883736Z  2024-12-18T01:01:59.8884130Z  2024-12-18T01:01:59.8884615Z  2024-12-18T01:01:59.8885043Z  2024-12-18T01:01:59.8885932Z  2024-12-18T01:01:59.8886992Z  2024-12-18T01:01:59.8887408Z  2024-12-18T01:01:59.8888266Z [19,334 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:01:59.8889198Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2024-12-18T01:01:59.8889898Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T01:01:59.8890630Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T01:01:59.8891445Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T01:01:59.8892295Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2024-12-18T01:01:59.8893303Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T01:01:59.8894178Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T01:01:59.8895078Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local ... 2024-12-18T01:02:00.1346124Z 2024-12-18T01:02:00.1347046Z  2024-12-18T01:02:00.1347477Z  2024-12-18T01:02:00.1347836Z  2024-12-18T01:02:00.1348197Z  2024-12-18T01:02:00.1348944Z  2024-12-18T01:02:00.1349403Z  2024-12-18T01:02:00.1349872Z  2024-12-18T01:02:00.1350328Z  2024-12-18T01:02:00.1351319Z [19,336 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:00.1352361Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2024-12-18T01:02:00.1353157Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2024-12-18T01:02:00.1354139Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T01:02:00.1355052Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T01:02:00.1356008Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2024-12-18T01:02:00.1356910Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T01:02:00.1357807Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T01:02:00.1358780Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local ... 2024-12-18T01:02:00.4892304Z 2024-12-18T01:02:00.4893189Z  2024-12-18T01:02:00.4893584Z  2024-12-18T01:02:00.4893931Z  2024-12-18T01:02:00.4894528Z  2024-12-18T01:02:00.4894891Z  2024-12-18T01:02:00.4895212Z  2024-12-18T01:02:00.4895559Z  2024-12-18T01:02:00.4895894Z  2024-12-18T01:02:00.4897114Z [19,338 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:00.4898083Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2024-12-18T01:02:00.4898992Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2024-12-18T01:02:00.4899774Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2024-12-18T01:02:00.4900599Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T01:02:00.4901515Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T01:02:00.4902409Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T01:02:00.4903283Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T01:02:00.4904205Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local ... 2024-12-18T01:02:01.1010931Z 2024-12-18T01:02:01.1011884Z  2024-12-18T01:02:01.1012363Z  2024-12-18T01:02:01.1012769Z  2024-12-18T01:02:01.1013160Z  2024-12-18T01:02:01.1013522Z  2024-12-18T01:02:01.1013889Z  2024-12-18T01:02:01.1014426Z  2024-12-18T01:02:01.1014804Z  2024-12-18T01:02:01.1015737Z [19,339 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:01.1017272Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2024-12-18T01:02:01.1017984Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2024-12-18T01:02:01.1018753Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2024-12-18T01:02:01.1019607Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T01:02:01.1020780Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T01:02:01.1021859Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T01:02:01.1022896Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T01:02:01.1023995Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local ... 2024-12-18T01:02:01.4903801Z 2024-12-18T01:02:01.4904703Z  2024-12-18T01:02:01.4907105Z  2024-12-18T01:02:01.4910449Z  2024-12-18T01:02:01.4913579Z  2024-12-18T01:02:01.4916569Z  2024-12-18T01:02:01.4919555Z  2024-12-18T01:02:01.4922600Z  2024-12-18T01:02:01.4925705Z  2024-12-18T01:02:01.4929188Z [19,339 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:01.4932614Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2024-12-18T01:02:01.4935983Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T01:02:01.4939989Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2024-12-18T01:02:01.4943313Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T01:02:01.4947052Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T01:02:01.4950575Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T01:02:01.4953913Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T01:02:01.4957631Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local ... 2024-12-18T01:02:01.8906328Z 2024-12-18T01:02:01.8909967Z  2024-12-18T01:02:01.8913044Z  2024-12-18T01:02:01.8915917Z  2024-12-18T01:02:01.8918845Z  2024-12-18T01:02:01.8919711Z  2024-12-18T01:02:01.8920792Z  2024-12-18T01:02:01.8921281Z  2024-12-18T01:02:01.8921716Z  2024-12-18T01:02:01.8922606Z [19,341 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:01.8923618Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2024-12-18T01:02:01.8924641Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T01:02:01.8925380Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T01:02:01.8926292Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T01:02:01.8927257Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T01:02:01.8928281Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T01:02:01.8929500Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T01:02:01.8930577Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local ... 2024-12-18T01:02:02.1630531Z 2024-12-18T01:02:02.1631972Z  2024-12-18T01:02:02.1632442Z  2024-12-18T01:02:02.1632787Z  2024-12-18T01:02:02.1633186Z  2024-12-18T01:02:02.1633545Z  2024-12-18T01:02:02.1633927Z  2024-12-18T01:02:02.1634378Z  2024-12-18T01:02:02.1634751Z  2024-12-18T01:02:02.1635599Z [19,342 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:02.1636548Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 137s local 2024-12-18T01:02:02.1637276Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2024-12-18T01:02:02.1638058Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T01:02:02.1638897Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T01:02:02.1639808Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2024-12-18T01:02:02.1640702Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T01:02:02.1641637Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T01:02:02.1642606Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local ... 2024-12-18T01:02:02.4913632Z 2024-12-18T01:02:02.4914891Z  2024-12-18T01:02:02.4915411Z  2024-12-18T01:02:02.4915827Z  2024-12-18T01:02:02.4916243Z  2024-12-18T01:02:02.4916633Z  2024-12-18T01:02:02.4917066Z  2024-12-18T01:02:02.4917454Z  2024-12-18T01:02:02.4917828Z  2024-12-18T01:02:02.4918753Z [19,342 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:02.4919862Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 137s local 2024-12-18T01:02:02.4920632Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2024-12-18T01:02:02.4921406Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2024-12-18T01:02:02.4922266Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2024-12-18T01:02:02.4923210Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2024-12-18T01:02:02.4924158Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T01:02:02.4925055Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T01:02:02.4926261Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local ... 2024-12-18T01:02:02.8730796Z 2024-12-18T01:02:02.8732216Z  2024-12-18T01:02:02.8732703Z  2024-12-18T01:02:02.8733111Z  2024-12-18T01:02:02.8733494Z  2024-12-18T01:02:02.8733892Z  2024-12-18T01:02:02.8734263Z  2024-12-18T01:02:02.8734603Z  2024-12-18T01:02:02.8735247Z  2024-12-18T01:02:02.8736106Z [19,344 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:02.8737222Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2024-12-18T01:02:02.8738033Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2024-12-18T01:02:02.8738921Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2024-12-18T01:02:02.8739877Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2024-12-18T01:02:02.8740746Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T01:02:02.8741626Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T01:02:02.8742727Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2024-12-18T01:02:02.8743646Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local ... 2024-12-18T01:02:03.0918441Z 2024-12-18T01:02:03.0919314Z  2024-12-18T01:02:03.0919783Z  2024-12-18T01:02:03.0920205Z  2024-12-18T01:02:03.0920591Z  2024-12-18T01:02:03.0920975Z  2024-12-18T01:02:03.0921349Z  2024-12-18T01:02:03.0921997Z  2024-12-18T01:02:03.0922426Z  2024-12-18T01:02:03.0923325Z [19,345 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:03.0924347Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2024-12-18T01:02:03.0925148Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2024-12-18T01:02:03.0926050Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2024-12-18T01:02:03.0927025Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2024-12-18T01:02:03.0927984Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T01:02:03.0929331Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T01:02:03.0930377Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T01:02:03.0931460Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local ... 2024-12-18T01:02:03.4926285Z 2024-12-18T01:02:03.4927164Z  2024-12-18T01:02:03.4927735Z  2024-12-18T01:02:03.4928197Z  2024-12-18T01:02:03.4928670Z  2024-12-18T01:02:03.4929136Z  2024-12-18T01:02:03.4929602Z  2024-12-18T01:02:03.4930063Z  2024-12-18T01:02:03.4930507Z  2024-12-18T01:02:03.4931634Z [19,346 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:03.4932947Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2024-12-18T01:02:03.4933912Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2024-12-18T01:02:03.4934973Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2024-12-18T01:02:03.4936055Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T01:02:03.4937319Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2024-12-18T01:02:03.4938414Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T01:02:03.4939524Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T01:02:03.4940657Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local ... 2024-12-18T01:02:04.4046825Z 2024-12-18T01:02:04.4047736Z  2024-12-18T01:02:04.4048221Z  2024-12-18T01:02:04.4049351Z  2024-12-18T01:02:04.4049758Z  2024-12-18T01:02:04.4050132Z  2024-12-18T01:02:04.4050528Z  2024-12-18T01:02:04.4050912Z  2024-12-18T01:02:04.4051606Z  2024-12-18T01:02:04.4052529Z [19,347 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:04.4053473Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T01:02:04.4054264Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2024-12-18T01:02:04.4055180Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T01:02:04.4056333Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T01:02:04.4057470Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T01:02:04.4058432Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2024-12-18T01:02:04.4059435Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T01:02:04.4060424Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local ... 2024-12-18T01:02:04.6938287Z 2024-12-18T01:02:04.6939169Z  2024-12-18T01:02:04.6939657Z  2024-12-18T01:02:04.6940070Z  2024-12-18T01:02:04.6940463Z  2024-12-18T01:02:04.6940851Z  2024-12-18T01:02:04.6941551Z  2024-12-18T01:02:04.6942309Z  2024-12-18T01:02:04.6942854Z  2024-12-18T01:02:04.6944036Z [19,347 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:04.6945424Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T01:02:04.6946446Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T01:02:04.6947692Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T01:02:04.6948797Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T01:02:04.6949933Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T01:02:04.6951068Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2024-12-18T01:02:04.6952195Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T01:02:04.6953410Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local ... 2024-12-18T01:02:04.8941809Z 2024-12-18T01:02:04.8942756Z  2024-12-18T01:02:04.8945166Z  2024-12-18T01:02:04.8945563Z  2024-12-18T01:02:04.8945896Z  2024-12-18T01:02:04.8946216Z  2024-12-18T01:02:04.8946563Z  2024-12-18T01:02:04.8946899Z  2024-12-18T01:02:04.8947237Z  2024-12-18T01:02:04.8948064Z [19,349 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:04.8948933Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2024-12-18T01:02:04.8949650Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T01:02:04.8950431Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T01:02:04.8951253Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T01:02:04.8952482Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T01:02:04.8953310Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2024-12-18T01:02:04.8954301Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2024-12-18T01:02:04.8955219Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local ... 2024-12-18T01:02:05.2945044Z 2024-12-18T01:02:05.2945927Z  2024-12-18T01:02:05.2946467Z  2024-12-18T01:02:05.2946873Z  2024-12-18T01:02:05.2947312Z  2024-12-18T01:02:05.2947677Z  2024-12-18T01:02:05.2948078Z  2024-12-18T01:02:05.2948478Z  2024-12-18T01:02:05.2948930Z  2024-12-18T01:02:05.2949880Z [19,350 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:05.2951379Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T01:02:05.2952355Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2024-12-18T01:02:05.2953405Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T01:02:05.2954984Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T01:02:05.2956106Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T01:02:05.2957213Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T01:02:05.2958313Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T01:02:05.2959390Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local ... 2024-12-18T01:02:05.6949008Z 2024-12-18T01:02:05.6949894Z  2024-12-18T01:02:05.6950356Z  2024-12-18T01:02:05.6950760Z  2024-12-18T01:02:05.6951145Z  2024-12-18T01:02:05.6951530Z  2024-12-18T01:02:05.6951922Z  2024-12-18T01:02:05.6952293Z  2024-12-18T01:02:05.6952678Z  2024-12-18T01:02:05.6953618Z [19,352 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:05.6954604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2024-12-18T01:02:05.6955444Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2024-12-18T01:02:05.6956586Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T01:02:05.6957528Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T01:02:05.6958475Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T01:02:05.6959404Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T01:02:05.6960353Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2024-12-18T01:02:05.6961432Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local ... 2024-12-18T01:02:06.6959926Z 2024-12-18T01:02:06.6960776Z  2024-12-18T01:02:06.6961230Z  2024-12-18T01:02:06.6961632Z  2024-12-18T01:02:06.6962042Z  2024-12-18T01:02:06.6962450Z  2024-12-18T01:02:06.6962830Z  2024-12-18T01:02:06.6963191Z  2024-12-18T01:02:06.6963572Z  2024-12-18T01:02:06.6964524Z [19,352 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:06.6965531Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2024-12-18T01:02:06.6966331Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T01:02:06.6967239Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2024-12-18T01:02:06.6968227Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T01:02:06.6969209Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2024-12-18T01:02:06.6970703Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T01:02:06.6971736Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T01:02:06.6972782Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local ... 2024-12-18T01:02:07.0089300Z 2024-12-18T01:02:07.0090499Z  2024-12-18T01:02:07.0091050Z  2024-12-18T01:02:07.0091543Z  2024-12-18T01:02:07.0093254Z  2024-12-18T01:02:07.0093720Z  2024-12-18T01:02:07.0095175Z  2024-12-18T01:02:07.0095636Z  2024-12-18T01:02:07.0097176Z  2024-12-18T01:02:07.0098119Z [19,353 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:07.0099058Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2024-12-18T01:02:07.0099765Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T01:02:07.0100575Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2024-12-18T01:02:07.0101412Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T01:02:07.0102229Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T01:02:07.0103038Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T01:02:07.0103835Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2024-12-18T01:02:07.0104646Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local ... 2024-12-18T01:02:07.2965557Z 2024-12-18T01:02:07.2966498Z  2024-12-18T01:02:07.2967037Z  2024-12-18T01:02:07.2967406Z  2024-12-18T01:02:07.2967776Z  2024-12-18T01:02:07.2968143Z  2024-12-18T01:02:07.2968522Z  2024-12-18T01:02:07.2968907Z  2024-12-18T01:02:07.2969295Z  2024-12-18T01:02:07.2970204Z [19,353 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:07.2971494Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T01:02:07.2972325Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T01:02:07.2973253Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T01:02:07.2974229Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T01:02:07.2975183Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T01:02:07.2976104Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T01:02:07.2977337Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T01:02:07.2978339Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local ... 2024-12-18T01:02:07.5791228Z 2024-12-18T01:02:07.5792138Z  2024-12-18T01:02:07.5792653Z  2024-12-18T01:02:07.5794183Z  2024-12-18T01:02:07.5794680Z  2024-12-18T01:02:07.5795071Z  2024-12-18T01:02:07.5795471Z  2024-12-18T01:02:07.5795873Z  2024-12-18T01:02:07.5796288Z  2024-12-18T01:02:07.5797458Z [19,354 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:07.5798444Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T01:02:07.5799295Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2024-12-18T01:02:07.5800338Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T01:02:07.5801350Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T01:02:07.5802344Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T01:02:07.5803254Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T01:02:07.5804144Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T01:02:07.5805128Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local ... 2024-12-18T01:02:07.8973739Z 2024-12-18T01:02:07.8974621Z  2024-12-18T01:02:07.8975074Z  2024-12-18T01:02:07.8975442Z  2024-12-18T01:02:07.8975761Z  2024-12-18T01:02:07.8976064Z  2024-12-18T01:02:07.8976551Z  2024-12-18T01:02:07.8976911Z  2024-12-18T01:02:07.8977300Z  2024-12-18T01:02:07.8978064Z [19,354 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:07.8978930Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2024-12-18T01:02:07.8979708Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T01:02:07.8980470Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T01:02:07.8981295Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T01:02:07.8982126Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:02:07.8982897Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T01:02:07.8983774Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2024-12-18T01:02:07.8984659Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local ... 2024-12-18T01:02:08.2977269Z 2024-12-18T01:02:08.2978451Z  2024-12-18T01:02:08.2980093Z  2024-12-18T01:02:08.2981570Z  2024-12-18T01:02:08.2982982Z  2024-12-18T01:02:08.2984484Z  2024-12-18T01:02:08.2985985Z  2024-12-18T01:02:08.2987479Z  2024-12-18T01:02:08.2988988Z  2024-12-18T01:02:08.2991111Z [19,355 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:08.2992776Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T01:02:08.2994036Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T01:02:08.2995206Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:02:08.2996400Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T01:02:08.2997773Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:02:08.2998980Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T01:02:08.3000151Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T01:02:08.3001389Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2024-12-18T01:02:08.4981295Z 2024-12-18T01:02:08.4982538Z  2024-12-18T01:02:08.4982982Z  2024-12-18T01:02:08.4983384Z  2024-12-18T01:02:08.4983885Z  2024-12-18T01:02:08.4984264Z  2024-12-18T01:02:08.4984644Z  2024-12-18T01:02:08.4985028Z  2024-12-18T01:02:08.4985668Z  2024-12-18T01:02:08.4986665Z [19,356 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:08.4987844Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T01:02:08.4988714Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2024-12-18T01:02:08.4989679Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:02:08.4990829Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T01:02:08.4991837Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:02:08.4992837Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T01:02:08.4993816Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T01:02:08.4994828Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2024-12-18T01:02:08.8139940Z 2024-12-18T01:02:08.8140834Z  2024-12-18T01:02:08.8141339Z  2024-12-18T01:02:08.8141790Z  2024-12-18T01:02:08.8142204Z  2024-12-18T01:02:08.8142719Z  2024-12-18T01:02:08.8143110Z  2024-12-18T01:02:08.8143486Z  2024-12-18T01:02:08.8143875Z  2024-12-18T01:02:08.8145064Z [19,358 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:08.8146037Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T01:02:08.8146878Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T01:02:08.8147809Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:02:08.8148798Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T01:02:08.8149764Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:02:08.8150663Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T01:02:08.8151604Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T01:02:08.8152548Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2024-12-18T01:02:09.0205391Z 2024-12-18T01:02:09.0206253Z  2024-12-18T01:02:09.0206708Z  2024-12-18T01:02:09.0207233Z  2024-12-18T01:02:09.0207603Z  2024-12-18T01:02:09.0208042Z  2024-12-18T01:02:09.0208427Z  2024-12-18T01:02:09.0208829Z  2024-12-18T01:02:09.0209243Z  2024-12-18T01:02:09.0210188Z [19,359 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:09.0211273Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2024-12-18T01:02:09.0212083Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T01:02:09.0213000Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:02:09.0213970Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T01:02:09.0215237Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2024-12-18T01:02:09.0216801Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T01:02:09.0217776Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2024-12-18T01:02:09.0218891Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2024-12-18T01:02:09.2988391Z 2024-12-18T01:02:09.2989407Z  2024-12-18T01:02:09.2989964Z  2024-12-18T01:02:09.2991511Z  2024-12-18T01:02:09.2992031Z  2024-12-18T01:02:09.2992506Z  2024-12-18T01:02:09.2994303Z  2024-12-18T01:02:09.2994774Z  2024-12-18T01:02:09.2996263Z  2024-12-18T01:02:09.2997311Z [19,359 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:09.2998467Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2024-12-18T01:02:09.2999404Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T01:02:09.3000893Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T01:02:09.3001987Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T01:02:09.3003063Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2024-12-18T01:02:09.3004108Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T01:02:09.3005028Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2024-12-18T01:02:09.3006065Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local ... 2024-12-18T01:02:09.5116381Z 2024-12-18T01:02:09.5117392Z  2024-12-18T01:02:09.5117951Z  2024-12-18T01:02:09.5118437Z  2024-12-18T01:02:09.5120192Z  2024-12-18T01:02:09.5120646Z  2024-12-18T01:02:09.5121032Z  2024-12-18T01:02:09.5121378Z  2024-12-18T01:02:09.5121824Z  2024-12-18T01:02:09.5122720Z [19,360 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:09.5123725Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2024-12-18T01:02:09.5124540Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2024-12-18T01:02:09.5125418Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T01:02:09.5126322Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T01:02:09.5127244Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2024-12-18T01:02:09.5128260Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T01:02:09.5129087Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2024-12-18T01:02:09.5130026Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local ... 2024-12-18T01:02:09.8994106Z 2024-12-18T01:02:09.8995031Z  2024-12-18T01:02:09.8995488Z  2024-12-18T01:02:09.8995871Z  2024-12-18T01:02:09.8996272Z  2024-12-18T01:02:09.8996696Z  2024-12-18T01:02:09.8997061Z  2024-12-18T01:02:09.8997459Z  2024-12-18T01:02:09.8997859Z  2024-12-18T01:02:09.8998815Z [19,362 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:09.8999815Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2024-12-18T01:02:09.9000708Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2024-12-18T01:02:09.9001617Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T01:02:09.9002619Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T01:02:09.9003513Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2024-12-18T01:02:09.9004379Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T01:02:09.9005129Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2024-12-18T01:02:09.9006036Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local ... 2024-12-18T01:02:10.8108280Z 2024-12-18T01:02:10.8109152Z  2024-12-18T01:02:10.8109605Z  2024-12-18T01:02:10.8111132Z  2024-12-18T01:02:10.8111545Z  2024-12-18T01:02:10.8111930Z  2024-12-18T01:02:10.8112280Z  2024-12-18T01:02:10.8112620Z  2024-12-18T01:02:10.8112986Z  2024-12-18T01:02:10.8113840Z [19,363 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:10.8115107Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2024-12-18T01:02:10.8115883Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T01:02:10.8116697Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2024-12-18T01:02:10.8117552Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T01:02:10.8118570Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2024-12-18T01:02:10.8119562Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2024-12-18T01:02:10.8120449Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2024-12-18T01:02:10.8121466Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local ... 2024-12-18T01:02:11.1008139Z 2024-12-18T01:02:11.1009175Z  2024-12-18T01:02:11.1009731Z  2024-12-18T01:02:11.1010239Z  2024-12-18T01:02:11.1011000Z  2024-12-18T01:02:11.1022813Z  2024-12-18T01:02:11.1023604Z  2024-12-18T01:02:11.1023997Z  2024-12-18T01:02:11.1024433Z  2024-12-18T01:02:11.1025588Z [19,364 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:02:11.1026617Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2024-12-18T01:02:11.1027414Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T01:02:11.1028336Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2024-12-18T01:02:11.1029198Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T01:02:11.1030142Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T01:02:11.1031067Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T01:02:11.1031988Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T01:02:11.1032916Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local ... 2024-12-18T01:02:11.3011224Z 2024-12-18T01:02:11.3013987Z  2024-12-18T01:02:11.3014518Z  2024-12-18T01:02:11.3014941Z  2024-12-18T01:02:11.3015378Z  2024-12-18T01:02:11.3017339Z  2024-12-18T01:02:11.3017826Z  2024-12-18T01:02:11.3019246Z  2024-12-18T01:02:11.3019700Z  2024-12-18T01:02:11.3021866Z [19,364 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:11.3023136Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2024-12-18T01:02:11.3024040Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2024-12-18T01:02:11.3025045Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T01:02:11.3026118Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T01:02:11.3027151Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T01:02:11.3028195Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T01:02:11.3029099Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T01:02:11.3030053Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local ... 2024-12-18T01:02:11.7016781Z 2024-12-18T01:02:11.7017719Z  2024-12-18T01:02:11.7018216Z  2024-12-18T01:02:11.7018554Z  2024-12-18T01:02:11.7018921Z  2024-12-18T01:02:11.7019316Z  2024-12-18T01:02:11.7019674Z  2024-12-18T01:02:11.7020042Z  2024-12-18T01:02:11.7020393Z  2024-12-18T01:02:11.7021369Z [19,366 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:11.7022642Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T01:02:11.7023494Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T01:02:11.7024492Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T01:02:11.7025935Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T01:02:11.7027079Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T01:02:11.7028187Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2024-12-18T01:02:11.7029294Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T01:02:11.7030434Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local ... 2024-12-18T01:02:12.1165759Z 2024-12-18T01:02:12.1166624Z  2024-12-18T01:02:12.1167151Z  2024-12-18T01:02:12.1167559Z  2024-12-18T01:02:12.1167964Z  2024-12-18T01:02:12.1168374Z  2024-12-18T01:02:12.1168751Z  2024-12-18T01:02:12.1169138Z  2024-12-18T01:02:12.1169516Z  2024-12-18T01:02:12.1170687Z [19,367 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:12.1171894Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T01:02:12.1172799Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T01:02:12.1173786Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T01:02:12.1174876Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T01:02:12.1175847Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:02:12.1176967Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:02:12.1177850Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T01:02:12.1178655Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local ... 2024-12-18T01:02:12.5025592Z 2024-12-18T01:02:12.5026567Z  2024-12-18T01:02:12.5027129Z  2024-12-18T01:02:12.5027648Z  2024-12-18T01:02:12.5029681Z  2024-12-18T01:02:12.5030162Z  2024-12-18T01:02:12.5030630Z  2024-12-18T01:02:12.5032516Z  2024-12-18T01:02:12.5032987Z  2024-12-18T01:02:12.5035137Z [19,367 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:12.5036320Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2024-12-18T01:02:12.5037362Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T01:02:12.5038451Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T01:02:12.5039518Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T01:02:12.5040588Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:02:12.5041655Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:02:12.5042489Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2024-12-18T01:02:12.5043418Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local ... 2024-12-18T01:02:12.7029526Z 2024-12-18T01:02:12.7030554Z  2024-12-18T01:02:12.7031126Z  2024-12-18T01:02:12.7031622Z  2024-12-18T01:02:12.7033505Z  2024-12-18T01:02:12.7034008Z  2024-12-18T01:02:12.7034477Z  2024-12-18T01:02:12.7036394Z  2024-12-18T01:02:12.7036893Z  2024-12-18T01:02:12.7039061Z [19,368 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:12.7040356Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T01:02:12.7041346Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T01:02:12.7042411Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T01:02:12.7043445Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T01:02:12.7044942Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:02:12.7045945Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:02:12.7046803Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2024-12-18T01:02:12.7047636Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local ... 2024-12-18T01:02:12.9539523Z 2024-12-18T01:02:12.9540520Z  2024-12-18T01:02:12.9541089Z  2024-12-18T01:02:12.9541755Z  2024-12-18T01:02:12.9543489Z  2024-12-18T01:02:12.9544049Z  2024-12-18T01:02:12.9544682Z  2024-12-18T01:02:12.9545125Z  2024-12-18T01:02:12.9545486Z  2024-12-18T01:02:12.9546301Z [19,370 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:12.9547229Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T01:02:12.9548062Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T01:02:12.9549187Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T01:02:12.9550060Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T01:02:12.9550879Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:02:12.9551707Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2024-12-18T01:02:12.9552530Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2024-12-18T01:02:12.9553606Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local ... 2024-12-18T01:02:13.3033913Z 2024-12-18T01:02:13.3034766Z  2024-12-18T01:02:13.3035133Z  2024-12-18T01:02:13.3035472Z  2024-12-18T01:02:13.3035866Z  2024-12-18T01:02:13.3036259Z  2024-12-18T01:02:13.3036618Z  2024-12-18T01:02:13.3036986Z  2024-12-18T01:02:13.3037356Z  2024-12-18T01:02:13.3038270Z [19,370 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:13.3039308Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T01:02:13.3040168Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T01:02:13.3041092Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T01:02:13.3042003Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T01:02:13.3042926Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T01:02:13.3043919Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T01:02:13.3045219Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T01:02:13.3046318Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local ... 2024-12-18T01:02:13.5768306Z 2024-12-18T01:02:13.5769219Z  2024-12-18T01:02:13.5769711Z  2024-12-18T01:02:13.5770115Z  2024-12-18T01:02:13.5770555Z  2024-12-18T01:02:13.5770946Z  2024-12-18T01:02:13.5771353Z  2024-12-18T01:02:13.5771763Z  2024-12-18T01:02:13.5772178Z  2024-12-18T01:02:13.5773093Z [19,371 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:13.5774108Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2024-12-18T01:02:13.5774994Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T01:02:13.5775973Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T01:02:13.5777027Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T01:02:13.5777900Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T01:02:13.5778805Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T01:02:13.5779724Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T01:02:13.5780577Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local ... 2024-12-18T01:02:13.7971324Z 2024-12-18T01:02:13.7972249Z  2024-12-18T01:02:13.7972988Z  2024-12-18T01:02:13.7973322Z  2024-12-18T01:02:13.7973656Z  2024-12-18T01:02:13.7974046Z  2024-12-18T01:02:13.7974440Z  2024-12-18T01:02:13.7974790Z  2024-12-18T01:02:13.7975181Z  2024-12-18T01:02:13.7976177Z [19,372 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:13.7977774Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T01:02:13.7978733Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T01:02:13.7979731Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T01:02:13.7980753Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T01:02:13.7981784Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T01:02:13.7982743Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2024-12-18T01:02:13.7983883Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T01:02:13.7984891Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local ... 2024-12-18T01:02:14.1040720Z 2024-12-18T01:02:14.1041661Z  2024-12-18T01:02:14.1042407Z  2024-12-18T01:02:14.1042978Z  2024-12-18T01:02:14.1043582Z  2024-12-18T01:02:14.1044100Z  2024-12-18T01:02:14.1044945Z  2024-12-18T01:02:14.1046443Z  2024-12-18T01:02:14.1048025Z  2024-12-18T01:02:14.1049584Z [19,372 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:14.1050707Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T01:02:14.1051681Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T01:02:14.1052579Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T01:02:14.1053547Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T01:02:14.1054516Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T01:02:14.1055423Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T01:02:14.1056540Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T01:02:14.1057612Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local ... 2024-12-18T01:02:14.4582728Z 2024-12-18T01:02:14.4583758Z  2024-12-18T01:02:14.4584207Z  2024-12-18T01:02:14.4584752Z  2024-12-18T01:02:14.4585198Z  2024-12-18T01:02:14.4585655Z  2024-12-18T01:02:14.4586107Z  2024-12-18T01:02:14.4586490Z  2024-12-18T01:02:14.4586858Z  2024-12-18T01:02:14.4587839Z [19,375 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:14.4588923Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2024-12-18T01:02:14.4589863Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2024-12-18T01:02:14.4590873Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T01:02:14.4591878Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T01:02:14.4592884Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T01:02:14.4593874Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T01:02:14.4594709Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2024-12-18T01:02:14.4595542Z Compiling xla/service/spmd/dot_handler.cc; 25s local ... 2024-12-18T01:02:14.7048423Z 2024-12-18T01:02:14.7049314Z  2024-12-18T01:02:14.7049794Z  2024-12-18T01:02:14.7050243Z  2024-12-18T01:02:14.7050719Z  2024-12-18T01:02:14.7051161Z  2024-12-18T01:02:14.7051558Z  2024-12-18T01:02:14.7051969Z  2024-12-18T01:02:14.7052388Z  2024-12-18T01:02:14.7053845Z [19,375 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:14.7054896Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T01:02:14.7055832Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2024-12-18T01:02:14.7056946Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T01:02:14.7058112Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T01:02:14.7059092Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2024-12-18T01:02:14.7060058Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T01:02:14.7060939Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2024-12-18T01:02:14.7061831Z Compiling xla/service/spmd/dot_handler.cc; 25s local ... 2024-12-18T01:02:15.2131698Z 2024-12-18T01:02:15.2132616Z  2024-12-18T01:02:15.2133063Z  2024-12-18T01:02:15.2133442Z  2024-12-18T01:02:15.2133864Z  2024-12-18T01:02:15.2134225Z  2024-12-18T01:02:15.2134581Z  2024-12-18T01:02:15.2134936Z  2024-12-18T01:02:15.2135542Z  2024-12-18T01:02:15.2136565Z [19,376 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:15.2137500Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T01:02:15.2138305Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2024-12-18T01:02:15.2139281Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T01:02:15.2140130Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T01:02:15.2140962Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T01:02:15.2141758Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T01:02:15.2142479Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T01:02:15.2143191Z Compiling xla/service/spmd/dot_handler.cc; 26s local ... 2024-12-18T01:02:15.5058281Z 2024-12-18T01:02:15.5059231Z  2024-12-18T01:02:15.5059782Z  2024-12-18T01:02:15.5060202Z  2024-12-18T01:02:15.5060566Z  2024-12-18T01:02:15.5060947Z  2024-12-18T01:02:15.5061330Z  2024-12-18T01:02:15.5061709Z  2024-12-18T01:02:15.5062095Z  2024-12-18T01:02:15.5062986Z [19,377 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:15.5064023Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2024-12-18T01:02:15.5064922Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2024-12-18T01:02:15.5065860Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T01:02:15.5066791Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T01:02:15.5067715Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T01:02:15.5068629Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T01:02:15.5069502Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T01:02:15.5070330Z Compiling xla/service/spmd/dot_handler.cc; 26s local ... 2024-12-18T01:02:15.7378821Z 2024-12-18T01:02:15.7379750Z  2024-12-18T01:02:15.7380231Z  2024-12-18T01:02:15.7380656Z  2024-12-18T01:02:15.7381030Z  2024-12-18T01:02:15.7381410Z  2024-12-18T01:02:15.7381782Z  2024-12-18T01:02:15.7382194Z  2024-12-18T01:02:15.7382564Z  2024-12-18T01:02:15.7383483Z [19,379 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:15.7384500Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:02:15.7385391Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T01:02:15.7386335Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T01:02:15.7387305Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T01:02:15.7388588Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T01:02:15.7389453Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T01:02:15.7390276Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T01:02:15.7391178Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local ... 2024-12-18T01:02:16.0479200Z 2024-12-18T01:02:16.0480104Z  2024-12-18T01:02:16.0480605Z  2024-12-18T01:02:16.0481019Z  2024-12-18T01:02:16.0481483Z  2024-12-18T01:02:16.0481896Z  2024-12-18T01:02:16.0482311Z  2024-12-18T01:02:16.0482726Z  2024-12-18T01:02:16.0483147Z  2024-12-18T01:02:16.0484049Z [19,381 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:16.0485023Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:02:16.0486003Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:02:16.0487027Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T01:02:16.0488302Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2024-12-18T01:02:16.0489315Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T01:02:16.0490249Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:16.0491034Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T01:02:16.0492110Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local ... 2024-12-18T01:02:16.3064557Z 2024-12-18T01:02:16.3065419Z  2024-12-18T01:02:16.3065978Z  2024-12-18T01:02:16.3066379Z  2024-12-18T01:02:16.3066780Z  2024-12-18T01:02:16.3067179Z  2024-12-18T01:02:16.3067604Z  2024-12-18T01:02:16.3068033Z  2024-12-18T01:02:16.3068428Z  2024-12-18T01:02:16.3069364Z [19,382 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:16.3070494Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:02:16.3071478Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:02:16.3072492Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T01:02:16.3073528Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T01:02:16.3074547Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T01:02:16.3075479Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:16.3076289Z Compiling xla/service/spmd/dot_handler.cc; 27s local 2024-12-18T01:02:16.3077085Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local ... 2024-12-18T01:02:16.5068886Z 2024-12-18T01:02:16.5070403Z  2024-12-18T01:02:16.5070924Z  2024-12-18T01:02:16.5071341Z  2024-12-18T01:02:16.5071754Z  2024-12-18T01:02:16.5072153Z  2024-12-18T01:02:16.5072591Z  2024-12-18T01:02:16.5073004Z  2024-12-18T01:02:16.5073410Z  2024-12-18T01:02:16.5074393Z [19,383 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:16.5075466Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2024-12-18T01:02:16.5076419Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:02:16.5077447Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T01:02:16.5078448Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T01:02:16.5079444Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T01:02:16.5080351Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:16.5081278Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2024-12-18T01:02:16.5082181Z Compiling stablehlo/reference/Ops.cpp; 26s local ... 2024-12-18T01:02:16.8374945Z 2024-12-18T01:02:16.8377344Z  2024-12-18T01:02:16.8377823Z  2024-12-18T01:02:16.8378207Z  2024-12-18T01:02:16.8379871Z  2024-12-18T01:02:16.8380291Z  2024-12-18T01:02:16.8381990Z  2024-12-18T01:02:16.8382391Z  2024-12-18T01:02:16.8384166Z  2024-12-18T01:02:16.8385720Z [19,384 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:16.8386991Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T01:02:16.8387891Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:02:16.8388870Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T01:02:16.8389777Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2024-12-18T01:02:16.8390697Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T01:02:16.8391605Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:16.8392496Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2024-12-18T01:02:16.8393396Z Compiling stablehlo/reference/Ops.cpp; 27s local ... 2024-12-18T01:02:17.1074868Z 2024-12-18T01:02:17.1075903Z  2024-12-18T01:02:17.1077563Z  2024-12-18T01:02:17.1079009Z  2024-12-18T01:02:17.1080360Z  2024-12-18T01:02:17.1081735Z  2024-12-18T01:02:17.1083129Z  2024-12-18T01:02:17.1084555Z  2024-12-18T01:02:17.1085900Z  2024-12-18T01:02:17.1088089Z [19,385 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:17.1090229Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T01:02:17.1092151Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T01:02:17.1094056Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T01:02:17.1095947Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2024-12-18T01:02:17.1098098Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T01:02:17.1099994Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T01:02:17.1101942Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2024-12-18T01:02:17.1103835Z Compiling stablehlo/reference/Ops.cpp; 27s local ... 2024-12-18T01:02:17.4565710Z 2024-12-18T01:02:17.4567702Z  2024-12-18T01:02:17.4569356Z  2024-12-18T01:02:17.4570438Z  2024-12-18T01:02:17.4570829Z  2024-12-18T01:02:17.4571166Z  2024-12-18T01:02:17.4571504Z  2024-12-18T01:02:17.4571836Z  2024-12-18T01:02:17.4572166Z  2024-12-18T01:02:17.4572963Z [19,386 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:17.4573816Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2024-12-18T01:02:17.4574701Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T01:02:17.4575458Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T01:02:17.4576257Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2024-12-18T01:02:17.4577283Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T01:02:17.4577992Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T01:02:17.4578708Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2024-12-18T01:02:17.4579409Z Compiling stablehlo/reference/Ops.cpp; 27s local ... 2024-12-18T01:02:17.7080397Z 2024-12-18T01:02:17.7081625Z  2024-12-18T01:02:17.7082157Z  2024-12-18T01:02:17.7082571Z  2024-12-18T01:02:17.7082964Z  2024-12-18T01:02:17.7083348Z  2024-12-18T01:02:17.7083744Z  2024-12-18T01:02:17.7084121Z  2024-12-18T01:02:17.7084488Z  2024-12-18T01:02:17.7085391Z [19,387 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:17.7086442Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2024-12-18T01:02:17.7087770Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T01:02:17.7088766Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T01:02:17.7089676Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2024-12-18T01:02:17.7090638Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T01:02:17.7091728Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T01:02:17.7092625Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T01:02:17.7093514Z Compiling stablehlo/reference/Ops.cpp; 27s local ... 2024-12-18T01:02:18.1085416Z 2024-12-18T01:02:18.1086691Z  2024-12-18T01:02:18.1087161Z  2024-12-18T01:02:18.1087551Z  2024-12-18T01:02:18.1087932Z  2024-12-18T01:02:18.1088338Z  2024-12-18T01:02:18.1088745Z  2024-12-18T01:02:18.1089143Z  2024-12-18T01:02:18.1089540Z  2024-12-18T01:02:18.1090489Z [19,388 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:18.1091757Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2024-12-18T01:02:18.1092669Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T01:02:18.1093603Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T01:02:18.1094556Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2024-12-18T01:02:18.1095587Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T01:02:18.1096641Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2024-12-18T01:02:18.1097479Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T01:02:18.1098355Z Compiling stablehlo/reference/Ops.cpp; 28s local ... 2024-12-18T01:02:19.1095632Z 2024-12-18T01:02:19.1097651Z  2024-12-18T01:02:19.1098133Z  2024-12-18T01:02:19.1098529Z  2024-12-18T01:02:19.1100501Z  2024-12-18T01:02:19.1100902Z  2024-12-18T01:02:19.1102624Z  2024-12-18T01:02:19.1103042Z  2024-12-18T01:02:19.1104791Z  2024-12-18T01:02:19.1105742Z [19,388 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:19.1106790Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T01:02:19.1107727Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2024-12-18T01:02:19.1108670Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T01:02:19.1109642Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T01:02:19.1110555Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2024-12-18T01:02:19.1111412Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T01:02:19.1112271Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T01:02:19.1113056Z Compiling stablehlo/reference/Ops.cpp; 29s local ... 2024-12-18T01:02:19.5102580Z 2024-12-18T01:02:19.5105536Z  2024-12-18T01:02:19.5106068Z  2024-12-18T01:02:19.5106479Z  2024-12-18T01:02:19.5107746Z  2024-12-18T01:02:19.5108548Z  2024-12-18T01:02:19.5109352Z  2024-12-18T01:02:19.5109834Z  2024-12-18T01:02:19.5110241Z  2024-12-18T01:02:19.5111151Z [19,389 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:19.5112247Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2024-12-18T01:02:19.5113213Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2024-12-18T01:02:19.5114187Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T01:02:19.5115203Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T01:02:19.5116186Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T01:02:19.5117054Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T01:02:19.5120399Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T01:02:19.5121311Z Compiling stablehlo/reference/Ops.cpp; 29s local ... 2024-12-18T01:02:19.9107855Z 2024-12-18T01:02:19.9109071Z  2024-12-18T01:02:19.9109573Z  2024-12-18T01:02:19.9109987Z  2024-12-18T01:02:19.9110376Z  2024-12-18T01:02:19.9111234Z  2024-12-18T01:02:19.9111629Z  2024-12-18T01:02:19.9112035Z  2024-12-18T01:02:19.9112443Z  2024-12-18T01:02:19.9113323Z [19,390 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:19.9114386Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T01:02:19.9115324Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T01:02:19.9116221Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T01:02:19.9117186Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2024-12-18T01:02:19.9118183Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T01:02:19.9119286Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T01:02:19.9120181Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T01:02:19.9120878Z Compiling stablehlo/reference/Ops.cpp; 30s local ... 2024-12-18T01:02:20.1110895Z 2024-12-18T01:02:20.1111843Z  2024-12-18T01:02:20.1112267Z  2024-12-18T01:02:20.1112618Z  2024-12-18T01:02:20.1113178Z  2024-12-18T01:02:20.1113800Z  2024-12-18T01:02:20.1114282Z  2024-12-18T01:02:20.1114775Z  2024-12-18T01:02:20.1115256Z  2024-12-18T01:02:20.1116239Z [19,393 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:20.1117299Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T01:02:20.1118214Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T01:02:20.1119163Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T01:02:20.1120146Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T01:02:20.1121108Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T01:02:20.1121997Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T01:02:20.1122896Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T01:02:20.1123724Z Compiling stablehlo/reference/Ops.cpp; 30s local ... 2024-12-18T01:02:20.5113132Z 2024-12-18T01:02:20.5114286Z  2024-12-18T01:02:20.5114710Z  2024-12-18T01:02:20.5115068Z  2024-12-18T01:02:20.5115691Z  2024-12-18T01:02:20.5116235Z  2024-12-18T01:02:20.5116712Z  2024-12-18T01:02:20.5117195Z  2024-12-18T01:02:20.5117663Z  2024-12-18T01:02:20.5118695Z [19,396 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:20.5119883Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2024-12-18T01:02:20.5120866Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T01:02:20.5121831Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T01:02:20.5123009Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T01:02:20.5124083Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T01:02:20.5125101Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T01:02:20.5126080Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T01:02:20.5127125Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local ... 2024-12-18T01:02:20.7414187Z 2024-12-18T01:02:20.7416243Z  2024-12-18T01:02:20.7418067Z  2024-12-18T01:02:20.7419466Z  2024-12-18T01:02:20.7420869Z  2024-12-18T01:02:20.7422266Z  2024-12-18T01:02:20.7424052Z  2024-12-18T01:02:20.7425569Z  2024-12-18T01:02:20.7426995Z  2024-12-18T01:02:20.7429008Z [19,397 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:20.7431100Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T01:02:20.7433057Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T01:02:20.7435304Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T01:02:20.7437949Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T01:02:20.7440467Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T01:02:20.7442975Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T01:02:20.7445704Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T01:02:20.7448184Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local ... 2024-12-18T01:02:21.0205362Z 2024-12-18T01:02:21.0207839Z  2024-12-18T01:02:21.0209933Z  2024-12-18T01:02:21.0211859Z  2024-12-18T01:02:21.0213743Z  2024-12-18T01:02:21.0215896Z  2024-12-18T01:02:21.0218103Z  2024-12-18T01:02:21.0220058Z  2024-12-18T01:02:21.0221955Z  2024-12-18T01:02:21.0224352Z [19,398 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:21.0227046Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T01:02:21.0229853Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2024-12-18T01:02:21.0232425Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T01:02:21.0234943Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2024-12-18T01:02:21.0237358Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T01:02:21.0239881Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T01:02:21.0242325Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T01:02:21.0245287Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local ... 2024-12-18T01:02:21.3120418Z 2024-12-18T01:02:21.3122766Z  2024-12-18T01:02:21.3124731Z  2024-12-18T01:02:21.3126615Z  2024-12-18T01:02:21.3128448Z  2024-12-18T01:02:21.3130302Z  2024-12-18T01:02:21.3132134Z  2024-12-18T01:02:21.3135479Z  2024-12-18T01:02:21.3135878Z  2024-12-18T01:02:21.3136941Z [19,399 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:21.3137956Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2024-12-18T01:02:21.3138855Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2024-12-18T01:02:21.3139803Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T01:02:21.3140738Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T01:02:21.3141675Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T01:02:21.3142517Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T01:02:21.3143376Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T01:02:21.3144683Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local ... 2024-12-18T01:02:21.7397740Z 2024-12-18T01:02:21.7398587Z  2024-12-18T01:02:21.7399184Z  2024-12-18T01:02:21.7399550Z  2024-12-18T01:02:21.7399909Z  2024-12-18T01:02:21.7400268Z  2024-12-18T01:02:21.7400640Z  2024-12-18T01:02:21.7401023Z  2024-12-18T01:02:21.7401379Z  2024-12-18T01:02:21.7402316Z [19,400 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:21.7403402Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T01:02:21.7404306Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2024-12-18T01:02:21.7405561Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T01:02:21.7406505Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2024-12-18T01:02:21.7407506Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T01:02:21.7408452Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T01:02:21.7409471Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T01:02:21.7410570Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local ... 2024-12-18T01:02:22.1130386Z 2024-12-18T01:02:22.1131313Z  2024-12-18T01:02:22.1131747Z  2024-12-18T01:02:22.1132091Z  2024-12-18T01:02:22.1132548Z  2024-12-18T01:02:22.1132931Z  2024-12-18T01:02:22.1133319Z  2024-12-18T01:02:22.1133683Z  2024-12-18T01:02:22.1134076Z  2024-12-18T01:02:22.1135004Z [19,400 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:22.1135991Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T01:02:22.1137340Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T01:02:22.1138227Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T01:02:22.1139198Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2024-12-18T01:02:22.1140090Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T01:02:22.1140931Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T01:02:22.1142017Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T01:02:22.1142906Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local ... 2024-12-18T01:02:22.3133103Z 2024-12-18T01:02:22.3133963Z  2024-12-18T01:02:22.3134473Z  2024-12-18T01:02:22.3134865Z  2024-12-18T01:02:22.3135255Z  2024-12-18T01:02:22.3135660Z  2024-12-18T01:02:22.3136056Z  2024-12-18T01:02:22.3136597Z  2024-12-18T01:02:22.3137028Z  2024-12-18T01:02:22.3137883Z [19,402 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:22.3138826Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2024-12-18T01:02:22.3139718Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T01:02:22.3140672Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T01:02:22.3141606Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2024-12-18T01:02:22.3142465Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2024-12-18T01:02:22.3143286Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T01:02:22.3144108Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T01:02:22.3145313Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local ... 2024-12-18T01:02:23.3141716Z 2024-12-18T01:02:23.3142730Z  2024-12-18T01:02:23.3143317Z  2024-12-18T01:02:23.3143729Z  2024-12-18T01:02:23.3144122Z  2024-12-18T01:02:23.3144761Z  2024-12-18T01:02:23.3145154Z  2024-12-18T01:02:23.3145560Z  2024-12-18T01:02:23.3145933Z  2024-12-18T01:02:23.3146851Z [19,402 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:23.3147854Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2024-12-18T01:02:23.3148756Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2024-12-18T01:02:23.3149747Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2024-12-18T01:02:23.3150654Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2024-12-18T01:02:23.3151589Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T01:02:23.3152415Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T01:02:23.3153290Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T01:02:23.3154479Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local ... 2024-12-18T01:02:23.7149304Z 2024-12-18T01:02:23.7150216Z  2024-12-18T01:02:23.7150707Z  2024-12-18T01:02:23.7151094Z  2024-12-18T01:02:23.7151459Z  2024-12-18T01:02:23.7151879Z  2024-12-18T01:02:23.7152286Z  2024-12-18T01:02:23.7152661Z  2024-12-18T01:02:23.7153026Z  2024-12-18T01:02:23.7154252Z [19,403 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:23.7155263Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:02:23.7156189Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2024-12-18T01:02:23.7157151Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2024-12-18T01:02:23.7158065Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2024-12-18T01:02:23.7158990Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T01:02:23.7159867Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T01:02:23.7160914Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T01:02:23.7161826Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local ... 2024-12-18T01:02:23.9152590Z 2024-12-18T01:02:23.9153481Z  2024-12-18T01:02:23.9153960Z  2024-12-18T01:02:23.9154365Z  2024-12-18T01:02:23.9154809Z  2024-12-18T01:02:23.9155229Z  2024-12-18T01:02:23.9155647Z  2024-12-18T01:02:23.9156042Z  2024-12-18T01:02:23.9156707Z  2024-12-18T01:02:23.9157703Z [19,404 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:23.9158670Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:02:23.9159568Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T01:02:23.9160502Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2024-12-18T01:02:23.9161460Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T01:02:23.9162265Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T01:02:23.9163116Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T01:02:23.9163979Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:02:23.9164723Z @llvm-project//mlir:VectorToLLVM; 23s local ... 2024-12-18T01:02:24.1637592Z 2024-12-18T01:02:24.1638448Z  2024-12-18T01:02:24.1638917Z  2024-12-18T01:02:24.1639309Z  2024-12-18T01:02:24.1639737Z  2024-12-18T01:02:24.1640129Z  2024-12-18T01:02:24.1640506Z  2024-12-18T01:02:24.1640899Z  2024-12-18T01:02:24.1641284Z  2024-12-18T01:02:24.1642232Z [19,405 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:24.1643210Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:02:24.1644082Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T01:02:24.1645236Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T01:02:24.1646075Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T01:02:24.1646843Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T01:02:24.1647600Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:02:24.1648336Z @llvm-project//mlir:VectorToLLVM; 23s local 2024-12-18T01:02:24.1649121Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 19s local ... 2024-12-18T01:02:24.4661474Z 2024-12-18T01:02:24.4662339Z  2024-12-18T01:02:24.4662767Z  2024-12-18T01:02:24.4663112Z  2024-12-18T01:02:24.4663472Z  2024-12-18T01:02:24.4663833Z  2024-12-18T01:02:24.4664190Z  2024-12-18T01:02:24.4664539Z  2024-12-18T01:02:24.4664914Z  2024-12-18T01:02:24.4665729Z [19,406 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:24.4666912Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2024-12-18T01:02:24.4667692Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T01:02:24.4668522Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T01:02:24.4669354Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T01:02:24.4670293Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T01:02:24.4671043Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:02:24.4671706Z @llvm-project//mlir:VectorToLLVM; 24s local 2024-12-18T01:02:24.4672460Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local ... 2024-12-18T01:02:24.6771647Z 2024-12-18T01:02:24.6772451Z  2024-12-18T01:02:24.6772836Z  2024-12-18T01:02:24.6773161Z  2024-12-18T01:02:24.6773459Z  2024-12-18T01:02:24.6773776Z  2024-12-18T01:02:24.6774135Z  2024-12-18T01:02:24.6774447Z  2024-12-18T01:02:24.6774756Z  2024-12-18T01:02:24.6775728Z [19,408 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:24.6776672Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T01:02:24.6777370Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T01:02:24.6778099Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T01:02:24.6778891Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T01:02:24.6779561Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T01:02:24.6780199Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:02:24.6780768Z @llvm-project//mlir:VectorToLLVM; 24s local 2024-12-18T01:02:24.6781408Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local ... 2024-12-18T01:02:24.9162927Z 2024-12-18T01:02:24.9163784Z  2024-12-18T01:02:24.9164249Z  2024-12-18T01:02:24.9164642Z  2024-12-18T01:02:24.9165004Z  2024-12-18T01:02:24.9165397Z  2024-12-18T01:02:24.9165779Z  2024-12-18T01:02:24.9166154Z  2024-12-18T01:02:24.9166494Z  2024-12-18T01:02:24.9167566Z [19,408 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:24.9168611Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2024-12-18T01:02:24.9169524Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2024-12-18T01:02:24.9170441Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T01:02:24.9171325Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T01:02:24.9172173Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T01:02:24.9173022Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2024-12-18T01:02:24.9173762Z @llvm-project//mlir:VectorToLLVM; 24s local 2024-12-18T01:02:24.9174607Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local ... 2024-12-18T01:02:25.9173590Z 2024-12-18T01:02:25.9174474Z  2024-12-18T01:02:25.9174954Z  2024-12-18T01:02:25.9175366Z  2024-12-18T01:02:25.9175763Z  2024-12-18T01:02:25.9176131Z  2024-12-18T01:02:25.9176663Z  2024-12-18T01:02:25.9177041Z  2024-12-18T01:02:25.9177451Z  2024-12-18T01:02:25.9178348Z [19,408 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:25.9179323Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T01:02:25.9180219Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T01:02:25.9181146Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2024-12-18T01:02:25.9182004Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2024-12-18T01:02:25.9182834Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T01:02:25.9183986Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2024-12-18T01:02:25.9184817Z @llvm-project//mlir:VectorToLLVM; 25s local 2024-12-18T01:02:25.9185624Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local ... 2024-12-18T01:02:26.2951984Z 2024-12-18T01:02:26.2952831Z  2024-12-18T01:02:26.2953275Z  2024-12-18T01:02:26.2953914Z  2024-12-18T01:02:26.2954296Z  2024-12-18T01:02:26.2954689Z  2024-12-18T01:02:26.2955071Z  2024-12-18T01:02:26.2955431Z  2024-12-18T01:02:26.2955909Z  2024-12-18T01:02:26.2956842Z [19,409 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:26.2957898Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T01:02:26.2958956Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T01:02:26.2959911Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T01:02:26.2960732Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T01:02:26.2961782Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T01:02:26.2962644Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2024-12-18T01:02:26.2963377Z @llvm-project//mlir:VectorToLLVM; 25s local 2024-12-18T01:02:26.2964234Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local ... 2024-12-18T01:02:26.5183117Z 2024-12-18T01:02:26.5184019Z  2024-12-18T01:02:26.5184494Z  2024-12-18T01:02:26.5185147Z  2024-12-18T01:02:26.5185550Z  2024-12-18T01:02:26.5185939Z  2024-12-18T01:02:26.5186320Z  2024-12-18T01:02:26.5186704Z  2024-12-18T01:02:26.5187090Z  2024-12-18T01:02:26.5187997Z [19,409 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:26.5189047Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2024-12-18T01:02:26.5190701Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T01:02:26.5191649Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T01:02:26.5192543Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T01:02:26.5193440Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T01:02:26.5194452Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2024-12-18T01:02:26.5195188Z @llvm-project//mlir:VectorToLLVM; 26s local 2024-12-18T01:02:26.5195975Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local ... 2024-12-18T01:02:27.0727574Z 2024-12-18T01:02:27.0728441Z  2024-12-18T01:02:27.0737871Z  2024-12-18T01:02:27.0738443Z  2024-12-18T01:02:27.0738795Z  2024-12-18T01:02:27.0739125Z  2024-12-18T01:02:27.0739449Z  2024-12-18T01:02:27.0739756Z  2024-12-18T01:02:27.0740083Z  2024-12-18T01:02:27.0740838Z [19,410 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:27.0741706Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2024-12-18T01:02:27.0742429Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2024-12-18T01:02:27.0743190Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T01:02:27.0743883Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T01:02:27.0744843Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T01:02:27.0745546Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2024-12-18T01:02:27.0746152Z @llvm-project//mlir:VectorToLLVM; 26s local 2024-12-18T01:02:27.0746831Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local ... 2024-12-18T01:02:27.3188895Z 2024-12-18T01:02:27.3190410Z  2024-12-18T01:02:27.3190958Z  2024-12-18T01:02:27.3191365Z  2024-12-18T01:02:27.3191752Z  2024-12-18T01:02:27.3192103Z  2024-12-18T01:02:27.3192818Z  2024-12-18T01:02:27.3193240Z  2024-12-18T01:02:27.3193616Z  2024-12-18T01:02:27.3194542Z [19,410 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:27.3195552Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2024-12-18T01:02:27.3196432Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2024-12-18T01:02:27.3197553Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T01:02:27.3198441Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T01:02:27.3199274Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T01:02:27.3200123Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2024-12-18T01:02:27.3200834Z @llvm-project//mlir:VectorToLLVM; 26s local 2024-12-18T01:02:27.3201669Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local ... 2024-12-18T01:02:27.7667256Z 2024-12-18T01:02:27.7668165Z  2024-12-18T01:02:27.7668716Z  2024-12-18T01:02:27.7669105Z  2024-12-18T01:02:27.7669482Z  2024-12-18T01:02:27.7670068Z  2024-12-18T01:02:27.7670422Z  2024-12-18T01:02:27.7670735Z  2024-12-18T01:02:27.7671085Z  2024-12-18T01:02:27.7671955Z [19,411 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:27.7672820Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T01:02:27.7673794Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2024-12-18T01:02:27.7674656Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T01:02:27.7675408Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T01:02:27.7676223Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T01:02:27.7676943Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2024-12-18T01:02:27.7677688Z @llvm-project//mlir:VectorToLLVM; 27s local 2024-12-18T01:02:27.7678502Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local ... 2024-12-18T01:02:28.1196791Z 2024-12-18T01:02:28.1197651Z  2024-12-18T01:02:28.1198110Z  2024-12-18T01:02:28.1198532Z  2024-12-18T01:02:28.1198960Z  2024-12-18T01:02:28.1199378Z  2024-12-18T01:02:28.1199769Z  2024-12-18T01:02:28.1200188Z  2024-12-18T01:02:28.1200617Z  2024-12-18T01:02:28.1201609Z [19,413 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:28.1202714Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T01:02:28.1203656Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2024-12-18T01:02:28.1204675Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T01:02:28.1205625Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T01:02:28.1206498Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T01:02:28.1207419Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2024-12-18T01:02:28.1208212Z @llvm-project//mlir:VectorToLLVM; 27s local 2024-12-18T01:02:28.1209121Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local ... 2024-12-18T01:02:28.5205473Z 2024-12-18T01:02:28.5206392Z  2024-12-18T01:02:28.5206857Z  2024-12-18T01:02:28.5207296Z  2024-12-18T01:02:28.5207712Z  2024-12-18T01:02:28.5208138Z  2024-12-18T01:02:28.5208535Z  2024-12-18T01:02:28.5208937Z  2024-12-18T01:02:28.5209345Z  2024-12-18T01:02:28.5210309Z [19,415 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:28.5211390Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2024-12-18T01:02:28.5212336Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2024-12-18T01:02:28.5213353Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2024-12-18T01:02:28.5214657Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T01:02:28.5215568Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T01:02:28.5216697Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2024-12-18T01:02:28.5217467Z @llvm-project//mlir:VectorToLLVM; 28s local 2024-12-18T01:02:28.5218452Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local ... 2024-12-18T01:02:28.8517573Z 2024-12-18T01:02:28.8518491Z  2024-12-18T01:02:28.8518974Z  2024-12-18T01:02:28.8519407Z  2024-12-18T01:02:28.8519775Z  2024-12-18T01:02:28.8520129Z  2024-12-18T01:02:28.8520523Z  2024-12-18T01:02:28.8520887Z  2024-12-18T01:02:28.8521275Z  2024-12-18T01:02:28.8522121Z [19,417 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:28.8523144Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T01:02:28.8524032Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2024-12-18T01:02:28.8525218Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2024-12-18T01:02:28.8526058Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T01:02:28.8526874Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T01:02:28.8527670Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2024-12-18T01:02:28.8528407Z @llvm-project//mlir:VectorToLLVM; 28s local 2024-12-18T01:02:28.8529456Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local ... 2024-12-18T01:02:29.1043574Z 2024-12-18T01:02:29.1045256Z  2024-12-18T01:02:29.1045908Z  2024-12-18T01:02:29.1046951Z  2024-12-18T01:02:29.1047407Z  2024-12-18T01:02:29.1047791Z  2024-12-18T01:02:29.1048190Z  2024-12-18T01:02:29.1048596Z  2024-12-18T01:02:29.1048998Z  2024-12-18T01:02:29.1049930Z [19,419 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:29.1050892Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T01:02:29.1051744Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 64s local 2024-12-18T01:02:29.1052666Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2024-12-18T01:02:29.1053517Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:29.1054336Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T01:02:29.1055016Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2024-12-18T01:02:29.1055686Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2024-12-18T01:02:29.1056597Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 20s local ... 2024-12-18T01:02:29.3208048Z 2024-12-18T01:02:29.3209317Z  2024-12-18T01:02:29.3209788Z  2024-12-18T01:02:29.3210165Z  2024-12-18T01:02:29.3210559Z  2024-12-18T01:02:29.3210977Z  2024-12-18T01:02:29.3211360Z  2024-12-18T01:02:29.3211722Z  2024-12-18T01:02:29.3212117Z  2024-12-18T01:02:29.3213041Z [19,419 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:29.3214029Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T01:02:29.3214905Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 64s local 2024-12-18T01:02:29.3215836Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2024-12-18T01:02:29.3216907Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:29.3217764Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T01:02:29.3218621Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2024-12-18T01:02:29.3219519Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2024-12-18T01:02:29.3220395Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 20s local ... 2024-12-18T01:02:29.5796031Z 2024-12-18T01:02:29.5797185Z  2024-12-18T01:02:29.5798040Z  2024-12-18T01:02:29.5798794Z  2024-12-18T01:02:29.5799837Z  2024-12-18T01:02:29.5800366Z  2024-12-18T01:02:29.5800806Z  2024-12-18T01:02:29.5801167Z  2024-12-18T01:02:29.5801537Z  2024-12-18T01:02:29.5802506Z [19,421 / 20,603] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:02:29.5803778Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2024-12-18T01:02:29.5804613Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 64s local 2024-12-18T01:02:29.5805516Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2024-12-18T01:02:29.5806325Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:29.5807238Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T01:02:29.5808113Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2024-12-18T01:02:29.5809108Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2024-12-18T01:02:29.5810148Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 20s local ... 2024-12-18T01:02:29.9214700Z 2024-12-18T01:02:29.9215575Z  2024-12-18T01:02:29.9216064Z  2024-12-18T01:02:29.9216595Z  2024-12-18T01:02:29.9217017Z  2024-12-18T01:02:29.9217409Z  2024-12-18T01:02:29.9217849Z  2024-12-18T01:02:29.9218263Z  2024-12-18T01:02:29.9218670Z  2024-12-18T01:02:29.9219869Z [19,422 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:29.9220983Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T01:02:29.9221955Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 65s local 2024-12-18T01:02:29.9222940Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2024-12-18T01:02:29.9224257Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:29.9225293Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T01:02:29.9226305Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2024-12-18T01:02:29.9227277Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2024-12-18T01:02:29.9228260Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 21s local ... 2024-12-18T01:02:30.3220989Z 2024-12-18T01:02:30.3221906Z  2024-12-18T01:02:30.3222427Z  2024-12-18T01:02:30.3222836Z  2024-12-18T01:02:30.3223242Z  2024-12-18T01:02:30.3223602Z  2024-12-18T01:02:30.3224015Z  2024-12-18T01:02:30.3224399Z  2024-12-18T01:02:30.3224788Z  2024-12-18T01:02:30.3225697Z [19,425 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:30.3226660Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2024-12-18T01:02:30.3227549Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 65s local 2024-12-18T01:02:30.3228450Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 58s local 2024-12-18T01:02:30.3229296Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T01:02:30.3230119Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T01:02:30.3230907Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2024-12-18T01:02:30.3231764Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2024-12-18T01:02:30.3232737Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 17s local ... 2024-12-18T01:02:30.7075225Z 2024-12-18T01:02:30.7076129Z  2024-12-18T01:02:30.7076766Z  2024-12-18T01:02:30.7077176Z  2024-12-18T01:02:30.7077570Z  2024-12-18T01:02:30.7077935Z  2024-12-18T01:02:30.7078331Z  2024-12-18T01:02:30.7078702Z  2024-12-18T01:02:30.7079090Z  2024-12-18T01:02:30.7079982Z [19,426 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:30.7081261Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T01:02:30.7082214Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 65s local 2024-12-18T01:02:30.7083179Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 58s local 2024-12-18T01:02:30.7084052Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T01:02:30.7084957Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T01:02:30.7085942Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2024-12-18T01:02:30.7086807Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2024-12-18T01:02:30.7087821Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 17s local ... 2024-12-18T01:02:30.9227206Z 2024-12-18T01:02:30.9228142Z  2024-12-18T01:02:30.9228664Z  2024-12-18T01:02:30.9229073Z  2024-12-18T01:02:30.9229502Z  2024-12-18T01:02:30.9229914Z  2024-12-18T01:02:30.9230312Z  2024-12-18T01:02:30.9230727Z  2024-12-18T01:02:30.9231103Z  2024-12-18T01:02:30.9232323Z [19,427 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:30.9233356Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T01:02:30.9234249Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 66s local 2024-12-18T01:02:30.9235220Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 58s local 2024-12-18T01:02:30.9236086Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T01:02:30.9237175Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T01:02:30.9238152Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2024-12-18T01:02:30.9239239Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2024-12-18T01:02:30.9240602Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 18s local ... 2024-12-18T01:02:31.1229703Z 2024-12-18T01:02:31.1230710Z  2024-12-18T01:02:31.1231209Z  2024-12-18T01:02:31.1231647Z  2024-12-18T01:02:31.1232052Z  2024-12-18T01:02:31.1232483Z  2024-12-18T01:02:31.1232925Z  2024-12-18T01:02:31.1233353Z  2024-12-18T01:02:31.1233886Z  2024-12-18T01:02:31.1234798Z [19,428 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:31.1235898Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T01:02:31.1236824Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 58s local 2024-12-18T01:02:31.1237717Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T01:02:31.1238593Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T01:02:31.1239463Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2024-12-18T01:02:31.1240353Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2024-12-18T01:02:31.1241422Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2024-12-18T01:02:31.1242416Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 17s local ... 2024-12-18T01:02:31.3987271Z 2024-12-18T01:02:31.3988147Z  2024-12-18T01:02:31.3988633Z  2024-12-18T01:02:31.3989041Z  2024-12-18T01:02:31.3989416Z  2024-12-18T01:02:31.3989800Z  2024-12-18T01:02:31.3990238Z  2024-12-18T01:02:31.3990595Z  2024-12-18T01:02:31.3990994Z  2024-12-18T01:02:31.3991908Z [19,429 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:31.3992891Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2024-12-18T01:02:31.3993731Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 59s local 2024-12-18T01:02:31.3994551Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T01:02:31.3995405Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T01:02:31.3996219Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2024-12-18T01:02:31.3997325Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2024-12-18T01:02:31.3998339Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2024-12-18T01:02:31.3999272Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 17s local ... 2024-12-18T01:02:31.7236233Z 2024-12-18T01:02:31.7237123Z  2024-12-18T01:02:31.7237918Z  2024-12-18T01:02:31.7238294Z  2024-12-18T01:02:31.7238718Z  2024-12-18T01:02:31.7239108Z  2024-12-18T01:02:31.7239502Z  2024-12-18T01:02:31.7239885Z  2024-12-18T01:02:31.7240264Z  2024-12-18T01:02:31.7241150Z [19,430 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:31.7242423Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:02:31.7243534Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 59s local 2024-12-18T01:02:31.7244810Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T01:02:31.7245641Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2024-12-18T01:02:31.7246748Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2024-12-18T01:02:31.7247725Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2024-12-18T01:02:31.7248685Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 17s local 2024-12-18T01:02:31.7249558Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 17s local ... 2024-12-18T01:02:31.9239184Z 2024-12-18T01:02:31.9240332Z  2024-12-18T01:02:31.9240894Z  2024-12-18T01:02:31.9241316Z  2024-12-18T01:02:31.9241731Z  2024-12-18T01:02:31.9242143Z  2024-12-18T01:02:31.9242522Z  2024-12-18T01:02:31.9242938Z  2024-12-18T01:02:31.9243330Z  2024-12-18T01:02:31.9244535Z [19,434 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:31.9245699Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:02:31.9246689Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T01:02:31.9247617Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2024-12-18T01:02:31.9248573Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2024-12-18T01:02:31.9249803Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 19s local 2024-12-18T01:02:31.9250786Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 18s local 2024-12-18T01:02:31.9251543Z @llvm-project//mlir:VectorToLLVM; 16s local 2024-12-18T01:02:31.9252253Z @llvm-project//mlir:VectorTransforms; 16s local ... 2024-12-18T01:02:32.2318606Z 2024-12-18T01:02:32.2319499Z  2024-12-18T01:02:32.2319987Z  2024-12-18T01:02:32.2320417Z  2024-12-18T01:02:32.2320828Z  2024-12-18T01:02:32.2321222Z  2024-12-18T01:02:32.2321628Z  2024-12-18T01:02:32.2322050Z  2024-12-18T01:02:32.2322460Z  2024-12-18T01:02:32.2323422Z [19,436 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:32.2324549Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:02:32.2325487Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T01:02:32.2326424Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2024-12-18T01:02:32.2327372Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2024-12-18T01:02:32.2328291Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 18s local 2024-12-18T01:02:32.2329075Z @llvm-project//mlir:VectorToLLVM; 16s local 2024-12-18T01:02:32.2329779Z @llvm-project//mlir:VectorTransforms; 16s local 2024-12-18T01:02:32.2330686Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local ... 2024-12-18T01:02:32.5245273Z 2024-12-18T01:02:32.5246114Z  2024-12-18T01:02:32.5246613Z  2024-12-18T01:02:32.5247023Z  2024-12-18T01:02:32.5247906Z  2024-12-18T01:02:32.5248301Z  2024-12-18T01:02:32.5248708Z  2024-12-18T01:02:32.5249118Z  2024-12-18T01:02:32.5249507Z  2024-12-18T01:02:32.5250428Z [19,436 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:32.5251552Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2024-12-18T01:02:32.5252482Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T01:02:32.5253583Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2024-12-18T01:02:32.5254974Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2024-12-18T01:02:32.5256023Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 18s local 2024-12-18T01:02:32.5257063Z @llvm-project//mlir:VectorToLLVM; 17s local 2024-12-18T01:02:32.5257914Z @llvm-project//mlir:VectorTransforms; 16s local 2024-12-18T01:02:32.5259069Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local ... 2024-12-18T01:02:32.7248213Z 2024-12-18T01:02:32.7249116Z  2024-12-18T01:02:32.7249593Z  2024-12-18T01:02:32.7249996Z  2024-12-18T01:02:32.7250677Z  2024-12-18T01:02:32.7251085Z  2024-12-18T01:02:32.7251491Z  2024-12-18T01:02:32.7251889Z  2024-12-18T01:02:32.7252299Z  2024-12-18T01:02:32.7253229Z [19,437 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:32.7254283Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2024-12-18T01:02:32.7255350Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T01:02:32.7256272Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2024-12-18T01:02:32.7257316Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2024-12-18T01:02:32.7258239Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 18s local 2024-12-18T01:02:32.7259017Z @llvm-project//mlir:VectorToLLVM; 17s local 2024-12-18T01:02:32.7259757Z @llvm-project//mlir:VectorTransforms; 17s local 2024-12-18T01:02:32.7260640Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local ... 2024-12-18T01:02:32.9299973Z 2024-12-18T01:02:32.9300849Z  2024-12-18T01:02:32.9301342Z  2024-12-18T01:02:32.9301737Z  2024-12-18T01:02:32.9302118Z  2024-12-18T01:02:32.9302525Z  2024-12-18T01:02:32.9302896Z  2024-12-18T01:02:32.9303318Z  2024-12-18T01:02:32.9303713Z  2024-12-18T01:02:32.9304635Z [19,438 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:32.9305911Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2024-12-18T01:02:32.9306811Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T01:02:32.9307724Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2024-12-18T01:02:32.9308615Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2024-12-18T01:02:32.9309563Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 19s local 2024-12-18T01:02:32.9310328Z @llvm-project//mlir:VectorToLLVM; 17s local 2024-12-18T01:02:32.9311003Z @llvm-project//mlir:VectorTransforms; 17s local 2024-12-18T01:02:32.9311873Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local ... 2024-12-18T01:02:33.3254486Z 2024-12-18T01:02:33.3255445Z  2024-12-18T01:02:33.3255949Z  2024-12-18T01:02:33.3256503Z  2024-12-18T01:02:33.3256936Z  2024-12-18T01:02:33.3257308Z  2024-12-18T01:02:33.3257695Z  2024-12-18T01:02:33.3258088Z  2024-12-18T01:02:33.3258486Z  2024-12-18T01:02:33.3259443Z [19,440 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:33.3260502Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2024-12-18T01:02:33.3261449Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T01:02:33.3262339Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2024-12-18T01:02:33.3263543Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2024-12-18T01:02:33.3264436Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 19s local 2024-12-18T01:02:33.3265203Z @llvm-project//mlir:VectorToLLVM; 18s local 2024-12-18T01:02:33.3265904Z @llvm-project//mlir:VectorTransforms; 17s local 2024-12-18T01:02:33.3266797Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local ... 2024-12-18T01:02:34.3261738Z 2024-12-18T01:02:34.3262650Z  2024-12-18T01:02:34.3263178Z  2024-12-18T01:02:34.3263679Z  2024-12-18T01:02:34.3264077Z  2024-12-18T01:02:34.3264498Z  2024-12-18T01:02:34.3264909Z  2024-12-18T01:02:34.3265306Z  2024-12-18T01:02:34.3265707Z  2024-12-18T01:02:34.3266707Z [19,440 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:34.3267716Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T01:02:34.3268619Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T01:02:34.3269816Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2024-12-18T01:02:34.3270743Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2024-12-18T01:02:34.3271639Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 20s local 2024-12-18T01:02:34.3272426Z @llvm-project//mlir:VectorToLLVM; 19s local 2024-12-18T01:02:34.3273178Z @llvm-project//mlir:VectorTransforms; 18s local 2024-12-18T01:02:34.3274294Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local ... 2024-12-18T01:02:34.5768663Z 2024-12-18T01:02:34.5769535Z  2024-12-18T01:02:34.5770033Z  2024-12-18T01:02:34.5770420Z  2024-12-18T01:02:34.5770845Z  2024-12-18T01:02:34.5771263Z  2024-12-18T01:02:34.5771674Z  2024-12-18T01:02:34.5772078Z  2024-12-18T01:02:34.5772435Z  2024-12-18T01:02:34.5773302Z [19,441 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:34.5774522Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2024-12-18T01:02:34.5775373Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T01:02:34.5776173Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2024-12-18T01:02:34.5776967Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2024-12-18T01:02:34.5777641Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 20s local 2024-12-18T01:02:34.5778309Z @llvm-project//mlir:VectorToLLVM; 19s local 2024-12-18T01:02:34.5779008Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2024-12-18T01:02:34.5779888Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local ... 2024-12-18T01:02:34.9265534Z 2024-12-18T01:02:34.9266433Z  2024-12-18T01:02:34.9266922Z  2024-12-18T01:02:34.9267318Z  2024-12-18T01:02:34.9267702Z  2024-12-18T01:02:34.9268106Z  2024-12-18T01:02:34.9268548Z  2024-12-18T01:02:34.9268944Z  2024-12-18T01:02:34.9269319Z  2024-12-18T01:02:34.9270267Z [19,441 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:34.9271297Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2024-12-18T01:02:34.9272560Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T01:02:34.9273555Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2024-12-18T01:02:34.9274510Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2024-12-18T01:02:34.9275440Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local 2024-12-18T01:02:34.9276294Z @llvm-project//mlir:VectorToLLVM; 19s local 2024-12-18T01:02:34.9277198Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2024-12-18T01:02:34.9278231Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local ... 2024-12-18T01:02:35.9273196Z 2024-12-18T01:02:35.9274352Z  2024-12-18T01:02:35.9274839Z  2024-12-18T01:02:35.9275231Z  2024-12-18T01:02:35.9275640Z  2024-12-18T01:02:35.9276065Z  2024-12-18T01:02:35.9276464Z  2024-12-18T01:02:35.9276865Z  2024-12-18T01:02:35.9277243Z  2024-12-18T01:02:35.9278209Z [19,441 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:35.9279518Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2024-12-18T01:02:35.9280483Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T01:02:35.9281356Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2024-12-18T01:02:35.9282255Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2024-12-18T01:02:35.9283184Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2024-12-18T01:02:35.9283974Z @llvm-project//mlir:VectorToLLVM; 20s local 2024-12-18T01:02:35.9284819Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2024-12-18T01:02:35.9285821Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local ... 2024-12-18T01:02:36.4086810Z 2024-12-18T01:02:36.4087843Z  2024-12-18T01:02:36.4089475Z  2024-12-18T01:02:36.4089867Z  2024-12-18T01:02:36.4090203Z  2024-12-18T01:02:36.4090607Z  2024-12-18T01:02:36.4090963Z  2024-12-18T01:02:36.4091334Z  2024-12-18T01:02:36.4091745Z  2024-12-18T01:02:36.4092655Z [19,442 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:36.4093937Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T01:02:36.4094758Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2024-12-18T01:02:36.4095600Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2024-12-18T01:02:36.4096601Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2024-12-18T01:02:36.4097327Z @llvm-project//mlir:VectorToLLVM; 21s local 2024-12-18T01:02:36.4098165Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2024-12-18T01:02:36.4099100Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2024-12-18T01:02:36.4100089Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 18s local ... 2024-12-18T01:02:36.6668745Z 2024-12-18T01:02:36.6669609Z  2024-12-18T01:02:36.6670213Z  2024-12-18T01:02:36.6670685Z  2024-12-18T01:02:36.6671052Z  2024-12-18T01:02:36.6671409Z  2024-12-18T01:02:36.6671731Z  2024-12-18T01:02:36.6672086Z  2024-12-18T01:02:36.6672467Z  2024-12-18T01:02:36.6673290Z [19,444 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:36.6674187Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2024-12-18T01:02:36.6674945Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2024-12-18T01:02:36.6675753Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2024-12-18T01:02:36.6676647Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2024-12-18T01:02:36.6677353Z @llvm-project//mlir:VectorToLLVM; 21s local 2024-12-18T01:02:36.6678334Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2024-12-18T01:02:36.6679138Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2024-12-18T01:02:36.6680142Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 18s local ... 2024-12-18T01:02:36.9281675Z 2024-12-18T01:02:36.9282529Z  2024-12-18T01:02:36.9282992Z  2024-12-18T01:02:36.9283432Z  2024-12-18T01:02:36.9283827Z  2024-12-18T01:02:36.9284214Z  2024-12-18T01:02:36.9284602Z  2024-12-18T01:02:36.9284990Z  2024-12-18T01:02:36.9285362Z  2024-12-18T01:02:36.9286315Z [19,444 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:36.9287355Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2024-12-18T01:02:36.9288484Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2024-12-18T01:02:36.9289328Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2024-12-18T01:02:36.9290197Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2024-12-18T01:02:36.9290959Z @llvm-project//mlir:VectorToLLVM; 21s local 2024-12-18T01:02:36.9291809Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2024-12-18T01:02:36.9292857Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2024-12-18T01:02:36.9293975Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 19s local ... 2024-12-18T01:02:37.3285325Z 2024-12-18T01:02:37.3286160Z  2024-12-18T01:02:37.3286631Z  2024-12-18T01:02:37.3287028Z  2024-12-18T01:02:37.3287381Z  2024-12-18T01:02:37.3287708Z  2024-12-18T01:02:37.3288070Z  2024-12-18T01:02:37.3288420Z  2024-12-18T01:02:37.3288726Z  2024-12-18T01:02:37.3289600Z [19,446 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:37.3290858Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2024-12-18T01:02:37.3291690Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2024-12-18T01:02:37.3292522Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2024-12-18T01:02:37.3293367Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2024-12-18T01:02:37.3294110Z @llvm-project//mlir:VectorToLLVM; 22s local 2024-12-18T01:02:37.3295045Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2024-12-18T01:02:37.3295920Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2024-12-18T01:02:37.3297101Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 19s local ... 2024-12-18T01:02:37.6946373Z 2024-12-18T01:02:37.6947223Z  2024-12-18T01:02:37.6947658Z  2024-12-18T01:02:37.6948047Z  2024-12-18T01:02:37.6948432Z  2024-12-18T01:02:37.6948829Z  2024-12-18T01:02:37.6949214Z  2024-12-18T01:02:37.6949613Z  2024-12-18T01:02:37.6950011Z  2024-12-18T01:02:37.6950923Z [19,448 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:37.6952006Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T01:02:37.6952867Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2024-12-18T01:02:37.6953744Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2024-12-18T01:02:37.6954628Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2024-12-18T01:02:37.6955382Z @llvm-project//mlir:VectorToLLVM; 22s local 2024-12-18T01:02:37.6956123Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2024-12-18T01:02:37.6957064Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2024-12-18T01:02:37.6958036Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 19s local ... 2024-12-18T01:02:37.9125145Z 2024-12-18T01:02:37.9126012Z  2024-12-18T01:02:37.9126522Z  2024-12-18T01:02:37.9127067Z  2024-12-18T01:02:37.9127443Z  2024-12-18T01:02:37.9127801Z  2024-12-18T01:02:37.9128172Z  2024-12-18T01:02:37.9128533Z  2024-12-18T01:02:37.9128893Z  2024-12-18T01:02:37.9129794Z [19,452 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:37.9130807Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T01:02:37.9131620Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:02:37.9132460Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2024-12-18T01:02:37.9133265Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2024-12-18T01:02:37.9133977Z @llvm-project//mlir:VectorToLLVM; 22s local 2024-12-18T01:02:37.9134735Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2024-12-18T01:02:37.9135943Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2024-12-18T01:02:37.9136865Z Compiling xla/service/cpu/ir_emitter.cc; 17s local ... 2024-12-18T01:02:38.1290763Z 2024-12-18T01:02:38.1291496Z  2024-12-18T01:02:38.1291956Z  2024-12-18T01:02:38.1292320Z  2024-12-18T01:02:38.1292663Z  2024-12-18T01:02:38.1293023Z  2024-12-18T01:02:38.1293500Z  2024-12-18T01:02:38.1294287Z  2024-12-18T01:02:38.1294782Z  2024-12-18T01:02:38.1295910Z [19,452 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:38.1297347Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T01:02:38.1298300Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:02:38.1299064Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2024-12-18T01:02:38.1299850Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2024-12-18T01:02:38.1300577Z @llvm-project//mlir:VectorToLLVM; 22s local 2024-12-18T01:02:38.1303431Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2024-12-18T01:02:38.1304463Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 22s local 2024-12-18T01:02:38.1305281Z Compiling xla/service/cpu/ir_emitter.cc; 18s local ... 2024-12-18T01:02:38.5294692Z 2024-12-18T01:02:38.5295548Z  2024-12-18T01:02:38.5296099Z  2024-12-18T01:02:38.5296657Z  2024-12-18T01:02:38.5297068Z  2024-12-18T01:02:38.5297471Z  2024-12-18T01:02:38.5297869Z  2024-12-18T01:02:38.5298511Z  2024-12-18T01:02:38.5298978Z  2024-12-18T01:02:38.5299930Z [19,454 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:38.5301013Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T01:02:38.5301860Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:02:38.5302955Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2024-12-18T01:02:38.5303856Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2024-12-18T01:02:38.5304629Z @llvm-project//mlir:VectorToLLVM; 23s local 2024-12-18T01:02:38.5305469Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2024-12-18T01:02:38.5306314Z Compiling xla/service/cpu/ir_emitter.cc; 18s local 2024-12-18T01:02:38.5307091Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2024-12-18T01:02:38.7630694Z 2024-12-18T01:02:38.7631588Z  2024-12-18T01:02:38.7632068Z  2024-12-18T01:02:38.7632505Z  2024-12-18T01:02:38.7632874Z  2024-12-18T01:02:38.7633245Z  2024-12-18T01:02:38.7633641Z  2024-12-18T01:02:38.7634000Z  2024-12-18T01:02:38.7634383Z  2024-12-18T01:02:38.7635269Z [19,457 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:38.7636268Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T01:02:38.7637100Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:02:38.7637934Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2024-12-18T01:02:38.7638808Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2024-12-18T01:02:38.7639569Z @llvm-project//mlir:VectorToLLVM; 23s local 2024-12-18T01:02:38.7640374Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:02:38.7641205Z Compiling xla/service/cpu/ir_emitter.cc; 18s local 2024-12-18T01:02:38.7641943Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2024-12-18T01:02:39.1299968Z 2024-12-18T01:02:39.1300768Z  2024-12-18T01:02:39.1301190Z  2024-12-18T01:02:39.1301550Z  2024-12-18T01:02:39.1301870Z  2024-12-18T01:02:39.1302224Z  2024-12-18T01:02:39.1302589Z  2024-12-18T01:02:39.1302955Z  2024-12-18T01:02:39.1303329Z  2024-12-18T01:02:39.1304158Z [19,459 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:39.1305437Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T01:02:39.1306289Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2024-12-18T01:02:39.1307059Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2024-12-18T01:02:39.1307967Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2024-12-18T01:02:39.1308734Z @llvm-project//mlir:VectorToLLVM; 23s local 2024-12-18T01:02:39.1309471Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:02:39.1310282Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2024-12-18T01:02:39.1310966Z @llvm-project//mlir:VectorToLLVM; 19s local ... 2024-12-18T01:02:39.3423564Z 2024-12-18T01:02:39.3424399Z  2024-12-18T01:02:39.3424841Z  2024-12-18T01:02:39.3425226Z  2024-12-18T01:02:39.3425560Z  2024-12-18T01:02:39.3425908Z  2024-12-18T01:02:39.3426284Z  2024-12-18T01:02:39.3426630Z  2024-12-18T01:02:39.3426974Z  2024-12-18T01:02:39.3428054Z [19,460 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:39.3429011Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T01:02:39.3429782Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2024-12-18T01:02:39.3430577Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2024-12-18T01:02:39.3431473Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2024-12-18T01:02:39.3432110Z @llvm-project//mlir:VectorToLLVM; 24s local 2024-12-18T01:02:39.3432829Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:02:39.3433605Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2024-12-18T01:02:39.3434269Z @llvm-project//mlir:VectorToLLVM; 19s local ... 2024-12-18T01:02:39.7305723Z 2024-12-18T01:02:39.7306599Z  2024-12-18T01:02:39.7307101Z  2024-12-18T01:02:39.7307521Z  2024-12-18T01:02:39.7307922Z  2024-12-18T01:02:39.7308310Z  2024-12-18T01:02:39.7308657Z  2024-12-18T01:02:39.7309017Z  2024-12-18T01:02:39.7309376Z  2024-12-18T01:02:39.7310343Z [19,461 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:39.7311630Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2024-12-18T01:02:39.7312518Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2024-12-18T01:02:39.7313495Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2024-12-18T01:02:39.7314357Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2024-12-18T01:02:39.7315096Z @llvm-project//mlir:VectorToLLVM; 24s local 2024-12-18T01:02:39.7315866Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2024-12-18T01:02:39.7316688Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2024-12-18T01:02:39.7317430Z @llvm-project//mlir:VectorToLLVM; 19s local ... 2024-12-18T01:02:40.7313462Z 2024-12-18T01:02:40.7314327Z  2024-12-18T01:02:40.7314864Z  2024-12-18T01:02:40.7315273Z  2024-12-18T01:02:40.7315658Z  2024-12-18T01:02:40.7316067Z  2024-12-18T01:02:40.7316451Z  2024-12-18T01:02:40.7316859Z  2024-12-18T01:02:40.7317252Z  2024-12-18T01:02:40.7318217Z [19,461 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:40.7319343Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2024-12-18T01:02:40.7320260Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2024-12-18T01:02:40.7321297Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2024-12-18T01:02:40.7322199Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2024-12-18T01:02:40.7322944Z @llvm-project//mlir:VectorToLLVM; 25s local 2024-12-18T01:02:40.7323750Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2024-12-18T01:02:40.7324888Z Compiling xla/service/cpu/ir_emitter.cc; 20s local 2024-12-18T01:02:40.7325620Z @llvm-project//mlir:VectorToLLVM; 20s local ... 2024-12-18T01:02:41.1751284Z 2024-12-18T01:02:41.1752196Z  2024-12-18T01:02:41.1752660Z  2024-12-18T01:02:41.1753077Z  2024-12-18T01:02:41.1753492Z  2024-12-18T01:02:41.1753896Z  2024-12-18T01:02:41.1754575Z  2024-12-18T01:02:41.1754951Z  2024-12-18T01:02:41.1755361Z  2024-12-18T01:02:41.1756299Z [19,462 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:41.1757403Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2024-12-18T01:02:41.1758273Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2024-12-18T01:02:41.1759208Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2024-12-18T01:02:41.1760158Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2024-12-18T01:02:41.1760953Z @llvm-project//mlir:VectorToLLVM; 25s local 2024-12-18T01:02:41.1761974Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2024-12-18T01:02:41.1762913Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2024-12-18T01:02:41.1763798Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 19s local ... 2024-12-18T01:02:41.5318461Z 2024-12-18T01:02:41.5319344Z  2024-12-18T01:02:41.5319967Z  2024-12-18T01:02:41.5320414Z  2024-12-18T01:02:41.5320883Z  2024-12-18T01:02:41.5321349Z  2024-12-18T01:02:41.5322029Z  2024-12-18T01:02:41.5322519Z  2024-12-18T01:02:41.5322961Z  2024-12-18T01:02:41.5323920Z [19,463 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:41.5325048Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T01:02:41.5325928Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2024-12-18T01:02:41.5326845Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2024-12-18T01:02:41.5327696Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2024-12-18T01:02:41.5328458Z @llvm-project//mlir:VectorToLLVM; 26s local 2024-12-18T01:02:41.5329289Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2024-12-18T01:02:41.5330148Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2024-12-18T01:02:41.5331024Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 20s local ... 2024-12-18T01:02:41.9998842Z 2024-12-18T01:02:41.9999731Z  2024-12-18T01:02:42.0000179Z  2024-12-18T01:02:42.0000556Z  2024-12-18T01:02:42.0000920Z  2024-12-18T01:02:42.0001285Z  2024-12-18T01:02:42.0001664Z  2024-12-18T01:02:42.0002042Z  2024-12-18T01:02:42.0002411Z  2024-12-18T01:02:42.0003232Z [19,464 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:42.0004050Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T01:02:42.0004766Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2024-12-18T01:02:42.0005433Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2024-12-18T01:02:42.0006079Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T01:02:42.0006669Z @llvm-project//mlir:VectorToLLVM; 26s local 2024-12-18T01:02:42.0007283Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T01:02:42.0007945Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2024-12-18T01:02:42.0008618Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 20s local ... 2024-12-18T01:02:42.3325926Z 2024-12-18T01:02:42.3326896Z  2024-12-18T01:02:42.3327390Z  2024-12-18T01:02:42.3327759Z  2024-12-18T01:02:42.3328181Z  2024-12-18T01:02:42.3328589Z  2024-12-18T01:02:42.3328963Z  2024-12-18T01:02:42.3329296Z  2024-12-18T01:02:42.3329998Z  2024-12-18T01:02:42.3330936Z [19,464 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:42.3331994Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T01:02:42.3332825Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2024-12-18T01:02:42.3333665Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2024-12-18T01:02:42.3334738Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T01:02:42.3335507Z @llvm-project//mlir:VectorToLLVM; 27s local 2024-12-18T01:02:42.3336307Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T01:02:42.3337209Z Compiling xla/service/cpu/ir_emitter.cc; 22s local 2024-12-18T01:02:42.3337888Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2024-12-18T01:02:42.7330452Z 2024-12-18T01:02:42.7331412Z  2024-12-18T01:02:42.7331862Z  2024-12-18T01:02:42.7332232Z  2024-12-18T01:02:42.7332649Z  2024-12-18T01:02:42.7333067Z  2024-12-18T01:02:42.7333434Z  2024-12-18T01:02:42.7334063Z  2024-12-18T01:02:42.7334373Z  2024-12-18T01:02:42.7335192Z [19,465 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:42.7336146Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T01:02:42.7337266Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2024-12-18T01:02:42.7338315Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2024-12-18T01:02:42.7339134Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2024-12-18T01:02:42.7339842Z @llvm-project//mlir:VectorToLLVM; 27s local 2024-12-18T01:02:42.7340628Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2024-12-18T01:02:42.7341490Z Compiling xla/service/cpu/ir_emitter.cc; 22s local 2024-12-18T01:02:42.7342191Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2024-12-18T01:02:43.0290947Z 2024-12-18T01:02:43.0291860Z  2024-12-18T01:02:43.0292337Z  2024-12-18T01:02:43.0292742Z  2024-12-18T01:02:43.0293165Z  2024-12-18T01:02:43.0293550Z  2024-12-18T01:02:43.0293928Z  2024-12-18T01:02:43.0294295Z  2024-12-18T01:02:43.0294663Z  2024-12-18T01:02:43.0295696Z [19,466 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:43.0296951Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T01:02:43.0297859Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T01:02:43.0298742Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2024-12-18T01:02:43.0299599Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:43.0300333Z @llvm-project//mlir:VectorToLLVM; 27s local 2024-12-18T01:02:43.0301153Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T01:02:43.0302035Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2024-12-18T01:02:43.0302917Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2024-12-18T01:02:43.3334447Z 2024-12-18T01:02:43.3335384Z  2024-12-18T01:02:43.3346362Z  2024-12-18T01:02:43.3347177Z  2024-12-18T01:02:43.3347615Z  2024-12-18T01:02:43.3348016Z  2024-12-18T01:02:43.3348444Z  2024-12-18T01:02:43.3348838Z  2024-12-18T01:02:43.3349230Z  2024-12-18T01:02:43.3350290Z [19,466 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:43.3351358Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T01:02:43.3352232Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T01:02:43.3353071Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2024-12-18T01:02:43.3353990Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:43.3355034Z @llvm-project//mlir:VectorToLLVM; 28s local 2024-12-18T01:02:43.3355695Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T01:02:43.3356337Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2024-12-18T01:02:43.3357052Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2024-12-18T01:02:43.5338660Z 2024-12-18T01:02:43.5339846Z  2024-12-18T01:02:43.5340276Z  2024-12-18T01:02:43.5340652Z  2024-12-18T01:02:43.5341048Z  2024-12-18T01:02:43.5341431Z  2024-12-18T01:02:43.5341840Z  2024-12-18T01:02:43.5342248Z  2024-12-18T01:02:43.5342613Z  2024-12-18T01:02:43.5343585Z [19,469 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:43.5344962Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:02:43.5345886Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T01:02:43.5346783Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T01:02:43.5347960Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:43.5348729Z @llvm-project//mlir:VectorToLLVM; 28s local 2024-12-18T01:02:43.5349598Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T01:02:43.5350521Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2024-12-18T01:02:43.5351415Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2024-12-18T01:02:43.7367426Z 2024-12-18T01:02:43.7368537Z  2024-12-18T01:02:43.7369072Z  2024-12-18T01:02:43.7369495Z  2024-12-18T01:02:43.7369901Z  2024-12-18T01:02:43.7370272Z  2024-12-18T01:02:43.7370665Z  2024-12-18T01:02:43.7371054Z  2024-12-18T01:02:43.7371432Z  2024-12-18T01:02:43.7372352Z [19,472 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:43.7373454Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:02:43.7374378Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T01:02:43.7375241Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T01:02:43.7376124Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2024-12-18T01:02:43.7377069Z @llvm-project//mlir:VectorToLLVM; 28s local 2024-12-18T01:02:43.7377862Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2024-12-18T01:02:43.7378747Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2024-12-18T01:02:43.7379599Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2024-12-18T01:02:44.0692328Z 2024-12-18T01:02:44.0693187Z  2024-12-18T01:02:44.0693657Z  2024-12-18T01:02:44.0694040Z  2024-12-18T01:02:44.0694439Z  2024-12-18T01:02:44.0694824Z  2024-12-18T01:02:44.0695206Z  2024-12-18T01:02:44.0695580Z  2024-12-18T01:02:44.0695944Z  2024-12-18T01:02:44.0697034Z [19,473 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:44.0698034Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:02:44.0698878Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2024-12-18T01:02:44.0699759Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T01:02:44.0700632Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T01:02:44.0701364Z @llvm-project//mlir:VectorToLLVM; 28s local 2024-12-18T01:02:44.0702173Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2024-12-18T01:02:44.0703007Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2024-12-18T01:02:44.0703803Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2024-12-18T01:02:44.3344551Z 2024-12-18T01:02:44.3345430Z  2024-12-18T01:02:44.3345899Z  2024-12-18T01:02:44.3346309Z  2024-12-18T01:02:44.3347012Z  2024-12-18T01:02:44.3347401Z  2024-12-18T01:02:44.3347810Z  2024-12-18T01:02:44.3348209Z  2024-12-18T01:02:44.3348614Z  2024-12-18T01:02:44.3349521Z [19,478 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:44.3350653Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:02:44.3351768Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2024-12-18T01:02:44.3352638Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2024-12-18T01:02:44.3353581Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2024-12-18T01:02:44.3354521Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2024-12-18T01:02:44.3355418Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2024-12-18T01:02:44.3356370Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T01:02:44.3357441Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local ... 2024-12-18T01:02:45.3351284Z 2024-12-18T01:02:45.3352128Z  2024-12-18T01:02:45.3352617Z  2024-12-18T01:02:45.3353349Z  2024-12-18T01:02:45.3353745Z  2024-12-18T01:02:45.3354165Z  2024-12-18T01:02:45.3354574Z  2024-12-18T01:02:45.3354968Z  2024-12-18T01:02:45.3355310Z  2024-12-18T01:02:45.3356247Z [19,478 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:45.3357511Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2024-12-18T01:02:45.3358454Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2024-12-18T01:02:45.3359390Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2024-12-18T01:02:45.3360306Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2024-12-18T01:02:45.3361170Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2024-12-18T01:02:45.3362009Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2024-12-18T01:02:45.3362924Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T01:02:45.3363954Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local ... 2024-12-18T01:02:46.0773712Z 2024-12-18T01:02:46.0774546Z  2024-12-18T01:02:46.0775025Z  2024-12-18T01:02:46.0775423Z  2024-12-18T01:02:46.0775824Z  2024-12-18T01:02:46.0776264Z  2024-12-18T01:02:46.0776982Z  2024-12-18T01:02:46.0777338Z  2024-12-18T01:02:46.0777742Z  2024-12-18T01:02:46.0778696Z [19,479 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:46.0779812Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T01:02:46.0780759Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2024-12-18T01:02:46.0781735Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T01:02:46.0782706Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T01:02:46.0783705Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2024-12-18T01:02:46.0784671Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2024-12-18T01:02:46.0785675Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T01:02:46.0786832Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local ... 2024-12-18T01:02:46.3359537Z 2024-12-18T01:02:46.3360442Z  2024-12-18T01:02:46.3360890Z  2024-12-18T01:02:46.3361265Z  2024-12-18T01:02:46.3361663Z  2024-12-18T01:02:46.3362031Z  2024-12-18T01:02:46.3362387Z  2024-12-18T01:02:46.3362775Z  2024-12-18T01:02:46.3363134Z  2024-12-18T01:02:46.3364025Z [19,480 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:46.3365050Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T01:02:46.3366153Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2024-12-18T01:02:46.3367045Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2024-12-18T01:02:46.3367905Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T01:02:46.3368779Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2024-12-18T01:02:46.3369654Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2024-12-18T01:02:46.3370737Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T01:02:46.3371896Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local ... 2024-12-18T01:02:46.5362095Z 2024-12-18T01:02:46.5362934Z  2024-12-18T01:02:46.5363416Z  2024-12-18T01:02:46.5363811Z  2024-12-18T01:02:46.5364176Z  2024-12-18T01:02:46.5364538Z  2024-12-18T01:02:46.5364921Z  2024-12-18T01:02:46.5365316Z  2024-12-18T01:02:46.5365694Z  2024-12-18T01:02:46.5366614Z [19,482 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:46.5367972Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T01:02:46.5368815Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2024-12-18T01:02:46.5369688Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T01:02:46.5370541Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2024-12-18T01:02:46.5371409Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2024-12-18T01:02:46.5372376Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2024-12-18T01:02:46.5373287Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T01:02:46.5374346Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local ... 2024-12-18T01:02:46.8677252Z 2024-12-18T01:02:46.8678142Z  2024-12-18T01:02:46.8678609Z  2024-12-18T01:02:46.8678991Z  2024-12-18T01:02:46.8679417Z  2024-12-18T01:02:46.8679873Z  2024-12-18T01:02:46.8680246Z  2024-12-18T01:02:46.8680624Z  2024-12-18T01:02:46.8681043Z  2024-12-18T01:02:46.8682003Z [19,485 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:46.8683068Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T01:02:46.8683965Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2024-12-18T01:02:46.8684804Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T01:02:46.8685658Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T01:02:46.8686549Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T01:02:46.8687454Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2024-12-18T01:02:46.8688364Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T01:02:46.8689402Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local ... 2024-12-18T01:02:47.1366908Z 2024-12-18T01:02:47.1367802Z  2024-12-18T01:02:47.1368257Z  2024-12-18T01:02:47.1368654Z  2024-12-18T01:02:47.1369110Z  2024-12-18T01:02:47.1369544Z  2024-12-18T01:02:47.1369951Z  2024-12-18T01:02:47.1370374Z  2024-12-18T01:02:47.1370771Z  2024-12-18T01:02:47.1371755Z [19,485 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:47.1372901Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T01:02:47.1373843Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2024-12-18T01:02:47.1374777Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2024-12-18T01:02:47.1375688Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2024-12-18T01:02:47.1376745Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2024-12-18T01:02:47.1377534Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2024-12-18T01:02:47.1378806Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T01:02:47.1379888Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local ... 2024-12-18T01:02:48.1377061Z 2024-12-18T01:02:48.1377902Z  2024-12-18T01:02:48.1378460Z  2024-12-18T01:02:48.1378938Z  2024-12-18T01:02:48.1379419Z  2024-12-18T01:02:48.1379895Z  2024-12-18T01:02:48.1380643Z  2024-12-18T01:02:48.1381107Z  2024-12-18T01:02:48.1381568Z  2024-12-18T01:02:48.1382634Z [19,485 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:48.1383808Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T01:02:48.1384945Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T01:02:48.1385982Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T01:02:48.1387014Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T01:02:48.1388039Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T01:02:48.1389259Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2024-12-18T01:02:48.1390548Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 26s local 2024-12-18T01:02:48.1391942Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local ... 2024-12-18T01:02:48.3988363Z 2024-12-18T01:02:48.3989210Z  2024-12-18T01:02:48.3989712Z  2024-12-18T01:02:48.3990085Z  2024-12-18T01:02:48.3990521Z  2024-12-18T01:02:48.3991111Z  2024-12-18T01:02:48.3991443Z  2024-12-18T01:02:48.3991767Z  2024-12-18T01:02:48.3992092Z  2024-12-18T01:02:48.3992848Z [19,486 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:48.3993717Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T01:02:48.3994585Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T01:02:48.3995354Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2024-12-18T01:02:48.3996092Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T01:02:48.3996835Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T01:02:48.3997544Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2024-12-18T01:02:48.3998307Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T01:02:48.3999194Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local ... 2024-12-18T01:02:48.6046029Z 2024-12-18T01:02:48.6046865Z  2024-12-18T01:02:48.6047340Z  2024-12-18T01:02:48.6047743Z  2024-12-18T01:02:48.6048114Z  2024-12-18T01:02:48.6048493Z  2024-12-18T01:02:48.6048903Z  2024-12-18T01:02:48.6049287Z  2024-12-18T01:02:48.6049669Z  2024-12-18T01:02:48.6050525Z [19,487 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:48.6051609Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T01:02:48.6052556Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T01:02:48.6053433Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2024-12-18T01:02:48.6054332Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2024-12-18T01:02:48.6055148Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2024-12-18T01:02:48.6056070Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T01:02:48.6057270Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2024-12-18T01:02:48.6058276Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local ... 2024-12-18T01:02:48.9385663Z 2024-12-18T01:02:48.9386512Z  2024-12-18T01:02:48.9386956Z  2024-12-18T01:02:48.9387321Z  2024-12-18T01:02:48.9387686Z  2024-12-18T01:02:48.9388022Z  2024-12-18T01:02:48.9388738Z  2024-12-18T01:02:48.9389116Z  2024-12-18T01:02:48.9389485Z  2024-12-18T01:02:48.9390400Z [19,487 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:48.9391426Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T01:02:48.9392319Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T01:02:48.9393404Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T01:02:48.9394282Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T01:02:48.9395056Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2024-12-18T01:02:48.9395801Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T01:02:48.9396733Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2024-12-18T01:02:48.9397681Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local ... 2024-12-18T01:02:49.3389889Z 2024-12-18T01:02:49.3390687Z  2024-12-18T01:02:49.3391160Z  2024-12-18T01:02:49.3391563Z  2024-12-18T01:02:49.3392329Z  2024-12-18T01:02:49.3392751Z  2024-12-18T01:02:49.3393143Z  2024-12-18T01:02:49.3393535Z  2024-12-18T01:02:49.3393904Z  2024-12-18T01:02:49.3394857Z [19,489 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:49.3396015Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T01:02:49.3397151Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2024-12-18T01:02:49.3398061Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T01:02:49.3398970Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T01:02:49.3399886Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2024-12-18T01:02:49.3400800Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T01:02:49.3401794Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2024-12-18T01:02:49.3402834Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2024-12-18T01:02:49.5394677Z 2024-12-18T01:02:49.5395526Z  2024-12-18T01:02:49.5395979Z  2024-12-18T01:02:49.5396393Z  2024-12-18T01:02:49.5396807Z  2024-12-18T01:02:49.5397220Z  2024-12-18T01:02:49.5397662Z  2024-12-18T01:02:49.5398056Z  2024-12-18T01:02:49.5398474Z  2024-12-18T01:02:49.5399475Z [19,490 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:49.5400642Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T01:02:49.5401673Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T01:02:49.5402598Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T01:02:49.5403545Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2024-12-18T01:02:49.5404478Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2024-12-18T01:02:49.5405467Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T01:02:49.5406555Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2024-12-18T01:02:49.5407616Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2024-12-18T01:02:49.7624219Z 2024-12-18T01:02:49.7625135Z  2024-12-18T01:02:49.7625624Z  2024-12-18T01:02:49.7626047Z  2024-12-18T01:02:49.7626439Z  2024-12-18T01:02:49.7626877Z  2024-12-18T01:02:49.7627304Z  2024-12-18T01:02:49.7627704Z  2024-12-18T01:02:49.7628101Z  2024-12-18T01:02:49.7629066Z [19,491 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:49.7630221Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T01:02:49.7631254Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T01:02:49.7632487Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2024-12-18T01:02:49.7633466Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T01:02:49.7634397Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2024-12-18T01:02:49.7635378Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T01:02:49.7636475Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2024-12-18T01:02:49.7637648Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2024-12-18T01:02:50.0319220Z 2024-12-18T01:02:50.0320083Z  2024-12-18T01:02:50.0320569Z  2024-12-18T01:02:50.0320983Z  2024-12-18T01:02:50.0321413Z  2024-12-18T01:02:50.0321828Z  2024-12-18T01:02:50.0322237Z  2024-12-18T01:02:50.0322643Z  2024-12-18T01:02:50.0323026Z  2024-12-18T01:02:50.0324028Z [19,494 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:50.0325133Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T01:02:50.0326337Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T01:02:50.0327326Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T01:02:50.0328262Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T01:02:50.0329123Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:02:50.0330191Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T01:02:50.0331227Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2024-12-18T01:02:50.0332276Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2024-12-18T01:02:50.3401391Z 2024-12-18T01:02:50.3402247Z  2024-12-18T01:02:50.3402709Z  2024-12-18T01:02:50.3403111Z  2024-12-18T01:02:50.3403504Z  2024-12-18T01:02:50.3403871Z  2024-12-18T01:02:50.3404293Z  2024-12-18T01:02:50.3404693Z  2024-12-18T01:02:50.3405075Z  2024-12-18T01:02:50.3405966Z [19,494 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:50.3407021Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T01:02:50.3407989Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2024-12-18T01:02:50.3408853Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T01:02:50.3409730Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T01:02:50.3410572Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:02:50.3411509Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T01:02:50.3412585Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2024-12-18T01:02:50.3413640Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local ... 2024-12-18T01:02:50.5659989Z 2024-12-18T01:02:50.5660795Z  2024-12-18T01:02:50.5661277Z  2024-12-18T01:02:50.5661691Z  2024-12-18T01:02:50.5662113Z  2024-12-18T01:02:50.5662501Z  2024-12-18T01:02:50.5662868Z  2024-12-18T01:02:50.5663256Z  2024-12-18T01:02:50.5663655Z  2024-12-18T01:02:50.5664618Z [19,496 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:50.5665761Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T01:02:50.5666730Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2024-12-18T01:02:50.5667625Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2024-12-18T01:02:50.5668565Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2024-12-18T01:02:50.5669455Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:02:50.5670373Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T01:02:50.5671704Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2024-12-18T01:02:50.5672730Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local ... 2024-12-18T01:02:50.9408142Z 2024-12-18T01:02:50.9408971Z  2024-12-18T01:02:50.9409460Z  2024-12-18T01:02:50.9409852Z  2024-12-18T01:02:50.9410243Z  2024-12-18T01:02:50.9410619Z  2024-12-18T01:02:50.9411017Z  2024-12-18T01:02:50.9411722Z  2024-12-18T01:02:50.9412274Z  2024-12-18T01:02:50.9413281Z [19,498 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:50.9414376Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T01:02:50.9415370Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2024-12-18T01:02:50.9416275Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T01:02:50.9417360Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T01:02:50.9418316Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:02:50.9419485Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T01:02:50.9420558Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2024-12-18T01:02:50.9421642Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local ... 2024-12-18T01:02:51.1411599Z 2024-12-18T01:02:51.1412492Z  2024-12-18T01:02:51.1412985Z  2024-12-18T01:02:51.1413412Z  2024-12-18T01:02:51.1413843Z  2024-12-18T01:02:51.1414267Z  2024-12-18T01:02:51.1414950Z  2024-12-18T01:02:51.1415384Z  2024-12-18T01:02:51.1415795Z  2024-12-18T01:02:51.1417136Z [19,499 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:51.1418344Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T01:02:51.1419406Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2024-12-18T01:02:51.1420400Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T01:02:51.1421496Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T01:02:51.1422340Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2024-12-18T01:02:51.1423259Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T01:02:51.1424240Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2024-12-18T01:02:51.1425146Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local ... 2024-12-18T01:02:51.5536565Z 2024-12-18T01:02:51.5537408Z  2024-12-18T01:02:51.5537866Z  2024-12-18T01:02:51.5538285Z  2024-12-18T01:02:51.5538692Z  2024-12-18T01:02:51.5539091Z  2024-12-18T01:02:51.5539478Z  2024-12-18T01:02:51.5539869Z  2024-12-18T01:02:51.5540284Z  2024-12-18T01:02:51.5541239Z [19,500 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:51.5542391Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T01:02:51.5543419Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T01:02:51.5544591Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2024-12-18T01:02:51.5545547Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2024-12-18T01:02:51.5546486Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2024-12-18T01:02:51.5547463Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T01:02:51.5548536Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2024-12-18T01:02:51.5549559Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local ... 2024-12-18T01:02:51.9418320Z 2024-12-18T01:02:51.9419202Z  2024-12-18T01:02:51.9419683Z  2024-12-18T01:02:51.9420060Z  2024-12-18T01:02:51.9420437Z  2024-12-18T01:02:51.9420819Z  2024-12-18T01:02:51.9421522Z  2024-12-18T01:02:51.9421920Z  2024-12-18T01:02:51.9422307Z  2024-12-18T01:02:51.9423179Z [19,501 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:51.9424243Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T01:02:51.9425194Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T01:02:51.9426416Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2024-12-18T01:02:51.9427337Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T01:02:51.9428219Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2024-12-18T01:02:51.9429155Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T01:02:51.9430195Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:02:51.9431166Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local ... 2024-12-18T01:02:52.1421539Z 2024-12-18T01:02:52.1422434Z  2024-12-18T01:02:52.1422913Z  2024-12-18T01:02:52.1423308Z  2024-12-18T01:02:52.1423712Z  2024-12-18T01:02:52.1424416Z  2024-12-18T01:02:52.1424836Z  2024-12-18T01:02:52.1425224Z  2024-12-18T01:02:52.1425617Z  2024-12-18T01:02:52.1426564Z [19,502 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:52.1427712Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T01:02:52.1428826Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T01:02:52.1429756Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2024-12-18T01:02:52.1430678Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T01:02:52.1431586Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2024-12-18T01:02:52.1432535Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T01:02:52.1433573Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:02:52.1434461Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local ... 2024-12-18T01:02:52.3993148Z 2024-12-18T01:02:52.3993974Z  2024-12-18T01:02:52.3994432Z  2024-12-18T01:02:52.3994843Z  2024-12-18T01:02:52.3995376Z  2024-12-18T01:02:52.3995746Z  2024-12-18T01:02:52.3996125Z  2024-12-18T01:02:52.3996564Z  2024-12-18T01:02:52.3996957Z  2024-12-18T01:02:52.3997882Z [19,503 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:52.3999007Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T01:02:52.3999976Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2024-12-18T01:02:52.4000911Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2024-12-18T01:02:52.4001835Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T01:02:52.4002759Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2024-12-18T01:02:52.4003729Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T01:02:52.4004742Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:02:52.4005723Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local ... 2024-12-18T01:02:52.7427735Z 2024-12-18T01:02:52.7428645Z  2024-12-18T01:02:52.7429131Z  2024-12-18T01:02:52.7429543Z  2024-12-18T01:02:52.7429952Z  2024-12-18T01:02:52.7430323Z  2024-12-18T01:02:52.7430700Z  2024-12-18T01:02:52.7431052Z  2024-12-18T01:02:52.7431417Z  2024-12-18T01:02:52.7432360Z [19,503 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:52.7433447Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:02:52.7434389Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T01:02:52.7435518Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2024-12-18T01:02:52.7436350Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2024-12-18T01:02:52.7437263Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2024-12-18T01:02:52.7438213Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T01:02:52.7439239Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2024-12-18T01:02:52.7440346Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local ... 2024-12-18T01:02:52.9430936Z 2024-12-18T01:02:52.9431807Z  2024-12-18T01:02:52.9432237Z  2024-12-18T01:02:52.9432630Z  2024-12-18T01:02:52.9433002Z  2024-12-18T01:02:52.9433380Z  2024-12-18T01:02:52.9433754Z  2024-12-18T01:02:52.9434121Z  2024-12-18T01:02:52.9434503Z  2024-12-18T01:02:52.9435432Z [19,505 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:52.9436477Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:02:52.9437715Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T01:02:52.9438558Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T01:02:52.9439398Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2024-12-18T01:02:52.9440304Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2024-12-18T01:02:52.9441150Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T01:02:52.9442416Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T01:02:52.9443560Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local ... 2024-12-18T01:02:53.2066465Z 2024-12-18T01:02:53.2067271Z  2024-12-18T01:02:53.2067737Z  2024-12-18T01:02:53.2068294Z  2024-12-18T01:02:53.2068638Z  2024-12-18T01:02:53.2069026Z  2024-12-18T01:02:53.2069457Z  2024-12-18T01:02:53.2069849Z  2024-12-18T01:02:53.2070232Z  2024-12-18T01:02:53.2071172Z [19,506 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:53.2072250Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:02:53.2073249Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2024-12-18T01:02:53.2074182Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T01:02:53.2075142Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2024-12-18T01:02:53.2076051Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2024-12-18T01:02:53.2077028Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2024-12-18T01:02:53.2078074Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T01:02:53.2079102Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local ... 2024-12-18T01:02:53.4625615Z 2024-12-18T01:02:53.4626473Z  2024-12-18T01:02:53.4626960Z  2024-12-18T01:02:53.4627356Z  2024-12-18T01:02:53.4627747Z  2024-12-18T01:02:53.4628144Z  2024-12-18T01:02:53.4628504Z  2024-12-18T01:02:53.4628879Z  2024-12-18T01:02:53.4629327Z  2024-12-18T01:02:53.4630261Z [19,507 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:53.4631337Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:02:53.4632307Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T01:02:53.4633167Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T01:02:53.4634069Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2024-12-18T01:02:53.4634944Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2024-12-18T01:02:53.4635870Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2024-12-18T01:02:53.4637235Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T01:02:53.4638254Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local ... 2024-12-18T01:02:53.7439117Z 2024-12-18T01:02:53.7439991Z  2024-12-18T01:02:53.7440467Z  2024-12-18T01:02:53.7440845Z  2024-12-18T01:02:53.7441236Z  2024-12-18T01:02:53.7441573Z  2024-12-18T01:02:53.7441959Z  2024-12-18T01:02:53.7442650Z  2024-12-18T01:02:53.7443045Z  2024-12-18T01:02:53.7443991Z [19,508 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:53.7445329Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2024-12-18T01:02:53.7446329Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T01:02:53.7447254Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2024-12-18T01:02:53.7448144Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2024-12-18T01:02:53.7448978Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2024-12-18T01:02:53.7450081Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2024-12-18T01:02:53.7451119Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T01:02:53.7452134Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local ... 2024-12-18T01:02:54.0162286Z 2024-12-18T01:02:54.0163187Z  2024-12-18T01:02:54.0163682Z  2024-12-18T01:02:54.0164096Z  2024-12-18T01:02:54.0164491Z  2024-12-18T01:02:54.0164892Z  2024-12-18T01:02:54.0165541Z  2024-12-18T01:02:54.0165962Z  2024-12-18T01:02:54.0166367Z  2024-12-18T01:02:54.0167250Z [19,509 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:54.0168332Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2024-12-18T01:02:54.0169299Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T01:02:54.0170177Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T01:02:54.0171109Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T01:02:54.0171977Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2024-12-18T01:02:54.0172896Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T01:02:54.0173826Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2024-12-18T01:02:54.0174818Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2024-12-18T01:02:54.2613940Z 2024-12-18T01:02:54.2614820Z  2024-12-18T01:02:54.2615292Z  2024-12-18T01:02:54.2615688Z  2024-12-18T01:02:54.2616055Z  2024-12-18T01:02:54.2616570Z  2024-12-18T01:02:54.2616967Z  2024-12-18T01:02:54.2617361Z  2024-12-18T01:02:54.2617750Z  2024-12-18T01:02:54.2618708Z [19,510 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:54.2619806Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2024-12-18T01:02:54.2620728Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2024-12-18T01:02:54.2621624Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T01:02:54.2622543Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T01:02:54.2623556Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T01:02:54.2624563Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T01:02:54.2625570Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2024-12-18T01:02:54.2626532Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 17s local ... 2024-12-18T01:02:54.5450070Z 2024-12-18T01:02:54.5450942Z  2024-12-18T01:02:54.5451411Z  2024-12-18T01:02:54.5451822Z  2024-12-18T01:02:54.5452210Z  2024-12-18T01:02:54.5452604Z  2024-12-18T01:02:54.5452990Z  2024-12-18T01:02:54.5453735Z  2024-12-18T01:02:54.5454127Z  2024-12-18T01:02:54.5455083Z [19,510 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:54.5456197Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2024-12-18T01:02:54.5457393Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2024-12-18T01:02:54.5458311Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T01:02:54.5459428Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2024-12-18T01:02:54.5460453Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T01:02:54.5461398Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T01:02:54.5462391Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2024-12-18T01:02:54.5463329Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local ... 2024-12-18T01:02:54.7453514Z 2024-12-18T01:02:54.7454381Z  2024-12-18T01:02:54.7454914Z  2024-12-18T01:02:54.7455328Z  2024-12-18T01:02:54.7455717Z  2024-12-18T01:02:54.7456519Z  2024-12-18T01:02:54.7456946Z  2024-12-18T01:02:54.7457329Z  2024-12-18T01:02:54.7457703Z  2024-12-18T01:02:54.7458608Z [19,512 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:54.7459712Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2024-12-18T01:02:54.7460688Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2024-12-18T01:02:54.7461731Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2024-12-18T01:02:54.7462609Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T01:02:54.7463567Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2024-12-18T01:02:54.7464467Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T01:02:54.7465431Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2024-12-18T01:02:54.7466393Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local ... 2024-12-18T01:02:55.1457374Z 2024-12-18T01:02:55.1458201Z  2024-12-18T01:02:55.1458673Z  2024-12-18T01:02:55.1459037Z  2024-12-18T01:02:55.1459409Z  2024-12-18T01:02:55.1459807Z  2024-12-18T01:02:55.1460218Z  2024-12-18T01:02:55.1460582Z  2024-12-18T01:02:55.1460984Z  2024-12-18T01:02:55.1461939Z [19,513 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:55.1463039Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2024-12-18T01:02:55.1463961Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2024-12-18T01:02:55.1464845Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T01:02:55.1465720Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T01:02:55.1466740Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T01:02:55.1467705Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2024-12-18T01:02:55.1468646Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local 2024-12-18T01:02:55.1469612Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local ... 2024-12-18T01:02:55.6226855Z 2024-12-18T01:02:55.6227727Z  2024-12-18T01:02:55.6228215Z  2024-12-18T01:02:55.6228611Z  2024-12-18T01:02:55.6229017Z  2024-12-18T01:02:55.6229385Z  2024-12-18T01:02:55.6229773Z  2024-12-18T01:02:55.6230166Z  2024-12-18T01:02:55.6230530Z  2024-12-18T01:02:55.6231429Z [19,514 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:55.6232514Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T01:02:55.6233480Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T01:02:55.6234624Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2024-12-18T01:02:55.6235531Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2024-12-18T01:02:55.6236534Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2024-12-18T01:02:55.6237527Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T01:02:55.6238453Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local 2024-12-18T01:02:55.6239543Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local ... 2024-12-18T01:02:55.8287090Z 2024-12-18T01:02:55.8287914Z  2024-12-18T01:02:55.8288404Z  2024-12-18T01:02:55.8288815Z  2024-12-18T01:02:55.8289193Z  2024-12-18T01:02:55.8289598Z  2024-12-18T01:02:55.8289990Z  2024-12-18T01:02:55.8290374Z  2024-12-18T01:02:55.8290729Z  2024-12-18T01:02:55.8291624Z [19,515 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:55.8292801Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T01:02:55.8294039Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T01:02:55.8294944Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:55.8295854Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T01:02:55.8296999Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T01:02:55.8297971Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T01:02:55.8299121Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local 2024-12-18T01:02:55.8300036Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local ... 2024-12-18T01:02:56.1464415Z 2024-12-18T01:02:56.1465237Z  2024-12-18T01:02:56.1465701Z  2024-12-18T01:02:56.1466094Z  2024-12-18T01:02:56.1466494Z  2024-12-18T01:02:56.1466881Z  2024-12-18T01:02:56.1467282Z  2024-12-18T01:02:56.1467672Z  2024-12-18T01:02:56.1468095Z  2024-12-18T01:02:56.1469074Z [19,516 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:56.1470214Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T01:02:56.1471149Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2024-12-18T01:02:56.1472033Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:56.1472990Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T01:02:56.1474016Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T01:02:56.1475034Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2024-12-18T01:02:56.1476044Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2024-12-18T01:02:56.1477009Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local ... 2024-12-18T01:02:56.5468833Z 2024-12-18T01:02:56.5469700Z  2024-12-18T01:02:56.5470201Z  2024-12-18T01:02:56.5470614Z  2024-12-18T01:02:56.5471020Z  2024-12-18T01:02:56.5471431Z  2024-12-18T01:02:56.5471825Z  2024-12-18T01:02:56.5472241Z  2024-12-18T01:02:56.5472661Z  2024-12-18T01:02:56.5473639Z [19,517 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:56.5474781Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T01:02:56.5475808Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T01:02:56.5476724Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:56.5477655Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2024-12-18T01:02:56.5478670Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T01:02:56.5479650Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T01:02:56.5480628Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2024-12-18T01:02:56.5481860Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local ... 2024-12-18T01:02:56.7471218Z 2024-12-18T01:02:56.7472047Z  2024-12-18T01:02:56.7472547Z  2024-12-18T01:02:56.7472934Z  2024-12-18T01:02:56.7473312Z  2024-12-18T01:02:56.7473681Z  2024-12-18T01:02:56.7474064Z  2024-12-18T01:02:56.7474460Z  2024-12-18T01:02:56.7475116Z  2024-12-18T01:02:56.7476100Z [19,518 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:56.7477183Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T01:02:56.7478150Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T01:02:56.7478901Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2024-12-18T01:02:56.7479627Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T01:02:56.7480435Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2024-12-18T01:02:56.7481260Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T01:02:56.7482289Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2024-12-18T01:02:56.7483110Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local ... 2024-12-18T01:02:57.1475297Z 2024-12-18T01:02:57.1476147Z  2024-12-18T01:02:57.1476617Z  2024-12-18T01:02:57.1477024Z  2024-12-18T01:02:57.1477412Z  2024-12-18T01:02:57.1477782Z  2024-12-18T01:02:57.1478149Z  2024-12-18T01:02:57.1478777Z  2024-12-18T01:02:57.1479143Z  2024-12-18T01:02:57.1480049Z [19,519 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:57.1481149Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T01:02:57.1482100Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2024-12-18T01:02:57.1483007Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T01:02:57.1483766Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T01:02:57.1484710Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2024-12-18T01:02:57.1485586Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2024-12-18T01:02:57.1486524Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2024-12-18T01:02:57.1487433Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local ... 2024-12-18T01:02:57.5480010Z 2024-12-18T01:02:57.5480835Z  2024-12-18T01:02:57.5481271Z  2024-12-18T01:02:57.5481653Z  2024-12-18T01:02:57.5482026Z  2024-12-18T01:02:57.5482418Z  2024-12-18T01:02:57.5482808Z  2024-12-18T01:02:57.5483191Z  2024-12-18T01:02:57.5483584Z  2024-12-18T01:02:57.5484505Z [19,522 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:57.5485565Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2024-12-18T01:02:57.5486516Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2024-12-18T01:02:57.5487382Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2024-12-18T01:02:57.5488240Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2024-12-18T01:02:57.5489138Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2024-12-18T01:02:57.5490096Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2024-12-18T01:02:57.5491045Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2024-12-18T01:02:57.5491911Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local ... 2024-12-18T01:02:58.1231485Z 2024-12-18T01:02:58.1232343Z  2024-12-18T01:02:58.1232833Z  2024-12-18T01:02:58.1233266Z  2024-12-18T01:02:58.1233800Z  2024-12-18T01:02:58.1234201Z  2024-12-18T01:02:58.1234598Z  2024-12-18T01:02:58.1234994Z  2024-12-18T01:02:58.1235771Z  2024-12-18T01:02:58.1236730Z [19,523 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:02:58.1237874Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2024-12-18T01:02:58.1238879Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2024-12-18T01:02:58.1239822Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T01:02:58.1240877Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2024-12-18T01:02:58.1241871Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2024-12-18T01:02:58.1242847Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2024-12-18T01:02:58.1243767Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2024-12-18T01:02:58.1244894Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local ... 2024-12-18T01:02:58.3485393Z 2024-12-18T01:02:58.3486246Z  2024-12-18T01:02:58.3486667Z  2024-12-18T01:02:58.3487053Z  2024-12-18T01:02:58.3487403Z  2024-12-18T01:02:58.3487769Z  2024-12-18T01:02:58.3497877Z  2024-12-18T01:02:58.3498632Z  2024-12-18T01:02:58.3499032Z  2024-12-18T01:02:58.3500018Z [19,523 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:58.3501150Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2024-12-18T01:02:58.3502171Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2024-12-18T01:02:58.3503270Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T01:02:58.3504257Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2024-12-18T01:02:58.3505267Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2024-12-18T01:02:58.3506274Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2024-12-18T01:02:58.3507325Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2024-12-18T01:02:58.3508330Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local ... 2024-12-18T01:02:58.7489881Z 2024-12-18T01:02:58.7490808Z  2024-12-18T01:02:58.7491270Z  2024-12-18T01:02:58.7491648Z  2024-12-18T01:02:58.7492013Z  2024-12-18T01:02:58.7492377Z  2024-12-18T01:02:58.7492740Z  2024-12-18T01:02:58.7493101Z  2024-12-18T01:02:58.7493477Z  2024-12-18T01:02:58.7494405Z [19,524 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:58.7495512Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T01:02:58.7496509Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T01:02:58.7497374Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2024-12-18T01:02:58.7498189Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T01:02:58.7499061Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2024-12-18T01:02:58.7499990Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2024-12-18T01:02:58.7500927Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2024-12-18T01:02:58.7501771Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local ... 2024-12-18T01:02:58.9493030Z 2024-12-18T01:02:58.9493922Z  2024-12-18T01:02:58.9494363Z  2024-12-18T01:02:58.9494745Z  2024-12-18T01:02:58.9495167Z  2024-12-18T01:02:58.9495696Z  2024-12-18T01:02:58.9496080Z  2024-12-18T01:02:58.9496604Z  2024-12-18T01:02:58.9497023Z  2024-12-18T01:02:58.9498013Z [19,525 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:58.9499131Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T01:02:58.9500095Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T01:02:58.9501046Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T01:02:58.9502315Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T01:02:58.9503283Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2024-12-18T01:02:58.9504232Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2024-12-18T01:02:58.9505170Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2024-12-18T01:02:58.9506271Z Compiling xla/pjrt/pjrt_client.cc; 17s local ... 2024-12-18T01:02:59.3497601Z 2024-12-18T01:02:59.3498437Z  2024-12-18T01:02:59.3498904Z  2024-12-18T01:02:59.3499323Z  2024-12-18T01:02:59.3499728Z  2024-12-18T01:02:59.3500136Z  2024-12-18T01:02:59.3500540Z  2024-12-18T01:02:59.3500937Z  2024-12-18T01:02:59.3501313Z  2024-12-18T01:02:59.3502254Z [19,527 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:59.3503353Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T01:02:59.3504335Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2024-12-18T01:02:59.3505626Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2024-12-18T01:02:59.3506634Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T01:02:59.3507573Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T01:02:59.3508478Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2024-12-18T01:02:59.3509359Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2024-12-18T01:02:59.3510356Z Compiling xla/pjrt/pjrt_client.cc; 18s local ... 2024-12-18T01:02:59.7501516Z 2024-12-18T01:02:59.7502421Z  2024-12-18T01:02:59.7502857Z  2024-12-18T01:02:59.7503254Z  2024-12-18T01:02:59.7503645Z  2024-12-18T01:02:59.7504038Z  2024-12-18T01:02:59.7504381Z  2024-12-18T01:02:59.7504769Z  2024-12-18T01:02:59.7505158Z  2024-12-18T01:02:59.7506082Z [19,528 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:02:59.7507240Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2024-12-18T01:02:59.7508151Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T01:02:59.7509130Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T01:02:59.7510098Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2024-12-18T01:02:59.7511070Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T01:02:59.7512043Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2024-12-18T01:02:59.7512967Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2024-12-18T01:02:59.7513701Z Compiling xla/pjrt/pjrt_client.cc; 18s local ... 2024-12-18T01:03:00.0484998Z 2024-12-18T01:03:00.0485856Z  2024-12-18T01:03:00.0486329Z  2024-12-18T01:03:00.0486725Z  2024-12-18T01:03:00.0487120Z  2024-12-18T01:03:00.0487510Z  2024-12-18T01:03:00.0487852Z  2024-12-18T01:03:00.0488237Z  2024-12-18T01:03:00.0488653Z  2024-12-18T01:03:00.0489569Z [19,529 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:00.0490595Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2024-12-18T01:03:00.0491557Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T01:03:00.0492543Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T01:03:00.0493476Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T01:03:00.0494452Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2024-12-18T01:03:00.0495337Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2024-12-18T01:03:00.0496181Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2024-12-18T01:03:00.0497124Z Compiling xla/pjrt/pjrt_client.cc; 18s local ... 2024-12-18T01:03:00.3507123Z 2024-12-18T01:03:00.3507989Z  2024-12-18T01:03:00.3508440Z  2024-12-18T01:03:00.3508837Z  2024-12-18T01:03:00.3509228Z  2024-12-18T01:03:00.3509635Z  2024-12-18T01:03:00.3510011Z  2024-12-18T01:03:00.3510356Z  2024-12-18T01:03:00.3510722Z  2024-12-18T01:03:00.3511607Z [19,529 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:00.3512981Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2024-12-18T01:03:00.3513931Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2024-12-18T01:03:00.3514885Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T01:03:00.3515896Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T01:03:00.3516793Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T01:03:00.3517721Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2024-12-18T01:03:00.3518526Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2024-12-18T01:03:00.3519531Z Compiling xla/pjrt/pjrt_client.cc; 19s local ... 2024-12-18T01:03:00.6469133Z 2024-12-18T01:03:00.6469990Z  2024-12-18T01:03:00.6470451Z  2024-12-18T01:03:00.6470866Z  2024-12-18T01:03:00.6471270Z  2024-12-18T01:03:00.6471653Z  2024-12-18T01:03:00.6472061Z  2024-12-18T01:03:00.6472452Z  2024-12-18T01:03:00.6472818Z  2024-12-18T01:03:00.6473963Z [19,530 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:00.6475040Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T01:03:00.6476003Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2024-12-18T01:03:00.6476998Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2024-12-18T01:03:00.6478024Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2024-12-18T01:03:00.6479003Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T01:03:00.6480002Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2024-12-18T01:03:00.6480902Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2024-12-18T01:03:00.6481668Z Compiling xla/pjrt/pjrt_client.cc; 19s local ... 2024-12-18T01:03:00.9512056Z 2024-12-18T01:03:00.9512922Z  2024-12-18T01:03:00.9513395Z  2024-12-18T01:03:00.9513780Z  2024-12-18T01:03:00.9514150Z  2024-12-18T01:03:00.9514523Z  2024-12-18T01:03:00.9514902Z  2024-12-18T01:03:00.9515265Z  2024-12-18T01:03:00.9515641Z  2024-12-18T01:03:00.9516513Z [19,530 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:00.9517559Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T01:03:00.9518433Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2024-12-18T01:03:00.9519367Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2024-12-18T01:03:00.9520300Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T01:03:00.9521227Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2024-12-18T01:03:00.9522189Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2024-12-18T01:03:00.9523067Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2024-12-18T01:03:00.9523827Z Compiling xla/pjrt/pjrt_client.cc; 19s local ... 2024-12-18T01:03:01.5836455Z 2024-12-18T01:03:01.5837335Z  2024-12-18T01:03:01.5837798Z  2024-12-18T01:03:01.5838191Z  2024-12-18T01:03:01.5838572Z  2024-12-18T01:03:01.5838957Z  2024-12-18T01:03:01.5839293Z  2024-12-18T01:03:01.5839669Z  2024-12-18T01:03:01.5840062Z  2024-12-18T01:03:01.5841010Z [19,531 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:01.5842330Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T01:03:01.5843298Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2024-12-18T01:03:01.5844512Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2024-12-18T01:03:01.5845724Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T01:03:01.5846888Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2024-12-18T01:03:01.5847764Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2024-12-18T01:03:01.5848517Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2024-12-18T01:03:01.5849363Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2024-12-18T01:03:01.9518885Z 2024-12-18T01:03:01.9519742Z  2024-12-18T01:03:01.9520233Z  2024-12-18T01:03:01.9520648Z  2024-12-18T01:03:01.9521054Z  2024-12-18T01:03:01.9521458Z  2024-12-18T01:03:01.9521897Z  2024-12-18T01:03:01.9522290Z  2024-12-18T01:03:01.9522708Z  2024-12-18T01:03:01.9523931Z [19,533 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:01.9525076Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T01:03:01.9526225Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T01:03:01.9527258Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T01:03:01.9528392Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2024-12-18T01:03:01.9529392Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2024-12-18T01:03:01.9530295Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2024-12-18T01:03:01.9531003Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2024-12-18T01:03:01.9531857Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2024-12-18T01:03:02.3119906Z 2024-12-18T01:03:02.3120774Z  2024-12-18T01:03:02.3121240Z  2024-12-18T01:03:02.3121626Z  2024-12-18T01:03:02.3122014Z  2024-12-18T01:03:02.3122415Z  2024-12-18T01:03:02.3122806Z  2024-12-18T01:03:02.3123193Z  2024-12-18T01:03:02.3123565Z  2024-12-18T01:03:02.3124477Z [19,534 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:02.3125538Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T01:03:02.3126473Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T01:03:02.3127448Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T01:03:02.3128409Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T01:03:02.3129376Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2024-12-18T01:03:02.3130305Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2024-12-18T01:03:02.3131101Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2024-12-18T01:03:02.3132022Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2024-12-18T01:03:02.5524199Z 2024-12-18T01:03:02.5525063Z  2024-12-18T01:03:02.5525502Z  2024-12-18T01:03:02.5525847Z  2024-12-18T01:03:02.5526203Z  2024-12-18T01:03:02.5526545Z  2024-12-18T01:03:02.5526868Z  2024-12-18T01:03:02.5527251Z  2024-12-18T01:03:02.5527645Z  2024-12-18T01:03:02.5528570Z [19,534 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:02.5529656Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T01:03:02.5530598Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2024-12-18T01:03:02.5531565Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2024-12-18T01:03:02.5532502Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T01:03:02.5533459Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2024-12-18T01:03:02.5534594Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:03:02.5535333Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2024-12-18T01:03:02.5536197Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local ... 2024-12-18T01:03:02.9453943Z 2024-12-18T01:03:02.9454818Z  2024-12-18T01:03:02.9455611Z  2024-12-18T01:03:02.9456007Z  2024-12-18T01:03:02.9456632Z  2024-12-18T01:03:02.9457051Z  2024-12-18T01:03:02.9457450Z  2024-12-18T01:03:02.9457838Z  2024-12-18T01:03:02.9458203Z  2024-12-18T01:03:02.9459078Z [19,537 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:02.9460135Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T01:03:02.9461102Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T01:03:02.9462077Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T01:03:02.9463225Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T01:03:02.9464214Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2024-12-18T01:03:02.9465152Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:03:02.9465920Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2024-12-18T01:03:02.9466860Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local ... 2024-12-18T01:03:03.1483334Z 2024-12-18T01:03:03.1484210Z  2024-12-18T01:03:03.1484921Z  2024-12-18T01:03:03.1485324Z  2024-12-18T01:03:03.1485703Z  2024-12-18T01:03:03.1486057Z  2024-12-18T01:03:03.1486411Z  2024-12-18T01:03:03.1486795Z  2024-12-18T01:03:03.1487170Z  2024-12-18T01:03:03.1487998Z [19,539 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:03.1489039Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T01:03:03.1489972Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T01:03:03.1490905Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T01:03:03.1491785Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2024-12-18T01:03:03.1492758Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2024-12-18T01:03:03.1493518Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:03:03.1494186Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2024-12-18T01:03:03.1495027Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local ... 2024-12-18T01:03:03.3530337Z 2024-12-18T01:03:03.3531235Z  2024-12-18T01:03:03.3531717Z  2024-12-18T01:03:03.3532120Z  2024-12-18T01:03:03.3532482Z  2024-12-18T01:03:03.3532854Z  2024-12-18T01:03:03.3533243Z  2024-12-18T01:03:03.3533629Z  2024-12-18T01:03:03.3534049Z  2024-12-18T01:03:03.3535025Z [19,541 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:03:03.3536117Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T01:03:03.3537247Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T01:03:03.3538189Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T01:03:03.3539199Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T01:03:03.3540170Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2024-12-18T01:03:03.3541033Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2024-12-18T01:03:03.3541818Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T01:03:03.3542769Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local ... 2024-12-18T01:03:03.5533584Z 2024-12-18T01:03:03.5534406Z  2024-12-18T01:03:03.5534877Z  2024-12-18T01:03:03.5535616Z  2024-12-18T01:03:03.5536003Z  2024-12-18T01:03:03.5536532Z  2024-12-18T01:03:03.5536929Z  2024-12-18T01:03:03.5537349Z  2024-12-18T01:03:03.5537721Z  2024-12-18T01:03:03.5538803Z [19,543 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:03.5539939Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:03:03.5541148Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2024-12-18T01:03:03.5542191Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2024-12-18T01:03:03.5543250Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T01:03:03.5544695Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2024-12-18T01:03:03.5545662Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2024-12-18T01:03:03.5546479Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T01:03:03.5547413Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2024-12-18T01:03:03.9273594Z 2024-12-18T01:03:03.9274750Z  2024-12-18T01:03:03.9275271Z  2024-12-18T01:03:03.9275674Z  2024-12-18T01:03:03.9276058Z  2024-12-18T01:03:03.9276457Z  2024-12-18T01:03:03.9277003Z  2024-12-18T01:03:03.9277407Z  2024-12-18T01:03:03.9277802Z  2024-12-18T01:03:03.9278741Z [19,544 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:03.9279993Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:03:03.9281013Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T01:03:03.9282056Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T01:03:03.9283075Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T01:03:03.9284045Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2024-12-18T01:03:03.9284941Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2024-12-18T01:03:03.9285714Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T01:03:03.9286665Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2024-12-18T01:03:04.1283840Z 2024-12-18T01:03:04.1284586Z  2024-12-18T01:03:04.1285024Z  2024-12-18T01:03:04.1285406Z  2024-12-18T01:03:04.1285795Z  2024-12-18T01:03:04.1286160Z  2024-12-18T01:03:04.1286539Z  2024-12-18T01:03:04.1286900Z  2024-12-18T01:03:04.1287289Z  2024-12-18T01:03:04.1288228Z [19,547 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:04.1289437Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:03:04.1290368Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T01:03:04.1291255Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T01:03:04.1292097Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2024-12-18T01:03:04.1292960Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2024-12-18T01:03:04.1293822Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2024-12-18T01:03:04.1294608Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T01:03:04.1295523Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2024-12-18T01:03:04.3540259Z 2024-12-18T01:03:04.3541123Z  2024-12-18T01:03:04.3541562Z  2024-12-18T01:03:04.3541988Z  2024-12-18T01:03:04.3542376Z  2024-12-18T01:03:04.3542768Z  2024-12-18T01:03:04.3543149Z  2024-12-18T01:03:04.3543632Z  2024-12-18T01:03:04.3543989Z  2024-12-18T01:03:04.3545130Z [19,548 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:04.3546399Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:03:04.3547631Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T01:03:04.3548608Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T01:03:04.3549533Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T01:03:04.3550443Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2024-12-18T01:03:04.3551348Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2024-12-18T01:03:04.3552324Z Compiling xla/pjrt/pjrt_client.cc; 23s local 2024-12-18T01:03:04.3553229Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2024-12-18T01:03:04.5543474Z 2024-12-18T01:03:04.5544540Z  2024-12-18T01:03:04.5545018Z  2024-12-18T01:03:04.5545410Z  2024-12-18T01:03:04.5545786Z  2024-12-18T01:03:04.5546160Z  2024-12-18T01:03:04.5546522Z  2024-12-18T01:03:04.5546897Z  2024-12-18T01:03:04.5547261Z  2024-12-18T01:03:04.5548165Z [19,550 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:04.5549595Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T01:03:04.5550538Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2024-12-18T01:03:04.5551505Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2024-12-18T01:03:04.5552450Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T01:03:04.5553468Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2024-12-18T01:03:04.5554730Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2024-12-18T01:03:04.5555535Z Compiling xla/pjrt/pjrt_client.cc; 23s local 2024-12-18T01:03:04.5556459Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 21s local ... 2024-12-18T01:03:04.9548049Z 2024-12-18T01:03:04.9548890Z  2024-12-18T01:03:04.9549364Z  2024-12-18T01:03:04.9549754Z  2024-12-18T01:03:04.9550187Z  2024-12-18T01:03:04.9550571Z  2024-12-18T01:03:04.9550962Z  2024-12-18T01:03:04.9551356Z  2024-12-18T01:03:04.9551737Z  2024-12-18T01:03:04.9552610Z [19,552 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:04.9553700Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T01:03:04.9554631Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2024-12-18T01:03:04.9555584Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2024-12-18T01:03:04.9556543Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2024-12-18T01:03:04.9557532Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2024-12-18T01:03:04.9558414Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2024-12-18T01:03:04.9559296Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2024-12-18T01:03:04.9560145Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local ... 2024-12-18T01:03:05.9555825Z 2024-12-18T01:03:05.9556670Z  2024-12-18T01:03:05.9557159Z  2024-12-18T01:03:05.9557565Z  2024-12-18T01:03:05.9557937Z  2024-12-18T01:03:05.9558343Z  2024-12-18T01:03:05.9558728Z  2024-12-18T01:03:05.9559116Z  2024-12-18T01:03:05.9559503Z  2024-12-18T01:03:05.9560467Z [19,552 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:05.9561587Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T01:03:05.9562570Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T01:03:05.9563596Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T01:03:05.9564564Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2024-12-18T01:03:05.9565513Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2024-12-18T01:03:05.9566410Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2024-12-18T01:03:05.9567589Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2024-12-18T01:03:05.9568451Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local ... 2024-12-18T01:03:06.1737034Z 2024-12-18T01:03:06.1737886Z  2024-12-18T01:03:06.1738377Z  2024-12-18T01:03:06.1738758Z  2024-12-18T01:03:06.1739138Z  2024-12-18T01:03:06.1739520Z  2024-12-18T01:03:06.1740191Z  2024-12-18T01:03:06.1740559Z  2024-12-18T01:03:06.1740954Z  2024-12-18T01:03:06.1741914Z [19,553 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:06.1743012Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T01:03:06.1743966Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T01:03:06.1745229Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T01:03:06.1746175Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T01:03:06.1747177Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2024-12-18T01:03:06.1748253Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2024-12-18T01:03:06.1749093Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2024-12-18T01:03:06.1749924Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local ... 2024-12-18T01:03:06.5560341Z 2024-12-18T01:03:06.5561258Z  2024-12-18T01:03:06.5561708Z  2024-12-18T01:03:06.5562068Z  2024-12-18T01:03:06.5562428Z  2024-12-18T01:03:06.5563082Z  2024-12-18T01:03:06.5563421Z  2024-12-18T01:03:06.5563763Z  2024-12-18T01:03:06.5564098Z  2024-12-18T01:03:06.5564947Z [19,553 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:06.5565858Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T01:03:06.5566598Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2024-12-18T01:03:06.5567447Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T01:03:06.5568246Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T01:03:06.5569025Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2024-12-18T01:03:06.5569760Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2024-12-18T01:03:06.5570480Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T01:03:06.5571186Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local ... 2024-12-18T01:03:06.7563770Z 2024-12-18T01:03:06.7564642Z  2024-12-18T01:03:06.7565111Z  2024-12-18T01:03:06.7565515Z  2024-12-18T01:03:06.7565904Z  2024-12-18T01:03:06.7566308Z  2024-12-18T01:03:06.7566712Z  2024-12-18T01:03:06.7567080Z  2024-12-18T01:03:06.7567471Z  2024-12-18T01:03:06.7568459Z [19,555 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:06.7569564Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T01:03:06.7570533Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:03:06.7571529Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2024-12-18T01:03:06.7572515Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T01:03:06.7573505Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2024-12-18T01:03:06.7574403Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2024-12-18T01:03:06.7575300Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T01:03:06.7576146Z Compiling xla/pjrt/pjrt_compiler.cc; 20s local ... 2024-12-18T01:03:07.1367104Z 2024-12-18T01:03:07.1367926Z  2024-12-18T01:03:07.1368461Z  2024-12-18T01:03:07.1369020Z  2024-12-18T01:03:07.1369364Z  2024-12-18T01:03:07.1369705Z  2024-12-18T01:03:07.1370029Z  2024-12-18T01:03:07.1370657Z  2024-12-18T01:03:07.1371055Z  2024-12-18T01:03:07.1371958Z [19,557 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:07.1373019Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T01:03:07.1373932Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:03:07.1375078Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T01:03:07.1376028Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2024-12-18T01:03:07.1377163Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T01:03:07.1378048Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2024-12-18T01:03:07.1378910Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T01:03:07.1379885Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local ... 2024-12-18T01:03:07.3568983Z 2024-12-18T01:03:07.3569862Z  2024-12-18T01:03:07.3570357Z  2024-12-18T01:03:07.3570766Z  2024-12-18T01:03:07.3571183Z  2024-12-18T01:03:07.3571807Z  2024-12-18T01:03:07.3572236Z  2024-12-18T01:03:07.3572662Z  2024-12-18T01:03:07.3573084Z  2024-12-18T01:03:07.3574047Z [19,557 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:07.3575181Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T01:03:07.3576544Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:03:07.3577563Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T01:03:07.3578546Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:03:07.3579492Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T01:03:07.3580421Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2024-12-18T01:03:07.3581312Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T01:03:07.3582292Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local ... 2024-12-18T01:03:07.5572334Z 2024-12-18T01:03:07.5573154Z  2024-12-18T01:03:07.5573660Z  2024-12-18T01:03:07.5574087Z  2024-12-18T01:03:07.5574477Z  2024-12-18T01:03:07.5574892Z  2024-12-18T01:03:07.5575287Z  2024-12-18T01:03:07.5575697Z  2024-12-18T01:03:07.5576087Z  2024-12-18T01:03:07.5577226Z [19,558 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:03:07.5578359Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T01:03:07.5579376Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2024-12-18T01:03:07.5580401Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2024-12-18T01:03:07.5581443Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:03:07.5582478Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T01:03:07.5583380Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2024-12-18T01:03:07.5584247Z Compiling xla/pjrt/distributed/topology_util.cc; 24s local 2024-12-18T01:03:07.5585250Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local ... 2024-12-18T01:03:07.8492284Z 2024-12-18T01:03:07.8493131Z  2024-12-18T01:03:07.8493636Z  2024-12-18T01:03:07.8494015Z  2024-12-18T01:03:07.8494387Z  2024-12-18T01:03:07.8494760Z  2024-12-18T01:03:07.8495122Z  2024-12-18T01:03:07.8495508Z  2024-12-18T01:03:07.8495889Z  2024-12-18T01:03:07.8496923Z [19,559 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:07.8497982Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T01:03:07.8498851Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T01:03:07.8500190Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T01:03:07.8501180Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:03:07.8502165Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2024-12-18T01:03:07.8503056Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2024-12-18T01:03:07.8503927Z Compiling xla/pjrt/distributed/topology_util.cc; 24s local 2024-12-18T01:03:07.8505078Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local ... 2024-12-18T01:03:08.1577245Z 2024-12-18T01:03:08.1578167Z  2024-12-18T01:03:08.1578644Z  2024-12-18T01:03:08.1579188Z  2024-12-18T01:03:08.1579609Z  2024-12-18T01:03:08.1580003Z  2024-12-18T01:03:08.1580402Z  2024-12-18T01:03:08.1580797Z  2024-12-18T01:03:08.1581199Z  2024-12-18T01:03:08.1582070Z [19,560 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:08.1583167Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T01:03:08.1584545Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2024-12-18T01:03:08.1585594Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2024-12-18T01:03:08.1586570Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2024-12-18T01:03:08.1587585Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2024-12-18T01:03:08.1588517Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2024-12-18T01:03:08.1589596Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local 2024-12-18T01:03:08.1590493Z Compiling xla/pjrt/pjrt_executable.cc; 17s local ... 2024-12-18T01:03:09.0877173Z 2024-12-18T01:03:09.0877995Z  2024-12-18T01:03:09.0878404Z  2024-12-18T01:03:09.0878748Z  2024-12-18T01:03:09.0879090Z  2024-12-18T01:03:09.0879455Z  2024-12-18T01:03:09.0879797Z  2024-12-18T01:03:09.0880179Z  2024-12-18T01:03:09.0880528Z  2024-12-18T01:03:09.0881445Z [19,561 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:09.0882520Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2024-12-18T01:03:09.0883495Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2024-12-18T01:03:09.0884433Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T01:03:09.0885386Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2024-12-18T01:03:09.0886325Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T01:03:09.0887190Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2024-12-18T01:03:09.0888169Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2024-12-18T01:03:09.0889073Z Compiling xla/pjrt/pjrt_executable.cc; 18s local ... 2024-12-18T01:03:09.3586026Z 2024-12-18T01:03:09.3586909Z  2024-12-18T01:03:09.3587391Z  2024-12-18T01:03:09.3587791Z  2024-12-18T01:03:09.3588148Z  2024-12-18T01:03:09.3588538Z  2024-12-18T01:03:09.3588950Z  2024-12-18T01:03:09.3589329Z  2024-12-18T01:03:09.3589725Z  2024-12-18T01:03:09.3590684Z [19,561 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:09.3591794Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2024-12-18T01:03:09.3592781Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2024-12-18T01:03:09.3593767Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T01:03:09.3594778Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2024-12-18T01:03:09.3595782Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T01:03:09.3596715Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2024-12-18T01:03:09.3597648Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2024-12-18T01:03:09.3598933Z Compiling xla/pjrt/pjrt_executable.cc; 18s local ... 2024-12-18T01:03:09.7590687Z 2024-12-18T01:03:09.7591709Z  2024-12-18T01:03:09.7592200Z  2024-12-18T01:03:09.7592609Z  2024-12-18T01:03:09.7593035Z  2024-12-18T01:03:09.7593449Z  2024-12-18T01:03:09.7593846Z  2024-12-18T01:03:09.7594255Z  2024-12-18T01:03:09.7594654Z  2024-12-18T01:03:09.7595932Z [19,562 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:09.7597124Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T01:03:09.7598145Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T01:03:09.7599160Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2024-12-18T01:03:09.7600062Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2024-12-18T01:03:09.7601056Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2024-12-18T01:03:09.7602001Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2024-12-18T01:03:09.7603134Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2024-12-18T01:03:09.7604055Z Compiling xla/pjrt/pjrt_executable.cc; 19s local ... 2024-12-18T01:03:10.0719491Z 2024-12-18T01:03:10.0720326Z  2024-12-18T01:03:10.0720811Z  2024-12-18T01:03:10.0721231Z  2024-12-18T01:03:10.0721609Z  2024-12-18T01:03:10.0721962Z  2024-12-18T01:03:10.0722350Z  2024-12-18T01:03:10.0722704Z  2024-12-18T01:03:10.0723339Z  2024-12-18T01:03:10.0724258Z [19,563 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:10.0725308Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T01:03:10.0726237Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T01:03:10.0727218Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2024-12-18T01:03:10.0728199Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2024-12-18T01:03:10.0729148Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T01:03:10.0730014Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2024-12-18T01:03:10.0730892Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2024-12-18T01:03:10.0731810Z Compiling xla/pjrt/pjrt_executable.cc; 19s local ... 2024-12-18T01:03:10.3596799Z 2024-12-18T01:03:10.3597680Z  2024-12-18T01:03:10.3598149Z  2024-12-18T01:03:10.3598569Z  2024-12-18T01:03:10.3598987Z  2024-12-18T01:03:10.3599385Z  2024-12-18T01:03:10.3599777Z  2024-12-18T01:03:10.3600175Z  2024-12-18T01:03:10.3600586Z  2024-12-18T01:03:10.3601563Z [19,567 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:10.3602684Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T01:03:10.3603791Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2024-12-18T01:03:10.3604761Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2024-12-18T01:03:10.3605758Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T01:03:10.3606728Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T01:03:10.3607618Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2024-12-18T01:03:10.3608518Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2024-12-18T01:03:10.3609392Z Compiling xla/pjrt/pjrt_executable.cc; 19s local ... 2024-12-18T01:03:10.7601321Z 2024-12-18T01:03:10.7602147Z  2024-12-18T01:03:10.7602613Z  2024-12-18T01:03:10.7603017Z  2024-12-18T01:03:10.7603416Z  2024-12-18T01:03:10.7603791Z  2024-12-18T01:03:10.7604175Z  2024-12-18T01:03:10.7604559Z  2024-12-18T01:03:10.7604975Z  2024-12-18T01:03:10.7606235Z [19,569 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:10.7607332Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T01:03:10.7608166Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T01:03:10.7609058Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2024-12-18T01:03:10.7610153Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T01:03:10.7611133Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2024-12-18T01:03:10.7611998Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2024-12-18T01:03:10.7612704Z Compiling xla/pjrt/pjrt_executable.cc; 20s local 2024-12-18T01:03:10.7613579Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local ... 2024-12-18T01:03:11.0274984Z 2024-12-18T01:03:11.0275972Z  2024-12-18T01:03:11.0276455Z  2024-12-18T01:03:11.0276853Z  2024-12-18T01:03:11.0277275Z  2024-12-18T01:03:11.0277646Z  2024-12-18T01:03:11.0278003Z  2024-12-18T01:03:11.0278378Z  2024-12-18T01:03:11.0279024Z  2024-12-18T01:03:11.0279998Z [19,571 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:11.0281121Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T01:03:11.0282150Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T01:03:11.0283328Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T01:03:11.0284376Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2024-12-18T01:03:11.0285371Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T01:03:11.0286276Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2024-12-18T01:03:11.0287268Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2024-12-18T01:03:11.0288332Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 17s local ... 2024-12-18T01:03:11.3606917Z 2024-12-18T01:03:11.3607773Z  2024-12-18T01:03:11.3608261Z  2024-12-18T01:03:11.3608660Z  2024-12-18T01:03:11.3609027Z  2024-12-18T01:03:11.3609375Z  2024-12-18T01:03:11.3609766Z  2024-12-18T01:03:11.3610137Z  2024-12-18T01:03:11.3610484Z  2024-12-18T01:03:11.3611395Z [19,571 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:11.3612498Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T01:03:11.3613462Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T01:03:11.3614416Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T01:03:11.3615416Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T01:03:11.3616337Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T01:03:11.3617343Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2024-12-18T01:03:11.3618303Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2024-12-18T01:03:11.3619317Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 17s local ... 2024-12-18T01:03:11.6354959Z 2024-12-18T01:03:11.6355841Z  2024-12-18T01:03:11.6356332Z  2024-12-18T01:03:11.6356727Z  2024-12-18T01:03:11.6357172Z  2024-12-18T01:03:11.6357578Z  2024-12-18T01:03:11.6357980Z  2024-12-18T01:03:11.6358393Z  2024-12-18T01:03:11.6358795Z  2024-12-18T01:03:11.6359710Z [19,572 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:11.6360712Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T01:03:11.6361522Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2024-12-18T01:03:11.6362347Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2024-12-18T01:03:11.6363485Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T01:03:11.6364366Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2024-12-18T01:03:11.6365131Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2024-12-18T01:03:11.6366184Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2024-12-18T01:03:11.6367234Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 18s local ... 2024-12-18T01:03:11.9612131Z 2024-12-18T01:03:11.9613000Z  2024-12-18T01:03:11.9613484Z  2024-12-18T01:03:11.9613907Z  2024-12-18T01:03:11.9614316Z  2024-12-18T01:03:11.9614715Z  2024-12-18T01:03:11.9615132Z  2024-12-18T01:03:11.9615515Z  2024-12-18T01:03:11.9615912Z  2024-12-18T01:03:11.9616928Z [19,573 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:11.9617847Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T01:03:11.9618722Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2024-12-18T01:03:11.9619823Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T01:03:11.9620867Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2024-12-18T01:03:11.9621791Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T01:03:11.9622640Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2024-12-18T01:03:11.9623545Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2024-12-18T01:03:11.9624683Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 18s local ... 2024-12-18T01:03:12.7190907Z 2024-12-18T01:03:12.7191721Z  2024-12-18T01:03:12.7192200Z  2024-12-18T01:03:12.7192596Z  2024-12-18T01:03:12.7192968Z  2024-12-18T01:03:12.7193393Z  2024-12-18T01:03:12.7193765Z  2024-12-18T01:03:12.7194116Z  2024-12-18T01:03:12.7194453Z  2024-12-18T01:03:12.7195330Z [19,574 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:12.7196301Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:03:12.7197179Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2024-12-18T01:03:12.7198035Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T01:03:12.7198898Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2024-12-18T01:03:12.7199722Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2024-12-18T01:03:12.7200710Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2024-12-18T01:03:12.7201546Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 19s local 2024-12-18T01:03:12.7202296Z Compiling xla/service/cpu/ir_emitter2.cc; 18s local ... 2024-12-18T01:03:12.9440942Z 2024-12-18T01:03:12.9441902Z  2024-12-18T01:03:12.9442407Z  2024-12-18T01:03:12.9442859Z  2024-12-18T01:03:12.9443278Z  2024-12-18T01:03:12.9443683Z  2024-12-18T01:03:12.9444108Z  2024-12-18T01:03:12.9444777Z  2024-12-18T01:03:12.9445197Z  2024-12-18T01:03:12.9446140Z [19,576 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:12.9447212Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:03:12.9448142Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T01:03:12.9449092Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T01:03:12.9449986Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T01:03:12.9450845Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2024-12-18T01:03:12.9451785Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 19s local 2024-12-18T01:03:12.9452697Z Compiling xla/service/cpu/ir_emitter2.cc; 18s local 2024-12-18T01:03:12.9453904Z Compiling xla/pjrt/stream_executor_executable.cc; 14s local ... 2024-12-18T01:03:13.1621123Z 2024-12-18T01:03:13.1621984Z  2024-12-18T01:03:13.1622487Z  2024-12-18T01:03:13.1622894Z  2024-12-18T01:03:13.1623289Z  2024-12-18T01:03:13.1623675Z  2024-12-18T01:03:13.1624088Z  2024-12-18T01:03:13.1624498Z  2024-12-18T01:03:13.1625059Z  2024-12-18T01:03:13.1626351Z [19,577 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:13.1627496Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:03:13.1628460Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T01:03:13.1629449Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2024-12-18T01:03:13.1630442Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T01:03:13.1631377Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2024-12-18T01:03:13.1632373Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 19s local 2024-12-18T01:03:13.1633512Z Compiling xla/service/cpu/ir_emitter2.cc; 18s local 2024-12-18T01:03:13.1634462Z Compiling xla/pjrt/stream_executor_executable.cc; 14s local ... 2024-12-18T01:03:13.4885229Z 2024-12-18T01:03:13.4886056Z  2024-12-18T01:03:13.4886538Z  2024-12-18T01:03:13.4886938Z  2024-12-18T01:03:13.4887346Z  2024-12-18T01:03:13.4887747Z  2024-12-18T01:03:13.4888144Z  2024-12-18T01:03:13.4888543Z  2024-12-18T01:03:13.4889181Z  2024-12-18T01:03:13.4890148Z [19,578 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:13.4891345Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:03:13.4892347Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T01:03:13.4893358Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T01:03:13.4894387Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T01:03:13.4895332Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2024-12-18T01:03:13.4896572Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 19s local 2024-12-18T01:03:13.4897503Z Compiling xla/service/cpu/ir_emitter2.cc; 19s local 2024-12-18T01:03:13.4898381Z Compiling xla/pjrt/stream_executor_executable.cc; 15s local ... 2024-12-18T01:03:13.7626975Z 2024-12-18T01:03:13.7627874Z  2024-12-18T01:03:13.7628386Z  2024-12-18T01:03:13.7628852Z  2024-12-18T01:03:13.7629292Z  2024-12-18T01:03:13.7629678Z  2024-12-18T01:03:13.7630114Z  2024-12-18T01:03:13.7640048Z  2024-12-18T01:03:13.7640499Z  2024-12-18T01:03:13.7641410Z [19,579 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:13.7642484Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2024-12-18T01:03:13.7643477Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2024-12-18T01:03:13.7644782Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2024-12-18T01:03:13.7645770Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2024-12-18T01:03:13.7646656Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2024-12-18T01:03:13.7647605Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 20s local 2024-12-18T01:03:13.7648534Z Compiling xla/service/cpu/ir_emitter2.cc; 19s local 2024-12-18T01:03:13.7649418Z Compiling xla/pjrt/stream_executor_executable.cc; 15s local ... 2024-12-18T01:03:14.2659945Z 2024-12-18T01:03:14.2660742Z  2024-12-18T01:03:14.2661206Z  2024-12-18T01:03:14.2661586Z  2024-12-18T01:03:14.2661973Z  2024-12-18T01:03:14.2662360Z  2024-12-18T01:03:14.2662753Z  2024-12-18T01:03:14.2663145Z  2024-12-18T01:03:14.2663523Z  2024-12-18T01:03:14.2664769Z [19,580 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:14.2665863Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2024-12-18T01:03:14.2666811Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T01:03:14.2667753Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T01:03:14.2668870Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2024-12-18T01:03:14.2669767Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2024-12-18T01:03:14.2670717Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 20s local 2024-12-18T01:03:14.2671618Z Compiling xla/service/cpu/ir_emitter2.cc; 19s local 2024-12-18T01:03:14.2672481Z Compiling xla/pjrt/stream_executor_executable.cc; 15s local ... 2024-12-18T01:03:14.5633406Z 2024-12-18T01:03:14.5634330Z  2024-12-18T01:03:14.5634788Z  2024-12-18T01:03:14.5635208Z  2024-12-18T01:03:14.5635634Z  2024-12-18T01:03:14.5636010Z  2024-12-18T01:03:14.5636406Z  2024-12-18T01:03:14.5637064Z  2024-12-18T01:03:14.5637492Z  2024-12-18T01:03:14.5638440Z [19,580 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:14.5639527Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T01:03:14.5640620Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2024-12-18T01:03:14.5641822Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2024-12-18T01:03:14.5642781Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2024-12-18T01:03:14.5643604Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2024-12-18T01:03:14.5644800Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 20s local 2024-12-18T01:03:14.5645838Z Compiling xla/service/cpu/ir_emitter2.cc; 20s local 2024-12-18T01:03:14.5646693Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local ... 2024-12-18T01:03:15.3366316Z 2024-12-18T01:03:15.3367190Z  2024-12-18T01:03:15.3367718Z  2024-12-18T01:03:15.3368122Z  2024-12-18T01:03:15.3368506Z  2024-12-18T01:03:15.3368901Z  2024-12-18T01:03:15.3369304Z  2024-12-18T01:03:15.3369694Z  2024-12-18T01:03:15.3370074Z  2024-12-18T01:03:15.3370986Z [19,581 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:15.3372093Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T01:03:15.3373000Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T01:03:15.3373957Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:03:15.3374925Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T01:03:15.3375775Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2024-12-18T01:03:15.3376895Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 21s local 2024-12-18T01:03:15.3377851Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:03:15.3378719Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local ... 2024-12-18T01:03:15.5640513Z 2024-12-18T01:03:15.5641340Z  2024-12-18T01:03:15.5641792Z  2024-12-18T01:03:15.5642164Z  2024-12-18T01:03:15.5642583Z  2024-12-18T01:03:15.5642941Z  2024-12-18T01:03:15.5643317Z  2024-12-18T01:03:15.5643683Z  2024-12-18T01:03:15.5644040Z  2024-12-18T01:03:15.5645262Z [19,584 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:15.5646448Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:03:15.5647401Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T01:03:15.5648321Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:03:15.5649342Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T01:03:15.5650203Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2024-12-18T01:03:15.5651117Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 21s local 2024-12-18T01:03:15.5652056Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:03:15.5652914Z Compiling xla/pjrt/stream_executor_executable.cc; 17s local ... 2024-12-18T01:03:15.7643950Z 2024-12-18T01:03:15.7645024Z  2024-12-18T01:03:15.7645522Z  2024-12-18T01:03:15.7646004Z  2024-12-18T01:03:15.7646436Z  2024-12-18T01:03:15.7646846Z  2024-12-18T01:03:15.7647268Z  2024-12-18T01:03:15.7647702Z  2024-12-18T01:03:15.7648129Z  2024-12-18T01:03:15.7649142Z [19,586 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:15.7650326Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:03:15.7651360Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2024-12-18T01:03:15.7652778Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:03:15.7653958Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2024-12-18T01:03:15.7654931Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2024-12-18T01:03:15.7655879Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 22s local 2024-12-18T01:03:15.7656874Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:03:15.7657827Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local ... 2024-12-18T01:03:16.0574511Z 2024-12-18T01:03:16.0575309Z  2024-12-18T01:03:16.0575895Z  2024-12-18T01:03:16.0576261Z  2024-12-18T01:03:16.0576766Z  2024-12-18T01:03:16.0577131Z  2024-12-18T01:03:16.0577518Z  2024-12-18T01:03:16.0577906Z  2024-12-18T01:03:16.0578283Z  2024-12-18T01:03:16.0579208Z [19,589 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:16.0580400Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:03:16.0581271Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T01:03:16.0582253Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2024-12-18T01:03:16.0583344Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:03:16.0584121Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2024-12-18T01:03:16.0584967Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 22s local 2024-12-18T01:03:16.0586133Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:03:16.0586910Z Compiling xla/pjrt/stream_executor_executable.cc; 17s local ... 2024-12-18T01:03:16.2668722Z 2024-12-18T01:03:16.2669607Z  2024-12-18T01:03:16.2670082Z  2024-12-18T01:03:16.2670507Z  2024-12-18T01:03:16.2670949Z  2024-12-18T01:03:16.2671344Z  2024-12-18T01:03:16.2671748Z  2024-12-18T01:03:16.2672163Z  2024-12-18T01:03:16.2672582Z  2024-12-18T01:03:16.2673536Z [19,593 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:16.2674665Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:03:16.2675636Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T01:03:16.2676631Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T01:03:16.2677613Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:03:16.2678542Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2024-12-18T01:03:16.2679517Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 22s local 2024-12-18T01:03:16.2680419Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:03:16.2681140Z @llvm-project//llvm:X86CodeGen; 13s local ... 2024-12-18T01:03:16.4931059Z 2024-12-18T01:03:16.4932006Z  2024-12-18T01:03:16.4932527Z  2024-12-18T01:03:16.4933008Z  2024-12-18T01:03:16.4933418Z  2024-12-18T01:03:16.4933845Z  2024-12-18T01:03:16.4934240Z  2024-12-18T01:03:16.4934670Z  2024-12-18T01:03:16.4935071Z  2024-12-18T01:03:16.4935991Z [19,595 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:16.4937455Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:03:16.4938391Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T01:03:16.4939337Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T01:03:16.4940245Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:03:16.4941081Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:03:16.4941990Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 22s local 2024-12-18T01:03:16.4942896Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:03:16.4943829Z @llvm-project//llvm:X86CodeGen; 13s local ... 2024-12-18T01:03:16.7128240Z 2024-12-18T01:03:16.7129120Z  2024-12-18T01:03:16.7129596Z  2024-12-18T01:03:16.7130011Z  2024-12-18T01:03:16.7130407Z  2024-12-18T01:03:16.7130781Z  2024-12-18T01:03:16.7131213Z  2024-12-18T01:03:16.7131610Z  2024-12-18T01:03:16.7132017Z  2024-12-18T01:03:16.7133243Z [19,598 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:16.7134303Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:03:16.7135421Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2024-12-18T01:03:16.7136284Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T01:03:16.7137325Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2024-12-18T01:03:16.7138226Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:03:16.7139130Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T01:03:16.7140023Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:03:16.7140768Z @llvm-project//llvm:X86CodeGen; 13s local ... 2024-12-18T01:03:16.9652555Z 2024-12-18T01:03:16.9653517Z  2024-12-18T01:03:16.9654094Z  2024-12-18T01:03:16.9654600Z  2024-12-18T01:03:16.9654986Z  2024-12-18T01:03:16.9655391Z  2024-12-18T01:03:16.9655824Z  2024-12-18T01:03:16.9656243Z  2024-12-18T01:03:16.9656872Z  2024-12-18T01:03:16.9657792Z [19,598 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:16.9658825Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:03:16.9659769Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T01:03:16.9660785Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2024-12-18T01:03:16.9661776Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T01:03:16.9662661Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:03:16.9663685Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T01:03:16.9664598Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:03:16.9665285Z @llvm-project//llvm:X86CodeGen; 14s local ... 2024-12-18T01:03:17.1933960Z 2024-12-18T01:03:17.1934840Z  2024-12-18T01:03:17.1935281Z  2024-12-18T01:03:17.1935767Z  2024-12-18T01:03:17.1936228Z  2024-12-18T01:03:17.1936865Z  2024-12-18T01:03:17.1937334Z  2024-12-18T01:03:17.1937734Z  2024-12-18T01:03:17.1938102Z  2024-12-18T01:03:17.1938998Z [19,599 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:17.1940558Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:03:17.1941531Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T01:03:17.1942527Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T01:03:17.1943575Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T01:03:17.1944861Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2024-12-18T01:03:17.1945884Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T01:03:17.1946908Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:03:17.1947614Z @llvm-project//llvm:X86CodeGen; 14s local ... 2024-12-18T01:03:17.4859807Z 2024-12-18T01:03:17.4860719Z  2024-12-18T01:03:17.4861185Z  2024-12-18T01:03:17.4861592Z  2024-12-18T01:03:17.4861979Z  2024-12-18T01:03:17.4862372Z  2024-12-18T01:03:17.4862757Z  2024-12-18T01:03:17.4863202Z  2024-12-18T01:03:17.4863606Z  2024-12-18T01:03:17.4864874Z [19,601 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:17.4866000Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:03:17.4866968Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T01:03:17.4867931Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T01:03:17.4868905Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T01:03:17.4869968Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2024-12-18T01:03:17.4870920Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2024-12-18T01:03:17.4871866Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2024-12-18T01:03:17.4872601Z @llvm-project//llvm:X86CodeGen; 14s local ... 2024-12-18T01:03:17.7658779Z 2024-12-18T01:03:17.7659656Z  2024-12-18T01:03:17.7660180Z  2024-12-18T01:03:17.7660564Z  2024-12-18T01:03:17.7660956Z  2024-12-18T01:03:17.7661351Z  2024-12-18T01:03:17.7661750Z  2024-12-18T01:03:17.7662108Z  2024-12-18T01:03:17.7662471Z  2024-12-18T01:03:17.7663414Z [19,601 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:17.7664508Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T01:03:17.7665449Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2024-12-18T01:03:17.7666401Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T01:03:17.7667329Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2024-12-18T01:03:17.7668118Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2024-12-18T01:03:17.7669000Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T01:03:17.7669918Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2024-12-18T01:03:17.7670639Z @llvm-project//llvm:X86CodeGen; 14s local ... 2024-12-18T01:03:17.9661452Z 2024-12-18T01:03:17.9662351Z  2024-12-18T01:03:17.9662808Z  2024-12-18T01:03:17.9663185Z  2024-12-18T01:03:17.9663560Z  2024-12-18T01:03:17.9663903Z  2024-12-18T01:03:17.9664268Z  2024-12-18T01:03:17.9664634Z  2024-12-18T01:03:17.9664997Z  2024-12-18T01:03:17.9665888Z [19,602 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:17.9666997Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T01:03:17.9667921Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T01:03:17.9668818Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2024-12-18T01:03:17.9669762Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T01:03:17.9670558Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2024-12-18T01:03:17.9671747Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T01:03:17.9672721Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2024-12-18T01:03:17.9673441Z @llvm-project//llvm:X86CodeGen; 15s local ... 2024-12-18T01:03:18.2102496Z 2024-12-18T01:03:18.2103362Z  2024-12-18T01:03:18.2103873Z  2024-12-18T01:03:18.2104273Z  2024-12-18T01:03:18.2105042Z  2024-12-18T01:03:18.2105449Z  2024-12-18T01:03:18.2105846Z  2024-12-18T01:03:18.2106243Z  2024-12-18T01:03:18.2106688Z  2024-12-18T01:03:18.2107645Z [19,604 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:18.2108891Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T01:03:18.2109775Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T01:03:18.2110752Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2024-12-18T01:03:18.2111638Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T01:03:18.2112672Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2024-12-18T01:03:18.2113552Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T01:03:18.2114440Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2024-12-18T01:03:18.2115116Z @llvm-project//llvm:X86CodeGen; 15s local ... 2024-12-18T01:03:18.4197086Z 2024-12-18T01:03:18.4197955Z  2024-12-18T01:03:18.4198443Z  2024-12-18T01:03:18.4199102Z  2024-12-18T01:03:18.4199531Z  2024-12-18T01:03:18.4199919Z  2024-12-18T01:03:18.4200280Z  2024-12-18T01:03:18.4200641Z  2024-12-18T01:03:18.4201044Z  2024-12-18T01:03:18.4201976Z [19,605 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:18.4203051Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T01:03:18.4204021Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T01:03:18.4204869Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2024-12-18T01:03:18.4205769Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T01:03:18.4206632Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2024-12-18T01:03:18.4207555Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2024-12-18T01:03:18.4208426Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2024-12-18T01:03:18.4209257Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 15s local ... 2024-12-18T01:03:18.7667643Z 2024-12-18T01:03:18.7668637Z  2024-12-18T01:03:18.7669137Z  2024-12-18T01:03:18.7669553Z  2024-12-18T01:03:18.7669932Z  2024-12-18T01:03:18.7670340Z  2024-12-18T01:03:18.7670748Z  2024-12-18T01:03:18.7671145Z  2024-12-18T01:03:18.7671541Z  2024-12-18T01:03:18.7672441Z [19,605 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:18.7673580Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T01:03:18.7674568Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2024-12-18T01:03:18.7675537Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2024-12-18T01:03:18.7676526Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2024-12-18T01:03:18.7677471Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2024-12-18T01:03:18.7678428Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T01:03:18.7679355Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2024-12-18T01:03:18.7680190Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 15s local ... 2024-12-18T01:03:19.3090505Z 2024-12-18T01:03:19.3091322Z  2024-12-18T01:03:19.3091807Z  2024-12-18T01:03:19.3092217Z  2024-12-18T01:03:19.3092920Z  2024-12-18T01:03:19.3093339Z  2024-12-18T01:03:19.3093750Z  2024-12-18T01:03:19.3094147Z  2024-12-18T01:03:19.3094714Z  2024-12-18T01:03:19.3095673Z [19,606 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:19.3096962Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T01:03:19.3097991Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T01:03:19.3099127Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T01:03:19.3100164Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T01:03:19.3101112Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2024-12-18T01:03:19.3102148Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T01:03:19.3103160Z Compiling xla/service/cpu/ir_emitter2.cc; 25s local 2024-12-18T01:03:19.3104065Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 15s local ... 2024-12-18T01:03:19.5198233Z 2024-12-18T01:03:19.5199174Z  2024-12-18T01:03:19.5199659Z  2024-12-18T01:03:19.5200423Z  2024-12-18T01:03:19.5200868Z  2024-12-18T01:03:19.5201321Z  2024-12-18T01:03:19.5201759Z  2024-12-18T01:03:19.5202220Z  2024-12-18T01:03:19.5202668Z  2024-12-18T01:03:19.5203722Z [19,609 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:19.5205032Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T01:03:19.5206308Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T01:03:19.5207459Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T01:03:19.5208692Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T01:03:19.5209653Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2024-12-18T01:03:19.5210659Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2024-12-18T01:03:19.5211659Z Compiling xla/service/cpu/ir_emitter2.cc; 25s local 2024-12-18T01:03:19.5212551Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local ... 2024-12-18T01:03:19.7675400Z 2024-12-18T01:03:19.7676271Z  2024-12-18T01:03:19.7676738Z  2024-12-18T01:03:19.7677133Z  2024-12-18T01:03:19.7677525Z  2024-12-18T01:03:19.7677953Z  2024-12-18T01:03:19.7678354Z  2024-12-18T01:03:19.7678747Z  2024-12-18T01:03:19.7679119Z  2024-12-18T01:03:19.7680085Z [19,612 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:19.7681178Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2024-12-18T01:03:19.7682160Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2024-12-18T01:03:19.7683164Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2024-12-18T01:03:19.7684147Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2024-12-18T01:03:19.7685069Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2024-12-18T01:03:19.7686063Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 26s local 2024-12-18T01:03:19.7687066Z Compiling xla/service/cpu/ir_emitter2.cc; 25s local 2024-12-18T01:03:19.7687936Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local ... 2024-12-18T01:03:20.7682088Z 2024-12-18T01:03:20.7682945Z  2024-12-18T01:03:20.7683407Z  2024-12-18T01:03:20.7683800Z  2024-12-18T01:03:20.7684195Z  2024-12-18T01:03:20.7684623Z  2024-12-18T01:03:20.7684995Z  2024-12-18T01:03:20.7685372Z  2024-12-18T01:03:20.7685743Z  2024-12-18T01:03:20.7686636Z [19,612 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:20.7687693Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T01:03:20.7688633Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2024-12-18T01:03:20.7689875Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2024-12-18T01:03:20.7690838Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2024-12-18T01:03:20.7691713Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2024-12-18T01:03:20.7692636Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T01:03:20.7693691Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2024-12-18T01:03:20.7694539Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local ... 2024-12-18T01:03:21.1317412Z 2024-12-18T01:03:21.1318343Z  2024-12-18T01:03:21.1318906Z  2024-12-18T01:03:21.1319396Z  2024-12-18T01:03:21.1319867Z  2024-12-18T01:03:21.1320344Z  2024-12-18T01:03:21.1320753Z  2024-12-18T01:03:21.1321226Z  2024-12-18T01:03:21.1321671Z  2024-12-18T01:03:21.1322702Z [19,613 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:21.1323901Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T01:03:21.1325056Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2024-12-18T01:03:21.1326122Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2024-12-18T01:03:21.1327037Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T01:03:21.1327905Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2024-12-18T01:03:21.1328993Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T01:03:21.1329936Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2024-12-18T01:03:21.1330749Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local ... 2024-12-18T01:03:21.3687184Z 2024-12-18T01:03:21.3688153Z  2024-12-18T01:03:21.3688631Z  2024-12-18T01:03:21.3689032Z  2024-12-18T01:03:21.3689428Z  2024-12-18T01:03:21.3689840Z  2024-12-18T01:03:21.3690278Z  2024-12-18T01:03:21.3690651Z  2024-12-18T01:03:21.3691021Z  2024-12-18T01:03:21.3691926Z [19,615 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:21.3692992Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T01:03:21.3693998Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2024-12-18T01:03:21.3694825Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T01:03:21.3695799Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2024-12-18T01:03:21.3696866Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2024-12-18T01:03:21.3697781Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2024-12-18T01:03:21.3698866Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2024-12-18T01:03:21.3699710Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local ... 2024-12-18T01:03:21.9432273Z 2024-12-18T01:03:21.9433205Z  2024-12-18T01:03:21.9433660Z  2024-12-18T01:03:21.9434045Z  2024-12-18T01:03:21.9434506Z  2024-12-18T01:03:21.9434959Z  2024-12-18T01:03:21.9435352Z  2024-12-18T01:03:21.9435674Z  2024-12-18T01:03:21.9436037Z  2024-12-18T01:03:21.9436956Z [19,616 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:21.9438044Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2024-12-18T01:03:21.9439008Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T01:03:21.9440019Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T01:03:21.9440862Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T01:03:21.9441743Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T01:03:21.9442629Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2024-12-18T01:03:21.9443649Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2024-12-18T01:03:21.9444823Z Compiling xla/service/cpu/parallel_task_assignment.cc; 18s local ... 2024-12-18T01:03:22.1693398Z 2024-12-18T01:03:22.1694285Z  2024-12-18T01:03:22.1694770Z  2024-12-18T01:03:22.1695145Z  2024-12-18T01:03:22.1695533Z  2024-12-18T01:03:22.1695922Z  2024-12-18T01:03:22.1696287Z  2024-12-18T01:03:22.1697202Z  2024-12-18T01:03:22.1697605Z  2024-12-18T01:03:22.1698559Z [19,617 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:22.1699611Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2024-12-18T01:03:22.1700578Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2024-12-18T01:03:22.1701509Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T01:03:22.1702377Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2024-12-18T01:03:22.1703331Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T01:03:22.1704480Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2024-12-18T01:03:22.1705279Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2024-12-18T01:03:22.1706210Z Compiling xla/service/cpu/parallel_task_assignment.cc; 18s local ... 2024-12-18T01:03:22.4202552Z 2024-12-18T01:03:22.4203374Z  2024-12-18T01:03:22.4203775Z  2024-12-18T01:03:22.4204124Z  2024-12-18T01:03:22.4204438Z  2024-12-18T01:03:22.4204775Z  2024-12-18T01:03:22.4205341Z  2024-12-18T01:03:22.4205678Z  2024-12-18T01:03:22.4206000Z  2024-12-18T01:03:22.4206759Z [19,618 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:22.4207631Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2024-12-18T01:03:22.4208396Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2024-12-18T01:03:22.4209175Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T01:03:22.4209905Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2024-12-18T01:03:22.4210645Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2024-12-18T01:03:22.4211473Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2024-12-18T01:03:22.4212274Z Compiling xla/service/cpu/parallel_task_assignment.cc; 19s local 2024-12-18T01:03:22.4213027Z Compiling xla/pjrt/pjrt_api.cc; 18s local ... 2024-12-18T01:03:22.7702664Z 2024-12-18T01:03:22.7703573Z  2024-12-18T01:03:22.7704030Z  2024-12-18T01:03:22.7704422Z  2024-12-18T01:03:22.7704812Z  2024-12-18T01:03:22.7705189Z  2024-12-18T01:03:22.7705552Z  2024-12-18T01:03:22.7705924Z  2024-12-18T01:03:22.7706310Z  2024-12-18T01:03:22.7707223Z [19,619 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:22.7708377Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2024-12-18T01:03:22.7709294Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2024-12-18T01:03:22.7710263Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2024-12-18T01:03:22.7711133Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2024-12-18T01:03:22.7712053Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T01:03:22.7712947Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2024-12-18T01:03:22.7713837Z Compiling xla/service/cpu/parallel_task_assignment.cc; 19s local 2024-12-18T01:03:22.7714689Z Compiling xla/pjrt/pjrt_api.cc; 18s local ... 2024-12-18T01:03:23.2724317Z 2024-12-18T01:03:23.2725162Z  2024-12-18T01:03:23.2725603Z  2024-12-18T01:03:23.2725964Z  2024-12-18T01:03:23.2726338Z  2024-12-18T01:03:23.2726721Z  2024-12-18T01:03:23.2727161Z  2024-12-18T01:03:23.2727874Z  2024-12-18T01:03:23.2728244Z  2024-12-18T01:03:23.2729172Z [19,620 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:23.2730125Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2024-12-18T01:03:23.2731005Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T01:03:23.2731893Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T01:03:23.2732936Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2024-12-18T01:03:23.2733831Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2024-12-18T01:03:23.2734708Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2024-12-18T01:03:23.2735577Z Compiling xla/service/cpu/parallel_task_assignment.cc; 19s local 2024-12-18T01:03:23.2736569Z Compiling xla/pjrt/pjrt_api.cc; 18s local ... 2024-12-18T01:03:23.5711543Z 2024-12-18T01:03:23.5712406Z  2024-12-18T01:03:23.5712851Z  2024-12-18T01:03:23.5713248Z  2024-12-18T01:03:23.5713628Z  2024-12-18T01:03:23.5714018Z  2024-12-18T01:03:23.5714712Z  2024-12-18T01:03:23.5715212Z  2024-12-18T01:03:23.5715602Z  2024-12-18T01:03:23.5716482Z [19,620 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:23.5717578Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T01:03:23.5718436Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T01:03:23.5719547Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T01:03:23.5720429Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2024-12-18T01:03:23.5721339Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T01:03:23.5722228Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2024-12-18T01:03:23.5723134Z Compiling xla/service/cpu/parallel_task_assignment.cc; 20s local 2024-12-18T01:03:23.5723894Z Compiling xla/pjrt/pjrt_api.cc; 19s local ... 2024-12-18T01:03:23.7771004Z 2024-12-18T01:03:23.7771886Z  2024-12-18T01:03:23.7772401Z  2024-12-18T01:03:23.7772821Z  2024-12-18T01:03:23.7773212Z  2024-12-18T01:03:23.7773595Z  2024-12-18T01:03:23.7774122Z  2024-12-18T01:03:23.7774529Z  2024-12-18T01:03:23.7774909Z  2024-12-18T01:03:23.7775889Z [19,624 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:23.7777151Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T01:03:23.7778059Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2024-12-18T01:03:23.7778930Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2024-12-18T01:03:23.7779850Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2024-12-18T01:03:23.7780769Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T01:03:23.7781756Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2024-12-18T01:03:23.7782723Z Compiling xla/service/cpu/parallel_task_assignment.cc; 20s local 2024-12-18T01:03:23.7783592Z Compiling xla/pjrt/pjrt_api.cc; 19s local ... 2024-12-18T01:03:24.1717188Z 2024-12-18T01:03:24.1718079Z  2024-12-18T01:03:24.1718536Z  2024-12-18T01:03:24.1718896Z  2024-12-18T01:03:24.1719308Z  2024-12-18T01:03:24.1719707Z  2024-12-18T01:03:24.1720117Z  2024-12-18T01:03:24.1720515Z  2024-12-18T01:03:24.1720876Z  2024-12-18T01:03:24.1721809Z [19,626 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:24.1722849Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T01:03:24.1723752Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2024-12-18T01:03:24.1724666Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T01:03:24.1725870Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2024-12-18T01:03:24.1726839Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2024-12-18T01:03:24.1727748Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2024-12-18T01:03:24.1728632Z Compiling xla/service/cpu/parallel_task_assignment.cc; 20s local 2024-12-18T01:03:24.1729458Z Compiling xla/pjrt/pjrt_api.cc; 19s local ... 2024-12-18T01:03:24.6415044Z 2024-12-18T01:03:24.6415942Z  2024-12-18T01:03:24.6416510Z  2024-12-18T01:03:24.6416940Z  2024-12-18T01:03:24.6417342Z  2024-12-18T01:03:24.6417727Z  2024-12-18T01:03:24.6418100Z  2024-12-18T01:03:24.6418477Z  2024-12-18T01:03:24.6418869Z  2024-12-18T01:03:24.6419824Z [19,627 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:24.6420909Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T01:03:24.6421861Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2024-12-18T01:03:24.6423081Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2024-12-18T01:03:24.6423910Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2024-12-18T01:03:24.6424842Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T01:03:24.6425712Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T01:03:24.6426471Z Compiling xla/pjrt/pjrt_api.cc; 20s local 2024-12-18T01:03:24.6427443Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local ... 2024-12-18T01:03:24.9724298Z 2024-12-18T01:03:24.9725092Z  2024-12-18T01:03:24.9725506Z  2024-12-18T01:03:24.9725852Z  2024-12-18T01:03:24.9726204Z  2024-12-18T01:03:24.9726560Z  2024-12-18T01:03:24.9726909Z  2024-12-18T01:03:24.9727246Z  2024-12-18T01:03:24.9727595Z  2024-12-18T01:03:24.9728419Z [19,627 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:24.9729391Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T01:03:24.9730220Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2024-12-18T01:03:24.9731126Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T01:03:24.9731916Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2024-12-18T01:03:24.9732762Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T01:03:24.9733606Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T01:03:24.9734258Z Compiling xla/pjrt/pjrt_api.cc; 20s local 2024-12-18T01:03:24.9735015Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local ... 2024-12-18T01:03:25.5235377Z 2024-12-18T01:03:25.5236281Z  2024-12-18T01:03:25.5236750Z  2024-12-18T01:03:25.5237131Z  2024-12-18T01:03:25.5237497Z  2024-12-18T01:03:25.5237908Z  2024-12-18T01:03:25.5238282Z  2024-12-18T01:03:25.5238630Z  2024-12-18T01:03:25.5238996Z  2024-12-18T01:03:25.5239904Z [19,628 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:25.5240956Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T01:03:25.5241856Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T01:03:25.5242756Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T01:03:25.5243567Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2024-12-18T01:03:25.5244828Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2024-12-18T01:03:25.5245704Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T01:03:25.5246408Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2024-12-18T01:03:25.5247149Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local ... 2024-12-18T01:03:25.7734413Z 2024-12-18T01:03:25.7735285Z  2024-12-18T01:03:25.7735749Z  2024-12-18T01:03:25.7736121Z  2024-12-18T01:03:25.7736662Z  2024-12-18T01:03:25.7737020Z  2024-12-18T01:03:25.7737389Z  2024-12-18T01:03:25.7737778Z  2024-12-18T01:03:25.7738170Z  2024-12-18T01:03:25.7739066Z [19,629 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:25.7740511Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T01:03:25.7741451Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2024-12-18T01:03:25.7742374Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2024-12-18T01:03:25.7743244Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2024-12-18T01:03:25.7744120Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2024-12-18T01:03:25.7745261Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T01:03:25.7745991Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2024-12-18T01:03:25.7746975Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local ... 2024-12-18T01:03:26.5259398Z 2024-12-18T01:03:26.5260260Z  2024-12-18T01:03:26.5260705Z  2024-12-18T01:03:26.5261062Z  2024-12-18T01:03:26.5261440Z  2024-12-18T01:03:26.5261789Z  2024-12-18T01:03:26.5262147Z  2024-12-18T01:03:26.5262535Z  2024-12-18T01:03:26.5262902Z  2024-12-18T01:03:26.5264036Z [19,630 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:26.5265084Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T01:03:26.5266029Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2024-12-18T01:03:26.5266957Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T01:03:26.5267819Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T01:03:26.5268705Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2024-12-18T01:03:26.5269625Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T01:03:26.5270308Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T01:03:26.5270891Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 22s local ... 2024-12-18T01:03:26.7744875Z 2024-12-18T01:03:26.7745704Z  2024-12-18T01:03:26.7746163Z  2024-12-18T01:03:26.7746506Z  2024-12-18T01:03:26.7746864Z  2024-12-18T01:03:26.7747299Z  2024-12-18T01:03:26.7747767Z  2024-12-18T01:03:26.7748205Z  2024-12-18T01:03:26.7748542Z  2024-12-18T01:03:26.7749387Z [19,633 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:26.7750381Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T01:03:26.7751198Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2024-12-18T01:03:26.7752034Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2024-12-18T01:03:26.7752808Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T01:03:26.7753497Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T01:03:26.7754161Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T01:03:26.7754717Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T01:03:26.7755332Z Compiling xla/pjrt/pjrt_client.cc; 22s local ... 2024-12-18T01:03:27.1304782Z 2024-12-18T01:03:27.1305704Z  2024-12-18T01:03:27.1306190Z  2024-12-18T01:03:27.1306592Z  2024-12-18T01:03:27.1306978Z  2024-12-18T01:03:27.1307361Z  2024-12-18T01:03:27.1307740Z  2024-12-18T01:03:27.1308098Z  2024-12-18T01:03:27.1308461Z  2024-12-18T01:03:27.1309363Z [19,635 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:27.1310408Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T01:03:27.1311659Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2024-12-18T01:03:27.1312590Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2024-12-18T01:03:27.1313418Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T01:03:27.1314208Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T01:03:27.1314916Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T01:03:27.1315755Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T01:03:27.1316441Z Compiling xla/pjrt/pjrt_client.cc; 22s local ... 2024-12-18T01:03:27.3748197Z 2024-12-18T01:03:27.3749136Z  2024-12-18T01:03:27.3749596Z  2024-12-18T01:03:27.3749959Z  2024-12-18T01:03:27.3750290Z  2024-12-18T01:03:27.3750667Z  2024-12-18T01:03:27.3751037Z  2024-12-18T01:03:27.3751407Z  2024-12-18T01:03:27.3751767Z  2024-12-18T01:03:27.3759042Z [19,636 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:27.3760323Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T01:03:27.3761118Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2024-12-18T01:03:27.3761866Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2024-12-18T01:03:27.3762527Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T01:03:27.3763165Z Compiling xla/pjrt/pjrt_api.cc; 23s local 2024-12-18T01:03:27.3763739Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T01:03:27.3764439Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T01:03:27.3765187Z Compiling xla/pjrt/distributed/topology_util.cc; 19s local ... 2024-12-18T01:03:27.5968334Z 2024-12-18T01:03:27.5969250Z  2024-12-18T01:03:27.5969718Z  2024-12-18T01:03:27.5970115Z  2024-12-18T01:03:27.5970511Z  2024-12-18T01:03:27.5970905Z  2024-12-18T01:03:27.5971282Z  2024-12-18T01:03:27.5971700Z  2024-12-18T01:03:27.5972086Z  2024-12-18T01:03:27.5972983Z [19,639 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:27.5974081Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T01:03:27.5975027Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T01:03:27.5975802Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2024-12-18T01:03:27.5976628Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2024-12-18T01:03:27.5977497Z Compiling xla/pjrt/distributed/topology_util.cc; 19s local 2024-12-18T01:03:27.5978455Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 18s local 2024-12-18T01:03:27.5979653Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2024-12-18T01:03:27.5980651Z Compiling xla/service/spmd/dot_handler.cc; 17s local ... 2024-12-18T01:03:27.9758680Z 2024-12-18T01:03:27.9759568Z  2024-12-18T01:03:27.9759984Z  2024-12-18T01:03:27.9760381Z  2024-12-18T01:03:27.9760751Z  2024-12-18T01:03:27.9761094Z  2024-12-18T01:03:27.9761439Z  2024-12-18T01:03:27.9761815Z  2024-12-18T01:03:27.9762163Z  2024-12-18T01:03:27.9763001Z [19,640 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:27.9763953Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T01:03:27.9764746Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T01:03:27.9765434Z Compiling xla/pjrt/pjrt_client.cc; 23s local 2024-12-18T01:03:27.9766141Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2024-12-18T01:03:27.9766982Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 18s local 2024-12-18T01:03:27.9767911Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2024-12-18T01:03:27.9768758Z Compiling xla/service/spmd/dot_handler.cc; 17s local 2024-12-18T01:03:27.9769863Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 17s local ... 2024-12-18T01:03:28.1775440Z 2024-12-18T01:03:28.1776792Z  2024-12-18T01:03:28.1777182Z  2024-12-18T01:03:28.1777493Z  2024-12-18T01:03:28.1777795Z  2024-12-18T01:03:28.1778096Z  2024-12-18T01:03:28.1778375Z  2024-12-18T01:03:28.1778674Z  2024-12-18T01:03:28.1779005Z  2024-12-18T01:03:28.1780148Z [19,641 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:28.1781222Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T01:03:28.1782064Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T01:03:28.1782788Z Compiling xla/pjrt/pjrt_client.cc; 23s local 2024-12-18T01:03:28.1783613Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2024-12-18T01:03:28.1784476Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 19s local 2024-12-18T01:03:28.1785460Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2024-12-18T01:03:28.1786598Z Compiling xla/service/spmd/dot_handler.cc; 17s local 2024-12-18T01:03:28.1787504Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 17s local ... 2024-12-18T01:03:28.3892387Z 2024-12-18T01:03:28.3893272Z  2024-12-18T01:03:28.3893747Z  2024-12-18T01:03:28.3894145Z  2024-12-18T01:03:28.3894564Z  2024-12-18T01:03:28.3894924Z  2024-12-18T01:03:28.3895456Z  2024-12-18T01:03:28.3895853Z  2024-12-18T01:03:28.3896658Z  2024-12-18T01:03:28.3897604Z [19,644 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:28.3898634Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T01:03:28.3899499Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 25s local 2024-12-18T01:03:28.3900325Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2024-12-18T01:03:28.3901354Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 19s local 2024-12-18T01:03:28.3902291Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2024-12-18T01:03:28.3903187Z Compiling xla/service/spmd/dot_handler.cc; 18s local 2024-12-18T01:03:28.3904011Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 17s local 2024-12-18T01:03:28.3904873Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 17s local ... 2024-12-18T01:03:28.7764843Z 2024-12-18T01:03:28.7765742Z  2024-12-18T01:03:28.7766238Z  2024-12-18T01:03:28.7766716Z  2024-12-18T01:03:28.7767137Z  2024-12-18T01:03:28.7767542Z  2024-12-18T01:03:28.7767933Z  2024-12-18T01:03:28.7768344Z  2024-12-18T01:03:28.7768729Z  2024-12-18T01:03:28.7769667Z [19,645 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:28.7770797Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2024-12-18T01:03:28.7771750Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2024-12-18T01:03:28.7772707Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 19s local 2024-12-18T01:03:28.7773841Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2024-12-18T01:03:28.7774783Z Compiling xla/service/spmd/dot_handler.cc; 18s local 2024-12-18T01:03:28.7775684Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 18s local 2024-12-18T01:03:28.7776766Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 17s local 2024-12-18T01:03:28.7777679Z Compiling xla/pjrt/host_memory_spaces.cc; 15s local ... 2024-12-18T01:03:29.1769289Z 2024-12-18T01:03:29.1770208Z  2024-12-18T01:03:29.1770699Z  2024-12-18T01:03:29.1771112Z  2024-12-18T01:03:29.1771548Z  2024-12-18T01:03:29.1771958Z  2024-12-18T01:03:29.1772345Z  2024-12-18T01:03:29.1772728Z  2024-12-18T01:03:29.1783360Z  2024-12-18T01:03:29.1784944Z [19,646 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:29.1785996Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2024-12-18T01:03:29.1786914Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 20s local 2024-12-18T01:03:29.1787926Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2024-12-18T01:03:29.1789078Z Compiling xla/service/spmd/dot_handler.cc; 18s local 2024-12-18T01:03:29.1789920Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 18s local 2024-12-18T01:03:29.1790831Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local 2024-12-18T01:03:29.1791653Z Compiling xla/pjrt/host_memory_spaces.cc; 16s local 2024-12-18T01:03:29.1792571Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local ... 2024-12-18T01:03:29.4286109Z 2024-12-18T01:03:29.4287038Z  2024-12-18T01:03:29.4287505Z  2024-12-18T01:03:29.4287928Z  2024-12-18T01:03:29.4288337Z  2024-12-18T01:03:29.4288733Z  2024-12-18T01:03:29.4289099Z  2024-12-18T01:03:29.4289734Z  2024-12-18T01:03:29.4290143Z  2024-12-18T01:03:29.4291077Z [19,648 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:29.4292166Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2024-12-18T01:03:29.4293095Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 20s local 2024-12-18T01:03:29.4294338Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2024-12-18T01:03:29.4295274Z Compiling xla/service/spmd/dot_handler.cc; 19s local 2024-12-18T01:03:29.4296100Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 18s local 2024-12-18T01:03:29.4297216Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local 2024-12-18T01:03:29.4298040Z Compiling xla/pjrt/host_memory_spaces.cc; 16s local 2024-12-18T01:03:29.4298973Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local ... 2024-12-18T01:03:29.6483643Z 2024-12-18T01:03:29.6484643Z  2024-12-18T01:03:29.6485251Z  2024-12-18T01:03:29.6485664Z  2024-12-18T01:03:29.6486122Z  2024-12-18T01:03:29.6486612Z  2024-12-18T01:03:29.6486997Z  2024-12-18T01:03:29.6487366Z  2024-12-18T01:03:29.6487731Z  2024-12-18T01:03:29.6488742Z [19,649 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:29.6489916Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2024-12-18T01:03:29.6490802Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 20s local 2024-12-18T01:03:29.6491873Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T01:03:29.6492825Z Compiling xla/service/spmd/dot_handler.cc; 19s local 2024-12-18T01:03:29.6493668Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 19s local 2024-12-18T01:03:29.6494626Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local 2024-12-18T01:03:29.6495485Z Compiling xla/pjrt/host_memory_spaces.cc; 16s local 2024-12-18T01:03:29.6496668Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local ... 2024-12-18T01:03:29.8732693Z 2024-12-18T01:03:29.8733567Z  2024-12-18T01:03:29.8734073Z  2024-12-18T01:03:29.8734500Z  2024-12-18T01:03:29.8734877Z  2024-12-18T01:03:29.8735268Z  2024-12-18T01:03:29.8735633Z  2024-12-18T01:03:29.8736111Z  2024-12-18T01:03:29.8736800Z  2024-12-18T01:03:29.8737683Z [19,652 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:29.8738717Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2024-12-18T01:03:29.8739626Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 20s local 2024-12-18T01:03:29.8740621Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T01:03:29.8741942Z Compiling xla/service/spmd/dot_handler.cc; 19s local 2024-12-18T01:03:29.8742894Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 19s local 2024-12-18T01:03:29.8743820Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local 2024-12-18T01:03:29.8744952Z Compiling xla/pjrt/host_memory_spaces.cc; 17s local 2024-12-18T01:03:29.8746302Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local ... 2024-12-18T01:03:30.1778570Z 2024-12-18T01:03:30.1779463Z  2024-12-18T01:03:30.1779961Z  2024-12-18T01:03:30.1780369Z  2024-12-18T01:03:30.1780761Z  2024-12-18T01:03:30.1781162Z  2024-12-18T01:03:30.1781544Z  2024-12-18T01:03:30.1781930Z  2024-12-18T01:03:30.1782333Z  2024-12-18T01:03:30.1783260Z [19,652 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:30.1784323Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2024-12-18T01:03:30.1785501Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 21s local 2024-12-18T01:03:30.1786524Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T01:03:30.1787455Z Compiling xla/service/spmd/dot_handler.cc; 19s local 2024-12-18T01:03:30.1788316Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 19s local 2024-12-18T01:03:30.1789271Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2024-12-18T01:03:30.1790294Z Compiling xla/pjrt/host_memory_spaces.cc; 17s local 2024-12-18T01:03:30.1791252Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local ... 2024-12-18T01:03:31.1788794Z 2024-12-18T01:03:31.1789703Z  2024-12-18T01:03:31.1790106Z  2024-12-18T01:03:31.1790439Z  2024-12-18T01:03:31.1790751Z  2024-12-18T01:03:31.1791081Z  2024-12-18T01:03:31.1791406Z  2024-12-18T01:03:31.1791733Z  2024-12-18T01:03:31.1792096Z  2024-12-18T01:03:31.1792869Z [19,652 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:31.1793707Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T01:03:31.1794448Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 22s local 2024-12-18T01:03:31.1795279Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2024-12-18T01:03:31.1796061Z Compiling xla/service/spmd/dot_handler.cc; 20s local 2024-12-18T01:03:31.1796773Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 20s local 2024-12-18T01:03:31.1797517Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2024-12-18T01:03:31.1798194Z Compiling xla/pjrt/host_memory_spaces.cc; 18s local 2024-12-18T01:03:31.1798951Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local ... 2024-12-18T01:03:31.5797029Z 2024-12-18T01:03:31.5797906Z  2024-12-18T01:03:31.5798427Z  2024-12-18T01:03:31.5798804Z  2024-12-18T01:03:31.5799193Z  2024-12-18T01:03:31.5799628Z  2024-12-18T01:03:31.5800149Z  2024-12-18T01:03:31.5800530Z  2024-12-18T01:03:31.5800906Z  2024-12-18T01:03:31.5801873Z [19,655 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:31.5802908Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T01:03:31.5803800Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 22s local 2024-12-18T01:03:31.5804836Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:31.5805749Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2024-12-18T01:03:31.5806579Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 21s local 2024-12-18T01:03:31.5808023Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2024-12-18T01:03:31.5808881Z Compiling xla/pjrt/host_memory_spaces.cc; 18s local 2024-12-18T01:03:31.5810458Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local ... 2024-12-18T01:03:31.7800230Z 2024-12-18T01:03:31.7801194Z  2024-12-18T01:03:31.7801703Z  2024-12-18T01:03:31.7802113Z  2024-12-18T01:03:31.7802520Z  2024-12-18T01:03:31.7802966Z  2024-12-18T01:03:31.7803385Z  2024-12-18T01:03:31.7803729Z  2024-12-18T01:03:31.7804438Z  2024-12-18T01:03:31.7805450Z [19,656 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:31.7806527Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2024-12-18T01:03:31.7807513Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 22s local 2024-12-18T01:03:31.7808566Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:31.7809530Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2024-12-18T01:03:31.7810374Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 21s local 2024-12-18T01:03:31.7811555Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2024-12-18T01:03:31.7812572Z Compiling xla/pjrt/host_memory_spaces.cc; 18s local 2024-12-18T01:03:31.7813519Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local ... 2024-12-18T01:03:32.0058253Z 2024-12-18T01:03:32.0059241Z  2024-12-18T01:03:32.0059742Z  2024-12-18T01:03:32.0060173Z  2024-12-18T01:03:32.0060557Z  2024-12-18T01:03:32.0060939Z  2024-12-18T01:03:32.0061318Z  2024-12-18T01:03:32.0062003Z  2024-12-18T01:03:32.0062408Z  2024-12-18T01:03:32.0063311Z [19,657 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:32.0064375Z Compiling xla/pjrt/distributed/topology_util.cc; 24s local 2024-12-18T01:03:32.0065304Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 22s local 2024-12-18T01:03:32.0066385Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:32.0067362Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2024-12-18T01:03:32.0068213Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 21s local 2024-12-18T01:03:32.0069204Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T01:03:32.0070063Z Compiling xla/pjrt/host_memory_spaces.cc; 19s local 2024-12-18T01:03:32.0071026Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local ... 2024-12-18T01:03:32.2898201Z 2024-12-18T01:03:32.2899119Z  2024-12-18T01:03:32.2899608Z  2024-12-18T01:03:32.2900022Z  2024-12-18T01:03:32.2900431Z  2024-12-18T01:03:32.2900848Z  2024-12-18T01:03:32.2901254Z  2024-12-18T01:03:32.2901675Z  2024-12-18T01:03:32.2902081Z  2024-12-18T01:03:32.2903045Z [19,661 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:32.2904175Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 23s local 2024-12-18T01:03:32.2905277Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:32.2906298Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2024-12-18T01:03:32.2907217Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 21s local 2024-12-18T01:03:32.2908217Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T01:03:32.2909114Z Compiling xla/pjrt/host_memory_spaces.cc; 19s local 2024-12-18T01:03:32.2910092Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T01:03:32.2911053Z Compiling xla/pjrt/host_callback.cc; 16s local ... 2024-12-18T01:03:32.5807623Z 2024-12-18T01:03:32.5808486Z  2024-12-18T01:03:32.5808976Z  2024-12-18T01:03:32.5809341Z  2024-12-18T01:03:32.5809765Z  2024-12-18T01:03:32.5810166Z  2024-12-18T01:03:32.5810522Z  2024-12-18T01:03:32.5811242Z  2024-12-18T01:03:32.5811596Z  2024-12-18T01:03:32.5812505Z [19,662 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:32.5813523Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 23s local 2024-12-18T01:03:32.5814539Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2024-12-18T01:03:32.5815690Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2024-12-18T01:03:32.5816724Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 22s local 2024-12-18T01:03:32.5817698Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T01:03:32.5818492Z Compiling xla/pjrt/host_memory_spaces.cc; 19s local 2024-12-18T01:03:32.5819439Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T01:03:32.5820294Z Compiling xla/pjrt/host_callback.cc; 16s local ... 2024-12-18T01:03:33.1068836Z 2024-12-18T01:03:33.1069742Z  2024-12-18T01:03:33.1070255Z  2024-12-18T01:03:33.1070667Z  2024-12-18T01:03:33.1071054Z  2024-12-18T01:03:33.1071439Z  2024-12-18T01:03:33.1072071Z  2024-12-18T01:03:33.1072509Z  2024-12-18T01:03:33.1072929Z  2024-12-18T01:03:33.1073868Z [19,663 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:33.1074874Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 24s local 2024-12-18T01:03:33.1076056Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2024-12-18T01:03:33.1076966Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2024-12-18T01:03:33.1077791Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 22s local 2024-12-18T01:03:33.1078717Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:03:33.1079498Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T01:03:33.1080432Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2024-12-18T01:03:33.1081356Z Compiling xla/pjrt/host_callback.cc; 17s local ... 2024-12-18T01:03:33.3815103Z 2024-12-18T01:03:33.3816012Z  2024-12-18T01:03:33.3816668Z  2024-12-18T01:03:33.3817060Z  2024-12-18T01:03:33.3817434Z  2024-12-18T01:03:33.3817802Z  2024-12-18T01:03:33.3818182Z  2024-12-18T01:03:33.3818571Z  2024-12-18T01:03:33.3818967Z  2024-12-18T01:03:33.3819897Z [19,665 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:33.3821092Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2024-12-18T01:03:33.3822086Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2024-12-18T01:03:33.3822994Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 22s local 2024-12-18T01:03:33.3823919Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:03:33.3824708Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T01:03:33.3825612Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:03:33.3826385Z Compiling xla/pjrt/host_callback.cc; 17s local 2024-12-18T01:03:33.3827065Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 17s local ... 2024-12-18T01:03:33.5818002Z 2024-12-18T01:03:33.5819008Z  2024-12-18T01:03:33.5819473Z  2024-12-18T01:03:33.5819912Z  2024-12-18T01:03:33.5820286Z  2024-12-18T01:03:33.5820642Z  2024-12-18T01:03:33.5821012Z  2024-12-18T01:03:33.5821383Z  2024-12-18T01:03:33.5821769Z  2024-12-18T01:03:33.5822674Z [19,666 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:33.5823680Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2024-12-18T01:03:33.5824519Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 23s local 2024-12-18T01:03:33.5825447Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:03:33.5826541Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T01:03:33.5827454Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:03:33.5828316Z Compiling xla/pjrt/host_callback.cc; 17s local 2024-12-18T01:03:33.5829190Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 17s local 2024-12-18T01:03:33.5830296Z Compiling xla/pjrt/host_callback.cc; 17s local ... 2024-12-18T01:03:33.7965707Z 2024-12-18T01:03:33.7966603Z  2024-12-18T01:03:33.7967043Z  2024-12-18T01:03:33.7967408Z  2024-12-18T01:03:33.7967762Z  2024-12-18T01:03:33.7968089Z  2024-12-18T01:03:33.7968460Z  2024-12-18T01:03:33.7968849Z  2024-12-18T01:03:33.7969180Z  2024-12-18T01:03:33.7970027Z [19,667 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:33.7970965Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2024-12-18T01:03:33.7971817Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 23s local 2024-12-18T01:03:33.7972998Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:03:33.7973781Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T01:03:33.7974460Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:03:33.7975211Z Compiling xla/pjrt/host_callback.cc; 18s local 2024-12-18T01:03:33.7975956Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 17s local 2024-12-18T01:03:33.7977172Z Compiling xla/pjrt/host_callback.cc; 17s local ... 2024-12-18T01:03:34.1823950Z 2024-12-18T01:03:34.1824831Z  2024-12-18T01:03:34.1825305Z  2024-12-18T01:03:34.1825702Z  2024-12-18T01:03:34.1826088Z  2024-12-18T01:03:34.1826487Z  2024-12-18T01:03:34.1826885Z  2024-12-18T01:03:34.1827269Z  2024-12-18T01:03:34.1827644Z  2024-12-18T01:03:34.1828580Z [19,668 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:34.1829632Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2024-12-18T01:03:34.1830494Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T01:03:34.1831350Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T01:03:34.1832268Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2024-12-18T01:03:34.1833158Z Compiling xla/pjrt/host_callback.cc; 18s local 2024-12-18T01:03:34.1834007Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local 2024-12-18T01:03:34.1834846Z Compiling xla/pjrt/host_callback.cc; 17s local 2024-12-18T01:03:34.1835693Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 14s local ... 2024-12-18T01:03:34.5829504Z 2024-12-18T01:03:34.5831037Z  2024-12-18T01:03:34.5831521Z  2024-12-18T01:03:34.5833078Z  2024-12-18T01:03:34.5834087Z  2024-12-18T01:03:34.5835245Z  2024-12-18T01:03:34.5836544Z  2024-12-18T01:03:34.5837936Z  2024-12-18T01:03:34.5839137Z  2024-12-18T01:03:34.5841220Z [19,669 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:34.5842366Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2024-12-18T01:03:34.5843264Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T01:03:34.5844050Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T01:03:34.5845120Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T01:03:34.5845983Z Compiling xla/pjrt/host_callback.cc; 18s local 2024-12-18T01:03:34.5846782Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local 2024-12-18T01:03:34.5847569Z Compiling xla/pjrt/host_callback.cc; 18s local 2024-12-18T01:03:34.5848455Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 15s local ... 2024-12-18T01:03:34.8580808Z 2024-12-18T01:03:34.8582010Z  2024-12-18T01:03:34.8582503Z  2024-12-18T01:03:34.8582891Z  2024-12-18T01:03:34.8583279Z  2024-12-18T01:03:34.8583657Z  2024-12-18T01:03:34.8584062Z  2024-12-18T01:03:34.8584428Z  2024-12-18T01:03:34.8584792Z  2024-12-18T01:03:34.8585868Z [19,670 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:34.8587049Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2024-12-18T01:03:34.8587905Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T01:03:34.8588782Z Compiling xla/pjrt/host_memory_spaces.cc; 22s local 2024-12-18T01:03:34.8589712Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T01:03:34.8590708Z Compiling xla/pjrt/host_callback.cc; 19s local 2024-12-18T01:03:34.8591557Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2024-12-18T01:03:34.8592424Z Compiling xla/pjrt/host_callback.cc; 18s local 2024-12-18T01:03:34.8593306Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 15s local ... 2024-12-18T01:03:35.1835141Z 2024-12-18T01:03:35.1836167Z  2024-12-18T01:03:35.1836622Z  2024-12-18T01:03:35.1837009Z  2024-12-18T01:03:35.1837404Z  2024-12-18T01:03:35.1837830Z  2024-12-18T01:03:35.1838218Z  2024-12-18T01:03:35.1838600Z  2024-12-18T01:03:35.1838993Z  2024-12-18T01:03:35.1839917Z [19,670 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:35.1841143Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2024-12-18T01:03:35.1842029Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2024-12-18T01:03:35.1842883Z Compiling xla/pjrt/host_memory_spaces.cc; 22s local 2024-12-18T01:03:35.1843775Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2024-12-18T01:03:35.1844852Z Compiling xla/pjrt/host_callback.cc; 19s local 2024-12-18T01:03:35.1845694Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2024-12-18T01:03:35.1846539Z Compiling xla/pjrt/host_callback.cc; 18s local 2024-12-18T01:03:35.1847352Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 15s local ... 2024-12-18T01:03:35.8014269Z 2024-12-18T01:03:35.8015265Z  2024-12-18T01:03:35.8015687Z  2024-12-18T01:03:35.8016036Z  2024-12-18T01:03:35.8016516Z  2024-12-18T01:03:35.8016897Z  2024-12-18T01:03:35.8017248Z  2024-12-18T01:03:35.8017589Z  2024-12-18T01:03:35.8017929Z  2024-12-18T01:03:35.8018712Z [19,671 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:35.8019537Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2024-12-18T01:03:35.8020261Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2024-12-18T01:03:35.8021091Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T01:03:35.8021866Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:35.8022627Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2024-12-18T01:03:35.8023352Z Compiling xla/pjrt/host_callback.cc; 19s local 2024-12-18T01:03:35.8024042Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 16s local 2024-12-18T01:03:35.8024836Z Compiling xla/pjrt/tracked_device_buffer.cc; 13s local ... 2024-12-18T01:03:36.0660250Z 2024-12-18T01:03:36.0661277Z  2024-12-18T01:03:36.0661736Z  2024-12-18T01:03:36.0662074Z  2024-12-18T01:03:36.0662439Z  2024-12-18T01:03:36.0662791Z  2024-12-18T01:03:36.0663138Z  2024-12-18T01:03:36.0663478Z  2024-12-18T01:03:36.0663816Z  2024-12-18T01:03:36.0664641Z [19,672 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:36.0665553Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2024-12-18T01:03:36.0666620Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T01:03:36.0667498Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2024-12-18T01:03:36.0668287Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:36.0669013Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2024-12-18T01:03:36.0669764Z Compiling xla/pjrt/host_callback.cc; 19s local 2024-12-18T01:03:36.0670595Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 16s local 2024-12-18T01:03:36.0671369Z Compiling xla/pjrt/tracked_device_buffer.cc; 14s local ... 2024-12-18T01:03:36.3845438Z 2024-12-18T01:03:36.3846911Z  2024-12-18T01:03:36.3847330Z  2024-12-18T01:03:36.3847700Z  2024-12-18T01:03:36.3848056Z  2024-12-18T01:03:36.3848410Z  2024-12-18T01:03:36.3848783Z  2024-12-18T01:03:36.3849119Z  2024-12-18T01:03:36.3849465Z  2024-12-18T01:03:36.3850283Z [19,673 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:36.3851440Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T01:03:36.3852187Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T01:03:36.3853065Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 22s local 2024-12-18T01:03:36.3853891Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:36.3854653Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2024-12-18T01:03:36.3855562Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:36.3856299Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 17s local 2024-12-18T01:03:36.3857235Z Compiling xla/pjrt/tracked_device_buffer.cc; 14s local ... 2024-12-18T01:03:36.5851789Z 2024-12-18T01:03:36.5852948Z  2024-12-18T01:03:36.5853414Z  2024-12-18T01:03:36.5853805Z  2024-12-18T01:03:36.5854191Z  2024-12-18T01:03:36.5854567Z  2024-12-18T01:03:36.5854979Z  2024-12-18T01:03:36.5855369Z  2024-12-18T01:03:36.5855735Z  2024-12-18T01:03:36.5856864Z [19,676 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:36.5857890Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T01:03:36.5858752Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T01:03:36.5859632Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:36.5860505Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2024-12-18T01:03:36.5861397Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:36.5862220Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 17s local 2024-12-18T01:03:36.5863122Z Compiling xla/pjrt/tracked_device_buffer.cc; 14s local 2024-12-18T01:03:36.5864023Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 14s local ... 2024-12-18T01:03:36.8365976Z 2024-12-18T01:03:36.8367348Z  2024-12-18T01:03:36.8367888Z  2024-12-18T01:03:36.8368288Z  2024-12-18T01:03:36.8368640Z  2024-12-18T01:03:36.8369044Z  2024-12-18T01:03:36.8369448Z  2024-12-18T01:03:36.8369820Z  2024-12-18T01:03:36.8370192Z  2024-12-18T01:03:36.8371085Z [19,677 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:36.8372076Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T01:03:36.8372917Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T01:03:36.8373731Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T01:03:36.8374525Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2024-12-18T01:03:36.8375368Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:36.8376134Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 17s local 2024-12-18T01:03:36.8377136Z Compiling xla/pjrt/tracked_device_buffer.cc; 14s local 2024-12-18T01:03:36.8378326Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 14s local ... 2024-12-18T01:03:37.1857199Z 2024-12-18T01:03:37.1858328Z  2024-12-18T01:03:37.1858825Z  2024-12-18T01:03:37.1859212Z  2024-12-18T01:03:37.1859601Z  2024-12-18T01:03:37.1859985Z  2024-12-18T01:03:37.1860362Z  2024-12-18T01:03:37.1860746Z  2024-12-18T01:03:37.1861127Z  2024-12-18T01:03:37.1862331Z [19,678 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:37.1863384Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2024-12-18T01:03:37.1864244Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T01:03:37.1864930Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T01:03:37.1865745Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2024-12-18T01:03:37.1866604Z Compiling xla/pjrt/host_callback.cc; 20s local 2024-12-18T01:03:37.1867424Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 17s local 2024-12-18T01:03:37.1868349Z Compiling xla/pjrt/tracked_device_buffer.cc; 15s local 2024-12-18T01:03:37.1869411Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local ... 2024-12-18T01:03:37.3859407Z 2024-12-18T01:03:37.3860295Z  2024-12-18T01:03:37.3860766Z  2024-12-18T01:03:37.3861123Z  2024-12-18T01:03:37.3861497Z  2024-12-18T01:03:37.3861891Z  2024-12-18T01:03:37.3862264Z  2024-12-18T01:03:37.3862637Z  2024-12-18T01:03:37.3862989Z  2024-12-18T01:03:37.3864112Z [19,679 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:37.3865128Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T01:03:37.3865904Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T01:03:37.3866662Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2024-12-18T01:03:37.3867423Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T01:03:37.3868186Z Compiling torch_xla/csrc/runtime/xla_util_test.cc; 18s local 2024-12-18T01:03:37.3869452Z Compiling xla/pjrt/tracked_device_buffer.cc; 15s local 2024-12-18T01:03:37.3870319Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2024-12-18T01:03:37.3871204Z Compiling xla/service/cpu/thunk_emitter.cc; 14s local ... 2024-12-18T01:03:37.7863035Z 2024-12-18T01:03:37.7864002Z  2024-12-18T01:03:37.7864550Z  2024-12-18T01:03:37.7864958Z  2024-12-18T01:03:37.7865315Z  2024-12-18T01:03:37.7865669Z  2024-12-18T01:03:37.7866067Z  2024-12-18T01:03:37.7866436Z  2024-12-18T01:03:37.7866835Z  2024-12-18T01:03:37.7867728Z [19,680 / 20,603] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2024-12-18T01:03:37.7868833Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T01:03:37.7869763Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:37.7870637Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2024-12-18T01:03:37.7871524Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T01:03:37.7872320Z Compiling xla/pjrt/tracked_device_buffer.cc; 15s local 2024-12-18T01:03:37.7873092Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2024-12-18T01:03:37.7874023Z Compiling xla/service/cpu/thunk_emitter.cc; 15s local 2024-12-18T01:03:37.7874934Z Compiling xla/service/allocation_tracker.cc; 13s local ... 2024-12-18T01:03:38.0172290Z 2024-12-18T01:03:38.0173267Z  2024-12-18T01:03:38.0173839Z  2024-12-18T01:03:38.0174243Z  2024-12-18T01:03:38.0174643Z  2024-12-18T01:03:38.0175073Z  2024-12-18T01:03:38.0175483Z  2024-12-18T01:03:38.0175876Z  2024-12-18T01:03:38.0176263Z  2024-12-18T01:03:38.0177405Z [19,682 / 20,603] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:38.0178867Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2024-12-18T01:03:38.0179855Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:38.0180685Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2024-12-18T01:03:38.0181495Z Compiling xla/pjrt/host_callback.cc; 21s local 2024-12-18T01:03:38.0182233Z Compiling xla/pjrt/tracked_device_buffer.cc; 16s local 2024-12-18T01:03:38.0183245Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2024-12-18T01:03:38.0184088Z Compiling xla/service/cpu/thunk_emitter.cc; 15s local 2024-12-18T01:03:38.0184923Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2024-12-18T01:03:38.3867709Z 2024-12-18T01:03:38.3868946Z  2024-12-18T01:03:38.3869440Z  2024-12-18T01:03:38.3869860Z  2024-12-18T01:03:38.3870217Z  2024-12-18T01:03:38.3870633Z  2024-12-18T01:03:38.3871019Z  2024-12-18T01:03:38.3871416Z  2024-12-18T01:03:38.3871815Z  2024-12-18T01:03:38.3872841Z [19,682 / 20,603] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:38.3874216Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2024-12-18T01:03:38.3875070Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:38.3875892Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2024-12-18T01:03:38.3876745Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:38.3877521Z Compiling xla/pjrt/tracked_device_buffer.cc; 16s local 2024-12-18T01:03:38.3878525Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2024-12-18T01:03:38.3879359Z Compiling xla/service/cpu/thunk_emitter.cc; 15s local 2024-12-18T01:03:38.3880197Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2024-12-18T01:03:38.5987264Z 2024-12-18T01:03:38.5988591Z  2024-12-18T01:03:38.5989069Z  2024-12-18T01:03:38.5989413Z  2024-12-18T01:03:38.5989773Z  2024-12-18T01:03:38.5990195Z  2024-12-18T01:03:38.5990561Z  2024-12-18T01:03:38.5990945Z  2024-12-18T01:03:38.5991325Z  2024-12-18T01:03:38.5992291Z [19,685 / 20,604] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:38.5993385Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2024-12-18T01:03:38.5994173Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:38.5995017Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2024-12-18T01:03:38.5995899Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:38.5996669Z Compiling xla/pjrt/tracked_device_buffer.cc; 16s local 2024-12-18T01:03:38.5997508Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2024-12-18T01:03:38.5998346Z Compiling xla/service/cpu/thunk_emitter.cc; 16s local 2024-12-18T01:03:38.5999134Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2024-12-18T01:03:38.9535018Z 2024-12-18T01:03:38.9536025Z  2024-12-18T01:03:38.9536601Z  2024-12-18T01:03:38.9536966Z  2024-12-18T01:03:38.9537329Z  2024-12-18T01:03:38.9537714Z  2024-12-18T01:03:38.9538066Z  2024-12-18T01:03:38.9538431Z  2024-12-18T01:03:38.9538777Z  2024-12-18T01:03:38.9539669Z [19,687 / 20,604] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:38.9540673Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2024-12-18T01:03:38.9541470Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T01:03:38.9542263Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2024-12-18T01:03:38.9543187Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:38.9543799Z Compiling xla/pjrt/tracked_device_buffer.cc; 17s local 2024-12-18T01:03:38.9544753Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2024-12-18T01:03:38.9545427Z Compiling xla/service/cpu/thunk_emitter.cc; 16s local 2024-12-18T01:03:38.9546359Z Compiling xla/service/allocation_tracker.cc; 15s local ... 2024-12-18T01:03:39.1877166Z 2024-12-18T01:03:39.1878941Z  2024-12-18T01:03:39.1879450Z  2024-12-18T01:03:39.1879851Z  2024-12-18T01:03:39.1880227Z  2024-12-18T01:03:39.1880624Z  2024-12-18T01:03:39.1881042Z  2024-12-18T01:03:39.1881453Z  2024-12-18T01:03:39.1883666Z  2024-12-18T01:03:39.1884616Z [19,687 / 20,604] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2024-12-18T01:03:39.1885732Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2024-12-18T01:03:39.1886570Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T01:03:39.1887428Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2024-12-18T01:03:39.1888302Z Compiling xla/pjrt/host_callback.cc; 22s local 2024-12-18T01:03:39.1889075Z Compiling xla/pjrt/tracked_device_buffer.cc; 17s local 2024-12-18T01:03:39.1889960Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2024-12-18T01:03:39.1890946Z Compiling xla/service/cpu/thunk_emitter.cc; 16s local 2024-12-18T01:03:39.1891806Z Compiling xla/service/allocation_tracker.cc; 15s local ... 2024-12-18T01:03:39.3880680Z 2024-12-18T01:03:39.3881684Z  2024-12-18T01:03:39.3882192Z  2024-12-18T01:03:39.3882587Z  2024-12-18T01:03:39.3883024Z  2024-12-18T01:03:39.3883420Z  2024-12-18T01:03:39.3883831Z  2024-12-18T01:03:39.3884212Z  2024-12-18T01:03:39.3884624Z  2024-12-18T01:03:39.3885812Z [19,692 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:39.3886858Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T01:03:39.3887697Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2024-12-18T01:03:39.3888571Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T01:03:39.3889371Z Compiling xla/pjrt/tracked_device_buffer.cc; 17s local 2024-12-18T01:03:39.3890228Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2024-12-18T01:03:39.3891099Z Compiling xla/service/cpu/thunk_emitter.cc; 16s local 2024-12-18T01:03:39.3891910Z Compiling xla/service/allocation_tracker.cc; 15s local 2024-12-18T01:03:39.3892866Z Compiling xla/service/cpu/ir_emitter.cc; 14s local ... 2024-12-18T01:03:39.5948190Z 2024-12-18T01:03:39.5949656Z  2024-12-18T01:03:39.5950076Z  2024-12-18T01:03:39.5951626Z  2024-12-18T01:03:39.5952422Z  2024-12-18T01:03:39.5953769Z  2024-12-18T01:03:39.5954820Z  2024-12-18T01:03:39.5956177Z  2024-12-18T01:03:39.5957229Z  2024-12-18T01:03:39.5959068Z [19,693 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:03:39.5960037Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T01:03:39.5960906Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2024-12-18T01:03:39.5961764Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T01:03:39.5962494Z Compiling xla/pjrt/tracked_device_buffer.cc; 17s local 2024-12-18T01:03:39.5963286Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2024-12-18T01:03:39.5964098Z Compiling xla/service/cpu/thunk_emitter.cc; 17s local 2024-12-18T01:03:39.5964893Z Compiling xla/service/allocation_tracker.cc; 15s local 2024-12-18T01:03:39.5965736Z Compiling xla/service/cpu/ir_emitter.cc; 14s local ... 2024-12-18T01:03:39.9952507Z 2024-12-18T01:03:39.9954079Z  2024-12-18T01:03:39.9954518Z  2024-12-18T01:03:39.9954871Z  2024-12-18T01:03:39.9955219Z  2024-12-18T01:03:39.9955562Z  2024-12-18T01:03:39.9955898Z  2024-12-18T01:03:39.9956227Z  2024-12-18T01:03:39.9956562Z  2024-12-18T01:03:39.9957384Z [19,693 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:39.9958531Z Compiling xla/pjrt/host_callback.cc; 24s local 2024-12-18T01:03:39.9959256Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2024-12-18T01:03:39.9959947Z Compiling xla/pjrt/host_callback.cc; 23s local 2024-12-18T01:03:39.9960595Z Compiling xla/pjrt/tracked_device_buffer.cc; 18s local 2024-12-18T01:03:39.9961299Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T01:03:39.9962140Z Compiling xla/service/cpu/thunk_emitter.cc; 17s local 2024-12-18T01:03:39.9962827Z Compiling xla/service/allocation_tracker.cc; 16s local 2024-12-18T01:03:39.9963502Z Compiling xla/service/cpu/ir_emitter.cc; 15s local ... 2024-12-18T01:03:40.2927494Z 2024-12-18T01:03:40.2929061Z  2024-12-18T01:03:40.2929539Z  2024-12-18T01:03:40.2929912Z  2024-12-18T01:03:40.2930289Z  2024-12-18T01:03:40.2930661Z  2024-12-18T01:03:40.2931059Z  2024-12-18T01:03:40.2931432Z  2024-12-18T01:03:40.2931817Z  2024-12-18T01:03:40.2932755Z [19,699 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:40.2934045Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2024-12-18T01:03:40.2934896Z Compiling xla/pjrt/host_callback.cc; 24s local 2024-12-18T01:03:40.2935629Z Compiling xla/pjrt/tracked_device_buffer.cc; 18s local 2024-12-18T01:03:40.2936609Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T01:03:40.2937414Z Compiling xla/service/cpu/thunk_emitter.cc; 17s local 2024-12-18T01:03:40.2938397Z Compiling xla/service/allocation_tracker.cc; 16s local 2024-12-18T01:03:40.2939341Z Compiling xla/service/cpu/ir_emitter.cc; 15s local 2024-12-18T01:03:40.2940261Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 13s local ... 2024-12-18T01:03:40.5959892Z 2024-12-18T01:03:40.5961286Z  2024-12-18T01:03:40.5961754Z  2024-12-18T01:03:40.5962123Z  2024-12-18T01:03:40.5962501Z  2024-12-18T01:03:40.5962861Z  2024-12-18T01:03:40.5963227Z  2024-12-18T01:03:40.5963602Z  2024-12-18T01:03:40.5963971Z  2024-12-18T01:03:40.5964835Z [19,699 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:40.5965869Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2024-12-18T01:03:40.5966787Z Compiling xla/pjrt/host_callback.cc; 24s local 2024-12-18T01:03:40.5967491Z Compiling xla/pjrt/tracked_device_buffer.cc; 18s local 2024-12-18T01:03:40.5968252Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T01:03:40.5968981Z Compiling xla/service/cpu/thunk_emitter.cc; 18s local 2024-12-18T01:03:40.5969703Z Compiling xla/service/allocation_tracker.cc; 16s local 2024-12-18T01:03:40.5970408Z Compiling xla/service/cpu/ir_emitter.cc; 15s local 2024-12-18T01:03:40.5971231Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 13s local ... 2024-12-18T01:03:40.9104767Z 2024-12-18T01:03:40.9106134Z  2024-12-18T01:03:40.9106584Z  2024-12-18T01:03:40.9106927Z  2024-12-18T01:03:40.9107303Z  2024-12-18T01:03:40.9107629Z  2024-12-18T01:03:40.9107968Z  2024-12-18T01:03:40.9108310Z  2024-12-18T01:03:40.9108650Z  2024-12-18T01:03:40.9109456Z [19,700 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:40.9110424Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2024-12-18T01:03:40.9111224Z Compiling xla/pjrt/tracked_device_buffer.cc; 18s local 2024-12-18T01:03:40.9111940Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2024-12-18T01:03:40.9112649Z Compiling xla/service/cpu/thunk_emitter.cc; 18s local 2024-12-18T01:03:40.9113364Z Compiling xla/service/allocation_tracker.cc; 17s local 2024-12-18T01:03:40.9114034Z Compiling xla/service/cpu/ir_emitter.cc; 16s local 2024-12-18T01:03:40.9114874Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 14s local 2024-12-18T01:03:40.9116001Z Compiling xla/python/ifrt/array.cc; 13s local ... 2024-12-18T01:03:41.1280827Z 2024-12-18T01:03:41.1281812Z  2024-12-18T01:03:41.1282283Z  2024-12-18T01:03:41.1282686Z  2024-12-18T01:03:41.1283074Z  2024-12-18T01:03:41.1283439Z  2024-12-18T01:03:41.1283801Z  2024-12-18T01:03:41.1284483Z  2024-12-18T01:03:41.1284889Z  2024-12-18T01:03:41.1285786Z [19,701 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:41.1286802Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2024-12-18T01:03:41.1287672Z Compiling xla/pjrt/tracked_device_buffer.cc; 19s local 2024-12-18T01:03:41.1288446Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2024-12-18T01:03:41.1289223Z Compiling xla/service/cpu/thunk_emitter.cc; 18s local 2024-12-18T01:03:41.1290022Z Compiling xla/service/allocation_tracker.cc; 17s local 2024-12-18T01:03:41.1290804Z Compiling xla/service/cpu/ir_emitter.cc; 16s local 2024-12-18T01:03:41.1291964Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 14s local 2024-12-18T01:03:41.1292935Z Compiling xla/python/ifrt/array.cc; 13s local ... 2024-12-18T01:03:41.3965684Z 2024-12-18T01:03:41.3967131Z  2024-12-18T01:03:41.3967591Z  2024-12-18T01:03:41.3969003Z  2024-12-18T01:03:41.3970077Z  2024-12-18T01:03:41.3971186Z  2024-12-18T01:03:41.3972566Z  2024-12-18T01:03:41.3974074Z  2024-12-18T01:03:41.3976209Z  2024-12-18T01:03:41.3977369Z [19,702 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:41.3978397Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2024-12-18T01:03:41.3979268Z Compiling xla/pjrt/tracked_device_buffer.cc; 19s local 2024-12-18T01:03:41.3980112Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2024-12-18T01:03:41.3980898Z Compiling xla/service/cpu/thunk_emitter.cc; 18s local 2024-12-18T01:03:41.3981725Z Compiling xla/service/allocation_tracker.cc; 17s local 2024-12-18T01:03:41.3982503Z Compiling xla/service/cpu/ir_emitter.cc; 16s local 2024-12-18T01:03:41.3983456Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 14s local 2024-12-18T01:03:41.3984457Z Compiling xla/python/ifrt/array.cc; 14s local ... 2024-12-18T01:03:41.5971557Z 2024-12-18T01:03:41.5972556Z  2024-12-18T01:03:41.5973121Z  2024-12-18T01:03:41.5973527Z  2024-12-18T01:03:41.5973905Z  2024-12-18T01:03:41.5974251Z  2024-12-18T01:03:41.5974629Z  2024-12-18T01:03:41.5975004Z  2024-12-18T01:03:41.5975370Z  2024-12-18T01:03:41.5976291Z [19,703 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:41.5977513Z Compiling xla/pjrt/tracked_device_buffer.cc; 19s local 2024-12-18T01:03:41.5978372Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2024-12-18T01:03:41.5979146Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local 2024-12-18T01:03:41.5979941Z Compiling xla/service/allocation_tracker.cc; 17s local 2024-12-18T01:03:41.5980643Z Compiling xla/service/cpu/ir_emitter.cc; 16s local 2024-12-18T01:03:41.5981596Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 14s local 2024-12-18T01:03:41.5982568Z Compiling xla/python/ifrt/array.cc; 14s local 2024-12-18T01:03:41.5983368Z Compiling xla/service/execution_tracker.cc; 14s local ... 2024-12-18T01:03:41.8143062Z 2024-12-18T01:03:41.8144882Z  2024-12-18T01:03:41.8145477Z  2024-12-18T01:03:41.8145942Z  2024-12-18T01:03:41.8146299Z  2024-12-18T01:03:41.8146676Z  2024-12-18T01:03:41.8147042Z  2024-12-18T01:03:41.8147414Z  2024-12-18T01:03:41.8147806Z  2024-12-18T01:03:41.8148727Z [19,704 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:41.8150064Z Compiling xla/pjrt/tracked_device_buffer.cc; 19s local 2024-12-18T01:03:41.8150917Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2024-12-18T01:03:41.8151730Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local 2024-12-18T01:03:41.8152557Z Compiling xla/service/cpu/ir_emitter.cc; 17s local 2024-12-18T01:03:41.8153780Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 15s local 2024-12-18T01:03:41.8154839Z Compiling xla/python/ifrt/array.cc; 14s local 2024-12-18T01:03:41.8155526Z Compiling xla/service/execution_tracker.cc; 14s local 2024-12-18T01:03:41.8156318Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 14s local ... 2024-12-18T01:03:42.1975663Z 2024-12-18T01:03:42.1977307Z  2024-12-18T01:03:42.1977811Z  2024-12-18T01:03:42.1978280Z  2024-12-18T01:03:42.1978712Z  2024-12-18T01:03:42.1979314Z  2024-12-18T01:03:42.1979699Z  2024-12-18T01:03:42.1980049Z  2024-12-18T01:03:42.1980427Z  2024-12-18T01:03:42.1981781Z [19,706 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:42.1982867Z Compiling xla/pjrt/tracked_device_buffer.cc; 20s local 2024-12-18T01:03:42.1983712Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2024-12-18T01:03:42.1984611Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local 2024-12-18T01:03:42.1985366Z Compiling xla/service/cpu/ir_emitter.cc; 17s local 2024-12-18T01:03:42.1986534Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 15s local 2024-12-18T01:03:42.1987534Z Compiling xla/service/execution_tracker.cc; 14s local 2024-12-18T01:03:42.1988325Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 14s local 2024-12-18T01:03:42.1989125Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2024-12-18T01:03:42.3978592Z 2024-12-18T01:03:42.3979664Z  2024-12-18T01:03:42.3980222Z  2024-12-18T01:03:42.3980587Z  2024-12-18T01:03:42.3980931Z  2024-12-18T01:03:42.3981307Z  2024-12-18T01:03:42.3981673Z  2024-12-18T01:03:42.3982081Z  2024-12-18T01:03:42.3982449Z  2024-12-18T01:03:42.3983353Z [19,707 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:42.3984372Z Compiling xla/pjrt/tracked_device_buffer.cc; 20s local 2024-12-18T01:03:42.3985195Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2024-12-18T01:03:42.3986009Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local 2024-12-18T01:03:42.3986770Z Compiling xla/service/cpu/ir_emitter.cc; 17s local 2024-12-18T01:03:42.3987671Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 15s local 2024-12-18T01:03:42.3988613Z Compiling xla/service/execution_tracker.cc; 14s local 2024-12-18T01:03:42.3989393Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 14s local 2024-12-18T01:03:42.3990216Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2024-12-18T01:03:42.7841021Z 2024-12-18T01:03:42.7842100Z  2024-12-18T01:03:42.7842647Z  2024-12-18T01:03:42.7843005Z  2024-12-18T01:03:42.7843362Z  2024-12-18T01:03:42.7843715Z  2024-12-18T01:03:42.7844079Z  2024-12-18T01:03:42.7844622Z  2024-12-18T01:03:42.7844979Z  2024-12-18T01:03:42.7845861Z [19,709 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:42.7846815Z Compiling xla/pjrt/tracked_device_buffer.cc; 20s local 2024-12-18T01:03:42.7847694Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2024-12-18T01:03:42.7848722Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2024-12-18T01:03:42.7849654Z Compiling xla/service/cpu/ir_emitter.cc; 18s local 2024-12-18T01:03:42.7850804Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2024-12-18T01:03:42.7852153Z Compiling xla/service/execution_tracker.cc; 15s local 2024-12-18T01:03:42.7852854Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 15s local 2024-12-18T01:03:42.7853625Z Compiling xla/service/allocation_tracker.cc; 15s local ... 2024-12-18T01:03:42.9983745Z 2024-12-18T01:03:42.9984761Z  2024-12-18T01:03:42.9985302Z  2024-12-18T01:03:42.9985733Z  2024-12-18T01:03:42.9986330Z  2024-12-18T01:03:42.9986635Z  2024-12-18T01:03:42.9986938Z  2024-12-18T01:03:42.9987241Z  2024-12-18T01:03:42.9987541Z  2024-12-18T01:03:42.9988371Z [19,711 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:42.9989349Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:43.0000613Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T01:03:43.0001485Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2024-12-18T01:03:43.0002307Z Compiling xla/service/cpu/ir_emitter.cc; 18s local 2024-12-18T01:03:43.0003453Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2024-12-18T01:03:43.0004483Z Compiling xla/service/execution_tracker.cc; 15s local 2024-12-18T01:03:43.0005329Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 15s local 2024-12-18T01:03:43.0006190Z Compiling xla/service/allocation_tracker.cc; 15s local ... 2024-12-18T01:03:43.4015323Z 2024-12-18T01:03:43.4016428Z  2024-12-18T01:03:43.4016916Z  2024-12-18T01:03:43.4017300Z  2024-12-18T01:03:43.4018012Z  2024-12-18T01:03:43.4018526Z  2024-12-18T01:03:43.4018900Z  2024-12-18T01:03:43.4019282Z  2024-12-18T01:03:43.4019669Z  2024-12-18T01:03:43.4020599Z [19,714 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:43.4021594Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:43.4022426Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T01:03:43.4023248Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2024-12-18T01:03:43.4023985Z Compiling xla/service/cpu/ir_emitter.cc; 18s local 2024-12-18T01:03:43.4024835Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2024-12-18T01:03:43.4025751Z Compiling xla/service/execution_tracker.cc; 15s local 2024-12-18T01:03:43.4026568Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 15s local 2024-12-18T01:03:43.4027413Z Compiling xla/service/allocation_tracker.cc; 15s local ... 2024-12-18T01:03:43.7237722Z 2024-12-18T01:03:43.7238768Z  2024-12-18T01:03:43.7239277Z  2024-12-18T01:03:43.7239707Z  2024-12-18T01:03:43.7240100Z  2024-12-18T01:03:43.7240503Z  2024-12-18T01:03:43.7240890Z  2024-12-18T01:03:43.7241260Z  2024-12-18T01:03:43.7241653Z  2024-12-18T01:03:43.7242563Z [19,715 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:43.7243612Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:43.7244630Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T01:03:43.7245420Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2024-12-18T01:03:43.7246192Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2024-12-18T01:03:43.7247135Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2024-12-18T01:03:43.7248102Z Compiling xla/service/execution_tracker.cc; 16s local 2024-12-18T01:03:43.7248902Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local 2024-12-18T01:03:43.7249736Z Compiling xla/service/allocation_tracker.cc; 16s local ... 2024-12-18T01:03:43.9260432Z 2024-12-18T01:03:43.9261408Z  2024-12-18T01:03:43.9261944Z  2024-12-18T01:03:43.9262422Z  2024-12-18T01:03:43.9262772Z  2024-12-18T01:03:43.9263130Z  2024-12-18T01:03:43.9263489Z  2024-12-18T01:03:43.9264161Z  2024-12-18T01:03:43.9264539Z  2024-12-18T01:03:43.9265461Z [19,716 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:43.9266380Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:43.9267167Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2024-12-18T01:03:43.9268005Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2024-12-18T01:03:43.9269001Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2024-12-18T01:03:43.9269916Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2024-12-18T01:03:43.9270813Z Compiling xla/service/execution_tracker.cc; 16s local 2024-12-18T01:03:43.9271605Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local 2024-12-18T01:03:43.9272393Z Compiling xla/service/allocation_tracker.cc; 16s local ... 2024-12-18T01:03:44.1995145Z 2024-12-18T01:03:44.1996219Z  2024-12-18T01:03:44.1996701Z  2024-12-18T01:03:44.1997151Z  2024-12-18T01:03:44.1997589Z  2024-12-18T01:03:44.1998050Z  2024-12-18T01:03:44.1998702Z  2024-12-18T01:03:44.1999058Z  2024-12-18T01:03:44.1999430Z  2024-12-18T01:03:44.2000319Z [19,717 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:44.2001280Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local 2024-12-18T01:03:44.2002067Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2024-12-18T01:03:44.2003049Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2024-12-18T01:03:44.2003766Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2024-12-18T01:03:44.2004664Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2024-12-18T01:03:44.2005580Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local 2024-12-18T01:03:44.2006338Z Compiling xla/service/allocation_tracker.cc; 16s local 2024-12-18T01:03:44.2007050Z Compiling xla/service/service.cc; 16s local ... 2024-12-18T01:03:44.4057580Z 2024-12-18T01:03:44.4058683Z  2024-12-18T01:03:44.4059244Z  2024-12-18T01:03:44.4059634Z  2024-12-18T01:03:44.4060033Z  2024-12-18T01:03:44.4060440Z  2024-12-18T01:03:44.4060793Z  2024-12-18T01:03:44.4061164Z  2024-12-18T01:03:44.4061548Z  2024-12-18T01:03:44.4062381Z [19,718 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:44.4063500Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local 2024-12-18T01:03:44.4064230Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2024-12-18T01:03:44.4065007Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2024-12-18T01:03:44.4065949Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2024-12-18T01:03:44.4066880Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local 2024-12-18T01:03:44.4067677Z Compiling xla/service/allocation_tracker.cc; 16s local 2024-12-18T01:03:44.4068410Z Compiling xla/service/service.cc; 16s local 2024-12-18T01:03:44.4069152Z Compiling xla/pjrt/tracked_device_buffer.cc; 15s local ... 2024-12-18T01:03:44.8003673Z 2024-12-18T01:03:44.8004663Z  2024-12-18T01:03:44.8005194Z  2024-12-18T01:03:44.8005654Z  2024-12-18T01:03:44.8006068Z  2024-12-18T01:03:44.8006475Z  2024-12-18T01:03:44.8006842Z  2024-12-18T01:03:44.8007193Z  2024-12-18T01:03:44.8007552Z  2024-12-18T01:03:44.8008474Z [19,718 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:44.8009470Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local 2024-12-18T01:03:44.8010299Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2024-12-18T01:03:44.8011090Z Compiling xla/service/cpu/ir_emitter.cc; 20s local 2024-12-18T01:03:44.8011963Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2024-12-18T01:03:44.8013298Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local 2024-12-18T01:03:44.8014093Z Compiling xla/service/allocation_tracker.cc; 17s local 2024-12-18T01:03:44.8014833Z Compiling xla/service/service.cc; 17s local 2024-12-18T01:03:44.8015560Z Compiling xla/pjrt/tracked_device_buffer.cc; 16s local ... 2024-12-18T01:03:45.5297202Z 2024-12-18T01:03:45.5298498Z  2024-12-18T01:03:45.5299120Z  2024-12-18T01:03:45.5299495Z  2024-12-18T01:03:45.5299880Z  2024-12-18T01:03:45.5300231Z  2024-12-18T01:03:45.5300596Z  2024-12-18T01:03:45.5300956Z  2024-12-18T01:03:45.5301265Z  2024-12-18T01:03:45.5302145Z [19,719 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:45.5303089Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2024-12-18T01:03:45.5303836Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2024-12-18T01:03:45.5304590Z Compiling xla/service/cpu/ir_emitter.cc; 20s local 2024-12-18T01:03:45.5305684Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2024-12-18T01:03:45.5306662Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2024-12-18T01:03:45.5307328Z Compiling xla/service/allocation_tracker.cc; 17s local 2024-12-18T01:03:45.5308032Z Compiling xla/service/service.cc; 17s local 2024-12-18T01:03:45.5308771Z Compiling xla/pjrt/tracked_device_buffer.cc; 16s local ... 2024-12-18T01:03:45.8015536Z 2024-12-18T01:03:45.8016639Z  2024-12-18T01:03:45.8017561Z  2024-12-18T01:03:45.8018079Z  2024-12-18T01:03:45.8018442Z  2024-12-18T01:03:45.8018801Z  2024-12-18T01:03:45.8019186Z  2024-12-18T01:03:45.8019556Z  2024-12-18T01:03:45.8019937Z  2024-12-18T01:03:45.8020879Z [19,720 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:45.8021855Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2024-12-18T01:03:45.8022649Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2024-12-18T01:03:45.8023427Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2024-12-18T01:03:45.8024365Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2024-12-18T01:03:45.8025358Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2024-12-18T01:03:45.8026119Z Compiling xla/service/service.cc; 18s local 2024-12-18T01:03:45.8026898Z Compiling xla/pjrt/tracked_device_buffer.cc; 17s local 2024-12-18T01:03:45.8027697Z Compiling xla/pjrt/host_memory_spaces.cc; 14s local ... 2024-12-18T01:03:46.0562627Z 2024-12-18T01:03:46.0563677Z  2024-12-18T01:03:46.0564214Z  2024-12-18T01:03:46.0564596Z  2024-12-18T01:03:46.0564972Z  2024-12-18T01:03:46.0565343Z  2024-12-18T01:03:46.0565707Z  2024-12-18T01:03:46.0566088Z  2024-12-18T01:03:46.0566462Z  2024-12-18T01:03:46.0567392Z [19,721 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:46.0568364Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2024-12-18T01:03:46.0569150Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2024-12-18T01:03:46.0570080Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2024-12-18T01:03:46.0571004Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2024-12-18T01:03:46.0571702Z Compiling xla/service/service.cc; 18s local 2024-12-18T01:03:46.0572402Z Compiling xla/pjrt/tracked_device_buffer.cc; 17s local 2024-12-18T01:03:46.0573088Z Compiling xla/pjrt/host_memory_spaces.cc; 14s local 2024-12-18T01:03:46.0573730Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 13s local ... 2024-12-18T01:03:46.4021148Z 2024-12-18T01:03:46.4022187Z  2024-12-18T01:03:46.4022746Z  2024-12-18T01:03:46.4023115Z  2024-12-18T01:03:46.4023487Z  2024-12-18T01:03:46.4024230Z  2024-12-18T01:03:46.4024602Z  2024-12-18T01:03:46.4024979Z  2024-12-18T01:03:46.4025387Z  2024-12-18T01:03:46.4026297Z [19,721 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:46.4027226Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2024-12-18T01:03:46.4027957Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2024-12-18T01:03:46.4028964Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2024-12-18T01:03:46.4029835Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2024-12-18T01:03:46.4030483Z Compiling xla/service/service.cc; 18s local 2024-12-18T01:03:46.4031152Z Compiling xla/pjrt/tracked_device_buffer.cc; 17s local 2024-12-18T01:03:46.4031862Z Compiling xla/pjrt/host_memory_spaces.cc; 15s local 2024-12-18T01:03:46.4032743Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 14s local ... 2024-12-18T01:03:46.9025750Z 2024-12-18T01:03:46.9026746Z  2024-12-18T01:03:46.9027291Z  2024-12-18T01:03:46.9027754Z  2024-12-18T01:03:46.9028149Z  2024-12-18T01:03:46.9028772Z  2024-12-18T01:03:46.9029203Z  2024-12-18T01:03:46.9029621Z  2024-12-18T01:03:46.9030025Z  2024-12-18T01:03:46.9030975Z [19,722 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:46.9031995Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2024-12-18T01:03:46.9032976Z Compiling xla/service/cpu/ir_emitter.cc; 22s local 2024-12-18T01:03:46.9033951Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T01:03:46.9034956Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2024-12-18T01:03:46.9035706Z Compiling xla/service/service.cc; 19s local 2024-12-18T01:03:46.9036468Z Compiling xla/pjrt/tracked_device_buffer.cc; 18s local 2024-12-18T01:03:46.9037251Z Compiling xla/pjrt/host_memory_spaces.cc; 15s local 2024-12-18T01:03:46.9038164Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 14s local ... 2024-12-18T01:03:47.2028968Z 2024-12-18T01:03:47.2029958Z  2024-12-18T01:03:47.2030465Z  2024-12-18T01:03:47.2030897Z  2024-12-18T01:03:47.2031323Z  2024-12-18T01:03:47.2031719Z  2024-12-18T01:03:47.2032173Z  2024-12-18T01:03:47.2032556Z  2024-12-18T01:03:47.2032911Z  2024-12-18T01:03:47.2033706Z [19,724 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:47.2034591Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2024-12-18T01:03:47.2035258Z Compiling xla/service/cpu/ir_emitter.cc; 22s local 2024-12-18T01:03:47.2036081Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T01:03:47.2036934Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2024-12-18T01:03:47.2037577Z Compiling xla/service/service.cc; 19s local 2024-12-18T01:03:47.2038235Z Compiling xla/pjrt/tracked_device_buffer.cc; 18s local 2024-12-18T01:03:47.2038898Z Compiling xla/pjrt/host_memory_spaces.cc; 15s local 2024-12-18T01:03:47.2039655Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 15s local ... 2024-12-18T01:03:47.4222061Z 2024-12-18T01:03:47.4223010Z  2024-12-18T01:03:47.4223494Z  2024-12-18T01:03:47.4223930Z  2024-12-18T01:03:47.4224385Z  2024-12-18T01:03:47.4224805Z  2024-12-18T01:03:47.4225217Z  2024-12-18T01:03:47.4225660Z  2024-12-18T01:03:47.4226025Z  2024-12-18T01:03:47.4226806Z [19,727 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:47.4227690Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2024-12-18T01:03:47.4228372Z Compiling xla/service/cpu/ir_emitter.cc; 22s local 2024-12-18T01:03:47.4229209Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2024-12-18T01:03:47.4230377Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2024-12-18T01:03:47.4231049Z Compiling xla/service/service.cc; 19s local 2024-12-18T01:03:47.4231721Z Compiling xla/pjrt/tracked_device_buffer.cc; 18s local 2024-12-18T01:03:47.4232426Z Compiling xla/pjrt/host_memory_spaces.cc; 16s local 2024-12-18T01:03:47.4233200Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 15s local ... 2024-12-18T01:03:47.7595797Z 2024-12-18T01:03:47.7596787Z  2024-12-18T01:03:47.7597303Z  2024-12-18T01:03:47.7597721Z  2024-12-18T01:03:47.7598188Z  2024-12-18T01:03:47.7598636Z  2024-12-18T01:03:47.7599066Z  2024-12-18T01:03:47.7599403Z  2024-12-18T01:03:47.7599750Z  2024-12-18T01:03:47.7600581Z [19,729 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:47.7601453Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2024-12-18T01:03:47.7602173Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2024-12-18T01:03:47.7603379Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2024-12-18T01:03:47.7604307Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2024-12-18T01:03:47.7605018Z Compiling xla/service/service.cc; 19s local 2024-12-18T01:03:47.7605715Z Compiling xla/pjrt/tracked_device_buffer.cc; 19s local 2024-12-18T01:03:47.7606428Z Compiling xla/pjrt/host_memory_spaces.cc; 16s local 2024-12-18T01:03:47.7607308Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 15s local ... 2024-12-18T01:03:48.0039039Z 2024-12-18T01:03:48.0040088Z  2024-12-18T01:03:48.0040585Z  2024-12-18T01:03:48.0041005Z  2024-12-18T01:03:48.0041435Z  2024-12-18T01:03:48.0041877Z  2024-12-18T01:03:48.0042225Z  2024-12-18T01:03:48.0042544Z  2024-12-18T01:03:48.0042878Z  2024-12-18T01:03:48.0043673Z [19,729 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:48.0044738Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2024-12-18T01:03:48.0045414Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2024-12-18T01:03:48.0046237Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2024-12-18T01:03:48.0047079Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2024-12-18T01:03:48.0047735Z Compiling xla/service/service.cc; 20s local 2024-12-18T01:03:48.0048427Z Compiling xla/pjrt/tracked_device_buffer.cc; 19s local 2024-12-18T01:03:48.0049126Z Compiling xla/pjrt/host_memory_spaces.cc; 16s local 2024-12-18T01:03:48.0049879Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 15s local ... 2024-12-18T01:03:48.4042616Z 2024-12-18T01:03:48.4043682Z  2024-12-18T01:03:48.4044314Z  2024-12-18T01:03:48.4044740Z  2024-12-18T01:03:48.4045162Z  2024-12-18T01:03:48.4045603Z  2024-12-18T01:03:48.4046036Z  2024-12-18T01:03:48.4046504Z  2024-12-18T01:03:48.4046908Z  2024-12-18T01:03:48.4047819Z [19,730 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:48.4048633Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2024-12-18T01:03:48.4049266Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2024-12-18T01:03:48.4050017Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2024-12-18T01:03:48.4050788Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2024-12-18T01:03:48.4051391Z Compiling xla/service/service.cc; 20s local 2024-12-18T01:03:48.4051993Z Compiling xla/pjrt/tracked_device_buffer.cc; 19s local 2024-12-18T01:03:48.4052614Z Compiling xla/pjrt/host_memory_spaces.cc; 17s local 2024-12-18T01:03:48.4053315Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 16s local ... 2024-12-18T01:03:48.7638065Z 2024-12-18T01:03:48.7639411Z  2024-12-18T01:03:48.7639846Z  2024-12-18T01:03:48.7640545Z  2024-12-18T01:03:48.7640975Z  2024-12-18T01:03:48.7641398Z  2024-12-18T01:03:48.7641807Z  2024-12-18T01:03:48.7642219Z  2024-12-18T01:03:48.7642664Z  2024-12-18T01:03:48.7643409Z [19,731 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:48.7644112Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2024-12-18T01:03:48.7646783Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2024-12-18T01:03:48.7647462Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:48.7648156Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T01:03:48.7648678Z Compiling xla/service/service.cc; 20s local 2024-12-18T01:03:48.7649194Z Compiling xla/pjrt/tracked_device_buffer.cc; 20s local 2024-12-18T01:03:48.7649758Z Compiling xla/pjrt/host_memory_spaces.cc; 17s local 2024-12-18T01:03:48.7650393Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 16s local ... 2024-12-18T01:03:49.0057569Z 2024-12-18T01:03:49.0058581Z  2024-12-18T01:03:49.0059143Z  2024-12-18T01:03:49.0059762Z  2024-12-18T01:03:49.0060068Z  2024-12-18T01:03:49.0060377Z  2024-12-18T01:03:49.0060692Z  2024-12-18T01:03:49.0061004Z  2024-12-18T01:03:49.0061326Z  2024-12-18T01:03:49.0062046Z [19,731 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:49.0062850Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2024-12-18T01:03:49.0063602Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2024-12-18T01:03:49.0064338Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:49.0065098Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T01:03:49.0065660Z Compiling xla/service/service.cc; 21s local 2024-12-18T01:03:49.0066243Z Compiling xla/pjrt/tracked_device_buffer.cc; 20s local 2024-12-18T01:03:49.0066865Z Compiling xla/pjrt/host_memory_spaces.cc; 17s local 2024-12-18T01:03:49.0067591Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 16s local ... 2024-12-18T01:03:49.4054963Z 2024-12-18T01:03:49.4056016Z  2024-12-18T01:03:49.4056580Z  2024-12-18T01:03:49.4057038Z  2024-12-18T01:03:49.4057485Z  2024-12-18T01:03:49.4057902Z  2024-12-18T01:03:49.4058371Z  2024-12-18T01:03:49.4058807Z  2024-12-18T01:03:49.4059244Z  2024-12-18T01:03:49.4060144Z [19,732 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:49.4060948Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2024-12-18T01:03:49.4061558Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2024-12-18T01:03:49.4062278Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:49.4062972Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2024-12-18T01:03:49.4063535Z Compiling xla/service/service.cc; 21s local 2024-12-18T01:03:49.4064082Z Compiling xla/pjrt/tracked_device_buffer.cc; 20s local 2024-12-18T01:03:49.4064659Z Compiling xla/pjrt/host_memory_spaces.cc; 18s local 2024-12-18T01:03:49.4065306Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local ... 2024-12-18T01:03:49.6832493Z 2024-12-18T01:03:49.6833495Z  2024-12-18T01:03:49.6834034Z  2024-12-18T01:03:49.6834485Z  2024-12-18T01:03:49.6834906Z  2024-12-18T01:03:49.6835349Z  2024-12-18T01:03:49.6835805Z  2024-12-18T01:03:49.6836140Z  2024-12-18T01:03:49.6836509Z  2024-12-18T01:03:49.6837347Z [19,733 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:49.6838249Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2024-12-18T01:03:49.6838972Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2024-12-18T01:03:49.6839830Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2024-12-18T01:03:49.6841001Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T01:03:49.6841673Z Compiling xla/service/service.cc; 21s local 2024-12-18T01:03:49.6842455Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:49.6843145Z Compiling xla/pjrt/host_memory_spaces.cc; 18s local 2024-12-18T01:03:49.6844039Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local ... 2024-12-18T01:03:49.8986438Z 2024-12-18T01:03:49.8987538Z  2024-12-18T01:03:49.8988052Z  2024-12-18T01:03:49.8988504Z  2024-12-18T01:03:49.8988947Z  2024-12-18T01:03:49.8989397Z  2024-12-18T01:03:49.8989851Z  2024-12-18T01:03:49.8990291Z  2024-12-18T01:03:49.8990748Z  2024-12-18T01:03:49.8991661Z [19,736 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:49.8992588Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2024-12-18T01:03:49.8993344Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2024-12-18T01:03:49.8994518Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2024-12-18T01:03:49.8995409Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T01:03:49.8996081Z Compiling xla/service/service.cc; 22s local 2024-12-18T01:03:49.8996777Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:49.8997518Z Compiling xla/pjrt/host_memory_spaces.cc; 18s local 2024-12-18T01:03:49.8998465Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local ... 2024-12-18T01:03:50.2060909Z 2024-12-18T01:03:50.2061993Z  2024-12-18T01:03:50.2062450Z  2024-12-18T01:03:50.2062879Z  2024-12-18T01:03:50.2063302Z  2024-12-18T01:03:50.2063726Z  2024-12-18T01:03:50.2064142Z  2024-12-18T01:03:50.2064559Z  2024-12-18T01:03:50.2064957Z  2024-12-18T01:03:50.2065920Z [19,737 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:50.2066809Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2024-12-18T01:03:50.2067544Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2024-12-18T01:03:50.2068440Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2024-12-18T01:03:50.2069389Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2024-12-18T01:03:50.2070117Z Compiling xla/service/service.cc; 22s local 2024-12-18T01:03:50.2070816Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:50.2071522Z Compiling xla/pjrt/host_memory_spaces.cc; 18s local 2024-12-18T01:03:50.2072410Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 18s local ... 2024-12-18T01:03:50.5258924Z 2024-12-18T01:03:50.5259931Z  2024-12-18T01:03:50.5260421Z  2024-12-18T01:03:50.5260865Z  2024-12-18T01:03:50.5261278Z  2024-12-18T01:03:50.5261756Z  2024-12-18T01:03:50.5262181Z  2024-12-18T01:03:50.5262520Z  2024-12-18T01:03:50.5262883Z  2024-12-18T01:03:50.5263729Z [19,739 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:50.5264637Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2024-12-18T01:03:50.5265349Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2024-12-18T01:03:50.5266071Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T01:03:50.5266742Z Compiling xla/service/service.cc; 22s local 2024-12-18T01:03:50.5267403Z Compiling xla/pjrt/tracked_device_buffer.cc; 21s local 2024-12-18T01:03:50.5268117Z Compiling xla/pjrt/host_memory_spaces.cc; 19s local 2024-12-18T01:03:50.5268821Z Compiling torch_xla/csrc/unwrap_data.cpp; 16s local 2024-12-18T01:03:50.5269587Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 16s local ... 2024-12-18T01:03:50.8070586Z 2024-12-18T01:03:50.8071634Z  2024-12-18T01:03:50.8072414Z  2024-12-18T01:03:50.8072839Z  2024-12-18T01:03:50.8073299Z  2024-12-18T01:03:50.8073729Z  2024-12-18T01:03:50.8074175Z  2024-12-18T01:03:50.8074597Z  2024-12-18T01:03:50.8075021Z  2024-12-18T01:03:50.8076079Z [19,740 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:50.8077240Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2024-12-18T01:03:50.8078012Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2024-12-18T01:03:50.8078810Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T01:03:50.8079536Z Compiling xla/service/service.cc; 23s local 2024-12-18T01:03:50.8080261Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local 2024-12-18T01:03:50.8081051Z Compiling xla/pjrt/host_memory_spaces.cc; 19s local 2024-12-18T01:03:50.8081812Z Compiling torch_xla/csrc/unwrap_data.cpp; 17s local 2024-12-18T01:03:50.8082710Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 16s local ... 2024-12-18T01:03:51.2074688Z 2024-12-18T01:03:51.2075693Z  2024-12-18T01:03:51.2076550Z  2024-12-18T01:03:51.2077026Z  2024-12-18T01:03:51.2077470Z  2024-12-18T01:03:51.2077937Z  2024-12-18T01:03:51.2078307Z  2024-12-18T01:03:51.2078684Z  2024-12-18T01:03:51.2079051Z  2024-12-18T01:03:51.2079984Z [19,741 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:51.2081187Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2024-12-18T01:03:51.2081979Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2024-12-18T01:03:51.2082730Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2024-12-18T01:03:51.2083464Z Compiling xla/service/service.cc; 23s local 2024-12-18T01:03:51.2084201Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local 2024-12-18T01:03:51.2084988Z Compiling xla/pjrt/host_memory_spaces.cc; 19s local 2024-12-18T01:03:51.2085754Z Compiling torch_xla/csrc/unwrap_data.cpp; 17s local 2024-12-18T01:03:51.2086635Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 16s local ... 2024-12-18T01:03:51.9183327Z 2024-12-18T01:03:51.9184254Z  2024-12-18T01:03:51.9184784Z  2024-12-18T01:03:51.9185216Z  2024-12-18T01:03:51.9185668Z  2024-12-18T01:03:51.9186095Z  2024-12-18T01:03:51.9186567Z  2024-12-18T01:03:51.9186996Z  2024-12-18T01:03:51.9187370Z  2024-12-18T01:03:51.9188291Z [19,742 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:51.9189414Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2024-12-18T01:03:51.9190190Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T01:03:51.9190934Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:03:51.9191624Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2024-12-18T01:03:51.9192412Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T01:03:51.9193178Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2024-12-18T01:03:51.9193983Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 17s local 2024-12-18T01:03:51.9194872Z Compiling xla/service/execution_tracker.cc; 16s local ... 2024-12-18T01:03:52.2083615Z 2024-12-18T01:03:52.2084674Z  2024-12-18T01:03:52.2085176Z  2024-12-18T01:03:52.2085616Z  2024-12-18T01:03:52.2086050Z  2024-12-18T01:03:52.2086477Z  2024-12-18T01:03:52.2086902Z  2024-12-18T01:03:52.2087464Z  2024-12-18T01:03:52.2087897Z  2024-12-18T01:03:52.2088803Z [19,744 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:52.2089709Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2024-12-18T01:03:52.2090430Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T01:03:52.2091097Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:03:52.2092088Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2024-12-18T01:03:52.2092832Z Compiling xla/pjrt/host_memory_spaces.cc; 20s local 2024-12-18T01:03:52.2093519Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2024-12-18T01:03:52.2094212Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 17s local 2024-12-18T01:03:52.2094999Z Compiling xla/service/execution_tracker.cc; 16s local ... 2024-12-18T01:03:52.4440839Z 2024-12-18T01:03:52.4441817Z  2024-12-18T01:03:52.4442317Z  2024-12-18T01:03:52.4442790Z  2024-12-18T01:03:52.4443211Z  2024-12-18T01:03:52.4443612Z  2024-12-18T01:03:52.4444053Z  2024-12-18T01:03:52.4444709Z  2024-12-18T01:03:52.4445071Z  2024-12-18T01:03:52.4445923Z [19,746 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:52.4446846Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2024-12-18T01:03:52.4447651Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2024-12-18T01:03:52.4448647Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:03:52.4449421Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2024-12-18T01:03:52.4450219Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T01:03:52.4450971Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2024-12-18T01:03:52.4451812Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local 2024-12-18T01:03:52.4452975Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 16s local ... 2024-12-18T01:03:52.8092074Z 2024-12-18T01:03:52.8092990Z  2024-12-18T01:03:52.8093492Z  2024-12-18T01:03:52.8093904Z  2024-12-18T01:03:52.8094336Z  2024-12-18T01:03:52.8094728Z  2024-12-18T01:03:52.8095170Z  2024-12-18T01:03:52.8095730Z  2024-12-18T01:03:52.8096047Z  2024-12-18T01:03:52.8097076Z [19,748 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:52.8098101Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2024-12-18T01:03:52.8098876Z Compiling xla/service/service.cc; 25s local 2024-12-18T01:03:52.8099551Z Compiling xla/pjrt/tracked_device_buffer.cc; 24s local 2024-12-18T01:03:52.8100317Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T01:03:52.8101025Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2024-12-18T01:03:52.8101852Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local 2024-12-18T01:03:52.8102771Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 16s local 2024-12-18T01:03:52.8103770Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 16s local ... 2024-12-18T01:03:53.2096591Z 2024-12-18T01:03:53.2097679Z  2024-12-18T01:03:53.2098224Z  2024-12-18T01:03:53.2098637Z  2024-12-18T01:03:53.2099011Z  2024-12-18T01:03:53.2099380Z  2024-12-18T01:03:53.2099710Z  2024-12-18T01:03:53.2100114Z  2024-12-18T01:03:53.2100500Z  2024-12-18T01:03:53.2101471Z [19,750 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:53.2102418Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2024-12-18T01:03:53.2103071Z Compiling xla/service/service.cc; 25s local 2024-12-18T01:03:53.2103777Z Compiling xla/pjrt/host_memory_spaces.cc; 21s local 2024-12-18T01:03:53.2104565Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2024-12-18T01:03:53.2105428Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local 2024-12-18T01:03:53.2106395Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 16s local 2024-12-18T01:03:53.2107406Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 16s local 2024-12-18T01:03:53.2108369Z @llvm-project//mlir:MemRefTransforms; 14s local ... 2024-12-18T01:03:53.4099586Z 2024-12-18T01:03:53.4100528Z  2024-12-18T01:03:53.4101051Z  2024-12-18T01:03:53.4101826Z  2024-12-18T01:03:53.4102249Z  2024-12-18T01:03:53.4102656Z  2024-12-18T01:03:53.4103090Z  2024-12-18T01:03:53.4103464Z  2024-12-18T01:03:53.4103830Z  2024-12-18T01:03:53.4104727Z [19,751 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:53.4105773Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2024-12-18T01:03:53.4106660Z Compiling xla/service/service.cc; 25s local 2024-12-18T01:03:53.4107451Z Compiling xla/pjrt/host_memory_spaces.cc; 22s local 2024-12-18T01:03:53.4108275Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2024-12-18T01:03:53.4109218Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2024-12-18T01:03:53.4110156Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 17s local 2024-12-18T01:03:53.4111018Z @llvm-project//mlir:MemRefTransforms; 14s local 2024-12-18T01:03:53.4111961Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 14s local ... 2024-12-18T01:03:54.0980465Z 2024-12-18T01:03:54.0981546Z  2024-12-18T01:03:54.0982017Z  2024-12-18T01:03:54.0982796Z  2024-12-18T01:03:54.0983247Z  2024-12-18T01:03:54.0983677Z  2024-12-18T01:03:54.0984119Z  2024-12-18T01:03:54.0984538Z  2024-12-18T01:03:54.0984998Z  2024-12-18T01:03:54.0985882Z [19,752 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:54.0986922Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2024-12-18T01:03:54.0987781Z Compiling xla/service/service.cc; 26s local 2024-12-18T01:03:54.0988525Z Compiling xla/pjrt/host_memory_spaces.cc; 22s local 2024-12-18T01:03:54.0989298Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2024-12-18T01:03:54.0990189Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2024-12-18T01:03:54.0991123Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 17s local 2024-12-18T01:03:54.0991941Z @llvm-project//mlir:MemRefTransforms; 15s local 2024-12-18T01:03:54.0992939Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local ... 2024-12-18T01:03:54.4106827Z 2024-12-18T01:03:54.4107891Z  2024-12-18T01:03:54.4108333Z  2024-12-18T01:03:54.4108765Z  2024-12-18T01:03:54.4109228Z  2024-12-18T01:03:54.4109653Z  2024-12-18T01:03:54.4110109Z  2024-12-18T01:03:54.4110518Z  2024-12-18T01:03:54.4110951Z  2024-12-18T01:03:54.4111851Z [19,753 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:54.4112697Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2024-12-18T01:03:54.4113366Z Compiling xla/service/service.cc; 26s local 2024-12-18T01:03:54.4114003Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2024-12-18T01:03:54.4114783Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T01:03:54.4115635Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local 2024-12-18T01:03:54.4116311Z @llvm-project//mlir:MemRefTransforms; 15s local 2024-12-18T01:03:54.4117070Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2024-12-18T01:03:54.4117886Z Compiling xla/service/cpu/ir_emitter2.cc; 15s local ... 2024-12-18T01:03:54.6957143Z 2024-12-18T01:03:54.6958345Z  2024-12-18T01:03:54.6958865Z  2024-12-18T01:03:54.6959254Z  2024-12-18T01:03:54.6959659Z  2024-12-18T01:03:54.6960103Z  2024-12-18T01:03:54.6960523Z  2024-12-18T01:03:54.6960951Z  2024-12-18T01:03:54.6961375Z  2024-12-18T01:03:54.6962370Z [19,754 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:54.6963266Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:03:54.6963923Z Compiling xla/service/service.cc; 26s local 2024-12-18T01:03:54.6964559Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2024-12-18T01:03:54.6965787Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T01:03:54.6966692Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local 2024-12-18T01:03:54.6967483Z @llvm-project//mlir:MemRefTransforms; 16s local 2024-12-18T01:03:54.6968387Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2024-12-18T01:03:54.6969324Z Compiling xla/service/cpu/ir_emitter2.cc; 15s local ... 2024-12-18T01:03:55.0117184Z 2024-12-18T01:03:55.0118257Z  2024-12-18T01:03:55.0118734Z  2024-12-18T01:03:55.0119226Z  2024-12-18T01:03:55.0119809Z  2024-12-18T01:03:55.0120232Z  2024-12-18T01:03:55.0120663Z  2024-12-18T01:03:55.0121083Z  2024-12-18T01:03:55.0121501Z  2024-12-18T01:03:55.0122413Z [19,755 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:55.0123353Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:03:55.0124070Z Compiling xla/service/service.cc; 27s local 2024-12-18T01:03:55.0124971Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2024-12-18T01:03:55.0125799Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T01:03:55.0126691Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local 2024-12-18T01:03:55.0127523Z @llvm-project//mlir:MemRefTransforms; 16s local 2024-12-18T01:03:55.0128496Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2024-12-18T01:03:55.0129608Z Compiling xla/service/cpu/ir_emitter2.cc; 15s local ... 2024-12-18T01:03:55.2115132Z 2024-12-18T01:03:55.2116064Z  2024-12-18T01:03:55.2116565Z  2024-12-18T01:03:55.2116990Z  2024-12-18T01:03:55.2117391Z  2024-12-18T01:03:55.2117799Z  2024-12-18T01:03:55.2118231Z  2024-12-18T01:03:55.2118659Z  2024-12-18T01:03:55.2119014Z  2024-12-18T01:03:55.2119896Z [19,758 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:55.2120889Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:03:55.2121614Z Compiling xla/service/service.cc; 27s local 2024-12-18T01:03:55.2122314Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2024-12-18T01:03:55.2123137Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2024-12-18T01:03:55.2124034Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local 2024-12-18T01:03:55.2124903Z @llvm-project//mlir:MemRefTransforms; 16s local 2024-12-18T01:03:55.2125829Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2024-12-18T01:03:55.2126787Z Compiling xla/service/cpu/ir_emitter2.cc; 15s local ... 2024-12-18T01:03:55.4970559Z 2024-12-18T01:03:55.4971645Z  2024-12-18T01:03:55.4972147Z  2024-12-18T01:03:55.4972527Z  2024-12-18T01:03:55.4972962Z  2024-12-18T01:03:55.4973425Z  2024-12-18T01:03:55.4973888Z  2024-12-18T01:03:55.4974324Z  2024-12-18T01:03:55.4974737Z  2024-12-18T01:03:55.4975750Z [19,759 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:55.4976797Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2024-12-18T01:03:55.4977509Z Compiling xla/service/service.cc; 27s local 2024-12-18T01:03:55.4978242Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2024-12-18T01:03:55.4979046Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2024-12-18T01:03:55.4979956Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local 2024-12-18T01:03:55.4980744Z @llvm-project//mlir:MemRefTransforms; 17s local 2024-12-18T01:03:55.4981583Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2024-12-18T01:03:55.4982566Z Compiling xla/service/cpu/ir_emitter2.cc; 16s local ... 2024-12-18T01:03:55.8123028Z 2024-12-18T01:03:55.8124077Z  2024-12-18T01:03:55.8125004Z  2024-12-18T01:03:55.8125439Z  2024-12-18T01:03:55.8125877Z  2024-12-18T01:03:55.8126301Z  2024-12-18T01:03:55.8126746Z  2024-12-18T01:03:55.8127190Z  2024-12-18T01:03:55.8127615Z  2024-12-18T01:03:55.8128502Z [19,759 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:55.8129489Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2024-12-18T01:03:55.8130409Z Compiling xla/service/service.cc; 28s local 2024-12-18T01:03:55.8131088Z Compiling torch_xla/csrc/unwrap_data.cpp; 22s local 2024-12-18T01:03:55.8131922Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2024-12-18T01:03:55.8132814Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local 2024-12-18T01:03:55.8133629Z @llvm-project//mlir:MemRefTransforms; 17s local 2024-12-18T01:03:55.8134494Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2024-12-18T01:03:55.8135471Z Compiling xla/service/cpu/ir_emitter2.cc; 16s local ... 2024-12-18T01:03:56.8133844Z 2024-12-18T01:03:56.8134920Z  2024-12-18T01:03:56.8135706Z  2024-12-18T01:03:56.8136161Z  2024-12-18T01:03:56.8136729Z  2024-12-18T01:03:56.8137159Z  2024-12-18T01:03:56.8137574Z  2024-12-18T01:03:56.8137966Z  2024-12-18T01:03:56.8138396Z  2024-12-18T01:03:56.8139330Z [19,759 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:56.8140425Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2024-12-18T01:03:56.8141101Z Compiling xla/service/service.cc; 29s local 2024-12-18T01:03:56.8141758Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2024-12-18T01:03:56.8142546Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2024-12-18T01:03:56.8143381Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2024-12-18T01:03:56.8144370Z @llvm-project//mlir:MemRefTransforms; 18s local 2024-12-18T01:03:56.8145243Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local 2024-12-18T01:03:56.8146094Z Compiling xla/service/cpu/ir_emitter2.cc; 17s local ... 2024-12-18T01:03:57.0375100Z 2024-12-18T01:03:57.0376134Z  2024-12-18T01:03:57.0376727Z  2024-12-18T01:03:57.0377153Z  2024-12-18T01:03:57.0377593Z  2024-12-18T01:03:57.0378016Z  2024-12-18T01:03:57.0378496Z  2024-12-18T01:03:57.0378922Z  2024-12-18T01:03:57.0379312Z  2024-12-18T01:03:57.0380299Z [19,760 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:57.0381221Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2024-12-18T01:03:57.0381975Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2024-12-18T01:03:57.0382766Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2024-12-18T01:03:57.0383706Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2024-12-18T01:03:57.0384559Z @llvm-project//mlir:MemRefTransforms; 18s local 2024-12-18T01:03:57.0385484Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local 2024-12-18T01:03:57.0386411Z Compiling xla/service/cpu/ir_emitter2.cc; 17s local 2024-12-18T01:03:57.0387202Z Compiling xla/service/cpu/thunk_emitter.cc; 17s local ... 2024-12-18T01:03:57.4139546Z 2024-12-18T01:03:57.4140607Z  2024-12-18T01:03:57.4141137Z  2024-12-18T01:03:57.4141595Z  2024-12-18T01:03:57.4142016Z  2024-12-18T01:03:57.4142466Z  2024-12-18T01:03:57.4142888Z  2024-12-18T01:03:57.4143326Z  2024-12-18T01:03:57.4143764Z  2024-12-18T01:03:57.4145005Z [19,760 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:57.4145959Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2024-12-18T01:03:57.4146691Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2024-12-18T01:03:57.4147863Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2024-12-18T01:03:57.4148788Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2024-12-18T01:03:57.4149601Z @llvm-project//mlir:MemRefTransforms; 18s local 2024-12-18T01:03:57.4150485Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local 2024-12-18T01:03:57.4151453Z Compiling xla/service/cpu/ir_emitter2.cc; 18s local 2024-12-18T01:03:57.4152488Z Compiling xla/service/cpu/thunk_emitter.cc; 18s local ... 2024-12-18T01:03:57.6962448Z 2024-12-18T01:03:57.6964471Z  2024-12-18T01:03:57.6965058Z  2024-12-18T01:03:57.6965511Z  2024-12-18T01:03:57.6965960Z  2024-12-18T01:03:57.6966379Z  2024-12-18T01:03:57.6966720Z  2024-12-18T01:03:57.6967085Z  2024-12-18T01:03:57.6967520Z  2024-12-18T01:03:57.6968428Z [19,763 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:57.6969376Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2024-12-18T01:03:57.6970102Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2024-12-18T01:03:57.6971141Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2024-12-18T01:03:57.6972095Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2024-12-18T01:03:57.6972956Z @llvm-project//mlir:MemRefTransforms; 19s local 2024-12-18T01:03:57.6973882Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local 2024-12-18T01:03:57.6974814Z Compiling xla/service/cpu/ir_emitter2.cc; 18s local 2024-12-18T01:03:57.6975968Z Compiling xla/service/cpu/thunk_emitter.cc; 18s local ... 2024-12-18T01:03:57.9611153Z 2024-12-18T01:03:57.9612139Z  2024-12-18T01:03:57.9612649Z  2024-12-18T01:03:57.9613078Z  2024-12-18T01:03:57.9613510Z  2024-12-18T01:03:57.9613893Z  2024-12-18T01:03:57.9614346Z  2024-12-18T01:03:57.9614743Z  2024-12-18T01:03:57.9615076Z  2024-12-18T01:03:57.9615949Z [19,764 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:03:57.9617091Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2024-12-18T01:03:57.9617872Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2024-12-18T01:03:57.9618647Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2024-12-18T01:03:57.9619453Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2024-12-18T01:03:57.9620242Z @llvm-project//mlir:MemRefTransforms; 19s local 2024-12-18T01:03:57.9621085Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 19s local 2024-12-18T01:03:57.9621936Z Compiling xla/service/cpu/ir_emitter2.cc; 18s local 2024-12-18T01:03:57.9622684Z Compiling xla/service/cpu/thunk_emitter.cc; 18s local ... 2024-12-18T01:03:58.3365076Z 2024-12-18T01:03:58.3366603Z  2024-12-18T01:03:58.3367105Z  2024-12-18T01:03:58.3367536Z  2024-12-18T01:03:58.3367948Z  2024-12-18T01:03:58.3368403Z  2024-12-18T01:03:58.3368830Z  2024-12-18T01:03:58.3369252Z  2024-12-18T01:03:58.3369654Z  2024-12-18T01:03:58.3370585Z [19,764 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:58.3371519Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2024-12-18T01:03:58.3372281Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2024-12-18T01:03:58.3373104Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2024-12-18T01:03:58.3373997Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2024-12-18T01:03:58.3374822Z @llvm-project//mlir:MemRefTransforms; 19s local 2024-12-18T01:03:58.3375741Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 19s local 2024-12-18T01:03:58.3376819Z Compiling xla/service/cpu/ir_emitter2.cc; 19s local 2024-12-18T01:03:58.3377638Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local ... 2024-12-18T01:03:58.7368293Z 2024-12-18T01:03:58.7370521Z  2024-12-18T01:03:58.7371038Z  2024-12-18T01:03:58.7372177Z  2024-12-18T01:03:58.7373410Z  2024-12-18T01:03:58.7374815Z  2024-12-18T01:03:58.7376161Z  2024-12-18T01:03:58.7377592Z  2024-12-18T01:03:58.7378891Z  2024-12-18T01:03:58.7380803Z [19,768 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:58.7382238Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2024-12-18T01:03:58.7383101Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2024-12-18T01:03:58.7384006Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2024-12-18T01:03:58.7384949Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2024-12-18T01:03:58.7394794Z @llvm-project//mlir:MemRefTransforms; 20s local 2024-12-18T01:03:58.7395761Z Compiling xla/service/cpu/ir_emitter2.cc; 19s local 2024-12-18T01:03:58.7396541Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local 2024-12-18T01:03:58.7397429Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local ... 2024-12-18T01:03:59.0001325Z 2024-12-18T01:03:59.0003207Z  2024-12-18T01:03:59.0003716Z  2024-12-18T01:03:59.0004920Z  2024-12-18T01:03:59.0006258Z  2024-12-18T01:03:59.0007660Z  2024-12-18T01:03:59.0008995Z  2024-12-18T01:03:59.0010364Z  2024-12-18T01:03:59.0011753Z  2024-12-18T01:03:59.0013702Z [19,770 / 20,604] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:03:59.0014976Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2024-12-18T01:03:59.0015833Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2024-12-18T01:03:59.0016865Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2024-12-18T01:03:59.0017833Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2024-12-18T01:03:59.0018635Z Compiling xla/service/cpu/ir_emitter2.cc; 19s local 2024-12-18T01:03:59.0019420Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local 2024-12-18T01:03:59.0020270Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2024-12-18T01:03:59.0021242Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local ... 2024-12-18T01:03:59.3372864Z 2024-12-18T01:03:59.3374983Z  2024-12-18T01:03:59.3375499Z  2024-12-18T01:03:59.3376714Z  2024-12-18T01:03:59.3377954Z  2024-12-18T01:03:59.3379234Z  2024-12-18T01:03:59.3380568Z  2024-12-18T01:03:59.3381867Z  2024-12-18T01:03:59.3383210Z  2024-12-18T01:03:59.3385165Z [19,770 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:03:59.3386208Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2024-12-18T01:03:59.3387041Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2024-12-18T01:03:59.3387962Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2024-12-18T01:03:59.3388982Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2024-12-18T01:03:59.3389736Z Compiling xla/service/cpu/ir_emitter2.cc; 20s local 2024-12-18T01:03:59.3390485Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2024-12-18T01:03:59.3391291Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2024-12-18T01:03:59.3392211Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local ... 2024-12-18T01:04:00.2148359Z 2024-12-18T01:04:00.2150788Z  2024-12-18T01:04:00.2152493Z  2024-12-18T01:04:00.2153053Z  2024-12-18T01:04:00.2154513Z  2024-12-18T01:04:00.2155052Z  2024-12-18T01:04:00.2156479Z  2024-12-18T01:04:00.2157031Z  2024-12-18T01:04:00.2158404Z  2024-12-18T01:04:00.2159427Z [19,771 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:00.2161469Z Compiling xla/service/cpu/ir_emitter.cc; 35s local 2024-12-18T01:04:00.2163846Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local 2024-12-18T01:04:00.2164818Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2024-12-18T01:04:00.2166714Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2024-12-18T01:04:00.2168501Z Compiling xla/service/cpu/ir_emitter2.cc; 20s local 2024-12-18T01:04:00.2169366Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2024-12-18T01:04:00.2171388Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2024-12-18T01:04:00.2173281Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local ... 2024-12-18T01:04:00.5380265Z 2024-12-18T01:04:00.5382330Z  2024-12-18T01:04:00.5383759Z  2024-12-18T01:04:00.5385084Z  2024-12-18T01:04:00.5386535Z  2024-12-18T01:04:00.5387037Z  2024-12-18T01:04:00.5388342Z  2024-12-18T01:04:00.5389660Z  2024-12-18T01:04:00.5390144Z  2024-12-18T01:04:00.5391979Z [19,771 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:00.5393944Z Compiling xla/service/cpu/ir_emitter.cc; 35s local 2024-12-18T01:04:00.5395146Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2024-12-18T01:04:00.5396962Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2024-12-18T01:04:00.5398788Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2024-12-18T01:04:00.5399608Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:04:00.5401176Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2024-12-18T01:04:00.5403004Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T01:04:00.5403875Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local ... 2024-12-18T01:04:00.7483985Z 2024-12-18T01:04:00.7486138Z  2024-12-18T01:04:00.7487635Z  2024-12-18T01:04:00.7489020Z  2024-12-18T01:04:00.7490373Z  2024-12-18T01:04:00.7491735Z  2024-12-18T01:04:00.7493082Z  2024-12-18T01:04:00.7494511Z  2024-12-18T01:04:00.7495861Z  2024-12-18T01:04:00.7497971Z [19,772 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:00.7500011Z Compiling xla/service/cpu/ir_emitter.cc; 36s local 2024-12-18T01:04:00.7500936Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2024-12-18T01:04:00.7502780Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2024-12-18T01:04:00.7504741Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2024-12-18T01:04:00.7505766Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:04:00.7507554Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2024-12-18T01:04:00.7509428Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T01:04:00.7510514Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local ... 2024-12-18T01:04:01.0971009Z 2024-12-18T01:04:01.0973012Z  2024-12-18T01:04:01.0974606Z  2024-12-18T01:04:01.0975988Z  2024-12-18T01:04:01.0977528Z  2024-12-18T01:04:01.0978897Z  2024-12-18T01:04:01.0979548Z  2024-12-18T01:04:01.0981070Z  2024-12-18T01:04:01.0982450Z  2024-12-18T01:04:01.0983506Z [19,775 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:01.0985463Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2024-12-18T01:04:01.0987204Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2024-12-18T01:04:01.0989100Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2024-12-18T01:04:01.0989994Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local 2024-12-18T01:04:01.0991679Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2024-12-18T01:04:01.0993439Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T01:04:01.0994437Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2024-12-18T01:04:01.0996560Z Compiling xla/python/ifrt/client.cc; 19s local ... 2024-12-18T01:04:01.3229741Z 2024-12-18T01:04:01.3230651Z  2024-12-18T01:04:01.3231154Z  2024-12-18T01:04:01.3231545Z  2024-12-18T01:04:01.3231906Z  2024-12-18T01:04:01.3232253Z  2024-12-18T01:04:01.3232604Z  2024-12-18T01:04:01.3232950Z  2024-12-18T01:04:01.3233303Z  2024-12-18T01:04:01.3234136Z [19,776 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:01.3235416Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2024-12-18T01:04:01.3236251Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2024-12-18T01:04:01.3237101Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T01:04:01.3237896Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:04:01.3238627Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2024-12-18T01:04:01.3239443Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2024-12-18T01:04:01.3240277Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2024-12-18T01:04:01.3241234Z Compiling xla/python/ifrt/client.cc; 19s local ... 2024-12-18T01:04:01.5391851Z 2024-12-18T01:04:01.5392709Z  2024-12-18T01:04:01.5393175Z  2024-12-18T01:04:01.5393561Z  2024-12-18T01:04:01.5393934Z  2024-12-18T01:04:01.5394360Z  2024-12-18T01:04:01.5394744Z  2024-12-18T01:04:01.5395141Z  2024-12-18T01:04:01.5395509Z  2024-12-18T01:04:01.5396731Z [19,778 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:01.5397747Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:01.5398606Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2024-12-18T01:04:01.5399501Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T01:04:01.5400243Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:04:01.5400967Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2024-12-18T01:04:01.5401750Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:04:01.5402526Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2024-12-18T01:04:01.5403293Z Compiling xla/python/ifrt/client.cc; 19s local ... 2024-12-18T01:04:01.7391479Z 2024-12-18T01:04:01.7392419Z  2024-12-18T01:04:01.7392902Z  2024-12-18T01:04:01.7393301Z  2024-12-18T01:04:01.7393696Z  2024-12-18T01:04:01.7394091Z  2024-12-18T01:04:01.7394483Z  2024-12-18T01:04:01.7394865Z  2024-12-18T01:04:01.7395260Z  2024-12-18T01:04:01.7396136Z [19,780 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:01.7397076Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:01.7397898Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T01:04:01.7398653Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:04:01.7399439Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2024-12-18T01:04:01.7400187Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:04:01.7401047Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2024-12-18T01:04:01.7401819Z Compiling xla/python/ifrt/client.cc; 19s local 2024-12-18T01:04:01.7402561Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 17s local ... 2024-12-18T01:04:01.9692905Z 2024-12-18T01:04:01.9693846Z  2024-12-18T01:04:01.9694288Z  2024-12-18T01:04:01.9694668Z  2024-12-18T01:04:01.9695047Z  2024-12-18T01:04:01.9695450Z  2024-12-18T01:04:01.9695839Z  2024-12-18T01:04:01.9696225Z  2024-12-18T01:04:01.9696711Z  2024-12-18T01:04:01.9697615Z [19,782 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:01.9698916Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:01.9699759Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T01:04:01.9700516Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:04:01.9701275Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2024-12-18T01:04:01.9702079Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:04:01.9703206Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2024-12-18T01:04:01.9704051Z Compiling xla/python/ifrt/client.cc; 20s local 2024-12-18T01:04:01.9704922Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 17s local ... 2024-12-18T01:04:02.2495202Z 2024-12-18T01:04:02.2496101Z  2024-12-18T01:04:02.2496692Z  2024-12-18T01:04:02.2497085Z  2024-12-18T01:04:02.2497448Z  2024-12-18T01:04:02.2497787Z  2024-12-18T01:04:02.2498160Z  2024-12-18T01:04:02.2498537Z  2024-12-18T01:04:02.2498932Z  2024-12-18T01:04:02.2499867Z [19,783 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:02.2501125Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:02.2501983Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2024-12-18T01:04:02.2502833Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2024-12-18T01:04:02.2503582Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2024-12-18T01:04:02.2504417Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2024-12-18T01:04:02.2505441Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2024-12-18T01:04:02.2506207Z Compiling xla/python/ifrt/client.cc; 20s local 2024-12-18T01:04:02.2506999Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 17s local ... 2024-12-18T01:04:02.5399672Z 2024-12-18T01:04:02.5400580Z  2024-12-18T01:04:02.5400976Z  2024-12-18T01:04:02.5401317Z  2024-12-18T01:04:02.5401671Z  2024-12-18T01:04:02.5402042Z  2024-12-18T01:04:02.5402383Z  2024-12-18T01:04:02.5402699Z  2024-12-18T01:04:02.5403063Z  2024-12-18T01:04:02.5403867Z [19,783 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:02.5404720Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2024-12-18T01:04:02.5405456Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2024-12-18T01:04:02.5406329Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2024-12-18T01:04:02.5406972Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2024-12-18T01:04:02.5407721Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T01:04:02.5408400Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2024-12-18T01:04:02.5409024Z Compiling xla/python/ifrt/client.cc; 20s local 2024-12-18T01:04:02.5409668Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2024-12-18T01:04:03.2319299Z 2024-12-18T01:04:03.2320187Z  2024-12-18T01:04:03.2320644Z  2024-12-18T01:04:03.2321026Z  2024-12-18T01:04:03.2321432Z  2024-12-18T01:04:03.2321834Z  2024-12-18T01:04:03.2322301Z  2024-12-18T01:04:03.2322683Z  2024-12-18T01:04:03.2323068Z  2024-12-18T01:04:03.2323957Z [19,784 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:03.2324979Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2024-12-18T01:04:03.2325836Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2024-12-18T01:04:03.2327147Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2024-12-18T01:04:03.2328085Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2024-12-18T01:04:03.2329094Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2024-12-18T01:04:03.2330118Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2024-12-18T01:04:03.2331024Z Compiling xla/python/ifrt/client.cc; 21s local 2024-12-18T01:04:03.2332415Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2024-12-18T01:04:03.5406877Z 2024-12-18T01:04:03.5407849Z  2024-12-18T01:04:03.5408392Z  2024-12-18T01:04:03.5408826Z  2024-12-18T01:04:03.5409272Z  2024-12-18T01:04:03.5409719Z  2024-12-18T01:04:03.5410182Z  2024-12-18T01:04:03.5410509Z  2024-12-18T01:04:03.5411043Z  2024-12-18T01:04:03.5411816Z [19,784 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:03.5412590Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2024-12-18T01:04:03.5413263Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2024-12-18T01:04:03.5413931Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2024-12-18T01:04:03.5414523Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2024-12-18T01:04:03.5415201Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2024-12-18T01:04:03.5415928Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2024-12-18T01:04:03.5416883Z Compiling xla/python/ifrt/client.cc; 21s local 2024-12-18T01:04:03.5417546Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local ... 2024-12-18T01:04:03.7409814Z 2024-12-18T01:04:03.7410789Z  2024-12-18T01:04:03.7411320Z  2024-12-18T01:04:03.7411746Z  2024-12-18T01:04:03.7412190Z  2024-12-18T01:04:03.7412601Z  2024-12-18T01:04:03.7413058Z  2024-12-18T01:04:03.7413453Z  2024-12-18T01:04:03.7414127Z  2024-12-18T01:04:03.7415022Z [19,786 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:03.7416015Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2024-12-18T01:04:03.7416990Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2024-12-18T01:04:03.7417806Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2024-12-18T01:04:03.7418570Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2024-12-18T01:04:03.7419383Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2024-12-18T01:04:03.7420229Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2024-12-18T01:04:03.7421014Z Compiling xla/python/ifrt/client.cc; 21s local 2024-12-18T01:04:03.7421841Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local ... 2024-12-18T01:04:04.5089065Z 2024-12-18T01:04:04.5090121Z  2024-12-18T01:04:04.5090628Z  2024-12-18T01:04:04.5091053Z  2024-12-18T01:04:04.5091524Z  2024-12-18T01:04:04.5091932Z  2024-12-18T01:04:04.5092392Z  2024-12-18T01:04:04.5092755Z  2024-12-18T01:04:04.5093088Z  2024-12-18T01:04:04.5093896Z [19,787 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:04.5094817Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T01:04:04.5095611Z Compiling xla/service/cpu/ir_emitter2.cc; 25s local 2024-12-18T01:04:04.5096497Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2024-12-18T01:04:04.5097372Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T01:04:04.5098160Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T01:04:04.5098922Z Compiling xla/python/ifrt/client.cc; 22s local 2024-12-18T01:04:04.5099791Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T01:04:04.5100733Z Compiling xla/client/local_client.cc; 17s local ... 2024-12-18T01:04:04.7421226Z 2024-12-18T01:04:04.7422096Z  2024-12-18T01:04:04.7422636Z  2024-12-18T01:04:04.7423079Z  2024-12-18T01:04:04.7423498Z  2024-12-18T01:04:04.7423907Z  2024-12-18T01:04:04.7424343Z  2024-12-18T01:04:04.7424761Z  2024-12-18T01:04:04.7425185Z  2024-12-18T01:04:04.7426134Z [19,789 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:04.7427566Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2024-12-18T01:04:04.7428483Z Compiling xla/service/cpu/ir_emitter2.cc; 25s local 2024-12-18T01:04:04.7429444Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2024-12-18T01:04:04.7430325Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T01:04:04.7431341Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T01:04:04.7432230Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T01:04:04.7433056Z Compiling xla/client/local_client.cc; 17s local 2024-12-18T01:04:04.7433902Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 17s local ... 2024-12-18T01:04:05.3053327Z 2024-12-18T01:04:05.3054241Z  2024-12-18T01:04:05.3054758Z  2024-12-18T01:04:05.3055201Z  2024-12-18T01:04:05.3055633Z  2024-12-18T01:04:05.3056062Z  2024-12-18T01:04:05.3056561Z  2024-12-18T01:04:05.3056983Z  2024-12-18T01:04:05.3057372Z  2024-12-18T01:04:05.3058539Z [19,790 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:05.3059610Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T01:04:05.3060428Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2024-12-18T01:04:05.3061184Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2024-12-18T01:04:05.3062054Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2024-12-18T01:04:05.3063111Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2024-12-18T01:04:05.3063995Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T01:04:05.3064796Z Compiling xla/client/local_client.cc; 18s local 2024-12-18T01:04:05.3065583Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 17s local ... 2024-12-18T01:04:05.5428519Z 2024-12-18T01:04:05.5429659Z  2024-12-18T01:04:05.5430409Z  2024-12-18T01:04:05.5431176Z  2024-12-18T01:04:05.5431773Z  2024-12-18T01:04:05.5432226Z  2024-12-18T01:04:05.5432663Z  2024-12-18T01:04:05.5433123Z  2024-12-18T01:04:05.5433526Z  2024-12-18T01:04:05.5434490Z [19,790 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:05.5435677Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T01:04:05.5436562Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2024-12-18T01:04:05.5437295Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2024-12-18T01:04:05.5438218Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T01:04:05.5439111Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T01:04:05.5439979Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:05.5440956Z Compiling xla/client/local_client.cc; 18s local 2024-12-18T01:04:05.5441842Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 17s local ... 2024-12-18T01:04:05.8865398Z 2024-12-18T01:04:05.8866318Z  2024-12-18T01:04:05.8866900Z  2024-12-18T01:04:05.8867313Z  2024-12-18T01:04:05.8867678Z  2024-12-18T01:04:05.8868054Z  2024-12-18T01:04:05.8868411Z  2024-12-18T01:04:05.8868782Z  2024-12-18T01:04:05.8869168Z  2024-12-18T01:04:05.8870095Z [19,791 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:05.8871146Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T01:04:05.8871939Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2024-12-18T01:04:05.8872737Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2024-12-18T01:04:05.8873517Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T01:04:05.8874374Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T01:04:05.8875224Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:05.8876287Z Compiling xla/client/local_client.cc; 18s local 2024-12-18T01:04:05.8877147Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2024-12-18T01:04:06.1433545Z 2024-12-18T01:04:06.1434461Z  2024-12-18T01:04:06.1434988Z  2024-12-18T01:04:06.1435545Z  2024-12-18T01:04:06.1435990Z  2024-12-18T01:04:06.1436788Z  2024-12-18T01:04:06.1437234Z  2024-12-18T01:04:06.1437594Z  2024-12-18T01:04:06.1437967Z  2024-12-18T01:04:06.1438811Z [19,792 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:06.1439768Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2024-12-18T01:04:06.1440551Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2024-12-18T01:04:06.1441324Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2024-12-18T01:04:06.1442176Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2024-12-18T01:04:06.1442983Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T01:04:06.1443955Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:06.1444914Z Compiling xla/client/local_client.cc; 19s local 2024-12-18T01:04:06.1445648Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2024-12-18T01:04:06.4007863Z 2024-12-18T01:04:06.4008840Z  2024-12-18T01:04:06.4009375Z  2024-12-18T01:04:06.4009820Z  2024-12-18T01:04:06.4010240Z  2024-12-18T01:04:06.4010639Z  2024-12-18T01:04:06.4011177Z  2024-12-18T01:04:06.4011518Z  2024-12-18T01:04:06.4011849Z  2024-12-18T01:04:06.4012614Z [19,793 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:06.4013496Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T01:04:06.4014172Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2024-12-18T01:04:06.4014828Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2024-12-18T01:04:06.4015547Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2024-12-18T01:04:06.4016288Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2024-12-18T01:04:06.4017140Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:06.4017786Z Compiling xla/client/local_client.cc; 19s local 2024-12-18T01:04:06.4018452Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2024-12-18T01:04:06.7439858Z 2024-12-18T01:04:06.7440799Z  2024-12-18T01:04:06.7441351Z  2024-12-18T01:04:06.7441781Z  2024-12-18T01:04:06.7442215Z  2024-12-18T01:04:06.7442647Z  2024-12-18T01:04:06.7443090Z  2024-12-18T01:04:06.7443520Z  2024-12-18T01:04:06.7443878Z  2024-12-18T01:04:06.7448251Z [19,793 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:06.7449480Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2024-12-18T01:04:06.7450281Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2024-12-18T01:04:06.7450988Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2024-12-18T01:04:06.7451792Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2024-12-18T01:04:06.7452644Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2024-12-18T01:04:06.7453490Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T01:04:06.7454268Z Compiling xla/client/local_client.cc; 19s local 2024-12-18T01:04:06.7455065Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local ... 2024-12-18T01:04:07.4418789Z 2024-12-18T01:04:07.4419748Z  2024-12-18T01:04:07.4420283Z  2024-12-18T01:04:07.4420713Z  2024-12-18T01:04:07.4421146Z  2024-12-18T01:04:07.4421552Z  2024-12-18T01:04:07.4421909Z  2024-12-18T01:04:07.4422265Z  2024-12-18T01:04:07.4422983Z  2024-12-18T01:04:07.4423944Z [19,794 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:07.4425002Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T01:04:07.4425859Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2024-12-18T01:04:07.4426689Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2024-12-18T01:04:07.4427766Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T01:04:07.4428576Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T01:04:07.4429335Z Compiling xla/client/local_client.cc; 20s local 2024-12-18T01:04:07.4430117Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local 2024-12-18T01:04:07.4431009Z Compiling torch_xla/csrc/runtime/computation_client.cc; 17s local ... 2024-12-18T01:04:07.7451291Z 2024-12-18T01:04:07.7452237Z  2024-12-18T01:04:07.7452774Z  2024-12-18T01:04:07.7453198Z  2024-12-18T01:04:07.7453677Z  2024-12-18T01:04:07.7454100Z  2024-12-18T01:04:07.7454562Z  2024-12-18T01:04:07.7455043Z  2024-12-18T01:04:07.7455670Z  2024-12-18T01:04:07.7456745Z [19,795 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:07.7457946Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T01:04:07.7458771Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2024-12-18T01:04:07.7459786Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2024-12-18T01:04:07.7460672Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T01:04:07.7461538Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T01:04:07.7462367Z Compiling xla/client/local_client.cc; 20s local 2024-12-18T01:04:07.7463099Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T01:04:07.7463962Z Compiling torch_xla/csrc/runtime/computation_client.cc; 17s local ... 2024-12-18T01:04:08.0684951Z 2024-12-18T01:04:08.0686030Z  2024-12-18T01:04:08.0686783Z  2024-12-18T01:04:08.0687604Z  2024-12-18T01:04:08.0688184Z  2024-12-18T01:04:08.0688596Z  2024-12-18T01:04:08.0689019Z  2024-12-18T01:04:08.0689447Z  2024-12-18T01:04:08.0689864Z  2024-12-18T01:04:08.0690818Z [19,798 / 20,604] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:04:08.0691996Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2024-12-18T01:04:08.0693192Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2024-12-18T01:04:08.0694095Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T01:04:08.0694960Z Compiling xla/client/local_client.cc; 21s local 2024-12-18T01:04:08.0695778Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T01:04:08.0696924Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2024-12-18T01:04:08.0697874Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 17s local 2024-12-18T01:04:08.0698735Z Compiling torch_xla/csrc/runtime/computation_client.cc; 17s local ... 2024-12-18T01:04:08.3460043Z 2024-12-18T01:04:08.3461042Z  2024-12-18T01:04:08.3461544Z  2024-12-18T01:04:08.3463052Z  2024-12-18T01:04:08.3463624Z  2024-12-18T01:04:08.3464060Z  2024-12-18T01:04:08.3464512Z  2024-12-18T01:04:08.3464930Z  2024-12-18T01:04:08.3465335Z  2024-12-18T01:04:08.3466322Z [19,799 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:08.3467339Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T01:04:08.3468151Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2024-12-18T01:04:08.3468964Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2024-12-18T01:04:08.3469775Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2024-12-18T01:04:08.3470986Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2024-12-18T01:04:08.3471909Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 18s local 2024-12-18T01:04:08.3472877Z Compiling torch_xla/csrc/runtime/computation_client.cc; 17s local 2024-12-18T01:04:08.3473750Z Compiling xla/client/client.cc; 16s local ... 2024-12-18T01:04:08.7464271Z 2024-12-18T01:04:08.7465619Z  2024-12-18T01:04:08.7466149Z  2024-12-18T01:04:08.7466962Z  2024-12-18T01:04:08.7467395Z  2024-12-18T01:04:08.7467822Z  2024-12-18T01:04:08.7468252Z  2024-12-18T01:04:08.7468670Z  2024-12-18T01:04:08.7469087Z  2024-12-18T01:04:08.7470062Z [19,802 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:08.7471219Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T01:04:08.7472181Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2024-12-18T01:04:08.7473052Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T01:04:08.7474122Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:08.7475012Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2024-12-18T01:04:08.7475877Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 18s local 2024-12-18T01:04:08.7476705Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2024-12-18T01:04:08.7477652Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 16s local ... 2024-12-18T01:04:09.0106619Z 2024-12-18T01:04:09.0107633Z  2024-12-18T01:04:09.0108178Z  2024-12-18T01:04:09.0109065Z  2024-12-18T01:04:09.0109508Z  2024-12-18T01:04:09.0110053Z  2024-12-18T01:04:09.0110468Z  2024-12-18T01:04:09.0110888Z  2024-12-18T01:04:09.0111306Z  2024-12-18T01:04:09.0112271Z [19,803 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:09.0113430Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2024-12-18T01:04:09.0114396Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2024-12-18T01:04:09.0115206Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T01:04:09.0116011Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:09.0116879Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2024-12-18T01:04:09.0117725Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 18s local 2024-12-18T01:04:09.0118656Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2024-12-18T01:04:09.0119592Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 16s local ... 2024-12-18T01:04:09.3070918Z 2024-12-18T01:04:09.3071913Z  2024-12-18T01:04:09.3072411Z  2024-12-18T01:04:09.3073891Z  2024-12-18T01:04:09.3074445Z  2024-12-18T01:04:09.3074888Z  2024-12-18T01:04:09.3075315Z  2024-12-18T01:04:09.3075778Z  2024-12-18T01:04:09.3076185Z  2024-12-18T01:04:09.3077179Z [19,804 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:09.3078345Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T01:04:09.3079303Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2024-12-18T01:04:09.3080252Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:09.3081259Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2024-12-18T01:04:09.3082207Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local 2024-12-18T01:04:09.3082948Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2024-12-18T01:04:09.3083668Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 17s local 2024-12-18T01:04:09.3084301Z Compiling xla/python/ifrt/topology.cc; 17s local ... 2024-12-18T01:04:09.5473532Z 2024-12-18T01:04:09.5474394Z  2024-12-18T01:04:09.5475110Z  2024-12-18T01:04:09.5475480Z  2024-12-18T01:04:09.5475858Z  2024-12-18T01:04:09.5476247Z  2024-12-18T01:04:09.5476644Z  2024-12-18T01:04:09.5477026Z  2024-12-18T01:04:09.5477316Z  2024-12-18T01:04:09.5478037Z [19,804 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:09.5478812Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T01:04:09.5479702Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T01:04:09.5480386Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2024-12-18T01:04:09.5481204Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2024-12-18T01:04:09.5482095Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local 2024-12-18T01:04:09.5482920Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2024-12-18T01:04:09.5483774Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 17s local 2024-12-18T01:04:09.5484557Z Compiling xla/python/ifrt/topology.cc; 17s local ... 2024-12-18T01:04:09.9475669Z 2024-12-18T01:04:09.9476868Z  2024-12-18T01:04:09.9477427Z  2024-12-18T01:04:09.9477865Z  2024-12-18T01:04:09.9478298Z  2024-12-18T01:04:09.9478692Z  2024-12-18T01:04:09.9479139Z  2024-12-18T01:04:09.9479511Z  2024-12-18T01:04:09.9479891Z  2024-12-18T01:04:09.9480803Z [19,805 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:09.9482047Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T01:04:09.9482906Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T01:04:09.9483690Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T01:04:09.9484555Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2024-12-18T01:04:09.9485445Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local 2024-12-18T01:04:09.9486340Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2024-12-18T01:04:09.9487216Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 17s local 2024-12-18T01:04:09.9488017Z Compiling xla/python/ifrt/topology.cc; 17s local ... 2024-12-18T01:04:10.1894826Z 2024-12-18T01:04:10.1895857Z  2024-12-18T01:04:10.1896503Z  2024-12-18T01:04:10.1896944Z  2024-12-18T01:04:10.1897538Z  2024-12-18T01:04:10.1897921Z  2024-12-18T01:04:10.1900457Z  2024-12-18T01:04:10.1903201Z  2024-12-18T01:04:10.1905980Z  2024-12-18T01:04:10.1909268Z [19,806 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:10.1912700Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2024-12-18T01:04:10.1915961Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2024-12-18T01:04:10.1919187Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T01:04:10.1921279Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2024-12-18T01:04:10.1922383Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local 2024-12-18T01:04:10.1923469Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2024-12-18T01:04:10.1924510Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 18s local 2024-12-18T01:04:10.1925462Z Compiling xla/python/ifrt/topology.cc; 18s local ... 2024-12-18T01:04:10.5481032Z 2024-12-18T01:04:10.5482227Z  2024-12-18T01:04:10.5483021Z  2024-12-18T01:04:10.5483670Z  2024-12-18T01:04:10.5484155Z  2024-12-18T01:04:10.5484566Z  2024-12-18T01:04:10.5485001Z  2024-12-18T01:04:10.5485426Z  2024-12-18T01:04:10.5485854Z  2024-12-18T01:04:10.5486809Z [19,807 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:10.5487695Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T01:04:10.5488775Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T01:04:10.5489541Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2024-12-18T01:04:10.5490334Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2024-12-18T01:04:10.5491140Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2024-12-18T01:04:10.5491929Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2024-12-18T01:04:10.5492902Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 18s local 2024-12-18T01:04:10.5493606Z Compiling xla/python/ifrt/topology.cc; 18s local ... 2024-12-18T01:04:10.9486516Z 2024-12-18T01:04:10.9487503Z  2024-12-18T01:04:10.9487994Z  2024-12-18T01:04:10.9488429Z  2024-12-18T01:04:10.9488851Z  2024-12-18T01:04:10.9489261Z  2024-12-18T01:04:10.9489717Z  2024-12-18T01:04:10.9490091Z  2024-12-18T01:04:10.9490413Z  2024-12-18T01:04:10.9491234Z [19,808 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:10.9492526Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T01:04:10.9493310Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T01:04:10.9494047Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T01:04:10.9494843Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2024-12-18T01:04:10.9495610Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2024-12-18T01:04:10.9496709Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2024-12-18T01:04:10.9497480Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 18s local 2024-12-18T01:04:10.9498166Z Compiling xla/python/ifrt/topology.cc; 18s local ... 2024-12-18T01:04:11.2461012Z 2024-12-18T01:04:11.2461891Z  2024-12-18T01:04:11.2462395Z  2024-12-18T01:04:11.2462818Z  2024-12-18T01:04:11.2463255Z  2024-12-18T01:04:11.2463668Z  2024-12-18T01:04:11.2464109Z  2024-12-18T01:04:11.2464476Z  2024-12-18T01:04:11.2464764Z  2024-12-18T01:04:11.2465462Z [19,809 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:11.2466206Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2024-12-18T01:04:11.2466853Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2024-12-18T01:04:11.2467505Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T01:04:11.2468168Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2024-12-18T01:04:11.2468811Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2024-12-18T01:04:11.2469451Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2024-12-18T01:04:11.2470077Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 19s local 2024-12-18T01:04:11.2470706Z Compiling xla/service/compile_only_service.cc; 18s local ... 2024-12-18T01:04:11.5492852Z 2024-12-18T01:04:11.5493810Z  2024-12-18T01:04:11.5494334Z  2024-12-18T01:04:11.5494801Z  2024-12-18T01:04:11.5495251Z  2024-12-18T01:04:11.5495660Z  2024-12-18T01:04:11.5496094Z  2024-12-18T01:04:11.5496651Z  2024-12-18T01:04:11.5497002Z  2024-12-18T01:04:11.5497826Z [19,809 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:11.5498873Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T01:04:11.5499710Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T01:04:11.5500527Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 23s local 2024-12-18T01:04:11.5501370Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2024-12-18T01:04:11.5502220Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2024-12-18T01:04:11.5503036Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2024-12-18T01:04:11.5504274Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 19s local 2024-12-18T01:04:11.5505167Z Compiling xla/service/compile_only_service.cc; 18s local ... 2024-12-18T01:04:11.8654781Z 2024-12-18T01:04:11.8655697Z  2024-12-18T01:04:11.8656168Z  2024-12-18T01:04:11.8656685Z  2024-12-18T01:04:11.8657040Z  2024-12-18T01:04:11.8657400Z  2024-12-18T01:04:11.8657764Z  2024-12-18T01:04:11.8658427Z  2024-12-18T01:04:11.8658817Z  2024-12-18T01:04:11.8659759Z [19,810 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:11.8660744Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T01:04:11.8661613Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T01:04:11.8662422Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 24s local 2024-12-18T01:04:11.8663301Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2024-12-18T01:04:11.8664225Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2024-12-18T01:04:11.8665288Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2024-12-18T01:04:11.8666159Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 19s local 2024-12-18T01:04:11.8666995Z Compiling xla/service/compile_only_service.cc; 19s local ... 2024-12-18T01:04:12.1498669Z 2024-12-18T01:04:12.1499573Z  2024-12-18T01:04:12.1500125Z  2024-12-18T01:04:12.1500550Z  2024-12-18T01:04:12.1500992Z  2024-12-18T01:04:12.1501412Z  2024-12-18T01:04:12.1502006Z  2024-12-18T01:04:12.1502388Z  2024-12-18T01:04:12.1502736Z  2024-12-18T01:04:12.1503663Z [19,810 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:12.1504694Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2024-12-18T01:04:12.1505529Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T01:04:12.1506410Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 24s local 2024-12-18T01:04:12.1507328Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2024-12-18T01:04:12.1508235Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2024-12-18T01:04:12.1509150Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2024-12-18T01:04:12.1510063Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 20s local 2024-12-18T01:04:12.1510951Z Compiling xla/service/compile_only_service.cc; 19s local ... 2024-12-18T01:04:12.3502800Z 2024-12-18T01:04:12.3503794Z  2024-12-18T01:04:12.3504318Z  2024-12-18T01:04:12.3504754Z  2024-12-18T01:04:12.3505183Z  2024-12-18T01:04:12.3505570Z  2024-12-18T01:04:12.3505929Z  2024-12-18T01:04:12.3506330Z  2024-12-18T01:04:12.3506673Z  2024-12-18T01:04:12.3507560Z [19,811 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:12.3508603Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T01:04:12.3509439Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2024-12-18T01:04:12.3510274Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 24s local 2024-12-18T01:04:12.3511135Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2024-12-18T01:04:12.3511989Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:12.3512870Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2024-12-18T01:04:12.3513791Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 20s local 2024-12-18T01:04:12.3514649Z Compiling xla/service/compile_only_service.cc; 19s local ... 2024-12-18T01:04:12.6722442Z 2024-12-18T01:04:12.6723434Z  2024-12-18T01:04:12.6723965Z  2024-12-18T01:04:12.6724412Z  2024-12-18T01:04:12.6724847Z  2024-12-18T01:04:12.6725256Z  2024-12-18T01:04:12.6725612Z  2024-12-18T01:04:12.6725990Z  2024-12-18T01:04:12.6726710Z  2024-12-18T01:04:12.6727670Z [19,812 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:12.6728723Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T01:04:12.6729442Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T01:04:12.6730242Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 25s local 2024-12-18T01:04:12.6731376Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2024-12-18T01:04:12.6732315Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:12.6733245Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2024-12-18T01:04:12.6734193Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 20s local 2024-12-18T01:04:12.6735143Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local ... 2024-12-18T01:04:12.9507672Z 2024-12-18T01:04:12.9508570Z  2024-12-18T01:04:12.9509042Z  2024-12-18T01:04:12.9509411Z  2024-12-18T01:04:12.9509772Z  2024-12-18T01:04:12.9510185Z  2024-12-18T01:04:12.9510820Z  2024-12-18T01:04:12.9511211Z  2024-12-18T01:04:12.9511568Z  2024-12-18T01:04:12.9512435Z [19,813 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:12.9513427Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T01:04:12.9514305Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T01:04:12.9515572Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2024-12-18T01:04:12.9516456Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:12.9517331Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2024-12-18T01:04:12.9518242Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 20s local 2024-12-18T01:04:12.9519097Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T01:04:12.9520047Z Compiling xla/service/compile_only_service.cc; 18s local ... 2024-12-18T01:04:13.1511766Z 2024-12-18T01:04:13.1512858Z  2024-12-18T01:04:13.1513379Z  2024-12-18T01:04:13.1513783Z  2024-12-18T01:04:13.1514197Z  2024-12-18T01:04:13.1514615Z  2024-12-18T01:04:13.1514974Z  2024-12-18T01:04:13.1515318Z  2024-12-18T01:04:13.1515700Z  2024-12-18T01:04:13.1516611Z [19,814 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:13.1517684Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2024-12-18T01:04:13.1518528Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T01:04:13.1519444Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2024-12-18T01:04:13.1520283Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:13.1521096Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2024-12-18T01:04:13.1521986Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 21s local 2024-12-18T01:04:13.1522811Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T01:04:13.1523688Z Compiling xla/service/compile_only_service.cc; 18s local ... 2024-12-18T01:04:13.3668726Z 2024-12-18T01:04:13.3669706Z  2024-12-18T01:04:13.3670230Z  2024-12-18T01:04:13.3670719Z  2024-12-18T01:04:13.3671163Z  2024-12-18T01:04:13.3671563Z  2024-12-18T01:04:13.3671922Z  2024-12-18T01:04:13.3672328Z  2024-12-18T01:04:13.3672724Z  2024-12-18T01:04:13.3673656Z [19,817 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:13.3674762Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T01:04:13.3675614Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2024-12-18T01:04:13.3676708Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2024-12-18T01:04:13.3677817Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T01:04:13.3678691Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2024-12-18T01:04:13.3679515Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 21s local 2024-12-18T01:04:13.3680370Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T01:04:13.3681432Z Compiling xla/service/compile_only_service.cc; 18s local ... 2024-12-18T01:04:13.6721608Z 2024-12-18T01:04:13.6722660Z  2024-12-18T01:04:13.6723233Z  2024-12-18T01:04:13.6723661Z  2024-12-18T01:04:13.6724095Z  2024-12-18T01:04:13.6724516Z  2024-12-18T01:04:13.6724871Z  2024-12-18T01:04:13.6725253Z  2024-12-18T01:04:13.6725618Z  2024-12-18T01:04:13.6726670Z [19,819 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:13.6727656Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T01:04:13.6728541Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2024-12-18T01:04:13.6729736Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2024-12-18T01:04:13.6730581Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T01:04:13.6731436Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2024-12-18T01:04:13.6742169Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 21s local 2024-12-18T01:04:13.6743234Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2024-12-18T01:04:13.6744613Z Compiling xla/service/compile_only_service.cc; 18s local ... 2024-12-18T01:04:13.9517377Z 2024-12-18T01:04:13.9518339Z  2024-12-18T01:04:13.9518857Z  2024-12-18T01:04:13.9519291Z  2024-12-18T01:04:13.9519718Z  2024-12-18T01:04:13.9520148Z  2024-12-18T01:04:13.9520606Z  2024-12-18T01:04:13.9520991Z  2024-12-18T01:04:13.9521355Z  2024-12-18T01:04:13.9522338Z [19,822 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:13.9523463Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T01:04:13.9524362Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2024-12-18T01:04:13.9525363Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2024-12-18T01:04:13.9526313Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T01:04:13.9527314Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2024-12-18T01:04:13.9528250Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 21s local 2024-12-18T01:04:13.9529130Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T01:04:13.9530087Z Compiling xla/service/compile_only_service.cc; 19s local ... 2024-12-18T01:04:14.1520526Z 2024-12-18T01:04:14.1521508Z  2024-12-18T01:04:14.1522033Z  2024-12-18T01:04:14.1522448Z  2024-12-18T01:04:14.1522911Z  2024-12-18T01:04:14.1523328Z  2024-12-18T01:04:14.1523733Z  2024-12-18T01:04:14.1524158Z  2024-12-18T01:04:14.1524557Z  2024-12-18T01:04:14.1525518Z [19,824 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:14.1526520Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2024-12-18T01:04:14.1527355Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2024-12-18T01:04:14.1528233Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2024-12-18T01:04:14.1529079Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T01:04:14.1529952Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2024-12-18T01:04:14.1530916Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local 2024-12-18T01:04:14.1531758Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T01:04:14.1532641Z Compiling xla/service/compile_only_service.cc; 19s local ... 2024-12-18T01:04:14.6765928Z 2024-12-18T01:04:14.6766824Z  2024-12-18T01:04:14.6767419Z  2024-12-18T01:04:14.6767983Z  2024-12-18T01:04:14.6768379Z  2024-12-18T01:04:14.6768770Z  2024-12-18T01:04:14.6769163Z  2024-12-18T01:04:14.6769534Z  2024-12-18T01:04:14.6769922Z  2024-12-18T01:04:14.6770864Z [19,825 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:14.6772218Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T01:04:14.6773122Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2024-12-18T01:04:14.6774046Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2024-12-18T01:04:14.6774950Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T01:04:14.6775851Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2024-12-18T01:04:14.6777341Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local 2024-12-18T01:04:14.6778431Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2024-12-18T01:04:14.6779486Z Compiling xla/service/service.cc; 17s local ... 2024-12-18T01:04:14.9527590Z 2024-12-18T01:04:14.9528526Z  2024-12-18T01:04:14.9529056Z  2024-12-18T01:04:14.9529495Z  2024-12-18T01:04:14.9529923Z  2024-12-18T01:04:14.9530371Z  2024-12-18T01:04:14.9530809Z  2024-12-18T01:04:14.9531183Z  2024-12-18T01:04:14.9531526Z  2024-12-18T01:04:14.9532690Z [19,826 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:14.9533760Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2024-12-18T01:04:14.9534642Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2024-12-18T01:04:14.9535562Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T01:04:14.9536627Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2024-12-18T01:04:14.9537578Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local 2024-12-18T01:04:14.9538492Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T01:04:14.9539273Z Compiling xla/service/service.cc; 17s local 2024-12-18T01:04:14.9539871Z Compiling torch_xla/csrc/unwrap_data.cpp; 17s local ... 2024-12-18T01:04:15.4944492Z 2024-12-18T01:04:15.4945415Z  2024-12-18T01:04:15.4945872Z  2024-12-18T01:04:15.4946240Z  2024-12-18T01:04:15.4946616Z  2024-12-18T01:04:15.4947012Z  2024-12-18T01:04:15.4947386Z  2024-12-18T01:04:15.4947769Z  2024-12-18T01:04:15.4948151Z  2024-12-18T01:04:15.4949072Z [19,827 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:15.4950063Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T01:04:15.4950983Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2024-12-18T01:04:15.4951882Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T01:04:15.4952796Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2024-12-18T01:04:15.4953667Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 23s local 2024-12-18T01:04:15.4954545Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T01:04:15.4955315Z Compiling xla/service/service.cc; 18s local 2024-12-18T01:04:15.4956018Z Compiling torch_xla/csrc/unwrap_data.cpp; 17s local ... 2024-12-18T01:04:15.7539794Z 2024-12-18T01:04:15.7540656Z  2024-12-18T01:04:15.7541089Z  2024-12-18T01:04:15.7541467Z  2024-12-18T01:04:15.7541823Z  2024-12-18T01:04:15.7542186Z  2024-12-18T01:04:15.7542516Z  2024-12-18T01:04:15.7542864Z  2024-12-18T01:04:15.7543212Z  2024-12-18T01:04:15.7544045Z [19,829 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:15.7545568Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T01:04:15.7546550Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2024-12-18T01:04:15.7547375Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T01:04:15.7548162Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2024-12-18T01:04:15.7549152Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2024-12-18T01:04:15.7549865Z Compiling xla/service/service.cc; 18s local 2024-12-18T01:04:15.7550504Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2024-12-18T01:04:15.7551237Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 17s local ... 2024-12-18T01:04:15.9542583Z 2024-12-18T01:04:15.9543457Z  2024-12-18T01:04:15.9543874Z  2024-12-18T01:04:15.9560455Z  2024-12-18T01:04:15.9561267Z  2024-12-18T01:04:15.9561614Z  2024-12-18T01:04:15.9561991Z  2024-12-18T01:04:15.9562399Z  2024-12-18T01:04:15.9562775Z  2024-12-18T01:04:15.9563990Z [19,830 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:15.9564997Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2024-12-18T01:04:15.9566042Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2024-12-18T01:04:15.9566896Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T01:04:15.9567664Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2024-12-18T01:04:15.9568596Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2024-12-18T01:04:15.9569316Z Compiling xla/service/service.cc; 18s local 2024-12-18T01:04:15.9569940Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2024-12-18T01:04:15.9570720Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 17s local ... 2024-12-18T01:04:16.2945755Z 2024-12-18T01:04:16.2946656Z  2024-12-18T01:04:16.2947144Z  2024-12-18T01:04:16.2947529Z  2024-12-18T01:04:16.2947907Z  2024-12-18T01:04:16.2948278Z  2024-12-18T01:04:16.2948666Z  2024-12-18T01:04:16.2949008Z  2024-12-18T01:04:16.2949376Z  2024-12-18T01:04:16.2950289Z [19,832 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:16.2951301Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T01:04:16.2952232Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2024-12-18T01:04:16.2953132Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:04:16.2954006Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2024-12-18T01:04:16.2954989Z Compiling xla/service/service.cc; 19s local 2024-12-18T01:04:16.2955708Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2024-12-18T01:04:16.2956536Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 17s local 2024-12-18T01:04:16.2957330Z Compiling torch_xla/csrc/ir.cpp; 17s local ... 2024-12-18T01:04:16.5549110Z 2024-12-18T01:04:16.5550054Z  2024-12-18T01:04:16.5550526Z  2024-12-18T01:04:16.5550995Z  2024-12-18T01:04:16.5551409Z  2024-12-18T01:04:16.5551816Z  2024-12-18T01:04:16.5552183Z  2024-12-18T01:04:16.5552572Z  2024-12-18T01:04:16.5552978Z  2024-12-18T01:04:16.5553933Z [19,833 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:16.5555011Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T01:04:16.5555983Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2024-12-18T01:04:16.5556952Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:04:16.5557886Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2024-12-18T01:04:16.5558689Z Compiling xla/service/service.cc; 19s local 2024-12-18T01:04:16.5559736Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2024-12-18T01:04:16.5560551Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 18s local 2024-12-18T01:04:16.5561344Z Compiling torch_xla/csrc/ir.cpp; 17s local ... 2024-12-18T01:04:16.9330156Z 2024-12-18T01:04:16.9331036Z  2024-12-18T01:04:16.9331452Z  2024-12-18T01:04:16.9331822Z  2024-12-18T01:04:16.9332186Z  2024-12-18T01:04:16.9332818Z  2024-12-18T01:04:16.9333182Z  2024-12-18T01:04:16.9333552Z  2024-12-18T01:04:16.9333928Z  2024-12-18T01:04:16.9334835Z [19,834 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:16.9335703Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T01:04:16.9336794Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:16.9337532Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:04:16.9338267Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2024-12-18T01:04:16.9339021Z Compiling xla/service/service.cc; 19s local 2024-12-18T01:04:16.9339775Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2024-12-18T01:04:16.9340528Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 18s local 2024-12-18T01:04:16.9341232Z Compiling torch_xla/csrc/ir.cpp; 17s local ... 2024-12-18T01:04:17.1554508Z 2024-12-18T01:04:17.1555361Z  2024-12-18T01:04:17.1555849Z  2024-12-18T01:04:17.1556266Z  2024-12-18T01:04:17.1556651Z  2024-12-18T01:04:17.1557325Z  2024-12-18T01:04:17.1557739Z  2024-12-18T01:04:17.1558147Z  2024-12-18T01:04:17.1558535Z  2024-12-18T01:04:17.1559488Z [19,834 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:17.1560566Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2024-12-18T01:04:17.1561556Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:17.1562508Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:04:17.1563486Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2024-12-18T01:04:17.1564354Z Compiling xla/service/service.cc; 20s local 2024-12-18T01:04:17.1565136Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2024-12-18T01:04:17.1566135Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 18s local 2024-12-18T01:04:17.1566997Z Compiling torch_xla/csrc/ir.cpp; 18s local ... 2024-12-18T01:04:17.4129649Z 2024-12-18T01:04:17.4130572Z  2024-12-18T01:04:17.4131001Z  2024-12-18T01:04:17.4131338Z  2024-12-18T01:04:17.4131676Z  2024-12-18T01:04:17.4132024Z  2024-12-18T01:04:17.4132364Z  2024-12-18T01:04:17.4132708Z  2024-12-18T01:04:17.4133035Z  2024-12-18T01:04:17.4133867Z [19,835 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:17.4134815Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T01:04:17.4135659Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:17.4136640Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2024-12-18T01:04:17.4137409Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2024-12-18T01:04:17.4138147Z Compiling xla/service/service.cc; 20s local 2024-12-18T01:04:17.4138813Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2024-12-18T01:04:17.4139504Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 19s local 2024-12-18T01:04:17.4140218Z Compiling torch_xla/csrc/ir.cpp; 18s local ... 2024-12-18T01:04:17.6555115Z 2024-12-18T01:04:17.6556000Z  2024-12-18T01:04:17.6556472Z  2024-12-18T01:04:17.6556876Z  2024-12-18T01:04:17.6557264Z  2024-12-18T01:04:17.6557663Z  2024-12-18T01:04:17.6558054Z  2024-12-18T01:04:17.6558446Z  2024-12-18T01:04:17.6559143Z  2024-12-18T01:04:17.6560259Z [19,837 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:17.6561314Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T01:04:17.6562267Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:17.6563209Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2024-12-18T01:04:17.6564320Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:17.6565132Z Compiling xla/service/service.cc; 20s local 2024-12-18T01:04:17.6565815Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2024-12-18T01:04:17.6566632Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 19s local 2024-12-18T01:04:17.6567421Z Compiling torch_xla/csrc/ir.cpp; 18s local ... 2024-12-18T01:04:17.9562322Z 2024-12-18T01:04:17.9563168Z  2024-12-18T01:04:17.9563649Z  2024-12-18T01:04:17.9564043Z  2024-12-18T01:04:17.9564474Z  2024-12-18T01:04:17.9564859Z  2024-12-18T01:04:17.9565238Z  2024-12-18T01:04:17.9565612Z  2024-12-18T01:04:17.9566214Z  2024-12-18T01:04:17.9567149Z [19,838 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:17.9568126Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2024-12-18T01:04:17.9568998Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T01:04:17.9570139Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:17.9570977Z Compiling xla/service/service.cc; 20s local 2024-12-18T01:04:17.9571700Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2024-12-18T01:04:17.9572547Z Compiling xla/python/pjrt_ifrt/pjrt_topology.cc; 19s local 2024-12-18T01:04:17.9573344Z Compiling torch_xla/csrc/ir.cpp; 18s local 2024-12-18T01:04:17.9574048Z Compiling xla/client/local_client.cc; 17s local ... 2024-12-18T01:04:18.2968904Z 2024-12-18T01:04:18.2969971Z  2024-12-18T01:04:18.2970424Z  2024-12-18T01:04:18.2970824Z  2024-12-18T01:04:18.2971253Z  2024-12-18T01:04:18.2971633Z  2024-12-18T01:04:18.2972026Z  2024-12-18T01:04:18.2972412Z  2024-12-18T01:04:18.2972791Z  2024-12-18T01:04:18.2973692Z [19,841 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:18.2974745Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T01:04:18.2975705Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T01:04:18.2976826Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:18.2977677Z Compiling xla/service/service.cc; 21s local 2024-12-18T01:04:18.2978396Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2024-12-18T01:04:18.2979037Z Compiling torch_xla/csrc/ir.cpp; 19s local 2024-12-18T01:04:18.2979707Z Compiling xla/client/local_client.cc; 17s local 2024-12-18T01:04:18.2980435Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 17s local ... 2024-12-18T01:04:18.5570198Z 2024-12-18T01:04:18.5571073Z  2024-12-18T01:04:18.5571551Z  2024-12-18T01:04:18.5571920Z  2024-12-18T01:04:18.5572326Z  2024-12-18T01:04:18.5572722Z  2024-12-18T01:04:18.5573082Z  2024-12-18T01:04:18.5573435Z  2024-12-18T01:04:18.5573745Z  2024-12-18T01:04:18.5574777Z [19,841 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:18.5575783Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T01:04:18.5576781Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T01:04:18.5577746Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2024-12-18T01:04:18.5578553Z Compiling xla/service/service.cc; 21s local 2024-12-18T01:04:18.5579247Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2024-12-18T01:04:18.5580336Z Compiling torch_xla/csrc/ir.cpp; 19s local 2024-12-18T01:04:18.5580984Z Compiling xla/client/local_client.cc; 17s local 2024-12-18T01:04:18.5581716Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 17s local ... 2024-12-18T01:04:18.7573041Z 2024-12-18T01:04:18.7573985Z  2024-12-18T01:04:18.7574443Z  2024-12-18T01:04:18.7574836Z  2024-12-18T01:04:18.7575587Z  2024-12-18T01:04:18.7575969Z  2024-12-18T01:04:18.7576516Z  2024-12-18T01:04:18.7576874Z  2024-12-18T01:04:18.7577329Z  2024-12-18T01:04:18.7578306Z [19,842 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:18.7579293Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2024-12-18T01:04:18.7580218Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T01:04:18.7581347Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T01:04:18.7582163Z Compiling xla/service/service.cc; 21s local 2024-12-18T01:04:18.7583111Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2024-12-18T01:04:18.7583814Z Compiling torch_xla/csrc/ir.cpp; 19s local 2024-12-18T01:04:18.7584501Z Compiling xla/client/local_client.cc; 17s local 2024-12-18T01:04:18.7585262Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 17s local ... 2024-12-18T01:04:19.4983802Z 2024-12-18T01:04:19.4984653Z  2024-12-18T01:04:19.4985061Z  2024-12-18T01:04:19.4985411Z  2024-12-18T01:04:19.4985753Z  2024-12-18T01:04:19.4986384Z  2024-12-18T01:04:19.4986744Z  2024-12-18T01:04:19.4987076Z  2024-12-18T01:04:19.4987410Z  2024-12-18T01:04:19.4988214Z [19,843 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:19.4989138Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T01:04:19.4990083Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T01:04:19.4990916Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2024-12-18T01:04:19.4991608Z Compiling xla/service/service.cc; 22s local 2024-12-18T01:04:19.4992226Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2024-12-18T01:04:19.4992826Z Compiling torch_xla/csrc/ir.cpp; 20s local 2024-12-18T01:04:19.4993434Z Compiling xla/client/local_client.cc; 18s local 2024-12-18T01:04:19.4994254Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 18s local ... 2024-12-18T01:04:19.7581488Z 2024-12-18T01:04:19.7582414Z  2024-12-18T01:04:19.7582817Z  2024-12-18T01:04:19.7583157Z  2024-12-18T01:04:19.7583465Z  2024-12-18T01:04:19.7583793Z  2024-12-18T01:04:19.7584113Z  2024-12-18T01:04:19.7584434Z  2024-12-18T01:04:19.7584745Z  2024-12-18T01:04:19.7585523Z [19,843 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:19.7586411Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T01:04:19.7587189Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T01:04:19.7587977Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T01:04:19.7588645Z Compiling xla/service/service.cc; 22s local 2024-12-18T01:04:19.7589206Z Compiling torch_xla/csrc/unwrap_data.cpp; 22s local 2024-12-18T01:04:19.7589800Z Compiling torch_xla/csrc/ir.cpp; 20s local 2024-12-18T01:04:19.7590362Z Compiling xla/client/local_client.cc; 18s local 2024-12-18T01:04:19.7590972Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 18s local ... 2024-12-18T01:04:20.0646332Z 2024-12-18T01:04:20.0647271Z  2024-12-18T01:04:20.0647723Z  2024-12-18T01:04:20.0648092Z  2024-12-18T01:04:20.0648529Z  2024-12-18T01:04:20.0648920Z  2024-12-18T01:04:20.0649431Z  2024-12-18T01:04:20.0649849Z  2024-12-18T01:04:20.0650209Z  2024-12-18T01:04:20.0651521Z [19,844 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:20.0652573Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2024-12-18T01:04:20.0653655Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T01:04:20.0657647Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T01:04:20.0658677Z Compiling xla/service/service.cc; 23s local 2024-12-18T01:04:20.0659275Z Compiling torch_xla/csrc/unwrap_data.cpp; 22s local 2024-12-18T01:04:20.0659971Z Compiling torch_xla/csrc/ir.cpp; 20s local 2024-12-18T01:04:20.0660608Z Compiling xla/client/local_client.cc; 19s local 2024-12-18T01:04:20.0661341Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 18s local ... 2024-12-18T01:04:20.3297176Z 2024-12-18T01:04:20.3298053Z  2024-12-18T01:04:20.3298511Z  2024-12-18T01:04:20.3298918Z  2024-12-18T01:04:20.3299288Z  2024-12-18T01:04:20.3299705Z  2024-12-18T01:04:20.3300074Z  2024-12-18T01:04:20.3300456Z  2024-12-18T01:04:20.3300824Z  2024-12-18T01:04:20.3302034Z [19,846 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:20.3303098Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T01:04:20.3304016Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T01:04:20.3305024Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T01:04:20.3306024Z Compiling xla/service/service.cc; 23s local 2024-12-18T01:04:20.3306727Z Compiling torch_xla/csrc/unwrap_data.cpp; 22s local 2024-12-18T01:04:20.3307430Z Compiling torch_xla/csrc/ir.cpp; 21s local 2024-12-18T01:04:20.3308099Z Compiling xla/client/local_client.cc; 19s local 2024-12-18T01:04:20.3308836Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 19s local ... 2024-12-18T01:04:20.5590824Z 2024-12-18T01:04:20.5591747Z  2024-12-18T01:04:20.5592195Z  2024-12-18T01:04:20.5592570Z  2024-12-18T01:04:20.5592959Z  2024-12-18T01:04:20.5593360Z  2024-12-18T01:04:20.5593880Z  2024-12-18T01:04:20.5594257Z  2024-12-18T01:04:20.5594649Z  2024-12-18T01:04:20.5595606Z [19,847 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:20.5596718Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T01:04:20.5597698Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T01:04:20.5598695Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2024-12-18T01:04:20.5599509Z Compiling xla/service/service.cc; 23s local 2024-12-18T01:04:20.5600237Z Compiling torch_xla/csrc/unwrap_data.cpp; 22s local 2024-12-18T01:04:20.5600950Z Compiling torch_xla/csrc/ir.cpp; 21s local 2024-12-18T01:04:20.5601635Z Compiling xla/client/local_client.cc; 19s local 2024-12-18T01:04:20.5602364Z Compiling torch_xla/csrc/ir.cpp; 19s local ... 2024-12-18T01:04:21.0802460Z 2024-12-18T01:04:21.0803405Z  2024-12-18T01:04:21.0803889Z  2024-12-18T01:04:21.0804292Z  2024-12-18T01:04:21.0804641Z  2024-12-18T01:04:21.0805032Z  2024-12-18T01:04:21.0805433Z  2024-12-18T01:04:21.0805831Z  2024-12-18T01:04:21.0806183Z  2024-12-18T01:04:21.0807089Z [19,848 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:21.0808147Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2024-12-18T01:04:21.0809074Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2024-12-18T01:04:21.0810037Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T01:04:21.0810862Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:04:21.0811500Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2024-12-18T01:04:21.0812671Z Compiling torch_xla/csrc/ir.cpp; 22s local 2024-12-18T01:04:21.0813300Z Compiling xla/client/local_client.cc; 20s local 2024-12-18T01:04:21.0813957Z Compiling torch_xla/csrc/ir.cpp; 19s local ... 2024-12-18T01:04:21.3410242Z 2024-12-18T01:04:21.3411113Z  2024-12-18T01:04:21.3411537Z  2024-12-18T01:04:21.3411869Z  2024-12-18T01:04:21.3412241Z  2024-12-18T01:04:21.3412902Z  2024-12-18T01:04:21.3413230Z  2024-12-18T01:04:21.3413660Z  2024-12-18T01:04:21.3414040Z  2024-12-18T01:04:21.3414934Z [19,849 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:21.3415983Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T01:04:21.3417069Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T01:04:21.3417838Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:04:21.3418516Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2024-12-18T01:04:21.3419229Z Compiling torch_xla/csrc/ir.cpp; 22s local 2024-12-18T01:04:21.3420066Z Compiling xla/client/local_client.cc; 20s local 2024-12-18T01:04:21.3420684Z Compiling torch_xla/csrc/ir.cpp; 19s local 2024-12-18T01:04:21.3421377Z Compiling torch_xla/csrc/lowering_context.cpp; 19s local ... 2024-12-18T01:04:21.5600898Z 2024-12-18T01:04:21.5601815Z  2024-12-18T01:04:21.5602324Z  2024-12-18T01:04:21.5602725Z  2024-12-18T01:04:21.5603135Z  2024-12-18T01:04:21.5603490Z  2024-12-18T01:04:21.5604162Z  2024-12-18T01:04:21.5604555Z  2024-12-18T01:04:21.5604927Z  2024-12-18T01:04:21.5605823Z [19,850 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:21.5606880Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T01:04:21.5607837Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2024-12-18T01:04:21.5608673Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:04:21.5609409Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2024-12-18T01:04:21.5610130Z Compiling torch_xla/csrc/ir.cpp; 22s local 2024-12-18T01:04:21.5610805Z Compiling xla/client/local_client.cc; 20s local 2024-12-18T01:04:21.5611476Z Compiling torch_xla/csrc/ir.cpp; 20s local 2024-12-18T01:04:21.5612278Z Compiling torch_xla/csrc/lowering_context.cpp; 19s local ... 2024-12-18T01:04:21.7604156Z 2024-12-18T01:04:21.7604980Z  2024-12-18T01:04:21.7605394Z  2024-12-18T01:04:21.7605775Z  2024-12-18T01:04:21.7606122Z  2024-12-18T01:04:21.7606451Z  2024-12-18T01:04:21.7606799Z  2024-12-18T01:04:21.7607137Z  2024-12-18T01:04:21.7607476Z  2024-12-18T01:04:21.7608277Z [19,851 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:21.7609212Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T01:04:21.7610058Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2024-12-18T01:04:21.7610800Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:04:21.7611408Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2024-12-18T01:04:21.7612027Z Compiling torch_xla/csrc/ir.cpp; 22s local 2024-12-18T01:04:21.7612617Z Compiling xla/client/local_client.cc; 20s local 2024-12-18T01:04:21.7613250Z Compiling torch_xla/csrc/ir.cpp; 20s local 2024-12-18T01:04:21.7613954Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local ... 2024-12-18T01:04:21.9724040Z 2024-12-18T01:04:21.9724850Z  2024-12-18T01:04:21.9725259Z  2024-12-18T01:04:21.9725614Z  2024-12-18T01:04:21.9725961Z  2024-12-18T01:04:21.9726317Z  2024-12-18T01:04:21.9726687Z  2024-12-18T01:04:21.9727033Z  2024-12-18T01:04:21.9727364Z  2024-12-18T01:04:21.9728209Z [19,852 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:21.9729498Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2024-12-18T01:04:21.9730339Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2024-12-18T01:04:21.9731076Z Compiling xla/service/service.cc; 24s local 2024-12-18T01:04:21.9731733Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2024-12-18T01:04:21.9732488Z Compiling torch_xla/csrc/ir.cpp; 22s local 2024-12-18T01:04:21.9733048Z Compiling torch_xla/csrc/ir.cpp; 20s local 2024-12-18T01:04:21.9733703Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local 2024-12-18T01:04:21.9734417Z Compiling xla/python/ifrt/compiler.cc; 18s local ... 2024-12-18T01:04:22.3611036Z 2024-12-18T01:04:22.3611868Z  2024-12-18T01:04:22.3612248Z  2024-12-18T01:04:22.3612562Z  2024-12-18T01:04:22.3612855Z  2024-12-18T01:04:22.3613162Z  2024-12-18T01:04:22.3613468Z  2024-12-18T01:04:22.3613770Z  2024-12-18T01:04:22.3614088Z  2024-12-18T01:04:22.3615124Z [19,855 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:22.3615947Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T01:04:22.3616716Z Compiling xla/service/service.cc; 25s local 2024-12-18T01:04:22.3617260Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2024-12-18T01:04:22.3617787Z Compiling torch_xla/csrc/ir.cpp; 23s local 2024-12-18T01:04:22.3618278Z Compiling torch_xla/csrc/ir.cpp; 20s local 2024-12-18T01:04:22.3618977Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local 2024-12-18T01:04:22.3619584Z Compiling xla/python/ifrt/compiler.cc; 19s local 2024-12-18T01:04:22.3620144Z Compiling xla/python/ifrt/client.cc; 18s local ... 2024-12-18T01:04:22.9762747Z 2024-12-18T01:04:22.9763634Z  2024-12-18T01:04:22.9764150Z  2024-12-18T01:04:22.9764532Z  2024-12-18T01:04:22.9764891Z  2024-12-18T01:04:22.9765297Z  2024-12-18T01:04:22.9765652Z  2024-12-18T01:04:22.9766028Z  2024-12-18T01:04:22.9766444Z  2024-12-18T01:04:22.9767334Z [19,856 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:22.9768280Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2024-12-18T01:04:22.9769065Z Compiling xla/service/service.cc; 25s local 2024-12-18T01:04:22.9769784Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2024-12-18T01:04:22.9770461Z Compiling torch_xla/csrc/ir.cpp; 23s local 2024-12-18T01:04:22.9771114Z Compiling torch_xla/csrc/ir.cpp; 21s local 2024-12-18T01:04:22.9771839Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2024-12-18T01:04:22.9772514Z Compiling xla/python/ifrt/client.cc; 19s local 2024-12-18T01:04:22.9773186Z Compiling xla/python/ifrt/compiler.cc; 18s local ... 2024-12-18T01:04:23.3622745Z 2024-12-18T01:04:23.3623609Z  2024-12-18T01:04:23.3624035Z  2024-12-18T01:04:23.3624376Z  2024-12-18T01:04:23.3624775Z  2024-12-18T01:04:23.3625150Z  2024-12-18T01:04:23.3625520Z  2024-12-18T01:04:23.3625881Z  2024-12-18T01:04:23.3626263Z  2024-12-18T01:04:23.3627172Z [19,856 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:23.3628205Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2024-12-18T01:04:23.3629019Z Compiling xla/service/service.cc; 26s local 2024-12-18T01:04:23.3629693Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2024-12-18T01:04:23.3630420Z Compiling torch_xla/csrc/ir.cpp; 24s local 2024-12-18T01:04:23.3631067Z Compiling torch_xla/csrc/ir.cpp; 21s local 2024-12-18T01:04:23.3631718Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2024-12-18T01:04:23.3632446Z Compiling xla/python/ifrt/client.cc; 19s local 2024-12-18T01:04:23.3633172Z Compiling xla/python/ifrt/compiler.cc; 18s local ... 2024-12-18T01:04:24.3634207Z 2024-12-18T01:04:24.3635104Z  2024-12-18T01:04:24.3635581Z  2024-12-18T01:04:24.3636023Z  2024-12-18T01:04:24.3636446Z  2024-12-18T01:04:24.3636847Z  2024-12-18T01:04:24.3637231Z  2024-12-18T01:04:24.3637631Z  2024-12-18T01:04:24.3638023Z  2024-12-18T01:04:24.3639125Z [19,856 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:24.3640782Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T01:04:24.3641620Z Compiling xla/service/service.cc; 27s local 2024-12-18T01:04:24.3642363Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local 2024-12-18T01:04:24.3643115Z Compiling torch_xla/csrc/ir.cpp; 25s local 2024-12-18T01:04:24.3643790Z Compiling torch_xla/csrc/ir.cpp; 22s local 2024-12-18T01:04:24.3644836Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2024-12-18T01:04:24.3645638Z Compiling xla/python/ifrt/client.cc; 20s local 2024-12-18T01:04:24.3646427Z Compiling xla/python/ifrt/compiler.cc; 19s local ... 2024-12-18T01:04:24.9804418Z 2024-12-18T01:04:24.9805337Z  2024-12-18T01:04:24.9805804Z  2024-12-18T01:04:24.9806176Z  2024-12-18T01:04:24.9806598Z  2024-12-18T01:04:24.9806984Z  2024-12-18T01:04:24.9807367Z  2024-12-18T01:04:24.9807725Z  2024-12-18T01:04:24.9808099Z  2024-12-18T01:04:24.9808958Z [19,857 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:24.9810173Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2024-12-18T01:04:24.9810962Z Compiling xla/service/service.cc; 27s local 2024-12-18T01:04:24.9811632Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2024-12-18T01:04:24.9812253Z Compiling torch_xla/csrc/ir.cpp; 25s local 2024-12-18T01:04:24.9812873Z Compiling torch_xla/csrc/ir.cpp; 23s local 2024-12-18T01:04:24.9813644Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2024-12-18T01:04:24.9814421Z Compiling xla/python/ifrt/client.cc; 21s local 2024-12-18T01:04:24.9815261Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local ... 2024-12-18T01:04:25.3645282Z 2024-12-18T01:04:25.3646196Z  2024-12-18T01:04:25.3646664Z  2024-12-18T01:04:25.3647042Z  2024-12-18T01:04:25.3647441Z  2024-12-18T01:04:25.3647802Z  2024-12-18T01:04:25.3648186Z  2024-12-18T01:04:25.3648573Z  2024-12-18T01:04:25.3648941Z  2024-12-18T01:04:25.3649850Z [19,857 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:25.3650913Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T01:04:25.3651641Z Compiling xla/service/service.cc; 28s local 2024-12-18T01:04:25.3652316Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2024-12-18T01:04:25.3652994Z Compiling torch_xla/csrc/ir.cpp; 26s local 2024-12-18T01:04:25.3653681Z Compiling torch_xla/csrc/ir.cpp; 23s local 2024-12-18T01:04:25.3654401Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2024-12-18T01:04:25.3655151Z Compiling xla/python/ifrt/client.cc; 21s local 2024-12-18T01:04:25.3655914Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local ... 2024-12-18T01:04:25.7649182Z 2024-12-18T01:04:25.7650016Z  2024-12-18T01:04:25.7650458Z  2024-12-18T01:04:25.7650813Z  2024-12-18T01:04:25.7651150Z  2024-12-18T01:04:25.7651504Z  2024-12-18T01:04:25.7651856Z  2024-12-18T01:04:25.7652198Z  2024-12-18T01:04:25.7652552Z  2024-12-18T01:04:25.7653388Z [19,858 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:25.7654321Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T01:04:25.7655003Z Compiling xla/service/service.cc; 28s local 2024-12-18T01:04:25.7655946Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:25.7656739Z Compiling torch_xla/csrc/ir.cpp; 26s local 2024-12-18T01:04:25.7657296Z Compiling torch_xla/csrc/ir.cpp; 24s local 2024-12-18T01:04:25.7657928Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T01:04:25.7658636Z Compiling xla/python/ifrt/client.cc; 22s local 2024-12-18T01:04:25.7659306Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local ... 2024-12-18T01:04:25.9648473Z 2024-12-18T01:04:25.9649376Z  2024-12-18T01:04:25.9649816Z  2024-12-18T01:04:25.9650195Z  2024-12-18T01:04:25.9650569Z  2024-12-18T01:04:25.9650921Z  2024-12-18T01:04:25.9651276Z  2024-12-18T01:04:25.9651640Z  2024-12-18T01:04:25.9651998Z  2024-12-18T01:04:25.9652929Z [19,859 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:25.9653859Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2024-12-18T01:04:25.9654602Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:25.9655467Z Compiling torch_xla/csrc/ir.cpp; 26s local 2024-12-18T01:04:25.9656046Z Compiling torch_xla/csrc/ir.cpp; 24s local 2024-12-18T01:04:25.9656874Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T01:04:25.9657580Z Compiling xla/python/ifrt/client.cc; 22s local 2024-12-18T01:04:25.9658277Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2024-12-18T01:04:25.9659183Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 18s local ... 2024-12-18T01:04:26.3265169Z 2024-12-18T01:04:26.3266521Z  2024-12-18T01:04:26.3266888Z  2024-12-18T01:04:26.3267195Z  2024-12-18T01:04:26.3267502Z  2024-12-18T01:04:26.3267919Z  2024-12-18T01:04:26.3268208Z  2024-12-18T01:04:26.3268508Z  2024-12-18T01:04:26.3268816Z  2024-12-18T01:04:26.3269534Z [19,861 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:26.3270369Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2024-12-18T01:04:26.3271183Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:26.3271725Z Compiling torch_xla/csrc/ir.cpp; 27s local 2024-12-18T01:04:26.3272226Z Compiling torch_xla/csrc/ir.cpp; 24s local 2024-12-18T01:04:26.3272819Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T01:04:26.3273478Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2024-12-18T01:04:26.3274131Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 18s local 2024-12-18T01:04:26.3274736Z Compiling xla/python/ifrt/topology.cc; 18s local ... 2024-12-18T01:04:26.5653981Z 2024-12-18T01:04:26.5654961Z  2024-12-18T01:04:26.5655436Z  2024-12-18T01:04:26.5655836Z  2024-12-18T01:04:26.5656228Z  2024-12-18T01:04:26.5656762Z  2024-12-18T01:04:26.5657151Z  2024-12-18T01:04:26.5657552Z  2024-12-18T01:04:26.5657979Z  2024-12-18T01:04:26.5658940Z [19,861 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:26.5660120Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2024-12-18T01:04:26.5660956Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2024-12-18T01:04:26.5661676Z Compiling torch_xla/csrc/ir.cpp; 27s local 2024-12-18T01:04:26.5662320Z Compiling torch_xla/csrc/ir.cpp; 25s local 2024-12-18T01:04:26.5663064Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T01:04:26.5664053Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2024-12-18T01:04:26.5664869Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 19s local 2024-12-18T01:04:26.5665658Z Compiling xla/python/ifrt/topology.cc; 18s local ... 2024-12-18T01:04:26.8407211Z 2024-12-18T01:04:26.8408186Z  2024-12-18T01:04:26.8408834Z  2024-12-18T01:04:26.8409219Z  2024-12-18T01:04:26.8409875Z  2024-12-18T01:04:26.8410234Z  2024-12-18T01:04:26.8410569Z  2024-12-18T01:04:26.8410953Z  2024-12-18T01:04:26.8411371Z  2024-12-18T01:04:26.8412281Z [19,863 / 20,604] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:04:26.8413320Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2024-12-18T01:04:26.8414415Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2024-12-18T01:04:26.8415169Z Compiling torch_xla/csrc/ir.cpp; 27s local 2024-12-18T01:04:26.8415768Z Compiling torch_xla/csrc/ir.cpp; 25s local 2024-12-18T01:04:26.8416624Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T01:04:26.8417411Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2024-12-18T01:04:26.8418230Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 19s local 2024-12-18T01:04:26.8418912Z Compiling xla/python/ifrt/topology.cc; 19s local ... 2024-12-18T01:04:27.1658683Z 2024-12-18T01:04:27.1660107Z  2024-12-18T01:04:27.1660547Z  2024-12-18T01:04:27.1660910Z  2024-12-18T01:04:27.1661258Z  2024-12-18T01:04:27.1661879Z  2024-12-18T01:04:27.1662249Z  2024-12-18T01:04:27.1662617Z  2024-12-18T01:04:27.1662969Z  2024-12-18T01:04:27.1664000Z [19,865 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:27.1664982Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2024-12-18T01:04:27.1665924Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2024-12-18T01:04:27.1666642Z Compiling torch_xla/csrc/ir.cpp; 28s local 2024-12-18T01:04:27.1667318Z Compiling torch_xla/csrc/ir.cpp; 25s local 2024-12-18T01:04:27.1668152Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T01:04:27.1669016Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2024-12-18T01:04:27.1669877Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 19s local 2024-12-18T01:04:27.1670728Z Compiling xla/python/ifrt/executable.cc; 14s local ... 2024-12-18T01:04:28.3678948Z 2024-12-18T01:04:28.3679889Z  2024-12-18T01:04:28.3680367Z  2024-12-18T01:04:28.3680755Z  2024-12-18T01:04:28.3681142Z  2024-12-18T01:04:28.3681512Z  2024-12-18T01:04:28.3681889Z  2024-12-18T01:04:28.3682271Z  2024-12-18T01:04:28.3682656Z  2024-12-18T01:04:28.3683590Z [19,866 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:04:28.3684689Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T01:04:28.3685465Z Compiling torch_xla/csrc/ir.cpp; 29s local 2024-12-18T01:04:28.3686128Z Compiling torch_xla/csrc/ir.cpp; 26s local 2024-12-18T01:04:28.3686827Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2024-12-18T01:04:28.3687685Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2024-12-18T01:04:28.3688551Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 20s local 2024-12-18T01:04:28.3689388Z Compiling xla/python/ifrt/executable.cc; 15s local 2024-12-18T01:04:28.3690212Z Compiling xla/python/ifrt/remap_plan.cc; 15s local ... 2024-12-18T01:04:28.7682761Z 2024-12-18T01:04:28.7683682Z  2024-12-18T01:04:28.7684173Z  2024-12-18T01:04:28.7684582Z  2024-12-18T01:04:28.7684980Z  2024-12-18T01:04:28.7685420Z  2024-12-18T01:04:28.7685794Z  2024-12-18T01:04:28.7686192Z  2024-12-18T01:04:28.7686572Z  2024-12-18T01:04:28.7687483Z [19,866 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:28.7688541Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T01:04:28.7689283Z Compiling torch_xla/csrc/ir.cpp; 29s local 2024-12-18T01:04:28.7689888Z Compiling torch_xla/csrc/ir.cpp; 27s local 2024-12-18T01:04:28.7690596Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T01:04:28.7691734Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T01:04:28.7692594Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 21s local 2024-12-18T01:04:28.7693359Z Compiling xla/python/ifrt/executable.cc; 16s local 2024-12-18T01:04:28.7694114Z Compiling xla/python/ifrt/remap_plan.cc; 15s local ... 2024-12-18T01:04:28.9684869Z 2024-12-18T01:04:28.9685692Z  2024-12-18T01:04:28.9686390Z  2024-12-18T01:04:28.9686745Z  2024-12-18T01:04:28.9687077Z  2024-12-18T01:04:28.9687401Z  2024-12-18T01:04:28.9687756Z  2024-12-18T01:04:28.9688120Z  2024-12-18T01:04:28.9688452Z  2024-12-18T01:04:28.9689256Z [19,867 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:28.9690237Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2024-12-18T01:04:28.9690965Z Compiling torch_xla/csrc/ir.cpp; 29s local 2024-12-18T01:04:28.9691535Z Compiling torch_xla/csrc/ir.cpp; 27s local 2024-12-18T01:04:28.9692195Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T01:04:28.9693114Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T01:04:28.9693841Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 21s local 2024-12-18T01:04:28.9694538Z Compiling xla/python/ifrt/executable.cc; 16s local 2024-12-18T01:04:28.9695240Z Compiling xla/python/ifrt/remap_plan.cc; 15s local ... 2024-12-18T01:04:29.5665694Z 2024-12-18T01:04:29.5666610Z  2024-12-18T01:04:29.5667011Z  2024-12-18T01:04:29.5667626Z  2024-12-18T01:04:29.5667972Z  2024-12-18T01:04:29.5668293Z  2024-12-18T01:04:29.5668630Z  2024-12-18T01:04:29.5668968Z  2024-12-18T01:04:29.5669304Z  2024-12-18T01:04:29.5670108Z [19,868 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:29.5671026Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T01:04:29.5671745Z Compiling torch_xla/csrc/ir.cpp; 30s local 2024-12-18T01:04:29.5672348Z Compiling torch_xla/csrc/ir.cpp; 28s local 2024-12-18T01:04:29.5673023Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T01:04:29.5673762Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2024-12-18T01:04:29.5674484Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 22s local 2024-12-18T01:04:29.5675313Z Compiling xla/python/ifrt/executable.cc; 16s local 2024-12-18T01:04:29.5676151Z Compiling stablehlo/transforms/VhloToVersion.cpp; 15s local ... 2024-12-18T01:04:29.7691462Z 2024-12-18T01:04:29.7692360Z  2024-12-18T01:04:29.7692779Z  2024-12-18T01:04:29.7693145Z  2024-12-18T01:04:29.7693531Z  2024-12-18T01:04:29.7693916Z  2024-12-18T01:04:29.7694289Z  2024-12-18T01:04:29.7694651Z  2024-12-18T01:04:29.7695016Z  2024-12-18T01:04:29.7695910Z [19,869 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:29.7697185Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T01:04:29.7697986Z Compiling torch_xla/csrc/ir.cpp; 30s local 2024-12-18T01:04:29.7698631Z Compiling torch_xla/csrc/ir.cpp; 28s local 2024-12-18T01:04:29.7699371Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T01:04:29.7700220Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T01:04:29.7701072Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 22s local 2024-12-18T01:04:29.7701850Z Compiling xla/python/ifrt/executable.cc; 17s local 2024-12-18T01:04:29.7702679Z Compiling stablehlo/transforms/VhloToVersion.cpp; 15s local ... 2024-12-18T01:04:29.9694896Z 2024-12-18T01:04:29.9695758Z  2024-12-18T01:04:29.9696256Z  2024-12-18T01:04:29.9696848Z  2024-12-18T01:04:29.9697238Z  2024-12-18T01:04:29.9697621Z  2024-12-18T01:04:29.9698013Z  2024-12-18T01:04:29.9698730Z  2024-12-18T01:04:29.9699074Z  2024-12-18T01:04:29.9699983Z [19,870 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:29.9701016Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2024-12-18T01:04:29.9701812Z Compiling torch_xla/csrc/ir.cpp; 30s local 2024-12-18T01:04:29.9702454Z Compiling torch_xla/csrc/ir.cpp; 28s local 2024-12-18T01:04:29.9703396Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T01:04:29.9704244Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T01:04:29.9705079Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 22s local 2024-12-18T01:04:29.9705844Z Compiling xla/python/ifrt/executable.cc; 17s local 2024-12-18T01:04:29.9706739Z Compiling stablehlo/transforms/VhloToVersion.cpp; 16s local ... 2024-12-18T01:04:30.3699505Z 2024-12-18T01:04:30.3710397Z  2024-12-18T01:04:30.3711082Z  2024-12-18T01:04:30.3711489Z  2024-12-18T01:04:30.3711866Z  2024-12-18T01:04:30.3712255Z  2024-12-18T01:04:30.3712636Z  2024-12-18T01:04:30.3713279Z  2024-12-18T01:04:30.3713660Z  2024-12-18T01:04:30.3714553Z [19,871 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:30.3715580Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:04:30.3716359Z Compiling torch_xla/csrc/ir.cpp; 31s local 2024-12-18T01:04:30.3716948Z Compiling torch_xla/csrc/ir.cpp; 28s local 2024-12-18T01:04:30.3717872Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T01:04:30.3718720Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T01:04:30.3719548Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 22s local 2024-12-18T01:04:30.3720379Z Compiling xla/python/ifrt/executable.cc; 17s local 2024-12-18T01:04:30.3721182Z Compiling stablehlo/transforms/VhloToVersion.cpp; 16s local ... 2024-12-18T01:04:30.5721002Z 2024-12-18T01:04:30.5721877Z  2024-12-18T01:04:30.5722318Z  2024-12-18T01:04:30.5722762Z  2024-12-18T01:04:30.5723165Z  2024-12-18T01:04:30.5723567Z  2024-12-18T01:04:30.5723950Z  2024-12-18T01:04:30.5724354Z  2024-12-18T01:04:30.5724737Z  2024-12-18T01:04:30.5725674Z [19,874 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:30.5726783Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:04:30.5727619Z Compiling torch_xla/csrc/ir.cpp; 31s local 2024-12-18T01:04:30.5728294Z Compiling torch_xla/csrc/ir.cpp; 29s local 2024-12-18T01:04:30.5729082Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T01:04:30.5729967Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2024-12-18T01:04:30.5730821Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 23s local 2024-12-18T01:04:30.5731626Z Compiling xla/python/ifrt/executable.cc; 17s local 2024-12-18T01:04:30.5732635Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 16s local ... 2024-12-18T01:04:30.9704338Z 2024-12-18T01:04:30.9705224Z  2024-12-18T01:04:30.9705677Z  2024-12-18T01:04:30.9706075Z  2024-12-18T01:04:30.9706486Z  2024-12-18T01:04:30.9706906Z  2024-12-18T01:04:30.9707289Z  2024-12-18T01:04:30.9707653Z  2024-12-18T01:04:30.9708025Z  2024-12-18T01:04:30.9708940Z [19,874 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:30.9710021Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:04:30.9710806Z Compiling torch_xla/csrc/ir.cpp; 31s local 2024-12-18T01:04:30.9711479Z Compiling torch_xla/csrc/ir.cpp; 29s local 2024-12-18T01:04:30.9712161Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T01:04:30.9713182Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2024-12-18T01:04:30.9714293Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 23s local 2024-12-18T01:04:30.9715096Z Compiling xla/python/ifrt/executable.cc; 18s local 2024-12-18T01:04:30.9716078Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 16s local ... 2024-12-18T01:04:31.1732627Z 2024-12-18T01:04:31.1733450Z  2024-12-18T01:04:31.1733899Z  2024-12-18T01:04:31.1734544Z  2024-12-18T01:04:31.1734897Z  2024-12-18T01:04:31.1735252Z  2024-12-18T01:04:31.1735594Z  2024-12-18T01:04:31.1735985Z  2024-12-18T01:04:31.1736348Z  2024-12-18T01:04:31.1737295Z [19,875 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:31.1738269Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2024-12-18T01:04:31.1738989Z Compiling torch_xla/csrc/ir.cpp; 32s local 2024-12-18T01:04:31.1739583Z Compiling torch_xla/csrc/ir.cpp; 29s local 2024-12-18T01:04:31.1740295Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T01:04:31.1741261Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2024-12-18T01:04:31.1742015Z Compiling xla/python/pjrt_ifrt/pjrt_remap.cc; 23s local 2024-12-18T01:04:31.1742761Z Compiling xla/python/ifrt/executable.cc; 18s local 2024-12-18T01:04:31.1743676Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 17s local ... 2024-12-18T01:04:31.5709170Z 2024-12-18T01:04:31.5709996Z  2024-12-18T01:04:31.5710395Z  2024-12-18T01:04:31.5710966Z  2024-12-18T01:04:31.5711311Z  2024-12-18T01:04:31.5711675Z  2024-12-18T01:04:31.5712026Z  2024-12-18T01:04:31.5712392Z  2024-12-18T01:04:31.5712723Z  2024-12-18T01:04:31.5713719Z [19,875 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:04:31.5714626Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2024-12-18T01:04:31.5715312Z Compiling torch_xla/csrc/ir.cpp; 32s local 2024-12-18T01:04:31.5715897Z Compiling torch_xla/csrc/ir.cpp; 30s local 2024-12-18T01:04:31.5716527Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T01:04:31.5717255Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2024-12-18T01:04:31.5717948Z Compiling xla/python/ifrt/executable.cc; 18s local 2024-12-18T01:04:31.5718756Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 17s local 2024-12-18T01:04:31.5719652Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 15s local ... 2024-12-18T01:04:31.7712773Z 2024-12-18T01:04:31.7713662Z  2024-12-18T01:04:31.7714053Z  2024-12-18T01:04:31.7714390Z  2024-12-18T01:04:31.7714704Z  2024-12-18T01:04:31.7714994Z  2024-12-18T01:04:31.7715331Z  2024-12-18T01:04:31.7715637Z  2024-12-18T01:04:31.7715963Z  2024-12-18T01:04:31.7716707Z [19,878 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:31.7717588Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2024-12-18T01:04:31.7718206Z Compiling torch_xla/csrc/ir.cpp; 30s local 2024-12-18T01:04:31.7718781Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:31.7719451Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T01:04:31.7720112Z Compiling xla/python/ifrt/executable.cc; 19s local 2024-12-18T01:04:31.7720836Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 17s local 2024-12-18T01:04:31.7721614Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 16s local 2024-12-18T01:04:31.7722250Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2024-12-18T01:04:32.0290891Z 2024-12-18T01:04:32.0291758Z  2024-12-18T01:04:32.0292228Z  2024-12-18T01:04:32.0292615Z  2024-12-18T01:04:32.0292992Z  2024-12-18T01:04:32.0293380Z  2024-12-18T01:04:32.0293772Z  2024-12-18T01:04:32.0294440Z  2024-12-18T01:04:32.0294807Z  2024-12-18T01:04:32.0295714Z [19,880 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:32.0296837Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2024-12-18T01:04:32.0297557Z Compiling torch_xla/csrc/ir.cpp; 30s local 2024-12-18T01:04:32.0298152Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:32.0299058Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T01:04:32.0300153Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 17s local 2024-12-18T01:04:32.0301115Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 16s local 2024-12-18T01:04:32.0302082Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 16s local 2024-12-18T01:04:32.0303154Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 15s local ... 2024-12-18T01:04:32.2711928Z 2024-12-18T01:04:32.2712814Z  2024-12-18T01:04:32.2713296Z  2024-12-18T01:04:32.2713666Z  2024-12-18T01:04:32.2714044Z  2024-12-18T01:04:32.2714694Z  2024-12-18T01:04:32.2715119Z  2024-12-18T01:04:32.2715508Z  2024-12-18T01:04:32.2715878Z  2024-12-18T01:04:32.2716769Z [19,881 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:32.2717821Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T01:04:32.2718586Z Compiling torch_xla/csrc/ir.cpp; 30s local 2024-12-18T01:04:32.2719638Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:32.2720442Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T01:04:32.2721355Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 18s local 2024-12-18T01:04:32.2722280Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 16s local 2024-12-18T01:04:32.2723203Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 16s local 2024-12-18T01:04:32.2724256Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 15s local ... 2024-12-18T01:04:32.5721691Z 2024-12-18T01:04:32.5722587Z  2024-12-18T01:04:32.5723059Z  2024-12-18T01:04:32.5723427Z  2024-12-18T01:04:32.5723796Z  2024-12-18T01:04:32.5724182Z  2024-12-18T01:04:32.5724586Z  2024-12-18T01:04:32.5724976Z  2024-12-18T01:04:32.5725378Z  2024-12-18T01:04:32.5726247Z [19,882 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:32.5727219Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T01:04:32.5727966Z Compiling torch_xla/csrc/ir.cpp; 31s local 2024-12-18T01:04:32.5728727Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:32.5729539Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2024-12-18T01:04:32.5730554Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 18s local 2024-12-18T01:04:32.5731633Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 16s local 2024-12-18T01:04:32.5732563Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 16s local 2024-12-18T01:04:32.5733643Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 16s local ... 2024-12-18T01:04:32.8920640Z 2024-12-18T01:04:32.8921530Z  2024-12-18T01:04:32.8921976Z  2024-12-18T01:04:32.8922411Z  2024-12-18T01:04:32.8922781Z  2024-12-18T01:04:32.8923184Z  2024-12-18T01:04:32.8923595Z  2024-12-18T01:04:32.8923976Z  2024-12-18T01:04:32.8924334Z  2024-12-18T01:04:32.8925181Z [19,883 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:32.8926171Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T01:04:32.8927010Z Compiling torch_xla/csrc/ir.cpp; 31s local 2024-12-18T01:04:32.8927746Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T01:04:32.8928882Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T01:04:32.8929857Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 18s local 2024-12-18T01:04:32.8930882Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 17s local 2024-12-18T01:04:32.8931855Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 16s local 2024-12-18T01:04:32.8933151Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 16s local ... 2024-12-18T01:04:33.1726844Z 2024-12-18T01:04:33.1727748Z  2024-12-18T01:04:33.1728278Z  2024-12-18T01:04:33.1728653Z  2024-12-18T01:04:33.1729041Z  2024-12-18T01:04:33.1729373Z  2024-12-18T01:04:33.1729693Z  2024-12-18T01:04:33.1730064Z  2024-12-18T01:04:33.1730517Z  2024-12-18T01:04:33.1731448Z [19,883 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:33.1732479Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2024-12-18T01:04:33.1733277Z Compiling torch_xla/csrc/ir.cpp; 31s local 2024-12-18T01:04:33.1734293Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T01:04:33.1735015Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T01:04:33.1735920Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 19s local 2024-12-18T01:04:33.1737119Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 17s local 2024-12-18T01:04:33.1738188Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 17s local 2024-12-18T01:04:33.1739245Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 16s local ... 2024-12-18T01:04:33.4856050Z 2024-12-18T01:04:33.4857098Z  2024-12-18T01:04:33.4857562Z  2024-12-18T01:04:33.4857934Z  2024-12-18T01:04:33.4858249Z  2024-12-18T01:04:33.4858596Z  2024-12-18T01:04:33.4858904Z  2024-12-18T01:04:33.4859267Z  2024-12-18T01:04:33.4859705Z  2024-12-18T01:04:33.4860765Z [19,884 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:33.4861845Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T01:04:33.4862641Z Compiling torch_xla/csrc/ir.cpp; 32s local 2024-12-18T01:04:33.4863372Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T01:04:33.4864263Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2024-12-18T01:04:33.4865292Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 19s local 2024-12-18T01:04:33.4866310Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 17s local 2024-12-18T01:04:33.4867401Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 17s local 2024-12-18T01:04:33.4868240Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 17s local ... 2024-12-18T01:04:33.7733251Z 2024-12-18T01:04:33.7734092Z  2024-12-18T01:04:33.7734565Z  2024-12-18T01:04:33.7734993Z  2024-12-18T01:04:33.7735346Z  2024-12-18T01:04:33.7735726Z  2024-12-18T01:04:33.7736089Z  2024-12-18T01:04:33.7736692Z  2024-12-18T01:04:33.7737050Z  2024-12-18T01:04:33.7737924Z [19,884 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:33.7738992Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T01:04:33.7739730Z Compiling torch_xla/csrc/ir.cpp; 32s local 2024-12-18T01:04:33.7740451Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T01:04:33.7741277Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T01:04:33.7742250Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 19s local 2024-12-18T01:04:33.7743149Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 18s local 2024-12-18T01:04:33.7744119Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 17s local 2024-12-18T01:04:33.7745399Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 17s local ... 2024-12-18T01:04:34.1737978Z 2024-12-18T01:04:34.1738883Z  2024-12-18T01:04:34.1739418Z  2024-12-18T01:04:34.1739868Z  2024-12-18T01:04:34.1740254Z  2024-12-18T01:04:34.1740631Z  2024-12-18T01:04:34.1741017Z  2024-12-18T01:04:34.1741407Z  2024-12-18T01:04:34.1741807Z  2024-12-18T01:04:34.1742793Z [19,886 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:34.1744427Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2024-12-18T01:04:34.1745324Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T01:04:34.1746193Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2024-12-18T01:04:34.1747252Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 20s local 2024-12-18T01:04:34.1748235Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 18s local 2024-12-18T01:04:34.1749191Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 17s local 2024-12-18T01:04:34.1750673Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 16s local 2024-12-18T01:04:34.1751732Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 16s local ... 2024-12-18T01:04:34.7381961Z 2024-12-18T01:04:34.7382917Z  2024-12-18T01:04:34.7383396Z  2024-12-18T01:04:34.7383783Z  2024-12-18T01:04:34.7384210Z  2024-12-18T01:04:34.7384619Z  2024-12-18T01:04:34.7384998Z  2024-12-18T01:04:34.7385395Z  2024-12-18T01:04:34.7385782Z  2024-12-18T01:04:34.7387042Z [19,887 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:34.7388089Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T01:04:34.7388905Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T01:04:34.7389711Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:34.7390694Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 20s local 2024-12-18T01:04:34.7391660Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 19s local 2024-12-18T01:04:34.7392519Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 18s local 2024-12-18T01:04:34.7393600Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 17s local 2024-12-18T01:04:34.7394573Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 17s local ... 2024-12-18T01:04:34.9745256Z 2024-12-18T01:04:34.9746108Z  2024-12-18T01:04:34.9746580Z  2024-12-18T01:04:34.9747023Z  2024-12-18T01:04:34.9747412Z  2024-12-18T01:04:34.9747791Z  2024-12-18T01:04:34.9748178Z  2024-12-18T01:04:34.9748574Z  2024-12-18T01:04:34.9748964Z  2024-12-18T01:04:34.9749900Z [19,887 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:34.9750959Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T01:04:34.9751884Z Compiling torch_xla/csrc/lowering_context.cpp; 33s local 2024-12-18T01:04:34.9752736Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:34.9753730Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 20s local 2024-12-18T01:04:34.9754719Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 19s local 2024-12-18T01:04:34.9755637Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 18s local 2024-12-18T01:04:34.9756687Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 17s local 2024-12-18T01:04:34.9757722Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 17s local ... 2024-12-18T01:04:35.2243536Z 2024-12-18T01:04:35.2244559Z  2024-12-18T01:04:35.2245016Z  2024-12-18T01:04:35.2245398Z  2024-12-18T01:04:35.2245755Z  2024-12-18T01:04:35.2246115Z  2024-12-18T01:04:35.2246476Z  2024-12-18T01:04:35.2246820Z  2024-12-18T01:04:35.2247194Z  2024-12-18T01:04:35.2248389Z [19,888 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:35.2249384Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2024-12-18T01:04:35.2250224Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:35.2251162Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local 2024-12-18T01:04:35.2252300Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 19s local 2024-12-18T01:04:35.2253147Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 18s local 2024-12-18T01:04:35.2254092Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 17s local 2024-12-18T01:04:35.2255040Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 17s local 2024-12-18T01:04:35.2255885Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 17s local ... 2024-12-18T01:04:35.5754810Z 2024-12-18T01:04:35.5755741Z  2024-12-18T01:04:35.5756214Z  2024-12-18T01:04:35.5756641Z  2024-12-18T01:04:35.5757018Z  2024-12-18T01:04:35.5757400Z  2024-12-18T01:04:35.5757795Z  2024-12-18T01:04:35.5758473Z  2024-12-18T01:04:35.5758867Z  2024-12-18T01:04:35.5759779Z [19,888 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:35.5760853Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T01:04:35.5761743Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2024-12-18T01:04:35.5762860Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local 2024-12-18T01:04:35.5763863Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 19s local 2024-12-18T01:04:35.5764719Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 19s local 2024-12-18T01:04:35.5765760Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 18s local 2024-12-18T01:04:35.5766732Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 17s local 2024-12-18T01:04:35.5767607Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 17s local ... 2024-12-18T01:04:35.8741490Z 2024-12-18T01:04:35.8742337Z  2024-12-18T01:04:35.8742850Z  2024-12-18T01:04:35.8743243Z  2024-12-18T01:04:35.8743649Z  2024-12-18T01:04:35.8744050Z  2024-12-18T01:04:35.8744712Z  2024-12-18T01:04:35.8745103Z  2024-12-18T01:04:35.8745510Z  2024-12-18T01:04:35.8746486Z [19,889 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:35.8747603Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T01:04:35.8748506Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T01:04:35.8749532Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local 2024-12-18T01:04:35.8750524Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 20s local 2024-12-18T01:04:35.8751510Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 19s local 2024-12-18T01:04:35.8752466Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 18s local 2024-12-18T01:04:35.8753362Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 18s local 2024-12-18T01:04:35.8754181Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 17s local ... 2024-12-18T01:04:36.1759298Z 2024-12-18T01:04:36.1760306Z  2024-12-18T01:04:36.1760719Z  2024-12-18T01:04:36.1761073Z  2024-12-18T01:04:36.1761463Z  2024-12-18T01:04:36.1761813Z  2024-12-18T01:04:36.1762164Z  2024-12-18T01:04:36.1762517Z  2024-12-18T01:04:36.1762874Z  2024-12-18T01:04:36.1763721Z [19,890 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:36.1764706Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2024-12-18T01:04:36.1765491Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2024-12-18T01:04:36.1766396Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 22s local 2024-12-18T01:04:36.1767581Z Compiling xla/python/pjrt_ifrt/pjrt_memory.cc; 20s local 2024-12-18T01:04:36.1768396Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 19s local 2024-12-18T01:04:36.1769331Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 18s local 2024-12-18T01:04:36.1770225Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 18s local 2024-12-18T01:04:36.1771140Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 18s local ... 2024-12-18T01:04:36.7508429Z 2024-12-18T01:04:36.7509309Z  2024-12-18T01:04:36.7509754Z  2024-12-18T01:04:36.7510120Z  2024-12-18T01:04:36.7510487Z  2024-12-18T01:04:36.7510807Z  2024-12-18T01:04:36.7511152Z  2024-12-18T01:04:36.7511471Z  2024-12-18T01:04:36.7511823Z  2024-12-18T01:04:36.7512635Z [19,891 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:36.7513494Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T01:04:36.7514256Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T01:04:36.7515325Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 22s local 2024-12-18T01:04:36.7516216Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 20s local 2024-12-18T01:04:36.7517121Z Compiling stablehlo/transforms/StablehloAggressiveFolder.cpp; 19s local 2024-12-18T01:04:36.7517979Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 19s local 2024-12-18T01:04:36.7518826Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 18s local 2024-12-18T01:04:36.7519484Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:36.9765419Z 2024-12-18T01:04:36.9766269Z  2024-12-18T01:04:36.9766737Z  2024-12-18T01:04:36.9767109Z  2024-12-18T01:04:36.9767450Z  2024-12-18T01:04:36.9767804Z  2024-12-18T01:04:36.9768144Z  2024-12-18T01:04:36.9768516Z  2024-12-18T01:04:36.9768872Z  2024-12-18T01:04:36.9769756Z [19,893 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:36.9770786Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T01:04:36.9771590Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T01:04:36.9772496Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 22s local 2024-12-18T01:04:36.9773509Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 20s local 2024-12-18T01:04:36.9774375Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 19s local 2024-12-18T01:04:36.9775210Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 18s local 2024-12-18T01:04:36.9775967Z @stablehlo//:linalg_passes; 18s local 2024-12-18T01:04:36.9776691Z @stablehlo//:stablehlo_passes; 17s local ... 2024-12-18T01:04:37.2372546Z 2024-12-18T01:04:37.2373464Z  2024-12-18T01:04:37.2373928Z  2024-12-18T01:04:37.2374299Z  2024-12-18T01:04:37.2374662Z  2024-12-18T01:04:37.2375060Z  2024-12-18T01:04:37.2375423Z  2024-12-18T01:04:37.2375789Z  2024-12-18T01:04:37.2376166Z  2024-12-18T01:04:37.2377310Z [19,894 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:37.2378282Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2024-12-18T01:04:37.2379090Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T01:04:37.2380077Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:37.2381294Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 20s local 2024-12-18T01:04:37.2382123Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 19s local 2024-12-18T01:04:37.2382901Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 19s local 2024-12-18T01:04:37.2383605Z @stablehlo//:linalg_passes; 18s local 2024-12-18T01:04:37.2384187Z @stablehlo//:stablehlo_passes; 17s local ... 2024-12-18T01:04:37.5770181Z 2024-12-18T01:04:37.5771003Z  2024-12-18T01:04:37.5771385Z  2024-12-18T01:04:37.5771715Z  2024-12-18T01:04:37.5772023Z  2024-12-18T01:04:37.5772315Z  2024-12-18T01:04:37.5772638Z  2024-12-18T01:04:37.5772929Z  2024-12-18T01:04:37.5773240Z  2024-12-18T01:04:37.5773971Z [19,894 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:37.5775067Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T01:04:37.5775817Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2024-12-18T01:04:37.5776818Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:37.5777707Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 21s local 2024-12-18T01:04:37.5778412Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 19s local 2024-12-18T01:04:37.5779129Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 19s local 2024-12-18T01:04:37.5779789Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:37.5780346Z @stablehlo//:stablehlo_passes; 18s local ... 2024-12-18T01:04:37.7773553Z 2024-12-18T01:04:37.7774447Z  2024-12-18T01:04:37.7774885Z  2024-12-18T01:04:37.7775226Z  2024-12-18T01:04:37.7775586Z  2024-12-18T01:04:37.7775905Z  2024-12-18T01:04:37.7776266Z  2024-12-18T01:04:37.7776781Z  2024-12-18T01:04:37.7777157Z  2024-12-18T01:04:37.7778143Z [19,895 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:04:37.7779113Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T01:04:37.7780025Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:37.7780971Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 21s local 2024-12-18T01:04:37.7781782Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 20s local 2024-12-18T01:04:37.7782579Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 19s local 2024-12-18T01:04:37.7783242Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:37.7783828Z @stablehlo//:stablehlo_passes; 18s local 2024-12-18T01:04:37.7784403Z @stablehlo//:linalg_passes; 17s local ... 2024-12-18T01:04:38.1777764Z 2024-12-18T01:04:38.1778658Z  2024-12-18T01:04:38.1779098Z  2024-12-18T01:04:38.1779490Z  2024-12-18T01:04:38.1779906Z  2024-12-18T01:04:38.1780272Z  2024-12-18T01:04:38.1780639Z  2024-12-18T01:04:38.1780975Z  2024-12-18T01:04:38.1781329Z  2024-12-18T01:04:38.1782201Z [19,895 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:38.1783208Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2024-12-18T01:04:38.1784199Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:38.1785205Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 21s local 2024-12-18T01:04:38.1786076Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 20s local 2024-12-18T01:04:38.1786942Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 20s local 2024-12-18T01:04:38.1787671Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:38.1788228Z @stablehlo//:stablehlo_passes; 18s local 2024-12-18T01:04:38.1788796Z @stablehlo//:linalg_passes; 17s local ... 2024-12-18T01:04:38.4014498Z 2024-12-18T01:04:38.4015384Z  2024-12-18T01:04:38.4015855Z  2024-12-18T01:04:38.4016239Z  2024-12-18T01:04:38.4016747Z  2024-12-18T01:04:38.4017125Z  2024-12-18T01:04:38.4017492Z  2024-12-18T01:04:38.4017867Z  2024-12-18T01:04:38.4018247Z  2024-12-18T01:04:38.4019154Z [19,896 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:38.4020188Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T01:04:38.4021139Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:38.4022497Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 22s local 2024-12-18T01:04:38.4023458Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 20s local 2024-12-18T01:04:38.4024277Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 20s local 2024-12-18T01:04:38.4025000Z @stablehlo//:linalg_passes; 20s local 2024-12-18T01:04:38.4025731Z @stablehlo//:stablehlo_passes; 18s local 2024-12-18T01:04:38.4026314Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:38.7783364Z 2024-12-18T01:04:38.7784294Z  2024-12-18T01:04:38.7784769Z  2024-12-18T01:04:38.7785155Z  2024-12-18T01:04:38.7785546Z  2024-12-18T01:04:38.7785916Z  2024-12-18T01:04:38.7786261Z  2024-12-18T01:04:38.7786612Z  2024-12-18T01:04:38.7786987Z  2024-12-18T01:04:38.7787893Z [19,897 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:38.7788934Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2024-12-18T01:04:38.7790264Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:38.7791260Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 22s local 2024-12-18T01:04:38.7792109Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local 2024-12-18T01:04:38.7792967Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 20s local 2024-12-18T01:04:38.7793709Z @stablehlo//:linalg_passes; 20s local 2024-12-18T01:04:38.7794487Z @stablehlo//:stablehlo_passes; 19s local 2024-12-18T01:04:38.7795071Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:39.3172382Z 2024-12-18T01:04:39.3173266Z  2024-12-18T01:04:39.3173697Z  2024-12-18T01:04:39.3174068Z  2024-12-18T01:04:39.3174414Z  2024-12-18T01:04:39.3174789Z  2024-12-18T01:04:39.3175143Z  2024-12-18T01:04:39.3175505Z  2024-12-18T01:04:39.3175892Z  2024-12-18T01:04:39.3176865Z [19,898 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:39.3177846Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:04:39.3178789Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:04:39.3179694Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local 2024-12-18T01:04:39.3180465Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 21s local 2024-12-18T01:04:39.3181337Z @stablehlo//:linalg_passes; 21s local 2024-12-18T01:04:39.3181996Z @stablehlo//:stablehlo_passes; 19s local 2024-12-18T01:04:39.3182626Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:39.3183139Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:39.5789379Z 2024-12-18T01:04:39.5790255Z  2024-12-18T01:04:39.5790727Z  2024-12-18T01:04:39.5791100Z  2024-12-18T01:04:39.5791465Z  2024-12-18T01:04:39.5791854Z  2024-12-18T01:04:39.5792239Z  2024-12-18T01:04:39.5792617Z  2024-12-18T01:04:39.5792973Z  2024-12-18T01:04:39.5793886Z [19,898 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:39.5794962Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:04:39.5795958Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:04:39.5796922Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local 2024-12-18T01:04:39.5797750Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 21s local 2024-12-18T01:04:39.5798498Z @stablehlo//:linalg_passes; 21s local 2024-12-18T01:04:39.5799104Z @stablehlo//:stablehlo_passes; 20s local 2024-12-18T01:04:39.5799702Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:39.5800300Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:39.7792512Z 2024-12-18T01:04:39.7793414Z  2024-12-18T01:04:39.7794248Z  2024-12-18T01:04:39.7794657Z  2024-12-18T01:04:39.7795017Z  2024-12-18T01:04:39.7795391Z  2024-12-18T01:04:39.7795786Z  2024-12-18T01:04:39.7796186Z  2024-12-18T01:04:39.7796561Z  2024-12-18T01:04:39.7797470Z [19,900 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:39.7798562Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:04:39.7799860Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:04:39.7800803Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 22s local 2024-12-18T01:04:39.7801804Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 21s local 2024-12-18T01:04:39.7802530Z @stablehlo//:linalg_passes; 21s local 2024-12-18T01:04:39.7803057Z @stablehlo//:stablehlo_passes; 20s local 2024-12-18T01:04:39.7803591Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:39.7804137Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:40.1796480Z 2024-12-18T01:04:40.1797363Z  2024-12-18T01:04:40.1797803Z  2024-12-18T01:04:40.1798497Z  2024-12-18T01:04:40.1798896Z  2024-12-18T01:04:40.1799272Z  2024-12-18T01:04:40.1799649Z  2024-12-18T01:04:40.1800002Z  2024-12-18T01:04:40.1800389Z  2024-12-18T01:04:40.1801307Z [19,901 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:40.1802398Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2024-12-18T01:04:40.1803573Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:04:40.1804565Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 22s local 2024-12-18T01:04:40.1805341Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 22s local 2024-12-18T01:04:40.1806125Z @stablehlo//:linalg_passes; 21s local 2024-12-18T01:04:40.1806769Z @stablehlo//:stablehlo_passes; 20s local 2024-12-18T01:04:40.1807409Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:40.1808035Z @stablehlo//:linalg_passes; 19s local ... 2024-12-18T01:04:41.1803899Z 2024-12-18T01:04:41.1804809Z  2024-12-18T01:04:41.1805270Z  2024-12-18T01:04:41.1805653Z  2024-12-18T01:04:41.1806024Z  2024-12-18T01:04:41.1806395Z  2024-12-18T01:04:41.1806768Z  2024-12-18T01:04:41.1807124Z  2024-12-18T01:04:41.1807485Z  2024-12-18T01:04:41.1808388Z [19,901 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:41.1809402Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2024-12-18T01:04:41.1810459Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:04:41.1811505Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local 2024-12-18T01:04:41.1812434Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 23s local 2024-12-18T01:04:41.1813237Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:04:41.1813879Z @stablehlo//:stablehlo_passes; 21s local 2024-12-18T01:04:41.1814512Z @stablehlo//:linalg_passes; 20s local 2024-12-18T01:04:41.1815136Z @stablehlo//:linalg_passes; 20s local ... 2024-12-18T01:04:42.0659034Z 2024-12-18T01:04:42.0659987Z  2024-12-18T01:04:42.0660417Z  2024-12-18T01:04:42.0660772Z  2024-12-18T01:04:42.0661172Z  2024-12-18T01:04:42.0661539Z  2024-12-18T01:04:42.0661911Z  2024-12-18T01:04:42.0662294Z  2024-12-18T01:04:42.0662683Z  2024-12-18T01:04:42.0663652Z [19,902 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:42.0664698Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2024-12-18T01:04:42.0665689Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:04:42.0666688Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local 2024-12-18T01:04:42.0667933Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local 2024-12-18T01:04:42.0668678Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:04:42.0669270Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:04:42.0669836Z @stablehlo//:linalg_passes; 21s local 2024-12-18T01:04:42.0670451Z @stablehlo//:linalg_passes; 20s local ... 2024-12-18T01:04:42.2967996Z 2024-12-18T01:04:42.2969103Z  2024-12-18T01:04:42.2969572Z  2024-12-18T01:04:42.2969956Z  2024-12-18T01:04:42.2970324Z  2024-12-18T01:04:42.2970699Z  2024-12-18T01:04:42.2971078Z  2024-12-18T01:04:42.2971427Z  2024-12-18T01:04:42.2971769Z  2024-12-18T01:04:42.2972634Z [19,904 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:42.2973591Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T01:04:42.2975119Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:04:42.2976124Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local 2024-12-18T01:04:42.2977299Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local 2024-12-18T01:04:42.2978011Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:04:42.2978594Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:04:42.2979205Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:04:42.2979937Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 20s local ... 2024-12-18T01:04:42.5813363Z 2024-12-18T01:04:42.5814412Z  2024-12-18T01:04:42.5815170Z  2024-12-18T01:04:42.5815583Z  2024-12-18T01:04:42.5815963Z  2024-12-18T01:04:42.5816439Z  2024-12-18T01:04:42.5816849Z  2024-12-18T01:04:42.5817247Z  2024-12-18T01:04:42.5817650Z  2024-12-18T01:04:42.5818649Z [19,904 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:42.5819816Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T01:04:42.5821110Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:04:42.5822221Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local 2024-12-18T01:04:42.5823172Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local 2024-12-18T01:04:42.5824040Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:04:42.5824723Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:04:42.5825396Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:04:42.5826147Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 20s local ... 2024-12-18T01:04:42.9026922Z 2024-12-18T01:04:42.9027814Z  2024-12-18T01:04:42.9028237Z  2024-12-18T01:04:42.9028605Z  2024-12-18T01:04:42.9028962Z  2024-12-18T01:04:42.9029330Z  2024-12-18T01:04:42.9029699Z  2024-12-18T01:04:42.9030043Z  2024-12-18T01:04:42.9030397Z  2024-12-18T01:04:42.9031259Z [19,905 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:42.9032314Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T01:04:42.9033392Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:04:42.9034196Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2024-12-18T01:04:42.9034906Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local 2024-12-18T01:04:42.9035546Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:04:42.9036061Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:04:42.9036567Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:04:42.9037225Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 20s local ... 2024-12-18T01:04:43.1818998Z 2024-12-18T01:04:43.1819855Z  2024-12-18T01:04:43.1820349Z  2024-12-18T01:04:43.1820735Z  2024-12-18T01:04:43.1821095Z  2024-12-18T01:04:43.1821482Z  2024-12-18T01:04:43.1821873Z  2024-12-18T01:04:43.1822661Z  2024-12-18T01:04:43.1823038Z  2024-12-18T01:04:43.1823956Z [19,905 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:43.1825046Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2024-12-18T01:04:43.1826095Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:04:43.1827226Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2024-12-18T01:04:43.1828162Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T01:04:43.1828947Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:04:43.1829580Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:04:43.1830185Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:04:43.1830945Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 21s local ... 2024-12-18T01:04:43.3822411Z 2024-12-18T01:04:43.3823412Z  2024-12-18T01:04:43.3823916Z  2024-12-18T01:04:43.3824368Z  2024-12-18T01:04:43.3824780Z  2024-12-18T01:04:43.3825168Z  2024-12-18T01:04:43.3825572Z  2024-12-18T01:04:43.3826242Z  2024-12-18T01:04:43.3826656Z  2024-12-18T01:04:43.3827593Z [19,906 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:43.3828641Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T01:04:43.3829667Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:04:43.3830802Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2024-12-18T01:04:43.3831646Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T01:04:43.3832428Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:04:43.3833045Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:04:43.3833666Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:04:43.3834264Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:43.8433509Z 2024-12-18T01:04:43.8434373Z  2024-12-18T01:04:43.8434831Z  2024-12-18T01:04:43.8435177Z  2024-12-18T01:04:43.8435551Z  2024-12-18T01:04:43.8436074Z  2024-12-18T01:04:43.8436462Z  2024-12-18T01:04:43.8436855Z  2024-12-18T01:04:43.8437247Z  2024-12-18T01:04:43.8438169Z [19,907 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:43.8439160Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T01:04:43.8440142Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:04:43.8441169Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2024-12-18T01:04:43.8442050Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T01:04:43.8442816Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:04:43.8443416Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:04:43.8444032Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:04:43.8444929Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:04:44.1828722Z 2024-12-18T01:04:44.1829669Z  2024-12-18T01:04:44.1830151Z  2024-12-18T01:04:44.1830545Z  2024-12-18T01:04:44.1830919Z  2024-12-18T01:04:44.1831294Z  2024-12-18T01:04:44.1831670Z  2024-12-18T01:04:44.1832077Z  2024-12-18T01:04:44.1832465Z  2024-12-18T01:04:44.1833387Z [19,909 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:44.1834484Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2024-12-18T01:04:44.1835498Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:04:44.1836434Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2024-12-18T01:04:44.1837291Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2024-12-18T01:04:44.1837998Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:04:44.1838984Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:04:44.1839588Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:04:44.1840263Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:04:44.3831884Z 2024-12-18T01:04:44.3832767Z  2024-12-18T01:04:44.3833225Z  2024-12-18T01:04:44.3833622Z  2024-12-18T01:04:44.3834003Z  2024-12-18T01:04:44.3834709Z  2024-12-18T01:04:44.3835093Z  2024-12-18T01:04:44.3835476Z  2024-12-18T01:04:44.3835861Z  2024-12-18T01:04:44.3836784Z [19,910 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:44.3837849Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2024-12-18T01:04:44.3838874Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:04:44.3840018Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2024-12-18T01:04:44.3840932Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2024-12-18T01:04:44.3841688Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:04:44.3842490Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:04:44.3843407Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 17s local 2024-12-18T01:04:44.3844709Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 17s local ... 2024-12-18T01:04:45.3103867Z 2024-12-18T01:04:45.3104746Z  2024-12-18T01:04:45.3105246Z  2024-12-18T01:04:45.3105636Z  2024-12-18T01:04:45.3106016Z  2024-12-18T01:04:45.3106658Z  2024-12-18T01:04:45.3107101Z  2024-12-18T01:04:45.3107482Z  2024-12-18T01:04:45.3107987Z  2024-12-18T01:04:45.3108938Z [19,911 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:45.3109983Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T01:04:45.3110983Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:04:45.3111982Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T01:04:45.3112889Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T01:04:45.3113695Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:04:45.3114299Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T01:04:45.3115189Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2024-12-18T01:04:45.3116452Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 18s local ... 2024-12-18T01:04:45.5246593Z 2024-12-18T01:04:45.5247442Z  2024-12-18T01:04:45.5247855Z  2024-12-18T01:04:45.5248217Z  2024-12-18T01:04:45.5248550Z  2024-12-18T01:04:45.5248912Z  2024-12-18T01:04:45.5249248Z  2024-12-18T01:04:45.5249610Z  2024-12-18T01:04:45.5249954Z  2024-12-18T01:04:45.5250751Z [19,912 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:45.5251754Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T01:04:45.5252770Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:04:45.5253738Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T01:04:45.5254541Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T01:04:45.5255237Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:04:45.5255812Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T01:04:45.5256783Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2024-12-18T01:04:45.5257766Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 18s local ... 2024-12-18T01:04:45.7838543Z 2024-12-18T01:04:45.7839522Z  2024-12-18T01:04:45.7840026Z  2024-12-18T01:04:45.7840425Z  2024-12-18T01:04:45.7840819Z  2024-12-18T01:04:45.7841192Z  2024-12-18T01:04:45.7841559Z  2024-12-18T01:04:45.7842254Z  2024-12-18T01:04:45.7842640Z  2024-12-18T01:04:45.7843574Z [19,912 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:45.7844858Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T01:04:45.7845849Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:04:45.7847023Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T01:04:45.7847906Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T01:04:45.7848694Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:04:45.7849319Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T01:04:45.7850219Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2024-12-18T01:04:45.7851155Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 18s local ... 2024-12-18T01:04:46.2467555Z 2024-12-18T01:04:46.2468874Z  2024-12-18T01:04:46.2469373Z  2024-12-18T01:04:46.2481227Z  2024-12-18T01:04:46.2481912Z  2024-12-18T01:04:46.2482289Z  2024-12-18T01:04:46.2483001Z  2024-12-18T01:04:46.2483400Z  2024-12-18T01:04:46.2483793Z  2024-12-18T01:04:46.2484658Z [19,913 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:46.2485672Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2024-12-18T01:04:46.2486738Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:04:46.2487892Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T01:04:46.2488860Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T01:04:46.2489585Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:04:46.2490132Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T01:04:46.2490954Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 19s local 2024-12-18T01:04:46.2492031Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 19s local ... 2024-12-18T01:04:46.5845447Z 2024-12-18T01:04:46.5846272Z  2024-12-18T01:04:46.5846795Z  2024-12-18T01:04:46.5847190Z  2024-12-18T01:04:46.5847560Z  2024-12-18T01:04:46.5847952Z  2024-12-18T01:04:46.5848345Z  2024-12-18T01:04:46.5848745Z  2024-12-18T01:04:46.5849119Z  2024-12-18T01:04:46.5850048Z [19,913 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:46.5851118Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2024-12-18T01:04:46.5852184Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:04:46.5853232Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T01:04:46.5854117Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T01:04:46.5854864Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:04:46.5855513Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T01:04:46.5856583Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 19s local 2024-12-18T01:04:46.5857658Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 19s local ... 2024-12-18T01:04:46.9849065Z 2024-12-18T01:04:46.9849960Z  2024-12-18T01:04:46.9850428Z  2024-12-18T01:04:46.9850800Z  2024-12-18T01:04:46.9851244Z  2024-12-18T01:04:46.9851651Z  2024-12-18T01:04:46.9852032Z  2024-12-18T01:04:46.9852394Z  2024-12-18T01:04:46.9852782Z  2024-12-18T01:04:46.9853727Z [19,915 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:46.9854767Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2024-12-18T01:04:46.9855726Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:04:46.9856814Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2024-12-18T01:04:46.9858029Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T01:04:46.9858771Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:04:46.9859393Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T01:04:46.9860288Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2024-12-18T01:04:46.9861363Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 19s local ... 2024-12-18T01:04:47.3852181Z 2024-12-18T01:04:47.3853031Z  2024-12-18T01:04:47.3853444Z  2024-12-18T01:04:47.3853795Z  2024-12-18T01:04:47.3854143Z  2024-12-18T01:04:47.3854488Z  2024-12-18T01:04:47.3854843Z  2024-12-18T01:04:47.3855170Z  2024-12-18T01:04:47.3855518Z  2024-12-18T01:04:47.3856445Z [19,916 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:47.3857411Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T01:04:47.3858343Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:04:47.3859502Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2024-12-18T01:04:47.3860298Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T01:04:47.3860955Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:04:47.3861507Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T01:04:47.3862291Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2024-12-18T01:04:47.3863267Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 20s local ... 2024-12-18T01:04:47.6292816Z 2024-12-18T01:04:47.6293671Z  2024-12-18T01:04:47.6294078Z  2024-12-18T01:04:47.6294434Z  2024-12-18T01:04:47.6294828Z  2024-12-18T01:04:47.6295155Z  2024-12-18T01:04:47.6295501Z  2024-12-18T01:04:47.6295864Z  2024-12-18T01:04:47.6296208Z  2024-12-18T01:04:47.6297126Z [19,917 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:47.6298017Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T01:04:47.6298899Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:04:47.6299758Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2024-12-18T01:04:47.6300517Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T01:04:47.6301170Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:04:47.6301705Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T01:04:47.6302461Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2024-12-18T01:04:47.6303395Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 20s local ... 2024-12-18T01:04:47.9864601Z 2024-12-18T01:04:47.9865510Z  2024-12-18T01:04:47.9865963Z  2024-12-18T01:04:47.9866309Z  2024-12-18T01:04:47.9866669Z  2024-12-18T01:04:47.9866999Z  2024-12-18T01:04:47.9867358Z  2024-12-18T01:04:47.9867740Z  2024-12-18T01:04:47.9868089Z  2024-12-18T01:04:47.9868895Z [19,917 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:47.9869864Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T01:04:47.9870788Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:04:47.9871663Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T01:04:47.9872453Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T01:04:47.9873133Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:04:47.9873766Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T01:04:47.9874577Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2024-12-18T01:04:47.9875706Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 20s local ... 2024-12-18T01:04:48.1865314Z 2024-12-18T01:04:48.1866106Z  2024-12-18T01:04:48.1866831Z  2024-12-18T01:04:48.1867178Z  2024-12-18T01:04:48.1867494Z  2024-12-18T01:04:48.1867825Z  2024-12-18T01:04:48.1868188Z  2024-12-18T01:04:48.1868548Z  2024-12-18T01:04:48.1868890Z  2024-12-18T01:04:48.1869648Z [19,918 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:48.1870555Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2024-12-18T01:04:48.1871558Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:04:48.1872422Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T01:04:48.1873198Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local 2024-12-18T01:04:48.1873881Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:04:48.1874422Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T01:04:48.1875199Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2024-12-18T01:04:48.1876162Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 21s local ... 2024-12-18T01:04:48.5187709Z 2024-12-18T01:04:48.5188837Z  2024-12-18T01:04:48.5189265Z  2024-12-18T01:04:48.5189562Z  2024-12-18T01:04:48.5189878Z  2024-12-18T01:04:48.5190189Z  2024-12-18T01:04:48.5190509Z  2024-12-18T01:04:48.5190821Z  2024-12-18T01:04:48.5191125Z  2024-12-18T01:04:48.5191906Z [19,919 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:48.5192906Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T01:04:48.5193739Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:04:48.5194682Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T01:04:48.5195390Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local 2024-12-18T01:04:48.5196025Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:04:48.5196563Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T01:04:48.5197327Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2024-12-18T01:04:48.5198239Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 21s local ... 2024-12-18T01:04:48.7869253Z 2024-12-18T01:04:48.7870064Z  2024-12-18T01:04:48.7870444Z  2024-12-18T01:04:48.7870756Z  2024-12-18T01:04:48.7871066Z  2024-12-18T01:04:48.7871375Z  2024-12-18T01:04:48.7871690Z  2024-12-18T01:04:48.7871995Z  2024-12-18T01:04:48.7872305Z  2024-12-18T01:04:48.7873031Z [19,919 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:48.7873840Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T01:04:48.7874625Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:04:48.7875388Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T01:04:48.7876054Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local 2024-12-18T01:04:48.7876637Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:04:48.7877128Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T01:04:48.7877809Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2024-12-18T01:04:48.7878619Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 21s local ... 2024-12-18T01:04:48.9872951Z 2024-12-18T01:04:48.9873763Z  2024-12-18T01:04:48.9874313Z  2024-12-18T01:04:48.9874786Z  2024-12-18T01:04:48.9875285Z  2024-12-18T01:04:48.9875758Z  2024-12-18T01:04:48.9876225Z  2024-12-18T01:04:48.9876697Z  2024-12-18T01:04:48.9877148Z  2024-12-18T01:04:48.9878170Z [19,920 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:48.9879332Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2024-12-18T01:04:48.9880455Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:04:48.9881881Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T01:04:48.9882688Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:04:48.9883385Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T01:04:48.9884360Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2024-12-18T01:04:48.9885642Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 21s local 2024-12-18T01:04:48.9886512Z @stablehlo//:stablehlo_passes; 19s local ... 2024-12-18T01:04:49.3106836Z 2024-12-18T01:04:49.3107716Z  2024-12-18T01:04:49.3108181Z  2024-12-18T01:04:49.3108696Z  2024-12-18T01:04:49.3109035Z  2024-12-18T01:04:49.3109432Z  2024-12-18T01:04:49.3109801Z  2024-12-18T01:04:49.3110216Z  2024-12-18T01:04:49.3110640Z  2024-12-18T01:04:49.3111544Z [19,922 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:49.3112683Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T01:04:49.3114020Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:04:49.3115001Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T01:04:49.3115715Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:04:49.3116295Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T01:04:49.3117207Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2024-12-18T01:04:49.3118387Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 22s local 2024-12-18T01:04:49.3119183Z @stablehlo//:stablehlo_passes; 19s local ... 2024-12-18T01:04:49.5493740Z 2024-12-18T01:04:49.5494562Z  2024-12-18T01:04:49.5495018Z  2024-12-18T01:04:49.5495386Z  2024-12-18T01:04:49.5495739Z  2024-12-18T01:04:49.5496089Z  2024-12-18T01:04:49.5496757Z  2024-12-18T01:04:49.5497097Z  2024-12-18T01:04:49.5497498Z  2024-12-18T01:04:49.5498342Z [19,924 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:49.5499373Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T01:04:49.5500282Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:04:49.5501163Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T01:04:49.5501877Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:04:49.5502460Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T01:04:49.5503264Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2024-12-18T01:04:49.5504184Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 22s local 2024-12-18T01:04:49.5504970Z @stablehlo//:stablehlo_passes; 19s local ... 2024-12-18T01:04:49.7879046Z 2024-12-18T01:04:49.7879900Z  2024-12-18T01:04:49.7880375Z  2024-12-18T01:04:49.7880756Z  2024-12-18T01:04:49.7881159Z  2024-12-18T01:04:49.7881529Z  2024-12-18T01:04:49.7881920Z  2024-12-18T01:04:49.7882316Z  2024-12-18T01:04:49.7882673Z  2024-12-18T01:04:49.7883577Z [19,925 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:49.7884644Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2024-12-18T01:04:49.7885657Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:04:49.7886515Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:04:49.7887141Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T01:04:49.7888007Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2024-12-18T01:04:49.7889055Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 22s local 2024-12-18T01:04:49.7889768Z @stablehlo//:stablehlo_passes; 20s local 2024-12-18T01:04:49.7890622Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local ... 2024-12-18T01:04:50.3788040Z 2024-12-18T01:04:50.3788892Z  2024-12-18T01:04:50.3789366Z  2024-12-18T01:04:50.3789797Z  2024-12-18T01:04:50.3790182Z  2024-12-18T01:04:50.3790562Z  2024-12-18T01:04:50.3790919Z  2024-12-18T01:04:50.3791273Z  2024-12-18T01:04:50.3791649Z  2024-12-18T01:04:50.3792523Z [19,926 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:50.3793866Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:04:50.3794891Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:04:50.3795748Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:04:50.3796366Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T01:04:50.3797099Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 23s local 2024-12-18T01:04:50.3797873Z @stablehlo//:stablehlo_passes; 20s local 2024-12-18T01:04:50.3798733Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2024-12-18T01:04:50.3799873Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2024-12-18T01:04:50.5886647Z 2024-12-18T01:04:50.5887541Z  2024-12-18T01:04:50.5888012Z  2024-12-18T01:04:50.5888393Z  2024-12-18T01:04:50.5888796Z  2024-12-18T01:04:50.5889175Z  2024-12-18T01:04:50.5889557Z  2024-12-18T01:04:50.5889985Z  2024-12-18T01:04:50.5890366Z  2024-12-18T01:04:50.5891703Z [19,926 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:50.5892776Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:04:50.5893795Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:04:50.5894674Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:04:50.5895276Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T01:04:50.5895991Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 23s local 2024-12-18T01:04:50.5896920Z @stablehlo//:stablehlo_passes; 21s local 2024-12-18T01:04:50.5897772Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2024-12-18T01:04:50.5898685Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2024-12-18T01:04:50.8224204Z 2024-12-18T01:04:50.8225058Z  2024-12-18T01:04:50.8225521Z  2024-12-18T01:04:50.8225939Z  2024-12-18T01:04:50.8226314Z  2024-12-18T01:04:50.8226673Z  2024-12-18T01:04:50.8227057Z  2024-12-18T01:04:50.8227437Z  2024-12-18T01:04:50.8227833Z  2024-12-18T01:04:50.8228725Z [19,927 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:50.8229799Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:04:50.8230707Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:04:50.8231490Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:04:50.8232011Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T01:04:50.8232704Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 23s local 2024-12-18T01:04:50.8233395Z @stablehlo//:stablehlo_passes; 21s local 2024-12-18T01:04:50.8234191Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2024-12-18T01:04:50.8235071Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2024-12-18T01:04:51.1892152Z 2024-12-18T01:04:51.1892991Z  2024-12-18T01:04:51.1893453Z  2024-12-18T01:04:51.1893842Z  2024-12-18T01:04:51.1894244Z  2024-12-18T01:04:51.1894621Z  2024-12-18T01:04:51.1894993Z  2024-12-18T01:04:51.1895359Z  2024-12-18T01:04:51.1895734Z  2024-12-18T01:04:51.1896800Z [19,927 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:51.1897975Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2024-12-18T01:04:51.1899382Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:04:51.1900256Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:04:51.1900839Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T01:04:51.1901578Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 24s local 2024-12-18T01:04:51.1902337Z @stablehlo//:stablehlo_passes; 21s local 2024-12-18T01:04:51.1903438Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2024-12-18T01:04:51.1904413Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2024-12-18T01:04:51.3895865Z 2024-12-18T01:04:51.3896915Z  2024-12-18T01:04:51.3897422Z  2024-12-18T01:04:51.3897806Z  2024-12-18T01:04:51.3898322Z  2024-12-18T01:04:51.3898703Z  2024-12-18T01:04:51.3899068Z  2024-12-18T01:04:51.3899448Z  2024-12-18T01:04:51.3899830Z  2024-12-18T01:04:51.3900786Z [19,928 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:51.3901880Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T01:04:51.3903188Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:04:51.3904094Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:04:51.3904689Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T01:04:51.3905449Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 24s local 2024-12-18T01:04:51.3906253Z @stablehlo//:stablehlo_passes; 21s local 2024-12-18T01:04:51.3907328Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2024-12-18T01:04:51.3908280Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2024-12-18T01:04:51.7851447Z 2024-12-18T01:04:51.7852344Z  2024-12-18T01:04:51.7852754Z  2024-12-18T01:04:51.7853157Z  2024-12-18T01:04:51.7853543Z  2024-12-18T01:04:51.7853939Z  2024-12-18T01:04:51.7854277Z  2024-12-18T01:04:51.7854598Z  2024-12-18T01:04:51.7854950Z  2024-12-18T01:04:51.7855720Z [19,929 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:51.7856716Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T01:04:51.7857354Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:04:51.7857855Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T01:04:51.7858473Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 24s local 2024-12-18T01:04:51.7859083Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:04:51.7859773Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2024-12-18T01:04:51.7860673Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2024-12-18T01:04:51.7861597Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local ... 2024-12-18T01:04:51.9901340Z 2024-12-18T01:04:51.9902160Z  2024-12-18T01:04:51.9902636Z  2024-12-18T01:04:51.9903020Z  2024-12-18T01:04:51.9903440Z  2024-12-18T01:04:51.9903803Z  2024-12-18T01:04:51.9904151Z  2024-12-18T01:04:51.9904542Z  2024-12-18T01:04:51.9904912Z  2024-12-18T01:04:51.9905796Z [19,931 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:51.9906827Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T01:04:51.9907547Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:04:51.9908135Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T01:04:51.9908735Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:04:51.9909555Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2024-12-18T01:04:51.9910625Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2024-12-18T01:04:51.9911693Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local 2024-12-18T01:04:51.9912606Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2024-12-18T01:04:52.1904353Z 2024-12-18T01:04:52.1905237Z  2024-12-18T01:04:52.1905664Z  2024-12-18T01:04:52.1906073Z  2024-12-18T01:04:52.1906471Z  2024-12-18T01:04:52.1906854Z  2024-12-18T01:04:52.1907253Z  2024-12-18T01:04:52.1907625Z  2024-12-18T01:04:52.1908021Z  2024-12-18T01:04:52.1908896Z [19,932 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:52.1910181Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2024-12-18T01:04:52.1910955Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:04:52.1911582Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T01:04:52.1912186Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:04:52.1912979Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2024-12-18T01:04:52.1914091Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2024-12-18T01:04:52.1915274Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local 2024-12-18T01:04:52.1916450Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2024-12-18T01:04:52.7296614Z 2024-12-18T01:04:52.7297466Z  2024-12-18T01:04:52.7297912Z  2024-12-18T01:04:52.7298298Z  2024-12-18T01:04:52.7298690Z  2024-12-18T01:04:52.7299029Z  2024-12-18T01:04:52.7299423Z  2024-12-18T01:04:52.7299850Z  2024-12-18T01:04:52.7300251Z  2024-12-18T01:04:52.7301449Z [19,933 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:52.7302561Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T01:04:52.7303359Z @stablehlo//:stablehlo_passes; 33s local 2024-12-18T01:04:52.7304004Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:04:52.7304883Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2024-12-18T01:04:52.7306048Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2024-12-18T01:04:52.7307233Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local 2024-12-18T01:04:52.7308145Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:04:52.7308973Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local ... 2024-12-18T01:04:52.9911149Z 2024-12-18T01:04:52.9912017Z  2024-12-18T01:04:52.9912474Z  2024-12-18T01:04:52.9912885Z  2024-12-18T01:04:52.9913237Z  2024-12-18T01:04:52.9913597Z  2024-12-18T01:04:52.9913946Z  2024-12-18T01:04:52.9914319Z  2024-12-18T01:04:52.9914669Z  2024-12-18T01:04:52.9915554Z [19,934 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:52.9916573Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2024-12-18T01:04:52.9917345Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:04:52.9918232Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2024-12-18T01:04:52.9919379Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2024-12-18T01:04:52.9920520Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local 2024-12-18T01:04:52.9921445Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:04:52.9922139Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local 2024-12-18T01:04:52.9923084Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 20s local ... 2024-12-18T01:04:53.5288268Z 2024-12-18T01:04:53.5289159Z  2024-12-18T01:04:53.5289628Z  2024-12-18T01:04:53.5290020Z  2024-12-18T01:04:53.5290410Z  2024-12-18T01:04:53.5290781Z  2024-12-18T01:04:53.5291163Z  2024-12-18T01:04:53.5291544Z  2024-12-18T01:04:53.5291930Z  2024-12-18T01:04:53.5292826Z [19,935 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:53.5294120Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T01:04:53.5294929Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:04:53.5295786Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2024-12-18T01:04:53.5297078Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2024-12-18T01:04:53.5298379Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local 2024-12-18T01:04:53.5299479Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:04:53.5300280Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local 2024-12-18T01:04:53.5301307Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local ... 2024-12-18T01:04:53.7919060Z 2024-12-18T01:04:53.7919863Z  2024-12-18T01:04:53.7920280Z  2024-12-18T01:04:53.7920677Z  2024-12-18T01:04:53.7921036Z  2024-12-18T01:04:53.7921398Z  2024-12-18T01:04:53.7921747Z  2024-12-18T01:04:53.7922169Z  2024-12-18T01:04:53.7922549Z  2024-12-18T01:04:53.7923779Z [19,935 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:53.7924887Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T01:04:53.7925664Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:04:53.7926565Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T01:04:53.7927733Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2024-12-18T01:04:53.7929059Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:53.7930050Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:04:53.7930890Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 22s local 2024-12-18T01:04:53.7931929Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local ... 2024-12-18T01:04:54.0084160Z 2024-12-18T01:04:54.0085026Z  2024-12-18T01:04:54.0085520Z  2024-12-18T01:04:54.0085913Z  2024-12-18T01:04:54.0086317Z  2024-12-18T01:04:54.0086687Z  2024-12-18T01:04:54.0087070Z  2024-12-18T01:04:54.0087436Z  2024-12-18T01:04:54.0087817Z  2024-12-18T01:04:54.0088724Z [19,936 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:54.0089727Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2024-12-18T01:04:54.0090492Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:04:54.0091453Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T01:04:54.0092694Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2024-12-18T01:04:54.0093740Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:54.0094597Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:04:54.0095402Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 22s local 2024-12-18T01:04:54.0096542Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local ... 2024-12-18T01:04:54.3927929Z 2024-12-18T01:04:54.3928786Z  2024-12-18T01:04:54.3929221Z  2024-12-18T01:04:54.3929630Z  2024-12-18T01:04:54.3930009Z  2024-12-18T01:04:54.3930404Z  2024-12-18T01:04:54.3930789Z  2024-12-18T01:04:54.3931168Z  2024-12-18T01:04:54.3931556Z  2024-12-18T01:04:54.3932478Z [19,936 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:54.3933627Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T01:04:54.3934417Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:04:54.3935316Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T01:04:54.3936671Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2024-12-18T01:04:54.3937891Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:54.3939237Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:04:54.3940054Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 22s local 2024-12-18T01:04:54.3941143Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local ... 2024-12-18T01:04:54.6056561Z 2024-12-18T01:04:54.6057443Z  2024-12-18T01:04:54.6057907Z  2024-12-18T01:04:54.6058559Z  2024-12-18T01:04:54.6058948Z  2024-12-18T01:04:54.6059347Z  2024-12-18T01:04:54.6059720Z  2024-12-18T01:04:54.6060100Z  2024-12-18T01:04:54.6060444Z  2024-12-18T01:04:54.6061337Z [19,937 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:54.6062423Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T01:04:54.6063233Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T01:04:54.6064128Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T01:04:54.6065100Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 24s local 2024-12-18T01:04:54.6066249Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:54.6067054Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:04:54.6067825Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local 2024-12-18T01:04:54.6068828Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local ... 2024-12-18T01:04:54.9933125Z 2024-12-18T01:04:54.9933994Z  2024-12-18T01:04:54.9934758Z  2024-12-18T01:04:54.9935166Z  2024-12-18T01:04:54.9935555Z  2024-12-18T01:04:54.9935930Z  2024-12-18T01:04:54.9936501Z  2024-12-18T01:04:54.9936890Z  2024-12-18T01:04:54.9937260Z  2024-12-18T01:04:54.9938180Z [19,937 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:54.9939162Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2024-12-18T01:04:54.9939949Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T01:04:54.9940863Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T01:04:54.9941982Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 24s local 2024-12-18T01:04:54.9943123Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:54.9944041Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:04:54.9945115Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local 2024-12-18T01:04:54.9946106Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local ... 2024-12-18T01:04:55.3938488Z 2024-12-18T01:04:55.3939307Z  2024-12-18T01:04:55.3939792Z  2024-12-18T01:04:55.3940183Z  2024-12-18T01:04:55.3940588Z  2024-12-18T01:04:55.3940982Z  2024-12-18T01:04:55.3941371Z  2024-12-18T01:04:55.3941754Z  2024-12-18T01:04:55.3942164Z  2024-12-18T01:04:55.3943100Z [19,941 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:55.3944432Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2024-12-18T01:04:55.3945509Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T01:04:55.3946736Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 24s local 2024-12-18T01:04:55.3947964Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:55.3948966Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:04:55.3949802Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local 2024-12-18T01:04:55.3950846Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:55.3952096Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 19s local ... 2024-12-18T01:04:56.3949214Z 2024-12-18T01:04:56.3950115Z  2024-12-18T01:04:56.3950856Z  2024-12-18T01:04:56.3951202Z  2024-12-18T01:04:56.3951552Z  2024-12-18T01:04:56.3951904Z  2024-12-18T01:04:56.3952265Z  2024-12-18T01:04:56.3952629Z  2024-12-18T01:04:56.3953051Z  2024-12-18T01:04:56.3953931Z [19,941 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:56.3955089Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T01:04:56.3956077Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2024-12-18T01:04:56.3957158Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 25s local 2024-12-18T01:04:56.3958222Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:04:56.3959103Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T01:04:56.3959865Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local 2024-12-18T01:04:56.3960861Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:56.3962147Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 20s local ... 2024-12-18T01:04:56.7394063Z 2024-12-18T01:04:56.7394924Z  2024-12-18T01:04:56.7395390Z  2024-12-18T01:04:56.7395790Z  2024-12-18T01:04:56.7396198Z  2024-12-18T01:04:56.7396595Z  2024-12-18T01:04:56.7396997Z  2024-12-18T01:04:56.7397438Z  2024-12-18T01:04:56.7397844Z  2024-12-18T01:04:56.7399034Z [19,942 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:56.7400181Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T01:04:56.7401170Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:04:56.7402318Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2024-12-18T01:04:56.7403420Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:04:56.7404343Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T01:04:56.7405110Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2024-12-18T01:04:56.7406125Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:56.7407275Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 20s local ... 2024-12-18T01:04:56.9953997Z 2024-12-18T01:04:56.9954896Z  2024-12-18T01:04:56.9955365Z  2024-12-18T01:04:56.9955774Z  2024-12-18T01:04:56.9956175Z  2024-12-18T01:04:56.9956573Z  2024-12-18T01:04:56.9956967Z  2024-12-18T01:04:56.9957350Z  2024-12-18T01:04:56.9957723Z  2024-12-18T01:04:56.9958681Z [19,942 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:56.9959650Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T01:04:56.9960650Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:04:56.9961812Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2024-12-18T01:04:56.9962996Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:04:56.9963986Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T01:04:56.9964777Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2024-12-18T01:04:56.9965769Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:56.9966996Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local ... 2024-12-18T01:04:57.2468548Z 2024-12-18T01:04:57.2469446Z  2024-12-18T01:04:57.2469915Z  2024-12-18T01:04:57.2470316Z  2024-12-18T01:04:57.2470718Z  2024-12-18T01:04:57.2471110Z  2024-12-18T01:04:57.2471502Z  2024-12-18T01:04:57.2471905Z  2024-12-18T01:04:57.2472303Z  2024-12-18T01:04:57.2473223Z [19,943 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:57.2474653Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2024-12-18T01:04:57.2475748Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:04:57.2476960Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2024-12-18T01:04:57.2478152Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:04:57.2479218Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T01:04:57.2479984Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2024-12-18T01:04:57.2480957Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:04:57.2482170Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local ... 2024-12-18T01:04:57.5959667Z 2024-12-18T01:04:57.5960502Z  2024-12-18T01:04:57.5960951Z  2024-12-18T01:04:57.5961318Z  2024-12-18T01:04:57.5961683Z  2024-12-18T01:04:57.5962111Z  2024-12-18T01:04:57.5962497Z  2024-12-18T01:04:57.5962873Z  2024-12-18T01:04:57.5963515Z  2024-12-18T01:04:57.5964483Z [19,943 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:57.5965602Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T01:04:57.5966699Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:04:57.5967918Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2024-12-18T01:04:57.5969303Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:04:57.5970237Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:04:57.5971180Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2024-12-18T01:04:57.5972161Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:04:57.5973347Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local ... 2024-12-18T01:04:57.7962431Z 2024-12-18T01:04:57.7963320Z  2024-12-18T01:04:57.7963819Z  2024-12-18T01:04:57.7964264Z  2024-12-18T01:04:57.7964652Z  2024-12-18T01:04:57.7965023Z  2024-12-18T01:04:57.7965419Z  2024-12-18T01:04:57.7965779Z  2024-12-18T01:04:57.7966161Z  2024-12-18T01:04:57.7967203Z [19,944 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:57.7968245Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2024-12-18T01:04:57.7969306Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2024-12-18T01:04:57.7970502Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2024-12-18T01:04:57.7971608Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:04:57.7972590Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2024-12-18T01:04:57.7973714Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:04:57.7974814Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local 2024-12-18T01:04:57.7975795Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local ... 2024-12-18T01:04:58.7696545Z 2024-12-18T01:04:58.7697370Z  2024-12-18T01:04:58.7697836Z  2024-12-18T01:04:58.7698264Z  2024-12-18T01:04:58.7698667Z  2024-12-18T01:04:58.7699032Z  2024-12-18T01:04:58.7699415Z  2024-12-18T01:04:58.7699795Z  2024-12-18T01:04:58.7700204Z  2024-12-18T01:04:58.7701112Z [19,945 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:58.7702170Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T01:04:58.7703167Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T01:04:58.7704271Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:04:58.7705561Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T01:04:58.7706587Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:04:58.7707791Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 22s local 2024-12-18T01:04:58.7708842Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:58.7709794Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2024-12-18T01:04:58.9970380Z 2024-12-18T01:04:58.9971446Z  2024-12-18T01:04:58.9971931Z  2024-12-18T01:04:58.9972313Z  2024-12-18T01:04:58.9972683Z  2024-12-18T01:04:58.9973058Z  2024-12-18T01:04:58.9973422Z  2024-12-18T01:04:58.9973790Z  2024-12-18T01:04:58.9974180Z  2024-12-18T01:04:58.9975092Z [19,946 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:58.9976204Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2024-12-18T01:04:58.9977439Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T01:04:58.9978900Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:04:58.9979900Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T01:04:58.9980909Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:04:58.9982063Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:58.9983218Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:58.9984029Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2024-12-18T01:04:59.3162394Z 2024-12-18T01:04:59.3163189Z  2024-12-18T01:04:59.3163654Z  2024-12-18T01:04:59.3164031Z  2024-12-18T01:04:59.3164396Z  2024-12-18T01:04:59.3164761Z  2024-12-18T01:04:59.3165141Z  2024-12-18T01:04:59.3165524Z  2024-12-18T01:04:59.3165931Z  2024-12-18T01:04:59.3167023Z [19,947 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:04:59.3168103Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:04:59.3169171Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T01:04:59.3170376Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:04:59.3171396Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2024-12-18T01:04:59.3172398Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:04:59.3173566Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:59.3174607Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:59.3175416Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2024-12-18T01:04:59.5975879Z 2024-12-18T01:04:59.5976862Z  2024-12-18T01:04:59.5977338Z  2024-12-18T01:04:59.5977859Z  2024-12-18T01:04:59.5978217Z  2024-12-18T01:04:59.5978588Z  2024-12-18T01:04:59.5978941Z  2024-12-18T01:04:59.5979271Z  2024-12-18T01:04:59.5979673Z  2024-12-18T01:04:59.5980596Z [19,947 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:59.5981636Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:04:59.5982619Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T01:04:59.5983701Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:04:59.5984733Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T01:04:59.5985719Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:04:59.5986797Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2024-12-18T01:04:59.5987723Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2024-12-18T01:04:59.5988792Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2024-12-18T01:04:59.9979880Z 2024-12-18T01:04:59.9980767Z  2024-12-18T01:04:59.9981262Z  2024-12-18T01:04:59.9981647Z  2024-12-18T01:04:59.9981998Z  2024-12-18T01:04:59.9982371Z  2024-12-18T01:04:59.9982749Z  2024-12-18T01:04:59.9983144Z  2024-12-18T01:04:59.9983790Z  2024-12-18T01:04:59.9984750Z [19,948 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:04:59.9985836Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:04:59.9986835Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2024-12-18T01:04:59.9987953Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:04:59.9988951Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T01:04:59.9989939Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:04:59.9991312Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:04:59.9992299Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T01:04:59.9993035Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2024-12-18T01:05:00.1981847Z 2024-12-18T01:05:00.1982655Z  2024-12-18T01:05:00.1983145Z  2024-12-18T01:05:00.1983550Z  2024-12-18T01:05:00.1983939Z  2024-12-18T01:05:00.1984323Z  2024-12-18T01:05:00.1984723Z  2024-12-18T01:05:00.1985366Z  2024-12-18T01:05:00.1985758Z  2024-12-18T01:05:00.1986571Z [19,949 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:00.1987578Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2024-12-18T01:05:00.1988598Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2024-12-18T01:05:00.1989732Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:05:00.1990853Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T01:05:00.1992021Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:05:00.1993199Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:05:00.1994197Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T01:05:00.1995031Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2024-12-18T01:05:00.5726469Z 2024-12-18T01:05:00.5727331Z  2024-12-18T01:05:00.5727785Z  2024-12-18T01:05:00.5728155Z  2024-12-18T01:05:00.5728525Z  2024-12-18T01:05:00.5728924Z  2024-12-18T01:05:00.5729328Z  2024-12-18T01:05:00.5729691Z  2024-12-18T01:05:00.5730041Z  2024-12-18T01:05:00.5730950Z [19,950 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:00.5732056Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2024-12-18T01:05:00.5733050Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2024-12-18T01:05:00.5734160Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:00.5735136Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2024-12-18T01:05:00.5736110Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:05:00.5737358Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:05:00.5738287Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2024-12-18T01:05:00.5739069Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2024-12-18T01:05:00.7985505Z 2024-12-18T01:05:00.7986353Z  2024-12-18T01:05:00.7986814Z  2024-12-18T01:05:00.7987246Z  2024-12-18T01:05:00.7987631Z  2024-12-18T01:05:00.7987991Z  2024-12-18T01:05:00.7988367Z  2024-12-18T01:05:00.7989101Z  2024-12-18T01:05:00.7989495Z  2024-12-18T01:05:00.7990436Z [19,950 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:00.7991518Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2024-12-18T01:05:00.7992527Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T01:05:00.7993851Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:00.7994858Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2024-12-18T01:05:00.7995891Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:05:00.7996999Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2024-12-18T01:05:00.7997948Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T01:05:00.7998761Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2024-12-18T01:05:01.3859554Z 2024-12-18T01:05:01.3860435Z  2024-12-18T01:05:01.3860891Z  2024-12-18T01:05:01.3861321Z  2024-12-18T01:05:01.3861784Z  2024-12-18T01:05:01.3862465Z  2024-12-18T01:05:01.3862838Z  2024-12-18T01:05:01.3863257Z  2024-12-18T01:05:01.3863609Z  2024-12-18T01:05:01.3864523Z [19,951 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:01.3865572Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T01:05:01.3866795Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T01:05:01.3868108Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:01.3869105Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2024-12-18T01:05:01.3870149Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:05:01.3871294Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:05:01.3872299Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T01:05:01.3873136Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2024-12-18T01:05:01.5992051Z 2024-12-18T01:05:01.5992922Z  2024-12-18T01:05:01.5993378Z  2024-12-18T01:05:01.5993785Z  2024-12-18T01:05:01.5994197Z  2024-12-18T01:05:01.5994601Z  2024-12-18T01:05:01.6005114Z  2024-12-18T01:05:01.6005925Z  2024-12-18T01:05:01.6006307Z  2024-12-18T01:05:01.6007283Z [19,952 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:01.6008433Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T01:05:01.6009535Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T01:05:01.6010725Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:01.6011793Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T01:05:01.6012840Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:05:01.6013968Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:05:01.6014895Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2024-12-18T01:05:01.6015673Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2024-12-18T01:05:01.7994876Z 2024-12-18T01:05:01.7995732Z  2024-12-18T01:05:01.7996156Z  2024-12-18T01:05:01.7996541Z  2024-12-18T01:05:01.7996904Z  2024-12-18T01:05:01.7997254Z  2024-12-18T01:05:01.7997667Z  2024-12-18T01:05:01.7998061Z  2024-12-18T01:05:01.7998434Z  2024-12-18T01:05:01.7999392Z [19,953 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:01.8000467Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T01:05:01.8001499Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T01:05:01.8002971Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:01.8004037Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T01:05:01.8005056Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:05:01.8006249Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2024-12-18T01:05:01.8007417Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T01:05:01.8008264Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2024-12-18T01:05:02.1999370Z 2024-12-18T01:05:02.2000179Z  2024-12-18T01:05:02.2000666Z  2024-12-18T01:05:02.2001055Z  2024-12-18T01:05:02.2001441Z  2024-12-18T01:05:02.2001821Z  2024-12-18T01:05:02.2002211Z  2024-12-18T01:05:02.2002618Z  2024-12-18T01:05:02.2002970Z  2024-12-18T01:05:02.2003872Z [19,954 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:02.2005002Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2024-12-18T01:05:02.2006228Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T01:05:02.2007308Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:02.2008240Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2024-12-18T01:05:02.2009173Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:02.2010487Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:05:02.2011484Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T01:05:02.2012271Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T01:05:02.6002499Z 2024-12-18T01:05:02.6003362Z  2024-12-18T01:05:02.6003814Z  2024-12-18T01:05:02.6004204Z  2024-12-18T01:05:02.6004605Z  2024-12-18T01:05:02.6004975Z  2024-12-18T01:05:02.6005369Z  2024-12-18T01:05:02.6005739Z  2024-12-18T01:05:02.6006157Z  2024-12-18T01:05:02.6007081Z [19,957 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:02.6008141Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:05:02.6009160Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T01:05:02.6010231Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:02.6011208Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T01:05:02.6012197Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:02.6013317Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:05:02.6014311Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2024-12-18T01:05:02.6015087Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T01:05:02.8781712Z 2024-12-18T01:05:02.8782608Z  2024-12-18T01:05:02.8783200Z  2024-12-18T01:05:02.8783573Z  2024-12-18T01:05:02.8783954Z  2024-12-18T01:05:02.8784383Z  2024-12-18T01:05:02.8784783Z  2024-12-18T01:05:02.8785171Z  2024-12-18T01:05:02.8785538Z  2024-12-18T01:05:02.8786406Z [19,958 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:02.8787350Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:05:02.8788377Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T01:05:02.8789487Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:02.8790479Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2024-12-18T01:05:02.8791492Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:02.8792616Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2024-12-18T01:05:02.8793881Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:05:02.8794619Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T01:05:03.1303586Z 2024-12-18T01:05:03.1304441Z  2024-12-18T01:05:03.1304886Z  2024-12-18T01:05:03.1305311Z  2024-12-18T01:05:03.1305691Z  2024-12-18T01:05:03.1306072Z  2024-12-18T01:05:03.1306443Z  2024-12-18T01:05:03.1307135Z  2024-12-18T01:05:03.1307523Z  2024-12-18T01:05:03.1308422Z [19,961 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:03.1309465Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2024-12-18T01:05:03.1310471Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T01:05:03.1311552Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:03.1312595Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:03.1313654Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:05:03.1314816Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:05:03.1315527Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:03.1316179Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2024-12-18T01:05:03.4008960Z 2024-12-18T01:05:03.4009865Z  2024-12-18T01:05:03.4010324Z  2024-12-18T01:05:03.4010725Z  2024-12-18T01:05:03.4011125Z  2024-12-18T01:05:03.4011492Z  2024-12-18T01:05:03.4012147Z  2024-12-18T01:05:03.4012546Z  2024-12-18T01:05:03.4012899Z  2024-12-18T01:05:03.4013725Z [19,962 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:03.4014765Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:05:03.4015789Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T01:05:03.4017088Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:03.4018270Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:03.4019413Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:05:03.4020446Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:05:03.4021279Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:03.4021982Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2024-12-18T01:05:03.6409455Z 2024-12-18T01:05:03.6410387Z  2024-12-18T01:05:03.6410842Z  2024-12-18T01:05:03.6411225Z  2024-12-18T01:05:03.6411612Z  2024-12-18T01:05:03.6411981Z  2024-12-18T01:05:03.6412383Z  2024-12-18T01:05:03.6412746Z  2024-12-18T01:05:03.6413141Z  2024-12-18T01:05:03.6414025Z [19,963 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:03.6414997Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:05:03.6416009Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T01:05:03.6417300Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:03.6418420Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:03.6419579Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2024-12-18T01:05:03.6420581Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2024-12-18T01:05:03.6421295Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:03.6421996Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2024-12-18T01:05:03.9906175Z 2024-12-18T01:05:03.9907006Z  2024-12-18T01:05:03.9907455Z  2024-12-18T01:05:03.9907853Z  2024-12-18T01:05:03.9908225Z  2024-12-18T01:05:03.9908610Z  2024-12-18T01:05:03.9908989Z  2024-12-18T01:05:03.9909715Z  2024-12-18T01:05:03.9910090Z  2024-12-18T01:05:03.9911024Z [19,964 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:03.9912065Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:05:03.9913071Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T01:05:03.9914361Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:03.9915557Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:03.9916768Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:05:03.9917763Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2024-12-18T01:05:03.9918483Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:03.9919165Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2024-12-18T01:05:04.2014960Z 2024-12-18T01:05:04.2015838Z  2024-12-18T01:05:04.2016557Z  2024-12-18T01:05:04.2016929Z  2024-12-18T01:05:04.2017272Z  2024-12-18T01:05:04.2017623Z  2024-12-18T01:05:04.2018285Z  2024-12-18T01:05:04.2018685Z  2024-12-18T01:05:04.2019103Z  2024-12-18T01:05:04.2019988Z [19,965 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:04.2021034Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2024-12-18T01:05:04.2022089Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T01:05:04.2023436Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:04.2024568Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:04.2025743Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:05:04.2026648Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:04.2027324Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:05:04.2028052Z @stablehlo//:stablehlo_passes; 21s local ... 2024-12-18T01:05:04.6019473Z 2024-12-18T01:05:04.6020345Z  2024-12-18T01:05:04.6020816Z  2024-12-18T01:05:04.6021237Z  2024-12-18T01:05:04.6021651Z  2024-12-18T01:05:04.6022046Z  2024-12-18T01:05:04.6022445Z  2024-12-18T01:05:04.6022877Z  2024-12-18T01:05:04.6023277Z  2024-12-18T01:05:04.6024253Z [19,966 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:04.6025418Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T01:05:04.6026547Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T01:05:04.6027781Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:05:04.6028927Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:04.6030150Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:05:04.6031114Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:04.6031829Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:05:04.6032583Z @stablehlo//:stablehlo_passes; 21s local ... 2024-12-18T01:05:04.8022872Z 2024-12-18T01:05:04.8023683Z  2024-12-18T01:05:04.8024170Z  2024-12-18T01:05:04.8024573Z  2024-12-18T01:05:04.8024966Z  2024-12-18T01:05:04.8025368Z  2024-12-18T01:05:04.8025757Z  2024-12-18T01:05:04.8026168Z  2024-12-18T01:05:04.8026572Z  2024-12-18T01:05:04.8027482Z [19,967 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:04.8028502Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T01:05:04.8029541Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T01:05:04.8030729Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:05:04.8032201Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:04.8033421Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2024-12-18T01:05:04.8034344Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:04.8035043Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T01:05:04.8035786Z @stablehlo//:stablehlo_passes; 21s local ... 2024-12-18T01:05:05.2363605Z 2024-12-18T01:05:05.2364426Z  2024-12-18T01:05:05.2364869Z  2024-12-18T01:05:05.2365258Z  2024-12-18T01:05:05.2365658Z  2024-12-18T01:05:05.2366043Z  2024-12-18T01:05:05.2366409Z  2024-12-18T01:05:05.2366814Z  2024-12-18T01:05:05.2367186Z  2024-12-18T01:05:05.2368070Z [19,968 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:05.2369117Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2024-12-18T01:05:05.2370153Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T01:05:05.2371541Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:05:05.2372674Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:05.2373806Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:05:05.2374695Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:05.2375312Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:05:05.2376102Z @stablehlo//:linalg_passes; 20s local ... 2024-12-18T01:05:05.6030025Z 2024-12-18T01:05:05.6030890Z  2024-12-18T01:05:05.6031342Z  2024-12-18T01:05:05.6031730Z  2024-12-18T01:05:05.6032079Z  2024-12-18T01:05:05.6032437Z  2024-12-18T01:05:05.6032803Z  2024-12-18T01:05:05.6033160Z  2024-12-18T01:05:05.6033544Z  2024-12-18T01:05:05.6034440Z [19,968 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:05.6035526Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T01:05:05.6036541Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T01:05:05.6037716Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:05.6038874Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:05.6039978Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2024-12-18T01:05:05.6040854Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:05.6041471Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:05:05.6042082Z @stablehlo//:linalg_passes; 21s local ... 2024-12-18T01:05:06.0033102Z 2024-12-18T01:05:06.0033896Z  2024-12-18T01:05:06.0034333Z  2024-12-18T01:05:06.0034727Z  2024-12-18T01:05:06.0035089Z  2024-12-18T01:05:06.0035478Z  2024-12-18T01:05:06.0035892Z  2024-12-18T01:05:06.0036265Z  2024-12-18T01:05:06.0036608Z  2024-12-18T01:05:06.0037479Z [19,969 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:06.0038528Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2024-12-18T01:05:06.0039558Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T01:05:06.0040729Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:06.0041877Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:06.0042951Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:06.0043774Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:06.0044656Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:05:06.0045291Z @stablehlo//:linalg_passes; 21s local ... 2024-12-18T01:05:06.4037157Z 2024-12-18T01:05:06.4038334Z  2024-12-18T01:05:06.4038810Z  2024-12-18T01:05:06.4039202Z  2024-12-18T01:05:06.4039564Z  2024-12-18T01:05:06.4039972Z  2024-12-18T01:05:06.4040333Z  2024-12-18T01:05:06.4040694Z  2024-12-18T01:05:06.4041124Z  2024-12-18T01:05:06.4042097Z [19,969 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:06.4043322Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2024-12-18T01:05:06.4044649Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T01:05:06.4045800Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:06.4046868Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:05:06.4047949Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2024-12-18T01:05:06.4048863Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:06.4049437Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:05:06.4050124Z @stablehlo//:linalg_passes; 22s local ... 2024-12-18T01:05:07.4044988Z 2024-12-18T01:05:07.4046090Z  2024-12-18T01:05:07.4046620Z  2024-12-18T01:05:07.4047039Z  2024-12-18T01:05:07.4047416Z  2024-12-18T01:05:07.4047818Z  2024-12-18T01:05:07.4048180Z  2024-12-18T01:05:07.4048553Z  2024-12-18T01:05:07.4048925Z  2024-12-18T01:05:07.4049855Z [19,969 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:07.4051141Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T01:05:07.4052196Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T01:05:07.4053353Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:05:07.4054506Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:07.4055637Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:07.4056710Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:07.4057367Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:05:07.4057997Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T01:05:07.6271357Z 2024-12-18T01:05:07.6272199Z  2024-12-18T01:05:07.6272669Z  2024-12-18T01:05:07.6273045Z  2024-12-18T01:05:07.6273464Z  2024-12-18T01:05:07.6273840Z  2024-12-18T01:05:07.6274227Z  2024-12-18T01:05:07.6274624Z  2024-12-18T01:05:07.6275036Z  2024-12-18T01:05:07.6275959Z [19,970 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:07.6277073Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T01:05:07.6278088Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T01:05:07.6279248Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:05:07.6280473Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:07.6281702Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2024-12-18T01:05:07.6282642Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:07.6283282Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:05:07.6283929Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T01:05:08.0047123Z 2024-12-18T01:05:08.0048539Z  2024-12-18T01:05:08.0049291Z  2024-12-18T01:05:08.0050372Z  2024-12-18T01:05:08.0050870Z  2024-12-18T01:05:08.0051307Z  2024-12-18T01:05:08.0051720Z  2024-12-18T01:05:08.0052106Z  2024-12-18T01:05:08.0052487Z  2024-12-18T01:05:08.0053436Z [19,970 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:08.0054544Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T01:05:08.0055955Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T01:05:08.0057320Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:05:08.0058423Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:08.0059612Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:08.0060796Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:08.0061407Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T01:05:08.0062010Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T01:05:08.2050134Z 2024-12-18T01:05:08.2051033Z  2024-12-18T01:05:08.2051526Z  2024-12-18T01:05:08.2051927Z  2024-12-18T01:05:08.2052313Z  2024-12-18T01:05:08.2052726Z  2024-12-18T01:05:08.2053123Z  2024-12-18T01:05:08.2053520Z  2024-12-18T01:05:08.2053905Z  2024-12-18T01:05:08.2054819Z [19,971 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:08.2056204Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2024-12-18T01:05:08.2057402Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T01:05:08.2058544Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:05:08.2059647Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:05:08.2060796Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2024-12-18T01:05:08.2061865Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:08.2062517Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T01:05:08.2063172Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T01:05:09.4059863Z 2024-12-18T01:05:09.4060732Z  2024-12-18T01:05:09.4061227Z  2024-12-18T01:05:09.4061782Z  2024-12-18T01:05:09.4062194Z  2024-12-18T01:05:09.4062583Z  2024-12-18T01:05:09.4063008Z  2024-12-18T01:05:09.4063429Z  2024-12-18T01:05:09.4063829Z  2024-12-18T01:05:09.4064772Z [19,971 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:09.4065866Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2024-12-18T01:05:09.4066849Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2024-12-18T01:05:09.4067928Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2024-12-18T01:05:09.4069052Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:05:09.4070186Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:09.4071048Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:09.4071649Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T01:05:09.4072293Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T01:05:09.6063075Z 2024-12-18T01:05:09.6063898Z  2024-12-18T01:05:09.6064399Z  2024-12-18T01:05:09.6064769Z  2024-12-18T01:05:09.6065169Z  2024-12-18T01:05:09.6065550Z  2024-12-18T01:05:09.6065920Z  2024-12-18T01:05:09.6066302Z  2024-12-18T01:05:09.6066688Z  2024-12-18T01:05:09.6067600Z [19,972 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:09.6068643Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2024-12-18T01:05:09.6069686Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2024-12-18T01:05:09.6070801Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2024-12-18T01:05:09.6071904Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:05:09.6072987Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2024-12-18T01:05:09.6073834Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:09.6074437Z @stablehlo//:stablehlo_passes; 26s local 2024-12-18T01:05:09.6075373Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T01:05:10.2902294Z 2024-12-18T01:05:10.2903194Z  2024-12-18T01:05:10.2903672Z  2024-12-18T01:05:10.2904074Z  2024-12-18T01:05:10.2904471Z  2024-12-18T01:05:10.2904869Z  2024-12-18T01:05:10.2905252Z  2024-12-18T01:05:10.2905631Z  2024-12-18T01:05:10.2906029Z  2024-12-18T01:05:10.2907260Z [19,973 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:10.2908400Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T01:05:10.2909448Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2024-12-18T01:05:10.2910654Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2024-12-18T01:05:10.2911823Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2024-12-18T01:05:10.2912978Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:05:10.2913884Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:10.2914670Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T01:05:10.2915322Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T01:05:10.6070199Z 2024-12-18T01:05:10.6071017Z  2024-12-18T01:05:10.6071432Z  2024-12-18T01:05:10.6071778Z  2024-12-18T01:05:10.6072160Z  2024-12-18T01:05:10.6072481Z  2024-12-18T01:05:10.6072831Z  2024-12-18T01:05:10.6073188Z  2024-12-18T01:05:10.6073820Z  2024-12-18T01:05:10.6074661Z [19,973 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:10.6075604Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2024-12-18T01:05:10.6076604Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2024-12-18T01:05:10.6077615Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2024-12-18T01:05:10.6078603Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2024-12-18T01:05:10.6079578Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2024-12-18T01:05:10.6080327Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:10.6080893Z @stablehlo//:stablehlo_passes; 27s local 2024-12-18T01:05:10.6081483Z @stablehlo//:linalg_passes; 26s local ... 2024-12-18T01:05:11.4771837Z 2024-12-18T01:05:11.4772702Z  2024-12-18T01:05:11.4773155Z  2024-12-18T01:05:11.4773563Z  2024-12-18T01:05:11.4773958Z  2024-12-18T01:05:11.4774337Z  2024-12-18T01:05:11.4774710Z  2024-12-18T01:05:11.4775056Z  2024-12-18T01:05:11.4775440Z  2024-12-18T01:05:11.4776473Z [19,974 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:11.4777524Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T01:05:11.4778567Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2024-12-18T01:05:11.4779717Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2024-12-18T01:05:11.4780838Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2024-12-18T01:05:11.4781933Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:11.4782749Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:11.4783369Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T01:05:11.4784031Z @stablehlo//:linalg_passes; 27s local ... 2024-12-18T01:05:11.8078574Z 2024-12-18T01:05:11.8079442Z  2024-12-18T01:05:11.8079908Z  2024-12-18T01:05:11.8080297Z  2024-12-18T01:05:11.8080673Z  2024-12-18T01:05:11.8081072Z  2024-12-18T01:05:11.8081451Z  2024-12-18T01:05:11.8081818Z  2024-12-18T01:05:11.8082193Z  2024-12-18T01:05:11.8083104Z [19,975 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:11.8084496Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2024-12-18T01:05:11.8085552Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T01:05:11.8086687Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T01:05:11.8087819Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2024-12-18T01:05:11.8089090Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2024-12-18T01:05:11.8089951Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:11.8090560Z @stablehlo//:stablehlo_passes; 28s local 2024-12-18T01:05:11.8091195Z @stablehlo//:linalg_passes; 27s local ... 2024-12-18T01:05:12.3274390Z 2024-12-18T01:05:12.3275238Z  2024-12-18T01:05:12.3275704Z  2024-12-18T01:05:12.3276103Z  2024-12-18T01:05:12.3276475Z  2024-12-18T01:05:12.3276851Z  2024-12-18T01:05:12.3277258Z  2024-12-18T01:05:12.3277633Z  2024-12-18T01:05:12.3278006Z  2024-12-18T01:05:12.3279143Z [19,976 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:12.3280316Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T01:05:12.3281362Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T01:05:12.3282559Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T01:05:12.3283824Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2024-12-18T01:05:12.3284898Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:05:12.3285777Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:12.3286386Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T01:05:12.3286975Z @stablehlo//:linalg_passes; 27s local ... 2024-12-18T01:05:12.6082553Z 2024-12-18T01:05:12.6083431Z  2024-12-18T01:05:12.6083954Z  2024-12-18T01:05:12.6084310Z  2024-12-18T01:05:12.6084647Z  2024-12-18T01:05:12.6085024Z  2024-12-18T01:05:12.6085422Z  2024-12-18T01:05:12.6085810Z  2024-12-18T01:05:12.6086182Z  2024-12-18T01:05:12.6087093Z [19,976 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:12.6088137Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T01:05:12.6089127Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T01:05:12.6090223Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2024-12-18T01:05:12.6091385Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2024-12-18T01:05:12.6092506Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:05:12.6093398Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:12.6094033Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T01:05:12.6094702Z @stablehlo//:linalg_passes; 28s local ... 2024-12-18T01:05:12.8746322Z 2024-12-18T01:05:12.8747202Z  2024-12-18T01:05:12.8747673Z  2024-12-18T01:05:12.8748067Z  2024-12-18T01:05:12.8748460Z  2024-12-18T01:05:12.8748827Z  2024-12-18T01:05:12.8749203Z  2024-12-18T01:05:12.8749571Z  2024-12-18T01:05:12.8749957Z  2024-12-18T01:05:12.8750897Z [19,978 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:12.8751964Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T01:05:12.8753020Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T01:05:12.8754202Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2024-12-18T01:05:12.8755380Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2024-12-18T01:05:12.8756534Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2024-12-18T01:05:12.8757749Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:12.8758387Z @stablehlo//:stablehlo_passes; 29s local 2024-12-18T01:05:12.8758988Z @stablehlo//:linalg_passes; 28s local ... 2024-12-18T01:05:13.2089363Z 2024-12-18T01:05:13.2090167Z  2024-12-18T01:05:13.2090807Z  2024-12-18T01:05:13.2091212Z  2024-12-18T01:05:13.2091896Z  2024-12-18T01:05:13.2092239Z  2024-12-18T01:05:13.2092586Z  2024-12-18T01:05:13.2092935Z  2024-12-18T01:05:13.2093282Z  2024-12-18T01:05:13.2094184Z [19,978 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:13.2095302Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2024-12-18T01:05:13.2096314Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T01:05:13.2097595Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2024-12-18T01:05:13.2098812Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T01:05:13.2100228Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2024-12-18T01:05:13.2101127Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:13.2101740Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T01:05:13.2102378Z @stablehlo//:linalg_passes; 28s local ... 2024-12-18T01:05:13.7021348Z 2024-12-18T01:05:13.7022231Z  2024-12-18T01:05:13.7022697Z  2024-12-18T01:05:13.7023079Z  2024-12-18T01:05:13.7023703Z  2024-12-18T01:05:13.7024080Z  2024-12-18T01:05:13.7024437Z  2024-12-18T01:05:13.7024824Z  2024-12-18T01:05:13.7025199Z  2024-12-18T01:05:13.7026104Z [19,979 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:13.7027126Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T01:05:13.7028173Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T01:05:13.7029327Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T01:05:13.7030459Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T01:05:13.7031337Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:13.7031949Z @stablehlo//:stablehlo_passes; 30s local 2024-12-18T01:05:13.7032567Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:13.7033165Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2024-12-18T01:05:14.0096205Z 2024-12-18T01:05:14.0097204Z  2024-12-18T01:05:14.0097685Z  2024-12-18T01:05:14.0098094Z  2024-12-18T01:05:14.0098476Z  2024-12-18T01:05:14.0098871Z  2024-12-18T01:05:14.0099192Z  2024-12-18T01:05:14.0099586Z  2024-12-18T01:05:14.0099981Z  2024-12-18T01:05:14.0100790Z [19,979 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:14.0101907Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2024-12-18T01:05:14.0102908Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T01:05:14.0104014Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T01:05:14.0105128Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2024-12-18T01:05:14.0105972Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:14.0106587Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T01:05:14.0107191Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:14.0107885Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2024-12-18T01:05:14.8261007Z 2024-12-18T01:05:14.8261986Z  2024-12-18T01:05:14.8262462Z  2024-12-18T01:05:14.8262862Z  2024-12-18T01:05:14.8263272Z  2024-12-18T01:05:14.8263680Z  2024-12-18T01:05:14.8264092Z  2024-12-18T01:05:14.8264464Z  2024-12-18T01:05:14.8265179Z  2024-12-18T01:05:14.8266148Z [19,980 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:14.8267301Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T01:05:14.8268375Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T01:05:14.8269570Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T01:05:14.8270878Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2024-12-18T01:05:14.8271778Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:14.8272402Z @stablehlo//:stablehlo_passes; 31s local 2024-12-18T01:05:14.8273026Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:14.8273673Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2024-12-18T01:05:15.0528574Z 2024-12-18T01:05:15.0529495Z  2024-12-18T01:05:15.0529962Z  2024-12-18T01:05:15.0530372Z  2024-12-18T01:05:15.0530817Z  2024-12-18T01:05:15.0531231Z  2024-12-18T01:05:15.0531602Z  2024-12-18T01:05:15.0532003Z  2024-12-18T01:05:15.0532639Z  2024-12-18T01:05:15.0533614Z [19,982 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:15.0534725Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2024-12-18T01:05:15.0535740Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T01:05:15.0537229Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T01:05:15.0538359Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T01:05:15.0539260Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:15.0539892Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T01:05:15.0540499Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:15.0541183Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2024-12-18T01:05:15.4105800Z 2024-12-18T01:05:15.4106647Z  2024-12-18T01:05:15.4107088Z  2024-12-18T01:05:15.4107473Z  2024-12-18T01:05:15.4107900Z  2024-12-18T01:05:15.4108301Z  2024-12-18T01:05:15.4108700Z  2024-12-18T01:05:15.4109079Z  2024-12-18T01:05:15.4109468Z  2024-12-18T01:05:15.4110426Z [19,983 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:15.4111557Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2024-12-18T01:05:15.4112504Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T01:05:15.4113637Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T01:05:15.4114756Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T01:05:15.4115620Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:15.4116250Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T01:05:15.4116892Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:15.4117610Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2024-12-18T01:05:15.8110567Z 2024-12-18T01:05:15.8111505Z  2024-12-18T01:05:15.8111987Z  2024-12-18T01:05:15.8112351Z  2024-12-18T01:05:15.8112702Z  2024-12-18T01:05:15.8113022Z  2024-12-18T01:05:15.8113349Z  2024-12-18T01:05:15.8113703Z  2024-12-18T01:05:15.8114067Z  2024-12-18T01:05:15.8115002Z [19,984 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:15.8116081Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2024-12-18T01:05:15.8117283Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T01:05:15.8118419Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T01:05:15.8119556Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T01:05:15.8120661Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:15.8121273Z @stablehlo//:stablehlo_passes; 32s local 2024-12-18T01:05:15.8121895Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:15.8122577Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2024-12-18T01:05:16.0111354Z 2024-12-18T01:05:16.0112258Z  2024-12-18T01:05:16.0112694Z  2024-12-18T01:05:16.0113061Z  2024-12-18T01:05:16.0113773Z  2024-12-18T01:05:16.0114159Z  2024-12-18T01:05:16.0114543Z  2024-12-18T01:05:16.0114928Z  2024-12-18T01:05:16.0115315Z  2024-12-18T01:05:16.0116258Z [19,986 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:16.0117159Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2024-12-18T01:05:16.0118009Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T01:05:16.0118929Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T01:05:16.0119897Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2024-12-18T01:05:16.0120954Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:16.0121526Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:16.0122160Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T01:05:16.0123065Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local ... 2024-12-18T01:05:16.4115679Z 2024-12-18T01:05:16.4116678Z  2024-12-18T01:05:16.4117154Z  2024-12-18T01:05:16.4117771Z  2024-12-18T01:05:16.4118193Z  2024-12-18T01:05:16.4118607Z  2024-12-18T01:05:16.4119015Z  2024-12-18T01:05:16.4119419Z  2024-12-18T01:05:16.4119832Z  2024-12-18T01:05:16.4120795Z [19,987 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:16.4121946Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2024-12-18T01:05:16.4123060Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T01:05:16.4124284Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T01:05:16.4125504Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T01:05:16.4126450Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:16.4127157Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:16.4128158Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T01:05:16.4129283Z @stablehlo//:stablehlo_passes; 21s local ... 2024-12-18T01:05:16.8121972Z 2024-12-18T01:05:16.8122858Z  2024-12-18T01:05:16.8123347Z  2024-12-18T01:05:16.8123769Z  2024-12-18T01:05:16.8124269Z  2024-12-18T01:05:16.8124776Z  2024-12-18T01:05:16.8125236Z  2024-12-18T01:05:16.8125746Z  2024-12-18T01:05:16.8126223Z  2024-12-18T01:05:16.8127229Z [19,987 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:16.8128355Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2024-12-18T01:05:16.8129367Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2024-12-18T01:05:16.8130481Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T01:05:16.8131591Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2024-12-18T01:05:16.8132465Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:16.8133167Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:16.8134070Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T01:05:16.8134935Z @stablehlo//:stablehlo_passes; 21s local ... 2024-12-18T01:05:17.1131310Z 2024-12-18T01:05:17.1132190Z  2024-12-18T01:05:17.1132700Z  2024-12-18T01:05:17.1133103Z  2024-12-18T01:05:17.1133485Z  2024-12-18T01:05:17.1134234Z  2024-12-18T01:05:17.1134616Z  2024-12-18T01:05:17.1134979Z  2024-12-18T01:05:17.1135328Z  2024-12-18T01:05:17.1136252Z [19,990 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:17.1137398Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2024-12-18T01:05:17.1138442Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T01:05:17.1139714Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T01:05:17.1140602Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:17.1141251Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:17.1141901Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:05:17.1142806Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2024-12-18T01:05:17.1143999Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local ... 2024-12-18T01:05:17.3622830Z 2024-12-18T01:05:17.3623892Z  2024-12-18T01:05:17.3624335Z  2024-12-18T01:05:17.3624703Z  2024-12-18T01:05:17.3625386Z  2024-12-18T01:05:17.3625796Z  2024-12-18T01:05:17.3626144Z  2024-12-18T01:05:17.3626527Z  2024-12-18T01:05:17.3626904Z  2024-12-18T01:05:17.3627825Z [19,991 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:17.3628983Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T01:05:17.3630323Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T01:05:17.3631157Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:17.3631820Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:17.3632471Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:05:17.3633344Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2024-12-18T01:05:17.3634410Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2024-12-18T01:05:17.3635490Z Compiling stablehlo/transforms/StablehloRefineShapes.cpp; 17s local ... 2024-12-18T01:05:17.6127709Z 2024-12-18T01:05:17.6128589Z  2024-12-18T01:05:17.6129067Z  2024-12-18T01:05:17.6129462Z  2024-12-18T01:05:17.6129840Z  2024-12-18T01:05:17.6130348Z  2024-12-18T01:05:17.6130690Z  2024-12-18T01:05:17.6131092Z  2024-12-18T01:05:17.6131462Z  2024-12-18T01:05:17.6132394Z [19,992 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:17.6133566Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T01:05:17.6134680Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T01:05:17.6135556Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:17.6136210Z @llvm-project//mlir:LinalgTransforms; 28s local 2024-12-18T01:05:17.6137032Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:05:17.6137940Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2024-12-18T01:05:17.6139081Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2024-12-18T01:05:17.6140142Z Compiling stablehlo/transforms/StablehloRefineShapes.cpp; 17s local ... 2024-12-18T01:05:17.8324015Z 2024-12-18T01:05:17.8325180Z  2024-12-18T01:05:17.8325951Z  2024-12-18T01:05:17.8326981Z  2024-12-18T01:05:17.8327434Z  2024-12-18T01:05:17.8327845Z  2024-12-18T01:05:17.8328258Z  2024-12-18T01:05:17.8328669Z  2024-12-18T01:05:17.8329083Z  2024-12-18T01:05:17.8330026Z [19,993 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:17.8331397Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T01:05:17.8332518Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2024-12-18T01:05:17.8333727Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:17.8334388Z @llvm-project//mlir:LinalgTransforms; 28s local 2024-12-18T01:05:17.8335048Z @stablehlo//:stablehlo_passes; 22s local 2024-12-18T01:05:17.8335973Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2024-12-18T01:05:17.8337355Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2024-12-18T01:05:17.8338766Z Compiling stablehlo/transforms/StablehloRefineShapes.cpp; 17s local ... 2024-12-18T01:05:18.2131531Z 2024-12-18T01:05:18.2132521Z  2024-12-18T01:05:18.2133044Z  2024-12-18T01:05:18.2133408Z  2024-12-18T01:05:18.2133798Z  2024-12-18T01:05:18.2134191Z  2024-12-18T01:05:18.2134584Z  2024-12-18T01:05:18.2134976Z  2024-12-18T01:05:18.2135343Z  2024-12-18T01:05:18.2136253Z [19,995 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:18.2137624Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T01:05:18.2139146Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T01:05:18.2140039Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:18.2140692Z @llvm-project//mlir:LinalgTransforms; 28s local 2024-12-18T01:05:18.2141368Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:05:18.2142226Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2024-12-18T01:05:18.2143500Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2024-12-18T01:05:18.2144771Z Compiling stablehlo/transforms/StablehloRefineShapes.cpp; 18s local ... 2024-12-18T01:05:18.5666562Z 2024-12-18T01:05:18.5667827Z  2024-12-18T01:05:18.5668261Z  2024-12-18T01:05:18.5668644Z  2024-12-18T01:05:18.5669027Z  2024-12-18T01:05:18.5669433Z  2024-12-18T01:05:18.5669821Z  2024-12-18T01:05:18.5670212Z  2024-12-18T01:05:18.5670582Z  2024-12-18T01:05:18.5671501Z [19,996 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:18.5672660Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T01:05:18.5673746Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T01:05:18.5674645Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:18.5675318Z @llvm-project//mlir:LinalgTransforms; 29s local 2024-12-18T01:05:18.5676060Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:05:18.5676974Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2024-12-18T01:05:18.5678128Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2024-12-18T01:05:18.5679217Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 17s local ... 2024-12-18T01:05:18.7848993Z 2024-12-18T01:05:18.7849895Z  2024-12-18T01:05:18.7850398Z  2024-12-18T01:05:18.7850833Z  2024-12-18T01:05:18.7851211Z  2024-12-18T01:05:18.7851617Z  2024-12-18T01:05:18.7862667Z  2024-12-18T01:05:18.7863120Z  2024-12-18T01:05:18.7863499Z  2024-12-18T01:05:18.7864387Z [19,997 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:18.7865566Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T01:05:18.7866630Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T01:05:18.7867482Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:18.7868253Z @llvm-project//mlir:LinalgTransforms; 29s local 2024-12-18T01:05:18.7868847Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:05:18.7869689Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2024-12-18T01:05:18.7870738Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 18s local 2024-12-18T01:05:18.7871961Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:19.0139403Z 2024-12-18T01:05:19.0140292Z  2024-12-18T01:05:19.0140748Z  2024-12-18T01:05:19.0141102Z  2024-12-18T01:05:19.0141490Z  2024-12-18T01:05:19.0141892Z  2024-12-18T01:05:19.0142272Z  2024-12-18T01:05:19.0142604Z  2024-12-18T01:05:19.0143014Z  2024-12-18T01:05:19.0144675Z [19,997 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:19.0145849Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T01:05:19.0146927Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2024-12-18T01:05:19.0147788Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:19.0148441Z @llvm-project//mlir:LinalgTransforms; 29s local 2024-12-18T01:05:19.0149116Z @stablehlo//:stablehlo_passes; 23s local 2024-12-18T01:05:19.0149983Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2024-12-18T01:05:19.0151495Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 18s local 2024-12-18T01:05:19.0152392Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:19.2142851Z 2024-12-18T01:05:19.2143772Z  2024-12-18T01:05:19.2144574Z  2024-12-18T01:05:19.2144957Z  2024-12-18T01:05:19.2145320Z  2024-12-18T01:05:19.2145737Z  2024-12-18T01:05:19.2146127Z  2024-12-18T01:05:19.2146504Z  2024-12-18T01:05:19.2146888Z  2024-12-18T01:05:19.2148088Z [19,998 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:19.2149271Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T01:05:19.2150367Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T01:05:19.2151215Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:19.2151862Z @llvm-project//mlir:LinalgTransforms; 29s local 2024-12-18T01:05:19.2152512Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:05:19.2153359Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2024-12-18T01:05:19.2154398Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 18s local 2024-12-18T01:05:19.2155314Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:19.6146592Z 2024-12-18T01:05:19.6147477Z  2024-12-18T01:05:19.6147972Z  2024-12-18T01:05:19.6148381Z  2024-12-18T01:05:19.6148805Z  2024-12-18T01:05:19.6149246Z  2024-12-18T01:05:19.6149693Z  2024-12-18T01:05:19.6150075Z  2024-12-18T01:05:19.6150513Z  2024-12-18T01:05:19.6151452Z [19,999 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:19.6152638Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 49s local 2024-12-18T01:05:19.6153791Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T01:05:19.6154790Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:19.6155469Z @llvm-project//mlir:LinalgTransforms; 30s local 2024-12-18T01:05:19.6156175Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:05:19.6157020Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2024-12-18T01:05:19.6158136Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 19s local 2024-12-18T01:05:19.6159038Z @stablehlo//:linalg_passes; 18s local ... 2024-12-18T01:05:20.0150962Z 2024-12-18T01:05:20.0151853Z  2024-12-18T01:05:20.0152335Z  2024-12-18T01:05:20.0152754Z  2024-12-18T01:05:20.0153158Z  2024-12-18T01:05:20.0153538Z  2024-12-18T01:05:20.0153944Z  2024-12-18T01:05:20.0154342Z  2024-12-18T01:05:20.0154729Z  2024-12-18T01:05:20.0155646Z [20,002 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:20.0157242Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2024-12-18T01:05:20.0158233Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:20.0158928Z @llvm-project//mlir:LinalgTransforms; 30s local 2024-12-18T01:05:20.0159651Z @stablehlo//:stablehlo_passes; 24s local 2024-12-18T01:05:20.0160607Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2024-12-18T01:05:20.0162051Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 19s local 2024-12-18T01:05:20.0162913Z @stablehlo//:linalg_passes; 18s local 2024-12-18T01:05:20.0163618Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:20.4149590Z 2024-12-18T01:05:20.4150470Z  2024-12-18T01:05:20.4150935Z  2024-12-18T01:05:20.4151337Z  2024-12-18T01:05:20.4151736Z  2024-12-18T01:05:20.4152111Z  2024-12-18T01:05:20.4152496Z  2024-12-18T01:05:20.4152900Z  2024-12-18T01:05:20.4153322Z  2024-12-18T01:05:20.4154268Z [20,003 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:20.4155754Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T01:05:20.4156670Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:20.4157353Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T01:05:20.4158071Z @stablehlo//:stablehlo_passes; 25s local 2024-12-18T01:05:20.4158999Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2024-12-18T01:05:20.4160314Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 19s local 2024-12-18T01:05:20.4161232Z @stablehlo//:linalg_passes; 18s local 2024-12-18T01:05:20.4161968Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2024-12-18T01:05:20.6156489Z 2024-12-18T01:05:20.6157308Z  2024-12-18T01:05:20.6157762Z  2024-12-18T01:05:20.6158161Z  2024-12-18T01:05:20.6158555Z  2024-12-18T01:05:20.6158968Z  2024-12-18T01:05:20.6159369Z  2024-12-18T01:05:20.6159765Z  2024-12-18T01:05:20.6160158Z  2024-12-18T01:05:20.6161095Z [20,004 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:20.6162489Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2024-12-18T01:05:20.6163412Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:20.6164119Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T01:05:20.6165108Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2024-12-18T01:05:20.6166258Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 20s local 2024-12-18T01:05:20.6167133Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:05:20.6167821Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T01:05:20.6168733Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 17s local ... 2024-12-18T01:05:21.3162225Z 2024-12-18T01:05:21.3163132Z  2024-12-18T01:05:21.3163597Z  2024-12-18T01:05:21.3163942Z  2024-12-18T01:05:21.3164310Z  2024-12-18T01:05:21.3164655Z  2024-12-18T01:05:21.3165004Z  2024-12-18T01:05:21.3165324Z  2024-12-18T01:05:21.3165661Z  2024-12-18T01:05:21.3166474Z [20,005 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:21.3167242Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:21.3167823Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T01:05:21.3168619Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T01:05:21.3169539Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 20s local 2024-12-18T01:05:21.3170257Z @stablehlo//:linalg_passes; 19s local 2024-12-18T01:05:21.3170827Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T01:05:21.3171553Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 18s local 2024-12-18T01:05:21.3172686Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 18s local ... 2024-12-18T01:05:21.5831828Z 2024-12-18T01:05:21.5832648Z  2024-12-18T01:05:21.5833096Z  2024-12-18T01:05:21.5833471Z  2024-12-18T01:05:21.5833832Z  2024-12-18T01:05:21.5834187Z  2024-12-18T01:05:21.5834526Z  2024-12-18T01:05:21.5834905Z  2024-12-18T01:05:21.5835559Z  2024-12-18T01:05:21.5836418Z [20,006 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:21.5837298Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:21.5837912Z @llvm-project//mlir:LinalgTransforms; 32s local 2024-12-18T01:05:21.5838892Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2024-12-18T01:05:21.5839763Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local 2024-12-18T01:05:21.5840434Z @stablehlo//:linalg_passes; 20s local 2024-12-18T01:05:21.5841069Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 18s local 2024-12-18T01:05:21.5841960Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 18s local 2024-12-18T01:05:21.5842793Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 18s local ... 2024-12-18T01:05:21.8163655Z 2024-12-18T01:05:21.8164548Z  2024-12-18T01:05:21.8164933Z  2024-12-18T01:05:21.8165313Z  2024-12-18T01:05:21.8165720Z  2024-12-18T01:05:21.8166067Z  2024-12-18T01:05:21.8166446Z  2024-12-18T01:05:21.8166818Z  2024-12-18T01:05:21.8167520Z  2024-12-18T01:05:21.8168477Z [20,006 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:21.8169403Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:21.8170086Z @llvm-project//mlir:LinalgTransforms; 32s local 2024-12-18T01:05:21.8171003Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T01:05:21.8172080Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local 2024-12-18T01:05:21.8172909Z @stablehlo//:linalg_passes; 20s local 2024-12-18T01:05:21.8173750Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 18s local 2024-12-18T01:05:21.8174763Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 18s local 2024-12-18T01:05:21.8175731Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 18s local ... 2024-12-18T01:05:22.5181030Z 2024-12-18T01:05:22.5181875Z  2024-12-18T01:05:22.5182343Z  2024-12-18T01:05:22.5182733Z  2024-12-18T01:05:22.5183157Z  2024-12-18T01:05:22.5183554Z  2024-12-18T01:05:22.5183939Z  2024-12-18T01:05:22.5184367Z  2024-12-18T01:05:22.5184744Z  2024-12-18T01:05:22.5185604Z [20,007 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:22.5186661Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:22.5187488Z @llvm-project//mlir:LinalgTransforms; 33s local 2024-12-18T01:05:22.5188542Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2024-12-18T01:05:22.5189594Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local 2024-12-18T01:05:22.5190461Z @stablehlo//:linalg_passes; 20s local 2024-12-18T01:05:22.5191245Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 19s local 2024-12-18T01:05:22.5192308Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 19s local 2024-12-18T01:05:22.5193256Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 19s local ... 2024-12-18T01:05:22.8171600Z 2024-12-18T01:05:22.8172460Z  2024-12-18T01:05:22.8172970Z  2024-12-18T01:05:22.8173450Z  2024-12-18T01:05:22.8173879Z  2024-12-18T01:05:22.8174260Z  2024-12-18T01:05:22.8174605Z  2024-12-18T01:05:22.8174971Z  2024-12-18T01:05:22.8175363Z  2024-12-18T01:05:22.8176260Z [20,007 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:22.8177619Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:22.8178256Z @llvm-project//mlir:LinalgTransforms; 33s local 2024-12-18T01:05:22.8179328Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2024-12-18T01:05:22.8180446Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2024-12-18T01:05:22.8181415Z @stablehlo//:linalg_passes; 21s local 2024-12-18T01:05:22.8182359Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 19s local 2024-12-18T01:05:22.8183325Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 19s local 2024-12-18T01:05:22.8184202Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 19s local ... 2024-12-18T01:05:23.4248623Z 2024-12-18T01:05:23.4249514Z  2024-12-18T01:05:23.4249945Z  2024-12-18T01:05:23.4250329Z  2024-12-18T01:05:23.4250682Z  2024-12-18T01:05:23.4251228Z  2024-12-18T01:05:23.4251596Z  2024-12-18T01:05:23.4252007Z  2024-12-18T01:05:23.4252368Z  2024-12-18T01:05:23.4253536Z [20,008 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:23.4254421Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:23.4255068Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T01:05:23.4255964Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2024-12-18T01:05:23.4257155Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2024-12-18T01:05:23.4258094Z @stablehlo//:linalg_passes; 21s local 2024-12-18T01:05:23.4258843Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 20s local 2024-12-18T01:05:23.4259737Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 20s local 2024-12-18T01:05:23.4260621Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 20s local ... 2024-12-18T01:05:23.8178096Z 2024-12-18T01:05:23.8178953Z  2024-12-18T01:05:23.8179439Z  2024-12-18T01:05:23.8179892Z  2024-12-18T01:05:23.8180306Z  2024-12-18T01:05:23.8180710Z  2024-12-18T01:05:23.8181060Z  2024-12-18T01:05:23.8181443Z  2024-12-18T01:05:23.8181882Z  2024-12-18T01:05:23.8182821Z [20,008 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:23.8183775Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:23.8184438Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T01:05:23.8185396Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:05:23.8186508Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2024-12-18T01:05:23.8187347Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:05:23.8188110Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 20s local 2024-12-18T01:05:23.8189044Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 20s local 2024-12-18T01:05:23.8189985Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 20s local ... 2024-12-18T01:05:24.0180901Z 2024-12-18T01:05:24.0181782Z  2024-12-18T01:05:24.0182253Z  2024-12-18T01:05:24.0182662Z  2024-12-18T01:05:24.0183036Z  2024-12-18T01:05:24.0183446Z  2024-12-18T01:05:24.0183833Z  2024-12-18T01:05:24.0184194Z  2024-12-18T01:05:24.0184572Z  2024-12-18T01:05:24.0185491Z [20,009 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:24.0186355Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:24.0186994Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T01:05:24.0187898Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:05:24.0188967Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2024-12-18T01:05:24.0189787Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:05:24.0190512Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 21s local 2024-12-18T01:05:24.0191800Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 21s local 2024-12-18T01:05:24.0192693Z Compiling xla/python/pjrt_ifrt/pjrt_device.cc; 20s local ... 2024-12-18T01:05:24.2692962Z 2024-12-18T01:05:24.2693782Z  2024-12-18T01:05:24.2694192Z  2024-12-18T01:05:24.2694548Z  2024-12-18T01:05:24.2694895Z  2024-12-18T01:05:24.2695236Z  2024-12-18T01:05:24.2695851Z  2024-12-18T01:05:24.2696197Z  2024-12-18T01:05:24.2696685Z  2024-12-18T01:05:24.2697534Z [20,010 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:24.2698348Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:24.2699112Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T01:05:24.2699925Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:05:24.2700894Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2024-12-18T01:05:24.2701648Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:05:24.2702477Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 21s local 2024-12-18T01:05:24.2703284Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 21s local 2024-12-18T01:05:24.2703942Z @stablehlo//:linalg_passes; 20s local ... 2024-12-18T01:05:24.6186069Z 2024-12-18T01:05:24.6186917Z  2024-12-18T01:05:24.6187432Z  2024-12-18T01:05:24.6187841Z  2024-12-18T01:05:24.6188211Z  2024-12-18T01:05:24.6188594Z  2024-12-18T01:05:24.6188999Z  2024-12-18T01:05:24.6189656Z  2024-12-18T01:05:24.6190097Z  2024-12-18T01:05:24.6191086Z [20,011 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:24.6192038Z @stablehlo//:linalg_passes; 40s local 2024-12-18T01:05:24.6192754Z @llvm-project//mlir:LinalgTransforms; 35s local 2024-12-18T01:05:24.6193538Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2024-12-18T01:05:24.6194518Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2024-12-18T01:05:24.6195308Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:05:24.6196023Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 21s local 2024-12-18T01:05:24.6196951Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 21s local 2024-12-18T01:05:24.6197751Z @stablehlo//:linalg_passes; 21s local ... 2024-12-18T01:05:25.5592136Z 2024-12-18T01:05:25.5593067Z  2024-12-18T01:05:25.5593553Z  2024-12-18T01:05:25.5593983Z  2024-12-18T01:05:25.5594426Z  2024-12-18T01:05:25.5594909Z  2024-12-18T01:05:25.5595292Z  2024-12-18T01:05:25.5595712Z  2024-12-18T01:05:25.5596087Z  2024-12-18T01:05:25.5596962Z [20,012 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:25.5597835Z @stablehlo//:linalg_passes; 41s local 2024-12-18T01:05:25.5598500Z @llvm-project//mlir:LinalgTransforms; 36s local 2024-12-18T01:05:25.5599408Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2024-12-18T01:05:25.5600377Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2024-12-18T01:05:25.5601102Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:05:25.5601846Z Compiling xla/python/pjrt_ifrt/pjrt_host_callback.cc; 22s local 2024-12-18T01:05:25.5602778Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 22s local 2024-12-18T01:05:25.5603536Z @stablehlo//:linalg_passes; 22s local ... 2024-12-18T01:05:25.8194823Z 2024-12-18T01:05:25.8195710Z  2024-12-18T01:05:25.8196154Z  2024-12-18T01:05:25.8196517Z  2024-12-18T01:05:25.8196864Z  2024-12-18T01:05:25.8197256Z  2024-12-18T01:05:25.8197614Z  2024-12-18T01:05:25.8197964Z  2024-12-18T01:05:25.8198356Z  2024-12-18T01:05:25.8199284Z [20,014 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:25.8200427Z @stablehlo//:linalg_passes; 41s local 2024-12-18T01:05:25.8201069Z @llvm-project//mlir:LinalgTransforms; 36s local 2024-12-18T01:05:25.8201958Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T01:05:25.8203051Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2024-12-18T01:05:25.8206078Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:05:25.8206737Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 22s local 2024-12-18T01:05:25.8207559Z @stablehlo//:linalg_passes; 22s local 2024-12-18T01:05:25.8208167Z @stablehlo//:linalg_passes; 22s local ... 2024-12-18T01:05:26.3066702Z 2024-12-18T01:05:26.3067518Z  2024-12-18T01:05:26.3068032Z  2024-12-18T01:05:26.3068440Z  2024-12-18T01:05:26.3068817Z  2024-12-18T01:05:26.3069189Z  2024-12-18T01:05:26.3069558Z  2024-12-18T01:05:26.3069949Z  2024-12-18T01:05:26.3070379Z  2024-12-18T01:05:26.3071638Z [20,015 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:26.3072592Z @stablehlo//:linalg_passes; 41s local 2024-12-18T01:05:26.3073216Z @llvm-project//mlir:LinalgTransforms; 36s local 2024-12-18T01:05:26.3074137Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T01:05:26.3075204Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2024-12-18T01:05:26.3075985Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:05:26.3076910Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 23s local 2024-12-18T01:05:26.3077665Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:05:26.3078263Z @stablehlo//:linalg_passes; 22s local ... 2024-12-18T01:05:26.6201867Z 2024-12-18T01:05:26.6202698Z  2024-12-18T01:05:26.6203119Z  2024-12-18T01:05:26.6203481Z  2024-12-18T01:05:26.6203843Z  2024-12-18T01:05:26.6204231Z  2024-12-18T01:05:26.6204599Z  2024-12-18T01:05:26.6204956Z  2024-12-18T01:05:26.6205312Z  2024-12-18T01:05:26.6206127Z [20,015 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:26.6206946Z @stablehlo//:linalg_passes; 42s local 2024-12-18T01:05:26.6207540Z @llvm-project//mlir:LinalgTransforms; 37s local 2024-12-18T01:05:26.6208366Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2024-12-18T01:05:26.6209379Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2024-12-18T01:05:26.6210158Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:26.6210814Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 23s local 2024-12-18T01:05:26.6211509Z @stablehlo//:linalg_passes; 23s local 2024-12-18T01:05:26.6212076Z @stablehlo//:linalg_passes; 22s local ... 2024-12-18T01:05:27.5555709Z 2024-12-18T01:05:27.5556609Z  2024-12-18T01:05:27.5557120Z  2024-12-18T01:05:27.5557497Z  2024-12-18T01:05:27.5557856Z  2024-12-18T01:05:27.5558244Z  2024-12-18T01:05:27.5558664Z  2024-12-18T01:05:27.5559059Z  2024-12-18T01:05:27.5559428Z  2024-12-18T01:05:27.5560305Z [20,016 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:27.5561163Z @stablehlo//:linalg_passes; 43s local 2024-12-18T01:05:27.5561919Z @llvm-project//mlir:LinalgTransforms; 38s local 2024-12-18T01:05:27.5562819Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2024-12-18T01:05:27.5563900Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2024-12-18T01:05:27.5564695Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:27.5565326Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local 2024-12-18T01:05:27.5566069Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:05:27.5566630Z @stablehlo//:linalg_passes; 23s local ... 2024-12-18T01:05:27.8213778Z 2024-12-18T01:05:27.8214712Z  2024-12-18T01:05:27.8215166Z  2024-12-18T01:05:27.8215548Z  2024-12-18T01:05:27.8215925Z  2024-12-18T01:05:27.8216476Z  2024-12-18T01:05:27.8216896Z  2024-12-18T01:05:27.8217285Z  2024-12-18T01:05:27.8217636Z  2024-12-18T01:05:27.8218486Z [20,016 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:27.8219708Z @stablehlo//:linalg_passes; 43s local 2024-12-18T01:05:27.8220404Z @llvm-project//mlir:LinalgTransforms; 38s local 2024-12-18T01:05:27.8221291Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T01:05:27.8222409Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2024-12-18T01:05:27.8223217Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:27.8223969Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local 2024-12-18T01:05:27.8224717Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:05:27.8225354Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T01:05:28.0994040Z 2024-12-18T01:05:28.0994945Z  2024-12-18T01:05:28.0995422Z  2024-12-18T01:05:28.0995832Z  2024-12-18T01:05:28.0996206Z  2024-12-18T01:05:28.0996584Z  2024-12-18T01:05:28.0996934Z  2024-12-18T01:05:28.0997311Z  2024-12-18T01:05:28.0997674Z  2024-12-18T01:05:28.0998585Z [20,018 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:28.0999481Z @stablehlo//:linalg_passes; 43s local 2024-12-18T01:05:28.1000272Z @llvm-project//mlir:LinalgTransforms; 38s local 2024-12-18T01:05:28.1001193Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T01:05:28.1002198Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2024-12-18T01:05:28.1003040Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:28.1003803Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T01:05:28.1004592Z @stablehlo//:linalg_passes; 24s local 2024-12-18T01:05:28.1005202Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T01:05:28.4222381Z 2024-12-18T01:05:28.4223216Z  2024-12-18T01:05:28.4223676Z  2024-12-18T01:05:28.4224091Z  2024-12-18T01:05:28.4224500Z  2024-12-18T01:05:28.4224878Z  2024-12-18T01:05:28.4225261Z  2024-12-18T01:05:28.4225631Z  2024-12-18T01:05:28.4226052Z  2024-12-18T01:05:28.4226946Z [20,019 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:28.4227827Z @stablehlo//:linalg_passes; 44s local 2024-12-18T01:05:28.4228480Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T01:05:28.4229356Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T01:05:28.4230331Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2024-12-18T01:05:28.4231095Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:28.4231786Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T01:05:28.4232655Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:28.4233328Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T01:05:28.6324886Z 2024-12-18T01:05:28.6325743Z  2024-12-18T01:05:28.6326196Z  2024-12-18T01:05:28.6326589Z  2024-12-18T01:05:28.6326963Z  2024-12-18T01:05:28.6327352Z  2024-12-18T01:05:28.6327763Z  2024-12-18T01:05:28.6328144Z  2024-12-18T01:05:28.6328508Z  2024-12-18T01:05:28.6329414Z [20,020 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:28.6330313Z @stablehlo//:linalg_passes; 44s local 2024-12-18T01:05:28.6330977Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T01:05:28.6331897Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2024-12-18T01:05:28.6333251Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2024-12-18T01:05:28.6334062Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:28.6334804Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2024-12-18T01:05:28.6335566Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:28.6336300Z @stablehlo//:linalg_passes; 24s local ... 2024-12-18T01:05:29.0228386Z 2024-12-18T01:05:29.0229248Z  2024-12-18T01:05:29.0229684Z  2024-12-18T01:05:29.0230072Z  2024-12-18T01:05:29.0230466Z  2024-12-18T01:05:29.0230864Z  2024-12-18T01:05:29.0231225Z  2024-12-18T01:05:29.0231612Z  2024-12-18T01:05:29.0232011Z  2024-12-18T01:05:29.0232875Z [20,022 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:29.0233796Z @stablehlo//:linalg_passes; 44s local 2024-12-18T01:05:29.0234414Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T01:05:29.0235587Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T01:05:29.0236724Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2024-12-18T01:05:29.0237611Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:29.0238393Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2024-12-18T01:05:29.0239230Z @stablehlo//:linalg_passes; 25s local 2024-12-18T01:05:29.0239839Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T01:05:29.4233738Z 2024-12-18T01:05:29.4234534Z  2024-12-18T01:05:29.4234958Z  2024-12-18T01:05:29.4235329Z  2024-12-18T01:05:29.4235677Z  2024-12-18T01:05:29.4236062Z  2024-12-18T01:05:29.4236419Z  2024-12-18T01:05:29.4236818Z  2024-12-18T01:05:29.4237151Z  2024-12-18T01:05:29.4238065Z [20,022 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:29.4238958Z @stablehlo//:linalg_passes; 45s local 2024-12-18T01:05:29.4239593Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T01:05:29.4240498Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T01:05:29.4241383Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2024-12-18T01:05:29.4242118Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:29.4242773Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2024-12-18T01:05:29.4243653Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:29.4244542Z @stablehlo//:linalg_passes; 25s local ... 2024-12-18T01:05:29.7062379Z 2024-12-18T01:05:29.7063265Z  2024-12-18T01:05:29.7063701Z  2024-12-18T01:05:29.7064109Z  2024-12-18T01:05:29.7064492Z  2024-12-18T01:05:29.7064886Z  2024-12-18T01:05:29.7065303Z  2024-12-18T01:05:29.7065693Z  2024-12-18T01:05:29.7066047Z  2024-12-18T01:05:29.7066898Z [20,023 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:29.7067687Z @stablehlo//:linalg_passes; 45s local 2024-12-18T01:05:29.7068307Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T01:05:29.7069177Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2024-12-18T01:05:29.7070211Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2024-12-18T01:05:29.7071060Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:29.7071828Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2024-12-18T01:05:29.7072572Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:29.7073157Z @stablehlo//:linalg_passes; 26s local ... 2024-12-18T01:05:30.0238125Z 2024-12-18T01:05:30.0238987Z  2024-12-18T01:05:30.0239480Z  2024-12-18T01:05:30.0239879Z  2024-12-18T01:05:30.0240272Z  2024-12-18T01:05:30.0240973Z  2024-12-18T01:05:30.0241368Z  2024-12-18T01:05:30.0241755Z  2024-12-18T01:05:30.0242149Z  2024-12-18T01:05:30.0243125Z [20,024 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:30.0244064Z @stablehlo//:linalg_passes; 45s local 2024-12-18T01:05:30.0244972Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T01:05:30.0246225Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T01:05:30.0247386Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2024-12-18T01:05:30.0248212Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:30.0249279Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T01:05:30.0250033Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:30.0250643Z @stablehlo//:linalg_passes; 26s local ... 2024-12-18T01:05:30.2341666Z 2024-12-18T01:05:30.2342563Z  2024-12-18T01:05:30.2343112Z  2024-12-18T01:05:30.2343507Z  2024-12-18T01:05:30.2343855Z  2024-12-18T01:05:30.2344425Z  2024-12-18T01:05:30.2345074Z  2024-12-18T01:05:30.2345472Z  2024-12-18T01:05:30.2345829Z  2024-12-18T01:05:30.2346723Z [20,025 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:30.2347631Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T01:05:30.2348369Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T01:05:30.2349530Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2024-12-18T01:05:30.2350298Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:30.2351086Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T01:05:30.2351822Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:30.2352404Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:30.2353194Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local ... 2024-12-18T01:05:30.6179376Z 2024-12-18T01:05:30.6180165Z  2024-12-18T01:05:30.6180623Z  2024-12-18T01:05:30.6180982Z  2024-12-18T01:05:30.6181360Z  2024-12-18T01:05:30.6181703Z  2024-12-18T01:05:30.6182036Z  2024-12-18T01:05:30.6182382Z  2024-12-18T01:05:30.6182733Z  2024-12-18T01:05:30.6183556Z [20,026 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:30.6184417Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T01:05:30.6185298Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2024-12-18T01:05:30.6186308Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:30.6187086Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:30.6187800Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T01:05:30.6188498Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:30.6189055Z @stablehlo//:linalg_passes; 26s local 2024-12-18T01:05:30.6189840Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local ... 2024-12-18T01:05:30.8245878Z 2024-12-18T01:05:30.8246678Z  2024-12-18T01:05:30.8247065Z  2024-12-18T01:05:30.8247429Z  2024-12-18T01:05:30.8247780Z  2024-12-18T01:05:30.8248159Z  2024-12-18T01:05:30.8248527Z  2024-12-18T01:05:30.8248882Z  2024-12-18T01:05:30.8249246Z  2024-12-18T01:05:30.8250096Z [20,027 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:30.8250967Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T01:05:30.8251806Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T01:05:30.8252829Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:30.8253563Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:30.8254505Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2024-12-18T01:05:30.8255174Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:30.8255689Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:30.8256520Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local ... 2024-12-18T01:05:31.1362402Z 2024-12-18T01:05:31.1363182Z  2024-12-18T01:05:31.1363841Z  2024-12-18T01:05:31.1364141Z  2024-12-18T01:05:31.1364453Z  2024-12-18T01:05:31.1364758Z  2024-12-18T01:05:31.1365068Z  2024-12-18T01:05:31.1365389Z  2024-12-18T01:05:31.1365680Z  2024-12-18T01:05:31.1366397Z [20,028 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:31.1367119Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T01:05:31.1367822Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T01:05:31.1368630Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:31.1369242Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:31.1370029Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T01:05:31.1370615Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:31.1371070Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:31.1371691Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local ... 2024-12-18T01:05:31.4254436Z 2024-12-18T01:05:31.4255316Z  2024-12-18T01:05:31.4255760Z  2024-12-18T01:05:31.4256643Z  2024-12-18T01:05:31.4257052Z  2024-12-18T01:05:31.4257449Z  2024-12-18T01:05:31.4257836Z  2024-12-18T01:05:31.4258210Z  2024-12-18T01:05:31.4258599Z  2024-12-18T01:05:31.4259551Z [20,029 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:31.4260515Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T01:05:31.4261470Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T01:05:31.4262542Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:31.4263386Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:31.4264136Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T01:05:31.4264916Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:31.4265523Z @stablehlo//:linalg_passes; 27s local 2024-12-18T01:05:31.4266365Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local ... 2024-12-18T01:05:31.6774779Z 2024-12-18T01:05:31.6775594Z  2024-12-18T01:05:31.6776058Z  2024-12-18T01:05:31.6776570Z  2024-12-18T01:05:31.6776954Z  2024-12-18T01:05:31.6777329Z  2024-12-18T01:05:31.6777699Z  2024-12-18T01:05:31.6778063Z  2024-12-18T01:05:31.6778432Z  2024-12-18T01:05:31.6779329Z [20,030 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:31.6780310Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T01:05:31.6781213Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2024-12-18T01:05:31.6782284Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T01:05:31.6783121Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:31.6783891Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T01:05:31.6784659Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:31.6785261Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:31.6786103Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local ... 2024-12-18T01:05:31.9096427Z 2024-12-18T01:05:31.9097330Z  2024-12-18T01:05:31.9097759Z  2024-12-18T01:05:31.9098056Z  2024-12-18T01:05:31.9098357Z  2024-12-18T01:05:31.9098703Z  2024-12-18T01:05:31.9099066Z  2024-12-18T01:05:31.9099735Z  2024-12-18T01:05:31.9100061Z  2024-12-18T01:05:31.9100977Z [20,031 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:31.9101882Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T01:05:31.9102755Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T01:05:31.9103923Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T01:05:31.9104730Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:31.9105512Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2024-12-18T01:05:31.9106206Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:31.9106813Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:31.9107599Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local ... 2024-12-18T01:05:32.2260807Z 2024-12-18T01:05:32.2261616Z  2024-12-18T01:05:32.2262089Z  2024-12-18T01:05:32.2262518Z  2024-12-18T01:05:32.2262899Z  2024-12-18T01:05:32.2263262Z  2024-12-18T01:05:32.2263597Z  2024-12-18T01:05:32.2264186Z  2024-12-18T01:05:32.2264548Z  2024-12-18T01:05:32.2265488Z [20,032 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:32.2266433Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T01:05:32.2267486Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T01:05:32.2268796Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T01:05:32.2269687Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:32.2270455Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T01:05:32.2271182Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:32.2271721Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:32.2272568Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local ... 2024-12-18T01:05:32.5338686Z 2024-12-18T01:05:32.5339551Z  2024-12-18T01:05:32.5339982Z  2024-12-18T01:05:32.5340370Z  2024-12-18T01:05:32.5340735Z  2024-12-18T01:05:32.5341090Z  2024-12-18T01:05:32.5341449Z  2024-12-18T01:05:32.5341859Z  2024-12-18T01:05:32.5342267Z  2024-12-18T01:05:32.5343215Z [20,033 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:32.5344468Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T01:05:32.5345349Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2024-12-18T01:05:32.5346451Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T01:05:32.5347294Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:32.5347996Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T01:05:32.5348732Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:32.5349414Z @stablehlo//:linalg_passes; 28s local 2024-12-18T01:05:32.5350259Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local ... 2024-12-18T01:05:32.8267694Z 2024-12-18T01:05:32.8268562Z  2024-12-18T01:05:32.8269038Z  2024-12-18T01:05:32.8269427Z  2024-12-18T01:05:32.8269732Z  2024-12-18T01:05:32.8270034Z  2024-12-18T01:05:32.8270335Z  2024-12-18T01:05:32.8270648Z  2024-12-18T01:05:32.8270946Z  2024-12-18T01:05:32.8271679Z [20,033 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:32.8272472Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T01:05:32.8273384Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T01:05:32.8274416Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T01:05:32.8275214Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:32.8276166Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 29s local 2024-12-18T01:05:32.8276895Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:32.8277473Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:32.8278181Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local ... 2024-12-18T01:05:33.2143817Z 2024-12-18T01:05:33.2144971Z  2024-12-18T01:05:33.2145478Z  2024-12-18T01:05:33.2146176Z  2024-12-18T01:05:33.2146559Z  2024-12-18T01:05:33.2146943Z  2024-12-18T01:05:33.2147323Z  2024-12-18T01:05:33.2147733Z  2024-12-18T01:05:33.2148116Z  2024-12-18T01:05:33.2148977Z [20,035 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:33.2149992Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T01:05:33.2150982Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T01:05:33.2152131Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T01:05:33.2153054Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:33.2153940Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local 2024-12-18T01:05:33.2154508Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:33.2154964Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:33.2155596Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local ... 2024-12-18T01:05:33.4276164Z 2024-12-18T01:05:33.4277005Z  2024-12-18T01:05:33.4277464Z  2024-12-18T01:05:33.4278115Z  2024-12-18T01:05:33.4278530Z  2024-12-18T01:05:33.4278883Z  2024-12-18T01:05:33.4279261Z  2024-12-18T01:05:33.4279645Z  2024-12-18T01:05:33.4280026Z  2024-12-18T01:05:33.4280882Z [20,037 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:33.4281853Z @llvm-project//mlir:LinalgTransforms; 44s local 2024-12-18T01:05:33.4282783Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2024-12-18T01:05:33.4283816Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T01:05:33.4284624Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:33.4285277Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local 2024-12-18T01:05:33.4285993Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:33.4286577Z @stablehlo//:linalg_passes; 29s local 2024-12-18T01:05:33.4287450Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local ... 2024-12-18T01:05:34.0808573Z 2024-12-18T01:05:34.0809433Z  2024-12-18T01:05:34.0809933Z  2024-12-18T01:05:34.0810323Z  2024-12-18T01:05:34.0810708Z  2024-12-18T01:05:34.0811093Z  2024-12-18T01:05:34.0811482Z  2024-12-18T01:05:34.0811882Z  2024-12-18T01:05:34.0812252Z  2024-12-18T01:05:34.0813184Z [20,038 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:34.0814167Z @llvm-project//mlir:LinalgTransforms; 44s local 2024-12-18T01:05:34.0815110Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T01:05:34.0816147Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T01:05:34.0817088Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:34.0817655Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:34.0818251Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:34.0819035Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:34.0820089Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local ... 2024-12-18T01:05:34.3746574Z 2024-12-18T01:05:34.3747431Z  2024-12-18T01:05:34.3747906Z  2024-12-18T01:05:34.3748277Z  2024-12-18T01:05:34.3748591Z  2024-12-18T01:05:34.3748969Z  2024-12-18T01:05:34.3749360Z  2024-12-18T01:05:34.3750070Z  2024-12-18T01:05:34.3750452Z  2024-12-18T01:05:34.3751318Z [20,039 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:34.3752292Z @llvm-project//mlir:LinalgTransforms; 44s local 2024-12-18T01:05:34.3753176Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T01:05:34.3754206Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T01:05:34.3755263Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:34.3755813Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:34.3756370Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:34.3757145Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:34.3758080Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local ... 2024-12-18T01:05:34.6285206Z 2024-12-18T01:05:34.6286434Z  2024-12-18T01:05:34.6287024Z  2024-12-18T01:05:34.6287368Z  2024-12-18T01:05:34.6287677Z  2024-12-18T01:05:34.6287973Z  2024-12-18T01:05:34.6288273Z  2024-12-18T01:05:34.6288806Z  2024-12-18T01:05:34.6289136Z  2024-12-18T01:05:34.6289853Z [20,040 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:34.6290621Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T01:05:34.6291366Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2024-12-18T01:05:34.6292315Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T01:05:34.6292977Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:34.6293455Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:34.6293926Z @stablehlo//:linalg_passes; 30s local 2024-12-18T01:05:34.6294553Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:34.6295349Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local ... 2024-12-18T01:05:34.8290134Z 2024-12-18T01:05:34.8290966Z  2024-12-18T01:05:34.8291441Z  2024-12-18T01:05:34.8291869Z  2024-12-18T01:05:34.8292232Z  2024-12-18T01:05:34.8292611Z  2024-12-18T01:05:34.8293005Z  2024-12-18T01:05:34.8293370Z  2024-12-18T01:05:34.8293769Z  2024-12-18T01:05:34.8304453Z [20,041 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:34.8305689Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T01:05:34.8306639Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T01:05:34.8307641Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T01:05:34.8308429Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:34.8309003Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:34.8309571Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:34.8310346Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2024-12-18T01:05:34.8311358Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local ... 2024-12-18T01:05:35.3111891Z 2024-12-18T01:05:35.3112761Z  2024-12-18T01:05:35.3113230Z  2024-12-18T01:05:35.3113646Z  2024-12-18T01:05:35.3114024Z  2024-12-18T01:05:35.3114355Z  2024-12-18T01:05:35.3114740Z  2024-12-18T01:05:35.3115122Z  2024-12-18T01:05:35.3115480Z  2024-12-18T01:05:35.3116367Z [20,042 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:35.3117452Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T01:05:35.3118315Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T01:05:35.3119269Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T01:05:35.3120063Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:35.3120930Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:35.3121554Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:35.3122345Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T01:05:35.3123395Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local ... 2024-12-18T01:05:35.6296490Z 2024-12-18T01:05:35.6297287Z  2024-12-18T01:05:35.6298083Z  2024-12-18T01:05:35.6298660Z  2024-12-18T01:05:35.6299163Z  2024-12-18T01:05:35.6299725Z  2024-12-18T01:05:35.6300280Z  2024-12-18T01:05:35.6300832Z  2024-12-18T01:05:35.6301333Z  2024-12-18T01:05:35.6302378Z [20,042 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:35.6303507Z @llvm-project//mlir:LinalgTransforms; 46s local 2024-12-18T01:05:35.6304525Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2024-12-18T01:05:35.6305805Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T01:05:35.6306735Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:35.6307589Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:35.6308351Z @stablehlo//:linalg_passes; 31s local 2024-12-18T01:05:35.6309345Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2024-12-18T01:05:35.6310604Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local ... 2024-12-18T01:05:36.4783319Z 2024-12-18T01:05:36.4784137Z  2024-12-18T01:05:36.4784576Z  2024-12-18T01:05:36.4785202Z  2024-12-18T01:05:36.4785550Z  2024-12-18T01:05:36.4785905Z  2024-12-18T01:05:36.4786264Z  2024-12-18T01:05:36.4786614Z  2024-12-18T01:05:36.4786967Z  2024-12-18T01:05:36.4787781Z [20,043 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:36.4788778Z @llvm-project//mlir:LinalgTransforms; 47s local 2024-12-18T01:05:36.4789628Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2024-12-18T01:05:36.4790579Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T01:05:36.4791311Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:36.4791831Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:36.4792358Z @stablehlo//:linalg_passes; 32s local 2024-12-18T01:05:36.4793077Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T01:05:36.4793982Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 20s local ... 2024-12-18T01:05:36.8308808Z 2024-12-18T01:05:36.8309731Z  2024-12-18T01:05:36.8310216Z  2024-12-18T01:05:36.8310552Z  2024-12-18T01:05:36.8310881Z  2024-12-18T01:05:36.8311207Z  2024-12-18T01:05:36.8311528Z  2024-12-18T01:05:36.8311840Z  2024-12-18T01:05:36.8312150Z  2024-12-18T01:05:36.8312897Z [20,046 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:36.8313724Z @llvm-project//mlir:LinalgTransforms; 47s local 2024-12-18T01:05:36.8314478Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2024-12-18T01:05:36.8315373Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T01:05:36.8316040Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:36.8316549Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:36.8317228Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2024-12-18T01:05:36.8318187Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2024-12-18T01:05:36.8319071Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:37.0311111Z 2024-12-18T01:05:37.0312104Z  2024-12-18T01:05:37.0312852Z  2024-12-18T01:05:37.0313400Z  2024-12-18T01:05:37.0313883Z  2024-12-18T01:05:37.0314328Z  2024-12-18T01:05:37.0315153Z  2024-12-18T01:05:37.0315640Z  2024-12-18T01:05:37.0316124Z  2024-12-18T01:05:37.0317034Z [20,047 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:37.0318160Z @llvm-project//mlir:LinalgTransforms; 47s local 2024-12-18T01:05:37.0319200Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2024-12-18T01:05:37.0320613Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T01:05:37.0321620Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:37.0322307Z @stablehlo//:linalg_passes; 33s local 2024-12-18T01:05:37.0323286Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T01:05:37.0324420Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2024-12-18T01:05:37.0325479Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:37.3330203Z 2024-12-18T01:05:37.3331195Z  2024-12-18T01:05:37.3331651Z  2024-12-18T01:05:37.3332273Z  2024-12-18T01:05:37.3332641Z  2024-12-18T01:05:37.3333462Z  2024-12-18T01:05:37.3334037Z  2024-12-18T01:05:37.3334523Z  2024-12-18T01:05:37.3335047Z  2024-12-18T01:05:37.3336116Z [20,049 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:37.3337357Z @llvm-project//mlir:LinalgTransforms; 47s local 2024-12-18T01:05:37.3338404Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2024-12-18T01:05:37.3339842Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T01:05:37.3340835Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:37.3341544Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:37.3342472Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T01:05:37.3343644Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2024-12-18T01:05:37.3345070Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:37.6319568Z 2024-12-18T01:05:37.6320497Z  2024-12-18T01:05:37.6322274Z  2024-12-18T01:05:37.6322723Z  2024-12-18T01:05:37.6323119Z  2024-12-18T01:05:37.6323545Z  2024-12-18T01:05:37.6323933Z  2024-12-18T01:05:37.6324318Z  2024-12-18T01:05:37.6324709Z  2024-12-18T01:05:37.6325650Z [20,049 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:37.6326698Z @llvm-project//mlir:LinalgTransforms; 48s local 2024-12-18T01:05:37.6327672Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2024-12-18T01:05:37.6328919Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T01:05:37.6329821Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:37.6330459Z @stablehlo//:linalg_passes; 34s local 2024-12-18T01:05:37.6331338Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2024-12-18T01:05:37.6332498Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2024-12-18T01:05:37.6333503Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2024-12-18T01:05:38.3257324Z 2024-12-18T01:05:38.3258181Z  2024-12-18T01:05:38.3258606Z  2024-12-18T01:05:38.3258971Z  2024-12-18T01:05:38.3259344Z  2024-12-18T01:05:38.3259703Z  2024-12-18T01:05:38.3260041Z  2024-12-18T01:05:38.3260418Z  2024-12-18T01:05:38.3260787Z  2024-12-18T01:05:38.3261620Z [20,050 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:38.3262496Z @llvm-project//mlir:LinalgTransforms; 48s local 2024-12-18T01:05:38.3263316Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2024-12-18T01:05:38.3264279Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T01:05:38.3265268Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:38.3265825Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:38.3266509Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T01:05:38.3267455Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2024-12-18T01:05:38.3268310Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2024-12-18T01:05:38.6329204Z 2024-12-18T01:05:38.6330086Z  2024-12-18T01:05:38.6331985Z  2024-12-18T01:05:38.6332453Z  2024-12-18T01:05:38.6332899Z  2024-12-18T01:05:38.6333296Z  2024-12-18T01:05:38.6333664Z  2024-12-18T01:05:38.6334030Z  2024-12-18T01:05:38.6334407Z  2024-12-18T01:05:38.6335351Z [20,050 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:38.6336558Z @llvm-project//mlir:LinalgTransforms; 49s local 2024-12-18T01:05:38.6337541Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2024-12-18T01:05:38.6338955Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T01:05:38.6339817Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:38.6340450Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:38.6341286Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2024-12-18T01:05:38.6342454Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2024-12-18T01:05:38.6343594Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2024-12-18T01:05:39.0313808Z 2024-12-18T01:05:39.0314742Z  2024-12-18T01:05:39.0315249Z  2024-12-18T01:05:39.0315572Z  2024-12-18T01:05:39.0315987Z  2024-12-18T01:05:39.0316315Z  2024-12-18T01:05:39.0316721Z  2024-12-18T01:05:39.0317049Z  2024-12-18T01:05:39.0317458Z  2024-12-18T01:05:39.0318191Z [20,051 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:39.0319089Z @llvm-project//mlir:LinalgTransforms; 49s local 2024-12-18T01:05:39.0319909Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T01:05:39.0320827Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T01:05:39.0321557Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:39.0322267Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:39.0322992Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T01:05:39.0323946Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2024-12-18T01:05:39.0324811Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2024-12-18T01:05:39.2334692Z 2024-12-18T01:05:39.2335604Z  2024-12-18T01:05:39.2336073Z  2024-12-18T01:05:39.2336577Z  2024-12-18T01:05:39.2336970Z  2024-12-18T01:05:39.2337336Z  2024-12-18T01:05:39.2337708Z  2024-12-18T01:05:39.2338130Z  2024-12-18T01:05:39.2338461Z  2024-12-18T01:05:39.2339276Z [20,052 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:39.2340056Z @llvm-project//mlir:LinalgTransforms; 49s local 2024-12-18T01:05:39.2340857Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T01:05:39.2341937Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T01:05:39.2342799Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:39.2343371Z @stablehlo//:linalg_passes; 35s local 2024-12-18T01:05:39.2344377Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T01:05:39.2345393Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2024-12-18T01:05:39.2346446Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2024-12-18T01:05:39.4345480Z 2024-12-18T01:05:39.4346402Z  2024-12-18T01:05:39.4347260Z  2024-12-18T01:05:39.4347669Z  2024-12-18T01:05:39.4348056Z  2024-12-18T01:05:39.4348454Z  2024-12-18T01:05:39.4348856Z  2024-12-18T01:05:39.4349248Z  2024-12-18T01:05:39.4349640Z  2024-12-18T01:05:39.4350534Z [20,054 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:39.4351498Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:05:39.4352585Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2024-12-18T01:05:39.4353730Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T01:05:39.4354540Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:39.4355123Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:39.4355956Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T01:05:39.4357093Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2024-12-18T01:05:39.4358043Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2024-12-18T01:05:39.8279118Z 2024-12-18T01:05:39.8280044Z  2024-12-18T01:05:39.8280820Z  2024-12-18T01:05:39.8281238Z  2024-12-18T01:05:39.8281619Z  2024-12-18T01:05:39.8281998Z  2024-12-18T01:05:39.8282363Z  2024-12-18T01:05:39.8282733Z  2024-12-18T01:05:39.8283106Z  2024-12-18T01:05:39.8284044Z [20,055 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:39.8285203Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:05:39.8286133Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T01:05:39.8287196Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T01:05:39.8288030Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:39.8288665Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:39.8289641Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2024-12-18T01:05:39.8290766Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T01:05:39.8291705Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2024-12-18T01:05:40.0351575Z 2024-12-18T01:05:40.0352552Z  2024-12-18T01:05:40.0353064Z  2024-12-18T01:05:40.0353440Z  2024-12-18T01:05:40.0353793Z  2024-12-18T01:05:40.0354148Z  2024-12-18T01:05:40.0354469Z  2024-12-18T01:05:40.0354826Z  2024-12-18T01:05:40.0355229Z  2024-12-18T01:05:40.0356208Z [20,056 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:40.0357234Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:05:40.0358177Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T01:05:40.0359283Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T01:05:40.0360136Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:40.0360758Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:40.0361611Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T01:05:40.0362828Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T01:05:40.0363806Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2024-12-18T01:05:40.2353360Z 2024-12-18T01:05:40.2354214Z  2024-12-18T01:05:40.2354821Z  2024-12-18T01:05:40.2355212Z  2024-12-18T01:05:40.2355603Z  2024-12-18T01:05:40.2356015Z  2024-12-18T01:05:40.2356391Z  2024-12-18T01:05:40.2356752Z  2024-12-18T01:05:40.2357140Z  2024-12-18T01:05:40.2358115Z [20,058 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:40.2359153Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:05:40.2360080Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T01:05:40.2361507Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T01:05:40.2362524Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:40.2363124Z @stablehlo//:linalg_passes; 36s local 2024-12-18T01:05:40.2363996Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T01:05:40.2365152Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T01:05:40.2366230Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2024-12-18T01:05:40.6356631Z 2024-12-18T01:05:40.6357538Z  2024-12-18T01:05:40.6357989Z  2024-12-18T01:05:40.6358365Z  2024-12-18T01:05:40.6358728Z  2024-12-18T01:05:40.6359097Z  2024-12-18T01:05:40.6359473Z  2024-12-18T01:05:40.6359848Z  2024-12-18T01:05:40.6360224Z  2024-12-18T01:05:40.6361127Z [20,059 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:40.6362295Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T01:05:40.6363485Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2024-12-18T01:05:40.6364469Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T01:05:40.6365239Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:40.6365983Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2024-12-18T01:05:40.6366963Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2024-12-18T01:05:40.6367944Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:40.6368806Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 18s local ... 2024-12-18T01:05:41.0361526Z 2024-12-18T01:05:41.0362338Z  2024-12-18T01:05:41.0362805Z  2024-12-18T01:05:41.0363202Z  2024-12-18T01:05:41.0363596Z  2024-12-18T01:05:41.0364003Z  2024-12-18T01:05:41.0364400Z  2024-12-18T01:05:41.0364829Z  2024-12-18T01:05:41.0365204Z  2024-12-18T01:05:41.0366157Z [20,060 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:41.0367131Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T01:05:41.0368077Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T01:05:41.0369210Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T01:05:41.0370074Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:41.0370914Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T01:05:41.0372041Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2024-12-18T01:05:41.0372961Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:41.0373920Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 18s local ... 2024-12-18T01:05:41.2593012Z 2024-12-18T01:05:41.2593903Z  2024-12-18T01:05:41.2594401Z  2024-12-18T01:05:41.2594817Z  2024-12-18T01:05:41.2595210Z  2024-12-18T01:05:41.2595566Z  2024-12-18T01:05:41.2595966Z  2024-12-18T01:05:41.2596364Z  2024-12-18T01:05:41.2596764Z  2024-12-18T01:05:41.2597681Z [20,061 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:41.2598668Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T01:05:41.2599635Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T01:05:41.2600922Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T01:05:41.2601828Z @stablehlo//:linalg_passes; 37s local 2024-12-18T01:05:41.2602699Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T01:05:41.2603853Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2024-12-18T01:05:41.2604848Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:41.2606182Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 18s local ... 2024-12-18T01:05:41.6366340Z 2024-12-18T01:05:41.6367150Z  2024-12-18T01:05:41.6367621Z  2024-12-18T01:05:41.6368003Z  2024-12-18T01:05:41.6368401Z  2024-12-18T01:05:41.6368794Z  2024-12-18T01:05:41.6369188Z  2024-12-18T01:05:41.6369576Z  2024-12-18T01:05:41.6370185Z  2024-12-18T01:05:41.6371116Z [20,062 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:41.6372099Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T01:05:41.6373037Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2024-12-18T01:05:41.6374150Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T01:05:41.6374980Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:41.6375796Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T01:05:41.6377035Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2024-12-18T01:05:41.6378138Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:41.6379097Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 19s local ... 2024-12-18T01:05:41.9454043Z 2024-12-18T01:05:41.9454894Z  2024-12-18T01:05:41.9455427Z  2024-12-18T01:05:41.9455950Z  2024-12-18T01:05:41.9456546Z  2024-12-18T01:05:41.9456924Z  2024-12-18T01:05:41.9457299Z  2024-12-18T01:05:41.9458004Z  2024-12-18T01:05:41.9458504Z  2024-12-18T01:05:41.9459402Z [20,063 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:41.9460193Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T01:05:41.9461077Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T01:05:41.9462133Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T01:05:41.9462946Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:41.9463886Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2024-12-18T01:05:41.9464970Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T01:05:41.9465806Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:41.9466743Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 19s local ... 2024-12-18T01:05:42.2371114Z 2024-12-18T01:05:42.2372007Z  2024-12-18T01:05:42.2372519Z  2024-12-18T01:05:42.2372924Z  2024-12-18T01:05:42.2373295Z  2024-12-18T01:05:42.2373665Z  2024-12-18T01:05:42.2374028Z  2024-12-18T01:05:42.2374414Z  2024-12-18T01:05:42.2374782Z  2024-12-18T01:05:42.2375732Z [20,063 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:42.2376884Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T01:05:42.2377825Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T01:05:42.2378915Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T01:05:42.2379753Z @stablehlo//:linalg_passes; 38s local 2024-12-18T01:05:42.2380577Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T01:05:42.2381687Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T01:05:42.2382653Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:42.2383613Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 19s local ... 2024-12-18T01:05:42.4375231Z 2024-12-18T01:05:42.4376064Z  2024-12-18T01:05:42.4376702Z  2024-12-18T01:05:42.4377113Z  2024-12-18T01:05:42.4377496Z  2024-12-18T01:05:42.4377896Z  2024-12-18T01:05:42.4378287Z  2024-12-18T01:05:42.4378668Z  2024-12-18T01:05:42.4379448Z  2024-12-18T01:05:42.4380381Z [20,064 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:42.4381395Z @llvm-project//mlir:LinalgTransforms; 53s local 2024-12-18T01:05:42.4382313Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T01:05:42.4383188Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:42.4384224Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T01:05:42.4385291Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T01:05:42.4386200Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:42.4387123Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 19s local 2024-12-18T01:05:42.4388003Z @xla//xla/mlir_hlo:mhlo_passes; 19s local ... 2024-12-18T01:05:42.7442455Z 2024-12-18T01:05:42.7443270Z  2024-12-18T01:05:42.7443705Z  2024-12-18T01:05:42.7444064Z  2024-12-18T01:05:42.7444651Z  2024-12-18T01:05:42.7444981Z  2024-12-18T01:05:42.7445329Z  2024-12-18T01:05:42.7445676Z  2024-12-18T01:05:42.7446263Z  2024-12-18T01:05:42.7447061Z [20,065 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:42.7447961Z @llvm-project//mlir:LinalgTransforms; 53s local 2024-12-18T01:05:42.7448831Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2024-12-18T01:05:42.7449603Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:42.7450499Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2024-12-18T01:05:42.7451466Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2024-12-18T01:05:42.7452285Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:42.7453068Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local 2024-12-18T01:05:42.7453875Z @xla//xla/mlir_hlo:mhlo_passes; 19s local ... 2024-12-18T01:05:43.0379586Z 2024-12-18T01:05:43.0380436Z  2024-12-18T01:05:43.0380882Z  2024-12-18T01:05:43.0381293Z  2024-12-18T01:05:43.0381679Z  2024-12-18T01:05:43.0382065Z  2024-12-18T01:05:43.0382453Z  2024-12-18T01:05:43.0382842Z  2024-12-18T01:05:43.0383227Z  2024-12-18T01:05:43.0384161Z [20,066 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:43.0385153Z @llvm-project//mlir:LinalgTransforms; 53s local 2024-12-18T01:05:43.0385994Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T01:05:43.0386750Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:43.0387584Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T01:05:43.0388640Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 26s local 2024-12-18T01:05:43.0389377Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:43.0390262Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local 2024-12-18T01:05:43.0391173Z @xla//xla/mlir_hlo:mhlo_passes; 19s local ... 2024-12-18T01:05:43.2482339Z 2024-12-18T01:05:43.2483202Z  2024-12-18T01:05:43.2483783Z  2024-12-18T01:05:43.2484294Z  2024-12-18T01:05:43.2484786Z  2024-12-18T01:05:43.2485267Z  2024-12-18T01:05:43.2485736Z  2024-12-18T01:05:43.2486226Z  2024-12-18T01:05:43.2486681Z  2024-12-18T01:05:43.2487650Z [20,067 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:43.2488568Z @llvm-project//mlir:LinalgTransforms; 53s local 2024-12-18T01:05:43.2489531Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T01:05:43.2490490Z @stablehlo//:linalg_passes; 39s local 2024-12-18T01:05:43.2491298Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T01:05:43.2492459Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:43.2493278Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local 2024-12-18T01:05:43.2494118Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:43.2494809Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2024-12-18T01:05:43.5447916Z 2024-12-18T01:05:43.5448719Z  2024-12-18T01:05:43.5449500Z  2024-12-18T01:05:43.5449895Z  2024-12-18T01:05:43.5450238Z  2024-12-18T01:05:43.5450624Z  2024-12-18T01:05:43.5450992Z  2024-12-18T01:05:43.5451381Z  2024-12-18T01:05:43.5451874Z  2024-12-18T01:05:43.5452769Z [20,069 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:43.5453699Z @llvm-project//mlir:LinalgTransforms; 54s local 2024-12-18T01:05:43.5454586Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2024-12-18T01:05:43.5455515Z @stablehlo//:linalg_passes; 40s local 2024-12-18T01:05:43.5456490Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T01:05:43.5457575Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:43.5458467Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2024-12-18T01:05:43.5459314Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:05:43.5460011Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2024-12-18T01:05:43.8385715Z 2024-12-18T01:05:43.8386634Z  2024-12-18T01:05:43.8387122Z  2024-12-18T01:05:43.8387780Z  2024-12-18T01:05:43.8388137Z  2024-12-18T01:05:43.8388428Z  2024-12-18T01:05:43.8388759Z  2024-12-18T01:05:43.8389136Z  2024-12-18T01:05:43.8389621Z  2024-12-18T01:05:43.8390548Z [20,071 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:43.8391509Z @llvm-project//mlir:LinalgTransforms; 54s local 2024-12-18T01:05:43.8392467Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2024-12-18T01:05:43.8393378Z @stablehlo//:linalg_passes; 40s local 2024-12-18T01:05:43.8394146Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2024-12-18T01:05:43.8395145Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2024-12-18T01:05:43.8395994Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:05:43.8396651Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T01:05:43.8397408Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2024-12-18T01:05:44.2390168Z 2024-12-18T01:05:44.2391019Z  2024-12-18T01:05:44.2391482Z  2024-12-18T01:05:44.2391883Z  2024-12-18T01:05:44.2392290Z  2024-12-18T01:05:44.2392701Z  2024-12-18T01:05:44.2393057Z  2024-12-18T01:05:44.2393391Z  2024-12-18T01:05:44.2393756Z  2024-12-18T01:05:44.2394651Z [20,072 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:44.2395712Z @llvm-project//mlir:LinalgTransforms; 54s local 2024-12-18T01:05:44.2396637Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2024-12-18T01:05:44.2397559Z @stablehlo//:linalg_passes; 40s local 2024-12-18T01:05:44.2398382Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T01:05:44.2399442Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2024-12-18T01:05:44.2400313Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:05:44.2400978Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:44.2401650Z @xla//xla/mlir_hlo:mhlo_passes; 15s local ... 2024-12-18T01:05:44.5131928Z 2024-12-18T01:05:44.5132808Z  2024-12-18T01:05:44.5133263Z  2024-12-18T01:05:44.5133638Z  2024-12-18T01:05:44.5134022Z  2024-12-18T01:05:44.5134411Z  2024-12-18T01:05:44.5134767Z  2024-12-18T01:05:44.5135469Z  2024-12-18T01:05:44.5135837Z  2024-12-18T01:05:44.5136948Z [20,073 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:44.5137773Z @llvm-project//mlir:LinalgTransforms; 55s local 2024-12-18T01:05:44.5138583Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2024-12-18T01:05:44.5139748Z @stablehlo//:linalg_passes; 41s local 2024-12-18T01:05:44.5140598Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T01:05:44.5141623Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2024-12-18T01:05:44.5142438Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:05:44.5143076Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:44.5143788Z @xla//xla/mlir_hlo:mhlo_passes; 15s local ... 2024-12-18T01:05:44.8395845Z 2024-12-18T01:05:44.8396695Z  2024-12-18T01:05:44.8397170Z  2024-12-18T01:05:44.8397584Z  2024-12-18T01:05:44.8397965Z  2024-12-18T01:05:44.8398351Z  2024-12-18T01:05:44.8398752Z  2024-12-18T01:05:44.8399521Z  2024-12-18T01:05:44.8399945Z  2024-12-18T01:05:44.8400894Z [20,076 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:44.8401957Z @llvm-project//mlir:LinalgTransforms; 55s local 2024-12-18T01:05:44.8402952Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2024-12-18T01:05:44.8404086Z @stablehlo//:linalg_passes; 41s local 2024-12-18T01:05:44.8404943Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2024-12-18T01:05:44.8405838Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:05:44.8406521Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:44.8407242Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:44.8408086Z Compiling .../shardy/mhlo_round_trip/shard_map_export.cc; 13s local ... 2024-12-18T01:05:45.2226310Z 2024-12-18T01:05:45.2227115Z  2024-12-18T01:05:45.2227534Z  2024-12-18T01:05:45.2227900Z  2024-12-18T01:05:45.2228243Z  2024-12-18T01:05:45.2228566Z  2024-12-18T01:05:45.2228895Z  2024-12-18T01:05:45.2229227Z  2024-12-18T01:05:45.2229582Z  2024-12-18T01:05:45.2230390Z [20,078 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:45.2231220Z @llvm-project//mlir:LinalgTransforms; 55s local 2024-12-18T01:05:45.2231803Z @stablehlo//:linalg_passes; 41s local 2024-12-18T01:05:45.2232516Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T01:05:45.2233257Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:05:45.2233881Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:45.2234494Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:45.2235256Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 13s local 2024-12-18T01:05:45.2236406Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 13s local ... 2024-12-18T01:05:45.4399231Z 2024-12-18T01:05:45.4400036Z  2024-12-18T01:05:45.4400442Z  2024-12-18T01:05:45.4400794Z  2024-12-18T01:05:45.4401128Z  2024-12-18T01:05:45.4401470Z  2024-12-18T01:05:45.4401796Z  2024-12-18T01:05:45.4402175Z  2024-12-18T01:05:45.4402513Z  2024-12-18T01:05:45.4403302Z [20,078 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:45.4404166Z @llvm-project//mlir:LinalgTransforms; 56s local 2024-12-18T01:05:45.4404748Z @stablehlo//:linalg_passes; 42s local 2024-12-18T01:05:45.4405451Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2024-12-18T01:05:45.4406175Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:05:45.4406728Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:45.4407629Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:45.4408357Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 13s local 2024-12-18T01:05:45.4409272Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 13s local ... 2024-12-18T01:05:45.6402233Z 2024-12-18T01:05:45.6403020Z  2024-12-18T01:05:45.6403403Z  2024-12-18T01:05:45.6403970Z  2024-12-18T01:05:45.6404278Z  2024-12-18T01:05:45.6404569Z  2024-12-18T01:05:45.6404881Z  2024-12-18T01:05:45.6405209Z  2024-12-18T01:05:45.6405595Z  2024-12-18T01:05:45.6406516Z [20,079 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:45.6407490Z @llvm-project//mlir:LinalgTransforms; 56s local 2024-12-18T01:05:45.6408152Z @stablehlo//:linalg_passes; 42s local 2024-12-18T01:05:45.6408756Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:05:45.6409441Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:45.6410149Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:45.6411179Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 13s local 2024-12-18T01:05:45.6412253Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 13s local 2024-12-18T01:05:45.6413158Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2024-12-18T01:05:46.1505965Z 2024-12-18T01:05:46.1506872Z  2024-12-18T01:05:46.1507331Z  2024-12-18T01:05:46.1507722Z  2024-12-18T01:05:46.1508115Z  2024-12-18T01:05:46.1508794Z  2024-12-18T01:05:46.1509197Z  2024-12-18T01:05:46.1509568Z  2024-12-18T01:05:46.1509945Z  2024-12-18T01:05:46.1510852Z [20,080 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:46.1511818Z @llvm-project//mlir:LinalgTransforms; 56s local 2024-12-18T01:05:46.1512489Z @stablehlo//:linalg_passes; 42s local 2024-12-18T01:05:46.1513122Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:05:46.1513772Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:46.1514444Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:46.1515255Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 14s local 2024-12-18T01:05:46.1516264Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 14s local 2024-12-18T01:05:46.1516933Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T01:05:46.4408977Z 2024-12-18T01:05:46.4409834Z  2024-12-18T01:05:46.4410298Z  2024-12-18T01:05:46.4410702Z  2024-12-18T01:05:46.4411082Z  2024-12-18T01:05:46.4411421Z  2024-12-18T01:05:46.4411806Z  2024-12-18T01:05:46.4412205Z  2024-12-18T01:05:46.4412589Z  2024-12-18T01:05:46.4413529Z [20,080 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:46.4414515Z @llvm-project//mlir:LinalgTransforms; 57s local 2024-12-18T01:05:46.4415209Z @stablehlo//:linalg_passes; 43s local 2024-12-18T01:05:46.4415861Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:05:46.4416713Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:46.4417330Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:46.4417978Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 14s local 2024-12-18T01:05:46.4419133Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 14s local 2024-12-18T01:05:46.4420010Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T01:05:46.6412267Z 2024-12-18T01:05:46.6413180Z  2024-12-18T01:05:46.6413591Z  2024-12-18T01:05:46.6413964Z  2024-12-18T01:05:46.6414321Z  2024-12-18T01:05:46.6414692Z  2024-12-18T01:05:46.6415046Z  2024-12-18T01:05:46.6415427Z  2024-12-18T01:05:46.6415804Z  2024-12-18T01:05:46.6416933Z [20,081 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:46.6418211Z @llvm-project//mlir:LinalgTransforms; 57s local 2024-12-18T01:05:46.6418836Z @stablehlo//:linalg_passes; 43s local 2024-12-18T01:05:46.6419431Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:05:46.6420072Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:46.6420894Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:46.6421636Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 14s local 2024-12-18T01:05:46.6422698Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 14s local 2024-12-18T01:05:46.6423602Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2024-12-18T01:05:47.4239886Z 2024-12-18T01:05:47.4240745Z  2024-12-18T01:05:47.4241149Z  2024-12-18T01:05:47.4241536Z  2024-12-18T01:05:47.4241893Z  2024-12-18T01:05:47.4242283Z  2024-12-18T01:05:47.4242632Z  2024-12-18T01:05:47.4243068Z  2024-12-18T01:05:47.4243470Z  2024-12-18T01:05:47.4244989Z [20,082 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:47.4246004Z @llvm-project//mlir:LinalgTransforms; 58s local 2024-12-18T01:05:47.4246655Z @stablehlo//:linalg_passes; 44s local 2024-12-18T01:05:47.4247212Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:05:47.4247939Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:47.4248603Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2024-12-18T01:05:47.4249606Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 15s local 2024-12-18T01:05:47.4250675Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 15s local 2024-12-18T01:05:47.4251522Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2024-12-18T01:05:47.6419806Z 2024-12-18T01:05:47.6420659Z  2024-12-18T01:05:47.6421092Z  2024-12-18T01:05:47.6421486Z  2024-12-18T01:05:47.6421913Z  2024-12-18T01:05:47.6422264Z  2024-12-18T01:05:47.6422656Z  2024-12-18T01:05:47.6423020Z  2024-12-18T01:05:47.6423389Z  2024-12-18T01:05:47.6424298Z [20,082 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:47.6425119Z @llvm-project//mlir:LinalgTransforms; 58s local 2024-12-18T01:05:47.6425659Z @stablehlo//:linalg_passes; 44s local 2024-12-18T01:05:47.6426238Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:05:47.6426803Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:47.6427505Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2024-12-18T01:05:47.6428527Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 15s local 2024-12-18T01:05:47.6429583Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 15s local 2024-12-18T01:05:47.6430447Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2024-12-18T01:05:47.9161987Z 2024-12-18T01:05:47.9162859Z  2024-12-18T01:05:47.9163370Z  2024-12-18T01:05:47.9163769Z  2024-12-18T01:05:47.9164146Z  2024-12-18T01:05:47.9164534Z  2024-12-18T01:05:47.9164896Z  2024-12-18T01:05:47.9165303Z  2024-12-18T01:05:47.9165671Z  2024-12-18T01:05:47.9166577Z [20,083 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:47.9167514Z @llvm-project//mlir:LinalgTransforms; 58s local 2024-12-18T01:05:47.9168181Z @stablehlo//:linalg_passes; 44s local 2024-12-18T01:05:47.9168794Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:05:47.9169461Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:47.9170115Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:47.9170924Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 16s local 2024-12-18T01:05:47.9171913Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local 2024-12-18T01:05:47.9173100Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2024-12-18T01:05:48.2313570Z 2024-12-18T01:05:48.2314631Z  2024-12-18T01:05:48.2315124Z  2024-12-18T01:05:48.2315513Z  2024-12-18T01:05:48.2315903Z  2024-12-18T01:05:48.2316259Z  2024-12-18T01:05:48.2316632Z  2024-12-18T01:05:48.2317040Z  2024-12-18T01:05:48.2317403Z  2024-12-18T01:05:48.2318545Z [20,086 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:48.2319473Z @llvm-project//mlir:LinalgTransforms; 58s local 2024-12-18T01:05:48.2320125Z @stablehlo//:linalg_passes; 44s local 2024-12-18T01:05:48.2320746Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:05:48.2321428Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:05:48.2322060Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:48.2322889Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local 2024-12-18T01:05:48.2323743Z @llvm-project//mlir:LinalgTransforms; 16s local 2024-12-18T01:05:48.2324634Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2024-12-18T01:05:48.4425663Z 2024-12-18T01:05:48.4426519Z  2024-12-18T01:05:48.4426978Z  2024-12-18T01:05:48.4427328Z  2024-12-18T01:05:48.4427689Z  2024-12-18T01:05:48.4428178Z  2024-12-18T01:05:48.4428560Z  2024-12-18T01:05:48.4428987Z  2024-12-18T01:05:48.4429349Z  2024-12-18T01:05:48.4430504Z [20,087 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:48.4431447Z @llvm-project//mlir:LinalgTransforms; 59s local 2024-12-18T01:05:48.4432006Z @stablehlo//:linalg_passes; 45s local 2024-12-18T01:05:48.4433067Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:05:48.4433721Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:05:48.4434365Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:48.4435208Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local 2024-12-18T01:05:48.4436096Z @llvm-project//mlir:LinalgTransforms; 16s local 2024-12-18T01:05:48.4436782Z @xla//xla/mlir_hlo:mhlo_passes; 15s local ... 2024-12-18T01:05:49.1203100Z 2024-12-18T01:05:49.1203960Z  2024-12-18T01:05:49.1204386Z  2024-12-18T01:05:49.1204752Z  2024-12-18T01:05:49.1205145Z  2024-12-18T01:05:49.1205481Z  2024-12-18T01:05:49.1205823Z  2024-12-18T01:05:49.1206168Z  2024-12-18T01:05:49.1206517Z  2024-12-18T01:05:49.1207312Z [20,088 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:49.1208137Z @llvm-project//mlir:LinalgTransforms; 59s local 2024-12-18T01:05:49.1208724Z @stablehlo//:linalg_passes; 45s local 2024-12-18T01:05:49.1209247Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:05:49.1210264Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T01:05:49.1210868Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:05:49.1211585Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local 2024-12-18T01:05:49.1212375Z @llvm-project//mlir:LinalgTransforms; 17s local 2024-12-18T01:05:49.1212976Z @xla//xla/mlir_hlo:mhlo_passes; 15s local ... 2024-12-18T01:05:49.3963288Z 2024-12-18T01:05:49.3964092Z  2024-12-18T01:05:49.3964508Z  2024-12-18T01:05:49.3964849Z  2024-12-18T01:05:49.3965197Z  2024-12-18T01:05:49.3965535Z  2024-12-18T01:05:49.3965868Z  2024-12-18T01:05:49.3966215Z  2024-12-18T01:05:49.3966566Z  2024-12-18T01:05:49.3967380Z [20,091 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:49.3968227Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T01:05:49.3968831Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:05:49.3969394Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:05:49.3970385Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local 2024-12-18T01:05:49.3971161Z @llvm-project//mlir:LinalgTransforms; 17s local 2024-12-18T01:05:49.3971768Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:49.3972442Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 15s local 2024-12-18T01:05:49.3973154Z @xla//xla/mlir_hlo:mhlo_passes; 12s local ... 2024-12-18T01:05:49.6433644Z 2024-12-18T01:05:49.6434415Z  2024-12-18T01:05:49.6434815Z  2024-12-18T01:05:49.6435166Z  2024-12-18T01:05:49.6435505Z  2024-12-18T01:05:49.6435840Z  2024-12-18T01:05:49.6436184Z  2024-12-18T01:05:49.6436509Z  2024-12-18T01:05:49.6436810Z  2024-12-18T01:05:49.6437636Z [20,092 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:49.6438514Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T01:05:49.6439113Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:05:49.6439727Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:05:49.6440727Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local 2024-12-18T01:05:49.6441477Z @llvm-project//mlir:LinalgTransforms; 17s local 2024-12-18T01:05:49.6442049Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:49.6442764Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 15s local 2024-12-18T01:05:49.6443498Z @xla//xla/mlir_hlo:mhlo_passes; 12s local ... 2024-12-18T01:05:50.0438544Z 2024-12-18T01:05:50.0439393Z  2024-12-18T01:05:50.0439922Z  2024-12-18T01:05:50.0440374Z  2024-12-18T01:05:50.0440839Z  2024-12-18T01:05:50.0441305Z  2024-12-18T01:05:50.0441761Z  2024-12-18T01:05:50.0442203Z  2024-12-18T01:05:50.0442666Z  2024-12-18T01:05:50.0443651Z [20,094 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:50.0444959Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T01:05:50.0455097Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:05:50.0456032Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:05:50.0457133Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 18s local 2024-12-18T01:05:50.0458122Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T01:05:50.0459061Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 15s local 2024-12-18T01:05:50.0459893Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:50.0460540Z @xla//xla/mlir_hlo:mhlo_passes; 11s local ... 2024-12-18T01:05:50.2457255Z 2024-12-18T01:05:50.2458114Z  2024-12-18T01:05:50.2458602Z  2024-12-18T01:05:50.2458976Z  2024-12-18T01:05:50.2459341Z  2024-12-18T01:05:50.2459745Z  2024-12-18T01:05:50.2460108Z  2024-12-18T01:05:50.2460484Z  2024-12-18T01:05:50.2460813Z  2024-12-18T01:05:50.2461731Z [20,095 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:50.2462684Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T01:05:50.2463301Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:05:50.2463903Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:05:50.2464633Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 18s local 2024-12-18T01:05:50.2465500Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T01:05:50.2466326Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2024-12-18T01:05:50.2467256Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:50.2467877Z @xla//xla/mlir_hlo:mhlo_passes; 11s local ... 2024-12-18T01:05:50.5140082Z 2024-12-18T01:05:50.5140968Z  2024-12-18T01:05:50.5141414Z  2024-12-18T01:05:50.5141802Z  2024-12-18T01:05:50.5142179Z  2024-12-18T01:05:50.5142542Z  2024-12-18T01:05:50.5143249Z  2024-12-18T01:05:50.5143612Z  2024-12-18T01:05:50.5143989Z  2024-12-18T01:05:50.5145101Z [20,096 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:50.5146017Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T01:05:50.5146540Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:05:50.5147000Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:05:50.5148102Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 18s local 2024-12-18T01:05:50.5148926Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T01:05:50.5149669Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2024-12-18T01:05:50.5150458Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:50.5151061Z @xla//xla/mlir_hlo:mhlo_passes; 12s local ... 2024-12-18T01:05:50.7699364Z 2024-12-18T01:05:50.7700202Z  2024-12-18T01:05:50.7700671Z  2024-12-18T01:05:50.7701091Z  2024-12-18T01:05:50.7701485Z  2024-12-18T01:05:50.7701879Z  2024-12-18T01:05:50.7702269Z  2024-12-18T01:05:50.7702970Z  2024-12-18T01:05:50.7703368Z  2024-12-18T01:05:50.7704306Z [20,097 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:50.7705261Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T01:05:50.7705972Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:05:50.7706615Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:05:50.7707411Z @llvm-project//mlir:LinalgTransforms; 18s local 2024-12-18T01:05:50.7708280Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2024-12-18T01:05:50.7709102Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:50.7709716Z @xla//xla/mlir_hlo:mhlo_passes; 12s local 2024-12-18T01:05:50.7710369Z @xla//xla/mlir_hlo:mhlo_passes; 11s local ... 2024-12-18T01:05:51.0185644Z 2024-12-18T01:05:51.0186567Z  2024-12-18T01:05:51.0187011Z  2024-12-18T01:05:51.0187401Z  2024-12-18T01:05:51.0187783Z  2024-12-18T01:05:51.0188171Z  2024-12-18T01:05:51.0188555Z  2024-12-18T01:05:51.0188901Z  2024-12-18T01:05:51.0189291Z  2024-12-18T01:05:51.0190140Z [20,098 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:51.0191045Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T01:05:51.0191714Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:05:51.0192340Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:05:51.0192988Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T01:05:51.0193887Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2024-12-18T01:05:51.0194727Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:51.0195350Z @xla//xla/mlir_hlo:mhlo_passes; 12s local 2024-12-18T01:05:51.0196001Z @xla//xla/mlir_hlo:mhlo_passes; 11s local ... 2024-12-18T01:05:51.2446980Z 2024-12-18T01:05:51.2447940Z  2024-12-18T01:05:51.2448576Z  2024-12-18T01:05:51.2448921Z  2024-12-18T01:05:51.2449281Z  2024-12-18T01:05:51.2449668Z  2024-12-18T01:05:51.2450038Z  2024-12-18T01:05:51.2450403Z  2024-12-18T01:05:51.2450802Z  2024-12-18T01:05:51.2451765Z [20,099 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:51.2452715Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T01:05:51.2453410Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:05:51.2454000Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:05:51.2454665Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T01:05:51.2455476Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local 2024-12-18T01:05:51.2456255Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:51.2457504Z @xla//xla/mlir_hlo:mhlo_passes; 12s local 2024-12-18T01:05:51.2458193Z @llvm-project//mlir:SCFTransforms; 11s local ... 2024-12-18T01:05:51.4931253Z 2024-12-18T01:05:51.4932069Z  2024-12-18T01:05:51.4932545Z  2024-12-18T01:05:51.4932955Z  2024-12-18T01:05:51.4933342Z  2024-12-18T01:05:51.4933737Z  2024-12-18T01:05:51.4934106Z  2024-12-18T01:05:51.4934492Z  2024-12-18T01:05:51.4935204Z  2024-12-18T01:05:51.4936114Z [20,100 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:51.4937179Z @llvm-project//mlir:LinalgTransforms; 62s local 2024-12-18T01:05:51.4937843Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:51.4938477Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:05:51.4939130Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T01:05:51.4939987Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local 2024-12-18T01:05:51.4940811Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:51.4941429Z @xla//xla/mlir_hlo:mhlo_passes; 12s local 2024-12-18T01:05:51.4942326Z @llvm-project//mlir:SCFTransforms; 12s local ... 2024-12-18T01:05:51.8451358Z 2024-12-18T01:05:51.8452200Z  2024-12-18T01:05:51.8452635Z  2024-12-18T01:05:51.8453041Z  2024-12-18T01:05:51.8453444Z  2024-12-18T01:05:51.8453879Z  2024-12-18T01:05:51.8454247Z  2024-12-18T01:05:51.8454598Z  2024-12-18T01:05:51.8454922Z  2024-12-18T01:05:51.8456084Z [20,100 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:51.8457161Z @llvm-project//mlir:LinalgTransforms; 62s local 2024-12-18T01:05:51.8457784Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:51.8458498Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:05:51.8459146Z @llvm-project//mlir:LinalgTransforms; 19s local 2024-12-18T01:05:51.8459808Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local 2024-12-18T01:05:51.8460539Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:51.8461118Z @xla//xla/mlir_hlo:mhlo_passes; 12s local 2024-12-18T01:05:51.8461708Z @llvm-project//mlir:SCFTransforms; 12s local ... 2024-12-18T01:05:52.1027862Z 2024-12-18T01:05:52.1028715Z  2024-12-18T01:05:52.1029214Z  2024-12-18T01:05:52.1029641Z  2024-12-18T01:05:52.1030037Z  2024-12-18T01:05:52.1030425Z  2024-12-18T01:05:52.1030791Z  2024-12-18T01:05:52.1031173Z  2024-12-18T01:05:52.1031554Z  2024-12-18T01:05:52.1032457Z [20,101 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:52.1033359Z @llvm-project//mlir:LinalgTransforms; 62s local 2024-12-18T01:05:52.1034045Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:52.1034670Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:05:52.1035338Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:52.1036215Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local 2024-12-18T01:05:52.1036995Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:52.1037612Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:52.1038291Z @llvm-project//mlir:SCFTransforms; 12s local ... 2024-12-18T01:05:52.4265023Z 2024-12-18T01:05:52.4265867Z  2024-12-18T01:05:52.4266351Z  2024-12-18T01:05:52.4266753Z  2024-12-18T01:05:52.4267146Z  2024-12-18T01:05:52.4267541Z  2024-12-18T01:05:52.4267939Z  2024-12-18T01:05:52.4268323Z  2024-12-18T01:05:52.4268698Z  2024-12-18T01:05:52.4269627Z [20,102 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:52.4270578Z @llvm-project//mlir:LinalgTransforms; 63s local 2024-12-18T01:05:52.4271278Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:52.4272285Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:05:52.4272979Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:52.4273809Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local 2024-12-18T01:05:52.4274624Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:52.4275273Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:52.4276068Z @llvm-project//mlir:SCFTransforms; 13s local ... 2024-12-18T01:05:52.6315252Z 2024-12-18T01:05:52.6316201Z  2024-12-18T01:05:52.6316664Z  2024-12-18T01:05:52.6317116Z  2024-12-18T01:05:52.6317528Z  2024-12-18T01:05:52.6317934Z  2024-12-18T01:05:52.6318316Z  2024-12-18T01:05:52.6318736Z  2024-12-18T01:05:52.6319135Z  2024-12-18T01:05:52.6320070Z [20,104 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:52.6321049Z @llvm-project//mlir:LinalgTransforms; 63s local 2024-12-18T01:05:52.6321742Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:05:52.6322606Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:05:52.6323216Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:52.6323853Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local 2024-12-18T01:05:52.6324506Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:52.6325201Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:52.6325976Z @llvm-project//mlir:SCFTransforms; 13s local ... 2024-12-18T01:05:52.8459099Z 2024-12-18T01:05:52.8459962Z  2024-12-18T01:05:52.8460441Z  2024-12-18T01:05:52.8460851Z  2024-12-18T01:05:52.8461238Z  2024-12-18T01:05:52.8461601Z  2024-12-18T01:05:52.8461998Z  2024-12-18T01:05:52.8462391Z  2024-12-18T01:05:52.8462790Z  2024-12-18T01:05:52.8463753Z [20,105 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:52.8464707Z @llvm-project//mlir:LinalgTransforms; 63s local 2024-12-18T01:05:52.8465417Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:05:52.8466038Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:05:52.8466687Z @llvm-project//mlir:LinalgTransforms; 20s local 2024-12-18T01:05:52.8467468Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local 2024-12-18T01:05:52.8468229Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:52.8468801Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:52.8469442Z @llvm-project//mlir:SCFTransforms; 13s local ... 2024-12-18T01:05:53.2411527Z 2024-12-18T01:05:53.2412412Z  2024-12-18T01:05:53.2412841Z  2024-12-18T01:05:53.2413218Z  2024-12-18T01:05:53.2413602Z  2024-12-18T01:05:53.2413964Z  2024-12-18T01:05:53.2414319Z  2024-12-18T01:05:53.2414693Z  2024-12-18T01:05:53.2415041Z  2024-12-18T01:05:53.2415953Z [20,106 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:53.2417071Z @llvm-project//mlir:LinalgTransforms; 63s local 2024-12-18T01:05:53.2417694Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:05:53.2418440Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:05:53.2419101Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:53.2419946Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local 2024-12-18T01:05:53.2420786Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:53.2421415Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:53.2422102Z @llvm-project//mlir:SCFTransforms; 13s local ... 2024-12-18T01:05:53.4463245Z 2024-12-18T01:05:53.4464123Z  2024-12-18T01:05:53.4464595Z  2024-12-18T01:05:53.4464995Z  2024-12-18T01:05:53.4465374Z  2024-12-18T01:05:53.4465756Z  2024-12-18T01:05:53.4466125Z  2024-12-18T01:05:53.4466841Z  2024-12-18T01:05:53.4467215Z  2024-12-18T01:05:53.4468135Z [20,106 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:53.4469094Z @llvm-project//mlir:LinalgTransforms; 64s local 2024-12-18T01:05:53.4469736Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:05:53.4470356Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:05:53.4471206Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:53.4472024Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local 2024-12-18T01:05:53.4472783Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:53.4473398Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:53.4474060Z @llvm-project//mlir:SCFTransforms; 14s local ... 2024-12-18T01:05:53.9341468Z 2024-12-18T01:05:53.9342321Z  2024-12-18T01:05:53.9342822Z  2024-12-18T01:05:53.9343232Z  2024-12-18T01:05:53.9343631Z  2024-12-18T01:05:53.9344017Z  2024-12-18T01:05:53.9344663Z  2024-12-18T01:05:53.9345051Z  2024-12-18T01:05:53.9345456Z  2024-12-18T01:05:53.9346598Z [20,107 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:53.9347557Z @llvm-project//mlir:LinalgTransforms; 64s local 2024-12-18T01:05:53.9348257Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:05:53.9348899Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:05:53.9349575Z @llvm-project//mlir:LinalgTransforms; 21s local 2024-12-18T01:05:53.9350624Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local 2024-12-18T01:05:53.9351429Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:53.9352065Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:53.9352722Z @llvm-project//mlir:SCFTransforms; 14s local ... 2024-12-18T01:05:54.2075340Z 2024-12-18T01:05:54.2076247Z  2024-12-18T01:05:54.2076762Z  2024-12-18T01:05:54.2077128Z  2024-12-18T01:05:54.2077436Z  2024-12-18T01:05:54.2077732Z  2024-12-18T01:05:54.2078030Z  2024-12-18T01:05:54.2078349Z  2024-12-18T01:05:54.2078727Z  2024-12-18T01:05:54.2079603Z [20,108 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:54.2080515Z @llvm-project//mlir:LinalgTransforms; 64s local 2024-12-18T01:05:54.2081093Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:05:54.2081642Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:05:54.2082185Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:54.2082922Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 20s local 2024-12-18T01:05:54.2083623Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:54.2084127Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:54.2084633Z @llvm-project//mlir:SCFTransforms; 14s local ... 2024-12-18T01:05:54.4213988Z 2024-12-18T01:05:54.4214901Z  2024-12-18T01:05:54.4215375Z  2024-12-18T01:05:54.4215765Z  2024-12-18T01:05:54.4216166Z  2024-12-18T01:05:54.4216711Z  2024-12-18T01:05:54.4217107Z  2024-12-18T01:05:54.4217474Z  2024-12-18T01:05:54.4217832Z  2024-12-18T01:05:54.4218711Z [20,109 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:54.4219638Z @llvm-project//mlir:LinalgTransforms; 65s local 2024-12-18T01:05:54.4220343Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:05:54.4220978Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:05:54.4221676Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:54.4222337Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:54.4222912Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:54.4223565Z @llvm-project//mlir:SCFTransforms; 15s local 2024-12-18T01:05:54.4224508Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2024-12-18T01:05:54.6470793Z 2024-12-18T01:05:54.6471620Z  2024-12-18T01:05:54.6472116Z  2024-12-18T01:05:54.6472479Z  2024-12-18T01:05:54.6472851Z  2024-12-18T01:05:54.6473210Z  2024-12-18T01:05:54.6473579Z  2024-12-18T01:05:54.6473929Z  2024-12-18T01:05:54.6474291Z  2024-12-18T01:05:54.6475178Z [20,111 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:54.6476404Z @llvm-project//mlir:LinalgTransforms; 65s local 2024-12-18T01:05:54.6477033Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:05:54.6477629Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:05:54.6478265Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:54.6478851Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:54.6479477Z @llvm-project//mlir:SCFTransforms; 15s local 2024-12-18T01:05:54.6480080Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:54.6480725Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2024-12-18T01:05:54.8485419Z 2024-12-18T01:05:54.8486574Z  2024-12-18T01:05:54.8487068Z  2024-12-18T01:05:54.8487453Z  2024-12-18T01:05:54.8487973Z  2024-12-18T01:05:54.8488359Z  2024-12-18T01:05:54.8488727Z  2024-12-18T01:05:54.8489097Z  2024-12-18T01:05:54.8489467Z  2024-12-18T01:05:54.8490388Z [20,112 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:54.8491451Z @llvm-project//mlir:LinalgTransforms; 65s local 2024-12-18T01:05:54.8492135Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:05:54.8492798Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:05:54.8493423Z @llvm-project//mlir:LinalgTransforms; 22s local 2024-12-18T01:05:54.8494104Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:54.8494789Z @llvm-project//mlir:SCFTransforms; 15s local 2024-12-18T01:05:54.8495479Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:54.8496189Z @llvm-project//mlir:SCFToControlFlow; 13s local ... 2024-12-18T01:05:55.1331893Z 2024-12-18T01:05:55.1332753Z  2024-12-18T01:05:55.1333261Z  2024-12-18T01:05:55.1333687Z  2024-12-18T01:05:55.1334097Z  2024-12-18T01:05:55.1334506Z  2024-12-18T01:05:55.1334948Z  2024-12-18T01:05:55.1335339Z  2024-12-18T01:05:55.1335706Z  2024-12-18T01:05:55.1336691Z [20,113 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:55.1337500Z @llvm-project//mlir:LinalgTransforms; 65s local 2024-12-18T01:05:55.1338092Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:05:55.1338658Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:05:55.1339270Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:55.1339839Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:55.1340481Z @llvm-project//mlir:SCFTransforms; 15s local 2024-12-18T01:05:55.1341165Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:55.1341884Z @llvm-project//mlir:SCFToControlFlow; 13s local ... 2024-12-18T01:05:55.4479060Z 2024-12-18T01:05:55.4479958Z  2024-12-18T01:05:55.4480374Z  2024-12-18T01:05:55.4480754Z  2024-12-18T01:05:55.4481138Z  2024-12-18T01:05:55.4481568Z  2024-12-18T01:05:55.4481978Z  2024-12-18T01:05:55.4482351Z  2024-12-18T01:05:55.4482703Z  2024-12-18T01:05:55.4483644Z [20,114 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:55.4484613Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T01:05:55.4485291Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:05:55.4485911Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:05:55.4486578Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:55.4487544Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:55.4488202Z @llvm-project//mlir:SCFTransforms; 16s local 2024-12-18T01:05:55.4488870Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:55.4489577Z @llvm-project//mlir:SCFToControlFlow; 13s local ... 2024-12-18T01:05:55.9610797Z 2024-12-18T01:05:55.9611669Z  2024-12-18T01:05:55.9612096Z  2024-12-18T01:05:55.9612717Z  2024-12-18T01:05:55.9613059Z  2024-12-18T01:05:55.9613388Z  2024-12-18T01:05:55.9613731Z  2024-12-18T01:05:55.9614087Z  2024-12-18T01:05:55.9614425Z  2024-12-18T01:05:55.9615227Z [20,115 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:55.9616059Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T01:05:55.9616819Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:05:55.9617380Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:05:55.9617980Z @llvm-project//mlir:LinalgTransforms; 23s local 2024-12-18T01:05:55.9618576Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:55.9619296Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:55.9619919Z @llvm-project//mlir:SCFToControlFlow; 14s local 2024-12-18T01:05:55.9620515Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2024-12-18T01:05:56.1879079Z 2024-12-18T01:05:56.1879967Z  2024-12-18T01:05:56.1880339Z  2024-12-18T01:05:56.1880677Z  2024-12-18T01:05:56.1881001Z  2024-12-18T01:05:56.1881586Z  2024-12-18T01:05:56.1881907Z  2024-12-18T01:05:56.1882228Z  2024-12-18T01:05:56.1882555Z  2024-12-18T01:05:56.1883324Z [20,116 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:56.1884076Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T01:05:56.1884608Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:05:56.1885125Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:05:56.1885669Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:05:56.1886226Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:56.1886767Z @llvm-project//mlir:SCFToControlFlow; 14s local 2024-12-18T01:05:56.1887299Z @xla//xla/mlir_hlo:mhlo_passes; 13s local 2024-12-18T01:05:56.1887835Z @llvm-project//mlir:SCFTransforms; 12s local ... 2024-12-18T01:05:56.4485333Z 2024-12-18T01:05:56.4486167Z  2024-12-18T01:05:56.4486601Z  2024-12-18T01:05:56.4486956Z  2024-12-18T01:05:56.4487341Z  2024-12-18T01:05:56.4487674Z  2024-12-18T01:05:56.4488018Z  2024-12-18T01:05:56.4488366Z  2024-12-18T01:05:56.4488704Z  2024-12-18T01:05:56.4489521Z [20,116 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:56.4490404Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T01:05:56.4491018Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:05:56.4491576Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:05:56.4492178Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:05:56.4492795Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:56.4493390Z @llvm-project//mlir:SCFToControlFlow; 14s local 2024-12-18T01:05:56.4493994Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:56.4494606Z @llvm-project//mlir:SCFTransforms; 13s local ... 2024-12-18T01:05:56.7410755Z 2024-12-18T01:05:56.7411614Z  2024-12-18T01:05:56.7412093Z  2024-12-18T01:05:56.7412459Z  2024-12-18T01:05:56.7412818Z  2024-12-18T01:05:56.7413151Z  2024-12-18T01:05:56.7413493Z  2024-12-18T01:05:56.7413845Z  2024-12-18T01:05:56.7414194Z  2024-12-18T01:05:56.7415017Z [20,118 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:56.7415915Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T01:05:56.7416968Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:05:56.7417543Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:56.7418134Z @llvm-project//mlir:LinalgTransforms; 24s local 2024-12-18T01:05:56.7418720Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:56.7419306Z @llvm-project//mlir:SCFToControlFlow; 15s local 2024-12-18T01:05:56.7420044Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:56.7420650Z @llvm-project//mlir:SCFTransforms; 13s local ... 2024-12-18T01:05:57.0489977Z 2024-12-18T01:05:57.0490783Z  2024-12-18T01:05:57.0491186Z  2024-12-18T01:05:57.0491508Z  2024-12-18T01:05:57.0491848Z  2024-12-18T01:05:57.0492177Z  2024-12-18T01:05:57.0492507Z  2024-12-18T01:05:57.0492829Z  2024-12-18T01:05:57.0493134Z  2024-12-18T01:05:57.0493899Z [20,119 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:57.0494698Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T01:05:57.0495531Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:05:57.0496051Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:57.0496725Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T01:05:57.0497271Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:57.0497823Z @llvm-project//mlir:SCFToControlFlow; 15s local 2024-12-18T01:05:57.0498368Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:05:57.0499068Z @llvm-project//mlir:SCFTransforms; 13s local ... 2024-12-18T01:05:57.3378822Z 2024-12-18T01:05:57.3379685Z  2024-12-18T01:05:57.3380151Z  2024-12-18T01:05:57.3380521Z  2024-12-18T01:05:57.3380850Z  2024-12-18T01:05:57.3381211Z  2024-12-18T01:05:57.3381575Z  2024-12-18T01:05:57.3381905Z  2024-12-18T01:05:57.3382260Z  2024-12-18T01:05:57.3383118Z [20,120 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:57.3384104Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T01:05:57.3384748Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:05:57.3385372Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:57.3386020Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T01:05:57.3386854Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:57.3387525Z @llvm-project//mlir:SCFToControlFlow; 15s local 2024-12-18T01:05:57.3388224Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:57.3388889Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2024-12-18T01:05:57.6495610Z 2024-12-18T01:05:57.6496575Z  2024-12-18T01:05:57.6497043Z  2024-12-18T01:05:57.6497446Z  2024-12-18T01:05:57.6497835Z  2024-12-18T01:05:57.6498211Z  2024-12-18T01:05:57.6498608Z  2024-12-18T01:05:57.6499005Z  2024-12-18T01:05:57.6499424Z  2024-12-18T01:05:57.6500369Z [20,121 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:57.6501330Z @llvm-project//mlir:LinalgTransforms; 68s local 2024-12-18T01:05:57.6502005Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:05:57.6502641Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:05:57.6503321Z @llvm-project//mlir:LinalgTransforms; 25s local 2024-12-18T01:05:57.6503999Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:57.6504652Z @llvm-project//mlir:SCFToControlFlow; 16s local 2024-12-18T01:05:57.6505334Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:57.6505966Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2024-12-18T01:05:58.0500076Z 2024-12-18T01:05:58.0500903Z  2024-12-18T01:05:58.0501513Z  2024-12-18T01:05:58.0501907Z  2024-12-18T01:05:58.0502248Z  2024-12-18T01:05:58.0502653Z  2024-12-18T01:05:58.0503314Z  2024-12-18T01:05:58.0503709Z  2024-12-18T01:05:58.0504083Z  2024-12-18T01:05:58.0504802Z [20,122 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:58.0505744Z @llvm-project//mlir:LinalgTransforms; 68s local 2024-12-18T01:05:58.0506438Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:05:58.0507059Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:05:58.0507898Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T01:05:58.0508592Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2024-12-18T01:05:58.0509261Z @llvm-project//mlir:SCFToControlFlow; 16s local 2024-12-18T01:05:58.0509945Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:05:58.0510574Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2024-12-18T01:05:58.6504752Z 2024-12-18T01:05:58.6505561Z  2024-12-18T01:05:58.6505972Z  2024-12-18T01:05:58.6506315Z  2024-12-18T01:05:58.6506649Z  2024-12-18T01:05:58.6506998Z  2024-12-18T01:05:58.6507335Z  2024-12-18T01:05:58.6507671Z  2024-12-18T01:05:58.6508223Z  2024-12-18T01:05:58.6508990Z [20,123 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:05:58.6509924Z @llvm-project//mlir:LinalgTransforms; 69s local 2024-12-18T01:05:58.6510514Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:05:58.6511074Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:05:58.6511950Z @llvm-project//mlir:LinalgTransforms; 26s local 2024-12-18T01:05:58.6512553Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2024-12-18T01:05:58.6513112Z @llvm-project//mlir:SCFToControlFlow; 17s local 2024-12-18T01:05:58.6513719Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:58.6514311Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2024-12-18T01:05:59.0508638Z 2024-12-18T01:05:59.0509409Z  2024-12-18T01:05:59.0509815Z  2024-12-18T01:05:59.0510191Z  2024-12-18T01:05:59.0510502Z  2024-12-18T01:05:59.0510827Z  2024-12-18T01:05:59.0511149Z  2024-12-18T01:05:59.0511483Z  2024-12-18T01:05:59.0511795Z  2024-12-18T01:05:59.0512585Z [20,125 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:59.0513397Z @llvm-project//mlir:LinalgTransforms; 69s local 2024-12-18T01:05:59.0513976Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:05:59.0514495Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:05:59.0515050Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:59.0515634Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:59.0516157Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:05:59.0516695Z Compiling xla/pjrt/mlir_to_hlo.cc; 14s local 2024-12-18T01:05:59.0517396Z Compiling xla/mlir_hlo/transforms/vectorize_copy.cc; 13s local ... 2024-12-18T01:05:59.3750479Z 2024-12-18T01:05:59.3751344Z  2024-12-18T01:05:59.3751740Z  2024-12-18T01:05:59.3752051Z  2024-12-18T01:05:59.3752387Z  2024-12-18T01:05:59.3752861Z  2024-12-18T01:05:59.3753155Z  2024-12-18T01:05:59.3753459Z  2024-12-18T01:05:59.3753761Z  2024-12-18T01:05:59.3754470Z [20,126 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:59.3755189Z @llvm-project//mlir:LinalgTransforms; 69s local 2024-12-18T01:05:59.3755701Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:05:59.3756182Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:05:59.3756681Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:59.3757191Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:59.3757661Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:59.3758241Z Compiling xla/pjrt/mlir_to_hlo.cc; 14s local 2024-12-18T01:05:59.3759012Z Compiling xla/mlir_hlo/transforms/vectorize_copy.cc; 14s local ... 2024-12-18T01:05:59.6295624Z 2024-12-18T01:05:59.6296232Z  2024-12-18T01:05:59.6296893Z  2024-12-18T01:05:59.6297322Z  2024-12-18T01:05:59.6297702Z  2024-12-18T01:05:59.6298040Z  2024-12-18T01:05:59.6298346Z  2024-12-18T01:05:59.6298658Z  2024-12-18T01:05:59.6298962Z  2024-12-18T01:05:59.6299677Z [20,127 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:05:59.6300743Z @llvm-project//mlir:LinalgTransforms; 70s local 2024-12-18T01:05:59.6301383Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:05:59.6302129Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:05:59.6302797Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:59.6303431Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:59.6304007Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:59.6304631Z Compiling xla/pjrt/mlir_to_hlo.cc; 14s local 2024-12-18T01:05:59.6305419Z Compiling xla/mlir_hlo/transforms/vectorize_copy.cc; 14s local ... 2024-12-18T01:05:59.8515442Z 2024-12-18T01:05:59.8516306Z  2024-12-18T01:05:59.8516755Z  2024-12-18T01:05:59.8517076Z  2024-12-18T01:05:59.8517357Z  2024-12-18T01:05:59.8517652Z  2024-12-18T01:05:59.8517947Z  2024-12-18T01:05:59.8518235Z  2024-12-18T01:05:59.8518574Z  2024-12-18T01:05:59.8519441Z [20,128 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:05:59.8520350Z @llvm-project//mlir:LinalgTransforms; 70s local 2024-12-18T01:05:59.8521002Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:05:59.8521560Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:05:59.8522039Z @llvm-project//mlir:LinalgTransforms; 27s local 2024-12-18T01:05:59.8522539Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:05:59.8523046Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:05:59.8523531Z Compiling xla/pjrt/mlir_to_hlo.cc; 15s local 2024-12-18T01:05:59.8524243Z Compiling xla/mlir_hlo/transforms/vectorize_copy.cc; 14s local ... 2024-12-18T01:06:00.0540665Z 2024-12-18T01:06:00.0541535Z  2024-12-18T01:06:00.0542054Z  2024-12-18T01:06:00.0542451Z  2024-12-18T01:06:00.0542867Z  2024-12-18T01:06:00.0543284Z  2024-12-18T01:06:00.0543641Z  2024-12-18T01:06:00.0543982Z  2024-12-18T01:06:00.0544614Z  2024-12-18T01:06:00.0545530Z [20,129 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:00.0546508Z @llvm-project//mlir:LinalgTransforms; 70s local 2024-12-18T01:06:00.0547249Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:06:00.0547832Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:00.0548505Z @llvm-project//mlir:LinalgTransforms; 28s local 2024-12-18T01:06:00.0549193Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:06:00.0549821Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2024-12-18T01:06:00.0550448Z Compiling xla/pjrt/mlir_to_hlo.cc; 15s local 2024-12-18T01:06:00.0551111Z @xla//xla/mlir_hlo:mhlo_passes; 12s local ... 2024-12-18T01:06:00.4520446Z 2024-12-18T01:06:00.4521355Z  2024-12-18T01:06:00.4521856Z  2024-12-18T01:06:00.4522225Z  2024-12-18T01:06:00.4522648Z  2024-12-18T01:06:00.4523038Z  2024-12-18T01:06:00.4523384Z  2024-12-18T01:06:00.4523754Z  2024-12-18T01:06:00.4524141Z  2024-12-18T01:06:00.4525059Z [20,130 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:00.4526092Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T01:06:00.4526717Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T01:06:00.4527287Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:00.4527921Z @llvm-project//mlir:LinalgTransforms; 28s local 2024-12-18T01:06:00.4528863Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:06:00.4529449Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2024-12-18T01:06:00.4530069Z Compiling xla/pjrt/mlir_to_hlo.cc; 15s local 2024-12-18T01:06:00.4530732Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2024-12-18T01:06:01.2903982Z 2024-12-18T01:06:01.2904820Z  2024-12-18T01:06:01.2905598Z  2024-12-18T01:06:01.2905944Z  2024-12-18T01:06:01.2906308Z  2024-12-18T01:06:01.2906688Z  2024-12-18T01:06:01.2907066Z  2024-12-18T01:06:01.2907417Z  2024-12-18T01:06:01.2907778Z  2024-12-18T01:06:01.2908713Z [20,131 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:01.2909692Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T01:06:01.2910364Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T01:06:01.2911008Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:06:01.2911670Z @llvm-project//mlir:LinalgTransforms; 29s local 2024-12-18T01:06:01.2912509Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:06:01.2913110Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:06:01.2913708Z Compiling xla/pjrt/mlir_to_hlo.cc; 16s local 2024-12-18T01:06:01.2914346Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2024-12-18T01:06:01.6529250Z 2024-12-18T01:06:01.6530124Z  2024-12-18T01:06:01.6530604Z  2024-12-18T01:06:01.6531009Z  2024-12-18T01:06:01.6531402Z  2024-12-18T01:06:01.6532106Z  2024-12-18T01:06:01.6532531Z  2024-12-18T01:06:01.6532913Z  2024-12-18T01:06:01.6533296Z  2024-12-18T01:06:01.6534212Z [20,134 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:01.6535191Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T01:06:01.6535894Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:06:01.6536921Z @llvm-project//mlir:LinalgTransforms; 29s local 2024-12-18T01:06:01.6537651Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:06:01.6538257Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2024-12-18T01:06:01.6538860Z Compiling xla/pjrt/mlir_to_hlo.cc; 17s local 2024-12-18T01:06:01.6539513Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2024-12-18T01:06:01.6540204Z Compiling xla/pjrt/pjrt_c_api_client.cc; 13s local ... 2024-12-18T01:06:02.6538390Z 2024-12-18T01:06:02.6539319Z  2024-12-18T01:06:02.6539907Z  2024-12-18T01:06:02.6540444Z  2024-12-18T01:06:02.6540936Z  2024-12-18T01:06:02.6541391Z  2024-12-18T01:06:02.6541760Z  2024-12-18T01:06:02.6542118Z  2024-12-18T01:06:02.6542493Z  2024-12-18T01:06:02.6543424Z [20,134 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:02.6544684Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T01:06:02.6545415Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:06:02.6546121Z @llvm-project//mlir:LinalgTransforms; 30s local 2024-12-18T01:06:02.6546799Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:06:02.6547399Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:06:02.6548041Z Compiling xla/pjrt/mlir_to_hlo.cc; 18s local 2024-12-18T01:06:02.6548671Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:06:02.6549386Z Compiling xla/pjrt/pjrt_c_api_client.cc; 14s local ... 2024-12-18T01:06:02.9638757Z 2024-12-18T01:06:02.9639614Z  2024-12-18T01:06:02.9640071Z  2024-12-18T01:06:02.9640465Z  2024-12-18T01:06:02.9640846Z  2024-12-18T01:06:02.9641242Z  2024-12-18T01:06:02.9641638Z  2024-12-18T01:06:02.9641988Z  2024-12-18T01:06:02.9642371Z  2024-12-18T01:06:02.9643274Z [20,135 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:02.9644864Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T01:06:02.9645506Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:02.9646147Z @llvm-project//mlir:LinalgTransforms; 30s local 2024-12-18T01:06:02.9646801Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:02.9647370Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:06:02.9647992Z Compiling xla/pjrt/mlir_to_hlo.cc; 18s local 2024-12-18T01:06:02.9648825Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:06:02.9649436Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T01:06:03.1857937Z 2024-12-18T01:06:03.1858799Z  2024-12-18T01:06:03.1859191Z  2024-12-18T01:06:03.1859502Z  2024-12-18T01:06:03.1859818Z  2024-12-18T01:06:03.1860159Z  2024-12-18T01:06:03.1860514Z  2024-12-18T01:06:03.1860887Z  2024-12-18T01:06:03.1861373Z  2024-12-18T01:06:03.1862443Z [20,137 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:03.1863442Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T01:06:03.1864438Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:03.1865131Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T01:06:03.1865783Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:03.1866371Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2024-12-18T01:06:03.1867027Z Compiling xla/pjrt/mlir_to_hlo.cc; 18s local 2024-12-18T01:06:03.1867843Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:06:03.1868576Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T01:06:03.4056026Z 2024-12-18T01:06:03.4057081Z  2024-12-18T01:06:03.4057541Z  2024-12-18T01:06:03.4057898Z  2024-12-18T01:06:03.4058343Z  2024-12-18T01:06:03.4058708Z  2024-12-18T01:06:03.4059081Z  2024-12-18T01:06:03.4059491Z  2024-12-18T01:06:03.4059879Z  2024-12-18T01:06:03.4060818Z [20,139 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:03.4061791Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T01:06:03.4062417Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:03.4063096Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T01:06:03.4063776Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:03.4064396Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:06:03.4065051Z Compiling xla/pjrt/mlir_to_hlo.cc; 18s local 2024-12-18T01:06:03.4065736Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2024-12-18T01:06:03.4066424Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T01:06:03.6549599Z 2024-12-18T01:06:03.6550432Z  2024-12-18T01:06:03.6550876Z  2024-12-18T01:06:03.6551274Z  2024-12-18T01:06:03.6551650Z  2024-12-18T01:06:03.6552024Z  2024-12-18T01:06:03.6552372Z  2024-12-18T01:06:03.6552757Z  2024-12-18T01:06:03.6553136Z  2024-12-18T01:06:03.6554048Z [20,139 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:03.6554959Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T01:06:03.6555619Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:03.6556270Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T01:06:03.6556942Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:03.6557507Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:06:03.6558245Z Compiling xla/pjrt/mlir_to_hlo.cc; 19s local 2024-12-18T01:06:03.6558877Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2024-12-18T01:06:03.6559552Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T01:06:03.8783365Z 2024-12-18T01:06:03.8784289Z  2024-12-18T01:06:03.8784754Z  2024-12-18T01:06:03.8785163Z  2024-12-18T01:06:03.8785552Z  2024-12-18T01:06:04.2578724Z  2024-12-18T01:06:04.2579223Z  2024-12-18T01:06:04.2579633Z  2024-12-18T01:06:04.2580012Z  2024-12-18T01:06:04.2580910Z [20,140 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:04.2581804Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T01:06:04.2582473Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:06:04.2583395Z @llvm-project//mlir:LinalgTransforms; 31s local 2024-12-18T01:06:04.2584030Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:04.2584657Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2024-12-18T01:06:04.2585301Z Compiling xla/pjrt/mlir_to_hlo.cc; 19s local 2024-12-18T01:06:04.2585973Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local 2024-12-18T01:06:04.2586669Z Compiling xla/pjrt/pjrt_c_api_client.cc; 15s local ... 2024-12-18T01:06:04.2587142Z 2024-12-18T01:06:04.2587542Z  2024-12-18T01:06:04.2587905Z  2024-12-18T01:06:04.2588267Z  2024-12-18T01:06:04.2588628Z  2024-12-18T01:06:04.2588987Z  2024-12-18T01:06:04.2589367Z  2024-12-18T01:06:04.2589966Z  2024-12-18T01:06:04.2590361Z  2024-12-18T01:06:04.2591223Z [20,140 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:04.2592148Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T01:06:04.2592828Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:06:04.2593467Z @llvm-project//mlir:LinalgTransforms; 32s local 2024-12-18T01:06:04.2594282Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:06:04.2594799Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:06:04.2595344Z Compiling xla/pjrt/mlir_to_hlo.cc; 19s local 2024-12-18T01:06:04.2595950Z Compiling xla/pjrt/pjrt_c_api_client.cc; 16s local 2024-12-18T01:06:04.2596585Z Compiling xla/pjrt/pjrt_c_api_client.cc; 16s local ... 2024-12-18T01:06:05.2542969Z 2024-12-18T01:06:05.2543906Z  2024-12-18T01:06:05.2544589Z  2024-12-18T01:06:05.2544997Z  2024-12-18T01:06:05.2545397Z  2024-12-18T01:06:05.2545772Z  2024-12-18T01:06:05.2546177Z  2024-12-18T01:06:05.2546551Z  2024-12-18T01:06:05.2546925Z  2024-12-18T01:06:05.2547829Z [20,141 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:05.2548833Z @llvm-project//mlir:LinalgTransforms; 75s local 2024-12-18T01:06:05.2549621Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:06:05.2550244Z @llvm-project//mlir:LinalgTransforms; 33s local 2024-12-18T01:06:05.2550910Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:06:05.2551542Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2024-12-18T01:06:05.2552123Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local 2024-12-18T01:06:05.2562621Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local 2024-12-18T01:06:05.2563518Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local ... 2024-12-18T01:06:05.4569317Z 2024-12-18T01:06:05.4570220Z  2024-12-18T01:06:05.4570695Z  2024-12-18T01:06:05.4571078Z  2024-12-18T01:06:05.4571440Z  2024-12-18T01:06:05.4571840Z  2024-12-18T01:06:05.4572230Z  2024-12-18T01:06:05.4572603Z  2024-12-18T01:06:05.4572984Z  2024-12-18T01:06:05.4573887Z [20,141 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:05.4574849Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T01:06:05.4575549Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:06:05.4576177Z @llvm-project//mlir:LinalgTransforms; 33s local 2024-12-18T01:06:05.4576958Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:06:05.4577580Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:05.4578237Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local 2024-12-18T01:06:05.4578955Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local 2024-12-18T01:06:05.4580043Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local ... 2024-12-18T01:06:05.8273999Z 2024-12-18T01:06:05.8274875Z  2024-12-18T01:06:05.8275360Z  2024-12-18T01:06:05.8275713Z  2024-12-18T01:06:05.8276064Z  2024-12-18T01:06:05.8276418Z  2024-12-18T01:06:05.8276767Z  2024-12-18T01:06:05.8277136Z  2024-12-18T01:06:05.8277819Z  2024-12-18T01:06:05.8278803Z [20,142 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:05.8279809Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T01:06:05.8280479Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T01:06:05.8281113Z @llvm-project//mlir:LinalgTransforms; 33s local 2024-12-18T01:06:05.8281753Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:06:05.8282376Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:05.8282985Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local 2024-12-18T01:06:05.8283675Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local 2024-12-18T01:06:05.8284732Z Compiling xla/pjrt/pjrt_c_api_client.cc; 17s local ... 2024-12-18T01:06:06.0571140Z 2024-12-18T01:06:06.0572042Z  2024-12-18T01:06:06.0572858Z  2024-12-18T01:06:06.0573380Z  2024-12-18T01:06:06.0573878Z  2024-12-18T01:06:06.0574354Z  2024-12-18T01:06:06.0574893Z  2024-12-18T01:06:06.0575419Z  2024-12-18T01:06:06.0575913Z  2024-12-18T01:06:06.0577417Z [20,142 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:06.0578579Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T01:06:06.0579372Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T01:06:06.0580155Z @llvm-project//mlir:LinalgTransforms; 34s local 2024-12-18T01:06:06.0580940Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:06:06.0581680Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2024-12-18T01:06:06.0582466Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local 2024-12-18T01:06:06.0583311Z Compiling xla/pjrt/pjrt_c_api_client.cc; 18s local 2024-12-18T01:06:06.0584231Z Compiling xla/pjrt/pjrt_c_api_client.cc; 18s local ... 2024-12-18T01:06:07.0580430Z 2024-12-18T01:06:07.0581297Z  2024-12-18T01:06:07.0581682Z  2024-12-18T01:06:07.0582039Z  2024-12-18T01:06:07.0582356Z  2024-12-18T01:06:07.0582652Z  2024-12-18T01:06:07.0582961Z  2024-12-18T01:06:07.0583273Z  2024-12-18T01:06:07.0583592Z  2024-12-18T01:06:07.0584333Z [20,142 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:07.0585109Z @llvm-project//mlir:LinalgTransforms; 77s local 2024-12-18T01:06:07.0585663Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2024-12-18T01:06:07.0586200Z @llvm-project//mlir:LinalgTransforms; 35s local 2024-12-18T01:06:07.0586754Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:06:07.0587250Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2024-12-18T01:06:07.0587769Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2024-12-18T01:06:07.0588346Z Compiling xla/pjrt/pjrt_c_api_client.cc; 19s local 2024-12-18T01:06:07.0588954Z Compiling xla/pjrt/pjrt_c_api_client.cc; 19s local ... 2024-12-18T01:06:07.3066223Z 2024-12-18T01:06:07.3067243Z  2024-12-18T01:06:07.3067697Z  2024-12-18T01:06:07.3068120Z  2024-12-18T01:06:07.3068512Z  2024-12-18T01:06:07.3068890Z  2024-12-18T01:06:07.3069291Z  2024-12-18T01:06:07.3069685Z  2024-12-18T01:06:07.3070080Z  2024-12-18T01:06:07.3070995Z [20,143 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:07.3071970Z @llvm-project//mlir:LinalgTransforms; 77s local 2024-12-18T01:06:07.3072650Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2024-12-18T01:06:07.3073617Z @llvm-project//mlir:LinalgTransforms; 35s local 2024-12-18T01:06:07.3074261Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:06:07.3074899Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:06:07.3075505Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2024-12-18T01:06:07.3076222Z Compiling xla/pjrt/pjrt_c_api_client.cc; 19s local 2024-12-18T01:06:07.3076985Z Compiling xla/pjrt/pjrt_c_api_client.cc; 19s local ... 2024-12-18T01:06:07.6589939Z 2024-12-18T01:06:07.6590811Z  2024-12-18T01:06:07.6591310Z  2024-12-18T01:06:07.6591722Z  2024-12-18T01:06:07.6592150Z  2024-12-18T01:06:07.6592563Z  2024-12-18T01:06:07.6592977Z  2024-12-18T01:06:07.6593380Z  2024-12-18T01:06:07.6593782Z  2024-12-18T01:06:07.6594750Z [20,143 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:07.6595777Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T01:06:07.6596519Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2024-12-18T01:06:07.6597220Z @llvm-project//mlir:LinalgTransforms; 35s local 2024-12-18T01:06:07.6598236Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:06:07.6598885Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2024-12-18T01:06:07.6599495Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2024-12-18T01:06:07.6600044Z Compiling xla/pjrt/pjrt_c_api_client.cc; 19s local 2024-12-18T01:06:07.6600706Z Compiling xla/pjrt/pjrt_c_api_client.cc; 19s local ... 2024-12-18T01:06:08.6602118Z 2024-12-18T01:06:08.6603298Z  2024-12-18T01:06:08.6603800Z  2024-12-18T01:06:08.6604188Z  2024-12-18T01:06:08.6604561Z  2024-12-18T01:06:08.6604931Z  2024-12-18T01:06:08.6605315Z  2024-12-18T01:06:08.6605674Z  2024-12-18T01:06:08.6606036Z  2024-12-18T01:06:08.6606928Z [20,143 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:08.6607879Z @llvm-project//mlir:LinalgTransforms; 79s local 2024-12-18T01:06:08.6608581Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2024-12-18T01:06:08.6609208Z @llvm-project//mlir:LinalgTransforms; 36s local 2024-12-18T01:06:08.6609864Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:06:08.6610500Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2024-12-18T01:06:08.6611188Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2024-12-18T01:06:08.6611916Z Compiling xla/pjrt/pjrt_c_api_client.cc; 20s local 2024-12-18T01:06:08.6612713Z Compiling xla/pjrt/pjrt_c_api_client.cc; 20s local ... 2024-12-18T01:06:09.3625190Z 2024-12-18T01:06:09.3626185Z  2024-12-18T01:06:09.3626691Z  2024-12-18T01:06:09.3627122Z  2024-12-18T01:06:09.3627534Z  2024-12-18T01:06:09.3627954Z  2024-12-18T01:06:09.3628379Z  2024-12-18T01:06:09.3628776Z  2024-12-18T01:06:09.3629227Z  2024-12-18T01:06:09.3630279Z [20,144 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:09.3631440Z @llvm-project//mlir:LinalgTransforms; 79s local 2024-12-18T01:06:09.3632253Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T01:06:09.3633027Z @llvm-project//mlir:LinalgTransforms; 37s local 2024-12-18T01:06:09.3633812Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:06:09.3634518Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:06:09.3635284Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2024-12-18T01:06:09.3636136Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local 2024-12-18T01:06:09.3637043Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local ... 2024-12-18T01:06:09.6608229Z 2024-12-18T01:06:09.6609193Z  2024-12-18T01:06:09.6609703Z  2024-12-18T01:06:09.6610240Z  2024-12-18T01:06:09.6610600Z  2024-12-18T01:06:09.6610964Z  2024-12-18T01:06:09.6611305Z  2024-12-18T01:06:09.6611677Z  2024-12-18T01:06:09.6612047Z  2024-12-18T01:06:09.6613478Z [20,145 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:09.6614424Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T01:06:09.6615086Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T01:06:09.6615739Z @llvm-project//mlir:LinalgTransforms; 37s local 2024-12-18T01:06:09.6616527Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:06:09.6617352Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:06:09.6617998Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2024-12-18T01:06:09.6618850Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local 2024-12-18T01:06:09.6619589Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local ... 2024-12-18T01:06:10.0850815Z 2024-12-18T01:06:10.0851769Z  2024-12-18T01:06:10.0852276Z  2024-12-18T01:06:10.0852703Z  2024-12-18T01:06:10.0853064Z  2024-12-18T01:06:10.0853442Z  2024-12-18T01:06:10.0853831Z  2024-12-18T01:06:10.0854227Z  2024-12-18T01:06:10.0854625Z  2024-12-18T01:06:10.0855778Z [20,146 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:10.0856948Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T01:06:10.0857643Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T01:06:10.0858352Z @llvm-project//mlir:LinalgTransforms; 38s local 2024-12-18T01:06:10.0859015Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:06:10.0859803Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2024-12-18T01:06:10.0860482Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2024-12-18T01:06:10.0861245Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2024-12-18T01:06:10.0862063Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local ... 2024-12-18T01:06:10.3140483Z 2024-12-18T01:06:10.3141411Z  2024-12-18T01:06:10.3141948Z  2024-12-18T01:06:10.3142402Z  2024-12-18T01:06:10.3142901Z  2024-12-18T01:06:10.3143314Z  2024-12-18T01:06:10.3143721Z  2024-12-18T01:06:10.3144396Z  2024-12-18T01:06:10.3145018Z  2024-12-18T01:06:10.3145906Z [20,147 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:10.3146785Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T01:06:10.3147413Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T01:06:10.3148082Z @llvm-project//mlir:LinalgTransforms; 38s local 2024-12-18T01:06:10.3148744Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:06:10.3149350Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:06:10.3150033Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2024-12-18T01:06:10.3150698Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2024-12-18T01:06:10.3151492Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local ... 2024-12-18T01:06:10.6615654Z 2024-12-18T01:06:10.6616733Z  2024-12-18T01:06:10.6617272Z  2024-12-18T01:06:10.6617682Z  2024-12-18T01:06:10.6618052Z  2024-12-18T01:06:10.6618404Z  2024-12-18T01:06:10.6618762Z  2024-12-18T01:06:10.6619091Z  2024-12-18T01:06:10.6619432Z  2024-12-18T01:06:10.6620250Z [20,147 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:10.6621103Z @llvm-project//mlir:LinalgTransforms; 81s local 2024-12-18T01:06:10.6621703Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T01:06:10.6622285Z @llvm-project//mlir:LinalgTransforms; 38s local 2024-12-18T01:06:10.6622857Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:06:10.6623375Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:06:10.6623939Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2024-12-18T01:06:10.6624600Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2024-12-18T01:06:10.6625362Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local ... 2024-12-18T01:06:11.0386887Z 2024-12-18T01:06:11.0387932Z  2024-12-18T01:06:11.0388486Z  2024-12-18T01:06:11.0388888Z  2024-12-18T01:06:11.0389322Z  2024-12-18T01:06:11.0389737Z  2024-12-18T01:06:11.0390276Z  2024-12-18T01:06:11.0390685Z  2024-12-18T01:06:11.0391084Z  2024-12-18T01:06:11.0391987Z [20,148 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:11.0393253Z @llvm-project//mlir:LinalgTransforms; 81s local 2024-12-18T01:06:11.0393924Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2024-12-18T01:06:11.0394605Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T01:06:11.0395291Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:11.0395940Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2024-12-18T01:06:11.0396596Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2024-12-18T01:06:11.0397297Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2024-12-18T01:06:11.0398008Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local ... 2024-12-18T01:06:11.2621579Z 2024-12-18T01:06:11.2622706Z  2024-12-18T01:06:11.2623467Z  2024-12-18T01:06:11.2623828Z  2024-12-18T01:06:11.2624179Z  2024-12-18T01:06:11.2624693Z  2024-12-18T01:06:11.2625099Z  2024-12-18T01:06:11.2625421Z  2024-12-18T01:06:11.2625787Z  2024-12-18T01:06:11.2626731Z [20,148 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:11.2628040Z @llvm-project//mlir:LinalgTransforms; 81s local 2024-12-18T01:06:11.2628742Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2024-12-18T01:06:11.2629398Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T01:06:11.2630092Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:11.2630781Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:06:11.2631431Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2024-12-18T01:06:11.2632151Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2024-12-18T01:06:11.2632856Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local ... 2024-12-18T01:06:11.5378993Z 2024-12-18T01:06:11.5379966Z  2024-12-18T01:06:11.5380474Z  2024-12-18T01:06:11.5380903Z  2024-12-18T01:06:11.5381307Z  2024-12-18T01:06:11.5381741Z  2024-12-18T01:06:11.5382146Z  2024-12-18T01:06:11.5382499Z  2024-12-18T01:06:11.5382858Z  2024-12-18T01:06:11.5383713Z [20,149 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:11.5384546Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T01:06:11.5385162Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2024-12-18T01:06:11.5385761Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T01:06:11.5386355Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:11.5386893Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:06:11.5387602Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2024-12-18T01:06:11.5388212Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2024-12-18T01:06:11.5388907Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local ... 2024-12-18T01:06:11.7419301Z 2024-12-18T01:06:11.7420269Z  2024-12-18T01:06:11.7420763Z  2024-12-18T01:06:11.7421199Z  2024-12-18T01:06:11.7421624Z  2024-12-18T01:06:11.7422118Z  2024-12-18T01:06:11.7422475Z  2024-12-18T01:06:11.7422827Z  2024-12-18T01:06:11.7423198Z  2024-12-18T01:06:11.7424014Z [20,151 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:11.7424827Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T01:06:11.7425419Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2024-12-18T01:06:11.7426014Z @llvm-project//mlir:LinalgTransforms; 39s local 2024-12-18T01:06:11.7426658Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:11.7427489Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:06:11.7428128Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2024-12-18T01:06:11.7428840Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2024-12-18T01:06:11.7429602Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 22s local ... 2024-12-18T01:06:12.0628568Z 2024-12-18T01:06:12.0629458Z  2024-12-18T01:06:12.0629832Z  2024-12-18T01:06:12.0630421Z  2024-12-18T01:06:12.0630724Z  2024-12-18T01:06:12.0631016Z  2024-12-18T01:06:12.0631321Z  2024-12-18T01:06:12.0631642Z  2024-12-18T01:06:12.0631947Z  2024-12-18T01:06:12.0632688Z [20,151 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:12.0633410Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T01:06:12.0633931Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2024-12-18T01:06:12.0634451Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T01:06:12.0634979Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:06:12.0635631Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2024-12-18T01:06:12.0636153Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2024-12-18T01:06:12.0636738Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2024-12-18T01:06:12.0637394Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 22s local ... 2024-12-18T01:06:12.8277900Z 2024-12-18T01:06:12.8278843Z  2024-12-18T01:06:12.8279339Z  2024-12-18T01:06:12.8279769Z  2024-12-18T01:06:12.8280482Z  2024-12-18T01:06:12.8280909Z  2024-12-18T01:06:12.8281271Z  2024-12-18T01:06:12.8281656Z  2024-12-18T01:06:12.8282039Z  2024-12-18T01:06:12.8282956Z [20,152 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:12.8283928Z @llvm-project//mlir:LinalgTransforms; 83s local 2024-12-18T01:06:12.8284602Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2024-12-18T01:06:12.8285290Z @llvm-project//mlir:LinalgTransforms; 40s local 2024-12-18T01:06:12.8285999Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:06:12.8286630Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:06:12.8287330Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2024-12-18T01:06:12.8288079Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2024-12-18T01:06:12.8288976Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local ... 2024-12-18T01:06:13.0636156Z 2024-12-18T01:06:13.0637016Z  2024-12-18T01:06:13.0637523Z  2024-12-18T01:06:13.0637901Z  2024-12-18T01:06:13.0638294Z  2024-12-18T01:06:13.0638685Z  2024-12-18T01:06:13.0639088Z  2024-12-18T01:06:13.0639492Z  2024-12-18T01:06:13.0639875Z  2024-12-18T01:06:13.0640825Z [20,152 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:13.0641761Z @llvm-project//mlir:LinalgTransforms; 83s local 2024-12-18T01:06:13.0642414Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2024-12-18T01:06:13.0643116Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T01:06:13.0643810Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:06:13.0647227Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2024-12-18T01:06:13.0647944Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2024-12-18T01:06:13.0648713Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2024-12-18T01:06:13.0649630Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local ... 2024-12-18T01:06:13.8497709Z 2024-12-18T01:06:13.8498695Z  2024-12-18T01:06:13.8499198Z  2024-12-18T01:06:13.8499621Z  2024-12-18T01:06:13.8500034Z  2024-12-18T01:06:13.8500457Z  2024-12-18T01:06:13.8500815Z  2024-12-18T01:06:13.8501152Z  2024-12-18T01:06:13.8501536Z  2024-12-18T01:06:13.8502421Z [20,154 / 20,604] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:06:13.8503755Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T01:06:13.8504427Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2024-12-18T01:06:13.8505101Z @llvm-project//mlir:LinalgTransforms; 41s local 2024-12-18T01:06:13.8505773Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:06:13.8506316Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:13.8507171Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2024-12-18T01:06:13.8507920Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2024-12-18T01:06:13.8508749Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local ... 2024-12-18T01:06:14.0643738Z 2024-12-18T01:06:14.0645569Z  2024-12-18T01:06:14.0646116Z  2024-12-18T01:06:14.0646488Z  2024-12-18T01:06:14.0646871Z  2024-12-18T01:06:14.0647251Z  2024-12-18T01:06:14.0647632Z  2024-12-18T01:06:14.0648032Z  2024-12-18T01:06:14.0648460Z  2024-12-18T01:06:14.0649661Z [20,155 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:14.0650649Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T01:06:14.0651315Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2024-12-18T01:06:14.0652058Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T01:06:14.0652866Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:14.0653505Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2024-12-18T01:06:14.0654340Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T01:06:14.0655079Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T01:06:14.0655964Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local ... 2024-12-18T01:06:14.3121909Z 2024-12-18T01:06:14.3122918Z  2024-12-18T01:06:14.3123381Z  2024-12-18T01:06:14.3123738Z  2024-12-18T01:06:14.3124126Z  2024-12-18T01:06:14.3124530Z  2024-12-18T01:06:14.3124910Z  2024-12-18T01:06:14.3125306Z  2024-12-18T01:06:14.3125694Z  2024-12-18T01:06:14.3126596Z [20,156 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:14.3127601Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T01:06:14.3128243Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2024-12-18T01:06:14.3128888Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T01:06:14.3129542Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:14.3130208Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:06:14.3130889Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T01:06:14.3131640Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T01:06:14.3132482Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local ... 2024-12-18T01:06:14.6647841Z 2024-12-18T01:06:14.6648994Z  2024-12-18T01:06:14.6649507Z  2024-12-18T01:06:14.6649935Z  2024-12-18T01:06:14.6650329Z  2024-12-18T01:06:14.6650731Z  2024-12-18T01:06:14.6651128Z  2024-12-18T01:06:14.6651530Z  2024-12-18T01:06:14.6651922Z  2024-12-18T01:06:14.6652871Z [20,158 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:14.6653845Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T01:06:14.6654545Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2024-12-18T01:06:14.6655216Z @llvm-project//mlir:LinalgTransforms; 42s local 2024-12-18T01:06:14.6655893Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:14.6656693Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:06:14.6657374Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T01:06:14.6658148Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2024-12-18T01:06:14.6659008Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local ... 2024-12-18T01:06:15.2211126Z 2024-12-18T01:06:15.2212122Z  2024-12-18T01:06:15.2212601Z  2024-12-18T01:06:15.2212974Z  2024-12-18T01:06:15.2213423Z  2024-12-18T01:06:15.2213810Z  2024-12-18T01:06:15.2214202Z  2024-12-18T01:06:15.2214569Z  2024-12-18T01:06:15.2214937Z  2024-12-18T01:06:15.2216018Z [20,159 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:15.2217620Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T01:06:15.2218477Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2024-12-18T01:06:15.2219133Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T01:06:15.2219763Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:06:15.2220341Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2024-12-18T01:06:15.2220961Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2024-12-18T01:06:15.2221690Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2024-12-18T01:06:15.2222581Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local ... 2024-12-18T01:06:15.4653452Z 2024-12-18T01:06:15.4654639Z  2024-12-18T01:06:15.4655097Z  2024-12-18T01:06:15.4655436Z  2024-12-18T01:06:15.4655829Z  2024-12-18T01:06:15.4656222Z  2024-12-18T01:06:15.4656716Z  2024-12-18T01:06:15.4657110Z  2024-12-18T01:06:15.4657501Z  2024-12-18T01:06:15.4658447Z [20,159 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:15.4659589Z @llvm-project//mlir:LinalgTransforms; 86s local 2024-12-18T01:06:15.4660180Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2024-12-18T01:06:15.4660692Z @llvm-project//mlir:LinalgTransforms; 43s local 2024-12-18T01:06:15.4661178Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:06:15.4661633Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2024-12-18T01:06:15.4662140Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2024-12-18T01:06:15.4662703Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2024-12-18T01:06:15.4663349Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local ... 2024-12-18T01:06:16.4660433Z 2024-12-18T01:06:16.4661403Z  2024-12-18T01:06:16.4661895Z  2024-12-18T01:06:16.4662305Z  2024-12-18T01:06:16.4662690Z  2024-12-18T01:06:16.4663072Z  2024-12-18T01:06:16.4663481Z  2024-12-18T01:06:16.4663870Z  2024-12-18T01:06:16.4664259Z  2024-12-18T01:06:16.4665212Z [20,159 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:16.4666195Z @llvm-project//mlir:LinalgTransforms; 87s local 2024-12-18T01:06:16.4666841Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2024-12-18T01:06:16.4667484Z @llvm-project//mlir:LinalgTransforms; 44s local 2024-12-18T01:06:16.4668125Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:06:16.4668789Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2024-12-18T01:06:16.4669475Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2024-12-18T01:06:16.4670335Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2024-12-18T01:06:16.4671143Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local ... 2024-12-18T01:06:17.5027196Z 2024-12-18T01:06:17.5028240Z  2024-12-18T01:06:17.5028673Z  2024-12-18T01:06:17.5029041Z  2024-12-18T01:06:17.5029457Z  2024-12-18T01:06:17.5029818Z  2024-12-18T01:06:17.5030186Z  2024-12-18T01:06:17.5030529Z  2024-12-18T01:06:17.5030894Z  2024-12-18T01:06:17.5031741Z [20,160 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:17.5032661Z @llvm-project//mlir:LinalgTransforms; 88s local 2024-12-18T01:06:17.5033294Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2024-12-18T01:06:17.5033887Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T01:06:17.5034526Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T01:06:17.5035388Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:06:17.5036031Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2024-12-18T01:06:17.5036743Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2024-12-18T01:06:17.5037504Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local ... 2024-12-18T01:06:17.8278134Z 2024-12-18T01:06:17.8279329Z  2024-12-18T01:06:17.8279742Z  2024-12-18T01:06:17.8280089Z  2024-12-18T01:06:17.8280428Z  2024-12-18T01:06:17.8280773Z  2024-12-18T01:06:17.8281128Z  2024-12-18T01:06:17.8281472Z  2024-12-18T01:06:17.8281842Z  2024-12-18T01:06:17.8282853Z [20,161 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:17.8283734Z @llvm-project//mlir:LinalgTransforms; 88s local 2024-12-18T01:06:17.8284328Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T01:06:17.8284938Z @llvm-project//mlir:LinalgTransforms; 45s local 2024-12-18T01:06:17.8285553Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:06:17.8286365Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2024-12-18T01:06:17.8287106Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2024-12-18T01:06:17.8287928Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2024-12-18T01:06:17.8288875Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local ... 2024-12-18T01:06:18.0671805Z 2024-12-18T01:06:18.0672759Z  2024-12-18T01:06:18.0673355Z  2024-12-18T01:06:18.0673657Z  2024-12-18T01:06:18.0673965Z  2024-12-18T01:06:18.0674273Z  2024-12-18T01:06:18.0674577Z  2024-12-18T01:06:18.0674874Z  2024-12-18T01:06:18.0675160Z  2024-12-18T01:06:18.0675869Z [20,162 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:18.0676746Z @llvm-project//mlir:LinalgTransforms; 88s local 2024-12-18T01:06:18.0677292Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T01:06:18.0677820Z @llvm-project//mlir:LinalgTransforms; 46s local 2024-12-18T01:06:18.0678325Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2024-12-18T01:06:18.0678856Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T01:06:18.0679436Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T01:06:18.0680090Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2024-12-18T01:06:18.0680813Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local ... 2024-12-18T01:06:18.5490233Z 2024-12-18T01:06:18.5491170Z  2024-12-18T01:06:18.5491657Z  2024-12-18T01:06:18.5492064Z  2024-12-18T01:06:18.5492462Z  2024-12-18T01:06:18.5492865Z  2024-12-18T01:06:18.5493275Z  2024-12-18T01:06:18.5493682Z  2024-12-18T01:06:18.5494073Z  2024-12-18T01:06:18.5494975Z [20,163 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:18.5496172Z @llvm-project//mlir:LinalgTransforms; 89s local 2024-12-18T01:06:18.5497053Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T01:06:18.5497753Z @llvm-project//mlir:LinalgTransforms; 46s local 2024-12-18T01:06:18.5498459Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:06:18.5499170Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T01:06:18.5499950Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T01:06:18.5500833Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2024-12-18T01:06:18.5501789Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local ... 2024-12-18T01:06:18.8679445Z 2024-12-18T01:06:18.8680435Z  2024-12-18T01:06:18.8680896Z  2024-12-18T01:06:18.8681298Z  2024-12-18T01:06:18.8681677Z  2024-12-18T01:06:18.8682042Z  2024-12-18T01:06:18.8682402Z  2024-12-18T01:06:18.8682777Z  2024-12-18T01:06:18.8683414Z  2024-12-18T01:06:18.8684334Z [20,163 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:18.8685368Z @llvm-project//mlir:LinalgTransforms; 89s local 2024-12-18T01:06:18.8686010Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2024-12-18T01:06:18.8686648Z @llvm-project//mlir:LinalgTransforms; 46s local 2024-12-18T01:06:18.8687505Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2024-12-18T01:06:18.8688177Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T01:06:18.8688927Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2024-12-18T01:06:18.8689717Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2024-12-18T01:06:18.8690610Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local ... 2024-12-18T01:06:20.0689841Z 2024-12-18T01:06:20.0690722Z  2024-12-18T01:06:20.0691162Z  2024-12-18T01:06:20.0691527Z  2024-12-18T01:06:20.0691860Z  2024-12-18T01:06:20.0692295Z  2024-12-18T01:06:20.0692663Z  2024-12-18T01:06:20.0693030Z  2024-12-18T01:06:20.0693380Z  2024-12-18T01:06:20.0694562Z [20,163 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:20.0695481Z @llvm-project//mlir:LinalgTransforms; 90s local 2024-12-18T01:06:20.0696142Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2024-12-18T01:06:20.0696944Z @llvm-project//mlir:LinalgTransforms; 48s local 2024-12-18T01:06:20.0697789Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2024-12-18T01:06:20.0698680Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2024-12-18T01:06:20.0699432Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2024-12-18T01:06:20.0700257Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2024-12-18T01:06:20.0701141Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local ... 2024-12-18T01:06:21.0696541Z 2024-12-18T01:06:21.0697502Z  2024-12-18T01:06:21.0698043Z  2024-12-18T01:06:21.0698446Z  2024-12-18T01:06:21.0698812Z  2024-12-18T01:06:21.0699172Z  2024-12-18T01:06:21.0699568Z  2024-12-18T01:06:21.0699955Z  2024-12-18T01:06:21.0700328Z  2024-12-18T01:06:21.0701234Z [20,163 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:21.0702189Z @llvm-project//mlir:LinalgTransforms; 91s local 2024-12-18T01:06:21.0702882Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2024-12-18T01:06:21.0703584Z @llvm-project//mlir:LinalgTransforms; 49s local 2024-12-18T01:06:21.0704213Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2024-12-18T01:06:21.0704925Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2024-12-18T01:06:21.0705691Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2024-12-18T01:06:21.0706566Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2024-12-18T01:06:21.0707524Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local ... 2024-12-18T01:06:21.5196608Z 2024-12-18T01:06:21.5197571Z  2024-12-18T01:06:21.5198101Z  2024-12-18T01:06:21.5198524Z  2024-12-18T01:06:21.5198901Z  2024-12-18T01:06:21.5199291Z  2024-12-18T01:06:21.5199679Z  2024-12-18T01:06:21.5200074Z  2024-12-18T01:06:21.5200466Z  2024-12-18T01:06:21.5201357Z [20,164 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:21.5202352Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T01:06:21.5203055Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2024-12-18T01:06:21.5203710Z @llvm-project//mlir:LinalgTransforms; 49s local 2024-12-18T01:06:21.5204409Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2024-12-18T01:06:21.5205058Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2024-12-18T01:06:21.5205858Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2024-12-18T01:06:21.5206973Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2024-12-18T01:06:21.5207956Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local ... 2024-12-18T01:06:21.7871674Z 2024-12-18T01:06:21.7872534Z  2024-12-18T01:06:21.7873087Z  2024-12-18T01:06:21.7873499Z  2024-12-18T01:06:21.7873943Z  2024-12-18T01:06:21.7874325Z  2024-12-18T01:06:21.7874709Z  2024-12-18T01:06:21.7875387Z  2024-12-18T01:06:21.7875765Z  2024-12-18T01:06:21.7876704Z [20,166 / 20,604] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:06:21.7877689Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T01:06:21.7878377Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2024-12-18T01:06:21.7879047Z @llvm-project//mlir:LinalgTransforms; 49s local 2024-12-18T01:06:21.7879746Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2024-12-18T01:06:21.7880444Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2024-12-18T01:06:21.7881340Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2024-12-18T01:06:21.7884319Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2024-12-18T01:06:21.7885452Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local ... 2024-12-18T01:06:22.0757693Z 2024-12-18T01:06:22.0758672Z  2024-12-18T01:06:22.0759128Z  2024-12-18T01:06:22.0759511Z  2024-12-18T01:06:22.0759965Z  2024-12-18T01:06:22.0760508Z  2024-12-18T01:06:22.0760918Z  2024-12-18T01:06:22.0761279Z  2024-12-18T01:06:22.0761947Z  2024-12-18T01:06:22.0762902Z [20,166 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:22.0763921Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T01:06:22.0764605Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2024-12-18T01:06:22.0765287Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:06:22.0765994Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2024-12-18T01:06:22.0766731Z Compiling xla/pjrt/pjrt_c_api_client.cc; 34s local 2024-12-18T01:06:22.0767560Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2024-12-18T01:06:22.0768463Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2024-12-18T01:06:22.0769387Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local ... 2024-12-18T01:06:22.2760876Z 2024-12-18T01:06:22.2761805Z  2024-12-18T01:06:22.2762251Z  2024-12-18T01:06:22.2762656Z  2024-12-18T01:06:22.2763038Z  2024-12-18T01:06:22.2763455Z  2024-12-18T01:06:22.2763855Z  2024-12-18T01:06:22.2764241Z  2024-12-18T01:06:22.2764636Z  2024-12-18T01:06:22.2765568Z [20,167 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:22.2766558Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T01:06:22.2767186Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2024-12-18T01:06:22.2767800Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:06:22.2768432Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T01:06:22.2769187Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2024-12-18T01:06:22.2770070Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2024-12-18T01:06:22.2770878Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2024-12-18T01:06:22.2771692Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local ... 2024-12-18T01:06:22.5576813Z 2024-12-18T01:06:22.5577680Z  2024-12-18T01:06:22.5578186Z  2024-12-18T01:06:22.5578590Z  2024-12-18T01:06:22.5578973Z  2024-12-18T01:06:22.5579329Z  2024-12-18T01:06:22.5579708Z  2024-12-18T01:06:22.5580087Z  2024-12-18T01:06:22.5580462Z  2024-12-18T01:06:22.5581355Z [20,168 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:22.5582321Z @llvm-project//mlir:LinalgTransforms; 93s local 2024-12-18T01:06:22.5583328Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2024-12-18T01:06:22.5583992Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:06:22.5584624Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T01:06:22.5585358Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2024-12-18T01:06:22.5586179Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2024-12-18T01:06:22.5587161Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2024-12-18T01:06:22.5587973Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local ... 2024-12-18T01:06:22.7676547Z 2024-12-18T01:06:22.7678910Z  2024-12-18T01:06:22.7679430Z  2024-12-18T01:06:22.7679821Z  2024-12-18T01:06:22.7680203Z  2024-12-18T01:06:22.7680565Z  2024-12-18T01:06:22.7680930Z  2024-12-18T01:06:22.7681310Z  2024-12-18T01:06:22.7681706Z  2024-12-18T01:06:22.7682606Z [20,172 / 20,604] 5 / 17 tests; 48 actions, 46 running; last test: ...til_test 2024-12-18T01:06:22.7683878Z @llvm-project//mlir:LinalgTransforms; 93s local 2024-12-18T01:06:22.7684551Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2024-12-18T01:06:22.7685215Z @llvm-project//mlir:LinalgTransforms; 50s local 2024-12-18T01:06:22.7685829Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T01:06:22.7686604Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2024-12-18T01:06:22.7687458Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2024-12-18T01:06:22.7688526Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2024-12-18T01:06:22.7689380Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local ... 2024-12-18T01:06:23.0767985Z 2024-12-18T01:06:23.0768918Z  2024-12-18T01:06:23.4772796Z  2024-12-18T01:06:23.4773354Z  2024-12-18T01:06:23.4773796Z  2024-12-18T01:06:23.4774230Z  2024-12-18T01:06:23.4774584Z  2024-12-18T01:06:23.4774947Z  2024-12-18T01:06:23.4775301Z  2024-12-18T01:06:23.4776228Z [20,172 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:23.4777312Z @llvm-project//mlir:LinalgTransforms; 93s local 2024-12-18T01:06:23.4778004Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2024-12-18T01:06:23.4778648Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T01:06:23.4779332Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2024-12-18T01:06:23.4779955Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2024-12-18T01:06:23.4780637Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2024-12-18T01:06:23.4781281Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2024-12-18T01:06:23.4781900Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local ... 2024-12-18T01:06:23.4782326Z 2024-12-18T01:06:23.4782599Z  2024-12-18T01:06:23.4782976Z  2024-12-18T01:06:23.4783412Z  2024-12-18T01:06:23.4783815Z  2024-12-18T01:06:23.4784211Z  2024-12-18T01:06:23.4784590Z  2024-12-18T01:06:23.4784973Z  2024-12-18T01:06:23.4785362Z  2024-12-18T01:06:23.4786238Z [20,173 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:23.4787141Z @llvm-project//mlir:LinalgTransforms; 94s local 2024-12-18T01:06:23.4787788Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2024-12-18T01:06:23.4788427Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T01:06:23.4789082Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T01:06:23.4789808Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2024-12-18T01:06:23.4790736Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 31s local 2024-12-18T01:06:23.4791462Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2024-12-18T01:06:23.4792124Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local ... 2024-12-18T01:06:23.6785125Z 2024-12-18T01:06:23.6785990Z  2024-12-18T01:06:23.6786472Z  2024-12-18T01:06:23.6786842Z  2024-12-18T01:06:23.6787251Z  2024-12-18T01:06:23.6787630Z  2024-12-18T01:06:23.6788013Z  2024-12-18T01:06:23.6788403Z  2024-12-18T01:06:23.6788772Z  2024-12-18T01:06:23.6789695Z [20,175 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:23.6790931Z @llvm-project//mlir:LinalgTransforms; 94s local 2024-12-18T01:06:23.6791627Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2024-12-18T01:06:23.6792290Z @llvm-project//mlir:LinalgTransforms; 51s local 2024-12-18T01:06:23.6793088Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T01:06:23.6793868Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2024-12-18T01:06:23.6794750Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T01:06:23.6795569Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T01:06:23.6796537Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local ... 2024-12-18T01:06:24.0777237Z 2024-12-18T01:06:24.0778438Z  2024-12-18T01:06:24.0778999Z  2024-12-18T01:06:24.0779458Z  2024-12-18T01:06:24.0779864Z  2024-12-18T01:06:24.0780286Z  2024-12-18T01:06:24.0780621Z  2024-12-18T01:06:24.0781004Z  2024-12-18T01:06:24.0781388Z  2024-12-18T01:06:24.0782299Z [20,175 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:24.0783593Z @llvm-project//mlir:LinalgTransforms; 94s local 2024-12-18T01:06:24.0784317Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2024-12-18T01:06:24.0785010Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T01:06:24.0785676Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2024-12-18T01:06:24.0786465Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2024-12-18T01:06:24.0787350Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T01:06:24.0788235Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T01:06:24.0789196Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local ... 2024-12-18T01:06:24.2779536Z 2024-12-18T01:06:24.2780460Z  2024-12-18T01:06:24.2780918Z  2024-12-18T01:06:24.2781287Z  2024-12-18T01:06:24.2781641Z  2024-12-18T01:06:24.2782032Z  2024-12-18T01:06:24.2782406Z  2024-12-18T01:06:24.2782793Z  2024-12-18T01:06:24.2783139Z  2024-12-18T01:06:24.2784064Z [20,176 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:24.2784995Z @llvm-project//mlir:LinalgTransforms; 94s local 2024-12-18T01:06:24.2785657Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2024-12-18T01:06:24.2786280Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T01:06:24.2786920Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2024-12-18T01:06:24.2787637Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2024-12-18T01:06:24.2788525Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T01:06:24.2789352Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2024-12-18T01:06:24.2790236Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local ... 2024-12-18T01:06:24.6783956Z 2024-12-18T01:06:24.6784956Z  2024-12-18T01:06:24.6785483Z  2024-12-18T01:06:24.6786010Z  2024-12-18T01:06:24.6786369Z  2024-12-18T01:06:24.6786710Z  2024-12-18T01:06:24.6787073Z  2024-12-18T01:06:24.6787422Z  2024-12-18T01:06:24.6787781Z  2024-12-18T01:06:24.6788620Z [20,176 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:24.6789510Z @llvm-project//mlir:LinalgTransforms; 95s local 2024-12-18T01:06:24.6790149Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T01:06:24.6790784Z @llvm-project//mlir:LinalgTransforms; 52s local 2024-12-18T01:06:24.6791710Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2024-12-18T01:06:24.6792475Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2024-12-18T01:06:24.6793248Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2024-12-18T01:06:24.6794006Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2024-12-18T01:06:24.6805688Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local ... 2024-12-18T01:06:25.6790880Z 2024-12-18T01:06:25.6791836Z  2024-12-18T01:06:25.6792404Z  2024-12-18T01:06:25.6792943Z  2024-12-18T01:06:25.6793454Z  2024-12-18T01:06:25.6793970Z  2024-12-18T01:06:25.6794355Z  2024-12-18T01:06:25.6794699Z  2024-12-18T01:06:25.6795089Z  2024-12-18T01:06:25.6796196Z [20,176 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:25.6797408Z @llvm-project//mlir:LinalgTransforms; 96s local 2024-12-18T01:06:25.6798094Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2024-12-18T01:06:25.6799057Z @llvm-project//mlir:LinalgTransforms; 53s local 2024-12-18T01:06:25.6799792Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2024-12-18T01:06:25.6800560Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2024-12-18T01:06:25.6801417Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2024-12-18T01:06:25.6802254Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2024-12-18T01:06:25.6803486Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local ... 2024-12-18T01:06:26.4797214Z 2024-12-18T01:06:26.4798141Z  2024-12-18T01:06:26.4798746Z  2024-12-18T01:06:26.4799267Z  2024-12-18T01:06:26.4799780Z  2024-12-18T01:06:26.4800111Z  2024-12-18T01:06:26.4800467Z  2024-12-18T01:06:26.4800821Z  2024-12-18T01:06:26.4801193Z  2024-12-18T01:06:26.4802255Z [20,177 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:26.4803502Z @llvm-project//mlir:LinalgTransforms; 97s local 2024-12-18T01:06:26.4804292Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2024-12-18T01:06:26.4805035Z @llvm-project//mlir:LinalgTransforms; 54s local 2024-12-18T01:06:26.4805845Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2024-12-18T01:06:26.4806783Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2024-12-18T01:06:26.4807739Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2024-12-18T01:06:26.4808741Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2024-12-18T01:06:26.4809792Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local ... 2024-12-18T01:06:26.6801824Z 2024-12-18T01:06:26.6802721Z  2024-12-18T01:06:26.6803217Z  2024-12-18T01:06:26.6803655Z  2024-12-18T01:06:26.6804087Z  2024-12-18T01:06:26.6804511Z  2024-12-18T01:06:26.6804916Z  2024-12-18T01:06:26.6805300Z  2024-12-18T01:06:26.6805682Z  2024-12-18T01:06:26.6806516Z [20,177 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:26.6807372Z @llvm-project//mlir:LinalgTransforms; 97s local 2024-12-18T01:06:26.6807975Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2024-12-18T01:06:26.6808596Z @llvm-project//mlir:LinalgTransforms; 54s local 2024-12-18T01:06:26.6809229Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2024-12-18T01:06:26.6809909Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2024-12-18T01:06:26.6810740Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 34s local 2024-12-18T01:06:26.6811526Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2024-12-18T01:06:26.6812328Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local ... 2024-12-18T01:06:27.4687636Z 2024-12-18T01:06:27.4688533Z  2024-12-18T01:06:27.4689047Z  2024-12-18T01:06:27.4689489Z  2024-12-18T01:06:27.4690198Z  2024-12-18T01:06:27.4690595Z  2024-12-18T01:06:27.4690927Z  2024-12-18T01:06:27.4691257Z  2024-12-18T01:06:27.4691578Z  2024-12-18T01:06:27.4692373Z [20,178 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:27.4693164Z @llvm-project//mlir:LinalgTransforms; 98s local 2024-12-18T01:06:27.4693735Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2024-12-18T01:06:27.4694412Z @llvm-project//mlir:LinalgTransforms; 55s local 2024-12-18T01:06:27.4694979Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2024-12-18T01:06:27.4695586Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2024-12-18T01:06:27.4696297Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 34s local 2024-12-18T01:06:27.4697164Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2024-12-18T01:06:27.4697902Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local ... 2024-12-18T01:06:27.6808410Z 2024-12-18T01:06:27.6809262Z  2024-12-18T01:06:27.6809644Z  2024-12-18T01:06:27.6809967Z  2024-12-18T01:06:27.6810293Z  2024-12-18T01:06:27.6810833Z  2024-12-18T01:06:27.6811149Z  2024-12-18T01:06:27.6811476Z  2024-12-18T01:06:27.6811801Z  2024-12-18T01:06:27.6812580Z [20,178 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:27.6813381Z @llvm-project//mlir:LinalgTransforms; 98s local 2024-12-18T01:06:27.6813922Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2024-12-18T01:06:27.6814596Z @llvm-project//mlir:LinalgTransforms; 55s local 2024-12-18T01:06:27.6815155Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2024-12-18T01:06:27.6815789Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2024-12-18T01:06:27.6816650Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 35s local 2024-12-18T01:06:27.6817338Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2024-12-18T01:06:27.6818051Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local ... 2024-12-18T01:06:28.5560370Z 2024-12-18T01:06:28.5561234Z  2024-12-18T01:06:28.5561792Z  2024-12-18T01:06:28.5562208Z  2024-12-18T01:06:28.5562635Z  2024-12-18T01:06:28.5563051Z  2024-12-18T01:06:28.5563444Z  2024-12-18T01:06:28.5563792Z  2024-12-18T01:06:28.5564164Z  2024-12-18T01:06:28.5565048Z [20,179 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:28.5565997Z @llvm-project//mlir:LinalgTransforms; 99s local 2024-12-18T01:06:28.5566668Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2024-12-18T01:06:28.5567298Z @llvm-project//mlir:LinalgTransforms; 56s local 2024-12-18T01:06:28.5567935Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2024-12-18T01:06:28.5568667Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T01:06:28.5569523Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 36s local 2024-12-18T01:06:28.5570392Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2024-12-18T01:06:28.5571269Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local ... 2024-12-18T01:06:28.8818801Z 2024-12-18T01:06:28.8819722Z  2024-12-18T01:06:28.8820254Z  2024-12-18T01:06:28.8820692Z  2024-12-18T01:06:28.8821114Z  2024-12-18T01:06:28.8821502Z  2024-12-18T01:06:28.8821882Z  2024-12-18T01:06:28.8822242Z  2024-12-18T01:06:28.8822596Z  2024-12-18T01:06:28.8823499Z [20,181 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:28.8824399Z @llvm-project//mlir:LinalgTransforms; 99s local 2024-12-18T01:06:28.8825094Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2024-12-18T01:06:28.8825758Z @llvm-project//mlir:LinalgTransforms; 56s local 2024-12-18T01:06:28.8826447Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2024-12-18T01:06:28.8827167Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T01:06:28.8828281Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T01:06:28.8829096Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2024-12-18T01:06:28.8829872Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local ... 2024-12-18T01:06:29.0820410Z 2024-12-18T01:06:29.0821323Z  2024-12-18T01:06:29.0821859Z  2024-12-18T01:06:29.0822606Z  2024-12-18T01:06:29.0823000Z  2024-12-18T01:06:29.0823337Z  2024-12-18T01:06:29.0823700Z  2024-12-18T01:06:29.0824102Z  2024-12-18T01:06:29.0824491Z  2024-12-18T01:06:29.0825448Z [20,182 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:29.0826391Z @llvm-project//mlir:LinalgTransforms; 99s local 2024-12-18T01:06:29.0827058Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2024-12-18T01:06:29.0827736Z @llvm-project//mlir:LinalgTransforms; 57s local 2024-12-18T01:06:29.0828408Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2024-12-18T01:06:29.0829376Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T01:06:29.0830219Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T01:06:29.0830891Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2024-12-18T01:06:29.0831601Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local ... 2024-12-18T01:06:29.4825637Z 2024-12-18T01:06:29.4826541Z  2024-12-18T01:06:29.4827082Z  2024-12-18T01:06:29.4827528Z  2024-12-18T01:06:29.4828246Z  2024-12-18T01:06:29.4828669Z  2024-12-18T01:06:29.4829036Z  2024-12-18T01:06:29.4829393Z  2024-12-18T01:06:29.4829757Z  2024-12-18T01:06:29.4830657Z [20,183 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:29.4831668Z @llvm-project//mlir:LinalgTransforms; 100s local 2024-12-18T01:06:29.4832372Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2024-12-18T01:06:29.4833079Z @llvm-project//mlir:LinalgTransforms; 57s local 2024-12-18T01:06:29.4833791Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2024-12-18T01:06:29.4834587Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2024-12-18T01:06:29.4835495Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2024-12-18T01:06:29.4836349Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2024-12-18T01:06:29.4837189Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local ... 2024-12-18T01:06:29.8710070Z 2024-12-18T01:06:29.8711044Z  2024-12-18T01:06:29.8711555Z  2024-12-18T01:06:29.8711976Z  2024-12-18T01:06:29.8712400Z  2024-12-18T01:06:29.8712822Z  2024-12-18T01:06:29.8713206Z  2024-12-18T01:06:29.8713572Z  2024-12-18T01:06:29.8713961Z  2024-12-18T01:06:29.8714844Z [20,184 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:29.8715759Z @llvm-project//mlir:LinalgTransforms; 100s local 2024-12-18T01:06:29.8716445Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T01:06:29.8717084Z @llvm-project//mlir:LinalgTransforms; 57s local 2024-12-18T01:06:29.8717767Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2024-12-18T01:06:29.8718564Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2024-12-18T01:06:29.8719519Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2024-12-18T01:06:29.8720327Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2024-12-18T01:06:29.8721140Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local ... 2024-12-18T01:06:30.0830172Z 2024-12-18T01:06:30.0831098Z  2024-12-18T01:06:30.0831656Z  2024-12-18T01:06:30.0832092Z  2024-12-18T01:06:30.0832524Z  2024-12-18T01:06:30.0832931Z  2024-12-18T01:06:30.0833344Z  2024-12-18T01:06:30.0833698Z  2024-12-18T01:06:30.0834055Z  2024-12-18T01:06:30.0835183Z [20,184 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:30.0836137Z @llvm-project//mlir:LinalgTransforms; 100s local 2024-12-18T01:06:30.0836834Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T01:06:30.0837499Z @llvm-project//mlir:LinalgTransforms; 58s local 2024-12-18T01:06:30.0838186Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2024-12-18T01:06:30.0839167Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2024-12-18T01:06:30.0840053Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2024-12-18T01:06:30.0840849Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2024-12-18T01:06:30.0841643Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local ... 2024-12-18T01:06:31.2837375Z 2024-12-18T01:06:31.2838300Z  2024-12-18T01:06:31.2838769Z  2024-12-18T01:06:31.2839161Z  2024-12-18T01:06:31.2839541Z  2024-12-18T01:06:31.2839930Z  2024-12-18T01:06:31.2840343Z  2024-12-18T01:06:31.2840706Z  2024-12-18T01:06:31.2841083Z  2024-12-18T01:06:31.2842278Z [20,184 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:31.2843233Z @llvm-project//mlir:LinalgTransforms; 101s local 2024-12-18T01:06:31.2843934Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T01:06:31.2844781Z @llvm-project//mlir:LinalgTransforms; 59s local 2024-12-18T01:06:31.2845455Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T01:06:31.2846423Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2024-12-18T01:06:31.2847268Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2024-12-18T01:06:31.2848072Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local 2024-12-18T01:06:31.2848836Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local ... 2024-12-18T01:06:31.4840456Z 2024-12-18T01:06:31.4841314Z  2024-12-18T01:06:31.4841680Z  2024-12-18T01:06:31.4842017Z  2024-12-18T01:06:31.4842312Z  2024-12-18T01:06:31.4842608Z  2024-12-18T01:06:31.4842881Z  2024-12-18T01:06:31.4843182Z  2024-12-18T01:06:31.4843477Z  2024-12-18T01:06:31.4844443Z [20,185 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:31.4845245Z @llvm-project//mlir:LinalgTransforms; 102s local 2024-12-18T01:06:31.4845834Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T01:06:31.4846633Z @llvm-project//mlir:LinalgTransforms; 59s local 2024-12-18T01:06:31.4847268Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T01:06:31.4848007Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2024-12-18T01:06:31.4848851Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2024-12-18T01:06:31.4849635Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local 2024-12-18T01:06:31.4850379Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local ... 2024-12-18T01:06:32.1898899Z 2024-12-18T01:06:32.1899764Z  2024-12-18T01:06:32.1900296Z  2024-12-18T01:06:32.1900741Z  2024-12-18T01:06:32.1901160Z  2024-12-18T01:06:32.1901590Z  2024-12-18T01:06:32.1901963Z  2024-12-18T01:06:32.1902320Z  2024-12-18T01:06:32.1902689Z  2024-12-18T01:06:32.1903509Z [20,186 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:32.1904466Z @llvm-project//mlir:LinalgTransforms; 102s local 2024-12-18T01:06:32.1905164Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2024-12-18T01:06:32.1905832Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T01:06:32.1906526Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2024-12-18T01:06:32.1907293Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2024-12-18T01:06:32.1908160Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2024-12-18T01:06:32.1909019Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local 2024-12-18T01:06:32.1910139Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local ... 2024-12-18T01:06:32.4858499Z 2024-12-18T01:06:32.4859409Z  2024-12-18T01:06:32.4859938Z  2024-12-18T01:06:32.4860369Z  2024-12-18T01:06:32.4860791Z  2024-12-18T01:06:32.4861170Z  2024-12-18T01:06:32.4861537Z  2024-12-18T01:06:32.4861910Z  2024-12-18T01:06:32.4862544Z  2024-12-18T01:06:32.4863450Z [20,186 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:32.4864395Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T01:06:32.4865071Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2024-12-18T01:06:32.4865751Z @llvm-project//mlir:LinalgTransforms; 60s local 2024-12-18T01:06:32.4866447Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2024-12-18T01:06:32.4867229Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2024-12-18T01:06:32.4868160Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2024-12-18T01:06:32.4869186Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2024-12-18T01:06:32.4870021Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local ... 2024-12-18T01:06:33.6465436Z 2024-12-18T01:06:33.6466419Z  2024-12-18T01:06:33.6466910Z  2024-12-18T01:06:33.6467348Z  2024-12-18T01:06:33.6467806Z  2024-12-18T01:06:33.6468191Z  2024-12-18T01:06:33.6468562Z  2024-12-18T01:06:33.6468929Z  2024-12-18T01:06:33.6469261Z  2024-12-18T01:06:33.6470421Z [20,187 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:33.6471432Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T01:06:33.6472091Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2024-12-18T01:06:33.6472748Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T01:06:33.6473416Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2024-12-18T01:06:33.6474159Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2024-12-18T01:06:33.6474991Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2024-12-18T01:06:33.6475742Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2024-12-18T01:06:33.6476486Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local ... 2024-12-18T01:06:33.8857597Z 2024-12-18T01:06:33.8858437Z  2024-12-18T01:06:33.8858942Z  2024-12-18T01:06:33.8859330Z  2024-12-18T01:06:33.8859700Z  2024-12-18T01:06:33.8860001Z  2024-12-18T01:06:33.8860351Z  2024-12-18T01:06:33.8860711Z  2024-12-18T01:06:33.8861083Z  2024-12-18T01:06:33.8861950Z [20,187 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:33.8862820Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T01:06:33.8863422Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2024-12-18T01:06:33.8863922Z @llvm-project//mlir:LinalgTransforms; 61s local 2024-12-18T01:06:33.8864530Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2024-12-18T01:06:33.8865271Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 41s local 2024-12-18T01:06:33.8866099Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2024-12-18T01:06:33.8866860Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2024-12-18T01:06:33.8867574Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local ... 2024-12-18T01:06:34.2679422Z 2024-12-18T01:06:34.2680345Z  2024-12-18T01:06:34.2680836Z  2024-12-18T01:06:34.2681288Z  2024-12-18T01:06:34.2681704Z  2024-12-18T01:06:34.2682087Z  2024-12-18T01:06:34.2682422Z  2024-12-18T01:06:34.2682784Z  2024-12-18T01:06:34.2683151Z  2024-12-18T01:06:34.2683990Z [20,188 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:34.2684946Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T01:06:34.2685897Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2024-12-18T01:06:34.2686566Z @llvm-project//mlir:LinalgTransforms; 62s local 2024-12-18T01:06:34.2687225Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2024-12-18T01:06:34.2687900Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2024-12-18T01:06:34.2688632Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2024-12-18T01:06:34.2689525Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local 2024-12-18T01:06:34.2690262Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local ... 2024-12-18T01:06:34.4862561Z 2024-12-18T01:06:34.4863506Z  2024-12-18T01:06:34.4863975Z  2024-12-18T01:06:34.4864357Z  2024-12-18T01:06:34.4864725Z  2024-12-18T01:06:34.4865066Z  2024-12-18T01:06:34.4865441Z  2024-12-18T01:06:34.4865832Z  2024-12-18T01:06:34.4866183Z  2024-12-18T01:06:34.4867062Z [20,188 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:34.4867992Z @llvm-project//mlir:LinalgTransforms; 105s local 2024-12-18T01:06:34.4870867Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2024-12-18T01:06:34.4871790Z @llvm-project//mlir:LinalgTransforms; 62s local 2024-12-18T01:06:34.4872433Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2024-12-18T01:06:34.4873571Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2024-12-18T01:06:34.4874461Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2024-12-18T01:06:34.4875268Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local 2024-12-18T01:06:34.4876244Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local ... 2024-12-18T01:06:35.4869603Z 2024-12-18T01:06:35.4870549Z  2024-12-18T01:06:35.4871066Z  2024-12-18T01:06:35.4871481Z  2024-12-18T01:06:35.4872015Z  2024-12-18T01:06:35.4872563Z  2024-12-18T01:06:35.4872848Z  2024-12-18T01:06:35.4873115Z  2024-12-18T01:06:35.4873400Z  2024-12-18T01:06:35.4874083Z [20,188 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:35.4874829Z @llvm-project//mlir:LinalgTransforms; 106s local 2024-12-18T01:06:35.4875332Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2024-12-18T01:06:35.4875813Z @llvm-project//mlir:LinalgTransforms; 63s local 2024-12-18T01:06:35.4876325Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2024-12-18T01:06:35.4876969Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2024-12-18T01:06:35.4877749Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2024-12-18T01:06:35.4878530Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2024-12-18T01:06:35.4879219Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local ... 2024-12-18T01:06:36.6877138Z 2024-12-18T01:06:36.6877976Z  2024-12-18T01:06:36.6878490Z  2024-12-18T01:06:36.6878920Z  2024-12-18T01:06:36.6879331Z  2024-12-18T01:06:36.6879732Z  2024-12-18T01:06:36.6880149Z  2024-12-18T01:06:36.6880610Z  2024-12-18T01:06:36.6881027Z  2024-12-18T01:06:36.6881970Z [20,188 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:36.6882865Z @llvm-project//mlir:LinalgTransforms; 107s local 2024-12-18T01:06:36.6883514Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T01:06:36.6884139Z @llvm-project//mlir:LinalgTransforms; 64s local 2024-12-18T01:06:36.6884809Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2024-12-18T01:06:36.6885474Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T01:06:36.6886209Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2024-12-18T01:06:36.6886893Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2024-12-18T01:06:36.6887764Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local ... 2024-12-18T01:06:37.0647422Z 2024-12-18T01:06:37.0648310Z  2024-12-18T01:06:37.0648850Z  2024-12-18T01:06:37.0649277Z  2024-12-18T01:06:37.0649688Z  2024-12-18T01:06:37.0650340Z  2024-12-18T01:06:37.0650678Z  2024-12-18T01:06:37.0651016Z  2024-12-18T01:06:37.0651339Z  2024-12-18T01:06:37.0652167Z [20,189 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:37.0653009Z @llvm-project//mlir:LinalgTransforms; 107s local 2024-12-18T01:06:37.0653618Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T01:06:37.0654345Z @llvm-project//mlir:LinalgTransforms; 65s local 2024-12-18T01:06:37.0654928Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2024-12-18T01:06:37.0655530Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T01:06:37.0656190Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T01:06:37.0656971Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2024-12-18T01:06:37.0657767Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local ... 2024-12-18T01:06:37.2883637Z 2024-12-18T01:06:37.2884573Z  2024-12-18T01:06:37.2885137Z  2024-12-18T01:06:37.2885564Z  2024-12-18T01:06:37.2885984Z  2024-12-18T01:06:37.2886620Z  2024-12-18T01:06:37.2886975Z  2024-12-18T01:06:37.2887337Z  2024-12-18T01:06:37.2887712Z  2024-12-18T01:06:37.2888792Z [20,189 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:37.2889649Z @llvm-project//mlir:LinalgTransforms; 107s local 2024-12-18T01:06:37.2890249Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T01:06:37.2890947Z @llvm-project//mlir:LinalgTransforms; 65s local 2024-12-18T01:06:37.2891520Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2024-12-18T01:06:37.2892102Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T01:06:37.2892752Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2024-12-18T01:06:37.2893382Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2024-12-18T01:06:37.2894155Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local ... 2024-12-18T01:06:38.2891171Z 2024-12-18T01:06:38.2892371Z  2024-12-18T01:06:38.2892883Z  2024-12-18T01:06:38.2893321Z  2024-12-18T01:06:38.2893755Z  2024-12-18T01:06:38.2894137Z  2024-12-18T01:06:38.2894467Z  2024-12-18T01:06:38.2894811Z  2024-12-18T01:06:38.2895153Z  2024-12-18T01:06:38.2895980Z [20,189 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:38.2897001Z @llvm-project//mlir:LinalgTransforms; 108s local 2024-12-18T01:06:38.2897638Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2024-12-18T01:06:38.2898233Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T01:06:38.2898832Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T01:06:38.2899499Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2024-12-18T01:06:38.2900184Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2024-12-18T01:06:38.2900871Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2024-12-18T01:06:38.2901686Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local ... 2024-12-18T01:06:38.6210631Z 2024-12-18T01:06:38.6211677Z  2024-12-18T01:06:38.6212265Z  2024-12-18T01:06:38.6212905Z  2024-12-18T01:06:38.6213511Z  2024-12-18T01:06:38.6213946Z  2024-12-18T01:06:38.6214370Z  2024-12-18T01:06:38.6214827Z  2024-12-18T01:06:38.6215230Z  2024-12-18T01:06:38.6216143Z [20,190 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:38.6217106Z @llvm-project//mlir:LinalgTransforms; 109s local 2024-12-18T01:06:38.6217679Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2024-12-18T01:06:38.6218229Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T01:06:38.6218791Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T01:06:38.6219358Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T01:06:38.6220256Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2024-12-18T01:06:38.6220861Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2024-12-18T01:06:38.8897673Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local ... 2024-12-18T01:06:38.8898274Z 2024-12-18T01:06:38.8898644Z  2024-12-18T01:06:38.8898983Z  2024-12-18T01:06:38.8899303Z  2024-12-18T01:06:38.8900311Z  2024-12-18T01:06:38.8900633Z  2024-12-18T01:06:38.8900948Z  2024-12-18T01:06:38.8901265Z  2024-12-18T01:06:38.8901592Z  2024-12-18T01:06:38.8902281Z [20,192 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:38.8903062Z @llvm-project//mlir:LinalgTransforms; 109s local 2024-12-18T01:06:38.8903636Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2024-12-18T01:06:38.8904176Z @llvm-project//mlir:LinalgTransforms; 66s local 2024-12-18T01:06:38.8904732Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T01:06:38.8905287Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T01:06:38.8906074Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T01:06:38.8906803Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2024-12-18T01:06:38.8907648Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local ... 2024-12-18T01:06:39.0900103Z 2024-12-18T01:06:39.0901207Z  2024-12-18T01:06:39.0901844Z  2024-12-18T01:06:39.0902410Z  2024-12-18T01:06:39.0903348Z  2024-12-18T01:06:39.0903806Z  2024-12-18T01:06:39.0904213Z  2024-12-18T01:06:39.0904629Z  2024-12-18T01:06:39.0905055Z  2024-12-18T01:06:39.0905856Z [20,193 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:39.0906570Z @llvm-project//mlir:LinalgTransforms; 109s local 2024-12-18T01:06:39.0907075Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2024-12-18T01:06:39.0907614Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T01:06:39.0908137Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2024-12-18T01:06:39.0908661Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T01:06:39.0909238Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T01:06:39.0909899Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2024-12-18T01:06:39.0910704Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local ... 2024-12-18T01:06:39.4903614Z 2024-12-18T01:06:39.4904518Z  2024-12-18T01:06:39.4904980Z  2024-12-18T01:06:39.4905352Z  2024-12-18T01:06:39.4905740Z  2024-12-18T01:06:39.4906107Z  2024-12-18T01:06:39.4906484Z  2024-12-18T01:06:39.4906841Z  2024-12-18T01:06:39.4907214Z  2024-12-18T01:06:39.4908122Z [20,193 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:39.4909085Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T01:06:39.4909777Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2024-12-18T01:06:39.4910428Z @llvm-project//mlir:LinalgTransforms; 67s local 2024-12-18T01:06:39.4911090Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2024-12-18T01:06:39.4911751Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T01:06:39.4912534Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2024-12-18T01:06:39.4913432Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local 2024-12-18T01:06:39.4914510Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local ... 2024-12-18T01:06:40.1990237Z 2024-12-18T01:06:40.1991132Z  2024-12-18T01:06:40.1991544Z  2024-12-18T01:06:40.1991867Z  2024-12-18T01:06:40.1992182Z  2024-12-18T01:06:40.1992488Z  2024-12-18T01:06:40.1992804Z  2024-12-18T01:06:40.1993118Z  2024-12-18T01:06:40.1993889Z  2024-12-18T01:06:40.1994874Z [20,194 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:40.1995670Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T01:06:40.1996266Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2024-12-18T01:06:40.1996846Z @llvm-project//mlir:LinalgTransforms; 68s local 2024-12-18T01:06:40.1997426Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2024-12-18T01:06:40.1998169Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T01:06:40.1998837Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T01:06:40.1999637Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local 2024-12-18T01:06:40.2000582Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local ... 2024-12-18T01:06:40.4910314Z 2024-12-18T01:06:40.4911600Z  2024-12-18T01:06:40.4912054Z  2024-12-18T01:06:40.4912445Z  2024-12-18T01:06:40.4912781Z  2024-12-18T01:06:40.4913195Z  2024-12-18T01:06:40.4913573Z  2024-12-18T01:06:40.4913970Z  2024-12-18T01:06:40.4914637Z  2024-12-18T01:06:40.4915578Z [20,194 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:40.4916606Z @llvm-project//mlir:LinalgTransforms; 111s local 2024-12-18T01:06:40.4917330Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2024-12-18T01:06:40.4918069Z @llvm-project//mlir:LinalgTransforms; 68s local 2024-12-18T01:06:40.4918938Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2024-12-18T01:06:40.4919645Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2024-12-18T01:06:40.4920471Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T01:06:40.4921431Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2024-12-18T01:06:40.4922604Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local ... 2024-12-18T01:06:40.8085921Z 2024-12-18T01:06:40.8087100Z  2024-12-18T01:06:40.8087582Z  2024-12-18T01:06:40.8087973Z  2024-12-18T01:06:40.8088389Z  2024-12-18T01:06:40.8088801Z  2024-12-18T01:06:40.8089180Z  2024-12-18T01:06:40.8089588Z  2024-12-18T01:06:40.8089991Z  2024-12-18T01:06:40.8090936Z [20,195 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:40.8091940Z @llvm-project//mlir:LinalgTransforms; 111s local 2024-12-18T01:06:40.8092640Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2024-12-18T01:06:40.8093345Z @llvm-project//mlir:LinalgTransforms; 68s local 2024-12-18T01:06:40.8094049Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2024-12-18T01:06:40.8094785Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2024-12-18T01:06:40.8095591Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2024-12-18T01:06:40.8096673Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2024-12-18T01:06:40.8097765Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local ... 2024-12-18T01:06:41.0916872Z 2024-12-18T01:06:41.0917866Z  2024-12-18T01:06:41.0918373Z  2024-12-18T01:06:41.0918756Z  2024-12-18T01:06:41.0919142Z  2024-12-18T01:06:41.0919520Z  2024-12-18T01:06:41.0919913Z  2024-12-18T01:06:41.0920316Z  2024-12-18T01:06:41.0920722Z  2024-12-18T01:06:41.0921675Z [20,197 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:41.0922689Z @llvm-project//mlir:LinalgTransforms; 111s local 2024-12-18T01:06:41.0923384Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2024-12-18T01:06:41.0924036Z @llvm-project//mlir:LinalgTransforms; 69s local 2024-12-18T01:06:41.0924713Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2024-12-18T01:06:41.0925396Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2024-12-18T01:06:41.0926185Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2024-12-18T01:06:41.0927271Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2024-12-18T01:06:41.0928320Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local ... 2024-12-18T01:06:42.0923513Z 2024-12-18T01:06:42.0924435Z  2024-12-18T01:06:42.0924920Z  2024-12-18T01:06:42.0925630Z  2024-12-18T01:06:42.0926040Z  2024-12-18T01:06:42.0926940Z  2024-12-18T01:06:42.0927470Z  2024-12-18T01:06:42.0927993Z  2024-12-18T01:06:42.0928510Z  2024-12-18T01:06:42.0929609Z [20,197 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:42.0930737Z @llvm-project//mlir:LinalgTransforms; 112s local 2024-12-18T01:06:42.0931559Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2024-12-18T01:06:42.0932372Z @llvm-project//mlir:LinalgTransforms; 70s local 2024-12-18T01:06:42.0933222Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2024-12-18T01:06:42.0933964Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2024-12-18T01:06:42.0935010Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2024-12-18T01:06:42.0936012Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2024-12-18T01:06:42.0937338Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local ... 2024-12-18T01:06:43.0932318Z 2024-12-18T01:06:43.0933307Z  2024-12-18T01:06:43.0933799Z  2024-12-18T01:06:43.0934194Z  2024-12-18T01:06:43.0934573Z  2024-12-18T01:06:43.0935282Z  2024-12-18T01:06:43.0935711Z  2024-12-18T01:06:43.0936104Z  2024-12-18T01:06:43.0936620Z  2024-12-18T01:06:43.0937548Z [20,197 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:43.0938495Z @llvm-project//mlir:LinalgTransforms; 113s local 2024-12-18T01:06:43.0939194Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2024-12-18T01:06:43.0939816Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T01:06:43.0940532Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2024-12-18T01:06:43.0941195Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2024-12-18T01:06:43.0942020Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2024-12-18T01:06:43.0942977Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local 2024-12-18T01:06:43.0944075Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local ... 2024-12-18T01:06:43.4935650Z 2024-12-18T01:06:43.4937046Z  2024-12-18T01:06:43.4937567Z  2024-12-18T01:06:43.4937925Z  2024-12-18T01:06:43.4938289Z  2024-12-18T01:06:43.4938676Z  2024-12-18T01:06:43.4939053Z  2024-12-18T01:06:43.4939393Z  2024-12-18T01:06:43.4939759Z  2024-12-18T01:06:43.4940627Z [20,198 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:43.4941571Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2024-12-18T01:06:43.4942282Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T01:06:43.4942975Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T01:06:43.4943679Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T01:06:43.4944779Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2024-12-18T01:06:43.4945677Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T01:06:43.4946754Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T01:06:43.4947906Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local ... 2024-12-18T01:06:43.6939320Z 2024-12-18T01:06:43.6940224Z  2024-12-18T01:06:43.6940701Z  2024-12-18T01:06:43.6941089Z  2024-12-18T01:06:43.6941449Z  2024-12-18T01:06:43.6941837Z  2024-12-18T01:06:43.6942224Z  2024-12-18T01:06:43.6942591Z  2024-12-18T01:06:43.6942941Z  2024-12-18T01:06:43.6944408Z [20,198 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:43.6945417Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:43.6946061Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T01:06:43.6946710Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T01:06:43.6947419Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T01:06:43.6948386Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2024-12-18T01:06:43.6949269Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T01:06:43.6950458Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T01:06:43.6951480Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local ... 2024-12-18T01:06:43.9688754Z 2024-12-18T01:06:43.9689633Z  2024-12-18T01:06:43.9690076Z  2024-12-18T01:06:43.9690431Z  2024-12-18T01:06:43.9690839Z  2024-12-18T01:06:43.9691259Z  2024-12-18T01:06:43.9691651Z  2024-12-18T01:06:43.9692016Z  2024-12-18T01:06:43.9692662Z  2024-12-18T01:06:43.9693607Z [20,199 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:43.9694452Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:43.9695087Z @llvm-project//mlir:LinalgTransforms; 71s local 2024-12-18T01:06:43.9695757Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T01:06:43.9696754Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T01:06:43.9697533Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T01:06:43.9698371Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T01:06:43.9699436Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T01:06:43.9700461Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local ... 2024-12-18T01:06:44.2468485Z 2024-12-18T01:06:44.2469372Z  2024-12-18T01:06:44.2469825Z  2024-12-18T01:06:44.2470225Z  2024-12-18T01:06:44.2470656Z  2024-12-18T01:06:44.2471010Z  2024-12-18T01:06:44.2471408Z  2024-12-18T01:06:44.2471810Z  2024-12-18T01:06:44.2472205Z  2024-12-18T01:06:44.2473137Z [20,199 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:44.2474099Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:44.2474833Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T01:06:44.2475546Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2024-12-18T01:06:44.2476290Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T01:06:44.2477097Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T01:06:44.2478048Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 41s local 2024-12-18T01:06:44.2479181Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2024-12-18T01:06:44.2480380Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local ... 2024-12-18T01:06:44.6472053Z 2024-12-18T01:06:44.6472982Z  2024-12-18T01:06:44.6473413Z  2024-12-18T01:06:44.6473811Z  2024-12-18T01:06:44.6474208Z  2024-12-18T01:06:44.6474613Z  2024-12-18T01:06:44.6474994Z  2024-12-18T01:06:44.6475413Z  2024-12-18T01:06:44.6475799Z  2024-12-18T01:06:44.6476755Z [20,202 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:44.6477623Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:44.6478253Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T01:06:44.6478945Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T01:06:44.6479649Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T01:06:44.6480457Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2024-12-18T01:06:44.6481686Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 41s local 2024-12-18T01:06:44.6482640Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2024-12-18T01:06:44.6483659Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2024-12-18T01:06:44.8893625Z 2024-12-18T01:06:44.8894459Z  2024-12-18T01:06:44.8894920Z  2024-12-18T01:06:44.8895580Z  2024-12-18T01:06:44.8895986Z  2024-12-18T01:06:44.8896515Z  2024-12-18T01:06:44.8896931Z  2024-12-18T01:06:44.8897339Z  2024-12-18T01:06:44.8897752Z  2024-12-18T01:06:44.8898718Z [20,204 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:44.8899677Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T01:06:44.8900314Z @llvm-project//mlir:LinalgTransforms; 72s local 2024-12-18T01:06:44.8900952Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T01:06:44.8901679Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T01:06:44.8902495Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T01:06:44.8903560Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2024-12-18T01:06:44.8904429Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2024-12-18T01:06:44.8905314Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local ... 2024-12-18T01:06:45.2476793Z 2024-12-18T01:06:45.2477696Z  2024-12-18T01:06:45.2478159Z  2024-12-18T01:06:45.2478590Z  2024-12-18T01:06:45.2479250Z  2024-12-18T01:06:45.2479654Z  2024-12-18T01:06:45.2480033Z  2024-12-18T01:06:45.2480411Z  2024-12-18T01:06:45.2480780Z  2024-12-18T01:06:45.2481752Z [20,204 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:45.2482643Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T01:06:45.2483321Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T01:06:45.2484030Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2024-12-18T01:06:45.2484733Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T01:06:45.2485460Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T01:06:45.2486483Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2024-12-18T01:06:45.2487398Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2024-12-18T01:06:45.2488295Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local ... 2024-12-18T01:06:45.8171645Z 2024-12-18T01:06:45.8172593Z  2024-12-18T01:06:45.8173007Z  2024-12-18T01:06:45.8173327Z  2024-12-18T01:06:45.8173699Z  2024-12-18T01:06:45.8174085Z  2024-12-18T01:06:45.8174421Z  2024-12-18T01:06:45.8174769Z  2024-12-18T01:06:45.8175092Z  2024-12-18T01:06:45.8175846Z [20,205 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:45.8176865Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2024-12-18T01:06:45.8177432Z @llvm-project//mlir:LinalgTransforms; 73s local 2024-12-18T01:06:45.8177977Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2024-12-18T01:06:45.8178618Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2024-12-18T01:06:45.8179360Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2024-12-18T01:06:45.8180118Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 42s local 2024-12-18T01:06:45.8180921Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2024-12-18T01:06:45.8181812Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local ... 2024-12-18T01:06:46.0482640Z 2024-12-18T01:06:46.0483904Z  2024-12-18T01:06:46.0484385Z  2024-12-18T01:06:46.0484785Z  2024-12-18T01:06:46.0485174Z  2024-12-18T01:06:46.0485528Z  2024-12-18T01:06:46.0485878Z  2024-12-18T01:06:46.0486549Z  2024-12-18T01:06:46.0486888Z  2024-12-18T01:06:46.0487686Z [20,206 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:46.0488531Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2024-12-18T01:06:46.0489141Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T01:06:46.0489810Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2024-12-18T01:06:46.0490668Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2024-12-18T01:06:46.0491391Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2024-12-18T01:06:46.0492173Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2024-12-18T01:06:46.0493009Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2024-12-18T01:06:46.0493748Z Compiling test/cpp/cpp_test_util.cpp; 36s local ... 2024-12-18T01:06:46.4486832Z 2024-12-18T01:06:46.4488099Z  2024-12-18T01:06:46.4488544Z  2024-12-18T01:06:46.4488965Z  2024-12-18T01:06:46.4489408Z  2024-12-18T01:06:46.4489823Z  2024-12-18T01:06:46.4490178Z  2024-12-18T01:06:46.4490511Z  2024-12-18T01:06:46.4491125Z  2024-12-18T01:06:46.4492083Z [20,208 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:46.4493051Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2024-12-18T01:06:46.4493791Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T01:06:46.4494479Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2024-12-18T01:06:46.4495227Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2024-12-18T01:06:46.4495913Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2024-12-18T01:06:46.4496704Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2024-12-18T01:06:46.4497432Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2024-12-18T01:06:46.4498124Z Compiling test/cpp/cpp_test_util.cpp; 36s local ... 2024-12-18T01:06:46.8491493Z 2024-12-18T01:06:46.8492653Z  2024-12-18T01:06:46.8493133Z  2024-12-18T01:06:46.8493476Z  2024-12-18T01:06:46.8493846Z  2024-12-18T01:06:46.8494214Z  2024-12-18T01:06:46.8494583Z  2024-12-18T01:06:46.8494916Z  2024-12-18T01:06:46.8495226Z  2024-12-18T01:06:46.8496043Z [20,209 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:46.8496967Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2024-12-18T01:06:46.8497537Z @llvm-project//mlir:LinalgTransforms; 74s local 2024-12-18T01:06:46.8498172Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2024-12-18T01:06:46.8498824Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2024-12-18T01:06:46.8499494Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2024-12-18T01:06:46.8500413Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2024-12-18T01:06:46.8501370Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2024-12-18T01:06:46.8502418Z Compiling test/cpp/cpp_test_util.cpp; 37s local ... 2024-12-18T01:06:47.2494989Z 2024-12-18T01:06:47.2495967Z  2024-12-18T01:06:47.2496596Z  2024-12-18T01:06:47.2497288Z  2024-12-18T01:06:47.2497687Z  2024-12-18T01:06:47.2498167Z  2024-12-18T01:06:47.2498635Z  2024-12-18T01:06:47.2499125Z  2024-12-18T01:06:47.2499602Z  2024-12-18T01:06:47.2500592Z [20,209 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:47.2501613Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2024-12-18T01:06:47.2502412Z @llvm-project//mlir:LinalgTransforms; 75s local 2024-12-18T01:06:47.2503160Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2024-12-18T01:06:47.2503928Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2024-12-18T01:06:47.2504676Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2024-12-18T01:06:47.2505552Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2024-12-18T01:06:47.2506973Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2024-12-18T01:06:47.2507963Z Compiling test/cpp/cpp_test_util.cpp; 37s local ... 2024-12-18T01:06:48.2504083Z 2024-12-18T01:06:48.2505030Z  2024-12-18T01:06:48.2505509Z  2024-12-18T01:06:48.2505872Z  2024-12-18T01:06:48.2506241Z  2024-12-18T01:06:48.2506941Z  2024-12-18T01:06:48.2507280Z  2024-12-18T01:06:48.2507655Z  2024-12-18T01:06:48.2508032Z  2024-12-18T01:06:48.2508986Z [20,209 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:48.2509838Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2024-12-18T01:06:48.2510508Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T01:06:48.2511204Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2024-12-18T01:06:48.2511944Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2024-12-18T01:06:48.2512711Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2024-12-18T01:06:48.2513746Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2024-12-18T01:06:48.2514691Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 42s local 2024-12-18T01:06:48.2515545Z Compiling test/cpp/cpp_test_util.cpp; 38s local ... 2024-12-18T01:06:48.5287053Z 2024-12-18T01:06:48.5288321Z  2024-12-18T01:06:48.5288816Z  2024-12-18T01:06:48.5289205Z  2024-12-18T01:06:48.5289577Z  2024-12-18T01:06:48.5289937Z  2024-12-18T01:06:48.5290603Z  2024-12-18T01:06:48.5291009Z  2024-12-18T01:06:48.5291544Z  2024-12-18T01:06:48.5292502Z [20,210 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:48.5293436Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2024-12-18T01:06:48.5294098Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T01:06:48.5294748Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2024-12-18T01:06:48.5295460Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2024-12-18T01:06:48.5296248Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2024-12-18T01:06:48.5297268Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2024-12-18T01:06:48.5298057Z Compiling test/cpp/cpp_test_util.cpp; 39s local 2024-12-18T01:06:48.5298809Z Compiling test/cpp/cpp_test_util.cpp; 38s local ... 2024-12-18T01:06:48.8507909Z 2024-12-18T01:06:48.8509162Z  2024-12-18T01:06:48.8509621Z  2024-12-18T01:06:48.8510031Z  2024-12-18T01:06:48.8510435Z  2024-12-18T01:06:48.8510841Z  2024-12-18T01:06:48.8511227Z  2024-12-18T01:06:48.8511636Z  2024-12-18T01:06:48.8512024Z  2024-12-18T01:06:48.8512927Z [20,212 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:48.8513869Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2024-12-18T01:06:48.8514592Z @llvm-project//mlir:LinalgTransforms; 76s local 2024-12-18T01:06:48.8515303Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2024-12-18T01:06:48.8516030Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2024-12-18T01:06:48.8516809Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2024-12-18T01:06:48.8517677Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2024-12-18T01:06:48.8518439Z Compiling test/cpp/cpp_test_util.cpp; 39s local 2024-12-18T01:06:48.8519148Z Compiling test/cpp/cpp_test_util.cpp; 38s local ... 2024-12-18T01:06:49.6514690Z 2024-12-18T01:06:49.6515847Z  2024-12-18T01:06:49.6516248Z  2024-12-18T01:06:49.6516626Z  2024-12-18T01:06:49.6516985Z  2024-12-18T01:06:49.6517345Z  2024-12-18T01:06:49.6517668Z  2024-12-18T01:06:49.6518027Z  2024-12-18T01:06:49.6518386Z  2024-12-18T01:06:49.6519306Z [20,213 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:49.6520604Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2024-12-18T01:06:49.6521223Z @llvm-project//mlir:LinalgTransforms; 77s local 2024-12-18T01:06:49.6521803Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2024-12-18T01:06:49.6522902Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T01:06:49.6523628Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2024-12-18T01:06:49.6524607Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2024-12-18T01:06:49.6525599Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2024-12-18T01:06:49.6526487Z Compiling test/cpp/cpp_test_util.cpp; 39s local ... 2024-12-18T01:06:50.0519902Z 2024-12-18T01:06:50.0520863Z  2024-12-18T01:06:50.0521338Z  2024-12-18T01:06:50.0521724Z  2024-12-18T01:06:50.0522136Z  2024-12-18T01:06:50.0522543Z  2024-12-18T01:06:50.0522942Z  2024-12-18T01:06:50.0523311Z  2024-12-18T01:06:50.0523710Z  2024-12-18T01:06:50.0524640Z [20,213 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:50.0525936Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T01:06:50.0526592Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T01:06:50.0527235Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2024-12-18T01:06:50.0527978Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T01:06:50.0528819Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T01:06:50.0529609Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 46s local 2024-12-18T01:06:50.0530559Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2024-12-18T01:06:50.0531304Z Compiling test/cpp/cpp_test_util.cpp; 39s local ... 2024-12-18T01:06:50.4498857Z 2024-12-18T01:06:50.4500095Z  2024-12-18T01:06:50.4500566Z  2024-12-18T01:06:50.4500913Z  2024-12-18T01:06:50.4501228Z  2024-12-18T01:06:50.4501558Z  2024-12-18T01:06:50.4501870Z  2024-12-18T01:06:50.4502238Z  2024-12-18T01:06:50.4502573Z  2024-12-18T01:06:50.4503384Z [20,214 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:50.4504223Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T01:06:50.4504818Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T01:06:50.4505418Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T01:06:50.4506118Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T01:06:50.4506913Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T01:06:50.4507663Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2024-12-18T01:06:50.4508357Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2024-12-18T01:06:50.4509162Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2024-12-18T01:06:50.6523710Z 2024-12-18T01:06:50.6524665Z  2024-12-18T01:06:50.6525034Z  2024-12-18T01:06:50.6525564Z  2024-12-18T01:06:50.6525910Z  2024-12-18T01:06:50.6526306Z  2024-12-18T01:06:50.6526732Z  2024-12-18T01:06:50.6527074Z  2024-12-18T01:06:50.6527553Z  2024-12-18T01:06:50.6528396Z [20,214 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:50.6529200Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T01:06:50.6529806Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T01:06:50.6530427Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T01:06:50.6531063Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2024-12-18T01:06:50.6531858Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2024-12-18T01:06:50.6532673Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2024-12-18T01:06:50.6533458Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2024-12-18T01:06:50.6534223Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2024-12-18T01:06:50.8843225Z 2024-12-18T01:06:50.8844626Z  2024-12-18T01:06:50.8845134Z  2024-12-18T01:06:50.8845515Z  2024-12-18T01:06:50.8845881Z  2024-12-18T01:06:50.8846299Z  2024-12-18T01:06:50.8846673Z  2024-12-18T01:06:50.8847067Z  2024-12-18T01:06:50.8847467Z  2024-12-18T01:06:50.8848427Z [20,215 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:50.8849552Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2024-12-18T01:06:50.8850241Z @llvm-project//mlir:LinalgTransforms; 78s local 2024-12-18T01:06:50.8850914Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T01:06:50.8851562Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2024-12-18T01:06:50.8852282Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2024-12-18T01:06:50.8853027Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2024-12-18T01:06:50.8853690Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2024-12-18T01:06:50.8854503Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2024-12-18T01:06:51.2528771Z 2024-12-18T01:06:51.2529690Z  2024-12-18T01:06:51.2530443Z  2024-12-18T01:06:51.2530845Z  2024-12-18T01:06:51.2531212Z  2024-12-18T01:06:51.2531592Z  2024-12-18T01:06:51.2531953Z  2024-12-18T01:06:51.2532295Z  2024-12-18T01:06:51.2532613Z  2024-12-18T01:06:51.2533369Z [20,217 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:51.2534271Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2024-12-18T01:06:51.2535181Z @llvm-project//mlir:LinalgTransforms; 79s local 2024-12-18T01:06:51.2535835Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2024-12-18T01:06:51.2536627Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2024-12-18T01:06:51.2537374Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2024-12-18T01:06:51.2538051Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2024-12-18T01:06:51.2538676Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2024-12-18T01:06:51.2539366Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2024-12-18T01:06:52.4537450Z 2024-12-18T01:06:52.4538715Z  2024-12-18T01:06:52.4539085Z  2024-12-18T01:06:52.4539426Z  2024-12-18T01:06:52.4539737Z  2024-12-18T01:06:52.4540045Z  2024-12-18T01:06:52.4540354Z  2024-12-18T01:06:52.4540681Z  2024-12-18T01:06:52.4540992Z  2024-12-18T01:06:52.4541742Z [20,217 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:52.4542456Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2024-12-18T01:06:52.4542994Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T01:06:52.4543511Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2024-12-18T01:06:52.4544435Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2024-12-18T01:06:52.4545227Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2024-12-18T01:06:52.4545834Z Compiling test/cpp/cpp_test_util.cpp; 42s local 2024-12-18T01:06:52.4546429Z Compiling test/cpp/cpp_test_util.cpp; 42s local 2024-12-18T01:06:52.4547068Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local ... 2024-12-18T01:06:52.7495067Z 2024-12-18T01:06:52.7496473Z  2024-12-18T01:06:52.7496974Z  2024-12-18T01:06:52.7497397Z  2024-12-18T01:06:52.7497795Z  2024-12-18T01:06:52.7498158Z  2024-12-18T01:06:52.7498505Z  2024-12-18T01:06:52.7498859Z  2024-12-18T01:06:52.7499225Z  2024-12-18T01:06:52.7500098Z [20,218 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:52.7500995Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2024-12-18T01:06:52.7501666Z @llvm-project//mlir:LinalgTransforms; 80s local 2024-12-18T01:06:52.7502280Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2024-12-18T01:06:52.7502983Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2024-12-18T01:06:52.7504065Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2024-12-18T01:06:52.7504840Z Compiling test/cpp/cpp_test_util.cpp; 43s local 2024-12-18T01:06:52.7505558Z Compiling test/cpp/cpp_test_util.cpp; 42s local 2024-12-18T01:06:52.7506302Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local ... 2024-12-18T01:06:53.0542236Z 2024-12-18T01:06:53.0543241Z  2024-12-18T01:06:53.0543998Z  2024-12-18T01:06:53.0544577Z  2024-12-18T01:06:53.0544960Z  2024-12-18T01:06:53.0545325Z  2024-12-18T01:06:53.0545715Z  2024-12-18T01:06:53.0546060Z  2024-12-18T01:06:53.0546399Z  2024-12-18T01:06:53.0547268Z [20,220 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:53.0548413Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2024-12-18T01:06:53.0549106Z @llvm-project//mlir:LinalgTransforms; 81s local 2024-12-18T01:06:53.0549778Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2024-12-18T01:06:53.0550533Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2024-12-18T01:06:53.0551551Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2024-12-18T01:06:53.0552273Z Compiling test/cpp/cpp_test_util.cpp; 43s local 2024-12-18T01:06:53.0552958Z Compiling test/cpp/cpp_test_util.cpp; 42s local 2024-12-18T01:06:53.0553716Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local ... 2024-12-18T01:06:54.0549032Z 2024-12-18T01:06:54.0550256Z  2024-12-18T01:06:54.0550729Z  2024-12-18T01:06:54.0551423Z  2024-12-18T01:06:54.0551834Z  2024-12-18T01:06:54.0552195Z  2024-12-18T01:06:54.0552600Z  2024-12-18T01:06:54.0553016Z  2024-12-18T01:06:54.0553375Z  2024-12-18T01:06:54.0554311Z [20,220 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:54.0555258Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2024-12-18T01:06:54.0555962Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T01:06:54.0556643Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2024-12-18T01:06:54.0557343Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2024-12-18T01:06:54.0558055Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2024-12-18T01:06:54.0558731Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2024-12-18T01:06:54.0559475Z Compiling test/cpp/cpp_test_util.cpp; 43s local 2024-12-18T01:06:54.0560283Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local ... 2024-12-18T01:06:54.2705167Z 2024-12-18T01:06:54.2706370Z  2024-12-18T01:06:54.2707192Z  2024-12-18T01:06:54.2708257Z  2024-12-18T01:06:54.2708693Z  2024-12-18T01:06:54.2709075Z  2024-12-18T01:06:54.2709481Z  2024-12-18T01:06:54.2709889Z  2024-12-18T01:06:54.2710274Z  2024-12-18T01:06:54.2711153Z [20,221 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:54.2712138Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2024-12-18T01:06:54.2712888Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T01:06:54.2713592Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2024-12-18T01:06:54.2714306Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2024-12-18T01:06:54.2715071Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2024-12-18T01:06:54.2715876Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2024-12-18T01:06:54.2716682Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2024-12-18T01:06:54.2717576Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local ... 2024-12-18T01:06:54.4903364Z 2024-12-18T01:06:54.4904461Z  2024-12-18T01:06:54.4905057Z  2024-12-18T01:06:54.4905533Z  2024-12-18T01:06:54.4906020Z  2024-12-18T01:06:54.4906498Z  2024-12-18T01:06:54.4906978Z  2024-12-18T01:06:54.4907456Z  2024-12-18T01:06:54.4907911Z  2024-12-18T01:06:54.4908923Z [20,223 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:54.4910617Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2024-12-18T01:06:54.4911612Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T01:06:54.4912545Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2024-12-18T01:06:54.4913541Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2024-12-18T01:06:54.4914669Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2024-12-18T01:06:54.4915521Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2024-12-18T01:06:54.4916343Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2024-12-18T01:06:54.4917193Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local ... 2024-12-18T01:06:54.8555315Z 2024-12-18T01:06:54.8556186Z  2024-12-18T01:06:54.8556632Z  2024-12-18T01:06:54.8557009Z  2024-12-18T01:06:54.8557391Z  2024-12-18T01:06:54.8557765Z  2024-12-18T01:06:54.8558129Z  2024-12-18T01:06:54.8558508Z  2024-12-18T01:06:54.8558881Z  2024-12-18T01:06:54.8560126Z [20,223 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:54.8561112Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2024-12-18T01:06:54.8561761Z @llvm-project//mlir:LinalgTransforms; 82s local 2024-12-18T01:06:54.8562399Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2024-12-18T01:06:54.8563298Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2024-12-18T01:06:54.8564509Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2024-12-18T01:06:54.8565237Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2024-12-18T01:06:54.8565917Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2024-12-18T01:06:54.8566690Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local ... 2024-12-18T01:06:55.8562961Z 2024-12-18T01:06:55.8563842Z  2024-12-18T01:06:55.8564908Z  2024-12-18T01:06:55.8566539Z  2024-12-18T01:06:55.8567984Z  2024-12-18T01:06:55.8569374Z  2024-12-18T01:06:55.8570796Z  2024-12-18T01:06:55.8572207Z  2024-12-18T01:06:55.8573645Z  2024-12-18T01:06:55.8575610Z [20,223 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:55.8577790Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2024-12-18T01:06:55.8579477Z @llvm-project//mlir:LinalgTransforms; 83s local 2024-12-18T01:06:55.8580435Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2024-12-18T01:06:55.8581421Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T01:06:55.8582561Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T01:06:55.8583698Z Compiling test/cpp/cpp_test_util.cpp; 46s local 2024-12-18T01:06:55.8584641Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2024-12-18T01:06:55.8585684Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local ... 2024-12-18T01:06:56.0697199Z 2024-12-18T01:06:56.0698462Z  2024-12-18T01:06:56.0698975Z  2024-12-18T01:06:56.0699378Z  2024-12-18T01:06:56.0699744Z  2024-12-18T01:06:56.0700138Z  2024-12-18T01:06:56.0700514Z  2024-12-18T01:06:56.0700904Z  2024-12-18T01:06:56.0701278Z  2024-12-18T01:06:56.0702199Z [20,225 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:56.0703133Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2024-12-18T01:06:56.0703770Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T01:06:56.0704414Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2024-12-18T01:06:56.0705060Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T01:06:56.0705664Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T01:06:56.0706264Z Compiling test/cpp/cpp_test_util.cpp; 46s local 2024-12-18T01:06:56.0707059Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2024-12-18T01:06:56.0708037Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local ... 2024-12-18T01:06:56.2762732Z 2024-12-18T01:06:56.2763633Z  2024-12-18T01:06:56.2764154Z  2024-12-18T01:06:56.2764538Z  2024-12-18T01:06:56.2764968Z  2024-12-18T01:06:56.2765336Z  2024-12-18T01:06:56.2765736Z  2024-12-18T01:06:56.2766084Z  2024-12-18T01:06:56.2766431Z  2024-12-18T01:06:56.2767287Z [20,226 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:56.2768546Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T01:06:56.2769155Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2024-12-18T01:06:56.2769833Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T01:06:56.2770547Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T01:06:56.2771204Z Compiling test/cpp/cpp_test_util.cpp; 46s local 2024-12-18T01:06:56.2771798Z Compiling test/cpp/cpp_test_util.cpp; 46s local 2024-12-18T01:06:56.2772498Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2024-12-18T01:06:56.2773490Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local ... 2024-12-18T01:06:56.6767174Z 2024-12-18T01:06:56.6768090Z  2024-12-18T01:06:56.6769226Z  2024-12-18T01:06:56.6770907Z  2024-12-18T01:06:56.6772336Z  2024-12-18T01:06:56.6773782Z  2024-12-18T01:06:56.6775066Z  2024-12-18T01:06:56.6776010Z  2024-12-18T01:06:56.6776557Z  2024-12-18T01:06:56.6777736Z [20,226 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:56.6778688Z @llvm-project//mlir:LinalgTransforms; 84s local 2024-12-18T01:06:56.6779373Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2024-12-18T01:06:56.6780124Z Compiling xla/service/cpu/cpu_compiler.cc; 62s local 2024-12-18T01:06:56.6780928Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2024-12-18T01:06:56.6781618Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2024-12-18T01:06:56.6782331Z Compiling test/cpp/cpp_test_util.cpp; 46s local 2024-12-18T01:06:56.6783112Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 46s local 2024-12-18T01:06:56.6783963Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local ... 2024-12-18T01:06:57.2773118Z 2024-12-18T01:06:57.2773960Z  2024-12-18T01:06:57.2774432Z  2024-12-18T01:06:57.2774903Z  2024-12-18T01:06:57.2775270Z  2024-12-18T01:06:57.2775614Z  2024-12-18T01:06:57.2776000Z  2024-12-18T01:06:57.2776528Z  2024-12-18T01:06:57.2776930Z  2024-12-18T01:06:57.2777789Z [20,227 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:57.2778677Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T01:06:57.2779283Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:57.2779898Z Compiling xla/service/cpu/cpu_compiler.cc; 62s local 2024-12-18T01:06:57.2780593Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2024-12-18T01:06:57.2781235Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2024-12-18T01:06:57.2781922Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 46s local 2024-12-18T01:06:57.2782654Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2024-12-18T01:06:57.2783357Z Compiling torch_xla/csrc/debug_util.cpp; 39s local ... 2024-12-18T01:06:57.4950559Z 2024-12-18T01:06:57.4951405Z  2024-12-18T01:06:57.4951893Z  2024-12-18T01:06:57.4952276Z  2024-12-18T01:06:57.4952670Z  2024-12-18T01:06:57.4953120Z  2024-12-18T01:06:57.4953517Z  2024-12-18T01:06:57.4953924Z  2024-12-18T01:06:57.4954285Z  2024-12-18T01:06:57.4955193Z [20,228 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:57.4956157Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T01:06:57.4957003Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:57.4960404Z Compiling xla/service/cpu/cpu_compiler.cc; 62s local 2024-12-18T01:06:57.4961319Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2024-12-18T01:06:57.4962072Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2024-12-18T01:06:57.4962838Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2024-12-18T01:06:57.4963646Z Compiling torch_xla/csrc/debug_util.cpp; 39s local 2024-12-18T01:06:57.4964685Z Compiling torch_xla/csrc/helpers.cpp; 35s local ... 2024-12-18T01:06:57.7142874Z 2024-12-18T01:06:57.7143713Z  2024-12-18T01:06:57.7144421Z  2024-12-18T01:06:57.7144807Z  2024-12-18T01:06:57.7145231Z  2024-12-18T01:06:57.7145643Z  2024-12-18T01:06:57.7146004Z  2024-12-18T01:06:57.7146390Z  2024-12-18T01:06:57.7146772Z  2024-12-18T01:06:57.7147667Z [20,229 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:57.7148598Z @llvm-project//mlir:LinalgTransforms; 85s local 2024-12-18T01:06:57.7149301Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:57.7150248Z Compiling xla/service/cpu/cpu_compiler.cc; 62s local 2024-12-18T01:06:57.7151023Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2024-12-18T01:06:57.7151705Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2024-12-18T01:06:57.7152447Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T01:06:57.7153222Z Compiling torch_xla/csrc/debug_util.cpp; 39s local 2024-12-18T01:06:57.7154146Z Compiling torch_xla/csrc/helpers.cpp; 36s local ... 2024-12-18T01:06:58.0779562Z 2024-12-18T01:06:58.0780602Z  2024-12-18T01:06:58.0781048Z  2024-12-18T01:06:58.0781384Z  2024-12-18T01:06:58.0781927Z  2024-12-18T01:06:58.0782313Z  2024-12-18T01:06:58.0782679Z  2024-12-18T01:06:58.0783022Z  2024-12-18T01:06:58.0783354Z  2024-12-18T01:06:58.0784238Z [20,229 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:58.0785208Z @llvm-project//mlir:LinalgTransforms; 86s local 2024-12-18T01:06:58.0785918Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2024-12-18T01:06:58.0786643Z Compiling xla/service/cpu/cpu_compiler.cc; 63s local 2024-12-18T01:06:58.0787355Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2024-12-18T01:06:58.0788024Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2024-12-18T01:06:58.0788792Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T01:06:58.0789487Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2024-12-18T01:06:58.0790206Z Compiling torch_xla/csrc/helpers.cpp; 36s local ... 2024-12-18T01:06:58.4785322Z 2024-12-18T01:06:58.4786290Z  2024-12-18T01:06:58.4786784Z  2024-12-18T01:06:58.4787147Z  2024-12-18T01:06:58.4787501Z  2024-12-18T01:06:58.4787893Z  2024-12-18T01:06:58.4788277Z  2024-12-18T01:06:58.4788678Z  2024-12-18T01:06:58.4789098Z  2024-12-18T01:06:58.4790071Z [20,230 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:06:58.4791054Z @llvm-project//mlir:LinalgTransforms; 86s local 2024-12-18T01:06:58.4791772Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T01:06:58.4792475Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2024-12-18T01:06:58.4793208Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2024-12-18T01:06:58.4793995Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T01:06:58.4794689Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2024-12-18T01:06:58.4795349Z Compiling torch_xla/csrc/helpers.cpp; 36s local 2024-12-18T01:06:58.4796062Z Compiling torch_xla/csrc/ir_dump_util.cpp; 36s local ... 2024-12-18T01:06:58.8789015Z 2024-12-18T01:06:58.8789962Z  2024-12-18T01:06:58.8790438Z  2024-12-18T01:06:58.8791002Z  2024-12-18T01:06:58.8791398Z  2024-12-18T01:06:58.8791815Z  2024-12-18T01:06:58.8792501Z  2024-12-18T01:06:58.8792926Z  2024-12-18T01:06:58.8793295Z  2024-12-18T01:06:58.8794266Z [20,230 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:58.8795071Z @llvm-project//mlir:LinalgTransforms; 86s local 2024-12-18T01:06:58.8795688Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T01:06:58.8796498Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2024-12-18T01:06:58.8797221Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2024-12-18T01:06:58.8797821Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T01:06:58.8798512Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2024-12-18T01:06:58.8799236Z Compiling torch_xla/csrc/helpers.cpp; 37s local 2024-12-18T01:06:58.8800039Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local ... 2024-12-18T01:06:59.0988763Z 2024-12-18T01:06:59.0989706Z  2024-12-18T01:06:59.0990179Z  2024-12-18T01:06:59.0990591Z  2024-12-18T01:06:59.0990967Z  2024-12-18T01:06:59.0991364Z  2024-12-18T01:06:59.0991768Z  2024-12-18T01:06:59.0992339Z  2024-12-18T01:06:59.0992742Z  2024-12-18T01:06:59.0993659Z [20,231 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:06:59.0994665Z @llvm-project//mlir:LinalgTransforms; 87s local 2024-12-18T01:06:59.0995393Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2024-12-18T01:06:59.0996092Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2024-12-18T01:06:59.0996935Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2024-12-18T01:06:59.0997705Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T01:06:59.0998503Z Compiling torch_xla/csrc/debug_util.cpp; 41s local 2024-12-18T01:06:59.0999274Z Compiling torch_xla/csrc/helpers.cpp; 37s local 2024-12-18T01:06:59.1000088Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local ... 2024-12-18T01:06:59.4794883Z 2024-12-18T01:06:59.4795759Z  2024-12-18T01:06:59.4796240Z  2024-12-18T01:06:59.4796645Z  2024-12-18T01:06:59.4797066Z  2024-12-18T01:06:59.4797433Z  2024-12-18T01:06:59.4797808Z  2024-12-18T01:06:59.4798169Z  2024-12-18T01:06:59.4798566Z  2024-12-18T01:06:59.4799534Z [20,232 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:06:59.4800522Z @llvm-project//mlir:LinalgTransforms; 87s local 2024-12-18T01:06:59.4801244Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2024-12-18T01:06:59.4801955Z Compiling test/cpp/cpp_test_util.cpp; 50s local 2024-12-18T01:06:59.4802705Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2024-12-18T01:06:59.4803469Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T01:06:59.4804254Z Compiling torch_xla/csrc/debug_util.cpp; 41s local 2024-12-18T01:06:59.4805019Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local 2024-12-18T01:06:59.4805856Z Compiling torch_xla/csrc/reduction.cpp; 35s local ... 2024-12-18T01:07:00.4806245Z 2024-12-18T01:07:00.4807153Z  2024-12-18T01:07:00.4807626Z  2024-12-18T01:07:00.4808038Z  2024-12-18T01:07:00.4808405Z  2024-12-18T01:07:00.4808797Z  2024-12-18T01:07:00.4809209Z  2024-12-18T01:07:00.4809624Z  2024-12-18T01:07:00.4810026Z  2024-12-18T01:07:00.4810984Z [20,232 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:00.4811961Z @llvm-project//mlir:LinalgTransforms; 88s local 2024-12-18T01:07:00.4812680Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2024-12-18T01:07:00.4813408Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2024-12-18T01:07:00.4814189Z Compiling test/cpp/cpp_test_util.cpp; 50s local 2024-12-18T01:07:00.4814991Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2024-12-18T01:07:00.4815765Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2024-12-18T01:07:00.4817042Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local 2024-12-18T01:07:00.4817842Z Compiling torch_xla/csrc/reduction.cpp; 36s local ... 2024-12-18T01:07:01.0811143Z 2024-12-18T01:07:01.0812100Z  2024-12-18T01:07:01.0812516Z  2024-12-18T01:07:01.0813314Z  2024-12-18T01:07:01.0813837Z  2024-12-18T01:07:01.0814327Z  2024-12-18T01:07:01.0815129Z  2024-12-18T01:07:01.0815610Z  2024-12-18T01:07:01.0816098Z  2024-12-18T01:07:01.0817403Z [20,233 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:01.0818474Z @llvm-project//mlir:LinalgTransforms; 89s local 2024-12-18T01:07:01.0819267Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2024-12-18T01:07:01.0820016Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2024-12-18T01:07:01.0820814Z Compiling test/cpp/cpp_test_util.cpp; 50s local 2024-12-18T01:07:01.0821630Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2024-12-18T01:07:01.0822514Z Compiling torch_xla/csrc/debug_util.cpp; 43s local 2024-12-18T01:07:01.0823549Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local 2024-12-18T01:07:01.0824421Z Compiling torch_xla/csrc/tensor_impl.cpp; 33s local ... 2024-12-18T01:07:01.4816828Z 2024-12-18T01:07:01.4817759Z  2024-12-18T01:07:01.4818513Z  2024-12-18T01:07:01.4818931Z  2024-12-18T01:07:01.4819464Z  2024-12-18T01:07:01.4819972Z  2024-12-18T01:07:01.4820464Z  2024-12-18T01:07:01.4821074Z  2024-12-18T01:07:01.4821873Z  2024-12-18T01:07:01.4822890Z [20,233 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:01.4824109Z @llvm-project//mlir:LinalgTransforms; 89s local 2024-12-18T01:07:01.4824919Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2024-12-18T01:07:01.4825729Z Compiling test/cpp/cpp_test_util.cpp; 52s local 2024-12-18T01:07:01.4826594Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2024-12-18T01:07:01.4827491Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2024-12-18T01:07:01.4828403Z Compiling torch_xla/csrc/debug_util.cpp; 43s local 2024-12-18T01:07:01.4829229Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local 2024-12-18T01:07:01.4830129Z Compiling torch_xla/csrc/tensor_impl.cpp; 33s local ... 2024-12-18T01:07:01.6820838Z 2024-12-18T01:07:01.6821748Z  2024-12-18T01:07:01.6822194Z  2024-12-18T01:07:01.6822565Z  2024-12-18T01:07:01.6822963Z  2024-12-18T01:07:01.6823376Z  2024-12-18T01:07:01.6823771Z  2024-12-18T01:07:01.6824152Z  2024-12-18T01:07:01.6824526Z  2024-12-18T01:07:01.6825441Z [20,234 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:01.6826597Z @llvm-project//mlir:LinalgTransforms; 89s local 2024-12-18T01:07:01.6827299Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2024-12-18T01:07:01.6828020Z Compiling test/cpp/cpp_test_util.cpp; 52s local 2024-12-18T01:07:01.6828759Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2024-12-18T01:07:01.6829530Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2024-12-18T01:07:01.6830341Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local 2024-12-18T01:07:01.6831101Z Compiling torch_xla/csrc/tensor_impl.cpp; 34s local 2024-12-18T01:07:01.6831880Z Compiling torch_xla/csrc/tensor.cpp; 33s local ... 2024-12-18T01:07:02.0824531Z 2024-12-18T01:07:02.0825385Z  2024-12-18T01:07:02.0825852Z  2024-12-18T01:07:02.0826255Z  2024-12-18T01:07:02.0826670Z  2024-12-18T01:07:02.0827097Z  2024-12-18T01:07:02.0827501Z  2024-12-18T01:07:02.0827871Z  2024-12-18T01:07:02.0828267Z  2024-12-18T01:07:02.0829227Z [20,234 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:02.0830252Z @llvm-project//mlir:LinalgTransforms; 90s local 2024-12-18T01:07:02.0831450Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2024-12-18T01:07:02.0832175Z Compiling test/cpp/cpp_test_util.cpp; 52s local 2024-12-18T01:07:02.0832952Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2024-12-18T01:07:02.0833764Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2024-12-18T01:07:02.0834557Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local 2024-12-18T01:07:02.0835425Z Compiling torch_xla/csrc/tensor_impl.cpp; 34s local 2024-12-18T01:07:02.0836189Z Compiling torch_xla/csrc/tensor.cpp; 33s local ... 2024-12-18T01:07:03.0831115Z 2024-12-18T01:07:03.0831951Z  2024-12-18T01:07:03.0832416Z  2024-12-18T01:07:03.0832839Z  2024-12-18T01:07:03.0833226Z  2024-12-18T01:07:03.0833634Z  2024-12-18T01:07:03.0834026Z  2024-12-18T01:07:03.0834424Z  2024-12-18T01:07:03.0834813Z  2024-12-18T01:07:03.0835735Z [20,234 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:03.0836675Z @llvm-project//mlir:LinalgTransforms; 91s local 2024-12-18T01:07:03.0837581Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2024-12-18T01:07:03.0838267Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2024-12-18T01:07:03.0838964Z Compiling test/cpp/cpp_test_util.cpp; 52s local 2024-12-18T01:07:03.0839692Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2024-12-18T01:07:03.0840491Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2024-12-18T01:07:03.0841339Z Compiling torch_xla/csrc/tensor_impl.cpp; 35s local 2024-12-18T01:07:03.0842022Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2024-12-18T01:07:03.2885998Z 2024-12-18T01:07:03.2886913Z  2024-12-18T01:07:03.2887372Z  2024-12-18T01:07:03.2887787Z  2024-12-18T01:07:03.2888194Z  2024-12-18T01:07:03.2888570Z  2024-12-18T01:07:03.2888965Z  2024-12-18T01:07:03.2889363Z  2024-12-18T01:07:03.2889784Z  2024-12-18T01:07:03.2890724Z [20,235 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:03.2891667Z @llvm-project//mlir:LinalgTransforms; 91s local 2024-12-18T01:07:03.2892312Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T01:07:03.2892992Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2024-12-18T01:07:03.2893687Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2024-12-18T01:07:03.2894429Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2024-12-18T01:07:03.2895175Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2024-12-18T01:07:03.2895926Z Compiling torch_xla/csrc/tensor_impl.cpp; 35s local 2024-12-18T01:07:03.2896822Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2024-12-18T01:07:03.6838901Z 2024-12-18T01:07:03.6839781Z  2024-12-18T01:07:03.6840417Z  2024-12-18T01:07:03.6840834Z  2024-12-18T01:07:03.6841229Z  2024-12-18T01:07:03.6841657Z  2024-12-18T01:07:03.6842053Z  2024-12-18T01:07:03.6842436Z  2024-12-18T01:07:03.6842825Z  2024-12-18T01:07:03.6843777Z [20,235 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:03.6845013Z @llvm-project//mlir:LinalgTransforms; 91s local 2024-12-18T01:07:03.6845748Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2024-12-18T01:07:03.6846416Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2024-12-18T01:07:03.6847063Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2024-12-18T01:07:03.6847800Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2024-12-18T01:07:03.6848587Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2024-12-18T01:07:03.6849385Z Compiling torch_xla/csrc/tensor_impl.cpp; 36s local 2024-12-18T01:07:03.6850152Z Compiling torch_xla/csrc/tensor.cpp; 35s local ... 2024-12-18T01:07:04.6849872Z 2024-12-18T01:07:04.6850757Z  2024-12-18T01:07:04.6851504Z  2024-12-18T01:07:04.6851879Z  2024-12-18T01:07:04.6852282Z  2024-12-18T01:07:04.6852656Z  2024-12-18T01:07:04.6853056Z  2024-12-18T01:07:04.6853473Z  2024-12-18T01:07:04.6853837Z  2024-12-18T01:07:04.6854758Z [20,235 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:04.6855734Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T01:07:04.6856799Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2024-12-18T01:07:04.6857559Z Compiling test/cpp/cpp_test_util.cpp; 55s local 2024-12-18T01:07:04.6858330Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2024-12-18T01:07:04.6859125Z Compiling torch_xla/csrc/aten_xla_type.cpp; 52s local 2024-12-18T01:07:04.6859921Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2024-12-18T01:07:04.6860700Z Compiling torch_xla/csrc/tensor_impl.cpp; 37s local 2024-12-18T01:07:04.6861464Z Compiling torch_xla/csrc/tensor.cpp; 36s local ... 2024-12-18T01:07:04.9105851Z 2024-12-18T01:07:04.9106829Z  2024-12-18T01:07:04.9107304Z  2024-12-18T01:07:04.9108020Z  2024-12-18T01:07:04.9108407Z  2024-12-18T01:07:04.9108831Z  2024-12-18T01:07:04.9109228Z  2024-12-18T01:07:04.9109637Z  2024-12-18T01:07:04.9110038Z  2024-12-18T01:07:04.9111009Z [20,236 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:04.9112083Z @llvm-project//mlir:LinalgTransforms; 92s local 2024-12-18T01:07:04.9112962Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2024-12-18T01:07:04.9113714Z Compiling test/cpp/cpp_test_util.cpp; 55s local 2024-12-18T01:07:04.9114462Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2024-12-18T01:07:04.9115244Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2024-12-18T01:07:04.9116083Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2024-12-18T01:07:04.9116873Z Compiling torch_xla/csrc/tensor.cpp; 36s local 2024-12-18T01:07:04.9117727Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local ... 2024-12-18T01:07:05.2859519Z 2024-12-18T01:07:05.2860434Z  2024-12-18T01:07:05.2860883Z  2024-12-18T01:07:05.2861262Z  2024-12-18T01:07:05.2861630Z  2024-12-18T01:07:05.2861987Z  2024-12-18T01:07:05.2862352Z  2024-12-18T01:07:05.2862719Z  2024-12-18T01:07:05.2863091Z  2024-12-18T01:07:05.2863949Z [20,237 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:05.2864959Z @llvm-project//mlir:LinalgTransforms; 93s local 2024-12-18T01:07:05.2865651Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2024-12-18T01:07:05.2866333Z Compiling test/cpp/cpp_test_util.cpp; 55s local 2024-12-18T01:07:05.2867090Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2024-12-18T01:07:05.2867899Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2024-12-18T01:07:05.2868654Z Compiling torch_xla/csrc/tensor.cpp; 36s local 2024-12-18T01:07:05.2869453Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local 2024-12-18T01:07:05.2870255Z Compiling torch_xla/csrc/tensor_util.cpp; 33s local ... 2024-12-18T01:07:05.6865196Z 2024-12-18T01:07:05.6866033Z  2024-12-18T01:07:05.6866517Z  2024-12-18T01:07:05.6866939Z  2024-12-18T01:07:05.6867307Z  2024-12-18T01:07:05.6867726Z  2024-12-18T01:07:05.6868118Z  2024-12-18T01:07:05.6868505Z  2024-12-18T01:07:05.6868882Z  2024-12-18T01:07:05.6869798Z [20,239 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:05.6870762Z @llvm-project//mlir:LinalgTransforms; 93s local 2024-12-18T01:07:05.6871374Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2024-12-18T01:07:05.6871972Z Compiling test/cpp/cpp_test_util.cpp; 55s local 2024-12-18T01:07:05.6872681Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2024-12-18T01:07:05.6873803Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2024-12-18T01:07:05.6874563Z Compiling torch_xla/csrc/tensor.cpp; 37s local 2024-12-18T01:07:05.6875344Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local 2024-12-18T01:07:05.6876178Z Compiling torch_xla/csrc/tensor_util.cpp; 34s local ... 2024-12-18T01:07:06.6872340Z 2024-12-18T01:07:06.6873198Z  2024-12-18T01:07:06.6873981Z  2024-12-18T01:07:06.6874411Z  2024-12-18T01:07:06.6874798Z  2024-12-18T01:07:06.6875167Z  2024-12-18T01:07:06.6875546Z  2024-12-18T01:07:06.6875933Z  2024-12-18T01:07:06.6876284Z  2024-12-18T01:07:06.6877128Z [20,239 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:06.6878101Z @llvm-project//mlir:LinalgTransforms; 94s local 2024-12-18T01:07:06.6878775Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2024-12-18T01:07:06.6879457Z Compiling test/cpp/cpp_test_util.cpp; 56s local 2024-12-18T01:07:06.6880250Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2024-12-18T01:07:06.6881254Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2024-12-18T01:07:06.6881988Z Compiling torch_xla/csrc/tensor.cpp; 38s local 2024-12-18T01:07:06.6882757Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local 2024-12-18T01:07:06.6883638Z Compiling torch_xla/csrc/tensor_util.cpp; 35s local ... 2024-12-18T01:07:06.9961813Z 2024-12-18T01:07:06.9962719Z  2024-12-18T01:07:06.9963157Z  2024-12-18T01:07:06.9963532Z  2024-12-18T01:07:06.9964201Z  2024-12-18T01:07:06.9964604Z  2024-12-18T01:07:06.9964957Z  2024-12-18T01:07:06.9965355Z  2024-12-18T01:07:06.9965760Z  2024-12-18T01:07:06.9966664Z [20,240 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:06.9967626Z @llvm-project//mlir:LinalgTransforms; 94s local 2024-12-18T01:07:06.9968360Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2024-12-18T01:07:06.9969085Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T01:07:06.9970064Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2024-12-18T01:07:06.9970823Z Compiling torch_xla/csrc/tensor.cpp; 38s local 2024-12-18T01:07:06.9971594Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local 2024-12-18T01:07:06.9972322Z Compiling torch_xla/csrc/tensor_util.cpp; 35s local 2024-12-18T01:07:06.9973077Z Compiling torch_xla/csrc/torch_util.cpp; 34s local ... 2024-12-18T01:07:07.2879327Z 2024-12-18T01:07:07.2880249Z  2024-12-18T01:07:07.2880709Z  2024-12-18T01:07:07.2881075Z  2024-12-18T01:07:07.2881408Z  2024-12-18T01:07:07.2881725Z  2024-12-18T01:07:07.2882056Z  2024-12-18T01:07:07.2882389Z  2024-12-18T01:07:07.2882733Z  2024-12-18T01:07:07.2883614Z [20,241 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:07.2884545Z @llvm-project//mlir:LinalgTransforms; 95s local 2024-12-18T01:07:07.2885182Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2024-12-18T01:07:07.2885856Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T01:07:07.2886564Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2024-12-18T01:07:07.2887245Z Compiling torch_xla/csrc/tensor.cpp; 38s local 2024-12-18T01:07:07.2887956Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local 2024-12-18T01:07:07.2888699Z Compiling torch_xla/csrc/tensor_util.cpp; 35s local 2024-12-18T01:07:07.2889410Z Compiling torch_xla/csrc/torch_util.cpp; 35s local ... 2024-12-18T01:07:08.2889378Z 2024-12-18T01:07:08.2890293Z  2024-12-18T01:07:08.2890711Z  2024-12-18T01:07:08.2891023Z  2024-12-18T01:07:08.2891323Z  2024-12-18T01:07:08.2891625Z  2024-12-18T01:07:08.2892245Z  2024-12-18T01:07:08.2892614Z  2024-12-18T01:07:08.2893058Z  2024-12-18T01:07:08.2894280Z [20,241 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:08.2895330Z @llvm-project//mlir:LinalgTransforms; 96s local 2024-12-18T01:07:08.2896101Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2024-12-18T01:07:08.2896993Z Compiling torch_xla/csrc/aten_xla_type.cpp; 56s local 2024-12-18T01:07:08.2897845Z Compiling torch_xla/csrc/ir_dump_util.cpp; 46s local 2024-12-18T01:07:08.2898847Z Compiling torch_xla/csrc/tensor.cpp; 39s local 2024-12-18T01:07:08.2899690Z Compiling torch_xla/csrc/tensor_methods.cpp; 39s local 2024-12-18T01:07:08.2900554Z Compiling torch_xla/csrc/tensor_util.cpp; 36s local 2024-12-18T01:07:08.2912129Z Compiling torch_xla/csrc/torch_util.cpp; 36s local ... 2024-12-18T01:07:08.9258319Z 2024-12-18T01:07:08.9259660Z  2024-12-18T01:07:08.9260156Z  2024-12-18T01:07:08.9260531Z  2024-12-18T01:07:08.9260882Z  2024-12-18T01:07:08.9261241Z  2024-12-18T01:07:08.9261629Z  2024-12-18T01:07:08.9262026Z  2024-12-18T01:07:08.9262386Z  2024-12-18T01:07:08.9263596Z [20,242 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:08.9264546Z @llvm-project//mlir:LinalgTransforms; 96s local 2024-12-18T01:07:08.9265239Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2024-12-18T01:07:08.9266010Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2024-12-18T01:07:08.9266694Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2024-12-18T01:07:08.9267606Z Compiling torch_xla/csrc/tensor_methods.cpp; 39s local 2024-12-18T01:07:08.9268370Z Compiling torch_xla/csrc/tensor_util.cpp; 37s local 2024-12-18T01:07:08.9269066Z Compiling torch_xla/csrc/torch_util.cpp; 36s local 2024-12-18T01:07:08.9269841Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 35s local ... 2024-12-18T01:07:09.2900877Z 2024-12-18T01:07:09.2902268Z  2024-12-18T01:07:09.2902766Z  2024-12-18T01:07:09.2903204Z  2024-12-18T01:07:09.2903626Z  2024-12-18T01:07:09.2903966Z  2024-12-18T01:07:09.2904322Z  2024-12-18T01:07:09.2904633Z  2024-12-18T01:07:09.2904916Z  2024-12-18T01:07:09.2905636Z [20,242 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:09.2906421Z @llvm-project//mlir:LinalgTransforms; 97s local 2024-12-18T01:07:09.2907036Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2024-12-18T01:07:09.2907697Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2024-12-18T01:07:09.2908295Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2024-12-18T01:07:09.2909105Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local 2024-12-18T01:07:09.2909882Z Compiling torch_xla/csrc/tensor_util.cpp; 37s local 2024-12-18T01:07:09.2910593Z Compiling torch_xla/csrc/torch_util.cpp; 37s local 2024-12-18T01:07:09.2911401Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 35s local ... 2024-12-18T01:07:10.2911791Z 2024-12-18T01:07:10.2913091Z  2024-12-18T01:07:10.2913544Z  2024-12-18T01:07:10.2913924Z  2024-12-18T01:07:10.2914243Z  2024-12-18T01:07:10.2914584Z  2024-12-18T01:07:10.2914911Z  2024-12-18T01:07:10.2915255Z  2024-12-18T01:07:10.2915593Z  2024-12-18T01:07:10.2916388Z [20,242 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:10.2917213Z @llvm-project//mlir:LinalgTransforms; 98s local 2024-12-18T01:07:10.2917884Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2024-12-18T01:07:10.2918569Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2024-12-18T01:07:10.2919195Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2024-12-18T01:07:10.2919838Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2024-12-18T01:07:10.2920498Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local 2024-12-18T01:07:10.2921158Z Compiling torch_xla/csrc/torch_util.cpp; 38s local 2024-12-18T01:07:10.2922170Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 36s local ... 2024-12-18T01:07:10.7829651Z 2024-12-18T01:07:10.7830990Z  2024-12-18T01:07:10.7831415Z  2024-12-18T01:07:10.7831781Z  2024-12-18T01:07:10.7832136Z  2024-12-18T01:07:10.7832528Z  2024-12-18T01:07:10.7832864Z  2024-12-18T01:07:10.7833588Z  2024-12-18T01:07:10.7833931Z  2024-12-18T01:07:10.7834790Z [20,243 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:10.7835810Z @llvm-project//mlir:LinalgTransforms; 98s local 2024-12-18T01:07:10.7836481Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2024-12-18T01:07:10.7837201Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2024-12-18T01:07:10.7837930Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2024-12-18T01:07:10.7838695Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2024-12-18T01:07:10.7839463Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local 2024-12-18T01:07:10.7840563Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 37s local 2024-12-18T01:07:10.7841596Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 36s local ... 2024-12-18T01:07:11.0917233Z 2024-12-18T01:07:11.0918503Z  2024-12-18T01:07:11.0918967Z  2024-12-18T01:07:11.0919326Z  2024-12-18T01:07:11.0919728Z  2024-12-18T01:07:11.0920095Z  2024-12-18T01:07:11.0920441Z  2024-12-18T01:07:11.0920796Z  2024-12-18T01:07:11.0921590Z  2024-12-18T01:07:11.0922491Z [20,243 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:11.0923421Z @llvm-project//mlir:LinalgTransforms; 99s local 2024-12-18T01:07:11.0924125Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2024-12-18T01:07:11.0924889Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2024-12-18T01:07:11.0925611Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2024-12-18T01:07:11.0926363Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local 2024-12-18T01:07:11.0927134Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local 2024-12-18T01:07:11.0927898Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 37s local 2024-12-18T01:07:11.0928694Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 36s local ... 2024-12-18T01:07:12.0926163Z 2024-12-18T01:07:12.0927645Z  2024-12-18T01:07:12.0928111Z  2024-12-18T01:07:12.0928501Z  2024-12-18T01:07:12.0928899Z  2024-12-18T01:07:12.0929307Z  2024-12-18T01:07:12.0929696Z  2024-12-18T01:07:12.0930073Z  2024-12-18T01:07:12.0930452Z  2024-12-18T01:07:12.0931375Z [20,243 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:12.0932352Z @llvm-project//mlir:LinalgTransforms; 100s local 2024-12-18T01:07:12.0933101Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T01:07:12.0933867Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2024-12-18T01:07:12.0934649Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2024-12-18T01:07:12.0935371Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2024-12-18T01:07:12.0936161Z Compiling torch_xla/csrc/tensor_util.cpp; 40s local 2024-12-18T01:07:12.0937111Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 38s local 2024-12-18T01:07:12.0938026Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local ... 2024-12-18T01:07:12.2931027Z 2024-12-18T01:07:12.2932447Z  2024-12-18T01:07:12.2932952Z  2024-12-18T01:07:12.2933278Z  2024-12-18T01:07:12.2933635Z  2024-12-18T01:07:12.2933987Z  2024-12-18T01:07:12.2934350Z  2024-12-18T01:07:12.2934716Z  2024-12-18T01:07:12.2935071Z  2024-12-18T01:07:12.2935949Z [20,244 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:12.2937357Z @llvm-project//mlir:LinalgTransforms; 100s local 2024-12-18T01:07:12.2938159Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T01:07:12.2938907Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2024-12-18T01:07:12.2939623Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2024-12-18T01:07:12.2940503Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2024-12-18T01:07:12.2941459Z Compiling torch_xla/csrc/tensor_util.cpp; 40s local 2024-12-18T01:07:12.2942191Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local 2024-12-18T01:07:12.2943021Z Compiling torch_xla/csrc/xla_lower_util.cpp; 35s local ... 2024-12-18T01:07:13.2941963Z 2024-12-18T01:07:13.2943393Z  2024-12-18T01:07:13.2943890Z  2024-12-18T01:07:13.2944460Z  2024-12-18T01:07:13.2944852Z  2024-12-18T01:07:13.2945213Z  2024-12-18T01:07:13.2945586Z  2024-12-18T01:07:13.2945975Z  2024-12-18T01:07:13.2946358Z  2024-12-18T01:07:13.2947332Z [20,244 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:13.2948596Z @llvm-project//mlir:LinalgTransforms; 101s local 2024-12-18T01:07:13.2949379Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T01:07:13.2950163Z Compiling torch_xla/csrc/ir_dump_util.cpp; 51s local 2024-12-18T01:07:13.2950885Z Compiling torch_xla/csrc/tensor.cpp; 44s local 2024-12-18T01:07:13.2951647Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2024-12-18T01:07:13.2952593Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2024-12-18T01:07:13.2953411Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 38s local 2024-12-18T01:07:13.2954246Z Compiling torch_xla/csrc/xla_lower_util.cpp; 36s local ... 2024-12-18T01:07:14.2953123Z 2024-12-18T01:07:14.2954516Z  2024-12-18T01:07:14.2955019Z  2024-12-18T01:07:14.2955399Z  2024-12-18T01:07:14.2955738Z  2024-12-18T01:07:14.2956138Z  2024-12-18T01:07:14.2956518Z  2024-12-18T01:07:14.2956876Z  2024-12-18T01:07:14.2957243Z  2024-12-18T01:07:14.2958154Z [20,244 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:14.2959083Z @llvm-project//mlir:LinalgTransforms; 102s local 2024-12-18T01:07:14.2959826Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2024-12-18T01:07:14.2960595Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2024-12-18T01:07:14.2961314Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2024-12-18T01:07:14.2962202Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2024-12-18T01:07:14.2962890Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local 2024-12-18T01:07:14.2963700Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local 2024-12-18T01:07:14.2964648Z Compiling torch_xla/csrc/xla_lower_util.cpp; 37s local ... 2024-12-18T01:07:15.0113941Z 2024-12-18T01:07:15.0115253Z  2024-12-18T01:07:15.0115799Z  2024-12-18T01:07:15.0116177Z  2024-12-18T01:07:15.0116573Z  2024-12-18T01:07:15.0116972Z  2024-12-18T01:07:15.0117342Z  2024-12-18T01:07:15.0117717Z  2024-12-18T01:07:15.0118101Z  2024-12-18T01:07:15.0118993Z [20,245 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:15.0119967Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T01:07:15.0120704Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T01:07:15.0121507Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2024-12-18T01:07:15.0122214Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2024-12-18T01:07:15.0122991Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2024-12-18T01:07:15.0123771Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2024-12-18T01:07:15.0124568Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local 2024-12-18T01:07:15.0125760Z Compiling torch_xla/csrc/xla_op_builder.cpp; 36s local ... 2024-12-18T01:07:15.2963087Z 2024-12-18T01:07:15.2963977Z  2024-12-18T01:07:15.2964459Z  2024-12-18T01:07:15.2964810Z  2024-12-18T01:07:15.2965159Z  2024-12-18T01:07:15.2965504Z  2024-12-18T01:07:15.2965868Z  2024-12-18T01:07:15.2966221Z  2024-12-18T01:07:15.2966572Z  2024-12-18T01:07:15.2967774Z [20,245 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:15.2968675Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T01:07:15.2969360Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T01:07:15.2970076Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2024-12-18T01:07:15.2970721Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2024-12-18T01:07:15.2971384Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2024-12-18T01:07:15.2972114Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2024-12-18T01:07:15.2972887Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local 2024-12-18T01:07:15.2973922Z Compiling torch_xla/csrc/xla_op_builder.cpp; 36s local ... 2024-12-18T01:07:15.5900733Z 2024-12-18T01:07:15.5901627Z  2024-12-18T01:07:15.5902102Z  2024-12-18T01:07:15.5902517Z  2024-12-18T01:07:15.5902918Z  2024-12-18T01:07:15.5903299Z  2024-12-18T01:07:15.5903717Z  2024-12-18T01:07:15.5904096Z  2024-12-18T01:07:15.5904488Z  2024-12-18T01:07:15.5905690Z [20,246 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:15.5906660Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T01:07:15.5907452Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T01:07:15.5908280Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2024-12-18T01:07:15.5909082Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2024-12-18T01:07:15.5909903Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2024-12-18T01:07:15.5910770Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2024-12-18T01:07:15.5911656Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 41s local 2024-12-18T01:07:15.5912584Z Compiling torch_xla/csrc/xla_op_builder.cpp; 36s local ... 2024-12-18T01:07:15.8082563Z 2024-12-18T01:07:15.8083448Z  2024-12-18T01:07:15.8083966Z  2024-12-18T01:07:15.8084305Z  2024-12-18T01:07:15.8084695Z  2024-12-18T01:07:15.8085042Z  2024-12-18T01:07:15.8085404Z  2024-12-18T01:07:15.8085808Z  2024-12-18T01:07:15.8086206Z  2024-12-18T01:07:15.8087101Z [20,247 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:15.8088057Z @llvm-project//mlir:LinalgTransforms; 103s local 2024-12-18T01:07:15.8088827Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:07:15.8089623Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2024-12-18T01:07:15.8090378Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2024-12-18T01:07:15.8091168Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2024-12-18T01:07:15.8091918Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2024-12-18T01:07:15.8092806Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 41s local 2024-12-18T01:07:15.8093748Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local ... 2024-12-18T01:07:16.0969421Z 2024-12-18T01:07:16.0970308Z  2024-12-18T01:07:16.0970794Z  2024-12-18T01:07:16.0971231Z  2024-12-18T01:07:16.0971630Z  2024-12-18T01:07:16.0972030Z  2024-12-18T01:07:16.0972375Z  2024-12-18T01:07:16.0972720Z  2024-12-18T01:07:16.0973072Z  2024-12-18T01:07:16.0973980Z [20,247 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:16.0974959Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T01:07:16.0975983Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:07:16.0976952Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2024-12-18T01:07:16.0977713Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2024-12-18T01:07:16.0978463Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T01:07:16.0979239Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2024-12-18T01:07:16.0980244Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 41s local 2024-12-18T01:07:16.0981158Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local ... 2024-12-18T01:07:16.3952918Z 2024-12-18T01:07:16.3953771Z  2024-12-18T01:07:16.3954225Z  2024-12-18T01:07:16.3954646Z  2024-12-18T01:07:16.3955011Z  2024-12-18T01:07:16.3955361Z  2024-12-18T01:07:16.3955760Z  2024-12-18T01:07:16.3956119Z  2024-12-18T01:07:16.3956487Z  2024-12-18T01:07:16.3957353Z [20,249 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:16.3958350Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T01:07:16.3959362Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:07:16.3960123Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2024-12-18T01:07:16.3960823Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T01:07:16.3961597Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2024-12-18T01:07:16.3962348Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2024-12-18T01:07:16.3964893Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local 2024-12-18T01:07:16.3965726Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 37s local ... 2024-12-18T01:07:16.6976313Z 2024-12-18T01:07:16.6977318Z  2024-12-18T01:07:16.6977749Z  2024-12-18T01:07:16.6978139Z  2024-12-18T01:07:16.6978502Z  2024-12-18T01:07:16.6978873Z  2024-12-18T01:07:16.6979254Z  2024-12-18T01:07:16.6979645Z  2024-12-18T01:07:16.6980027Z  2024-12-18T01:07:16.6980952Z [20,250 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:16.6981939Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T01:07:16.6982697Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:07:16.6983433Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2024-12-18T01:07:16.6984187Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T01:07:16.6984957Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local 2024-12-18T01:07:16.6985770Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2024-12-18T01:07:16.6986606Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local 2024-12-18T01:07:16.6987397Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 37s local ... 2024-12-18T01:07:16.8979858Z 2024-12-18T01:07:16.8980730Z  2024-12-18T01:07:16.8981173Z  2024-12-18T01:07:16.8981603Z  2024-12-18T01:07:16.8981989Z  2024-12-18T01:07:16.8982354Z  2024-12-18T01:07:16.8982740Z  2024-12-18T01:07:16.8983137Z  2024-12-18T01:07:16.8983522Z  2024-12-18T01:07:16.8984472Z [20,250 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:16.8985446Z @llvm-project//mlir:LinalgTransforms; 104s local 2024-12-18T01:07:16.8986200Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2024-12-18T01:07:16.8986974Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2024-12-18T01:07:16.8987773Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T01:07:16.8988580Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local 2024-12-18T01:07:16.8989322Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2024-12-18T01:07:16.8990120Z Compiling torch_xla/csrc/xla_op_builder.cpp; 38s local 2024-12-18T01:07:16.8990981Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 37s local ... 2024-12-18T01:07:17.6428431Z 2024-12-18T01:07:17.6429291Z  2024-12-18T01:07:17.6429736Z  2024-12-18T01:07:17.6430126Z  2024-12-18T01:07:17.6430517Z  2024-12-18T01:07:17.6430872Z  2024-12-18T01:07:17.6431207Z  2024-12-18T01:07:17.6431564Z  2024-12-18T01:07:17.6431912Z  2024-12-18T01:07:17.6432731Z [20,251 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:17.6433828Z @llvm-project//mlir:LinalgTransforms; 105s local 2024-12-18T01:07:17.6434573Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2024-12-18T01:07:17.6435284Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2024-12-18T01:07:17.6435988Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2024-12-18T01:07:17.6436691Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2024-12-18T01:07:17.6437406Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2024-12-18T01:07:17.6438137Z Compiling torch_xla/csrc/xla_op_builder.cpp; 38s local 2024-12-18T01:07:17.6438933Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local ... 2024-12-18T01:07:17.8988537Z 2024-12-18T01:07:17.8989387Z  2024-12-18T01:07:17.8989779Z  2024-12-18T01:07:17.8990107Z  2024-12-18T01:07:17.8990447Z  2024-12-18T01:07:17.8990741Z  2024-12-18T01:07:17.8991176Z  2024-12-18T01:07:17.8991513Z  2024-12-18T01:07:17.8991840Z  2024-12-18T01:07:17.8992736Z [20,251 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:17.8993525Z @llvm-project//mlir:LinalgTransforms; 105s local 2024-12-18T01:07:17.8994317Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T01:07:17.8994926Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2024-12-18T01:07:17.8995531Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2024-12-18T01:07:17.8996160Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2024-12-18T01:07:17.8996805Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2024-12-18T01:07:17.8997480Z Compiling torch_xla/csrc/xla_op_builder.cpp; 39s local 2024-12-18T01:07:17.8998151Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local ... 2024-12-18T01:07:18.1625866Z 2024-12-18T01:07:18.1626826Z  2024-12-18T01:07:18.1627297Z  2024-12-18T01:07:18.1627657Z  2024-12-18T01:07:18.1628041Z  2024-12-18T01:07:18.1628369Z  2024-12-18T01:07:18.1628718Z  2024-12-18T01:07:18.1629061Z  2024-12-18T01:07:18.1629423Z  2024-12-18T01:07:18.1630220Z [20,252 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:18.1631087Z @llvm-project//mlir:LinalgTransforms; 106s local 2024-12-18T01:07:18.1631759Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T01:07:18.1632413Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2024-12-18T01:07:18.1633092Z Compiling torch_xla/csrc/tensor_methods.cpp; 49s local 2024-12-18T01:07:18.1633906Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2024-12-18T01:07:18.1634618Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2024-12-18T01:07:18.1635363Z Compiling torch_xla/csrc/xla_op_builder.cpp; 39s local 2024-12-18T01:07:18.1636115Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 39s local ... 2024-12-18T01:07:18.4997535Z 2024-12-18T01:07:18.4998361Z  2024-12-18T01:07:18.4998787Z  2024-12-18T01:07:18.4999149Z  2024-12-18T01:07:18.4999530Z  2024-12-18T01:07:18.4999871Z  2024-12-18T01:07:18.5000225Z  2024-12-18T01:07:18.5000586Z  2024-12-18T01:07:18.5000950Z  2024-12-18T01:07:18.5001811Z [20,252 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:18.5002694Z @llvm-project//mlir:LinalgTransforms; 106s local 2024-12-18T01:07:18.5003400Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T01:07:18.5004352Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2024-12-18T01:07:18.5005049Z Compiling torch_xla/csrc/tensor_methods.cpp; 49s local 2024-12-18T01:07:18.5005770Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2024-12-18T01:07:18.5006488Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local 2024-12-18T01:07:18.5007234Z Compiling torch_xla/csrc/xla_op_builder.cpp; 39s local 2024-12-18T01:07:18.5008220Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 39s local ... 2024-12-18T01:07:19.5006918Z 2024-12-18T01:07:19.5007875Z  2024-12-18T01:07:19.5008347Z  2024-12-18T01:07:19.5008723Z  2024-12-18T01:07:19.5009105Z  2024-12-18T01:07:19.5009568Z  2024-12-18T01:07:19.5010065Z  2024-12-18T01:07:19.5010419Z  2024-12-18T01:07:19.5010788Z  2024-12-18T01:07:19.5011714Z [20,252 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:19.5012717Z @llvm-project//mlir:LinalgTransforms; 107s local 2024-12-18T01:07:19.5013727Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2024-12-18T01:07:19.5014473Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2024-12-18T01:07:19.5015256Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2024-12-18T01:07:19.5016029Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2024-12-18T01:07:19.5017029Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2024-12-18T01:07:19.5018209Z Compiling torch_xla/csrc/xla_op_builder.cpp; 40s local 2024-12-18T01:07:19.5019056Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local ... 2024-12-18T01:07:19.7611530Z 2024-12-18T01:07:19.7612397Z  2024-12-18T01:07:19.7612913Z  2024-12-18T01:07:19.7613358Z  2024-12-18T01:07:19.7613756Z  2024-12-18T01:07:19.7614150Z  2024-12-18T01:07:19.7614562Z  2024-12-18T01:07:19.7614958Z  2024-12-18T01:07:19.7615399Z  2024-12-18T01:07:19.7616362Z [20,253 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:19.7617546Z @llvm-project//mlir:LinalgTransforms; 107s local 2024-12-18T01:07:19.7618360Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T01:07:19.7619196Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2024-12-18T01:07:19.7620016Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2024-12-18T01:07:19.7620851Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2024-12-18T01:07:19.7621744Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2024-12-18T01:07:19.7622618Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local 2024-12-18T01:07:19.7623499Z Compiling torch_xla/csrc/RegisterXLA.cpp; 38s local ... 2024-12-18T01:07:20.1012689Z 2024-12-18T01:07:20.1014163Z  2024-12-18T01:07:20.1014614Z  2024-12-18T01:07:20.1015012Z  2024-12-18T01:07:20.1015404Z  2024-12-18T01:07:20.1015840Z  2024-12-18T01:07:20.1016206Z  2024-12-18T01:07:20.1016718Z  2024-12-18T01:07:20.1017135Z  2024-12-18T01:07:20.1018054Z [20,253 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:20.1019036Z @llvm-project//mlir:LinalgTransforms; 108s local 2024-12-18T01:07:20.1019854Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T01:07:20.1020691Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2024-12-18T01:07:20.1021454Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2024-12-18T01:07:20.1022287Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2024-12-18T01:07:20.1023072Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2024-12-18T01:07:20.1023839Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 41s local 2024-12-18T01:07:20.1024651Z Compiling torch_xla/csrc/RegisterXLA.cpp; 39s local ... 2024-12-18T01:07:20.5019105Z 2024-12-18T01:07:20.5019896Z  2024-12-18T01:07:20.5020402Z  2024-12-18T01:07:20.5020791Z  2024-12-18T01:07:20.5021166Z  2024-12-18T01:07:20.5021577Z  2024-12-18T01:07:20.5021957Z  2024-12-18T01:07:20.5022339Z  2024-12-18T01:07:20.5022695Z  2024-12-18T01:07:20.5023594Z [20,254 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:20.5024868Z @llvm-project//mlir:LinalgTransforms; 108s local 2024-12-18T01:07:20.5025636Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T01:07:20.5026436Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2024-12-18T01:07:20.5027213Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2024-12-18T01:07:20.5028008Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2024-12-18T01:07:20.5028866Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2024-12-18T01:07:20.5029693Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 41s local 2024-12-18T01:07:20.5030551Z Compiling torch_xla/csrc/RegisterXLA.cpp; 39s local ... 2024-12-18T01:07:21.4494295Z 2024-12-18T01:07:21.4495416Z  2024-12-18T01:07:21.4495919Z  2024-12-18T01:07:21.4496291Z  2024-12-18T01:07:21.4496765Z  2024-12-18T01:07:21.4497128Z  2024-12-18T01:07:21.4497501Z  2024-12-18T01:07:21.4497856Z  2024-12-18T01:07:21.4498234Z  2024-12-18T01:07:21.4499167Z [20,255 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:21.4500267Z @llvm-project//mlir:LinalgTransforms; 109s local 2024-12-18T01:07:21.4501057Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2024-12-18T01:07:21.4501828Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2024-12-18T01:07:21.4502554Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2024-12-18T01:07:21.4503297Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2024-12-18T01:07:21.4504110Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2024-12-18T01:07:21.4504974Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local 2024-12-18T01:07:21.4505794Z Compiling torch_xla/csrc/RegisterXLA.cpp; 40s local ... 2024-12-18T01:07:21.7029596Z 2024-12-18T01:07:21.7030506Z  2024-12-18T01:07:21.7030992Z  2024-12-18T01:07:21.7031372Z  2024-12-18T01:07:21.7031747Z  2024-12-18T01:07:21.7032146Z  2024-12-18T01:07:21.7032537Z  2024-12-18T01:07:21.7032937Z  2024-12-18T01:07:21.7033313Z  2024-12-18T01:07:21.7034249Z [20,256 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:21.7035227Z @llvm-project//mlir:LinalgTransforms; 109s local 2024-12-18T01:07:21.7036014Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2024-12-18T01:07:21.7036740Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2024-12-18T01:07:21.7037518Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2024-12-18T01:07:21.7038295Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2024-12-18T01:07:21.7039089Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2024-12-18T01:07:21.7039876Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local 2024-12-18T01:07:21.7040655Z Compiling torch_xla/csrc/RegisterXLA.cpp; 40s local ... 2024-12-18T01:07:22.2258422Z 2024-12-18T01:07:22.2259297Z  2024-12-18T01:07:22.2259774Z  2024-12-18T01:07:22.2260165Z  2024-12-18T01:07:22.2260543Z  2024-12-18T01:07:22.2260957Z  2024-12-18T01:07:22.2261339Z  2024-12-18T01:07:22.2261707Z  2024-12-18T01:07:22.2262089Z  2024-12-18T01:07:22.2262933Z [20,257 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:22.2263901Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T01:07:22.2264686Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T01:07:22.2265883Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2024-12-18T01:07:22.2266680Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2024-12-18T01:07:22.2267481Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2024-12-18T01:07:22.2268342Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2024-12-18T01:07:22.2269154Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2024-12-18T01:07:22.2270528Z Compiling torch_xla/csrc/RegisterXLA.cpp; 41s local ... 2024-12-18T01:07:22.5035525Z 2024-12-18T01:07:22.5036436Z  2024-12-18T01:07:22.5036921Z  2024-12-18T01:07:22.5037324Z  2024-12-18T01:07:22.5037707Z  2024-12-18T01:07:22.5038106Z  2024-12-18T01:07:22.5038489Z  2024-12-18T01:07:22.5038874Z  2024-12-18T01:07:22.5039248Z  2024-12-18T01:07:22.5040145Z [20,257 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:22.5041152Z @llvm-project//mlir:LinalgTransforms; 110s local 2024-12-18T01:07:22.5042193Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T01:07:22.5043001Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2024-12-18T01:07:22.5043725Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2024-12-18T01:07:22.5044771Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2024-12-18T01:07:22.5045574Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2024-12-18T01:07:22.5047153Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2024-12-18T01:07:22.5048015Z Compiling torch_xla/csrc/RegisterXLA.cpp; 41s local ... 2024-12-18T01:07:23.5043864Z 2024-12-18T01:07:23.5044919Z  2024-12-18T01:07:23.5045411Z  2024-12-18T01:07:23.5045811Z  2024-12-18T01:07:23.5046184Z  2024-12-18T01:07:23.5046550Z  2024-12-18T01:07:23.5046911Z  2024-12-18T01:07:23.5047279Z  2024-12-18T01:07:23.5047673Z  2024-12-18T01:07:23.5048595Z [20,257 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:23.5049574Z @llvm-project//mlir:LinalgTransforms; 111s local 2024-12-18T01:07:23.5050359Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2024-12-18T01:07:23.5051157Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2024-12-18T01:07:23.5051940Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2024-12-18T01:07:23.5052743Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2024-12-18T01:07:23.5053573Z Compiling torch_xla/csrc/xla_op_builder.cpp; 44s local 2024-12-18T01:07:23.5054926Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 44s local 2024-12-18T01:07:23.5055743Z Compiling torch_xla/csrc/RegisterXLA.cpp; 42s local ... 2024-12-18T01:07:24.5058783Z 2024-12-18T01:07:24.5059612Z  2024-12-18T01:07:24.5060062Z  2024-12-18T01:07:24.5060413Z  2024-12-18T01:07:24.5060778Z  2024-12-18T01:07:24.5061179Z  2024-12-18T01:07:24.5061530Z  2024-12-18T01:07:24.5061883Z  2024-12-18T01:07:24.5062220Z  2024-12-18T01:07:24.5063057Z [20,257 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:24.5063950Z @llvm-project//mlir:LinalgTransforms; 112s local 2024-12-18T01:07:24.5064713Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2024-12-18T01:07:24.5065454Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2024-12-18T01:07:24.5066157Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T01:07:24.5066893Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T01:07:24.5067628Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local 2024-12-18T01:07:24.5068396Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 45s local 2024-12-18T01:07:24.5069179Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local ... 2024-12-18T01:07:24.7970928Z 2024-12-18T01:07:24.7972077Z  2024-12-18T01:07:24.7972495Z  2024-12-18T01:07:24.7972819Z  2024-12-18T01:07:24.7973147Z  2024-12-18T01:07:24.7973467Z  2024-12-18T01:07:24.7973786Z  2024-12-18T01:07:24.7974105Z  2024-12-18T01:07:24.7974419Z  2024-12-18T01:07:24.7975182Z [20,259 / 20,604] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:07:24.7976067Z @llvm-project//mlir:LinalgTransforms; 112s local 2024-12-18T01:07:24.7976848Z Compiling torch_xla/csrc/aten_xla_type.cpp; 73s local 2024-12-18T01:07:24.7977505Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2024-12-18T01:07:24.7978131Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T01:07:24.7978776Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T01:07:24.7979432Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local 2024-12-18T01:07:24.7980098Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 45s local 2024-12-18T01:07:24.7980794Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local ... 2024-12-18T01:07:25.1055879Z 2024-12-18T01:07:25.1057130Z  2024-12-18T01:07:25.1057660Z  2024-12-18T01:07:25.1058025Z  2024-12-18T01:07:25.1058374Z  2024-12-18T01:07:25.1058709Z  2024-12-18T01:07:25.1059035Z  2024-12-18T01:07:25.1059373Z  2024-12-18T01:07:25.1059722Z  2024-12-18T01:07:25.1060600Z [20,259 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:25.1061829Z @llvm-project//mlir:LinalgTransforms; 113s local 2024-12-18T01:07:25.1062594Z Compiling torch_xla/csrc/aten_xla_type.cpp; 73s local 2024-12-18T01:07:25.1063429Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2024-12-18T01:07:25.1064266Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T01:07:25.1065141Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T01:07:25.1065989Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local 2024-12-18T01:07:25.1066902Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2024-12-18T01:07:25.1067712Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local ... 2024-12-18T01:07:25.3062224Z 2024-12-18T01:07:25.3063138Z  2024-12-18T01:07:25.3063615Z  2024-12-18T01:07:25.3064003Z  2024-12-18T01:07:25.3064403Z  2024-12-18T01:07:25.3064830Z  2024-12-18T01:07:25.3065229Z  2024-12-18T01:07:25.3065626Z  2024-12-18T01:07:25.3066016Z  2024-12-18T01:07:25.3066985Z [20,260 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:25.3067981Z @llvm-project//mlir:LinalgTransforms; 113s local 2024-12-18T01:07:25.3068772Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2024-12-18T01:07:25.3069554Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T01:07:25.3070381Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2024-12-18T01:07:25.3071254Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local 2024-12-18T01:07:25.3072088Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2024-12-18T01:07:25.3072903Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2024-12-18T01:07:25.3073892Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 39s local ... 2024-12-18T01:07:25.6271669Z 2024-12-18T01:07:25.6272921Z  2024-12-18T01:07:25.6273406Z  2024-12-18T01:07:25.6273789Z  2024-12-18T01:07:25.6274183Z  2024-12-18T01:07:25.6274603Z  2024-12-18T01:07:25.6275032Z  2024-12-18T01:07:25.6275405Z  2024-12-18T01:07:25.6275797Z  2024-12-18T01:07:25.6276697Z [20,261 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:25.6277637Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2024-12-18T01:07:25.6278415Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T01:07:25.6279426Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2024-12-18T01:07:25.6280276Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local 2024-12-18T01:07:25.6281132Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2024-12-18T01:07:25.6281953Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2024-12-18T01:07:25.6282817Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 39s local 2024-12-18T01:07:25.6283818Z Compiling torch_xla/csrc/aten_fallback.cpp; 35s local ... 2024-12-18T01:07:25.8485748Z 2024-12-18T01:07:25.8486975Z  2024-12-18T01:07:25.8487469Z  2024-12-18T01:07:25.8487904Z  2024-12-18T01:07:25.8488277Z  2024-12-18T01:07:25.8488670Z  2024-12-18T01:07:25.8489051Z  2024-12-18T01:07:25.8489447Z  2024-12-18T01:07:25.8489813Z  2024-12-18T01:07:25.8490719Z [20,262 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:25.8491745Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2024-12-18T01:07:25.8492816Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T01:07:25.8493724Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2024-12-18T01:07:25.8494638Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2024-12-18T01:07:25.8495489Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2024-12-18T01:07:25.8496313Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2024-12-18T01:07:25.8497481Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 39s local 2024-12-18T01:07:25.8498318Z Compiling torch_xla/csrc/aten_fallback.cpp; 35s local ... 2024-12-18T01:07:26.1066898Z 2024-12-18T01:07:26.1067791Z  2024-12-18T01:07:26.1068244Z  2024-12-18T01:07:26.1068673Z  2024-12-18T01:07:26.1069073Z  2024-12-18T01:07:26.1069457Z  2024-12-18T01:07:26.1069843Z  2024-12-18T01:07:26.1070215Z  2024-12-18T01:07:26.1070631Z  2024-12-18T01:07:26.1071579Z [20,262 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:26.1072486Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2024-12-18T01:07:26.1073219Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T01:07:26.1074162Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2024-12-18T01:07:26.1075206Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2024-12-18T01:07:26.1076241Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2024-12-18T01:07:26.1077071Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2024-12-18T01:07:26.1077840Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 40s local 2024-12-18T01:07:26.1078642Z Compiling torch_xla/csrc/aten_fallback.cpp; 35s local ... 2024-12-18T01:07:26.3079041Z 2024-12-18T01:07:26.3080339Z  2024-12-18T01:07:26.3080812Z  2024-12-18T01:07:26.3081196Z  2024-12-18T01:07:26.3081587Z  2024-12-18T01:07:26.3081960Z  2024-12-18T01:07:26.3082276Z  2024-12-18T01:07:26.3082582Z  2024-12-18T01:07:26.3082875Z  2024-12-18T01:07:26.3083756Z [20,263 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:26.3084810Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2024-12-18T01:07:26.3085655Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T01:07:26.3086509Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2024-12-18T01:07:26.3087376Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2024-12-18T01:07:26.3088203Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2024-12-18T01:07:26.3089094Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2024-12-18T01:07:26.3089996Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 40s local 2024-12-18T01:07:26.3090903Z Compiling torch_xla/csrc/aten_fallback.cpp; 35s local ... 2024-12-18T01:07:26.6874321Z 2024-12-18T01:07:26.6875440Z  2024-12-18T01:07:26.6876138Z  2024-12-18T01:07:26.6877102Z  2024-12-18T01:07:26.6877561Z  2024-12-18T01:07:26.6877939Z  2024-12-18T01:07:26.6878339Z  2024-12-18T01:07:26.6878741Z  2024-12-18T01:07:26.6879131Z  2024-12-18T01:07:26.6880018Z [20,264 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:26.6881243Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2024-12-18T01:07:26.6882049Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2024-12-18T01:07:26.6882750Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2024-12-18T01:07:26.6883519Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2024-12-18T01:07:26.6884364Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2024-12-18T01:07:26.6885207Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2024-12-18T01:07:26.6886066Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 40s local 2024-12-18T01:07:26.6887158Z Compiling torch_xla/csrc/aten_fallback.cpp; 36s local ... 2024-12-18T01:07:26.9083787Z 2024-12-18T01:07:26.9085092Z  2024-12-18T01:07:26.9085564Z  2024-12-18T01:07:26.9085969Z  2024-12-18T01:07:26.9086365Z  2024-12-18T01:07:26.9086740Z  2024-12-18T01:07:26.9087126Z  2024-12-18T01:07:26.9087501Z  2024-12-18T01:07:26.9087939Z  2024-12-18T01:07:26.9089133Z [20,264 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:26.9090239Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2024-12-18T01:07:26.9091026Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2024-12-18T01:07:26.9091831Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2024-12-18T01:07:26.9092727Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2024-12-18T01:07:26.9093544Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2024-12-18T01:07:26.9094439Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2024-12-18T01:07:26.9095212Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 41s local 2024-12-18T01:07:26.9095952Z Compiling torch_xla/csrc/aten_fallback.cpp; 36s local ... 2024-12-18T01:07:27.3963367Z 2024-12-18T01:07:27.3964226Z  2024-12-18T01:07:27.3964662Z  2024-12-18T01:07:27.3965009Z  2024-12-18T01:07:27.3965308Z  2024-12-18T01:07:27.3965629Z  2024-12-18T01:07:27.3965958Z  2024-12-18T01:07:27.3966273Z  2024-12-18T01:07:27.3966655Z  2024-12-18T01:07:27.3967568Z [20,265 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:27.3968613Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2024-12-18T01:07:27.3969382Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2024-12-18T01:07:27.3970205Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2024-12-18T01:07:27.3971036Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2024-12-18T01:07:27.3971855Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local 2024-12-18T01:07:27.3972628Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2024-12-18T01:07:27.3973403Z Compiling torch_xla/csrc/aten_fallback.cpp; 36s local 2024-12-18T01:07:27.3974332Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local ... 2024-12-18T01:07:27.7092849Z 2024-12-18T01:07:27.7093683Z  2024-12-18T01:07:27.7094097Z  2024-12-18T01:07:27.7094474Z  2024-12-18T01:07:27.7094821Z  2024-12-18T01:07:27.7095157Z  2024-12-18T01:07:27.7095530Z  2024-12-18T01:07:27.7095877Z  2024-12-18T01:07:27.7096212Z  2024-12-18T01:07:27.7097238Z [20,265 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:27.7098107Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2024-12-18T01:07:27.7099079Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2024-12-18T01:07:27.7099794Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2024-12-18T01:07:27.7100540Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2024-12-18T01:07:27.7101254Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local 2024-12-18T01:07:27.7101940Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2024-12-18T01:07:27.7102696Z Compiling torch_xla/csrc/aten_fallback.cpp; 37s local 2024-12-18T01:07:27.7103482Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local ... 2024-12-18T01:07:27.9572008Z 2024-12-18T01:07:27.9572807Z  2024-12-18T01:07:27.9573243Z  2024-12-18T01:07:27.9573610Z  2024-12-18T01:07:27.9573972Z  2024-12-18T01:07:27.9574298Z  2024-12-18T01:07:27.9574636Z  2024-12-18T01:07:27.9574985Z  2024-12-18T01:07:27.9575318Z  2024-12-18T01:07:27.9576093Z [20,266 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:27.9577380Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2024-12-18T01:07:27.9578079Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2024-12-18T01:07:27.9578812Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2024-12-18T01:07:27.9579630Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2024-12-18T01:07:27.9580651Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local 2024-12-18T01:07:27.9581670Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local 2024-12-18T01:07:27.9582526Z Compiling torch_xla/csrc/aten_fallback.cpp; 37s local 2024-12-18T01:07:27.9583545Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 37s local ... 2024-12-18T01:07:28.3099993Z 2024-12-18T01:07:28.3101161Z  2024-12-18T01:07:28.3101634Z  2024-12-18T01:07:28.3102034Z  2024-12-18T01:07:28.3102381Z  2024-12-18T01:07:28.3102761Z  2024-12-18T01:07:28.3103164Z  2024-12-18T01:07:28.3103553Z  2024-12-18T01:07:28.3103942Z  2024-12-18T01:07:28.3104858Z [20,266 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:28.3105866Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2024-12-18T01:07:28.3106673Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2024-12-18T01:07:28.3107475Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2024-12-18T01:07:28.3108266Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2024-12-18T01:07:28.3109096Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local 2024-12-18T01:07:28.3109892Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local 2024-12-18T01:07:28.3110657Z Compiling torch_xla/csrc/aten_fallback.cpp; 37s local 2024-12-18T01:07:28.3111541Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 37s local ... 2024-12-18T01:07:29.2417278Z 2024-12-18T01:07:29.2418155Z  2024-12-18T01:07:29.2418667Z  2024-12-18T01:07:29.2419079Z  2024-12-18T01:07:29.2419483Z  2024-12-18T01:07:29.2419875Z  2024-12-18T01:07:29.2420411Z  2024-12-18T01:07:29.2420804Z  2024-12-18T01:07:29.2421201Z  2024-12-18T01:07:29.2422132Z [20,267 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:29.2423125Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2024-12-18T01:07:29.2423910Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2024-12-18T01:07:29.2424735Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2024-12-18T01:07:29.2425570Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2024-12-18T01:07:29.2426400Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2024-12-18T01:07:29.2427200Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2024-12-18T01:07:29.2436912Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local 2024-12-18T01:07:29.2438286Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 38s local ... 2024-12-18T01:07:29.4724249Z 2024-12-18T01:07:29.4725119Z  2024-12-18T01:07:29.4725539Z  2024-12-18T01:07:29.4725943Z  2024-12-18T01:07:29.4726341Z  2024-12-18T01:07:29.4726718Z  2024-12-18T01:07:29.4727105Z  2024-12-18T01:07:29.4727504Z  2024-12-18T01:07:29.4727883Z  2024-12-18T01:07:29.4729114Z [20,270 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:29.4730130Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2024-12-18T01:07:29.4730889Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2024-12-18T01:07:29.4731660Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T01:07:29.4732496Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2024-12-18T01:07:29.4733283Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2024-12-18T01:07:29.4734108Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2024-12-18T01:07:29.4735099Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local 2024-12-18T01:07:29.4736030Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 38s local ... 2024-12-18T01:07:29.6941772Z 2024-12-18T01:07:29.6942680Z  2024-12-18T01:07:29.6943165Z  2024-12-18T01:07:29.6943549Z  2024-12-18T01:07:29.6943999Z  2024-12-18T01:07:29.6944641Z  2024-12-18T01:07:29.6945060Z  2024-12-18T01:07:29.6945460Z  2024-12-18T01:07:29.6945851Z  2024-12-18T01:07:29.6946955Z [20,271 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:29.6947923Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2024-12-18T01:07:29.6948865Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2024-12-18T01:07:29.6949785Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T01:07:29.6950635Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2024-12-18T01:07:29.6951436Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2024-12-18T01:07:29.6952263Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2024-12-18T01:07:29.6953032Z Compiling torch_xla/csrc/aten_fallback.cpp; 39s local 2024-12-18T01:07:29.6953801Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local ... 2024-12-18T01:07:29.9115265Z 2024-12-18T01:07:29.9116149Z  2024-12-18T01:07:29.9116636Z  2024-12-18T01:07:29.9117026Z  2024-12-18T01:07:29.9117408Z  2024-12-18T01:07:29.9117835Z  2024-12-18T01:07:29.9118232Z  2024-12-18T01:07:29.9118639Z  2024-12-18T01:07:29.9119007Z  2024-12-18T01:07:29.9119962Z [20,271 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:29.9120997Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2024-12-18T01:07:29.9121797Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2024-12-18T01:07:29.9122645Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T01:07:29.9123509Z Compiling torch_xla/csrc/xla_op_builder.cpp; 51s local 2024-12-18T01:07:29.9124302Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2024-12-18T01:07:29.9125115Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2024-12-18T01:07:29.9125724Z Compiling torch_xla/csrc/aten_fallback.cpp; 39s local 2024-12-18T01:07:29.9126484Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local ... 2024-12-18T01:07:30.1118372Z 2024-12-18T01:07:30.1119305Z  2024-12-18T01:07:30.1119775Z  2024-12-18T01:07:30.1120160Z  2024-12-18T01:07:30.1120537Z  2024-12-18T01:07:30.1120911Z  2024-12-18T01:07:30.1121296Z  2024-12-18T01:07:30.1121646Z  2024-12-18T01:07:30.1122026Z  2024-12-18T01:07:30.1122938Z [20,272 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:30.1124233Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2024-12-18T01:07:30.1125031Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2024-12-18T01:07:30.1125812Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T01:07:30.1126609Z Compiling torch_xla/csrc/xla_op_builder.cpp; 51s local 2024-12-18T01:07:30.1127473Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2024-12-18T01:07:30.1128435Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2024-12-18T01:07:30.1129213Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2024-12-18T01:07:30.1129973Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local ... 2024-12-18T01:07:30.3277746Z 2024-12-18T01:07:30.3278642Z  2024-12-18T01:07:30.3279125Z  2024-12-18T01:07:30.3279536Z  2024-12-18T01:07:30.3279926Z  2024-12-18T01:07:30.3280324Z  2024-12-18T01:07:30.3280687Z  2024-12-18T01:07:30.3281067Z  2024-12-18T01:07:30.3281456Z  2024-12-18T01:07:30.3282300Z [20,273 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:30.3283452Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2024-12-18T01:07:30.3284293Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2024-12-18T01:07:30.3285111Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2024-12-18T01:07:30.3285926Z Compiling torch_xla/csrc/xla_op_builder.cpp; 51s local 2024-12-18T01:07:30.3286946Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2024-12-18T01:07:30.3290025Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2024-12-18T01:07:30.3291018Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2024-12-18T01:07:30.3291738Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local ... 2024-12-18T01:07:30.7125793Z 2024-12-18T01:07:30.7126637Z  2024-12-18T01:07:30.7127097Z  2024-12-18T01:07:30.7127488Z  2024-12-18T01:07:30.7127878Z  2024-12-18T01:07:30.7128313Z  2024-12-18T01:07:30.7128700Z  2024-12-18T01:07:30.7129078Z  2024-12-18T01:07:30.7129447Z  2024-12-18T01:07:30.7130394Z [20,273 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:30.7131415Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2024-12-18T01:07:30.7132203Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2024-12-18T01:07:30.7133030Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2024-12-18T01:07:30.7133865Z Compiling torch_xla/csrc/xla_op_builder.cpp; 51s local 2024-12-18T01:07:30.7134680Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2024-12-18T01:07:30.7135490Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2024-12-18T01:07:30.7136254Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2024-12-18T01:07:30.7137188Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local ... 2024-12-18T01:07:30.9128145Z 2024-12-18T01:07:30.9129051Z  2024-12-18T01:07:30.9129518Z  2024-12-18T01:07:30.9129915Z  2024-12-18T01:07:30.9130318Z  2024-12-18T01:07:30.9130724Z  2024-12-18T01:07:30.9131110Z  2024-12-18T01:07:30.9131490Z  2024-12-18T01:07:30.9131844Z  2024-12-18T01:07:30.9132776Z [20,274 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:30.9133776Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2024-12-18T01:07:30.9134598Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2024-12-18T01:07:30.9135427Z Compiling torch_xla/csrc/xla_op_builder.cpp; 52s local 2024-12-18T01:07:30.9136218Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2024-12-18T01:07:30.9137257Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2024-12-18T01:07:30.9137991Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2024-12-18T01:07:30.9138725Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2024-12-18T01:07:30.9139875Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local ... 2024-12-18T01:07:31.3135717Z 2024-12-18T01:07:31.3136726Z  2024-12-18T01:07:31.3137173Z  2024-12-18T01:07:31.3137561Z  2024-12-18T01:07:31.3137922Z  2024-12-18T01:07:31.3138302Z  2024-12-18T01:07:31.3138704Z  2024-12-18T01:07:31.3139094Z  2024-12-18T01:07:31.3139535Z  2024-12-18T01:07:31.3140832Z [20,274 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:31.3141824Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2024-12-18T01:07:31.3142643Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2024-12-18T01:07:31.3143494Z Compiling torch_xla/csrc/xla_op_builder.cpp; 52s local 2024-12-18T01:07:31.3144562Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2024-12-18T01:07:31.3145365Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2024-12-18T01:07:31.3146144Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2024-12-18T01:07:31.3147114Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2024-12-18T01:07:31.3147952Z Compiling torch_xla/csrc/ops/custom_call.cpp; 32s local ... 2024-12-18T01:07:31.7105534Z 2024-12-18T01:07:31.7106449Z  2024-12-18T01:07:31.7106880Z  2024-12-18T01:07:31.7107303Z  2024-12-18T01:07:31.7107705Z  2024-12-18T01:07:31.7108152Z  2024-12-18T01:07:31.7108537Z  2024-12-18T01:07:31.7108908Z  2024-12-18T01:07:31.7109265Z  2024-12-18T01:07:31.7110232Z [20,275 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:31.7110987Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2024-12-18T01:07:31.7111615Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2024-12-18T01:07:31.7112433Z Compiling torch_xla/csrc/xla_op_builder.cpp; 52s local 2024-12-18T01:07:31.7113265Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2024-12-18T01:07:31.7114125Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2024-12-18T01:07:31.7114860Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2024-12-18T01:07:31.7115581Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2024-12-18T01:07:31.7116322Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local ... 2024-12-18T01:07:31.9141685Z 2024-12-18T01:07:31.9143094Z  2024-12-18T01:07:31.9143471Z  2024-12-18T01:07:31.9145580Z  2024-12-18T01:07:31.9146518Z  2024-12-18T01:07:31.9147477Z  2024-12-18T01:07:31.9147875Z  2024-12-18T01:07:31.9148267Z  2024-12-18T01:07:31.9148640Z  2024-12-18T01:07:31.9149616Z [20,275 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:31.9150658Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2024-12-18T01:07:31.9151514Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2024-12-18T01:07:31.9152399Z Compiling torch_xla/csrc/xla_op_builder.cpp; 53s local 2024-12-18T01:07:31.9153248Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2024-12-18T01:07:31.9154085Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2024-12-18T01:07:31.9154880Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2024-12-18T01:07:31.9155673Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2024-12-18T01:07:31.9156497Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local ... 2024-12-18T01:07:32.1167144Z 2024-12-18T01:07:32.1168964Z  2024-12-18T01:07:32.1169392Z  2024-12-18T01:07:32.1169727Z  2024-12-18T01:07:32.1170033Z  2024-12-18T01:07:32.1170332Z  2024-12-18T01:07:32.1170685Z  2024-12-18T01:07:32.1171045Z  2024-12-18T01:07:32.1171413Z  2024-12-18T01:07:32.1172319Z [20,276 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:32.1173340Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2024-12-18T01:07:32.1173974Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2024-12-18T01:07:32.1174642Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2024-12-18T01:07:32.1175270Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2024-12-18T01:07:32.1175953Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2024-12-18T01:07:32.1177037Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2024-12-18T01:07:32.1177760Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2024-12-18T01:07:32.1178523Z Compiling torch_xla/csrc/ops/cumprod.cpp; 30s local ... 2024-12-18T01:07:32.5146883Z 2024-12-18T01:07:32.5147777Z  2024-12-18T01:07:32.5148209Z  2024-12-18T01:07:32.5148547Z  2024-12-18T01:07:32.5148893Z  2024-12-18T01:07:32.5149238Z  2024-12-18T01:07:32.5149571Z  2024-12-18T01:07:32.5149911Z  2024-12-18T01:07:32.5150261Z  2024-12-18T01:07:32.5151118Z [20,276 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:32.5152329Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2024-12-18T01:07:32.5153077Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2024-12-18T01:07:32.5153840Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2024-12-18T01:07:32.5154559Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2024-12-18T01:07:32.5155229Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2024-12-18T01:07:32.5156148Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2024-12-18T01:07:32.5156820Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2024-12-18T01:07:32.5157505Z Compiling torch_xla/csrc/ops/cumprod.cpp; 31s local ... 2024-12-18T01:07:33.0108788Z 2024-12-18T01:07:33.0109631Z  2024-12-18T01:07:33.0110069Z  2024-12-18T01:07:33.0110431Z  2024-12-18T01:07:33.0110771Z  2024-12-18T01:07:33.0111098Z  2024-12-18T01:07:33.0111476Z  2024-12-18T01:07:33.0111813Z  2024-12-18T01:07:33.0112130Z  2024-12-18T01:07:33.0112938Z [20,277 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:33.0113777Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2024-12-18T01:07:33.0114486Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2024-12-18T01:07:33.0115187Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2024-12-18T01:07:33.0115801Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2024-12-18T01:07:33.0116446Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2024-12-18T01:07:33.0117082Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2024-12-18T01:07:33.0117716Z Compiling torch_xla/csrc/ops/cumprod.cpp; 31s local 2024-12-18T01:07:33.0118427Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 31s local ... 2024-12-18T01:07:33.3156719Z 2024-12-18T01:07:33.3158136Z  2024-12-18T01:07:33.3158679Z  2024-12-18T01:07:33.3159078Z  2024-12-18T01:07:33.3159460Z  2024-12-18T01:07:33.3159831Z  2024-12-18T01:07:33.3160207Z  2024-12-18T01:07:33.3160585Z  2024-12-18T01:07:33.3161028Z  2024-12-18T01:07:33.3161968Z [20,277 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:33.3162966Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2024-12-18T01:07:33.3163795Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2024-12-18T01:07:33.3164617Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2024-12-18T01:07:33.3165387Z Compiling torch_xla/csrc/ops/cast.cpp; 37s local 2024-12-18T01:07:33.3166083Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2024-12-18T01:07:33.3166790Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T01:07:33.3167461Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2024-12-18T01:07:33.3168319Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 31s local ... 2024-12-18T01:07:33.8703618Z 2024-12-18T01:07:33.8704925Z  2024-12-18T01:07:33.8705528Z  2024-12-18T01:07:33.8705935Z  2024-12-18T01:07:33.8706347Z  2024-12-18T01:07:33.8706732Z  2024-12-18T01:07:33.8707172Z  2024-12-18T01:07:33.8707564Z  2024-12-18T01:07:33.8707970Z  2024-12-18T01:07:33.8708875Z [20,278 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:33.8710164Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2024-12-18T01:07:33.8710969Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2024-12-18T01:07:33.8711755Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2024-12-18T01:07:33.8712454Z Compiling torch_xla/csrc/ops/cast.cpp; 37s local 2024-12-18T01:07:33.8713206Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2024-12-18T01:07:33.8713957Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T01:07:33.8714757Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2024-12-18T01:07:33.8715830Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 30s local ... 2024-12-18T01:07:34.0748755Z 2024-12-18T01:07:34.0749596Z  2024-12-18T01:07:34.0750079Z  2024-12-18T01:07:34.0750505Z  2024-12-18T01:07:34.0750927Z  2024-12-18T01:07:34.0751333Z  2024-12-18T01:07:34.0751753Z  2024-12-18T01:07:34.0752156Z  2024-12-18T01:07:34.0752565Z  2024-12-18T01:07:34.0753760Z [20,279 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:34.0754807Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2024-12-18T01:07:34.0755653Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2024-12-18T01:07:34.0756492Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2024-12-18T01:07:34.0757292Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2024-12-18T01:07:34.0758098Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T01:07:34.0758888Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2024-12-18T01:07:34.0759723Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 30s local 2024-12-18T01:07:34.0760632Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local ... 2024-12-18T01:07:34.3166588Z 2024-12-18T01:07:34.3167907Z  2024-12-18T01:07:34.3168385Z  2024-12-18T01:07:34.3168791Z  2024-12-18T01:07:34.3169156Z  2024-12-18T01:07:34.3169536Z  2024-12-18T01:07:34.3169924Z  2024-12-18T01:07:34.3170332Z  2024-12-18T01:07:34.3170708Z  2024-12-18T01:07:34.3171611Z [20,279 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:34.3172632Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2024-12-18T01:07:34.3173480Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2024-12-18T01:07:34.3174311Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2024-12-18T01:07:34.3175103Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2024-12-18T01:07:34.3175766Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2024-12-18T01:07:34.3176341Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2024-12-18T01:07:34.3177316Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 30s local 2024-12-18T01:07:34.3178201Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local ... 2024-12-18T01:07:35.1172795Z 2024-12-18T01:07:35.1174130Z  2024-12-18T01:07:35.1174602Z  2024-12-18T01:07:35.1175043Z  2024-12-18T01:07:35.1175437Z  2024-12-18T01:07:35.1175834Z  2024-12-18T01:07:35.1176224Z  2024-12-18T01:07:35.1176714Z  2024-12-18T01:07:35.1177125Z  2024-12-18T01:07:35.1178064Z [20,280 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:35.1179049Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2024-12-18T01:07:35.1180189Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2024-12-18T01:07:35.1181037Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2024-12-18T01:07:35.1181824Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2024-12-18T01:07:35.1182600Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2024-12-18T01:07:35.1183443Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 31s local 2024-12-18T01:07:35.1184430Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local 2024-12-18T01:07:35.1185263Z Compiling torch_xla/csrc/ops/diagonal.cpp; 29s local ... 2024-12-18T01:07:35.5178264Z 2024-12-18T01:07:35.5179574Z  2024-12-18T01:07:35.5179971Z  2024-12-18T01:07:35.5180301Z  2024-12-18T01:07:35.5180628Z  2024-12-18T01:07:35.5181044Z  2024-12-18T01:07:35.5181454Z  2024-12-18T01:07:35.5181807Z  2024-12-18T01:07:35.5182222Z  2024-12-18T01:07:35.5183158Z [20,280 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:35.5184464Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2024-12-18T01:07:35.5185212Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2024-12-18T01:07:35.5186038Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2024-12-18T01:07:35.5186983Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T01:07:35.5187753Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2024-12-18T01:07:35.5188533Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 32s local 2024-12-18T01:07:35.5189687Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local 2024-12-18T01:07:35.5190513Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local ... 2024-12-18T01:07:36.5075403Z 2024-12-18T01:07:36.5076810Z  2024-12-18T01:07:36.5077289Z  2024-12-18T01:07:36.5077668Z  2024-12-18T01:07:36.5078031Z  2024-12-18T01:07:36.5078413Z  2024-12-18T01:07:36.5078802Z  2024-12-18T01:07:36.5079206Z  2024-12-18T01:07:36.5079600Z  2024-12-18T01:07:36.5080522Z [20,281 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:36.5081511Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2024-12-18T01:07:36.5082338Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2024-12-18T01:07:36.5083163Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2024-12-18T01:07:36.5083925Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2024-12-18T01:07:36.5084681Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2024-12-18T01:07:36.5085476Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2024-12-18T01:07:36.5086258Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2024-12-18T01:07:36.5087144Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local ... 2024-12-18T01:07:36.7189707Z 2024-12-18T01:07:36.7191235Z  2024-12-18T01:07:36.7191771Z  2024-12-18T01:07:36.7192199Z  2024-12-18T01:07:36.7192611Z  2024-12-18T01:07:36.7192977Z  2024-12-18T01:07:36.7193385Z  2024-12-18T01:07:36.7193800Z  2024-12-18T01:07:36.7194189Z  2024-12-18T01:07:36.7195061Z [20,281 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:36.7195966Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2024-12-18T01:07:36.7196782Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2024-12-18T01:07:36.7197615Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2024-12-18T01:07:36.7198370Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2024-12-18T01:07:36.7199105Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2024-12-18T01:07:36.7199833Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2024-12-18T01:07:36.7200629Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2024-12-18T01:07:36.7201516Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local ... 2024-12-18T01:07:37.2500845Z 2024-12-18T01:07:37.2502142Z  2024-12-18T01:07:37.2502586Z  2024-12-18T01:07:37.2502979Z  2024-12-18T01:07:37.2503303Z  2024-12-18T01:07:37.2503654Z  2024-12-18T01:07:37.2504003Z  2024-12-18T01:07:37.2504356Z  2024-12-18T01:07:37.2504698Z  2024-12-18T01:07:37.2505499Z [20,283 / 20,604] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2024-12-18T01:07:37.2506648Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2024-12-18T01:07:37.2507357Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2024-12-18T01:07:37.2508101Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2024-12-18T01:07:37.2508829Z Compiling torch_xla/csrc/ops/cumsum.cpp; 38s local 2024-12-18T01:07:37.2509508Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T01:07:37.2510215Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2024-12-18T01:07:37.2511028Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2024-12-18T01:07:37.2512140Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local ... 2024-12-18T01:07:37.5199631Z 2024-12-18T01:07:37.5201189Z  2024-12-18T01:07:37.5201653Z  2024-12-18T01:07:37.5202022Z  2024-12-18T01:07:37.5202366Z  2024-12-18T01:07:37.5202732Z  2024-12-18T01:07:37.5203098Z  2024-12-18T01:07:37.5203468Z  2024-12-18T01:07:37.5203825Z  2024-12-18T01:07:37.5204996Z [20,283 / 20,604] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:37.5206022Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2024-12-18T01:07:37.5206809Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2024-12-18T01:07:37.5207598Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2024-12-18T01:07:37.5208480Z Compiling torch_xla/csrc/ops/cumsum.cpp; 38s local 2024-12-18T01:07:37.5209195Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T01:07:37.5209987Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2024-12-18T01:07:37.5210858Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2024-12-18T01:07:37.9328326Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local ... 2024-12-18T01:07:37.9328977Z 2024-12-18T01:07:37.9329416Z  2024-12-18T01:07:37.9329884Z  2024-12-18T01:07:37.9330310Z  2024-12-18T01:07:37.9330745Z  2024-12-18T01:07:37.9331183Z  2024-12-18T01:07:37.9331582Z  2024-12-18T01:07:37.9332016Z  2024-12-18T01:07:37.9332450Z  2024-12-18T01:07:37.9333332Z [20,284 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:37.9334325Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2024-12-18T01:07:37.9335144Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2024-12-18T01:07:37.9335979Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2024-12-18T01:07:37.9336903Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T01:07:37.9337701Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2024-12-18T01:07:37.9338612Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2024-12-18T01:07:37.9339518Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local 2024-12-18T01:07:37.9340422Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local ... 2024-12-18T01:07:38.2465821Z 2024-12-18T01:07:38.2467262Z  2024-12-18T01:07:38.2467712Z  2024-12-18T01:07:38.2469198Z  2024-12-18T01:07:38.2470120Z  2024-12-18T01:07:38.2471285Z  2024-12-18T01:07:38.2472416Z  2024-12-18T01:07:38.2473274Z  2024-12-18T01:07:38.2474171Z  2024-12-18T01:07:38.2475833Z [20,285 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:38.2476845Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2024-12-18T01:07:38.2478121Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2024-12-18T01:07:38.2479003Z Compiling torch_xla/csrc/ops/cumprod.cpp; 37s local 2024-12-18T01:07:38.2479770Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2024-12-18T01:07:38.2480662Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 31s local 2024-12-18T01:07:38.2481787Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2024-12-18T01:07:38.2482655Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local 2024-12-18T01:07:38.2483605Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 25s local ... 2024-12-18T01:07:38.4668222Z 2024-12-18T01:07:38.4669635Z  2024-12-18T01:07:38.4670048Z  2024-12-18T01:07:38.4671551Z  2024-12-18T01:07:38.4672471Z  2024-12-18T01:07:38.4672985Z  2024-12-18T01:07:38.4673348Z  2024-12-18T01:07:38.4673732Z  2024-12-18T01:07:38.4674063Z  2024-12-18T01:07:38.4674887Z [20,286 / 20,604] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:38.4676088Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2024-12-18T01:07:38.4676794Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2024-12-18T01:07:38.4677507Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2024-12-18T01:07:38.4678338Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 31s local 2024-12-18T01:07:38.4679164Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2024-12-18T01:07:38.4680067Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local 2024-12-18T01:07:38.4680891Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local 2024-12-18T01:07:38.4681900Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 23s local ... 2024-12-18T01:07:38.8672827Z 2024-12-18T01:07:38.8674090Z  2024-12-18T01:07:38.8674500Z  2024-12-18T01:07:38.8674824Z  2024-12-18T01:07:38.8675188Z  2024-12-18T01:07:38.8675516Z  2024-12-18T01:07:38.8675819Z  2024-12-18T01:07:38.8676136Z  2024-12-18T01:07:38.8676476Z  2024-12-18T01:07:38.8677256Z [20,287 / 20,604] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2024-12-18T01:07:38.8678080Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2024-12-18T01:07:38.8678741Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2024-12-18T01:07:38.8679438Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2024-12-18T01:07:38.8680187Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 31s local 2024-12-18T01:07:38.8680887Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2024-12-18T01:07:38.8681566Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2024-12-18T01:07:38.8682285Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local 2024-12-18T01:07:38.8683016Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 23s local ... 2024-12-18T01:07:39.0847025Z 2024-12-18T01:07:39.0848308Z  2024-12-18T01:07:39.0848715Z  2024-12-18T01:07:39.0849024Z  2024-12-18T01:07:39.0849360Z  2024-12-18T01:07:39.0849647Z  2024-12-18T01:07:39.0849943Z  2024-12-18T01:07:39.0850240Z  2024-12-18T01:07:39.0850536Z  2024-12-18T01:07:39.0851224Z [20,289 / 20,605] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2024-12-18T01:07:39.0851957Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2024-12-18T01:07:39.0852557Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2024-12-18T01:07:39.0853164Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2024-12-18T01:07:39.0853790Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2024-12-18T01:07:39.0854441Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local 2024-12-18T01:07:39.0855065Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 23s local 2024-12-18T01:07:39.0855967Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 23s local 2024-12-18T01:07:39.0856710Z Compiling torch_xla/csrc/ops/einsum.cpp; 23s local ... 2024-12-18T01:07:39.4678103Z 2024-12-18T01:07:39.4679498Z  2024-12-18T01:07:39.4680029Z  2024-12-18T01:07:39.4680442Z  2024-12-18T01:07:39.4680841Z  2024-12-18T01:07:39.4681237Z  2024-12-18T01:07:39.4681624Z  2024-12-18T01:07:39.4682321Z  2024-12-18T01:07:39.4682711Z  2024-12-18T01:07:39.4683667Z [20,289 / 20,605] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2024-12-18T01:07:39.4684610Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2024-12-18T01:07:39.4685417Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2024-12-18T01:07:39.4686276Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2024-12-18T01:07:39.4687149Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2024-12-18T01:07:39.4688036Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 27s local 2024-12-18T01:07:39.4688933Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 24s local 2024-12-18T01:07:39.4689945Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 23s local 2024-12-18T01:07:39.4690791Z Compiling torch_xla/csrc/ops/einsum.cpp; 23s local ... 2024-12-18T01:07:39.8460811Z 2024-12-18T01:07:39.8462148Z  2024-12-18T01:07:39.8462666Z  2024-12-18T01:07:39.8463072Z  2024-12-18T01:07:39.8463441Z  2024-12-18T01:07:39.8463788Z  2024-12-18T01:07:39.8464172Z  2024-12-18T01:07:39.8464825Z  2024-12-18T01:07:39.8465133Z  2024-12-18T01:07:39.8465861Z [20,289 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:39.8466768Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2024-12-18T01:07:39.8467568Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2024-12-18T01:07:39.8468459Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2024-12-18T01:07:39.8469406Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2024-12-18T01:07:39.8470296Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 27s local 2024-12-18T01:07:39.8471213Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 24s local 2024-12-18T01:07:39.8472078Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 24s local 2024-12-18T01:07:39.8472939Z Compiling torch_xla/csrc/ops/einsum.cpp; 23s local ... 2024-12-18T01:07:40.0500477Z 2024-12-18T01:07:40.0501809Z  2024-12-18T01:07:40.0502221Z  2024-12-18T01:07:40.0502591Z  2024-12-18T01:07:40.0502916Z  2024-12-18T01:07:40.0503246Z  2024-12-18T01:07:40.0503573Z  2024-12-18T01:07:40.0503880Z  2024-12-18T01:07:40.0504205Z  2024-12-18T01:07:40.0504957Z [20,291 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:40.0505741Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2024-12-18T01:07:40.0506394Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2024-12-18T01:07:40.0507075Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2024-12-18T01:07:40.0507784Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 27s local 2024-12-18T01:07:40.0508487Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 24s local 2024-12-18T01:07:40.0509141Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 24s local 2024-12-18T01:07:40.0509769Z Compiling torch_xla/csrc/ops/einsum.cpp; 24s local 2024-12-18T01:07:40.0510473Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 23s local ... 2024-12-18T01:07:40.2684177Z 2024-12-18T01:07:40.2685428Z  2024-12-18T01:07:40.2685839Z  2024-12-18T01:07:40.2686191Z  2024-12-18T01:07:40.2686520Z  2024-12-18T01:07:40.2686844Z  2024-12-18T01:07:40.2687154Z  2024-12-18T01:07:40.2687489Z  2024-12-18T01:07:40.2687810Z  2024-12-18T01:07:40.2688560Z [20,291 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:40.2689729Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2024-12-18T01:07:40.2690437Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2024-12-18T01:07:40.2691167Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2024-12-18T01:07:40.2691973Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2024-12-18T01:07:40.2692868Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 25s local 2024-12-18T01:07:40.2693699Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 24s local 2024-12-18T01:07:40.2694555Z Compiling torch_xla/csrc/ops/einsum.cpp; 24s local 2024-12-18T01:07:40.2695314Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 23s local ... 2024-12-18T01:07:41.0304343Z 2024-12-18T01:07:41.0305567Z  2024-12-18T01:07:41.0306008Z  2024-12-18T01:07:41.0306381Z  2024-12-18T01:07:41.0306731Z  2024-12-18T01:07:41.0307103Z  2024-12-18T01:07:41.0307527Z  2024-12-18T01:07:41.0307904Z  2024-12-18T01:07:41.0308251Z  2024-12-18T01:07:41.0309450Z [20,292 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:41.0310458Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2024-12-18T01:07:41.0311302Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2024-12-18T01:07:41.0312212Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2024-12-18T01:07:41.0313245Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 25s local 2024-12-18T01:07:41.0314033Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 25s local 2024-12-18T01:07:41.0314764Z Compiling torch_xla/csrc/ops/einsum.cpp; 25s local 2024-12-18T01:07:41.0315532Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 24s local 2024-12-18T01:07:41.0316381Z Compiling torch_xla/csrc/ops/eigh.cpp; 24s local ... 2024-12-18T01:07:41.2690905Z 2024-12-18T01:07:41.2692289Z  2024-12-18T01:07:41.2692827Z  2024-12-18T01:07:41.2693221Z  2024-12-18T01:07:41.2693590Z  2024-12-18T01:07:41.2693990Z  2024-12-18T01:07:41.2694340Z  2024-12-18T01:07:41.2694712Z  2024-12-18T01:07:41.2695072Z  2024-12-18T01:07:41.2695984Z [20,292 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:41.2697126Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2024-12-18T01:07:41.2697879Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2024-12-18T01:07:41.2698725Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2024-12-18T01:07:41.2699595Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 26s local 2024-12-18T01:07:41.2700440Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 25s local 2024-12-18T01:07:41.2701197Z Compiling torch_xla/csrc/ops/einsum.cpp; 25s local 2024-12-18T01:07:41.2701954Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 24s local 2024-12-18T01:07:41.2702824Z Compiling torch_xla/csrc/ops/eigh.cpp; 24s local ... 2024-12-18T01:07:42.4699052Z 2024-12-18T01:07:42.4700549Z  2024-12-18T01:07:42.4701043Z  2024-12-18T01:07:42.4701416Z  2024-12-18T01:07:42.4701826Z  2024-12-18T01:07:42.4702212Z  2024-12-18T01:07:42.4702589Z  2024-12-18T01:07:42.4702993Z  2024-12-18T01:07:42.4703330Z  2024-12-18T01:07:42.4704226Z [20,292 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:42.4705222Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2024-12-18T01:07:42.4706043Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2024-12-18T01:07:42.4706943Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2024-12-18T01:07:42.4707848Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 27s local 2024-12-18T01:07:42.4708689Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 26s local 2024-12-18T01:07:42.4709705Z Compiling torch_xla/csrc/ops/einsum.cpp; 26s local 2024-12-18T01:07:42.4710661Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 26s local 2024-12-18T01:07:42.4711492Z Compiling torch_xla/csrc/ops/eigh.cpp; 26s local ... 2024-12-18T01:07:43.0704412Z 2024-12-18T01:07:43.0705750Z  2024-12-18T01:07:43.0706250Z  2024-12-18T01:07:43.0706637Z  2024-12-18T01:07:43.0706988Z  2024-12-18T01:07:43.0707658Z  2024-12-18T01:07:43.0708038Z  2024-12-18T01:07:43.0708380Z  2024-12-18T01:07:43.0708735Z  2024-12-18T01:07:43.0709651Z [20,293 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:07:43.0710619Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2024-12-18T01:07:43.0711443Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2024-12-18T01:07:43.0712315Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 27s local 2024-12-18T01:07:43.0713100Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 27s local 2024-12-18T01:07:43.0713820Z Compiling torch_xla/csrc/ops/einsum.cpp; 27s local 2024-12-18T01:07:43.0714784Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 26s local 2024-12-18T01:07:43.0715362Z Compiling torch_xla/csrc/ops/eigh.cpp; 26s local 2024-12-18T01:07:43.0715947Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 26s local ... 2024-12-18T01:07:43.4707760Z 2024-12-18T01:07:43.4709116Z  2024-12-18T01:07:43.4709599Z  2024-12-18T01:07:43.4709941Z  2024-12-18T01:07:43.4710309Z  2024-12-18T01:07:43.4711020Z  2024-12-18T01:07:43.4711441Z  2024-12-18T01:07:43.4711868Z  2024-12-18T01:07:43.4712274Z  2024-12-18T01:07:43.4713315Z [20,293 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:43.4714421Z Compiling torch_xla/csrc/tensor_util.cpp; 72s local 2024-12-18T01:07:43.4715511Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2024-12-18T01:07:43.4716295Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2024-12-18T01:07:43.4716967Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 27s local 2024-12-18T01:07:43.4717706Z Compiling torch_xla/csrc/ops/einsum.cpp; 27s local 2024-12-18T01:07:43.4718438Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 27s local 2024-12-18T01:07:43.4719156Z Compiling torch_xla/csrc/ops/eigh.cpp; 27s local 2024-12-18T01:07:43.4719905Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 26s local ... 2024-12-18T01:07:44.4715023Z 2024-12-18T01:07:44.4716414Z  2024-12-18T01:07:44.4716900Z  2024-12-18T01:07:44.4717289Z  2024-12-18T01:07:44.4717655Z  2024-12-18T01:07:44.4718003Z  2024-12-18T01:07:44.4718360Z  2024-12-18T01:07:44.4718671Z  2024-12-18T01:07:44.4718973Z  2024-12-18T01:07:44.4719788Z [20,293 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:44.4720768Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2024-12-18T01:07:44.4721622Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2024-12-18T01:07:44.4722444Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local 2024-12-18T01:07:44.4723262Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 28s local 2024-12-18T01:07:44.4724023Z Compiling torch_xla/csrc/ops/einsum.cpp; 28s local 2024-12-18T01:07:44.4724848Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 28s local 2024-12-18T01:07:44.4725665Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local 2024-12-18T01:07:44.4726458Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 27s local ... 2024-12-18T01:07:45.4722306Z 2024-12-18T01:07:45.4723621Z  2024-12-18T01:07:45.4724042Z  2024-12-18T01:07:45.4724571Z  2024-12-18T01:07:45.4724950Z  2024-12-18T01:07:45.4725332Z  2024-12-18T01:07:45.4725696Z  2024-12-18T01:07:45.4726063Z  2024-12-18T01:07:45.4726707Z  2024-12-18T01:07:45.4727548Z [20,293 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:45.4728420Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2024-12-18T01:07:45.4729165Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2024-12-18T01:07:45.4729998Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2024-12-18T01:07:45.4730895Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2024-12-18T01:07:45.4731545Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local 2024-12-18T01:07:45.4732249Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2024-12-18T01:07:45.4732961Z Compiling torch_xla/csrc/ops/eigh.cpp; 29s local 2024-12-18T01:07:45.4733674Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 28s local ... 2024-12-18T01:07:46.4729941Z 2024-12-18T01:07:46.4730793Z  2024-12-18T01:07:46.4731318Z  2024-12-18T01:07:46.4731700Z  2024-12-18T01:07:46.4732106Z  2024-12-18T01:07:46.4732484Z  2024-12-18T01:07:46.4732895Z  2024-12-18T01:07:46.4733249Z  2024-12-18T01:07:46.4734093Z  2024-12-18T01:07:46.4735076Z [20,293 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:46.4735997Z Compiling torch_xla/csrc/tensor_util.cpp; 75s local 2024-12-18T01:07:46.4737028Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2024-12-18T01:07:46.4737912Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 31s local 2024-12-18T01:07:46.4738957Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2024-12-18T01:07:46.4739738Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2024-12-18T01:07:46.4740574Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2024-12-18T01:07:46.4741389Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2024-12-18T01:07:46.4742218Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local ... 2024-12-18T01:07:47.4738111Z 2024-12-18T01:07:47.4738979Z  2024-12-18T01:07:47.4739536Z  2024-12-18T01:07:47.4740090Z  2024-12-18T01:07:47.4740490Z  2024-12-18T01:07:47.4740885Z  2024-12-18T01:07:47.4741229Z  2024-12-18T01:07:47.4741592Z  2024-12-18T01:07:47.4741985Z  2024-12-18T01:07:47.4742894Z [20,293 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:47.4743885Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T01:07:47.4744941Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T01:07:47.4745762Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 32s local 2024-12-18T01:07:47.4746472Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2024-12-18T01:07:47.4747220Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2024-12-18T01:07:47.4748041Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2024-12-18T01:07:47.4748838Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T01:07:47.4749630Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local ... 2024-12-18T01:07:47.7185290Z 2024-12-18T01:07:47.7186222Z  2024-12-18T01:07:47.7186685Z  2024-12-18T01:07:47.7187113Z  2024-12-18T01:07:47.7187493Z  2024-12-18T01:07:47.7187885Z  2024-12-18T01:07:47.7188270Z  2024-12-18T01:07:47.7188671Z  2024-12-18T01:07:47.7189049Z  2024-12-18T01:07:47.7189970Z [20,295 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:47.7190905Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T01:07:47.7191670Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T01:07:47.7192416Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2024-12-18T01:07:47.7193193Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2024-12-18T01:07:47.7193926Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T01:07:47.7195149Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local 2024-12-18T01:07:47.7195877Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2024-12-18T01:07:47.7196566Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local ... 2024-12-18T01:07:48.0743191Z 2024-12-18T01:07:48.0744093Z  2024-12-18T01:07:48.0744758Z  2024-12-18T01:07:48.0745498Z  2024-12-18T01:07:48.0745896Z  2024-12-18T01:07:48.0746284Z  2024-12-18T01:07:48.0746673Z  2024-12-18T01:07:48.0747070Z  2024-12-18T01:07:48.0747457Z  2024-12-18T01:07:48.0748322Z [20,295 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:48.0749287Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T01:07:48.0750090Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T01:07:48.0750944Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2024-12-18T01:07:48.0751756Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2024-12-18T01:07:48.0752793Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T01:07:48.0753614Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2024-12-18T01:07:48.0754414Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2024-12-18T01:07:48.0755171Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local ... 2024-12-18T01:07:48.7531184Z 2024-12-18T01:07:48.7532087Z  2024-12-18T01:07:48.7532564Z  2024-12-18T01:07:48.7532940Z  2024-12-18T01:07:48.7533562Z  2024-12-18T01:07:48.7533930Z  2024-12-18T01:07:48.7534297Z  2024-12-18T01:07:48.7534670Z  2024-12-18T01:07:48.7535055Z  2024-12-18T01:07:48.7535952Z [20,296 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:48.7537093Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2024-12-18T01:07:48.7538061Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2024-12-18T01:07:48.7538876Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T01:07:48.7539624Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2024-12-18T01:07:48.7540376Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2024-12-18T01:07:48.7541142Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local 2024-12-18T01:07:48.7541852Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2024-12-18T01:07:48.7542585Z Compiling torch_xla/csrc/ops/exponential.cpp; 28s local ... 2024-12-18T01:07:49.0750990Z 2024-12-18T01:07:49.0751877Z  2024-12-18T01:07:49.0752358Z  2024-12-18T01:07:49.0752770Z  2024-12-18T01:07:49.0753130Z  2024-12-18T01:07:49.0753499Z  2024-12-18T01:07:49.0753867Z  2024-12-18T01:07:49.0754237Z  2024-12-18T01:07:49.0754622Z  2024-12-18T01:07:49.0755545Z [20,296 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:49.0756586Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2024-12-18T01:07:49.0757425Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2024-12-18T01:07:49.0758255Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T01:07:49.0758977Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2024-12-18T01:07:49.0759767Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2024-12-18T01:07:49.0761104Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local 2024-12-18T01:07:49.0772204Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2024-12-18T01:07:49.0773189Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local ... 2024-12-18T01:07:49.4732599Z 2024-12-18T01:07:49.4734440Z  2024-12-18T01:07:49.4735725Z  2024-12-18T01:07:49.4737039Z  2024-12-18T01:07:49.4738148Z  2024-12-18T01:07:49.4739315Z  2024-12-18T01:07:49.4740462Z  2024-12-18T01:07:49.4741630Z  2024-12-18T01:07:49.4745617Z  2024-12-18T01:07:49.4747322Z [20,298 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:07:49.4748985Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2024-12-18T01:07:49.4750525Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 37s local 2024-12-18T01:07:49.4752081Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T01:07:49.4753737Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T01:07:49.4755499Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2024-12-18T01:07:49.4757003Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2024-12-18T01:07:49.4758553Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2024-12-18T01:07:49.4760123Z Compiling torch_xla/csrc/ops/gather.cpp; 27s local ... 2024-12-18T01:07:49.6755631Z 2024-12-18T01:07:49.6757808Z  2024-12-18T01:07:49.6759157Z  2024-12-18T01:07:49.6761481Z  2024-12-18T01:07:49.6763152Z  2024-12-18T01:07:49.6764722Z  2024-12-18T01:07:49.6766316Z  2024-12-18T01:07:49.6767915Z  2024-12-18T01:07:49.6769847Z  2024-12-18T01:07:49.6771993Z [20,300 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:07:49.6774177Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2024-12-18T01:07:49.6776279Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T01:07:49.6778360Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T01:07:49.6780455Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2024-12-18T01:07:49.6782413Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2024-12-18T01:07:49.6784372Z Compiling torch_xla/csrc/ops/gather.cpp; 28s local 2024-12-18T01:07:49.6786324Z Compiling torch_xla/csrc/ops/generic.cpp; 28s local 2024-12-18T01:07:49.6788284Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 27s local ... 2024-12-18T01:07:49.8759227Z 2024-12-18T01:07:49.8761491Z  2024-12-18T01:07:49.8763141Z  2024-12-18T01:07:49.8764693Z  2024-12-18T01:07:49.8766308Z  2024-12-18T01:07:49.8767925Z  2024-12-18T01:07:49.8769519Z  2024-12-18T01:07:49.8771146Z  2024-12-18T01:07:49.8772732Z  2024-12-18T01:07:49.8774827Z [20,300 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:49.8777219Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2024-12-18T01:07:49.8779165Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2024-12-18T01:07:49.8781183Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T01:07:49.8783130Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2024-12-18T01:07:49.8785126Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2024-12-18T01:07:49.8787198Z Compiling torch_xla/csrc/ops/gather.cpp; 28s local 2024-12-18T01:07:49.8789151Z Compiling torch_xla/csrc/ops/generic.cpp; 28s local 2024-12-18T01:07:49.8791593Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 27s local ... 2024-12-18T01:07:51.0768400Z 2024-12-18T01:07:51.0769209Z  2024-12-18T01:07:51.0769580Z  2024-12-18T01:07:51.0769883Z  2024-12-18T01:07:51.0770186Z  2024-12-18T01:07:51.0770473Z  2024-12-18T01:07:51.0770769Z  2024-12-18T01:07:51.0771080Z  2024-12-18T01:07:51.0771393Z  2024-12-18T01:07:51.0772098Z [20,300 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:51.0772828Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2024-12-18T01:07:51.0773407Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2024-12-18T01:07:51.0773982Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2024-12-18T01:07:51.0774572Z Compiling torch_xla/csrc/ops/exponential.cpp; 31s local 2024-12-18T01:07:51.0775211Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2024-12-18T01:07:51.0776148Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local 2024-12-18T01:07:51.0776859Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local 2024-12-18T01:07:51.0777487Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 28s local ... 2024-12-18T01:07:52.0776197Z 2024-12-18T01:07:52.0777212Z  2024-12-18T01:07:52.0777652Z  2024-12-18T01:07:52.0778012Z  2024-12-18T01:07:52.0778770Z  2024-12-18T01:07:52.0779133Z  2024-12-18T01:07:52.0779497Z  2024-12-18T01:07:52.0779854Z  2024-12-18T01:07:52.0780214Z  2024-12-18T01:07:52.0781095Z [20,300 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:52.0782180Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2024-12-18T01:07:52.0782914Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T01:07:52.0783679Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2024-12-18T01:07:52.0784459Z Compiling torch_xla/csrc/ops/exponential.cpp; 32s local 2024-12-18T01:07:52.0785687Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2024-12-18T01:07:52.0786520Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2024-12-18T01:07:52.0787273Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2024-12-18T01:07:52.0788113Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 29s local ... 2024-12-18T01:07:52.3606630Z 2024-12-18T01:07:52.3607524Z  2024-12-18T01:07:52.3607904Z  2024-12-18T01:07:52.3608210Z  2024-12-18T01:07:52.3608514Z  2024-12-18T01:07:52.3609120Z  2024-12-18T01:07:52.3609432Z  2024-12-18T01:07:52.3609733Z  2024-12-18T01:07:52.3610032Z  2024-12-18T01:07:52.3610738Z [20,301 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:52.3611472Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2024-12-18T01:07:52.3612074Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T01:07:52.3612670Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2024-12-18T01:07:52.3613280Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2024-12-18T01:07:52.3613901Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2024-12-18T01:07:52.3614460Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2024-12-18T01:07:52.3615083Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T01:07:52.3615807Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 27s local ... 2024-12-18T01:07:52.6779142Z 2024-12-18T01:07:52.6780390Z  2024-12-18T01:07:52.6780800Z  2024-12-18T01:07:52.6781150Z  2024-12-18T01:07:52.6781511Z  2024-12-18T01:07:52.6781870Z  2024-12-18T01:07:52.6782242Z  2024-12-18T01:07:52.6782597Z  2024-12-18T01:07:52.6782934Z  2024-12-18T01:07:52.6783790Z [20,301 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:52.6784743Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2024-12-18T01:07:52.6785477Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T01:07:52.6786195Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2024-12-18T01:07:52.6786894Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2024-12-18T01:07:52.6787633Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2024-12-18T01:07:52.6788331Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2024-12-18T01:07:52.6789108Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T01:07:52.6790012Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 27s local ... 2024-12-18T01:07:52.9366114Z 2024-12-18T01:07:52.9366973Z  2024-12-18T01:07:52.9367384Z  2024-12-18T01:07:52.9367720Z  2024-12-18T01:07:52.9368074Z  2024-12-18T01:07:52.9368416Z  2024-12-18T01:07:52.9368754Z  2024-12-18T01:07:52.9369087Z  2024-12-18T01:07:52.9369740Z  2024-12-18T01:07:52.9370573Z [20,302 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:52.9371441Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2024-12-18T01:07:52.9372156Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2024-12-18T01:07:52.9372854Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2024-12-18T01:07:52.9373698Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2024-12-18T01:07:52.9374464Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2024-12-18T01:07:52.9375575Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T01:07:52.9376368Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 28s local 2024-12-18T01:07:52.9377433Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 28s local ... 2024-12-18T01:07:53.1551776Z 2024-12-18T01:07:53.1552599Z  2024-12-18T01:07:53.1553016Z  2024-12-18T01:07:53.1553351Z  2024-12-18T01:07:53.1553697Z  2024-12-18T01:07:53.1554033Z  2024-12-18T01:07:53.1554375Z  2024-12-18T01:07:53.1554715Z  2024-12-18T01:07:53.1555294Z  2024-12-18T01:07:53.1556083Z [20,303 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:53.1556924Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2024-12-18T01:07:53.1557620Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2024-12-18T01:07:53.1558635Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2024-12-18T01:07:53.1559472Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2024-12-18T01:07:53.1560480Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T01:07:53.1561343Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 28s local 2024-12-18T01:07:53.1562195Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 28s local 2024-12-18T01:07:53.1563079Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 27s local ... 2024-12-18T01:07:53.4784842Z 2024-12-18T01:07:53.4785685Z  2024-12-18T01:07:53.4786108Z  2024-12-18T01:07:53.4786515Z  2024-12-18T01:07:53.4786847Z  2024-12-18T01:07:53.4787201Z  2024-12-18T01:07:53.4787552Z  2024-12-18T01:07:53.4787893Z  2024-12-18T01:07:53.4788222Z  2024-12-18T01:07:53.4789078Z [20,303 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:53.4789974Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2024-12-18T01:07:53.4790677Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2024-12-18T01:07:53.4791371Z Compiling torch_xla/csrc/ops/eigh.cpp; 37s local 2024-12-18T01:07:53.4792221Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2024-12-18T01:07:53.4792966Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2024-12-18T01:07:53.4793721Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 28s local 2024-12-18T01:07:53.4794500Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 28s local 2024-12-18T01:07:53.4795493Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 28s local ... 2024-12-18T01:07:53.9544980Z 2024-12-18T01:07:53.9545982Z  2024-12-18T01:07:53.9546518Z  2024-12-18T01:07:53.9546883Z  2024-12-18T01:07:53.9547226Z  2024-12-18T01:07:53.9547559Z  2024-12-18T01:07:53.9547920Z  2024-12-18T01:07:53.9548271Z  2024-12-18T01:07:53.9548647Z  2024-12-18T01:07:53.9549468Z [20,304 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:53.9550461Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2024-12-18T01:07:53.9551146Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T01:07:53.9551830Z Compiling torch_xla/csrc/ops/eigh.cpp; 37s local 2024-12-18T01:07:53.9552523Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2024-12-18T01:07:53.9553643Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local 2024-12-18T01:07:53.9554610Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2024-12-18T01:07:53.9555387Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 28s local 2024-12-18T01:07:53.9556190Z Compiling torch_xla/csrc/ops/index_get.cpp; 28s local ... 2024-12-18T01:07:54.2790905Z 2024-12-18T01:07:54.2791877Z  2024-12-18T01:07:54.2792725Z  2024-12-18T01:07:54.2793137Z  2024-12-18T01:07:54.2793482Z  2024-12-18T01:07:54.2793818Z  2024-12-18T01:07:54.2794182Z  2024-12-18T01:07:54.2794541Z  2024-12-18T01:07:54.2794877Z  2024-12-18T01:07:54.2795714Z [20,304 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:54.2796573Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2024-12-18T01:07:54.2797231Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T01:07:54.2797887Z Compiling torch_xla/csrc/ops/eigh.cpp; 37s local 2024-12-18T01:07:54.2798615Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T01:07:54.2799617Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local 2024-12-18T01:07:54.2800381Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2024-12-18T01:07:54.2801147Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 28s local 2024-12-18T01:07:54.2801936Z Compiling torch_xla/csrc/ops/index_get.cpp; 28s local ... 2024-12-18T01:07:54.5530708Z 2024-12-18T01:07:54.5531667Z  2024-12-18T01:07:54.5532377Z  2024-12-18T01:07:54.5532790Z  2024-12-18T01:07:54.5533192Z  2024-12-18T01:07:54.5533600Z  2024-12-18T01:07:54.5533989Z  2024-12-18T01:07:54.5534387Z  2024-12-18T01:07:54.5534780Z  2024-12-18T01:07:54.5535893Z [20,305 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:54.5537067Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2024-12-18T01:07:54.5537737Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T01:07:54.5538463Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T01:07:54.5539256Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local 2024-12-18T01:07:54.5540017Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2024-12-18T01:07:54.5540721Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local 2024-12-18T01:07:54.5541447Z Compiling torch_xla/csrc/ops/index_get.cpp; 28s local 2024-12-18T01:07:54.5542143Z Compiling torch_xla/csrc/ops/index_put.cpp; 28s local ... 2024-12-18T01:07:54.8796705Z 2024-12-18T01:07:54.8797672Z  2024-12-18T01:07:54.8798148Z  2024-12-18T01:07:54.8798443Z  2024-12-18T01:07:54.8798746Z  2024-12-18T01:07:54.8799052Z  2024-12-18T01:07:54.8799348Z  2024-12-18T01:07:54.8799639Z  2024-12-18T01:07:54.8799944Z  2024-12-18T01:07:54.8800698Z [20,305 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:54.8801453Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2024-12-18T01:07:54.8802044Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 39s local 2024-12-18T01:07:54.8802665Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T01:07:54.8803321Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2024-12-18T01:07:54.8804014Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2024-12-18T01:07:54.8804700Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local 2024-12-18T01:07:54.8805343Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local 2024-12-18T01:07:54.8805960Z Compiling torch_xla/csrc/ops/index_put.cpp; 28s local ... 2024-12-18T01:07:55.8804525Z 2024-12-18T01:07:55.8805490Z  2024-12-18T01:07:55.8805994Z  2024-12-18T01:07:55.8806371Z  2024-12-18T01:07:55.8807200Z  2024-12-18T01:07:55.8807573Z  2024-12-18T01:07:55.8807957Z  2024-12-18T01:07:55.8808334Z  2024-12-18T01:07:55.8808728Z  2024-12-18T01:07:55.8809637Z [20,305 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:55.8810587Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2024-12-18T01:07:55.8811354Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 40s local 2024-12-18T01:07:55.8812325Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2024-12-18T01:07:55.8813133Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2024-12-18T01:07:55.8813991Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2024-12-18T01:07:55.8814850Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2024-12-18T01:07:55.8815627Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2024-12-18T01:07:55.8816539Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local ... 2024-12-18T01:07:56.8812029Z 2024-12-18T01:07:56.8813049Z  2024-12-18T01:07:56.8813485Z  2024-12-18T01:07:56.8813846Z  2024-12-18T01:07:56.8814507Z  2024-12-18T01:07:56.8814942Z  2024-12-18T01:07:56.8815338Z  2024-12-18T01:07:56.8815707Z  2024-12-18T01:07:56.8816059Z  2024-12-18T01:07:56.8817093Z [20,305 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:56.8818104Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2024-12-18T01:07:56.8819048Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 41s local 2024-12-18T01:07:56.8819900Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2024-12-18T01:07:56.8820805Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T01:07:56.8821701Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2024-12-18T01:07:56.8822589Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2024-12-18T01:07:56.8823433Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2024-12-18T01:07:56.8824211Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local ... 2024-12-18T01:07:57.1050973Z 2024-12-18T01:07:57.1051815Z  2024-12-18T01:07:57.1052327Z  2024-12-18T01:07:57.1052753Z  2024-12-18T01:07:57.1053139Z  2024-12-18T01:07:57.1053550Z  2024-12-18T01:07:57.1053937Z  2024-12-18T01:07:57.1054384Z  2024-12-18T01:07:57.1054746Z  2024-12-18T01:07:57.1055716Z [20,306 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:57.1056907Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2024-12-18T01:07:57.1057730Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 41s local 2024-12-18T01:07:57.1058570Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2024-12-18T01:07:57.1059510Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T01:07:57.1060432Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T01:07:57.1061282Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2024-12-18T01:07:57.1062100Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2024-12-18T01:07:57.1062958Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local ... 2024-12-18T01:07:57.3805141Z 2024-12-18T01:07:57.3806640Z  2024-12-18T01:07:57.3807267Z  2024-12-18T01:07:57.3807640Z  2024-12-18T01:07:57.3808150Z  2024-12-18T01:07:57.3808599Z  2024-12-18T01:07:57.3808928Z  2024-12-18T01:07:57.3809351Z  2024-12-18T01:07:57.3809859Z  2024-12-18T01:07:57.3810905Z [20,308 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:57.3812031Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2024-12-18T01:07:57.3812951Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2024-12-18T01:07:57.3813982Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T01:07:57.3815269Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T01:07:57.3816048Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2024-12-18T01:07:57.3817042Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2024-12-18T01:07:57.3817843Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local 2024-12-18T01:07:57.3818822Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local ... 2024-12-18T01:07:57.6037259Z 2024-12-18T01:07:57.6038396Z  2024-12-18T01:07:57.6038909Z  2024-12-18T01:07:57.6039333Z  2024-12-18T01:07:57.6039755Z  2024-12-18T01:07:57.6040138Z  2024-12-18T01:07:57.6040534Z  2024-12-18T01:07:57.6040937Z  2024-12-18T01:07:57.6041332Z  2024-12-18T01:07:57.6042285Z [20,309 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:57.6043302Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2024-12-18T01:07:57.6044432Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T01:07:57.6045605Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T01:07:57.6046428Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2024-12-18T01:07:57.6047207Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2024-12-18T01:07:57.6048021Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2024-12-18T01:07:57.6048839Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local 2024-12-18T01:07:57.6049849Z Compiling torch_xla/csrc/ops/linspace.cpp; 28s local ... 2024-12-18T01:07:57.8819517Z 2024-12-18T01:07:57.8820430Z  2024-12-18T01:07:57.8820897Z  2024-12-18T01:07:57.8821280Z  2024-12-18T01:07:57.8821669Z  2024-12-18T01:07:57.8822033Z  2024-12-18T01:07:57.8822387Z  2024-12-18T01:07:57.8822798Z  2024-12-18T01:07:57.8823185Z  2024-12-18T01:07:57.8824258Z [20,310 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:07:57.8825231Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2024-12-18T01:07:57.8826048Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T01:07:57.8826971Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T01:07:57.8827820Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2024-12-18T01:07:57.8829150Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2024-12-18T01:07:57.8830155Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local 2024-12-18T01:07:57.8831107Z Compiling torch_xla/csrc/ops/linspace.cpp; 28s local 2024-12-18T01:07:57.8832103Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local ... 2024-12-18T01:07:58.1265345Z 2024-12-18T01:07:58.1266488Z  2024-12-18T01:07:58.1266967Z  2024-12-18T01:07:58.1267343Z  2024-12-18T01:07:58.1267765Z  2024-12-18T01:07:58.1268160Z  2024-12-18T01:07:58.1268579Z  2024-12-18T01:07:58.1268892Z  2024-12-18T01:07:58.1269199Z  2024-12-18T01:07:58.1270136Z [20,311 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:58.1271127Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2024-12-18T01:07:58.1271956Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T01:07:58.1272841Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2024-12-18T01:07:58.1273672Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2024-12-18T01:07:58.1274509Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local 2024-12-18T01:07:58.1275279Z Compiling torch_xla/csrc/ops/linspace.cpp; 28s local 2024-12-18T01:07:58.1276147Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local 2024-12-18T01:07:58.1277143Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 28s local ... 2024-12-18T01:07:58.4825395Z 2024-12-18T01:07:58.4827582Z  2024-12-18T01:07:58.4828040Z  2024-12-18T01:07:58.4829667Z  2024-12-18T01:07:58.4830749Z  2024-12-18T01:07:58.4831884Z  2024-12-18T01:07:58.4833275Z  2024-12-18T01:07:58.4834527Z  2024-12-18T01:07:58.4835992Z  2024-12-18T01:07:58.4837902Z [20,311 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:58.4839196Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2024-12-18T01:07:58.4840000Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T01:07:58.4840873Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2024-12-18T01:07:58.4841663Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2024-12-18T01:07:58.4842441Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2024-12-18T01:07:58.4843162Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2024-12-18T01:07:58.4843937Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local 2024-12-18T01:07:58.4845097Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 28s local ... 2024-12-18T01:07:59.4833179Z 2024-12-18T01:07:59.4835028Z  2024-12-18T01:07:59.4835470Z  2024-12-18T01:07:59.4837028Z  2024-12-18T01:07:59.4838029Z  2024-12-18T01:07:59.4839128Z  2024-12-18T01:07:59.4840472Z  2024-12-18T01:07:59.4841718Z  2024-12-18T01:07:59.4842944Z  2024-12-18T01:07:59.4845257Z [20,311 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:07:59.4846276Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2024-12-18T01:07:59.4847110Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2024-12-18T01:07:59.4848042Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2024-12-18T01:07:59.4848857Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T01:07:59.4849609Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T01:07:59.4850400Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2024-12-18T01:07:59.4851282Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2024-12-18T01:07:59.4852232Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local ... 2024-12-18T01:07:59.8358888Z 2024-12-18T01:07:59.8360015Z  2024-12-18T01:07:59.8360563Z  2024-12-18T01:07:59.8361027Z  2024-12-18T01:07:59.8361438Z  2024-12-18T01:07:59.8361844Z  2024-12-18T01:07:59.8362272Z  2024-12-18T01:07:59.8362714Z  2024-12-18T01:07:59.8363138Z  2024-12-18T01:07:59.8364066Z [20,312 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:07:59.8365047Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2024-12-18T01:07:59.8365861Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2024-12-18T01:07:59.8366717Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T01:07:59.8367528Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T01:07:59.8368295Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2024-12-18T01:07:59.8369207Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2024-12-18T01:07:59.8370153Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2024-12-18T01:07:59.8371082Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local ... 2024-12-18T01:08:00.0837621Z 2024-12-18T01:08:00.0838969Z  2024-12-18T01:08:00.0839364Z  2024-12-18T01:08:00.0839721Z  2024-12-18T01:08:00.0840030Z  2024-12-18T01:08:00.0840328Z  2024-12-18T01:08:00.0840645Z  2024-12-18T01:08:00.0840963Z  2024-12-18T01:08:00.0841270Z  2024-12-18T01:08:00.0841982Z [20,312 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:00.0842760Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2024-12-18T01:08:00.0843694Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2024-12-18T01:08:00.0851418Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T01:08:00.0852108Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T01:08:00.0852732Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2024-12-18T01:08:00.0853394Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2024-12-18T01:08:00.0854382Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2024-12-18T01:08:00.0855226Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local ... 2024-12-18T01:08:00.8844933Z 2024-12-18T01:08:00.8845781Z  2024-12-18T01:08:00.8846174Z  2024-12-18T01:08:00.8846503Z  2024-12-18T01:08:00.8846821Z  2024-12-18T01:08:00.8847123Z  2024-12-18T01:08:00.8847436Z  2024-12-18T01:08:00.8847750Z  2024-12-18T01:08:00.8848065Z  2024-12-18T01:08:00.8848816Z [20,313 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:00.8849927Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2024-12-18T01:08:00.8850591Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2024-12-18T01:08:00.8851258Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2024-12-18T01:08:00.8851895Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2024-12-18T01:08:00.8852609Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local 2024-12-18T01:08:00.8853481Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2024-12-18T01:08:00.8854189Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2024-12-18T01:08:00.8854883Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 30s local ... 2024-12-18T01:08:01.2076732Z 2024-12-18T01:08:01.2077975Z  2024-12-18T01:08:01.2078463Z  2024-12-18T01:08:01.2078867Z  2024-12-18T01:08:01.2079272Z  2024-12-18T01:08:01.2079711Z  2024-12-18T01:08:01.2080115Z  2024-12-18T01:08:01.2080498Z  2024-12-18T01:08:01.2080888Z  2024-12-18T01:08:01.2081823Z [20,314 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:01.2082881Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2024-12-18T01:08:01.2083773Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T01:08:01.2084666Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2024-12-18T01:08:01.2085655Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local 2024-12-18T01:08:01.2086722Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2024-12-18T01:08:01.2087711Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2024-12-18T01:08:01.2088610Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 31s local 2024-12-18T01:08:01.2089545Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local ... 2024-12-18T01:08:01.4850326Z 2024-12-18T01:08:01.4851302Z  2024-12-18T01:08:01.4851776Z  2024-12-18T01:08:01.4852194Z  2024-12-18T01:08:01.4852623Z  2024-12-18T01:08:01.4852989Z  2024-12-18T01:08:01.4853342Z  2024-12-18T01:08:01.4853739Z  2024-12-18T01:08:01.4854109Z  2024-12-18T01:08:01.4855037Z [20,316 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:01.4856014Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2024-12-18T01:08:01.4856940Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T01:08:01.4857758Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T01:08:01.4858531Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2024-12-18T01:08:01.4859318Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 31s local 2024-12-18T01:08:01.4860080Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2024-12-18T01:08:01.4860851Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2024-12-18T01:08:01.4861949Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 29s local ... 2024-12-18T01:08:01.8853454Z 2024-12-18T01:08:01.8854329Z  2024-12-18T01:08:01.8854785Z  2024-12-18T01:08:01.8855181Z  2024-12-18T01:08:01.8855560Z  2024-12-18T01:08:01.8855951Z  2024-12-18T01:08:01.8856334Z  2024-12-18T01:08:01.8856840Z  2024-12-18T01:08:01.8857489Z  2024-12-18T01:08:01.8858400Z [20,317 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:01.8859391Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2024-12-18T01:08:01.8860219Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 37s local 2024-12-18T01:08:01.8861017Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T01:08:01.8861718Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 31s local 2024-12-18T01:08:01.8862422Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2024-12-18T01:08:01.8863164Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2024-12-18T01:08:01.8864076Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2024-12-18T01:08:01.8864865Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local ... 2024-12-18T01:08:02.1465798Z 2024-12-18T01:08:02.1467341Z  2024-12-18T01:08:02.1467837Z  2024-12-18T01:08:02.1468179Z  2024-12-18T01:08:02.1468554Z  2024-12-18T01:08:02.1468937Z  2024-12-18T01:08:02.1469300Z  2024-12-18T01:08:02.1469830Z  2024-12-18T01:08:02.1470452Z  2024-12-18T01:08:02.1471380Z [20,318 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:02.1472383Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2024-12-18T01:08:02.1473190Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T01:08:02.1473946Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 31s local 2024-12-18T01:08:02.1474698Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2024-12-18T01:08:02.1475455Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T01:08:02.1476253Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2024-12-18T01:08:02.1477092Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local 2024-12-18T01:08:02.1477876Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local ... 2024-12-18T01:08:02.4858971Z 2024-12-18T01:08:02.4859879Z  2024-12-18T01:08:02.4860293Z  2024-12-18T01:08:02.4860626Z  2024-12-18T01:08:02.4860981Z  2024-12-18T01:08:02.4861311Z  2024-12-18T01:08:02.4861641Z  2024-12-18T01:08:02.4861965Z  2024-12-18T01:08:02.4862277Z  2024-12-18T01:08:02.4863050Z [20,318 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:02.4863841Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2024-12-18T01:08:02.4864492Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2024-12-18T01:08:02.4865147Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 32s local 2024-12-18T01:08:02.4865820Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2024-12-18T01:08:02.4866445Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T01:08:02.4867124Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2024-12-18T01:08:02.4867814Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2024-12-18T01:08:02.4868489Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local ... 2024-12-18T01:08:03.3383405Z 2024-12-18T01:08:03.3384299Z  2024-12-18T01:08:03.3384765Z  2024-12-18T01:08:03.3385169Z  2024-12-18T01:08:03.3385559Z  2024-12-18T01:08:03.3385891Z  2024-12-18T01:08:03.3386256Z  2024-12-18T01:08:03.3386632Z  2024-12-18T01:08:03.3387020Z  2024-12-18T01:08:03.3388090Z [20,319 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:03.3389328Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2024-12-18T01:08:03.3390125Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2024-12-18T01:08:03.3390945Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 33s local 2024-12-18T01:08:03.3391651Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2024-12-18T01:08:03.3392475Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2024-12-18T01:08:03.3393866Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2024-12-18T01:08:03.3394896Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2024-12-18T01:08:03.3395934Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 29s local ... 2024-12-18T01:08:03.6873134Z 2024-12-18T01:08:03.6874139Z  2024-12-18T01:08:03.6874622Z  2024-12-18T01:08:03.6874994Z  2024-12-18T01:08:03.6875407Z  2024-12-18T01:08:03.6875793Z  2024-12-18T01:08:03.6876168Z  2024-12-18T01:08:03.6876588Z  2024-12-18T01:08:03.6876976Z  2024-12-18T01:08:03.6878372Z [20,320 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:03.6879395Z Compiling torch_xla/csrc/tensor_util.cpp; 92s local 2024-12-18T01:08:03.6880127Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2024-12-18T01:08:03.6880934Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 33s local 2024-12-18T01:08:03.6881736Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2024-12-18T01:08:03.6882728Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2024-12-18T01:08:03.6883600Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2024-12-18T01:08:03.6884429Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 29s local 2024-12-18T01:08:03.6885472Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 29s local ... 2024-12-18T01:08:04.0876475Z 2024-12-18T01:08:04.0878059Z  2024-12-18T01:08:04.0878555Z  2024-12-18T01:08:04.0878978Z  2024-12-18T01:08:04.0879309Z  2024-12-18T01:08:04.0879669Z  2024-12-18T01:08:04.0880033Z  2024-12-18T01:08:04.0880425Z  2024-12-18T01:08:04.0880803Z  2024-12-18T01:08:04.0881651Z [20,320 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:04.0882653Z Compiling torch_xla/csrc/tensor_util.cpp; 92s local 2024-12-18T01:08:04.0883482Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2024-12-18T01:08:04.0884294Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 33s local 2024-12-18T01:08:04.0885126Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2024-12-18T01:08:04.0885857Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2024-12-18T01:08:04.0886651Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2024-12-18T01:08:04.0887433Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2024-12-18T01:08:04.0888322Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local ... 2024-12-18T01:08:05.0884428Z 2024-12-18T01:08:05.0885333Z  2024-12-18T01:08:05.0885822Z  2024-12-18T01:08:05.0886239Z  2024-12-18T01:08:05.0886662Z  2024-12-18T01:08:05.0886997Z  2024-12-18T01:08:05.0887351Z  2024-12-18T01:08:05.0887721Z  2024-12-18T01:08:05.0888101Z  2024-12-18T01:08:05.0889025Z [20,320 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:05.0890056Z Compiling torch_xla/csrc/tensor_util.cpp; 93s local 2024-12-18T01:08:05.0890851Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2024-12-18T01:08:05.0891792Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 34s local 2024-12-18T01:08:05.0892601Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2024-12-18T01:08:05.0893364Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2024-12-18T01:08:05.0894180Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2024-12-18T01:08:05.0895290Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2024-12-18T01:08:05.0896192Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local ... 2024-12-18T01:08:05.7868872Z 2024-12-18T01:08:05.7870401Z  2024-12-18T01:08:05.7870941Z  2024-12-18T01:08:05.7871382Z  2024-12-18T01:08:05.7871826Z  2024-12-18T01:08:05.7872249Z  2024-12-18T01:08:05.7872972Z  2024-12-18T01:08:05.7873420Z  2024-12-18T01:08:05.7873870Z  2024-12-18T01:08:05.7874912Z [20,322 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:05.7876053Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2024-12-18T01:08:05.7876965Z Compiling torch_xla/csrc/ops/index_ops.cpp; 38s local 2024-12-18T01:08:05.7878078Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 35s local 2024-12-18T01:08:05.7879059Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T01:08:05.7880046Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2024-12-18T01:08:05.7881194Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2024-12-18T01:08:05.7882202Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2024-12-18T01:08:05.7883210Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 29s local ... 2024-12-18T01:08:06.0891950Z 2024-12-18T01:08:06.0892806Z  2024-12-18T01:08:06.0893319Z  2024-12-18T01:08:06.0893711Z  2024-12-18T01:08:06.0894086Z  2024-12-18T01:08:06.0894472Z  2024-12-18T01:08:06.0895119Z  2024-12-18T01:08:06.0895516Z  2024-12-18T01:08:06.0895855Z  2024-12-18T01:08:06.0896912Z [20,322 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:06.0897882Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2024-12-18T01:08:06.0898664Z Compiling torch_xla/csrc/ops/index_ops.cpp; 38s local 2024-12-18T01:08:06.0899476Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 35s local 2024-12-18T01:08:06.0900260Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T01:08:06.0901032Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2024-12-18T01:08:06.0901833Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2024-12-18T01:08:06.0902635Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2024-12-18T01:08:06.0903468Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 29s local ... 2024-12-18T01:08:06.7733524Z 2024-12-18T01:08:06.7735062Z  2024-12-18T01:08:06.7735576Z  2024-12-18T01:08:06.7735943Z  2024-12-18T01:08:06.7736313Z  2024-12-18T01:08:06.7736830Z  2024-12-18T01:08:06.7737233Z  2024-12-18T01:08:06.7737607Z  2024-12-18T01:08:06.7737987Z  2024-12-18T01:08:06.7738858Z [20,323 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:06.7739760Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2024-12-18T01:08:06.7740555Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2024-12-18T01:08:06.7741322Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 36s local 2024-12-18T01:08:06.7742093Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2024-12-18T01:08:06.7742872Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2024-12-18T01:08:06.7743712Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2024-12-18T01:08:06.7744802Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2024-12-18T01:08:06.7745639Z Compiling torch_xla/csrc/ops/mean.cpp; 29s local ... 2024-12-18T01:08:07.0899562Z 2024-12-18T01:08:07.0900495Z  2024-12-18T01:08:07.0901001Z  2024-12-18T01:08:07.0901407Z  2024-12-18T01:08:07.0901799Z  2024-12-18T01:08:07.0902182Z  2024-12-18T01:08:07.0902572Z  2024-12-18T01:08:07.0902957Z  2024-12-18T01:08:07.0903330Z  2024-12-18T01:08:07.0904301Z [20,323 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:07.0905691Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2024-12-18T01:08:07.0906467Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2024-12-18T01:08:07.0907309Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 36s local 2024-12-18T01:08:07.0908136Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2024-12-18T01:08:07.0909151Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2024-12-18T01:08:07.0910050Z Compiling torch_xla/csrc/ops/masked_select.cpp; 34s local 2024-12-18T01:08:07.0910939Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2024-12-18T01:08:07.0911790Z Compiling torch_xla/csrc/ops/mean.cpp; 29s local ... 2024-12-18T01:08:07.4902366Z 2024-12-18T01:08:07.4903304Z  2024-12-18T01:08:07.4903720Z  2024-12-18T01:08:07.4904070Z  2024-12-18T01:08:07.4904431Z  2024-12-18T01:08:07.4904796Z  2024-12-18T01:08:07.4905328Z  2024-12-18T01:08:07.4905669Z  2024-12-18T01:08:07.4906008Z  2024-12-18T01:08:07.4907157Z [20,324 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:07.4908051Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2024-12-18T01:08:07.4908716Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 37s local 2024-12-18T01:08:07.4909422Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 37s local 2024-12-18T01:08:07.4910237Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2024-12-18T01:08:07.4910957Z Compiling torch_xla/csrc/ops/masked_select.cpp; 34s local 2024-12-18T01:08:07.4911675Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2024-12-18T01:08:07.4912367Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T01:08:07.4913020Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local ... 2024-12-18T01:08:07.8501959Z 2024-12-18T01:08:07.8502952Z  2024-12-18T01:08:07.8503445Z  2024-12-18T01:08:07.8504046Z  2024-12-18T01:08:07.8504458Z  2024-12-18T01:08:07.8504968Z  2024-12-18T01:08:07.8505460Z  2024-12-18T01:08:07.8505971Z  2024-12-18T01:08:07.8506460Z  2024-12-18T01:08:07.8507449Z [20,326 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:07.8508541Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2024-12-18T01:08:07.8509396Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 37s local 2024-12-18T01:08:07.8510354Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2024-12-18T01:08:07.8511236Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T01:08:07.8512143Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T01:08:07.8512999Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T01:08:07.8514117Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 29s local 2024-12-18T01:08:07.8515378Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local ... 2024-12-18T01:08:08.0908878Z 2024-12-18T01:08:08.0909832Z  2024-12-18T01:08:08.0910303Z  2024-12-18T01:08:08.0910688Z  2024-12-18T01:08:08.0911090Z  2024-12-18T01:08:08.0911450Z  2024-12-18T01:08:08.0911823Z  2024-12-18T01:08:08.0912175Z  2024-12-18T01:08:08.0912550Z  2024-12-18T01:08:08.0913457Z [20,326 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:08.0914416Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2024-12-18T01:08:08.0915159Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 37s local 2024-12-18T01:08:08.0915970Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 37s local 2024-12-18T01:08:08.0916751Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T01:08:08.0917525Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T01:08:08.0918237Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T01:08:08.0919441Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T01:08:08.0920447Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local ... 2024-12-18T01:08:08.2911110Z 2024-12-18T01:08:08.2912789Z  2024-12-18T01:08:08.2913256Z  2024-12-18T01:08:08.2913634Z  2024-12-18T01:08:08.2913983Z  2024-12-18T01:08:08.2914729Z  2024-12-18T01:08:08.2915076Z  2024-12-18T01:08:08.2915427Z  2024-12-18T01:08:08.2915780Z  2024-12-18T01:08:08.2916663Z [20,327 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:08.2917597Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2024-12-18T01:08:08.2918329Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local 2024-12-18T01:08:08.2919346Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T01:08:08.2919987Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T01:08:08.2920553Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T01:08:08.2921318Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T01:08:08.2921985Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local 2024-12-18T01:08:08.2922700Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local ... 2024-12-18T01:08:08.6915481Z 2024-12-18T01:08:08.6917141Z  2024-12-18T01:08:08.6917649Z  2024-12-18T01:08:08.6917983Z  2024-12-18T01:08:08.6918351Z  2024-12-18T01:08:08.6918930Z  2024-12-18T01:08:08.6919349Z  2024-12-18T01:08:08.6919725Z  2024-12-18T01:08:08.6920176Z  2024-12-18T01:08:08.6921209Z [20,327 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:08.6922161Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2024-12-18T01:08:08.6922965Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local 2024-12-18T01:08:08.6923872Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2024-12-18T01:08:08.6924708Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T01:08:08.6925509Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 31s local 2024-12-18T01:08:08.6926433Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T01:08:08.6927370Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T01:08:08.6928427Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local ... 2024-12-18T01:08:09.2519071Z 2024-12-18T01:08:09.2520571Z  2024-12-18T01:08:09.2521265Z  2024-12-18T01:08:09.2521614Z  2024-12-18T01:08:09.2521956Z  2024-12-18T01:08:09.2522296Z  2024-12-18T01:08:09.2522638Z  2024-12-18T01:08:09.2522961Z  2024-12-18T01:08:09.2523294Z  2024-12-18T01:08:09.2524099Z [20,329 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:09.2524975Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2024-12-18T01:08:09.2525695Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2024-12-18T01:08:09.2526373Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T01:08:09.2527336Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 31s local 2024-12-18T01:08:09.2537839Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T01:08:09.2539068Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2024-12-18T01:08:09.2540009Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T01:08:09.2540840Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local ... 2024-12-18T01:08:09.4845626Z 2024-12-18T01:08:09.4846522Z  2024-12-18T01:08:09.4846952Z  2024-12-18T01:08:09.4847314Z  2024-12-18T01:08:09.4847672Z  2024-12-18T01:08:09.4848015Z  2024-12-18T01:08:09.4848626Z  2024-12-18T01:08:09.4849287Z  2024-12-18T01:08:09.4849667Z  2024-12-18T01:08:09.4850575Z [20,331 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:09.4851527Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2024-12-18T01:08:09.4852340Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2024-12-18T01:08:09.4853070Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T01:08:09.4854211Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2024-12-18T01:08:09.4855089Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2024-12-18T01:08:09.4856026Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T01:08:09.4856963Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2024-12-18T01:08:09.4857896Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local ... 2024-12-18T01:08:09.6922447Z 2024-12-18T01:08:09.6923492Z  2024-12-18T01:08:09.6923936Z  2024-12-18T01:08:09.6924297Z  2024-12-18T01:08:09.6924639Z  2024-12-18T01:08:09.6924990Z  2024-12-18T01:08:09.6925561Z  2024-12-18T01:08:09.6925923Z  2024-12-18T01:08:09.6926273Z  2024-12-18T01:08:09.6927087Z [20,331 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:09.6927967Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2024-12-18T01:08:09.6928698Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T01:08:09.6929556Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T01:08:09.6930254Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2024-12-18T01:08:09.6931100Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2024-12-18T01:08:09.6932034Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T01:08:09.6932885Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2024-12-18T01:08:09.6933629Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local ... 2024-12-18T01:08:09.9927012Z 2024-12-18T01:08:09.9928028Z  2024-12-18T01:08:09.9928464Z  2024-12-18T01:08:09.9928837Z  2024-12-18T01:08:09.9929174Z  2024-12-18T01:08:09.9929496Z  2024-12-18T01:08:09.9929826Z  2024-12-18T01:08:09.9930168Z  2024-12-18T01:08:09.9930499Z  2024-12-18T01:08:09.9931321Z [20,332 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:09.9932181Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2024-12-18T01:08:09.9932812Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T01:08:09.9933630Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T01:08:09.9934367Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2024-12-18T01:08:09.9935272Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T01:08:09.9936140Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2024-12-18T01:08:09.9937193Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2024-12-18T01:08:09.9937921Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local ... 2024-12-18T01:08:10.2927568Z 2024-12-18T01:08:10.2928599Z  2024-12-18T01:08:10.2929017Z  2024-12-18T01:08:10.2929412Z  2024-12-18T01:08:10.2929809Z  2024-12-18T01:08:10.2930174Z  2024-12-18T01:08:10.2930526Z  2024-12-18T01:08:10.2930845Z  2024-12-18T01:08:10.2931171Z  2024-12-18T01:08:10.2931941Z [20,333 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:10.2932829Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2024-12-18T01:08:10.2933564Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T01:08:10.2934288Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T01:08:10.2935387Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2024-12-18T01:08:10.2936284Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 31s local 2024-12-18T01:08:10.2937178Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2024-12-18T01:08:10.2937894Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2024-12-18T01:08:10.2938732Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local ... 2024-12-18T01:08:10.4931340Z 2024-12-18T01:08:10.4932418Z  2024-12-18T01:08:10.4932906Z  2024-12-18T01:08:10.4933317Z  2024-12-18T01:08:10.4933730Z  2024-12-18T01:08:10.4934117Z  2024-12-18T01:08:10.4934540Z  2024-12-18T01:08:10.4934927Z  2024-12-18T01:08:10.4935300Z  2024-12-18T01:08:10.4936202Z [20,334 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:10.4937329Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2024-12-18T01:08:10.4938175Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T01:08:10.4938952Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2024-12-18T01:08:10.4940161Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2024-12-18T01:08:10.4941080Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2024-12-18T01:08:10.4941892Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2024-12-18T01:08:10.4942797Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2024-12-18T01:08:10.4943920Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local ... 2024-12-18T01:08:10.8935341Z 2024-12-18T01:08:10.8936189Z  2024-12-18T01:08:10.8936729Z  2024-12-18T01:08:10.8937088Z  2024-12-18T01:08:10.8937441Z  2024-12-18T01:08:10.8938320Z  2024-12-18T01:08:10.8939741Z  2024-12-18T01:08:10.8940497Z  2024-12-18T01:08:10.8941136Z  2024-12-18T01:08:10.8941986Z [20,334 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:10.8942942Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2024-12-18T01:08:10.8943712Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2024-12-18T01:08:10.8944719Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2024-12-18T01:08:10.8945530Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2024-12-18T01:08:10.8946403Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2024-12-18T01:08:10.8947154Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2024-12-18T01:08:10.8947971Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2024-12-18T01:08:10.8948804Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local ... 2024-12-18T01:08:11.0939139Z 2024-12-18T01:08:11.0940418Z  2024-12-18T01:08:11.0940842Z  2024-12-18T01:08:11.0941203Z  2024-12-18T01:08:11.0941559Z  2024-12-18T01:08:11.0941940Z  2024-12-18T01:08:11.0942332Z  2024-12-18T01:08:11.0942698Z  2024-12-18T01:08:11.0943075Z  2024-12-18T01:08:11.0943913Z [20,335 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:11.0945124Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2024-12-18T01:08:11.0945902Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2024-12-18T01:08:11.0946645Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2024-12-18T01:08:11.0947396Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2024-12-18T01:08:11.0948060Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2024-12-18T01:08:11.0948809Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2024-12-18T01:08:11.0949640Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local 2024-12-18T01:08:11.0950401Z Compiling torch_xla/csrc/ops/nms.cpp; 23s local ... 2024-12-18T01:08:11.9619556Z 2024-12-18T01:08:11.9620786Z  2024-12-18T01:08:11.9621495Z  2024-12-18T01:08:11.9621826Z  2024-12-18T01:08:11.9622155Z  2024-12-18T01:08:11.9622464Z  2024-12-18T01:08:11.9622818Z  2024-12-18T01:08:11.9623130Z  2024-12-18T01:08:11.9623450Z  2024-12-18T01:08:11.9624213Z [20,337 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:11.9625021Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2024-12-18T01:08:11.9625802Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 35s local 2024-12-18T01:08:11.9626451Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T01:08:11.9627143Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2024-12-18T01:08:11.9627924Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 28s local 2024-12-18T01:08:11.9628580Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local 2024-12-18T01:08:11.9629233Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local 2024-12-18T01:08:11.9629918Z Compiling torch_xla/csrc/ops/normal.cpp; 23s local ... 2024-12-18T01:08:12.2947218Z 2024-12-18T01:08:12.2948095Z  2024-12-18T01:08:12.2948718Z  2024-12-18T01:08:12.2949053Z  2024-12-18T01:08:12.2949364Z  2024-12-18T01:08:12.2949679Z  2024-12-18T01:08:12.2950037Z  2024-12-18T01:08:12.2950384Z  2024-12-18T01:08:12.2950741Z  2024-12-18T01:08:12.2951630Z [20,337 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:12.2952787Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2024-12-18T01:08:12.2953563Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 35s local 2024-12-18T01:08:12.2954313Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T01:08:12.2955095Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2024-12-18T01:08:12.2955985Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2024-12-18T01:08:12.2956958Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local 2024-12-18T01:08:12.2957854Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local 2024-12-18T01:08:12.2958608Z Compiling torch_xla/csrc/ops/normal.cpp; 23s local ... 2024-12-18T01:08:12.7821477Z 2024-12-18T01:08:12.7822366Z  2024-12-18T01:08:12.7822835Z  2024-12-18T01:08:12.7823220Z  2024-12-18T01:08:12.7823602Z  2024-12-18T01:08:12.7824020Z  2024-12-18T01:08:12.7824398Z  2024-12-18T01:08:12.7824767Z  2024-12-18T01:08:12.7825131Z  2024-12-18T01:08:12.7825967Z [20,338 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:12.7826877Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2024-12-18T01:08:12.7827703Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 36s local 2024-12-18T01:08:12.7828480Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2024-12-18T01:08:12.7829289Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2024-12-18T01:08:12.7830118Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local 2024-12-18T01:08:12.7830926Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local 2024-12-18T01:08:12.7831718Z Compiling torch_xla/csrc/ops/normal.cpp; 23s local 2024-12-18T01:08:12.7832482Z Compiling torch_xla/csrc/ops/nonzero.cpp; 23s local ... 2024-12-18T01:08:13.0953276Z 2024-12-18T01:08:13.0954631Z  2024-12-18T01:08:13.0955175Z  2024-12-18T01:08:13.0955553Z  2024-12-18T01:08:13.0955927Z  2024-12-18T01:08:13.0956347Z  2024-12-18T01:08:13.0956748Z  2024-12-18T01:08:13.0957107Z  2024-12-18T01:08:13.0957488Z  2024-12-18T01:08:13.0958398Z [20,338 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:13.0959513Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2024-12-18T01:08:13.0960303Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 36s local 2024-12-18T01:08:13.0961358Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2024-12-18T01:08:13.0962160Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2024-12-18T01:08:13.0962873Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local 2024-12-18T01:08:13.0963603Z Compiling torch_xla/csrc/ops/not_supported.cpp; 25s local 2024-12-18T01:08:13.0964449Z Compiling torch_xla/csrc/ops/normal.cpp; 24s local 2024-12-18T01:08:13.0965424Z Compiling torch_xla/csrc/ops/nonzero.cpp; 23s local ... 2024-12-18T01:08:13.6440941Z 2024-12-18T01:08:13.6441820Z  2024-12-18T01:08:13.6442339Z  2024-12-18T01:08:13.6442750Z  2024-12-18T01:08:13.6443147Z  2024-12-18T01:08:13.6443555Z  2024-12-18T01:08:13.6443957Z  2024-12-18T01:08:13.6444572Z  2024-12-18T01:08:13.6444988Z  2024-12-18T01:08:13.6445941Z [20,339 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:13.6446978Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2024-12-18T01:08:13.6447740Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2024-12-18T01:08:13.6448714Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local 2024-12-18T01:08:13.6449552Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local 2024-12-18T01:08:13.6450356Z Compiling torch_xla/csrc/ops/not_supported.cpp; 25s local 2024-12-18T01:08:13.6451100Z Compiling torch_xla/csrc/ops/normal.cpp; 24s local 2024-12-18T01:08:13.6451808Z Compiling torch_xla/csrc/ops/nonzero.cpp; 24s local 2024-12-18T01:08:13.6452779Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 23s local ... 2024-12-18T01:08:13.8959386Z 2024-12-18T01:08:13.8960653Z  2024-12-18T01:08:13.8961110Z  2024-12-18T01:08:13.8961471Z  2024-12-18T01:08:13.8961851Z  2024-12-18T01:08:13.8962226Z  2024-12-18T01:08:13.8962600Z  2024-12-18T01:08:13.8962968Z  2024-12-18T01:08:13.8963342Z  2024-12-18T01:08:13.8964248Z [20,339 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:13.8965268Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2024-12-18T01:08:13.8966006Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2024-12-18T01:08:13.8966811Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local 2024-12-18T01:08:13.8967587Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local 2024-12-18T01:08:13.8968375Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2024-12-18T01:08:13.8969179Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2024-12-18T01:08:13.8969902Z Compiling torch_xla/csrc/ops/nonzero.cpp; 24s local 2024-12-18T01:08:13.8970687Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 24s local ... 2024-12-18T01:08:14.7783931Z 2024-12-18T01:08:14.7785214Z  2024-12-18T01:08:14.7785703Z  2024-12-18T01:08:14.7786124Z  2024-12-18T01:08:14.7786508Z  2024-12-18T01:08:14.7786912Z  2024-12-18T01:08:14.7787376Z  2024-12-18T01:08:14.7787731Z  2024-12-18T01:08:14.7788022Z  2024-12-18T01:08:14.7788722Z [20,340 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:14.7789468Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2024-12-18T01:08:14.7790112Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2024-12-18T01:08:14.7790735Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2024-12-18T01:08:14.7791417Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2024-12-18T01:08:14.7792250Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2024-12-18T01:08:14.7793059Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2024-12-18T01:08:14.7793836Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local 2024-12-18T01:08:14.7794714Z Compiling torch_xla/csrc/ops/ops.cpp; 25s local ... 2024-12-18T01:08:15.0967895Z 2024-12-18T01:08:15.0969962Z  2024-12-18T01:08:15.0970681Z  2024-12-18T01:08:15.0970984Z  2024-12-18T01:08:15.0971337Z  2024-12-18T01:08:15.0971715Z  2024-12-18T01:08:15.0972094Z  2024-12-18T01:08:15.0972466Z  2024-12-18T01:08:15.0972838Z  2024-12-18T01:08:15.0973626Z [20,340 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:15.0974356Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2024-12-18T01:08:15.0975163Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2024-12-18T01:08:15.0975766Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2024-12-18T01:08:15.0976408Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2024-12-18T01:08:15.0977193Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2024-12-18T01:08:15.0977786Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2024-12-18T01:08:15.0978508Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local 2024-12-18T01:08:15.0979277Z Compiling torch_xla/csrc/ops/ops.cpp; 25s local ... 2024-12-18T01:08:15.3618497Z 2024-12-18T01:08:15.3619338Z  2024-12-18T01:08:15.3620129Z  2024-12-18T01:08:15.3620536Z  2024-12-18T01:08:15.3620894Z  2024-12-18T01:08:15.3621285Z  2024-12-18T01:08:15.3621672Z  2024-12-18T01:08:15.3622059Z  2024-12-18T01:08:15.3622449Z  2024-12-18T01:08:15.3623355Z [20,341 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:15.3624552Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2024-12-18T01:08:15.3625318Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2024-12-18T01:08:15.3626534Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2024-12-18T01:08:15.3627427Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2024-12-18T01:08:15.3628296Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2024-12-18T01:08:15.3629193Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local 2024-12-18T01:08:15.3630060Z Compiling torch_xla/csrc/ops/ops.cpp; 25s local 2024-12-18T01:08:15.3630942Z Compiling torch_xla/csrc/ops/permute.cpp; 22s local ... 2024-12-18T01:08:15.6972522Z 2024-12-18T01:08:15.6973422Z  2024-12-18T01:08:15.6973919Z  2024-12-18T01:08:15.6974305Z  2024-12-18T01:08:15.6974683Z  2024-12-18T01:08:15.6975072Z  2024-12-18T01:08:15.6975515Z  2024-12-18T01:08:15.6975896Z  2024-12-18T01:08:15.6976298Z  2024-12-18T01:08:15.6977438Z [20,341 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:15.6978423Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2024-12-18T01:08:15.6979135Z Compiling torch_xla/csrc/ops/nms.cpp; 28s local 2024-12-18T01:08:15.6979833Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2024-12-18T01:08:15.6980417Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2024-12-18T01:08:15.6980974Z Compiling torch_xla/csrc/ops/nonzero.cpp; 26s local 2024-12-18T01:08:15.6981580Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local 2024-12-18T01:08:15.6982156Z Compiling torch_xla/csrc/ops/ops.cpp; 25s local 2024-12-18T01:08:15.6982727Z Compiling torch_xla/csrc/ops/permute.cpp; 23s local ... 2024-12-18T01:08:16.6981005Z 2024-12-18T01:08:16.6981843Z  2024-12-18T01:08:16.6982240Z  2024-12-18T01:08:16.6982573Z  2024-12-18T01:08:16.6982873Z  2024-12-18T01:08:16.6983158Z  2024-12-18T01:08:16.6983452Z  2024-12-18T01:08:16.6983759Z  2024-12-18T01:08:16.6984051Z  2024-12-18T01:08:16.6984810Z [20,341 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:16.6985549Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2024-12-18T01:08:16.6986111Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2024-12-18T01:08:16.6986836Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2024-12-18T01:08:16.6987921Z Compiling torch_xla/csrc/ops/normal.cpp; 27s local 2024-12-18T01:08:16.6988658Z Compiling torch_xla/csrc/ops/nonzero.cpp; 27s local 2024-12-18T01:08:16.6989453Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 26s local 2024-12-18T01:08:16.6990219Z Compiling torch_xla/csrc/ops/ops.cpp; 26s local 2024-12-18T01:08:16.6990951Z Compiling torch_xla/csrc/ops/permute.cpp; 24s local ... 2024-12-18T01:08:17.8989089Z 2024-12-18T01:08:17.8989985Z  2024-12-18T01:08:17.8990419Z  2024-12-18T01:08:17.8992078Z  2024-12-18T01:08:17.8992561Z  2024-12-18T01:08:17.8992965Z  2024-12-18T01:08:17.8993339Z  2024-12-18T01:08:17.8993725Z  2024-12-18T01:08:17.8994114Z  2024-12-18T01:08:17.8994987Z [20,341 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:17.8995926Z Compiling torch_xla/csrc/tensor_util.cpp; 106s local 2024-12-18T01:08:17.8996673Z Compiling torch_xla/csrc/ops/nms.cpp; 30s local 2024-12-18T01:08:17.8997407Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2024-12-18T01:08:17.8998336Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2024-12-18T01:08:17.8998992Z Compiling torch_xla/csrc/ops/nonzero.cpp; 28s local 2024-12-18T01:08:17.8999754Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2024-12-18T01:08:17.9000501Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2024-12-18T01:08:17.9001222Z Compiling torch_xla/csrc/ops/permute.cpp; 25s local ... 2024-12-18T01:08:18.8997443Z 2024-12-18T01:08:18.8998304Z  2024-12-18T01:08:18.8998708Z  2024-12-18T01:08:18.8999003Z  2024-12-18T01:08:18.8999328Z  2024-12-18T01:08:18.8999685Z  2024-12-18T01:08:18.9000023Z  2024-12-18T01:08:18.9000379Z  2024-12-18T01:08:18.9000723Z  2024-12-18T01:08:18.9001567Z [20,342 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:18.9002529Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2024-12-18T01:08:18.9003222Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local 2024-12-18T01:08:18.9003913Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2024-12-18T01:08:18.9004646Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2024-12-18T01:08:18.9005379Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T01:08:18.9006108Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T01:08:18.9006871Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local 2024-12-18T01:08:18.9007714Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 25s local ... 2024-12-18T01:08:19.0998386Z 2024-12-18T01:08:19.0999620Z  2024-12-18T01:08:19.1000108Z  2024-12-18T01:08:19.1000487Z  2024-12-18T01:08:19.1000877Z  2024-12-18T01:08:19.1001300Z  2024-12-18T01:08:19.1001886Z  2024-12-18T01:08:19.1002252Z  2024-12-18T01:08:19.1002671Z  2024-12-18T01:08:19.1003620Z [20,342 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:19.1004684Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2024-12-18T01:08:19.1005412Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local 2024-12-18T01:08:19.1006188Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2024-12-18T01:08:19.1006976Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2024-12-18T01:08:19.1007801Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T01:08:19.1008596Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T01:08:19.1009387Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local 2024-12-18T01:08:19.1010288Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local ... 2024-12-18T01:08:19.3166566Z 2024-12-18T01:08:19.3167818Z  2024-12-18T01:08:19.3168379Z  2024-12-18T01:08:19.3168841Z  2024-12-18T01:08:19.3169208Z  2024-12-18T01:08:19.3169917Z  2024-12-18T01:08:19.3170295Z  2024-12-18T01:08:19.3170701Z  2024-12-18T01:08:19.3171087Z  2024-12-18T01:08:19.3172035Z [20,343 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:19.3173206Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2024-12-18T01:08:19.3173987Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2024-12-18T01:08:19.3174977Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2024-12-18T01:08:19.3175782Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T01:08:19.3176681Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T01:08:19.3177418Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local 2024-12-18T01:08:19.3178284Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local 2024-12-18T01:08:19.3179139Z Compiling torch_xla/csrc/ops/put.cpp; 26s local ... 2024-12-18T01:08:19.7004862Z 2024-12-18T01:08:19.7006131Z  2024-12-18T01:08:19.7006556Z  2024-12-18T01:08:19.7006903Z  2024-12-18T01:08:19.7007255Z  2024-12-18T01:08:19.7007890Z  2024-12-18T01:08:19.7008254Z  2024-12-18T01:08:19.7008622Z  2024-12-18T01:08:19.7008986Z  2024-12-18T01:08:19.7009830Z [20,343 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:19.7010778Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2024-12-18T01:08:19.7011473Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2024-12-18T01:08:19.7012269Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2024-12-18T01:08:19.7012987Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T01:08:19.7013679Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T01:08:19.7014335Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local 2024-12-18T01:08:19.7015092Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local 2024-12-18T01:08:19.7015905Z Compiling torch_xla/csrc/ops/put.cpp; 26s local ... 2024-12-18T01:08:20.4292107Z 2024-12-18T01:08:20.4292926Z  2024-12-18T01:08:20.4293321Z  2024-12-18T01:08:20.4293708Z  2024-12-18T01:08:20.4294032Z  2024-12-18T01:08:20.4294379Z  2024-12-18T01:08:20.4294721Z  2024-12-18T01:08:20.4295056Z  2024-12-18T01:08:20.4295381Z  2024-12-18T01:08:20.4296182Z [20,344 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:20.4297201Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2024-12-18T01:08:20.4297863Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2024-12-18T01:08:20.4298566Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2024-12-18T01:08:20.4299314Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2024-12-18T01:08:20.4299987Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local 2024-12-18T01:08:20.4300785Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2024-12-18T01:08:20.4301541Z Compiling torch_xla/csrc/ops/put.cpp; 27s local 2024-12-18T01:08:20.4302158Z Compiling torch_xla/csrc/ops/qr.cpp; 26s local ... 2024-12-18T01:08:20.7011833Z 2024-12-18T01:08:20.7012700Z  2024-12-18T01:08:20.7013119Z  2024-12-18T01:08:20.7013491Z  2024-12-18T01:08:20.7013841Z  2024-12-18T01:08:20.7014221Z  2024-12-18T01:08:20.7014561Z  2024-12-18T01:08:20.7014928Z  2024-12-18T01:08:20.7015292Z  2024-12-18T01:08:20.7016134Z [20,344 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:20.7017157Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2024-12-18T01:08:20.7017846Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2024-12-18T01:08:20.7018622Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2024-12-18T01:08:20.7019303Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2024-12-18T01:08:20.7020266Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2024-12-18T01:08:20.7021038Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2024-12-18T01:08:20.7021805Z Compiling torch_xla/csrc/ops/put.cpp; 27s local 2024-12-18T01:08:20.7022518Z Compiling torch_xla/csrc/ops/qr.cpp; 26s local ... 2024-12-18T01:08:21.7018947Z 2024-12-18T01:08:21.7019902Z  2024-12-18T01:08:21.7020762Z  2024-12-18T01:08:21.7021074Z  2024-12-18T01:08:21.7021405Z  2024-12-18T01:08:21.7021725Z  2024-12-18T01:08:21.7022059Z  2024-12-18T01:08:21.7022376Z  2024-12-18T01:08:21.7022681Z  2024-12-18T01:08:21.7023446Z [20,344 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:21.7024249Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2024-12-18T01:08:21.7024878Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2024-12-18T01:08:21.7025535Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2024-12-18T01:08:21.7026144Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2024-12-18T01:08:21.7026902Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2024-12-18T01:08:21.7027611Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local 2024-12-18T01:08:21.7028284Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2024-12-18T01:08:21.7028888Z Compiling torch_xla/csrc/ops/qr.cpp; 27s local ... 2024-12-18T01:08:22.7029613Z 2024-12-18T01:08:22.7030564Z  2024-12-18T01:08:22.7031457Z  2024-12-18T01:08:22.7031827Z  2024-12-18T01:08:22.7032152Z  2024-12-18T01:08:22.7032471Z  2024-12-18T01:08:22.7032818Z  2024-12-18T01:08:22.7033153Z  2024-12-18T01:08:22.7033502Z  2024-12-18T01:08:22.7034335Z [20,344 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:22.7035275Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2024-12-18T01:08:22.7036002Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2024-12-18T01:08:22.7036829Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 32s local 2024-12-18T01:08:22.7037543Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2024-12-18T01:08:22.7038238Z Compiling torch_xla/csrc/ops/permute.cpp; 30s local 2024-12-18T01:08:22.7039047Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2024-12-18T01:08:22.7039823Z Compiling torch_xla/csrc/ops/put.cpp; 29s local 2024-12-18T01:08:22.7040552Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local ... 2024-12-18T01:08:23.7039415Z 2024-12-18T01:08:23.7040297Z  2024-12-18T01:08:23.7040735Z  2024-12-18T01:08:23.7041050Z  2024-12-18T01:08:23.7041348Z  2024-12-18T01:08:23.7041643Z  2024-12-18T01:08:23.7041948Z  2024-12-18T01:08:23.7042320Z  2024-12-18T01:08:23.7042693Z  2024-12-18T01:08:23.7043542Z [20,344 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:23.7044766Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2024-12-18T01:08:23.7045479Z Compiling torch_xla/csrc/ops/nonzero.cpp; 34s local 2024-12-18T01:08:23.7046263Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2024-12-18T01:08:23.7047010Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2024-12-18T01:08:23.7047720Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T01:08:23.7048708Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T01:08:23.7049549Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2024-12-18T01:08:23.7050274Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local ... 2024-12-18T01:08:23.9097720Z 2024-12-18T01:08:23.9098561Z  2024-12-18T01:08:23.9099025Z  2024-12-18T01:08:23.9099386Z  2024-12-18T01:08:23.9099779Z  2024-12-18T01:08:23.9100112Z  2024-12-18T01:08:23.9100482Z  2024-12-18T01:08:23.9101186Z  2024-12-18T01:08:23.9101556Z  2024-12-18T01:08:23.9102455Z [20,345 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:23.9103374Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2024-12-18T01:08:23.9104114Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T01:08:23.9104867Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2024-12-18T01:08:23.9105796Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T01:08:23.9106643Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T01:08:23.9107472Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2024-12-18T01:08:23.9108139Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local 2024-12-18T01:08:23.9108825Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local ... 2024-12-18T01:08:24.3048994Z 2024-12-18T01:08:24.3049862Z  2024-12-18T01:08:24.3050357Z  2024-12-18T01:08:24.3050758Z  2024-12-18T01:08:24.3051105Z  2024-12-18T01:08:24.3051446Z  2024-12-18T01:08:24.3051785Z  2024-12-18T01:08:24.3052431Z  2024-12-18T01:08:24.3052832Z  2024-12-18T01:08:24.3053761Z [20,345 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:24.3054717Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2024-12-18T01:08:24.3055509Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T01:08:24.3056911Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2024-12-18T01:08:24.3057844Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T01:08:24.3058934Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2024-12-18T01:08:24.3059914Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2024-12-18T01:08:24.3060768Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local 2024-12-18T01:08:24.3061642Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local ... 2024-12-18T01:08:24.7149115Z 2024-12-18T01:08:24.7149957Z  2024-12-18T01:08:24.7150408Z  2024-12-18T01:08:24.7152310Z  2024-12-18T01:08:24.7155563Z  2024-12-18T01:08:24.7158839Z  2024-12-18T01:08:24.7161839Z  2024-12-18T01:08:24.7164836Z  2024-12-18T01:08:24.7167781Z  2024-12-18T01:08:24.7171278Z [20,347 / 20,605] 6 / 17 tests; 46 actions running; last test: ..._client_test 2024-12-18T01:08:24.7174876Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2024-12-18T01:08:24.7178372Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T01:08:24.7179515Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2024-12-18T01:08:24.7180836Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2024-12-18T01:08:24.7181642Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local 2024-12-18T01:08:24.7182325Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2024-12-18T01:08:24.7183091Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 27s local 2024-12-18T01:08:24.7183958Z Compiling torch_xla/csrc/ops/randperm.cpp; 27s local ... 2024-12-18T01:08:25.1058792Z 2024-12-18T01:08:25.1060014Z  2024-12-18T01:08:25.1060498Z  2024-12-18T01:08:25.1060887Z  2024-12-18T01:08:25.1061252Z  2024-12-18T01:08:25.1061626Z  2024-12-18T01:08:25.1062022Z  2024-12-18T01:08:25.1062413Z  2024-12-18T01:08:25.1062824Z  2024-12-18T01:08:25.1063715Z [20,347 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:25.1064689Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2024-12-18T01:08:25.1065456Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T01:08:25.1066201Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2024-12-18T01:08:25.1067035Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2024-12-18T01:08:25.1067799Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T01:08:25.1068897Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2024-12-18T01:08:25.1069669Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 27s local 2024-12-18T01:08:25.1070485Z Compiling torch_xla/csrc/ops/randperm.cpp; 27s local ... 2024-12-18T01:08:25.7063468Z 2024-12-18T01:08:25.7064523Z  2024-12-18T01:08:25.7065234Z  2024-12-18T01:08:25.7066394Z  2024-12-18T01:08:25.7067172Z  2024-12-18T01:08:25.7067566Z  2024-12-18T01:08:25.7067922Z  2024-12-18T01:08:25.7068259Z  2024-12-18T01:08:25.7068797Z  2024-12-18T01:08:25.7069745Z [20,348 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:25.7070725Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2024-12-18T01:08:25.7071565Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T01:08:25.7072374Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2024-12-18T01:08:25.7073266Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2024-12-18T01:08:25.7074332Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2024-12-18T01:08:25.7075159Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 28s local 2024-12-18T01:08:25.7075984Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local 2024-12-18T01:08:25.7076798Z Compiling torch_xla/csrc/ops/recv.cpp; 28s local ... 2024-12-18T01:08:26.1069111Z 2024-12-18T01:08:26.1070321Z  2024-12-18T01:08:26.1070812Z  2024-12-18T01:08:26.1071185Z  2024-12-18T01:08:26.1071859Z  2024-12-18T01:08:26.1072241Z  2024-12-18T01:08:26.1072590Z  2024-12-18T01:08:26.1072978Z  2024-12-18T01:08:26.1073332Z  2024-12-18T01:08:26.1074254Z [20,348 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:26.1075174Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2024-12-18T01:08:26.1075963Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2024-12-18T01:08:26.1076777Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T01:08:26.1077565Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2024-12-18T01:08:26.1078421Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2024-12-18T01:08:26.1079181Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 28s local 2024-12-18T01:08:26.1079975Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local 2024-12-18T01:08:26.1080742Z Compiling torch_xla/csrc/ops/recv.cpp; 28s local ... 2024-12-18T01:08:27.1079711Z 2024-12-18T01:08:27.1081165Z  2024-12-18T01:08:27.1081605Z  2024-12-18T01:08:27.1081987Z  2024-12-18T01:08:27.1082376Z  2024-12-18T01:08:27.1082761Z  2024-12-18T01:08:27.1083146Z  2024-12-18T01:08:27.1083504Z  2024-12-18T01:08:27.1083882Z  2024-12-18T01:08:27.1084790Z [20,348 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:27.1085777Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2024-12-18T01:08:27.1086586Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T01:08:27.1087485Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2024-12-18T01:08:27.1088249Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 34s local 2024-12-18T01:08:27.1089028Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2024-12-18T01:08:27.1089768Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 29s local 2024-12-18T01:08:27.1090554Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local 2024-12-18T01:08:27.1091279Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local ... 2024-12-18T01:08:27.6935723Z 2024-12-18T01:08:27.6936859Z  2024-12-18T01:08:27.6937316Z  2024-12-18T01:08:27.6937690Z  2024-12-18T01:08:27.6938037Z  2024-12-18T01:08:27.6938414Z  2024-12-18T01:08:27.6938791Z  2024-12-18T01:08:27.6939135Z  2024-12-18T01:08:27.6939800Z  2024-12-18T01:08:27.6940665Z [20,349 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:27.6941629Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2024-12-18T01:08:27.6942389Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T01:08:27.6943145Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2024-12-18T01:08:27.6944057Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2024-12-18T01:08:27.6944944Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2024-12-18T01:08:27.6945803Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2024-12-18T01:08:27.6946479Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2024-12-18T01:08:27.6947220Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local ... 2024-12-18T01:08:27.9962826Z 2024-12-18T01:08:27.9964138Z  2024-12-18T01:08:27.9964646Z  2024-12-18T01:08:27.9965094Z  2024-12-18T01:08:27.9965498Z  2024-12-18T01:08:27.9965911Z  2024-12-18T01:08:27.9966288Z  2024-12-18T01:08:27.9966645Z  2024-12-18T01:08:27.9967021Z  2024-12-18T01:08:27.9968231Z [20,349 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:27.9969188Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2024-12-18T01:08:27.9969972Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 38s local 2024-12-18T01:08:27.9970739Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2024-12-18T01:08:27.9971600Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2024-12-18T01:08:27.9972364Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2024-12-18T01:08:27.9973217Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2024-12-18T01:08:27.9973941Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2024-12-18T01:08:27.9974893Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local ... 2024-12-18T01:08:28.3966527Z 2024-12-18T01:08:28.3967539Z  2024-12-18T01:08:28.3968083Z  2024-12-18T01:08:28.3968466Z  2024-12-18T01:08:28.3968816Z  2024-12-18T01:08:28.3969206Z  2024-12-18T01:08:28.3969585Z  2024-12-18T01:08:28.3969950Z  2024-12-18T01:08:28.3970319Z  2024-12-18T01:08:28.3971287Z [20,350 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:28.3972299Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2024-12-18T01:08:28.3973037Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2024-12-18T01:08:28.3973752Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2024-12-18T01:08:28.3974538Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2024-12-18T01:08:28.3975317Z Compiling torch_xla/csrc/ops/randperm.cpp; 31s local 2024-12-18T01:08:28.3976030Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2024-12-18T01:08:28.3976988Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2024-12-18T01:08:28.3977887Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local ... 2024-12-18T01:08:28.5969047Z 2024-12-18T01:08:28.5970039Z  2024-12-18T01:08:28.5970551Z  2024-12-18T01:08:28.5970960Z  2024-12-18T01:08:28.5971383Z  2024-12-18T01:08:28.5971794Z  2024-12-18T01:08:28.5972227Z  2024-12-18T01:08:28.5972519Z  2024-12-18T01:08:28.5972818Z  2024-12-18T01:08:28.5973576Z [20,350 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:28.5974375Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2024-12-18T01:08:28.5975021Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2024-12-18T01:08:28.5975666Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2024-12-18T01:08:28.5976399Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2024-12-18T01:08:28.5977323Z Compiling torch_xla/csrc/ops/randperm.cpp; 31s local 2024-12-18T01:08:28.5978046Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2024-12-18T01:08:28.5979214Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2024-12-18T01:08:28.5980090Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local ... 2024-12-18T01:08:28.8825475Z 2024-12-18T01:08:28.8826425Z  2024-12-18T01:08:28.8826940Z  2024-12-18T01:08:28.8827405Z  2024-12-18T01:08:28.8827781Z  2024-12-18T01:08:28.8828460Z  2024-12-18T01:08:28.8828850Z  2024-12-18T01:08:28.8829236Z  2024-12-18T01:08:28.8829622Z  2024-12-18T01:08:28.8830540Z [20,352 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:28.8831520Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2024-12-18T01:08:28.8832275Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2024-12-18T01:08:28.8833015Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2024-12-18T01:08:28.8833785Z Compiling torch_xla/csrc/ops/randperm.cpp; 31s local 2024-12-18T01:08:28.8834644Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2024-12-18T01:08:28.8835703Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2024-12-18T01:08:28.8836697Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2024-12-18T01:08:28.8837974Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 28s local ... 2024-12-18T01:08:29.1973059Z 2024-12-18T01:08:29.1973956Z  2024-12-18T01:08:29.1974426Z  2024-12-18T01:08:29.1974799Z  2024-12-18T01:08:29.1975215Z  2024-12-18T01:08:29.1975914Z  2024-12-18T01:08:29.1976352Z  2024-12-18T01:08:29.1976917Z  2024-12-18T01:08:29.1977357Z  2024-12-18T01:08:29.1978377Z [20,353 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:29.1979499Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2024-12-18T01:08:29.1980239Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2024-12-18T01:08:29.1980944Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2024-12-18T01:08:29.1981644Z Compiling torch_xla/csrc/ops/randperm.cpp; 31s local 2024-12-18T01:08:29.1982484Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2024-12-18T01:08:29.1983472Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2024-12-18T01:08:29.1984458Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 29s local 2024-12-18T01:08:29.1985369Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 28s local ... 2024-12-18T01:08:29.5978043Z 2024-12-18T01:08:29.5979287Z  2024-12-18T01:08:29.5979902Z  2024-12-18T01:08:29.5980301Z  2024-12-18T01:08:29.5980718Z  2024-12-18T01:08:29.5981106Z  2024-12-18T01:08:29.5981483Z  2024-12-18T01:08:29.5981870Z  2024-12-18T01:08:29.5982263Z  2024-12-18T01:08:29.5983192Z [20,353 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:29.5984193Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2024-12-18T01:08:29.5984928Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2024-12-18T01:08:29.5985652Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2024-12-18T01:08:29.5986381Z Compiling torch_xla/csrc/ops/randperm.cpp; 32s local 2024-12-18T01:08:29.5987178Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2024-12-18T01:08:29.5988135Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2024-12-18T01:08:29.5989129Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 29s local 2024-12-18T01:08:29.5990083Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 28s local ... 2024-12-18T01:08:29.7981660Z 2024-12-18T01:08:29.7982675Z  2024-12-18T01:08:29.7983205Z  2024-12-18T01:08:29.7983595Z  2024-12-18T01:08:29.7983936Z  2024-12-18T01:08:29.7984290Z  2024-12-18T01:08:29.7984635Z  2024-12-18T01:08:29.7985332Z  2024-12-18T01:08:29.7985684Z  2024-12-18T01:08:29.7986551Z [20,354 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:29.7987481Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2024-12-18T01:08:29.7988226Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T01:08:29.7988917Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:08:29.7989868Z Compiling torch_xla/csrc/ops/randperm.cpp; 32s local 2024-12-18T01:08:29.7990679Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2024-12-18T01:08:29.7991511Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 29s local 2024-12-18T01:08:29.7992437Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 28s local 2024-12-18T01:08:29.7993295Z Compiling torch_xla/csrc/ops/resize.cpp; 28s local ... 2024-12-18T01:08:30.1984275Z 2024-12-18T01:08:30.1985163Z  2024-12-18T01:08:30.1985566Z  2024-12-18T01:08:30.1985927Z  2024-12-18T01:08:30.1986256Z  2024-12-18T01:08:30.1986561Z  2024-12-18T01:08:30.1986884Z  2024-12-18T01:08:30.1987447Z  2024-12-18T01:08:30.1987782Z  2024-12-18T01:08:30.1988563Z [20,354 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:30.1989336Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2024-12-18T01:08:30.1989952Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T01:08:30.1990527Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:08:30.1991290Z Compiling torch_xla/csrc/ops/randperm.cpp; 32s local 2024-12-18T01:08:30.1991947Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 32s local 2024-12-18T01:08:30.1992769Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2024-12-18T01:08:30.1993496Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2024-12-18T01:08:30.1994191Z Compiling torch_xla/csrc/ops/resize.cpp; 28s local ... 2024-12-18T01:08:30.4113008Z 2024-12-18T01:08:30.4113995Z  2024-12-18T01:08:30.4114610Z  2024-12-18T01:08:30.4115017Z  2024-12-18T01:08:30.4115366Z  2024-12-18T01:08:30.4115737Z  2024-12-18T01:08:30.4116102Z  2024-12-18T01:08:30.4116657Z  2024-12-18T01:08:30.4117035Z  2024-12-18T01:08:30.4117947Z [20,355 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:30.4118921Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2024-12-18T01:08:30.4119608Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T01:08:30.4120312Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:08:30.4121032Z Compiling torch_xla/csrc/ops/randperm.cpp; 33s local 2024-12-18T01:08:30.4121804Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2024-12-18T01:08:30.4134139Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2024-12-18T01:08:30.4134849Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2024-12-18T01:08:30.4135421Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local ... 2024-12-18T01:08:30.6139749Z 2024-12-18T01:08:30.6140644Z  2024-12-18T01:08:30.6141116Z  2024-12-18T01:08:30.6141474Z  2024-12-18T01:08:30.6141850Z  2024-12-18T01:08:30.6142246Z  2024-12-18T01:08:30.6142632Z  2024-12-18T01:08:30.6143017Z  2024-12-18T01:08:30.6143407Z  2024-12-18T01:08:30.6144632Z [20,356 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:30.6145583Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2024-12-18T01:08:30.6146277Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T01:08:30.6146973Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:08:30.6147754Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2024-12-18T01:08:30.6148817Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2024-12-18T01:08:30.6150019Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2024-12-18T01:08:30.6150795Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2024-12-18T01:08:30.6151666Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local ... 2024-12-18T01:08:30.9989169Z 2024-12-18T01:08:30.9990427Z  2024-12-18T01:08:30.9990903Z  2024-12-18T01:08:30.9991672Z  2024-12-18T01:08:30.9992142Z  2024-12-18T01:08:30.9992493Z  2024-12-18T01:08:30.9992831Z  2024-12-18T01:08:30.9993192Z  2024-12-18T01:08:30.9993563Z  2024-12-18T01:08:30.9994462Z [20,356 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:30.9995578Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2024-12-18T01:08:30.9996326Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2024-12-18T01:08:30.9997059Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2024-12-18T01:08:30.9997840Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2024-12-18T01:08:30.9999051Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2024-12-18T01:08:30.9999881Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2024-12-18T01:08:31.0000547Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2024-12-18T01:08:31.0001331Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local ... 2024-12-18T01:08:31.5829086Z 2024-12-18T01:08:31.5829845Z  2024-12-18T01:08:31.5830328Z  2024-12-18T01:08:31.5830999Z  2024-12-18T01:08:31.5831391Z  2024-12-18T01:08:31.5831740Z  2024-12-18T01:08:31.5832218Z  2024-12-18T01:08:31.5832587Z  2024-12-18T01:08:31.5832892Z  2024-12-18T01:08:31.5833674Z [20,357 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:31.5834441Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2024-12-18T01:08:31.5835019Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2024-12-18T01:08:31.5835576Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2024-12-18T01:08:31.5836232Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2024-12-18T01:08:31.5836894Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2024-12-18T01:08:31.5837449Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2024-12-18T01:08:31.5838059Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2024-12-18T01:08:31.5838817Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local ... 2024-12-18T01:08:31.7997031Z 2024-12-18T01:08:31.7997937Z  2024-12-18T01:08:31.7998413Z  2024-12-18T01:08:31.7998764Z  2024-12-18T01:08:31.7999153Z  2024-12-18T01:08:31.7999547Z  2024-12-18T01:08:31.7999912Z  2024-12-18T01:08:31.8000289Z  2024-12-18T01:08:31.8000685Z  2024-12-18T01:08:31.8001583Z [20,357 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:31.8002612Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2024-12-18T01:08:31.8003360Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2024-12-18T01:08:31.8004093Z Compiling torch_xla/csrc/ops/prod.cpp; 37s local 2024-12-18T01:08:31.8004976Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2024-12-18T01:08:31.8005885Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2024-12-18T01:08:31.8006618Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2024-12-18T01:08:31.8007421Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2024-12-18T01:08:31.8008464Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local ... 2024-12-18T01:08:31.9998312Z 2024-12-18T01:08:31.9999190Z  2024-12-18T01:08:31.9999633Z  2024-12-18T01:08:31.9999972Z  2024-12-18T01:08:32.0000262Z  2024-12-18T01:08:32.0000581Z  2024-12-18T01:08:32.0001302Z  2024-12-18T01:08:32.0001860Z  2024-12-18T01:08:32.0002197Z  2024-12-18T01:08:32.0003086Z [20,359 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:32.0004068Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2024-12-18T01:08:32.0004788Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2024-12-18T01:08:32.0005758Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2024-12-18T01:08:32.0006470Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2024-12-18T01:08:32.0007238Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2024-12-18T01:08:32.0008193Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2024-12-18T01:08:32.0009085Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2024-12-18T01:08:32.0009819Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local ... 2024-12-18T01:08:32.4002525Z 2024-12-18T01:08:32.4003399Z  2024-12-18T01:08:32.4005281Z  2024-12-18T01:08:32.4006324Z  2024-12-18T01:08:32.4007590Z  2024-12-18T01:08:32.4008896Z  2024-12-18T01:08:32.4010631Z  2024-12-18T01:08:32.4011575Z  2024-12-18T01:08:32.4012897Z  2024-12-18T01:08:32.4014579Z [20,359 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:32.4015496Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2024-12-18T01:08:32.4016858Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2024-12-18T01:08:32.4018248Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2024-12-18T01:08:32.4019210Z Compiling torch_xla/csrc/ops/roll.cpp; 31s local 2024-12-18T01:08:32.4020429Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 31s local 2024-12-18T01:08:32.4021718Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2024-12-18T01:08:32.4022828Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2024-12-18T01:08:32.4023942Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local ... 2024-12-18T01:08:32.7908288Z 2024-12-18T01:08:32.7909197Z  2024-12-18T01:08:32.7909703Z  2024-12-18T01:08:32.7910091Z  2024-12-18T01:08:32.7910475Z  2024-12-18T01:08:32.7910864Z  2024-12-18T01:08:32.7911245Z  2024-12-18T01:08:32.7911615Z  2024-12-18T01:08:32.7911996Z  2024-12-18T01:08:32.7912894Z [20,361 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:32.7913906Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2024-12-18T01:08:32.7914645Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T01:08:32.7915364Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2024-12-18T01:08:32.7916128Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2024-12-18T01:08:32.7917017Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2024-12-18T01:08:32.7917799Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2024-12-18T01:08:32.7918548Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2024-12-18T01:08:32.7919417Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 26s local ... 2024-12-18T01:08:33.0009240Z 2024-12-18T01:08:33.0010163Z  2024-12-18T01:08:33.0010643Z  2024-12-18T01:08:33.0011005Z  2024-12-18T01:08:33.0011328Z  2024-12-18T01:08:33.0011745Z  2024-12-18T01:08:33.0012145Z  2024-12-18T01:08:33.0012531Z  2024-12-18T01:08:33.0012900Z  2024-12-18T01:08:33.0013846Z [20,362 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:33.0014820Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2024-12-18T01:08:33.0015566Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T01:08:33.0016620Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 31s local 2024-12-18T01:08:33.0017540Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2024-12-18T01:08:33.0018618Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2024-12-18T01:08:33.0019458Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2024-12-18T01:08:33.0020333Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2024-12-18T01:08:33.0021183Z Compiling torch_xla/csrc/ops/select.cpp; 27s local ... 2024-12-18T01:08:33.2429649Z 2024-12-18T01:08:33.2431159Z  2024-12-18T01:08:33.2431989Z  2024-12-18T01:08:33.2432402Z  2024-12-18T01:08:33.2432808Z  2024-12-18T01:08:33.2433194Z  2024-12-18T01:08:33.2433581Z  2024-12-18T01:08:33.2433912Z  2024-12-18T01:08:33.2434302Z  2024-12-18T01:08:33.2435197Z [20,363 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:33.2436008Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2024-12-18T01:08:33.2436702Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T01:08:33.2437408Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2024-12-18T01:08:33.2438151Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2024-12-18T01:08:33.2439120Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2024-12-18T01:08:33.2439959Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2024-12-18T01:08:33.2440778Z Compiling torch_xla/csrc/ops/select.cpp; 27s local 2024-12-18T01:08:33.2441531Z Compiling torch_xla/csrc/ops/send.cpp; 26s local ... 2024-12-18T01:08:33.6013892Z 2024-12-18T01:08:33.6014855Z  2024-12-18T01:08:33.6015306Z  2024-12-18T01:08:33.6015950Z  2024-12-18T01:08:33.6016303Z  2024-12-18T01:08:33.6016834Z  2024-12-18T01:08:33.6017209Z  2024-12-18T01:08:33.6017542Z  2024-12-18T01:08:33.6017882Z  2024-12-18T01:08:33.6018718Z [20,363 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:33.6019609Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2024-12-18T01:08:33.6020329Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T01:08:33.6021050Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2024-12-18T01:08:33.6021757Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2024-12-18T01:08:33.6022499Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2024-12-18T01:08:33.6023259Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2024-12-18T01:08:33.6024019Z Compiling torch_xla/csrc/ops/select.cpp; 27s local 2024-12-18T01:08:33.6024694Z Compiling torch_xla/csrc/ops/send.cpp; 26s local ... 2024-12-18T01:08:34.6022276Z 2024-12-18T01:08:34.6023606Z  2024-12-18T01:08:34.6024094Z  2024-12-18T01:08:34.6025635Z  2024-12-18T01:08:34.6026771Z  2024-12-18T01:08:34.6028002Z  2024-12-18T01:08:34.6029350Z  2024-12-18T01:08:34.6030715Z  2024-12-18T01:08:34.6032007Z  2024-12-18T01:08:34.6033905Z [20,363 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:34.6034895Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2024-12-18T01:08:34.6035532Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2024-12-18T01:08:34.6036170Z Compiling torch_xla/csrc/ops/scalar.cpp; 32s local 2024-12-18T01:08:34.6036788Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2024-12-18T01:08:34.6037523Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2024-12-18T01:08:34.6038311Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 28s local 2024-12-18T01:08:34.6039035Z Compiling torch_xla/csrc/ops/select.cpp; 28s local 2024-12-18T01:08:34.6039678Z Compiling torch_xla/csrc/ops/send.cpp; 27s local ... 2024-12-18T01:08:35.0025363Z 2024-12-18T01:08:35.0026363Z  2024-12-18T01:08:35.0026846Z  2024-12-18T01:08:35.0030127Z  2024-12-18T01:08:35.0030609Z  2024-12-18T01:08:35.0030999Z  2024-12-18T01:08:35.0031357Z  2024-12-18T01:08:35.0032011Z  2024-12-18T01:08:35.0032393Z  2024-12-18T01:08:35.0033473Z [20,364 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:35.0034397Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2024-12-18T01:08:35.0035072Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2024-12-18T01:08:35.0035830Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2024-12-18T01:08:35.0036818Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 31s local 2024-12-18T01:08:35.0037711Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T01:08:35.0038520Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T01:08:35.0039280Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T01:08:35.0040165Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local ... 2024-12-18T01:08:35.2028472Z 2024-12-18T01:08:35.2029354Z  2024-12-18T01:08:35.2029790Z  2024-12-18T01:08:35.2030179Z  2024-12-18T01:08:35.2030566Z  2024-12-18T01:08:35.2030949Z  2024-12-18T01:08:35.2031309Z  2024-12-18T01:08:35.2031941Z  2024-12-18T01:08:35.2032325Z  2024-12-18T01:08:35.2033270Z [20,365 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:35.2034233Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2024-12-18T01:08:35.2034919Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2024-12-18T01:08:35.2035645Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 31s local 2024-12-18T01:08:35.2036581Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T01:08:35.2037429Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T01:08:35.2038137Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T01:08:35.2038952Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local 2024-12-18T01:08:35.2039907Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local ... 2024-12-18T01:08:35.5706565Z 2024-12-18T01:08:35.5707578Z  2024-12-18T01:08:35.5708079Z  2024-12-18T01:08:35.5708514Z  2024-12-18T01:08:35.5708925Z  2024-12-18T01:08:35.5709332Z  2024-12-18T01:08:35.5709731Z  2024-12-18T01:08:35.5710126Z  2024-12-18T01:08:35.5710526Z  2024-12-18T01:08:35.5711496Z [20,368 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:35.5712585Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T01:08:35.5713414Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T01:08:35.5714188Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T01:08:35.5715051Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local 2024-12-18T01:08:35.5716026Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local 2024-12-18T01:08:35.5716888Z Compiling torch_xla/csrc/ops/softmax.cpp; 27s local 2024-12-18T01:08:35.5717695Z Compiling torch_xla/csrc/ops/squeeze.cpp; 27s local 2024-12-18T01:08:35.5718519Z Compiling torch_xla/csrc/ops/split.cpp; 26s local ... 2024-12-18T01:08:35.8033497Z 2024-12-18T01:08:35.8034465Z  2024-12-18T01:08:35.8034927Z  2024-12-18T01:08:35.8035321Z  2024-12-18T01:08:35.8035715Z  2024-12-18T01:08:35.8036129Z  2024-12-18T01:08:35.8036516Z  2024-12-18T01:08:35.8036963Z  2024-12-18T01:08:35.8037368Z  2024-12-18T01:08:35.8038325Z [20,368 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:35.8039355Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T01:08:35.8040211Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T01:08:35.8040958Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T01:08:35.8041830Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2024-12-18T01:08:35.8042766Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2024-12-18T01:08:35.8043987Z Compiling torch_xla/csrc/ops/softmax.cpp; 27s local 2024-12-18T01:08:35.8045060Z Compiling torch_xla/csrc/ops/squeeze.cpp; 27s local 2024-12-18T01:08:35.8045898Z Compiling torch_xla/csrc/ops/split.cpp; 26s local ... 2024-12-18T01:08:36.8040561Z 2024-12-18T01:08:36.8041559Z  2024-12-18T01:08:36.8042002Z  2024-12-18T01:08:36.8042705Z  2024-12-18T01:08:36.8043083Z  2024-12-18T01:08:36.8043590Z  2024-12-18T01:08:36.8043974Z  2024-12-18T01:08:36.8044610Z  2024-12-18T01:08:36.8045099Z  2024-12-18T01:08:36.8046052Z [20,368 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:36.8047255Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2024-12-18T01:08:36.8048116Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2024-12-18T01:08:36.8048848Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2024-12-18T01:08:36.8049668Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 29s local 2024-12-18T01:08:36.8050796Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2024-12-18T01:08:36.8051648Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2024-12-18T01:08:36.8052415Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2024-12-18T01:08:36.8053219Z Compiling torch_xla/csrc/ops/split.cpp; 27s local ... 2024-12-18T01:08:37.3482444Z 2024-12-18T01:08:37.3483444Z  2024-12-18T01:08:37.3483890Z  2024-12-18T01:08:37.3484542Z  2024-12-18T01:08:37.3484969Z  2024-12-18T01:08:37.3485325Z  2024-12-18T01:08:37.3485664Z  2024-12-18T01:08:37.3485990Z  2024-12-18T01:08:37.3486357Z  2024-12-18T01:08:37.3487241Z [20,369 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:37.3488099Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2024-12-18T01:08:37.3488775Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2024-12-18T01:08:37.3489545Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 29s local 2024-12-18T01:08:37.3490472Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2024-12-18T01:08:37.3491254Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2024-12-18T01:08:37.3492025Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2024-12-18T01:08:37.3492796Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2024-12-18T01:08:37.3493614Z Compiling torch_xla/csrc/aten_xla_type.cpp; 28s local ... 2024-12-18T01:08:37.6047492Z 2024-12-18T01:08:37.6048381Z  2024-12-18T01:08:37.6048848Z  2024-12-18T01:08:37.6049209Z  2024-12-18T01:08:37.6049585Z  2024-12-18T01:08:37.6050000Z  2024-12-18T01:08:37.6050400Z  2024-12-18T01:08:37.6050758Z  2024-12-18T01:08:37.6051111Z  2024-12-18T01:08:37.6051991Z [20,369 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:37.6053009Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2024-12-18T01:08:37.6053779Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2024-12-18T01:08:37.6054615Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2024-12-18T01:08:37.6055459Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2024-12-18T01:08:37.6056313Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2024-12-18T01:08:37.6057235Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local 2024-12-18T01:08:37.6057985Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2024-12-18T01:08:37.6058786Z Compiling torch_xla/csrc/aten_xla_type.cpp; 28s local ... 2024-12-18T01:08:37.8049870Z 2024-12-18T01:08:37.8050777Z  2024-12-18T01:08:37.8051239Z  2024-12-18T01:08:37.8051630Z  2024-12-18T01:08:37.8052022Z  2024-12-18T01:08:37.8052422Z  2024-12-18T01:08:37.8052798Z  2024-12-18T01:08:37.8053499Z  2024-12-18T01:08:37.8053873Z  2024-12-18T01:08:37.8054835Z [20,370 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:37.8055831Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2024-12-18T01:08:37.8056900Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2024-12-18T01:08:37.8057801Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2024-12-18T01:08:37.8058728Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2024-12-18T01:08:37.8059465Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local 2024-12-18T01:08:37.8060365Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2024-12-18T01:08:37.8061179Z Compiling torch_xla/csrc/aten_xla_type.cpp; 28s local 2024-12-18T01:08:37.8061931Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local ... 2024-12-18T01:08:38.3509136Z 2024-12-18T01:08:38.3510021Z  2024-12-18T01:08:38.3510506Z  2024-12-18T01:08:38.3510922Z  2024-12-18T01:08:38.3511413Z  2024-12-18T01:08:38.3511753Z  2024-12-18T01:08:38.3512143Z  2024-12-18T01:08:38.3512779Z  2024-12-18T01:08:38.3513194Z  2024-12-18T01:08:38.3514074Z [20,371 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:38.3515088Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2024-12-18T01:08:38.3515976Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2024-12-18T01:08:38.3516964Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2024-12-18T01:08:38.3517712Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local 2024-12-18T01:08:38.3518388Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2024-12-18T01:08:38.3519137Z Compiling torch_xla/csrc/aten_xla_type.cpp; 29s local 2024-12-18T01:08:38.3519834Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local 2024-12-18T01:08:38.3520535Z Compiling torch_xla/csrc/ops/std.cpp; 28s local ... 2024-12-18T01:08:38.6055702Z 2024-12-18T01:08:38.6056727Z  2024-12-18T01:08:38.6057225Z  2024-12-18T01:08:38.6057685Z  2024-12-18T01:08:38.6058072Z  2024-12-18T01:08:38.6058477Z  2024-12-18T01:08:38.6058866Z  2024-12-18T01:08:38.6059250Z  2024-12-18T01:08:38.6059648Z  2024-12-18T01:08:38.6060569Z [20,371 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:38.6061673Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 31s local 2024-12-18T01:08:38.6062614Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2024-12-18T01:08:38.6063412Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2024-12-18T01:08:38.6064155Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2024-12-18T01:08:38.6064902Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2024-12-18T01:08:38.6065670Z Compiling torch_xla/csrc/aten_xla_type.cpp; 29s local 2024-12-18T01:08:38.6066437Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2024-12-18T01:08:38.6067185Z Compiling torch_xla/csrc/ops/std.cpp; 29s local ... 2024-12-18T01:08:39.0059571Z 2024-12-18T01:08:39.0060749Z  2024-12-18T01:08:39.0061173Z  2024-12-18T01:08:39.0061535Z  2024-12-18T01:08:39.0061884Z  2024-12-18T01:08:39.0062216Z  2024-12-18T01:08:39.0062550Z  2024-12-18T01:08:39.0062940Z  2024-12-18T01:08:39.0063286Z  2024-12-18T01:08:39.0064130Z [20,372 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:08:39.0065063Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 31s local 2024-12-18T01:08:39.0065775Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2024-12-18T01:08:39.0066456Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2024-12-18T01:08:39.0067149Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2024-12-18T01:08:39.0067849Z Compiling torch_xla/csrc/aten_xla_type.cpp; 29s local 2024-12-18T01:08:39.0068821Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2024-12-18T01:08:39.0069506Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2024-12-18T01:08:39.0070186Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local ... 2024-12-18T01:08:39.4063628Z 2024-12-18T01:08:39.4064845Z  2024-12-18T01:08:39.4065290Z  2024-12-18T01:08:39.4065644Z  2024-12-18T01:08:39.4066325Z  2024-12-18T01:08:39.4066735Z  2024-12-18T01:08:39.4067094Z  2024-12-18T01:08:39.4067478Z  2024-12-18T01:08:39.4067870Z  2024-12-18T01:08:39.4068798Z [20,373 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:39.4069797Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2024-12-18T01:08:39.4070539Z Compiling torch_xla/csrc/ops/squeeze.cpp; 31s local 2024-12-18T01:08:39.4071291Z Compiling torch_xla/csrc/ops/split.cpp; 30s local 2024-12-18T01:08:39.4072071Z Compiling torch_xla/csrc/aten_xla_type.cpp; 30s local 2024-12-18T01:08:39.4072791Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2024-12-18T01:08:39.4073720Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2024-12-18T01:08:39.4074368Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2024-12-18T01:08:39.4075072Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local ... 2024-12-18T01:08:40.1257030Z 2024-12-18T01:08:40.1258374Z  2024-12-18T01:08:40.1259166Z  2024-12-18T01:08:40.1260203Z  2024-12-18T01:08:40.1260632Z  2024-12-18T01:08:40.1261324Z  2024-12-18T01:08:40.1261733Z  2024-12-18T01:08:40.1262111Z  2024-12-18T01:08:40.1262581Z  2024-12-18T01:08:40.1263504Z [20,374 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:40.1264517Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2024-12-18T01:08:40.1265288Z Compiling torch_xla/csrc/ops/split.cpp; 30s local 2024-12-18T01:08:40.1266275Z Compiling torch_xla/csrc/aten_xla_type.cpp; 30s local 2024-12-18T01:08:40.1267092Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2024-12-18T01:08:40.1267833Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2024-12-18T01:08:40.1268588Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2024-12-18T01:08:40.1269356Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2024-12-18T01:08:40.1270151Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local ... 2024-12-18T01:08:40.4070184Z 2024-12-18T01:08:40.4071425Z  2024-12-18T01:08:40.4071945Z  2024-12-18T01:08:40.4072342Z  2024-12-18T01:08:40.4072885Z  2024-12-18T01:08:40.4073251Z  2024-12-18T01:08:40.4073622Z  2024-12-18T01:08:40.4073987Z  2024-12-18T01:08:40.4074357Z  2024-12-18T01:08:40.4075262Z [20,374 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:40.4076139Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2024-12-18T01:08:40.4076901Z Compiling torch_xla/csrc/ops/split.cpp; 31s local 2024-12-18T01:08:40.4077678Z Compiling torch_xla/csrc/aten_xla_type.cpp; 31s local 2024-12-18T01:08:40.4078419Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2024-12-18T01:08:40.4079150Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2024-12-18T01:08:40.4079896Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2024-12-18T01:08:40.4080714Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2024-12-18T01:08:40.4081491Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local ... 2024-12-18T01:08:41.0772238Z 2024-12-18T01:08:41.0773207Z  2024-12-18T01:08:41.0773599Z  2024-12-18T01:08:41.0773911Z  2024-12-18T01:08:41.0774272Z  2024-12-18T01:08:41.0774583Z  2024-12-18T01:08:41.0774892Z  2024-12-18T01:08:41.0775187Z  2024-12-18T01:08:41.0775502Z  2024-12-18T01:08:41.0776281Z [20,375 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:41.0777751Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2024-12-18T01:08:41.0778665Z Compiling torch_xla/csrc/aten_xla_type.cpp; 31s local 2024-12-18T01:08:41.0779365Z Compiling torch_xla/csrc/ops/stack.cpp; 31s local 2024-12-18T01:08:41.0780053Z Compiling torch_xla/csrc/ops/std.cpp; 31s local 2024-12-18T01:08:41.0780923Z Compiling torch_xla/csrc/ops/std_mean.cpp; 31s local 2024-12-18T01:08:41.0781593Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2024-12-18T01:08:41.0782301Z Compiling torch_xla/csrc/ops/symeig.cpp; 30s local 2024-12-18T01:08:41.0783109Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local ... 2024-12-18T01:08:41.2813544Z 2024-12-18T01:08:41.2814722Z  2024-12-18T01:08:41.2815114Z  2024-12-18T01:08:41.2815434Z  2024-12-18T01:08:41.2815747Z  2024-12-18T01:08:41.2816042Z  2024-12-18T01:08:41.2816349Z  2024-12-18T01:08:41.2816843Z  2024-12-18T01:08:41.2817154Z  2024-12-18T01:08:41.2818285Z [20,377 / 20,605] 6 / 17 tests; 48 actions, 46 running; last test: ...ent_test 2024-12-18T01:08:41.2819085Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2024-12-18T01:08:41.2819728Z Compiling torch_xla/csrc/aten_xla_type.cpp; 31s local 2024-12-18T01:08:41.2820362Z Compiling torch_xla/csrc/ops/std_mean.cpp; 31s local 2024-12-18T01:08:41.2820987Z Compiling torch_xla/csrc/ops/svd.cpp; 31s local 2024-12-18T01:08:41.2821712Z Compiling torch_xla/csrc/ops/symeig.cpp; 30s local 2024-12-18T01:08:41.2822334Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2024-12-18T01:08:41.2822955Z Compiling torch_xla/csrc/ops/topk.cpp; 29s local 2024-12-18T01:08:41.2823649Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 29s local ... 2024-12-18T01:08:41.6078904Z 2024-12-18T01:08:41.6079745Z  2024-12-18T01:08:41.6080208Z  2024-12-18T01:08:41.6080607Z  2024-12-18T01:08:41.6080990Z  2024-12-18T01:08:41.6081375Z  2024-12-18T01:08:41.6081742Z  2024-12-18T01:08:41.6082152Z  2024-12-18T01:08:41.6082500Z  2024-12-18T01:08:41.6083436Z [20,377 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:41.6084482Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2024-12-18T01:08:41.6085299Z Compiling torch_xla/csrc/aten_xla_type.cpp; 32s local 2024-12-18T01:08:41.6086106Z Compiling torch_xla/csrc/ops/std_mean.cpp; 31s local 2024-12-18T01:08:41.6086869Z Compiling torch_xla/csrc/ops/svd.cpp; 31s local 2024-12-18T01:08:41.6087640Z Compiling torch_xla/csrc/ops/symeig.cpp; 31s local 2024-12-18T01:08:41.6088433Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2024-12-18T01:08:41.6089228Z Compiling torch_xla/csrc/ops/topk.cpp; 29s local 2024-12-18T01:08:41.6090096Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 29s local ... 2024-12-18T01:08:41.8309697Z 2024-12-18T01:08:41.8311232Z  2024-12-18T01:08:41.8311952Z  2024-12-18T01:08:41.8313092Z  2024-12-18T01:08:41.8313600Z  2024-12-18T01:08:41.8313967Z  2024-12-18T01:08:41.8314343Z  2024-12-18T01:08:41.8314810Z  2024-12-18T01:08:41.8315215Z  2024-12-18T01:08:41.8316129Z [20,378 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:41.8317143Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2024-12-18T01:08:41.8317923Z Compiling torch_xla/csrc/aten_xla_type.cpp; 32s local 2024-12-18T01:08:41.8318654Z Compiling torch_xla/csrc/ops/svd.cpp; 31s local 2024-12-18T01:08:41.8319741Z Compiling torch_xla/csrc/ops/symeig.cpp; 31s local 2024-12-18T01:08:41.8320707Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2024-12-18T01:08:41.8321628Z Compiling torch_xla/csrc/ops/topk.cpp; 29s local 2024-12-18T01:08:41.8322653Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 29s local 2024-12-18T01:08:41.8323864Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local ... 2024-12-18T01:08:42.2056869Z 2024-12-18T01:08:42.2058125Z  2024-12-18T01:08:42.2058625Z  2024-12-18T01:08:42.2059042Z  2024-12-18T01:08:42.2059440Z  2024-12-18T01:08:42.2059848Z  2024-12-18T01:08:42.2060262Z  2024-12-18T01:08:42.2060685Z  2024-12-18T01:08:42.2061400Z  2024-12-18T01:08:42.2062513Z [20,380 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:42.2063482Z Compiling torch_xla/csrc/ops/softmax.cpp; 34s local 2024-12-18T01:08:42.2064280Z Compiling torch_xla/csrc/aten_xla_type.cpp; 32s local 2024-12-18T01:08:42.2065120Z Compiling torch_xla/csrc/ops/threshold.cpp; 31s local 2024-12-18T01:08:42.2065877Z Compiling torch_xla/csrc/ops/topk.cpp; 30s local 2024-12-18T01:08:42.2066707Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local 2024-12-18T01:08:42.2067636Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T01:08:42.2068622Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 28s local 2024-12-18T01:08:42.2069631Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 27s local ... 2024-12-18T01:08:42.4084894Z 2024-12-18T01:08:42.4086060Z  2024-12-18T01:08:42.4086526Z  2024-12-18T01:08:42.4086909Z  2024-12-18T01:08:42.4087351Z  2024-12-18T01:08:42.4087749Z  2024-12-18T01:08:42.4088143Z  2024-12-18T01:08:42.4088554Z  2024-12-18T01:08:42.4089227Z  2024-12-18T01:08:42.4090189Z [20,380 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:42.4091190Z Compiling torch_xla/csrc/ops/softmax.cpp; 34s local 2024-12-18T01:08:42.4092002Z Compiling torch_xla/csrc/aten_xla_type.cpp; 33s local 2024-12-18T01:08:42.4092799Z Compiling torch_xla/csrc/ops/threshold.cpp; 31s local 2024-12-18T01:08:42.4093993Z Compiling torch_xla/csrc/ops/topk.cpp; 30s local 2024-12-18T01:08:42.4094998Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local 2024-12-18T01:08:42.4095944Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T01:08:42.4096985Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 28s local 2024-12-18T01:08:42.4098027Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 27s local ... 2024-12-18T01:08:42.8709790Z 2024-12-18T01:08:42.8710907Z  2024-12-18T01:08:42.8711379Z  2024-12-18T01:08:42.8711756Z  2024-12-18T01:08:42.8712148Z  2024-12-18T01:08:42.8712521Z  2024-12-18T01:08:42.8712876Z  2024-12-18T01:08:42.8713264Z  2024-12-18T01:08:42.8713632Z  2024-12-18T01:08:42.8714430Z [20,381 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:42.8715798Z Compiling torch_xla/csrc/ops/softmax.cpp; 34s local 2024-12-18T01:08:42.8716561Z Compiling torch_xla/csrc/aten_xla_type.cpp; 33s local 2024-12-18T01:08:42.8717553Z Compiling torch_xla/csrc/ops/topk.cpp; 30s local 2024-12-18T01:08:42.8718483Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local 2024-12-18T01:08:42.8719427Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T01:08:42.8720367Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local 2024-12-18T01:08:42.8721402Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 28s local 2024-12-18T01:08:42.8722423Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local ... 2024-12-18T01:08:43.2091654Z 2024-12-18T01:08:43.2092630Z  2024-12-18T01:08:43.2093027Z  2024-12-18T01:08:43.2093660Z  2024-12-18T01:08:43.2094029Z  2024-12-18T01:08:43.2094595Z  2024-12-18T01:08:43.2095120Z  2024-12-18T01:08:43.2095639Z  2024-12-18T01:08:43.2096156Z  2024-12-18T01:08:43.2097220Z [20,381 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:43.2098777Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2024-12-18T01:08:43.2099733Z Compiling torch_xla/csrc/aten_xla_type.cpp; 33s local 2024-12-18T01:08:43.2100627Z Compiling torch_xla/csrc/ops/topk.cpp; 31s local 2024-12-18T01:08:43.2101620Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 31s local 2024-12-18T01:08:43.2102563Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T01:08:43.2106265Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local 2024-12-18T01:08:43.2107330Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 28s local 2024-12-18T01:08:43.2108131Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local ... 2024-12-18T01:08:43.4366292Z 2024-12-18T01:08:43.4368382Z  2024-12-18T01:08:43.4368818Z  2024-12-18T01:08:43.4370547Z  2024-12-18T01:08:43.4370895Z  2024-12-18T01:08:43.4371263Z  2024-12-18T01:08:43.4371595Z  2024-12-18T01:08:43.4371938Z  2024-12-18T01:08:43.4372337Z  2024-12-18T01:08:43.4373453Z [20,382 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:43.4374350Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2024-12-18T01:08:43.4375288Z Compiling torch_xla/csrc/aten_xla_type.cpp; 34s local 2024-12-18T01:08:43.4376230Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 31s local 2024-12-18T01:08:43.4377236Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T01:08:43.4378235Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local 2024-12-18T01:08:43.4379167Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 28s local 2024-12-18T01:08:43.4380017Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local 2024-12-18T01:08:43.4380867Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 24s local ... 2024-12-18T01:08:43.7160304Z 2024-12-18T01:08:43.7161299Z  2024-12-18T01:08:43.7161727Z  2024-12-18T01:08:43.7164328Z  2024-12-18T01:08:43.7164676Z  2024-12-18T01:08:43.7165023Z  2024-12-18T01:08:43.7165359Z  2024-12-18T01:08:43.7165734Z  2024-12-18T01:08:43.7166104Z  2024-12-18T01:08:43.7166984Z [20,383 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:43.7167844Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2024-12-18T01:08:43.7168801Z Compiling torch_xla/csrc/aten_xla_type.cpp; 34s local 2024-12-18T01:08:43.7169469Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T01:08:43.7170299Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local 2024-12-18T01:08:43.7171229Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 28s local 2024-12-18T01:08:43.7172089Z Compiling torch_xla/csrc/ops/unselect.cpp; 28s local 2024-12-18T01:08:43.7172889Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 24s local 2024-12-18T01:08:43.7173676Z Compiling torch_xla/csrc/ops/uniform.cpp; 24s local ... 2024-12-18T01:08:44.0097797Z 2024-12-18T01:08:44.0098613Z  2024-12-18T01:08:44.0098970Z  2024-12-18T01:08:44.0099299Z  2024-12-18T01:08:44.0099600Z  2024-12-18T01:08:44.0099898Z  2024-12-18T01:08:44.0100175Z  2024-12-18T01:08:44.0100476Z  2024-12-18T01:08:44.0100773Z  2024-12-18T01:08:44.0101508Z [20,383 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:44.0102269Z Compiling torch_xla/csrc/ops/softmax.cpp; 36s local 2024-12-18T01:08:44.0102958Z Compiling torch_xla/csrc/aten_xla_type.cpp; 34s local 2024-12-18T01:08:44.0103579Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2024-12-18T01:08:44.0104306Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 30s local 2024-12-18T01:08:44.0105055Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 29s local 2024-12-18T01:08:44.0105773Z Compiling torch_xla/csrc/ops/unselect.cpp; 28s local 2024-12-18T01:08:44.0106806Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 25s local 2024-12-18T01:08:44.0107509Z Compiling torch_xla/csrc/ops/uniform.cpp; 24s local ... 2024-12-18T01:08:45.0105142Z 2024-12-18T01:08:45.0105949Z  2024-12-18T01:08:45.0106413Z  2024-12-18T01:08:45.0106782Z  2024-12-18T01:08:45.0107150Z  2024-12-18T01:08:45.0107532Z  2024-12-18T01:08:45.0107909Z  2024-12-18T01:08:45.0108604Z  2024-12-18T01:08:45.0108970Z  2024-12-18T01:08:45.0109782Z [20,383 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:45.0110532Z Compiling torch_xla/csrc/ops/softmax.cpp; 37s local 2024-12-18T01:08:45.0111133Z Compiling torch_xla/csrc/aten_xla_type.cpp; 35s local 2024-12-18T01:08:45.0111711Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2024-12-18T01:08:45.0112305Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 31s local 2024-12-18T01:08:45.0112978Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 30s local 2024-12-18T01:08:45.0113644Z Compiling torch_xla/csrc/ops/unselect.cpp; 29s local 2024-12-18T01:08:45.0114404Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 26s local 2024-12-18T01:08:45.0115050Z Compiling torch_xla/csrc/ops/uniform.cpp; 25s local ... 2024-12-18T01:08:45.2108301Z 2024-12-18T01:08:45.2109170Z  2024-12-18T01:08:45.2109640Z  2024-12-18T01:08:45.2110040Z  2024-12-18T01:08:45.2110416Z  2024-12-18T01:08:45.2110781Z  2024-12-18T01:08:45.2111228Z  2024-12-18T01:08:45.2111596Z  2024-12-18T01:08:45.2112271Z  2024-12-18T01:08:45.2113221Z [20,384 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:45.2114150Z Compiling torch_xla/csrc/aten_xla_type.cpp; 35s local 2024-12-18T01:08:45.2114849Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2024-12-18T01:08:45.2115604Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 31s local 2024-12-18T01:08:45.2116939Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 30s local 2024-12-18T01:08:45.2117799Z Compiling torch_xla/csrc/ops/unselect.cpp; 29s local 2024-12-18T01:08:45.2118682Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 26s local 2024-12-18T01:08:45.2119532Z Compiling torch_xla/csrc/ops/uniform.cpp; 25s local 2024-12-18T01:08:45.2120527Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 24s local ... 2024-12-18T01:08:45.6113248Z 2024-12-18T01:08:45.6114171Z  2024-12-18T01:08:45.6114614Z  2024-12-18T01:08:45.6117275Z  2024-12-18T01:08:45.6120290Z  2024-12-18T01:08:45.6123346Z  2024-12-18T01:08:45.6126540Z  2024-12-18T01:08:45.6129405Z  2024-12-18T01:08:45.6132478Z  2024-12-18T01:08:45.6135724Z [20,384 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:45.6139216Z Compiling torch_xla/csrc/aten_xla_type.cpp; 36s local 2024-12-18T01:08:45.6142346Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2024-12-18T01:08:45.6145740Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 31s local 2024-12-18T01:08:45.6148975Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 30s local 2024-12-18T01:08:45.6152311Z Compiling torch_xla/csrc/ops/unselect.cpp; 30s local 2024-12-18T01:08:45.6154766Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 26s local 2024-12-18T01:08:45.6156867Z Compiling torch_xla/csrc/ops/uniform.cpp; 26s local 2024-12-18T01:08:45.6158890Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 25s local ... 2024-12-18T01:08:46.2839685Z 2024-12-18T01:08:46.2841570Z  2024-12-18T01:08:46.2843202Z  2024-12-18T01:08:46.2844955Z  2024-12-18T01:08:46.2845665Z  2024-12-18T01:08:46.2846253Z  2024-12-18T01:08:46.2846715Z  2024-12-18T01:08:46.2847118Z  2024-12-18T01:08:46.2847467Z  2024-12-18T01:08:46.2848322Z [20,385 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:46.2849636Z Compiling torch_xla/csrc/aten_xla_type.cpp; 36s local 2024-12-18T01:08:46.2850422Z Compiling torch_xla/csrc/ops/sum.cpp; 33s local 2024-12-18T01:08:46.2851176Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 32s local 2024-12-18T01:08:46.2852018Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 31s local 2024-12-18T01:08:46.2853077Z Compiling torch_xla/csrc/ops/unselect.cpp; 30s local 2024-12-18T01:08:46.2853829Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 27s local 2024-12-18T01:08:46.2854633Z Compiling torch_xla/csrc/ops/uniform.cpp; 26s local 2024-12-18T01:08:46.2855514Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 25s local ... 2024-12-18T01:08:46.5130910Z 2024-12-18T01:08:46.5131759Z  2024-12-18T01:08:46.5132204Z  2024-12-18T01:08:46.5132711Z  2024-12-18T01:08:46.5133178Z  2024-12-18T01:08:46.5133567Z  2024-12-18T01:08:46.5133951Z  2024-12-18T01:08:46.5134325Z  2024-12-18T01:08:46.5134653Z  2024-12-18T01:08:46.5135807Z [20,386 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:46.5137105Z Compiling torch_xla/csrc/aten_xla_type.cpp; 37s local 2024-12-18T01:08:46.5137820Z Compiling torch_xla/csrc/ops/sum.cpp; 33s local 2024-12-18T01:08:46.5138592Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 32s local 2024-12-18T01:08:46.5139393Z Compiling torch_xla/csrc/ops/unselect.cpp; 31s local 2024-12-18T01:08:46.5140358Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 27s local 2024-12-18T01:08:46.5141133Z Compiling torch_xla/csrc/ops/uniform.cpp; 27s local 2024-12-18T01:08:46.5141956Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 26s local 2024-12-18T01:08:46.5142927Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 22s local ... 2024-12-18T01:08:46.8119845Z 2024-12-18T01:08:46.8120744Z  2024-12-18T01:08:46.8121243Z  2024-12-18T01:08:46.8121629Z  2024-12-18T01:08:46.8122008Z  2024-12-18T01:08:46.8122394Z  2024-12-18T01:08:46.8122810Z  2024-12-18T01:08:46.8123193Z  2024-12-18T01:08:46.8123586Z  2024-12-18T01:08:46.8124526Z [20,386 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:46.8125544Z Compiling torch_xla/csrc/aten_xla_type.cpp; 37s local 2024-12-18T01:08:46.8126323Z Compiling torch_xla/csrc/ops/sum.cpp; 33s local 2024-12-18T01:08:46.8127096Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 33s local 2024-12-18T01:08:46.8127923Z Compiling torch_xla/csrc/ops/unselect.cpp; 31s local 2024-12-18T01:08:46.8128626Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 27s local 2024-12-18T01:08:46.8129377Z Compiling torch_xla/csrc/ops/uniform.cpp; 27s local 2024-12-18T01:08:46.8130238Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 26s local 2024-12-18T01:08:46.8131212Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 22s local ... 2024-12-18T01:08:47.5633946Z 2024-12-18T01:08:47.5634783Z  2024-12-18T01:08:47.5635190Z  2024-12-18T01:08:47.5635524Z  2024-12-18T01:08:47.5635860Z  2024-12-18T01:08:47.5636195Z  2024-12-18T01:08:47.5636537Z  2024-12-18T01:08:47.5636857Z  2024-12-18T01:08:47.5637195Z  2024-12-18T01:08:47.5638013Z [20,387 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:47.5638891Z Compiling torch_xla/csrc/aten_xla_type.cpp; 38s local 2024-12-18T01:08:47.5639572Z Compiling torch_xla/csrc/ops/sum.cpp; 34s local 2024-12-18T01:08:47.5640213Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2024-12-18T01:08:47.5640903Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 28s local 2024-12-18T01:08:47.5641594Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2024-12-18T01:08:47.5642324Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 27s local 2024-12-18T01:08:47.5643490Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 23s local 2024-12-18T01:08:47.5644645Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 22s local ... 2024-12-18T01:08:47.8127154Z 2024-12-18T01:08:47.8127985Z  2024-12-18T01:08:47.8128458Z  2024-12-18T01:08:47.8128874Z  2024-12-18T01:08:47.8129271Z  2024-12-18T01:08:47.8129983Z  2024-12-18T01:08:47.8130399Z  2024-12-18T01:08:47.8130797Z  2024-12-18T01:08:47.8131201Z  2024-12-18T01:08:47.8132155Z [20,387 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:47.8133223Z Compiling torch_xla/csrc/aten_xla_type.cpp; 38s local 2024-12-18T01:08:47.8134019Z Compiling torch_xla/csrc/ops/sum.cpp; 34s local 2024-12-18T01:08:47.8134812Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2024-12-18T01:08:47.8135652Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 28s local 2024-12-18T01:08:47.8136623Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2024-12-18T01:08:47.8137711Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 27s local 2024-12-18T01:08:47.8138724Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 23s local 2024-12-18T01:08:47.8139776Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 23s local ... 2024-12-18T01:08:48.0746202Z 2024-12-18T01:08:48.0747019Z  2024-12-18T01:08:48.0747478Z  2024-12-18T01:08:48.0747833Z  2024-12-18T01:08:48.0748214Z  2024-12-18T01:08:48.0748861Z  2024-12-18T01:08:48.0749278Z  2024-12-18T01:08:48.0749669Z  2024-12-18T01:08:48.0750022Z  2024-12-18T01:08:48.0750902Z [20,388 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:48.0751856Z Compiling torch_xla/csrc/aten_xla_type.cpp; 38s local 2024-12-18T01:08:48.0752602Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2024-12-18T01:08:48.0753388Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2024-12-18T01:08:48.0754140Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 29s local 2024-12-18T01:08:48.0764765Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2024-12-18T01:08:48.0765791Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 27s local 2024-12-18T01:08:48.0766740Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 24s local 2024-12-18T01:08:48.0767764Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 23s local ... 2024-12-18T01:08:48.4316521Z 2024-12-18T01:08:48.4317488Z  2024-12-18T01:08:48.4318029Z  2024-12-18T01:08:48.4318506Z  2024-12-18T01:08:48.4320193Z  2024-12-18T01:08:48.4320632Z  2024-12-18T01:08:48.4322030Z  2024-12-18T01:08:48.4322471Z  2024-12-18T01:08:48.4323899Z  2024-12-18T01:08:48.4324896Z [20,388 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:48.4326026Z Compiling torch_xla/csrc/aten_xla_type.cpp; 39s local 2024-12-18T01:08:48.4326838Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2024-12-18T01:08:48.4327638Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2024-12-18T01:08:48.4328478Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 29s local 2024-12-18T01:08:48.4329297Z Compiling torch_xla/csrc/ops/uniform.cpp; 29s local 2024-12-18T01:08:48.4330212Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 27s local 2024-12-18T01:08:48.4331216Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 24s local 2024-12-18T01:08:48.4332127Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 23s local ... 2024-12-18T01:08:49.4322714Z 2024-12-18T01:08:49.4323564Z  2024-12-18T01:08:49.4324036Z  2024-12-18T01:08:49.4324431Z  2024-12-18T01:08:49.4324819Z  2024-12-18T01:08:49.4325186Z  2024-12-18T01:08:49.4325735Z  2024-12-18T01:08:49.4326110Z  2024-12-18T01:08:49.4326790Z  2024-12-18T01:08:49.4327715Z [20,388 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:49.4328681Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2024-12-18T01:08:49.4329414Z Compiling torch_xla/csrc/ops/sum.cpp; 36s local 2024-12-18T01:08:49.4330131Z Compiling torch_xla/csrc/ops/unselect.cpp; 33s local 2024-12-18T01:08:49.4331009Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 30s local 2024-12-18T01:08:49.4331763Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local 2024-12-18T01:08:49.4332566Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 28s local 2024-12-18T01:08:49.4333485Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 25s local 2024-12-18T01:08:49.4334449Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 24s local ... 2024-12-18T01:08:49.9505788Z 2024-12-18T01:08:49.9506828Z  2024-12-18T01:08:49.9507356Z  2024-12-18T01:08:49.9508013Z  2024-12-18T01:08:49.9509868Z  2024-12-18T01:08:49.9510327Z  2024-12-18T01:08:49.9511754Z  2024-12-18T01:08:49.9512550Z  2024-12-18T01:08:49.9512971Z  2024-12-18T01:08:49.9515183Z [20,389 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:49.9516260Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2024-12-18T01:08:49.9517133Z Compiling torch_xla/csrc/ops/unselect.cpp; 34s local 2024-12-18T01:08:49.9518146Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 30s local 2024-12-18T01:08:49.9518978Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local 2024-12-18T01:08:49.9519883Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 29s local 2024-12-18T01:08:49.9520902Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 25s local 2024-12-18T01:08:49.9521893Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 25s local 2024-12-18T01:08:49.9522863Z Compiling torch_xla/csrc/ops/user_computation.cpp; 25s local ... 2024-12-18T01:08:50.2329238Z 2024-12-18T01:08:50.2330244Z  2024-12-18T01:08:50.2330813Z  2024-12-18T01:08:50.2331176Z  2024-12-18T01:08:50.2331630Z  2024-12-18T01:08:50.2332020Z  2024-12-18T01:08:50.2332380Z  2024-12-18T01:08:50.2332697Z  2024-12-18T01:08:50.2333079Z  2024-12-18T01:08:50.2333987Z [20,389 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:50.2335019Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2024-12-18T01:08:50.2335709Z Compiling torch_xla/csrc/ops/unselect.cpp; 34s local 2024-12-18T01:08:50.2336388Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 31s local 2024-12-18T01:08:50.2337244Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local 2024-12-18T01:08:50.2338054Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 29s local 2024-12-18T01:08:50.2338964Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 26s local 2024-12-18T01:08:50.2339954Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 25s local 2024-12-18T01:08:50.2340971Z Compiling torch_xla/csrc/ops/user_computation.cpp; 25s local ... 2024-12-18T01:08:50.4331069Z 2024-12-18T01:08:50.4332006Z  2024-12-18T01:08:50.4332458Z  2024-12-18T01:08:50.4332837Z  2024-12-18T01:08:50.4333192Z  2024-12-18T01:08:50.4333613Z  2024-12-18T01:08:50.4333995Z  2024-12-18T01:08:50.4334389Z  2024-12-18T01:08:50.4334750Z  2024-12-18T01:08:50.4335702Z [20,390 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:50.4336848Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2024-12-18T01:08:50.4337619Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 31s local 2024-12-18T01:08:50.4338414Z Compiling torch_xla/csrc/ops/uniform.cpp; 31s local 2024-12-18T01:08:50.4339253Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 29s local 2024-12-18T01:08:50.4340509Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 26s local 2024-12-18T01:08:50.4341547Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 25s local 2024-12-18T01:08:50.4342589Z Compiling torch_xla/csrc/ops/user_computation.cpp; 25s local 2024-12-18T01:08:50.4343603Z Compiling .../csrc/ops/upsample_nearest2d_backward.cpp; 24s local ... 2024-12-18T01:08:50.8334929Z 2024-12-18T01:08:50.8335837Z  2024-12-18T01:08:50.8336284Z  2024-12-18T01:08:50.8336796Z  2024-12-18T01:08:50.8337210Z  2024-12-18T01:08:50.8337549Z  2024-12-18T01:08:50.8337956Z  2024-12-18T01:08:50.8338358Z  2024-12-18T01:08:50.8338742Z  2024-12-18T01:08:50.8339532Z [20,391 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:50.8340307Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2024-12-18T01:08:50.8340924Z Compiling torch_xla/csrc/ops/uniform.cpp; 31s local 2024-12-18T01:08:50.8341874Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 30s local 2024-12-18T01:08:50.8342669Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 26s local 2024-12-18T01:08:50.8343489Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 26s local 2024-12-18T01:08:50.8344562Z Compiling torch_xla/csrc/ops/user_computation.cpp; 26s local 2024-12-18T01:08:50.8345492Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 25s local 2024-12-18T01:08:50.8346535Z Compiling torch_xla/csrc/ops/update_slice.cpp; 22s local ... 2024-12-18T01:08:51.8342322Z 2024-12-18T01:08:51.8343106Z  2024-12-18T01:08:51.8343543Z  2024-12-18T01:08:51.8343894Z  2024-12-18T01:08:51.8344385Z  2024-12-18T01:08:51.8344748Z  2024-12-18T01:08:51.8345093Z  2024-12-18T01:08:51.8345472Z  2024-12-18T01:08:51.8345805Z  2024-12-18T01:08:51.8346626Z [20,391 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:51.8347546Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2024-12-18T01:08:51.8348202Z Compiling torch_xla/csrc/ops/uniform.cpp; 32s local 2024-12-18T01:08:51.8348929Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 31s local 2024-12-18T01:08:51.8349762Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 27s local 2024-12-18T01:08:51.8350653Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 27s local 2024-12-18T01:08:51.8351559Z Compiling torch_xla/csrc/ops/user_computation.cpp; 27s local 2024-12-18T01:08:51.8352445Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 26s local 2024-12-18T01:08:51.8353286Z Compiling torch_xla/csrc/ops/update_slice.cpp; 23s local ... 2024-12-18T01:08:52.0780290Z 2024-12-18T01:08:52.0781106Z  2024-12-18T01:08:52.0781527Z  2024-12-18T01:08:52.0781883Z  2024-12-18T01:08:52.0782255Z  2024-12-18T01:08:52.0782606Z  2024-12-18T01:08:52.0782970Z  2024-12-18T01:08:52.0783293Z  2024-12-18T01:08:52.0783885Z  2024-12-18T01:08:52.0784784Z [20,392 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:52.0785767Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2024-12-18T01:08:52.0786573Z Compiling torch_xla/csrc/ops/uniform.cpp; 32s local 2024-12-18T01:08:52.0787441Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 28s local 2024-12-18T01:08:52.0788473Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 27s local 2024-12-18T01:08:52.0789445Z Compiling torch_xla/csrc/ops/user_computation.cpp; 27s local 2024-12-18T01:08:52.0790408Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 26s local 2024-12-18T01:08:52.0791347Z Compiling torch_xla/csrc/ops/update_slice.cpp; 24s local 2024-12-18T01:08:52.0792140Z Compiling torch_xla/csrc/ops/view.cpp; 23s local ... 2024-12-18T01:08:52.4346950Z 2024-12-18T01:08:52.4347770Z  2024-12-18T01:08:52.4348170Z  2024-12-18T01:08:52.4348537Z  2024-12-18T01:08:52.4348852Z  2024-12-18T01:08:52.4349194Z  2024-12-18T01:08:52.4349539Z  2024-12-18T01:08:52.4349873Z  2024-12-18T01:08:52.4350198Z  2024-12-18T01:08:52.4351011Z [20,392 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:52.4352131Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2024-12-18T01:08:52.4352808Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2024-12-18T01:08:52.4353542Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 28s local 2024-12-18T01:08:52.4354447Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 27s local 2024-12-18T01:08:52.4355292Z Compiling torch_xla/csrc/ops/user_computation.cpp; 27s local 2024-12-18T01:08:52.4356149Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 26s local 2024-12-18T01:08:52.4357004Z Compiling torch_xla/csrc/ops/update_slice.cpp; 24s local 2024-12-18T01:08:52.4357828Z Compiling torch_xla/csrc/ops/view.cpp; 23s local ... 2024-12-18T01:08:53.4356528Z 2024-12-18T01:08:53.4357375Z  2024-12-18T01:08:53.4357850Z  2024-12-18T01:08:53.4359786Z  2024-12-18T01:08:53.4360118Z  2024-12-18T01:08:53.4360496Z  2024-12-18T01:08:53.4360855Z  2024-12-18T01:08:53.4361184Z  2024-12-18T01:08:53.4361507Z  2024-12-18T01:08:53.4362589Z [20,392 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:53.4363424Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2024-12-18T01:08:53.4364068Z Compiling torch_xla/csrc/ops/uniform.cpp; 34s local 2024-12-18T01:08:53.4364775Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 29s local 2024-12-18T01:08:53.4365617Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 28s local 2024-12-18T01:08:53.4366475Z Compiling torch_xla/csrc/ops/user_computation.cpp; 28s local 2024-12-18T01:08:53.4367297Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 27s local 2024-12-18T01:08:53.4368090Z Compiling torch_xla/csrc/ops/update_slice.cpp; 25s local 2024-12-18T01:08:53.4368757Z Compiling torch_xla/csrc/ops/view.cpp; 24s local ... 2024-12-18T01:08:54.4362787Z 2024-12-18T01:08:54.4363647Z  2024-12-18T01:08:54.4364105Z  2024-12-18T01:08:54.4364464Z  2024-12-18T01:08:54.4364822Z  2024-12-18T01:08:54.4365196Z  2024-12-18T01:08:54.4365562Z  2024-12-18T01:08:54.4365927Z  2024-12-18T01:08:54.4366305Z  2024-12-18T01:08:54.4367175Z [20,392 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:54.4368045Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2024-12-18T01:08:54.4368767Z Compiling torch_xla/csrc/ops/uniform.cpp; 35s local 2024-12-18T01:08:54.4369570Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 30s local 2024-12-18T01:08:54.4370538Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 29s local 2024-12-18T01:08:54.4371275Z Compiling torch_xla/csrc/ops/user_computation.cpp; 29s local 2024-12-18T01:08:54.4371983Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 28s local 2024-12-18T01:08:54.4372835Z Compiling torch_xla/csrc/ops/update_slice.cpp; 26s local 2024-12-18T01:08:54.4373555Z Compiling torch_xla/csrc/ops/view.cpp; 25s local ... 2024-12-18T01:08:55.4370715Z 2024-12-18T01:08:55.4371562Z  2024-12-18T01:08:55.4372142Z  2024-12-18T01:08:55.4372541Z  2024-12-18T01:08:55.4372899Z  2024-12-18T01:08:55.4373280Z  2024-12-18T01:08:55.4373647Z  2024-12-18T01:08:55.4374015Z  2024-12-18T01:08:55.4374362Z  2024-12-18T01:08:55.4375383Z [20,392 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:55.4376748Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T01:08:55.4377437Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2024-12-18T01:08:55.4378199Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 31s local 2024-12-18T01:08:55.4379129Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 30s local 2024-12-18T01:08:55.4380450Z Compiling torch_xla/csrc/ops/user_computation.cpp; 30s local 2024-12-18T01:08:55.4381376Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 29s local 2024-12-18T01:08:55.4382287Z Compiling torch_xla/csrc/ops/update_slice.cpp; 27s local 2024-12-18T01:08:55.4383054Z Compiling torch_xla/csrc/ops/view.cpp; 26s local ... 2024-12-18T01:08:55.7951687Z 2024-12-18T01:08:55.7952543Z  2024-12-18T01:08:55.7952992Z  2024-12-18T01:08:55.7953358Z  2024-12-18T01:08:55.7953740Z  2024-12-18T01:08:55.7954127Z  2024-12-18T01:08:55.7954543Z  2024-12-18T01:08:55.7954919Z  2024-12-18T01:08:55.7955293Z  2024-12-18T01:08:55.7956620Z [20,393 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:55.7957566Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T01:08:55.7958283Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2024-12-18T01:08:55.7959169Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 31s local 2024-12-18T01:08:55.7960283Z Compiling torch_xla/csrc/ops/user_computation.cpp; 30s local 2024-12-18T01:08:55.7961228Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 29s local 2024-12-18T01:08:55.7962137Z Compiling torch_xla/csrc/ops/update_slice.cpp; 27s local 2024-12-18T01:08:55.7962892Z Compiling torch_xla/csrc/ops/view.cpp; 27s local 2024-12-18T01:08:55.7963617Z Compiling torch_xla/csrc/ops/var.cpp; 26s local ... 2024-12-18T01:08:56.0373934Z 2024-12-18T01:08:56.0374843Z  2024-12-18T01:08:56.0375306Z  2024-12-18T01:08:56.0375672Z  2024-12-18T01:08:56.0376041Z  2024-12-18T01:08:56.0376419Z  2024-12-18T01:08:56.0377102Z  2024-12-18T01:08:56.0377418Z  2024-12-18T01:08:56.0377790Z  2024-12-18T01:08:56.0378687Z [20,393 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:56.0379680Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2024-12-18T01:08:56.0380444Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2024-12-18T01:08:56.0381350Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 31s local 2024-12-18T01:08:56.0382362Z Compiling torch_xla/csrc/ops/user_computation.cpp; 31s local 2024-12-18T01:08:56.0383351Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 30s local 2024-12-18T01:08:56.0384351Z Compiling torch_xla/csrc/ops/update_slice.cpp; 27s local 2024-12-18T01:08:56.0385137Z Compiling torch_xla/csrc/ops/view.cpp; 27s local 2024-12-18T01:08:56.0385890Z Compiling torch_xla/csrc/ops/var.cpp; 27s local ... 2024-12-18T01:08:56.3422357Z 2024-12-18T01:08:56.3423225Z  2024-12-18T01:08:56.3423777Z  2024-12-18T01:08:56.3424153Z  2024-12-18T01:08:56.3424544Z  2024-12-18T01:08:56.3424908Z  2024-12-18T01:08:56.3425249Z  2024-12-18T01:08:56.3425608Z  2024-12-18T01:08:56.3426084Z  2024-12-18T01:08:56.3427184Z [20,394 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:56.3428180Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T01:08:56.3428969Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2024-12-18T01:08:56.3429902Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 31s local 2024-12-18T01:08:56.3431001Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 30s local 2024-12-18T01:08:56.3432009Z Compiling torch_xla/csrc/ops/update_slice.cpp; 28s local 2024-12-18T01:08:56.3433145Z Compiling torch_xla/csrc/ops/view.cpp; 27s local 2024-12-18T01:08:56.3433870Z Compiling torch_xla/csrc/ops/var.cpp; 27s local 2024-12-18T01:08:56.3434472Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local ... 2024-12-18T01:08:56.5451660Z 2024-12-18T01:08:56.5452524Z  2024-12-18T01:08:56.5452982Z  2024-12-18T01:08:56.5453792Z  2024-12-18T01:08:56.5454151Z  2024-12-18T01:08:56.5454568Z  2024-12-18T01:08:56.5454936Z  2024-12-18T01:08:56.5455279Z  2024-12-18T01:08:56.5455646Z  2024-12-18T01:08:56.5456645Z [20,395 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:56.5457634Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T01:08:56.5458547Z Compiling torch_xla/csrc/ops/uniform.cpp; 37s local 2024-12-18T01:08:56.5459539Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 30s local 2024-12-18T01:08:56.5460405Z Compiling torch_xla/csrc/ops/update_slice.cpp; 28s local 2024-12-18T01:08:56.5461293Z Compiling torch_xla/csrc/ops/view.cpp; 28s local 2024-12-18T01:08:56.5461985Z Compiling torch_xla/csrc/ops/var.cpp; 27s local 2024-12-18T01:08:56.5462702Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local 2024-12-18T01:08:56.5463436Z Compiling test/cpp/torch_xla_test.cpp; 26s local ... 2024-12-18T01:08:56.8380298Z 2024-12-18T01:08:56.8381141Z  2024-12-18T01:08:56.8381608Z  2024-12-18T01:08:56.8382047Z  2024-12-18T01:08:56.8382710Z  2024-12-18T01:08:56.8383130Z  2024-12-18T01:08:56.8383425Z  2024-12-18T01:08:56.8383765Z  2024-12-18T01:08:56.8384139Z  2024-12-18T01:08:56.8385050Z [20,396 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:56.8385966Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2024-12-18T01:08:56.8386851Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 31s local 2024-12-18T01:08:56.8387823Z Compiling torch_xla/csrc/ops/update_slice.cpp; 28s local 2024-12-18T01:08:56.8388438Z Compiling torch_xla/csrc/ops/view.cpp; 28s local 2024-12-18T01:08:56.8389113Z Compiling torch_xla/csrc/ops/var.cpp; 27s local 2024-12-18T01:08:56.8389813Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local 2024-12-18T01:08:56.8390541Z Compiling test/cpp/torch_xla_test.cpp; 27s local 2024-12-18T01:08:56.8391258Z Compiling torch_xla/csrc/ops/view.cpp; 26s local ... 2024-12-18T01:08:57.3892755Z 2024-12-18T01:08:57.3893983Z  2024-12-18T01:08:57.3894482Z  2024-12-18T01:08:57.3894878Z  2024-12-18T01:08:57.3895252Z  2024-12-18T01:08:57.3895634Z  2024-12-18T01:08:57.3895989Z  2024-12-18T01:08:57.3896391Z  2024-12-18T01:08:57.3897017Z  2024-12-18T01:08:57.3897888Z [20,397 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:08:57.3898885Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2024-12-18T01:08:57.3899710Z Compiling torch_xla/csrc/ops/update_slice.cpp; 29s local 2024-12-18T01:08:57.3900576Z Compiling torch_xla/csrc/ops/view.cpp; 28s local 2024-12-18T01:08:57.3901362Z Compiling torch_xla/csrc/ops/var.cpp; 28s local 2024-12-18T01:08:57.3902049Z Compiling torch_xla/csrc/ops/var_mean.cpp; 28s local 2024-12-18T01:08:57.3902786Z Compiling test/cpp/torch_xla_test.cpp; 27s local 2024-12-18T01:08:57.3903468Z Compiling torch_xla/csrc/ops/view.cpp; 26s local 2024-12-18T01:08:57.3904053Z Compiling torch_xla/csrc/ops/var_mean.cpp; 25s local ... 2024-12-18T01:08:57.6387408Z 2024-12-18T01:08:57.6388293Z  2024-12-18T01:08:57.6388730Z  2024-12-18T01:08:57.6389104Z  2024-12-18T01:08:57.6389516Z  2024-12-18T01:08:57.6389981Z  2024-12-18T01:08:57.6390339Z  2024-12-18T01:08:57.6390708Z  2024-12-18T01:08:57.6391089Z  2024-12-18T01:08:57.6392311Z [20,397 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:57.6393297Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2024-12-18T01:08:57.6394106Z Compiling torch_xla/csrc/ops/update_slice.cpp; 29s local 2024-12-18T01:08:57.6394885Z Compiling torch_xla/csrc/ops/view.cpp; 29s local 2024-12-18T01:08:57.6395797Z Compiling torch_xla/csrc/ops/var.cpp; 28s local 2024-12-18T01:08:57.6396559Z Compiling torch_xla/csrc/ops/var_mean.cpp; 28s local 2024-12-18T01:08:57.6397321Z Compiling test/cpp/torch_xla_test.cpp; 27s local 2024-12-18T01:08:57.6397997Z Compiling torch_xla/csrc/ops/view.cpp; 27s local 2024-12-18T01:08:57.6398767Z Compiling torch_xla/csrc/ops/var_mean.cpp; 25s local ... 2024-12-18T01:08:58.6393645Z 2024-12-18T01:08:58.6394496Z  2024-12-18T01:08:58.6395005Z  2024-12-18T01:08:58.6395520Z  2024-12-18T01:08:58.6396025Z  2024-12-18T01:08:58.6396456Z  2024-12-18T01:08:58.6396762Z  2024-12-18T01:08:58.6397071Z  2024-12-18T01:08:58.6397418Z  2024-12-18T01:08:58.6398556Z [20,397 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:58.6399545Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2024-12-18T01:08:58.6400302Z Compiling torch_xla/csrc/ops/update_slice.cpp; 30s local 2024-12-18T01:08:58.6401060Z Compiling torch_xla/csrc/ops/view.cpp; 30s local 2024-12-18T01:08:58.6402069Z Compiling torch_xla/csrc/ops/var.cpp; 29s local 2024-12-18T01:08:58.6402818Z Compiling torch_xla/csrc/ops/var_mean.cpp; 29s local 2024-12-18T01:08:58.6403524Z Compiling test/cpp/torch_xla_test.cpp; 28s local 2024-12-18T01:08:58.6404215Z Compiling torch_xla/csrc/ops/view.cpp; 28s local 2024-12-18T01:08:58.6405173Z Compiling torch_xla/csrc/ops/var_mean.cpp; 26s local ... 2024-12-18T01:08:59.6401314Z 2024-12-18T01:08:59.6402137Z  2024-12-18T01:08:59.6402573Z  2024-12-18T01:08:59.6402880Z  2024-12-18T01:08:59.6403186Z  2024-12-18T01:08:59.6403545Z  2024-12-18T01:08:59.6403888Z  2024-12-18T01:08:59.6404257Z  2024-12-18T01:08:59.6404625Z  2024-12-18T01:08:59.6405506Z [20,397 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:08:59.6406334Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2024-12-18T01:08:59.6407017Z Compiling torch_xla/csrc/ops/update_slice.cpp; 31s local 2024-12-18T01:08:59.6407628Z Compiling torch_xla/csrc/ops/view.cpp; 31s local 2024-12-18T01:08:59.6408230Z Compiling torch_xla/csrc/ops/var.cpp; 30s local 2024-12-18T01:08:59.6408876Z Compiling torch_xla/csrc/ops/var_mean.cpp; 30s local 2024-12-18T01:08:59.6409470Z Compiling test/cpp/torch_xla_test.cpp; 29s local 2024-12-18T01:08:59.6410123Z Compiling torch_xla/csrc/ops/view.cpp; 29s local 2024-12-18T01:08:59.6410722Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local ... 2024-12-18T01:09:00.4161696Z 2024-12-18T01:09:00.4162556Z  2024-12-18T01:09:00.4163019Z  2024-12-18T01:09:00.4163380Z  2024-12-18T01:09:00.4163733Z  2024-12-18T01:09:00.4164112Z  2024-12-18T01:09:00.4164485Z  2024-12-18T01:09:00.4164849Z  2024-12-18T01:09:00.4165197Z  2024-12-18T01:09:00.4166049Z [20,398 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:00.4167037Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2024-12-18T01:09:00.4167776Z Compiling torch_xla/csrc/ops/update_slice.cpp; 32s local 2024-12-18T01:09:00.4168524Z Compiling torch_xla/csrc/ops/var.cpp; 31s local 2024-12-18T01:09:00.4169220Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local 2024-12-18T01:09:00.4169911Z Compiling test/cpp/torch_xla_test.cpp; 30s local 2024-12-18T01:09:00.4170595Z Compiling torch_xla/csrc/ops/view.cpp; 29s local 2024-12-18T01:09:00.4171673Z Compiling torch_xla/csrc/ops/var_mean.cpp; 28s local 2024-12-18T01:09:00.4172452Z Compiling torch_xla/csrc/ops/var.cpp; 28s local ... 2024-12-18T01:09:00.6408021Z 2024-12-18T01:09:00.6408877Z  2024-12-18T01:09:00.6409326Z  2024-12-18T01:09:00.6409714Z  2024-12-18T01:09:00.6410098Z  2024-12-18T01:09:00.6410513Z  2024-12-18T01:09:00.6410923Z  2024-12-18T01:09:00.6411700Z  2024-12-18T01:09:00.6412125Z  2024-12-18T01:09:00.6413185Z [20,398 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:00.6414242Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2024-12-18T01:09:00.6414879Z Compiling torch_xla/csrc/ops/update_slice.cpp; 32s local 2024-12-18T01:09:00.6415511Z Compiling torch_xla/csrc/ops/var.cpp; 31s local 2024-12-18T01:09:00.6416238Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local 2024-12-18T01:09:00.6416928Z Compiling test/cpp/torch_xla_test.cpp; 30s local 2024-12-18T01:09:00.6417476Z Compiling torch_xla/csrc/ops/view.cpp; 30s local 2024-12-18T01:09:00.6418195Z Compiling torch_xla/csrc/ops/var_mean.cpp; 28s local 2024-12-18T01:09:00.6418754Z Compiling torch_xla/csrc/ops/var.cpp; 28s local ... 2024-12-18T01:09:01.8417442Z 2024-12-18T01:09:01.8418353Z  2024-12-18T01:09:01.8418788Z  2024-12-18T01:09:01.8419152Z  2024-12-18T01:09:01.8419475Z  2024-12-18T01:09:01.8419787Z  2024-12-18T01:09:01.8420110Z  2024-12-18T01:09:01.8420438Z  2024-12-18T01:09:01.8421039Z  2024-12-18T01:09:01.8421821Z [20,398 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:01.8422619Z Compiling torch_xla/csrc/aten_xla_type.cpp; 52s local 2024-12-18T01:09:01.8423286Z Compiling torch_xla/csrc/ops/update_slice.cpp; 33s local 2024-12-18T01:09:01.8423928Z Compiling torch_xla/csrc/ops/var.cpp; 32s local 2024-12-18T01:09:01.8424542Z Compiling torch_xla/csrc/ops/var_mean.cpp; 32s local 2024-12-18T01:09:01.8425154Z Compiling test/cpp/torch_xla_test.cpp; 32s local 2024-12-18T01:09:01.8425737Z Compiling torch_xla/csrc/ops/view.cpp; 31s local 2024-12-18T01:09:01.8426312Z Compiling torch_xla/csrc/ops/var_mean.cpp; 30s local 2024-12-18T01:09:01.8426928Z Compiling torch_xla/csrc/ops/var.cpp; 29s local ... 2024-12-18T01:09:02.8424903Z 2024-12-18T01:09:02.8425801Z  2024-12-18T01:09:02.8426257Z  2024-12-18T01:09:02.8426608Z  2024-12-18T01:09:02.8426997Z  2024-12-18T01:09:02.8427423Z  2024-12-18T01:09:02.8427769Z  2024-12-18T01:09:02.8428136Z  2024-12-18T01:09:02.8428511Z  2024-12-18T01:09:02.8429458Z [20,398 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:02.8430438Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2024-12-18T01:09:02.8431257Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2024-12-18T01:09:02.8432072Z Compiling torch_xla/csrc/ops/var.cpp; 33s local 2024-12-18T01:09:02.8432790Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2024-12-18T01:09:02.8433523Z Compiling test/cpp/torch_xla_test.cpp; 33s local 2024-12-18T01:09:02.8434264Z Compiling torch_xla/csrc/ops/view.cpp; 32s local 2024-12-18T01:09:02.8434999Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local 2024-12-18T01:09:02.8435783Z Compiling torch_xla/csrc/ops/var.cpp; 30s local ... 2024-12-18T01:09:03.6430678Z 2024-12-18T01:09:03.6431554Z  2024-12-18T01:09:03.6432041Z  2024-12-18T01:09:03.6432473Z  2024-12-18T01:09:03.6432860Z  2024-12-18T01:09:03.6433218Z  2024-12-18T01:09:03.6433576Z  2024-12-18T01:09:03.6433976Z  2024-12-18T01:09:03.6434360Z  2024-12-18T01:09:03.6435296Z [20,399 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:03.6436609Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2024-12-18T01:09:03.6437472Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2024-12-18T01:09:03.6438228Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2024-12-18T01:09:03.6438910Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2024-12-18T01:09:03.6439607Z Compiling test/cpp/torch_xla_test.cpp; 33s local 2024-12-18T01:09:03.6440483Z Compiling torch_xla/csrc/ops/view.cpp; 33s local 2024-12-18T01:09:03.6441211Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local 2024-12-18T01:09:03.6441993Z Compiling torch_xla/csrc/ops/var.cpp; 31s local ... 2024-12-18T01:09:04.0434910Z 2024-12-18T01:09:04.0435751Z  2024-12-18T01:09:04.0436194Z  2024-12-18T01:09:04.0436551Z  2024-12-18T01:09:04.0436892Z  2024-12-18T01:09:04.0437223Z  2024-12-18T01:09:04.0437571Z  2024-12-18T01:09:04.0437917Z  2024-12-18T01:09:04.0438275Z  2024-12-18T01:09:04.0439094Z [20,399 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:04.0440357Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2024-12-18T01:09:04.0441109Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2024-12-18T01:09:04.0441782Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2024-12-18T01:09:04.0442453Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2024-12-18T01:09:04.0443123Z Compiling test/cpp/torch_xla_test.cpp; 34s local 2024-12-18T01:09:04.0443876Z Compiling torch_xla/csrc/ops/view.cpp; 33s local 2024-12-18T01:09:04.0444779Z Compiling torch_xla/csrc/ops/var_mean.cpp; 32s local 2024-12-18T01:09:04.0445461Z Compiling torch_xla/csrc/ops/var.cpp; 31s local ... 2024-12-18T01:09:04.2981134Z 2024-12-18T01:09:04.2982089Z  2024-12-18T01:09:04.2982571Z  2024-12-18T01:09:04.2982979Z  2024-12-18T01:09:04.2983337Z  2024-12-18T01:09:04.2983704Z  2024-12-18T01:09:04.2984130Z  2024-12-18T01:09:04.2984530Z  2024-12-18T01:09:04.2984890Z  2024-12-18T01:09:04.2985739Z [20,400 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:04.2986712Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2024-12-18T01:09:04.2987509Z Compiling torch_xla/csrc/ops/update_slice.cpp; 36s local 2024-12-18T01:09:04.2988262Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2024-12-18T01:09:04.2989002Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2024-12-18T01:09:04.2989732Z Compiling test/cpp/torch_xla_test.cpp; 34s local 2024-12-18T01:09:04.2990429Z Compiling torch_xla/csrc/ops/view.cpp; 33s local 2024-12-18T01:09:04.2991164Z Compiling torch_xla/csrc/ops/var_mean.cpp; 32s local 2024-12-18T01:09:04.2991913Z Compiling torch_xla/csrc/ops/var.cpp; 32s local ... 2024-12-18T01:09:04.5037997Z 2024-12-18T01:09:04.5039255Z  2024-12-18T01:09:04.5039651Z  2024-12-18T01:09:04.5040017Z  2024-12-18T01:09:04.5040354Z  2024-12-18T01:09:04.5040684Z  2024-12-18T01:09:04.5040996Z  2024-12-18T01:09:04.5041327Z  2024-12-18T01:09:04.5041647Z  2024-12-18T01:09:04.5042400Z [20,403 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:04.5043222Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T01:09:04.5043906Z Compiling torch_xla/csrc/ops/update_slice.cpp; 36s local 2024-12-18T01:09:04.5044844Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2024-12-18T01:09:04.5045484Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2024-12-18T01:09:04.5046128Z Compiling test/cpp/torch_xla_test.cpp; 34s local 2024-12-18T01:09:04.5046775Z Compiling torch_xla/csrc/ops/var_mean.cpp; 32s local 2024-12-18T01:09:04.5047553Z Compiling torch_xla/csrc/ops/var.cpp; 32s local 2024-12-18T01:09:04.5048239Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 31s local ... 2024-12-18T01:09:04.8867676Z 2024-12-18T01:09:04.8868892Z  2024-12-18T01:09:04.8869298Z  2024-12-18T01:09:04.8869646Z  2024-12-18T01:09:04.8869991Z  2024-12-18T01:09:04.8870304Z  2024-12-18T01:09:04.8870616Z  2024-12-18T01:09:04.8870901Z  2024-12-18T01:09:04.8871204Z  2024-12-18T01:09:04.8871951Z [20,405 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:09:04.8873120Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T01:09:04.8873749Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2024-12-18T01:09:04.8874347Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2024-12-18T01:09:04.8874954Z Compiling test/cpp/torch_xla_test.cpp; 35s local 2024-12-18T01:09:04.8875600Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2024-12-18T01:09:04.8876232Z Compiling torch_xla/csrc/ops/var.cpp; 32s local 2024-12-18T01:09:04.8876886Z Compiling torch_xla/csrc/ops/update_slice.cpp; 30s local 2024-12-18T01:09:04.8877565Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 29s local ... 2024-12-18T01:09:05.2874529Z 2024-12-18T01:09:05.2875783Z  2024-12-18T01:09:05.2876167Z  2024-12-18T01:09:05.2876487Z  2024-12-18T01:09:05.2876804Z  2024-12-18T01:09:05.2877113Z  2024-12-18T01:09:05.2877409Z  2024-12-18T01:09:05.2877729Z  2024-12-18T01:09:05.2878062Z  2024-12-18T01:09:05.2879023Z [20,405 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:05.2879990Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2024-12-18T01:09:05.2880564Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2024-12-18T01:09:05.2881121Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2024-12-18T01:09:05.2881705Z Compiling test/cpp/torch_xla_test.cpp; 35s local 2024-12-18T01:09:05.2882274Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2024-12-18T01:09:05.2882845Z Compiling torch_xla/csrc/ops/var.cpp; 33s local 2024-12-18T01:09:05.2883431Z Compiling torch_xla/csrc/ops/update_slice.cpp; 30s local 2024-12-18T01:09:05.2884052Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 30s local ... 2024-12-18T01:09:06.0880719Z 2024-12-18T01:09:06.0881965Z  2024-12-18T01:09:06.0882452Z  2024-12-18T01:09:06.0884218Z  2024-12-18T01:09:06.0884703Z  2024-12-18T01:09:06.0885070Z  2024-12-18T01:09:06.0885452Z  2024-12-18T01:09:06.0885815Z  2024-12-18T01:09:06.0886184Z  2024-12-18T01:09:06.0887165Z [20,406 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:06.0888176Z Compiling torch_xla/csrc/aten_xla_type.cpp; 56s local 2024-12-18T01:09:06.0888943Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2024-12-18T01:09:06.0889654Z Compiling test/cpp/torch_xla_test.cpp; 36s local 2024-12-18T01:09:06.0890436Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2024-12-18T01:09:06.0891155Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2024-12-18T01:09:06.0891961Z Compiling torch_xla/csrc/ops/update_slice.cpp; 31s local 2024-12-18T01:09:06.0892829Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 30s local 2024-12-18T01:09:06.0893664Z Compiling torch_xla/csrc/ops/unselect.cpp; 30s local ... 2024-12-18T01:09:06.4494191Z 2024-12-18T01:09:06.4495356Z  2024-12-18T01:09:06.4495851Z  2024-12-18T01:09:06.4496246Z  2024-12-18T01:09:06.4496836Z  2024-12-18T01:09:06.4497247Z  2024-12-18T01:09:06.4497623Z  2024-12-18T01:09:06.4497997Z  2024-12-18T01:09:06.4498367Z  2024-12-18T01:09:06.4499242Z [20,407 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:06.4500240Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2024-12-18T01:09:06.4501000Z Compiling torch_xla/csrc/ops/var_mean.cpp; 37s local 2024-12-18T01:09:06.4502052Z Compiling test/cpp/torch_xla_test.cpp; 36s local 2024-12-18T01:09:06.4502843Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2024-12-18T01:09:06.4503606Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2024-12-18T01:09:06.4504402Z Compiling torch_xla/csrc/ops/update_slice.cpp; 31s local 2024-12-18T01:09:06.4505221Z Compiling torch_xla/csrc/ops/unselect.cpp; 31s local 2024-12-18T01:09:06.4506205Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local ... 2024-12-18T01:09:06.6886240Z 2024-12-18T01:09:06.6887074Z  2024-12-18T01:09:06.6887490Z  2024-12-18T01:09:06.6887818Z  2024-12-18T01:09:06.6888155Z  2024-12-18T01:09:06.6888520Z  2024-12-18T01:09:06.6888862Z  2024-12-18T01:09:06.6889195Z  2024-12-18T01:09:06.6889531Z  2024-12-18T01:09:06.6890368Z [20,408 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:06.6891288Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2024-12-18T01:09:06.6891951Z Compiling test/cpp/torch_xla_test.cpp; 36s local 2024-12-18T01:09:06.6892849Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2024-12-18T01:09:06.6893479Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2024-12-18T01:09:06.6894134Z Compiling torch_xla/csrc/ops/update_slice.cpp; 31s local 2024-12-18T01:09:06.6894833Z Compiling torch_xla/csrc/ops/unselect.cpp; 31s local 2024-12-18T01:09:06.6895500Z Compiling torch_xla/csrc/ops/uniform.cpp; 31s local 2024-12-18T01:09:06.6896335Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 31s local ... 2024-12-18T01:09:07.3681988Z 2024-12-18T01:09:07.3683161Z  2024-12-18T01:09:07.3683877Z  2024-12-18T01:09:07.3684472Z  2024-12-18T01:09:07.3684860Z  2024-12-18T01:09:07.3685304Z  2024-12-18T01:09:07.3685668Z  2024-12-18T01:09:07.3686007Z  2024-12-18T01:09:07.3686362Z  2024-12-18T01:09:07.3687229Z [20,409 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:07.3688109Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2024-12-18T01:09:07.3688794Z Compiling test/cpp/torch_xla_test.cpp; 37s local 2024-12-18T01:09:07.3689450Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2024-12-18T01:09:07.3690081Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2024-12-18T01:09:07.3690744Z Compiling torch_xla/csrc/ops/update_slice.cpp; 32s local 2024-12-18T01:09:07.3691444Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2024-12-18T01:09:07.3692112Z Compiling torch_xla/csrc/ops/uniform.cpp; 31s local 2024-12-18T01:09:07.3692844Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local ... 2024-12-18T01:09:07.6892994Z 2024-12-18T01:09:07.6894500Z  2024-12-18T01:09:07.6894942Z  2024-12-18T01:09:07.6895281Z  2024-12-18T01:09:07.6895728Z  2024-12-18T01:09:07.6896201Z  2024-12-18T01:09:07.6896726Z  2024-12-18T01:09:07.6897056Z  2024-12-18T01:09:07.6897370Z  2024-12-18T01:09:07.6898145Z [20,409 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:07.6898928Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2024-12-18T01:09:07.6899532Z Compiling test/cpp/torch_xla_test.cpp; 37s local 2024-12-18T01:09:07.6900147Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2024-12-18T01:09:07.6900728Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2024-12-18T01:09:07.6901349Z Compiling torch_xla/csrc/ops/update_slice.cpp; 32s local 2024-12-18T01:09:07.6901970Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2024-12-18T01:09:07.6902582Z Compiling torch_xla/csrc/ops/uniform.cpp; 32s local 2024-12-18T01:09:07.6903242Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 30s local ... 2024-12-18T01:09:08.6596608Z 2024-12-18T01:09:08.6597819Z  2024-12-18T01:09:08.6599055Z  2024-12-18T01:09:08.6599679Z  2024-12-18T01:09:08.6600316Z  2024-12-18T01:09:08.6600755Z  2024-12-18T01:09:08.6601182Z  2024-12-18T01:09:08.6601541Z  2024-12-18T01:09:08.6601901Z  2024-12-18T01:09:08.6602822Z [20,410 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:08.6603815Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2024-12-18T01:09:08.6604871Z Compiling torch_xla/csrc/ops/var_mean.cpp; 37s local 2024-12-18T01:09:08.6605615Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2024-12-18T01:09:08.6606436Z Compiling torch_xla/csrc/ops/update_slice.cpp; 33s local 2024-12-18T01:09:08.6607310Z Compiling torch_xla/csrc/ops/unselect.cpp; 33s local 2024-12-18T01:09:08.6608111Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2024-12-18T01:09:08.6608956Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 31s local 2024-12-18T01:09:08.6609785Z Compiling torch_xla/csrc/ops/topk.cpp; 30s local ... 2024-12-18T01:09:08.8712345Z 2024-12-18T01:09:08.8713735Z  2024-12-18T01:09:08.8714807Z  2024-12-18T01:09:08.8715461Z  2024-12-18T01:09:08.8716050Z  2024-12-18T01:09:08.8716525Z  2024-12-18T01:09:08.8716916Z  2024-12-18T01:09:08.8717277Z  2024-12-18T01:09:08.8717636Z  2024-12-18T01:09:08.8718557Z [20,413 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:08.8719738Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2024-12-18T01:09:08.8720517Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2024-12-18T01:09:08.8721273Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2024-12-18T01:09:08.8722077Z Compiling torch_xla/csrc/ops/unselect.cpp; 33s local 2024-12-18T01:09:08.8722783Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2024-12-18T01:09:08.8723593Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 31s local 2024-12-18T01:09:08.8724410Z Compiling torch_xla/csrc/ops/topk.cpp; 31s local 2024-12-18T01:09:08.8725273Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local ... 2024-12-18T01:09:09.0735849Z 2024-12-18T01:09:09.0737012Z  2024-12-18T01:09:09.0737450Z  2024-12-18T01:09:09.0737826Z  2024-12-18T01:09:09.0738242Z  2024-12-18T01:09:09.0738614Z  2024-12-18T01:09:09.0739035Z  2024-12-18T01:09:09.0739416Z  2024-12-18T01:09:09.0739815Z  2024-12-18T01:09:09.0740758Z [20,414 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:09.0741808Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2024-12-18T01:09:09.0742603Z Compiling torch_xla/csrc/ops/var.cpp; 37s local 2024-12-18T01:09:09.0743354Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2024-12-18T01:09:09.0744394Z Compiling torch_xla/csrc/ops/unselect.cpp; 33s local 2024-12-18T01:09:09.0745187Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2024-12-18T01:09:09.0745935Z Compiling torch_xla/csrc/ops/topk.cpp; 31s local 2024-12-18T01:09:09.0746736Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local 2024-12-18T01:09:09.0747555Z Compiling torch_xla/csrc/ops/threshold.cpp; 29s local ... 2024-12-18T01:09:09.2904290Z 2024-12-18T01:09:09.2905423Z  2024-12-18T01:09:09.2905888Z  2024-12-18T01:09:09.2906243Z  2024-12-18T01:09:09.2906598Z  2024-12-18T01:09:09.2906941Z  2024-12-18T01:09:09.2907270Z  2024-12-18T01:09:09.2907623Z  2024-12-18T01:09:09.2907967Z  2024-12-18T01:09:09.2908777Z [20,415 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:09.2909659Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2024-12-18T01:09:09.2910311Z Compiling torch_xla/csrc/ops/var.cpp; 37s local 2024-12-18T01:09:09.2910987Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2024-12-18T01:09:09.2911955Z Compiling torch_xla/csrc/ops/unselect.cpp; 33s local 2024-12-18T01:09:09.2912617Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2024-12-18T01:09:09.2913320Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local 2024-12-18T01:09:09.2914042Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2024-12-18T01:09:09.2914793Z Compiling torch_xla/csrc/ops/symeig.cpp; 30s local ... 2024-12-18T01:09:09.5210270Z 2024-12-18T01:09:09.5211332Z  2024-12-18T01:09:09.5211799Z  2024-12-18T01:09:09.5212215Z  2024-12-18T01:09:09.5212590Z  2024-12-18T01:09:09.5212985Z  2024-12-18T01:09:09.5213383Z  2024-12-18T01:09:09.5213766Z  2024-12-18T01:09:09.5214166Z  2024-12-18T01:09:09.5215102Z [20,416 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:09.5216282Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T01:09:09.5217300Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2024-12-18T01:09:09.5218428Z Compiling torch_xla/csrc/ops/unselect.cpp; 34s local 2024-12-18T01:09:09.5219250Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2024-12-18T01:09:09.5220148Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 31s local 2024-12-18T01:09:09.5221065Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2024-12-18T01:09:09.5221900Z Compiling torch_xla/csrc/ops/symeig.cpp; 30s local 2024-12-18T01:09:09.5222833Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local ... 2024-12-18T01:09:09.8354171Z 2024-12-18T01:09:09.8355296Z  2024-12-18T01:09:09.8356007Z  2024-12-18T01:09:09.8356611Z  2024-12-18T01:09:09.8356962Z  2024-12-18T01:09:09.8357376Z  2024-12-18T01:09:09.8357799Z  2024-12-18T01:09:09.8358242Z  2024-12-18T01:09:09.8358636Z  2024-12-18T01:09:09.8359432Z [20,417 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:09.8360315Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T01:09:09.8361005Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2024-12-18T01:09:09.8361682Z Compiling torch_xla/csrc/ops/unselect.cpp; 34s local 2024-12-18T01:09:09.8362330Z Compiling torch_xla/csrc/ops/uniform.cpp; 34s local 2024-12-18T01:09:09.8362991Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2024-12-18T01:09:09.8363623Z Compiling torch_xla/csrc/ops/symeig.cpp; 30s local 2024-12-18T01:09:09.8364236Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2024-12-18T01:09:09.8364891Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local ... 2024-12-18T01:09:10.0910482Z 2024-12-18T01:09:10.0911703Z  2024-12-18T01:09:10.0912212Z  2024-12-18T01:09:10.0912570Z  2024-12-18T01:09:10.0912924Z  2024-12-18T01:09:10.0913322Z  2024-12-18T01:09:10.0913697Z  2024-12-18T01:09:10.0914118Z  2024-12-18T01:09:10.0914499Z  2024-12-18T01:09:10.0915426Z [20,417 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:10.0916459Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T01:09:10.0917276Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2024-12-18T01:09:10.0918092Z Compiling torch_xla/csrc/ops/unselect.cpp; 34s local 2024-12-18T01:09:10.0918865Z Compiling torch_xla/csrc/ops/uniform.cpp; 34s local 2024-12-18T01:09:10.0919633Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2024-12-18T01:09:10.0920373Z Compiling torch_xla/csrc/ops/symeig.cpp; 30s local 2024-12-18T01:09:10.0921081Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2024-12-18T01:09:10.0921753Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local ... 2024-12-18T01:09:10.3176884Z 2024-12-18T01:09:10.3178140Z  2024-12-18T01:09:10.3178580Z  2024-12-18T01:09:10.3178945Z  2024-12-18T01:09:10.3179557Z  2024-12-18T01:09:10.3179900Z  2024-12-18T01:09:10.3180257Z  2024-12-18T01:09:10.3180617Z  2024-12-18T01:09:10.3181014Z  2024-12-18T01:09:10.3181881Z [20,418 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:10.3182829Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2024-12-18T01:09:10.3183799Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2024-12-18T01:09:10.3184537Z Compiling torch_xla/csrc/ops/uniform.cpp; 34s local 2024-12-18T01:09:10.3185287Z Compiling torch_xla/csrc/ops/threshold.cpp; 31s local 2024-12-18T01:09:10.3186033Z Compiling torch_xla/csrc/ops/symeig.cpp; 31s local 2024-12-18T01:09:10.3186732Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2024-12-18T01:09:10.3187527Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T01:09:10.3188237Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local ... 2024-12-18T01:09:10.5652984Z 2024-12-18T01:09:10.5653856Z  2024-12-18T01:09:10.5654366Z  2024-12-18T01:09:10.5654715Z  2024-12-18T01:09:10.5655295Z  2024-12-18T01:09:10.5655661Z  2024-12-18T01:09:10.5656040Z  2024-12-18T01:09:10.5656421Z  2024-12-18T01:09:10.5657125Z  2024-12-18T01:09:10.5658036Z [20,419 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:10.5659040Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T01:09:10.5670869Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2024-12-18T01:09:10.5671697Z Compiling torch_xla/csrc/ops/uniform.cpp; 34s local 2024-12-18T01:09:10.5672450Z Compiling torch_xla/csrc/ops/symeig.cpp; 31s local 2024-12-18T01:09:10.5673183Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2024-12-18T01:09:10.5673856Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T01:09:10.5674728Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2024-12-18T01:09:10.5675491Z Compiling torch_xla/csrc/ops/std.cpp; 29s local ... 2024-12-18T01:09:10.8124542Z 2024-12-18T01:09:10.8125714Z  2024-12-18T01:09:10.8127150Z  2024-12-18T01:09:10.8128545Z  2024-12-18T01:09:10.8129574Z  2024-12-18T01:09:10.8130215Z  2024-12-18T01:09:10.8130665Z  2024-12-18T01:09:10.8131067Z  2024-12-18T01:09:10.8131416Z  2024-12-18T01:09:10.8132249Z [20,420 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:10.8133157Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T01:09:10.8133953Z Compiling torch_xla/csrc/ops/update_slice.cpp; 36s local 2024-12-18T01:09:10.8134798Z Compiling torch_xla/csrc/ops/uniform.cpp; 35s local 2024-12-18T01:09:10.8135502Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2024-12-18T01:09:10.8136215Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T01:09:10.8137123Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2024-12-18T01:09:10.8137895Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2024-12-18T01:09:10.8138592Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local ... 2024-12-18T01:09:11.0918195Z 2024-12-18T01:09:11.0919551Z  2024-12-18T01:09:11.0920026Z  2024-12-18T01:09:11.0920401Z  2024-12-18T01:09:11.0920794Z  2024-12-18T01:09:11.0921214Z  2024-12-18T01:09:11.0921600Z  2024-12-18T01:09:11.0921976Z  2024-12-18T01:09:11.0922375Z  2024-12-18T01:09:11.0923300Z [20,420 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:11.0924288Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2024-12-18T01:09:11.0925099Z Compiling torch_xla/csrc/ops/update_slice.cpp; 36s local 2024-12-18T01:09:11.0925902Z Compiling torch_xla/csrc/ops/uniform.cpp; 35s local 2024-12-18T01:09:11.0926641Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2024-12-18T01:09:11.0928098Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2024-12-18T01:09:11.0928840Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2024-12-18T01:09:11.0929727Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2024-12-18T01:09:11.0930608Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local ... 2024-12-18T01:09:11.8445224Z 2024-12-18T01:09:11.8446473Z  2024-12-18T01:09:11.8447283Z  2024-12-18T01:09:11.8447677Z  2024-12-18T01:09:11.8448093Z  2024-12-18T01:09:11.8448467Z  2024-12-18T01:09:11.8448870Z  2024-12-18T01:09:11.8449217Z  2024-12-18T01:09:11.8449580Z  2024-12-18T01:09:11.8450446Z [20,421 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:11.8451490Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2024-12-18T01:09:11.8452284Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2024-12-18T01:09:11.8453741Z Compiling torch_xla/csrc/ops/svd.cpp; 31s local 2024-12-18T01:09:11.8454612Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T01:09:11.8455715Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2024-12-18T01:09:11.8456662Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2024-12-18T01:09:11.8457512Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2024-12-18T01:09:11.8458416Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local ... 2024-12-18T01:09:12.0925004Z 2024-12-18T01:09:12.0926169Z  2024-12-18T01:09:12.0926603Z  2024-12-18T01:09:12.0927234Z  2024-12-18T01:09:12.0927609Z  2024-12-18T01:09:12.0927942Z  2024-12-18T01:09:12.0928333Z  2024-12-18T01:09:12.0928720Z  2024-12-18T01:09:12.0929093Z  2024-12-18T01:09:12.0929931Z [20,421 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:12.0930876Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2024-12-18T01:09:12.0931656Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2024-12-18T01:09:12.0932335Z Compiling torch_xla/csrc/ops/svd.cpp; 31s local 2024-12-18T01:09:12.0933474Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2024-12-18T01:09:12.0934208Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2024-12-18T01:09:12.0935015Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2024-12-18T01:09:12.0935933Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2024-12-18T01:09:12.0937109Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local ... 2024-12-18T01:09:12.2930006Z 2024-12-18T01:09:12.2931201Z  2024-12-18T01:09:12.2932842Z  2024-12-18T01:09:12.2934335Z  2024-12-18T01:09:12.2935802Z  2024-12-18T01:09:12.2937409Z  2024-12-18T01:09:12.2938892Z  2024-12-18T01:09:12.2940195Z  2024-12-18T01:09:12.2940894Z  2024-12-18T01:09:12.2941835Z [20,422 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:12.2942752Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2024-12-18T01:09:12.2943549Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2024-12-18T01:09:12.2944540Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2024-12-18T01:09:12.2945291Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2024-12-18T01:09:12.2945834Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2024-12-18T01:09:12.2946434Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2024-12-18T01:09:12.2947101Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2024-12-18T01:09:12.2947847Z Compiling torch_xla/csrc/ops/split.cpp; 30s local ... 2024-12-18T01:09:12.5883036Z 2024-12-18T01:09:12.5884283Z  2024-12-18T01:09:12.5884700Z  2024-12-18T01:09:12.5885049Z  2024-12-18T01:09:12.5885388Z  2024-12-18T01:09:12.5885721Z  2024-12-18T01:09:12.5886046Z  2024-12-18T01:09:12.5886380Z  2024-12-18T01:09:12.5886981Z  2024-12-18T01:09:12.5887816Z [20,423 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:12.5888691Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T01:09:12.5889376Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2024-12-18T01:09:12.5890077Z Compiling torch_xla/csrc/ops/std_mean.cpp; 31s local 2024-12-18T01:09:12.5890871Z Compiling torch_xla/csrc/ops/std.cpp; 31s local 2024-12-18T01:09:12.5891511Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2024-12-18T01:09:12.5892535Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2024-12-18T01:09:12.5893397Z Compiling torch_xla/csrc/ops/split.cpp; 30s local 2024-12-18T01:09:12.5894265Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local ... 2024-12-18T01:09:12.8933632Z 2024-12-18T01:09:12.8934489Z  2024-12-18T01:09:12.8934868Z  2024-12-18T01:09:12.8935155Z  2024-12-18T01:09:12.8935454Z  2024-12-18T01:09:12.8935783Z  2024-12-18T01:09:12.8936088Z  2024-12-18T01:09:12.8936371Z  2024-12-18T01:09:12.8936818Z  2024-12-18T01:09:12.8937818Z [20,423 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:12.8938573Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T01:09:12.8939141Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2024-12-18T01:09:12.8939694Z Compiling torch_xla/csrc/ops/std_mean.cpp; 31s local 2024-12-18T01:09:12.8940360Z Compiling torch_xla/csrc/ops/std.cpp; 31s local 2024-12-18T01:09:12.8940913Z Compiling torch_xla/csrc/ops/stack.cpp; 31s local 2024-12-18T01:09:12.8941472Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2024-12-18T01:09:12.8942030Z Compiling torch_xla/csrc/ops/split.cpp; 30s local 2024-12-18T01:09:12.8942659Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local ... 2024-12-18T01:09:13.0997029Z 2024-12-18T01:09:13.0998155Z  2024-12-18T01:09:13.0998667Z  2024-12-18T01:09:13.0999093Z  2024-12-18T01:09:13.0999504Z  2024-12-18T01:09:13.0999907Z  2024-12-18T01:09:13.1000290Z  2024-12-18T01:09:13.1000588Z  2024-12-18T01:09:13.1000959Z  2024-12-18T01:09:13.1001729Z [20,425 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:13.1002545Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2024-12-18T01:09:13.1003117Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2024-12-18T01:09:13.1004007Z Compiling torch_xla/csrc/ops/stack.cpp; 31s local 2024-12-18T01:09:13.1004680Z Compiling torch_xla/csrc/ops/squeeze.cpp; 31s local 2024-12-18T01:09:13.1005435Z Compiling torch_xla/csrc/ops/split.cpp; 30s local 2024-12-18T01:09:13.1006287Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2024-12-18T01:09:13.1007233Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2024-12-18T01:09:13.1008084Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 29s local ... 2024-12-18T01:09:13.4939121Z 2024-12-18T01:09:13.4940000Z  2024-12-18T01:09:13.4940493Z  2024-12-18T01:09:13.4940888Z  2024-12-18T01:09:13.4941279Z  2024-12-18T01:09:13.4941632Z  2024-12-18T01:09:13.4941974Z  2024-12-18T01:09:13.4942342Z  2024-12-18T01:09:13.4942705Z  2024-12-18T01:09:13.4943580Z [20,425 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:13.4944840Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:09:13.4945523Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2024-12-18T01:09:13.4946227Z Compiling torch_xla/csrc/ops/stack.cpp; 31s local 2024-12-18T01:09:13.4946939Z Compiling torch_xla/csrc/ops/squeeze.cpp; 31s local 2024-12-18T01:09:13.4947631Z Compiling torch_xla/csrc/ops/split.cpp; 31s local 2024-12-18T01:09:13.4948396Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2024-12-18T01:09:13.4949456Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2024-12-18T01:09:13.4950326Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 29s local ... 2024-12-18T01:09:13.7309286Z 2024-12-18T01:09:13.7310485Z  2024-12-18T01:09:13.7312006Z  2024-12-18T01:09:13.7313635Z  2024-12-18T01:09:13.7314311Z  2024-12-18T01:09:13.7314776Z  2024-12-18T01:09:13.7315471Z  2024-12-18T01:09:13.7315835Z  2024-12-18T01:09:13.7316234Z  2024-12-18T01:09:13.7317162Z [20,427 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:13.7318080Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:09:13.7318850Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2024-12-18T01:09:13.7319600Z Compiling torch_xla/csrc/ops/squeeze.cpp; 31s local 2024-12-18T01:09:13.7320371Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2024-12-18T01:09:13.7321265Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2024-12-18T01:09:13.7322482Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 29s local 2024-12-18T01:09:13.7323423Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T01:09:13.7324289Z Compiling torch_xla/csrc/ops/select.cpp; 27s local ... 2024-12-18T01:09:13.9678179Z 2024-12-18T01:09:13.9679550Z  2024-12-18T01:09:13.9680043Z  2024-12-18T01:09:13.9680402Z  2024-12-18T01:09:13.9680756Z  2024-12-18T01:09:13.9681122Z  2024-12-18T01:09:13.9681769Z  2024-12-18T01:09:13.9682172Z  2024-12-18T01:09:13.9682553Z  2024-12-18T01:09:13.9683454Z [20,428 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:13.9684464Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:09:13.9685205Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2024-12-18T01:09:13.9686012Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 31s local 2024-12-18T01:09:13.9686821Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2024-12-18T01:09:13.9687654Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2024-12-18T01:09:13.9688488Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T01:09:13.9689237Z Compiling torch_xla/csrc/ops/select.cpp; 27s local 2024-12-18T01:09:13.9690109Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local ... 2024-12-18T01:09:14.1715205Z 2024-12-18T01:09:14.1716406Z  2024-12-18T01:09:14.1717924Z  2024-12-18T01:09:14.1719371Z  2024-12-18T01:09:14.1720790Z  2024-12-18T01:09:14.1722207Z  2024-12-18T01:09:14.1723602Z  2024-12-18T01:09:14.1725034Z  2024-12-18T01:09:14.1726455Z  2024-12-18T01:09:14.1728436Z [20,429 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:14.1730570Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2024-12-18T01:09:14.1731634Z Compiling torch_xla/csrc/ops/sum.cpp; 33s local 2024-12-18T01:09:14.1732658Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2024-12-18T01:09:14.1733763Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2024-12-18T01:09:14.1734836Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2024-12-18T01:09:14.1735825Z Compiling torch_xla/csrc/ops/select.cpp; 27s local 2024-12-18T01:09:14.1736996Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2024-12-18T01:09:14.1738145Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 26s local ... 2024-12-18T01:09:14.5453575Z 2024-12-18T01:09:14.5454713Z  2024-12-18T01:09:14.5455184Z  2024-12-18T01:09:14.5455585Z  2024-12-18T01:09:14.5455950Z  2024-12-18T01:09:14.5456302Z  2024-12-18T01:09:14.5456829Z  2024-12-18T01:09:14.5457222Z  2024-12-18T01:09:14.5457633Z  2024-12-18T01:09:14.5458486Z [20,429 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:14.5459933Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2024-12-18T01:09:14.5460778Z Compiling torch_xla/csrc/ops/sum.cpp; 33s local 2024-12-18T01:09:14.5461591Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2024-12-18T01:09:14.5462528Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2024-12-18T01:09:14.5463579Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2024-12-18T01:09:14.5464217Z Compiling torch_xla/csrc/ops/select.cpp; 28s local 2024-12-18T01:09:14.5464858Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2024-12-18T01:09:14.5465516Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 26s local ... 2024-12-18T01:09:15.5460538Z 2024-12-18T01:09:15.5461796Z  2024-12-18T01:09:15.5462298Z  2024-12-18T01:09:15.5462718Z  2024-12-18T01:09:15.5463113Z  2024-12-18T01:09:15.5463525Z  2024-12-18T01:09:15.5463970Z  2024-12-18T01:09:15.5464383Z  2024-12-18T01:09:15.5464755Z  2024-12-18T01:09:15.5465975Z [20,429 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:15.5467014Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T01:09:15.5467767Z Compiling torch_xla/csrc/ops/sum.cpp; 34s local 2024-12-18T01:09:15.5468542Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2024-12-18T01:09:15.5469367Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 31s local 2024-12-18T01:09:15.5470346Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2024-12-18T01:09:15.5471093Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T01:09:15.5471902Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T01:09:15.5472733Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 27s local ... 2024-12-18T01:09:15.7546749Z 2024-12-18T01:09:15.7547620Z  2024-12-18T01:09:15.7548050Z  2024-12-18T01:09:15.7548363Z  2024-12-18T01:09:15.7548697Z  2024-12-18T01:09:15.7549033Z  2024-12-18T01:09:15.7549380Z  2024-12-18T01:09:15.7549745Z  2024-12-18T01:09:15.7550109Z  2024-12-18T01:09:15.7551014Z [20,430 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:15.7551956Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T01:09:15.7552681Z Compiling torch_xla/csrc/ops/sum.cpp; 34s local 2024-12-18T01:09:15.7553390Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2024-12-18T01:09:15.7554085Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2024-12-18T01:09:15.7554790Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T01:09:15.7555566Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T01:09:15.7556412Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2024-12-18T01:09:15.7557228Z Compiling torch_xla/csrc/ops/scatter.cpp; 27s local ... 2024-12-18T01:09:16.1465528Z 2024-12-18T01:09:16.1466794Z  2024-12-18T01:09:16.1467278Z  2024-12-18T01:09:16.1467721Z  2024-12-18T01:09:16.1468105Z  2024-12-18T01:09:16.1468502Z  2024-12-18T01:09:16.1468903Z  2024-12-18T01:09:16.1469294Z  2024-12-18T01:09:16.1469686Z  2024-12-18T01:09:16.1470588Z [20,430 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:16.1471619Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2024-12-18T01:09:16.1472394Z Compiling torch_xla/csrc/ops/sum.cpp; 34s local 2024-12-18T01:09:16.1473146Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2024-12-18T01:09:16.1473978Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2024-12-18T01:09:16.1474784Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2024-12-18T01:09:16.1475574Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2024-12-18T01:09:16.1476769Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2024-12-18T01:09:16.1477609Z Compiling torch_xla/csrc/ops/scatter.cpp; 27s local ... 2024-12-18T01:09:16.8402837Z 2024-12-18T01:09:16.8403903Z  2024-12-18T01:09:16.8404311Z  2024-12-18T01:09:16.8404666Z  2024-12-18T01:09:16.8405004Z  2024-12-18T01:09:16.8405582Z  2024-12-18T01:09:16.8405964Z  2024-12-18T01:09:16.8406617Z  2024-12-18T01:09:16.8406965Z  2024-12-18T01:09:16.8407949Z [20,431 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:16.8408928Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2024-12-18T01:09:16.8409679Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2024-12-18T01:09:16.8410416Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2024-12-18T01:09:16.8411167Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2024-12-18T01:09:16.8411979Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2024-12-18T01:09:16.8412806Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2024-12-18T01:09:16.8413767Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local 2024-12-18T01:09:16.8414560Z Compiling torch_xla/csrc/ops/scalar.cpp; 26s local ... 2024-12-18T01:09:17.1472329Z 2024-12-18T01:09:17.1474397Z  2024-12-18T01:09:17.1474812Z  2024-12-18T01:09:17.1475189Z  2024-12-18T01:09:17.1476057Z  2024-12-18T01:09:17.1476394Z  2024-12-18T01:09:17.1476725Z  2024-12-18T01:09:17.1477208Z  2024-12-18T01:09:17.1477815Z  2024-12-18T01:09:17.1478736Z [20,431 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:17.1479699Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2024-12-18T01:09:17.1480449Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2024-12-18T01:09:17.1481180Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2024-12-18T01:09:17.1481939Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2024-12-18T01:09:17.1482735Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2024-12-18T01:09:17.1483554Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2024-12-18T01:09:17.1484339Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local 2024-12-18T01:09:17.1485114Z Compiling torch_xla/csrc/ops/scalar.cpp; 27s local ... 2024-12-18T01:09:18.0827075Z 2024-12-18T01:09:18.0828068Z  2024-12-18T01:09:18.0828527Z  2024-12-18T01:09:18.0828920Z  2024-12-18T01:09:18.0829315Z  2024-12-18T01:09:18.0829965Z  2024-12-18T01:09:18.0830373Z  2024-12-18T01:09:18.0830772Z  2024-12-18T01:09:18.0831456Z  2024-12-18T01:09:18.0832336Z [20,432 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:18.0833441Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T01:09:18.0834323Z Compiling torch_xla/csrc/ops/sum.cpp; 36s local 2024-12-18T01:09:18.0835173Z Compiling torch_xla/csrc/ops/softmax.cpp; 34s local 2024-12-18T01:09:18.0836017Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2024-12-18T01:09:18.0836871Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2024-12-18T01:09:18.0837764Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2024-12-18T01:09:18.0838636Z Compiling torch_xla/csrc/ops/scalar.cpp; 28s local 2024-12-18T01:09:18.0839629Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 27s local ... 2024-12-18T01:09:18.3091742Z 2024-12-18T01:09:18.3093756Z  2024-12-18T01:09:18.3094216Z  2024-12-18T01:09:18.3094602Z  2024-12-18T01:09:18.3096368Z  2024-12-18T01:09:18.3096819Z  2024-12-18T01:09:18.3098578Z  2024-12-18T01:09:18.3098904Z  2024-12-18T01:09:18.3099571Z  2024-12-18T01:09:18.3100345Z [20,433 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:18.3101556Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2024-12-18T01:09:18.3102279Z Compiling torch_xla/csrc/ops/sum.cpp; 37s local 2024-12-18T01:09:18.3102811Z Compiling torch_xla/csrc/ops/softmax.cpp; 34s local 2024-12-18T01:09:18.3103388Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2024-12-18T01:09:18.3103968Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2024-12-18T01:09:18.3104742Z Compiling torch_xla/csrc/ops/scalar.cpp; 28s local 2024-12-18T01:09:18.3105446Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 27s local 2024-12-18T01:09:18.3106273Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 27s local ... 2024-12-18T01:09:18.5481908Z 2024-12-18T01:09:18.5483258Z  2024-12-18T01:09:18.5484010Z  2024-12-18T01:09:18.5484508Z  2024-12-18T01:09:18.5484975Z  2024-12-18T01:09:18.5485365Z  2024-12-18T01:09:18.5485770Z  2024-12-18T01:09:18.5486190Z  2024-12-18T01:09:18.5486600Z  2024-12-18T01:09:18.5487906Z [20,433 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:18.5489031Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2024-12-18T01:09:18.5489805Z Compiling torch_xla/csrc/ops/sum.cpp; 37s local 2024-12-18T01:09:18.5490684Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2024-12-18T01:09:18.5491595Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2024-12-18T01:09:18.5492669Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2024-12-18T01:09:18.5493495Z Compiling torch_xla/csrc/ops/scalar.cpp; 28s local 2024-12-18T01:09:18.5494489Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 28s local 2024-12-18T01:09:18.5495611Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 27s local ... 2024-12-18T01:09:19.0702313Z 2024-12-18T01:09:19.0703492Z  2024-12-18T01:09:19.0703886Z  2024-12-18T01:09:19.0704250Z  2024-12-18T01:09:19.0704607Z  2024-12-18T01:09:19.0704933Z  2024-12-18T01:09:19.0705254Z  2024-12-18T01:09:19.0705603Z  2024-12-18T01:09:19.0705936Z  2024-12-18T01:09:19.0706762Z [20,434 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:19.0707637Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2024-12-18T01:09:19.0708312Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2024-12-18T01:09:19.0709014Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 31s local 2024-12-18T01:09:19.0709701Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2024-12-18T01:09:19.0710334Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2024-12-18T01:09:19.0711122Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 28s local 2024-12-18T01:09:19.0711935Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 28s local 2024-12-18T01:09:19.0712645Z Compiling torch_xla/csrc/ops/roll.cpp; 26s local ... 2024-12-18T01:09:19.3487795Z 2024-12-18T01:09:19.3488935Z  2024-12-18T01:09:19.3489426Z  2024-12-18T01:09:19.3489926Z  2024-12-18T01:09:19.3490292Z  2024-12-18T01:09:19.3490926Z  2024-12-18T01:09:19.3491340Z  2024-12-18T01:09:19.3491854Z  2024-12-18T01:09:19.3492375Z  2024-12-18T01:09:19.3493449Z [20,434 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:19.3494598Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T01:09:19.3495511Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2024-12-18T01:09:19.3496433Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 31s local 2024-12-18T01:09:19.3497425Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2024-12-18T01:09:19.3498299Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2024-12-18T01:09:19.3499322Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 28s local 2024-12-18T01:09:19.3500700Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 28s local 2024-12-18T01:09:19.3501636Z Compiling torch_xla/csrc/ops/roll.cpp; 27s local ... 2024-12-18T01:09:19.5490735Z 2024-12-18T01:09:19.5491566Z  2024-12-18T01:09:19.5491979Z  2024-12-18T01:09:19.5492313Z  2024-12-18T01:09:19.5492643Z  2024-12-18T01:09:19.5492954Z  2024-12-18T01:09:19.5493536Z  2024-12-18T01:09:19.5493866Z  2024-12-18T01:09:19.5494206Z  2024-12-18T01:09:19.5495014Z [20,435 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:19.5495820Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T01:09:19.5496611Z Compiling torch_xla/csrc/ops/softmax.cpp; 36s local 2024-12-18T01:09:19.5497253Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2024-12-18T01:09:19.5497880Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2024-12-18T01:09:19.5498641Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local 2024-12-18T01:09:19.5499606Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 28s local 2024-12-18T01:09:19.5500291Z Compiling torch_xla/csrc/ops/roll.cpp; 27s local 2024-12-18T01:09:19.5500930Z Compiling torch_xla/csrc/ops/resize.cpp; 23s local ... 2024-12-18T01:09:19.9495742Z 2024-12-18T01:09:19.9497094Z  2024-12-18T01:09:19.9498748Z  2024-12-18T01:09:19.9500226Z  2024-12-18T01:09:19.9501675Z  2024-12-18T01:09:19.9503086Z  2024-12-18T01:09:19.9504489Z  2024-12-18T01:09:19.9505533Z  2024-12-18T01:09:19.9505943Z  2024-12-18T01:09:19.9506830Z [20,435 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:19.9507771Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2024-12-18T01:09:19.9508532Z Compiling torch_xla/csrc/ops/softmax.cpp; 36s local 2024-12-18T01:09:19.9509286Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2024-12-18T01:09:19.9509937Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2024-12-18T01:09:19.9510739Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local 2024-12-18T01:09:19.9511665Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local 2024-12-18T01:09:19.9512447Z Compiling torch_xla/csrc/ops/roll.cpp; 27s local 2024-12-18T01:09:19.9513198Z Compiling torch_xla/csrc/ops/resize.cpp; 24s local ... 2024-12-18T01:09:20.3498735Z 2024-12-18T01:09:20.3499981Z  2024-12-18T01:09:20.3501321Z  2024-12-18T01:09:20.3501808Z  2024-12-18T01:09:20.3502152Z  2024-12-18T01:09:20.3502555Z  2024-12-18T01:09:20.3502941Z  2024-12-18T01:09:20.3503368Z  2024-12-18T01:09:20.3503729Z  2024-12-18T01:09:20.3504619Z [20,436 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:20.3505592Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2024-12-18T01:09:20.3506359Z Compiling torch_xla/csrc/ops/scatter.cpp; 32s local 2024-12-18T01:09:20.3507145Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2024-12-18T01:09:20.3508070Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local 2024-12-18T01:09:20.3509109Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local 2024-12-18T01:09:20.3509960Z Compiling torch_xla/csrc/ops/roll.cpp; 28s local 2024-12-18T01:09:20.3510767Z Compiling torch_xla/csrc/ops/resize.cpp; 24s local 2024-12-18T01:09:20.3511763Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 23s local ... 2024-12-18T01:09:20.7503242Z 2024-12-18T01:09:20.7504282Z  2024-12-18T01:09:20.7504783Z  2024-12-18T01:09:20.7505185Z  2024-12-18T01:09:20.7505608Z  2024-12-18T01:09:20.7505986Z  2024-12-18T01:09:20.7506361Z  2024-12-18T01:09:20.7506751Z  2024-12-18T01:09:20.7507139Z  2024-12-18T01:09:20.7508090Z [20,436 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:20.7509375Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2024-12-18T01:09:20.7510151Z Compiling torch_xla/csrc/ops/scatter.cpp; 32s local 2024-12-18T01:09:20.7510944Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2024-12-18T01:09:20.7511877Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2024-12-18T01:09:20.7513090Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2024-12-18T01:09:20.7514050Z Compiling torch_xla/csrc/ops/roll.cpp; 28s local 2024-12-18T01:09:20.7514773Z Compiling torch_xla/csrc/ops/resize.cpp; 24s local 2024-12-18T01:09:20.7515708Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 24s local ... 2024-12-18T01:09:21.0816793Z 2024-12-18T01:09:21.0817885Z  2024-12-18T01:09:21.0818271Z  2024-12-18T01:09:21.0818579Z  2024-12-18T01:09:21.0818884Z  2024-12-18T01:09:21.0819213Z  2024-12-18T01:09:21.0819561Z  2024-12-18T01:09:21.0819898Z  2024-12-18T01:09:21.0820219Z  2024-12-18T01:09:21.0821268Z [20,437 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:21.0822056Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2024-12-18T01:09:21.0822708Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2024-12-18T01:09:21.0823475Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2024-12-18T01:09:21.0824446Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2024-12-18T01:09:21.0825122Z Compiling torch_xla/csrc/ops/roll.cpp; 28s local 2024-12-18T01:09:21.0825748Z Compiling torch_xla/csrc/ops/resize.cpp; 25s local 2024-12-18T01:09:21.0826486Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 24s local 2024-12-18T01:09:21.0827316Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 24s local ... 2024-12-18T01:09:21.3508835Z 2024-12-18T01:09:21.3510023Z  2024-12-18T01:09:21.3511514Z  2024-12-18T01:09:21.3512928Z  2024-12-18T01:09:21.3514366Z  2024-12-18T01:09:21.3515754Z  2024-12-18T01:09:21.3517343Z  2024-12-18T01:09:21.3518756Z  2024-12-18T01:09:21.3520192Z  2024-12-18T01:09:21.3522201Z [20,437 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:21.3524328Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2024-12-18T01:09:21.3526176Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2024-12-18T01:09:21.3527399Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2024-12-18T01:09:21.3528634Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2024-12-18T01:09:21.3529670Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2024-12-18T01:09:21.3530660Z Compiling torch_xla/csrc/ops/resize.cpp; 25s local 2024-12-18T01:09:21.3531812Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 24s local 2024-12-18T01:09:21.3533057Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 24s local ... 2024-12-18T01:09:21.8935164Z 2024-12-18T01:09:21.8936312Z  2024-12-18T01:09:21.8936872Z  2024-12-18T01:09:21.8937286Z  2024-12-18T01:09:21.8937672Z  2024-12-18T01:09:21.8938071Z  2024-12-18T01:09:21.8938466Z  2024-12-18T01:09:21.8938877Z  2024-12-18T01:09:21.8939281Z  2024-12-18T01:09:21.8940233Z [20,438 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:21.8941239Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2024-12-18T01:09:21.8942056Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2024-12-18T01:09:21.8942932Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 31s local 2024-12-18T01:09:21.8943827Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2024-12-18T01:09:21.8944803Z Compiling torch_xla/csrc/ops/resize.cpp; 26s local 2024-12-18T01:09:21.8946496Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 25s local 2024-12-18T01:09:21.8947443Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 25s local 2024-12-18T01:09:21.8948372Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 25s local ... 2024-12-18T01:09:22.1514496Z 2024-12-18T01:09:22.1515423Z  2024-12-18T01:09:22.1515903Z  2024-12-18T01:09:22.1516803Z  2024-12-18T01:09:22.1517204Z  2024-12-18T01:09:22.1517616Z  2024-12-18T01:09:22.1518022Z  2024-12-18T01:09:22.1518418Z  2024-12-18T01:09:22.1518814Z  2024-12-18T01:09:22.1519758Z [20,439 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:22.1520974Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2024-12-18T01:09:22.1521814Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 31s local 2024-12-18T01:09:22.1522653Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2024-12-18T01:09:22.1523422Z Compiling torch_xla/csrc/ops/resize.cpp; 26s local 2024-12-18T01:09:22.1524515Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 25s local 2024-12-18T01:09:22.1525502Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 25s local 2024-12-18T01:09:22.1526497Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 25s local 2024-12-18T01:09:22.1527567Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 24s local ... 2024-12-18T01:09:22.5518920Z 2024-12-18T01:09:22.5519834Z  2024-12-18T01:09:22.5520555Z  2024-12-18T01:09:22.5520987Z  2024-12-18T01:09:22.5521365Z  2024-12-18T01:09:22.5521745Z  2024-12-18T01:09:22.5522143Z  2024-12-18T01:09:22.5522515Z  2024-12-18T01:09:22.5522888Z  2024-12-18T01:09:22.5523779Z [20,440 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:22.5524764Z Compiling torch_xla/csrc/aten_xla_type.cpp; 73s local 2024-12-18T01:09:22.5525563Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2024-12-18T01:09:22.5526308Z Compiling torch_xla/csrc/ops/resize.cpp; 26s local 2024-12-18T01:09:22.5527181Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 26s local 2024-12-18T01:09:22.5528170Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 25s local 2024-12-18T01:09:22.5529141Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 25s local 2024-12-18T01:09:22.5530123Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 25s local 2024-12-18T01:09:22.5531068Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 22s local ... 2024-12-18T01:09:23.1524552Z 2024-12-18T01:09:23.1525534Z  2024-12-18T01:09:23.1526093Z  2024-12-18T01:09:23.1526588Z  2024-12-18T01:09:23.1528441Z  2024-12-18T01:09:23.1528906Z  2024-12-18T01:09:23.1529383Z  2024-12-18T01:09:23.1531210Z  2024-12-18T01:09:23.1531678Z  2024-12-18T01:09:23.1533809Z [20,441 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:23.1534903Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2024-12-18T01:09:23.1535719Z Compiling torch_xla/csrc/ops/resize.cpp; 27s local 2024-12-18T01:09:23.1536828Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 26s local 2024-12-18T01:09:23.1537915Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 26s local 2024-12-18T01:09:23.1538997Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 26s local 2024-12-18T01:09:23.1540081Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 25s local 2024-12-18T01:09:23.1540900Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 22s local 2024-12-18T01:09:23.1541685Z Compiling torch_xla/csrc/ops/recv.cpp; 19s local ... 2024-12-18T01:09:23.5529046Z 2024-12-18T01:09:23.5530059Z  2024-12-18T01:09:23.5530620Z  2024-12-18T01:09:23.5531117Z  2024-12-18T01:09:23.5531833Z  2024-12-18T01:09:23.5532270Z  2024-12-18T01:09:23.5532675Z  2024-12-18T01:09:23.5533096Z  2024-12-18T01:09:23.5533537Z  2024-12-18T01:09:23.5534551Z [20,441 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:23.5535440Z Compiling torch_xla/csrc/ops/roll.cpp; 31s local 2024-12-18T01:09:23.5536300Z Compiling torch_xla/csrc/ops/resize.cpp; 27s local 2024-12-18T01:09:23.5537375Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 27s local 2024-12-18T01:09:23.5538406Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 26s local 2024-12-18T01:09:23.5539424Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 26s local 2024-12-18T01:09:23.5540451Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 26s local 2024-12-18T01:09:23.5541355Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 23s local 2024-12-18T01:09:23.5542028Z Compiling torch_xla/csrc/ops/recv.cpp; 19s local ... 2024-12-18T01:09:23.7531127Z 2024-12-18T01:09:23.7531957Z  2024-12-18T01:09:23.7532410Z  2024-12-18T01:09:23.7533056Z  2024-12-18T01:09:23.7533431Z  2024-12-18T01:09:23.7533823Z  2024-12-18T01:09:23.7534264Z  2024-12-18T01:09:23.7534591Z  2024-12-18T01:09:23.7534938Z  2024-12-18T01:09:23.7535840Z [20,442 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:23.7537198Z Compiling torch_xla/csrc/ops/resize.cpp; 27s local 2024-12-18T01:09:23.7538169Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 27s local 2024-12-18T01:09:23.7539039Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 27s local 2024-12-18T01:09:23.7539889Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 27s local 2024-12-18T01:09:23.7540769Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 26s local 2024-12-18T01:09:23.7541572Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 23s local 2024-12-18T01:09:23.7542328Z Compiling torch_xla/csrc/ops/recv.cpp; 20s local 2024-12-18T01:09:23.7543082Z Compiling torch_xla/csrc/ops/randperm.cpp; 19s local ... 2024-12-18T01:09:24.1536395Z 2024-12-18T01:09:24.1537542Z  2024-12-18T01:09:24.1539359Z  2024-12-18T01:09:24.1540411Z  2024-12-18T01:09:24.1541801Z  2024-12-18T01:09:24.1543228Z  2024-12-18T01:09:24.1544988Z  2024-12-18T01:09:24.1546469Z  2024-12-18T01:09:24.1547853Z  2024-12-18T01:09:24.1549837Z [20,442 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:24.1551729Z Compiling torch_xla/csrc/ops/resize.cpp; 28s local 2024-12-18T01:09:24.1553676Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 27s local 2024-12-18T01:09:24.1555670Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 27s local 2024-12-18T01:09:24.1556998Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 27s local 2024-12-18T01:09:24.1558243Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 26s local 2024-12-18T01:09:24.1559409Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 23s local 2024-12-18T01:09:24.1560409Z Compiling torch_xla/csrc/ops/recv.cpp; 20s local 2024-12-18T01:09:24.1561442Z Compiling torch_xla/csrc/ops/randperm.cpp; 19s local ... 2024-12-18T01:09:25.1543639Z 2024-12-18T01:09:25.1544993Z  2024-12-18T01:09:25.1545510Z  2024-12-18T01:09:25.1545932Z  2024-12-18T01:09:25.1546327Z  2024-12-18T01:09:25.1546737Z  2024-12-18T01:09:25.1547156Z  2024-12-18T01:09:25.1547573Z  2024-12-18T01:09:25.1547921Z  2024-12-18T01:09:25.1548817Z [20,442 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:25.1549746Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2024-12-18T01:09:25.1550648Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 28s local 2024-12-18T01:09:25.1551918Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 28s local 2024-12-18T01:09:25.1553051Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 28s local 2024-12-18T01:09:25.1553958Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 27s local 2024-12-18T01:09:25.1554843Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 24s local 2024-12-18T01:09:25.1555844Z Compiling torch_xla/csrc/ops/recv.cpp; 21s local 2024-12-18T01:09:25.1556617Z Compiling torch_xla/csrc/ops/randperm.cpp; 20s local ... 2024-12-18T01:09:26.1550934Z 2024-12-18T01:09:26.1551728Z  2024-12-18T01:09:26.1552107Z  2024-12-18T01:09:26.1552414Z  2024-12-18T01:09:26.1552697Z  2024-12-18T01:09:26.1552996Z  2024-12-18T01:09:26.1553295Z  2024-12-18T01:09:26.1553596Z  2024-12-18T01:09:26.1553880Z  2024-12-18T01:09:26.1554586Z [20,442 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:26.1555319Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2024-12-18T01:09:26.1556253Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2024-12-18T01:09:26.1556969Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 29s local 2024-12-18T01:09:26.1557670Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local 2024-12-18T01:09:26.1558379Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 28s local 2024-12-18T01:09:26.1559030Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 25s local 2024-12-18T01:09:26.1559726Z Compiling torch_xla/csrc/ops/recv.cpp; 22s local 2024-12-18T01:09:26.1560310Z Compiling torch_xla/csrc/ops/randperm.cpp; 21s local ... 2024-12-18T01:09:26.6081779Z 2024-12-18T01:09:26.6082678Z  2024-12-18T01:09:26.6083131Z  2024-12-18T01:09:26.6083499Z  2024-12-18T01:09:26.6083885Z  2024-12-18T01:09:26.6084254Z  2024-12-18T01:09:26.6084619Z  2024-12-18T01:09:26.6085002Z  2024-12-18T01:09:26.6085384Z  2024-12-18T01:09:26.6086266Z [20,443 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:26.6087194Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2024-12-18T01:09:26.6087991Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2024-12-18T01:09:26.6088906Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2024-12-18T01:09:26.6089811Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local 2024-12-18T01:09:26.6090759Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 29s local 2024-12-18T01:09:26.6091550Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 26s local 2024-12-18T01:09:26.6092259Z Compiling torch_xla/csrc/ops/recv.cpp; 22s local 2024-12-18T01:09:26.6092989Z Compiling torch_xla/csrc/ops/randperm.cpp; 22s local ... 2024-12-18T01:09:26.9555969Z 2024-12-18T01:09:26.9556824Z  2024-12-18T01:09:26.9557310Z  2024-12-18T01:09:26.9557694Z  2024-12-18T01:09:26.9558027Z  2024-12-18T01:09:26.9558400Z  2024-12-18T01:09:26.9558779Z  2024-12-18T01:09:26.9559161Z  2024-12-18T01:09:26.9559531Z  2024-12-18T01:09:26.9560441Z [20,443 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:26.9561392Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2024-12-18T01:09:26.9562429Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2024-12-18T01:09:26.9563344Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2024-12-18T01:09:26.9564306Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2024-12-18T01:09:26.9565231Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 29s local 2024-12-18T01:09:26.9566112Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 26s local 2024-12-18T01:09:26.9566873Z Compiling torch_xla/csrc/ops/recv.cpp; 23s local 2024-12-18T01:09:27.6074007Z Compiling torch_xla/csrc/ops/randperm.cpp; 22s local ... 2024-12-18T01:09:27.6074670Z 2024-12-18T01:09:27.6075179Z  2024-12-18T01:09:27.6075866Z  2024-12-18T01:09:27.6077437Z  2024-12-18T01:09:27.6078871Z  2024-12-18T01:09:27.6080323Z  2024-12-18T01:09:27.6081734Z  2024-12-18T01:09:27.6083165Z  2024-12-18T01:09:27.6084591Z  2024-12-18T01:09:27.6087016Z [20,444 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:27.6089167Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2024-12-18T01:09:27.6090579Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2024-12-18T01:09:27.6091776Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2024-12-18T01:09:27.6092970Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2024-12-18T01:09:27.6094093Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 27s local 2024-12-18T01:09:27.6095110Z Compiling torch_xla/csrc/ops/recv.cpp; 23s local 2024-12-18T01:09:27.6096352Z Compiling torch_xla/csrc/ops/randperm.cpp; 23s local 2024-12-18T01:09:27.6097428Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 23s local ... 2024-12-18T01:09:27.9563125Z 2024-12-18T01:09:27.9564297Z  2024-12-18T01:09:27.9564790Z  2024-12-18T01:09:27.9565254Z  2024-12-18T01:09:27.9565672Z  2024-12-18T01:09:27.9566030Z  2024-12-18T01:09:27.9566452Z  2024-12-18T01:09:27.9566894Z  2024-12-18T01:09:27.9567667Z  2024-12-18T01:09:27.9568551Z [20,444 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:27.9569642Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2024-12-18T01:09:27.9570606Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2024-12-18T01:09:27.9571580Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2024-12-18T01:09:27.9572564Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2024-12-18T01:09:27.9573460Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 27s local 2024-12-18T01:09:27.9574267Z Compiling torch_xla/csrc/ops/recv.cpp; 24s local 2024-12-18T01:09:27.9575045Z Compiling torch_xla/csrc/ops/randperm.cpp; 23s local 2024-12-18T01:09:27.9575889Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 23s local ... 2024-12-18T01:09:28.2942248Z 2024-12-18T01:09:28.2943100Z  2024-12-18T01:09:28.2943526Z  2024-12-18T01:09:28.2943978Z  2024-12-18T01:09:28.2944610Z  2024-12-18T01:09:28.2944966Z  2024-12-18T01:09:28.2945345Z  2024-12-18T01:09:28.2945777Z  2024-12-18T01:09:28.2946186Z  2024-12-18T01:09:28.2947177Z [20,446 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:28.2948319Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2024-12-18T01:09:28.2949449Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2024-12-18T01:09:28.2950442Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 27s local 2024-12-18T01:09:28.2951187Z Compiling torch_xla/csrc/ops/recv.cpp; 24s local 2024-12-18T01:09:28.2951922Z Compiling torch_xla/csrc/ops/randperm.cpp; 23s local 2024-12-18T01:09:28.2952687Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 23s local 2024-12-18T01:09:28.2953456Z Compiling torch_xla/csrc/ops/qr.cpp; 23s local 2024-12-18T01:09:28.2954193Z Compiling torch_xla/csrc/ops/put.cpp; 23s local ... 2024-12-18T01:09:28.5451409Z 2024-12-18T01:09:28.5452284Z  2024-12-18T01:09:28.5452719Z  2024-12-18T01:09:28.5453104Z  2024-12-18T01:09:28.5453503Z  2024-12-18T01:09:28.5453893Z  2024-12-18T01:09:28.5454290Z  2024-12-18T01:09:28.5454660Z  2024-12-18T01:09:28.5455067Z  2024-12-18T01:09:28.5456018Z [20,447 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:28.5457536Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2024-12-18T01:09:28.5458434Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 28s local 2024-12-18T01:09:28.5459208Z Compiling torch_xla/csrc/ops/recv.cpp; 24s local 2024-12-18T01:09:28.5459964Z Compiling torch_xla/csrc/ops/randperm.cpp; 24s local 2024-12-18T01:09:28.5460930Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 24s local 2024-12-18T01:09:28.5461736Z Compiling torch_xla/csrc/ops/qr.cpp; 24s local 2024-12-18T01:09:28.5462472Z Compiling torch_xla/csrc/ops/put.cpp; 24s local 2024-12-18T01:09:28.5463242Z Compiling torch_xla/csrc/ops/permute.cpp; 23s local ... 2024-12-18T01:09:28.7568673Z 2024-12-18T01:09:28.7569547Z  2024-12-18T01:09:28.7570183Z  2024-12-18T01:09:28.7570555Z  2024-12-18T01:09:28.7570943Z  2024-12-18T01:09:28.7571339Z  2024-12-18T01:09:28.7571727Z  2024-12-18T01:09:28.7572156Z  2024-12-18T01:09:28.7582388Z  2024-12-18T01:09:28.7583998Z [20,447 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:28.7585096Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2024-12-18T01:09:28.7586022Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 28s local 2024-12-18T01:09:28.7586795Z Compiling torch_xla/csrc/ops/recv.cpp; 25s local 2024-12-18T01:09:28.7587504Z Compiling torch_xla/csrc/ops/randperm.cpp; 24s local 2024-12-18T01:09:28.7588503Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 24s local 2024-12-18T01:09:28.7589261Z Compiling torch_xla/csrc/ops/qr.cpp; 24s local 2024-12-18T01:09:28.7589954Z Compiling torch_xla/csrc/ops/put.cpp; 24s local 2024-12-18T01:09:28.7590698Z Compiling torch_xla/csrc/ops/permute.cpp; 23s local ... 2024-12-18T01:09:29.4779919Z 2024-12-18T01:09:29.4780890Z  2024-12-18T01:09:29.4782761Z  2024-12-18T01:09:29.4783865Z  2024-12-18T01:09:29.4785288Z  2024-12-18T01:09:29.4786736Z  2024-12-18T01:09:29.4788103Z  2024-12-18T01:09:29.4789548Z  2024-12-18T01:09:29.4790966Z  2024-12-18T01:09:29.4792965Z [20,448 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:29.4795050Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 28s local 2024-12-18T01:09:29.4796945Z Compiling torch_xla/csrc/ops/recv.cpp; 25s local 2024-12-18T01:09:29.4798867Z Compiling torch_xla/csrc/ops/randperm.cpp; 25s local 2024-12-18T01:09:29.4800672Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 25s local 2024-12-18T01:09:29.4802439Z Compiling torch_xla/csrc/ops/qr.cpp; 25s local 2024-12-18T01:09:29.4804126Z Compiling torch_xla/csrc/ops/put.cpp; 24s local 2024-12-18T01:09:29.4805885Z Compiling torch_xla/csrc/ops/permute.cpp; 24s local 2024-12-18T01:09:29.4806927Z Compiling torch_xla/csrc/ops/prod.cpp; 24s local ... 2024-12-18T01:09:29.7575600Z 2024-12-18T01:09:29.7577125Z  2024-12-18T01:09:29.7577632Z  2024-12-18T01:09:29.7578090Z  2024-12-18T01:09:29.7578497Z  2024-12-18T01:09:29.7578893Z  2024-12-18T01:09:29.7579329Z  2024-12-18T01:09:29.7579733Z  2024-12-18T01:09:29.7580011Z  2024-12-18T01:09:29.7580706Z [20,448 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:29.7581487Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local 2024-12-18T01:09:29.7582144Z Compiling torch_xla/csrc/ops/recv.cpp; 26s local 2024-12-18T01:09:29.7582707Z Compiling torch_xla/csrc/ops/randperm.cpp; 25s local 2024-12-18T01:09:29.7583410Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 25s local 2024-12-18T01:09:29.7584123Z Compiling torch_xla/csrc/ops/qr.cpp; 25s local 2024-12-18T01:09:29.7584819Z Compiling torch_xla/csrc/ops/put.cpp; 25s local 2024-12-18T01:09:29.7585369Z Compiling torch_xla/csrc/ops/permute.cpp; 24s local 2024-12-18T01:09:29.7586242Z Compiling torch_xla/csrc/ops/prod.cpp; 24s local ... 2024-12-18T01:09:30.7583594Z 2024-12-18T01:09:30.7584707Z  2024-12-18T01:09:30.7585219Z  2024-12-18T01:09:30.7585650Z  2024-12-18T01:09:30.7586073Z  2024-12-18T01:09:30.7586457Z  2024-12-18T01:09:30.7586849Z  2024-12-18T01:09:30.7587424Z  2024-12-18T01:09:30.7588149Z  2024-12-18T01:09:30.7589140Z [20,448 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:30.7590148Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2024-12-18T01:09:30.7590810Z Compiling torch_xla/csrc/ops/recv.cpp; 27s local 2024-12-18T01:09:30.7591422Z Compiling torch_xla/csrc/ops/randperm.cpp; 26s local 2024-12-18T01:09:30.7592098Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 26s local 2024-12-18T01:09:30.7592729Z Compiling torch_xla/csrc/ops/qr.cpp; 26s local 2024-12-18T01:09:30.7593334Z Compiling torch_xla/csrc/ops/put.cpp; 26s local 2024-12-18T01:09:30.7594082Z Compiling torch_xla/csrc/ops/permute.cpp; 25s local 2024-12-18T01:09:30.7594719Z Compiling torch_xla/csrc/ops/prod.cpp; 25s local ... 2024-12-18T01:09:31.7591610Z 2024-12-18T01:09:31.7593769Z  2024-12-18T01:09:31.7594351Z  2024-12-18T01:09:31.7594865Z  2024-12-18T01:09:31.7595377Z  2024-12-18T01:09:31.7595881Z  2024-12-18T01:09:31.7596370Z  2024-12-18T01:09:31.7596855Z  2024-12-18T01:09:31.7597513Z  2024-12-18T01:09:31.7598794Z [20,448 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:31.7599890Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2024-12-18T01:09:31.7600833Z Compiling torch_xla/csrc/ops/recv.cpp; 28s local 2024-12-18T01:09:31.7601688Z Compiling torch_xla/csrc/ops/randperm.cpp; 27s local 2024-12-18T01:09:31.7602594Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 27s local 2024-12-18T01:09:31.7603492Z Compiling torch_xla/csrc/ops/qr.cpp; 27s local 2024-12-18T01:09:31.7604343Z Compiling torch_xla/csrc/ops/put.cpp; 27s local 2024-12-18T01:09:31.7605225Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local 2024-12-18T01:09:31.7606075Z Compiling torch_xla/csrc/ops/prod.cpp; 26s local ... 2024-12-18T01:09:32.7598142Z 2024-12-18T01:09:32.7600434Z  2024-12-18T01:09:32.7600949Z  2024-12-18T01:09:32.7602387Z  2024-12-18T01:09:32.7602758Z  2024-12-18T01:09:32.7603136Z  2024-12-18T01:09:32.7603545Z  2024-12-18T01:09:32.7603936Z  2024-12-18T01:09:32.7604332Z  2024-12-18T01:09:32.7605588Z [20,448 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:32.7606817Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 32s local 2024-12-18T01:09:32.7607762Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local 2024-12-18T01:09:32.7608703Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local 2024-12-18T01:09:32.7609682Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 28s local 2024-12-18T01:09:32.7610577Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local 2024-12-18T01:09:32.7611414Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2024-12-18T01:09:32.7612332Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local 2024-12-18T01:09:32.7613204Z Compiling torch_xla/csrc/ops/prod.cpp; 27s local ... 2024-12-18T01:09:33.0868188Z 2024-12-18T01:09:33.0869420Z  2024-12-18T01:09:33.0871008Z  2024-12-18T01:09:33.0872398Z  2024-12-18T01:09:33.0873752Z  2024-12-18T01:09:33.0875147Z  2024-12-18T01:09:33.0876534Z  2024-12-18T01:09:33.0878112Z  2024-12-18T01:09:33.0879508Z  2024-12-18T01:09:33.0880810Z [20,449 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:33.0881866Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local 2024-12-18T01:09:33.0883083Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local 2024-12-18T01:09:33.0883878Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 28s local 2024-12-18T01:09:33.0884603Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local 2024-12-18T01:09:33.0885258Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2024-12-18T01:09:33.0885999Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2024-12-18T01:09:33.0886856Z Compiling torch_xla/csrc/ops/prod.cpp; 28s local 2024-12-18T01:09:33.0887693Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local ... 2024-12-18T01:09:33.3603149Z 2024-12-18T01:09:33.3605422Z  2024-12-18T01:09:33.3606039Z  2024-12-18T01:09:33.3606574Z  2024-12-18T01:09:33.3607092Z  2024-12-18T01:09:33.3607605Z  2024-12-18T01:09:33.3608114Z  2024-12-18T01:09:33.3608625Z  2024-12-18T01:09:33.3609120Z  2024-12-18T01:09:33.3610122Z [20,449 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:33.3611631Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local 2024-12-18T01:09:33.3612691Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local 2024-12-18T01:09:33.3613594Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 28s local 2024-12-18T01:09:33.3614452Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local 2024-12-18T01:09:33.3615298Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2024-12-18T01:09:33.3616120Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2024-12-18T01:09:33.3617290Z Compiling torch_xla/csrc/ops/prod.cpp; 28s local 2024-12-18T01:09:33.3618221Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local ... 2024-12-18T01:09:34.3611678Z 2024-12-18T01:09:34.3612751Z  2024-12-18T01:09:34.3613838Z  2024-12-18T01:09:34.3615228Z  2024-12-18T01:09:34.3616724Z  2024-12-18T01:09:34.3618140Z  2024-12-18T01:09:34.3619691Z  2024-12-18T01:09:34.3621124Z  2024-12-18T01:09:34.3622460Z  2024-12-18T01:09:34.3624410Z [20,449 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:34.3626386Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2024-12-18T01:09:34.3628132Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local 2024-12-18T01:09:34.3629927Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 29s local 2024-12-18T01:09:34.3631588Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local 2024-12-18T01:09:34.3633239Z Compiling torch_xla/csrc/ops/put.cpp; 29s local 2024-12-18T01:09:34.3634402Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2024-12-18T01:09:34.3635358Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local 2024-12-18T01:09:34.3636477Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local ... 2024-12-18T01:09:35.3617804Z 2024-12-18T01:09:35.3618992Z  2024-12-18T01:09:35.3619479Z  2024-12-18T01:09:35.3619935Z  2024-12-18T01:09:35.3620358Z  2024-12-18T01:09:35.3620726Z  2024-12-18T01:09:35.3621182Z  2024-12-18T01:09:35.3621545Z  2024-12-18T01:09:35.3621837Z  2024-12-18T01:09:35.3622548Z [20,450 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:35.3623301Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2024-12-18T01:09:35.3623906Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2024-12-18T01:09:35.3624621Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2024-12-18T01:09:35.3625383Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local 2024-12-18T01:09:35.3626089Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2024-12-18T01:09:35.3626836Z Compiling torch_xla/csrc/ops/permute.cpp; 30s local 2024-12-18T01:09:35.3627569Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2024-12-18T01:09:35.3628408Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local ... 2024-12-18T01:09:35.6289335Z 2024-12-18T01:09:35.6290447Z  2024-12-18T01:09:35.6290911Z  2024-12-18T01:09:35.6291310Z  2024-12-18T01:09:35.6291710Z  2024-12-18T01:09:35.6292343Z  2024-12-18T01:09:35.6292774Z  2024-12-18T01:09:35.6293286Z  2024-12-18T01:09:35.6293804Z  2024-12-18T01:09:35.6294858Z [20,451 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:09:35.6296270Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2024-12-18T01:09:35.6297327Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2024-12-18T01:09:35.6298168Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T01:09:35.6299032Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2024-12-18T01:09:35.6299877Z Compiling torch_xla/csrc/ops/permute.cpp; 30s local 2024-12-18T01:09:35.6300690Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2024-12-18T01:09:35.6301605Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2024-12-18T01:09:35.6302595Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local ... 2024-12-18T01:09:35.9761926Z 2024-12-18T01:09:35.9762819Z  2024-12-18T01:09:35.9763306Z  2024-12-18T01:09:35.9763719Z  2024-12-18T01:09:35.9764115Z  2024-12-18T01:09:35.9764527Z  2024-12-18T01:09:35.9764905Z  2024-12-18T01:09:35.9765324Z  2024-12-18T01:09:35.9765706Z  2024-12-18T01:09:35.9766813Z [20,452 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:35.9767781Z Compiling torch_xla/csrc/ops/recv.cpp; 32s local 2024-12-18T01:09:35.9768466Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T01:09:35.9769035Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2024-12-18T01:09:35.9769705Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T01:09:35.9770449Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2024-12-18T01:09:35.9771331Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2024-12-18T01:09:35.9772251Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T01:09:35.9773048Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local ... 2024-12-18T01:09:36.2083252Z 2024-12-18T01:09:36.2084508Z  2024-12-18T01:09:36.2085983Z  2024-12-18T01:09:36.2087366Z  2024-12-18T01:09:36.2088804Z  2024-12-18T01:09:36.2090200Z  2024-12-18T01:09:36.2091545Z  2024-12-18T01:09:36.2092939Z  2024-12-18T01:09:36.2094373Z  2024-12-18T01:09:36.2096333Z [20,453 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:36.2097693Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T01:09:36.2098656Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2024-12-18T01:09:36.2099636Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T01:09:36.2100625Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2024-12-18T01:09:36.2101756Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T01:09:36.2102897Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T01:09:36.2103923Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2024-12-18T01:09:36.2104946Z Compiling test/cpp/test_xla_sharding.cpp; 27s local ... 2024-12-18T01:09:36.4295399Z 2024-12-18T01:09:36.4296677Z  2024-12-18T01:09:36.4297170Z  2024-12-18T01:09:36.4297597Z  2024-12-18T01:09:36.4298020Z  2024-12-18T01:09:36.4298681Z  2024-12-18T01:09:36.4299106Z  2024-12-18T01:09:36.4299505Z  2024-12-18T01:09:36.4299923Z  2024-12-18T01:09:36.4300907Z [20,453 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:36.4302111Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2024-12-18T01:09:36.4303043Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2024-12-18T01:09:36.4304248Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T01:09:36.4305210Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2024-12-18T01:09:36.4306281Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T01:09:36.4307320Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2024-12-18T01:09:36.4308260Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2024-12-18T01:09:36.4309358Z Compiling test/cpp/test_xla_sharding.cpp; 27s local ... 2024-12-18T01:09:36.7326217Z 2024-12-18T01:09:36.7327393Z  2024-12-18T01:09:36.7327905Z  2024-12-18T01:09:36.7328320Z  2024-12-18T01:09:36.7328753Z  2024-12-18T01:09:36.7329161Z  2024-12-18T01:09:36.7329620Z  2024-12-18T01:09:36.7330009Z  2024-12-18T01:09:36.7330342Z  2024-12-18T01:09:36.7331286Z [20,454 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:36.7332265Z Compiling torch_xla/csrc/ops/qr.cpp; 32s local 2024-12-18T01:09:36.7333032Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2024-12-18T01:09:36.7334108Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2024-12-18T01:09:36.7334983Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T01:09:36.7335805Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2024-12-18T01:09:36.7336420Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T01:09:36.7337192Z Compiling test/cpp/test_xla_sharding.cpp; 27s local 2024-12-18T01:09:36.7337988Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local ... 2024-12-18T01:09:37.0301020Z 2024-12-18T01:09:37.0302197Z  2024-12-18T01:09:37.0302663Z  2024-12-18T01:09:37.0303058Z  2024-12-18T01:09:37.0303456Z  2024-12-18T01:09:37.0304047Z  2024-12-18T01:09:37.0304500Z  2024-12-18T01:09:37.0304940Z  2024-12-18T01:09:37.0305466Z  2024-12-18T01:09:37.0306603Z [20,454 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:37.0307578Z Compiling torch_xla/csrc/ops/qr.cpp; 32s local 2024-12-18T01:09:37.0308368Z Compiling torch_xla/csrc/ops/permute.cpp; 32s local 2024-12-18T01:09:37.0309171Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2024-12-18T01:09:37.0310075Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2024-12-18T01:09:37.0311016Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2024-12-18T01:09:37.0311799Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T01:09:37.0312573Z Compiling test/cpp/test_xla_sharding.cpp; 28s local 2024-12-18T01:09:37.0313474Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local ... 2024-12-18T01:09:37.4304814Z 2024-12-18T01:09:37.4305980Z  2024-12-18T01:09:37.4306385Z  2024-12-18T01:09:37.4306714Z  2024-12-18T01:09:37.4307047Z  2024-12-18T01:09:37.4307372Z  2024-12-18T01:09:37.4307719Z  2024-12-18T01:09:37.4308045Z  2024-12-18T01:09:37.4308366Z  2024-12-18T01:09:37.4309156Z [20,455 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:37.4309929Z Compiling torch_xla/csrc/ops/qr.cpp; 32s local 2024-12-18T01:09:37.4310512Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2024-12-18T01:09:37.4311202Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2024-12-18T01:09:37.4312353Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2024-12-18T01:09:37.4313079Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2024-12-18T01:09:37.4313841Z Compiling test/cpp/test_xla_sharding.cpp; 28s local 2024-12-18T01:09:37.4314706Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2024-12-18T01:09:37.4315493Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local ... 2024-12-18T01:09:38.4312513Z 2024-12-18T01:09:38.4313397Z  2024-12-18T01:09:38.4314108Z  2024-12-18T01:09:38.4314487Z  2024-12-18T01:09:38.4314828Z  2024-12-18T01:09:38.4315138Z  2024-12-18T01:09:38.4315477Z  2024-12-18T01:09:38.4315801Z  2024-12-18T01:09:38.4316127Z  2024-12-18T01:09:38.4317039Z [20,456 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:38.4317965Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2024-12-18T01:09:38.4318961Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2024-12-18T01:09:38.4319846Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2024-12-18T01:09:38.4320628Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2024-12-18T01:09:38.4321342Z Compiling test/cpp/test_xla_sharding.cpp; 29s local 2024-12-18T01:09:38.4322140Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2024-12-18T01:09:38.4322938Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2024-12-18T01:09:38.4323659Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local ... 2024-12-18T01:09:38.8315719Z 2024-12-18T01:09:38.8316830Z  2024-12-18T01:09:38.8317511Z  2024-12-18T01:09:38.8318072Z  2024-12-18T01:09:38.8318550Z  2024-12-18T01:09:38.8319065Z  2024-12-18T01:09:38.8319584Z  2024-12-18T01:09:38.8320077Z  2024-12-18T01:09:38.8320582Z  2024-12-18T01:09:38.8321611Z [20,456 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:38.8322827Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2024-12-18T01:09:38.8323749Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2024-12-18T01:09:38.8324714Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 32s local 2024-12-18T01:09:38.8325558Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2024-12-18T01:09:38.8326367Z Compiling test/cpp/test_xla_sharding.cpp; 30s local 2024-12-18T01:09:38.8327292Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2024-12-18T01:09:38.8328175Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2024-12-18T01:09:38.8329003Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local ... 2024-12-18T01:09:39.8323262Z 2024-12-18T01:09:39.8325414Z  2024-12-18T01:09:39.8325891Z  2024-12-18T01:09:39.8327241Z  2024-12-18T01:09:39.8327589Z  2024-12-18T01:09:39.8327932Z  2024-12-18T01:09:39.8328298Z  2024-12-18T01:09:39.8328758Z  2024-12-18T01:09:39.8329286Z  2024-12-18T01:09:39.8330301Z [20,456 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:39.8331243Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2024-12-18T01:09:39.8332175Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2024-12-18T01:09:39.8333073Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2024-12-18T01:09:39.8333878Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2024-12-18T01:09:39.8334693Z Compiling test/cpp/test_xla_sharding.cpp; 31s local 2024-12-18T01:09:39.8335575Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2024-12-18T01:09:39.8336407Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2024-12-18T01:09:39.8337310Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local ... 2024-12-18T01:09:40.2327653Z 2024-12-18T01:09:40.2328775Z  2024-12-18T01:09:40.2329272Z  2024-12-18T01:09:40.2329666Z  2024-12-18T01:09:40.2330030Z  2024-12-18T01:09:40.2330418Z  2024-12-18T01:09:40.2331010Z  2024-12-18T01:09:40.2331495Z  2024-12-18T01:09:40.2332028Z  2024-12-18T01:09:40.2333105Z [20,457 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:40.2334041Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:09:40.2334932Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 34s local 2024-12-18T01:09:40.2336124Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2024-12-18T01:09:40.2337026Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2024-12-18T01:09:40.2337962Z Compiling test/cpp/test_xla_sharding.cpp; 31s local 2024-12-18T01:09:40.2338781Z Compiling torch_xla/csrc/ops/not_supported.cpp; 31s local 2024-12-18T01:09:40.2339530Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2024-12-18T01:09:40.2340360Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local ... 2024-12-18T01:09:40.4331697Z 2024-12-18T01:09:40.4332895Z  2024-12-18T01:09:40.4333666Z  2024-12-18T01:09:40.4334260Z  2024-12-18T01:09:40.4334674Z  2024-12-18T01:09:40.4335089Z  2024-12-18T01:09:40.4335501Z  2024-12-18T01:09:40.4335914Z  2024-12-18T01:09:40.4336301Z  2024-12-18T01:09:40.4337395Z [20,457 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:40.4338402Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:09:40.4339039Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 34s local 2024-12-18T01:09:40.4340010Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2024-12-18T01:09:40.4340588Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2024-12-18T01:09:40.4341118Z Compiling test/cpp/test_xla_sharding.cpp; 31s local 2024-12-18T01:09:40.4341690Z Compiling torch_xla/csrc/ops/not_supported.cpp; 31s local 2024-12-18T01:09:40.4342262Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2024-12-18T01:09:40.4342931Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local ... 2024-12-18T01:09:40.6481275Z 2024-12-18T01:09:40.6482362Z  2024-12-18T01:09:40.6482738Z  2024-12-18T01:09:40.6483043Z  2024-12-18T01:09:40.6483321Z  2024-12-18T01:09:40.6483846Z  2024-12-18T01:09:40.6484237Z  2024-12-18T01:09:40.6484675Z  2024-12-18T01:09:40.6485170Z  2024-12-18T01:09:40.6486139Z [20,458 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:40.6487057Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:09:40.6487934Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 34s local 2024-12-18T01:09:40.6488778Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T01:09:40.6489544Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2024-12-18T01:09:40.6490304Z Compiling test/cpp/test_xla_sharding.cpp; 31s local 2024-12-18T01:09:40.6491083Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2024-12-18T01:09:40.6491835Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2024-12-18T01:09:40.6492537Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local ... 2024-12-18T01:09:40.8883884Z 2024-12-18T01:09:40.8885136Z  2024-12-18T01:09:40.8886639Z  2024-12-18T01:09:40.8888040Z  2024-12-18T01:09:40.8889479Z  2024-12-18T01:09:40.8890887Z  2024-12-18T01:09:40.8892295Z  2024-12-18T01:09:40.8893731Z  2024-12-18T01:09:40.8895147Z  2024-12-18T01:09:40.8897318Z [20,460 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:40.8898523Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2024-12-18T01:09:40.8899589Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T01:09:40.8900609Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2024-12-18T01:09:40.8901617Z Compiling test/cpp/test_xla_sharding.cpp; 32s local 2024-12-18T01:09:40.8902636Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2024-12-18T01:09:40.8903626Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local 2024-12-18T01:09:40.8904678Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local 2024-12-18T01:09:40.8905881Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local ... 2024-12-18T01:09:41.2336110Z 2024-12-18T01:09:41.2337432Z  2024-12-18T01:09:41.2337918Z  2024-12-18T01:09:41.2338664Z  2024-12-18T01:09:41.2339054Z  2024-12-18T01:09:41.2339489Z  2024-12-18T01:09:41.2339879Z  2024-12-18T01:09:41.2340219Z  2024-12-18T01:09:41.2340553Z  2024-12-18T01:09:41.2341522Z [20,461 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:41.2342408Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2024-12-18T01:09:41.2343329Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T01:09:41.2344068Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2024-12-18T01:09:41.2345245Z Compiling test/cpp/test_xla_sharding.cpp; 32s local 2024-12-18T01:09:41.2345983Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2024-12-18T01:09:41.2346772Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2024-12-18T01:09:41.2347639Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2024-12-18T01:09:41.2348519Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local ... 2024-12-18T01:09:41.4339480Z 2024-12-18T01:09:41.4340826Z  2024-12-18T01:09:41.4341325Z  2024-12-18T01:09:41.4342069Z  2024-12-18T01:09:41.4342487Z  2024-12-18T01:09:41.4342889Z  2024-12-18T01:09:41.4343323Z  2024-12-18T01:09:41.4343662Z  2024-12-18T01:09:41.4343996Z  2024-12-18T01:09:41.4345060Z [20,461 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:41.4345966Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2024-12-18T01:09:41.4346884Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2024-12-18T01:09:41.4347526Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2024-12-18T01:09:41.4348071Z Compiling test/cpp/test_xla_sharding.cpp; 32s local 2024-12-18T01:09:41.4348617Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2024-12-18T01:09:41.4349203Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2024-12-18T01:09:41.4349878Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2024-12-18T01:09:41.4350532Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local ... 2024-12-18T01:09:41.8964837Z 2024-12-18T01:09:41.8966046Z  2024-12-18T01:09:41.8966500Z  2024-12-18T01:09:41.8966990Z  2024-12-18T01:09:41.8967513Z  2024-12-18T01:09:41.8967869Z  2024-12-18T01:09:41.8968263Z  2024-12-18T01:09:41.8968618Z  2024-12-18T01:09:41.8969004Z  2024-12-18T01:09:41.8969884Z [20,462 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:41.8970852Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2024-12-18T01:09:41.8971637Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T01:09:41.8972397Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2024-12-18T01:09:41.8973138Z Compiling test/cpp/test_xla_sharding.cpp; 33s local 2024-12-18T01:09:41.8974365Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2024-12-18T01:09:41.8975220Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2024-12-18T01:09:41.8976242Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2024-12-18T01:09:41.8977296Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local ... 2024-12-18T01:09:42.2345662Z 2024-12-18T01:09:42.2346518Z  2024-12-18T01:09:42.2346930Z  2024-12-18T01:09:42.2347245Z  2024-12-18T01:09:42.2347552Z  2024-12-18T01:09:42.2347843Z  2024-12-18T01:09:42.2348148Z  2024-12-18T01:09:42.2348461Z  2024-12-18T01:09:42.2348761Z  2024-12-18T01:09:42.2349478Z [20,462 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:42.2350187Z Compiling torch_xla/csrc/ops/prod.cpp; 37s local 2024-12-18T01:09:42.2350854Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T01:09:42.2351714Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2024-12-18T01:09:42.2352689Z Compiling test/cpp/test_xla_sharding.cpp; 33s local 2024-12-18T01:09:42.2353370Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2024-12-18T01:09:42.2354108Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2024-12-18T01:09:42.2354924Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2024-12-18T01:09:42.2355705Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local ... 2024-12-18T01:09:42.4348276Z 2024-12-18T01:09:42.4349181Z  2024-12-18T01:09:42.4349638Z  2024-12-18T01:09:42.4350052Z  2024-12-18T01:09:42.4350410Z  2024-12-18T01:09:42.4350772Z  2024-12-18T01:09:42.4351133Z  2024-12-18T01:09:42.4351479Z  2024-12-18T01:09:42.4351855Z  2024-12-18T01:09:42.4352729Z [20,464 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:09:42.4353707Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2024-12-18T01:09:42.4354479Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2024-12-18T01:09:42.4355427Z Compiling test/cpp/test_xla_sharding.cpp; 33s local 2024-12-18T01:09:42.4356198Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2024-12-18T01:09:42.4356924Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2024-12-18T01:09:42.4357873Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2024-12-18T01:09:42.4358648Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2024-12-18T01:09:42.4359793Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local ... 2024-12-18T01:09:42.6601086Z 2024-12-18T01:09:42.6603255Z  2024-12-18T01:09:42.6603878Z  2024-12-18T01:09:42.6604429Z  2024-12-18T01:09:42.6604929Z  2024-12-18T01:09:42.6605451Z  2024-12-18T01:09:42.6605964Z  2024-12-18T01:09:42.6606478Z  2024-12-18T01:09:42.6606988Z  2024-12-18T01:09:42.6608035Z [20,465 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:42.6609251Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2024-12-18T01:09:42.6610132Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2024-12-18T01:09:42.6610982Z Compiling test/cpp/test_xla_sharding.cpp; 33s local 2024-12-18T01:09:42.6611855Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2024-12-18T01:09:42.6612733Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2024-12-18T01:09:42.6613674Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2024-12-18T01:09:42.6614749Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T01:09:42.6615899Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local ... 2024-12-18T01:09:43.0354267Z 2024-12-18T01:09:43.0355494Z  2024-12-18T01:09:43.0357141Z  2024-12-18T01:09:43.0358559Z  2024-12-18T01:09:43.0360004Z  2024-12-18T01:09:43.0361415Z  2024-12-18T01:09:43.0362836Z  2024-12-18T01:09:43.0364310Z  2024-12-18T01:09:43.0365738Z  2024-12-18T01:09:43.0367312Z [20,465 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:43.0368441Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2024-12-18T01:09:43.0369306Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2024-12-18T01:09:43.0370067Z Compiling test/cpp/test_xla_sharding.cpp; 34s local 2024-12-18T01:09:43.0370752Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2024-12-18T01:09:43.0371513Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 32s local 2024-12-18T01:09:43.0372283Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 31s local 2024-12-18T01:09:43.0373389Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2024-12-18T01:09:43.0374581Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local ... 2024-12-18T01:09:43.3911528Z 2024-12-18T01:09:43.3912803Z  2024-12-18T01:09:43.3913249Z  2024-12-18T01:09:43.3913608Z  2024-12-18T01:09:43.3913976Z  2024-12-18T01:09:43.3914649Z  2024-12-18T01:09:43.3915057Z  2024-12-18T01:09:43.3915547Z  2024-12-18T01:09:43.3916076Z  2024-12-18T01:09:43.3917127Z [20,466 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:43.3918477Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2024-12-18T01:09:43.3919390Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2024-12-18T01:09:43.3920263Z Compiling test/cpp/test_xla_sharding.cpp; 34s local 2024-12-18T01:09:43.3921130Z Compiling torch_xla/csrc/ops/nonzero.cpp; 34s local 2024-12-18T01:09:43.3922062Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 31s local 2024-12-18T01:09:43.3923135Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2024-12-18T01:09:43.3924252Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2024-12-18T01:09:43.3925318Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local ... 2024-12-18T01:09:43.6193725Z 2024-12-18T01:09:43.6195526Z  2024-12-18T01:09:43.6197206Z  2024-12-18T01:09:43.6198620Z  2024-12-18T01:09:43.6200035Z  2024-12-18T01:09:43.6201451Z  2024-12-18T01:09:43.6202874Z  2024-12-18T01:09:43.6204300Z  2024-12-18T01:09:43.6205703Z  2024-12-18T01:09:43.6207238Z [20,467 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:43.6208763Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2024-12-18T01:09:43.6209800Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T01:09:43.6210793Z Compiling test/cpp/test_xla_sharding.cpp; 34s local 2024-12-18T01:09:43.6211805Z Compiling torch_xla/csrc/ops/nonzero.cpp; 34s local 2024-12-18T01:09:43.6212977Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2024-12-18T01:09:43.6214287Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2024-12-18T01:09:43.6215494Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T01:09:43.6216761Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local ... 2024-12-18T01:09:43.8239973Z 2024-12-18T01:09:43.8241146Z  2024-12-18T01:09:43.8241665Z  2024-12-18T01:09:43.8242135Z  2024-12-18T01:09:43.8242548Z  2024-12-18T01:09:43.8242950Z  2024-12-18T01:09:43.8243398Z  2024-12-18T01:09:43.8243767Z  2024-12-18T01:09:43.8244122Z  2024-12-18T01:09:43.8245231Z [20,468 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:43.8246245Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T01:09:43.8246892Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T01:09:43.8247512Z Compiling test/cpp/test_xla_sharding.cpp; 35s local 2024-12-18T01:09:43.8248369Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2024-12-18T01:09:43.8249335Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2024-12-18T01:09:43.8250217Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T01:09:43.8251023Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T01:09:43.8251886Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local ... 2024-12-18T01:09:44.0360180Z 2024-12-18T01:09:44.0361084Z  2024-12-18T01:09:44.0361550Z  2024-12-18T01:09:44.0361971Z  2024-12-18T01:09:44.0362352Z  2024-12-18T01:09:44.0362756Z  2024-12-18T01:09:44.0363318Z  2024-12-18T01:09:44.0363688Z  2024-12-18T01:09:44.0364056Z  2024-12-18T01:09:44.0364990Z [20,469 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:44.0366001Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T01:09:44.0367061Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T01:09:44.0367774Z Compiling test/cpp/test_xla_sharding.cpp; 35s local 2024-12-18T01:09:44.0368664Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2024-12-18T01:09:44.0369628Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2024-12-18T01:09:44.0370648Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2024-12-18T01:09:44.0371707Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T01:09:44.0372555Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local ... 2024-12-18T01:09:44.2475430Z 2024-12-18T01:09:44.2476295Z  2024-12-18T01:09:44.2476760Z  2024-12-18T01:09:44.2477132Z  2024-12-18T01:09:44.2477490Z  2024-12-18T01:09:44.2477874Z  2024-12-18T01:09:44.2478255Z  2024-12-18T01:09:44.2478657Z  2024-12-18T01:09:44.2479024Z  2024-12-18T01:09:44.2479968Z [20,470 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:44.2481290Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T01:09:44.2482107Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2024-12-18T01:09:44.2482851Z Compiling test/cpp/test_xla_sharding.cpp; 35s local 2024-12-18T01:09:44.2483659Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2024-12-18T01:09:44.2484568Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 31s local 2024-12-18T01:09:44.2485527Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T01:09:44.2486300Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2024-12-18T01:09:44.2487191Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local ... 2024-12-18T01:09:44.5472666Z 2024-12-18T01:09:44.5473713Z  2024-12-18T01:09:44.5474578Z  2024-12-18T01:09:44.5475373Z  2024-12-18T01:09:44.5476199Z  2024-12-18T01:09:44.5477036Z  2024-12-18T01:09:44.5477870Z  2024-12-18T01:09:44.5478700Z  2024-12-18T01:09:44.5479533Z  2024-12-18T01:09:44.5480959Z [20,471 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:44.5482247Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2024-12-18T01:09:44.5484112Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2024-12-18T01:09:44.5485705Z Compiling test/cpp/test_xla_sharding.cpp; 35s local 2024-12-18T01:09:44.5486702Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2024-12-18T01:09:44.5487720Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2024-12-18T01:09:44.5488751Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2024-12-18T01:09:44.5489738Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T01:09:44.5490794Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local ... 2024-12-18T01:09:44.8366920Z 2024-12-18T01:09:44.8368065Z  2024-12-18T01:09:44.8368485Z  2024-12-18T01:09:44.8368800Z  2024-12-18T01:09:44.8369091Z  2024-12-18T01:09:44.8369407Z  2024-12-18T01:09:44.8369734Z  2024-12-18T01:09:44.8370039Z  2024-12-18T01:09:44.8370346Z  2024-12-18T01:09:44.8371081Z [20,471 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:44.8371922Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 38s local 2024-12-18T01:09:44.8372666Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2024-12-18T01:09:44.8373396Z Compiling test/cpp/test_xla_sharding.cpp; 36s local 2024-12-18T01:09:44.8374261Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2024-12-18T01:09:44.8375001Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 31s local 2024-12-18T01:09:44.8375719Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2024-12-18T01:09:44.8376574Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2024-12-18T01:09:44.8377404Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local ... 2024-12-18T01:09:45.0369630Z 2024-12-18T01:09:45.0370655Z  2024-12-18T01:09:45.0371124Z  2024-12-18T01:09:45.0371505Z  2024-12-18T01:09:45.0371842Z  2024-12-18T01:09:45.0372197Z  2024-12-18T01:09:45.0372562Z  2024-12-18T01:09:45.0372915Z  2024-12-18T01:09:45.0373287Z  2024-12-18T01:09:45.0374197Z [20,474 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:45.0375449Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2024-12-18T01:09:45.0376201Z Compiling test/cpp/test_xla_sharding.cpp; 36s local 2024-12-18T01:09:45.0377091Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2024-12-18T01:09:45.0377859Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T01:09:45.0378611Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2024-12-18T01:09:45.0379519Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 29s local 2024-12-18T01:09:45.0380427Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 28s local 2024-12-18T01:09:45.0383769Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 26s local ... 2024-12-18T01:09:45.4373575Z 2024-12-18T01:09:45.4374420Z  2024-12-18T01:09:45.4374806Z  2024-12-18T01:09:45.4375129Z  2024-12-18T01:09:45.4375547Z  2024-12-18T01:09:45.4375917Z  2024-12-18T01:09:45.4376283Z  2024-12-18T01:09:45.4376770Z  2024-12-18T01:09:45.4377138Z  2024-12-18T01:09:45.4378314Z [20,474 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:45.4379153Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2024-12-18T01:09:45.4379858Z Compiling test/cpp/test_xla_sharding.cpp; 36s local 2024-12-18T01:09:45.4380583Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2024-12-18T01:09:45.4381225Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T01:09:45.4381879Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T01:09:45.4382660Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 29s local 2024-12-18T01:09:45.4383361Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 28s local 2024-12-18T01:09:45.4384537Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 27s local ... 2024-12-18T01:09:45.8378378Z 2024-12-18T01:09:45.8379365Z  2024-12-18T01:09:45.8379979Z  2024-12-18T01:09:45.8380571Z  2024-12-18T01:09:45.8381932Z  2024-12-18T01:09:45.8383302Z  2024-12-18T01:09:45.8384710Z  2024-12-18T01:09:45.8386067Z  2024-12-18T01:09:45.8387423Z  2024-12-18T01:09:45.8389448Z [20,475 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:45.8391365Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2024-12-18T01:09:45.8393156Z Compiling test/cpp/test_xla_sharding.cpp; 37s local 2024-12-18T01:09:45.8394891Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2024-12-18T01:09:45.8396699Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2024-12-18T01:09:45.8398634Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local 2024-12-18T01:09:45.8400519Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 28s local 2024-12-18T01:09:45.8402318Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 27s local 2024-12-18T01:09:45.8404209Z Compiling torch_xla/csrc/ops/masked_select.cpp; 27s local ... 2024-12-18T01:09:46.8384992Z 2024-12-18T01:09:46.8387050Z  2024-12-18T01:09:46.8388503Z  2024-12-18T01:09:46.8389119Z  2024-12-18T01:09:46.8389572Z  2024-12-18T01:09:46.8390007Z  2024-12-18T01:09:46.8390374Z  2024-12-18T01:09:46.8390727Z  2024-12-18T01:09:46.8391106Z  2024-12-18T01:09:46.8391957Z [20,475 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:46.8392865Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2024-12-18T01:09:46.8393961Z Compiling test/cpp/test_xla_sharding.cpp; 38s local 2024-12-18T01:09:46.8394638Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2024-12-18T01:09:46.8395378Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2024-12-18T01:09:46.8396259Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local 2024-12-18T01:09:46.8397162Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 29s local 2024-12-18T01:09:46.8398128Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 28s local 2024-12-18T01:09:46.8398956Z Compiling torch_xla/csrc/ops/masked_select.cpp; 28s local ... 2024-12-18T01:09:47.7417522Z 2024-12-18T01:09:47.7418406Z  2024-12-18T01:09:47.7418878Z  2024-12-18T01:09:47.7419306Z  2024-12-18T01:09:47.7419736Z  2024-12-18T01:09:47.7420162Z  2024-12-18T01:09:47.7420564Z  2024-12-18T01:09:47.7420991Z  2024-12-18T01:09:47.7421416Z  2024-12-18T01:09:47.7422386Z [20,476 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:47.7423490Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T01:09:47.7424036Z Compiling test/cpp/test_xla_sharding.cpp; 38s local 2024-12-18T01:09:47.7424600Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2024-12-18T01:09:47.7425228Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T01:09:47.7426505Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2024-12-18T01:09:47.7427467Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local 2024-12-18T01:09:47.7428237Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2024-12-18T01:09:47.7429285Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 28s local ... 2024-12-18T01:09:48.0394068Z 2024-12-18T01:09:48.0395085Z  2024-12-18T01:09:48.0395638Z  2024-12-18T01:09:48.0396128Z  2024-12-18T01:09:48.0397909Z  2024-12-18T01:09:48.0398384Z  2024-12-18T01:09:48.0399783Z  2024-12-18T01:09:48.0400258Z  2024-12-18T01:09:48.0401489Z  2024-12-18T01:09:48.0402431Z [20,476 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:48.0403398Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2024-12-18T01:09:48.0404210Z Compiling test/cpp/test_xla_sharding.cpp; 39s local 2024-12-18T01:09:48.0405042Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T01:09:48.0405860Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2024-12-18T01:09:48.0406769Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2024-12-18T01:09:48.0407673Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local 2024-12-18T01:09:48.0408576Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2024-12-18T01:09:48.0409488Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 28s local ... 2024-12-18T01:09:48.7747997Z 2024-12-18T01:09:48.7749021Z  2024-12-18T01:09:48.7749620Z  2024-12-18T01:09:48.7750265Z  2024-12-18T01:09:48.7751635Z  2024-12-18T01:09:48.7753057Z  2024-12-18T01:09:48.7754510Z  2024-12-18T01:09:48.7755914Z  2024-12-18T01:09:48.7757305Z  2024-12-18T01:09:48.7759299Z [20,477 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:48.7761246Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2024-12-18T01:09:48.7763036Z Compiling test/cpp/test_xla_sharding.cpp; 39s local 2024-12-18T01:09:48.7764800Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T01:09:48.7765873Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2024-12-18T01:09:48.7766961Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2024-12-18T01:09:48.7768067Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2024-12-18T01:09:48.7769172Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 29s local 2024-12-18T01:09:48.7770655Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 29s local ... 2024-12-18T01:09:48.9790331Z 2024-12-18T01:09:48.9791558Z  2024-12-18T01:09:48.9792055Z  2024-12-18T01:09:48.9792424Z  2024-12-18T01:09:48.9792791Z  2024-12-18T01:09:48.9802819Z  2024-12-18T01:09:48.9803564Z  2024-12-18T01:09:48.9803959Z  2024-12-18T01:09:48.9804334Z  2024-12-18T01:09:48.9805239Z [20,478 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:48.9806516Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2024-12-18T01:09:48.9807211Z Compiling test/cpp/test_xla_sharding.cpp; 40s local 2024-12-18T01:09:48.9807933Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2024-12-18T01:09:48.9808547Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2024-12-18T01:09:48.9809211Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2024-12-18T01:09:48.9809906Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 29s local 2024-12-18T01:09:48.9810612Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 29s local 2024-12-18T01:09:48.9811617Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 28s local ... 2024-12-18T01:09:49.2401060Z 2024-12-18T01:09:49.2401934Z  2024-12-18T01:09:49.2402394Z  2024-12-18T01:09:49.2402782Z  2024-12-18T01:09:49.2403150Z  2024-12-18T01:09:49.2403524Z  2024-12-18T01:09:49.2403929Z  2024-12-18T01:09:49.2404290Z  2024-12-18T01:09:49.2404683Z  2024-12-18T01:09:49.2405888Z [20,478 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:49.2406834Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2024-12-18T01:09:49.2407521Z Compiling test/cpp/test_xla_sharding.cpp; 40s local 2024-12-18T01:09:49.2408254Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2024-12-18T01:09:49.2409012Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2024-12-18T01:09:49.2409807Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2024-12-18T01:09:49.2410633Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2024-12-18T01:09:49.2411416Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 29s local 2024-12-18T01:09:49.2412221Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 28s local ... 2024-12-18T01:09:49.5587012Z 2024-12-18T01:09:49.5587852Z  2024-12-18T01:09:49.5588339Z  2024-12-18T01:09:49.5588681Z  2024-12-18T01:09:49.5589057Z  2024-12-18T01:09:49.5589433Z  2024-12-18T01:09:49.5589819Z  2024-12-18T01:09:49.5590183Z  2024-12-18T01:09:49.5590536Z  2024-12-18T01:09:49.5591406Z [20,479 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:49.5592313Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2024-12-18T01:09:49.5593020Z Compiling test/cpp/test_xla_sharding.cpp; 40s local 2024-12-18T01:09:49.5593736Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2024-12-18T01:09:49.5594520Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2024-12-18T01:09:49.5595380Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2024-12-18T01:09:49.5596174Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local 2024-12-18T01:09:49.5596986Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 29s local 2024-12-18T01:09:49.5597852Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 28s local ... 2024-12-18T01:09:49.8407225Z 2024-12-18T01:09:49.8408191Z  2024-12-18T01:09:49.8408790Z  2024-12-18T01:09:49.8409285Z  2024-12-18T01:09:49.8411080Z  2024-12-18T01:09:49.8411540Z  2024-12-18T01:09:49.8412996Z  2024-12-18T01:09:49.8413466Z  2024-12-18T01:09:49.8414935Z  2024-12-18T01:09:49.8415979Z [20,479 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:49.8417191Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2024-12-18T01:09:49.8418385Z Compiling test/cpp/test_xla_sharding.cpp; 41s local 2024-12-18T01:09:49.8419227Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2024-12-18T01:09:49.8420103Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2024-12-18T01:09:49.8421062Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2024-12-18T01:09:49.8421989Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local 2024-12-18T01:09:49.8423004Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 29s local 2024-12-18T01:09:49.8423785Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 28s local ... 2024-12-18T01:09:50.8414089Z 2024-12-18T01:09:50.8415247Z  2024-12-18T01:09:50.8415756Z  2024-12-18T01:09:50.8416183Z  2024-12-18T01:09:50.8416723Z  2024-12-18T01:09:50.8417060Z  2024-12-18T01:09:50.8417406Z  2024-12-18T01:09:50.8417728Z  2024-12-18T01:09:50.8418033Z  2024-12-18T01:09:50.8418856Z [20,479 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:50.8420015Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T01:09:50.8420710Z Compiling test/cpp/test_xla_sharding.cpp; 42s local 2024-12-18T01:09:50.8421430Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2024-12-18T01:09:50.8422142Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2024-12-18T01:09:50.8422949Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 31s local 2024-12-18T01:09:50.8423786Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2024-12-18T01:09:50.8424550Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2024-12-18T01:09:50.8425407Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local ... 2024-12-18T01:09:51.0490295Z 2024-12-18T01:09:51.0491191Z  2024-12-18T01:09:51.0491592Z  2024-12-18T01:09:51.0491936Z  2024-12-18T01:09:51.0492302Z  2024-12-18T01:09:51.0492649Z  2024-12-18T01:09:51.0493028Z  2024-12-18T01:09:51.0493359Z  2024-12-18T01:09:51.0493706Z  2024-12-18T01:09:51.0494550Z [20,481 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:51.0495424Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T01:09:51.0496179Z Compiling test/cpp/test_xla_sharding.cpp; 42s local 2024-12-18T01:09:51.0496968Z Compiling torch_xla/csrc/ops/mean.cpp; 37s local 2024-12-18T01:09:51.0497643Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2024-12-18T01:09:51.0498359Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2024-12-18T01:09:51.0499093Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local 2024-12-18T01:09:51.0499843Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 29s local 2024-12-18T01:09:51.0500718Z Compiling torch_xla/csrc/ops/linspace.cpp; 28s local ... 2024-12-18T01:09:51.2880562Z 2024-12-18T01:09:51.2881400Z  2024-12-18T01:09:51.2883124Z  2024-12-18T01:09:51.2885750Z  2024-12-18T01:09:51.2888334Z  2024-12-18T01:09:51.2891043Z  2024-12-18T01:09:51.2893609Z  2024-12-18T01:09:51.2896204Z  2024-12-18T01:09:51.2899027Z  2024-12-18T01:09:51.2902104Z [20,482 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:51.2905193Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2024-12-18T01:09:51.2908194Z Compiling test/cpp/test_xla_sharding.cpp; 42s local 2024-12-18T01:09:51.2911258Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2024-12-18T01:09:51.2914201Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2024-12-18T01:09:51.2917153Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2024-12-18T01:09:51.2920142Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 29s local 2024-12-18T01:09:51.2922971Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2024-12-18T01:09:51.2926474Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local ... 2024-12-18T01:09:51.6420846Z 2024-12-18T01:09:51.6424240Z  2024-12-18T01:09:51.6427151Z  2024-12-18T01:09:51.6429916Z  2024-12-18T01:09:51.6432688Z  2024-12-18T01:09:51.6435425Z  2024-12-18T01:09:51.6438157Z  2024-12-18T01:09:51.6438892Z  2024-12-18T01:09:51.6439609Z  2024-12-18T01:09:51.6440771Z [20,482 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:51.6441778Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2024-12-18T01:09:51.6442790Z Compiling test/cpp/test_xla_sharding.cpp; 42s local 2024-12-18T01:09:51.6443888Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2024-12-18T01:09:51.6445163Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2024-12-18T01:09:51.6446372Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2024-12-18T01:09:51.6447577Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 29s local 2024-12-18T01:09:51.6448669Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2024-12-18T01:09:51.6450129Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local ... 2024-12-18T01:09:52.8428517Z 2024-12-18T01:09:52.8429744Z  2024-12-18T01:09:52.8430181Z  2024-12-18T01:09:52.8430572Z  2024-12-18T01:09:52.8430952Z  2024-12-18T01:09:52.8431323Z  2024-12-18T01:09:52.8431661Z  2024-12-18T01:09:52.8431999Z  2024-12-18T01:09:52.8432400Z  2024-12-18T01:09:52.8433626Z [20,483 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:52.8434609Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2024-12-18T01:09:52.8435286Z Compiling test/cpp/test_xla_sharding.cpp; 44s local 2024-12-18T01:09:52.8436075Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2024-12-18T01:09:52.8436914Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2024-12-18T01:09:52.8437786Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2024-12-18T01:09:52.8438582Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2024-12-18T01:09:52.8439437Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2024-12-18T01:09:52.8440265Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local ... 2024-12-18T01:09:53.2432735Z 2024-12-18T01:09:53.2433608Z  2024-12-18T01:09:53.2434043Z  2024-12-18T01:09:53.2434397Z  2024-12-18T01:09:53.2434785Z  2024-12-18T01:09:53.2435196Z  2024-12-18T01:09:53.2435568Z  2024-12-18T01:09:53.2436044Z  2024-12-18T01:09:53.2436406Z  2024-12-18T01:09:53.2437322Z [20,483 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:53.2438217Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2024-12-18T01:09:53.2438935Z Compiling test/cpp/test_xla_sharding.cpp; 44s local 2024-12-18T01:09:53.2440167Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2024-12-18T01:09:53.2441000Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 32s local 2024-12-18T01:09:53.2442045Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T01:09:53.2442934Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2024-12-18T01:09:53.2443942Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2024-12-18T01:09:53.2445252Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local ... 2024-12-18T01:09:53.4507190Z 2024-12-18T01:09:53.4508105Z  2024-12-18T01:09:53.4508590Z  2024-12-18T01:09:53.4508979Z  2024-12-18T01:09:53.4509376Z  2024-12-18T01:09:53.4509741Z  2024-12-18T01:09:53.4510126Z  2024-12-18T01:09:53.4510490Z  2024-12-18T01:09:53.4510849Z  2024-12-18T01:09:53.4511741Z [20,484 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:53.4512946Z Compiling test/cpp/test_xla_sharding.cpp; 44s local 2024-12-18T01:09:53.4513742Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2024-12-18T01:09:53.4514531Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 32s local 2024-12-18T01:09:53.4515361Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T01:09:53.4516153Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2024-12-18T01:09:53.4517182Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local 2024-12-18T01:09:53.4518575Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2024-12-18T01:09:53.4519605Z Compiling torch_xla/csrc/ops/index_select.cpp; 25s local ... 2024-12-18T01:09:53.8437833Z 2024-12-18T01:09:53.8438690Z  2024-12-18T01:09:53.8439147Z  2024-12-18T01:09:53.8439504Z  2024-12-18T01:09:53.8439857Z  2024-12-18T01:09:53.8440203Z  2024-12-18T01:09:53.8440561Z  2024-12-18T01:09:53.8441267Z  2024-12-18T01:09:53.8441831Z  2024-12-18T01:09:53.8443076Z [20,484 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:53.8444444Z Compiling test/cpp/test_xla_sharding.cpp; 45s local 2024-12-18T01:09:53.8445343Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2024-12-18T01:09:53.8446714Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 32s local 2024-12-18T01:09:53.8450033Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2024-12-18T01:09:53.8453704Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2024-12-18T01:09:53.8457237Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local 2024-12-18T01:09:53.8460543Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T01:09:53.8463587Z Compiling torch_xla/csrc/ops/index_select.cpp; 26s local ... 2024-12-18T01:09:54.0440800Z 2024-12-18T01:09:54.0442013Z  2024-12-18T01:09:54.0443474Z  2024-12-18T01:09:54.0444102Z  2024-12-18T01:09:54.0444887Z  2024-12-18T01:09:54.0445256Z  2024-12-18T01:09:54.0445647Z  2024-12-18T01:09:54.0446088Z  2024-12-18T01:09:54.0446507Z  2024-12-18T01:09:54.0447500Z [20,486 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:54.0448547Z Compiling test/cpp/test_xla_sharding.cpp; 45s local 2024-12-18T01:09:54.0449259Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2024-12-18T01:09:54.0450114Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 32s local 2024-12-18T01:09:54.0450973Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2024-12-18T01:09:54.0451795Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T01:09:54.0452620Z Compiling torch_xla/csrc/ops/index_select.cpp; 26s local 2024-12-18T01:09:54.0453428Z Compiling torch_xla/csrc/ops/index_put.cpp; 25s local 2024-12-18T01:09:54.0454227Z Compiling torch_xla/csrc/ops/index_ops.cpp; 25s local ... 2024-12-18T01:09:54.4445881Z 2024-12-18T01:09:54.4446784Z  2024-12-18T01:09:54.4447247Z  2024-12-18T01:09:54.4447647Z  2024-12-18T01:09:54.4448039Z  2024-12-18T01:09:54.4448397Z  2024-12-18T01:09:54.4448768Z  2024-12-18T01:09:54.4449133Z  2024-12-18T01:09:54.4449502Z  2024-12-18T01:09:54.4450434Z [20,486 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:54.4451394Z Compiling test/cpp/test_xla_sharding.cpp; 45s local 2024-12-18T01:09:54.4452173Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2024-12-18T01:09:54.4453007Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 33s local 2024-12-18T01:09:54.4453898Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2024-12-18T01:09:54.4454682Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T01:09:54.4455504Z Compiling torch_xla/csrc/ops/index_select.cpp; 26s local 2024-12-18T01:09:54.4456808Z Compiling torch_xla/csrc/ops/index_put.cpp; 26s local 2024-12-18T01:09:54.4457561Z Compiling torch_xla/csrc/ops/index_ops.cpp; 26s local ... 2024-12-18T01:09:54.6447879Z 2024-12-18T01:09:54.6448775Z  2024-12-18T01:09:54.6449271Z  2024-12-18T01:09:54.6449661Z  2024-12-18T01:09:54.6450023Z  2024-12-18T01:09:54.6450392Z  2024-12-18T01:09:54.6451096Z  2024-12-18T01:09:54.6451479Z  2024-12-18T01:09:54.6451874Z  2024-12-18T01:09:54.6452816Z [20,487 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:54.6453805Z Compiling test/cpp/test_xla_sharding.cpp; 45s local 2024-12-18T01:09:54.6454614Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2024-12-18T01:09:54.6455396Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2024-12-18T01:09:54.6456115Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2024-12-18T01:09:54.6457041Z Compiling torch_xla/csrc/ops/index_select.cpp; 26s local 2024-12-18T01:09:54.6458012Z Compiling torch_xla/csrc/ops/index_put.cpp; 26s local 2024-12-18T01:09:54.6458785Z Compiling torch_xla/csrc/ops/index_ops.cpp; 26s local 2024-12-18T01:09:54.6459551Z Compiling torch_xla/csrc/ops/index_get.cpp; 26s local ... 2024-12-18T01:09:55.5606471Z 2024-12-18T01:09:55.5607358Z  2024-12-18T01:09:55.5607822Z  2024-12-18T01:09:55.5608194Z  2024-12-18T01:09:55.5608578Z  2024-12-18T01:09:55.5608977Z  2024-12-18T01:09:55.5609343Z  2024-12-18T01:09:55.5610042Z  2024-12-18T01:09:55.5610449Z  2024-12-18T01:09:55.5611374Z [20,488 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:55.5612213Z Compiling test/cpp/test_xla_sharding.cpp; 46s local 2024-12-18T01:09:55.5612930Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T01:09:55.5613711Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2024-12-18T01:09:55.5614527Z Compiling torch_xla/csrc/ops/index_select.cpp; 27s local 2024-12-18T01:09:55.5615338Z Compiling torch_xla/csrc/ops/index_put.cpp; 27s local 2024-12-18T01:09:55.5616116Z Compiling torch_xla/csrc/ops/index_ops.cpp; 27s local 2024-12-18T01:09:55.5617040Z Compiling torch_xla/csrc/ops/index_get.cpp; 26s local 2024-12-18T01:09:55.5617843Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 26s local ... 2024-12-18T01:09:55.8474325Z 2024-12-18T01:09:55.8475252Z  2024-12-18T01:09:55.8475768Z  2024-12-18T01:09:55.8476152Z  2024-12-18T01:09:55.8476506Z  2024-12-18T01:09:55.8476891Z  2024-12-18T01:09:55.8477263Z  2024-12-18T01:09:55.8477642Z  2024-12-18T01:09:55.8478014Z  2024-12-18T01:09:55.8478904Z [20,488 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:55.8479779Z Compiling test/cpp/test_xla_sharding.cpp; 47s local 2024-12-18T01:09:55.8480559Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T01:09:55.8481354Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2024-12-18T01:09:55.8482161Z Compiling torch_xla/csrc/ops/index_select.cpp; 28s local 2024-12-18T01:09:55.8482880Z Compiling torch_xla/csrc/ops/index_put.cpp; 27s local 2024-12-18T01:09:55.8483598Z Compiling torch_xla/csrc/ops/index_ops.cpp; 27s local 2024-12-18T01:09:55.8484299Z Compiling torch_xla/csrc/ops/index_get.cpp; 27s local 2024-12-18T01:09:55.8485129Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 26s local ... 2024-12-18T01:09:56.2479149Z 2024-12-18T01:09:56.2480106Z  2024-12-18T01:09:56.2480585Z  2024-12-18T01:09:56.2480977Z  2024-12-18T01:09:56.2481355Z  2024-12-18T01:09:56.2481744Z  2024-12-18T01:09:56.2482102Z  2024-12-18T01:09:56.2482475Z  2024-12-18T01:09:56.2482865Z  2024-12-18T01:09:56.2483759Z [20,488 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:56.2484961Z Compiling test/cpp/test_xla_sharding.cpp; 47s local 2024-12-18T01:09:56.2485688Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2024-12-18T01:09:56.2486448Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2024-12-18T01:09:56.2487297Z Compiling torch_xla/csrc/ops/index_select.cpp; 28s local 2024-12-18T01:09:56.2488271Z Compiling torch_xla/csrc/ops/index_put.cpp; 28s local 2024-12-18T01:09:56.2489132Z Compiling torch_xla/csrc/ops/index_ops.cpp; 27s local 2024-12-18T01:09:56.2489856Z Compiling torch_xla/csrc/ops/index_get.cpp; 27s local 2024-12-18T01:09:56.2490648Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 26s local ... 2024-12-18T01:09:57.4486843Z 2024-12-18T01:09:57.4487775Z  2024-12-18T01:09:57.4488255Z  2024-12-18T01:09:57.4488630Z  2024-12-18T01:09:57.4488965Z  2024-12-18T01:09:57.4489349Z  2024-12-18T01:09:57.4489756Z  2024-12-18T01:09:57.4490137Z  2024-12-18T01:09:57.4490519Z  2024-12-18T01:09:57.4491676Z [20,488 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:57.4492627Z Compiling test/cpp/test_xla_sharding.cpp; 48s local 2024-12-18T01:09:57.4493347Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2024-12-18T01:09:57.4493982Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2024-12-18T01:09:57.4494575Z Compiling torch_xla/csrc/ops/index_select.cpp; 29s local 2024-12-18T01:09:57.4495312Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local 2024-12-18T01:09:57.4495909Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local 2024-12-18T01:09:57.4496713Z Compiling torch_xla/csrc/ops/index_get.cpp; 28s local 2024-12-18T01:09:57.4497486Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 27s local ... 2024-12-18T01:09:57.6489399Z 2024-12-18T01:09:57.6490288Z  2024-12-18T01:09:57.6490761Z  2024-12-18T01:09:57.6491108Z  2024-12-18T01:09:57.6491455Z  2024-12-18T01:09:57.6491825Z  2024-12-18T01:09:57.6492205Z  2024-12-18T01:09:57.6492543Z  2024-12-18T01:09:57.6492926Z  2024-12-18T01:09:57.6493849Z [20,489 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:57.6494797Z Compiling test/cpp/test_xla_sharding.cpp; 48s local 2024-12-18T01:09:57.6495576Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2024-12-18T01:09:57.6496361Z Compiling torch_xla/csrc/ops/index_select.cpp; 29s local 2024-12-18T01:09:57.6497329Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local 2024-12-18T01:09:57.6498185Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local 2024-12-18T01:09:57.6498911Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local 2024-12-18T01:09:57.6499693Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 28s local 2024-12-18T01:09:57.6500657Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 24s local ... 2024-12-18T01:09:58.0493901Z 2024-12-18T01:09:58.0494860Z  2024-12-18T01:09:58.0495336Z  2024-12-18T01:09:58.0495736Z  2024-12-18T01:09:58.0496150Z  2024-12-18T01:09:58.0496716Z  2024-12-18T01:09:58.0497134Z  2024-12-18T01:09:58.0497519Z  2024-12-18T01:09:58.0497892Z  2024-12-18T01:09:58.0498837Z [20,490 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:58.0499755Z Compiling test/cpp/test_xla_sharding.cpp; 49s local 2024-12-18T01:09:58.0500498Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2024-12-18T01:09:58.0501279Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2024-12-18T01:09:58.0502066Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local 2024-12-18T01:09:58.0502804Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local 2024-12-18T01:09:58.0503815Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local 2024-12-18T01:09:58.0504604Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 28s local 2024-12-18T01:09:58.0505532Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 24s local ... 2024-12-18T01:09:58.8214998Z 2024-12-18T01:09:58.8215867Z  2024-12-18T01:09:58.8216273Z  2024-12-18T01:09:58.8216739Z  2024-12-18T01:09:58.8217079Z  2024-12-18T01:09:58.8217728Z  2024-12-18T01:09:58.8218055Z  2024-12-18T01:09:58.8218389Z  2024-12-18T01:09:58.8218723Z  2024-12-18T01:09:58.8219575Z [20,491 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:58.8220444Z Compiling test/cpp/test_xla_sharding.cpp; 49s local 2024-12-18T01:09:58.8221312Z Compiling torch_xla/csrc/ops/index_select.cpp; 31s local 2024-12-18T01:09:58.8222016Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2024-12-18T01:09:58.8222756Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2024-12-18T01:09:58.8223474Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2024-12-18T01:09:58.8224387Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local 2024-12-18T01:09:58.8225175Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 25s local 2024-12-18T01:09:58.8225981Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 23s local ... 2024-12-18T01:09:59.0501265Z 2024-12-18T01:09:59.0502121Z  2024-12-18T01:09:59.0502539Z  2024-12-18T01:09:59.0502880Z  2024-12-18T01:09:59.0503229Z  2024-12-18T01:09:59.0503845Z  2024-12-18T01:09:59.0504181Z  2024-12-18T01:09:59.0504550Z  2024-12-18T01:09:59.0504895Z  2024-12-18T01:09:59.0505669Z [20,491 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:59.0506500Z Compiling test/cpp/test_xla_sharding.cpp; 50s local 2024-12-18T01:09:59.0507155Z Compiling torch_xla/csrc/ops/index_select.cpp; 31s local 2024-12-18T01:09:59.0507849Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2024-12-18T01:09:59.0508510Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2024-12-18T01:09:59.0509197Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2024-12-18T01:09:59.0509947Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local 2024-12-18T01:09:59.0510661Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 25s local 2024-12-18T01:09:59.0511507Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 23s local ... 2024-12-18T01:09:59.2542429Z 2024-12-18T01:09:59.2543342Z  2024-12-18T01:09:59.2543792Z  2024-12-18T01:09:59.2544385Z  2024-12-18T01:09:59.2544818Z  2024-12-18T01:09:59.2545205Z  2024-12-18T01:09:59.2545583Z  2024-12-18T01:09:59.2545972Z  2024-12-18T01:09:59.2546346Z  2024-12-18T01:09:59.2547244Z [20,492 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:09:59.2548212Z Compiling test/cpp/test_xla_sharding.cpp; 50s local 2024-12-18T01:09:59.2548984Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2024-12-18T01:09:59.2549747Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2024-12-18T01:09:59.2550541Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2024-12-18T01:09:59.2551336Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local 2024-12-18T01:09:59.2552201Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 26s local 2024-12-18T01:09:59.2553106Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 23s local 2024-12-18T01:09:59.2553830Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 23s local ... 2024-12-18T01:09:59.6506719Z 2024-12-18T01:09:59.6507567Z  2024-12-18T01:09:59.6508081Z  2024-12-18T01:09:59.6508478Z  2024-12-18T01:09:59.6508865Z  2024-12-18T01:09:59.6509278Z  2024-12-18T01:09:59.6509685Z  2024-12-18T01:09:59.6510410Z  2024-12-18T01:09:59.6510805Z  2024-12-18T01:09:59.6511786Z [20,493 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:09:59.6512837Z Compiling test/cpp/test_xla_sharding.cpp; 50s local 2024-12-18T01:09:59.6513556Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2024-12-18T01:09:59.6514310Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2024-12-18T01:09:59.6515214Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2024-12-18T01:09:59.6515955Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 26s local 2024-12-18T01:09:59.6516641Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 23s local 2024-12-18T01:09:59.6517326Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 23s local 2024-12-18T01:09:59.6517961Z Compiling torch_xla/csrc/ops/generic.cpp; 23s local ... 2024-12-18T01:09:59.8509789Z 2024-12-18T01:09:59.8510674Z  2024-12-18T01:09:59.8511156Z  2024-12-18T01:09:59.8511597Z  2024-12-18T01:09:59.8512015Z  2024-12-18T01:09:59.8512394Z  2024-12-18T01:09:59.8512789Z  2024-12-18T01:09:59.8513463Z  2024-12-18T01:09:59.8513897Z  2024-12-18T01:09:59.8514856Z [20,494 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:09:59.8515987Z Compiling test/cpp/test_xla_sharding.cpp; 51s local 2024-12-18T01:09:59.8516768Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2024-12-18T01:09:59.8517640Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2024-12-18T01:09:59.8518321Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 26s local 2024-12-18T01:09:59.8519016Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 24s local 2024-12-18T01:09:59.8519703Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 24s local 2024-12-18T01:09:59.8520311Z Compiling torch_xla/csrc/ops/generic.cpp; 23s local 2024-12-18T01:09:59.8520931Z Compiling torch_xla/csrc/ops/gather.cpp; 23s local ... 2024-12-18T01:10:01.0517969Z 2024-12-18T01:10:01.0518796Z  2024-12-18T01:10:01.0519216Z  2024-12-18T01:10:01.0519538Z  2024-12-18T01:10:01.0519853Z  2024-12-18T01:10:01.0520152Z  2024-12-18T01:10:01.0520466Z  2024-12-18T01:10:01.0520956Z  2024-12-18T01:10:01.0521281Z  2024-12-18T01:10:01.0522071Z [20,494 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:01.0522895Z Compiling test/cpp/test_xla_sharding.cpp; 52s local 2024-12-18T01:10:01.0523542Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T01:10:01.0524244Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2024-12-18T01:10:01.0524981Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 27s local 2024-12-18T01:10:01.0525748Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 25s local 2024-12-18T01:10:01.0526486Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 25s local 2024-12-18T01:10:01.0527177Z Compiling torch_xla/csrc/ops/generic.cpp; 24s local 2024-12-18T01:10:01.0527888Z Compiling torch_xla/csrc/ops/gather.cpp; 24s local ... 2024-12-18T01:10:01.2725102Z 2024-12-18T01:10:01.2726012Z  2024-12-18T01:10:01.2726459Z  2024-12-18T01:10:01.2726821Z  2024-12-18T01:10:01.2727170Z  2024-12-18T01:10:01.2727546Z  2024-12-18T01:10:01.2727887Z  2024-12-18T01:10:01.2728210Z  2024-12-18T01:10:01.2728548Z  2024-12-18T01:10:01.2729364Z [20,495 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:01.2730230Z Compiling test/cpp/test_xla_sharding.cpp; 52s local 2024-12-18T01:10:01.2730898Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2024-12-18T01:10:01.2731607Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 28s local 2024-12-18T01:10:01.2732379Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 25s local 2024-12-18T01:10:01.2733456Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 25s local 2024-12-18T01:10:01.2734152Z Compiling torch_xla/csrc/ops/generic.cpp; 25s local 2024-12-18T01:10:01.2734791Z Compiling torch_xla/csrc/ops/gather.cpp; 24s local 2024-12-18T01:10:01.2735435Z Compiling torch_xla/csrc/ops/flip.cpp; 24s local ... 2024-12-18T01:10:01.6523232Z 2024-12-18T01:10:01.6524362Z  2024-12-18T01:10:01.6524821Z  2024-12-18T01:10:01.6525162Z  2024-12-18T01:10:01.6525506Z  2024-12-18T01:10:01.6525868Z  2024-12-18T01:10:01.6526231Z  2024-12-18T01:10:01.6526600Z  2024-12-18T01:10:01.6526970Z  2024-12-18T01:10:01.6527884Z [20,495 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:01.6528868Z Compiling test/cpp/test_xla_sharding.cpp; 52s local 2024-12-18T01:10:01.6529616Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2024-12-18T01:10:01.6530443Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 28s local 2024-12-18T01:10:01.6531523Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 25s local 2024-12-18T01:10:01.6532413Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 25s local 2024-12-18T01:10:01.6533226Z Compiling torch_xla/csrc/ops/generic.cpp; 25s local 2024-12-18T01:10:01.6533966Z Compiling torch_xla/csrc/ops/gather.cpp; 25s local 2024-12-18T01:10:01.6534659Z Compiling torch_xla/csrc/ops/flip.cpp; 24s local ... 2024-12-18T01:10:02.6531640Z 2024-12-18T01:10:02.6532814Z  2024-12-18T01:10:02.6535607Z  2024-12-18T01:10:02.6536176Z  2024-12-18T01:10:02.6536688Z  2024-12-18T01:10:02.6536994Z  2024-12-18T01:10:02.6537344Z  2024-12-18T01:10:02.6537674Z  2024-12-18T01:10:02.6537996Z  2024-12-18T01:10:02.6538741Z [20,495 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:02.6539524Z Compiling test/cpp/test_xla_sharding.cpp; 53s local 2024-12-18T01:10:02.6540146Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2024-12-18T01:10:02.6540803Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 29s local 2024-12-18T01:10:02.6541522Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 26s local 2024-12-18T01:10:02.6542240Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 26s local 2024-12-18T01:10:02.6542881Z Compiling torch_xla/csrc/ops/generic.cpp; 26s local 2024-12-18T01:10:02.6543464Z Compiling torch_xla/csrc/ops/gather.cpp; 26s local 2024-12-18T01:10:02.6544074Z Compiling torch_xla/csrc/ops/flip.cpp; 25s local ... 2024-12-18T01:10:03.6538799Z 2024-12-18T01:10:03.6540018Z  2024-12-18T01:10:03.6540489Z  2024-12-18T01:10:03.6540856Z  2024-12-18T01:10:03.6541450Z  2024-12-18T01:10:03.6541905Z  2024-12-18T01:10:03.6542297Z  2024-12-18T01:10:03.6542667Z  2024-12-18T01:10:03.6543070Z  2024-12-18T01:10:03.6544027Z [20,495 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:03.6545238Z Compiling test/cpp/test_xla_sharding.cpp; 54s local 2024-12-18T01:10:03.6546035Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2024-12-18T01:10:03.6546869Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2024-12-18T01:10:03.6547816Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 27s local 2024-12-18T01:10:03.6548747Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 27s local 2024-12-18T01:10:03.6549548Z Compiling torch_xla/csrc/ops/generic.cpp; 27s local 2024-12-18T01:10:03.6550308Z Compiling torch_xla/csrc/ops/gather.cpp; 27s local 2024-12-18T01:10:03.6551087Z Compiling torch_xla/csrc/ops/flip.cpp; 26s local ... 2024-12-18T01:10:04.8547914Z 2024-12-18T01:10:04.8548830Z  2024-12-18T01:10:04.8549269Z  2024-12-18T01:10:04.8549614Z  2024-12-18T01:10:04.8549987Z  2024-12-18T01:10:04.8550652Z  2024-12-18T01:10:04.8551031Z  2024-12-18T01:10:04.8551375Z  2024-12-18T01:10:04.8551729Z  2024-12-18T01:10:04.8552657Z [20,495 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:04.8553602Z Compiling test/cpp/test_xla_sharding.cpp; 56s local 2024-12-18T01:10:04.8554356Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2024-12-18T01:10:04.8555369Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2024-12-18T01:10:04.8556277Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local 2024-12-18T01:10:04.8557149Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2024-12-18T01:10:04.8557904Z Compiling torch_xla/csrc/ops/generic.cpp; 28s local 2024-12-18T01:10:04.8558586Z Compiling torch_xla/csrc/ops/gather.cpp; 28s local 2024-12-18T01:10:04.8559318Z Compiling torch_xla/csrc/ops/flip.cpp; 28s local ... 2024-12-18T01:10:05.3542983Z 2024-12-18T01:10:05.3543922Z  2024-12-18T01:10:05.3544525Z  2024-12-18T01:10:05.3545000Z  2024-12-18T01:10:05.3545420Z  2024-12-18T01:10:05.3546198Z  2024-12-18T01:10:05.3546585Z  2024-12-18T01:10:05.3546937Z  2024-12-18T01:10:05.3547300Z  2024-12-18T01:10:05.3548352Z [20,496 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:05.3549288Z Compiling test/cpp/test_xla_sharding.cpp; 56s local 2024-12-18T01:10:05.3549975Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2024-12-18T01:10:05.3551008Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local 2024-12-18T01:10:05.3551903Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2024-12-18T01:10:05.3552699Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local 2024-12-18T01:10:05.3553387Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local 2024-12-18T01:10:05.3554098Z Compiling torch_xla/csrc/ops/flip.cpp; 28s local 2024-12-18T01:10:05.3554927Z Compiling torch_xla/csrc/ops/exponential.cpp; 28s local ... 2024-12-18T01:10:05.6553987Z 2024-12-18T01:10:05.6555915Z  2024-12-18T01:10:05.6556350Z  2024-12-18T01:10:05.6556680Z  2024-12-18T01:10:05.6556987Z  2024-12-18T01:10:05.6557311Z  2024-12-18T01:10:05.6557632Z  2024-12-18T01:10:05.6557949Z  2024-12-18T01:10:05.6558250Z  2024-12-18T01:10:05.6559060Z [20,496 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:05.6559896Z Compiling test/cpp/test_xla_sharding.cpp; 56s local 2024-12-18T01:10:05.6560545Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2024-12-18T01:10:05.6561225Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local 2024-12-18T01:10:05.6561928Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2024-12-18T01:10:05.6562569Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local 2024-12-18T01:10:05.6563185Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local 2024-12-18T01:10:05.6563809Z Compiling torch_xla/csrc/ops/flip.cpp; 28s local 2024-12-18T01:10:05.6564448Z Compiling torch_xla/csrc/ops/exponential.cpp; 28s local ... 2024-12-18T01:10:06.6560837Z 2024-12-18T01:10:06.6561704Z  2024-12-18T01:10:06.6562151Z  2024-12-18T01:10:06.6562516Z  2024-12-18T01:10:06.6562891Z  2024-12-18T01:10:06.6563284Z  2024-12-18T01:10:06.6563677Z  2024-12-18T01:10:06.6564357Z  2024-12-18T01:10:06.6564760Z  2024-12-18T01:10:06.6565737Z [20,496 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:06.6566738Z Compiling test/cpp/test_xla_sharding.cpp; 57s local 2024-12-18T01:10:06.6567524Z Compiling torch_xla/csrc/ops/index_ops.cpp; 38s local 2024-12-18T01:10:06.6568392Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2024-12-18T01:10:06.6569348Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2024-12-18T01:10:06.6570508Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2024-12-18T01:10:06.6571210Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2024-12-18T01:10:06.6571886Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local 2024-12-18T01:10:06.6572627Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local ... 2024-12-18T01:10:07.6568389Z 2024-12-18T01:10:07.6569541Z  2024-12-18T01:10:07.6569941Z  2024-12-18T01:10:07.6570256Z  2024-12-18T01:10:07.6570587Z  2024-12-18T01:10:07.6570940Z  2024-12-18T01:10:07.6571263Z  2024-12-18T01:10:07.6571583Z  2024-12-18T01:10:07.6571888Z  2024-12-18T01:10:07.6572651Z [20,497 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:07.6573457Z Compiling test/cpp/test_xla_sharding.cpp; 58s local 2024-12-18T01:10:07.6574099Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2024-12-18T01:10:07.6574828Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2024-12-18T01:10:07.6575966Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2024-12-18T01:10:07.6576896Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2024-12-18T01:10:07.6577604Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2024-12-18T01:10:07.6578341Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2024-12-18T01:10:07.6579088Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local ... 2024-12-18T01:10:08.0572648Z 2024-12-18T01:10:08.0574084Z  2024-12-18T01:10:08.0574575Z  2024-12-18T01:10:08.0574934Z  2024-12-18T01:10:08.0575352Z  2024-12-18T01:10:08.0575716Z  2024-12-18T01:10:08.0576091Z  2024-12-18T01:10:08.0576594Z  2024-12-18T01:10:08.0576942Z  2024-12-18T01:10:08.0577802Z [20,498 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:08.0578776Z Compiling test/cpp/test_xla_sharding.cpp; 59s local 2024-12-18T01:10:08.0579511Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2024-12-18T01:10:08.0580266Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T01:10:08.0581074Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T01:10:08.0581814Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2024-12-18T01:10:08.0582576Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2024-12-18T01:10:08.0583422Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2024-12-18T01:10:08.0584209Z Compiling torch_xla/csrc/ops/expand.cpp; 27s local ... 2024-12-18T01:10:08.3657535Z 2024-12-18T01:10:08.3658742Z  2024-12-18T01:10:08.3659220Z  2024-12-18T01:10:08.3659599Z  2024-12-18T01:10:08.3660108Z  2024-12-18T01:10:08.3660493Z  2024-12-18T01:10:08.3660869Z  2024-12-18T01:10:08.3661243Z  2024-12-18T01:10:08.3661634Z  2024-12-18T01:10:08.3662519Z [20,499 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:08.3663495Z Compiling test/cpp/test_xla_sharding.cpp; 59s local 2024-12-18T01:10:08.3664301Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2024-12-18T01:10:08.3665155Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T01:10:08.3666011Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T01:10:08.3666770Z Compiling torch_xla/csrc/ops/exponential.cpp; 31s local 2024-12-18T01:10:08.3667589Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2024-12-18T01:10:08.3668412Z Compiling torch_xla/csrc/ops/expand.cpp; 27s local 2024-12-18T01:10:08.3669241Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 27s local ... 2024-12-18T01:10:08.5996142Z 2024-12-18T01:10:08.5997484Z  2024-12-18T01:10:08.5998139Z  2024-12-18T01:10:08.5998515Z  2024-12-18T01:10:08.5999179Z  2024-12-18T01:10:08.5999560Z  2024-12-18T01:10:08.5999929Z  2024-12-18T01:10:08.6000285Z  2024-12-18T01:10:08.6000659Z  2024-12-18T01:10:08.6001538Z [20,499 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:08.6002499Z Compiling test/cpp/test_xla_sharding.cpp; 59s local 2024-12-18T01:10:08.6003275Z Compiling torch_xla/csrc/ops/index_ops.cpp; 40s local 2024-12-18T01:10:08.6004347Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2024-12-18T01:10:08.6005253Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2024-12-18T01:10:08.6006083Z Compiling torch_xla/csrc/ops/exponential.cpp; 31s local 2024-12-18T01:10:08.6006946Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2024-12-18T01:10:08.6007701Z Compiling torch_xla/csrc/ops/expand.cpp; 27s local 2024-12-18T01:10:08.6008489Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 27s local ... 2024-12-18T01:10:08.7999308Z 2024-12-18T01:10:08.8000157Z  2024-12-18T01:10:08.8000592Z  2024-12-18T01:10:08.8000965Z  2024-12-18T01:10:08.8001623Z  2024-12-18T01:10:08.8002027Z  2024-12-18T01:10:08.8002409Z  2024-12-18T01:10:08.8002787Z  2024-12-18T01:10:08.8003207Z  2024-12-18T01:10:08.8004121Z [20,501 / 20,605] 6 / 17 tests; 48 actions, 46 running; last test: ...ent_test 2024-12-18T01:10:08.8005125Z Compiling test/cpp/test_xla_sharding.cpp; 59s local 2024-12-18T01:10:08.8006151Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T01:10:08.8007081Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2024-12-18T01:10:08.8007931Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2024-12-18T01:10:08.8008739Z Compiling torch_xla/csrc/ops/expand.cpp; 28s local 2024-12-18T01:10:08.8009542Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 27s local 2024-12-18T01:10:08.8010407Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 27s local 2024-12-18T01:10:08.8011241Z Compiling torch_xla/csrc/ops/einsum.cpp; 27s local ... 2024-12-18T01:10:09.2003514Z 2024-12-18T01:10:09.2004795Z  2024-12-18T01:10:09.2005275Z  2024-12-18T01:10:09.2005633Z  2024-12-18T01:10:09.2006003Z  2024-12-18T01:10:09.2006392Z  2024-12-18T01:10:09.2006796Z  2024-12-18T01:10:09.2007223Z  2024-12-18T01:10:09.2007743Z  2024-12-18T01:10:09.2008693Z [20,501 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:09.2009693Z Compiling test/cpp/test_xla_sharding.cpp; 60s local 2024-12-18T01:10:09.2010564Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2024-12-18T01:10:09.2011447Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2024-12-18T01:10:09.2012297Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2024-12-18T01:10:09.2013133Z Compiling torch_xla/csrc/ops/expand.cpp; 28s local 2024-12-18T01:10:09.2013916Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 28s local 2024-12-18T01:10:09.2014762Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 28s local 2024-12-18T01:10:09.2015606Z Compiling torch_xla/csrc/ops/einsum.cpp; 27s local ... 2024-12-18T01:10:10.2011317Z 2024-12-18T01:10:10.2012169Z  2024-12-18T01:10:10.2012661Z  2024-12-18T01:10:10.2013042Z  2024-12-18T01:10:10.2013403Z  2024-12-18T01:10:10.2013748Z  2024-12-18T01:10:10.2014102Z  2024-12-18T01:10:10.2014490Z  2024-12-18T01:10:10.2014863Z  2024-12-18T01:10:10.2015793Z [20,501 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:10.2016910Z Compiling test/cpp/test_xla_sharding.cpp; 61s local 2024-12-18T01:10:10.2017700Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2024-12-18T01:10:10.2018531Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2024-12-18T01:10:10.2019716Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2024-12-18T01:10:10.2020481Z Compiling torch_xla/csrc/ops/expand.cpp; 29s local 2024-12-18T01:10:10.2021281Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local 2024-12-18T01:10:10.2022086Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2024-12-18T01:10:10.2023158Z Compiling torch_xla/csrc/ops/einsum.cpp; 28s local ... 2024-12-18T01:10:10.4088156Z 2024-12-18T01:10:10.4089031Z  2024-12-18T01:10:10.4089466Z  2024-12-18T01:10:10.4089918Z  2024-12-18T01:10:10.4090289Z  2024-12-18T01:10:10.4090644Z  2024-12-18T01:10:10.4091027Z  2024-12-18T01:10:10.4091398Z  2024-12-18T01:10:10.4091799Z  2024-12-18T01:10:10.4092700Z [20,502 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:10.4093675Z Compiling test/cpp/test_xla_sharding.cpp; 61s local 2024-12-18T01:10:10.4094477Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2024-12-18T01:10:10.4095626Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2024-12-18T01:10:10.4096681Z Compiling torch_xla/csrc/ops/expand.cpp; 29s local 2024-12-18T01:10:10.4097520Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local 2024-12-18T01:10:10.4098515Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2024-12-18T01:10:10.4099366Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local 2024-12-18T01:10:10.4100333Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local ... 2024-12-18T01:10:10.8016884Z 2024-12-18T01:10:10.8017821Z  2024-12-18T01:10:10.8018292Z  2024-12-18T01:10:10.8018751Z  2024-12-18T01:10:10.8019123Z  2024-12-18T01:10:10.8019517Z  2024-12-18T01:10:10.8019872Z  2024-12-18T01:10:10.8020228Z  2024-12-18T01:10:10.8020598Z  2024-12-18T01:10:10.8021494Z [20,502 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:10.8022476Z Compiling test/cpp/test_xla_sharding.cpp; 61s local 2024-12-18T01:10:10.8023293Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2024-12-18T01:10:10.8024078Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2024-12-18T01:10:10.8024816Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2024-12-18T01:10:10.8025583Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local 2024-12-18T01:10:10.8026393Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2024-12-18T01:10:10.8027263Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local 2024-12-18T01:10:10.8028154Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local ... 2024-12-18T01:10:11.8024026Z 2024-12-18T01:10:11.8025471Z  2024-12-18T01:10:11.8025948Z  2024-12-18T01:10:11.8027417Z  2024-12-18T01:10:11.8028505Z  2024-12-18T01:10:11.8029709Z  2024-12-18T01:10:11.8031055Z  2024-12-18T01:10:11.8032360Z  2024-12-18T01:10:11.8033787Z  2024-12-18T01:10:11.8035745Z [20,502 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:11.8036720Z Compiling test/cpp/test_xla_sharding.cpp; 62s local 2024-12-18T01:10:11.8037533Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T01:10:11.8038371Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2024-12-18T01:10:11.8039138Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local 2024-12-18T01:10:11.8039922Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local 2024-12-18T01:10:11.8040826Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2024-12-18T01:10:11.8041606Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2024-12-18T01:10:11.8042379Z Compiling torch_xla/csrc/ops/eigh.cpp; 29s local ... 2024-12-18T01:10:12.1816066Z 2024-12-18T01:10:12.1827432Z  2024-12-18T01:10:12.1828532Z  2024-12-18T01:10:12.1828937Z  2024-12-18T01:10:12.1829324Z  2024-12-18T01:10:12.1829695Z  2024-12-18T01:10:12.1830067Z  2024-12-18T01:10:12.1830426Z  2024-12-18T01:10:12.1830759Z  2024-12-18T01:10:12.1831629Z [20,503 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:12.1832535Z Compiling test/cpp/test_xla_sharding.cpp; 63s local 2024-12-18T01:10:12.1833536Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T01:10:12.1834266Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2024-12-18T01:10:12.1834988Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2024-12-18T01:10:12.1835751Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2024-12-18T01:10:12.1836438Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2024-12-18T01:10:12.1837106Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2024-12-18T01:10:12.1837792Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local ... 2024-12-18T01:10:12.4029227Z 2024-12-18T01:10:12.4030280Z  2024-12-18T01:10:12.4031015Z  2024-12-18T01:10:12.4031419Z  2024-12-18T01:10:12.4031779Z  2024-12-18T01:10:12.4032154Z  2024-12-18T01:10:12.4032524Z  2024-12-18T01:10:12.4032917Z  2024-12-18T01:10:12.4033291Z  2024-12-18T01:10:12.4034150Z [20,503 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:12.4035289Z Compiling test/cpp/test_xla_sharding.cpp; 63s local 2024-12-18T01:10:12.4036073Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T01:10:12.4036890Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2024-12-18T01:10:12.4038011Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2024-12-18T01:10:12.4038900Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2024-12-18T01:10:12.4039747Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2024-12-18T01:10:12.4040525Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2024-12-18T01:10:12.4041361Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local ... 2024-12-18T01:10:12.6206650Z 2024-12-18T01:10:12.6207613Z  2024-12-18T01:10:12.6208094Z  2024-12-18T01:10:12.6210044Z  2024-12-18T01:10:12.6210447Z  2024-12-18T01:10:12.6212218Z  2024-12-18T01:10:12.6212607Z  2024-12-18T01:10:12.6214437Z  2024-12-18T01:10:12.6214814Z  2024-12-18T01:10:12.6217092Z [20,504 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:12.6218108Z Compiling test/cpp/test_xla_sharding.cpp; 63s local 2024-12-18T01:10:12.6218850Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2024-12-18T01:10:12.6219672Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T01:10:12.6220455Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2024-12-18T01:10:12.6221244Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2024-12-18T01:10:12.6221956Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2024-12-18T01:10:12.6222727Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2024-12-18T01:10:12.6223585Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local ... 2024-12-18T01:10:13.0033873Z 2024-12-18T01:10:13.0035924Z  2024-12-18T01:10:13.0037476Z  2024-12-18T01:10:13.0038830Z  2024-12-18T01:10:13.0040104Z  2024-12-18T01:10:13.0041431Z  2024-12-18T01:10:13.0042838Z  2024-12-18T01:10:13.0044634Z  2024-12-18T01:10:13.0045971Z  2024-12-18T01:10:13.0048641Z [20,504 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:13.0050626Z Compiling test/cpp/test_xla_sharding.cpp; 64s local 2024-12-18T01:10:13.0052351Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 37s local 2024-12-18T01:10:13.0054547Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T01:10:13.0056352Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2024-12-18T01:10:13.0058247Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2024-12-18T01:10:13.0059972Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T01:10:13.0061760Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2024-12-18T01:10:13.0063902Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local ... 2024-12-18T01:10:13.2086739Z 2024-12-18T01:10:13.2088594Z  2024-12-18T01:10:13.2090157Z  2024-12-18T01:10:13.2091520Z  2024-12-18T01:10:13.2092866Z  2024-12-18T01:10:13.2094214Z  2024-12-18T01:10:13.2095560Z  2024-12-18T01:10:13.2097150Z  2024-12-18T01:10:13.2098753Z  2024-12-18T01:10:13.2100691Z [20,508 / 20,605] 6 / 17 tests; 46 actions, 44 running; last test: ...ent_test 2024-12-18T01:10:13.2102702Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T01:10:13.2104532Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T01:10:13.2106641Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2024-12-18T01:10:13.2108485Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2024-12-18T01:10:13.2110292Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2024-12-18T01:10:13.2112133Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2024-12-18T01:10:13.2113974Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2024-12-18T01:10:13.2116124Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local ... 2024-12-18T01:10:13.4169116Z 2024-12-18T01:10:13.4170972Z  2024-12-18T01:10:13.4172561Z  2024-12-18T01:10:13.4173960Z  2024-12-18T01:10:13.4175371Z  2024-12-18T01:10:13.4176966Z  2024-12-18T01:10:13.4178358Z  2024-12-18T01:10:13.4179665Z  2024-12-18T01:10:13.4180998Z  2024-12-18T01:10:13.4182906Z [20,508 / 20,605] 6 / 17 tests; 47 actions, 44 running; last test: ...ent_test 2024-12-18T01:10:13.4184879Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2024-12-18T01:10:13.4186661Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T01:10:13.4188422Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2024-12-18T01:10:13.4190260Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2024-12-18T01:10:13.4192036Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2024-12-18T01:10:13.4193738Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2024-12-18T01:10:13.4195552Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2024-12-18T01:10:13.4197472Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local ... 2024-12-18T01:10:13.8040151Z 2024-12-18T01:10:13.8042077Z  2024-12-18T01:10:13.8043637Z  2024-12-18T01:10:13.8045262Z  2024-12-18T01:10:13.8046640Z  2024-12-18T01:10:13.8048045Z  2024-12-18T01:10:13.8049460Z  2024-12-18T01:10:13.8050846Z  2024-12-18T01:10:13.8052252Z  2024-12-18T01:10:13.8054187Z [20,508 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:13.8056286Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2024-12-18T01:10:13.8058330Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2024-12-18T01:10:13.8060014Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 31s local 2024-12-18T01:10:13.8062407Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2024-12-18T01:10:13.8064981Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2024-12-18T01:10:13.8067439Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2024-12-18T01:10:13.8069895Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2024-12-18T01:10:13.8072522Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local ... 2024-12-18T01:10:14.1621846Z 2024-12-18T01:10:14.1624525Z  2024-12-18T01:10:14.1626951Z  2024-12-18T01:10:14.1629199Z  2024-12-18T01:10:14.1631324Z  2024-12-18T01:10:14.1633332Z  2024-12-18T01:10:14.1635521Z  2024-12-18T01:10:14.1637522Z  2024-12-18T01:10:14.1639584Z  2024-12-18T01:10:14.1642106Z [20,509 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:14.1646629Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2024-12-18T01:10:14.1647413Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2024-12-18T01:10:14.1648122Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2024-12-18T01:10:14.1648904Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2024-12-18T01:10:14.1649707Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2024-12-18T01:10:14.1650502Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2024-12-18T01:10:14.1651417Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2024-12-18T01:10:14.1652527Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local ... 2024-12-18T01:10:14.4047583Z 2024-12-18T01:10:14.4048428Z  2024-12-18T01:10:14.4048888Z  2024-12-18T01:10:14.4049261Z  2024-12-18T01:10:14.4049611Z  2024-12-18T01:10:14.4049974Z  2024-12-18T01:10:14.4050337Z  2024-12-18T01:10:14.4050745Z  2024-12-18T01:10:14.4051094Z  2024-12-18T01:10:14.4052384Z [20,509 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:14.4053222Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2024-12-18T01:10:14.4054006Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2024-12-18T01:10:14.4054738Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2024-12-18T01:10:14.4055571Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2024-12-18T01:10:14.4056328Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2024-12-18T01:10:14.4057414Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2024-12-18T01:10:14.4058255Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2024-12-18T01:10:14.4059281Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local ... 2024-12-18T01:10:15.2054227Z 2024-12-18T01:10:15.2055126Z  2024-12-18T01:10:15.2055639Z  2024-12-18T01:10:15.2056030Z  2024-12-18T01:10:15.2056583Z  2024-12-18T01:10:15.2056965Z  2024-12-18T01:10:15.2057337Z  2024-12-18T01:10:15.2057727Z  2024-12-18T01:10:15.2058122Z  2024-12-18T01:10:15.2059032Z [20,510 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:15.2060017Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2024-12-18T01:10:15.2060828Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T01:10:15.2061593Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2024-12-18T01:10:15.2062457Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 32s local 2024-12-18T01:10:15.2063290Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2024-12-18T01:10:15.2064138Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2024-12-18T01:10:15.2064982Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2024-12-18T01:10:15.2065793Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local ... 2024-12-18T01:10:15.4500279Z 2024-12-18T01:10:15.4501114Z  2024-12-18T01:10:15.4501656Z  2024-12-18T01:10:15.4502068Z  2024-12-18T01:10:15.4502447Z  2024-12-18T01:10:15.4502808Z  2024-12-18T01:10:15.4503195Z  2024-12-18T01:10:15.4503596Z  2024-12-18T01:10:15.4503990Z  2024-12-18T01:10:15.4504879Z [20,512 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:15.4505919Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2024-12-18T01:10:15.4507060Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T01:10:15.4507804Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2024-12-18T01:10:15.4508632Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2024-12-18T01:10:15.4509452Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2024-12-18T01:10:15.4510271Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2024-12-18T01:10:15.4511275Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 30s local 2024-12-18T01:10:15.4512124Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 30s local ... 2024-12-18T01:10:15.8059577Z 2024-12-18T01:10:15.8060432Z  2024-12-18T01:10:15.8060891Z  2024-12-18T01:10:15.8061285Z  2024-12-18T01:10:15.8061683Z  2024-12-18T01:10:15.8062071Z  2024-12-18T01:10:15.8062441Z  2024-12-18T01:10:15.8062827Z  2024-12-18T01:10:15.8063205Z  2024-12-18T01:10:15.8064099Z [20,512 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:15.8065405Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2024-12-18T01:10:15.8066211Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2024-12-18T01:10:15.8066980Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T01:10:15.8067812Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2024-12-18T01:10:15.8068660Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2024-12-18T01:10:15.8071678Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2024-12-18T01:10:15.8072784Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 31s local 2024-12-18T01:10:15.8073651Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 30s local ... 2024-12-18T01:10:16.0845359Z 2024-12-18T01:10:16.0846236Z  2024-12-18T01:10:16.0846696Z  2024-12-18T01:10:16.0847084Z  2024-12-18T01:10:16.0847442Z  2024-12-18T01:10:16.0847836Z  2024-12-18T01:10:16.0848201Z  2024-12-18T01:10:16.0848563Z  2024-12-18T01:10:16.0848911Z  2024-12-18T01:10:16.0849779Z [20,513 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:16.0850782Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2024-12-18T01:10:16.0851544Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2024-12-18T01:10:16.0852266Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T01:10:16.0853082Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2024-12-18T01:10:16.0853878Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2024-12-18T01:10:16.0854988Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 31s local 2024-12-18T01:10:16.0855847Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 31s local 2024-12-18T01:10:16.0856836Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local ... 2024-12-18T01:10:16.4066567Z 2024-12-18T01:10:16.4067429Z  2024-12-18T01:10:16.4067838Z  2024-12-18T01:10:16.4068177Z  2024-12-18T01:10:16.4068544Z  2024-12-18T01:10:16.4068871Z  2024-12-18T01:10:16.4069188Z  2024-12-18T01:10:16.4069524Z  2024-12-18T01:10:16.4069866Z  2024-12-18T01:10:16.4070681Z [20,513 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:16.4071656Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2024-12-18T01:10:16.4072391Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2024-12-18T01:10:16.4073100Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2024-12-18T01:10:16.4073825Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2024-12-18T01:10:16.4074540Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2024-12-18T01:10:16.4075282Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 31s local 2024-12-18T01:10:16.4076129Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 31s local 2024-12-18T01:10:16.4077248Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local ... 2024-12-18T01:10:16.6197391Z 2024-12-18T01:10:16.6198259Z  2024-12-18T01:10:16.6198736Z  2024-12-18T01:10:16.6199138Z  2024-12-18T01:10:16.6199519Z  2024-12-18T01:10:16.6199894Z  2024-12-18T01:10:16.6200283Z  2024-12-18T01:10:16.6200663Z  2024-12-18T01:10:16.6201305Z  2024-12-18T01:10:16.6202194Z [20,514 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:16.6203212Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 38s local 2024-12-18T01:10:16.6203982Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2024-12-18T01:10:16.6204712Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2024-12-18T01:10:16.6205550Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2024-12-18T01:10:16.6206394Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2024-12-18T01:10:16.6207223Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 31s local 2024-12-18T01:10:16.6208222Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local 2024-12-18T01:10:16.6209000Z Compiling torch_xla/csrc/ops/cumsum.cpp; 31s local ... 2024-12-18T01:10:16.9157826Z 2024-12-18T01:10:16.9158717Z  2024-12-18T01:10:16.9159162Z  2024-12-18T01:10:16.9159571Z  2024-12-18T01:10:16.9159987Z  2024-12-18T01:10:16.9160348Z  2024-12-18T01:10:16.9160698Z  2024-12-18T01:10:16.9161065Z  2024-12-18T01:10:16.9161742Z  2024-12-18T01:10:16.9162679Z [20,515 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:16.9163558Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 38s local 2024-12-18T01:10:16.9164310Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2024-12-18T01:10:16.9165031Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2024-12-18T01:10:16.9165832Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2024-12-18T01:10:16.9166622Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2024-12-18T01:10:16.9167402Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local 2024-12-18T01:10:16.9168157Z Compiling torch_xla/csrc/ops/cumsum.cpp; 31s local 2024-12-18T01:10:16.9168904Z Compiling torch_xla/csrc/ops/cumprod.cpp; 31s local ... 2024-12-18T01:10:17.2372795Z 2024-12-18T01:10:17.2373646Z  2024-12-18T01:10:17.2374069Z  2024-12-18T01:10:17.2374436Z  2024-12-18T01:10:17.2374805Z  2024-12-18T01:10:17.2375147Z  2024-12-18T01:10:17.2375490Z  2024-12-18T01:10:17.2375821Z  2024-12-18T01:10:17.2376190Z  2024-12-18T01:10:17.2377295Z [20,515 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:17.2378240Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 38s local 2024-12-18T01:10:17.2379161Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2024-12-18T01:10:17.2379869Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2024-12-18T01:10:17.2380686Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2024-12-18T01:10:17.2381457Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2024-12-18T01:10:17.2382208Z Compiling torch_xla/csrc/ops/custom_call.cpp; 32s local 2024-12-18T01:10:17.2383001Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2024-12-18T01:10:17.2383828Z Compiling torch_xla/csrc/ops/cumprod.cpp; 31s local ... 2024-12-18T01:10:17.6377407Z 2024-12-18T01:10:17.6378300Z  2024-12-18T01:10:17.6378768Z  2024-12-18T01:10:17.6379162Z  2024-12-18T01:10:17.6379547Z  2024-12-18T01:10:17.6379952Z  2024-12-18T01:10:17.6380344Z  2024-12-18T01:10:17.6380734Z  2024-12-18T01:10:17.6381132Z  2024-12-18T01:10:17.6382057Z [20,516 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:17.6383467Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 39s local 2024-12-18T01:10:17.6384263Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2024-12-18T01:10:17.6385058Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2024-12-18T01:10:17.6385933Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2024-12-18T01:10:17.6386795Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2024-12-18T01:10:17.6387767Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2024-12-18T01:10:17.6388512Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2024-12-18T01:10:17.6389285Z Compiling torch_xla/csrc/ops/count_nonzero.cpp; 29s local ... 2024-12-18T01:10:18.2382740Z 2024-12-18T01:10:18.2383606Z  2024-12-18T01:10:18.2384060Z  2024-12-18T01:10:18.2384448Z  2024-12-18T01:10:18.2384835Z  2024-12-18T01:10:18.2385219Z  2024-12-18T01:10:18.2385583Z  2024-12-18T01:10:18.2385968Z  2024-12-18T01:10:18.2386387Z  2024-12-18T01:10:18.2387598Z [20,517 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:18.2388540Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2024-12-18T01:10:18.2389257Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2024-12-18T01:10:18.2390079Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2024-12-18T01:10:18.2391174Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2024-12-18T01:10:18.2392158Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2024-12-18T01:10:18.2392911Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2024-12-18T01:10:18.2393721Z Compiling torch_xla/csrc/ops/count_nonzero.cpp; 30s local 2024-12-18T01:10:18.2394664Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 29s local ... 2024-12-18T01:10:18.6386883Z 2024-12-18T01:10:18.6387751Z  2024-12-18T01:10:18.6388212Z  2024-12-18T01:10:18.6388624Z  2024-12-18T01:10:18.6388977Z  2024-12-18T01:10:18.6389361Z  2024-12-18T01:10:18.6389742Z  2024-12-18T01:10:18.6390134Z  2024-12-18T01:10:18.6390497Z  2024-12-18T01:10:18.6391436Z [20,517 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:18.6392448Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2024-12-18T01:10:18.6393160Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T01:10:18.6393974Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2024-12-18T01:10:18.6394745Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2024-12-18T01:10:18.6395448Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2024-12-18T01:10:18.6396194Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2024-12-18T01:10:18.6396947Z Compiling torch_xla/csrc/ops/count_nonzero.cpp; 30s local 2024-12-18T01:10:18.6397882Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 29s local ... 2024-12-18T01:10:18.8854806Z 2024-12-18T01:10:18.8855660Z  2024-12-18T01:10:18.8856128Z  2024-12-18T01:10:18.8856662Z  2024-12-18T01:10:18.8856991Z  2024-12-18T01:10:18.8857301Z  2024-12-18T01:10:18.8857603Z  2024-12-18T01:10:18.8857900Z  2024-12-18T01:10:18.8858199Z  2024-12-18T01:10:18.8858904Z [20,518 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:18.8859656Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2024-12-18T01:10:18.8860251Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T01:10:18.8860885Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T01:10:18.8861532Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2024-12-18T01:10:18.8862104Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2024-12-18T01:10:18.8862665Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2024-12-18T01:10:18.8863642Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 30s local 2024-12-18T01:10:18.8864279Z //torch_xla/csrc:tensor; 29s local ... 2024-12-18T01:10:19.2292320Z 2024-12-18T01:10:19.2293135Z  2024-12-18T01:10:19.2293520Z  2024-12-18T01:10:19.2293834Z  2024-12-18T01:10:19.2294144Z  2024-12-18T01:10:19.2294443Z  2024-12-18T01:10:19.2294746Z  2024-12-18T01:10:19.2295315Z  2024-12-18T01:10:19.2295626Z  2024-12-18T01:10:19.2296366Z [20,520 / 20,605] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2024-12-18T01:10:19.2297276Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T01:10:19.2297949Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T01:10:19.2298604Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T01:10:19.2299197Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2024-12-18T01:10:19.2299895Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 30s local 2024-12-18T01:10:19.2300847Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 30s local 2024-12-18T01:10:19.2301612Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 29s local 2024-12-18T01:10:19.2302296Z Compiling torch_xla/csrc/ops/constant.cpp; 28s local ... 2024-12-18T01:10:19.4392858Z 2024-12-18T01:10:19.4393651Z  2024-12-18T01:10:19.4394102Z  2024-12-18T01:10:19.4394451Z  2024-12-18T01:10:19.4394777Z  2024-12-18T01:10:19.4395119Z  2024-12-18T01:10:19.4395734Z  2024-12-18T01:10:19.4396083Z  2024-12-18T01:10:19.4396405Z  2024-12-18T01:10:19.4397220Z [20,520 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:19.4398085Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2024-12-18T01:10:19.4398811Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2024-12-18T01:10:19.4399564Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2024-12-18T01:10:19.4400237Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2024-12-18T01:10:19.4401025Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 30s local 2024-12-18T01:10:19.4401990Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 30s local 2024-12-18T01:10:19.4402837Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 29s local 2024-12-18T01:10:19.4403628Z Compiling torch_xla/csrc/ops/constant.cpp; 28s local ... 2024-12-18T01:10:20.4400019Z 2024-12-18T01:10:20.4400991Z  2024-12-18T01:10:20.4401399Z  2024-12-18T01:10:20.4401756Z  2024-12-18T01:10:20.4402120Z  2024-12-18T01:10:20.4402443Z  2024-12-18T01:10:20.4402772Z  2024-12-18T01:10:20.4403114Z  2024-12-18T01:10:20.4403464Z  2024-12-18T01:10:20.4404292Z [20,520 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:20.4405184Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2024-12-18T01:10:20.4405943Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2024-12-18T01:10:20.4406663Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2024-12-18T01:10:20.4407328Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2024-12-18T01:10:20.4408104Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 31s local 2024-12-18T01:10:20.4409030Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 31s local 2024-12-18T01:10:20.4409892Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 30s local 2024-12-18T01:10:20.4410663Z Compiling torch_xla/csrc/ops/constant.cpp; 29s local ... 2024-12-18T01:10:20.6455944Z 2024-12-18T01:10:20.6456853Z  2024-12-18T01:10:20.6457269Z  2024-12-18T01:10:20.6457609Z  2024-12-18T01:10:20.6457935Z  2024-12-18T01:10:20.6458282Z  2024-12-18T01:10:20.6458612Z  2024-12-18T01:10:20.6458958Z  2024-12-18T01:10:20.6459683Z  2024-12-18T01:10:20.6460501Z [20,521 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:20.6461355Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T01:10:20.6462015Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2024-12-18T01:10:20.6462669Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2024-12-18T01:10:20.6463535Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 31s local 2024-12-18T01:10:20.6464394Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 31s local 2024-12-18T01:10:20.6465361Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 31s local 2024-12-18T01:10:20.6466049Z Compiling torch_xla/csrc/ops/constant.cpp; 29s local 2024-12-18T01:10:20.6466794Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 29s local ... 2024-12-18T01:10:20.8465761Z 2024-12-18T01:10:20.8466525Z  2024-12-18T01:10:20.8466931Z  2024-12-18T01:10:20.8467348Z  2024-12-18T01:10:20.8467724Z  2024-12-18T01:10:20.8468103Z  2024-12-18T01:10:20.8468479Z  2024-12-18T01:10:20.8469094Z  2024-12-18T01:10:20.8469483Z  2024-12-18T01:10:20.8470379Z [20,522 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:20.8471301Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T01:10:20.8472058Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2024-12-18T01:10:20.8473040Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2024-12-18T01:10:20.8473912Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 31s local 2024-12-18T01:10:20.8474849Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 31s local 2024-12-18T01:10:20.8475645Z Compiling torch_xla/csrc/ops/constant.cpp; 29s local 2024-12-18T01:10:20.8476450Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 29s local 2024-12-18T01:10:20.8477256Z Compiling torch_xla/csrc/ops/cdist.cpp; 29s local ... 2024-12-18T01:10:21.1630328Z 2024-12-18T01:10:21.1631207Z  2024-12-18T01:10:21.1631688Z  2024-12-18T01:10:21.1632062Z  2024-12-18T01:10:21.1632430Z  2024-12-18T01:10:21.1632826Z  2024-12-18T01:10:21.1633249Z  2024-12-18T01:10:21.1633657Z  2024-12-18T01:10:21.1634057Z  2024-12-18T01:10:21.1635006Z [20,523 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:21.1636089Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T01:10:21.1636920Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T01:10:21.1637690Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2024-12-18T01:10:21.1638465Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 31s local 2024-12-18T01:10:21.1639315Z Compiling torch_xla/csrc/ops/constant.cpp; 30s local 2024-12-18T01:10:21.1640229Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 30s local 2024-12-18T01:10:21.1641135Z Compiling torch_xla/csrc/ops/cdist.cpp; 29s local 2024-12-18T01:10:21.1641934Z Compiling torch_xla/csrc/ops/cat.cpp; 28s local ... 2024-12-18T01:10:21.4405596Z 2024-12-18T01:10:21.4406412Z  2024-12-18T01:10:21.4406877Z  2024-12-18T01:10:21.4407278Z  2024-12-18T01:10:21.4407664Z  2024-12-18T01:10:21.4408057Z  2024-12-18T01:10:21.4408471Z  2024-12-18T01:10:21.4408834Z  2024-12-18T01:10:21.4409195Z  2024-12-18T01:10:21.4410101Z [20,523 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:21.4411112Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2024-12-18T01:10:21.4411900Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T01:10:21.4412682Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2024-12-18T01:10:21.4413477Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 31s local 2024-12-18T01:10:21.4414598Z Compiling torch_xla/csrc/ops/constant.cpp; 30s local 2024-12-18T01:10:21.4415454Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 30s local 2024-12-18T01:10:21.4416326Z Compiling torch_xla/csrc/ops/cdist.cpp; 30s local 2024-12-18T01:10:21.4417279Z Compiling torch_xla/csrc/ops/cat.cpp; 28s local ... 2024-12-18T01:10:21.8207695Z 2024-12-18T01:10:21.8208539Z  2024-12-18T01:10:21.8209306Z  2024-12-18T01:10:21.8209722Z  2024-12-18T01:10:21.8210061Z  2024-12-18T01:10:21.8210423Z  2024-12-18T01:10:21.8210767Z  2024-12-18T01:10:21.8211106Z  2024-12-18T01:10:21.8211444Z  2024-12-18T01:10:21.8212198Z [20,524 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:21.8213262Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T01:10:21.8213941Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T01:10:21.8214647Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 32s local 2024-12-18T01:10:21.8215361Z Compiling torch_xla/csrc/ops/constant.cpp; 30s local 2024-12-18T01:10:21.8216271Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 30s local 2024-12-18T01:10:21.8217118Z Compiling torch_xla/csrc/ops/cdist.cpp; 30s local 2024-12-18T01:10:21.8217761Z Compiling torch_xla/csrc/ops/cat.cpp; 28s local 2024-12-18T01:10:21.8218429Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 28s local ... 2024-12-18T01:10:22.0411585Z 2024-12-18T01:10:22.0412512Z  2024-12-18T01:10:22.0412921Z  2024-12-18T01:10:22.0413560Z  2024-12-18T01:10:22.0413919Z  2024-12-18T01:10:22.0414265Z  2024-12-18T01:10:22.0414608Z  2024-12-18T01:10:22.0414950Z  2024-12-18T01:10:22.0415301Z  2024-12-18T01:10:22.0416140Z [20,524 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:22.0417156Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2024-12-18T01:10:22.0417889Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T01:10:22.0418604Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 32s local 2024-12-18T01:10:22.0419327Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2024-12-18T01:10:22.0420083Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 30s local 2024-12-18T01:10:22.0420844Z Compiling torch_xla/csrc/ops/cdist.cpp; 30s local 2024-12-18T01:10:22.0421490Z Compiling torch_xla/csrc/ops/cat.cpp; 29s local 2024-12-18T01:10:22.0422194Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 28s local ... 2024-12-18T01:10:22.4415865Z 2024-12-18T01:10:22.4416818Z  2024-12-18T01:10:22.4417295Z  2024-12-18T01:10:22.4417678Z  2024-12-18T01:10:22.4418040Z  2024-12-18T01:10:22.4418452Z  2024-12-18T01:10:22.4418840Z  2024-12-18T01:10:22.4419198Z  2024-12-18T01:10:22.4419569Z  2024-12-18T01:10:22.4420490Z [20,526 / 20,605] 6 / 17 tests; 46 actions running; last test: ..._client_test 2024-12-18T01:10:22.4421479Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2024-12-18T01:10:22.4422262Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2024-12-18T01:10:22.4423014Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2024-12-18T01:10:22.4423812Z Compiling torch_xla/csrc/ops/cdist.cpp; 31s local 2024-12-18T01:10:22.4424567Z Compiling torch_xla/csrc/ops/cat.cpp; 29s local 2024-12-18T01:10:22.4425311Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 28s local 2024-12-18T01:10:22.4426088Z Compiling torch_xla/csrc/ops/cast.cpp; 28s local 2024-12-18T01:10:22.4426652Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 28s local ... 2024-12-18T01:10:22.6418935Z 2024-12-18T01:10:22.6419795Z  2024-12-18T01:10:22.6420288Z  2024-12-18T01:10:22.6420668Z  2024-12-18T01:10:22.6421020Z  2024-12-18T01:10:22.6421409Z  2024-12-18T01:10:22.6421780Z  2024-12-18T01:10:22.6422423Z  2024-12-18T01:10:22.6422789Z  2024-12-18T01:10:22.6423680Z [20,527 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:22.6424644Z Compiling torch_xla/csrc/ops/cumprod.cpp; 37s local 2024-12-18T01:10:22.6425361Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2024-12-18T01:10:22.6426173Z Compiling torch_xla/csrc/ops/cdist.cpp; 31s local 2024-12-18T01:10:22.6427130Z Compiling torch_xla/csrc/ops/cat.cpp; 29s local 2024-12-18T01:10:22.6427794Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 29s local 2024-12-18T01:10:22.6428503Z Compiling torch_xla/csrc/ops/cast.cpp; 28s local 2024-12-18T01:10:22.6429183Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 28s local 2024-12-18T01:10:22.6429999Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 28s local ... 2024-12-18T01:10:22.9678050Z 2024-12-18T01:10:22.9679002Z  2024-12-18T01:10:22.9679470Z  2024-12-18T01:10:22.9679813Z  2024-12-18T01:10:22.9680217Z  2024-12-18T01:10:22.9680598Z  2024-12-18T01:10:22.9680971Z  2024-12-18T01:10:22.9681322Z  2024-12-18T01:10:22.9682162Z  2024-12-18T01:10:22.9683102Z [20,528 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:22.9684097Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2024-12-18T01:10:22.9684876Z Compiling torch_xla/csrc/ops/cdist.cpp; 31s local 2024-12-18T01:10:22.9685589Z Compiling torch_xla/csrc/ops/cat.cpp; 30s local 2024-12-18T01:10:22.9686583Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 29s local 2024-12-18T01:10:22.9687372Z Compiling torch_xla/csrc/ops/cast.cpp; 28s local 2024-12-18T01:10:22.9688096Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 28s local 2024-12-18T01:10:22.9688917Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 28s local 2024-12-18T01:10:22.9689829Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 27s local ... 2024-12-18T01:10:23.1808363Z 2024-12-18T01:10:23.1809210Z  2024-12-18T01:10:23.1809709Z  2024-12-18T01:10:23.1810119Z  2024-12-18T01:10:23.1810524Z  2024-12-18T01:10:23.1810891Z  2024-12-18T01:10:23.1811253Z  2024-12-18T01:10:23.1811595Z  2024-12-18T01:10:23.1811962Z  2024-12-18T01:10:23.1812830Z [20,529 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:23.1814271Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local 2024-12-18T01:10:23.1815209Z Compiling torch_xla/csrc/ops/cat.cpp; 30s local 2024-12-18T01:10:23.1816123Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 29s local 2024-12-18T01:10:23.1817128Z Compiling torch_xla/csrc/ops/cast.cpp; 29s local 2024-12-18T01:10:23.1818031Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 29s local 2024-12-18T01:10:23.1819046Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 28s local 2024-12-18T01:10:23.1820061Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 27s local 2024-12-18T01:10:23.1821170Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 25s local ... 2024-12-18T01:10:23.4424673Z 2024-12-18T01:10:23.4425582Z  2024-12-18T01:10:23.4426075Z  2024-12-18T01:10:23.4426443Z  2024-12-18T01:10:23.4426826Z  2024-12-18T01:10:23.4427276Z  2024-12-18T01:10:23.4427684Z  2024-12-18T01:10:23.4428084Z  2024-12-18T01:10:23.4428487Z  2024-12-18T01:10:23.4429424Z [20,529 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:23.4430435Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local 2024-12-18T01:10:23.4431215Z Compiling torch_xla/csrc/ops/cat.cpp; 30s local 2024-12-18T01:10:23.4431935Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 29s local 2024-12-18T01:10:23.4432645Z Compiling torch_xla/csrc/ops/cast.cpp; 29s local 2024-12-18T01:10:23.4433387Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 29s local 2024-12-18T01:10:23.4434739Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 28s local 2024-12-18T01:10:23.4435675Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 27s local 2024-12-18T01:10:23.4436751Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 25s local ... 2024-12-18T01:10:24.1126705Z 2024-12-18T01:10:24.1127523Z  2024-12-18T01:10:24.1128047Z  2024-12-18T01:10:24.1128764Z  2024-12-18T01:10:24.1129166Z  2024-12-18T01:10:24.1129553Z  2024-12-18T01:10:24.1129962Z  2024-12-18T01:10:24.1130383Z  2024-12-18T01:10:24.1130770Z  2024-12-18T01:10:24.1131577Z [20,530 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:24.1132571Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2024-12-18T01:10:24.1133349Z Compiling torch_xla/csrc/ops/cat.cpp; 31s local 2024-12-18T01:10:24.1134123Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 30s local 2024-12-18T01:10:24.1134890Z Compiling torch_xla/csrc/ops/cast.cpp; 30s local 2024-12-18T01:10:24.1135875Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 29s local 2024-12-18T01:10:24.1136854Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 29s local 2024-12-18T01:10:24.1137754Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 28s local 2024-12-18T01:10:24.1138633Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 26s local ... 2024-12-18T01:10:24.3860708Z 2024-12-18T01:10:24.3861655Z  2024-12-18T01:10:24.3863397Z  2024-12-18T01:10:24.3864272Z  2024-12-18T01:10:24.3864699Z  2024-12-18T01:10:24.3865081Z  2024-12-18T01:10:24.3865492Z  2024-12-18T01:10:24.3865870Z  2024-12-18T01:10:24.3866288Z  2024-12-18T01:10:24.3867353Z [20,531 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:24.3868485Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2024-12-18T01:10:24.3869483Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 30s local 2024-12-18T01:10:24.3870338Z Compiling torch_xla/csrc/ops/cast.cpp; 30s local 2024-12-18T01:10:24.3871120Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 30s local 2024-12-18T01:10:24.3872279Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 29s local 2024-12-18T01:10:24.3873205Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 28s local 2024-12-18T01:10:24.3874146Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 26s local 2024-12-18T01:10:24.3875208Z Compiling torch_xla/csrc/convert_ops.cpp; 26s local ... 2024-12-18T01:10:24.6433838Z 2024-12-18T01:10:24.6434742Z  2024-12-18T01:10:24.6435229Z  2024-12-18T01:10:24.6435743Z  2024-12-18T01:10:24.6436250Z  2024-12-18T01:10:24.6436656Z  2024-12-18T01:10:24.6437036Z  2024-12-18T01:10:24.6437385Z  2024-12-18T01:10:24.6437691Z  2024-12-18T01:10:24.6438526Z [20,531 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:24.6439561Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2024-12-18T01:10:24.6440497Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 31s local 2024-12-18T01:10:24.6441302Z Compiling torch_xla/csrc/ops/cast.cpp; 30s local 2024-12-18T01:10:24.6442175Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 30s local 2024-12-18T01:10:24.6443155Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 30s local 2024-12-18T01:10:24.6443930Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 28s local 2024-12-18T01:10:24.6445039Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 27s local 2024-12-18T01:10:24.6445946Z Compiling torch_xla/csrc/convert_ops.cpp; 26s local ... 2024-12-18T01:10:25.5982700Z 2024-12-18T01:10:25.5983626Z  2024-12-18T01:10:25.5984123Z  2024-12-18T01:10:25.5984545Z  2024-12-18T01:10:25.5984887Z  2024-12-18T01:10:25.5985229Z  2024-12-18T01:10:25.5985932Z  2024-12-18T01:10:25.5986306Z  2024-12-18T01:10:25.5986785Z  2024-12-18T01:10:25.5988337Z [20,532 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:25.5989683Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2024-12-18T01:10:25.5990542Z Compiling torch_xla/csrc/ops/cast.cpp; 31s local 2024-12-18T01:10:25.5991612Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 31s local 2024-12-18T01:10:25.5992563Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 30s local 2024-12-18T01:10:25.5993543Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 29s local 2024-12-18T01:10:25.5994541Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 27s local 2024-12-18T01:10:25.5995489Z Compiling torch_xla/csrc/convert_ops.cpp; 27s local 2024-12-18T01:10:25.5996390Z Compiling torch_xla/csrc/ops/as_strided.cpp; 26s local ... 2024-12-18T01:10:25.8441847Z 2024-12-18T01:10:25.8442719Z  2024-12-18T01:10:25.8443179Z  2024-12-18T01:10:25.8443552Z  2024-12-18T01:10:25.8443919Z  2024-12-18T01:10:25.8444497Z  2024-12-18T01:10:25.8445144Z  2024-12-18T01:10:25.8445584Z  2024-12-18T01:10:25.8445924Z  2024-12-18T01:10:25.8446882Z [20,533 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:25.8447869Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2024-12-18T01:10:25.8448603Z Compiling torch_xla/csrc/ops/cast.cpp; 31s local 2024-12-18T01:10:25.8449589Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 31s local 2024-12-18T01:10:25.8450430Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 29s local 2024-12-18T01:10:25.8451243Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 28s local 2024-12-18T01:10:25.8452039Z Compiling torch_xla/csrc/convert_ops.cpp; 28s local 2024-12-18T01:10:25.8452774Z Compiling torch_xla/csrc/ops/as_strided.cpp; 26s local 2024-12-18T01:10:25.8453590Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 26s local ... 2024-12-18T01:10:26.2446343Z 2024-12-18T01:10:26.2447265Z  2024-12-18T01:10:26.2447708Z  2024-12-18T01:10:26.2448094Z  2024-12-18T01:10:26.2448482Z  2024-12-18T01:10:26.2448893Z  2024-12-18T01:10:26.2449315Z  2024-12-18T01:10:26.2449688Z  2024-12-18T01:10:26.2450084Z  2024-12-18T01:10:26.2451035Z [20,533 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:26.2452050Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2024-12-18T01:10:26.2452805Z Compiling torch_xla/csrc/ops/cast.cpp; 32s local 2024-12-18T01:10:26.2453654Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 31s local 2024-12-18T01:10:26.2454545Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 30s local 2024-12-18T01:10:26.2455431Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 28s local 2024-12-18T01:10:26.2456208Z Compiling torch_xla/csrc/convert_ops.cpp; 28s local 2024-12-18T01:10:26.2457031Z Compiling torch_xla/csrc/ops/as_strided.cpp; 27s local 2024-12-18T01:10:26.2457825Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 26s local ... 2024-12-18T01:10:26.4449650Z 2024-12-18T01:10:26.4450545Z  2024-12-18T01:10:26.4450999Z  2024-12-18T01:10:26.4451332Z  2024-12-18T01:10:26.4451703Z  2024-12-18T01:10:26.4452062Z  2024-12-18T01:10:26.4452396Z  2024-12-18T01:10:26.4452729Z  2024-12-18T01:10:26.4453053Z  2024-12-18T01:10:26.4453915Z [20,534 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:26.4454774Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2024-12-18T01:10:26.4455395Z Compiling torch_xla/csrc/ops/cast.cpp; 32s local 2024-12-18T01:10:26.4456111Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 31s local 2024-12-18T01:10:26.4457301Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 30s local 2024-12-18T01:10:26.4458129Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 28s local 2024-12-18T01:10:26.4458858Z Compiling torch_xla/csrc/convert_ops.cpp; 28s local 2024-12-18T01:10:26.4459576Z Compiling torch_xla/csrc/ops/as_strided.cpp; 27s local 2024-12-18T01:10:26.4460481Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 27s local ... 2024-12-18T01:10:26.8453521Z 2024-12-18T01:10:26.8454446Z  2024-12-18T01:10:26.8454917Z  2024-12-18T01:10:26.8455282Z  2024-12-18T01:10:26.8455740Z  2024-12-18T01:10:26.8456114Z  2024-12-18T01:10:26.8456649Z  2024-12-18T01:10:26.8457036Z  2024-12-18T01:10:26.8457422Z  2024-12-18T01:10:26.8458344Z [20,534 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:26.8459315Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2024-12-18T01:10:26.8460065Z Compiling torch_xla/csrc/ops/cast.cpp; 32s local 2024-12-18T01:10:26.8460899Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 32s local 2024-12-18T01:10:26.8462099Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 30s local 2024-12-18T01:10:26.8463026Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 29s local 2024-12-18T01:10:26.8463872Z Compiling torch_xla/csrc/convert_ops.cpp; 29s local 2024-12-18T01:10:26.8464575Z Compiling torch_xla/csrc/ops/as_strided.cpp; 27s local 2024-12-18T01:10:26.8467711Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 27s local ... 2024-12-18T01:10:27.8460833Z 2024-12-18T01:10:27.8461756Z  2024-12-18T01:10:27.8462287Z  2024-12-18T01:10:27.8462667Z  2024-12-18T01:10:27.8463035Z  2024-12-18T01:10:27.8463416Z  2024-12-18T01:10:27.8463800Z  2024-12-18T01:10:27.8464209Z  2024-12-18T01:10:27.8464606Z  2024-12-18T01:10:27.8465651Z [20,534 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:27.8466678Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2024-12-18T01:10:27.8467438Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local 2024-12-18T01:10:27.8468311Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 33s local 2024-12-18T01:10:27.8469250Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 31s local 2024-12-18T01:10:27.8470233Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 30s local 2024-12-18T01:10:27.8471139Z Compiling torch_xla/csrc/convert_ops.cpp; 30s local 2024-12-18T01:10:27.8471980Z Compiling torch_xla/csrc/ops/as_strided.cpp; 28s local 2024-12-18T01:10:27.8472919Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 28s local ... 2024-12-18T01:10:28.2465086Z 2024-12-18T01:10:28.2465991Z  2024-12-18T01:10:28.2466464Z  2024-12-18T01:10:28.2466851Z  2024-12-18T01:10:28.2467231Z  2024-12-18T01:10:28.2467661Z  2024-12-18T01:10:28.2468093Z  2024-12-18T01:10:28.2468510Z  2024-12-18T01:10:28.2468922Z  2024-12-18T01:10:28.2469917Z [20,535 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:28.2470931Z Compiling torch_xla/csrc/ops/constant.cpp; 37s local 2024-12-18T01:10:28.2471713Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2024-12-18T01:10:28.2472501Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 32s local 2024-12-18T01:10:28.2473398Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 30s local 2024-12-18T01:10:28.2474299Z Compiling torch_xla/csrc/convert_ops.cpp; 30s local 2024-12-18T01:10:28.2475103Z Compiling torch_xla/csrc/ops/as_strided.cpp; 29s local 2024-12-18T01:10:28.2476004Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 28s local 2024-12-18T01:10:28.2476953Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 28s local ... 2024-12-18T01:10:28.6010295Z 2024-12-18T01:10:28.6011254Z  2024-12-18T01:10:28.6021854Z  2024-12-18T01:10:28.6022607Z  2024-12-18T01:10:28.6023004Z  2024-12-18T01:10:28.6023401Z  2024-12-18T01:10:28.6023876Z  2024-12-18T01:10:28.6024276Z  2024-12-18T01:10:28.6024673Z  2024-12-18T01:10:28.6025452Z [20,536 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:28.6026470Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2024-12-18T01:10:28.6027498Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 32s local 2024-12-18T01:10:28.6028392Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 30s local 2024-12-18T01:10:28.6029232Z Compiling torch_xla/csrc/convert_ops.cpp; 30s local 2024-12-18T01:10:28.6030002Z Compiling torch_xla/csrc/ops/as_strided.cpp; 29s local 2024-12-18T01:10:28.6030878Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 29s local 2024-12-18T01:10:28.6031763Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 28s local 2024-12-18T01:10:28.6032525Z //torch_xla/csrc:tensor; 28s local ... 2024-12-18T01:10:28.8470106Z 2024-12-18T01:10:28.8470894Z  2024-12-18T01:10:28.8471619Z  2024-12-18T01:10:28.8472041Z  2024-12-18T01:10:28.8472432Z  2024-12-18T01:10:28.8472838Z  2024-12-18T01:10:28.8473245Z  2024-12-18T01:10:28.8473645Z  2024-12-18T01:10:28.8474041Z  2024-12-18T01:10:28.8475218Z [20,537 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:28.8476422Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2024-12-18T01:10:28.8477365Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 31s local 2024-12-18T01:10:28.8478304Z Compiling torch_xla/csrc/convert_ops.cpp; 31s local 2024-12-18T01:10:28.8479142Z Compiling torch_xla/csrc/ops/as_strided.cpp; 29s local 2024-12-18T01:10:28.8480063Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 29s local 2024-12-18T01:10:28.8481041Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 29s local 2024-12-18T01:10:28.8481858Z //torch_xla/csrc:tensor; 29s local 2024-12-18T01:10:28.8482637Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 27s local ... 2024-12-18T01:10:30.0477758Z 2024-12-18T01:10:30.0478607Z  2024-12-18T01:10:30.0479018Z  2024-12-18T01:10:30.0479363Z  2024-12-18T01:10:30.0479701Z  2024-12-18T01:10:30.0480055Z  2024-12-18T01:10:30.0480391Z  2024-12-18T01:10:30.0480723Z  2024-12-18T01:10:30.0481066Z  2024-12-18T01:10:30.0481889Z [20,537 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:30.0482703Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2024-12-18T01:10:30.0483448Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 32s local 2024-12-18T01:10:30.0484172Z Compiling torch_xla/csrc/convert_ops.cpp; 32s local 2024-12-18T01:10:30.0484802Z Compiling torch_xla/csrc/ops/as_strided.cpp; 30s local 2024-12-18T01:10:30.0485545Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 30s local 2024-12-18T01:10:30.0486329Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 30s local 2024-12-18T01:10:30.0486949Z //torch_xla/csrc:tensor; 30s local 2024-12-18T01:10:30.0487540Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 28s local ... 2024-12-18T01:10:30.5132648Z 2024-12-18T01:10:30.5133522Z  2024-12-18T01:10:30.5133996Z  2024-12-18T01:10:30.5134335Z  2024-12-18T01:10:30.5134705Z  2024-12-18T01:10:30.5135091Z  2024-12-18T01:10:30.5135491Z  2024-12-18T01:10:30.5135854Z  2024-12-18T01:10:30.5136238Z  2024-12-18T01:10:30.5137281Z [20,538 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:30.5138231Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2024-12-18T01:10:30.5139068Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 32s local 2024-12-18T01:10:30.5140793Z Compiling torch_xla/csrc/convert_ops.cpp; 32s local 2024-12-18T01:10:30.5141707Z Compiling torch_xla/csrc/ops/as_strided.cpp; 31s local 2024-12-18T01:10:30.5142681Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 30s local 2024-12-18T01:10:30.5143533Z //torch_xla/csrc:tensor; 30s local 2024-12-18T01:10:30.5144477Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 29s local 2024-12-18T01:10:30.5145630Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 25s local ... 2024-12-18T01:10:30.8485974Z 2024-12-18T01:10:30.8486966Z  2024-12-18T01:10:30.8487470Z  2024-12-18T01:10:30.8487862Z  2024-12-18T01:10:30.8488208Z  2024-12-18T01:10:30.8488622Z  2024-12-18T01:10:30.8488998Z  2024-12-18T01:10:30.8489361Z  2024-12-18T01:10:30.8489688Z  2024-12-18T01:10:30.8490454Z [20,538 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:30.8491228Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2024-12-18T01:10:30.8491918Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 33s local 2024-12-18T01:10:30.8493065Z Compiling torch_xla/csrc/convert_ops.cpp; 33s local 2024-12-18T01:10:30.8493835Z Compiling torch_xla/csrc/ops/as_strided.cpp; 31s local 2024-12-18T01:10:30.8494658Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 31s local 2024-12-18T01:10:30.8495411Z //torch_xla/csrc:tensor; 31s local 2024-12-18T01:10:30.8496032Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 29s local 2024-12-18T01:10:30.8497292Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 25s local ... 2024-12-18T01:10:31.6492099Z 2024-12-18T01:10:31.6493045Z  2024-12-18T01:10:31.6493617Z  2024-12-18T01:10:31.6493989Z  2024-12-18T01:10:31.6494327Z  2024-12-18T01:10:31.6494682Z  2024-12-18T01:10:31.6495025Z  2024-12-18T01:10:31.6495391Z  2024-12-18T01:10:31.6495714Z  2024-12-18T01:10:31.6496727Z [20,539 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:31.6497552Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 34s local 2024-12-18T01:10:31.6498164Z Compiling torch_xla/csrc/convert_ops.cpp; 33s local 2024-12-18T01:10:31.6498712Z Compiling torch_xla/csrc/ops/as_strided.cpp; 32s local 2024-12-18T01:10:31.6499343Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 31s local 2024-12-18T01:10:31.6499897Z //torch_xla/csrc:tensor; 31s local 2024-12-18T01:10:31.6500394Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 30s local 2024-12-18T01:10:31.6501044Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 26s local 2024-12-18T01:10:31.6501792Z Compiling torch_xla/csrc/ops/all_gather.cpp; 23s local ... 2024-12-18T01:10:32.0497401Z 2024-12-18T01:10:32.0498330Z  2024-12-18T01:10:32.0498997Z  2024-12-18T01:10:32.0499406Z  2024-12-18T01:10:32.0499803Z  2024-12-18T01:10:32.0500215Z  2024-12-18T01:10:32.0500662Z  2024-12-18T01:10:32.0501041Z  2024-12-18T01:10:32.0501446Z  2024-12-18T01:10:32.0502332Z [20,539 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:32.0503419Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 34s local 2024-12-18T01:10:32.0504303Z Compiling torch_xla/csrc/convert_ops.cpp; 34s local 2024-12-18T01:10:32.0505078Z Compiling torch_xla/csrc/ops/as_strided.cpp; 32s local 2024-12-18T01:10:32.0505941Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 32s local 2024-12-18T01:10:32.0506696Z //torch_xla/csrc:tensor; 32s local 2024-12-18T01:10:32.0507371Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 30s local 2024-12-18T01:10:32.0508178Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 26s local 2024-12-18T01:10:32.0509005Z Compiling torch_xla/csrc/ops/all_gather.cpp; 24s local ... 2024-12-18T01:10:32.6502583Z 2024-12-18T01:10:32.6503536Z  2024-12-18T01:10:32.6504329Z  2024-12-18T01:10:32.6504683Z  2024-12-18T01:10:32.6505082Z  2024-12-18T01:10:32.6505469Z  2024-12-18T01:10:32.6505886Z  2024-12-18T01:10:32.6506270Z  2024-12-18T01:10:32.6506653Z  2024-12-18T01:10:32.6507436Z [20,540 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:32.6508228Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2024-12-18T01:10:32.6509038Z Compiling torch_xla/csrc/convert_ops.cpp; 34s local 2024-12-18T01:10:32.6509655Z Compiling torch_xla/csrc/ops/as_strided.cpp; 33s local 2024-12-18T01:10:32.6510291Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 32s local 2024-12-18T01:10:32.6510981Z //torch_xla/csrc:tensor; 32s local 2024-12-18T01:10:32.6511599Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 31s local 2024-12-18T01:10:32.6512347Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 27s local 2024-12-18T01:10:32.6513128Z Compiling torch_xla/csrc/ops/all_gather.cpp; 24s local ... 2024-12-18T01:10:33.0506952Z 2024-12-18T01:10:33.0507983Z  2024-12-18T01:10:33.0508911Z  2024-12-18T01:10:33.0509330Z  2024-12-18T01:10:33.0509748Z  2024-12-18T01:10:33.0510154Z  2024-12-18T01:10:33.0510532Z  2024-12-18T01:10:33.0510937Z  2024-12-18T01:10:33.0511333Z  2024-12-18T01:10:33.0512303Z [20,540 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:33.0513653Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2024-12-18T01:10:33.0514582Z Compiling torch_xla/csrc/convert_ops.cpp; 35s local 2024-12-18T01:10:33.0515371Z Compiling torch_xla/csrc/ops/as_strided.cpp; 33s local 2024-12-18T01:10:33.0516264Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 33s local 2024-12-18T01:10:33.0517061Z //torch_xla/csrc:tensor; 33s local 2024-12-18T01:10:33.0517751Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 31s local 2024-12-18T01:10:33.0518593Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 27s local 2024-12-18T01:10:33.0519460Z Compiling torch_xla/csrc/ops/all_gather.cpp; 25s local ... 2024-12-18T01:10:33.2510585Z 2024-12-18T01:10:33.2511509Z  2024-12-18T01:10:33.2511976Z  2024-12-18T01:10:33.2512350Z  2024-12-18T01:10:33.2512745Z  2024-12-18T01:10:33.2513144Z  2024-12-18T01:10:33.2513568Z  2024-12-18T01:10:33.2513954Z  2024-12-18T01:10:33.2514293Z  2024-12-18T01:10:33.2515192Z [20,541 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:33.2516289Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2024-12-18T01:10:33.2517188Z Compiling torch_xla/csrc/ops/as_strided.cpp; 34s local 2024-12-18T01:10:33.2518021Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 33s local 2024-12-18T01:10:33.2518742Z //torch_xla/csrc:tensor; 33s local 2024-12-18T01:10:33.2519430Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 31s local 2024-12-18T01:10:33.2520223Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 27s local 2024-12-18T01:10:33.2521014Z Compiling torch_xla/csrc/ops/all_gather.cpp; 25s local 2024-12-18T01:10:33.2521848Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 25s local ... 2024-12-18T01:10:34.1825487Z 2024-12-18T01:10:34.1826497Z  2024-12-18T01:10:34.1826948Z  2024-12-18T01:10:34.1827519Z  2024-12-18T01:10:34.1827912Z  2024-12-18T01:10:34.1828374Z  2024-12-18T01:10:34.1828890Z  2024-12-18T01:10:34.1829348Z  2024-12-18T01:10:34.1829838Z  2024-12-18T01:10:34.1830823Z [20,542 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:34.1831931Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local 2024-12-18T01:10:34.1832863Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2024-12-18T01:10:34.1834045Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 34s local 2024-12-18T01:10:34.1834835Z //torch_xla/csrc:tensor; 34s local 2024-12-18T01:10:34.1835557Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 28s local 2024-12-18T01:10:34.1836412Z Compiling torch_xla/csrc/ops/all_gather.cpp; 26s local 2024-12-18T01:10:34.1837340Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 26s local 2024-12-18T01:10:34.1838479Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 25s local ... 2024-12-18T01:10:34.4517468Z 2024-12-18T01:10:34.4518407Z  2024-12-18T01:10:34.4518844Z  2024-12-18T01:10:34.4519198Z  2024-12-18T01:10:34.4519511Z  2024-12-18T01:10:34.4520065Z  2024-12-18T01:10:34.4520455Z  2024-12-18T01:10:34.4520785Z  2024-12-18T01:10:34.4521231Z  2024-12-18T01:10:34.4522190Z [20,542 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:34.4523278Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local 2024-12-18T01:10:34.4524431Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2024-12-18T01:10:34.4525306Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 34s local 2024-12-18T01:10:34.4526054Z //torch_xla/csrc:tensor; 34s local 2024-12-18T01:10:34.4526779Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 29s local 2024-12-18T01:10:34.4527608Z Compiling torch_xla/csrc/ops/all_gather.cpp; 26s local 2024-12-18T01:10:34.4528494Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 26s local 2024-12-18T01:10:34.4529532Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 25s local ... 2024-12-18T01:10:34.9323553Z 2024-12-18T01:10:34.9324338Z  2024-12-18T01:10:34.9324717Z  2024-12-18T01:10:34.9325015Z  2024-12-18T01:10:34.9325326Z  2024-12-18T01:10:34.9325631Z  2024-12-18T01:10:34.9325932Z  2024-12-18T01:10:34.9326229Z  2024-12-18T01:10:34.9326514Z  2024-12-18T01:10:34.9327255Z [20,543 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:34.9328026Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2024-12-18T01:10:34.9328670Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 35s local 2024-12-18T01:10:34.9329245Z //torch_xla/csrc:tensor; 35s local 2024-12-18T01:10:34.9329740Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 29s local 2024-12-18T01:10:34.9330349Z Compiling torch_xla/csrc/ops/all_gather.cpp; 27s local 2024-12-18T01:10:34.9331015Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 27s local 2024-12-18T01:10:34.9331717Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 26s local 2024-12-18T01:10:34.9332413Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 26s local ... 2024-12-18T01:10:35.1524195Z 2024-12-18T01:10:35.1525160Z  2024-12-18T01:10:35.1525654Z  2024-12-18T01:10:35.1526043Z  2024-12-18T01:10:35.1526471Z  2024-12-18T01:10:35.1527107Z  2024-12-18T01:10:35.1527559Z  2024-12-18T01:10:35.1528039Z  2024-12-18T01:10:35.1528559Z  2024-12-18T01:10:35.1529576Z [20,545 / 20,605] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2024-12-18T01:10:35.1530686Z Compiling torch_xla/csrc/ops/as_strided.cpp; 36s local 2024-12-18T01:10:35.1531575Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 29s local 2024-12-18T01:10:35.1532452Z Compiling torch_xla/csrc/ops/all_gather.cpp; 27s local 2024-12-18T01:10:35.1533408Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 27s local 2024-12-18T01:10:35.1534409Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 26s local 2024-12-18T01:10:35.1535412Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 26s local 2024-12-18T01:10:35.1536330Z Compiling torch_xla/csrc/RegisterXLA.cpp; 26s local 2024-12-18T01:10:35.1537397Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 22s local ... 2024-12-18T01:10:35.4524830Z 2024-12-18T01:10:35.4525788Z  2024-12-18T01:10:35.4526195Z  2024-12-18T01:10:35.4526575Z  2024-12-18T01:10:35.4527163Z  2024-12-18T01:10:35.4527547Z  2024-12-18T01:10:35.4527971Z  2024-12-18T01:10:35.4528421Z  2024-12-18T01:10:35.4528860Z  2024-12-18T01:10:35.4529768Z [20,545 / 20,605] 6 / 17 tests; 48 actions running; last test: ..._client_test 2024-12-18T01:10:35.4530951Z Compiling torch_xla/csrc/ops/as_strided.cpp; 36s local 2024-12-18T01:10:35.4531753Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 30s local 2024-12-18T01:10:35.4532672Z Compiling torch_xla/csrc/ops/all_gather.cpp; 27s local 2024-12-18T01:10:35.4533503Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 27s local 2024-12-18T01:10:35.4534380Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 26s local 2024-12-18T01:10:35.4535279Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 26s local 2024-12-18T01:10:35.4536330Z Compiling torch_xla/csrc/RegisterXLA.cpp; 26s local 2024-12-18T01:10:35.4537529Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 23s local ... 2024-12-18T01:10:35.6531394Z 2024-12-18T01:10:35.6532257Z  2024-12-18T01:10:35.6532717Z  2024-12-18T01:10:35.6533048Z  2024-12-18T01:10:35.6533358Z  2024-12-18T01:10:35.6533664Z  2024-12-18T01:10:35.6533988Z  2024-12-18T01:10:35.6534309Z  2024-12-18T01:10:35.6534690Z  2024-12-18T01:10:35.6535916Z [20,546 / 20,605] 6 / 17 tests; 47 actions running; last test: ..._client_test 2024-12-18T01:10:35.6537119Z Compiling torch_xla/csrc/ops/as_strided.cpp; 36s local 2024-12-18T01:10:35.6537916Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 30s local 2024-12-18T01:10:35.6538726Z Compiling torch_xla/csrc/ops/all_gather.cpp; 27s local 2024-12-18T01:10:35.6539598Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 27s local 2024-12-18T01:10:35.6540556Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 27s local 2024-12-18T01:10:35.6541504Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 26s local 2024-12-18T01:10:35.6542336Z Compiling torch_xla/csrc/RegisterXLA.cpp; 26s local 2024-12-18T01:10:35.6543202Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 23s local ... 2024-12-18T01:10:36.0534111Z 2024-12-18T01:10:36.0535019Z  2024-12-18T01:10:36.0535463Z  2024-12-18T01:10:36.0535847Z  2024-12-18T01:10:36.0536208Z  2024-12-18T01:10:36.0536716Z  2024-12-18T01:10:36.0537094Z  2024-12-18T01:10:36.0537452Z  2024-12-18T01:10:36.0537810Z  2024-12-18T01:10:36.0538664Z [20,547 / 20,605] 6 / 17 tests; 46 actions running; last test: ..._client_test 2024-12-18T01:10:36.0539597Z Compiling torch_xla/csrc/ops/as_strided.cpp; 36s local 2024-12-18T01:10:36.0540358Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 30s local 2024-12-18T01:10:36.0541154Z Compiling torch_xla/csrc/ops/all_gather.cpp; 28s local 2024-12-18T01:10:36.0542012Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 28s local 2024-12-18T01:10:36.0542965Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 27s local 2024-12-18T01:10:36.0543917Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 27s local 2024-12-18T01:10:36.0544982Z Compiling torch_xla/csrc/RegisterXLA.cpp; 27s local 2024-12-18T01:10:36.0545849Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 23s local ... 2024-12-18T01:10:36.8544643Z 2024-12-18T01:10:36.8545573Z  2024-12-18T01:10:36.8546015Z  2024-12-18T01:10:36.8546369Z  2024-12-18T01:10:36.8546771Z  2024-12-18T01:10:36.8547122Z  2024-12-18T01:10:36.8547507Z  2024-12-18T01:10:36.8547902Z  2024-12-18T01:10:36.8548270Z  2024-12-18T01:10:36.8549123Z [20,548 / 20,605] 6 / 17 tests; 45 actions running; last test: ..._client_test 2024-12-18T01:10:36.8550466Z Compiling torch_xla/csrc/ops/as_strided.cpp; 37s local 2024-12-18T01:10:36.8551427Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 31s local 2024-12-18T01:10:36.8552204Z Compiling torch_xla/csrc/ops/all_gather.cpp; 29s local 2024-12-18T01:10:36.8552949Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 29s local 2024-12-18T01:10:36.8554040Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 28s local 2024-12-18T01:10:36.8555329Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 28s local 2024-12-18T01:10:36.8556231Z Compiling torch_xla/csrc/RegisterXLA.cpp; 28s local 2024-12-18T01:10:36.8557028Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 24s local ... 2024-12-18T01:10:37.2549277Z 2024-12-18T01:10:37.2550166Z  2024-12-18T01:10:37.2550628Z  2024-12-18T01:10:37.2551017Z  2024-12-18T01:10:37.2551392Z  2024-12-18T01:10:37.2551788Z  2024-12-18T01:10:37.2552133Z  2024-12-18T01:10:37.2552483Z  2024-12-18T01:10:37.2552887Z  2024-12-18T01:10:37.2554055Z [20,549 / 20,605] 6 / 17 tests; 44 actions running; last test: ..._client_test 2024-12-18T01:10:37.2555081Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 31s local 2024-12-18T01:10:37.2555816Z Compiling torch_xla/csrc/ops/all_gather.cpp; 29s local 2024-12-18T01:10:37.2556589Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 29s local 2024-12-18T01:10:37.2557484Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 28s local 2024-12-18T01:10:37.2558530Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 28s local 2024-12-18T01:10:37.2559297Z Compiling torch_xla/csrc/RegisterXLA.cpp; 28s local 2024-12-18T01:10:37.2560000Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 24s local 2024-12-18T01:10:37.2560731Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 24s local ... 2024-12-18T01:10:37.8552961Z 2024-12-18T01:10:37.8553799Z  2024-12-18T01:10:37.8554150Z  2024-12-18T01:10:37.8554469Z  2024-12-18T01:10:37.8554757Z  2024-12-18T01:10:37.8555023Z  2024-12-18T01:10:37.8555306Z  2024-12-18T01:10:37.8555596Z  2024-12-18T01:10:37.8555925Z  2024-12-18T01:10:37.8556623Z [20,550 / 20,605] 6 / 17 tests; 43 actions running; last test: ..._client_test 2024-12-18T01:10:37.8557332Z Compiling torch_xla/csrc/ops/all_gather.cpp; 30s local 2024-12-18T01:10:37.8558131Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 30s local 2024-12-18T01:10:37.8559010Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 29s local 2024-12-18T01:10:37.8559748Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 29s local 2024-12-18T01:10:37.8560334Z Compiling torch_xla/csrc/RegisterXLA.cpp; 29s local 2024-12-18T01:10:37.8560920Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 25s local 2024-12-18T01:10:37.8561587Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 25s local 2024-12-18T01:10:37.8562193Z Compiling test/cpp/test_symint.cpp; 24s local ... 2024-12-18T01:10:39.0561368Z 2024-12-18T01:10:39.0562234Z  2024-12-18T01:10:39.0562782Z  2024-12-18T01:10:39.0563157Z  2024-12-18T01:10:39.0563537Z  2024-12-18T01:10:39.0563924Z  2024-12-18T01:10:39.0564307Z  2024-12-18T01:10:39.0564700Z  2024-12-18T01:10:39.0565070Z  2024-12-18T01:10:39.0565992Z [20,550 / 20,605] 6 / 17 tests; 43 actions running; last test: ..._client_test 2024-12-18T01:10:39.0567031Z Compiling torch_xla/csrc/ops/all_gather.cpp; 31s local 2024-12-18T01:10:39.0567815Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 31s local 2024-12-18T01:10:39.0568772Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 30s local 2024-12-18T01:10:39.0569645Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 30s local 2024-12-18T01:10:39.0570446Z Compiling torch_xla/csrc/RegisterXLA.cpp; 30s local 2024-12-18T01:10:39.0571286Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 26s local 2024-12-18T01:10:39.0572437Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 26s local 2024-12-18T01:10:39.0573227Z Compiling test/cpp/test_symint.cpp; 25s local ... 2024-12-18T01:10:39.6564869Z 2024-12-18T01:10:39.6565758Z  2024-12-18T01:10:39.6566210Z  2024-12-18T01:10:39.6566576Z  2024-12-18T01:10:39.6566943Z  2024-12-18T01:10:39.6567610Z  2024-12-18T01:10:39.6567991Z  2024-12-18T01:10:39.6568357Z  2024-12-18T01:10:39.6568714Z  2024-12-18T01:10:39.6569634Z [20,551 / 20,605] 6 / 17 tests; 42 actions running; last test: ..._client_test 2024-12-18T01:10:39.6570586Z Compiling torch_xla/csrc/ops/all_gather.cpp; 31s local 2024-12-18T01:10:39.6571458Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 31s local 2024-12-18T01:10:39.6572389Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 31s local 2024-12-18T01:10:39.6573321Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 30s local 2024-12-18T01:10:39.6574114Z Compiling torch_xla/csrc/RegisterXLA.cpp; 30s local 2024-12-18T01:10:39.6575140Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 27s local 2024-12-18T01:10:39.6575998Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 27s local 2024-12-18T01:10:39.6576955Z Compiling test/cpp/test_symint.cpp; 26s local ... 2024-12-18T01:10:40.0568277Z 2024-12-18T01:10:40.0569111Z  2024-12-18T01:10:40.0569573Z  2024-12-18T01:10:40.0569891Z  2024-12-18T01:10:40.0570185Z  2024-12-18T01:10:40.0570716Z  2024-12-18T01:10:40.0571011Z  2024-12-18T01:10:40.0571297Z  2024-12-18T01:10:40.0571582Z  2024-12-18T01:10:40.0572269Z [20,552 / 20,605] 6 / 17 tests; 41 actions running; last test: ..._client_test 2024-12-18T01:10:40.0573058Z Compiling torch_xla/csrc/ops/all_gather.cpp; 32s local 2024-12-18T01:10:40.0573706Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 31s local 2024-12-18T01:10:40.0574462Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 31s local 2024-12-18T01:10:40.0575203Z Compiling torch_xla/csrc/RegisterXLA.cpp; 31s local 2024-12-18T01:10:40.0576004Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 27s local 2024-12-18T01:10:40.0577009Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 27s local 2024-12-18T01:10:40.0577789Z Compiling test/cpp/test_symint.cpp; 26s local 2024-12-18T01:10:40.0578524Z Compiling torch_xla/csrc/xla_op_builder.cpp; 26s local ... 2024-12-18T01:10:40.2572267Z 2024-12-18T01:10:40.2573112Z  2024-12-18T01:10:40.2573503Z  2024-12-18T01:10:40.2573815Z  2024-12-18T01:10:40.2574172Z  2024-12-18T01:10:40.2574455Z  2024-12-18T01:10:40.2574755Z  2024-12-18T01:10:40.2575073Z  2024-12-18T01:10:40.2575393Z  2024-12-18T01:10:40.2576273Z [20,553 / 20,605] 6 / 17 tests; 40 actions running; last test: ..._client_test 2024-12-18T01:10:40.2577452Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 31s local 2024-12-18T01:10:40.2578331Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 31s local 2024-12-18T01:10:40.2579148Z Compiling torch_xla/csrc/RegisterXLA.cpp; 31s local 2024-12-18T01:10:40.2579965Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 27s local 2024-12-18T01:10:40.2580792Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 27s local 2024-12-18T01:10:40.2581476Z Compiling test/cpp/test_symint.cpp; 26s local 2024-12-18T01:10:40.2582138Z Compiling torch_xla/csrc/xla_op_builder.cpp; 26s local 2024-12-18T01:10:40.2582915Z Compiling torch_xla/csrc/xla_lower_util.cpp; 26s local ... 2024-12-18T01:10:40.6575552Z 2024-12-18T01:10:40.6576364Z  2024-12-18T01:10:40.6576911Z  2024-12-18T01:10:40.6577264Z  2024-12-18T01:10:40.6577604Z  2024-12-18T01:10:40.6577942Z  2024-12-18T01:10:40.6578269Z  2024-12-18T01:10:40.6578588Z  2024-12-18T01:10:40.6579196Z  2024-12-18T01:10:40.6580036Z [20,554 / 20,605] 6 / 17 tests; 39 actions running; last test: ..._client_test 2024-12-18T01:10:40.6581025Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 31s local 2024-12-18T01:10:40.6581723Z Compiling torch_xla/csrc/RegisterXLA.cpp; 31s local 2024-12-18T01:10:40.6582447Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 28s local 2024-12-18T01:10:40.6583383Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 28s local 2024-12-18T01:10:40.6584041Z Compiling test/cpp/test_symint.cpp; 27s local 2024-12-18T01:10:40.6584684Z Compiling torch_xla/csrc/xla_op_builder.cpp; 27s local 2024-12-18T01:10:40.6585358Z Compiling torch_xla/csrc/xla_lower_util.cpp; 27s local 2024-12-18T01:10:40.6586079Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 27s local ... 2024-12-18T01:10:41.0575891Z 2024-12-18T01:10:41.0576840Z  2024-12-18T01:10:41.0577256Z  2024-12-18T01:10:41.0577669Z  2024-12-18T01:10:41.0578026Z  2024-12-18T01:10:41.0578397Z  2024-12-18T01:10:41.0578754Z  2024-12-18T01:10:41.0579421Z  2024-12-18T01:10:41.0579736Z  2024-12-18T01:10:41.0580591Z [20,555 / 20,605] 6 / 17 tests; 38 actions running; last test: ..._client_test 2024-12-18T01:10:41.0581602Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 32s local 2024-12-18T01:10:41.0582413Z Compiling torch_xla/csrc/RegisterXLA.cpp; 32s local 2024-12-18T01:10:41.0583402Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 28s local 2024-12-18T01:10:41.0584312Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 28s local 2024-12-18T01:10:41.0585082Z Compiling test/cpp/test_symint.cpp; 27s local 2024-12-18T01:10:41.0585825Z Compiling torch_xla/csrc/xla_op_builder.cpp; 27s local 2024-12-18T01:10:41.0586597Z Compiling torch_xla/csrc/xla_lower_util.cpp; 27s local 2024-12-18T01:10:41.0587443Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 27s local ... 2024-12-18T01:10:41.4578822Z 2024-12-18T01:10:41.4579628Z  2024-12-18T01:10:41.4580063Z  2024-12-18T01:10:41.4580412Z  2024-12-18T01:10:41.4580758Z  2024-12-18T01:10:41.4581125Z  2024-12-18T01:10:41.4581451Z  2024-12-18T01:10:41.4581744Z  2024-12-18T01:10:41.4582056Z  2024-12-18T01:10:41.4582836Z [20,556 / 20,605] 6 / 17 tests; 37 actions running; last test: ..._client_test 2024-12-18T01:10:41.4583748Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 32s local 2024-12-18T01:10:41.4584470Z Compiling torch_xla/csrc/RegisterXLA.cpp; 32s local 2024-12-18T01:10:41.4585168Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 29s local 2024-12-18T01:10:41.4585944Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 28s local 2024-12-18T01:10:41.4586564Z Compiling test/cpp/test_symint.cpp; 28s local 2024-12-18T01:10:41.4587193Z Compiling torch_xla/csrc/xla_op_builder.cpp; 27s local 2024-12-18T01:10:41.4587877Z Compiling torch_xla/csrc/xla_lower_util.cpp; 27s local 2024-12-18T01:10:41.4588618Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 27s local ... 2024-12-18T01:10:42.6586305Z 2024-12-18T01:10:42.6587320Z  2024-12-18T01:10:42.6587753Z  2024-12-18T01:10:42.6588127Z  2024-12-18T01:10:42.6588493Z  2024-12-18T01:10:42.6588850Z  2024-12-18T01:10:42.6589224Z  2024-12-18T01:10:42.6589596Z  2024-12-18T01:10:42.6589937Z  2024-12-18T01:10:42.6590772Z [20,556 / 20,605] 6 / 17 tests; 37 actions running; last test: ..._client_test 2024-12-18T01:10:42.6591685Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 33s local 2024-12-18T01:10:42.6592430Z Compiling torch_xla/csrc/RegisterXLA.cpp; 33s local 2024-12-18T01:10:42.6593196Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 30s local 2024-12-18T01:10:42.6593982Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 30s local 2024-12-18T01:10:42.6594965Z Compiling test/cpp/test_symint.cpp; 29s local 2024-12-18T01:10:42.6595635Z Compiling torch_xla/csrc/xla_op_builder.cpp; 29s local 2024-12-18T01:10:42.6596345Z Compiling torch_xla/csrc/xla_lower_util.cpp; 29s local 2024-12-18T01:10:42.6597096Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 29s local ... 2024-12-18T01:10:42.8589307Z 2024-12-18T01:10:42.8590122Z  2024-12-18T01:10:42.8590869Z  2024-12-18T01:10:42.8591267Z  2024-12-18T01:10:42.8591626Z  2024-12-18T01:10:42.8592009Z  2024-12-18T01:10:42.8592365Z  2024-12-18T01:10:42.8592770Z  2024-12-18T01:10:42.8593138Z  2024-12-18T01:10:42.8594008Z [20,557 / 20,605] 6 / 17 tests; 36 actions running; last test: ..._client_test 2024-12-18T01:10:42.8595023Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 34s local 2024-12-18T01:10:42.8595855Z Compiling torch_xla/csrc/RegisterXLA.cpp; 34s local 2024-12-18T01:10:42.8596689Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 30s local 2024-12-18T01:10:42.8597769Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 30s local 2024-12-18T01:10:42.8598545Z Compiling test/cpp/test_symint.cpp; 29s local 2024-12-18T01:10:42.8599267Z Compiling torch_xla/csrc/xla_op_builder.cpp; 29s local 2024-12-18T01:10:42.8600035Z Compiling torch_xla/csrc/xla_lower_util.cpp; 29s local 2024-12-18T01:10:42.8601014Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 29s local ... 2024-12-18T01:10:44.0597411Z 2024-12-18T01:10:44.0598433Z  2024-12-18T01:10:44.0599153Z  2024-12-18T01:10:44.0599526Z  2024-12-18T01:10:44.0599902Z  2024-12-18T01:10:44.0600262Z  2024-12-18T01:10:44.0600629Z  2024-12-18T01:10:44.0600984Z  2024-12-18T01:10:44.0601336Z  2024-12-18T01:10:44.0602205Z [20,557 / 20,605] 6 / 17 tests; 36 actions running; last test: ..._client_test 2024-12-18T01:10:44.0603217Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 35s local 2024-12-18T01:10:44.0604082Z Compiling torch_xla/csrc/RegisterXLA.cpp; 35s local 2024-12-18T01:10:44.0604796Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 31s local 2024-12-18T01:10:44.0605465Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 31s local 2024-12-18T01:10:44.0606062Z Compiling test/cpp/test_symint.cpp; 30s local 2024-12-18T01:10:44.0606647Z Compiling torch_xla/csrc/xla_op_builder.cpp; 30s local 2024-12-18T01:10:44.0607253Z Compiling torch_xla/csrc/xla_lower_util.cpp; 30s local 2024-12-18T01:10:44.0607922Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 30s local ... 2024-12-18T01:10:45.2605756Z 2024-12-18T01:10:45.2606740Z  2024-12-18T01:10:45.2607203Z  2024-12-18T01:10:45.2607569Z  2024-12-18T01:10:45.2607940Z  2024-12-18T01:10:45.2608303Z  2024-12-18T01:10:45.2608693Z  2024-12-18T01:10:45.2609076Z  2024-12-18T01:10:45.2609457Z  2024-12-18T01:10:45.2610374Z [20,557 / 20,605] 6 / 17 tests; 36 actions running; last test: ..._client_test 2024-12-18T01:10:45.2611428Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 36s local 2024-12-18T01:10:45.2612278Z Compiling torch_xla/csrc/RegisterXLA.cpp; 36s local 2024-12-18T01:10:45.2613147Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 33s local 2024-12-18T01:10:45.2614018Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 32s local 2024-12-18T01:10:45.2614806Z Compiling test/cpp/test_symint.cpp; 31s local 2024-12-18T01:10:45.2615550Z Compiling torch_xla/csrc/xla_op_builder.cpp; 31s local 2024-12-18T01:10:45.2616342Z Compiling torch_xla/csrc/xla_lower_util.cpp; 31s local 2024-12-18T01:10:46.2613857Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 31s local ... 2024-12-18T01:10:46.2614502Z 2024-12-18T01:10:46.2614930Z  2024-12-18T01:10:46.2615311Z  2024-12-18T01:10:46.2615687Z  2024-12-18T01:10:46.2616065Z  2024-12-18T01:10:46.2616902Z  2024-12-18T01:10:46.2617252Z  2024-12-18T01:10:46.2617611Z  2024-12-18T01:10:46.2617983Z  2024-12-18T01:10:46.2618848Z [20,557 / 20,605] 6 / 17 tests; 36 actions running; last test: ..._client_test 2024-12-18T01:10:46.2619833Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 37s local 2024-12-18T01:10:46.2620592Z Compiling torch_xla/csrc/RegisterXLA.cpp; 37s local 2024-12-18T01:10:46.2621755Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 34s local 2024-12-18T01:10:46.2622600Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 33s local 2024-12-18T01:10:46.2623282Z Compiling test/cpp/test_symint.cpp; 32s local 2024-12-18T01:10:46.2623960Z Compiling torch_xla/csrc/xla_op_builder.cpp; 32s local 2024-12-18T01:10:46.2624736Z Compiling torch_xla/csrc/xla_lower_util.cpp; 32s local 2024-12-18T01:10:46.2625514Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 32s local ... 2024-12-18T01:10:47.2620467Z 2024-12-18T01:10:47.2621368Z  2024-12-18T01:10:47.2621789Z  2024-12-18T01:10:47.2622176Z  2024-12-18T01:10:47.2622563Z  2024-12-18T01:10:47.2623251Z  2024-12-18T01:10:47.2623643Z  2024-12-18T01:10:47.2624027Z  2024-12-18T01:10:47.2624409Z  2024-12-18T01:10:47.2625310Z [20,557 / 20,605] 6 / 17 tests; 36 actions running; last test: ..._client_test 2024-12-18T01:10:47.2626414Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 38s local 2024-12-18T01:10:47.2627422Z Compiling torch_xla/csrc/RegisterXLA.cpp; 38s local 2024-12-18T01:10:47.2628265Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 35s local 2024-12-18T01:10:47.2629108Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 34s local 2024-12-18T01:10:47.2629833Z Compiling test/cpp/test_symint.cpp; 33s local 2024-12-18T01:10:47.2630522Z Compiling torch_xla/csrc/xla_op_builder.cpp; 33s local 2024-12-18T01:10:47.2631202Z Compiling torch_xla/csrc/xla_lower_util.cpp; 33s local 2024-12-18T01:10:47.2631961Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 33s local ... 2024-12-18T01:10:47.8625169Z 2024-12-18T01:10:47.8625958Z  2024-12-18T01:10:47.8626343Z  2024-12-18T01:10:47.8626681Z  2024-12-18T01:10:47.8627010Z  2024-12-18T01:10:47.8627346Z  2024-12-18T01:10:47.8627684Z  2024-12-18T01:10:47.8628014Z  2024-12-18T01:10:47.8628348Z  2024-12-18T01:10:47.8629138Z [20,558 / 20,605] 6 / 17 tests; 35 actions running; last test: ..._client_test 2024-12-18T01:10:47.8630080Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 39s local 2024-12-18T01:10:47.8630854Z Compiling torch_xla/csrc/RegisterXLA.cpp; 39s local 2024-12-18T01:10:47.8631604Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 35s local 2024-12-18T01:10:47.8632359Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 35s local 2024-12-18T01:10:47.8632996Z Compiling test/cpp/test_symint.cpp; 34s local 2024-12-18T01:10:47.8633629Z Compiling torch_xla/csrc/xla_op_builder.cpp; 34s local 2024-12-18T01:10:47.8634330Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 34s local 2024-12-18T01:10:47.8635058Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 33s local ... 2024-12-18T01:10:48.6631918Z 2024-12-18T01:10:48.6632786Z  2024-12-18T01:10:48.6633286Z  2024-12-18T01:10:48.6633739Z  2024-12-18T01:10:48.6634275Z  2024-12-18T01:10:48.6634696Z  2024-12-18T01:10:48.6635062Z  2024-12-18T01:10:48.6635559Z  2024-12-18T01:10:48.6636067Z  2024-12-18T01:10:48.6636956Z [20,560 / 20,605] 6 / 17 tests; 33 actions running; last test: ..._client_test 2024-12-18T01:10:48.6637856Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 39s local 2024-12-18T01:10:48.6638638Z Compiling torch_xla/csrc/RegisterXLA.cpp; 39s local 2024-12-18T01:10:48.6639409Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 36s local 2024-12-18T01:10:48.6640416Z Compiling test/cpp/test_symint.cpp; 35s local 2024-12-18T01:10:48.6641322Z Compiling torch_xla/csrc/xla_op_builder.cpp; 35s local 2024-12-18T01:10:48.6642221Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 35s local 2024-12-18T01:10:48.6643193Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 34s local 2024-12-18T01:10:48.6644424Z Compiling torch_xla/csrc/torch_util.cpp; 33s local ... 2024-12-18T01:10:49.2637007Z 2024-12-18T01:10:49.2637885Z  2024-12-18T01:10:49.2638466Z  2024-12-18T01:10:49.2638856Z  2024-12-18T01:10:49.2639310Z  2024-12-18T01:10:49.2639725Z  2024-12-18T01:10:49.2640128Z  2024-12-18T01:10:49.2640544Z  2024-12-18T01:10:49.2640937Z  2024-12-18T01:10:49.2641843Z [20,561 / 20,605] 6 / 17 tests; 32 actions running; last test: ..._client_test 2024-12-18T01:10:49.2642826Z Compiling torch_xla/csrc/RegisterXLA.cpp; 40s local 2024-12-18T01:10:49.2643652Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 36s local 2024-12-18T01:10:49.2644684Z Compiling test/cpp/test_symint.cpp; 35s local 2024-12-18T01:10:49.2645647Z Compiling torch_xla/csrc/xla_op_builder.cpp; 35s local 2024-12-18T01:10:49.2646469Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 35s local 2024-12-18T01:10:49.2647317Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 35s local 2024-12-18T01:10:49.2648088Z Compiling torch_xla/csrc/torch_util.cpp; 33s local 2024-12-18T01:10:49.2648828Z Compiling torch_xla/csrc/tensor_util.cpp; 33s local ... 2024-12-18T01:10:49.6640420Z 2024-12-18T01:10:49.6641477Z  2024-12-18T01:10:49.6641929Z  2024-12-18T01:10:49.6642223Z  2024-12-18T01:10:49.6642511Z  2024-12-18T01:10:49.6642776Z  2024-12-18T01:10:49.6643053Z  2024-12-18T01:10:49.6643333Z  2024-12-18T01:10:49.6643617Z  2024-12-18T01:10:49.6644520Z [20,562 / 20,605] 6 / 17 tests; 31 actions running; last test: ..._client_test 2024-12-18T01:10:49.6645223Z Compiling torch_xla/csrc/RegisterXLA.cpp; 40s local 2024-12-18T01:10:49.6645794Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 37s local 2024-12-18T01:10:49.6646432Z Compiling test/cpp/test_symint.cpp; 36s local 2024-12-18T01:10:49.6646979Z Compiling torch_xla/csrc/xla_op_builder.cpp; 36s local 2024-12-18T01:10:49.6647562Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 36s local 2024-12-18T01:10:49.6648157Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 35s local 2024-12-18T01:10:49.6648723Z Compiling torch_xla/csrc/torch_util.cpp; 34s local 2024-12-18T01:10:49.6649279Z Compiling torch_xla/csrc/tensor_util.cpp; 33s local ... 2024-12-18T01:10:50.6648486Z 2024-12-18T01:10:50.6649315Z  2024-12-18T01:10:50.6649821Z  2024-12-18T01:10:50.6650209Z  2024-12-18T01:10:50.6650594Z  2024-12-18T01:10:50.6651004Z  2024-12-18T01:10:50.6651400Z  2024-12-18T01:10:50.6651782Z  2024-12-18T01:10:50.6652194Z  2024-12-18T01:10:50.6653095Z [20,562 / 20,605] 6 / 17 tests; 31 actions running; last test: ..._client_test 2024-12-18T01:10:50.6654065Z Compiling torch_xla/csrc/RegisterXLA.cpp; 41s local 2024-12-18T01:10:50.6654864Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local 2024-12-18T01:10:50.6655594Z Compiling test/cpp/test_symint.cpp; 37s local 2024-12-18T01:10:50.6656314Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local 2024-12-18T01:10:50.6657321Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local 2024-12-18T01:10:50.6658130Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 36s local 2024-12-18T01:10:50.6658905Z Compiling torch_xla/csrc/torch_util.cpp; 35s local 2024-12-18T01:10:50.6659653Z Compiling torch_xla/csrc/tensor_util.cpp; 34s local ... 2024-12-18T01:10:51.0651793Z 2024-12-18T01:10:51.0652580Z  2024-12-18T01:10:51.0652984Z  2024-12-18T01:10:51.0653325Z  2024-12-18T01:10:51.0653652Z  2024-12-18T01:10:51.0654225Z  2024-12-18T01:10:51.0654561Z  2024-12-18T01:10:51.0654889Z  2024-12-18T01:10:51.0655209Z  2024-12-18T01:10:51.0656026Z [20,563 / 20,605] 6 / 17 tests; 30 actions running; last test: ..._client_test 2024-12-18T01:10:51.0656987Z Compiling torch_xla/csrc/RegisterXLA.cpp; 42s local 2024-12-18T01:10:51.0657653Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local 2024-12-18T01:10:51.0658418Z Compiling test/cpp/test_symint.cpp; 37s local 2024-12-18T01:10:51.0659038Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local 2024-12-18T01:10:51.0659737Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local 2024-12-18T01:10:51.0660453Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 36s local 2024-12-18T01:10:51.0661124Z Compiling torch_xla/csrc/torch_util.cpp; 35s local 2024-12-18T01:10:51.0661776Z Compiling torch_xla/csrc/tensor_util.cpp; 34s local ... 2024-12-18T01:10:51.4655425Z 2024-12-18T01:10:51.4656119Z  2024-12-18T01:10:51.4656543Z  2024-12-18T01:10:51.4656795Z  2024-12-18T01:10:51.4657023Z  2024-12-18T01:10:51.4657451Z  2024-12-18T01:10:51.4657714Z  2024-12-18T01:10:51.4657949Z  2024-12-18T01:10:51.4658186Z  2024-12-18T01:10:51.4658723Z [20,564 / 20,605] 6 / 17 tests; 29 actions running; last test: ..._client_test 2024-12-18T01:10:51.4659305Z Compiling torch_xla/csrc/RegisterXLA.cpp; 42s local 2024-12-18T01:10:51.4659855Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local 2024-12-18T01:10:51.4660306Z Compiling test/cpp/test_symint.cpp; 38s local 2024-12-18T01:10:51.4660741Z Compiling torch_xla/csrc/xla_op_builder.cpp; 38s local 2024-12-18T01:10:51.4661213Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local 2024-12-18T01:10:51.4661674Z Compiling torch_xla/csrc/torch_util.cpp; 36s local 2024-12-18T01:10:51.4662108Z Compiling torch_xla/csrc/tensor_util.cpp; 35s local 2024-12-18T01:10:51.4662570Z Compiling torch_xla/csrc/tensor_methods.cpp; 34s local ... 2024-12-18T01:10:52.2660921Z 2024-12-18T01:10:52.2661836Z  2024-12-18T01:10:52.2662292Z  2024-12-18T01:10:52.2662642Z  2024-12-18T01:10:52.2662998Z  2024-12-18T01:10:52.2663328Z  2024-12-18T01:10:52.2663674Z  2024-12-18T01:10:52.2664011Z  2024-12-18T01:10:52.2664358Z  2024-12-18T01:10:52.2665137Z [20,565 / 20,605] 6 / 17 tests; 28 actions running; last test: ..._client_test 2024-12-18T01:10:52.2665919Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local 2024-12-18T01:10:52.2666612Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 39s local 2024-12-18T01:10:52.2667263Z Compiling test/cpp/test_symint.cpp; 38s local 2024-12-18T01:10:52.2667904Z Compiling torch_xla/csrc/xla_op_builder.cpp; 38s local 2024-12-18T01:10:52.2668582Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 38s local 2024-12-18T01:10:52.2669244Z Compiling torch_xla/csrc/torch_util.cpp; 36s local 2024-12-18T01:10:52.2669861Z Compiling torch_xla/csrc/tensor_util.cpp; 36s local 2024-12-18T01:10:52.2670544Z Compiling torch_xla/csrc/tensor_methods.cpp; 34s local ... 2024-12-18T01:10:52.6664487Z 2024-12-18T01:10:52.6665297Z  2024-12-18T01:10:52.6665679Z  2024-12-18T01:10:52.6666010Z  2024-12-18T01:10:52.6666342Z  2024-12-18T01:10:52.6666690Z  2024-12-18T01:10:52.6667019Z  2024-12-18T01:10:52.6667337Z  2024-12-18T01:10:52.6667653Z  2024-12-18T01:10:52.6668444Z [20,566 / 20,605] 6 / 17 tests; 27 actions running; last test: ..._client_test 2024-12-18T01:10:52.6669263Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local 2024-12-18T01:10:52.6669897Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local 2024-12-18T01:10:52.6670540Z Compiling test/cpp/test_symint.cpp; 39s local 2024-12-18T01:10:52.6671156Z Compiling torch_xla/csrc/xla_op_builder.cpp; 39s local 2024-12-18T01:10:52.6672063Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local 2024-12-18T01:10:52.6672727Z Compiling torch_xla/csrc/torch_util.cpp; 37s local 2024-12-18T01:10:52.6673331Z Compiling torch_xla/csrc/tensor_util.cpp; 36s local 2024-12-18T01:10:52.6673972Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local ... 2024-12-18T01:10:53.0668005Z 2024-12-18T01:10:53.0669046Z  2024-12-18T01:10:53.0669589Z  2024-12-18T01:10:53.0670057Z  2024-12-18T01:10:53.0670528Z  2024-12-18T01:10:53.0670982Z  2024-12-18T01:10:53.0671472Z  2024-12-18T01:10:53.0671948Z  2024-12-18T01:10:53.0672420Z  2024-12-18T01:10:53.0673444Z [20,567 / 20,605] 6 / 17 tests; 26 actions running; last test: ..._client_test 2024-12-18T01:10:53.0674531Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2024-12-18T01:10:53.0675467Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local 2024-12-18T01:10:53.0676375Z Compiling test/cpp/test_symint.cpp; 39s local 2024-12-18T01:10:53.0677384Z Compiling torch_xla/csrc/xla_op_builder.cpp; 39s local 2024-12-18T01:10:53.0678311Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local 2024-12-18T01:10:53.0679245Z Compiling torch_xla/csrc/tensor_util.cpp; 36s local 2024-12-18T01:10:53.0680075Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local 2024-12-18T01:10:53.0680933Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2024-12-18T01:10:53.4671866Z 2024-12-18T01:10:53.4672648Z  2024-12-18T01:10:53.4673257Z  2024-12-18T01:10:53.4673556Z  2024-12-18T01:10:53.4673844Z  2024-12-18T01:10:53.4674134Z  2024-12-18T01:10:53.4674400Z  2024-12-18T01:10:53.4674771Z  2024-12-18T01:10:53.4675064Z  2024-12-18T01:10:53.4675767Z [20,569 / 20,605] 6 / 17 tests; 24 actions running; last test: ..._client_test 2024-12-18T01:10:53.4676481Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2024-12-18T01:10:53.4677260Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local 2024-12-18T01:10:53.4678006Z Compiling test/cpp/test_symint.cpp; 40s local 2024-12-18T01:10:53.4678661Z Compiling torch_xla/csrc/xla_op_builder.cpp; 40s local 2024-12-18T01:10:53.4679439Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local 2024-12-18T01:10:53.4680206Z Compiling torch_xla/csrc/tensor_util.cpp; 37s local 2024-12-18T01:10:53.4680955Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local 2024-12-18T01:10:53.4681715Z Compiling torch_xla/csrc/tensor.cpp; 35s local ... 2024-12-18T01:10:54.4678916Z 2024-12-18T01:10:54.4679679Z  2024-12-18T01:10:54.4680104Z  2024-12-18T01:10:54.4680443Z  2024-12-18T01:10:54.4680760Z  2024-12-18T01:10:54.4681103Z  2024-12-18T01:10:54.4681432Z  2024-12-18T01:10:54.4681767Z  2024-12-18T01:10:54.4682089Z  2024-12-18T01:10:54.4682875Z [20,569 / 20,605] 6 / 17 tests; 24 actions running; last test: ..._client_test 2024-12-18T01:10:54.4683800Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2024-12-18T01:10:54.4684540Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 41s local 2024-12-18T01:10:54.4685226Z Compiling test/cpp/test_symint.cpp; 41s local 2024-12-18T01:10:54.4694257Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2024-12-18T01:10:54.4695026Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local 2024-12-18T01:10:54.4695801Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local 2024-12-18T01:10:54.4696600Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local 2024-12-18T01:10:54.4697289Z Compiling torch_xla/csrc/tensor.cpp; 36s local ... 2024-12-18T01:10:55.6686646Z 2024-12-18T01:10:55.6687430Z  2024-12-18T01:10:55.6687865Z  2024-12-18T01:10:55.6688226Z  2024-12-18T01:10:55.6688555Z  2024-12-18T01:10:55.6688904Z  2024-12-18T01:10:55.6689495Z  2024-12-18T01:10:55.6689853Z  2024-12-18T01:10:55.6690200Z  2024-12-18T01:10:55.6691019Z [20,569 / 20,605] 6 / 17 tests; 24 actions running; last test: ..._client_test 2024-12-18T01:10:55.6691894Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2024-12-18T01:10:55.6692617Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2024-12-18T01:10:55.6693419Z Compiling test/cpp/test_symint.cpp; 42s local 2024-12-18T01:10:55.6694100Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2024-12-18T01:10:55.6694828Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2024-12-18T01:10:55.6695539Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local 2024-12-18T01:10:55.6696186Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local 2024-12-18T01:10:55.6697015Z Compiling torch_xla/csrc/tensor.cpp; 37s local ... 2024-12-18T01:10:56.0691211Z 2024-12-18T01:10:56.0692028Z  2024-12-18T01:10:56.0692514Z  2024-12-18T01:10:56.0692971Z  2024-12-18T01:10:56.0693412Z  2024-12-18T01:10:56.0693853Z  2024-12-18T01:10:56.0694286Z  2024-12-18T01:10:56.0694911Z  2024-12-18T01:10:56.0695338Z  2024-12-18T01:10:56.0696525Z [20,571 / 20,605] 6 / 17 tests; 22 actions running; last test: ..._client_test 2024-12-18T01:10:56.0697647Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local 2024-12-18T01:10:56.0698584Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2024-12-18T01:10:56.0699598Z Compiling test/cpp/test_symint.cpp; 42s local 2024-12-18T01:10:56.0700438Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2024-12-18T01:10:56.0701395Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2024-12-18T01:10:56.0702323Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local 2024-12-18T01:10:56.0703208Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local 2024-12-18T01:10:56.0704105Z Compiling torch_xla/csrc/tensor.cpp; 37s local ... 2024-12-18T01:10:56.4695621Z 2024-12-18T01:10:56.4696508Z  2024-12-18T01:10:56.4696934Z  2024-12-18T01:10:56.4697330Z  2024-12-18T01:10:56.4697693Z  2024-12-18T01:10:56.4698046Z  2024-12-18T01:10:56.4698421Z  2024-12-18T01:10:56.4698775Z  2024-12-18T01:10:56.4699128Z  2024-12-18T01:10:56.4699954Z [20,573 / 20,605] 6 / 17 tests; 20 actions running; last test: ..._client_test 2024-12-18T01:10:56.4700901Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local 2024-12-18T01:10:56.4701662Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2024-12-18T01:10:56.4702393Z Compiling test/cpp/test_symint.cpp; 43s local 2024-12-18T01:10:56.4703077Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2024-12-18T01:10:56.4703881Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2024-12-18T01:10:56.4704624Z Compiling torch_xla/csrc/tensor_util.cpp; 40s local 2024-12-18T01:10:56.4705351Z Compiling torch_xla/csrc/tensor_methods.cpp; 39s local 2024-12-18T01:10:56.4706069Z Compiling torch_xla/csrc/tensor.cpp; 38s local ... 2024-12-18T01:10:57.4703864Z 2024-12-18T01:10:57.4704647Z  2024-12-18T01:10:57.4705018Z  2024-12-18T01:10:57.4705320Z  2024-12-18T01:10:57.4705620Z  2024-12-18T01:10:57.4705917Z  2024-12-18T01:10:57.4706195Z  2024-12-18T01:10:57.4706515Z  2024-12-18T01:10:57.4706818Z  2024-12-18T01:10:57.4707542Z [20,573 / 20,605] 6 / 17 tests; 20 actions running; last test: ..._client_test 2024-12-18T01:10:57.4708271Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2024-12-18T01:10:57.4708851Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 44s local 2024-12-18T01:10:57.4709421Z Compiling test/cpp/test_symint.cpp; 44s local 2024-12-18T01:10:57.4709968Z Compiling torch_xla/csrc/xla_op_builder.cpp; 44s local 2024-12-18T01:10:57.4710587Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2024-12-18T01:10:57.4711427Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2024-12-18T01:10:57.4712027Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local 2024-12-18T01:10:57.4712652Z Compiling torch_xla/csrc/tensor.cpp; 39s local ... 2024-12-18T01:10:57.6705672Z 2024-12-18T01:10:57.6706465Z  2024-12-18T01:10:57.6706981Z  2024-12-18T01:10:57.6707623Z  2024-12-18T01:10:57.6708019Z  2024-12-18T01:10:57.6708391Z  2024-12-18T01:10:57.6708760Z  2024-12-18T01:10:57.6709125Z  2024-12-18T01:10:57.6709492Z  2024-12-18T01:10:57.6710445Z [20,575 / 20,605] 6 / 17 tests; 19 actions running; last test: ..._client_test 2024-12-18T01:10:57.6711467Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2024-12-18T01:10:57.6712233Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 45s local 2024-12-18T01:10:57.6713091Z Compiling test/cpp/test_symint.cpp; 44s local 2024-12-18T01:10:57.6713830Z Compiling torch_xla/csrc/xla_op_builder.cpp; 44s local 2024-12-18T01:10:57.6714796Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local 2024-12-18T01:10:57.6715418Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2024-12-18T01:10:57.6716157Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local 2024-12-18T01:10:57.6716901Z Compiling torch_xla/csrc/tensor.cpp; 39s local ... 2024-12-18T01:10:58.8713296Z 2024-12-18T01:10:58.8714092Z  2024-12-18T01:10:58.8714541Z  2024-12-18T01:10:58.8714907Z  2024-12-18T01:10:58.8715532Z  2024-12-18T01:10:58.8715962Z  2024-12-18T01:10:58.8716312Z  2024-12-18T01:10:58.8716679Z  2024-12-18T01:10:58.8717040Z  2024-12-18T01:10:58.8717887Z [20,575 / 20,605] 6 / 17 tests; 19 actions running; last test: ..._client_test 2024-12-18T01:10:58.8718821Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2024-12-18T01:10:58.8719611Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2024-12-18T01:10:58.8720382Z Compiling test/cpp/test_symint.cpp; 45s local 2024-12-18T01:10:58.8721103Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local 2024-12-18T01:10:58.8721873Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2024-12-18T01:10:58.8722559Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local 2024-12-18T01:10:58.8723215Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2024-12-18T01:10:58.8723951Z Compiling torch_xla/csrc/tensor.cpp; 40s local ... 2024-12-18T01:10:59.2716173Z 2024-12-18T01:10:59.2716980Z  2024-12-18T01:10:59.2717423Z  2024-12-18T01:10:59.2717784Z  2024-12-18T01:10:59.2718155Z  2024-12-18T01:10:59.2718535Z  2024-12-18T01:10:59.2718904Z  2024-12-18T01:10:59.2719256Z  2024-12-18T01:10:59.2719630Z  2024-12-18T01:10:59.2720533Z [20,576 / 20,605] 6 / 17 tests; 18 actions running; last test: ..._client_test 2024-12-18T01:10:59.2721524Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2024-12-18T01:10:59.2722292Z Compiling test/cpp/test_symint.cpp; 45s local 2024-12-18T01:10:59.2723008Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local 2024-12-18T01:10:59.2723800Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2024-12-18T01:10:59.2724567Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2024-12-18T01:10:59.2725328Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2024-12-18T01:10:59.2726063Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2024-12-18T01:10:59.2726807Z Compiling torch_xla/csrc/ir_dump_util.cpp; 36s local ... 2024-12-18T01:10:59.4718702Z 2024-12-18T01:10:59.4719496Z  2024-12-18T01:10:59.4719939Z  2024-12-18T01:10:59.4720333Z  2024-12-18T01:10:59.4720706Z  2024-12-18T01:10:59.4721066Z  2024-12-18T01:10:59.4721407Z  2024-12-18T01:10:59.4721780Z  2024-12-18T01:10:59.4722431Z  2024-12-18T01:10:59.4723353Z [20,577 / 20,605] 6 / 17 tests; 17 actions running; last test: ..._client_test 2024-12-18T01:10:59.4724344Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2024-12-18T01:10:59.4725077Z Compiling test/cpp/test_symint.cpp; 46s local 2024-12-18T01:10:59.4725810Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2024-12-18T01:10:59.4726813Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2024-12-18T01:10:59.4727544Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local 2024-12-18T01:10:59.4728333Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2024-12-18T01:10:59.4729048Z Compiling torch_xla/csrc/ir_dump_util.cpp; 36s local 2024-12-18T01:10:59.4729778Z Compiling torch_xla/csrc/debug_util.cpp; 35s local ... 2024-12-18T01:11:00.0724733Z 2024-12-18T01:11:00.0725558Z  2024-12-18T01:11:00.0726007Z  2024-12-18T01:11:00.0726363Z  2024-12-18T01:11:00.0726728Z  2024-12-18T01:11:00.0727143Z  2024-12-18T01:11:00.0727516Z  2024-12-18T01:11:00.0727872Z  2024-12-18T01:11:00.0728244Z  2024-12-18T01:11:00.0729377Z [20,578 / 20,605] 6 / 17 tests; 16 actions running; last test: ..._client_test 2024-12-18T01:11:00.0730383Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2024-12-18T01:11:00.0731169Z Compiling test/cpp/test_symint.cpp; 46s local 2024-12-18T01:11:00.0731988Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2024-12-18T01:11:00.0733154Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2024-12-18T01:11:00.0733878Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local 2024-12-18T01:11:00.0734603Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2024-12-18T01:11:00.0735339Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local 2024-12-18T01:11:00.0736155Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 31s local ... 2024-12-18T01:11:00.4728723Z 2024-12-18T01:11:00.4729396Z  2024-12-18T01:11:00.4729706Z  2024-12-18T01:11:00.4729965Z  2024-12-18T01:11:00.4730243Z  2024-12-18T01:11:00.4730494Z  2024-12-18T01:11:00.4730729Z  2024-12-18T01:11:00.4730949Z  2024-12-18T01:11:00.4731181Z  2024-12-18T01:11:00.4731720Z [20,579 / 20,605] 6 / 17 tests; 15 actions running; last test: ..._client_test 2024-12-18T01:11:00.4732276Z Compiling test/cpp/test_symint.cpp; 47s local 2024-12-18T01:11:00.4732736Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2024-12-18T01:11:00.4733199Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2024-12-18T01:11:00.4733647Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2024-12-18T01:11:00.4734096Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2024-12-18T01:11:00.4734525Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local 2024-12-18T01:11:00.4734989Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 32s local 2024-12-18T01:11:00.4735473Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 31s local ... 2024-12-18T01:11:01.4738686Z 2024-12-18T01:11:01.4739341Z  2024-12-18T01:11:01.4739671Z  2024-12-18T01:11:01.4739916Z  2024-12-18T01:11:01.4740158Z  2024-12-18T01:11:01.4740402Z  2024-12-18T01:11:01.4740641Z  2024-12-18T01:11:01.4740880Z  2024-12-18T01:11:01.4741119Z  2024-12-18T01:11:01.4741665Z [20,579 / 20,605] 6 / 17 tests; 15 actions running; last test: ..._client_test 2024-12-18T01:11:01.4742235Z Compiling test/cpp/test_symint.cpp; 48s local 2024-12-18T01:11:01.4742702Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2024-12-18T01:11:01.4743175Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local 2024-12-18T01:11:01.4743629Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2024-12-18T01:11:01.4744059Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2024-12-18T01:11:01.4744688Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local 2024-12-18T01:11:01.4745317Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 33s local 2024-12-18T01:11:01.4745820Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 32s local ... 2024-12-18T01:11:02.6746032Z 2024-12-18T01:11:02.6746848Z  2024-12-18T01:11:02.6747310Z  2024-12-18T01:11:02.6747698Z  2024-12-18T01:11:02.6748056Z  2024-12-18T01:11:02.6748673Z  2024-12-18T01:11:02.6749036Z  2024-12-18T01:11:02.6749411Z  2024-12-18T01:11:02.6749790Z  2024-12-18T01:11:02.6750692Z [20,579 / 20,605] 6 / 17 tests; 15 actions running; last test: ..._client_test 2024-12-18T01:11:02.6751624Z Compiling test/cpp/test_symint.cpp; 49s local 2024-12-18T01:11:02.6752377Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2024-12-18T01:11:02.6753130Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2024-12-18T01:11:02.6753866Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2024-12-18T01:11:02.6754619Z Compiling torch_xla/csrc/tensor.cpp; 44s local 2024-12-18T01:11:02.6755545Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local 2024-12-18T01:11:02.6756356Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 34s local 2024-12-18T01:11:02.6757239Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 33s local ... 2024-12-18T01:11:03.0748918Z 2024-12-18T01:11:03.0749726Z  2024-12-18T01:11:03.0750222Z  2024-12-18T01:11:03.0750608Z  2024-12-18T01:11:03.0751032Z  2024-12-18T01:11:03.0751409Z  2024-12-18T01:11:03.0751999Z  2024-12-18T01:11:03.0752395Z  2024-12-18T01:11:03.0752733Z  2024-12-18T01:11:03.0753651Z [20,580 / 20,605] 6 / 17 tests; 14 actions running; last test: ..._client_test 2024-12-18T01:11:03.0754662Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2024-12-18T01:11:03.0755472Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2024-12-18T01:11:03.0756268Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2024-12-18T01:11:03.0756977Z Compiling torch_xla/csrc/tensor.cpp; 44s local 2024-12-18T01:11:03.0757702Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local 2024-12-18T01:11:03.0758466Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 34s local 2024-12-18T01:11:03.0759250Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 34s local 2024-12-18T01:11:03.0760050Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 32s local ... 2024-12-18T01:11:04.0755105Z 2024-12-18T01:11:04.0755901Z  2024-12-18T01:11:04.0756381Z  2024-12-18T01:11:04.0756780Z  2024-12-18T01:11:04.0757141Z  2024-12-18T01:11:04.0757480Z  2024-12-18T01:11:04.0757828Z  2024-12-18T01:11:04.0758211Z  2024-12-18T01:11:04.0758541Z  2024-12-18T01:11:04.0759410Z [20,582 / 20,605] 6 / 17 tests; 12 actions running; last test: ..._client_test 2024-12-18T01:11:04.0760296Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2024-12-18T01:11:04.0760974Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2024-12-18T01:11:04.0761700Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2024-12-18T01:11:04.0762504Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 35s local 2024-12-18T01:11:04.0763281Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 35s local 2024-12-18T01:11:04.0764112Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 33s local 2024-12-18T01:11:04.0764957Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 32s local 2024-12-18T01:11:04.0765783Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 31s local ... 2024-12-18T01:11:05.0760780Z 2024-12-18T01:11:05.0761551Z  2024-12-18T01:11:05.0761915Z  2024-12-18T01:11:05.0762203Z  2024-12-18T01:11:05.0762505Z  2024-12-18T01:11:05.0762806Z  2024-12-18T01:11:05.0763123Z  2024-12-18T01:11:05.0763425Z  2024-12-18T01:11:05.0763711Z  2024-12-18T01:11:05.0764671Z [20,582 / 20,605] 6 / 17 tests; 12 actions running; last test: ..._client_test 2024-12-18T01:11:05.0765413Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2024-12-18T01:11:05.0766002Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2024-12-18T01:11:05.0766591Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2024-12-18T01:11:05.0767166Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 36s local 2024-12-18T01:11:05.0767934Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 36s local 2024-12-18T01:11:05.0768560Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 34s local 2024-12-18T01:11:05.0769173Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 33s local 2024-12-18T01:11:05.0769806Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 32s local ... 2024-12-18T01:11:06.0770852Z 2024-12-18T01:11:06.0771632Z  2024-12-18T01:11:06.0772030Z  2024-12-18T01:11:06.0772372Z  2024-12-18T01:11:06.0772708Z  2024-12-18T01:11:06.0773054Z  2024-12-18T01:11:06.0773386Z  2024-12-18T01:11:06.0773720Z  2024-12-18T01:11:06.0774047Z  2024-12-18T01:11:06.0775089Z [20,582 / 20,605] 6 / 17 tests; 12 actions running; last test: ..._client_test 2024-12-18T01:11:06.0775898Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2024-12-18T01:11:06.0776670Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2024-12-18T01:11:06.0777336Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2024-12-18T01:11:06.0778125Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 37s local 2024-12-18T01:11:06.0778815Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 37s local 2024-12-18T01:11:06.0779514Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 35s local 2024-12-18T01:11:06.0780227Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 34s local 2024-12-18T01:11:06.0780976Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 33s local ... 2024-12-18T01:11:07.0778843Z 2024-12-18T01:11:07.0779593Z  2024-12-18T01:11:07.0779974Z  2024-12-18T01:11:07.0780310Z  2024-12-18T01:11:07.0780609Z  2024-12-18T01:11:07.0780936Z  2024-12-18T01:11:07.0781248Z  2024-12-18T01:11:07.0781560Z  2024-12-18T01:11:07.0781858Z  2024-12-18T01:11:07.0782616Z [20,582 / 20,605] 6 / 17 tests; 12 actions running; last test: ..._client_test 2024-12-18T01:11:07.0783411Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2024-12-18T01:11:07.0784045Z Compiling torch_xla/csrc/tensor_methods.cpp; 49s local 2024-12-18T01:11:07.0784706Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2024-12-18T01:11:07.0785331Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 38s local 2024-12-18T01:11:07.0785998Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 38s local 2024-12-18T01:11:07.0786671Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 36s local 2024-12-18T01:11:07.0787329Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 35s local 2024-12-18T01:11:07.0788016Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 34s local ... 2024-12-18T01:11:07.8784323Z 2024-12-18T01:11:07.8785174Z  2024-12-18T01:11:07.8785639Z  2024-12-18T01:11:07.8786006Z  2024-12-18T01:11:07.8786405Z  2024-12-18T01:11:07.8786779Z  2024-12-18T01:11:07.8787151Z  2024-12-18T01:11:07.8787514Z  2024-12-18T01:11:07.8787901Z  2024-12-18T01:11:07.8788800Z [20,583 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:07.8789777Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2024-12-18T01:11:07.8790524Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2024-12-18T01:11:07.8791317Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 39s local 2024-12-18T01:11:07.8792089Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 39s local 2024-12-18T01:11:07.8792866Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 37s local 2024-12-18T01:11:07.8793905Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 36s local 2024-12-18T01:11:07.8794725Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 35s local 2024-12-18T01:11:07.8795545Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 34s local ... 2024-12-18T01:11:08.0786380Z 2024-12-18T01:11:08.0787179Z  2024-12-18T01:11:08.0787661Z  2024-12-18T01:11:08.0788027Z  2024-12-18T01:11:08.0788672Z  2024-12-18T01:11:08.0789029Z  2024-12-18T01:11:08.0789403Z  2024-12-18T01:11:08.0789761Z  2024-12-18T01:11:08.0790140Z  2024-12-18T01:11:08.0791011Z [20,584 / 20,605] 6 / 17 tests; 10 actions running; last test: ..._client_test 2024-12-18T01:11:08.0791958Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2024-12-18T01:11:08.0792730Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 39s local 2024-12-18T01:11:08.0793537Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 39s local 2024-12-18T01:11:08.0794363Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 37s local 2024-12-18T01:11:08.0795315Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 36s local 2024-12-18T01:11:08.0796190Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 35s local 2024-12-18T01:11:08.0796970Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 34s local 2024-12-18T01:11:08.0797700Z Compiling test/cpp/test_ir.cpp; 33s local ... 2024-12-18T01:11:09.2795230Z 2024-12-18T01:11:09.2796043Z  2024-12-18T01:11:09.2796510Z  2024-12-18T01:11:09.2796895Z  2024-12-18T01:11:09.2797260Z  2024-12-18T01:11:09.2797874Z  2024-12-18T01:11:09.2798275Z  2024-12-18T01:11:09.2798647Z  2024-12-18T01:11:09.2798988Z  2024-12-18T01:11:09.2799890Z [20,584 / 20,605] 6 / 17 tests; 10 actions running; last test: ..._client_test 2024-12-18T01:11:09.2800809Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T01:11:09.2801566Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 40s local 2024-12-18T01:11:09.2802363Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 40s local 2024-12-18T01:11:09.2803192Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 38s local 2024-12-18T01:11:09.2803984Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 37s local 2024-12-18T01:11:09.2804805Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 36s local 2024-12-18T01:11:09.2805635Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 36s local 2024-12-18T01:11:09.2806370Z Compiling test/cpp/test_ir.cpp; 34s local ... 2024-12-18T01:11:10.0801789Z 2024-12-18T01:11:10.0802591Z  2024-12-18T01:11:10.0803036Z  2024-12-18T01:11:10.0803399Z  2024-12-18T01:11:10.0803763Z  2024-12-18T01:11:10.0804140Z  2024-12-18T01:11:10.0804519Z  2024-12-18T01:11:10.0804893Z  2024-12-18T01:11:10.0805346Z  2024-12-18T01:11:10.0806320Z [20,585 / 20,605] 6 / 17 tests; 9 actions running; last test: ...n_client_test 2024-12-18T01:11:10.0807337Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2024-12-18T01:11:10.0808131Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 41s local 2024-12-18T01:11:10.0808929Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 39s local 2024-12-18T01:11:10.0809770Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 38s local 2024-12-18T01:11:10.0810529Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 37s local 2024-12-18T01:11:10.0811301Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 36s local 2024-12-18T01:11:10.0812017Z Compiling test/cpp/test_ir.cpp; 35s local 2024-12-18T01:11:10.0812709Z Compiling test/cpp/test_replication.cpp; 34s local ... 2024-12-18T01:11:10.6806240Z 2024-12-18T01:11:10.6807009Z  2024-12-18T01:11:10.6807380Z  2024-12-18T01:11:10.6807716Z  2024-12-18T01:11:10.6808065Z  2024-12-18T01:11:10.6808399Z  2024-12-18T01:11:10.6808710Z  2024-12-18T01:11:10.6809032Z  2024-12-18T01:11:10.6809575Z  2024-12-18T01:11:10.6810359Z [20,586 / 20,605] 6 / 17 tests; 8 actions running; last test: ...n_client_test 2024-12-18T01:11:10.6811158Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2024-12-18T01:11:10.6811803Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 42s local 2024-12-18T01:11:10.6812513Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 40s local 2024-12-18T01:11:10.6813346Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 38s local 2024-12-18T01:11:10.6814053Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 37s local 2024-12-18T01:11:10.6814775Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 37s local 2024-12-18T01:11:10.6815444Z Compiling test/cpp/test_ir.cpp; 35s local 2024-12-18T01:11:10.6816065Z Compiling test/cpp/test_replication.cpp; 35s local 2024-12-18T01:11:11.6815866Z 2024-12-18T01:11:11.6816757Z  2024-12-18T01:11:11.6817148Z  2024-12-18T01:11:11.6817477Z  2024-12-18T01:11:11.6817783Z  2024-12-18T01:11:11.6818134Z  2024-12-18T01:11:11.6818444Z  2024-12-18T01:11:11.6818763Z  2024-12-18T01:11:11.6819077Z  2024-12-18T01:11:11.6820014Z [20,587 / 20,605] 6 / 17 tests; 7 actions running; last test: ...n_client_test 2024-12-18T01:11:11.6820806Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2024-12-18T01:11:11.6821438Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 43s local 2024-12-18T01:11:11.6822111Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 41s local 2024-12-18T01:11:11.6822860Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 39s local 2024-12-18T01:11:11.6823497Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 38s local 2024-12-18T01:11:11.6824152Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 38s local 2024-12-18T01:11:11.6824781Z Compiling test/cpp/test_replication.cpp; 36s local 2024-12-18T01:11:12.6821576Z 2024-12-18T01:11:12.6822315Z  2024-12-18T01:11:12.6822686Z  2024-12-18T01:11:12.6823024Z  2024-12-18T01:11:12.6823338Z  2024-12-18T01:11:12.6823623Z  2024-12-18T01:11:12.6823924Z  2024-12-18T01:11:12.6824231Z  2024-12-18T01:11:12.6824975Z [20,587 / 20,605] 6 / 17 tests; 7 actions running; last test: ...n_client_test 2024-12-18T01:11:12.6825719Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2024-12-18T01:11:12.6826334Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 44s local 2024-12-18T01:11:12.6826946Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 42s local 2024-12-18T01:11:12.6827578Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 40s local 2024-12-18T01:11:12.6828196Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 39s local 2024-12-18T01:11:12.6828808Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 39s local 2024-12-18T01:11:12.6829410Z Compiling test/cpp/test_replication.cpp; 37s local 2024-12-18T01:11:13.6827129Z 2024-12-18T01:11:13.6827908Z  2024-12-18T01:11:13.6828384Z  2024-12-18T01:11:13.6828762Z  2024-12-18T01:11:13.6829115Z  2024-12-18T01:11:13.6829495Z  2024-12-18T01:11:13.6829873Z  2024-12-18T01:11:13.6830243Z  2024-12-18T01:11:13.6831151Z [20,587 / 20,605] 6 / 17 tests; 7 actions running; last test: ...n_client_test 2024-12-18T01:11:13.6832089Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2024-12-18T01:11:13.6832880Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 45s local 2024-12-18T01:11:13.6833708Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 43s local 2024-12-18T01:11:13.6834522Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 41s local 2024-12-18T01:11:13.6835296Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 40s local 2024-12-18T01:11:13.6836102Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 40s local 2024-12-18T01:11:13.6836859Z Compiling test/cpp/test_replication.cpp; 38s local 2024-12-18T01:11:14.0829512Z 2024-12-18T01:11:14.0830317Z  2024-12-18T01:11:14.0831046Z  2024-12-18T01:11:14.0831447Z  2024-12-18T01:11:14.0831861Z  2024-12-18T01:11:14.0832216Z  2024-12-18T01:11:14.0832600Z  2024-12-18T01:11:14.0832957Z  2024-12-18T01:11:14.0833818Z [20,589 / 20,605] 6 / 17 tests; 5 actions running; last test: ...n_client_test 2024-12-18T01:11:14.0834769Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2024-12-18T01:11:14.0835744Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 45s local 2024-12-18T01:11:14.0836556Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 43s local 2024-12-18T01:11:14.0837381Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 42s local 2024-12-18T01:11:14.0838174Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 40s local 2024-12-18T01:11:15.2839023Z 2024-12-18T01:11:15.2839802Z  2024-12-18T01:11:15.2840271Z  2024-12-18T01:11:15.2840660Z  2024-12-18T01:11:15.2841056Z  2024-12-18T01:11:15.2841444Z  2024-12-18T01:11:15.2842410Z [20,589 / 20,605] 6 / 17 tests; 5 actions running; last test: ...n_client_test 2024-12-18T01:11:15.2843607Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2024-12-18T01:11:15.2844616Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 46s local 2024-12-18T01:11:15.2845397Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 44s local 2024-12-18T01:11:15.2846233Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 43s local 2024-12-18T01:11:15.2847052Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 42s local 2024-12-18T01:11:16.4848020Z 2024-12-18T01:11:16.4848818Z  2024-12-18T01:11:16.4849281Z  2024-12-18T01:11:16.4849669Z  2024-12-18T01:11:16.4850074Z  2024-12-18T01:11:16.4850455Z  2024-12-18T01:11:16.4851377Z [20,589 / 20,605] 6 / 17 tests; 5 actions running; last test: ...n_client_test 2024-12-18T01:11:16.4852406Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2024-12-18T01:11:16.4853220Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 48s local 2024-12-18T01:11:16.4854095Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 45s local 2024-12-18T01:11:16.4854941Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 44s local 2024-12-18T01:11:16.4855802Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 43s local 2024-12-18T01:11:17.2852317Z 2024-12-18T01:11:17.2853096Z  2024-12-18T01:11:17.2853579Z  2024-12-18T01:11:17.2853961Z  2024-12-18T01:11:17.2854351Z  2024-12-18T01:11:17.2854856Z  2024-12-18T01:11:17.2855787Z [20,591 / 20,605] 6 / 17 tests; 3 actions running; last test: ...n_client_test 2024-12-18T01:11:17.2856850Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2024-12-18T01:11:17.2857664Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 48s local 2024-12-18T01:11:17.2858506Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 46s local 2024-12-18T01:11:18.2859831Z 2024-12-18T01:11:18.2860670Z  2024-12-18T01:11:18.2861139Z  2024-12-18T01:11:18.2861532Z  2024-12-18T01:11:18.2862479Z [20,591 / 20,605] 6 / 17 tests; 3 actions running; last test: ...n_client_test 2024-12-18T01:11:18.2863438Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2024-12-18T01:11:18.2864188Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 49s local 2024-12-18T01:11:18.2865027Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 47s local 2024-12-18T01:11:19.4864903Z 2024-12-18T01:11:19.4865658Z  2024-12-18T01:11:19.4866144Z  2024-12-18T01:11:19.4866553Z  2024-12-18T01:11:19.4867469Z [20,591 / 20,605] 6 / 17 tests; 3 actions running; last test: ...n_client_test 2024-12-18T01:11:19.4868470Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2024-12-18T01:11:19.4869301Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 51s local 2024-12-18T01:11:19.4870147Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 48s local 2024-12-18T01:11:20.4869667Z 2024-12-18T01:11:20.4870428Z  2024-12-18T01:11:20.4870811Z  2024-12-18T01:11:20.4871154Z  2024-12-18T01:11:20.4871911Z [20,591 / 20,605] 6 / 17 tests; 3 actions running; last test: ...n_client_test 2024-12-18T01:11:20.4872720Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2024-12-18T01:11:20.4873672Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 52s local 2024-12-18T01:11:20.4874359Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 49s local 2024-12-18T01:11:21.0876094Z 2024-12-18T01:11:21.0876893Z  2024-12-18T01:11:21.0877217Z  2024-12-18T01:11:21.0877484Z  2024-12-18T01:11:21.0878033Z [20,592 / 20,605] 6 / 17 tests; 2 actions running; last test: ...n_client_test 2024-12-18T01:11:21.0878587Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2024-12-18T01:11:21.0879056Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 50s local 2024-12-18T01:11:21.6884769Z 2024-12-18T01:11:21.6885405Z  2024-12-18T01:11:21.6885691Z  2024-12-18T01:11:21.6886412Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:21.6886988Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2024-12-18T01:11:22.6891985Z 2024-12-18T01:11:22.6892599Z  2024-12-18T01:11:22.6893217Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:22.6893968Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2024-12-18T01:11:23.6898965Z 2024-12-18T01:11:23.6899603Z  2024-12-18T01:11:23.6900214Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:23.6900794Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2024-12-18T01:11:24.8904597Z 2024-12-18T01:11:24.8905262Z  2024-12-18T01:11:24.8905911Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:26.0912795Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2024-12-18T01:11:26.0913124Z 2024-12-18T01:11:26.0913445Z  2024-12-18T01:11:26.0913984Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:26.0914550Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2024-12-18T01:11:27.0918870Z 2024-12-18T01:11:27.0919641Z  2024-12-18T01:11:27.0920288Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:27.0920875Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2024-12-18T01:11:28.2926396Z 2024-12-18T01:11:28.2927043Z  2024-12-18T01:11:28.2927664Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:28.2928268Z Compiling torch_xla/csrc/tensor_util.cpp; 72s local 2024-12-18T01:11:29.2935022Z 2024-12-18T01:11:29.2935647Z  2024-12-18T01:11:29.2936284Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:29.2936959Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2024-12-18T01:11:30.2940128Z 2024-12-18T01:11:30.2940796Z  2024-12-18T01:11:30.2941416Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:30.2941997Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2024-12-18T01:11:31.4945113Z 2024-12-18T01:11:31.4945742Z  2024-12-18T01:11:31.4946354Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:31.4946935Z Compiling torch_xla/csrc/tensor_util.cpp; 75s local 2024-12-18T01:11:32.6951189Z 2024-12-18T01:11:32.6951940Z  2024-12-18T01:11:32.6952559Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:32.6953139Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T01:11:33.0955221Z 2024-12-18T01:11:33.0955855Z  2024-12-18T01:11:33.0956457Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:33.0957197Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2024-12-18T01:11:34.0962053Z 2024-12-18T01:11:34.0962824Z  2024-12-18T01:11:34.0963429Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:34.0964004Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2024-12-18T01:11:35.0968398Z 2024-12-18T01:11:35.0969024Z  2024-12-18T01:11:35.0969631Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:35.0970241Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2024-12-18T01:11:36.2977791Z 2024-12-18T01:11:36.2978640Z  2024-12-18T01:11:36.2979335Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:36.2979911Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2024-12-18T01:11:37.4982588Z 2024-12-18T01:11:37.4983230Z  2024-12-18T01:11:37.4984001Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:37.4984588Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2024-12-18T01:11:38.4987142Z 2024-12-18T01:11:38.4987779Z  2024-12-18T01:11:38.4988370Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:38.4988949Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2024-12-18T01:11:39.6995930Z 2024-12-18T01:11:39.6996580Z  2024-12-18T01:11:39.6997243Z [20,593 / 20,605] 6 / 17 tests; 1 action; last test: ...mputation_client_test 2024-12-18T01:11:39.6997818Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2024-12-18T01:11:40.3000592Z 2024-12-18T01:11:40.3001225Z  2024-12-18T01:11:40.3001829Z [20,594 / 20,605] 6 / 17 tests; checking cached actions; last test: ...nt_test 2024-12-18T01:11:40.7003191Z 2024-12-18T01:11:40.7004000Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:40.7004577Z Linking test/cpp/test_aten_xla_tensor_4; 0s local 2024-12-18T01:11:40.7005005Z Linking test/cpp/test_aten_xla_tensor_5; 0s local 2024-12-18T01:11:40.7005389Z Linking test/cpp/test_lazy; 0s local 2024-12-18T01:11:40.7005723Z Linking test/cpp/test_ir; 0s local 2024-12-18T01:11:40.7006099Z Linking test/cpp/test_aten_xla_tensor_3; 0s local 2024-12-18T01:11:40.7006518Z Linking test/cpp/test_aten_xla_tensor_6; 0s local 2024-12-18T01:11:40.7006910Z Linking test/cpp/test_tensor; 0s local 2024-12-18T01:11:40.7007291Z Linking test/cpp/test_xla_sharding; 0s local ... 2024-12-18T01:11:41.7010819Z 2024-12-18T01:11:41.7011244Z  2024-12-18T01:11:41.7011527Z  2024-12-18T01:11:41.7011772Z  2024-12-18T01:11:41.7011996Z  2024-12-18T01:11:41.7012251Z  2024-12-18T01:11:41.7012485Z  2024-12-18T01:11:41.7012722Z  2024-12-18T01:11:41.7012954Z  2024-12-18T01:11:41.7013469Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:41.7014023Z Linking test/cpp/test_aten_xla_tensor_4; 1s local 2024-12-18T01:11:41.7014455Z Linking test/cpp/test_aten_xla_tensor_5; 1s local 2024-12-18T01:11:41.7014843Z Linking test/cpp/test_lazy; 1s local 2024-12-18T01:11:41.7015197Z Linking test/cpp/test_ir; 1s local 2024-12-18T01:11:41.7015698Z Linking test/cpp/test_aten_xla_tensor_3; 1s local 2024-12-18T01:11:41.7016125Z Linking test/cpp/test_aten_xla_tensor_6; 1s local 2024-12-18T01:11:41.7016627Z Linking test/cpp/test_tensor; 1s local 2024-12-18T01:11:41.7017022Z Linking test/cpp/test_xla_sharding; 1s local ... 2024-12-18T01:11:42.7019938Z 2024-12-18T01:11:42.7020596Z  2024-12-18T01:11:42.7020921Z  2024-12-18T01:11:42.7021421Z  2024-12-18T01:11:42.7021686Z  2024-12-18T01:11:42.7021928Z  2024-12-18T01:11:42.7022155Z  2024-12-18T01:11:42.7022405Z  2024-12-18T01:11:42.7022643Z  2024-12-18T01:11:42.7023184Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:42.7023745Z Linking test/cpp/test_aten_xla_tensor_4; 2s local 2024-12-18T01:11:42.7024164Z Linking test/cpp/test_aten_xla_tensor_5; 2s local 2024-12-18T01:11:42.7024561Z Linking test/cpp/test_lazy; 2s local 2024-12-18T01:11:42.7024921Z Linking test/cpp/test_ir; 2s local 2024-12-18T01:11:42.7025303Z Linking test/cpp/test_aten_xla_tensor_3; 2s local 2024-12-18T01:11:42.7025815Z Linking test/cpp/test_aten_xla_tensor_6; 2s local 2024-12-18T01:11:42.7026192Z Linking test/cpp/test_tensor; 2s local 2024-12-18T01:11:42.7026581Z Linking test/cpp/test_xla_sharding; 2s local ... 2024-12-18T01:11:43.9026144Z 2024-12-18T01:11:43.9026861Z  2024-12-18T01:11:43.9027177Z  2024-12-18T01:11:43.9027429Z  2024-12-18T01:11:43.9027676Z  2024-12-18T01:11:43.9028096Z  2024-12-18T01:11:43.9028329Z  2024-12-18T01:11:43.9028565Z  2024-12-18T01:11:43.9028802Z  2024-12-18T01:11:43.9029338Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:43.9029900Z Linking test/cpp/test_aten_xla_tensor_4; 3s local 2024-12-18T01:11:43.9030318Z Linking test/cpp/test_aten_xla_tensor_5; 3s local 2024-12-18T01:11:43.9030715Z Linking test/cpp/test_lazy; 3s local 2024-12-18T01:11:43.9031061Z Linking test/cpp/test_ir; 3s local 2024-12-18T01:11:43.9031442Z Linking test/cpp/test_aten_xla_tensor_3; 3s local 2024-12-18T01:11:43.9031857Z Linking test/cpp/test_aten_xla_tensor_6; 3s local 2024-12-18T01:11:43.9032246Z Linking test/cpp/test_tensor; 3s local 2024-12-18T01:11:43.9032616Z Linking test/cpp/test_xla_sharding; 3s local ... 2024-12-18T01:11:45.1035713Z 2024-12-18T01:11:45.1036463Z  2024-12-18T01:11:45.1036798Z  2024-12-18T01:11:45.1037083Z  2024-12-18T01:11:45.1037369Z  2024-12-18T01:11:45.1037630Z  2024-12-18T01:11:45.1037874Z  2024-12-18T01:11:45.1038131Z  2024-12-18T01:11:45.1038377Z  2024-12-18T01:11:45.1038918Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:45.1039484Z Linking test/cpp/test_aten_xla_tensor_4; 4s local 2024-12-18T01:11:45.1039910Z Linking test/cpp/test_aten_xla_tensor_5; 4s local 2024-12-18T01:11:45.1040297Z Linking test/cpp/test_lazy; 4s local 2024-12-18T01:11:45.1040656Z Linking test/cpp/test_ir; 4s local 2024-12-18T01:11:45.1041031Z Linking test/cpp/test_aten_xla_tensor_3; 4s local 2024-12-18T01:11:45.1041451Z Linking test/cpp/test_aten_xla_tensor_6; 4s local 2024-12-18T01:11:45.1041827Z Linking test/cpp/test_tensor; 4s local 2024-12-18T01:11:45.1042218Z Linking test/cpp/test_xla_sharding; 4s local ... 2024-12-18T01:11:46.1043183Z 2024-12-18T01:11:46.1043938Z  2024-12-18T01:11:46.1044649Z  2024-12-18T01:11:46.1044888Z  2024-12-18T01:11:46.1045132Z  2024-12-18T01:11:46.1045373Z  2024-12-18T01:11:46.1045608Z  2024-12-18T01:11:46.1045841Z  2024-12-18T01:11:46.1046063Z  2024-12-18T01:11:46.1046602Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:46.1047158Z Linking test/cpp/test_aten_xla_tensor_4; 5s local 2024-12-18T01:11:46.1047809Z Linking test/cpp/test_aten_xla_tensor_5; 5s local 2024-12-18T01:11:46.1048203Z Linking test/cpp/test_lazy; 5s local 2024-12-18T01:11:46.1048541Z Linking test/cpp/test_ir; 5s local 2024-12-18T01:11:46.1048916Z Linking test/cpp/test_aten_xla_tensor_3; 5s local 2024-12-18T01:11:46.1049336Z Linking test/cpp/test_aten_xla_tensor_6; 5s local 2024-12-18T01:11:46.1049792Z Linking test/cpp/test_tensor; 5s local 2024-12-18T01:11:46.1050176Z Linking test/cpp/test_xla_sharding; 5s local ... 2024-12-18T01:11:47.1052759Z 2024-12-18T01:11:47.1053430Z  2024-12-18T01:11:47.1053762Z  2024-12-18T01:11:47.1054027Z  2024-12-18T01:11:47.1054279Z  2024-12-18T01:11:47.1054523Z  2024-12-18T01:11:47.1054771Z  2024-12-18T01:11:47.1055017Z  2024-12-18T01:11:47.1055267Z  2024-12-18T01:11:47.1055821Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:47.1056376Z Linking test/cpp/test_aten_xla_tensor_4; 6s local 2024-12-18T01:11:47.1057150Z Linking test/cpp/test_aten_xla_tensor_5; 6s local 2024-12-18T01:11:47.1057548Z Linking test/cpp/test_lazy; 6s local 2024-12-18T01:11:47.1057916Z Linking test/cpp/test_ir; 6s local 2024-12-18T01:11:47.1058294Z Linking test/cpp/test_aten_xla_tensor_3; 6s local 2024-12-18T01:11:47.1058715Z Linking test/cpp/test_aten_xla_tensor_6; 6s local 2024-12-18T01:11:47.1059110Z Linking test/cpp/test_tensor; 6s local 2024-12-18T01:11:47.1059575Z Linking test/cpp/test_xla_sharding; 6s local ... 2024-12-18T01:11:48.1057992Z 2024-12-18T01:11:48.1058764Z  2024-12-18T01:11:48.1059063Z  2024-12-18T01:11:48.1059312Z  2024-12-18T01:11:48.1059537Z  2024-12-18T01:11:48.1059781Z  2024-12-18T01:11:48.1060018Z  2024-12-18T01:11:48.1060255Z  2024-12-18T01:11:48.1060480Z  2024-12-18T01:11:48.1061019Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:48.1061625Z Linking test/cpp/test_aten_xla_tensor_4; 7s local 2024-12-18T01:11:48.1062063Z Linking test/cpp/test_aten_xla_tensor_5; 7s local 2024-12-18T01:11:48.1062453Z Linking test/cpp/test_lazy; 7s local 2024-12-18T01:11:48.1062810Z Linking test/cpp/test_ir; 7s local 2024-12-18T01:11:48.1063191Z Linking test/cpp/test_aten_xla_tensor_3; 7s local 2024-12-18T01:11:48.1063611Z Linking test/cpp/test_aten_xla_tensor_6; 7s local 2024-12-18T01:11:48.1064016Z Linking test/cpp/test_tensor; 7s local 2024-12-18T01:11:48.1064409Z Linking test/cpp/test_xla_sharding; 7s local ... 2024-12-18T01:11:49.3064654Z 2024-12-18T01:11:49.3065402Z  2024-12-18T01:11:49.3065718Z  2024-12-18T01:11:49.3065961Z  2024-12-18T01:11:49.3066197Z  2024-12-18T01:11:49.3066436Z  2024-12-18T01:11:49.3066657Z  2024-12-18T01:11:49.3066891Z  2024-12-18T01:11:49.3067147Z  2024-12-18T01:11:49.3067699Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:49.3068261Z Linking test/cpp/test_aten_xla_tensor_4; 8s local 2024-12-18T01:11:49.3068674Z Linking test/cpp/test_aten_xla_tensor_5; 8s local 2024-12-18T01:11:49.3069066Z Linking test/cpp/test_lazy; 8s local 2024-12-18T01:11:49.3069424Z Linking test/cpp/test_ir; 8s local 2024-12-18T01:11:49.3069798Z Linking test/cpp/test_aten_xla_tensor_3; 8s local 2024-12-18T01:11:49.3070216Z Linking test/cpp/test_aten_xla_tensor_6; 8s local 2024-12-18T01:11:49.3070589Z Linking test/cpp/test_tensor; 8s local 2024-12-18T01:11:49.3070974Z Linking test/cpp/test_xla_sharding; 8s local ... 2024-12-18T01:11:50.3070650Z 2024-12-18T01:11:50.3071299Z  2024-12-18T01:11:50.3071632Z  2024-12-18T01:11:50.3071886Z  2024-12-18T01:11:50.3072136Z  2024-12-18T01:11:50.3072385Z  2024-12-18T01:11:50.3072826Z  2024-12-18T01:11:50.3073065Z  2024-12-18T01:11:50.3073301Z  2024-12-18T01:11:50.3073874Z [20,594 / 20,605] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:50.3074440Z Linking test/cpp/test_aten_xla_tensor_4; 9s local 2024-12-18T01:11:50.3074854Z Linking test/cpp/test_aten_xla_tensor_5; 9s local 2024-12-18T01:11:50.3075322Z Linking test/cpp/test_lazy; 9s local 2024-12-18T01:11:50.3075675Z Linking test/cpp/test_ir; 9s local 2024-12-18T01:11:50.3076062Z Linking test/cpp/test_aten_xla_tensor_3; 9s local 2024-12-18T01:11:50.3076484Z Linking test/cpp/test_aten_xla_tensor_6; 9s local 2024-12-18T01:11:50.3076859Z Linking test/cpp/test_tensor; 9s local 2024-12-18T01:11:50.3077244Z Linking test/cpp/test_xla_sharding; 9s local ... 2024-12-18T01:11:50.6593128Z 2024-12-18T01:11:50.6593723Z  2024-12-18T01:11:50.6594016Z  2024-12-18T01:11:50.6594247Z  2024-12-18T01:11:50.6594502Z  2024-12-18T01:11:50.6594737Z  2024-12-18T01:11:50.6594968Z  2024-12-18T01:11:50.6595189Z  2024-12-18T01:11:50.6596954Z  2024-12-18T01:11:50.6597542Z [20,596 / 20,606] 6 / 17 tests; 10 actions, 9 running; last test: ...ient_test 2024-12-18T01:11:50.6598097Z Linking test/cpp/test_aten_xla_tensor_5; 10s local 2024-12-18T01:11:50.6598492Z Linking test/cpp/test_lazy; 10s local 2024-12-18T01:11:50.6598876Z Linking test/cpp/test_aten_xla_tensor_3; 10s local 2024-12-18T01:11:50.6599623Z Linking test/cpp/test_aten_xla_tensor_6; 10s local 2024-12-18T01:11:50.6600024Z Linking test/cpp/test_tensor; 10s local 2024-12-18T01:11:50.6600401Z Linking test/cpp/test_xla_sharding; 10s local 2024-12-18T01:11:50.6600795Z Linking test/cpp/test_replication; 10s local 2024-12-18T01:11:50.6601216Z Linking test/cpp/test_aten_xla_tensor_1; 10s local ... 2024-12-18T01:11:50.9075671Z 2024-12-18T01:11:50.9076753Z  2024-12-18T01:11:50.9077381Z  2024-12-18T01:11:50.9077914Z  2024-12-18T01:11:50.9078436Z  2024-12-18T01:11:50.9078949Z  2024-12-18T01:11:50.9079452Z  2024-12-18T01:11:50.9079959Z  2024-12-18T01:11:50.9091488Z  2024-12-18T01:11:50.9092746Z [20,600 / 20,611] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:50.9094030Z Linking test/cpp/test_aten_xla_tensor_3; 10s local 2024-12-18T01:11:50.9095002Z Linking test/cpp/test_aten_xla_tensor_6; 10s local 2024-12-18T01:11:50.9095945Z Linking test/cpp/test_replication; 10s local 2024-12-18T01:11:50.9097016Z Linking test/cpp/test_aten_xla_tensor_1; 10s local 2024-12-18T01:11:50.9097960Z Linking test/cpp/test_aten_xla_tensor_2; 10s local 2024-12-18T01:11:50.9098840Z Testing //test/cpp:test_ir; 0s local 2024-12-18T01:11:50.9099688Z Testing //test/cpp:test_aten_xla_tensor_4; 0s local 2024-12-18T01:11:50.9100614Z Testing //test/cpp:test_tensor; 0s local ... 2024-12-18T01:11:51.1079543Z 2024-12-18T01:11:51.1080559Z  2024-12-18T01:11:51.1081167Z  2024-12-18T01:11:51.1081699Z  2024-12-18T01:11:51.1082234Z  2024-12-18T01:11:51.1082738Z  2024-12-18T01:11:51.1083254Z  2024-12-18T01:11:51.1083763Z  2024-12-18T01:11:51.1084269Z  2024-12-18T01:11:51.1085447Z [20,605 / 20,615] 6 / 17 tests; 10 actions running; last test: ..._client_test 2024-12-18T01:11:51.1086663Z Testing //test/cpp:test_ir; 0s local 2024-12-18T01:11:51.1087547Z Testing //test/cpp:test_aten_xla_tensor_4; 0s local 2024-12-18T01:11:51.1088449Z Testing //test/cpp:test_tensor; 0s local 2024-12-18T01:11:51.1089253Z Testing //test/cpp:test_lazy; 0s local 2024-12-18T01:11:51.1090109Z Testing //test/cpp:test_aten_xla_tensor_5; 0s local 2024-12-18T01:11:51.1091043Z Testing //test/cpp:test_xla_sharding; 0s local 2024-12-18T01:11:51.1091969Z Testing //test/cpp:test_aten_xla_tensor_6; 0s local 2024-12-18T01:11:51.1093229Z Testing //test/cpp:test_aten_xla_tensor_3; 0s local ... 2024-12-18T01:11:51.5083646Z 2024-12-18T01:11:51.5084579Z  2024-12-18T01:11:51.5085070Z  2024-12-18T01:11:51.5085507Z  2024-12-18T01:11:51.5085918Z  2024-12-18T01:11:51.5086348Z  2024-12-18T01:11:51.5086796Z  2024-12-18T01:11:51.5087205Z  2024-12-18T01:11:51.5087611Z  2024-12-18T01:11:51.5088867Z [20,605 / 20,616] 6 / 17 tests; 11 actions running; last test: ..._client_test 2024-12-18T01:11:51.5089881Z Testing //test/cpp:test_ir; 0s local 2024-12-18T01:11:51.5090614Z Testing //test/cpp:test_aten_xla_tensor_4; 0s local 2024-12-18T01:11:51.5091367Z Testing //test/cpp:test_tensor; 0s local 2024-12-18T01:11:51.5092044Z Testing //test/cpp:test_lazy; 0s local 2024-12-18T01:11:51.5092757Z Testing //test/cpp:test_aten_xla_tensor_5; 0s local 2024-12-18T01:11:51.5093533Z Testing //test/cpp:test_xla_sharding; 0s local 2024-12-18T01:11:51.5094314Z Testing //test/cpp:test_aten_xla_tensor_6; 0s local 2024-12-18T01:11:51.5095245Z Testing //test/cpp:test_aten_xla_tensor_3; 0s local ... 2024-12-18T01:11:51.8346473Z 2024-12-18T01:11:51.8347326Z  2024-12-18T01:11:51.8347816Z  2024-12-18T01:11:51.8348226Z  2024-12-18T01:11:51.8348635Z  2024-12-18T01:11:51.8349063Z  2024-12-18T01:11:51.8349466Z  2024-12-18T01:11:51.8349888Z  2024-12-18T01:11:51.8350291Z  2024-12-18T01:11:51.8351428Z [20,607 / 20,616] 9 / 17 tests; 9 actions running; last test: ..._xla_sharding 2024-12-18T01:11:51.8352439Z Testing //test/cpp:test_aten_xla_tensor_4; 1s local 2024-12-18T01:11:51.8353157Z Testing //test/cpp:test_tensor; 1s local 2024-12-18T01:11:51.8353869Z Testing //test/cpp:test_aten_xla_tensor_5; 1s local 2024-12-18T01:11:51.8354609Z Testing //test/cpp:test_xla_sharding; 1s local 2024-12-18T01:11:51.8355356Z Testing //test/cpp:test_aten_xla_tensor_6; 0s local 2024-12-18T01:11:51.8356119Z Testing //test/cpp:test_aten_xla_tensor_3; 0s local 2024-12-18T01:11:51.8356858Z Testing //test/cpp:test_replication; 0s local 2024-12-18T01:11:51.8357616Z Testing //test/cpp:test_aten_xla_tensor_1; 0s local ... 2024-12-18T01:11:52.1154439Z 2024-12-18T01:11:52.1155544Z  2024-12-18T01:11:52.1156174Z  2024-12-18T01:11:52.1156709Z  2024-12-18T01:11:52.1157255Z  2024-12-18T01:11:52.1157785Z  2024-12-18T01:11:52.1158297Z  2024-12-18T01:11:52.1158824Z  2024-12-18T01:11:52.1159370Z  2024-12-18T01:11:52.1160836Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:52.1162346Z Testing //test/cpp:test_aten_xla_tensor_4; 1s local 2024-12-18T01:11:52.1163400Z Testing //test/cpp:test_tensor; 1s local 2024-12-18T01:11:52.1164438Z Testing //test/cpp:test_aten_xla_tensor_5; 1s local 2024-12-18T01:11:52.1165555Z Testing //test/cpp:test_aten_xla_tensor_6; 1s local 2024-12-18T01:11:52.1166765Z Testing //test/cpp:test_aten_xla_tensor_3; 1s local 2024-12-18T01:11:52.1167744Z Testing //test/cpp:test_aten_xla_tensor_1; 1s local 2024-12-18T01:11:52.1168721Z Testing //test/cpp:test_aten_xla_tensor_2; 0s local 2024-12-18T01:11:53.1161080Z 2024-12-18T01:11:53.1162015Z  2024-12-18T01:11:53.1162523Z  2024-12-18T01:11:53.1162998Z  2024-12-18T01:11:53.1163413Z  2024-12-18T01:11:53.1163856Z  2024-12-18T01:11:53.1164278Z  2024-12-18T01:11:53.1164685Z  2024-12-18T01:11:53.1165687Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:53.1166764Z Testing //test/cpp:test_aten_xla_tensor_4; 2s local 2024-12-18T01:11:53.1167522Z Testing //test/cpp:test_tensor; 2s local 2024-12-18T01:11:53.1168256Z Testing //test/cpp:test_aten_xla_tensor_5; 2s local 2024-12-18T01:11:53.1169077Z Testing //test/cpp:test_aten_xla_tensor_6; 2s local 2024-12-18T01:11:53.1170130Z Testing //test/cpp:test_aten_xla_tensor_3; 2s local 2024-12-18T01:11:53.1170914Z Testing //test/cpp:test_aten_xla_tensor_1; 2s local 2024-12-18T01:11:53.1171703Z Testing //test/cpp:test_aten_xla_tensor_2; 1s local 2024-12-18T01:11:54.3166310Z 2024-12-18T01:11:54.3167090Z  2024-12-18T01:11:54.3167563Z  2024-12-18T01:11:54.3168237Z  2024-12-18T01:11:54.3168608Z  2024-12-18T01:11:54.3168993Z  2024-12-18T01:11:54.3169376Z  2024-12-18T01:11:54.3169754Z  2024-12-18T01:11:54.3170637Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:54.3171609Z Testing //test/cpp:test_aten_xla_tensor_4; 3s local 2024-12-18T01:11:54.3172280Z Testing //test/cpp:test_tensor; 3s local 2024-12-18T01:11:54.3172947Z Testing //test/cpp:test_aten_xla_tensor_5; 3s local 2024-12-18T01:11:54.3173657Z Testing //test/cpp:test_aten_xla_tensor_6; 3s local 2024-12-18T01:11:54.3174382Z Testing //test/cpp:test_aten_xla_tensor_3; 3s local 2024-12-18T01:11:54.3175176Z Testing //test/cpp:test_aten_xla_tensor_1; 3s local 2024-12-18T01:11:54.3175889Z Testing //test/cpp:test_aten_xla_tensor_2; 3s local 2024-12-18T01:11:55.3174198Z 2024-12-18T01:11:55.3175034Z  2024-12-18T01:11:55.3175571Z  2024-12-18T01:11:55.3176031Z  2024-12-18T01:11:55.3176616Z  2024-12-18T01:11:55.3177086Z  2024-12-18T01:11:55.3177555Z  2024-12-18T01:11:55.3178039Z  2024-12-18T01:11:55.3179393Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:55.3180601Z Testing //test/cpp:test_aten_xla_tensor_4; 4s local 2024-12-18T01:11:55.3181447Z Testing //test/cpp:test_tensor; 4s local 2024-12-18T01:11:55.3182276Z Testing //test/cpp:test_aten_xla_tensor_5; 4s local 2024-12-18T01:11:55.3183230Z Testing //test/cpp:test_aten_xla_tensor_6; 4s local 2024-12-18T01:11:55.3183917Z Testing //test/cpp:test_aten_xla_tensor_3; 4s local 2024-12-18T01:11:55.3184605Z Testing //test/cpp:test_aten_xla_tensor_1; 4s local 2024-12-18T01:11:55.3185281Z Testing //test/cpp:test_aten_xla_tensor_2; 4s local 2024-12-18T01:11:56.3180244Z 2024-12-18T01:11:56.3181193Z  2024-12-18T01:11:56.3181707Z  2024-12-18T01:11:56.3182163Z  2024-12-18T01:11:56.3182641Z  2024-12-18T01:11:56.3183089Z  2024-12-18T01:11:56.3183547Z  2024-12-18T01:11:56.3183974Z  2024-12-18T01:11:56.3185050Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:56.3186208Z Testing //test/cpp:test_aten_xla_tensor_4; 5s local 2024-12-18T01:11:56.3187014Z Testing //test/cpp:test_tensor; 5s local 2024-12-18T01:11:56.3187796Z Testing //test/cpp:test_aten_xla_tensor_5; 5s local 2024-12-18T01:11:56.3188638Z Testing //test/cpp:test_aten_xla_tensor_6; 5s local 2024-12-18T01:11:56.3189508Z Testing //test/cpp:test_aten_xla_tensor_3; 5s local 2024-12-18T01:11:56.3190385Z Testing //test/cpp:test_aten_xla_tensor_1; 5s local 2024-12-18T01:11:56.3191238Z Testing //test/cpp:test_aten_xla_tensor_2; 5s local 2024-12-18T01:11:57.5190453Z 2024-12-18T01:11:57.5191197Z  2024-12-18T01:11:57.5191560Z  2024-12-18T01:11:57.5191858Z  2024-12-18T01:11:57.5192182Z  2024-12-18T01:11:57.5192482Z  2024-12-18T01:11:57.5192754Z  2024-12-18T01:11:57.5193042Z  2024-12-18T01:11:57.5193712Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:57.5194390Z Testing //test/cpp:test_aten_xla_tensor_4; 6s local 2024-12-18T01:11:57.5194892Z Testing //test/cpp:test_tensor; 6s local 2024-12-18T01:11:57.5195360Z Testing //test/cpp:test_aten_xla_tensor_5; 6s local 2024-12-18T01:11:57.5195877Z Testing //test/cpp:test_aten_xla_tensor_6; 6s local 2024-12-18T01:11:57.5196644Z Testing //test/cpp:test_aten_xla_tensor_3; 6s local 2024-12-18T01:11:57.5197162Z Testing //test/cpp:test_aten_xla_tensor_1; 6s local 2024-12-18T01:11:57.5197695Z Testing //test/cpp:test_aten_xla_tensor_2; 6s local 2024-12-18T01:11:58.7197477Z 2024-12-18T01:11:58.7198258Z  2024-12-18T01:11:58.7198696Z  2024-12-18T01:11:58.7199091Z  2024-12-18T01:11:58.7199447Z  2024-12-18T01:11:58.7200112Z  2024-12-18T01:11:58.7200476Z  2024-12-18T01:11:58.7200840Z  2024-12-18T01:11:58.7201732Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:58.7202655Z Testing //test/cpp:test_aten_xla_tensor_4; 8s local 2024-12-18T01:11:58.7203312Z Testing //test/cpp:test_tensor; 7s local 2024-12-18T01:11:58.7203964Z Testing //test/cpp:test_aten_xla_tensor_5; 7s local 2024-12-18T01:11:58.7204658Z Testing //test/cpp:test_aten_xla_tensor_6; 7s local 2024-12-18T01:11:58.7205358Z Testing //test/cpp:test_aten_xla_tensor_3; 7s local 2024-12-18T01:11:58.7206135Z Testing //test/cpp:test_aten_xla_tensor_1; 7s local 2024-12-18T01:11:58.7206816Z Testing //test/cpp:test_aten_xla_tensor_2; 7s local 2024-12-18T01:11:59.7203650Z 2024-12-18T01:11:59.7204597Z  2024-12-18T01:11:59.7205131Z  2024-12-18T01:11:59.7205587Z  2024-12-18T01:11:59.7206223Z  2024-12-18T01:11:59.7206684Z  2024-12-18T01:11:59.7207115Z  2024-12-18T01:11:59.7207554Z  2024-12-18T01:11:59.7208902Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:11:59.7210006Z Testing //test/cpp:test_aten_xla_tensor_4; 9s local 2024-12-18T01:11:59.7210781Z Testing //test/cpp:test_tensor; 8s local 2024-12-18T01:11:59.7211554Z Testing //test/cpp:test_aten_xla_tensor_5; 8s local 2024-12-18T01:11:59.7212384Z Testing //test/cpp:test_aten_xla_tensor_6; 8s local 2024-12-18T01:11:59.7213220Z Testing //test/cpp:test_aten_xla_tensor_3; 8s local 2024-12-18T01:11:59.7214048Z Testing //test/cpp:test_aten_xla_tensor_1; 8s local 2024-12-18T01:11:59.7214876Z Testing //test/cpp:test_aten_xla_tensor_2; 8s local 2024-12-18T01:12:00.7210371Z 2024-12-18T01:12:00.7211266Z  2024-12-18T01:12:00.7211764Z  2024-12-18T01:12:00.7212191Z  2024-12-18T01:12:00.7212648Z  2024-12-18T01:12:00.7213092Z  2024-12-18T01:12:00.7213500Z  2024-12-18T01:12:00.7213911Z  2024-12-18T01:12:00.7214882Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:00.7215892Z Testing //test/cpp:test_aten_xla_tensor_4; 10s local 2024-12-18T01:12:00.7216670Z Testing //test/cpp:test_tensor; 9s local 2024-12-18T01:12:00.7217370Z Testing //test/cpp:test_aten_xla_tensor_5; 9s local 2024-12-18T01:12:00.7218120Z Testing //test/cpp:test_aten_xla_tensor_6; 9s local 2024-12-18T01:12:00.7218876Z Testing //test/cpp:test_aten_xla_tensor_3; 9s local 2024-12-18T01:12:00.7219633Z Testing //test/cpp:test_aten_xla_tensor_1; 9s local 2024-12-18T01:12:00.7220375Z Testing //test/cpp:test_aten_xla_tensor_2; 9s local 2024-12-18T01:12:01.8602888Z 2024-12-18T01:12:01.8603734Z  2024-12-18T01:12:01.8604204Z  2024-12-18T01:12:01.8604592Z  2024-12-18T01:12:01.8604994Z  2024-12-18T01:12:01.8605430Z  2024-12-18T01:12:01.8605826Z  2024-12-18T01:12:01.8606227Z  2024-12-18T01:12:01.8607173Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:01.8608191Z Testing //test/cpp:test_aten_xla_tensor_4; 11s local 2024-12-18T01:12:01.8608922Z Testing //test/cpp:test_tensor; 11s local 2024-12-18T01:12:01.8609649Z Testing //test/cpp:test_aten_xla_tensor_5; 11s local 2024-12-18T01:12:01.8610426Z Testing //test/cpp:test_aten_xla_tensor_6; 10s local 2024-12-18T01:12:01.8611203Z Testing //test/cpp:test_aten_xla_tensor_3; 10s local 2024-12-18T01:12:01.8612234Z Testing //test/cpp:test_aten_xla_tensor_1; 10s local 2024-12-18T01:12:01.8613018Z Testing //test/cpp:test_aten_xla_tensor_2; 10s local 2024-12-18T01:12:02.9222300Z 2024-12-18T01:12:02.9223138Z  2024-12-18T01:12:02.9223583Z  2024-12-18T01:12:02.9223975Z  2024-12-18T01:12:02.9224370Z  2024-12-18T01:12:02.9225038Z  2024-12-18T01:12:02.9225415Z  2024-12-18T01:12:02.9225762Z  2024-12-18T01:12:02.9226710Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:02.9227679Z Testing //test/cpp:test_aten_xla_tensor_4; 12s local 2024-12-18T01:12:02.9228402Z Testing //test/cpp:test_tensor; 12s local 2024-12-18T01:12:02.9229122Z Testing //test/cpp:test_aten_xla_tensor_5; 12s local 2024-12-18T01:12:02.9229899Z Testing //test/cpp:test_aten_xla_tensor_6; 11s local 2024-12-18T01:12:02.9230660Z Testing //test/cpp:test_aten_xla_tensor_3; 11s local 2024-12-18T01:12:02.9231429Z Testing //test/cpp:test_aten_xla_tensor_1; 11s local 2024-12-18T01:12:02.9232370Z Testing //test/cpp:test_aten_xla_tensor_2; 11s local 2024-12-18T01:12:03.9229511Z 2024-12-18T01:12:03.9230330Z  2024-12-18T01:12:03.9230799Z  2024-12-18T01:12:03.9231208Z  2024-12-18T01:12:03.9231621Z  2024-12-18T01:12:03.9232010Z  2024-12-18T01:12:03.9232411Z  2024-12-18T01:12:03.9232798Z  2024-12-18T01:12:03.9233989Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:03.9234991Z Testing //test/cpp:test_aten_xla_tensor_4; 13s local 2024-12-18T01:12:03.9235699Z Testing //test/cpp:test_tensor; 13s local 2024-12-18T01:12:03.9236382Z Testing //test/cpp:test_aten_xla_tensor_5; 13s local 2024-12-18T01:12:03.9237130Z Testing //test/cpp:test_aten_xla_tensor_6; 12s local 2024-12-18T01:12:03.9237877Z Testing //test/cpp:test_aten_xla_tensor_3; 12s local 2024-12-18T01:12:03.9238630Z Testing //test/cpp:test_aten_xla_tensor_1; 12s local 2024-12-18T01:12:03.9239378Z Testing //test/cpp:test_aten_xla_tensor_2; 12s local 2024-12-18T01:12:05.1236755Z 2024-12-18T01:12:05.1237656Z  2024-12-18T01:12:05.1238165Z  2024-12-18T01:12:05.1238594Z  2024-12-18T01:12:05.1239022Z  2024-12-18T01:12:05.1239422Z  2024-12-18T01:12:05.1239869Z  2024-12-18T01:12:05.1240288Z  2024-12-18T01:12:05.1241300Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:05.1242369Z Testing //test/cpp:test_aten_xla_tensor_4; 14s local 2024-12-18T01:12:05.1243130Z Testing //test/cpp:test_tensor; 14s local 2024-12-18T01:12:05.1243887Z Testing //test/cpp:test_aten_xla_tensor_5; 14s local 2024-12-18T01:12:05.1244821Z Testing //test/cpp:test_aten_xla_tensor_6; 14s local 2024-12-18T01:12:05.1245629Z Testing //test/cpp:test_aten_xla_tensor_3; 14s local 2024-12-18T01:12:05.1246426Z Testing //test/cpp:test_aten_xla_tensor_1; 14s local 2024-12-18T01:12:05.1247238Z Testing //test/cpp:test_aten_xla_tensor_2; 14s local 2024-12-18T01:12:06.1298612Z 2024-12-18T01:12:06.1299444Z  2024-12-18T01:12:06.1299902Z  2024-12-18T01:12:06.1300283Z  2024-12-18T01:12:06.1300688Z  2024-12-18T01:12:06.1301053Z  2024-12-18T01:12:06.1301476Z  2024-12-18T01:12:06.1301850Z  2024-12-18T01:12:06.1302749Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:06.1303718Z Testing //test/cpp:test_aten_xla_tensor_4; 15s local 2024-12-18T01:12:06.1304391Z Testing //test/cpp:test_tensor; 15s local 2024-12-18T01:12:06.1305062Z Testing //test/cpp:test_aten_xla_tensor_5; 15s local 2024-12-18T01:12:06.1305797Z Testing //test/cpp:test_aten_xla_tensor_6; 15s local 2024-12-18T01:12:06.1306525Z Testing //test/cpp:test_aten_xla_tensor_3; 15s local 2024-12-18T01:12:06.1307490Z Testing //test/cpp:test_aten_xla_tensor_1; 15s local 2024-12-18T01:12:06.1308222Z Testing //test/cpp:test_aten_xla_tensor_2; 15s local 2024-12-18T01:12:07.3306473Z 2024-12-18T01:12:07.3307255Z  2024-12-18T01:12:07.3307713Z  2024-12-18T01:12:07.3308094Z  2024-12-18T01:12:07.3308471Z  2024-12-18T01:12:07.3308833Z  2024-12-18T01:12:07.3309497Z  2024-12-18T01:12:07.3309873Z  2024-12-18T01:12:07.3310782Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:07.3311757Z Testing //test/cpp:test_aten_xla_tensor_4; 16s local 2024-12-18T01:12:07.3312428Z Testing //test/cpp:test_tensor; 16s local 2024-12-18T01:12:07.3313098Z Testing //test/cpp:test_aten_xla_tensor_5; 16s local 2024-12-18T01:12:07.3313822Z Testing //test/cpp:test_aten_xla_tensor_6; 16s local 2024-12-18T01:12:07.3314547Z Testing //test/cpp:test_aten_xla_tensor_3; 16s local 2024-12-18T01:12:07.3315272Z Testing //test/cpp:test_aten_xla_tensor_1; 16s local 2024-12-18T01:12:07.3316083Z Testing //test/cpp:test_aten_xla_tensor_2; 16s local 2024-12-18T01:12:08.3436965Z 2024-12-18T01:12:08.3437695Z  2024-12-18T01:12:08.3438132Z  2024-12-18T01:12:08.3438495Z  2024-12-18T01:12:08.3438876Z  2024-12-18T01:12:08.3439259Z  2024-12-18T01:12:08.3439657Z  2024-12-18T01:12:08.3440030Z  2024-12-18T01:12:08.3441149Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:08.3442121Z Testing //test/cpp:test_aten_xla_tensor_4; 17s local 2024-12-18T01:12:08.3442805Z Testing //test/cpp:test_tensor; 17s local 2024-12-18T01:12:08.3443479Z Testing //test/cpp:test_aten_xla_tensor_5; 17s local 2024-12-18T01:12:08.3444341Z Testing //test/cpp:test_aten_xla_tensor_6; 17s local 2024-12-18T01:12:08.3445048Z Testing //test/cpp:test_aten_xla_tensor_3; 17s local 2024-12-18T01:12:08.3445774Z Testing //test/cpp:test_aten_xla_tensor_1; 17s local 2024-12-18T01:12:08.3446495Z Testing //test/cpp:test_aten_xla_tensor_2; 17s local 2024-12-18T01:12:09.3513040Z 2024-12-18T01:12:09.3514034Z  2024-12-18T01:12:09.3514595Z  2024-12-18T01:12:09.3515070Z  2024-12-18T01:12:09.3515536Z  2024-12-18T01:12:09.3515993Z  2024-12-18T01:12:09.3516480Z  2024-12-18T01:12:09.3516952Z  2024-12-18T01:12:09.3518037Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:09.3519414Z Testing //test/cpp:test_aten_xla_tensor_4; 18s local 2024-12-18T01:12:09.3520351Z Testing //test/cpp:test_tensor; 18s local 2024-12-18T01:12:09.3521274Z Testing //test/cpp:test_aten_xla_tensor_5; 18s local 2024-12-18T01:12:09.3522237Z Testing //test/cpp:test_aten_xla_tensor_6; 18s local 2024-12-18T01:12:09.3523223Z Testing //test/cpp:test_aten_xla_tensor_3; 18s local 2024-12-18T01:12:09.3524212Z Testing //test/cpp:test_aten_xla_tensor_1; 18s local 2024-12-18T01:12:09.3525198Z Testing //test/cpp:test_aten_xla_tensor_2; 18s local 2024-12-18T01:12:10.3453883Z 2024-12-18T01:12:10.3454670Z  2024-12-18T01:12:10.3455121Z  2024-12-18T01:12:10.3455510Z  2024-12-18T01:12:10.3455893Z  2024-12-18T01:12:10.3456269Z  2024-12-18T01:12:10.3456736Z  2024-12-18T01:12:10.3457107Z  2024-12-18T01:12:10.3458015Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:10.3458975Z Testing //test/cpp:test_aten_xla_tensor_4; 19s local 2024-12-18T01:12:10.3459663Z Testing //test/cpp:test_tensor; 19s local 2024-12-18T01:12:10.3460336Z Testing //test/cpp:test_aten_xla_tensor_5; 19s local 2024-12-18T01:12:10.3461072Z Testing //test/cpp:test_aten_xla_tensor_6; 19s local 2024-12-18T01:12:10.3461798Z Testing //test/cpp:test_aten_xla_tensor_3; 19s local 2024-12-18T01:12:10.3462752Z Testing //test/cpp:test_aten_xla_tensor_1; 19s local 2024-12-18T01:12:10.3463482Z Testing //test/cpp:test_aten_xla_tensor_2; 19s local 2024-12-18T01:12:11.3460875Z 2024-12-18T01:12:11.3461888Z  2024-12-18T01:12:11.3462343Z  2024-12-18T01:12:11.3462725Z  2024-12-18T01:12:11.3463089Z  2024-12-18T01:12:11.3463486Z  2024-12-18T01:12:11.3464151Z  2024-12-18T01:12:11.3464528Z  2024-12-18T01:12:11.3465399Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:11.3466361Z Testing //test/cpp:test_aten_xla_tensor_4; 20s local 2024-12-18T01:12:11.3467030Z Testing //test/cpp:test_tensor; 20s local 2024-12-18T01:12:11.3467690Z Testing //test/cpp:test_aten_xla_tensor_5; 20s local 2024-12-18T01:12:11.3468409Z Testing //test/cpp:test_aten_xla_tensor_6; 20s local 2024-12-18T01:12:11.3469120Z Testing //test/cpp:test_aten_xla_tensor_3; 20s local 2024-12-18T01:12:11.3469817Z Testing //test/cpp:test_aten_xla_tensor_1; 20s local 2024-12-18T01:12:11.3470613Z Testing //test/cpp:test_aten_xla_tensor_2; 20s local 2024-12-18T01:12:12.5469288Z 2024-12-18T01:12:12.5470412Z  2024-12-18T01:12:12.5470836Z  2024-12-18T01:12:12.5471192Z  2024-12-18T01:12:12.5471529Z  2024-12-18T01:12:12.5471879Z  2024-12-18T01:12:12.5472263Z  2024-12-18T01:12:12.5472634Z  2024-12-18T01:12:12.5473722Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:12.5474590Z Testing //test/cpp:test_aten_xla_tensor_4; 21s local 2024-12-18T01:12:12.5475228Z Testing //test/cpp:test_tensor; 21s local 2024-12-18T01:12:12.5475843Z Testing //test/cpp:test_aten_xla_tensor_5; 21s local 2024-12-18T01:12:12.5476519Z Testing //test/cpp:test_aten_xla_tensor_6; 21s local 2024-12-18T01:12:12.5477206Z Testing //test/cpp:test_aten_xla_tensor_3; 21s local 2024-12-18T01:12:12.5477909Z Testing //test/cpp:test_aten_xla_tensor_1; 21s local 2024-12-18T01:12:12.5478615Z Testing //test/cpp:test_aten_xla_tensor_2; 21s local 2024-12-18T01:12:13.5474634Z 2024-12-18T01:12:13.5475419Z  2024-12-18T01:12:13.5475874Z  2024-12-18T01:12:13.5476263Z  2024-12-18T01:12:13.5476640Z  2024-12-18T01:12:13.5477020Z  2024-12-18T01:12:13.5477407Z  2024-12-18T01:12:13.5477782Z  2024-12-18T01:12:13.5478816Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:13.5479818Z Testing //test/cpp:test_aten_xla_tensor_4; 22s local 2024-12-18T01:12:13.5480521Z Testing //test/cpp:test_tensor; 22s local 2024-12-18T01:12:13.5481202Z Testing //test/cpp:test_aten_xla_tensor_5; 22s local 2024-12-18T01:12:13.5481943Z Testing //test/cpp:test_aten_xla_tensor_6; 22s local 2024-12-18T01:12:13.5482692Z Testing //test/cpp:test_aten_xla_tensor_3; 22s local 2024-12-18T01:12:13.5483440Z Testing //test/cpp:test_aten_xla_tensor_1; 22s local 2024-12-18T01:12:13.5484188Z Testing //test/cpp:test_aten_xla_tensor_2; 22s local 2024-12-18T01:12:14.5481964Z 2024-12-18T01:12:14.5482795Z  2024-12-18T01:12:14.5483244Z  2024-12-18T01:12:14.5483614Z  2024-12-18T01:12:14.5483996Z  2024-12-18T01:12:14.5484373Z  2024-12-18T01:12:14.5484776Z  2024-12-18T01:12:14.5485143Z  2024-12-18T01:12:14.5486057Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:14.5487036Z Testing //test/cpp:test_aten_xla_tensor_4; 23s local 2024-12-18T01:12:14.5487728Z Testing //test/cpp:test_tensor; 23s local 2024-12-18T01:12:14.5488402Z Testing //test/cpp:test_aten_xla_tensor_5; 23s local 2024-12-18T01:12:14.5489110Z Testing //test/cpp:test_aten_xla_tensor_6; 23s local 2024-12-18T01:12:14.5489838Z Testing //test/cpp:test_aten_xla_tensor_3; 23s local 2024-12-18T01:12:14.5490788Z Testing //test/cpp:test_aten_xla_tensor_1; 23s local 2024-12-18T01:12:14.5491524Z Testing //test/cpp:test_aten_xla_tensor_2; 23s local 2024-12-18T01:12:15.7489873Z 2024-12-18T01:12:15.7490684Z  2024-12-18T01:12:15.7491141Z  2024-12-18T01:12:15.7491553Z  2024-12-18T01:12:15.7491897Z  2024-12-18T01:12:15.7492271Z  2024-12-18T01:12:15.7492903Z  2024-12-18T01:12:15.7493256Z  2024-12-18T01:12:15.7494156Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:15.7495131Z Testing //test/cpp:test_aten_xla_tensor_4; 25s local 2024-12-18T01:12:15.7495803Z Testing //test/cpp:test_tensor; 25s local 2024-12-18T01:12:15.7496540Z Testing //test/cpp:test_aten_xla_tensor_5; 25s local 2024-12-18T01:12:15.7497244Z Testing //test/cpp:test_aten_xla_tensor_6; 24s local 2024-12-18T01:12:15.7497956Z Testing //test/cpp:test_aten_xla_tensor_3; 24s local 2024-12-18T01:12:15.7498703Z Testing //test/cpp:test_aten_xla_tensor_1; 24s local 2024-12-18T01:12:15.7499615Z Testing //test/cpp:test_aten_xla_tensor_2; 24s local 2024-12-18T01:12:16.9500149Z 2024-12-18T01:12:16.9501285Z  2024-12-18T01:12:16.9501742Z  2024-12-18T01:12:16.9502112Z  2024-12-18T01:12:16.9502591Z  2024-12-18T01:12:16.9502934Z  2024-12-18T01:12:16.9503353Z  2024-12-18T01:12:16.9503712Z  2024-12-18T01:12:16.9504896Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:16.9505832Z Testing //test/cpp:test_aten_xla_tensor_4; 26s local 2024-12-18T01:12:16.9506462Z Testing //test/cpp:test_tensor; 26s local 2024-12-18T01:12:16.9507265Z Testing //test/cpp:test_aten_xla_tensor_5; 26s local 2024-12-18T01:12:16.9507951Z Testing //test/cpp:test_aten_xla_tensor_6; 25s local 2024-12-18T01:12:16.9508632Z Testing //test/cpp:test_aten_xla_tensor_3; 25s local 2024-12-18T01:12:16.9509326Z Testing //test/cpp:test_aten_xla_tensor_1; 25s local 2024-12-18T01:12:16.9510027Z Testing //test/cpp:test_aten_xla_tensor_2; 25s local 2024-12-18T01:12:18.1507540Z 2024-12-18T01:12:18.1508751Z  2024-12-18T01:12:18.1509191Z  2024-12-18T01:12:18.1509577Z  2024-12-18T01:12:18.1509968Z  2024-12-18T01:12:18.1510352Z  2024-12-18T01:12:18.1510750Z  2024-12-18T01:12:18.1511165Z  2024-12-18T01:12:18.1512093Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:18.1513079Z Testing //test/cpp:test_aten_xla_tensor_4; 27s local 2024-12-18T01:12:18.1513782Z Testing //test/cpp:test_tensor; 27s local 2024-12-18T01:12:18.1514450Z Testing //test/cpp:test_aten_xla_tensor_5; 27s local 2024-12-18T01:12:18.1515296Z Testing //test/cpp:test_aten_xla_tensor_6; 27s local 2024-12-18T01:12:18.1516077Z Testing //test/cpp:test_aten_xla_tensor_3; 27s local 2024-12-18T01:12:18.1516803Z Testing //test/cpp:test_aten_xla_tensor_1; 27s local 2024-12-18T01:12:18.1517529Z Testing //test/cpp:test_aten_xla_tensor_2; 27s local 2024-12-18T01:12:19.1513711Z 2024-12-18T01:12:19.1514887Z  2024-12-18T01:12:19.1515319Z  2024-12-18T01:12:19.1515700Z  2024-12-18T01:12:19.1516062Z  2024-12-18T01:12:19.1516431Z  2024-12-18T01:12:19.1516776Z  2024-12-18T01:12:19.1517179Z  2024-12-18T01:12:19.1518067Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:19.1519007Z Testing //test/cpp:test_aten_xla_tensor_4; 28s local 2024-12-18T01:12:19.1519674Z Testing //test/cpp:test_tensor; 28s local 2024-12-18T01:12:19.1520384Z Testing //test/cpp:test_aten_xla_tensor_5; 28s local 2024-12-18T01:12:19.1521069Z Testing //test/cpp:test_aten_xla_tensor_6; 28s local 2024-12-18T01:12:19.1521781Z Testing //test/cpp:test_aten_xla_tensor_3; 28s local 2024-12-18T01:12:19.1522749Z Testing //test/cpp:test_aten_xla_tensor_1; 28s local 2024-12-18T01:12:19.1523461Z Testing //test/cpp:test_aten_xla_tensor_2; 28s local 2024-12-18T01:12:20.1519938Z 2024-12-18T01:12:20.1520742Z  2024-12-18T01:12:20.1521182Z  2024-12-18T01:12:20.1521562Z  2024-12-18T01:12:20.1521953Z  2024-12-18T01:12:20.1522332Z  2024-12-18T01:12:20.1522708Z  2024-12-18T01:12:20.1523364Z  2024-12-18T01:12:20.1524290Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:20.1525279Z Testing //test/cpp:test_aten_xla_tensor_4; 29s local 2024-12-18T01:12:20.1526010Z Testing //test/cpp:test_tensor; 29s local 2024-12-18T01:12:20.1526727Z Testing //test/cpp:test_aten_xla_tensor_5; 29s local 2024-12-18T01:12:20.1527486Z Testing //test/cpp:test_aten_xla_tensor_6; 29s local 2024-12-18T01:12:20.1528264Z Testing //test/cpp:test_aten_xla_tensor_3; 29s local 2024-12-18T01:12:20.1529042Z Testing //test/cpp:test_aten_xla_tensor_1; 29s local 2024-12-18T01:12:20.1530002Z Testing //test/cpp:test_aten_xla_tensor_2; 29s local 2024-12-18T01:12:21.3526468Z 2024-12-18T01:12:21.3527399Z  2024-12-18T01:12:21.3527880Z  2024-12-18T01:12:21.3528311Z  2024-12-18T01:12:21.3528718Z  2024-12-18T01:12:21.3529135Z  2024-12-18T01:12:21.3529531Z  2024-12-18T01:12:21.3530104Z  2024-12-18T01:12:21.3531357Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:21.3532458Z Testing //test/cpp:test_aten_xla_tensor_4; 30s local 2024-12-18T01:12:21.3533229Z Testing //test/cpp:test_tensor; 30s local 2024-12-18T01:12:21.3533976Z Testing //test/cpp:test_aten_xla_tensor_5; 30s local 2024-12-18T01:12:21.3534791Z Testing //test/cpp:test_aten_xla_tensor_6; 30s local 2024-12-18T01:12:21.3535608Z Testing //test/cpp:test_aten_xla_tensor_3; 30s local 2024-12-18T01:12:21.3536435Z Testing //test/cpp:test_aten_xla_tensor_1; 30s local 2024-12-18T01:12:21.3537337Z Testing //test/cpp:test_aten_xla_tensor_2; 30s local 2024-12-18T01:12:22.3531976Z 2024-12-18T01:12:22.3532776Z  2024-12-18T01:12:22.3533333Z  2024-12-18T01:12:22.3533858Z  2024-12-18T01:12:22.3534363Z  2024-12-18T01:12:22.3534862Z  2024-12-18T01:12:22.3535366Z  2024-12-18T01:12:22.3535887Z  2024-12-18T01:12:22.3537167Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:22.3538623Z Testing //test/cpp:test_aten_xla_tensor_4; 31s local 2024-12-18T01:12:22.3539542Z Testing //test/cpp:test_tensor; 31s local 2024-12-18T01:12:22.3540262Z Testing //test/cpp:test_aten_xla_tensor_5; 31s local 2024-12-18T01:12:22.3541041Z Testing //test/cpp:test_aten_xla_tensor_6; 31s local 2024-12-18T01:12:22.3541819Z Testing //test/cpp:test_aten_xla_tensor_3; 31s local 2024-12-18T01:12:22.3542591Z Testing //test/cpp:test_aten_xla_tensor_1; 31s local 2024-12-18T01:12:22.3543373Z Testing //test/cpp:test_aten_xla_tensor_2; 31s local 2024-12-18T01:12:23.3538587Z 2024-12-18T01:12:23.3539338Z  2024-12-18T01:12:23.3539813Z  2024-12-18T01:12:23.3540205Z  2024-12-18T01:12:23.3540601Z  2024-12-18T01:12:23.3540992Z  2024-12-18T01:12:23.3541381Z  2024-12-18T01:12:23.3541789Z  2024-12-18T01:12:23.3542722Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:23.3544541Z Testing //test/cpp:test_aten_xla_tensor_4; 32s local 2024-12-18T01:12:23.3545575Z Testing //test/cpp:test_tensor; 32s local 2024-12-18T01:12:23.3546569Z Testing //test/cpp:test_aten_xla_tensor_5; 32s local 2024-12-18T01:12:23.3547784Z Testing //test/cpp:test_aten_xla_tensor_6; 32s local 2024-12-18T01:12:23.3548833Z Testing //test/cpp:test_aten_xla_tensor_3; 32s local 2024-12-18T01:12:23.3550222Z Testing //test/cpp:test_aten_xla_tensor_1; 32s local 2024-12-18T01:12:23.3551294Z Testing //test/cpp:test_aten_xla_tensor_2; 32s local 2024-12-18T01:12:24.5549129Z 2024-12-18T01:12:24.5549922Z  2024-12-18T01:12:24.5550496Z  2024-12-18T01:12:24.5550993Z  2024-12-18T01:12:24.5551491Z  2024-12-18T01:12:24.5551885Z  2024-12-18T01:12:24.5552273Z  2024-12-18T01:12:24.5553255Z  2024-12-18T01:12:24.5554655Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:24.5556205Z Testing //test/cpp:test_aten_xla_tensor_4; 33s local 2024-12-18T01:12:24.5557276Z Testing //test/cpp:test_tensor; 33s local 2024-12-18T01:12:24.5558332Z Testing //test/cpp:test_aten_xla_tensor_5; 33s local 2024-12-18T01:12:24.5559462Z Testing //test/cpp:test_aten_xla_tensor_6; 33s local 2024-12-18T01:12:24.5560606Z Testing //test/cpp:test_aten_xla_tensor_3; 33s local 2024-12-18T01:12:24.5561602Z Testing //test/cpp:test_aten_xla_tensor_1; 33s local 2024-12-18T01:12:24.5562756Z Testing //test/cpp:test_aten_xla_tensor_2; 33s local 2024-12-18T01:12:25.5554871Z 2024-12-18T01:12:25.5555843Z  2024-12-18T01:12:25.5556356Z  2024-12-18T01:12:25.5556800Z  2024-12-18T01:12:25.5557222Z  2024-12-18T01:12:25.5557665Z  2024-12-18T01:12:25.5558098Z  2024-12-18T01:12:25.5558564Z  2024-12-18T01:12:25.5559580Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:25.5560975Z Testing //test/cpp:test_aten_xla_tensor_4; 34s local 2024-12-18T01:12:25.5561788Z Testing //test/cpp:test_tensor; 34s local 2024-12-18T01:12:25.5562575Z Testing //test/cpp:test_aten_xla_tensor_5; 34s local 2024-12-18T01:12:25.5563433Z Testing //test/cpp:test_aten_xla_tensor_6; 34s local 2024-12-18T01:12:25.5564279Z Testing //test/cpp:test_aten_xla_tensor_3; 34s local 2024-12-18T01:12:25.5565114Z Testing //test/cpp:test_aten_xla_tensor_1; 34s local 2024-12-18T01:12:26.5561949Z Testing //test/cpp:test_aten_xla_tensor_2; 34s local 2024-12-18T01:12:26.5562582Z 2024-12-18T01:12:26.5563011Z  2024-12-18T01:12:26.5563478Z  2024-12-18T01:12:26.5563894Z  2024-12-18T01:12:26.5564319Z  2024-12-18T01:12:26.5564747Z  2024-12-18T01:12:26.5565188Z  2024-12-18T01:12:26.5565630Z  2024-12-18T01:12:26.5566577Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:26.5567688Z Testing //test/cpp:test_aten_xla_tensor_4; 35s local 2024-12-18T01:12:26.5568477Z Testing //test/cpp:test_tensor; 35s local 2024-12-18T01:12:26.5569252Z Testing //test/cpp:test_aten_xla_tensor_5; 35s local 2024-12-18T01:12:26.5570076Z Testing //test/cpp:test_aten_xla_tensor_6; 35s local 2024-12-18T01:12:26.5570895Z Testing //test/cpp:test_aten_xla_tensor_3; 35s local 2024-12-18T01:12:26.5571733Z Testing //test/cpp:test_aten_xla_tensor_1; 35s local 2024-12-18T01:12:26.5572560Z Testing //test/cpp:test_aten_xla_tensor_2; 35s local 2024-12-18T01:12:27.7568730Z 2024-12-18T01:12:27.7569655Z  2024-12-18T01:12:27.7570130Z  2024-12-18T01:12:27.7570552Z  2024-12-18T01:12:27.7570967Z  2024-12-18T01:12:27.7571394Z  2024-12-18T01:12:27.7571812Z  2024-12-18T01:12:27.7572247Z  2024-12-18T01:12:27.7573231Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:27.7574360Z Testing //test/cpp:test_aten_xla_tensor_4; 37s local 2024-12-18T01:12:27.7575150Z Testing //test/cpp:test_tensor; 37s local 2024-12-18T01:12:27.7575940Z Testing //test/cpp:test_aten_xla_tensor_5; 37s local 2024-12-18T01:12:27.7576792Z Testing //test/cpp:test_aten_xla_tensor_6; 36s local 2024-12-18T01:12:27.7577592Z Testing //test/cpp:test_aten_xla_tensor_3; 36s local 2024-12-18T01:12:27.7578646Z Testing //test/cpp:test_aten_xla_tensor_1; 36s local 2024-12-18T01:12:27.7579435Z Testing //test/cpp:test_aten_xla_tensor_2; 36s local 2024-12-18T01:12:28.9575746Z 2024-12-18T01:12:28.9576584Z  2024-12-18T01:12:28.9577079Z  2024-12-18T01:12:28.9577491Z  2024-12-18T01:12:28.9577886Z  2024-12-18T01:12:28.9578299Z  2024-12-18T01:12:28.9578670Z  2024-12-18T01:12:28.9579300Z  2024-12-18T01:12:28.9580294Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:28.9581258Z Testing //test/cpp:test_aten_xla_tensor_4; 38s local 2024-12-18T01:12:28.9581929Z Testing //test/cpp:test_tensor; 38s local 2024-12-18T01:12:28.9582584Z Testing //test/cpp:test_aten_xla_tensor_5; 38s local 2024-12-18T01:12:28.9583297Z Testing //test/cpp:test_aten_xla_tensor_6; 37s local 2024-12-18T01:12:28.9584000Z Testing //test/cpp:test_aten_xla_tensor_3; 37s local 2024-12-18T01:12:28.9584882Z Testing //test/cpp:test_aten_xla_tensor_1; 37s local 2024-12-18T01:12:28.9585581Z Testing //test/cpp:test_aten_xla_tensor_2; 37s local 2024-12-18T01:12:29.9582011Z 2024-12-18T01:12:29.9582775Z  2024-12-18T01:12:29.9583349Z  2024-12-18T01:12:29.9583862Z  2024-12-18T01:12:29.9584349Z  2024-12-18T01:12:29.9584856Z  2024-12-18T01:12:29.9585360Z  2024-12-18T01:12:29.9585881Z  2024-12-18T01:12:29.9587110Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:29.9588468Z Testing //test/cpp:test_aten_xla_tensor_4; 39s local 2024-12-18T01:12:29.9589178Z Testing //test/cpp:test_tensor; 39s local 2024-12-18T01:12:29.9589885Z Testing //test/cpp:test_aten_xla_tensor_5; 39s local 2024-12-18T01:12:29.9590645Z Testing //test/cpp:test_aten_xla_tensor_6; 38s local 2024-12-18T01:12:29.9591405Z Testing //test/cpp:test_aten_xla_tensor_3; 38s local 2024-12-18T01:12:29.9592158Z Testing //test/cpp:test_aten_xla_tensor_1; 38s local 2024-12-18T01:12:29.9592917Z Testing //test/cpp:test_aten_xla_tensor_2; 38s local 2024-12-18T01:12:30.9756630Z 2024-12-18T01:12:30.9757737Z  2024-12-18T01:12:30.9758332Z  2024-12-18T01:12:30.9758835Z  2024-12-18T01:12:30.9759357Z  2024-12-18T01:12:30.9759868Z  2024-12-18T01:12:30.9760374Z  2024-12-18T01:12:30.9760858Z  2024-12-18T01:12:30.9762069Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:30.9763381Z Testing //test/cpp:test_aten_xla_tensor_4; 40s local 2024-12-18T01:12:30.9764295Z Testing //test/cpp:test_tensor; 40s local 2024-12-18T01:12:30.9765206Z Testing //test/cpp:test_aten_xla_tensor_5; 40s local 2024-12-18T01:12:30.9766185Z Testing //test/cpp:test_aten_xla_tensor_6; 40s local 2024-12-18T01:12:30.9767136Z Testing //test/cpp:test_aten_xla_tensor_3; 39s local 2024-12-18T01:12:30.9768098Z Testing //test/cpp:test_aten_xla_tensor_1; 39s local 2024-12-18T01:12:30.9769065Z Testing //test/cpp:test_aten_xla_tensor_2; 39s local 2024-12-18T01:12:31.8678265Z 2024-12-18T01:12:31.8679205Z  2024-12-18T01:12:31.8679735Z  2024-12-18T01:12:31.8680189Z  2024-12-18T01:12:31.8680637Z  2024-12-18T01:12:31.8681073Z  2024-12-18T01:12:31.8681499Z  2024-12-18T01:12:31.8681932Z  2024-12-18T01:12:31.8682993Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:31.8684145Z Testing //test/cpp:test_aten_xla_tensor_4; 41s local 2024-12-18T01:12:31.8684954Z Testing //test/cpp:test_tensor; 41s local 2024-12-18T01:12:31.8685741Z Testing //test/cpp:test_aten_xla_tensor_5; 41s local 2024-12-18T01:12:31.8686721Z Testing //test/cpp:test_aten_xla_tensor_6; 40s local 2024-12-18T01:12:31.8687594Z Testing //test/cpp:test_aten_xla_tensor_3; 40s local 2024-12-18T01:12:31.8688462Z Testing //test/cpp:test_aten_xla_tensor_1; 40s local 2024-12-18T01:12:31.8689647Z Testing //test/cpp:test_aten_xla_tensor_2; 40s local 2024-12-18T01:12:32.9768171Z 2024-12-18T01:12:32.9769215Z  2024-12-18T01:12:32.9769860Z  2024-12-18T01:12:32.9770435Z  2024-12-18T01:12:32.9770948Z  2024-12-18T01:12:32.9771496Z  2024-12-18T01:12:32.9772042Z  2024-12-18T01:12:32.9772575Z  2024-12-18T01:12:32.9774223Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:32.9775615Z Testing //test/cpp:test_aten_xla_tensor_4; 42s local 2024-12-18T01:12:32.9776660Z Testing //test/cpp:test_tensor; 42s local 2024-12-18T01:12:32.9777620Z Testing //test/cpp:test_aten_xla_tensor_5; 42s local 2024-12-18T01:12:32.9778645Z Testing //test/cpp:test_aten_xla_tensor_6; 42s local 2024-12-18T01:12:32.9779684Z Testing //test/cpp:test_aten_xla_tensor_3; 41s local 2024-12-18T01:12:32.9780678Z Testing //test/cpp:test_aten_xla_tensor_1; 41s local 2024-12-18T01:12:32.9781698Z Testing //test/cpp:test_aten_xla_tensor_2; 41s local 2024-12-18T01:12:33.9775324Z 2024-12-18T01:12:33.9776413Z  2024-12-18T01:12:33.9777100Z  2024-12-18T01:12:33.9777645Z  2024-12-18T01:12:33.9778186Z  2024-12-18T01:12:33.9778729Z  2024-12-18T01:12:33.9779265Z  2024-12-18T01:12:33.9779777Z  2024-12-18T01:12:33.9781048Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:33.9782586Z Testing //test/cpp:test_aten_xla_tensor_4; 43s local 2024-12-18T01:12:33.9783562Z Testing //test/cpp:test_tensor; 43s local 2024-12-18T01:12:33.9784534Z Testing //test/cpp:test_aten_xla_tensor_5; 43s local 2024-12-18T01:12:33.9785547Z Testing //test/cpp:test_aten_xla_tensor_6; 43s local 2024-12-18T01:12:33.9786585Z Testing //test/cpp:test_aten_xla_tensor_3; 42s local 2024-12-18T01:12:33.9787604Z Testing //test/cpp:test_aten_xla_tensor_1; 42s local 2024-12-18T01:12:33.9788637Z Testing //test/cpp:test_aten_xla_tensor_2; 42s local 2024-12-18T01:12:34.9781461Z 2024-12-18T01:12:34.9782294Z  2024-12-18T01:12:34.9782860Z  2024-12-18T01:12:34.9783253Z  2024-12-18T01:12:34.9783642Z  2024-12-18T01:12:34.9784026Z  2024-12-18T01:12:34.9784409Z  2024-12-18T01:12:34.9784797Z  2024-12-18T01:12:34.9785765Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:34.9786804Z Testing //test/cpp:test_aten_xla_tensor_4; 44s local 2024-12-18T01:12:34.9787537Z Testing //test/cpp:test_tensor; 44s local 2024-12-18T01:12:34.9788241Z Testing //test/cpp:test_aten_xla_tensor_5; 44s local 2024-12-18T01:12:34.9789009Z Testing //test/cpp:test_aten_xla_tensor_6; 44s local 2024-12-18T01:12:34.9789773Z Testing //test/cpp:test_aten_xla_tensor_3; 43s local 2024-12-18T01:12:34.9790550Z Testing //test/cpp:test_aten_xla_tensor_1; 43s local 2024-12-18T01:12:34.9791321Z Testing //test/cpp:test_aten_xla_tensor_2; 43s local 2024-12-18T01:12:36.1787321Z 2024-12-18T01:12:36.1788127Z  2024-12-18T01:12:36.1788568Z  2024-12-18T01:12:36.1788973Z  2024-12-18T01:12:36.1789371Z  2024-12-18T01:12:36.1789760Z  2024-12-18T01:12:36.1790138Z  2024-12-18T01:12:36.1790531Z  2024-12-18T01:12:36.1791477Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:36.1792496Z Testing //test/cpp:test_aten_xla_tensor_4; 45s local 2024-12-18T01:12:36.1793218Z Testing //test/cpp:test_tensor; 45s local 2024-12-18T01:12:36.1793925Z Testing //test/cpp:test_aten_xla_tensor_5; 45s local 2024-12-18T01:12:36.1794671Z Testing //test/cpp:test_aten_xla_tensor_6; 45s local 2024-12-18T01:12:36.1795743Z Testing //test/cpp:test_aten_xla_tensor_3; 45s local 2024-12-18T01:12:36.1796829Z Testing //test/cpp:test_aten_xla_tensor_1; 45s local 2024-12-18T01:12:36.1798078Z Testing //test/cpp:test_aten_xla_tensor_2; 45s local 2024-12-18T01:12:37.1794826Z 2024-12-18T01:12:37.1795608Z  2024-12-18T01:12:37.1796052Z  2024-12-18T01:12:37.1796473Z  2024-12-18T01:12:37.1796841Z  2024-12-18T01:12:37.1797196Z  2024-12-18T01:12:37.1797569Z  2024-12-18T01:12:37.1797934Z  2024-12-18T01:12:37.1799072Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:37.1800041Z Testing //test/cpp:test_aten_xla_tensor_4; 46s local 2024-12-18T01:12:37.1800701Z Testing //test/cpp:test_tensor; 46s local 2024-12-18T01:12:37.1801359Z Testing //test/cpp:test_aten_xla_tensor_5; 46s local 2024-12-18T01:12:37.1802063Z Testing //test/cpp:test_aten_xla_tensor_6; 46s local 2024-12-18T01:12:37.1802780Z Testing //test/cpp:test_aten_xla_tensor_3; 46s local 2024-12-18T01:12:37.1803529Z Testing //test/cpp:test_aten_xla_tensor_1; 46s local 2024-12-18T01:12:37.1804228Z Testing //test/cpp:test_aten_xla_tensor_2; 46s local 2024-12-18T01:12:38.1847548Z 2024-12-18T01:12:38.1848397Z  2024-12-18T01:12:38.1848840Z  2024-12-18T01:12:38.1849215Z  2024-12-18T01:12:38.1849577Z  2024-12-18T01:12:38.1849958Z  2024-12-18T01:12:38.1850330Z  2024-12-18T01:12:38.1850710Z  2024-12-18T01:12:38.1851602Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:38.1852644Z Testing //test/cpp:test_aten_xla_tensor_4; 47s local 2024-12-18T01:12:38.1853337Z Testing //test/cpp:test_tensor; 47s local 2024-12-18T01:12:38.1854003Z Testing //test/cpp:test_aten_xla_tensor_5; 47s local 2024-12-18T01:12:38.1854721Z Testing //test/cpp:test_aten_xla_tensor_6; 47s local 2024-12-18T01:12:38.1855433Z Testing //test/cpp:test_aten_xla_tensor_3; 47s local 2024-12-18T01:12:38.1856127Z Testing //test/cpp:test_aten_xla_tensor_1; 47s local 2024-12-18T01:12:38.1856916Z Testing //test/cpp:test_aten_xla_tensor_2; 47s local 2024-12-18T01:12:39.2053522Z 2024-12-18T01:12:39.2054394Z  2024-12-18T01:12:39.2054867Z  2024-12-18T01:12:39.2055288Z  2024-12-18T01:12:39.2055680Z  2024-12-18T01:12:39.2056083Z  2024-12-18T01:12:39.2056559Z  2024-12-18T01:12:39.2056964Z  2024-12-18T01:12:39.2057922Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:39.2058970Z Testing //test/cpp:test_aten_xla_tensor_4; 48s local 2024-12-18T01:12:39.2059710Z Testing //test/cpp:test_tensor; 48s local 2024-12-18T01:12:39.2060430Z Testing //test/cpp:test_aten_xla_tensor_5; 48s local 2024-12-18T01:12:39.2061209Z Testing //test/cpp:test_aten_xla_tensor_6; 48s local 2024-12-18T01:12:39.2061983Z Testing //test/cpp:test_aten_xla_tensor_3; 48s local 2024-12-18T01:12:39.2062737Z Testing //test/cpp:test_aten_xla_tensor_1; 48s local 2024-12-18T01:12:39.2063506Z Testing //test/cpp:test_aten_xla_tensor_2; 48s local 2024-12-18T01:12:40.2059266Z 2024-12-18T01:12:40.2060045Z  2024-12-18T01:12:40.2060504Z  2024-12-18T01:12:40.2060860Z  2024-12-18T01:12:40.2061243Z  2024-12-18T01:12:40.2061620Z  2024-12-18T01:12:40.2061994Z  2024-12-18T01:12:40.2062363Z  2024-12-18T01:12:40.2063246Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:40.2064225Z Testing //test/cpp:test_aten_xla_tensor_4; 49s local 2024-12-18T01:12:40.2064909Z Testing //test/cpp:test_tensor; 49s local 2024-12-18T01:12:40.2065577Z Testing //test/cpp:test_aten_xla_tensor_5; 49s local 2024-12-18T01:12:40.2074577Z Testing //test/cpp:test_aten_xla_tensor_6; 49s local 2024-12-18T01:12:40.2075392Z Testing //test/cpp:test_aten_xla_tensor_3; 49s local 2024-12-18T01:12:40.2076122Z Testing //test/cpp:test_aten_xla_tensor_1; 49s local 2024-12-18T01:12:40.2077088Z Testing //test/cpp:test_aten_xla_tensor_2; 49s local 2024-12-18T01:12:41.4067168Z 2024-12-18T01:12:41.4068197Z  2024-12-18T01:12:41.4068664Z  2024-12-18T01:12:41.4070288Z  2024-12-18T01:12:41.4070755Z  2024-12-18T01:12:41.4071156Z  2024-12-18T01:12:41.4071538Z  2024-12-18T01:12:41.4071938Z  2024-12-18T01:12:41.4073119Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:41.4074165Z Testing //test/cpp:test_aten_xla_tensor_4; 50s local 2024-12-18T01:12:41.4074899Z Testing //test/cpp:test_tensor; 50s local 2024-12-18T01:12:41.4075605Z Testing //test/cpp:test_aten_xla_tensor_5; 50s local 2024-12-18T01:12:41.4076386Z Testing //test/cpp:test_aten_xla_tensor_6; 50s local 2024-12-18T01:12:41.4077170Z Testing //test/cpp:test_aten_xla_tensor_3; 50s local 2024-12-18T01:12:41.4077949Z Testing //test/cpp:test_aten_xla_tensor_1; 50s local 2024-12-18T01:12:41.4078727Z Testing //test/cpp:test_aten_xla_tensor_2; 50s local 2024-12-18T01:12:42.4387983Z 2024-12-18T01:12:42.4389088Z  2024-12-18T01:12:42.4389539Z  2024-12-18T01:12:42.4389897Z  2024-12-18T01:12:42.4390290Z  2024-12-18T01:12:42.4390655Z  2024-12-18T01:12:42.4391200Z  2024-12-18T01:12:42.4391564Z  2024-12-18T01:12:42.4392428Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:42.4393469Z Testing //test/cpp:test_aten_xla_tensor_4; 51s local 2024-12-18T01:12:42.4394133Z Testing //test/cpp:test_tensor; 51s local 2024-12-18T01:12:42.4394790Z Testing //test/cpp:test_aten_xla_tensor_5; 51s local 2024-12-18T01:12:42.4395625Z Testing //test/cpp:test_aten_xla_tensor_6; 51s local 2024-12-18T01:12:42.4396335Z Testing //test/cpp:test_aten_xla_tensor_3; 51s local 2024-12-18T01:12:42.4397055Z Testing //test/cpp:test_aten_xla_tensor_1; 51s local 2024-12-18T01:12:42.4397846Z Testing //test/cpp:test_aten_xla_tensor_2; 51s local 2024-12-18T01:12:43.4395115Z 2024-12-18T01:12:43.4396386Z  2024-12-18T01:12:43.4396840Z  2024-12-18T01:12:43.4397224Z  2024-12-18T01:12:43.4397607Z  2024-12-18T01:12:43.4397986Z  2024-12-18T01:12:43.4398367Z  2024-12-18T01:12:43.4398727Z  2024-12-18T01:12:43.4399621Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:43.4400604Z Testing //test/cpp:test_aten_xla_tensor_4; 52s local 2024-12-18T01:12:43.4401285Z Testing //test/cpp:test_tensor; 52s local 2024-12-18T01:12:43.4401958Z Testing //test/cpp:test_aten_xla_tensor_5; 52s local 2024-12-18T01:12:43.4402740Z Testing //test/cpp:test_aten_xla_tensor_6; 52s local 2024-12-18T01:12:43.4403467Z Testing //test/cpp:test_aten_xla_tensor_3; 52s local 2024-12-18T01:12:43.4404184Z Testing //test/cpp:test_aten_xla_tensor_1; 52s local 2024-12-18T01:12:43.4404920Z Testing //test/cpp:test_aten_xla_tensor_2; 52s local 2024-12-18T01:12:44.4450580Z 2024-12-18T01:12:44.4451830Z  2024-12-18T01:12:44.4452279Z  2024-12-18T01:12:44.4452682Z  2024-12-18T01:12:44.4453068Z  2024-12-18T01:12:44.4453457Z  2024-12-18T01:12:44.4453839Z  2024-12-18T01:12:44.4454208Z  2024-12-18T01:12:44.4455113Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:44.4456114Z Testing //test/cpp:test_aten_xla_tensor_4; 53s local 2024-12-18T01:12:44.4456840Z Testing //test/cpp:test_tensor; 53s local 2024-12-18T01:12:44.4457514Z Testing //test/cpp:test_aten_xla_tensor_5; 53s local 2024-12-18T01:12:44.4458232Z Testing //test/cpp:test_aten_xla_tensor_6; 53s local 2024-12-18T01:12:44.4458956Z Testing //test/cpp:test_aten_xla_tensor_3; 53s local 2024-12-18T01:12:44.4459684Z Testing //test/cpp:test_aten_xla_tensor_1; 53s local 2024-12-18T01:12:44.4460672Z Testing //test/cpp:test_aten_xla_tensor_2; 53s local 2024-12-18T01:12:45.6408679Z 2024-12-18T01:12:45.6409817Z  2024-12-18T01:12:45.6410436Z  2024-12-18T01:12:45.6410945Z  2024-12-18T01:12:45.6411459Z  2024-12-18T01:12:45.6411988Z  2024-12-18T01:12:45.6412494Z  2024-12-18T01:12:45.6412995Z  2024-12-18T01:12:45.6414195Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:45.6415906Z Testing //test/cpp:test_aten_xla_tensor_4; 54s local 2024-12-18T01:12:45.6416898Z Testing //test/cpp:test_tensor; 54s local 2024-12-18T01:12:45.6417780Z Testing //test/cpp:test_aten_xla_tensor_5; 54s local 2024-12-18T01:12:45.6418736Z Testing //test/cpp:test_aten_xla_tensor_6; 54s local 2024-12-18T01:12:45.6419705Z Testing //test/cpp:test_aten_xla_tensor_3; 54s local 2024-12-18T01:12:45.6420678Z Testing //test/cpp:test_aten_xla_tensor_1; 54s local 2024-12-18T01:12:45.6421642Z Testing //test/cpp:test_aten_xla_tensor_2; 54s local 2024-12-18T01:12:46.8414726Z 2024-12-18T01:12:46.8415746Z  2024-12-18T01:12:46.8416242Z  2024-12-18T01:12:46.8416729Z  2024-12-18T01:12:46.8417128Z  2024-12-18T01:12:46.8417535Z  2024-12-18T01:12:46.8417945Z  2024-12-18T01:12:46.8418349Z  2024-12-18T01:12:46.8419328Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:46.8420485Z Testing //test/cpp:test_aten_xla_tensor_4; 56s local 2024-12-18T01:12:46.8421240Z Testing //test/cpp:test_tensor; 56s local 2024-12-18T01:12:46.8421983Z Testing //test/cpp:test_aten_xla_tensor_5; 56s local 2024-12-18T01:12:46.8422789Z Testing //test/cpp:test_aten_xla_tensor_6; 55s local 2024-12-18T01:12:46.8423588Z Testing //test/cpp:test_aten_xla_tensor_3; 55s local 2024-12-18T01:12:46.8424368Z Testing //test/cpp:test_aten_xla_tensor_1; 55s local 2024-12-18T01:12:46.8425171Z Testing //test/cpp:test_aten_xla_tensor_2; 55s local 2024-12-18T01:12:47.8422321Z 2024-12-18T01:12:47.8423130Z  2024-12-18T01:12:47.8423605Z  2024-12-18T01:12:47.8424028Z  2024-12-18T01:12:47.8424444Z  2024-12-18T01:12:47.8424842Z  2024-12-18T01:12:47.8425355Z  2024-12-18T01:12:47.8425756Z  2024-12-18T01:12:47.8426714Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:47.8427765Z Testing //test/cpp:test_aten_xla_tensor_4; 57s local 2024-12-18T01:12:47.8428506Z Testing //test/cpp:test_tensor; 57s local 2024-12-18T01:12:47.8429239Z Testing //test/cpp:test_aten_xla_tensor_5; 57s local 2024-12-18T01:12:47.8430008Z Testing //test/cpp:test_aten_xla_tensor_6; 56s local 2024-12-18T01:12:47.8430772Z Testing //test/cpp:test_aten_xla_tensor_3; 56s local 2024-12-18T01:12:47.8431540Z Testing //test/cpp:test_aten_xla_tensor_1; 56s local 2024-12-18T01:12:47.8432291Z Testing //test/cpp:test_aten_xla_tensor_2; 56s local 2024-12-18T01:12:48.8427910Z 2024-12-18T01:12:48.8428911Z  2024-12-18T01:12:48.8429357Z  2024-12-18T01:12:48.8429730Z  2024-12-18T01:12:48.8430494Z  2024-12-18T01:12:48.8430931Z  2024-12-18T01:12:48.8431527Z  2024-12-18T01:12:48.8432024Z  2024-12-18T01:12:48.8433239Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:48.8434585Z Testing //test/cpp:test_aten_xla_tensor_4; 58s local 2024-12-18T01:12:48.8435525Z Testing //test/cpp:test_tensor; 58s local 2024-12-18T01:12:48.8436436Z Testing //test/cpp:test_aten_xla_tensor_5; 58s local 2024-12-18T01:12:48.8437423Z Testing //test/cpp:test_aten_xla_tensor_6; 57s local 2024-12-18T01:12:48.8438329Z Testing //test/cpp:test_aten_xla_tensor_3; 57s local 2024-12-18T01:12:48.8439263Z Testing //test/cpp:test_aten_xla_tensor_1; 57s local 2024-12-18T01:12:48.8440336Z Testing //test/cpp:test_aten_xla_tensor_2; 57s local 2024-12-18T01:12:50.0435064Z 2024-12-18T01:12:50.0435902Z  2024-12-18T01:12:50.0436341Z  2024-12-18T01:12:50.0436759Z  2024-12-18T01:12:50.0437159Z  2024-12-18T01:12:50.0437551Z  2024-12-18T01:12:50.0437943Z  2024-12-18T01:12:50.0438312Z  2024-12-18T01:12:50.0439240Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:50.0440516Z Testing //test/cpp:test_aten_xla_tensor_4; 59s local 2024-12-18T01:12:50.0441240Z Testing //test/cpp:test_tensor; 59s local 2024-12-18T01:12:50.0441936Z Testing //test/cpp:test_aten_xla_tensor_5; 59s local 2024-12-18T01:12:50.0442695Z Testing //test/cpp:test_aten_xla_tensor_6; 59s local 2024-12-18T01:12:50.0443448Z Testing //test/cpp:test_aten_xla_tensor_3; 59s local 2024-12-18T01:12:50.0444356Z Testing //test/cpp:test_aten_xla_tensor_1; 58s local 2024-12-18T01:12:50.0445032Z Testing //test/cpp:test_aten_xla_tensor_2; 58s local 2024-12-18T01:12:51.0441482Z 2024-12-18T01:12:51.0442666Z  2024-12-18T01:12:51.0443136Z  2024-12-18T01:12:51.0443583Z  2024-12-18T01:12:51.0444016Z  2024-12-18T01:12:51.0444648Z  2024-12-18T01:12:51.0445043Z  2024-12-18T01:12:51.0445444Z  2024-12-18T01:12:51.0446406Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:51.0447622Z Testing //test/cpp:test_aten_xla_tensor_4; 60s local 2024-12-18T01:12:51.0448360Z Testing //test/cpp:test_tensor; 60s local 2024-12-18T01:12:51.0449068Z Testing //test/cpp:test_aten_xla_tensor_5; 60s local 2024-12-18T01:12:51.0449845Z Testing //test/cpp:test_aten_xla_tensor_6; 60s local 2024-12-18T01:12:51.0450625Z Testing //test/cpp:test_aten_xla_tensor_3; 60s local 2024-12-18T01:12:51.0451409Z Testing //test/cpp:test_aten_xla_tensor_1; 59s local 2024-12-18T01:12:51.0452196Z Testing //test/cpp:test_aten_xla_tensor_2; 59s local 2024-12-18T01:12:52.2448791Z 2024-12-18T01:12:52.2449958Z  2024-12-18T01:12:52.2450511Z  2024-12-18T01:12:52.2450961Z  2024-12-18T01:12:52.2451406Z  2024-12-18T01:12:52.2451842Z  2024-12-18T01:12:52.2452366Z  2024-12-18T01:12:52.2452764Z  2024-12-18T01:12:52.2453648Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:52.2454906Z Testing //test/cpp:test_aten_xla_tensor_4; 61s local 2024-12-18T01:12:52.2455726Z Testing //test/cpp:test_tensor; 61s local 2024-12-18T01:12:52.2456619Z Testing //test/cpp:test_aten_xla_tensor_5; 61s local 2024-12-18T01:12:52.2457495Z Testing //test/cpp:test_aten_xla_tensor_6; 61s local 2024-12-18T01:12:52.2458368Z Testing //test/cpp:test_aten_xla_tensor_3; 61s local 2024-12-18T01:12:52.2459258Z Testing //test/cpp:test_aten_xla_tensor_1; 61s local 2024-12-18T01:12:52.2460117Z Testing //test/cpp:test_aten_xla_tensor_2; 61s local 2024-12-18T01:12:53.4455409Z 2024-12-18T01:12:53.4456240Z  2024-12-18T01:12:53.4456807Z  2024-12-18T01:12:53.4457184Z  2024-12-18T01:12:53.4457573Z  2024-12-18T01:12:53.4457956Z  2024-12-18T01:12:53.4458338Z  2024-12-18T01:12:53.4458707Z  2024-12-18T01:12:53.4459611Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:53.4460604Z Testing //test/cpp:test_aten_xla_tensor_4; 62s local 2024-12-18T01:12:53.4461303Z Testing //test/cpp:test_tensor; 62s local 2024-12-18T01:12:53.4461982Z Testing //test/cpp:test_aten_xla_tensor_5; 62s local 2024-12-18T01:12:53.4462718Z Testing //test/cpp:test_aten_xla_tensor_6; 62s local 2024-12-18T01:12:53.4463444Z Testing //test/cpp:test_aten_xla_tensor_3; 62s local 2024-12-18T01:12:53.4464175Z Testing //test/cpp:test_aten_xla_tensor_1; 62s local 2024-12-18T01:12:53.4465177Z Testing //test/cpp:test_aten_xla_tensor_2; 62s local 2024-12-18T01:12:54.4461423Z 2024-12-18T01:12:54.4462235Z  2024-12-18T01:12:54.4462733Z  2024-12-18T01:12:54.4463291Z  2024-12-18T01:12:54.4463713Z  2024-12-18T01:12:54.4464112Z  2024-12-18T01:12:54.4464504Z  2024-12-18T01:12:54.4464884Z  2024-12-18T01:12:54.4465842Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:54.4467132Z Testing //test/cpp:test_aten_xla_tensor_4; 63s local 2024-12-18T01:12:54.4467872Z Testing //test/cpp:test_tensor; 63s local 2024-12-18T01:12:54.4469309Z Testing //test/cpp:test_aten_xla_tensor_5; 63s local 2024-12-18T01:12:54.4470301Z Testing //test/cpp:test_aten_xla_tensor_6; 63s local 2024-12-18T01:12:54.4471283Z Testing //test/cpp:test_aten_xla_tensor_3; 63s local 2024-12-18T01:12:54.4472268Z Testing //test/cpp:test_aten_xla_tensor_1; 63s local 2024-12-18T01:12:54.4473272Z Testing //test/cpp:test_aten_xla_tensor_2; 63s local 2024-12-18T01:12:55.6467740Z 2024-12-18T01:12:55.6468568Z  2024-12-18T01:12:55.6469312Z  2024-12-18T01:12:55.6470054Z  2024-12-18T01:12:55.6470526Z  2024-12-18T01:12:55.6470951Z  2024-12-18T01:12:55.6471451Z  2024-12-18T01:12:55.6471951Z  2024-12-18T01:12:55.6472980Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:55.6474100Z Testing //test/cpp:test_aten_xla_tensor_4; 64s local 2024-12-18T01:12:55.6475133Z Testing //test/cpp:test_tensor; 64s local 2024-12-18T01:12:55.6476194Z Testing //test/cpp:test_aten_xla_tensor_5; 64s local 2024-12-18T01:12:55.6477101Z Testing //test/cpp:test_aten_xla_tensor_6; 64s local 2024-12-18T01:12:55.6478028Z Testing //test/cpp:test_aten_xla_tensor_3; 64s local 2024-12-18T01:12:55.6479085Z Testing //test/cpp:test_aten_xla_tensor_1; 64s local 2024-12-18T01:12:55.6479904Z Testing //test/cpp:test_aten_xla_tensor_2; 64s local 2024-12-18T01:12:56.6473132Z 2024-12-18T01:12:56.6473918Z  2024-12-18T01:12:56.6474398Z  2024-12-18T01:12:56.6474810Z  2024-12-18T01:12:56.6475217Z  2024-12-18T01:12:56.6475624Z  2024-12-18T01:12:56.6476007Z  2024-12-18T01:12:56.6476418Z  2024-12-18T01:12:56.6477373Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:56.6478427Z Testing //test/cpp:test_aten_xla_tensor_4; 65s local 2024-12-18T01:12:56.6479169Z Testing //test/cpp:test_tensor; 65s local 2024-12-18T01:12:56.6479876Z Testing //test/cpp:test_aten_xla_tensor_5; 65s local 2024-12-18T01:12:56.6480653Z Testing //test/cpp:test_aten_xla_tensor_6; 65s local 2024-12-18T01:12:56.6481432Z Testing //test/cpp:test_aten_xla_tensor_3; 65s local 2024-12-18T01:12:56.6482214Z Testing //test/cpp:test_aten_xla_tensor_1; 65s local 2024-12-18T01:12:56.6482996Z Testing //test/cpp:test_aten_xla_tensor_2; 65s local 2024-12-18T01:12:57.6479449Z 2024-12-18T01:12:57.6480231Z  2024-12-18T01:12:57.6480703Z  2024-12-18T01:12:57.6481090Z  2024-12-18T01:12:57.6481452Z  2024-12-18T01:12:57.6481850Z  2024-12-18T01:12:57.6482222Z  2024-12-18T01:12:57.6482593Z  2024-12-18T01:12:57.6483494Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:57.6484466Z Testing //test/cpp:test_aten_xla_tensor_4; 66s local 2024-12-18T01:12:57.6485155Z Testing //test/cpp:test_tensor; 66s local 2024-12-18T01:12:57.6485832Z Testing //test/cpp:test_aten_xla_tensor_5; 66s local 2024-12-18T01:12:57.6486563Z Testing //test/cpp:test_aten_xla_tensor_6; 66s local 2024-12-18T01:12:57.6487296Z Testing //test/cpp:test_aten_xla_tensor_3; 66s local 2024-12-18T01:12:57.6488019Z Testing //test/cpp:test_aten_xla_tensor_1; 66s local 2024-12-18T01:12:57.6488972Z Testing //test/cpp:test_aten_xla_tensor_2; 66s local 2024-12-18T01:12:58.8486875Z 2024-12-18T01:12:58.8487799Z  2024-12-18T01:12:58.8488345Z  2024-12-18T01:12:58.8488773Z  2024-12-18T01:12:58.8489219Z  2024-12-18T01:12:58.8489639Z  2024-12-18T01:12:58.8490065Z  2024-12-18T01:12:58.8490495Z  2024-12-18T01:12:58.8491527Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:58.8492908Z Testing //test/cpp:test_aten_xla_tensor_4; 68s local 2024-12-18T01:12:58.8493841Z Testing //test/cpp:test_tensor; 68s local 2024-12-18T01:12:58.8494664Z Testing //test/cpp:test_aten_xla_tensor_5; 68s local 2024-12-18T01:12:58.8495502Z Testing //test/cpp:test_aten_xla_tensor_6; 67s local 2024-12-18T01:12:58.8496337Z Testing //test/cpp:test_aten_xla_tensor_3; 67s local 2024-12-18T01:12:58.8497250Z Testing //test/cpp:test_aten_xla_tensor_1; 67s local 2024-12-18T01:12:58.8498106Z Testing //test/cpp:test_aten_xla_tensor_2; 67s local 2024-12-18T01:12:59.8493332Z 2024-12-18T01:12:59.8494322Z  2024-12-18T01:12:59.8495355Z  2024-12-18T01:12:59.8495877Z  2024-12-18T01:12:59.8496414Z  2024-12-18T01:12:59.8497010Z  2024-12-18T01:12:59.8497498Z  2024-12-18T01:12:59.8498011Z  2024-12-18T01:12:59.8499225Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:12:59.8500571Z Testing //test/cpp:test_aten_xla_tensor_4; 69s local 2024-12-18T01:12:59.8501684Z Testing //test/cpp:test_tensor; 69s local 2024-12-18T01:12:59.8502678Z Testing //test/cpp:test_aten_xla_tensor_5; 69s local 2024-12-18T01:12:59.8503573Z Testing //test/cpp:test_aten_xla_tensor_6; 68s local 2024-12-18T01:12:59.8504450Z Testing //test/cpp:test_aten_xla_tensor_3; 68s local 2024-12-18T01:12:59.8505318Z Testing //test/cpp:test_aten_xla_tensor_1; 68s local 2024-12-18T01:12:59.8506196Z Testing //test/cpp:test_aten_xla_tensor_2; 68s local 2024-12-18T01:13:00.8498684Z 2024-12-18T01:13:00.8499463Z  2024-12-18T01:13:00.8499922Z  2024-12-18T01:13:00.8500281Z  2024-12-18T01:13:00.8500652Z  2024-12-18T01:13:00.8501062Z  2024-12-18T01:13:00.8501432Z  2024-12-18T01:13:00.8501782Z  2024-12-18T01:13:00.8502663Z [20,609 / 20,616] 10 / 17 tests; 7 actions running; last test: ..._replication 2024-12-18T01:13:00.8503630Z Testing //test/cpp:test_aten_xla_tensor_4; 70s local 2024-12-18T01:13:00.8504305Z Testing //test/cpp:test_tensor; 70s local 2024-12-18T01:13:00.8504957Z Testing //test/cpp:test_aten_xla_tensor_5; 70s local 2024-12-18T01:13:00.8505663Z Testing //test/cpp:test_aten_xla_tensor_6; 69s local 2024-12-18T01:13:00.8506350Z Testing //test/cpp:test_aten_xla_tensor_3; 69s local 2024-12-18T01:13:00.8507058Z Testing //test/cpp:test_aten_xla_tensor_1; 69s local 2024-12-18T01:13:00.8507766Z Testing //test/cpp:test_aten_xla_tensor_2; 69s local 2024-12-18T01:13:01.5478687Z 2024-12-18T01:13:01.5479548Z  2024-12-18T01:13:01.5480000Z  2024-12-18T01:13:01.5480372Z  2024-12-18T01:13:01.5480750Z  2024-12-18T01:13:01.5481122Z  2024-12-18T01:13:01.5481477Z  2024-12-18T01:13:01.5482018Z  2024-12-18T01:13:01.5482892Z [20,609 / 20,616] 11 / 17 tests; 7 actions running; last test: ...xla_tensor_5 2024-12-18T01:13:01.5483850Z Testing //test/cpp:test_aten_xla_tensor_4; 70s local 2024-12-18T01:13:01.5484523Z Testing //test/cpp:test_tensor; 70s local 2024-12-18T01:13:01.5485173Z Testing //test/cpp:test_aten_xla_tensor_5; 70s local 2024-12-18T01:13:01.5485883Z Testing //test/cpp:test_aten_xla_tensor_6; 70s local 2024-12-18T01:13:01.5486596Z Testing //test/cpp:test_aten_xla_tensor_3; 70s local 2024-12-18T01:13:01.5487336Z Testing //test/cpp:test_aten_xla_tensor_1; 70s local 2024-12-18T01:13:01.5488074Z Testing //test/cpp:test_aten_xla_tensor_2; 70s local 2024-12-18T01:13:01.8505091Z 2024-12-18T01:13:01.8505960Z  2024-12-18T01:13:01.8506581Z  2024-12-18T01:13:01.8507080Z  2024-12-18T01:13:01.8507613Z  2024-12-18T01:13:01.8508116Z  2024-12-18T01:13:01.8508627Z  2024-12-18T01:13:01.8509129Z  2024-12-18T01:13:01.8510313Z [20,610 / 20,616] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_5 2024-12-18T01:13:01.8511722Z Testing //test/cpp:test_aten_xla_tensor_4; 71s local 2024-12-18T01:13:01.8512464Z Testing //test/cpp:test_tensor; 71s local 2024-12-18T01:13:01.8513184Z Testing //test/cpp:test_aten_xla_tensor_6; 70s local 2024-12-18T01:13:01.8513962Z Testing //test/cpp:test_aten_xla_tensor_3; 70s local 2024-12-18T01:13:01.8514885Z Testing //test/cpp:test_aten_xla_tensor_1; 70s local 2024-12-18T01:13:01.8515648Z Testing //test/cpp:test_aten_xla_tensor_2; 70s local 2024-12-18T01:13:02.8511964Z 2024-12-18T01:13:02.8512763Z  2024-12-18T01:13:02.8513238Z  2024-12-18T01:13:02.8513621Z  2024-12-18T01:13:02.8514013Z  2024-12-18T01:13:02.8514735Z  2024-12-18T01:13:02.8515120Z  2024-12-18T01:13:02.8516020Z [20,610 / 20,616] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_5 2024-12-18T01:13:02.8517009Z Testing //test/cpp:test_aten_xla_tensor_4; 72s local 2024-12-18T01:13:02.8517714Z Testing //test/cpp:test_tensor; 72s local 2024-12-18T01:13:02.8518487Z Testing //test/cpp:test_aten_xla_tensor_6; 71s local 2024-12-18T01:13:02.8519232Z Testing //test/cpp:test_aten_xla_tensor_3; 71s local 2024-12-18T01:13:02.8520144Z Testing //test/cpp:test_aten_xla_tensor_1; 71s local 2024-12-18T01:13:02.8521372Z Testing //test/cpp:test_aten_xla_tensor_2; 71s local 2024-12-18T01:13:03.8517128Z 2024-12-18T01:13:03.8517936Z  2024-12-18T01:13:03.8518558Z  2024-12-18T01:13:03.8518958Z  2024-12-18T01:13:03.8519376Z  2024-12-18T01:13:03.8519775Z  2024-12-18T01:13:03.8520164Z  2024-12-18T01:13:03.8521093Z [20,610 / 20,616] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_5 2024-12-18T01:13:03.8522600Z Testing //test/cpp:test_aten_xla_tensor_4; 73s local 2024-12-18T01:13:03.8523535Z Testing //test/cpp:test_tensor; 73s local 2024-12-18T01:13:03.8524458Z Testing //test/cpp:test_aten_xla_tensor_6; 72s local 2024-12-18T01:13:03.8525459Z Testing //test/cpp:test_aten_xla_tensor_3; 72s local 2024-12-18T01:13:03.8526457Z Testing //test/cpp:test_aten_xla_tensor_1; 72s local 2024-12-18T01:13:03.8527420Z Testing //test/cpp:test_aten_xla_tensor_2; 72s local 2024-12-18T01:13:05.0523676Z 2024-12-18T01:13:05.0524461Z  2024-12-18T01:13:05.0524904Z  2024-12-18T01:13:05.0525297Z  2024-12-18T01:13:05.0525754Z  2024-12-18T01:13:05.0526150Z  2024-12-18T01:13:05.0526531Z  2024-12-18T01:13:05.0527418Z [20,610 / 20,616] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_5 2024-12-18T01:13:05.0528447Z Testing //test/cpp:test_aten_xla_tensor_4; 74s local 2024-12-18T01:13:05.0529166Z Testing //test/cpp:test_tensor; 74s local 2024-12-18T01:13:05.0530179Z Testing //test/cpp:test_aten_xla_tensor_6; 74s local 2024-12-18T01:13:05.0531147Z Testing //test/cpp:test_aten_xla_tensor_3; 74s local 2024-12-18T01:13:05.0532124Z Testing //test/cpp:test_aten_xla_tensor_1; 73s local 2024-12-18T01:13:05.0533096Z Testing //test/cpp:test_aten_xla_tensor_2; 73s local 2024-12-18T01:13:06.0949656Z 2024-12-18T01:13:06.0950457Z  2024-12-18T01:13:06.0950919Z  2024-12-18T01:13:06.0951304Z  2024-12-18T01:13:06.0951714Z  2024-12-18T01:13:06.0952178Z  2024-12-18T01:13:06.0952564Z  2024-12-18T01:13:06.0953601Z [20,610 / 20,616] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_5 2024-12-18T01:13:06.0954822Z Testing //test/cpp:test_aten_xla_tensor_4; 75s local 2024-12-18T01:13:06.0955507Z Testing //test/cpp:test_tensor; 75s local 2024-12-18T01:13:06.0956189Z Testing //test/cpp:test_aten_xla_tensor_6; 75s local 2024-12-18T01:13:06.0956922Z Testing //test/cpp:test_aten_xla_tensor_3; 75s local 2024-12-18T01:13:06.0957647Z Testing //test/cpp:test_aten_xla_tensor_1; 74s local 2024-12-18T01:13:06.0958453Z Testing //test/cpp:test_aten_xla_tensor_2; 74s local 2024-12-18T01:13:06.5289638Z 2024-12-18T01:13:06.5290433Z  2024-12-18T01:13:06.5290878Z  2024-12-18T01:13:06.5291324Z  2024-12-18T01:13:06.5291704Z  2024-12-18T01:13:06.5292095Z  2024-12-18T01:13:06.5292459Z  2024-12-18T01:13:06.5293347Z [20,610 / 20,616] 12 / 17 tests; 6 actions running; last test: ...xla_tensor_4 2024-12-18T01:13:06.5294315Z Testing //test/cpp:test_aten_xla_tensor_4; 75s local 2024-12-18T01:13:06.5295000Z Testing //test/cpp:test_tensor; 75s local 2024-12-18T01:13:06.5295690Z Testing //test/cpp:test_aten_xla_tensor_6; 75s local 2024-12-18T01:13:06.5296682Z Testing //test/cpp:test_aten_xla_tensor_3; 75s local 2024-12-18T01:13:06.5297419Z Testing //test/cpp:test_aten_xla_tensor_1; 75s local 2024-12-18T01:13:06.5298147Z Testing //test/cpp:test_aten_xla_tensor_2; 75s local 2024-12-18T01:13:06.8536815Z 2024-12-18T01:13:06.8537793Z  2024-12-18T01:13:06.8538489Z  2024-12-18T01:13:06.8539036Z  2024-12-18T01:13:06.8539549Z  2024-12-18T01:13:06.8540107Z  2024-12-18T01:13:06.8540974Z  2024-12-18T01:13:06.8542364Z [20,611 / 20,616] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_4 2024-12-18T01:13:06.8543652Z Testing //test/cpp:test_tensor; 76s local 2024-12-18T01:13:06.8544726Z Testing //test/cpp:test_aten_xla_tensor_6; 75s local 2024-12-18T01:13:06.8545750Z Testing //test/cpp:test_aten_xla_tensor_3; 75s local 2024-12-18T01:13:06.8546809Z Testing //test/cpp:test_aten_xla_tensor_1; 75s local 2024-12-18T01:13:06.8547832Z Testing //test/cpp:test_aten_xla_tensor_2; 75s local 2024-12-18T01:13:07.8541250Z 2024-12-18T01:13:07.8542043Z  2024-12-18T01:13:07.8542496Z  2024-12-18T01:13:07.8542893Z  2024-12-18T01:13:07.8543284Z  2024-12-18T01:13:07.8543656Z  2024-12-18T01:13:07.8544710Z [20,611 / 20,616] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_4 2024-12-18T01:13:07.8545675Z Testing //test/cpp:test_tensor; 77s local 2024-12-18T01:13:07.8546386Z Testing //test/cpp:test_aten_xla_tensor_6; 76s local 2024-12-18T01:13:07.8547146Z Testing //test/cpp:test_aten_xla_tensor_3; 76s local 2024-12-18T01:13:07.8547887Z Testing //test/cpp:test_aten_xla_tensor_1; 76s local 2024-12-18T01:13:07.8548641Z Testing //test/cpp:test_aten_xla_tensor_2; 76s local 2024-12-18T01:13:08.8547595Z 2024-12-18T01:13:08.8548430Z  2024-12-18T01:13:08.8548934Z  2024-12-18T01:13:08.8549405Z  2024-12-18T01:13:08.8549957Z  2024-12-18T01:13:08.8550350Z  2024-12-18T01:13:08.8551297Z [20,611 / 20,616] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_4 2024-12-18T01:13:08.8552283Z Testing //test/cpp:test_tensor; 78s local 2024-12-18T01:13:08.8552999Z Testing //test/cpp:test_aten_xla_tensor_6; 77s local 2024-12-18T01:13:08.8553783Z Testing //test/cpp:test_aten_xla_tensor_3; 77s local 2024-12-18T01:13:08.8554547Z Testing //test/cpp:test_aten_xla_tensor_1; 77s local 2024-12-18T01:13:08.8555322Z Testing //test/cpp:test_aten_xla_tensor_2; 77s local 2024-12-18T01:13:09.8627687Z 2024-12-18T01:13:09.8628514Z  2024-12-18T01:13:09.8628980Z  2024-12-18T01:13:09.8629366Z  2024-12-18T01:13:09.8629766Z  2024-12-18T01:13:09.8630181Z  2024-12-18T01:13:09.8631132Z [20,611 / 20,616] 13 / 17 tests; 5 actions running; last test: ...xla_tensor_3 2024-12-18T01:13:09.8632338Z Testing //test/cpp:test_tensor; 79s local 2024-12-18T01:13:09.8632981Z Testing //test/cpp:test_aten_xla_tensor_6; 78s local 2024-12-18T01:13:09.8633804Z Testing //test/cpp:test_aten_xla_tensor_3; 78s local 2024-12-18T01:13:09.8634670Z Testing //test/cpp:test_aten_xla_tensor_1; 78s local 2024-12-18T01:13:09.8635534Z Testing //test/cpp:test_aten_xla_tensor_2; 78s local 2024-12-18T01:13:10.2554631Z 2024-12-18T01:13:10.2555388Z  2024-12-18T01:13:10.2555835Z  2024-12-18T01:13:10.2556242Z  2024-12-18T01:13:10.2556647Z  2024-12-18T01:13:10.2557016Z  2024-12-18T01:13:10.2557916Z [20,612 / 20,616] 13 / 17 tests; 4 actions running; last test: ...xla_tensor_3 2024-12-18T01:13:10.2558838Z Testing //test/cpp:test_tensor; 79s local 2024-12-18T01:13:10.2559532Z Testing //test/cpp:test_aten_xla_tensor_6; 79s local 2024-12-18T01:13:10.2560270Z Testing //test/cpp:test_aten_xla_tensor_1; 79s local 2024-12-18T01:13:10.2560997Z Testing //test/cpp:test_aten_xla_tensor_2; 79s local 2024-12-18T01:13:11.2561445Z 2024-12-18T01:13:11.2565445Z  2024-12-18T01:13:11.2566264Z  2024-12-18T01:13:11.2566780Z  2024-12-18T01:13:11.2567269Z  2024-12-18T01:13:11.2568487Z [20,612 / 20,616] 13 / 17 tests; 4 actions running; last test: ...xla_tensor_3 2024-12-18T01:13:11.2569725Z Testing //test/cpp:test_tensor; 80s local 2024-12-18T01:13:11.2570645Z Testing //test/cpp:test_aten_xla_tensor_6; 80s local 2024-12-18T01:13:11.2571769Z Testing //test/cpp:test_aten_xla_tensor_1; 80s local 2024-12-18T01:13:11.2572753Z Testing //test/cpp:test_aten_xla_tensor_2; 80s local 2024-12-18T01:13:11.6565559Z 2024-12-18T01:13:11.6566248Z  2024-12-18T01:13:11.6566792Z  2024-12-18T01:13:11.6567327Z  2024-12-18T01:13:11.6567817Z  2024-12-18T01:13:11.6568946Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:11.6570141Z Testing //test/cpp:test_tensor; 80s local 2024-12-18T01:13:11.6571022Z Testing //test/cpp:test_aten_xla_tensor_6; 80s local 2024-12-18T01:13:11.6571958Z Testing //test/cpp:test_aten_xla_tensor_1; 80s local 2024-12-18T01:13:12.6655213Z 2024-12-18T01:13:12.6656037Z  2024-12-18T01:13:12.6656702Z  2024-12-18T01:13:12.6657206Z  2024-12-18T01:13:12.6658439Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:12.6659716Z Testing //test/cpp:test_tensor; 81s local 2024-12-18T01:13:12.6660688Z Testing //test/cpp:test_aten_xla_tensor_6; 81s local 2024-12-18T01:13:12.6661451Z Testing //test/cpp:test_aten_xla_tensor_1; 81s local 2024-12-18T01:13:13.6660903Z 2024-12-18T01:13:13.6661701Z  2024-12-18T01:13:13.6662179Z  2024-12-18T01:13:13.6662654Z  2024-12-18T01:13:13.6663643Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:13.6664722Z Testing //test/cpp:test_tensor; 82s local 2024-12-18T01:13:13.6665702Z Testing //test/cpp:test_aten_xla_tensor_6; 82s local 2024-12-18T01:13:13.6666695Z Testing //test/cpp:test_aten_xla_tensor_1; 82s local 2024-12-18T01:13:14.8666377Z 2024-12-18T01:13:14.8667158Z  2024-12-18T01:13:14.8667590Z  2024-12-18T01:13:14.8667998Z  2024-12-18T01:13:14.8668871Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:14.8669778Z Testing //test/cpp:test_tensor; 84s local 2024-12-18T01:13:14.8670427Z Testing //test/cpp:test_aten_xla_tensor_6; 83s local 2024-12-18T01:13:14.8671140Z Testing //test/cpp:test_aten_xla_tensor_1; 83s local 2024-12-18T01:13:15.8673510Z 2024-12-18T01:13:15.8674362Z  2024-12-18T01:13:15.8674996Z  2024-12-18T01:13:15.8675474Z  2024-12-18T01:13:15.8676458Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:15.8677699Z Testing //test/cpp:test_tensor; 85s local 2024-12-18T01:13:15.8678456Z Testing //test/cpp:test_aten_xla_tensor_6; 84s local 2024-12-18T01:13:15.8679256Z Testing //test/cpp:test_aten_xla_tensor_1; 84s local 2024-12-18T01:13:16.8678494Z 2024-12-18T01:13:16.8679261Z  2024-12-18T01:13:16.8680191Z  2024-12-18T01:13:16.8680696Z  2024-12-18T01:13:16.8681677Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:16.8682635Z Testing //test/cpp:test_tensor; 86s local 2024-12-18T01:13:16.8683390Z Testing //test/cpp:test_aten_xla_tensor_6; 85s local 2024-12-18T01:13:16.8684192Z Testing //test/cpp:test_aten_xla_tensor_1; 85s local 2024-12-18T01:13:18.0684896Z 2024-12-18T01:13:18.0685669Z  2024-12-18T01:13:18.0686140Z  2024-12-18T01:13:18.0686538Z  2024-12-18T01:13:18.0687627Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:18.0688777Z Testing //test/cpp:test_tensor; 87s local 2024-12-18T01:13:18.0689469Z Testing //test/cpp:test_aten_xla_tensor_6; 87s local 2024-12-18T01:13:18.0690211Z Testing //test/cpp:test_aten_xla_tensor_1; 86s local 2024-12-18T01:13:19.0691584Z 2024-12-18T01:13:19.0692428Z  2024-12-18T01:13:19.0692905Z  2024-12-18T01:13:19.0693328Z  2024-12-18T01:13:19.0694531Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:19.0695535Z Testing //test/cpp:test_tensor; 88s local 2024-12-18T01:13:19.0696279Z Testing //test/cpp:test_aten_xla_tensor_6; 88s local 2024-12-18T01:13:19.0697136Z Testing //test/cpp:test_aten_xla_tensor_1; 87s local 2024-12-18T01:13:20.2698131Z 2024-12-18T01:13:20.2699319Z  2024-12-18T01:13:20.2700025Z  2024-12-18T01:13:20.2700657Z  2024-12-18T01:13:20.2702169Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:20.2703458Z Testing //test/cpp:test_tensor; 89s local 2024-12-18T01:13:20.2704351Z Testing //test/cpp:test_aten_xla_tensor_6; 89s local 2024-12-18T01:13:20.2705132Z Testing //test/cpp:test_aten_xla_tensor_1; 89s local 2024-12-18T01:13:21.4705001Z 2024-12-18T01:13:21.4706734Z  2024-12-18T01:13:21.4707182Z  2024-12-18T01:13:21.4707555Z  2024-12-18T01:13:21.4708492Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:21.4709419Z Testing //test/cpp:test_tensor; 90s local 2024-12-18T01:13:21.4710104Z Testing //test/cpp:test_aten_xla_tensor_6; 90s local 2024-12-18T01:13:21.4710845Z Testing //test/cpp:test_aten_xla_tensor_1; 90s local 2024-12-18T01:13:22.4709985Z 2024-12-18T01:13:22.4710960Z  2024-12-18T01:13:22.4711633Z  2024-12-18T01:13:22.4712263Z  2024-12-18T01:13:22.4713603Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:22.4715003Z Testing //test/cpp:test_tensor; 91s local 2024-12-18T01:13:22.4716070Z Testing //test/cpp:test_aten_xla_tensor_6; 91s local 2024-12-18T01:13:22.4716920Z Testing //test/cpp:test_aten_xla_tensor_1; 91s local 2024-12-18T01:13:22.9075187Z 2024-12-18T01:13:22.9075951Z  2024-12-18T01:13:22.9076392Z  2024-12-18T01:13:22.9076932Z  2024-12-18T01:13:22.9077971Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:22.9079007Z Testing //test/cpp:test_tensor; 92s local 2024-12-18T01:13:22.9079824Z Testing //test/cpp:test_aten_xla_tensor_6; 91s local 2024-12-18T01:13:22.9080702Z Testing //test/cpp:test_aten_xla_tensor_1; 91s local 2024-12-18T01:13:24.0719121Z 2024-12-18T01:13:24.0720306Z  2024-12-18T01:13:24.0720830Z  2024-12-18T01:13:24.0721361Z  2024-12-18T01:13:24.0722712Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:24.0724144Z Testing //test/cpp:test_tensor; 93s local 2024-12-18T01:13:24.0725152Z Testing //test/cpp:test_aten_xla_tensor_6; 93s local 2024-12-18T01:13:24.0726386Z Testing //test/cpp:test_aten_xla_tensor_1; 92s local 2024-12-18T01:13:25.2727354Z 2024-12-18T01:13:25.2728399Z  2024-12-18T01:13:25.2728715Z  2024-12-18T01:13:25.2728985Z  2024-12-18T01:13:25.2729540Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:25.2730076Z Testing //test/cpp:test_tensor; 94s local 2024-12-18T01:13:25.2730490Z Testing //test/cpp:test_aten_xla_tensor_6; 94s local 2024-12-18T01:13:25.2730913Z Testing //test/cpp:test_aten_xla_tensor_1; 94s local 2024-12-18T01:13:26.2730766Z 2024-12-18T01:13:26.2731877Z  2024-12-18T01:13:26.2732500Z  2024-12-18T01:13:26.2733040Z  2024-12-18T01:13:26.2734633Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:26.2735869Z Testing //test/cpp:test_tensor; 95s local 2024-12-18T01:13:26.2736885Z Testing //test/cpp:test_aten_xla_tensor_6; 95s local 2024-12-18T01:13:26.2737895Z Testing //test/cpp:test_aten_xla_tensor_1; 95s local 2024-12-18T01:13:27.4736907Z 2024-12-18T01:13:27.4737927Z  2024-12-18T01:13:27.4738695Z  2024-12-18T01:13:27.4739148Z  2024-12-18T01:13:27.4740210Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:27.4741282Z Testing //test/cpp:test_tensor; 96s local 2024-12-18T01:13:27.4742090Z Testing //test/cpp:test_aten_xla_tensor_6; 96s local 2024-12-18T01:13:27.4743023Z Testing //test/cpp:test_aten_xla_tensor_1; 96s local 2024-12-18T01:13:28.4743282Z 2024-12-18T01:13:28.4744132Z  2024-12-18T01:13:28.4744741Z  2024-12-18T01:13:28.4745173Z  2024-12-18T01:13:28.4746125Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:28.4747103Z Testing //test/cpp:test_tensor; 97s local 2024-12-18T01:13:28.4747826Z Testing //test/cpp:test_aten_xla_tensor_6; 97s local 2024-12-18T01:13:28.4748616Z Testing //test/cpp:test_aten_xla_tensor_1; 97s local 2024-12-18T01:13:29.4750395Z 2024-12-18T01:13:29.4751238Z  2024-12-18T01:13:29.4751811Z  2024-12-18T01:13:29.4752305Z  2024-12-18T01:13:29.4753216Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:29.4754154Z Testing //test/cpp:test_tensor; 98s local 2024-12-18T01:13:29.4754830Z Testing //test/cpp:test_aten_xla_tensor_6; 98s local 2024-12-18T01:13:29.4755622Z Testing //test/cpp:test_aten_xla_tensor_1; 98s local 2024-12-18T01:13:30.6757834Z 2024-12-18T01:13:30.6758858Z  2024-12-18T01:13:30.6759504Z  2024-12-18T01:13:30.6760032Z  2024-12-18T01:13:30.6761266Z [20,613 / 20,616] 14 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2024-12-18T01:13:30.6762496Z Testing //test/cpp:test_tensor; 99s local 2024-12-18T01:13:30.6763415Z Testing //test/cpp:test_aten_xla_tensor_6; 99s local 2024-12-18T01:13:30.6764399Z Testing //test/cpp:test_aten_xla_tensor_1; 99s local 2024-12-18T01:13:31.3893455Z 2024-12-18T01:13:31.3894621Z  2024-12-18T01:13:31.3895367Z  2024-12-18T01:13:31.3896010Z  2024-12-18T01:13:31.3897559Z [20,613 / 20,616] 15 / 17 tests; 3 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:31.3898803Z Testing //test/cpp:test_tensor; 100s local 2024-12-18T01:13:31.3899731Z Testing //test/cpp:test_aten_xla_tensor_6; 100s local 2024-12-18T01:13:31.3900988Z Testing //test/cpp:test_aten_xla_tensor_1; 100s local 2024-12-18T01:13:31.6762398Z 2024-12-18T01:13:31.6763187Z  2024-12-18T01:13:31.6763737Z  2024-12-18T01:13:31.6764228Z  2024-12-18T01:13:31.6765425Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:31.6766665Z Testing //test/cpp:test_tensor; 100s local 2024-12-18T01:13:31.6767821Z Testing //test/cpp:test_aten_xla_tensor_6; 100s local 2024-12-18T01:13:32.6767954Z 2024-12-18T01:13:32.6768847Z  2024-12-18T01:13:32.6769429Z  2024-12-18T01:13:32.6770661Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:32.6771944Z Testing //test/cpp:test_tensor; 101s local 2024-12-18T01:13:32.6772909Z Testing //test/cpp:test_aten_xla_tensor_6; 101s local 2024-12-18T01:13:33.7252772Z 2024-12-18T01:13:33.7253597Z  2024-12-18T01:13:33.7254096Z  2024-12-18T01:13:33.7255305Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:33.7256288Z Testing //test/cpp:test_tensor; 102s local 2024-12-18T01:13:33.7257085Z Testing //test/cpp:test_aten_xla_tensor_6; 102s local 2024-12-18T01:13:34.7257123Z 2024-12-18T01:13:34.7257894Z  2024-12-18T01:13:34.7258372Z  2024-12-18T01:13:34.7259293Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:34.7260504Z Testing //test/cpp:test_tensor; 103s local 2024-12-18T01:13:34.7261235Z Testing //test/cpp:test_aten_xla_tensor_6; 103s local 2024-12-18T01:13:35.9264685Z 2024-12-18T01:13:35.9265569Z  2024-12-18T01:13:35.9266020Z  2024-12-18T01:13:35.9266943Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:35.9267876Z Testing //test/cpp:test_tensor; 105s local 2024-12-18T01:13:35.9268607Z Testing //test/cpp:test_aten_xla_tensor_6; 104s local 2024-12-18T01:13:36.9268604Z 2024-12-18T01:13:36.9269381Z  2024-12-18T01:13:36.9269905Z  2024-12-18T01:13:36.9271098Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:36.9272360Z Testing //test/cpp:test_tensor; 106s local 2024-12-18T01:13:36.9273321Z Testing //test/cpp:test_aten_xla_tensor_6; 105s local 2024-12-18T01:13:38.1274388Z 2024-12-18T01:13:38.1275167Z  2024-12-18T01:13:38.1275607Z  2024-12-18T01:13:38.1276498Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:38.1277395Z Testing //test/cpp:test_tensor; 107s local 2024-12-18T01:13:38.1278071Z Testing //test/cpp:test_aten_xla_tensor_6; 107s local 2024-12-18T01:13:39.1280282Z 2024-12-18T01:13:39.1281079Z  2024-12-18T01:13:39.1281583Z  2024-12-18T01:13:39.1282563Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:39.1283577Z Testing //test/cpp:test_tensor; 108s local 2024-12-18T01:13:39.1284329Z Testing //test/cpp:test_aten_xla_tensor_6; 108s local 2024-12-18T01:13:40.3287857Z 2024-12-18T01:13:40.3288567Z  2024-12-18T01:13:40.3289009Z  2024-12-18T01:13:40.3289939Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:40.3291029Z Testing //test/cpp:test_tensor; 109s local 2024-12-18T01:13:40.3291722Z Testing //test/cpp:test_aten_xla_tensor_6; 109s local 2024-12-18T01:13:41.5292879Z 2024-12-18T01:13:41.5293683Z  2024-12-18T01:13:41.5294097Z  2024-12-18T01:13:41.5294980Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:41.5295870Z Testing //test/cpp:test_tensor; 110s local 2024-12-18T01:13:41.5296889Z Testing //test/cpp:test_aten_xla_tensor_6; 110s local 2024-12-18T01:13:42.5298205Z 2024-12-18T01:13:42.5298947Z  2024-12-18T01:13:42.5299390Z  2024-12-18T01:13:42.5300369Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:42.5301303Z Testing //test/cpp:test_tensor; 111s local 2024-12-18T01:13:42.5302218Z Testing //test/cpp:test_aten_xla_tensor_6; 111s local 2024-12-18T01:13:42.9092356Z 2024-12-18T01:13:42.9093147Z  2024-12-18T01:13:42.9093708Z  2024-12-18T01:13:42.9094886Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:42.9096136Z Testing //test/cpp:test_tensor; 112s local 2024-12-18T01:13:42.9097129Z Testing //test/cpp:test_aten_xla_tensor_6; 111s local 2024-12-18T01:13:43.9304307Z 2024-12-18T01:13:43.9305234Z  2024-12-18T01:13:43.9305717Z  2024-12-18T01:13:43.9306803Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:43.9307706Z Testing //test/cpp:test_tensor; 113s local 2024-12-18T01:13:43.9308375Z Testing //test/cpp:test_aten_xla_tensor_6; 112s local 2024-12-18T01:13:44.9309380Z 2024-12-18T01:13:44.9310120Z  2024-12-18T01:13:44.9310562Z  2024-12-18T01:13:44.9311575Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:44.9312971Z Testing //test/cpp:test_tensor; 114s local 2024-12-18T01:13:44.9313803Z Testing //test/cpp:test_aten_xla_tensor_6; 113s local 2024-12-18T01:13:46.1315353Z 2024-12-18T01:13:46.1316159Z  2024-12-18T01:13:46.1316626Z  2024-12-18T01:13:46.1317584Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:46.1318565Z Testing //test/cpp:test_tensor; 115s local 2024-12-18T01:13:46.1319325Z Testing //test/cpp:test_aten_xla_tensor_6; 115s local 2024-12-18T01:13:47.1320483Z 2024-12-18T01:13:47.1321310Z  2024-12-18T01:13:47.1321770Z  2024-12-18T01:13:47.1322662Z [20,614 / 20,616] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2024-12-18T01:13:47.1323593Z Testing //test/cpp:test_tensor; 116s local 2024-12-18T01:13:47.1324292Z Testing //test/cpp:test_aten_xla_tensor_6; 116s local 2024-12-18T01:13:47.4546830Z 2024-12-18T01:13:47.4547508Z  2024-12-18T01:13:47.4547887Z  2024-12-18T01:13:47.4548444Z [20,614 / 20,616] 16 / 17 tests; 2 actions running; last test: ...:test_tensor 2024-12-18T01:13:47.4549033Z Testing //test/cpp:test_tensor; 116s local 2024-12-18T01:13:47.4549490Z Testing //test/cpp:test_aten_xla_tensor_6; 116s local 2024-12-18T01:13:47.7324476Z 2024-12-18T01:13:47.7325233Z  2024-12-18T01:13:47.7325671Z  2024-12-18T01:13:47.7326596Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:47.7327553Z Testing //test/cpp:test_aten_xla_tensor_6; 116s local 2024-12-18T01:13:48.7329818Z 2024-12-18T01:13:48.7330552Z  2024-12-18T01:13:48.7331505Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:48.7332480Z Testing //test/cpp:test_aten_xla_tensor_6; 117s local 2024-12-18T01:13:49.7337887Z 2024-12-18T01:13:49.7338646Z  2024-12-18T01:13:49.7339288Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:49.7339859Z Testing //test/cpp:test_aten_xla_tensor_6; 118s local 2024-12-18T01:13:50.9340503Z 2024-12-18T01:13:50.9341257Z  2024-12-18T01:13:50.9342198Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:50.9343368Z Testing //test/cpp:test_aten_xla_tensor_6; 119s local 2024-12-18T01:13:51.9344414Z 2024-12-18T01:13:51.9345023Z  2024-12-18T01:13:51.9345957Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:51.9346909Z Testing //test/cpp:test_aten_xla_tensor_6; 120s local 2024-12-18T01:13:53.1349341Z 2024-12-18T01:13:53.1349983Z  2024-12-18T01:13:53.1350908Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:53.1351845Z Testing //test/cpp:test_aten_xla_tensor_6; 122s local 2024-12-18T01:13:54.1353957Z 2024-12-18T01:13:54.1354547Z  2024-12-18T01:13:54.1355471Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:54.1356419Z Testing //test/cpp:test_aten_xla_tensor_6; 123s local 2024-12-18T01:13:55.3359926Z 2024-12-18T01:13:55.3360665Z  2024-12-18T01:13:55.3361839Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:55.3362802Z Testing //test/cpp:test_aten_xla_tensor_6; 124s local 2024-12-18T01:13:56.3369092Z 2024-12-18T01:13:56.3369765Z  2024-12-18T01:13:56.3370355Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:56.3370948Z Testing //test/cpp:test_aten_xla_tensor_6; 125s local 2024-12-18T01:13:57.5377986Z 2024-12-18T01:13:57.5378619Z  2024-12-18T01:13:57.5379222Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:57.5379793Z Testing //test/cpp:test_aten_xla_tensor_6; 126s local 2024-12-18T01:13:58.5381520Z 2024-12-18T01:13:58.5382183Z  2024-12-18T01:13:58.5382786Z [20,615 / 20,616] 16 / 17 tests; 1 action; last test: //test/cpp:test_tensor 2024-12-18T01:13:58.5383378Z Testing //test/cpp:test_aten_xla_tensor_6; 127s local 2024-12-18T01:13:58.7411820Z 2024-12-18T01:13:58.7413534Z  2024-12-18T01:13:58.7414341Z [20,615 / 20,616] 17 / 17 tests; 1 action; last test: ...st_aten_xla_tensor_6 2024-12-18T01:13:58.7415121Z Testing //test/cpp:test_aten_xla_tensor_6; 127s local 2024-12-18T01:13:58.8484433Z 2024-12-18T01:13:58.8485194Z  2024-12-18T01:13:58.8485800Z INFO: Elapsed time: 1777.533s, Critical Path: 341.01s 2024-12-18T01:13:58.8486519Z [20,616 / 20,616] 17 / 17 tests; checking cached actions; last test: ...nsor_6 2024-12-18T01:13:58.8486929Z 2024-12-18T01:13:58.8487191Z INFO: 20616 processes: 9266 internal, 11350 local. 2024-12-18T01:13:58.8495161Z [20,616 / 20,616] 17 / 17 tests; checking cached actions; last test: ...nsor_6 2024-12-18T01:13:58.8496047Z 2024-12-18T01:13:58.8496750Z INFO: Build completed successfully, 20616 total actions 2024-12-18T01:13:58.8619720Z //test/cpp:test_aten_xla_tensor_1 PASSED in 100.3s 2024-12-18T01:13:58.8621237Z //test/cpp:test_aten_xla_tensor_2 PASSED in 80.3s 2024-12-18T01:13:58.8622671Z //test/cpp:test_aten_xla_tensor_3 PASSED in 78.9s 2024-12-18T01:13:58.8624091Z //test/cpp:test_aten_xla_tensor_4 PASSED in 75.9s 2024-12-18T01:13:58.8625219Z //test/cpp:test_aten_xla_tensor_5 PASSED in 70.8s 2024-12-18T01:13:58.8626465Z //test/cpp:test_aten_xla_tensor_6 PASSED in 127.8s 2024-12-18T01:13:58.8627620Z //test/cpp:test_ir PASSED in 1.0s 2024-12-18T01:13:58.8628923Z //test/cpp:test_lazy PASSED in 1.0s 2024-12-18T01:13:58.8630098Z //test/cpp:test_replication PASSED in 0.8s 2024-12-18T01:13:58.8631446Z //test/cpp:test_tensor PASSED in 116.7s 2024-12-18T01:13:58.8632972Z //test/cpp:test_xla_sharding PASSED in 1.0s 2024-12-18T01:13:58.8634379Z //torch_xla/csrc/runtime:cache_test PASSED in 0.8s 2024-12-18T01:13:58.8635693Z //torch_xla/csrc/runtime:env_hash_test PASSED in 0.8s 2024-12-18T01:13:58.8637120Z //torch_xla/csrc/runtime:pjrt_computation_client_test PASSED in 0.9s 2024-12-18T01:13:58.8638526Z //torch_xla/csrc/runtime:sys_util_test PASSED in 0.0s 2024-12-18T01:13:58.8639927Z //torch_xla/csrc/runtime:util_test PASSED in 0.1s 2024-12-18T01:13:58.8641161Z //torch_xla/csrc/runtime:xla_util_test PASSED in 0.7s 2024-12-18T01:13:58.8643690Z 2024-12-18T01:13:58.8644001Z Executed 17 out of 17 tests: 17 tests pass. 2024-12-18T01:13:58.8645216Z There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. 2024-12-18T01:13:58.8687594Z + popd 2024-12-18T01:13:58.8687989Z /var/lib/jenkins/workspace 2024-12-18T01:13:58.8688384Z + run_torch_xla_benchmark_tests /var/lib/jenkins/workspace/xla 2024-12-18T01:13:58.8688821Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2024-12-18T01:13:58.8689174Z + pushd /var/lib/jenkins/workspace/xla 2024-12-18T01:13:58.8689578Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2024-12-18T01:13:58.8689993Z + echo 'Running Benchmark Tests' 2024-12-18T01:13:58.8690309Z Running Benchmark Tests 2024-12-18T01:13:58.8690601Z + test/benchmarks/run_tests.sh -L 2024-12-18T01:13:58.8702868Z /bin/bash: /opt/conda/lib/libtinfo.so.6: no version information available (required by /bin/bash) 2024-12-18T01:13:58.8721653Z +++ dirname test/benchmarks/run_tests.sh 2024-12-18T01:13:58.8727165Z ++ cd test/benchmarks 2024-12-18T01:13:58.8727455Z ++ pwd -P 2024-12-18T01:13:58.8729469Z + CDIR=/var/lib/jenkins/workspace/xla/test/benchmarks 2024-12-18T01:13:58.8729889Z + LOGFILE=/tmp/pytorch_benchmarks_test.log 2024-12-18T01:13:58.8730237Z + VERBOSITY=0 2024-12-18T01:13:58.8730673Z + export PYTHONPATH=:/var/lib/jenkins/workspace/xla/test/benchmarks/../../benchmarks/ 2024-12-18T01:13:58.8731372Z + PYTHONPATH=:/var/lib/jenkins/workspace/xla/test/benchmarks/../../benchmarks/ 2024-12-18T01:13:58.8731879Z + CONTINUE_ON_ERROR=0 2024-12-18T01:13:58.8732138Z + [[ 0 == \1 ]] 2024-12-18T01:13:58.8732382Z + getopts LV: OPTION 2024-12-18T01:13:58.8732629Z + case $OPTION in 2024-12-18T01:13:58.8732875Z + LOGFILE= 2024-12-18T01:13:58.8733104Z + getopts LV: OPTION 2024-12-18T01:13:58.8733361Z + shift 1 2024-12-18T01:13:58.8733585Z + '[' '' '!=' '' ']' 2024-12-18T01:13:58.8733819Z + run_tests 2024-12-18T01:13:58.8734045Z + run_make_tests 2024-12-18T01:13:58.8734281Z + MAKE_V= 2024-12-18T01:13:58.8734497Z + '[' 0 '!=' 0 ']' 2024-12-18T01:13:58.8734837Z + make -C /var/lib/jenkins/workspace/xla/test/benchmarks all 2024-12-18T01:13:58.8777208Z make: Entering directory '/var/lib/jenkins/workspace/xla/test/benchmarks' 2024-12-18T01:13:58.9090471Z AGGREGATE --accelerator=a6000 --test=inference --report=speedup 2024-12-18T01:13:59.4217507Z DIFF a6000.inference.speedup.test 2024-12-18T01:13:59.4290933Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:13:59.4312003Z [?1h= 2024-12-18T01:13:59.4312173Z 2024-12-18T01:13:59.4325730Z [?1l> RM a6000.inference.speedup.test.tmp 2024-12-18T01:13:59.4455752Z AGGREGATE --accelerator=a6000 --test=training --report=latest --backends openxla+lazytensor -- 2024-12-18T01:13:59.8943453Z cannot find data for accelerator a6000 2024-12-18T01:13:59.9402182Z DIFF a6000.training.latest.empty.test 2024-12-18T01:13:59.9419198Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:13:59.9427290Z [?1h= 2024-12-18T01:13:59.9429369Z 2024-12-18T01:13:59.9439935Z [?1l> RM a6000.training.latest.empty.test.tmp 2024-12-18T01:13:59.9567061Z AGGREGATE --accelerator=a6000 --test=training --report=latest 2024-12-18T01:14:00.4524982Z DIFF a6000.training.latest.test 2024-12-18T01:14:00.4540501Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:00.4546018Z [?1h= 2024-12-18T01:14:00.4546166Z 2024-12-18T01:14:00.4555231Z [?1l> RM a6000.training.latest.test.tmp 2024-12-18T01:14:00.4688068Z AGGREGATE --accelerator=v100 --test=inference --report=histogram --backends inductor openxla+lazytensor -- 2024-12-18T01:14:00.9694214Z DIFF v100.inference.histogram.lazytensor.test 2024-12-18T01:14:00.9712736Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:00.9714864Z [?1h= 2024-12-18T01:14:00.9714996Z 2024-12-18T01:14:00.9725549Z [?1l> RM v100.inference.histogram.lazytensor.test.tmp 2024-12-18T01:14:00.9853633Z AGGREGATE --accelerator=v100 --test=inference --report=histogram --backends inductor openxla+lazytensor --format=tab 2024-12-18T01:14:01.4827451Z DIFF v100.inference.histogram.lazytensor_tab.test 2024-12-18T01:14:01.4847402Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:01.4851187Z [?1h= 2024-12-18T01:14:01.4851316Z 2024-12-18T01:14:01.4861017Z [?1l> RM v100.inference.histogram.lazytensor_tab.test.tmp 2024-12-18T01:14:01.5003426Z AGGREGATE --accelerator=v100 --test=inference --report=histogram --format=tab 2024-12-18T01:14:01.9981405Z DIFF v100.inference.histogram.tab.test 2024-12-18T01:14:02.0003295Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:02.0005161Z [?1h= 2024-12-18T01:14:02.0005294Z 2024-12-18T01:14:02.0015470Z [?1l> RM v100.inference.histogram.tab.test.tmp 2024-12-18T01:14:02.0143613Z AGGREGATE --accelerator=v100 --test=inference --report=histogram 2024-12-18T01:14:02.5126233Z DIFF v100.inference.histogram.test 2024-12-18T01:14:02.5141745Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:02.5147126Z [?1h= 2024-12-18T01:14:02.5147301Z 2024-12-18T01:14:02.5156483Z [?1l> RM v100.inference.histogram.test.tmp 2024-12-18T01:14:02.5289599Z AGGREGATE --accelerator=v100 --test=inference --report=latest --backends openxla+dynamo inductor --baseline=latest --filter-by-tier=1 2024-12-18T01:14:03.0226182Z DIFF v100.inference.latest.openxla_baseline.test 2024-12-18T01:14:03.0247305Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:03.0250001Z [?1h= 2024-12-18T01:14:03.0250132Z 2024-12-18T01:14:03.0259645Z [?1l> RM v100.inference.latest.openxla_baseline.test.tmp 2024-12-18T01:14:03.0386193Z AGGREGATE --accelerator=v100 --test=inference --report=latest --backends inductor openxla+dynamo openxla+lazytensor --format=tab 2024-12-18T01:14:03.5375155Z DIFF v100.inference.latest.tab.test 2024-12-18T01:14:03.5394915Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:03.5395764Z [?1h= 2024-12-18T01:14:03.5395908Z 2024-12-18T01:14:03.5404865Z [?1l> RM v100.inference.latest.tab.test.tmp 2024-12-18T01:14:03.5538428Z AGGREGATE --accelerator=v100 --test=inference --report=latest --backends inductor openxla+dynamo openxla+lazytensor -- 2024-12-18T01:14:04.0538337Z DIFF v100.inference.latest.test 2024-12-18T01:14:04.0553235Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:04.0558206Z [?1h= 2024-12-18T01:14:04.0558351Z 2024-12-18T01:14:04.0568412Z [?1l> RM v100.inference.latest.test.tmp 2024-12-18T01:14:04.0699422Z AGGREGATE --accelerator=v100 --test=inference --report=latest --filter-by-tier=1 2024-12-18T01:14:04.5648284Z DIFF v100.inference.latest.tier1.test 2024-12-18T01:14:04.5664362Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:04.5669562Z [?1h= 2024-12-18T01:14:04.5669693Z 2024-12-18T01:14:04.5679791Z [?1l> RM v100.inference.latest.tier1.test.tmp 2024-12-18T01:14:04.5812220Z AGGREGATE --accelerator=v100 --test=inference --report=latest_grouped 2024-12-18T01:14:05.0836969Z DIFF v100.inference.latest_grouped.test 2024-12-18T01:14:05.0851098Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:05.0856105Z [?1h= 2024-12-18T01:14:05.0856246Z 2024-12-18T01:14:05.0865582Z [?1l> RM v100.inference.latest_grouped.test.tmp 2024-12-18T01:14:05.1003929Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --baseline=latest 2024-12-18T01:14:05.5997914Z DIFF v100.inference.speedup.baseline_latest.test 2024-12-18T01:14:05.6015942Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:05.6016933Z [?1h= 2024-12-18T01:14:05.6017062Z 2024-12-18T01:14:05.6026373Z [?1l> RM v100.inference.speedup.baseline_latest.test.tmp 2024-12-18T01:14:05.6155594Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --backends inductor openxla+lazytensor -- 2024-12-18T01:14:06.1198686Z DIFF v100.inference.speedup.lazytensor.test 2024-12-18T01:14:06.1218227Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:06.1220606Z [?1h= 2024-12-18T01:14:06.1220750Z 2024-12-18T01:14:06.1230529Z [?1l> RM v100.inference.speedup.lazytensor.test.tmp 2024-12-18T01:14:06.1361474Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --backends inductor openxla+lazytensor --format=tab 2024-12-18T01:14:06.6352657Z DIFF v100.inference.speedup.lazytensor_tab.test 2024-12-18T01:14:06.6378362Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:06.6380520Z [?1h= 2024-12-18T01:14:06.6380651Z 2024-12-18T01:14:06.6394731Z [?1l> RM v100.inference.speedup.lazytensor_tab.test.tmp 2024-12-18T01:14:06.6526642Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --format=tab 2024-12-18T01:14:07.1540396Z DIFF v100.inference.speedup.tab.test 2024-12-18T01:14:07.1560917Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:07.1563456Z [?1h= 2024-12-18T01:14:07.1563708Z 2024-12-18T01:14:07.1573558Z [?1l> RM v100.inference.speedup.tab.test.tmp 2024-12-18T01:14:07.1701737Z AGGREGATE --accelerator=v100 --test=inference --report=speedup 2024-12-18T01:14:07.6723037Z DIFF v100.inference.speedup.test 2024-12-18T01:14:07.6739218Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2024-12-18T01:14:07.6744091Z [?1h= 2024-12-18T01:14:07.6744443Z 2024-12-18T01:14:07.6753825Z [?1l> RM v100.inference.speedup.test.tmp 2024-12-18T01:14:07.6762783Z make: Leaving directory '/var/lib/jenkins/workspace/xla/test/benchmarks' 2024-12-18T01:14:07.6764982Z + run_python_tests 2024-12-18T01:14:07.6765539Z + pushd /var/lib/jenkins/workspace/xla/test/benchmarks 2024-12-18T01:14:07.6766175Z /var/lib/jenkins/workspace/xla/test/benchmarks /var/lib/jenkins/workspace/xla 2024-12-18T01:14:07.6766704Z + python3 test_experiment_runner.py 2024-12-18T01:14:10.7096974Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2024-12-18T01:14:24.9503570Z .sss.ss 2024-12-18T01:14:24.9503934Z ---------------------------------------------------------------------- 2024-12-18T01:14:24.9504675Z Ran 7 tests in 14.226s 2024-12-18T01:14:24.9504881Z 2024-12-18T01:14:24.9505004Z OK (skipped=5) 2024-12-18T01:14:25.5024914Z + python3 test_benchmark_experiment.py 2024-12-18T01:14:28.5092056Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2024-12-18T01:14:28.5173751Z . 2024-12-18T01:14:28.5174120Z ---------------------------------------------------------------------- 2024-12-18T01:14:28.5174543Z Ran 1 test in 0.006s 2024-12-18T01:14:28.5174707Z 2024-12-18T01:14:28.5174812Z OK 2024-12-18T01:14:29.0580835Z + python3 test_benchmark_model.py 2024-12-18T01:14:32.0405987Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2024-12-18T01:14:32.0419421Z . 2024-12-18T01:14:32.0420079Z ---------------------------------------------------------------------- 2024-12-18T01:14:32.0420499Z Ran 1 test in 0.000s 2024-12-18T01:14:32.0420680Z 2024-12-18T01:14:32.0420775Z OK 2024-12-18T01:14:32.5779045Z + python3 test_result_analyzer.py 2024-12-18T01:14:32.8681614Z .. 2024-12-18T01:14:32.8682030Z ---------------------------------------------------------------------- 2024-12-18T01:14:32.8682449Z Ran 2 tests in 0.004s 2024-12-18T01:14:32.8682640Z 2024-12-18T01:14:32.8682963Z OK 2024-12-18T01:14:32.9027157Z + popd 2024-12-18T01:14:32.9027455Z /var/lib/jenkins/workspace/xla 2024-12-18T01:14:32.9029565Z + assert_git_not_dirty 2024-12-18T01:14:32.9029869Z + [[ linux-focal-py3.9-clang9-xla != *rocm* ]] 2024-12-18T01:14:32.9030262Z + [[ linux-focal-py3.9-clang9-xla != *xla* ]] 2024-12-18T01:14:32.9056420Z + cleanup_workspace 2024-12-18T01:14:32.9057087Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-12-18T01:14:32.9058041Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-12-18T01:14:32.9058755Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-12-18T01:14:32.9059242Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-12-18T01:14:32.9059853Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-12-18T01:14:32.9060535Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-12-18T01:14:32.9061083Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-12-18T01:14:36.7164692Z + sccache_epilogue 2024-12-18T01:14:36.7165093Z + echo '::group::Sccache Compilation Log' 2024-12-18T01:14:36.7165883Z ##[group]Sccache Compilation Log 2024-12-18T01:14:36.7166265Z + echo '=================== sccache compilation log ===================' 2024-12-18T01:14:36.7166702Z =================== sccache compilation log =================== 2024-12-18T01:14:36.7167368Z + python /var/lib/jenkins/workspace/.ci/pytorch/print_sccache_log.py /home/jenkins/sccache_error.log 2024-12-18T01:14:36.7337454Z + echo '=========== If your build fails, please take a look at the log above for possible reasons ===========' 2024-12-18T01:14:36.7338226Z =========== If your build fails, please take a look at the log above for possible reasons =========== 2024-12-18T01:14:36.7338748Z + sccache --show-stats 2024-12-18T01:14:36.7368085Z Compile requests 0 2024-12-18T01:14:36.7368505Z Compile requests executed 0 2024-12-18T01:14:36.7368868Z Cache hits 0 2024-12-18T01:14:36.7369211Z Cache misses 0 2024-12-18T01:14:36.7369619Z Cache timeouts 0 2024-12-18T01:14:36.7369933Z Cache read errors 0 2024-12-18T01:14:36.7370261Z Forced recaches 0 2024-12-18T01:14:36.7370588Z Cache write errors 0 2024-12-18T01:14:36.7371089Z Compilation failures 0 2024-12-18T01:14:36.7371425Z Cache errors 0 2024-12-18T01:14:36.7371753Z Non-cacheable compilations 0 2024-12-18T01:14:36.7372098Z Non-cacheable calls 0 2024-12-18T01:14:36.7372441Z Non-compilation calls 0 2024-12-18T01:14:36.7372784Z Unsupported compiler calls 0 2024-12-18T01:14:36.7373191Z Average cache write 0.000 s 2024-12-18T01:14:36.7373526Z Average cache read miss 0.000 s 2024-12-18T01:14:36.7373877Z Average cache read hit 0.000 s 2024-12-18T01:14:36.7374232Z Failed distributed compilations 0 2024-12-18T01:14:36.7375132Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2024-12-18T01:14:36.7375899Z + sccache --stop-server 2024-12-18T01:14:36.7397411Z Stopping sccache server... 2024-12-18T01:14:36.7397777Z Compile requests 0 2024-12-18T01:14:36.7398145Z Compile requests executed 0 2024-12-18T01:14:36.7398610Z Cache hits 0 2024-12-18T01:14:36.7398942Z Cache misses 0 2024-12-18T01:14:36.7399266Z Cache timeouts 0 2024-12-18T01:14:36.7399579Z Cache read errors 0 2024-12-18T01:14:36.7399906Z Forced recaches 0 2024-12-18T01:14:36.7400238Z Cache write errors 0 2024-12-18T01:14:36.7400571Z Compilation failures 0 2024-12-18T01:14:36.7400966Z Cache errors 0 2024-12-18T01:14:36.7401294Z Non-cacheable compilations 0 2024-12-18T01:14:36.7401637Z Non-cacheable calls 0 2024-12-18T01:14:36.7401976Z Non-compilation calls 0 2024-12-18T01:14:36.7402327Z Unsupported compiler calls 0 2024-12-18T01:14:36.7402675Z Average cache write 0.000 s 2024-12-18T01:14:36.7403014Z Average cache read miss 0.000 s 2024-12-18T01:14:36.7403397Z Average cache read hit 0.000 s 2024-12-18T01:14:36.7403752Z Failed distributed compilations 0 2024-12-18T01:14:36.7404551Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2024-12-18T01:14:36.7405350Z + echo ::endgroup:: 2024-12-18T01:14:36.7405921Z ##[endgroup] 2024-12-18T01:14:36.7406215Z + ccache_epilogue 2024-12-18T01:14:36.7406532Z + ccache --show-stats 2024-12-18T01:14:36.7452201Z cache directory /home/jenkins/.cache/ccache 2024-12-18T01:14:36.7452742Z primary config /home/jenkins/.config/ccache/ccache.conf 2024-12-18T01:14:36.7453240Z secondary config (readonly) /etc/ccache.conf 2024-12-18T01:14:36.7453681Z stats updated Wed Dec 18 00:16:45 2024 2024-12-18T01:14:36.7454120Z stats zeroed Wed Dec 18 00:16:45 2024 2024-12-18T01:14:36.7454520Z cache hit (direct) 0 2024-12-18T01:14:36.7454858Z cache hit (preprocessed) 0 2024-12-18T01:14:36.7455202Z cache miss 0 2024-12-18T01:14:36.7455540Z cache hit rate 0.00 % 2024-12-18T01:14:36.7455889Z cleanups performed 0 2024-12-18T01:14:36.7456230Z files in cache 0 2024-12-18T01:14:36.7456665Z cache size 0.0 kB 2024-12-18T01:14:36.7457011Z max cache size 5.0 GB 2024-12-18T01:14:36.7457357Z + sccache_epilogue 2024-12-18T01:14:36.7457663Z + echo '::group::Sccache Compilation Log' 2024-12-18T01:14:36.7458228Z ##[group]Sccache Compilation Log 2024-12-18T01:14:36.7458602Z + echo '=================== sccache compilation log ===================' 2024-12-18T01:14:36.7459034Z =================== sccache compilation log =================== 2024-12-18T01:14:36.7459651Z + python /var/lib/jenkins/workspace/.ci/pytorch/print_sccache_log.py /home/jenkins/sccache_error.log 2024-12-18T01:14:36.7618065Z + echo '=========== If your build fails, please take a look at the log above for possible reasons ===========' 2024-12-18T01:14:36.7618805Z =========== If your build fails, please take a look at the log above for possible reasons =========== 2024-12-18T01:14:36.7619327Z + sccache --show-stats 2024-12-18T01:14:36.7815269Z Compile requests 0 2024-12-18T01:14:36.7815822Z Compile requests executed 0 2024-12-18T01:14:36.7816179Z Cache hits 0 2024-12-18T01:14:36.7816610Z Cache misses 0 2024-12-18T01:14:36.7816937Z Cache timeouts 0 2024-12-18T01:14:36.7817324Z Cache read errors 0 2024-12-18T01:14:36.7817651Z Forced recaches 0 2024-12-18T01:14:36.7817976Z Cache write errors 0 2024-12-18T01:14:36.7818299Z Compilation failures 0 2024-12-18T01:14:36.7818632Z Cache errors 0 2024-12-18T01:14:36.7818974Z Non-cacheable compilations 0 2024-12-18T01:14:36.7819396Z Non-cacheable calls 0 2024-12-18T01:14:36.7819737Z Non-compilation calls 0 2024-12-18T01:14:36.7820068Z Unsupported compiler calls 0 2024-12-18T01:14:36.7820415Z Average cache write 0.000 s 2024-12-18T01:14:36.7820764Z Average cache read miss 0.000 s 2024-12-18T01:14:36.7821112Z Average cache read hit 0.000 s 2024-12-18T01:14:36.7821510Z Failed distributed compilations 0 2024-12-18T01:14:36.7822306Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2024-12-18T01:14:36.7823095Z + sccache --stop-server 2024-12-18T01:14:36.7841284Z Stopping sccache server... 2024-12-18T01:14:36.7841661Z Compile requests 0 2024-12-18T01:14:36.7842039Z Compile requests executed 0 2024-12-18T01:14:36.7842384Z Cache hits 0 2024-12-18T01:14:36.7842698Z Cache misses 0 2024-12-18T01:14:36.7843024Z Cache timeouts 0 2024-12-18T01:14:36.7843446Z Cache read errors 0 2024-12-18T01:14:36.7843856Z Forced recaches 0 2024-12-18T01:14:36.7844373Z Cache write errors 0 2024-12-18T01:14:36.7844707Z Compilation failures 0 2024-12-18T01:14:36.7845041Z Cache errors 0 2024-12-18T01:14:36.7845387Z Non-cacheable compilations 0 2024-12-18T01:14:36.7845726Z Non-cacheable calls 0 2024-12-18T01:14:36.7846063Z Non-compilation calls 0 2024-12-18T01:14:36.7846394Z Unsupported compiler calls 0 2024-12-18T01:14:36.7846738Z Average cache write 0.000 s 2024-12-18T01:14:36.7847087Z Average cache read miss 0.000 s 2024-12-18T01:14:36.7847432Z Average cache read hit 0.000 s 2024-12-18T01:14:36.7847785Z Failed distributed compilations 0 2024-12-18T01:14:36.7848573Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2024-12-18T01:14:36.7849378Z + echo ::endgroup:: 2024-12-18T01:14:36.7849867Z ##[endgroup] 2024-12-18T01:14:36.7850097Z + ccache_epilogue 2024-12-18T01:14:36.7850357Z + ccache --show-stats 2024-12-18T01:14:36.7896077Z cache directory /home/jenkins/.cache/ccache 2024-12-18T01:14:36.7896757Z primary config /home/jenkins/.config/ccache/ccache.conf 2024-12-18T01:14:36.7897242Z secondary config (readonly) /etc/ccache.conf 2024-12-18T01:14:36.7897670Z stats updated Wed Dec 18 00:16:45 2024 2024-12-18T01:14:36.7898107Z stats zeroed Wed Dec 18 00:16:45 2024 2024-12-18T01:14:36.7898501Z cache hit (direct) 0 2024-12-18T01:14:36.7898974Z cache hit (preprocessed) 0 2024-12-18T01:14:36.7899313Z cache miss 0 2024-12-18T01:14:36.7899637Z cache hit rate 0.00 % 2024-12-18T01:14:36.7899982Z cleanups performed 0 2024-12-18T01:14:36.7900319Z files in cache 0 2024-12-18T01:14:36.7900653Z cache size 0.0 kB 2024-12-18T01:14:36.7901046Z max cache size 5.0 GB 2024-12-18T01:14:36.8101430Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@release/2.6 2024-12-18T01:14:36.8101951Z with: 2024-12-18T01:14:36.8102216Z benchmark-results-dir: test/test-reports 2024-12-18T01:14:36.8102559Z dry-run: false 2024-12-18T01:14:36.8102814Z schema-version: v3 2024-12-18T01:14:36.8103252Z github-token: *** 2024-12-18T01:14:36.8103499Z env: 2024-12-18T01:14:36.8103715Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:36.8104197Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:36.8104723Z ##[endgroup] 2024-12-18T01:14:36.8130032Z ##[group]Run set -eux 2024-12-18T01:14:36.8130302Z set -eux 2024-12-18T01:14:36.8130559Z python3 -mpip install boto3==1.35.33 2024-12-18T01:14:36.8139499Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:36.8139901Z env: 2024-12-18T01:14:36.8140137Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:36.8140674Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:36.8141185Z ##[endgroup] 2024-12-18T01:14:36.8169397Z + python3 -mpip install boto3==1.35.33 2024-12-18T01:14:37.3771891Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T01:14:37.4111450Z Requirement already satisfied: boto3==1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (1.35.33) 2024-12-18T01:14:37.4161119Z Requirement already satisfied: botocore<1.36.0,>=1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (1.35.83) 2024-12-18T01:14:37.4163704Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0) 2024-12-18T01:14:37.4167807Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.4) 2024-12-18T01:14:37.4222574Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10) 2024-12-18T01:14:37.4228065Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.1) 2024-12-18T01:14:37.4267895Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0) 2024-12-18T01:14:37.5428926Z ##[group]Run set -eux 2024-12-18T01:14:37.5429210Z set -eux 2024-12-18T01:14:37.5429444Z  2024-12-18T01:14:37.5429692Z if [[ -z "${GITHUB_TOKEN}" ]]; then 2024-12-18T01:14:37.5430051Z  echo "Missing github-token input" 2024-12-18T01:14:37.5430375Z  exit 1 2024-12-18T01:14:37.5430604Z fi 2024-12-18T01:14:37.5437232Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:37.5437594Z env: 2024-12-18T01:14:37.5437828Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:37.5438296Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:37.5439022Z GITHUB_TOKEN: *** 2024-12-18T01:14:37.5439267Z ##[endgroup] 2024-12-18T01:14:37.5464735Z + [[ -z *** ]] 2024-12-18T01:14:37.5519000Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main 2024-12-18T01:14:37.5519431Z with: 2024-12-18T01:14:37.5519777Z github-token: *** 2024-12-18T01:14:37.5520017Z env: 2024-12-18T01:14:37.5520235Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:37.5520673Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:37.5521238Z ##[endgroup] 2024-12-18T01:14:37.5555907Z ##[group]Run set -eux 2024-12-18T01:14:37.5556183Z set -eux 2024-12-18T01:14:37.5556423Z  2024-12-18T01:14:37.5556927Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-18T01:14:37.5562850Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:37.5563227Z env: 2024-12-18T01:14:37.5563455Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:37.5563928Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:37.5564619Z GITHUB_TOKEN: *** 2024-12-18T01:14:37.5564868Z ##[endgroup] 2024-12-18T01:14:37.5587314Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 12383255652 i-0dcf3a01d7b6a24eb 2024-12-18T01:14:40.5740158Z setting job-id=34566322490 2024-12-18T01:14:40.5740723Z setting job-name=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-18T01:14:40.5862086Z ##[group]Run set -eux 2024-12-18T01:14:40.5862401Z set -eux 2024-12-18T01:14:40.5862671Z  2024-12-18T01:14:40.5863109Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \ 2024-12-18T01:14:40.5863787Z  --schema-version "${SCHEMA_VERSION}" \ 2024-12-18T01:14:40.5864149Z  --repo "${REPO}" \ 2024-12-18T01:14:40.5864467Z  --head-branch "${HEAD_BRANCH}" \ 2024-12-18T01:14:40.5864801Z  --head-sha "${HEAD_SHA}" \ 2024-12-18T01:14:40.5865156Z  --workflow-id "${WORKFLOW_RUN_ID}" \ 2024-12-18T01:14:40.5865523Z  --run-attempt "${RUN_ATTEMPT}" \ 2024-12-18T01:14:40.5865872Z  --job-id "${JOB_ID}" \ 2024-12-18T01:14:40.5866189Z  --job-name "${JOB_NAME}" 2024-12-18T01:14:40.5871840Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:40.5872241Z env: 2024-12-18T01:14:40.5872477Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:40.5872942Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:40.5873446Z SCHEMA_VERSION: v3 2024-12-18T01:14:40.5873708Z REPO: pytorch/pytorch 2024-12-18T01:14:40.5873976Z HEAD_BRANCH: refs/heads/release/2.6 2024-12-18T01:14:40.5874351Z HEAD_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T01:14:40.5874712Z WORKFLOW_RUN_ID: 12383255652 2024-12-18T01:14:40.5874997Z RUN_ATTEMPT: 1 2024-12-18T01:14:40.5875239Z JOB_ID: 34566322490 2024-12-18T01:14:40.5875601Z JOB_NAME: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) 2024-12-18T01:14:40.5876039Z ##[endgroup] 2024-12-18T01:14:40.5902949Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/release/2.6 --head-sha 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 --workflow-id 12383255652 --run-attempt 1 --job-id 34566322490 --job-name 'linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge)' 2024-12-18T01:14:40.6229306Z ##[group]Run set -eux 2024-12-18T01:14:40.6229584Z set -eux 2024-12-18T01:14:40.6229802Z  2024-12-18T01:14:40.6230065Z # TODO (huydhn): Implement this part 2024-12-18T01:14:40.6230444Z echo "runners=[]" >> "${GITHUB_OUTPUT}" 2024-12-18T01:14:40.6235568Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:40.6235948Z env: 2024-12-18T01:14:40.6236172Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:40.6236642Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:40.6237137Z ##[endgroup] 2024-12-18T01:14:40.6259797Z + echo 'runners=[]' 2024-12-18T01:14:40.6283942Z ##[group]Run set -eux 2024-12-18T01:14:40.6286435Z set -eux 2024-12-18T01:14:40.6286769Z  2024-12-18T01:14:40.6287049Z # TODO (huydhn): Implement this part 2024-12-18T01:14:40.6287468Z echo "dependencies={}" >> "${GITHUB_OUTPUT}" 2024-12-18T01:14:40.6292906Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:40.6293441Z env: 2024-12-18T01:14:40.6293675Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:40.6294407Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:40.6294908Z ##[endgroup] 2024-12-18T01:14:40.6316933Z + echo 'dependencies={}' 2024-12-18T01:14:40.6342342Z ##[group]Run set -eux 2024-12-18T01:14:40.6342644Z set -eux 2024-12-18T01:14:40.6342895Z  2024-12-18T01:14:40.6343186Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then 2024-12-18T01:14:40.6343656Z  echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping" 2024-12-18T01:14:40.6344362Z  # We don't want the job to fail if the directory doesn't exist 2024-12-18T01:14:40.6344830Z  exit 0 2024-12-18T01:14:40.6345061Z fi 2024-12-18T01:14:40.6345298Z  2024-12-18T01:14:40.6345560Z if [[ "${DRY_RUN}" == "true" ]]; then 2024-12-18T01:14:40.6346071Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T01:14:40.6346663Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T01:14:40.6347127Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T01:14:40.6347492Z  --runners "${RUNNER_INFO}" \ 2024-12-18T01:14:40.6347870Z  --dependencies "${DEPENDENCIES}" \ 2024-12-18T01:14:40.6348226Z  --dry-run 2024-12-18T01:14:40.6348496Z else 2024-12-18T01:14:40.6348898Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T01:14:40.6349466Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T01:14:40.6349917Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T01:14:40.6350302Z  --runners "${RUNNER_INFO}" \ 2024-12-18T01:14:40.6350671Z  --dependencies "${DEPENDENCIES}" 2024-12-18T01:14:40.6351017Z fi 2024-12-18T01:14:40.6355989Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:40.6356481Z env: 2024-12-18T01:14:40.6356706Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:40.6357169Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:40.6357689Z BENCHMARK_RESULTS_DIR: test/test-reports 2024-12-18T01:14:40.6358034Z DRY_RUN: false 2024-12-18T01:14:40.6359421Z BENCHMARK_METADATA: {"timestamp": 1734484480, "schema_version": "v3", "name": "linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255652, "run_attempt": 1, "job_id": 34566322490} 2024-12-18T01:14:40.6360723Z RUNNER_INFO: [] 2024-12-18T01:14:40.6360952Z DEPENDENCIES: {} 2024-12-18T01:14:40.6361190Z ##[endgroup] 2024-12-18T01:14:40.6381949Z + [[ ! -d test/test-reports ]] 2024-12-18T01:14:40.6382345Z + echo 'test/test-reports does not exist, skipping' 2024-12-18T01:14:40.6382758Z + exit 0 2024-12-18T01:14:40.6383043Z test/test-reports does not exist, skipping 2024-12-18T01:14:40.6419996Z ##[group]Run cat test/**/*_toprint.log || true 2024-12-18T01:14:40.6420388Z cat test/**/*_toprint.log || true 2024-12-18T01:14:40.6425365Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:40.6425771Z env: 2024-12-18T01:14:40.6426010Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:40.6426503Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:40.6427034Z ##[endgroup] 2024-12-18T01:14:40.6491779Z cat: 'test/**/*_toprint.log': No such file or directory 2024-12-18T01:14:40.6526308Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-12-18T01:14:40.6526785Z kill "$MONITOR_SCRIPT_PID" 2024-12-18T01:14:40.6531364Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:40.6531747Z env: 2024-12-18T01:14:40.6531971Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:40.6532430Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:40.6532935Z MONITOR_SCRIPT_PID: 637796 2024-12-18T01:14:40.6533198Z ##[endgroup] 2024-12-18T01:14:40.6687013Z Prepare all required actions 2024-12-18T01:14:40.6687556Z Getting action download info 2024-12-18T01:14:40.8052498Z Download action repository 'actions/upload-artifact@v4' (SHA:6f51ac03b9356f520e9adb1b1b7802705f340c2b) 2024-12-18T01:14:41.1025354Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-12-18T01:14:41.1025733Z with: 2024-12-18T01:14:41.1026034Z file-suffix: test-xla-1-1-linux.12xlarge_34566322490 2024-12-18T01:14:41.1026412Z s3-bucket: gha-artifacts 2024-12-18T01:14:41.1026691Z env: 2024-12-18T01:14:41.1026937Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:41.1027416Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:41.1027941Z ##[endgroup] 2024-12-18T01:14:41.1057823Z ##[group]Run # Remove any previous test jsons if they exist 2024-12-18T01:14:41.1058330Z # Remove any previous test jsons if they exist 2024-12-18T01:14:41.1058708Z rm -f test-jsons-*.zip 2024-12-18T01:14:41.1059205Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json' 2024-12-18T01:14:41.1065174Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:41.1065559Z env: 2024-12-18T01:14:41.1065793Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:41.1066273Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:41.1066853Z FILE_SUFFIX: test-xla-1-1-linux.12xlarge_34566322490 2024-12-18T01:14:41.1067222Z ##[endgroup] 2024-12-18T01:14:41.1111293Z zip warning: name not matched: test/test-reports 2024-12-18T01:14:41.1111758Z zip warning: zip file empty 2024-12-18T01:14:41.1142475Z ##[group]Run # Remove any previous test reports if they exist 2024-12-18T01:14:41.1142963Z # Remove any previous test reports if they exist 2024-12-18T01:14:41.1143357Z rm -f test-reports-*.zip 2024-12-18T01:14:41.1143837Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv' 2024-12-18T01:14:41.1149312Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:41.1149710Z env: 2024-12-18T01:14:41.1149934Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:41.1150409Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:41.1150982Z FILE_SUFFIX: test-xla-1-1-linux.12xlarge_34566322490 2024-12-18T01:14:41.1151343Z ##[endgroup] 2024-12-18T01:14:41.1189925Z zip warning: name not matched: test/test-reports 2024-12-18T01:14:41.1190359Z zip warning: zip file empty 2024-12-18T01:14:41.1235687Z ##[group]Run # Remove any previous usage logs if they exist 2024-12-18T01:14:41.1236398Z # Remove any previous usage logs if they exist 2024-12-18T01:14:41.1237104Z rm -f logs-*.zip 2024-12-18T01:14:41.1237864Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-12-18T01:14:41.1238931Z # so check to see if the file exists first 2024-12-18T01:14:41.1239578Z if [ -f 'usage_log.txt' ]; then 2024-12-18T01:14:41.1240116Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-12-18T01:14:41.1240724Z fi 2024-12-18T01:14:41.1241357Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then 2024-12-18T01:14:41.1242293Z  zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log' 2024-12-18T01:14:41.1242874Z fi 2024-12-18T01:14:41.1250787Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:41.1251423Z env: 2024-12-18T01:14:41.1251978Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:41.1252755Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:41.1253748Z FILE_SUFFIX: test-xla-1-1-linux.12xlarge_34566322490 2024-12-18T01:14:41.1254332Z ##[endgroup] 2024-12-18T01:14:41.1330663Z adding: usage_log.txt (deflated 92%) 2024-12-18T01:14:41.1378425Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-12-18T01:14:41.1379113Z # Remove any previous debugging artifacts if they exist 2024-12-18T01:14:41.1379543Z rm -f debug-*.zip 2024-12-18T01:14:41.1379834Z if [ -d 'test/debug' ]; then 2024-12-18T01:14:41.1380214Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-12-18T01:14:41.1380581Z fi 2024-12-18T01:14:41.1385384Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:41.1385781Z env: 2024-12-18T01:14:41.1386013Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:41.1386488Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:41.1387086Z FILE_SUFFIX: test-xla-1-1-linux.12xlarge_34566322490 2024-12-18T01:14:41.1387457Z ##[endgroup] 2024-12-18T01:14:41.1469694Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T01:14:41.1470048Z with: 2024-12-18T01:14:41.1470276Z s3-bucket: gha-artifacts 2024-12-18T01:14:41.1470620Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T01:14:41.1471007Z retention-days: 14 2024-12-18T01:14:41.1471386Z if-no-files-found: warn 2024-12-18T01:14:41.1471671Z path: test-jsons-*.zip 2024-12-18T01:14:41.1471923Z name: artifact 2024-12-18T01:14:41.1472165Z region: us-east-1 2024-12-18T01:14:41.1472405Z env: 2024-12-18T01:14:41.1472627Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:41.1473098Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:41.1473588Z ##[endgroup] 2024-12-18T01:14:41.5061165Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T01:14:41.5061671Z With the provided path, there will be 1 file uploaded 2024-12-18T01:14:41.5062154Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T01:14:41.5105709Z Starting upload of test-jsons-test-xla-1-1-linux.12xlarge_34566322490.zip 2024-12-18T01:14:41.6110764Z Finished upload of test-jsons-test-xla-1-1-linux.12xlarge_34566322490.zip 2024-12-18T01:14:41.6318974Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T01:14:41.6319312Z with: 2024-12-18T01:14:41.6319524Z s3-bucket: gha-artifacts 2024-12-18T01:14:41.6319847Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T01:14:41.6320359Z retention-days: 14 2024-12-18T01:14:41.6320629Z if-no-files-found: error 2024-12-18T01:14:41.6320922Z path: test-reports-*.zip 2024-12-18T01:14:41.6321183Z name: artifact 2024-12-18T01:14:41.6321424Z region: us-east-1 2024-12-18T01:14:41.6321664Z env: 2024-12-18T01:14:41.6322431Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:41.6322902Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:41.6323410Z ##[endgroup] 2024-12-18T01:14:41.9473206Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T01:14:41.9473725Z With the provided path, there will be 1 file uploaded 2024-12-18T01:14:41.9474216Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T01:14:41.9511331Z Starting upload of test-reports-test-xla-1-1-linux.12xlarge_34566322490.zip 2024-12-18T01:14:42.0564987Z Finished upload of test-reports-test-xla-1-1-linux.12xlarge_34566322490.zip 2024-12-18T01:14:42.0784411Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T01:14:42.0784740Z with: 2024-12-18T01:14:42.0784966Z s3-bucket: gha-artifacts 2024-12-18T01:14:42.0785284Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T01:14:42.0785615Z retention-days: 14 2024-12-18T01:14:42.0785870Z if-no-files-found: ignore 2024-12-18T01:14:42.0786141Z path: logs-*.zip 2024-12-18T01:14:42.0786378Z name: artifact 2024-12-18T01:14:42.0786767Z region: us-east-1 2024-12-18T01:14:42.0786985Z env: 2024-12-18T01:14:42.0787199Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:42.0787652Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:42.0788138Z ##[endgroup] 2024-12-18T01:14:42.3925483Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T01:14:42.3926762Z With the provided path, there will be 1 file uploaded 2024-12-18T01:14:42.3927308Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T01:14:42.3964313Z Starting upload of logs-test-xla-1-1-linux.12xlarge_34566322490.zip 2024-12-18T01:14:42.5476632Z Finished upload of logs-test-xla-1-1-linux.12xlarge_34566322490.zip 2024-12-18T01:14:42.5688789Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T01:14:42.5689245Z with: 2024-12-18T01:14:42.5689460Z s3-bucket: gha-artifacts 2024-12-18T01:14:42.5689966Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T01:14:42.5690361Z retention-days: 14 2024-12-18T01:14:42.5690640Z if-no-files-found: ignore 2024-12-18T01:14:42.5691106Z path: debug-*.zip 2024-12-18T01:14:42.5691348Z name: artifact 2024-12-18T01:14:42.5691601Z region: us-east-1 2024-12-18T01:14:42.5691850Z env: 2024-12-18T01:14:42.5692086Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:42.5692574Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:42.5693091Z ##[endgroup] 2024-12-18T01:14:42.8805383Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-12-18T01:14:42.9005862Z ##[group]Run # shellcheck disable=SC2156 2024-12-18T01:14:42.9006253Z # shellcheck disable=SC2156 2024-12-18T01:14:42.9006852Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-12-18T01:14:42.9013267Z shell: /usr/bin/bash -e {0} 2024-12-18T01:14:42.9013544Z env: 2024-12-18T01:14:42.9013761Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:42.9014226Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:42.9014696Z ##[endgroup] 2024-12-18T01:14:43.1252831Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@release/2.6 2024-12-18T01:14:43.1253358Z with: 2024-12-18T01:14:43.1253589Z env: 2024-12-18T01:14:43.1253809Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:43.1254331Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:43.1254865Z ##[endgroup] 2024-12-18T01:14:43.1278827Z ##[group]Run set -eou pipefail 2024-12-18T01:14:43.1279160Z set -eou pipefail 2024-12-18T01:14:43.1279443Z  2024-12-18T01:14:43.1279827Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-12-18T01:14:43.1280306Z for _ in $(seq 1440); do 2024-12-18T01:14:43.1280641Z  # Break if no ssh session exists anymore 2024-12-18T01:14:43.1281003Z  if [ "$(who)" = "" ]; then 2024-12-18T01:14:43.1281330Z  break 2024-12-18T01:14:43.1281578Z  fi 2024-12-18T01:14:43.1281952Z  echo "." 2024-12-18T01:14:43.1282198Z  sleep 5 2024-12-18T01:14:43.1282424Z done 2024-12-18T01:14:43.1287299Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:43.1287671Z env: 2024-12-18T01:14:43.1287886Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:43.1288332Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:43.1288816Z ##[endgroup] 2024-12-18T01:14:43.1309947Z Holding runner for 2 hours until all ssh sessions have logged out 2024-12-18T01:14:43.1362944Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T01:14:43.1363513Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T01:14:43.1363957Z # shellcheck disable=SC2046 2024-12-18T01:14:43.1364291Z docker stop $(docker ps -q) || true 2024-12-18T01:14:43.1364779Z # Prune all of the docker images 2024-12-18T01:14:43.1365122Z docker system prune -af 2024-12-18T01:14:43.1370008Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:14:43.1370379Z env: 2024-12-18T01:14:43.1370595Z GIT_DEFAULT_BRANCH: main 2024-12-18T01:14:43.1371041Z DOCKER_CONTAINER_ID: a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:14:43.1371523Z ##[endgroup] 2024-12-18T01:14:54.4981112Z a9d01d962683 2024-12-18T01:15:02.6485589Z Deleted Containers: 2024-12-18T01:15:02.6486080Z a9d01d96268354ff410c42278caebf967d4f400e908f849cb7fac1ee69c8125c 2024-12-18T01:15:02.6486432Z 2024-12-18T01:15:08.7689680Z Deleted Images: 2024-12-18T01:15:08.7690833Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2024-12-18T01:15:08.7691874Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base@sha256:9d335f45f6e71fbb6ae402124a4084895d94a26118fc11ddd5d654d4fdd009e9 2024-12-18T01:15:08.7692854Z deleted: sha256:cf27a324d40a0113eed6566aaff9ac3dc962999a9bd00a53137bed1837a9bbf1 2024-12-18T01:15:08.7693560Z deleted: sha256:66f91d1624bf98cebb5084cdf6636bf3b4a4f38a0b03bb0f818552a1543a3b59 2024-12-18T01:15:08.7694242Z deleted: sha256:3cb34579f1fcca3dcfbca645880d94f0dd3cc7e952d58d268b5b7c4bef7efd3d 2024-12-18T01:15:08.7694926Z deleted: sha256:49ba1da429f5eb406bb26b58c656dc62cb9fb334b8a9d1ec5e9ef9c1da331b78 2024-12-18T01:15:08.7695592Z deleted: sha256:16378cad1870166316b7cca6510e46d19eee6ddf0ebbed12f4a3270729ee5eb6 2024-12-18T01:15:08.7696264Z deleted: sha256:bb088b55a4e6262f33b74f61baea1f49585e0caf6a50d65b0b3b62c84d88187e 2024-12-18T01:15:08.7697037Z deleted: sha256:3812041c235c5f1c5a0c63a7690ba5cea5d2b3d0a7d9ca29158ea0adc714fcaf 2024-12-18T01:15:08.7697710Z deleted: sha256:cecc415258a7d695e962d85e927075149a7904da70ef215c0cc3c9710509ccdd 2024-12-18T01:15:08.7698385Z deleted: sha256:aacad8b1ed87eec1776b2763c1f1c910f2647daf22acc5698f07f71b94b0dd90 2024-12-18T01:15:08.7699092Z deleted: sha256:0fc74d85c1ceaade06a46ec7a0c0f22ebf9958ff6136f36ca75407349acbf951 2024-12-18T01:15:08.7700039Z deleted: sha256:15e081c23ce0d7e11a14387f974a7258e112f1ec2dbca3b4216c5651c7d1f122 2024-12-18T01:15:08.7700714Z deleted: sha256:73767943ca8caa72ea3b9b5a2298afdcb1c5f92c8e84a179e1df33bcab628795 2024-12-18T01:15:08.7701395Z deleted: sha256:bf6a980b53b6e2be7b000ace52b8314e984056c0b6a2d21ae9ffb359df3d12e7 2024-12-18T01:15:08.7702070Z deleted: sha256:da064ea3b3fe001d13df9bf955154b565110f70b789e28ddd345107acc9a6f0d 2024-12-18T01:15:08.7702739Z deleted: sha256:47e28631a1576b7519ece8e679ff534e194bd35b4f4887ccb98eccdd46f8a467 2024-12-18T01:15:08.7703419Z deleted: sha256:be6abd4fafd5a39fbb823164c54e47854c7c657283c1d3e204ddc6af120ab16f 2024-12-18T01:15:08.7704194Z deleted: sha256:f9ba405b63e9d7a8be16759a11618137ea90239a667534fff43b956780d00a5a 2024-12-18T01:15:08.7704874Z deleted: sha256:df8b7b5edfea9425fe770bcbb02ec04804d7e689ba5769fc6378c7426eb4db21 2024-12-18T01:15:08.7705558Z deleted: sha256:7824b166d7566ed77fa8089b273e857a42caadb63551ebaa18bacbcb7cbcd8e5 2024-12-18T01:15:08.7706239Z deleted: sha256:417529c8d7d279cf9213a0b576964e3af5f8a6f2350a7097733593e996fe43cd 2024-12-18T01:15:08.7706915Z deleted: sha256:afdf127c6ec441b6ff18b6fcd92ecb5fa8a315cc8b92625d11f39ca734ca7551 2024-12-18T01:15:08.7707606Z deleted: sha256:d7dcb562d63e6db420964dbd3e17ee0c6b42c030e3a0995c5604aaf586e03d1e 2024-12-18T01:15:08.7708269Z deleted: sha256:dfc6ad964b17dc0c7e0bd237e86b189532de931936a76c2924619b010d6f22f8 2024-12-18T01:15:08.7708942Z deleted: sha256:3c6ad48d1c3fc46b88d054d6ce1065af3ad10a3622425cc726a60f2172ac2745 2024-12-18T01:15:08.7709618Z deleted: sha256:422a71c440bb5d5bae851958fb1e3f72ff59f134fe683b5e875cac2f99fc8ff1 2024-12-18T01:15:08.7710298Z deleted: sha256:c6ceefd1ce554cbe655cca8b65076389e35cd4673c56944c5acd4590dc9f0d43 2024-12-18T01:15:08.7710972Z deleted: sha256:80fdd624232f43db3213a19006ffe87df2f6354210467b1d81554efe4117ea5b 2024-12-18T01:15:08.7711653Z deleted: sha256:3aae0d66ede19deeac27b3409cc650add8f80a168c94adf3db6bd98dc16eded9 2024-12-18T01:15:08.7712479Z deleted: sha256:60633fccee0d1774fc4959ef90484d9dbb4e2a2d7aec6d2ba5feacbe6abebce5 2024-12-18T01:15:08.7713170Z deleted: sha256:a0220fdcabca5d037251b0afb85b798fdf430f987c2398283fa542899e0ffcd2 2024-12-18T01:15:08.7713852Z deleted: sha256:e3ead3a94e61fd2b95c1378b922d1f10da30ea1fe76c9e31f31ea80f9b02b80f 2024-12-18T01:15:08.7714534Z deleted: sha256:59d52bac3d44e2ec27d1f7ec5c0a771877e7df5352777cbdfd236b6360fe2a04 2024-12-18T01:15:08.7715213Z deleted: sha256:7b329afd97eb4c8a9f81c95a2d2d416de77859f73cb1540dcad0fdc1ee1167f6 2024-12-18T01:15:08.7715612Z 2024-12-18T01:15:08.7715750Z Total reclaimed space: 29.79GB 2024-12-18T01:15:08.7783263Z Post job cleanup. 2024-12-18T01:15:08.7830392Z Post job cleanup. 2024-12-18T01:15:08.8594432Z [command]/usr/bin/git version 2024-12-18T01:15:08.8645899Z git version 2.40.1 2024-12-18T01:15:08.8687355Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/3a7c849f-5c44-4f78-bcea-8912f05d7f45' before making global git config changes 2024-12-18T01:15:08.8688395Z Adding repository directory to the temporary git global config as a safe directory 2024-12-18T01:15:08.8689557Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T01:15:08.8715524Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-18T01:15:08.8739890Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-18T01:15:08.9035486Z Entering 'android/libs/fbjni' 2024-12-18T01:15:08.9088305Z Entering 'third_party/FP16' 2024-12-18T01:15:08.9144080Z Entering 'third_party/FXdiv' 2024-12-18T01:15:08.9195772Z Entering 'third_party/NNPACK' 2024-12-18T01:15:08.9246640Z Entering 'third_party/NVTX' 2024-12-18T01:15:08.9298657Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T01:15:08.9349632Z Entering 'third_party/XNNPACK' 2024-12-18T01:15:08.9417939Z Entering 'third_party/benchmark' 2024-12-18T01:15:08.9467738Z Entering 'third_party/composable_kernel' 2024-12-18T01:15:08.9524569Z Entering 'third_party/cpp-httplib' 2024-12-18T01:15:08.9578418Z Entering 'third_party/cpuinfo' 2024-12-18T01:15:08.9633286Z Entering 'third_party/cudnn_frontend' 2024-12-18T01:15:08.9687946Z Entering 'third_party/cutlass' 2024-12-18T01:15:08.9745954Z Entering 'third_party/eigen' 2024-12-18T01:15:08.9800767Z Entering 'third_party/fbgemm' 2024-12-18T01:15:08.9851644Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T01:15:08.9904635Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T01:15:08.9953657Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T01:15:09.0011260Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T01:15:09.0059529Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T01:15:09.0121296Z Entering 'third_party/flatbuffers' 2024-12-18T01:15:09.0175735Z Entering 'third_party/fmt' 2024-12-18T01:15:09.0224505Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T01:15:09.0275502Z Entering 'third_party/gloo' 2024-12-18T01:15:09.0326963Z Entering 'third_party/googletest' 2024-12-18T01:15:09.0381286Z Entering 'third_party/ideep' 2024-12-18T01:15:09.0434246Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T01:15:09.0491310Z Entering 'third_party/ittapi' 2024-12-18T01:15:09.0540210Z Entering 'third_party/kineto' 2024-12-18T01:15:09.0593409Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T01:15:09.0643893Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T01:15:09.0697470Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T01:15:09.0745929Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T01:15:09.0796672Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T01:15:09.0846413Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T01:15:09.0898179Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T01:15:09.0949805Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T01:15:09.1002562Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T01:15:09.1052808Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T01:15:09.1104227Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T01:15:09.1153295Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T01:15:09.1205913Z Entering 'third_party/mimalloc' 2024-12-18T01:15:09.1254442Z Entering 'third_party/nccl/nccl' 2024-12-18T01:15:09.1305098Z Entering 'third_party/nlohmann' 2024-12-18T01:15:09.1360427Z Entering 'third_party/onnx' 2024-12-18T01:15:09.1425909Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T01:15:09.1480493Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T01:15:09.1532380Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T01:15:09.1580665Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T01:15:09.1631365Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T01:15:09.1680355Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T01:15:09.1731573Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T01:15:09.1785740Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T01:15:09.1836138Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T01:15:09.1892438Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T01:15:09.1941992Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T01:15:09.1998942Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T01:15:09.2071228Z Entering 'third_party/pocketfft' 2024-12-18T01:15:09.2120344Z Entering 'third_party/protobuf' 2024-12-18T01:15:09.2175068Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T01:15:09.2222558Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T01:15:09.2277124Z Entering 'third_party/psimd' 2024-12-18T01:15:09.2326684Z Entering 'third_party/pthreadpool' 2024-12-18T01:15:09.2378758Z Entering 'third_party/pybind11' 2024-12-18T01:15:09.2432918Z Entering 'third_party/python-peachpy' 2024-12-18T01:15:09.2489803Z Entering 'third_party/sleef' 2024-12-18T01:15:09.2538749Z Entering 'third_party/tensorpipe' 2024-12-18T01:15:09.2595772Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T01:15:09.2645678Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T01:15:09.2694978Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T01:15:09.2742688Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T01:15:09.2794795Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T01:15:09.2860652Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-18T01:15:09.2877820Z http.https://github.com/.extraheader 2024-12-18T01:15:09.2884818Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-12-18T01:15:09.2912432Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-18T01:15:09.3191718Z Entering 'android/libs/fbjni' 2024-12-18T01:15:09.3224555Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3257102Z Entering 'third_party/FP16' 2024-12-18T01:15:09.3292071Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3330812Z Entering 'third_party/FXdiv' 2024-12-18T01:15:09.3366422Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3397765Z Entering 'third_party/NNPACK' 2024-12-18T01:15:09.3432290Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3462309Z Entering 'third_party/NVTX' 2024-12-18T01:15:09.3497264Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3529593Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T01:15:09.3564002Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3596701Z Entering 'third_party/XNNPACK' 2024-12-18T01:15:09.3631376Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3680466Z Entering 'third_party/benchmark' 2024-12-18T01:15:09.3718234Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3749938Z Entering 'third_party/composable_kernel' 2024-12-18T01:15:09.3786682Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3831296Z Entering 'third_party/cpp-httplib' 2024-12-18T01:15:09.3864542Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3897799Z Entering 'third_party/cpuinfo' 2024-12-18T01:15:09.3933111Z http.https://github.com/.extraheader 2024-12-18T01:15:09.3965462Z Entering 'third_party/cudnn_frontend' 2024-12-18T01:15:09.3999354Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4031384Z Entering 'third_party/cutlass' 2024-12-18T01:15:09.4064139Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4103775Z Entering 'third_party/eigen' 2024-12-18T01:15:09.4138234Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4171558Z Entering 'third_party/fbgemm' 2024-12-18T01:15:09.4206188Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4238653Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T01:15:09.4271205Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4302335Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T01:15:09.4337426Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4370914Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T01:15:09.4404910Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4444547Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T01:15:09.4478529Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4515159Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T01:15:09.4546831Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4579918Z Entering 'third_party/flatbuffers' 2024-12-18T01:15:09.4616623Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4658555Z Entering 'third_party/fmt' 2024-12-18T01:15:09.4692163Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4724868Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T01:15:09.4759794Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4795665Z Entering 'third_party/gloo' 2024-12-18T01:15:09.4831490Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4862090Z Entering 'third_party/googletest' 2024-12-18T01:15:09.4896417Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4932156Z Entering 'third_party/ideep' 2024-12-18T01:15:09.4966094Z http.https://github.com/.extraheader 2024-12-18T01:15:09.4996618Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T01:15:09.5030054Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5076272Z Entering 'third_party/ittapi' 2024-12-18T01:15:09.5110708Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5141240Z Entering 'third_party/kineto' 2024-12-18T01:15:09.5175952Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5209684Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T01:15:09.5243539Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5277858Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T01:15:09.5310605Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5347726Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T01:15:09.5380476Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5418235Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T01:15:09.5454095Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5487991Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T01:15:09.5525638Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5559820Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T01:15:09.5593756Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5636277Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T01:15:09.5671615Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5703401Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T01:15:09.5738125Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5775975Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T01:15:09.5808957Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5842592Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T01:15:09.5876542Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5911189Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T01:15:09.5948516Z http.https://github.com/.extraheader 2024-12-18T01:15:09.5983842Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T01:15:09.6018261Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6054291Z Entering 'third_party/mimalloc' 2024-12-18T01:15:09.6088984Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6120943Z Entering 'third_party/nccl/nccl' 2024-12-18T01:15:09.6154566Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6192568Z Entering 'third_party/nlohmann' 2024-12-18T01:15:09.6227983Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6261411Z Entering 'third_party/onnx' 2024-12-18T01:15:09.6296149Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6346980Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T01:15:09.6380560Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6419034Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T01:15:09.6453381Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6487291Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T01:15:09.6520531Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6555987Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T01:15:09.6592099Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6628026Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T01:15:09.6661477Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6697957Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T01:15:09.6731219Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6764790Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T01:15:09.6797335Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6833494Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T01:15:09.6868290Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6898777Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T01:15:09.6932688Z http.https://github.com/.extraheader 2024-12-18T01:15:09.6965417Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T01:15:09.6997894Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7037626Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T01:15:09.7072465Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7105432Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T01:15:09.7138283Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7191201Z Entering 'third_party/pocketfft' 2024-12-18T01:15:09.7225077Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7265681Z Entering 'third_party/protobuf' 2024-12-18T01:15:09.7299194Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7337089Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T01:15:09.7371284Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7408420Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T01:15:09.7442840Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7489892Z Entering 'third_party/psimd' 2024-12-18T01:15:09.7528270Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7560914Z Entering 'third_party/pthreadpool' 2024-12-18T01:15:09.7595002Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7626586Z Entering 'third_party/pybind11' 2024-12-18T01:15:09.7660503Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7698477Z Entering 'third_party/python-peachpy' 2024-12-18T01:15:09.7733187Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7764655Z Entering 'third_party/sleef' 2024-12-18T01:15:09.7798996Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7832401Z Entering 'third_party/tensorpipe' 2024-12-18T01:15:09.7864315Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7900743Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T01:15:09.7936144Z http.https://github.com/.extraheader 2024-12-18T01:15:09.7968860Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T01:15:09.8002185Z http.https://github.com/.extraheader 2024-12-18T01:15:09.8034761Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T01:15:09.8066670Z http.https://github.com/.extraheader 2024-12-18T01:15:09.8102168Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T01:15:09.8136731Z http.https://github.com/.extraheader 2024-12-18T01:15:09.8169275Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T01:15:09.8202048Z http.https://github.com/.extraheader 2024-12-18T01:15:09.8322454Z A job completed hook has been configured by the self-hosted runner administrator 2024-12-18T01:15:09.8345072Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-12-18T01:15:09.8350261Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T01:15:09.8350655Z ##[endgroup] 2024-12-18T01:15:20.3702648Z Cleaning up orphan processes